So, today I learned something. Part of my job is to work in Azure(365) and this little bit I never knew but now I know. If you are trying to follow a SP site it will not work unless you are a member of the site. It does not matter if you are a site admin to begin with. That was some annoying banging my head against the wall… not literally of course.