Looks like there was a bit of confusion on my and my friend's part. We got the "bell"-notifications in the app and browser with new activities of others but looks like they are gone now. Maybe a fuckup on Strava's side.
But unchecked that other box you mentioned anyway, so thnx. :)
If push notifications means the app rather than browser, that has a similar option.