What is the biggest impact of remote work on people at startups early in their career?

I am am huge advocate for remote work and have worked on distributed teams for about 15 years now. I do not want to ever go back. However, I am not sure if the younger me would have benefited as much from it as I did from being in the office with my peers and more experienced members of the team. What do you think? Does remote work in startups hurt people early in their career?