Certainly there’s an allure to working outside the office—at least for some remote workers. Freedom seems to be the primary benefit cited. But as the workforce moves ever more toward office-less workers, a growing number are finding there are more drawbacks than benefits to being able to work in your bathrobe.

The Harvard Business Review recently published a study that quizzed more than 1,100 workers, 600 of whom spend part or all of their workday at a remote location, about their experience with this model.

“Overall, remote employees may enjoy the freedom to live and work where they please, but working through and with others becomes more challenging,” said co-authors David Maxfield and Joseph Genny, both of whom have written extensively on business performance issues. “They report that workplace politics are more pervasive and difficult, and when conflicts arise they have a harder time resolving them. When remote members of a team encountered common workplace challenges, 84 percent said the concern dragged on for a few days or more, while 47 percent admitted to letting it drag on for weeks or more.”