Remote work will end up hurting more than helping