Workers at Twitter Inc.'s Singapore office were told to empty out their desks and vacate the premises, said people familiar with the situation, as Elon Musk continues to pare expenses around the globe.