Tesla investors have perceived Elon Musk's role at Twitter as a distraction that prevented him from focusing on the car company.