The rise of multiple modalities of data will be united in a multi-sided view of the world, which could be an important step toward programs that perform "reasoning" and "planning".