Hugh Grant said on "The Late Show With Stephen Colbert" that actors would be having on-set affairs if mobile phones were banned.