Crews are continuing to battle hot spots after an early-morning house fire in downtown Toronto forced the evacuation of a number of homes.