Novak Djokovic says it was "not pleasant" to deal with the controversy surrounding his father Srdjan before his Australian Open semi-final victory.