Ramiz Raja has accused England of "failing a member of their cricket fraternity" after the joint men's and women's tour of Pakistan next month was cancelled.