In another statement, the central bank said penalty on HDFC Bank is for violation of directions on acceptance of deposits from non-residents.