Finance Minister Nirmala Sitharaman has asked public sector banks (PSBs) to take swift action in cases concerning fraud and wilful defaults to reduce bad loans and take steps to accelerate growth momentum, sources said.