All private sector banks will be allowed to handle government-related banking transactions such as the collection of taxes, pension payments and small savings schemes, the finance ministry announced on Wednesday.