The Treasury Committee says it is very concerned because tax officials have a history of making mistakes.
Chancellor George Osborne unveiled the plan at this year's Budget.
But in a wide-ranging report, the committee did welcome another Budget plan - to allow greater flexibility on how pension savings can be used.
In the Budget, Mr Osborne outlined plans for new powers for HM Revenue and Customs (HMRC) to recover tax debts from anyone who owes more than £1,000 in tax or in tax credits.
This would allow the tax authority to seize the tax owed directly from debtors' bank accounts.