Work and Pensions Secretary Iain Duncan Smith has dismissed the Archbishop of Canterbury's claim that benefit changes will drive more children into poverty.
Justin Welby and 43 Anglican bishops have said capping rises on working-age benefits at 1% will hit the vulnerable.
But Mr Duncan Smith told MPs the system was "out of control" and simply "giving more and more money" would not help.
"I always listen to everybody who gives me advice. I don't necessarily follow it," he added.
Archbishop Welby has backed an open letter to the Sunday Telegraph, signed by 43 of his bishops, criticising plans to limit rises in working-age benefits and some tax credits to 1% for three years.
A "civilised society" had a duty to support the vulnerable, he argued.
In their letter, the bishops said they were concerned 200,000 children could be pushed into poverty.
Speaking during Work and Pensions Questions in the House of Commons, Mr Duncan Smith said: "I have no issue with the Church of England, with the bishops, for them to say whatever they believe.
"It's quite right and proper. They should try and argue with us and put pressure on us over a number of issues.
"I simply say that I don't agree that the way to get children out of poverty is to simply keep transferring more and more money to keep them out of work.
"The reality is what we're having to do is reform a system that became completely out of control under the last government, get people back in work, for being in work is how you get your children out of poverty."
Mr Duncan Smith added: "The reality is that we are doing the right thing in bringing in the benefit cap.
"For the first time ever, people on low and average earnings will realise at last that those on benefits will not be able to be paid more in taxes than they themselves earn."