Am I "talking down" to my husband?

I told my husband of 2 years that we should work towards combining our finances when pre-marriage debt is settled. He agreed that would be a good thing. Then I said in order to that, we will have to live by a budget because otherwise one or the other will get the short end. He responded "ok, I can live on nothing" to this I responded "a budget doesn't mean you have to live on nothing, it's a plan on what to spend on". He found this offensive and said that I was lecturing him and assuming he doesn't know what a budget is. Given his response that he can live on nothing, I thought it was not unreasonable to explain what I meant. Am I wrong?