It is difficult but try to remember it isn't you that is the issue. It probably isn't even the bills he is blaming. Try to be supporting and encourage him to speak with someone. His GP is probably an easy place to start or calling a help line. It might help to sort out where the distress is coming from.
But importantly, don't lose your own peace of mind over it. You may need to pull back and let him deal with things without your input, especially as he may not be ready to make changes just yet. It is early days by the sound of things.
Hugs to you.
