Consulting with a Client Who Is Also a Friend

Question: I have a close friend who is also a client. He went through a rough time with his wife threatening a divorce and we spent a lot of time talking about it (out of office settings).  I sent him a bill and he returned it with a notation that “we spoke as friends and not as a professional consultation, and the bill should be cancelled.”  What should I do?