Frustrated and unhappy

Hi everyone. I'm getting more and more unhappy in my marriage. My husband has ADHD and bad RSD. The RSD is causing regular problems in our relationship. I understand how ADHD and the RSD affect him and that it's part of it but I'm finding it more and more difficult to handle. At times he is blatantly rude and horrible. 
 

He drinks regularly which doesn't help as it affects his moods. He regularly takes offence at very normal things I do which would not affect anyone else. If I treated him the way he does me he would not put up with it. He apologised sometimes and I accept the apology but it's having a big impact and I now enjoy spending time alone more than spending time with him. He talks and talks and it's all about how he feels, what's he's been doing, what he wants to do, what his current ailments are etc. and doesn't really show a lot of interest in my feelings. We have good times,  don't get me wrong but the ADHD / RSD makes him aggressive and rude and he gives me the silent treatment constantly for days on end. I'm walking on eggshells trying not to say the wrong thing. He tells me daily he loves and how lucky he is. But we seem to be wanting to do different social things. He likes to drink/watch tv and I like to go out walking, reading, shopping and don't want to sit in a pub all day.  What can I do to try and improve things? He likes me to be with him all the time but I'm finding this difficult as I need a break.