He has no confidence and is unreliable

He said he would call and come over.  Didn't call, got drunk instead.  When I said I 'didn't want to talk' and expected him to say 'please we need to talk' or something, he just said 'ok suits me'!  Just don't know how much longer I can put up with it, but feel as if I am in love with him.  I have anxiety issues myself, but if I say I am going to call I do, how hard is it to just send a text and say I can't make it.  I am beginning to think he just likes hurting me or is trying to push me away, and it's working! but my heart is breaking.