It does get easier, took me a while to get there but you do.
I too questioned leaving and stopping contact. I felt guilty and a bad person about how ‘upset’ he was over it all and how I made him like that. But after some counselling I seen things differently and started believing I did the right thing and his behaviour now just proves I did – I would also restrict mutual friends on social and take off any friends you had that came via your ex.