Advice please

I live with my ex in the home he owns with our baby, I cannot afford to move out as he told me to quit my job. I have been working with women’s aid for a few months, he is financially controlling, coercive and a textbook n********t. I have been viewing properties but have been very fussy. I have now been given a kick up the back side as he regularly does (drug removed by Moderator) (which I have told him to stop) and there was residue on the floor where our baby crawls! Luckily I saw it before the baby went near it.
He wants 50/50 custody which I am not willing to do if he is endangering our child, and he works full time regularly out until all hours. I have viewings this week, I want to ask him to pay the deposit and first months rent as I need support and need to get out. My only other option will be to move up north as I simply cannot afford in our area. Am I allowed to live hours away if he will not financially support me? He has a lot of money and has threatened lawyers many times.