This is crazy.
Ring your local DA team, I’m sure you said you’d had a contact from them.
Are they saying leave for your safety or is your abuser gaslighting everyone?
Please try to get some local support.
If ss are saying go as they think you are the “problem” (and they get it wrgong quite often!! ) the if they say it’s affecting the children they should do a strategy meeting and all agencies should be involved in this – police will be and I’m sure DA team can be involved too. I suspect all your children are of school age, if not does your health visitor know your side of things or your GP? Gather your evidence and share it with someone involved if there is a strategy meeting. Keep strong it will work out I’m sure xxxx