Relapse with contact

Hi everyone, it’s a while since I’ve posted on here, which is a mistake in itself. When I got him out I vowed that I would never let him back into my house, but now, I’ve been letting him stay over occasionally and those occasions are increasing. I basically gave into my little girl missing him and let him stay once or twice. He’s taken her to school a few times and recently I discovered (I have cctv in my house now) that he had left the door on the latch and let himself back in after he’d (I was at work) dropped her off. He says I overreacted and he didn’t realise it would be a problem and he was trying to do me a favour by going back to tidy up/clean. He also now keeps saying things which I think is to purposefully get me to allow him to stay, like if I say I’ll bring our lg over he’ll say he’s got no food in the house and no money to buy any. Once he realises I’m not going to offer for him to stay at my house he will then admit he doesn’t have some food so I can take our lg over there.

I suffer with depression and anxiety (mainly over parenting my little girl) and it’s very easy for me to just give in and let him take over which is what keeps happening especially when I’m feeling very low.

So now I’m in this situation where I keep letting him stay because it’s easier than having the difficult conversation of saying no to him :(. How do I get over this and be strong against him? x