It’s great that your son is telling you these things- because you can put him right!
You can say to him that families who care do things together, and that is normal.
He is trying to make your son feel grateful to him now. He can’t control you, do he’s trying to control your son by making him feel grateful and through guilt.
Put your son right. Tell him nice dads make an effort.