I could have written this. It sounds a lot like my last relationship. Have a look for my post , its in the general discussion part in the post entitled abusers friends with their exes. and also its in are you new to the forum.
Your feelings are correct. He should not be on the phone to his friends when he is with you its not respectful. There should be boundaries and you should be number one. My ex always put his friends first above me, did not care how upset I was I was made to feel the unreasonable one.