Am I wrong to not want him there?

I am 20 weeks pregnant with my boyfriend and I's first child. October will be 6 years for us. This past week he has watched me bust my *** cleaning our house and lugging the vacuum and laundry up and down the stairs and not once did he offer to help me. He sat his *** on the couch and played with his phone. He has not made one prenatal appointment and only went to the first ultrasound. Back in January before I got pregnant, he admitted that he had dated another girl while at a strip club with his friends and last night I made a y remark to him about it and he told me that I was the reason and when I confronted him this morning about it he said thats not what he meant. I dont understand him. Monday is our 2nd Ultrasound to see the baby, make sure everything is ok, and to find out the . Am I wrong to ask him not to come? I feel like he hasnt really made an effort in this baby's life as it is and I dont want him spoiling this great experience for me. I dont know what to do anymore.