Can we just get something straight? As a general rule of thumb, apostrophes show possession. A plain “s” shows plurality.
So, you can invite the Connors (more than one person with the last name of Connor) over for dinner and you can go to the Connor’s (because you are going to their house, the possession is implied) for dinner. You do not invite the Connor’s for dinner.
Thank you. Lesson over.