Try not to worry...Its never that bad! They are always very discreet and remember lots of others feel the same way.
I'm starting again tomorrow after a year off. I'm worried too as I don't like meeting new people and the hardest bit for me is staying for the whole meeting.
But stay...