If you're that embarassed about skipping the meal, you could go, either pretend to get a phone call or pretend to be ill before the starter is served, and bugger off up to your room for an hour or an hour and a half.
Return to the table as dessert is finishing, tell them you had a family...