go for it -there is an old sticky at the top about exercise on SS. I "think" the advice is not to start new exercise in the first couple of weeks (or nothing more than gentle walking) and then gentle to moderate exercise is Ok (so you could still talk), so swimming should be fine.
I do 2-3 sessions of aqua fit, 2 sessions in gym - cardio and toning not weights (and chat to my buddy through all of them!!!) and 2-3 hours of karate each week on SS and not having any problems. Did nothing last time round and noticing that am far less flabby already this time.