Most groups are fine with children going, I don't often take my little one but people have said they don't mind him coming along on the occasions he has come, in fact one week he said he wanted to come and I told him no, and I was told I should have let him come when I got to group.
I have heard about some groups being funny about children though, so I'd ring the consultant first and speak to them, see what they think. I do think all groups should accept children, but if you speak to the consultant first you'll save yourself any embarrassment if she/he happens to be one of the few who are funny about people bringing their children.