Think you should be okay with that. You can't have fruit teas because of the additional sugar content, but you're okay with all leaf teas. Can't imagine that the added spices would do too much damage.
I drink all types of tea with sweetner except the fruit teas ( can't stand the taste of those), green tea and earl grey , those are my favourites, Chai should be fine unless its the brand that comes with powdered milk