If the coffee has no added sugar, no carb content and no calories, then I would say just enjoy!
I drank gallons of flavoured coffee when I was on Cambridge - not Littles, Boaters - and it helped such a lot cos regular black coffee used to make me feel sick.