You have posted this in the healthy extra section, but I expect someone will move it soon.
Bananas are free, so you can eat them if you wish. Most people can eat them in moderation, but if you think that they are hindering your weight loss then maybe just one, or maybe two, a day, and maybe not every day. There's loads of other free fruit you could be eating instead.