Your weekly allowance is there to be used. But if you don't want to use it, you don't have to. I eat at least 40 of mine every week and still lose weight

The only thing I don't do is eat a bunch of my weeklies in the last couple of days before weigh in, I tend to eat the majority of mine at the beginning of the week