The SW plan itself advises in the book to eat until satisfied - it's part of the plan, not an extra thing that someone has decided to add on as a tweak.
Nobody is suggesting you should count or control calories, but it is the underlying basis of how the plan works, and if your losses slow down it's worth looking at what you're eating as some of the free foods can be high in calories, so if you're eating lots of it then the plan won't work. My consultant (both current and previous ones) have all made these comments when people have struggled to lose.
You're right, the plan is about cutting out the crap, but the reason it works is that the calorie intake is restricted by the superfree foods which we eat, so often it's ok to skip the superfree food and have great losses, but if your plate is piled high with just meat and potatoes, it's unlikely that you're going to do well on the plan. So it all depends on how you pile your plate