It's because we're addicted to food. It's the same as giving up smoking. You have to fight the urge yet you can never fully go cold turkey because you have to eat to survive. Also mentally we don't see eating as an addiction so we don't process the craving the same way. You just need to chalk it down now and start again.