Itprobably wont affect your losses much (although calcium is thought to help with weight loss I think) however they are part of the plan and there to ensure rhat your diet is balanced and healthy. So while it might not stop you losing weight, you might not necessarily be healthy.