I've noticed that the more I get into the diet, the slower the weight loss. It really is demotivating, but I am learning that if I just drink more water and do some gentle exercising, it helps. I am going into the gym next week to start swimming. I think my body has adjusted to the diet, and probably needs a kick up the bum to restart the good weight loss.
I would not have milk, as the amount of calories needed to keep you in ketosis is probably higher than it should be now that you have added calories.