Why be scared? Life is too short!
Try not to get so tied up in knots about what the scales will say each week. Have confidence in the plan and know that as long as you are following it properly the weight will come off - if not this week then in the future.