I don't think it will work if you are only having 4g of fat in total in a meal. Xenical recommend no more than 15 g of fat per meal.
In saying that the Xenical might not have an effect, but eating a low fat diet like that will help you to lose weight, and in essence there would be no point in having the Xenical.