I used to have comments like that from friends and while I don't think that they are being deliberately nasty or anything I think sometimes there is a bit of jealousy involved. Only you know what your goal is or should be and as long as it's still within a healthy weight range, go for it and try...