Worrying constantly about your calorie intake causes your cortisol levels to spike up. This is a stress hormone related to obesity. Try and lead a balanced life with a balanced diet. Don't worry about falling off the wagon sometimes. It just adds more stress. Also, try and keep and active lifestyle and when it is possible, do some compound exercises or HIIT training.