If losing body fat is your goal, limit your intake of fruit to once a day or less. The best time to eat fruit is right after a workout or mid-afternoon. Some fruits, such as pineapple and banana, are higher in fructose (a natural sugar, but a sugar nonetheless) than other fruits, such as berries, apples or melon. Limit the portion size of higher-fructose fruit if fat-loss is your goal.