Fit Trivia: Can You Decrease Fat Cells? Fit Trivia: Can You Decrease Fat Cells As You Age? Answer: No. At birth, your number of fat cells is determined. As you gain or lose weight, your fat cells will grow or shrink, but you cannot add or remove fat cells.