Does your brain slowly deteriorate as you get older even if you have a healthy and normal brain?

I read somewhere that EVERYONE'S brains deteriorate and the intellect goes down as they get older even if they are born with a healthy, normal, and sharp brain. I also heard that the brain starts to go down hill for everybody when they are in the mid-20s. Is that true?