Many people strive to have pearly whites. But did you know that teeth naturally darken with age? Dentin, the inner hard part and main portion of your teeth, is mostly responsible for the color of your teeth — whether they’re white, off-white, gray or yellowish. The color of teeth varies between people and even from tooth to tooth of the same person.