Census Taker Problem

During a recent census, a census taker went to a man's house who had three children.  The father of the children told the census taker that the product of his children's' ages is 72.  The census taker waited for more information.  The man then told him that the sum of their ages is the same as his house number.  The census taker looked at the house number and then replied "I still don't know how old they are."  The father said "Oh, I forgot to tell you that my oldest child likes chocolate pudding!"  The census taker was then able to write down the children's ages and go on to the next house.  How old are the children.  How do you know?