This depends totally on the size of the garden and where you a living. Can you give us a little more information please.

Depends on your definition of 'problem'. If the tree is planted at least 45 feet away from any house or wall, and you don't mind having a tree that's over 55 feet in height, then its not a problem. If you have it planted within, say, 20 feet of a house, then it's best to pollard or stool it to grow it either as a small tree, or a shrub.