pot orange tree - very small fruit

why does my pot citrus orange flower loverly then tiny oranges appear then when the size of a pea turn yellow and drop off ,i have been feeding it as per instructions but this happened every year since i bought it.it lives in the conservetoy in winter and outside in summer ,the was large fruits on it when i bought it ,so what am i doing wrong?

On plant citrus sinensis