Fruit drop is usully a result of stress of some kind.
Trees often respond to stress by flowering prolifically and setting masses of fruit. I guess hoping that some witll make it to maturity. when conditions improve the tree realises it doent need so much fruit and drops some until it reaches an equilibrium with available nutrient and water.
check the link below as it suggests some possible remedies
Fertiliser:
Citrus trees are very heavy feeders and require monthly applications of a good complete fetiliser complete with trace elements. Sure, before fertiliser was available citrus trees grew somwhere but only a few fruit ever made it to maturity.
Water:
Walk a distance away from your tree and dig down into an uncultivated area of ground about a spade depth or so. How dry is the soil? Its sometimes surprising how dry the soil can be at depth.
Temperature variation.
cold nights hot days at this time of year can sometimes upset fruit retention. The poor tree doesnt know wether its winter or summer.
Found this.
Premature shedding of citrus
This problem is a recurring one that is difficult to
prevent but the following explanation may help in
understanding the situation.
Normally about 98 per cent of the fruitlets
that originally set on orange trees shed before
reaching maturity. The remaining 1 to 2 per cent
is sufficient to produce a commercial crop of fruit.
Most of this drop or loss of fruitlets occurs at the
end of flowering or shortly afterwards when the
fruit is about pea sized.
A second fall, known as the ‘midsummer’ or
‘December’ drop usually determines what the
ultimate production of fruit will be. The fruit is
then 2 to 2.5 cm in diameter.
Trees growing in the sandy soils of metropolitan
Perth often suffer a very severe midsummer drop.
At this time of the year rapidly rising temperatures
and desiccating easterly winds intensify the fall
with the result that despite normally acceptable
care and apparent good health, the tree is
practically denuded of fruit.
http://www.agric.wa.gov.au/objtwr/imported_assets/content/hort/fn/pw/citrusloss.pdf