Have you pruned it to , to create spurs ?

It might be where its planted - this particular variety likes a very sheltered and warmer spot, hates a frost pocket, even though it flowers a little later than most.

Try feeding it with Potash or even Growmore.

Also, depending on the rootstock, in some circumstances it could take as long as 10 years to fruit. Although this would be exceptional it could be the case.