Tabernaemontana fushsiaefolia - Toad Tree

I've looked up toad tree.
Apparently the fruit has a look and texture similar to toad skin.

You're correct. I've seen the fruit. It does resemble a toad.

It's too bad this tree is not more common here in San Diego. Its gardenia fragrance alone is worth growing this tree.

The flowers and leaves do resemble Gardenia. It is however, in the Apocynaceae family which includes such genera as: Adenium, Oleander, and Plumeria.