Where is it located?

Compare with Chionanthus virginiana fruit.

It almost looks like a Nyssa sylvatica berry, but the leaves/berries aren't quite right. The petioles on Nyssa aren't purple like that though. Where are you located? do you have a pic of the whole tree?

Those leaves almost look evergreen

This is a double post by the OP. I have C. virginiana and the leaves are exactly like those in the photo, complete with the purple on the bottom of the petiole.

Agree, one of the Fringe trees.

Here's my female Chionanthus virginicus. Male tree drowned, and nobody around has a male to pollinate mine.
{{gwi:376984}}

Nice and lush! Do you get good fall color on that one, Dzit?

No fall color unless you call yellow-brown a color. Bush is about 15ft. dia. and 8 ft tall because when it was a toddler, the deer rubbed it and one side of it all but fell down. Other than that, deer don't eat a single leaf on this plant.