Try Philadelphus coronarius 'Aureus'.

OP wants evergreen.

Juniperus chinensis 'Aurea' or 'Gold Coast' comes immediately to mind for that shape.

Dan

'Aurea' is a tree form cultivar prone to sunburn and rare in commerce here. Gold Coast is a Pfitzer juniper, with the typical low habit. 'Gold Cone' common juniper might be acceptable, although mine has started to fall apart after some years of growth - this seems to be chronic with conical forms of common juniper in my climate.

There are many yellow forms of other popular conifers such as Hinoki and Sawara cypresses in nurseries. Many are brassy yellow and/or prone to some sunburn. But a visit to a favorite outlet with a good selection might result in one being found that appears to suit.

Good choices above. Just to give you some options, an abelia might fit the bill, although they tend to grow wider than tall. But with pruning you might make it work. I have an abelia grandiflora 'Kaleidoscope' that looks fantastic all year long, with flowers the butterflies use in summer (mine are not really fragrant as is sometimes advertised). It has variegated lime green/yellow foliage that has red and white in it as well, and changes color when I water it for some reason.

My 'Frostproof' gardenia has lime-green new foliage that quickly matures to a dark green. So it's not lime-green year round. But it is evergreen, very fragrant in summer bloom, and reliably hardy in zone 7 if you get it in the ground in early spring to get established before first freeze.

The other suggestions are better. =)

Somewhat rarely seen in commerce (at least here in CT, even in a better nurseries) Golden Fastigiate Yew - Taxus baccata 'David' (sometimes listed as T. baccata aurea 'David' or 'Davie') perfectly fits your requirements.
Very slow growing, therefore 3-4 foot specimen may cost some hefty chunk of money.

Here is a link that might be useful: Golden Fastigiate Yew