Paul, can you post a picture that shows the overall space so we can see the parameters and conditions?

The Osmanthus fragrans is a great choice of shrub, but give it room as they get big. I'd recommend Sasanqua Camellias as a better landscape shrub than C. japonicas. Daphne odora marginata is another good fragrant early winter blooming shrub. If this garden area is dappled shade below pines, I'd also recommend using some good foliage shrubs such as Aucuba japonica variegata and foliage plants such as Mahonia lomariifolia as tall background or accent plants. For summer fragrance, I really like Trachelospermum jasminoides and mock oranges/Philadelphia spp's. Summer fragrance might be achieved with plantings of Tuberose and Lilies.