The first question to ask is did it flower? Never any fruit without a flower as both males and females need to flower.

I don't recall seeing any flowering.

Then yes there is still a chance that it is female.

You're sure it's sumac, and not Ailanthus?
I can't tell from the photo, but none of the sumacs here would have a single trunk that tall without some lower branching.

Oh lucky_p, good point!! It is rather tall and unbranched, isn't it?

Check this link out - near the bottom are excellent leaf scar pictures and in my opinion is the best way to tell right now (without fruit or flowers) what you have. Pull off a leaf to get a fresh scar to examine.

Of course if you pull off the leaf then you have that to look at too and that can be quite distinctive ... :)

Here is a link that might be useful: Differences

The other plants next to it have the same growth habit; I'm guessing they are shaded. See that brilliant fleck of color in the branches? Premature senescence, and an aspect shared by many sumacs.

Lucky, partially-shaded smooth sumacs near my lot are much taller & skinnier than typical.

When you're done checking out the leaf give it a crushing... If it stinks and makes you want to immediately wash the smell off your hands, then it's alianthus. I think it's sumac though. I have several with the single stem look. They grow quickly, kind of like..... weeds?
Jk, I keep mine for the same reason, near instant privacy along the fence while other stuff fills in.

Just saw your discussion, 6 years later. :-) You may not still have the plant by now. Def sumac, agree with the coloring on the base of the leaves being characteristic, and the legginess comes from shade. It may be too shady there to flower. Correct that both males and females will flower but only females will produce fruits. Also --- in 2016, I dug up one from the side of the road that I knew was female because it had fruit. I transplanted it into my yard and it was fine and healthy, but for some reason, the thing never bloomed until this year, 2020, 4 years later. No idea why. I'm doing backflips over it finally flowering.

For the last 3 years the wild sumac behind my place have been male, but this year while the flowers started out looking like male flowers some of them started to get tighter and are now a pink colour...weird thing is that some of the flowers on the same tree still look like males. I live in Midland Ontario.