Leave it all at least til Dec. when the tree will be dormant. I wouldn't necessarily cut off "all the brown branches", but depending on how it looks then, you'd be the best judge. If scratching the bark of them shows no green underneath at that time, you might as well do them, but consider using some for jinning and shari.

Want to thank you for the fast reply and will wait untill Dec. and see what happens.

Thanks Again