You don't need to remove the leaves that have the larva; just take the larva off. I find BT to be a very effective control that is organic and relatively safe.
Renais

Thank you Renais1...was reading about BT. Am concerned with research showing harmful for human consumption in GMO crops. I know those crops are already harmful for human consumption but can't find any other research....

So flick it into soapy water.

Or put it in a covered container with food (the leaf it's on) and wait until it works through its life cycle and becomes a moth.

The Bacillus thuringiensis bacterium sprayed onto plants is of little concern to us while the bacterium in plants, and the fruits from those plants, may be. Any of the bacterium that you might spray onto the fruits will be easily washed off, so the possibility you might ingest some is very slime, while the bacterium Genetically Engineered into a plant is in the fruit you eat.
Neem Oil products, BTK, or pyrethrin sprays or dusts may be good controls.
No need to remove any of the leaves the larva may be on.
Sharp sprays of water are the best method of removing
Aphids from plants. Buying Lady Beetles is not a good idea.