Cutting back in the fall is recommended. I suppose the general cleanup removes some insect pests and prevents future problems. There have been years, however, when I neglected this chore until spring and, quite frankly, I didn't note any difference in growth or production. My current bed is about 12 years old and a mix of Martha Washington and newer Jersey type varieties.

I want to cut it all down to the ground.

That's the norm. ;) Just take care not to damage the crowns themselves in the process. Then mulch the whole bed well and feed it well in early spring before shoots begin to emerge.

If growing asparagus is new to you, you might want to read through all the prior discussions about it here for even more info. Linked below.

Dave

Here is a link that might be useful: Asparagus discussions