If you're crushing brass, are they all single head stamp? Do you trim them? If you have not, try trimming them all to the same length (best after FL sized) and make sure that whatever system your press has to locate brass under the die is working.
I don't have a 32-20 but all my loading is done full length sized with one exception. I have a Savage BAT/s .308 which I'm very persnickety about brass. I only use my own new single head stamp brass (not bought used) sort by weight, prep flash hole, trim them all to the same length, and neck size.
My .223 I just load as they are and don't sort or trim. if they crush I chuck them.