It would take some effort, but a taxi told me to rub the antlers on tree/brush that the animal would have used to get back the natural color. I tried it on a small deer shed in my back yard and it turned the antler green. I suppose had I used a tree that the buck would have used as a rubbing tree it would have worked. I would try it on a test antler first. Assuming it works, I would imagine it would be easier having some of the brush in your hand and rubbing that against the antlers instead of rubbing the antlers on the brush. If it does work, then I'd imagine it would be the most natural looking way to refurbish a set of antlers.
I personally like the white look over some of the stains I've seen. A bad stain job can ruin the visual appeal of the antlers.