In Colorado, it's my understanding if you want a full refund, you will lose your points. If you want to retain the points used to draw the tag, you have to forgo the refund.
On the other hand, you can return the tag, and forfeit the tag fee and retain your points. You do not get a point for the current year that you drew however, which will set you back one year from the pack. I did that in 2010 when I drew one of the top tags, but didn't have time to go on the hunt.
Grand Slam #1005 + 2: Dall (1986 Yukon), Fannin/Stone (1987 Yukon), Bighorn (1988 Colorado Unit S-26), Stone (1995 British Columbia), Desert (2001 Nevada Unit 161), Bighorn (2009 Wyoming Unit 5)