Do the opposite that you did to gain the muscle.
1. Calorie restriction.
2. Focus on LSD.
The truth of the matter is that your skeleton and connective tissue has permanently changed because of the lifting, so there will be some weight that won't come off.
I remember Greg Lamonde talking about how he'd put on muscle during his off season and would have to get rid of it before he could successfully race again.