You could try adding HIIT to the end of your fast a couple times a week. Worked wonders for me in getting rid of stubborn fat, and I never had to go to an uncomfortable deficit. My favorites are Sprint-8 on the rower or Burpees in quick sets of ten, but there are many flavors.
On rock? Rock on