There was some light glue/sticky stuff under mine.  I ran a pick or small screwdriver carefully along the bar, up under the rubber, and worked it around the bar to release the grip and slip it off.  It stayed tacky enough that I didn't need to reapply any when I put it on the new bar, but you might need to use something.