Do you mean the handle itself? If so, remove the arm rest bit and the handbrake gaitor by just pulling it so it unclips. There is a zip tie holding the handbrake handle to the gaitor so you'll need to snip that.
Once that's done, the handle just pulls off, though I had to hit mine with a hammer gently - did it this morning actually!
Once that's done, the handle just pulls off, though I had to hit mine with a hammer gently - did it this morning actually!