Yep, although if you're not going to use the key, you can allegedly use a toothbrush charger on them too, but I've not really tried it.
I replaced both of mine recently, and if you're confident with a soldering iron, it's really not a bad job. Glueing the case back together neatly is probably the hardest part!
Like all batteries, they lose capacity over time, so if it's only a weekend car, you might find them going flat/having short range as they get older and get charged up less frequently.
But knowing there is a solution if they do stop holding charge is a nice piece of mind!