This is the required battery, they are still available, I believe, in Maplin’s.....
I would certainly replace this old PS/2 as soon as possible, when the hard drive fails it will be difficult to replace. I’m amazed that the drive is still alive after so many years.
Peter