If it were mine, I'd give the shaft a gentle squeeze in the vice between two bits of scrap steel rod about the same OD as the bush ID, at the right point along the shaft length. The aim would be to send it oval, and restore a non-rattly fit. It's not the most elegant solution but it will work and after all, this is not a high-speed bearing
If trial fits are quick and easy I'd try to creep up on it, rather than overdo it.