That is the most permanent way to fix. Has worked for many on this site. But like Bert said star washer is best. I would use both nylon nut and star.
Do not try yo remove rivet the hard way. Use a drill and drill it out. Hammer and chisel or cutting it off is the hard way. If you have a grinder and are really careful you can possibly grind it off on side then drive it out.