So I took apart the mechanism where the starter pawls retract. There was one weird piece of plastic in there that I thought might be causing sounds, so I tossed it and reassembled. Started it up, still rattley noise.
While it was running, I very slightly pulled the starter rope until the pawls...