The spacer and the nut have to clamp the pulley tight.
There are several different spacers and nuts.
You might even need to put a washer on top of the pulley to get better clamping force.
It is designed to strip out ( safety feature if too much resistance & belt does not slip )
An over tight belt will make this worse as will cutting too much as the clippings put a big load on the right pulley, more so when mulching.