When the key is on the start and crank position, it needs 12 volts. When you shut the keyswitch off, the voltage needs to be gone.....
Or you could just clip the tip off of the needle, but when you shut the mower down, you will likely have a real loud bang that will destroy the muffler.