When you hear the noise, stop the sled and look
at your plugs. Are they white? Flecks of aluminum?
If not, and they look black or brown, then I
would check the clamps around your pipe. Maybe
by putting on the choke, you are changing the
vibration of the engine (different RPM's) and
the shield stops rattling. Just a thought.