My manual says you should have zero clearance when the valve is fully closed. As suggested earlier it may just be there to prevent the throttle sticking shut.
Should have little affect on idle speed until it is open too far for the ECU to adjust with the ISC valve.