Which "small handle" are you speaking? There are only two handles on mine. One, the one with the wooden knob, is for adjusting the flame height and the other, is the preheat cup priming pump and yes, it should be spring loaded. Steve