A herky-jerky transition from backswing to forward swing almost always creates poor speed control.  Using The Pendulum Putting Rod during practice will smooth the transistion and refine your touch.