To reproduce: ``` %matplotlib qt5 import matplotlib.pyplot as plt plt.plot([1, 2, 5]) ``` Then select the pan button and move the plot continuously. It will stop for 1000ms from time to time. Fixed by #573