The library mpld3 can create interactive plots (pan, zoom, point info) based on matplotlib.
The good things is that you just have to do python the usual way and finish your code with mpld3.show(fig) instead of plt.show(). Yes that is (almost) it !
Here is a test with the 3FGL fits (version gll_psc_v10.fit) file showing the variability index as a function of Curvature index.
If you stop on a data point, it will show some infos. To activate the pan & zoom tools, click on the grey cross on the lower left part of the plot.
Once you clicked on the grey cross you can click and pan and use the mousewheel to zoom in/out.
Sky plots: here