You might need to use this magic:

%matplotlib inline


Every time you want to force the inline output for a graph figure generated from matplotlib, which is actually most of the times.

There is a way to make this “automatic” by configuring the file .jupyter/jupyter_notebook_config.py:

c.InteractiveShellApp.matplotlib = "inline"