Realtime output from a shell command in Jupyter notebook

[bfurtwa]

I'm telling jupyter to execute a python script:

!python build_database.py

When executed from the terminal, the python script prints the progress during execution. However, in the jupyter notebook, I get all output printed as a list of strings, AFTER the execution. Is there a way to see the output live?

[amrs-tech]

@Benni93 Can you please provide any screenshots for your both cases ?

[bfurtwa]

This is from the jupyter notebook. It is not live, the output is shown after everything is finished.

This is from the shell script. The output is live, I see every iteration.

[amrs-tech]

Have you tried running in the notebook as follows ?
%run build_database.py

[bfurtwa]

Yes, but I can´t run the script in the jupyter notebook, since it uses asyncio. (#3397)

[amrs-tech]

I too a newcomer as a contributor. I'll try to help you. I'll check for any solution to your problem. But I think I might take some time.

[bollwyvl]

If async was holding you back, turns out you're in luck: ipython 7 with ipykernel 5 from pip or conda-forge have got you covered: https://blog.jupyter.org/ipython-7-0-async-repl-a35ce050f7f7 If you do run into issues, make sure to raise them over in @ipython/ipython !

…

On Sun, Sep 30, 2018, 10:17 Benjamin Furtwängler ***@***.***> wrote: Yes, but I can´t run the script in the jupyter notebook, since it uses asyncio. (#3397 <#3397>) — You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub <#4048 (comment)>, or mute the thread <https://github.com/notifications/unsubscribe-auth/AACxRE_3Tv8UFb-CJsjs_oVnilWnbM5Wks5ugNKWgaJpZM4W-rhS> .

[krassowski]

Closing as this is a solved problem with IPython 8.32:

print-loop-sleep.webm

If that does not work for you it might be because of Python buffering see https://docs.python.org/3/using/cmdline.html#envvar-PYTHONUNBUFFERED.

In future such issues would be best opened on repository of respective kernels or underlying implementations.