Watching something be piped to a file live with tailHow to continue running a program inspite of killing the shell which invoked itLinux terminal, my program only resumes after scrolling the printoutIs there a command in Linux which waits till it will be terminated?Ctrl+c in a sub process is killing a nohup'ed process earlier in the scriptCtrl-C'd an in-place recursive gzip - is this likely to have broken anything?Getting output of another script while preserving line-breakssocat and rich terminal againScript executed as other user from root creates files in wrong directory (root)Dealing with Ctrl+Z in UnixHow to pass Ctrl+C to script called from batch job

What is a romance in Latin?

Could the museum Saturn V's be refitted for one more flight?

What does “the session was packed” mean in this context?

How did the Super Star Destroyer Executor get destroyed exactly?

How to tell a function to use the default argument values?

Venezuelan girlfriend wants to travel the USA to be with me. What is the process?

How do I handle a potential work/personal life conflict as the manager of one of my friends?

What does the expression "A Mann!" means

Which is the best way to check return result?

Is it acceptable for a professor to tell male students to not think that they are smarter than female students?

Can we compute the area of a quadrilateral with one right angle when we only know the lengths of any three sides?

Why is it a bad idea to hire a hitman to eliminate most corrupt politicians?

Are there any examples of a variable being normally distributed that is *not* due to the Central Limit Theorem?

Why would the Red Woman birth a shadow if she worshipped the Lord of the Light?

What killed these X2 caps?

Im going to France and my passport expires June 19th

Do scales need to be in alphabetical order?

How can I deal with my CEO asking me to hire someone with a higher salary than me, a co-founder?

iPad being using in wall mount battery swollen

Can a virus destroy the BIOS of a modern computer?

What do you call someone who asks many questions?

How can I determine if the org that I'm currently connected to is a scratch org?

What reasons are there for a Capitalist to oppose a 100% inheritance tax?

Is there a hemisphere-neutral way of specifying a season?



Watching something be piped to a file live with tail


How to continue running a program inspite of killing the shell which invoked itLinux terminal, my program only resumes after scrolling the printoutIs there a command in Linux which waits till it will be terminated?Ctrl+c in a sub process is killing a nohup'ed process earlier in the scriptCtrl-C'd an in-place recursive gzip - is this likely to have broken anything?Getting output of another script while preserving line-breakssocat and rich terminal againScript executed as other user from root creates files in wrong directory (root)Dealing with Ctrl+Z in UnixHow to pass Ctrl+C to script called from batch job













2















I have a python program which is, slowly, generating some output.



I want to capture that in a file, but I also thought I could watch it live with tail.



So in one terminal I'm doing :



python myprog.py > output.txt


and in another terminal :



tail -f output.txt


But it seems like the tail isn't showing me anything while the python program is running. If I hit ctrl-c to kill the python script, suddenly the tail of output.txt starts filling up. But not while the python is running.



What am I doing wrong?










share|improve this question

















  • 2





    How about python myprog.py | tee output.txt instead?

    – n8te
    2 hours ago















2















I have a python program which is, slowly, generating some output.



I want to capture that in a file, but I also thought I could watch it live with tail.



So in one terminal I'm doing :



python myprog.py > output.txt


and in another terminal :



tail -f output.txt


But it seems like the tail isn't showing me anything while the python program is running. If I hit ctrl-c to kill the python script, suddenly the tail of output.txt starts filling up. But not while the python is running.



What am I doing wrong?










share|improve this question

















  • 2





    How about python myprog.py | tee output.txt instead?

    – n8te
    2 hours ago













2












2








2








I have a python program which is, slowly, generating some output.



I want to capture that in a file, but I also thought I could watch it live with tail.



So in one terminal I'm doing :



python myprog.py > output.txt


and in another terminal :



tail -f output.txt


But it seems like the tail isn't showing me anything while the python program is running. If I hit ctrl-c to kill the python script, suddenly the tail of output.txt starts filling up. But not while the python is running.



What am I doing wrong?










share|improve this question














I have a python program which is, slowly, generating some output.



I want to capture that in a file, but I also thought I could watch it live with tail.



So in one terminal I'm doing :



python myprog.py > output.txt


and in another terminal :



tail -f output.txt


But it seems like the tail isn't showing me anything while the python program is running. If I hit ctrl-c to kill the python script, suddenly the tail of output.txt starts filling up. But not while the python is running.



What am I doing wrong?







linux command-line pipe






share|improve this question













share|improve this question











share|improve this question




share|improve this question










asked 2 hours ago









interstarinterstar

320310




320310







  • 2





    How about python myprog.py | tee output.txt instead?

    – n8te
    2 hours ago












  • 2





    How about python myprog.py | tee output.txt instead?

    – n8te
    2 hours ago







2




2





How about python myprog.py | tee output.txt instead?

– n8te
2 hours ago





How about python myprog.py | tee output.txt instead?

– n8te
2 hours ago










2 Answers
2






active

oldest

votes


















2














You may also need to explicitly flush the buffer for it to get piped upon generation. This is because output is typically only printed when the pipe's buffer fills up (which is in kilobytes I belive), and when the stdin message ends. This is probably to save on read/writes. You could do this after every print, or if you are looping, after the last print within the loop.



import sys
...
print('Some message')
sys.stdout.flush()






share|improve this answer








New contributor




Davey is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.



























    2














    Instead of trying to tail a live file, use tee instead. It was made to do exactly what you're trying to do.



    From man tee:




    tee(1) - Linux man page



    Name tee - read from standard input and write to standard output and files



    Synopsis



    tee [OPTION]... [FILE]...


    Description



    Copy standard input to each FILE, and also to standard output.



    -a, --append 
    append to the given FILEs, do not overwrite
    -i, --ignore-interrupts
    ignore interrupt signals
    --help
    display this help and exit
    --version
    output version information and exit


    If a FILE is -, copy again to standard output.




    So in your case you'd run:



    python myprog.py | tee output.txt





    share|improve this answer























      Your Answer








      StackExchange.ready(function()
      var channelOptions =
      tags: "".split(" "),
      id: "3"
      ;
      initTagRenderer("".split(" "), "".split(" "), channelOptions);

      StackExchange.using("externalEditor", function()
      // Have to fire editor after snippets, if snippets enabled
      if (StackExchange.settings.snippets.snippetsEnabled)
      StackExchange.using("snippets", function()
      createEditor();
      );

      else
      createEditor();

      );

      function createEditor()
      StackExchange.prepareEditor(
      heartbeatType: 'answer',
      autoActivateHeartbeat: false,
      convertImagesToLinks: true,
      noModals: true,
      showLowRepImageUploadWarning: true,
      reputationToPostImages: 10,
      bindNavPrevention: true,
      postfix: "",
      imageUploader:
      brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
      contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
      allowUrls: true
      ,
      onDemand: true,
      discardSelector: ".discard-answer"
      ,immediatelyShowMarkdownHelp:true
      );



      );













      draft saved

      draft discarded


















      StackExchange.ready(
      function ()
      StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fsuperuser.com%2fquestions%2f1421123%2fwatching-something-be-piped-to-a-file-live-with-tail%23new-answer', 'question_page');

      );

      Post as a guest















      Required, but never shown

























      2 Answers
      2






      active

      oldest

      votes








      2 Answers
      2






      active

      oldest

      votes









      active

      oldest

      votes






      active

      oldest

      votes









      2














      You may also need to explicitly flush the buffer for it to get piped upon generation. This is because output is typically only printed when the pipe's buffer fills up (which is in kilobytes I belive), and when the stdin message ends. This is probably to save on read/writes. You could do this after every print, or if you are looping, after the last print within the loop.



      import sys
      ...
      print('Some message')
      sys.stdout.flush()






      share|improve this answer








      New contributor




      Davey is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
      Check out our Code of Conduct.
























        2














        You may also need to explicitly flush the buffer for it to get piped upon generation. This is because output is typically only printed when the pipe's buffer fills up (which is in kilobytes I belive), and when the stdin message ends. This is probably to save on read/writes. You could do this after every print, or if you are looping, after the last print within the loop.



        import sys
        ...
        print('Some message')
        sys.stdout.flush()






        share|improve this answer








        New contributor




        Davey is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
        Check out our Code of Conduct.






















          2












          2








          2







          You may also need to explicitly flush the buffer for it to get piped upon generation. This is because output is typically only printed when the pipe's buffer fills up (which is in kilobytes I belive), and when the stdin message ends. This is probably to save on read/writes. You could do this after every print, or if you are looping, after the last print within the loop.



          import sys
          ...
          print('Some message')
          sys.stdout.flush()






          share|improve this answer








          New contributor




          Davey is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
          Check out our Code of Conduct.










          You may also need to explicitly flush the buffer for it to get piped upon generation. This is because output is typically only printed when the pipe's buffer fills up (which is in kilobytes I belive), and when the stdin message ends. This is probably to save on read/writes. You could do this after every print, or if you are looping, after the last print within the loop.



          import sys
          ...
          print('Some message')
          sys.stdout.flush()







          share|improve this answer








          New contributor




          Davey is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
          Check out our Code of Conduct.









          share|improve this answer



          share|improve this answer






          New contributor




          Davey is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
          Check out our Code of Conduct.









          answered 2 hours ago









          DaveyDavey

          361




          361




          New contributor




          Davey is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
          Check out our Code of Conduct.





          New contributor





          Davey is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
          Check out our Code of Conduct.






          Davey is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
          Check out our Code of Conduct.























              2














              Instead of trying to tail a live file, use tee instead. It was made to do exactly what you're trying to do.



              From man tee:




              tee(1) - Linux man page



              Name tee - read from standard input and write to standard output and files



              Synopsis



              tee [OPTION]... [FILE]...


              Description



              Copy standard input to each FILE, and also to standard output.



              -a, --append 
              append to the given FILEs, do not overwrite
              -i, --ignore-interrupts
              ignore interrupt signals
              --help
              display this help and exit
              --version
              output version information and exit


              If a FILE is -, copy again to standard output.




              So in your case you'd run:



              python myprog.py | tee output.txt





              share|improve this answer



























                2














                Instead of trying to tail a live file, use tee instead. It was made to do exactly what you're trying to do.



                From man tee:




                tee(1) - Linux man page



                Name tee - read from standard input and write to standard output and files



                Synopsis



                tee [OPTION]... [FILE]...


                Description



                Copy standard input to each FILE, and also to standard output.



                -a, --append 
                append to the given FILEs, do not overwrite
                -i, --ignore-interrupts
                ignore interrupt signals
                --help
                display this help and exit
                --version
                output version information and exit


                If a FILE is -, copy again to standard output.




                So in your case you'd run:



                python myprog.py | tee output.txt





                share|improve this answer

























                  2












                  2








                  2







                  Instead of trying to tail a live file, use tee instead. It was made to do exactly what you're trying to do.



                  From man tee:




                  tee(1) - Linux man page



                  Name tee - read from standard input and write to standard output and files



                  Synopsis



                  tee [OPTION]... [FILE]...


                  Description



                  Copy standard input to each FILE, and also to standard output.



                  -a, --append 
                  append to the given FILEs, do not overwrite
                  -i, --ignore-interrupts
                  ignore interrupt signals
                  --help
                  display this help and exit
                  --version
                  output version information and exit


                  If a FILE is -, copy again to standard output.




                  So in your case you'd run:



                  python myprog.py | tee output.txt





                  share|improve this answer













                  Instead of trying to tail a live file, use tee instead. It was made to do exactly what you're trying to do.



                  From man tee:




                  tee(1) - Linux man page



                  Name tee - read from standard input and write to standard output and files



                  Synopsis



                  tee [OPTION]... [FILE]...


                  Description



                  Copy standard input to each FILE, and also to standard output.



                  -a, --append 
                  append to the given FILEs, do not overwrite
                  -i, --ignore-interrupts
                  ignore interrupt signals
                  --help
                  display this help and exit
                  --version
                  output version information and exit


                  If a FILE is -, copy again to standard output.




                  So in your case you'd run:



                  python myprog.py | tee output.txt






                  share|improve this answer












                  share|improve this answer



                  share|improve this answer










                  answered 2 hours ago









                  n8ten8te

                  5,16172234




                  5,16172234



























                      draft saved

                      draft discarded
















































                      Thanks for contributing an answer to Super User!


                      • Please be sure to answer the question. Provide details and share your research!

                      But avoid


                      • Asking for help, clarification, or responding to other answers.

                      • Making statements based on opinion; back them up with references or personal experience.

                      To learn more, see our tips on writing great answers.




                      draft saved


                      draft discarded














                      StackExchange.ready(
                      function ()
                      StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fsuperuser.com%2fquestions%2f1421123%2fwatching-something-be-piped-to-a-file-live-with-tail%23new-answer', 'question_page');

                      );

                      Post as a guest















                      Required, but never shown





















































                      Required, but never shown














                      Required, but never shown












                      Required, but never shown







                      Required, but never shown

































                      Required, but never shown














                      Required, but never shown












                      Required, but never shown







                      Required, but never shown







                      Popular posts from this blog

                      Can not update quote_id field of “quote_item” table magento 2Magento 2.1 - We can't remove the item. (Shopping Cart doesnt allow us to remove items before becomes empty)Add value for custom quote item attribute using REST apiREST API endpoint v1/carts/cartId/items always returns error messageCorrect way to save entries to databaseHow to remove all associated quote objects of a customer completelyMagento 2 - Save value from custom input field to quote_itemGet quote_item data using quote id and product id filter in Magento 2How to set additional data to quote_item table from controller in Magento 2?What is the purpose of additional_data column in quote_item table in magento2Set Custom Price to Quote item magento2 from controller

                      Magento 2 disable Secret Key on URL's from terminal The Next CEO of Stack OverflowMagento 2 Shortcut/GUI tool to perform commandline tasks for windowsIn menu add configuration linkMagento oAuth : Generating access token and access secretMagento 2 security key issue in Third-Party API redirect URIPublic actions in admin controllersHow to Disable Cache in Custom WidgetURL Key not changing in Magento 2Product URL Key gets deleted when importing custom options - Magento 2Problem with reindex terminalMagento 2 - bin/magento Commands not working in Cpanel Terminal

                      Aasi (pallopeli) Navigointivalikko