Jenkins console output not in realtime
Pretty new to Jenkins and I have simple yet annoying problem. When I run job (Build) on Jenkins I am triggering ruby command to execute my test script.
Problem is Jenkins is not displaying output in real time from console. Here is trigger log.
Building in workspace /var/lib/jenkins/workspace/foo_bar
No emails were triggered.
[foo_bar] $ /bin/sh -xe /tmp/hudson4042436272524123595.sh
+ ruby /var/lib/jenkins/test-script.rb
Basically it hangs on this output until build is complete than it just shows full output. Funny thing is this is not consistent behavior, sometimes it works as it should. But most of the time there is no real time console output.
Jenkins version: 1.461
To clarify some of the answers.
-
ruby
orpython
or any sensible scripting language will buffer the output; this is in order to minimize the IO; writing to disk is slow, writing to a console is slow... - usually the data gets
flush()
'ed automatically after you have enough data in the buffer with special handling for newlines. e.g. writing a string without newline thensleep()
would not write anything until after thesleep()
is complete (I'm only usingsleep
as an example, feel free to substitute with any other expensive system call).
e.g. this would wait 8 seconds, print one line, wait 5 more seconds, print a second line.
from time import sleep
def test():
print "ok",
time.sleep(3)
print "now",
time.sleep(5)
print "done"
time.sleep(5)
print "again"
test()
-
for
ruby
,STDOUT.sync = true
, turns theautoflush
on; all writes toSTDOUT
are followed byflush()
. This would solve your problem but result in more IO.STDOUT.sync = true
-
for
python
, you can usepython -u
or the environment variablePYTHONUNBUFFERED
to makestdin/stdout/stout
not buffered, but there are other solutions that do not changestdin
orstderr
export PYTHONUNBUFFERED=1
-
for
perl
, you haveautoflush
autoflush STDOUT 1;
Make sure your script is flushing its stdout and stderr. In my case I had a buffering issue similar to what you describe but I was using python. The following python code fixed it for me:
import sys
sys.stdout.flush()
I'm not a Ruby coder, but Google reveals the following:
$stdout.flush
It seems to me that python -u
works as well.
E.g. In batch command
python -u foo.py