builder: mozilla-central-linux64-asan-nightly slave: bld-linux64-spot-471 starttime: 1446981031.68 results: retry (5) buildid: 20151108030417 builduid: e6dc3ae838954565b651788113c7b119 revision: e2a910c048dc82fc3be53475f18e7f81f03e377b ========= Started set props: master (results: 0, elapsed: 0 secs) (at 2015-11-08 03:10:31.683224) ========= master: http://buildbot-master74.bb.releng.usw2.mozilla.com:8001/ ========= Finished set props: master (results: 0, elapsed: 0 secs) (at 2015-11-08 03:10:31.683676) ========= ========= Started set props: basedir (results: 0, elapsed: 0 secs) (at 2015-11-08 03:10:31.683972) ========= bash -c pwd in dir /builds/slave/m-cen-l64-asan-ntly-0000000000/. (timeout 1200 secs) watching logfiles {} argv: ['bash', '-c', 'pwd'] environment: CCACHE_HASHDIR= G_BROKEN_FILENAMES=1 HISTCONTROL=ignoredups HISTSIZE=1000 HOME=/home/cltbld HOSTNAME=bld-linux64-spot-471.build.releng.usw2.mozilla.com LANG=en_US.UTF-8 LESSOPEN=|/usr/bin/lesspipe.sh %s LOGNAME=cltbld MAIL=/var/spool/mail/cltbld PATH=/usr/local/bin:/usr/lib64/ccache:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/home/cltbld/bin PWD=/builds/slave/m-cen-l64-asan-ntly-0000000000 SHELL=/bin/bash SHLVL=1 TERM=linux TMOUT=86400 USER=cltbld _=/tools/buildbot/bin/python using PTY: False /builds/slave/m-cen-l64-asan-ntly-0000000000 program finished with exit code 0 elapsedTime=0.004086 basedir: '/builds/slave/m-cen-l64-asan-ntly-0000000000' ========= master_lag: 0.05 ========= ========= Finished set props: basedir (results: 0, elapsed: 0 secs) (at 2015-11-08 03:10:31.738402) ========= ========= Started downloading to buildprops.json (results: 0, elapsed: 0 secs) (at 2015-11-08 03:10:31.738733) ========= ========= Finished downloading to buildprops.json (results: 0, elapsed: 0 secs) (at 2015-11-08 03:10:31.751948) ========= ========= Started 'rm -rf ...' (results: 0, elapsed: 0 secs) (at 2015-11-08 03:10:31.752242) ========= rm -rf properties in dir /builds/slave/m-cen-l64-asan-ntly-0000000000/. (timeout 1200 secs) watching logfiles {} argv: ['rm', '-rf', 'properties'] environment: CCACHE_HASHDIR= G_BROKEN_FILENAMES=1 HISTCONTROL=ignoredups HISTSIZE=1000 HOME=/home/cltbld HOSTNAME=bld-linux64-spot-471.build.releng.usw2.mozilla.com LANG=en_US.UTF-8 LESSOPEN=|/usr/bin/lesspipe.sh %s LOGNAME=cltbld MAIL=/var/spool/mail/cltbld PATH=/usr/local/bin:/usr/lib64/ccache:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/home/cltbld/bin PWD=/builds/slave/m-cen-l64-asan-ntly-0000000000 SHELL=/bin/bash SHLVL=1 TERM=linux TMOUT=86400 USER=cltbld _=/tools/buildbot/bin/python using PTY: False program finished with exit code 0 elapsedTime=0.002537 ========= master_lag: 0.04 ========= ========= Finished 'rm -rf ...' (results: 0, elapsed: 0 secs) (at 2015-11-08 03:10:31.799512) ========= ========= Started set props: script_repo_url (results: 0, elapsed: 0 secs) (at 2015-11-08 03:10:31.799815) ========= script_repo_url: https://hg.mozilla.org/build/mozharness ========= Finished set props: script_repo_url (results: 0, elapsed: 0 secs) (at 2015-11-08 03:10:31.800159) ========= ========= Started 'rm -rf ...' (results: 0, elapsed: 0 secs) (at 2015-11-08 03:10:31.800452) ========= rm -rf scripts in dir /builds/slave/m-cen-l64-asan-ntly-0000000000/. (timeout 1200 secs) watching logfiles {} argv: ['rm', '-rf', 'scripts'] environment: CCACHE_HASHDIR= G_BROKEN_FILENAMES=1 HISTCONTROL=ignoredups HISTSIZE=1000 HOME=/home/cltbld HOSTNAME=bld-linux64-spot-471.build.releng.usw2.mozilla.com LANG=en_US.UTF-8 LESSOPEN=|/usr/bin/lesspipe.sh %s LOGNAME=cltbld MAIL=/var/spool/mail/cltbld PATH=/usr/local/bin:/usr/lib64/ccache:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/home/cltbld/bin PWD=/builds/slave/m-cen-l64-asan-ntly-0000000000 SHELL=/bin/bash SHLVL=1 TERM=linux TMOUT=86400 USER=cltbld _=/tools/buildbot/bin/python using PTY: False program finished with exit code 0 elapsedTime=0.002518 ========= master_lag: 0.05 ========= ========= Finished 'rm -rf ...' (results: 0, elapsed: 0 secs) (at 2015-11-08 03:10:31.848601) ========= ========= Started 'bash -c ...' (results: 0, elapsed: 0 secs) (at 2015-11-08 03:10:31.848937) ========= bash -c 'python /tools/checkouts/build-tools/buildfarm/utils/archiver_client.py mozharness --repo mozilla-central --rev e2a910c048dc82fc3be53475f18e7f81f03e377b --destination scripts --debug' in dir /builds/slave/m-cen-l64-asan-ntly-0000000000/. (timeout 1200 secs) watching logfiles {} argv: ['bash', '-c', 'python /tools/checkouts/build-tools/buildfarm/utils/archiver_client.py mozharness --repo mozilla-central --rev e2a910c048dc82fc3be53475f18e7f81f03e377b --destination scripts --debug'] environment: CCACHE_HASHDIR= G_BROKEN_FILENAMES=1 HISTCONTROL=ignoredups HISTSIZE=1000 HOME=/home/cltbld HOSTNAME=bld-linux64-spot-471.build.releng.usw2.mozilla.com LANG=en_US.UTF-8 LESSOPEN=|/usr/bin/lesspipe.sh %s LOGNAME=cltbld MAIL=/var/spool/mail/cltbld PATH=/usr/local/bin:/usr/lib64/ccache:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/home/cltbld/bin PWD=/builds/slave/m-cen-l64-asan-ntly-0000000000 SHELL=/bin/bash SHLVL=1 TERM=linux TMOUT=86400 USER=cltbld _=/tools/buildbot/bin/python using PTY: False 2015-11-08 03:10:31,904 truncating revision to first 12 chars 2015-11-08 03:10:31,904 Setting DEBUG logging. 2015-11-08 03:10:31,905 attempt 1/10 2015-11-08 03:10:31,905 Getting archive location from https://api.pub.build.mozilla.org/archiver/hgmo/mozilla-central/e2a910c048dc?&preferred_region=us-west-2&suffix=tar.gz&subdir=testing/mozharness 2015-11-08 03:10:32,283 unpacking tar archive at: mozilla-central-e2a910c048dc/testing/mozharness/ program finished with exit code 0 elapsedTime=0.543698 ========= master_lag: 0.01 ========= ========= Finished 'bash -c ...' (results: 0, elapsed: 0 secs) (at 2015-11-08 03:10:32.406124) ========= ========= Started downloading to oauth.txt (results: 0, elapsed: 0 secs) (at 2015-11-08 03:10:32.406451) ========= ========= Finished downloading to oauth.txt (results: 0, elapsed: 0 secs) (at 2015-11-08 03:10:32.417942) ========= ========= Started tinderboxprint_script_revlink (results: 0, elapsed: 0 secs) (at 2015-11-08 03:10:32.418198) ========= TinderboxPrint: script_revlink: https://hg.mozilla.org/build/mozharness/rev/production ========= Finished tinderboxprint_script_revlink (results: 0, elapsed: 0 secs) (at 2015-11-08 03:10:32.418579) ========= ========= Started '/tools/buildbot/bin/python scripts/scripts/fx_desktop_build.py ...' interrupted (results: 5, elapsed: 3 mins, 5 secs) (at 2015-11-08 03:10:32.418863) ========= /tools/buildbot/bin/python scripts/scripts/fx_desktop_build.py --config builds/releng_base_linux_64_builds.py --custom-build-variant-cfg asan --config balrog/production.py --branch mozilla-central --build-pool production --enable-nightly in dir /builds/slave/m-cen-l64-asan-ntly-0000000000/. (timeout 10800 secs) (maxTime 19800 secs) watching logfiles {} argv: ['/tools/buildbot/bin/python', 'scripts/scripts/fx_desktop_build.py', '--config', 'builds/releng_base_linux_64_builds.py', '--custom-build-variant-cfg', 'asan', '--config', 'balrog/production.py', '--branch', 'mozilla-central', '--build-pool', 'production', '--enable-nightly'] environment: CCACHE_COMPRESS=1 CCACHE_DIR=/builds/ccache CCACHE_HASHDIR= CCACHE_UMASK=002 DISPLAY=:2 G_BROKEN_FILENAMES=1 HG_SHARE_BASE_DIR=/builds/hg-shared HISTCONTROL=ignoredups HISTSIZE=1000 HOME=/home/cltbld HOSTNAME=bld-linux64-spot-471.build.releng.usw2.mozilla.com LANG=en_US.UTF-8 LC_ALL=C LESSOPEN=|/usr/bin/lesspipe.sh %s LOGNAME=cltbld MAIL=/var/spool/mail/cltbld MOZ_AUTOMATION=1 MOZ_CRASHREPORTER_NO_REPORT=1 MOZ_OBJDIR=obj-firefox MOZ_SYMBOLS_EXTRA_BUILDID=linux64-asan PATH=/tools/buildbot/bin:/usr/local/bin:/usr/lib64/ccache:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/tools/git/bin:/tools/python27/bin:/tools/python27-mercurial/bin:/home/cltbld/bin POST_SYMBOL_UPLOAD_CMD=/usr/local/bin/post-symbol-upload.py PROPERTIES_FILE=/builds/slave/m-cen-l64-asan-ntly-0000000000/buildprops.json PWD=/builds/slave/m-cen-l64-asan-ntly-0000000000 SHELL=/bin/bash SHLVL=1 SYMBOL_SERVER_HOST=symbolpush.mozilla.org SYMBOL_SERVER_PATH=/mnt/netapp/breakpad/symbols_ffx/ SYMBOL_SERVER_SSH_KEY=/home/mock_mozilla/.ssh/ffxbld_rsa SYMBOL_SERVER_USER=ffxbld TERM=linux TINDERBOX_OUTPUT=1 TMOUT=86400 TOOLTOOL_CACHE=/builds/tooltool_cache TOOLTOOL_HOME=/builds USER=cltbld _=/tools/buildbot/bin/python using PTY: False 03:10:32 INFO - MultiFileLogger online at 20151108 03:10:32 in /builds/slave/m-cen-l64-asan-ntly-0000000000 03:10:32 INFO - Script was run with '--custom-build-variant-cfg asan' and 'asan' matches a key in 'builds/releng_sub_linux_configs/64_asan.py'. Updating self.config with items from that key's value. 03:10:32 INFO - Script was run with '--branch mozilla-central' and 'mozilla-central' matches a key in 'builds/branch_specifics.py'. Updating self.config with items from that key's value. 03:10:32 INFO - Script was run with '--build-pool production' and 'production' matches a key in 'builds/build_pool_specifics.py'. Updating self.config with items from that key's value. 03:10:32 INFO - To generate a config file based upon options passed and config files used, run script as before but extend options with "--dump-config" 03:10:32 INFO - For a diff of where self.config got its items, run the script again as before but extend options with: "--dump-config-hierarchy" 03:10:32 INFO - Both --dump-config and --dump-config-hierarchy don't actually run any actions. 03:10:32 INFO - We are running this in buildbot, grab the build props 03:10:32 INFO - Using buildbot properties: 03:10:32 INFO - { 03:10:32 INFO - "properties": { 03:10:32 INFO - "buildnumber": 26, 03:10:32 INFO - "product": "firefox", 03:10:32 INFO - "script_repo_revision": "production", 03:10:32 INFO - "branch": "mozilla-central", 03:10:32 INFO - "repository": "", 03:10:32 INFO - "buildername": "Linux x86-64 mozilla-central asan nightly", 03:10:32 INFO - "buildid": "20151108030417", 03:10:32 INFO - "basedir": "/builds/slave/m-cen-l64-asan-ntly-0000000000", 03:10:32 INFO - "project": "", 03:10:32 INFO - "platform": "linux64-asan", 03:10:32 INFO - "master": "http://buildbot-master74.bb.releng.usw2.mozilla.com:8001/", 03:10:32 INFO - "scheduler": "mozilla-central nightly", 03:10:32 INFO - "repo_path": "mozilla-central", 03:10:32 INFO - "slavename": "bld-linux64-spot-471", 03:10:32 INFO - "builduid": "e6dc3ae838954565b651788113c7b119", 03:10:32 INFO - "revision": "e2a910c048dc82fc3be53475f18e7f81f03e377b" 03:10:32 INFO - }, 03:10:32 INFO - "sourcestamp": { 03:10:32 INFO - "repository": "", 03:10:32 INFO - "hasPatch": false, 03:10:32 INFO - "project": "", 03:10:32 INFO - "branch": "mozilla-central", 03:10:32 INFO - "changes": [], 03:10:32 INFO - "revision": "e2a910c048dc82fc3be53475f18e7f81f03e377b" 03:10:32 INFO - } 03:10:32 INFO - } 03:10:32 INFO - Setting buildbot property stage_platform to linux64-asan 03:10:32 INFO - mkdir: /builds/slave/m-cen-l64-asan-ntly-0000000000/properties 03:10:32 INFO - Writing buildbot properties ['stage_platform'] to /builds/slave/m-cen-l64-asan-ntly-0000000000/properties/stage_platform 03:10:32 INFO - Writing to file /builds/slave/m-cen-l64-asan-ntly-0000000000/properties/stage_platform 03:10:32 INFO - Contents: 03:10:32 INFO - stage_platform:linux64-asan 03:10:32 INFO - Run as scripts/scripts/fx_desktop_build.py --config builds/releng_base_linux_64_builds.py --custom-build-variant-cfg asan --config balrog/production.py --branch mozilla-central --build-pool production --enable-nightly 03:10:32 INFO - Determining buildid from buildbot properties 03:10:32 INFO - Setting buildbot property buildid to 20151108030417 03:10:32 INFO - Writing buildbot properties ['buildid'] to /builds/slave/m-cen-l64-asan-ntly-0000000000/properties/buildid 03:10:32 INFO - Writing to file /builds/slave/m-cen-l64-asan-ntly-0000000000/properties/buildid 03:10:32 INFO - Contents: 03:10:32 INFO - buildid:20151108030417 03:10:32 INFO - Determining builduid from buildbot properties 03:10:32 INFO - Setting buildbot property builduid to e6dc3ae838954565b651788113c7b119 03:10:32 INFO - Writing buildbot properties ['builduid'] to /builds/slave/m-cen-l64-asan-ntly-0000000000/properties/builduid 03:10:32 INFO - Writing to file /builds/slave/m-cen-l64-asan-ntly-0000000000/properties/builduid 03:10:32 INFO - Contents: 03:10:32 INFO - builduid:e6dc3ae838954565b651788113c7b119 03:10:32 INFO - Creating virtualenv /builds/slave/m-cen-l64-asan-ntly-0000000000/build/venv 03:10:32 INFO - mkdir: /builds/slave/m-cen-l64-asan-ntly-0000000000/build 03:10:32 INFO - Running command: ['virtualenv', '--no-site-packages', '--distribute', '/builds/slave/m-cen-l64-asan-ntly-0000000000/build/venv'] in /builds/slave/m-cen-l64-asan-ntly-0000000000/build 03:10:32 INFO - Copy/paste: virtualenv --no-site-packages --distribute /builds/slave/m-cen-l64-asan-ntly-0000000000/build/venv 03:10:32 INFO - The --no-site-packages flag is deprecated; it is now the default behavior. 03:10:32 INFO - New python executable in /builds/slave/m-cen-l64-asan-ntly-0000000000/build/venv/bin/python2.7 03:10:32 INFO - Also creating executable in /builds/slave/m-cen-l64-asan-ntly-0000000000/build/venv/bin/python 03:10:33 INFO - Installing distribute.............................................................................................................................................................................................done. 03:10:33 INFO - Installing pip...............done. 03:10:33 INFO - Return code: 0 03:10:33 INFO - Installing requests==2.2.1 into virtualenv /builds/slave/m-cen-l64-asan-ntly-0000000000/build/venv 03:10:33 INFO - retry: Calling run_command with args: [['/builds/slave/m-cen-l64-asan-ntly-0000000000/build/venv/bin/pip', 'install', '--download-cache', '/builds/slave/m-cen-l64-asan-ntly-0000000000/build/venv/cache', '--timeout', '120', 'requests==2.2.1']], kwargs: {'error_level': 'warning', 'error_list': [{'substr': 'not found or a compiler error:', 'level': 'warning'}, {'regex': <_sre.SRE_Pattern object at 0x2285350>, 'level': 'error'}, {'regex': <_sre.SRE_Pattern object at 0x215b8b8>, 'level': 'warning'}, {'regex': <_sre.SRE_Pattern object at 0x20fec10>, 'level': 'debug'}, {'substr': 'command not found', 'level': 'error'}, {'regex': <_sre.SRE_Pattern object at 0x2350440>, 'level': 'warning'}, {'substr': 'Traceback (most recent call last)', 'level': 'error'}, {'substr': 'SyntaxError: ', 'level': 'error'}, {'substr': 'TypeError: ', 'level': 'error'}, {'substr': 'NameError: ', 'level': 'error'}, {'substr': 'ZeroDivisionError: ', 'level': 'error'}, {'regex': <_sre.SRE_Pattern object at 0x1f14a50>, 'level': 'critical'}, {'regex': <_sre.SRE_Pattern object at 0x22b0350>, 'level': 'critical'}], 'cwd': '/builds/slave/m-cen-l64-asan-ntly-0000000000/build', 'env': {'MOZ_AUTOMATION': '1', 'LESSOPEN': '|/usr/bin/lesspipe.sh %s', 'TMOUT': '86400', 'LOGNAME': 'cltbld', 'USER': 'cltbld', 'MOZ_OBJDIR': 'obj-firefox', 'PATH': '/tools/buildbot/bin:/usr/local/bin:/usr/lib64/ccache:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/tools/git/bin:/tools/python27/bin:/tools/python27-mercurial/bin:/home/cltbld/bin', 'SYMBOL_SERVER_USER': 'ffxbld', 'DISPLAY': ':2', 'CCACHE_UMASK': '002', 'LANG': 'en_US.UTF-8', 'CCACHE_HASHDIR': '', 'TERM': 'linux', 'SHELL': '/bin/bash', 'MOZ_SYMBOLS_EXTRA_BUILDID': 'linux64-asan', 'SHLVL': '1', 'G_BROKEN_FILENAMES': '1', 'HISTSIZE': '1000', 'SYMBOL_SERVER_PATH': '/mnt/netapp/breakpad/symbols_ffx/', 'HOME': '/home/cltbld', 'HG_SHARE_BASE_DIR': '/builds/hg-shared', 'SYMBOL_SERVER_HOST': 'symbolpush.mozilla.org', 'CCACHE_DIR': '/builds/ccache', 'TINDERBOX_OUTPUT': '1', 'MAIL': '/var/spool/mail/cltbld', 'LC_ALL': 'C', 'TOOLTOOL_HOME': '/builds', '_': '/tools/buildbot/bin/python', 'HOSTNAME': 'bld-linux64-spot-471.build.releng.usw2.mozilla.com', 'SYMBOL_SERVER_SSH_KEY': '/home/mock_mozilla/.ssh/ffxbld_rsa', 'MOZBUILD_STATE_PATH': '/builds/slave/m-cen-l64-asan-ntly-0000000000/.mozbuild', 'HISTCONTROL': 'ignoredups', 'POST_SYMBOL_UPLOAD_CMD': '/usr/local/bin/post-symbol-upload.py', 'PWD': '/builds/slave/m-cen-l64-asan-ntly-0000000000', 'PROPERTIES_FILE': '/builds/slave/m-cen-l64-asan-ntly-0000000000/buildprops.json', 'MOZ_CRASHREPORTER_NO_REPORT': '1', 'CCACHE_COMPRESS': '1', 'TOOLTOOL_CACHE': '/builds/tooltool_cache'}}, attempt #1 03:10:33 INFO - Running command: ['/builds/slave/m-cen-l64-asan-ntly-0000000000/build/venv/bin/pip', 'install', '--download-cache', '/builds/slave/m-cen-l64-asan-ntly-0000000000/build/venv/cache', '--timeout', '120', 'requests==2.2.1'] in /builds/slave/m-cen-l64-asan-ntly-0000000000/build 03:10:33 INFO - Copy/paste: /builds/slave/m-cen-l64-asan-ntly-0000000000/build/venv/bin/pip install --download-cache /builds/slave/m-cen-l64-asan-ntly-0000000000/build/venv/cache --timeout 120 requests==2.2.1 03:10:33 INFO - Using env: {'CCACHE_COMPRESS': '1', 03:10:33 INFO - 'CCACHE_DIR': '/builds/ccache', 03:10:33 INFO - 'CCACHE_HASHDIR': '', 03:10:33 INFO - 'CCACHE_UMASK': '002', 03:10:33 INFO - 'DISPLAY': ':2', 03:10:33 INFO - 'G_BROKEN_FILENAMES': '1', 03:10:33 INFO - 'HG_SHARE_BASE_DIR': '/builds/hg-shared', 03:10:33 INFO - 'HISTCONTROL': 'ignoredups', 03:10:33 INFO - 'HISTSIZE': '1000', 03:10:33 INFO - 'HOME': '/home/cltbld', 03:10:33 INFO - 'HOSTNAME': 'bld-linux64-spot-471.build.releng.usw2.mozilla.com', 03:10:33 INFO - 'LANG': 'en_US.UTF-8', 03:10:33 INFO - 'LC_ALL': 'C', 03:10:33 INFO - 'LESSOPEN': '|/usr/bin/lesspipe.sh %s', 03:10:33 INFO - 'LOGNAME': 'cltbld', 03:10:33 INFO - 'MAIL': '/var/spool/mail/cltbld', 03:10:33 INFO - 'MOZBUILD_STATE_PATH': '/builds/slave/m-cen-l64-asan-ntly-0000000000/.mozbuild', 03:10:33 INFO - 'MOZ_AUTOMATION': '1', 03:10:33 INFO - 'MOZ_CRASHREPORTER_NO_REPORT': '1', 03:10:33 INFO - 'MOZ_OBJDIR': 'obj-firefox', 03:10:33 INFO - 'MOZ_SYMBOLS_EXTRA_BUILDID': 'linux64-asan', 03:10:33 INFO - 'PATH': '/tools/buildbot/bin:/usr/local/bin:/usr/lib64/ccache:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/tools/git/bin:/tools/python27/bin:/tools/python27-mercurial/bin:/home/cltbld/bin', 03:10:33 INFO - 'POST_SYMBOL_UPLOAD_CMD': '/usr/local/bin/post-symbol-upload.py', 03:10:33 INFO - 'PROPERTIES_FILE': '/builds/slave/m-cen-l64-asan-ntly-0000000000/buildprops.json', 03:10:33 INFO - 'PWD': '/builds/slave/m-cen-l64-asan-ntly-0000000000', 03:10:33 INFO - 'SHELL': '/bin/bash', 03:10:33 INFO - 'SHLVL': '1', 03:10:33 INFO - 'SYMBOL_SERVER_HOST': 'symbolpush.mozilla.org', 03:10:33 INFO - 'SYMBOL_SERVER_PATH': '/mnt/netapp/breakpad/symbols_ffx/', 03:10:33 INFO - 'SYMBOL_SERVER_SSH_KEY': '/home/mock_mozilla/.ssh/ffxbld_rsa', 03:10:33 INFO - 'SYMBOL_SERVER_USER': 'ffxbld', 03:10:33 INFO - 'TERM': 'linux', 03:10:33 INFO - 'TINDERBOX_OUTPUT': '1', 03:10:33 INFO - 'TMOUT': '86400', 03:10:33 INFO - 'TOOLTOOL_CACHE': '/builds/tooltool_cache', 03:10:33 INFO - 'TOOLTOOL_HOME': '/builds', 03:10:33 INFO - 'USER': 'cltbld', 03:10:33 INFO - '_': '/tools/buildbot/bin/python'} 03:10:35 INFO - Ignoring indexes: http://pypi.python.org/simple/ 03:10:35 INFO - Downloading/unpacking requests==2.2.1 03:10:35 INFO - Creating supposed download cache at /builds/slave/m-cen-l64-asan-ntly-0000000000/build/venv/cache 03:10:35 INFO - Storing download in cache at ./venv/cache/http%3A%2F%2Fpypi.pvt.build.mozilla.org%2Fpub%2Frequests-2.2.1.tar.gz 03:10:35 INFO - Running setup.py egg_info for package requests 03:10:35 INFO - Installing collected packages: requests 03:10:35 INFO - Running setup.py install for requests 03:10:35 INFO - Successfully installed requests 03:10:35 INFO - Cleaning up... 03:10:35 INFO - Return code: 0 03:10:35 INFO - Installing PyHawk-with-a-single-extra-commit==0.1.5 into virtualenv /builds/slave/m-cen-l64-asan-ntly-0000000000/build/venv 03:10:35 INFO - retry: Calling run_command with args: [['/builds/slave/m-cen-l64-asan-ntly-0000000000/build/venv/bin/pip', 'install', '--download-cache', '/builds/slave/m-cen-l64-asan-ntly-0000000000/build/venv/cache', '--timeout', '120', 'PyHawk-with-a-single-extra-commit==0.1.5']], kwargs: {'error_level': 'warning', 'error_list': [{'substr': 'not found or a compiler error:', 'level': 'warning'}, {'regex': <_sre.SRE_Pattern object at 0x2285350>, 'level': 'error'}, {'regex': <_sre.SRE_Pattern object at 0x215b8b8>, 'level': 'warning'}, {'regex': <_sre.SRE_Pattern object at 0x20fec10>, 'level': 'debug'}, {'substr': 'command not found', 'level': 'error'}, {'regex': <_sre.SRE_Pattern object at 0x2350440>, 'level': 'warning'}, {'substr': 'Traceback (most recent call last)', 'level': 'error'}, {'substr': 'SyntaxError: ', 'level': 'error'}, {'substr': 'TypeError: ', 'level': 'error'}, {'substr': 'NameError: ', 'level': 'error'}, {'substr': 'ZeroDivisionError: ', 'level': 'error'}, {'regex': <_sre.SRE_Pattern object at 0x1f14a50>, 'level': 'critical'}, {'regex': <_sre.SRE_Pattern object at 0x22b0350>, 'level': 'critical'}], 'cwd': '/builds/slave/m-cen-l64-asan-ntly-0000000000/build', 'env': {'MOZ_AUTOMATION': '1', 'LESSOPEN': '|/usr/bin/lesspipe.sh %s', 'TMOUT': '86400', 'LOGNAME': 'cltbld', 'USER': 'cltbld', 'MOZ_OBJDIR': 'obj-firefox', 'PATH': '/tools/buildbot/bin:/usr/local/bin:/usr/lib64/ccache:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/tools/git/bin:/tools/python27/bin:/tools/python27-mercurial/bin:/home/cltbld/bin', 'SYMBOL_SERVER_USER': 'ffxbld', 'DISPLAY': ':2', 'CCACHE_UMASK': '002', 'LANG': 'en_US.UTF-8', 'CCACHE_HASHDIR': '', 'TERM': 'linux', 'SHELL': '/bin/bash', 'MOZ_SYMBOLS_EXTRA_BUILDID': 'linux64-asan', 'SHLVL': '1', 'G_BROKEN_FILENAMES': '1', 'HISTSIZE': '1000', 'SYMBOL_SERVER_PATH': '/mnt/netapp/breakpad/symbols_ffx/', 'HOME': '/home/cltbld', 'HG_SHARE_BASE_DIR': '/builds/hg-shared', 'SYMBOL_SERVER_HOST': 'symbolpush.mozilla.org', 'CCACHE_DIR': '/builds/ccache', 'TINDERBOX_OUTPUT': '1', 'MAIL': '/var/spool/mail/cltbld', 'LC_ALL': 'C', 'TOOLTOOL_HOME': '/builds', '_': '/tools/buildbot/bin/python', 'HOSTNAME': 'bld-linux64-spot-471.build.releng.usw2.mozilla.com', 'SYMBOL_SERVER_SSH_KEY': '/home/mock_mozilla/.ssh/ffxbld_rsa', 'MOZBUILD_STATE_PATH': '/builds/slave/m-cen-l64-asan-ntly-0000000000/.mozbuild', 'HISTCONTROL': 'ignoredups', 'POST_SYMBOL_UPLOAD_CMD': '/usr/local/bin/post-symbol-upload.py', 'PWD': '/builds/slave/m-cen-l64-asan-ntly-0000000000', 'PROPERTIES_FILE': '/builds/slave/m-cen-l64-asan-ntly-0000000000/buildprops.json', 'MOZ_CRASHREPORTER_NO_REPORT': '1', 'CCACHE_COMPRESS': '1', 'TOOLTOOL_CACHE': '/builds/tooltool_cache'}}, attempt #1 03:10:35 INFO - Running command: ['/builds/slave/m-cen-l64-asan-ntly-0000000000/build/venv/bin/pip', 'install', '--download-cache', '/builds/slave/m-cen-l64-asan-ntly-0000000000/build/venv/cache', '--timeout', '120', 'PyHawk-with-a-single-extra-commit==0.1.5'] in /builds/slave/m-cen-l64-asan-ntly-0000000000/build 03:10:35 INFO - Copy/paste: /builds/slave/m-cen-l64-asan-ntly-0000000000/build/venv/bin/pip install --download-cache /builds/slave/m-cen-l64-asan-ntly-0000000000/build/venv/cache --timeout 120 PyHawk-with-a-single-extra-commit==0.1.5 03:10:35 INFO - Using env: {'CCACHE_COMPRESS': '1', 03:10:35 INFO - 'CCACHE_DIR': '/builds/ccache', 03:10:35 INFO - 'CCACHE_HASHDIR': '', 03:10:35 INFO - 'CCACHE_UMASK': '002', 03:10:35 INFO - 'DISPLAY': ':2', 03:10:35 INFO - 'G_BROKEN_FILENAMES': '1', 03:10:35 INFO - 'HG_SHARE_BASE_DIR': '/builds/hg-shared', 03:10:35 INFO - 'HISTCONTROL': 'ignoredups', 03:10:35 INFO - 'HISTSIZE': '1000', 03:10:35 INFO - 'HOME': '/home/cltbld', 03:10:35 INFO - 'HOSTNAME': 'bld-linux64-spot-471.build.releng.usw2.mozilla.com', 03:10:35 INFO - 'LANG': 'en_US.UTF-8', 03:10:35 INFO - 'LC_ALL': 'C', 03:10:35 INFO - 'LESSOPEN': '|/usr/bin/lesspipe.sh %s', 03:10:35 INFO - 'LOGNAME': 'cltbld', 03:10:35 INFO - 'MAIL': '/var/spool/mail/cltbld', 03:10:35 INFO - 'MOZBUILD_STATE_PATH': '/builds/slave/m-cen-l64-asan-ntly-0000000000/.mozbuild', 03:10:35 INFO - 'MOZ_AUTOMATION': '1', 03:10:35 INFO - 'MOZ_CRASHREPORTER_NO_REPORT': '1', 03:10:35 INFO - 'MOZ_OBJDIR': 'obj-firefox', 03:10:35 INFO - 'MOZ_SYMBOLS_EXTRA_BUILDID': 'linux64-asan', 03:10:35 INFO - 'PATH': '/tools/buildbot/bin:/usr/local/bin:/usr/lib64/ccache:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/tools/git/bin:/tools/python27/bin:/tools/python27-mercurial/bin:/home/cltbld/bin', 03:10:35 INFO - 'POST_SYMBOL_UPLOAD_CMD': '/usr/local/bin/post-symbol-upload.py', 03:10:35 INFO - 'PROPERTIES_FILE': '/builds/slave/m-cen-l64-asan-ntly-0000000000/buildprops.json', 03:10:35 INFO - 'PWD': '/builds/slave/m-cen-l64-asan-ntly-0000000000', 03:10:35 INFO - 'SHELL': '/bin/bash', 03:10:35 INFO - 'SHLVL': '1', 03:10:35 INFO - 'SYMBOL_SERVER_HOST': 'symbolpush.mozilla.org', 03:10:35 INFO - 'SYMBOL_SERVER_PATH': '/mnt/netapp/breakpad/symbols_ffx/', 03:10:35 INFO - 'SYMBOL_SERVER_SSH_KEY': '/home/mock_mozilla/.ssh/ffxbld_rsa', 03:10:35 INFO - 'SYMBOL_SERVER_USER': 'ffxbld', 03:10:35 INFO - 'TERM': 'linux', 03:10:35 INFO - 'TINDERBOX_OUTPUT': '1', 03:10:35 INFO - 'TMOUT': '86400', 03:10:35 INFO - 'TOOLTOOL_CACHE': '/builds/tooltool_cache', 03:10:35 INFO - 'TOOLTOOL_HOME': '/builds', 03:10:35 INFO - 'USER': 'cltbld', 03:10:35 INFO - '_': '/tools/buildbot/bin/python'} 03:10:36 INFO - Ignoring indexes: http://pypi.python.org/simple/ 03:10:36 INFO - Downloading/unpacking PyHawk-with-a-single-extra-commit==0.1.5 03:10:36 INFO - Downloading PyHawk-with-a-single-extra-commit-0.1.5.tar.gz 03:10:36 INFO - Storing download in cache at ./venv/cache/http%3A%2F%2Fpypi.pvt.build.mozilla.org%2Fpub%2FPyHawk-with-a-single-extra-commit-0.1.5.tar.gz 03:10:36 INFO - Running setup.py egg_info for package PyHawk-with-a-single-extra-commit 03:10:36 INFO - Installing collected packages: PyHawk-with-a-single-extra-commit 03:10:36 INFO - Running setup.py install for PyHawk-with-a-single-extra-commit 03:10:36 INFO - Successfully installed PyHawk-with-a-single-extra-commit 03:10:36 INFO - Cleaning up... 03:10:36 INFO - Return code: 0 03:10:36 INFO - Installing taskcluster==0.0.15 into virtualenv /builds/slave/m-cen-l64-asan-ntly-0000000000/build/venv 03:10:36 INFO - retry: Calling run_command with args: [['/builds/slave/m-cen-l64-asan-ntly-0000000000/build/venv/bin/pip', 'install', '--download-cache', '/builds/slave/m-cen-l64-asan-ntly-0000000000/build/venv/cache', '--timeout', '120', 'taskcluster==0.0.15']], kwargs: {'error_level': 'warning', 'error_list': [{'substr': 'not found or a compiler error:', 'level': 'warning'}, {'regex': <_sre.SRE_Pattern object at 0x2285350>, 'level': 'error'}, {'regex': <_sre.SRE_Pattern object at 0x215b8b8>, 'level': 'warning'}, {'regex': <_sre.SRE_Pattern object at 0x20fec10>, 'level': 'debug'}, {'substr': 'command not found', 'level': 'error'}, {'regex': <_sre.SRE_Pattern object at 0x2350440>, 'level': 'warning'}, {'substr': 'Traceback (most recent call last)', 'level': 'error'}, {'substr': 'SyntaxError: ', 'level': 'error'}, {'substr': 'TypeError: ', 'level': 'error'}, {'substr': 'NameError: ', 'level': 'error'}, {'substr': 'ZeroDivisionError: ', 'level': 'error'}, {'regex': <_sre.SRE_Pattern object at 0x1f14a50>, 'level': 'critical'}, {'regex': <_sre.SRE_Pattern object at 0x22b0350>, 'level': 'critical'}], 'cwd': '/builds/slave/m-cen-l64-asan-ntly-0000000000/build', 'env': {'MOZ_AUTOMATION': '1', 'LESSOPEN': '|/usr/bin/lesspipe.sh %s', 'TMOUT': '86400', 'LOGNAME': 'cltbld', 'USER': 'cltbld', 'MOZ_OBJDIR': 'obj-firefox', 'PATH': '/tools/buildbot/bin:/usr/local/bin:/usr/lib64/ccache:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/tools/git/bin:/tools/python27/bin:/tools/python27-mercurial/bin:/home/cltbld/bin', 'SYMBOL_SERVER_USER': 'ffxbld', 'DISPLAY': ':2', 'CCACHE_UMASK': '002', 'LANG': 'en_US.UTF-8', 'CCACHE_HASHDIR': '', 'TERM': 'linux', 'SHELL': '/bin/bash', 'MOZ_SYMBOLS_EXTRA_BUILDID': 'linux64-asan', 'SHLVL': '1', 'G_BROKEN_FILENAMES': '1', 'HISTSIZE': '1000', 'SYMBOL_SERVER_PATH': '/mnt/netapp/breakpad/symbols_ffx/', 'HOME': '/home/cltbld', 'HG_SHARE_BASE_DIR': '/builds/hg-shared', 'SYMBOL_SERVER_HOST': 'symbolpush.mozilla.org', 'CCACHE_DIR': '/builds/ccache', 'TINDERBOX_OUTPUT': '1', 'MAIL': '/var/spool/mail/cltbld', 'LC_ALL': 'C', 'TOOLTOOL_HOME': '/builds', '_': '/tools/buildbot/bin/python', 'HOSTNAME': 'bld-linux64-spot-471.build.releng.usw2.mozilla.com', 'SYMBOL_SERVER_SSH_KEY': '/home/mock_mozilla/.ssh/ffxbld_rsa', 'MOZBUILD_STATE_PATH': '/builds/slave/m-cen-l64-asan-ntly-0000000000/.mozbuild', 'HISTCONTROL': 'ignoredups', 'POST_SYMBOL_UPLOAD_CMD': '/usr/local/bin/post-symbol-upload.py', 'PWD': '/builds/slave/m-cen-l64-asan-ntly-0000000000', 'PROPERTIES_FILE': '/builds/slave/m-cen-l64-asan-ntly-0000000000/buildprops.json', 'MOZ_CRASHREPORTER_NO_REPORT': '1', 'CCACHE_COMPRESS': '1', 'TOOLTOOL_CACHE': '/builds/tooltool_cache'}}, attempt #1 03:10:36 INFO - Running command: ['/builds/slave/m-cen-l64-asan-ntly-0000000000/build/venv/bin/pip', 'install', '--download-cache', '/builds/slave/m-cen-l64-asan-ntly-0000000000/build/venv/cache', '--timeout', '120', 'taskcluster==0.0.15'] in /builds/slave/m-cen-l64-asan-ntly-0000000000/build 03:10:36 INFO - Copy/paste: /builds/slave/m-cen-l64-asan-ntly-0000000000/build/venv/bin/pip install --download-cache /builds/slave/m-cen-l64-asan-ntly-0000000000/build/venv/cache --timeout 120 taskcluster==0.0.15 03:10:36 INFO - Using env: {'CCACHE_COMPRESS': '1', 03:10:36 INFO - 'CCACHE_DIR': '/builds/ccache', 03:10:36 INFO - 'CCACHE_HASHDIR': '', 03:10:36 INFO - 'CCACHE_UMASK': '002', 03:10:36 INFO - 'DISPLAY': ':2', 03:10:36 INFO - 'G_BROKEN_FILENAMES': '1', 03:10:36 INFO - 'HG_SHARE_BASE_DIR': '/builds/hg-shared', 03:10:36 INFO - 'HISTCONTROL': 'ignoredups', 03:10:36 INFO - 'HISTSIZE': '1000', 03:10:36 INFO - 'HOME': '/home/cltbld', 03:10:36 INFO - 'HOSTNAME': 'bld-linux64-spot-471.build.releng.usw2.mozilla.com', 03:10:36 INFO - 'LANG': 'en_US.UTF-8', 03:10:36 INFO - 'LC_ALL': 'C', 03:10:36 INFO - 'LESSOPEN': '|/usr/bin/lesspipe.sh %s', 03:10:36 INFO - 'LOGNAME': 'cltbld', 03:10:36 INFO - 'MAIL': '/var/spool/mail/cltbld', 03:10:36 INFO - 'MOZBUILD_STATE_PATH': '/builds/slave/m-cen-l64-asan-ntly-0000000000/.mozbuild', 03:10:36 INFO - 'MOZ_AUTOMATION': '1', 03:10:36 INFO - 'MOZ_CRASHREPORTER_NO_REPORT': '1', 03:10:36 INFO - 'MOZ_OBJDIR': 'obj-firefox', 03:10:36 INFO - 'MOZ_SYMBOLS_EXTRA_BUILDID': 'linux64-asan', 03:10:36 INFO - 'PATH': '/tools/buildbot/bin:/usr/local/bin:/usr/lib64/ccache:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/tools/git/bin:/tools/python27/bin:/tools/python27-mercurial/bin:/home/cltbld/bin', 03:10:36 INFO - 'POST_SYMBOL_UPLOAD_CMD': '/usr/local/bin/post-symbol-upload.py', 03:10:36 INFO - 'PROPERTIES_FILE': '/builds/slave/m-cen-l64-asan-ntly-0000000000/buildprops.json', 03:10:36 INFO - 'PWD': '/builds/slave/m-cen-l64-asan-ntly-0000000000', 03:10:36 INFO - 'SHELL': '/bin/bash', 03:10:36 INFO - 'SHLVL': '1', 03:10:36 INFO - 'SYMBOL_SERVER_HOST': 'symbolpush.mozilla.org', 03:10:36 INFO - 'SYMBOL_SERVER_PATH': '/mnt/netapp/breakpad/symbols_ffx/', 03:10:36 INFO - 'SYMBOL_SERVER_SSH_KEY': '/home/mock_mozilla/.ssh/ffxbld_rsa', 03:10:36 INFO - 'SYMBOL_SERVER_USER': 'ffxbld', 03:10:36 INFO - 'TERM': 'linux', 03:10:36 INFO - 'TINDERBOX_OUTPUT': '1', 03:10:36 INFO - 'TMOUT': '86400', 03:10:36 INFO - 'TOOLTOOL_CACHE': '/builds/tooltool_cache', 03:10:36 INFO - 'TOOLTOOL_HOME': '/builds', 03:10:36 INFO - 'USER': 'cltbld', 03:10:36 INFO - '_': '/tools/buildbot/bin/python'} remoteFailed: [Failure instance: Traceback (failure with no frames): : Connection to the other side was lost in a non-clean fashion. ] [Failure instance: Traceback (failure with no frames): : Connection to the other side was lost in a non-clean fashion. ] ========= Finished '/tools/buildbot/bin/python scripts/scripts/fx_desktop_build.py ...' interrupted (results: 5, elapsed: 3 mins, 5 secs) (at 2015-11-08 03:13:37.630172) ========= ========= Skipped (results: not started, elapsed: not started) ========= ========= Skipped (results: not started, elapsed: not started) ========= ========= Skipped (results: not started, elapsed: not started) ========= ========= Total master_lag: 0.15 =========