builder: mozilla-central-linux64-asan-debug-nightly slave: bld-linux64-spot-283 starttime: 1462792914.93 results: exception (4) buildid: 20160509041458 builduid: b180be2732cd45dfa522f66ec456e8c4 revision: 043082cb7bd8 ========= Started set props: master (results: 0, elapsed: 0 secs) (at 2016-05-09 04:21:54.933426) ========= master: http://buildbot-master70.bb.releng.use1.mozilla.com:8001/ ========= Finished set props: master (results: 0, elapsed: 0 secs) (at 2016-05-09 04:21:54.933871) ========= ========= Started downloading to buildprops.json (results: 0, elapsed: 0 secs) (at 2016-05-09 04:21:54.934156) ========= ========= Finished downloading to buildprops.json (results: 0, elapsed: 0 secs) (at 2016-05-09 04:21:54.953479) ========= ========= Started 'rm -rf ...' (results: 0, elapsed: 0 secs) (at 2016-05-09 04:21:54.953796) ========= rm -rf scripts properties in dir /builds/slave/m-cen-l64-asan-d-ntly-00000000/. (timeout 1200 secs) watching logfiles {} argv: ['rm', '-rf', 'scripts', 'properties'] environment: CCACHE_HASHDIR= G_BROKEN_FILENAMES=1 HISTCONTROL=ignoredups HISTSIZE=1000 HOME=/home/cltbld HOSTNAME=bld-linux64-spot-283.build.releng.use1.mozilla.com LANG=en_US.UTF-8 LESSOPEN=|/usr/bin/lesspipe.sh %s LOGNAME=cltbld MAIL=/var/spool/mail/cltbld PATH=/usr/local/bin:/usr/lib64/ccache:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/home/cltbld/bin PWD=/builds/slave/m-cen-l64-asan-d-ntly-00000000 SHELL=/bin/bash SHLVL=1 TERM=linux TMOUT=86400 USER=cltbld _=/tools/buildbot/bin/python using PTY: False program finished with exit code 0 elapsedTime=0.003072 ========= master_lag: 0.05 ========= ========= Finished 'rm -rf ...' (results: 0, elapsed: 0 secs) (at 2016-05-09 04:21:55.004162) ========= ========= Started 'bash -c ...' (results: 0, elapsed: 2 secs) (at 2016-05-09 04:21:55.004476) ========= bash -c 'python /tools/checkouts/build-tools/buildfarm/utils/archiver_client.py mozharness --repo mozilla-central --rev 043082cb7bd8 --destination scripts --debug' in dir /builds/slave/m-cen-l64-asan-d-ntly-00000000/. (timeout 1200 secs) watching logfiles {} argv: ['bash', '-c', 'python /tools/checkouts/build-tools/buildfarm/utils/archiver_client.py mozharness --repo mozilla-central --rev 043082cb7bd8 --destination scripts --debug'] environment: CCACHE_HASHDIR= G_BROKEN_FILENAMES=1 HISTCONTROL=ignoredups HISTSIZE=1000 HOME=/home/cltbld HOSTNAME=bld-linux64-spot-283.build.releng.use1.mozilla.com LANG=en_US.UTF-8 LESSOPEN=|/usr/bin/lesspipe.sh %s LOGNAME=cltbld MAIL=/var/spool/mail/cltbld PATH=/usr/local/bin:/usr/lib64/ccache:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/home/cltbld/bin PWD=/builds/slave/m-cen-l64-asan-d-ntly-00000000 SHELL=/bin/bash SHLVL=1 TERM=linux TMOUT=86400 USER=cltbld _=/tools/buildbot/bin/python using PTY: False 2016-05-09 04:21:55,049 Setting DEBUG logging. 2016-05-09 04:21:55,050 attempt 1/10 2016-05-09 04:21:55,050 Getting archive location from https://api.pub.build.mozilla.org/archiver/hgmo/mozilla-central/043082cb7bd8?&preferred_region=us-west-2&suffix=tar.gz&subdir=testing/mozharness 2016-05-09 04:21:56,550 unpacking tar archive at: mozilla-central-043082cb7bd8/testing/mozharness/ program finished with exit code 0 elapsedTime=2.080987 ========= master_lag: 0.01 ========= ========= Finished 'bash -c ...' (results: 0, elapsed: 2 secs) (at 2016-05-09 04:21:57.098639) ========= ========= Started set props: script_repo_revision (results: 0, elapsed: 0 secs) (at 2016-05-09 04:21:57.098938) ========= script_repo_revision: 043082cb7bd8 ========= Finished set props: script_repo_revision (results: 0, elapsed: 0 secs) (at 2016-05-09 04:21:57.099295) ========= ========= Started downloading to oauth.txt (results: 0, elapsed: 0 secs) (at 2016-05-09 04:21:57.099585) ========= ========= Finished downloading to oauth.txt (results: 0, elapsed: 0 secs) (at 2016-05-09 04:21:57.113155) ========= ========= Started '/tools/buildbot/bin/python scripts/scripts/fx_desktop_build.py ...' exception (results: 4, elapsed: 11 mins, 53 secs) (at 2016-05-09 04:21:57.113432) ========= /tools/buildbot/bin/python scripts/scripts/fx_desktop_build.py --config builds/releng_base_linux_64_builds.py --custom-build-variant-cfg asan-and-debug --config balrog/production.py --branch mozilla-central --build-pool production --enable-nightly in dir /builds/slave/m-cen-l64-asan-d-ntly-00000000/. (timeout 10800 secs) (maxTime 19800 secs) watching logfiles {} argv: ['/tools/buildbot/bin/python', 'scripts/scripts/fx_desktop_build.py', '--config', 'builds/releng_base_linux_64_builds.py', '--custom-build-variant-cfg', 'asan-and-debug', '--config', 'balrog/production.py', '--branch', 'mozilla-central', '--build-pool', 'production', '--enable-nightly'] environment: CCACHE_COMPRESS=1 CCACHE_DIR=/builds/ccache CCACHE_HASHDIR= CCACHE_UMASK=002 DISPLAY=:2 G_BROKEN_FILENAMES=1 HG_SHARE_BASE_DIR=/builds/hg-shared HISTCONTROL=ignoredups HISTSIZE=1000 HOME=/home/cltbld HOSTNAME=bld-linux64-spot-283.build.releng.use1.mozilla.com LANG=en_US.UTF-8 LC_ALL=C LESSOPEN=|/usr/bin/lesspipe.sh %s LOGNAME=cltbld MAIL=/var/spool/mail/cltbld MOZ_AUTOMATION=1 MOZ_CRASHREPORTER_NO_REPORT=1 MOZ_OBJDIR=obj-firefox PATH=/tools/buildbot/bin:/usr/local/bin:/usr/lib64/ccache:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/tools/git/bin:/tools/python27/bin:/tools/python27-mercurial/bin:/home/cltbld/bin PROPERTIES_FILE=/builds/slave/m-cen-l64-asan-d-ntly-00000000/buildprops.json PWD=/builds/slave/m-cen-l64-asan-d-ntly-00000000 SHELL=/bin/bash SHLVL=1 TERM=linux TINDERBOX_OUTPUT=1 TMOUT=86400 TOOLTOOL_CACHE=/builds/tooltool_cache TOOLTOOL_HOME=/builds USER=cltbld _=/tools/buildbot/bin/python using PTY: False 04:21:57 INFO - MultiFileLogger online at 20160509 04:21:57 in /builds/slave/m-cen-l64-asan-d-ntly-00000000 04:21:57 INFO - Script was run with '--custom-build-variant-cfg asan-and-debug' and 'asan-and-debug' matches a key in 'builds/releng_sub_linux_configs/64_asan_and_debug.py'. Updating self.config with items from that key's value. 04:21:57 INFO - Script was run with '--branch mozilla-central' and 'mozilla-central' matches a key in 'builds/branch_specifics.py'. Updating self.config with items from that key's value. 04:21:57 INFO - Script was run with '--build-pool production' and 'production' matches a key in 'builds/build_pool_specifics.py'. Updating self.config with items from that key's value. 04:21:57 INFO - To generate a config file based upon options passed and config files used, run script as before but extend options with "--dump-config" 04:21:57 INFO - For a diff of where self.config got its items, run the script again as before but extend options with: "--dump-config-hierarchy" 04:21:57 INFO - Both --dump-config and --dump-config-hierarchy don't actually run any actions. 04:21:57 INFO - We are running this in buildbot, grab the build props 04:21:57 INFO - Using buildbot properties: 04:21:57 INFO - { 04:21:57 INFO - "project": "", 04:21:57 INFO - "product": "firefox", 04:21:57 INFO - "script_repo_revision": "production", 04:21:57 INFO - "repository": "", 04:21:57 INFO - "buildername": "Linux x86-64 mozilla-central debug asan nightly", 04:21:57 INFO - "buildid": "20160509041458", 04:21:57 INFO - "basedir": "/builds/slave/m-cen-l64-asan-d-ntly-00000000", 04:21:57 INFO - "buildnumber": 2, 04:21:57 INFO - "platform": "linux64-asan-debug", 04:21:57 INFO - "master": "http://buildbot-master70.bb.releng.use1.mozilla.com:8001/", 04:21:57 INFO - "branch": "mozilla-central", 04:21:57 INFO - "revision": "043082cb7bd8", 04:21:57 INFO - "slavename": "bld-linux64-spot-283", 04:21:57 INFO - "builduid": "b180be2732cd45dfa522f66ec456e8c4", 04:21:57 INFO - "repo_path": "mozilla-central" 04:21:57 INFO - } 04:21:57 INFO - Setting buildbot property stage_platform to linux64-asan-debug 04:21:57 INFO - mkdir: /builds/slave/m-cen-l64-asan-d-ntly-00000000/properties 04:21:57 INFO - Writing buildbot properties ['stage_platform'] to /builds/slave/m-cen-l64-asan-d-ntly-00000000/properties/stage_platform 04:21:57 INFO - Writing to file /builds/slave/m-cen-l64-asan-d-ntly-00000000/properties/stage_platform 04:21:57 INFO - Contents: 04:21:57 INFO - stage_platform:linux64-asan-debug 04:21:57 INFO - Run as scripts/scripts/fx_desktop_build.py --config builds/releng_base_linux_64_builds.py --custom-build-variant-cfg asan-and-debug --config balrog/production.py --branch mozilla-central --build-pool production --enable-nightly 04:21:57 INFO - Determining buildid from buildbot properties 04:21:57 INFO - Setting buildbot property buildid to 20160509041458 04:21:57 INFO - Writing buildbot properties ['buildid'] to /builds/slave/m-cen-l64-asan-d-ntly-00000000/properties/buildid 04:21:57 INFO - Writing to file /builds/slave/m-cen-l64-asan-d-ntly-00000000/properties/buildid 04:21:57 INFO - Contents: 04:21:57 INFO - buildid:20160509041458 04:21:57 INFO - Determining builduid from buildbot properties 04:21:57 INFO - Setting buildbot property builduid to b180be2732cd45dfa522f66ec456e8c4 04:21:57 INFO - Writing buildbot properties ['builduid'] to /builds/slave/m-cen-l64-asan-d-ntly-00000000/properties/builduid 04:21:57 INFO - Writing to file /builds/slave/m-cen-l64-asan-d-ntly-00000000/properties/builduid 04:21:57 INFO - Contents: 04:21:57 INFO - builduid:b180be2732cd45dfa522f66ec456e8c4 04:21:57 INFO - Creating virtualenv /builds/slave/m-cen-l64-asan-d-ntly-00000000/build/venv 04:21:57 INFO - mkdir: /builds/slave/m-cen-l64-asan-d-ntly-00000000/build 04:21:57 INFO - Running command: ['virtualenv', '--no-site-packages', '--distribute', '/builds/slave/m-cen-l64-asan-d-ntly-00000000/build/venv'] in /builds/slave/m-cen-l64-asan-d-ntly-00000000/build 04:21:57 INFO - Copy/paste: virtualenv --no-site-packages --distribute /builds/slave/m-cen-l64-asan-d-ntly-00000000/build/venv 04:21:57 INFO - The --no-site-packages flag is deprecated; it is now the default behavior. 04:21:57 INFO - New python executable in /builds/slave/m-cen-l64-asan-d-ntly-00000000/build/venv/bin/python2.7 04:21:57 INFO - Also creating executable in /builds/slave/m-cen-l64-asan-d-ntly-00000000/build/venv/bin/python 04:21:57 INFO - Installing distribute.............................................................................................................................................................................................done. 04:21:58 INFO - Installing pip...............done. 04:21:58 INFO - Return code: 0 04:21:58 INFO - Installing requests==2.8.1 into virtualenv /builds/slave/m-cen-l64-asan-d-ntly-00000000/build/venv 04:21:58 INFO - retry: Calling run_command with args: [['/builds/slave/m-cen-l64-asan-d-ntly-00000000/build/venv/bin/pip', 'install', '--timeout', '120', 'requests==2.8.1']], kwargs: {'error_level': 'warning', 'error_list': [{'substr': 'not found or a compiler error:', 'level': 'warning'}, {'regex': <_sre.SRE_Pattern object at 0x15700d0>, 'level': 'error'}, {'regex': <_sre.SRE_Pattern object at 0x16d8b58>, 'level': 'warning'}, {'regex': <_sre.SRE_Pattern object at 0x1732b60>, 'level': 'debug'}, {'substr': 'command not found', 'level': 'error'}, {'regex': <_sre.SRE_Pattern object at 0x16c62a0>, 'level': 'warning'}, {'substr': 'Traceback (most recent call last)', 'level': 'error'}, {'substr': 'SyntaxError: ', 'level': 'error'}, {'substr': 'TypeError: ', 'level': 'error'}, {'substr': 'NameError: ', 'level': 'error'}, {'substr': 'ZeroDivisionError: ', 'level': 'error'}, {'regex': <_sre.SRE_Pattern object at 0x16df618>, 'level': 'critical'}, {'regex': <_sre.SRE_Pattern object at 0x148a418>, 'level': 'critical'}], 'cwd': '/builds/slave/m-cen-l64-asan-d-ntly-00000000/build', 'env': {'MOZ_AUTOMATION': '1', 'LESSOPEN': '|/usr/bin/lesspipe.sh %s', 'TMOUT': '86400', 'LOGNAME': 'cltbld', 'USER': 'cltbld', 'MOZ_OBJDIR': 'obj-firefox', 'PATH': '/tools/buildbot/bin:/usr/local/bin:/usr/lib64/ccache:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/tools/git/bin:/tools/python27/bin:/tools/python27-mercurial/bin:/home/cltbld/bin', 'DISPLAY': ':2', 'CCACHE_UMASK': '002', 'LANG': 'en_US.UTF-8', 'CCACHE_HASHDIR': '', 'TERM': 'linux', 'SHELL': '/bin/bash', 'SHLVL': '1', 'G_BROKEN_FILENAMES': '1', 'HISTSIZE': '1000', 'HOME': '/home/cltbld', 'HG_SHARE_BASE_DIR': '/builds/hg-shared', 'TINDERBOX_OUTPUT': '1', 'MOZ_CRASHREPORTER_NO_REPORT': '1', 'LC_ALL': 'C', 'TOOLTOOL_HOME': '/builds', '_': '/tools/buildbot/bin/python', 'MAIL': '/var/spool/mail/cltbld', 'HOSTNAME': 'bld-linux64-spot-283.build.releng.use1.mozilla.com', 'MOZBUILD_STATE_PATH': '/builds/slave/m-cen-l64-asan-d-ntly-00000000/.mozbuild', 'HISTCONTROL': 'ignoredups', 'PWD': '/builds/slave/m-cen-l64-asan-d-ntly-00000000', 'PROPERTIES_FILE': '/builds/slave/m-cen-l64-asan-d-ntly-00000000/buildprops.json', 'CCACHE_DIR': '/builds/ccache', 'CCACHE_COMPRESS': '1', 'TOOLTOOL_CACHE': '/builds/tooltool_cache'}}, attempt #1 04:21:58 INFO - Running command: ['/builds/slave/m-cen-l64-asan-d-ntly-00000000/build/venv/bin/pip', 'install', '--timeout', '120', 'requests==2.8.1'] in /builds/slave/m-cen-l64-asan-d-ntly-00000000/build 04:21:58 INFO - Copy/paste: /builds/slave/m-cen-l64-asan-d-ntly-00000000/build/venv/bin/pip install --timeout 120 requests==2.8.1 04:21:58 INFO - Using env: {'CCACHE_COMPRESS': '1', 04:21:58 INFO - 'CCACHE_DIR': '/builds/ccache', 04:21:58 INFO - 'CCACHE_HASHDIR': '', 04:21:58 INFO - 'CCACHE_UMASK': '002', 04:21:58 INFO - 'DISPLAY': ':2', 04:21:58 INFO - 'G_BROKEN_FILENAMES': '1', 04:21:58 INFO - 'HG_SHARE_BASE_DIR': '/builds/hg-shared', 04:21:58 INFO - 'HISTCONTROL': 'ignoredups', 04:21:58 INFO - 'HISTSIZE': '1000', 04:21:58 INFO - 'HOME': '/home/cltbld', 04:21:58 INFO - 'HOSTNAME': 'bld-linux64-spot-283.build.releng.use1.mozilla.com', 04:21:58 INFO - 'LANG': 'en_US.UTF-8', 04:21:58 INFO - 'LC_ALL': 'C', 04:21:58 INFO - 'LESSOPEN': '|/usr/bin/lesspipe.sh %s', 04:21:58 INFO - 'LOGNAME': 'cltbld', 04:21:58 INFO - 'MAIL': '/var/spool/mail/cltbld', 04:21:58 INFO - 'MOZBUILD_STATE_PATH': '/builds/slave/m-cen-l64-asan-d-ntly-00000000/.mozbuild', 04:21:58 INFO - 'MOZ_AUTOMATION': '1', 04:21:58 INFO - 'MOZ_CRASHREPORTER_NO_REPORT': '1', 04:21:58 INFO - 'MOZ_OBJDIR': 'obj-firefox', 04:21:58 INFO - 'PATH': '/tools/buildbot/bin:/usr/local/bin:/usr/lib64/ccache:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/tools/git/bin:/tools/python27/bin:/tools/python27-mercurial/bin:/home/cltbld/bin', 04:21:58 INFO - 'PROPERTIES_FILE': '/builds/slave/m-cen-l64-asan-d-ntly-00000000/buildprops.json', 04:21:58 INFO - 'PWD': '/builds/slave/m-cen-l64-asan-d-ntly-00000000', 04:21:58 INFO - 'SHELL': '/bin/bash', 04:21:58 INFO - 'SHLVL': '1', 04:21:58 INFO - 'TERM': 'linux', 04:21:58 INFO - 'TINDERBOX_OUTPUT': '1', 04:21:58 INFO - 'TMOUT': '86400', 04:21:58 INFO - 'TOOLTOOL_CACHE': '/builds/tooltool_cache', 04:21:58 INFO - 'TOOLTOOL_HOME': '/builds', 04:21:58 INFO - 'USER': 'cltbld', 04:21:58 INFO - '_': '/tools/buildbot/bin/python'} 04:22:00 INFO - Ignoring indexes: http://pypi.python.org/simple/ 04:22:00 INFO - Downloading/unpacking requests==2.8.1 04:22:00 INFO - Running setup.py egg_info for package requests 04:22:00 INFO - Installing collected packages: requests 04:22:00 INFO - Running setup.py install for requests 04:22:00 INFO - Successfully installed requests 04:22:00 INFO - Cleaning up... 04:22:00 INFO - Return code: 0 04:22:00 INFO - Installing PyHawk-with-a-single-extra-commit==0.1.5 into virtualenv /builds/slave/m-cen-l64-asan-d-ntly-00000000/build/venv 04:22:00 INFO - retry: Calling run_command with args: [['/builds/slave/m-cen-l64-asan-d-ntly-00000000/build/venv/bin/pip', 'install', '--timeout', '120', 'PyHawk-with-a-single-extra-commit==0.1.5']], kwargs: {'error_level': 'warning', 'error_list': [{'substr': 'not found or a compiler error:', 'level': 'warning'}, {'regex': <_sre.SRE_Pattern object at 0x15700d0>, 'level': 'error'}, {'regex': <_sre.SRE_Pattern object at 0x16d8b58>, 'level': 'warning'}, {'regex': <_sre.SRE_Pattern object at 0x1732b60>, 'level': 'debug'}, {'substr': 'command not found', 'level': 'error'}, {'regex': <_sre.SRE_Pattern object at 0x16c62a0>, 'level': 'warning'}, {'substr': 'Traceback (most recent call last)', 'level': 'error'}, {'substr': 'SyntaxError: ', 'level': 'error'}, {'substr': 'TypeError: ', 'level': 'error'}, {'substr': 'NameError: ', 'level': 'error'}, {'substr': 'ZeroDivisionError: ', 'level': 'error'}, {'regex': <_sre.SRE_Pattern object at 0x16df618>, 'level': 'critical'}, {'regex': <_sre.SRE_Pattern object at 0x148a418>, 'level': 'critical'}], 'cwd': '/builds/slave/m-cen-l64-asan-d-ntly-00000000/build', 'env': {'MOZ_AUTOMATION': '1', 'LESSOPEN': '|/usr/bin/lesspipe.sh %s', 'TMOUT': '86400', 'LOGNAME': 'cltbld', 'USER': 'cltbld', 'MOZ_OBJDIR': 'obj-firefox', 'PATH': '/tools/buildbot/bin:/usr/local/bin:/usr/lib64/ccache:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/tools/git/bin:/tools/python27/bin:/tools/python27-mercurial/bin:/home/cltbld/bin', 'DISPLAY': ':2', 'CCACHE_UMASK': '002', 'LANG': 'en_US.UTF-8', 'CCACHE_HASHDIR': '', 'TERM': 'linux', 'SHELL': '/bin/bash', 'SHLVL': '1', 'G_BROKEN_FILENAMES': '1', 'HISTSIZE': '1000', 'HOME': '/home/cltbld', 'HG_SHARE_BASE_DIR': '/builds/hg-shared', 'TINDERBOX_OUTPUT': '1', 'MOZ_CRASHREPORTER_NO_REPORT': '1', 'LC_ALL': 'C', 'TOOLTOOL_HOME': '/builds', '_': '/tools/buildbot/bin/python', 'MAIL': '/var/spool/mail/cltbld', 'HOSTNAME': 'bld-linux64-spot-283.build.releng.use1.mozilla.com', 'MOZBUILD_STATE_PATH': '/builds/slave/m-cen-l64-asan-d-ntly-00000000/.mozbuild', 'HISTCONTROL': 'ignoredups', 'PWD': '/builds/slave/m-cen-l64-asan-d-ntly-00000000', 'PROPERTIES_FILE': '/builds/slave/m-cen-l64-asan-d-ntly-00000000/buildprops.json', 'CCACHE_DIR': '/builds/ccache', 'CCACHE_COMPRESS': '1', 'TOOLTOOL_CACHE': '/builds/tooltool_cache'}}, attempt #1 04:22:00 INFO - Running command: ['/builds/slave/m-cen-l64-asan-d-ntly-00000000/build/venv/bin/pip', 'install', '--timeout', '120', 'PyHawk-with-a-single-extra-commit==0.1.5'] in /builds/slave/m-cen-l64-asan-d-ntly-00000000/build 04:22:00 INFO - Copy/paste: /builds/slave/m-cen-l64-asan-d-ntly-00000000/build/venv/bin/pip install --timeout 120 PyHawk-with-a-single-extra-commit==0.1.5 04:22:00 INFO - Using env: {'CCACHE_COMPRESS': '1', 04:22:00 INFO - 'CCACHE_DIR': '/builds/ccache', 04:22:00 INFO - 'CCACHE_HASHDIR': '', 04:22:00 INFO - 'CCACHE_UMASK': '002', 04:22:00 INFO - 'DISPLAY': ':2', 04:22:00 INFO - 'G_BROKEN_FILENAMES': '1', 04:22:00 INFO - 'HG_SHARE_BASE_DIR': '/builds/hg-shared', 04:22:00 INFO - 'HISTCONTROL': 'ignoredups', 04:22:00 INFO - 'HISTSIZE': '1000', 04:22:00 INFO - 'HOME': '/home/cltbld', 04:22:00 INFO - 'HOSTNAME': 'bld-linux64-spot-283.build.releng.use1.mozilla.com', 04:22:00 INFO - 'LANG': 'en_US.UTF-8', 04:22:00 INFO - 'LC_ALL': 'C', 04:22:00 INFO - 'LESSOPEN': '|/usr/bin/lesspipe.sh %s', 04:22:00 INFO - 'LOGNAME': 'cltbld', 04:22:00 INFO - 'MAIL': '/var/spool/mail/cltbld', 04:22:00 INFO - 'MOZBUILD_STATE_PATH': '/builds/slave/m-cen-l64-asan-d-ntly-00000000/.mozbuild', 04:22:00 INFO - 'MOZ_AUTOMATION': '1', 04:22:00 INFO - 'MOZ_CRASHREPORTER_NO_REPORT': '1', 04:22:00 INFO - 'MOZ_OBJDIR': 'obj-firefox', 04:22:00 INFO - 'PATH': '/tools/buildbot/bin:/usr/local/bin:/usr/lib64/ccache:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/tools/git/bin:/tools/python27/bin:/tools/python27-mercurial/bin:/home/cltbld/bin', 04:22:00 INFO - 'PROPERTIES_FILE': '/builds/slave/m-cen-l64-asan-d-ntly-00000000/buildprops.json', 04:22:00 INFO - 'PWD': '/builds/slave/m-cen-l64-asan-d-ntly-00000000', 04:22:00 INFO - 'SHELL': '/bin/bash', 04:22:00 INFO - 'SHLVL': '1', 04:22:00 INFO - 'TERM': 'linux', 04:22:00 INFO - 'TINDERBOX_OUTPUT': '1', 04:22:00 INFO - 'TMOUT': '86400', 04:22:00 INFO - 'TOOLTOOL_CACHE': '/builds/tooltool_cache', 04:22:00 INFO - 'TOOLTOOL_HOME': '/builds', 04:22:00 INFO - 'USER': 'cltbld', 04:22:00 INFO - '_': '/tools/buildbot/bin/python'} 04:22:01 INFO - Ignoring indexes: http://pypi.python.org/simple/ 04:22:01 INFO - Downloading/unpacking PyHawk-with-a-single-extra-commit==0.1.5 04:22:01 INFO - Downloading PyHawk-with-a-single-extra-commit-0.1.5.tar.gz 04:22:01 INFO - Running setup.py egg_info for package PyHawk-with-a-single-extra-commit 04:22:01 INFO - Installing collected packages: PyHawk-with-a-single-extra-commit 04:22:01 INFO - Running setup.py install for PyHawk-with-a-single-extra-commit 04:22:01 INFO - Successfully installed PyHawk-with-a-single-extra-commit 04:22:01 INFO - Cleaning up... 04:22:01 INFO - Return code: 0 04:22:01 INFO - Installing taskcluster==0.0.26 into virtualenv /builds/slave/m-cen-l64-asan-d-ntly-00000000/build/venv 04:22:01 INFO - retry: Calling run_command with args: [['/builds/slave/m-cen-l64-asan-d-ntly-00000000/build/venv/bin/pip', 'install', '--timeout', '120', 'taskcluster==0.0.26']], kwargs: {'error_level': 'warning', 'error_list': [{'substr': 'not found or a compiler error:', 'level': 'warning'}, {'regex': <_sre.SRE_Pattern object at 0x15700d0>, 'level': 'error'}, {'regex': <_sre.SRE_Pattern object at 0x16d8b58>, 'level': 'warning'}, {'regex': <_sre.SRE_Pattern object at 0x1732b60>, 'level': 'debug'}, {'substr': 'command not found', 'level': 'error'}, {'regex': <_sre.SRE_Pattern object at 0x16c62a0>, 'level': 'warning'}, {'substr': 'Traceback (most recent call last)', 'level': 'error'}, {'substr': 'SyntaxError: ', 'level': 'error'}, {'substr': 'TypeError: ', 'level': 'error'}, {'substr': 'NameError: ', 'level': 'error'}, {'substr': 'ZeroDivisionError: ', 'level': 'error'}, {'regex': <_sre.SRE_Pattern object at 0x16df618>, 'level': 'critical'}, {'regex': <_sre.SRE_Pattern object at 0x148a418>, 'level': 'critical'}], 'cwd': '/builds/slave/m-cen-l64-asan-d-ntly-00000000/build', 'env': {'MOZ_AUTOMATION': '1', 'LESSOPEN': '|/usr/bin/lesspipe.sh %s', 'TMOUT': '86400', 'LOGNAME': 'cltbld', 'USER': 'cltbld', 'MOZ_OBJDIR': 'obj-firefox', 'PATH': '/tools/buildbot/bin:/usr/local/bin:/usr/lib64/ccache:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/tools/git/bin:/tools/python27/bin:/tools/python27-mercurial/bin:/home/cltbld/bin', 'DISPLAY': ':2', 'CCACHE_UMASK': '002', 'LANG': 'en_US.UTF-8', 'CCACHE_HASHDIR': '', 'TERM': 'linux', 'SHELL': '/bin/bash', 'SHLVL': '1', 'G_BROKEN_FILENAMES': '1', 'HISTSIZE': '1000', 'HOME': '/home/cltbld', 'HG_SHARE_BASE_DIR': '/builds/hg-shared', 'TINDERBOX_OUTPUT': '1', 'MOZ_CRASHREPORTER_NO_REPORT': '1', 'LC_ALL': 'C', 'TOOLTOOL_HOME': '/builds', '_': '/tools/buildbot/bin/python', 'MAIL': '/var/spool/mail/cltbld', 'HOSTNAME': 'bld-linux64-spot-283.build.releng.use1.mozilla.com', 'MOZBUILD_STATE_PATH': '/builds/slave/m-cen-l64-asan-d-ntly-00000000/.mozbuild', 'HISTCONTROL': 'ignoredups', 'PWD': '/builds/slave/m-cen-l64-asan-d-ntly-00000000', 'PROPERTIES_FILE': '/builds/slave/m-cen-l64-asan-d-ntly-00000000/buildprops.json', 'CCACHE_DIR': '/builds/ccache', 'CCACHE_COMPRESS': '1', 'TOOLTOOL_CACHE': '/builds/tooltool_cache'}}, attempt #1 04:22:01 INFO - Running command: ['/builds/slave/m-cen-l64-asan-d-ntly-00000000/build/venv/bin/pip', 'install', '--timeout', '120', 'taskcluster==0.0.26'] in /builds/slave/m-cen-l64-asan-d-ntly-00000000/build 04:22:01 INFO - Copy/paste: /builds/slave/m-cen-l64-asan-d-ntly-00000000/build/venv/bin/pip install --timeout 120 taskcluster==0.0.26 04:22:01 INFO - Using env: {'CCACHE_COMPRESS': '1', 04:22:01 INFO - 'CCACHE_DIR': '/builds/ccache', 04:22:01 INFO - 'CCACHE_HASHDIR': '', 04:22:01 INFO - 'CCACHE_UMASK': '002', 04:22:01 INFO - 'DISPLAY': ':2', 04:22:01 INFO - 'G_BROKEN_FILENAMES': '1', 04:22:01 INFO - 'HG_SHARE_BASE_DIR': '/builds/hg-shared', 04:22:01 INFO - 'HISTCONTROL': 'ignoredups', 04:22:01 INFO - 'HISTSIZE': '1000', 04:22:01 INFO - 'HOME': '/home/cltbld', 04:22:01 INFO - 'HOSTNAME': 'bld-linux64-spot-283.build.releng.use1.mozilla.com', 04:22:01 INFO - 'LANG': 'en_US.UTF-8', 04:22:01 INFO - 'LC_ALL': 'C', 04:22:01 INFO - 'LESSOPEN': '|/usr/bin/lesspipe.sh %s', 04:22:01 INFO - 'LOGNAME': 'cltbld', 04:22:01 INFO - 'MAIL': '/var/spool/mail/cltbld', 04:22:01 INFO - 'MOZBUILD_STATE_PATH': '/builds/slave/m-cen-l64-asan-d-ntly-00000000/.mozbuild', 04:22:01 INFO - 'MOZ_AUTOMATION': '1', 04:22:01 INFO - 'MOZ_CRASHREPORTER_NO_REPORT': '1', 04:22:01 INFO - 'MOZ_OBJDIR': 'obj-firefox', 04:22:01 INFO - 'PATH': '/tools/buildbot/bin:/usr/local/bin:/usr/lib64/ccache:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/tools/git/bin:/tools/python27/bin:/tools/python27-mercurial/bin:/home/cltbld/bin', 04:22:01 INFO - 'PROPERTIES_FILE': '/builds/slave/m-cen-l64-asan-d-ntly-00000000/buildprops.json', 04:22:01 INFO - 'PWD': '/builds/slave/m-cen-l64-asan-d-ntly-00000000', 04:22:01 INFO - 'SHELL': '/bin/bash', 04:22:01 INFO - 'SHLVL': '1', 04:22:01 INFO - 'TERM': 'linux', 04:22:01 INFO - 'TINDERBOX_OUTPUT': '1', 04:22:01 INFO - 'TMOUT': '86400', 04:22:01 INFO - 'TOOLTOOL_CACHE': '/builds/tooltool_cache', 04:22:01 INFO - 'TOOLTOOL_HOME': '/builds', 04:22:01 INFO - 'USER': 'cltbld', 04:22:01 INFO - '_': '/tools/buildbot/bin/python'} 04:22:05 INFO - Ignoring indexes: http://pypi.python.org/simple/ 04:22:05 INFO - Downloading/unpacking taskcluster==0.0.26 04:22:05 INFO - Downloading taskcluster-0.0.26.tar.gz 04:22:05 INFO - Running setup.py egg_info for package taskcluster 04:22:05 INFO - Downloading/unpacking requests>=2.4.3,<=2.7.0 (from taskcluster==0.0.26) 04:22:05 INFO - Running setup.py egg_info for package requests 04:22:05 INFO - Requirement already satisfied (use --upgrade to upgrade): PyHawk-with-a-single-extra-commit==0.1.5 in ./venv/lib/python2.7/site-packages (from taskcluster==0.0.26) 04:22:05 INFO - Downloading/unpacking slugid (from taskcluster==0.0.26) 04:22:05 INFO - Downloading slugid-1.0.7.tar.gz 04:22:05 INFO - Running setup.py egg_info for package slugid 04:22:05 INFO - Installing collected packages: taskcluster, requests, slugid 04:22:05 INFO - Running setup.py install for taskcluster 04:22:05 INFO - Found existing installation: requests 2.8.1 04:22:05 INFO - Uninstalling requests: 04:22:05 INFO - Successfully uninstalled requests 04:22:05 INFO - Running setup.py install for requests 04:22:05 INFO - Running setup.py install for slugid 04:22:05 INFO - Successfully installed taskcluster requests slugid 04:22:05 INFO - Cleaning up... 04:22:05 INFO - Return code: 0 04:22:05 INFO - Done creating virtualenv /builds/slave/m-cen-l64-asan-d-ntly-00000000/build/venv. 04:22:05 INFO - Getting output from command: ['/builds/slave/m-cen-l64-asan-d-ntly-00000000/build/venv/bin/pip', 'freeze'] 04:22:05 INFO - Copy/paste: /builds/slave/m-cen-l64-asan-d-ntly-00000000/build/venv/bin/pip freeze 04:22:05 INFO - Reading from file tmpfile_stdout 04:22:05 INFO - Current package versions: 04:22:05 INFO - PyHawk-with-a-single-extra-commit == 0.1.5 04:22:05 INFO - distribute == 0.6.24 04:22:05 INFO - requests == 2.7.0 04:22:05 INFO - slugid == 1.0.7 04:22:05 INFO - taskcluster == 0.0.26 04:22:05 INFO - wsgiref == 0.1.2 04:22:05 INFO - Running pre-run listener: influxdb_recording_init 04:22:05 INFO - build_resources.json path: /builds/slave/m-cen-l64-asan-d-ntly-00000000/build/src/obj-firefox/.mozbuild/build_resources.json 04:22:05 INFO - rmtree: /builds/slave/m-cen-l64-asan-d-ntly-00000000/build/src/obj-firefox/.mozbuild/build_resources.json 04:22:05 INFO - Getting output from command: ['/builds/slave/m-cen-l64-asan-d-ntly-00000000/build/venv/bin/python', '-c', 'from distutils.sysconfig import get_python_lib; print(get_python_lib())'] 04:22:05 INFO - Copy/paste: /builds/slave/m-cen-l64-asan-d-ntly-00000000/build/venv/bin/python -c "from distutils.sysconfig import get_python_lib; print(get_python_lib())" 04:22:05 INFO - Reading from file tmpfile_stdout 04:22:05 INFO - Output received: 04:22:05 INFO - /builds/slave/m-cen-l64-asan-d-ntly-00000000/build/venv/lib/python2.7/site-packages 04:22:05 INFO - Dumping config to /builds/slave/m-cen-l64-asan-d-ntly-00000000/logs/localconfig.json. 04:22:05 INFO - {'app_ini_path': '%(obj_dir)s/dist/bin/application.ini', 04:22:05 INFO - 'append_to_log': False, 04:22:05 INFO - 'balrog_credentials_file': 'oauth.txt', 04:22:05 INFO - 'balrog_servers': ({'balrog_api_root': 'https://aus4-admin.mozilla.org/api', 04:22:05 INFO - 'balrog_usernames': {'Fennec': 'ffxbld', 04:22:05 INFO - 'b2g': 'b2gbld', 04:22:05 INFO - 'firefox': 'ffxbld', 04:22:05 INFO - 'graphene': 'ffxbld', 04:22:05 INFO - 'horizon': 'ffxbld', 04:22:05 INFO - 'mobile': 'ffxbld', 04:22:05 INFO - 'thunderbird': 'tbirdbld'}, 04:22:05 INFO - 'ignore_failures': False, 04:22:05 INFO - 'url_replacements': (('http://archive.mozilla.org/pub', 04:22:05 INFO - 'http://download.cdn.mozilla.net/pub'),)},), 04:22:05 INFO - 'base_name': 'Linux_x86-64_%(branch)s', 04:22:05 INFO - 'base_work_dir': '/builds/slave/m-cen-l64-asan-d-ntly-00000000', 04:22:05 INFO - 'branch': 'mozilla-central', 04:22:05 INFO - 'build_pool': 'production', 04:22:05 INFO - 'build_resources_path': '%(abs_src_dir)s/obj-firefox/.mozbuild/build_resources.json', 04:22:05 INFO - 'build_type': 'asan-debug', 04:22:05 INFO - 'build_variant': 'asan-and-debug', 04:22:05 INFO - 'buildbot_json_path': 'buildprops.json', 04:22:05 INFO - 'check_test_env': {'MINIDUMP_SAVE_PATH': '%(base_work_dir)s/minidumps', 04:22:05 INFO - 'MINIDUMP_STACKWALK': '%(abs_tools_dir)s/breakpad/linux64/minidump_stackwalk'}, 04:22:05 INFO - 'clobberer_url': 'https://api.pub.build.mozilla.org/clobberer/lastclobber', 04:22:05 INFO - 'clone_by_revision': False, 04:22:05 INFO - 'clone_with_purge': False, 04:22:05 INFO - 'compare_locales_repo': 'https://hg.mozilla.org/build/compare-locales', 04:22:05 INFO - 'compare_locales_rev': 'RELEASE_AUTOMATION', 04:22:05 INFO - 'compare_locales_vcs': 'hgtool', 04:22:05 INFO - 'config_files': ('builds/releng_base_linux_64_builds.py', 04:22:05 INFO - '/builds/slave/m-cen-l64-asan-d-ntly-00000000/scripts/scripts/../configs/builds/releng_sub_linux_configs/64_asan_and_debug.py', 04:22:05 INFO - 'balrog/production.py', 04:22:05 INFO - 'builds/branch_specifics.py', 04:22:05 INFO - 'builds/build_pool_specifics.py'), 04:22:05 INFO - 'debug_build': True, 04:22:05 INFO - 'default_actions': ('clobber', 04:22:05 INFO - 'clone-tools', 04:22:05 INFO - 'checkout-sources', 04:22:05 INFO - 'setup-mock', 04:22:05 INFO - 'build', 04:22:05 INFO - 'upload-files', 04:22:05 INFO - 'sendchange', 04:22:05 INFO - 'check-test'), 04:22:05 INFO - 'default_vcs': 'hgtool', 04:22:05 INFO - 'enable_ccache': True, 04:22:05 INFO - 'enable_count_ctors': True, 04:22:05 INFO - 'enable_signing': False, 04:22:05 INFO - 'enable_talos_sendchange': False, 04:22:05 INFO - 'enable_unittest_sendchange': True, 04:22:05 INFO - 'env': {'CCACHE_COMPRESS': '1', 04:22:05 INFO - 'CCACHE_DIR': '/builds/ccache', 04:22:05 INFO - 'CCACHE_UMASK': '002', 04:22:05 INFO - 'DISPLAY': ':2', 04:22:05 INFO - 'HG_SHARE_BASE_DIR': '/builds/hg-shared', 04:22:05 INFO - 'LC_ALL': 'C', 04:22:05 INFO - 'MOZBUILD_STATE_PATH': '/builds/slave/m-cen-l64-asan-d-ntly-00000000/.mozbuild', 04:22:05 INFO - 'MOZ_AUTOMATION': '1', 04:22:05 INFO - 'MOZ_CRASHREPORTER_NO_REPORT': '1', 04:22:05 INFO - 'MOZ_OBJDIR': 'obj-firefox', 04:22:05 INFO - 'PATH': '/tools/buildbot/bin:/usr/local/bin:/usr/lib64/ccache:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/tools/git/bin:/tools/python27/bin:/tools/python27-mercurial/bin:/home/cltbld/bin', 04:22:05 INFO - 'TINDERBOX_OUTPUT': '1', 04:22:05 INFO - 'TOOLTOOL_CACHE': '/builds/tooltool_cache', 04:22:05 INFO - 'TOOLTOOL_HOME': '/builds'}, 04:22:05 INFO - 'exes': {'buildbot': '/tools/buildbot/bin/buildbot', 04:22:05 INFO - 'hgtool.py': '/builds/slave/m-cen-l64-asan-d-ntly-00000000/build/tools/buildfarm/utils/hgtool.py'}, 04:22:05 INFO - 'graph_selector': '/server/collect.cgi', 04:22:05 INFO - 'graph_server': 'graphs.mozilla.org', 04:22:05 INFO - 'graph_server_branch_name': 'Firefox', 04:22:05 INFO - 'hgtool_base_bundle_urls': ('https://ftp-ssl.mozilla.org/pub/mozilla.org/firefox/bundles',), 04:22:05 INFO - 'include_post_upload_builddir': False, 04:22:05 INFO - 'influx_credentials_file': 'oauth.txt', 04:22:05 INFO - 'is_automation': True, 04:22:05 INFO - 'latest_mar_dir': '/pub/mozilla.org/firefox/nightly/latest-%(branch)s', 04:22:05 INFO - 'log_level': 'info', 04:22:05 INFO - 'log_to_console': True, 04:22:05 INFO - 'mock_files': (('/home/cltbld/.ssh', '/home/mock_mozilla/.ssh'), 04:22:05 INFO - ('/home/cltbld/.hgrc', '/builds/.hgrc'), 04:22:05 INFO - ('/home/cltbld/.boto', '/builds/.boto'), 04:22:05 INFO - ('/builds/gapi.data', '/builds/gapi.data'), 04:22:05 INFO - ('/builds/relengapi.tok', '/builds/relengapi.tok'), 04:22:05 INFO - ('/tools/tooltool.py', '/builds/tooltool.py'), 04:22:05 INFO - ('/builds/mozilla-desktop-geoloc-api.key', 04:22:05 INFO - '/builds/mozilla-desktop-geoloc-api.key'), 04:22:05 INFO - ('/builds/crash-stats-api.token', 04:22:05 INFO - '/builds/crash-stats-api.token'), 04:22:05 INFO - ('/builds/adjust-sdk.token', '/builds/adjust-sdk.token'), 04:22:05 INFO - ('/builds/adjust-sdk-beta.token', 04:22:05 INFO - '/builds/adjust-sdk-beta.token'), 04:22:05 INFO - ('/usr/local/lib/hgext', '/usr/local/lib/hgext')), 04:22:05 INFO - 'mock_mozilla_dir': '/builds/mock_mozilla', 04:22:05 INFO - 'mock_packages': ('autoconf213', 04:22:05 INFO - 'python', 04:22:05 INFO - 'mozilla-python27', 04:22:05 INFO - 'zip', 04:22:05 INFO - 'mozilla-python27-mercurial', 04:22:05 INFO - 'git', 04:22:05 INFO - 'ccache', 04:22:05 INFO - 'perl-Test-Simple', 04:22:05 INFO - 'perl-Config-General', 04:22:05 INFO - 'yasm', 04:22:05 INFO - 'wget', 04:22:05 INFO - 'mpfr', 04:22:05 INFO - 'xorg-x11-font*', 04:22:05 INFO - 'imake', 04:22:05 INFO - 'gcc45_0moz3', 04:22:05 INFO - 'gcc454_0moz1', 04:22:05 INFO - 'gcc472_0moz1', 04:22:05 INFO - 'gcc473_0moz1', 04:22:05 INFO - 'yasm', 04:22:05 INFO - 'ccache', 04:22:05 INFO - 'valgrind', 04:22:05 INFO - 'dbus-x11', 04:22:05 INFO - 'glibc-static', 04:22:05 INFO - 'libstdc++-static', 04:22:05 INFO - 'gtk2-devel', 04:22:05 INFO - 'libnotify-devel', 04:22:05 INFO - 'alsa-lib-devel', 04:22:05 INFO - 'libcurl-devel', 04:22:05 INFO - 'wireless-tools-devel', 04:22:05 INFO - 'libX11-devel', 04:22:05 INFO - 'libXt-devel', 04:22:05 INFO - 'mesa-libGL-devel', 04:22:05 INFO - 'gnome-vfs2-devel', 04:22:05 INFO - 'GConf2-devel', 04:22:05 INFO - 'gcc45_0moz3', 04:22:05 INFO - 'gcc454_0moz1', 04:22:05 INFO - 'gcc472_0moz1', 04:22:05 INFO - 'gcc473_0moz1', 04:22:05 INFO - 'yasm', 04:22:05 INFO - 'ccache', 04:22:05 INFO - 'pulseaudio-libs-devel', 04:22:05 INFO - 'gstreamer-devel', 04:22:05 INFO - 'gstreamer-plugins-base-devel', 04:22:05 INFO - 'freetype-2.3.11-6.el6_1.8.x86_64', 04:22:05 INFO - 'freetype-devel-2.3.11-6.el6_1.8.x86_64'), 04:22:05 INFO - 'mock_target': 'mozilla-centos6-x86_64', 04:22:05 INFO - 'nightly_build': True, 04:22:05 INFO - 'nightly_promotion_branches': ('mozilla-central', 'mozilla-aurora'), 04:22:05 INFO - 'objdir': 'obj-firefox', 04:22:05 INFO - 'old_packages': ('%(objdir)s/dist/firefox-*', 04:22:05 INFO - '%(objdir)s/dist/fennec*', 04:22:05 INFO - '%(objdir)s/dist/seamonkey*', 04:22:05 INFO - '%(objdir)s/dist/thunderbird*', 04:22:05 INFO - '%(objdir)s/dist/install/sea/*.exe'), 04:22:05 INFO - 'opt_config_files': (), 04:22:05 INFO - 'periodic_clobber': 168, 04:22:05 INFO - 'pgo_build': False, 04:22:05 INFO - 'pgo_platforms': ('linux', 'linux64', 'win32', 'win64'), 04:22:05 INFO - 'platform': 'linux64', 04:22:05 INFO - 'platform_supports_post_upload_to_latest': False, 04:22:05 INFO - 'publish_nightly_en_US_routes': False, 04:22:05 INFO - 'release_to_try_builds': False, 04:22:05 INFO - 'repo_base': 'https://hg.mozilla.org', 04:22:05 INFO - 'repo_path': 'mozilla-central', 04:22:05 INFO - 'scm_level': 1, 04:22:05 INFO - 'secret_files': ({'default': 'try-build-has-no-secrets', 04:22:05 INFO - 'filename': '/builds/gapi.data', 04:22:05 INFO - 'min_scm_level': 2, 04:22:05 INFO - 'secret_name': 'project/releng/gecko/build/level-%(scm-level)s/gapi.data'}, 04:22:05 INFO - {'default': 'try-build-has-no-secrets', 04:22:05 INFO - 'filename': '/builds/mozilla-desktop-geoloc-api.key', 04:22:05 INFO - 'min_scm_level': 2, 04:22:05 INFO - 'secret_name': 'project/releng/gecko/build/level-%(scm-level)s/mozilla-desktop-geoloc-api.key'}, 04:22:05 INFO - {'default': 'try-build-has-no-secrets', 04:22:05 INFO - 'filename': '/builds/adjust-sdk.token', 04:22:05 INFO - 'min_scm_level': 2, 04:22:05 INFO - 'secret_name': 'project/releng/gecko/build/level-%(scm-level)s/adjust-sdk.token'}, 04:22:05 INFO - {'default': 'try-build-has-no-secrets', 04:22:05 INFO - 'filename': '/builds/adjust-sdk-beta.token', 04:22:05 INFO - 'min_scm_level': 2, 04:22:05 INFO - 'secret_name': 'project/releng/gecko/build/level-%(scm-level)s/adjust-sdk-beta.token'}), 04:22:05 INFO - 'sendchange_masters': ('buildbot-master81.build.mozilla.org:9301',), 04:22:05 INFO - 'src_mozconfig': 'browser/config/mozconfigs/linux64/debug-asan', 04:22:05 INFO - 'stage_platform': 'linux64-asan-debug', 04:22:05 INFO - 'stage_product': 'firefox', 04:22:05 INFO - 'stage_server': 'upload.ffxbld.productdelivery.prod.mozaws.net', 04:22:05 INFO - 'stage_ssh_key': 'ffxbld_rsa', 04:22:05 INFO - 'stage_username': 'ffxbld', 04:22:05 INFO - 'taskcluster_credentials_file': 'oauth.txt', 04:22:05 INFO - 'taskcluster_index': 'index', 04:22:05 INFO - 'tinderbox_build_dir': None, 04:22:05 INFO - 'to_tinderbox_dated': True, 04:22:05 INFO - 'tools_repo': 'https://hg.mozilla.org/build/tools', 04:22:05 INFO - 'tooltool_bootstrap': 'setup.sh', 04:22:05 INFO - 'tooltool_manifest_src': 'browser/config/tooltool-manifests/linux64/asan.manifest', 04:22:05 INFO - 'tooltool_script': ('/builds/tooltool.py',), 04:22:05 INFO - 'tooltool_url': 'https://api.pub.build.mozilla.org/tooltool/', 04:22:05 INFO - 'update_channel': 'nightly', 04:22:05 INFO - 'upload_env': {'UPLOAD_HOST': '%(stage_server)s', 04:22:05 INFO - 'UPLOAD_SSH_KEY': '/home/mock_mozilla/.ssh/%(stage_ssh_key)s', 04:22:05 INFO - 'UPLOAD_TO_TEMP': '1', 04:22:05 INFO - 'UPLOAD_USER': '%(stage_username)s'}, 04:22:05 INFO - 'use_clobberer': True, 04:22:05 INFO - 'vcs_share_base': '/builds/hg-shared', 04:22:05 INFO - 'virtualenv_modules': ('requests==2.8.1', 04:22:05 INFO - 'PyHawk-with-a-single-extra-commit==0.1.5', 04:22:05 INFO - 'taskcluster==0.0.26'), 04:22:05 INFO - 'virtualenv_path': 'venv', 04:22:05 INFO - 'volatile_config': {'actions': None, 'add_actions': None, 'no_actions': None}, 04:22:05 INFO - 'who': '', 04:22:05 INFO - 'work_dir': 'build'} 04:22:05 INFO - ##### 04:22:05 INFO - ##### Skipping get-secrets step. 04:22:05 INFO - ##### 04:22:05 INFO - ##### 04:22:05 INFO - ##### Running clobber step. 04:22:05 INFO - ##### 04:22:05 INFO - Running pre-action listener: influxdb_recording_pre_action 04:22:05 INFO - Running main action method: clobber 04:22:05 INFO - Clobbering because we're a nightly build 04:22:05 INFO - rmtree: /builds/slave/m-cen-l64-asan-d-ntly-00000000/build 04:22:05 INFO - retry: Calling rmtree with args: ('/builds/slave/m-cen-l64-asan-d-ntly-00000000/build',), kwargs: {}, attempt #1 04:22:05 INFO - retry: Calling run_command with args: [['/builds/slave/m-cen-l64-asan-d-ntly-00000000/scripts/external_tools/clobberer.py', '-s', 'scripts', '-s', 'logs', '-s', 'buildprops.json', '-s', 'token', '-s', 'oauth.txt', '-t', '168', 'https://api.pub.build.mozilla.org/clobberer/lastclobber', u'mozilla-central', u'Linux x86-64 mozilla-central debug asan nightly', 'm-cen-l64-asan-d-ntly-00000000', u'bld-linux64-spot-283', u'http://buildbot-master70.bb.releng.use1.mozilla.com:8001/']], kwargs: {'error_list': [{'substr': 'Error contacting server', 'explanation': 'Error contacting server for clobberer information.', 'level': 'error'}], 'cwd': '/builds/slave'}, attempt #1 04:22:05 INFO - Running command: ['/builds/slave/m-cen-l64-asan-d-ntly-00000000/scripts/external_tools/clobberer.py', '-s', 'scripts', '-s', 'logs', '-s', 'buildprops.json', '-s', 'token', '-s', 'oauth.txt', '-t', '168', 'https://api.pub.build.mozilla.org/clobberer/lastclobber', u'mozilla-central', u'Linux x86-64 mozilla-central debug asan nightly', 'm-cen-l64-asan-d-ntly-00000000', u'bld-linux64-spot-283', u'http://buildbot-master70.bb.releng.use1.mozilla.com:8001/'] in /builds/slave 04:22:05 INFO - Copy/paste: /builds/slave/m-cen-l64-asan-d-ntly-00000000/scripts/external_tools/clobberer.py -s scripts -s logs -s buildprops.json -s token -s oauth.txt -t 168 https://api.pub.build.mozilla.org/clobberer/lastclobber mozilla-central "Linux x86-64 mozilla-central debug asan nightly" m-cen-l64-asan-d-ntly-00000000 bld-linux64-spot-283 http://buildbot-master70.bb.releng.use1.mozilla.com:8001/ 04:22:05 INFO - Checking clobber URL: https://api.pub.build.mozilla.org/clobberer/lastclobber?master=http%3A%2F%2Fbuildbot-master70.bb.releng.use1.mozilla.com%3A8001%2F&slave=bld-linux64-spot-283&builddir=m-cen-l64-asan-d-ntly-00000000&branch=mozilla-central&buildername=Linux+x86-64+mozilla-central+debug+asan+nightly 04:22:05 INFO - m-cen-l64-asan-d-ntly-00000000:Our last clobber date: 2016-05-09 03:07:55 04:22:05 INFO - m-cen-l64-asan-d-ntly-00000000:Server clobber date: 2016-05-09 03:07:55 04:22:05 INFO - Return code: 0 04:22:05 INFO - Running post-action listener: influxdb_recording_post_action 04:22:05 INFO - Starting new HTTPS connection (1): goldiewilson-onepointtwentyone-1.c.influxdb.com /builds/slave/m-cen-l64-asan-d-ntly-00000000/build/venv/lib/python2.7/site-packages/requests/packages/urllib3/util/ssl_.py:90: InsecurePlatformWarning: A true SSLContext object is not available. This prevents urllib3 from configuring SSL appropriately and may cause certain SSL connections to fail. For more information, see https://urllib3.readthedocs.org/en/latest/security.html#insecureplatformwarning. 04:22:05 WARNING - Failed to log stats. Exception = [Errno 185090050] _ssl.c:340: error:0B084002:x509 certificate routines:X509_load_cert_crl_file:system lib 04:22:05 INFO - ##### 04:22:05 INFO - ##### Finished clobber step (success) 04:22:05 INFO - ##### 04:22:05 INFO - ##### 04:22:05 INFO - ##### Running clone-tools step. 04:22:05 INFO - ##### 04:22:05 INFO - Running pre-action listener: influxdb_recording_pre_action 04:22:05 INFO - Running main action method: clone_tools 04:22:05 INFO - retry: Calling _get_revision with args: (, '/builds/slave/m-cen-l64-asan-d-ntly-00000000/build/tools'), kwargs: {}, attempt #1 04:22:05 INFO - Setting /builds/slave/m-cen-l64-asan-d-ntly-00000000/build/tools to https://hg.mozilla.org/build/tools using shared directory /builds/hg-shared. 04:22:05 INFO - Checking if share extension works. 04:22:05 INFO - Getting output from command: ['hg', '--config', 'ui.merge=internal:merge', 'help', 'share'] 04:22:05 INFO - Copy/paste: hg --config ui.merge=internal:merge help share 04:22:06 INFO - Reading from file tmpfile_stdout 04:22:06 INFO - hg share works. 04:22:06 INFO - mkdir: /builds/slave/m-cen-l64-asan-d-ntly-00000000/build 04:22:06 INFO - Updating shared repo 04:22:06 INFO - Pulling https://hg.mozilla.org/build/tools to /builds/hg-shared/build/tools and updating. 04:22:06 INFO - Running command: ['hg', '--config', 'ui.merge=internal:merge', 'pull', 'https://hg.mozilla.org/build/tools'] in /builds/hg-shared/build/tools 04:22:06 INFO - Copy/paste: hg --config ui.merge=internal:merge pull https://hg.mozilla.org/build/tools 04:22:06 INFO - Calling ['hg', '--config', 'ui.merge=internal:merge', 'pull', 'https://hg.mozilla.org/build/tools'] with output_timeout 1200 04:22:07 INFO - pulling from https://hg.mozilla.org/build/tools 04:22:07 INFO - searching for changes 04:22:07 INFO - no changes found 04:22:07 INFO - Return code: 0 04:22:07 INFO - Updating /builds/hg-shared/build/tools. 04:22:07 INFO - Getting output from command: ['hg', '--config', 'ui.merge=internal:merge', 'branch'] in /builds/hg-shared/build/tools 04:22:07 INFO - Copy/paste: hg --config ui.merge=internal:merge branch 04:22:07 INFO - Reading from file tmpfile_stdout 04:22:07 INFO - Output received: 04:22:07 INFO - default 04:22:07 INFO - Running command: ['hg', '--config', 'ui.merge=internal:merge', 'update', '-C'] in /builds/hg-shared/build/tools 04:22:07 INFO - Copy/paste: hg --config ui.merge=internal:merge update -C 04:22:08 INFO - 1139 files updated, 0 files merged, 0 files removed, 0 files unresolved 04:22:08 INFO - Return code: 0 04:22:08 INFO - Getting output from command: ['hg', '--config', 'ui.merge=internal:merge', 'parent', '--template', '{node}'] in /builds/hg-shared/build/tools 04:22:08 INFO - Copy/paste: hg --config ui.merge=internal:merge parent --template {node} 04:22:08 INFO - Reading from file tmpfile_stdout 04:22:08 INFO - Output received: 04:22:08 INFO - b030af490d9395958c3dc17443204037faf6a991 04:22:08 INFO - Trying to share /builds/hg-shared/build/tools to /builds/slave/m-cen-l64-asan-d-ntly-00000000/build/tools 04:22:08 INFO - Sharing /builds/hg-shared/build/tools to /builds/slave/m-cen-l64-asan-d-ntly-00000000/build/tools. 04:22:08 INFO - mkdir: /builds/slave/m-cen-l64-asan-d-ntly-00000000/build/tools 04:22:08 INFO - Running command: ['hg', '--config', 'ui.merge=internal:merge', 'share', '-U', '/builds/hg-shared/build/tools', '/builds/slave/m-cen-l64-asan-d-ntly-00000000/build/tools'] 04:22:08 INFO - Copy/paste: hg --config ui.merge=internal:merge share -U /builds/hg-shared/build/tools /builds/slave/m-cen-l64-asan-d-ntly-00000000/build/tools 04:22:09 INFO - Return code: 0 04:22:09 INFO - Updating /builds/slave/m-cen-l64-asan-d-ntly-00000000/build/tools. 04:22:09 INFO - Getting output from command: ['hg', '--config', 'ui.merge=internal:merge', 'branch'] in /builds/slave/m-cen-l64-asan-d-ntly-00000000/build/tools 04:22:09 INFO - Copy/paste: hg --config ui.merge=internal:merge branch 04:22:09 INFO - Reading from file tmpfile_stdout 04:22:09 INFO - Output received: 04:22:09 INFO - default 04:22:09 INFO - Running command: ['hg', '--config', 'ui.merge=internal:merge', 'update', '-C'] in /builds/slave/m-cen-l64-asan-d-ntly-00000000/build/tools 04:22:09 INFO - Copy/paste: hg --config ui.merge=internal:merge update -C 04:22:10 INFO - 1139 files updated, 0 files merged, 0 files removed, 0 files unresolved 04:22:10 INFO - Return code: 0 04:22:10 INFO - Getting output from command: ['hg', '--config', 'ui.merge=internal:merge', 'parent', '--template', '{node}'] in /builds/slave/m-cen-l64-asan-d-ntly-00000000/build/tools 04:22:10 INFO - Copy/paste: hg --config ui.merge=internal:merge parent --template {node} 04:22:11 INFO - Reading from file tmpfile_stdout 04:22:11 INFO - Output received: 04:22:11 INFO - b030af490d9395958c3dc17443204037faf6a991 04:22:11 INFO - Running post-action listener: influxdb_recording_post_action 04:22:11 INFO - ##### 04:22:11 INFO - ##### Finished clone-tools step (success) 04:22:11 INFO - ##### 04:22:11 INFO - ##### 04:22:11 INFO - ##### Running checkout-sources step. 04:22:11 INFO - ##### 04:22:11 INFO - Running pre-action listener: influxdb_recording_pre_action 04:22:11 INFO - Running main action method: checkout_sources 04:22:11 INFO - retry: Calling _get_revision with args: (, '/builds/slave/m-cen-l64-asan-d-ntly-00000000/build/src'), kwargs: {}, attempt #1 04:22:11 INFO - Running command: ['/builds/slave/m-cen-l64-asan-d-ntly-00000000/build/tools/buildfarm/utils/hgtool.py', '-r', '043082cb7bd8', '--bundle', 'https://ftp-ssl.mozilla.org/pub/mozilla.org/firefox/bundles/mozilla-central.hg', 'https://hg.mozilla.org/mozilla-central', '/builds/slave/m-cen-l64-asan-d-ntly-00000000/build/src'] 04:22:11 INFO - Copy/paste: /builds/slave/m-cen-l64-asan-d-ntly-00000000/build/tools/buildfarm/utils/hgtool.py -r 043082cb7bd8 --bundle https://ftp-ssl.mozilla.org/pub/mozilla.org/firefox/bundles/mozilla-central.hg https://hg.mozilla.org/mozilla-central /builds/slave/m-cen-l64-asan-d-ntly-00000000/build/src 04:22:11 INFO - Using env: {'CCACHE_COMPRESS': '1', 04:22:11 INFO - 'CCACHE_DIR': '/builds/ccache', 04:22:11 INFO - 'CCACHE_HASHDIR': '', 04:22:11 INFO - 'CCACHE_UMASK': '002', 04:22:11 INFO - 'DISPLAY': ':2', 04:22:11 INFO - 'G_BROKEN_FILENAMES': '1', 04:22:11 INFO - 'HG_SHARE_BASE_DIR': '/builds/hg-shared', 04:22:11 INFO - 'HISTCONTROL': 'ignoredups', 04:22:11 INFO - 'HISTSIZE': '1000', 04:22:11 INFO - 'HOME': '/home/cltbld', 04:22:11 INFO - 'HOSTNAME': 'bld-linux64-spot-283.build.releng.use1.mozilla.com', 04:22:11 INFO - 'IS_NIGHTLY': 'yes', 04:22:11 INFO - 'LANG': 'en_US.UTF-8', 04:22:11 INFO - 'LC_ALL': 'C', 04:22:11 INFO - 'LESSOPEN': '|/usr/bin/lesspipe.sh %s', 04:22:11 INFO - 'LOGNAME': 'cltbld', 04:22:11 INFO - 'MAIL': '/var/spool/mail/cltbld', 04:22:11 INFO - 'MOZBUILD_STATE_PATH': '/builds/slave/m-cen-l64-asan-d-ntly-00000000/.mozbuild', 04:22:11 INFO - 'MOZ_AUTOMATION': '1', 04:22:11 INFO - 'MOZ_BUILD_DATE': '20160509041458', 04:22:11 INFO - 'MOZ_CRASHREPORTER_NO_REPORT': '1', 04:22:11 INFO - 'MOZ_OBJDIR': 'obj-firefox', 04:22:11 INFO - 'MOZ_UPDATE_CHANNEL': 'nightly', 04:22:11 INFO - 'PATH': '/tools/buildbot/bin:/usr/local/bin:/usr/lib64/ccache:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/tools/git/bin:/tools/python27/bin:/tools/python27-mercurial/bin:/home/cltbld/bin', 04:22:11 INFO - 'PROPERTIES_FILE': '/builds/slave/m-cen-l64-asan-d-ntly-00000000/buildprops.json', 04:22:11 INFO - 'PWD': '/builds/slave/m-cen-l64-asan-d-ntly-00000000', 04:22:11 INFO - 'SHELL': '/bin/bash', 04:22:11 INFO - 'SHLVL': '1', 04:22:11 INFO - 'TERM': 'linux', 04:22:11 INFO - 'TINDERBOX_OUTPUT': '1', 04:22:11 INFO - 'TMOUT': '86400', 04:22:11 INFO - 'TOOLTOOL_CACHE': '/builds/tooltool_cache', 04:22:11 INFO - 'TOOLTOOL_HOME': '/builds', 04:22:11 INFO - 'USER': 'cltbld', 04:22:11 INFO - '_': '/tools/buildbot/bin/python'} 04:22:11 INFO - Reporting hg version in use 04:22:11 INFO - command: START 04:22:11 INFO - command: hg -q version 04:22:11 INFO - command: cwd: . 04:22:11 INFO - command: output: 04:22:11 INFO - Mercurial Distributed SCM (version 3.7.3) 04:22:11 INFO - command: END (0.27s elapsed) 04:22:11 INFO - Checking if share extension works 04:22:11 INFO - command: START 04:22:11 INFO - command: hg help share 04:22:11 INFO - command: cwd: /builds/slave/m-cen-l64-asan-d-ntly-00000000 04:22:11 INFO - command: env: {'HGPLAIN': '1'} 04:22:11 INFO - command: END (0.50s elapsed) 04:22:11 INFO - Updating shared repo 04:22:11 INFO - Reporting hg version in use 04:22:11 INFO - command: START 04:22:11 INFO - command: hg -q version 04:22:11 INFO - command: cwd: . 04:22:11 INFO - command: output: 04:22:12 INFO - Mercurial Distributed SCM (version 3.7.3) 04:22:12 INFO - command: END (0.27s elapsed) 04:22:12 INFO - Attempting to initialize clone with bundles 04:22:12 INFO - command: START 04:22:12 INFO - command: hg init /builds/hg-shared/mozilla-central 04:22:12 INFO - command: cwd: /builds/slave/m-cen-l64-asan-d-ntly-00000000 04:22:12 INFO - command: output: 04:22:12 INFO - command: END (0.32s elapsed) 04:22:12 INFO - Trying to use bundle https://ftp-ssl.mozilla.org/pub/mozilla.org/firefox/bundles/mozilla-central.hg 04:22:12 INFO - command: START 04:22:12 INFO - command: hg unbundle --traceback https://ftp-ssl.mozilla.org/pub/mozilla.org/firefox/bundles/mozilla-central.hg 04:22:12 INFO - command: cwd: /builds/hg-shared/mozilla-central 04:22:12 INFO - command: env: {'HGPLAIN': '1'} 04:32:31 INFO - command: END (618.63s elapsed) 04:32:31 INFO - command: output: 04:32:31 INFO - adding changesets 04:32:31 INFO - adding manifests 04:32:31 INFO - adding file changes 04:32:31 INFO - added 288995 changesets with 1645947 changes to 240775 files 04:32:31 INFO - (run 'hg update' to get a working copy) 04:32:31 INFO - command: START 04:32:31 INFO - command: hg pull --traceback -r 043082cb7bd8 https://hg.mozilla.org/mozilla-central 04:32:31 INFO - command: cwd: /builds/hg-shared/mozilla-central 04:32:31 INFO - command: env: {'HGPLAIN': '1'} 04:32:55 INFO - command: END (24.79s elapsed) 04:32:55 INFO - command: output: 04:32:55 INFO - pulling from https://hg.mozilla.org/mozilla-central 04:32:55 INFO - searching for changes 04:32:55 INFO - adding changesets 04:32:55 INFO - adding manifests 04:32:55 INFO - adding file changes 04:32:55 INFO - added 7589 changesets with 41171 changes to 18057 files 04:32:55 INFO - (run 'hg update' to get a working copy) 04:32:55 INFO - Trying to share /builds/hg-shared/mozilla-central to /builds/slave/m-cen-l64-asan-d-ntly-00000000/build/src 04:32:55 INFO - mkdir: /builds/slave/m-cen-l64-asan-d-ntly-00000000/build/src 04:32:55 INFO - command: START 04:32:55 INFO - command: hg share -U /builds/hg-shared/mozilla-central /builds/slave/m-cen-l64-asan-d-ntly-00000000/build/src 04:32:55 INFO - command: cwd: /builds/slave/m-cen-l64-asan-d-ntly-00000000 04:32:55 INFO - command: output: 04:32:56 INFO - command: END (0.32s elapsed) 04:32:56 INFO - command: START 04:32:56 INFO - command: hg update -C -r 043082cb7bd8 04:32:56 INFO - command: cwd: /builds/slave/m-cen-l64-asan-d-ntly-00000000/build/src 04:32:56 INFO - command: output: 04:33:44 INFO - 139959 files updated, 0 files merged, 0 files removed, 0 files unresolved 04:33:44 INFO - command: END (48.78s elapsed) 04:33:44 INFO - command: START 04:33:44 INFO - command: hg parent --template {node|short} 04:33:44 INFO - command: cwd: /builds/slave/m-cen-l64-asan-d-ntly-00000000/build/src 04:33:44 INFO - command: env: {'HGPLAIN': '1'} 04:33:45 INFO - command: END (0.50s elapsed) 04:33:45 INFO - command: output: 04:33:45 INFO - 043082cb7bd8 04:33:45 INFO - Got revision 043082cb7bd8 04:33:45 INFO - Return code: 0 04:33:45 WARNING - "comments" could not be determined. This may be because it was a forced build. 04:33:45 INFO - Setting buildbot property got_revision to 043082cb7bd8 04:33:45 INFO - Writing buildbot properties ['got_revision'] to /builds/slave/m-cen-l64-asan-d-ntly-00000000/properties/got_revision 04:33:45 INFO - Writing to file /builds/slave/m-cen-l64-asan-d-ntly-00000000/properties/got_revision 04:33:45 INFO - Contents: 04:33:45 INFO - got_revision:043082cb7bd8 04:33:45 INFO - Running post-action listener: influxdb_recording_post_action 04:33:45 INFO - ##### 04:33:45 INFO - ##### Finished checkout-sources step (success) 04:33:45 INFO - ##### 04:33:45 INFO - ##### 04:33:45 INFO - ##### Running setup-mock step. 04:33:45 INFO - ##### 04:33:45 INFO - Running pre-action listener: influxdb_recording_pre_action 04:33:45 INFO - Running main action method: setup_mock 04:33:45 INFO - Getting output from command: ['mock_mozilla', '-r', 'mozilla-centos6-x86_64', '--print-root-path'] 04:33:45 INFO - Copy/paste: mock_mozilla -r mozilla-centos6-x86_64 --print-root-path 04:33:45 INFO - Reading from file tmpfile_stdout 04:33:45 INFO - Output received: 04:33:45 INFO - /builds/mock_mozilla/mozilla-centos6-x86_64/root/ 04:33:45 INFO - no previous package list found 04:33:45 INFO - Running command: ['mock_mozilla', '-r', 'mozilla-centos6-x86_64', '--init'] 04:33:45 INFO - Copy/paste: mock_mozilla -r mozilla-centos6-x86_64 --init 04:33:45 INFO - INFO: mock_mozilla.py version 1.0.3 starting... 04:33:45 INFO - State Changed: init plugins 04:33:45 INFO - INFO: selinux disabled 04:33:45 INFO - State Changed: start 04:33:45 INFO - State Changed: lock buildroot 04:33:45 INFO - State Changed: clean 04:33:45 INFO - State Changed: unlock buildroot 04:33:45 INFO - State Changed: init 04:33:45 INFO - State Changed: lock buildroot 04:33:45 INFO - Mock Version: 1.0.3 04:33:45 INFO - INFO: Mock Version: 1.0.3 04:33:45 INFO - INFO: calling preinit hooks 04:33:45 INFO - INFO: enabled root cache 04:33:45 INFO - INFO: enabled yum cache 04:33:45 INFO - State Changed: cleaning yum metadata 04:33:45 INFO - INFO: enabled ccache 04:33:45 INFO - State Changed: running yum 04:33:50 INFO - ERROR: Command failed: 04:33:50 INFO - # ['/usr/bin/yum', '--installroot', '/builds/mock_mozilla/mozilla-centos6-x86_64/root/', 'install', 'bash', 'bzip2', 'coreutils', 'cpio', 'diffutils', 'fedora-release', 'findutils', 'gawk', 'gmp', 'libstdc++', 'ppl', 'cpp', 'gcc', 'gcc-c++', 'grep', 'gzip', 'info', 'make', 'patch', 'redhat-rpm-config', 'rpm-build', 'sed', 'shadow-utils', 'tar', 'unzip', 'util-linux', 'which', 'xz'] 04:33:50 INFO - https://s3-external-1.amazonaws.com/mozilla-releng-mock-centos-us-east-1/custom/valgrind/x86_64/repodata/repomd.xml: [Errno 14] PYCURL ERROR 22 - "The requested URL returned error: 500 Internal Server Error" 04:33:50 INFO - Trying other mirror. 04:33:50 INFO - Error: Cannot retrieve repository metadata (repomd.xml) for repository: custom-valgrind. Please verify its path and try again 04:33:50 ERROR - Return code: 30 04:33:50 ERROR - 30 not in success codes: [0] 04:33:50 WARNING - setting return code to 3 04:33:50 FATAL - Halting on failure while running ['mock_mozilla', '-r', 'mozilla-centos6-x86_64', '--init'] 04:33:50 FATAL - Running post_fatal callback... 04:33:50 FATAL - Exiting 3 04:33:50 INFO - Running post-action listener: influxdb_recording_post_action 04:33:50 INFO - ##### 04:33:50 INFO - ##### Finished setup-mock step (failed) 04:33:50 INFO - ##### 04:33:50 INFO - Running post-run listener: _summarize 04:33:50 ERROR - # TBPL EXCEPTION # 04:33:50 INFO - ##### 04:33:50 INFO - ##### FxDesktopBuild summary: 04:33:50 INFO - ##### 04:33:50 ERROR - # TBPL EXCEPTION # 04:33:50 INFO - Running post-run listener: copy_logs_to_upload_dir 04:33:50 INFO - Copying logs to upload dir... 04:33:50 INFO - mkdir: /builds/slave/m-cen-l64-asan-d-ntly-00000000/build/upload/logs program finished with exit code 3 elapsedTime=713.880789 ========= master_lag: 0.02 ========= ========= Finished '/tools/buildbot/bin/python scripts/scripts/fx_desktop_build.py ...' exception (results: 4, elapsed: 11 mins, 53 secs) (at 2016-05-09 04:33:51.011098) ========= ========= Started set props: buildid got_revision stage_platform builduid (results: 0, elapsed: 0 secs) (at 2016-05-09 04:33:51.022834) ========= bash -c 'for file in `ls -1`; do cat $file; done' in dir /builds/slave/m-cen-l64-asan-d-ntly-00000000/properties (timeout 1200 secs) watching logfiles {} argv: ['bash', '-c', 'for file in `ls -1`; do cat $file; done'] environment: CCACHE_HASHDIR= G_BROKEN_FILENAMES=1 HISTCONTROL=ignoredups HISTSIZE=1000 HOME=/home/cltbld HOSTNAME=bld-linux64-spot-283.build.releng.use1.mozilla.com LANG=en_US.UTF-8 LESSOPEN=|/usr/bin/lesspipe.sh %s LOGNAME=cltbld MAIL=/var/spool/mail/cltbld PATH=/usr/local/bin:/usr/lib64/ccache:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/home/cltbld/bin PWD=/builds/slave/m-cen-l64-asan-d-ntly-00000000/properties SHELL=/bin/bash SHLVL=1 TERM=linux TMOUT=86400 USER=cltbld _=/tools/buildbot/bin/python using PTY: False buildid:20160509041458 builduid:b180be2732cd45dfa522f66ec456e8c4 got_revision:043082cb7bd8 stage_platform:linux64-asan-debug program finished with exit code 0 elapsedTime=0.006351 buildid: '20160509041458' got_revision: '043082cb7bd8' stage_platform: 'linux64-asan-debug' builduid: 'b180be2732cd45dfa522f66ec456e8c4' ========= master_lag: 0.04 ========= ========= Finished set props: buildid got_revision stage_platform builduid (results: 0, elapsed: 0 secs) (at 2016-05-09 04:33:51.073187) ========= ========= Started 'rm -f ...' (results: 0, elapsed: 0 secs) (at 2016-05-09 04:33:51.073499) ========= rm -f oauth.txt in dir /builds/slave/m-cen-l64-asan-d-ntly-00000000/. (timeout 1200 secs) watching logfiles {} argv: ['rm', '-f', 'oauth.txt'] environment: CCACHE_HASHDIR= G_BROKEN_FILENAMES=1 HISTCONTROL=ignoredups HISTSIZE=1000 HOME=/home/cltbld HOSTNAME=bld-linux64-spot-283.build.releng.use1.mozilla.com LANG=en_US.UTF-8 LESSOPEN=|/usr/bin/lesspipe.sh %s LOGNAME=cltbld MAIL=/var/spool/mail/cltbld PATH=/usr/local/bin:/usr/lib64/ccache:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/home/cltbld/bin PWD=/builds/slave/m-cen-l64-asan-d-ntly-00000000 SHELL=/bin/bash SHLVL=1 TERM=linux TMOUT=86400 USER=cltbld _=/tools/buildbot/bin/python using PTY: False program finished with exit code 0 elapsedTime=0.002367 ========= master_lag: 0.05 ========= ========= Finished 'rm -f ...' (results: 0, elapsed: 0 secs) (at 2016-05-09 04:33:51.122254) ========= ========= Started reboot skipped (results: 3, elapsed: 0 secs) (at 2016-05-09 04:33:51.122573) ========= ========= Finished reboot skipped (results: 3, elapsed: 0 secs) (at 2016-05-09 04:33:51.122840) ========= ========= Total master_lag: 0.17 =========