Tuesday, 2017-11-07

*** jamesmca_ has joined #openstack-infra00:00
clarkbif you wnat to follow the horse race and potentially win trip to vancouver https://openstackfoundation.formstack.com/forms/melbournecupraffle00:01
*** slaweq has quit IRC00:02
*** rbrndt has quit IRC00:03
*** jamesmcarthur has quit IRC00:03
clarkbMy money (acutally 0 AUD) is on US Army Ranger because that name is awesome for an australian horse race00:05
rbergeronjeblair: ahh yes. just saw this after we discussed upstairs ;)00:05
rbergeronclarkb: i went with boom time :)00:06
*** baoli_ has joined #openstack-infra00:10
*** danpawlik has joined #openstack-infra00:12
*** felipemonteiro__ has joined #openstack-infra00:13
*** felipemonteiro__ has quit IRC00:13
*** baoli has quit IRC00:13
*** ilpianista_ has joined #openstack-infra00:14
*** aspiers[m] has joined #openstack-infra00:14
*** gouthamr has quit IRC00:14
prometheanfirewoo, you should be able to clean up some stuff :D00:15
prometheanfire18:15 <    openstackgerrit > Merged openstack/requirements master: Convert legacy tox requirements jobs  https://review.openstack.org/51776700:15
fungiprometheanfire: congrats!00:15
prometheanfireand to you too :D00:15
*** danpawlik has quit IRC00:18
*** andreas_s has joined #openstack-infra00:19
*** gouthamr has joined #openstack-infra00:19
*** bobh has joined #openstack-infra00:24
*** tmorin has joined #openstack-infra00:25
*** dingyichen has joined #openstack-infra00:26
tmorinhi infraroot, I would like to know if there is a short answer to the following question: in zuulv3/ansible what plays the role that devstack-gate-vm.sh plays in zuulv2/JJB jobs ?00:27
clarkbtmorin: for the "legacy" jobs it is that same script, it is just executed in zuulv3 instead of zuulv200:27
clarkbtmorin: for the non legacy jobs (and this is still a work in progress) it is the ansible roles and jobs defined in the devstack repo itself00:28
tmorinclarkb: I knew the first part of the answer, thanks for providing the answer to the second!00:29
clarkbtmorin: https://git.openstack.org/cgit/openstack-infra/openstack-zuul-jobs/tree/playbooks/legacy/tempest-dsvm-neutron-full there is the legacy playbook00:30
clarkbtmorin: https://git.openstack.org/cgit/openstack-dev/devstack/tree/playbooks is the non legacy stuff in devstack itself00:30
*** salv-orlando has joined #openstack-infra00:32
*** andreas_s has quit IRC00:32
*** signed8bit is now known as signed8bit_Zzz00:33
*** bobh has quit IRC00:35
*** slaweq has joined #openstack-infra00:36
*** salv-orlando has quit IRC00:36
*** andreas_s has joined #openstack-infra00:37
*** sbezverk has quit IRC00:40
*** slaweq has quit IRC00:40
*** huanxie has joined #openstack-infra00:40
*** andreas_s has quit IRC00:42
*** jaypipes has quit IRC00:44
*** signed8bit_Zzz has quit IRC00:45
*** mriedem has joined #openstack-infra00:49
*** Nil_ has quit IRC00:51
*** andreas_s has joined #openstack-infra00:51
*** sbezverk has joined #openstack-infra00:51
*** thingee has quit IRC00:52
*** tmorin has quit IRC00:52
*** thingee has joined #openstack-infra00:53
*** kmalloc has quit IRC00:53
*** tmorin has joined #openstack-infra00:53
*** cuongnv has joined #openstack-infra00:56
*** jkilpatr has joined #openstack-infra00:58
openstackgerritRicardo Noriega proposed openstack-infra/project-config master: Add new repo for Neutron L2GW Tempest Plugin  https://review.openstack.org/51540800:59
*** andreas_s has quit IRC01:00
*** tmorin has quit IRC01:00
fungiclarkb: what session did you end up in this timeslot?01:00
clarkbdocs and release notes01:00
clarkbc4.10 iirc01:00
fungii considered hitting that one by then looking more closely at the abstract it seemed to be less about the release notes tooling and more about content01:01
dhinesham having failures while installing reno "sudo pip install reno"01:02
clarkbdhinesh: can you provide more information?01:02
clarkbmaybe paste the process output?01:02
fungidhinesh: have a traceback you can post to paste.openstack.org for us?01:02
fungiwith other output for context if there is any01:02
*** Apoorva_ has quit IRC01:05
dhineshclarkb: fungi: basically gcc is failing http://paste.openstack.org/show/625658/01:06
dhineshbut i have gcc installed01:06
clarkbdhinesh: dulwich/_objects.c:21:20: error: Python.h: No such file or directory is the problem. You need to install the python dev headers01:07
clarkbon ubuntu I think this is in the python-dev package and on centos it is python-devel01:07
*** owalsh_ has joined #openstack-infra01:09
*** caphrim007 has quit IRC01:09
*** ihrachys has quit IRC01:10
*** ihrachys has joined #openstack-infra01:10
*** thorst has joined #openstack-infra01:10
*** owalsh has quit IRC01:11
*** slaweq has joined #openstack-infra01:11
*** cshastri has joined #openstack-infra01:12
fungidhinesh: if reno has a bindep.txt you may want to look at that and see if you have everything it needs installed01:12
*** thorst has quit IRC01:13
clarkbI'm headed to lunch now, going to grab boxed lunch then sit and eat in that room I guess01:14
*** owalsh_ is now known as owalsh01:15
*** mat128 has joined #openstack-infra01:15
*** slaweq has quit IRC01:15
*** mriedem has quit IRC01:16
*** baoli_ has quit IRC01:17
*** jamesmca_ has quit IRC01:18
fungidhinesh: i just checked, no bindep list for it. i suppose http://git.openstack.org/cgit/openstack/reno/tree/doc/source/install/index.rst could use updating at least01:18
fungidhellmann: ^ you may be interested01:18
fungiclarkb: which room?01:18
clarkbthe same one as yesterday 4th floor boxed lunch room01:20
clarkb4.501:21
fungithanks! omw01:22
dhineshfungi: clarkb: thanks installing python-devel worked01:22
*** signed8bit has joined #openstack-infra01:23
*** andreas_s has joined #openstack-infra01:23
*** dave-mccowan has quit IRC01:24
*** jamesmcarthur has joined #openstack-infra01:24
*** liujiong has joined #openstack-infra01:24
*** edmondsw has quit IRC01:27
*** sbezverk has quit IRC01:28
*** gouthamr has quit IRC01:30
openstackgerritsebastian marcet proposed openstack-infra/openstackid-resources master: Updated api cache responses time  https://review.openstack.org/51819301:31
openstackgerritMerged openstack-infra/openstackid-resources master: Updated api cache responses time  https://review.openstack.org/51819301:31
*** salv-orlando has joined #openstack-infra01:32
*** kiennt26 has joined #openstack-infra01:35
*** esberglu has joined #openstack-infra01:36
*** esberglu has quit IRC01:36
*** gouthamr has joined #openstack-infra01:37
*** salv-orlando has quit IRC01:38
*** andreas_s has quit IRC01:41
*** edmondsw has joined #openstack-infra01:41
*** edmondsw has quit IRC01:41
*** gouthamr has quit IRC01:41
*** camunoz has quit IRC01:44
*** signed8bit is now known as signed8bit_Zzz01:47
*** slaweq has joined #openstack-infra01:50
*** slaweq has quit IRC01:56
*** signed8bit_Zzz has quit IRC01:56
*** rwsu has joined #openstack-infra02:01
*** jamesmcarthur has quit IRC02:04
*** andreas_s has joined #openstack-infra02:04
*** andreas_s has quit IRC02:08
*** jamesmcarthur has joined #openstack-infra02:10
*** Apoorva has joined #openstack-infra02:13
*** sree has joined #openstack-infra02:13
*** thorst has joined #openstack-infra02:13
*** jamesmcarthur has quit IRC02:14
openstackgerritEmilien Macchi proposed openstack-infra/openstack-zuul-jobs master: Switch undercloud-containers to use oooq/fs027  https://review.openstack.org/51819702:15
openstackgerritMerged openstack-infra/system-config master: Add #openstack-women to meetbot channels  https://review.openstack.org/51553102:16
*** sdague has quit IRC02:17
*** Apoorva has quit IRC02:17
*** sree has quit IRC02:18
*** thorst has quit IRC02:19
*** gouthamr has joined #openstack-infra02:20
*** signed8bit has joined #openstack-infra02:20
*** dklyle has joined #openstack-infra02:21
*** david-lyle has quit IRC02:22
*** jamesmcarthur has joined #openstack-infra02:22
*** caphrim007 has joined #openstack-infra02:24
*** jamesmca_ has joined #openstack-infra02:25
*** andreas_s has joined #openstack-infra02:26
*** jkilpatr has quit IRC02:27
*** jamesmcarthur has quit IRC02:27
*** caphrim007 has quit IRC02:29
*** slaweq has joined #openstack-infra02:30
openstackgerritMonty Taylor proposed openstack-infra/project-config master: Remove legacy dsvm jobs from openstacksdk  https://review.openstack.org/51820202:31
mordredjeblair, clarkb: have a sec to +3 for me real quick? ^^02:32
*** salv-orlando has joined #openstack-infra02:33
*** bobh has joined #openstack-infra02:34
*** slaweq has quit IRC02:34
*** andreas_s has quit IRC02:36
*** annp has joined #openstack-infra02:36
*** salv-orlando has quit IRC02:38
*** markvoelker has joined #openstack-infra02:40
*** andreas_s has joined #openstack-infra02:40
mordredthanks!02:41
*** openstack has joined #openstack-infra02:43
*** ChanServ sets mode: +o openstack02:43
openstackgerritMerged openstack-infra/project-config master: Remove legacy dsvm jobs from openstacksdk  https://review.openstack.org/51820202:44
openstackgerritMerged openstack-infra/project-config master: Use openstack-tox-functional  https://review.openstack.org/51776202:44
*** caphrim007 has joined #openstack-infra02:44
*** andreas_s has quit IRC02:45
*** dhinesh has quit IRC02:46
openstackgerritMerged openstack-infra/openstack-zuul-jobs master: Openstack-Helm: only run legacy jobs on primary node  https://review.openstack.org/51783402:47
*** bobh has quit IRC02:48
*** rodrigods has quit IRC02:50
*** signed8bit_Zzz has quit IRC02:50
*** gouthamr has quit IRC02:50
*** links has joined #openstack-infra02:52
*** yamahata has quit IRC02:53
*** gyee has quit IRC02:54
*** gyee has joined #openstack-infra02:55
*** xingchao has joined #openstack-infra02:56
*** xingchao has quit IRC02:57
*** rodrigods has joined #openstack-infra02:58
*** Douhet has quit IRC03:01
*** signed8bit has joined #openstack-infra03:03
*** andreas_s has joined #openstack-infra03:03
*** Douhet has joined #openstack-infra03:05
*** slaweq has joined #openstack-infra03:06
*** xingchao has joined #openstack-infra03:06
*** apetrich has quit IRC03:09
*** slaweq has quit IRC03:11
*** jamesmca_ has quit IRC03:17
*** thorst has joined #openstack-infra03:19
*** gildub has joined #openstack-infra03:20
*** andreas_s has quit IRC03:21
*** gildub has quit IRC03:21
*** gildub has joined #openstack-infra03:21
*** felipemonteiro has joined #openstack-infra03:24
*** gouthamr has joined #openstack-infra03:26
*** andreas_s has joined #openstack-infra03:26
*** liujiong has quit IRC03:28
*** andreas_s has quit IRC03:31
*** jamesmcarthur has joined #openstack-infra03:31
*** markvoelker has quit IRC03:32
*** liujiong has joined #openstack-infra03:34
*** andreas_s has joined #openstack-infra03:35
*** jamesmcarthur has quit IRC03:35
openstackgerritEmilien Macchi proposed openstack-infra/project-config master: Do not run baremetal scenarios after Ocata  https://review.openstack.org/51821003:39
*** andreas_s has quit IRC03:40
*** slaweq has joined #openstack-infra03:41
*** psachin has joined #openstack-infra03:43
*** felipemonteiro has quit IRC03:44
*** xingchao has quit IRC03:45
*** slaweq has quit IRC03:45
*** signed8b_ has joined #openstack-infra03:46
*** andreas_s has joined #openstack-infra03:48
*** ihrachys has quit IRC03:49
*** edmondsw has joined #openstack-infra03:49
*** signed8bit has quit IRC03:50
*** gildub has quit IRC03:51
*** xingchao has joined #openstack-infra03:51
*** edmondsw has quit IRC03:53
*** xingchao has quit IRC03:56
*** andreas_s has quit IRC03:57
*** jamesmcarthur has joined #openstack-infra04:02
*** jamesmcarthur has quit IRC04:07
*** andreas_s has joined #openstack-infra04:07
*** ykarel|afk has joined #openstack-infra04:08
*** udesale has joined #openstack-infra04:10
*** andreas_s has quit IRC04:11
*** gyee has quit IRC04:12
*** slaweq has joined #openstack-infra04:13
*** xingchao has joined #openstack-infra04:15
*** slaweq has quit IRC04:17
*** mriedem has joined #openstack-infra04:19
*** andreas_s has joined #openstack-infra04:21
*** sbezverk has joined #openstack-infra04:22
*** sbezverk has quit IRC04:22
*** nicolasbock has quit IRC04:23
* fungi is in the consol^Wconstellations session04:24
*** kiennt26 has quit IRC04:24
*** dbecker has quit IRC04:24
clarkbI'm in the ansible state of the communitytalk in c2.204:25
*** ramishra has joined #openstack-infra04:27
*** xingchao has quit IRC04:28
openstackgerritTristan Cacqueray proposed openstack-infra/zuul feature/zuulv3: Add restricted-node-labels global limits  https://review.openstack.org/50687104:28
*** vsaienk0 has joined #openstack-infra04:30
*** jamesmcarthur has joined #openstack-infra04:30
*** edmondsw_ has joined #openstack-infra04:31
*** jamesmcarthur has quit IRC04:35
*** gouthamr has quit IRC04:35
*** salv-orlando has joined #openstack-infra04:35
*** huanxie has quit IRC04:35
dmsimardusing bindep with zuul v3 is a bit weird now04:36
dmsimardI feel it's obsoleted by ansible :/04:36
openstackgerritMatt Smith (_alastor_) proposed openstack-infra/statusbot master: Adding gerrit request file with request methods  https://review.openstack.org/51822004:37
clarkbdmsimard: its not, because people may use your software (generally maybe not ara) without ansible04:37
dmsimardWith the ansible_os_family/ansible_os_distribution include_vars pattern and the package module which abstracts the differences between the distros and package installers04:37
dmsimardclarkb: I did mention *with* zuul v3, but yes, I realize that04:38
clarkbits a single file to describe what the deps are for maybe packaging or source installations etc04:38
*** dbecker has joined #openstack-infra04:38
clarkbya its mostly about using tooling across the board04:38
*** andreas_s has quit IRC04:39
clarkbwhat we've found is if you only encode this stuff in the tests then it isn't discoverable04:39
clarkbso instead we encode it elsewhere then make the tests consume that regardless of how the tests run04:39
*** nsingh is now known as niraj_singh04:39
dmsimardbut you still need to install bindep anyway04:39
*** gouthamr has joined #openstack-infra04:39
*** vsaienk0 has quit IRC04:40
dmsimardwhich is a pip install away, not unlike ansible04:40
dmsimardanyway, I don't have a strong opinion on this, just a random shower thought :)04:40
*** salv-orlando has quit IRC04:40
clarkbdmsimard: and before bindep it was run this shell script which doesn't require pip/bindep/ansible04:41
clarkbits largely about comunication04:41
*** xingchao has joined #openstack-infra04:42
dmsimardyeah the format is convenient and explicit like reqs.txt/test-reqs.txt04:42
dmsimardwhich is going to be pipfile soon but that's another topic04:43
*** yamahata has joined #openstack-infra04:43
dmsimardAJaeger: oh no that's odd, I was trying out ara on opensuse for integration tests and it's the only distro with an encoding/decoding error :( I'll have to check tomorrow04:45
*** edmondsw_ has quit IRC04:45
dmsimardhttp://logs.openstack.org/26/517826/7/check/ara-integration-opensuse-py27-latest/52a7810/ara/result/c30f3aec-2329-4004-b0e8-3ec16e5676a1/04:45
*** slaweq has joined #openstack-infra04:46
*** sree has joined #openstack-infra04:46
dirkdmsimard: I might know something about that04:46
*** yamamoto has joined #openstack-infra04:47
dirkdmsimard: is this a nodepool image?04:48
*** andreas_s has joined #openstack-infra04:48
dmsimarddirk: yeah, it is04:48
dmsimardara mostly relies on oslo.utils encoding methods to (hopefully) not have to bother with that kind of stuff04:49
clarkbdmsimard: robin and mordred are showing off ara right now at the summit04:49
dirkdmsimard: I believe in order to workaround some other problem we had set LC_ALL=C in that image rather than LC_ALL=en_US.utf804:49
dmsimardclarkb: snap me a picture! :D04:50
*** slaweq has quit IRC04:50
dirklike on other distros. so this causes issues with utf8 non-ascii04:50
clarkbmight be too late mordred just sat down :/ sorry04:50
dmsimardclarkb: lol it's all right, is that a recorded talk ?04:50
*** xingchao has quit IRC04:51
dmsimarddirk: yeah I have integration tests especially to test non-ascii and weird things04:51
clarkbdmsimard: I'm not sure04:51
dirkdmsimard: do you have a capability to pause one of those jobs and add my ssh key to it? happy to dig around and find the issue04:51
clarkbI don't see an obvious camera04:52
dirkdmsimard: most rooms are not recorded ;/04:52
dmsimardoh wow really ? is that new ?04:52
dmsimardI thought everything was recorded04:52
clarkbI think it has depended on the venue and stuff in the past04:52
dmsimardor is that like ops/design summit rooms04:52
*** andreas_s has quit IRC04:53
clarkband ya forum rooms have never been04:53
*** edmondsw has joined #openstack-infra04:53
*** jamesmcarthur has joined #openstack-infra04:53
fungidmsimard: as for "installing bindep" in most python-based projects we just add a convenience "bindep" tox env so if you already have tox you can just `tox -e bindep`04:54
dmsimarddirk: I'm not able to hold one of those nodes unfortunately but it should be fairly easy to reproduce04:54
dmsimardfungi: I have a convenience tox -e ansible-playbook :D04:54
dmsimardtox -e ansible-playbook -- -i hosts some/playbook.yaml04:54
fungidmsimard: ...and bindep has no dependencies04:55
fungiso that it can be used for finding out your dependencies04:55
dirkdmsimard: so tox -e py27?04:55
dmsimardDon't get me wrong, I don't want to kill bindep with fire, I was just raising an overlap in tooling04:55
dmsimarddirk: git clone https://git.openstack.org/cgit/openstack/ara; cd ara; ./run_tests.sh04:56
dirkdmsimard: trying now04:56
dmsimarddirk: it doesn't install anything, everything is in a venv04:56
dmsimardmight be some deps to install, there's a bindep.txt file (woah!)04:57
fungidmsimard: yup, the primary point of bindep is "i want to hack on nova and run tests for it locally, but i don't know what i need to install first to be able to do that"04:57
*** bhavik1 has joined #openstack-infra04:57
*** jamesmcarthur has quit IRC04:58
dmsimardclarkb: oh matrunge got me covered for ara https://twitter.com/matrunge/status/927759891007094784 :p04:58
fungidmsimard: it's first a utility for informing developers whether they're missing system packages from their dev environents, and then secondarily we can reuse that on the ci side to avoid redefining that list in multiple places04:59
clarkbI'm going to be in c4.9 for network engineer and data center developers share ideas04:59
openstackgerritStephen Finucane proposed openstack-dev/pbr master: Deprecate testr and nose integration  https://review.openstack.org/51822404:59
clarkband pretend to be a networking person again04:59
*** bhavik1 has quit IRC05:00
*** mriedem has quit IRC05:02
dmsimardfungi: yes, I think this might be a case of if you have a hammer (ansible) everything looks like a nail :)05:02
dirkdmsimard: ok, as I feared/expected. this passes just fine with LC_ALL=en_US.utf8, and fails the same way like in the CI with LC_ALL=C. so I need to rediscover the magic place that is changing locale for the other distros and figure out why/how that needs to be done for opensuse05:03
dmsimardOk, it's getting late on the other end of the planet, I'll go to sleep. Have fun !05:03
dirkclarkb: is there a way to figure out the output of "locale" easily on all the different nodepool images other than posting a DNM review that introspects the run?05:03
dmsimarddirk: it's really cool that we at least know what the problem is -- it's not a blocker for me but it'd be a nice to have05:03
dirkI remember we had issues with that int he past but I forgot where the magic locale stuff was done05:04
dirkprobably this is in diskimage-builder05:04
* dirk goes chasing05:04
dmsimarddirk: I'll have to catch up tomorrow, good night :)05:04
clarkbdirk an infra root can login and check but that may not be the same env as used by zuul/ansible05:05
clarkbso may be best to do that anyways05:05
dirkclarkb: k, thanks. doing a DNM review now05:06
dmsimarddirk: you'll want to rebase on top of https://review.openstack.org/#/c/517826/05:07
dirkclarkb: btw, any time this week to sync up on tumbleweed nodepool images?05:07
* dmsimard off05:07
dirkmaybe grabbing pabelanger alongside05:07
clarkbdirk: lunch tomorrow?05:07
*** sree has quit IRC05:10
*** janki has joined #openstack-infra05:17
*** slaweq has joined #openstack-infra05:25
*** huanxie has joined #openstack-infra05:29
*** slaweq has quit IRC05:29
*** armaan has quit IRC05:30
*** armaan has joined #openstack-infra05:30
*** felipemonteiro has joined #openstack-infra05:32
*** salv-orlando has joined #openstack-infra05:36
*** salv-orlando has quit IRC05:40
*** sree has joined #openstack-infra05:43
AJaegerconfig-core, https://review.openstack.org/517768 is ready for review05:44
openstackgerritAndreas Jaeger proposed openstack-infra/openstack-zuul-jobs master: Remove unused tox-functional jobs  https://review.openstack.org/51776105:44
openstackgerritAndreas Jaeger proposed openstack-infra/openstack-zuul-jobs master: Remove legacy tox-func jobs  https://review.openstack.org/51776605:44
ianwAJaeger: haha your ears must be burning, you were just mentioned as the super reviewer in the windmill session :)05:45
AJaegerme and windmill? Never reviewed ;)05:48
openstackgerritMerged openstack-infra/project-config master: Use tox-functional for func jobs  https://review.openstack.org/51776505:48
*** sree has quit IRC05:48
openstackgerritMerged openstack-infra/project-config master: Remove requirements tox jobs  https://review.openstack.org/51776805:52
openstackgerritAndreas Jaeger proposed openstack-infra/openstack-zuul-jobs master: Remove opensdk jobs  https://review.openstack.org/51823205:54
*** stakeda has joined #openstack-infra05:56
*** slaweq has joined #openstack-infra05:56
*** jamesmcarthur has joined #openstack-infra06:01
*** slaweq has quit IRC06:01
*** sbezverk has joined #openstack-infra06:01
*** jamesmca_ has joined #openstack-infra06:03
openstackgerritOpenStack Proposal Bot proposed openstack-infra/project-config master: Normalize projects.yaml  https://review.openstack.org/51823406:03
*** jamesmca_ has quit IRC06:04
*** jamesmc__ has joined #openstack-infra06:05
*** jamesmcarthur has quit IRC06:05
*** jamesmc__ has quit IRC06:09
*** sbezverk has quit IRC06:16
*** namnh has joined #openstack-infra06:18
*** dhinesh has joined #openstack-infra06:19
*** edmondsw has quit IRC06:26
*** edmondsw has joined #openstack-infra06:29
*** edmondsw has quit IRC06:29
*** edmondsw has joined #openstack-infra06:30
*** edmondsw has quit IRC06:30
*** slaweq has joined #openstack-infra06:33
dirkclarkb: yep, works for me. I will try to be on the 4th level around lunch time tomorrow06:33
*** salv-orlando has joined #openstack-infra06:35
*** slaweq has quit IRC06:37
*** slaweq has joined #openstack-infra06:37
*** slaweq has quit IRC06:38
*** edmondsw has joined #openstack-infra06:38
*** slaweq has joined #openstack-infra06:38
*** felipemonteiro has quit IRC06:39
*** jamesmcarthur has joined #openstack-infra06:40
*** edmondsw has quit IRC06:40
*** jamesmca_ has joined #openstack-infra06:41
*** jamesmcarthur has quit IRC06:41
*** mat128 has quit IRC06:42
*** jamesmca_ has quit IRC06:43
*** slaweq has quit IRC06:43
*** jamesmcarthur has joined #openstack-infra06:43
*** sbezverk has joined #openstack-infra06:43
*** jamesmcarthur has quit IRC06:47
*** baoli has joined #openstack-infra06:51
*** gouthamr has quit IRC06:54
*** sree has joined #openstack-infra06:54
*** baoli has quit IRC06:55
*** jamesmcarthur has joined #openstack-infra06:57
*** sree has quit IRC06:59
*** purp has quit IRC06:59
*** jamesmcarthur has quit IRC07:01
*** jamesmcarthur has joined #openstack-infra07:04
openstackgerritMerged openstack-infra/project-config master: Normalize projects.yaml  https://review.openstack.org/51823407:08
*** jamesmcarthur has quit IRC07:09
dhellmannfungi : thanks07:10
prometheanfirewell, you guys said to bug you more often no... https://review.openstack.org/50453007:10
prometheanfirekthnx07:10
*** pgadiya has joined #openstack-infra07:11
SamYapleprometheanfire: are we actually going to gate on ubuntu? that ought to be fun :D07:11
prometheanfireSamYaple: where did you see ubuntu?07:11
openstackgerritNisha Agarwal proposed openstack-infra/project-config master: Remove legacy sushy jobs  https://review.openstack.org/51826107:11
SamYapleprometheanfire: s/ubuntu/gentoo/07:12
prometheanfireSamYaple: this is mainly for osa :P07:12
prometheanfireactually, should be osad from now on07:12
prometheanfireevrardjp: ping07:12
prometheanfirenope, doesn't pop up on his presentation07:12
prometheanfire:D07:12
SamYapleprometheanfire: youre regressing, it was already osad!07:12
SamYaplei forgetwhat it wasnOD amed before then07:13
prometheanfireindeed, and it now is again07:13
SamYapleis it really?07:13
prometheanfireansible-lxc-openstack07:13
*** andreas_s has joined #openstack-infra07:13
prometheanfireno, but I'm bringing it back, baby07:13
SamYaplehaha07:13
prometheanfireok, seeing you guys at the suse party or wherever07:14
prometheanfire:D07:14
*** edmondsw has joined #openstack-infra07:14
*** sbezverk has quit IRC07:15
SamYaplenot me :(07:15
SamYapleim in california on other business07:15
dhellmannfungi , dhinesh : https://review.openstack.org/51826507:16
*** dhinesh has quit IRC07:19
*** edmondsw has quit IRC07:19
openstackgerritNisha Agarwal proposed openstack-infra/openstack-zuul-jobs master: CleanUp sushy legacy jobs  https://review.openstack.org/51826807:21
*** spectr has quit IRC07:22
*** zigo has quit IRC07:24
*** signed8b_ is now known as signed8bit_Zzz07:27
*** zigo has joined #openstack-infra07:28
*** signed8bit_Zzz has quit IRC07:35
*** signed8bit has joined #openstack-infra07:36
*** huanxie has quit IRC07:42
*** annp has quit IRC07:42
*** thorre has quit IRC07:43
*** thorre has joined #openstack-infra07:44
*** HeOS has joined #openstack-infra07:46
*** ykarel|afk is now known as ykarel|lunch07:47
openstackgerritNisha Agarwal proposed openstack-infra/project-config master: Removes the legacy jobs for virtualbmc  https://review.openstack.org/51827207:47
*** huanxie has joined #openstack-infra07:48
*** vsaienk0 has joined #openstack-infra07:49
*** slaweq has joined #openstack-infra07:56
*** erlon has quit IRC07:58
openstackgerritNisha Agarwal proposed openstack-infra/project-config master: Removes the legacy jobs for virtualbmc  https://review.openstack.org/51827207:59
*** eumel8 has joined #openstack-infra07:59
openstackgerritNisha Agarwal proposed openstack-infra/project-config master: Remove legacy sushy jobs  https://review.openstack.org/51826108:00
*** slaweq has quit IRC08:00
openstackgerritNisha Agarwal proposed openstack-infra/openstack-zuul-jobs master: CleanUp sushy legacy jobs  https://review.openstack.org/51826808:02
*** hogepodge has quit IRC08:02
*** samueldmq has quit IRC08:03
*** hogepodge has joined #openstack-infra08:04
*** apetrich has joined #openstack-infra08:06
*** samueldmq has joined #openstack-infra08:06
*** pcaruana has joined #openstack-infra08:06
openstackgerritNisha Agarwal proposed openstack-infra/openstack-zuul-jobs master: CleanUp the virtualbmc jobs definitions  https://review.openstack.org/51827708:06
*** dsariel__ has quit IRC08:07
*** signed8bit is now known as signed8bit_Zzz08:08
*** slaweq has joined #openstack-infra08:10
*** Liced has joined #openstack-infra08:12
*** Hal has joined #openstack-infra08:14
*** signed8bit_Zzz has quit IRC08:14
*** hashar has joined #openstack-infra08:15
*** slaweq has quit IRC08:18
*** alexchadin has joined #openstack-infra08:18
*** slaweq has joined #openstack-infra08:21
*** slaweq has quit IRC08:22
*** slaweq has joined #openstack-infra08:22
*** tesseract has joined #openstack-infra08:23
*** edmondsw has joined #openstack-infra08:23
*** slaweq has quit IRC08:24
*** sree has joined #openstack-infra08:24
*** trown|outtypewww has quit IRC08:26
*** slaweq has joined #openstack-infra08:27
*** trown has joined #openstack-infra08:27
*** martinkopec has joined #openstack-infra08:27
*** edmondsw has quit IRC08:28
*** zoli is now known as zli08:28
*** zli is now known as zoli08:28
*** jpena|off is now known as jpena08:30
*** dizquierdo has joined #openstack-infra08:30
*** ralonsoh has joined #openstack-infra08:33
*** martinkopec has quit IRC08:36
*** ccamacho has joined #openstack-infra08:36
*** jascott1 has quit IRC08:37
*** e0ne has joined #openstack-infra08:37
*** jascott1 has joined #openstack-infra08:38
*** jascott1 has quit IRC08:42
*** dizquierdo has quit IRC08:44
*** salv-orlando has quit IRC08:45
*** salv-orlando has joined #openstack-infra08:46
*** amoralej|off is now known as amoralej08:47
*** zhurong has joined #openstack-infra08:50
*** salv-orlando has quit IRC08:51
*** ykarel|lunch is now known as ykarel08:53
*** dingyichen has quit IRC08:54
*** namnh has quit IRC08:55
*** edmondsw has joined #openstack-infra08:57
*** edmondsw has quit IRC09:01
*** jpich has joined #openstack-infra09:02
*** yamamoto has quit IRC09:02
*** slaweq has quit IRC09:04
*** yamamoto has joined #openstack-infra09:05
*** alexchadin has quit IRC09:05
*** alexchadin has joined #openstack-infra09:05
*** alexchadin has quit IRC09:06
*** alexchadin has joined #openstack-infra09:06
*** alexchadin has quit IRC09:06
*** alexchadin has joined #openstack-infra09:07
*** alexchadin has quit IRC09:07
openstackgerritTristan Cacqueray proposed openstack-infra/zuul feature/zuulv3: mqtt: Add basic reporter  https://review.openstack.org/51827909:07
*** alexchadin has joined #openstack-infra09:08
*** yamamoto has quit IRC09:09
*** alexchadin has quit IRC09:12
*** lucas-afk is now known as lucasagomes09:17
*** alexchadin has joined #openstack-infra09:20
*** salv-orlando has joined #openstack-infra09:23
*** alexchadin has quit IRC09:24
*** liujiong has quit IRC09:30
*** dsariel__ has joined #openstack-infra09:31
*** slaweq has joined #openstack-infra09:36
*** derekh has joined #openstack-infra09:42
*** alexchadin has joined #openstack-infra09:45
*** tosky has joined #openstack-infra09:46
*** yamamoto has joined #openstack-infra09:46
*** zhurong has quit IRC09:49
*** alexchadin has quit IRC09:49
openstackgerritAntoine Musso proposed openstack-infra/gearman-plugin master: Add maven as a test bindep  https://review.openstack.org/51828409:51
*** gouthamr has joined #openstack-infra09:51
*** alexchadin has joined #openstack-infra09:53
*** hashar has quit IRC09:53
*** hashar has joined #openstack-infra09:53
*** Kevin_Zheng has quit IRC09:55
*** alexchadin has quit IRC09:57
*** edmondsw has joined #openstack-infra10:06
*** wolverineav has joined #openstack-infra10:07
*** vipul has quit IRC10:09
*** alexchadin has joined #openstack-infra10:10
*** alexchadin has quit IRC10:10
*** alexchadin has joined #openstack-infra10:10
*** spiffxp has quit IRC10:10
odyssey4meis it just me, or is http://logs.openstack.org/ dead?10:10
*** edmondsw has quit IRC10:11
*** cuongnv has quit IRC10:12
*** wolverineav has quit IRC10:13
openstackgerritAntoine Musso proposed openstack-infra/gearman-plugin master: Add maven as a test bindep  https://review.openstack.org/51828410:14
AJaegerodyssey4me: works for me10:17
odyssey4meAJaeger weird, I'm getting a full connection timeout - I guess a reboot might be in order10:18
*** vipul has joined #openstack-infra10:26
*** jchhatbar has joined #openstack-infra10:26
*** janki has quit IRC10:26
*** spiffxp has joined #openstack-infra10:27
*** yamamoto has quit IRC10:27
*** salv-orlando has quit IRC10:27
*** yamamoto has joined #openstack-infra10:27
openstackgerritAntoine Musso proposed openstack-infra/openstack-zuul-jobs master: Jenkins plugins to xenial for java 8  https://review.openstack.org/51828710:29
*** slaweq has quit IRC10:29
*** vipul has quit IRC10:30
openstackgerritAntoine Musso proposed openstack-infra/gearman-plugin master: Add maven/java8 jdk as test bindeps  https://review.openstack.org/51828410:30
*** spiffxp has quit IRC10:31
openstackgerritAntoine Musso proposed openstack-infra/zmq-event-publisher master: Add maven/java8 jdk as test bindeps  https://review.openstack.org/51829010:32
*** yamamoto has quit IRC10:33
*** ianychoi_ has joined #openstack-infra10:33
*** pgadiya has quit IRC10:33
*** markvoelker has joined #openstack-infra10:34
*** janki has joined #openstack-infra10:34
fricklerAJaeger: I'd be fine with merging gentoo nodepool builds (https://review.openstack.org/504530) but I'm not sure about the timing, should we wait until after the summit? where can we see build logs currently?10:34
*** jchhatbar has quit IRC10:35
*** sree has quit IRC10:36
*** ianychoi has quit IRC10:36
*** sree has joined #openstack-infra10:36
*** markvoelker_ has joined #openstack-infra10:37
*** markvoel_ has joined #openstack-infra10:37
*** vipul has joined #openstack-infra10:40
*** markvoelker has quit IRC10:40
*** yongwc has joined #openstack-infra10:41
*** markvoelker_ has quit IRC10:41
*** sree has quit IRC10:41
*** spiffxp has joined #openstack-infra10:42
*** ldnunes has joined #openstack-infra10:43
*** armaan has quit IRC10:43
yongwcHello, when I use the stack.sh or unstack.sh of devstack, sometimes the shell will report "fork: retry: No child processes, fork: Resource temporarily unavailable". Anybody knows the cause of that problem?10:45
*** links has quit IRC10:45
AJaegerfrickler: good question, haven't looked for logs for some time. Best ask an infra-root about that - and whether timing for merge of 504530 is fine10:45
*** slaweq has joined #openstack-infra10:46
AJaegeryongwc: next time better ask on #openstack-dev, that's the development channel.10:47
*** slaweq has quit IRC10:47
AJaegeryongwc: you hit a Linux process limit on your system, google search should explain this in more detail and suggest solutionls for your environment. Nothing OpenStack specific here10:47
*** slaweq has joined #openstack-infra10:47
yongwcAjaeger: OK, thanks for your help.10:49
*** sdague has joined #openstack-infra10:53
*** slaweq has quit IRC10:53
*** wolverineav has joined #openstack-infra10:55
*** ykarel is now known as ykarel|afk10:57
*** links has joined #openstack-infra10:58
*** huanxie has quit IRC10:59
*** sree has joined #openstack-infra11:03
*** pbourke has quit IRC11:07
*** sree has quit IRC11:08
*** markvoel_ has quit IRC11:08
*** pbourke has joined #openstack-infra11:08
*** markvoelker has joined #openstack-infra11:09
*** yamamoto has joined #openstack-infra11:12
*** rfolco has joined #openstack-infra11:15
*** armaan has joined #openstack-infra11:16
*** andreas_s has quit IRC11:16
*** alexchadin has quit IRC11:17
*** pblaho has quit IRC11:20
*** jamesmcarthur has joined #openstack-infra11:23
*** milan_ has joined #openstack-infra11:25
vdrokgood morning folks! trying to understand why check-requirements job is not run on stable/pike in https://review.openstack.org/51801511:25
vdrok(the patch is adding an incorrect requirement version, the job should have been run and failed?)11:26
milan_vdrok ++11:26
*** stakeda has quit IRC11:27
*** armaan has quit IRC11:27
*** salv-orlando has joined #openstack-infra11:27
*** armaan has joined #openstack-infra11:28
*** jamesmcarthur has quit IRC11:28
*** udesale has quit IRC11:28
*** alexchadin has joined #openstack-infra11:28
*** martinkopec has joined #openstack-infra11:28
*** slaweq has joined #openstack-infra11:29
*** links has quit IRC11:30
*** yamamoto has quit IRC11:31
*** salv-orlando has quit IRC11:32
*** wangyong has joined #openstack-infra11:35
*** yongwc has quit IRC11:37
* milan_ is away: hungry11:39
*** andreas_s has joined #openstack-infra11:41
*** yamamoto has joined #openstack-infra11:43
*** links has joined #openstack-infra11:44
*** yongwc has joined #openstack-infra11:44
*** thorst has quit IRC11:46
*** wangyong has quit IRC11:47
*** smatzek has joined #openstack-infra11:48
*** dtantsur|afk is now known as dtantsur11:49
*** vsaienk0 has quit IRC11:49
*** slaweq has quit IRC11:54
*** andreas_s has quit IRC11:54
*** yamamoto has quit IRC11:58
*** vsaienk0 has joined #openstack-infra11:59
*** andreas_s has joined #openstack-infra11:59
*** jpena is now known as jpena|lunch12:00
*** nicolasbock has joined #openstack-infra12:02
*** sree has joined #openstack-infra12:03
*** lucasagomes is now known as lucas-hungry12:04
*** jkilpatr has joined #openstack-infra12:04
openstackgerritAndrea Frittoli proposed openstack-infra/zuul-jobs master: Add compress capabilities to stage artifacts  https://review.openstack.org/50923412:05
andreafjeblair, mordred: the patch to compress logs https://review.openstack.org/50923412:07
*** ykarel|afk is now known as ykarel12:07
*** sree has quit IRC12:08
*** gcb has joined #openstack-infra12:08
dtantsurfolks, we're trying to bring in legacy jobs, and the cover jobs fails with POST_FAILURE https://review.openstack.org/51701012:10
dtantsurany hints?12:10
dtantsurI *think* it's because of some non-standard layout in the "cover" tox target, but I don't know how to proceed12:11
AJaegerdtantsur: check the ara link12:11
AJaegerdtantsur:  in http://logs.openstack.org/10/517010/1/check/openstack-tox-cover/282fcb8/12:12
AJaegerdtantsur: and then see which task failed and look at log files12:12
dtantsurAJaeger: this does seem to confirm my guess, but it does not give any clue how to proceed12:12
dtantsurrsync: link_stat "/home/zuul/src/git.openstack.org/openstack/ironic-inspector/cover" failed: No such file or directory (2)12:13
AJaegerdtantsur: you're not producing the cover content in your job at all12:13
dtantsurmaybe? it used to work before the transition, but it used to be non-standard for sure12:13
AJaegerdtantsur: I suggest to check how other projects handle this and what they do different.12:14
dtantsurI think in Pike and older it was just printing the coverage12:14
dtantsurAJaeger: this requires researching how 'testr --coverage' works.. I'd prefer to just disable the job on stable branches or make it non-voting12:15
AJaegerdtantsur: I see on master in your tox.ini "coverage html -d ./cover" but this is not in the job output.12:16
AJaegerdtantsur: what about adding this to the stable branch?12:16
dtantsurlemme try12:16
AJaegerdtantsur: I'm guessing here - disabling cover on the branch is an option for sure as well...12:17
*** hashar has quit IRC12:17
*** bbc1__ has quit IRC12:17
*** alexchadin has quit IRC12:19
dtantsurAJaeger: trying with https://review.openstack.org/#/c/518318/ now12:21
*** janki has quit IRC12:22
*** cshastri has quit IRC12:23
*** hashar has joined #openstack-infra12:25
*** ekhugen| has quit IRC12:25
*** zz_ja has quit IRC12:26
*** pblaho has joined #openstack-infra12:26
*** ekhugen has joined #openstack-infra12:27
*** zz_ja has joined #openstack-infra12:27
*** salv-orlando has joined #openstack-infra12:29
*** ldnunes has quit IRC12:29
*** salv-orlando has quit IRC12:31
*** salv-orl_ has joined #openstack-infra12:31
*** edmondsw has joined #openstack-infra12:31
*** yamamoto has joined #openstack-infra12:34
*** catintheroof has joined #openstack-infra12:34
*** edmondsw has quit IRC12:35
*** alexchadin has joined #openstack-infra12:36
*** links has quit IRC12:37
*** edmondsw has joined #openstack-infra12:38
*** salv-orl_ has quit IRC12:40
*** yongwc has quit IRC12:41
*** ldnunes has joined #openstack-infra12:42
*** hemna_ has joined #openstack-infra12:44
*** sree has joined #openstack-infra12:44
*** catintheroof has quit IRC12:45
*** markvoelker_ has joined #openstack-infra12:46
*** markvoel_ has joined #openstack-infra12:47
*** markvoelker has quit IRC12:47
vdrokAJaeger: morning. maybe you have some idea regarding the https://review.openstack.org/518015? in history ~an hour ago12:47
*** ldnunes has quit IRC12:49
*** gouthamr has quit IRC12:50
*** markvoelker_ has quit IRC12:51
*** samueldmq has quit IRC12:55
*** samueldmq has joined #openstack-infra12:55
*** catintheroof has joined #openstack-infra12:57
*** markus_z has joined #openstack-infra12:57
*** thorst has joined #openstack-infra12:57
*** slaweq has joined #openstack-infra12:57
*** lucas-hungry is now known as lucasagomes12:57
*** LindaWang has joined #openstack-infra12:58
*** ldnunes has joined #openstack-infra13:01
*** rlandy has joined #openstack-infra13:02
*** eharney has quit IRC13:02
*** jcoufal has joined #openstack-infra13:05
* milan_ is back (gone 01:26:50)13:06
*** ramishra has quit IRC13:12
*** ramishra has joined #openstack-infra13:14
*** hashar has quit IRC13:17
*** edmondsw has quit IRC13:19
*** armaan has quit IRC13:20
*** armaan has joined #openstack-infra13:21
*** pcaruana has quit IRC13:22
*** signed8bit has joined #openstack-infra13:23
*** hashar has joined #openstack-infra13:24
*** thorst has quit IRC13:25
*** slaweq has quit IRC13:25
*** slaweq has joined #openstack-infra13:26
AJaegervdrok: I guess that requirements repo needs backport of the jobs to their stable branches. You could try that and then add a depends-On the backport to verify that it helps13:27
*** panda|ruck is now known as panada|ruck|brb13:28
vdrokAJaeger: thank you, will do in a bit13:29
vdrokmilan_: or, if you want to try now :)13:29
*** slaweq has quit IRC13:31
milan_vdrok, sure, where do I start? :)13:34
AJaegermilan_: copy .zuul.d and playbooks directories to stable branch of requirements13:34
AJaegerbackporting individual changes might be too much, I would backport everything at once13:35
AJaegermilan_, vdrok https://docs.openstack.org/infra/manual/zuulv3.html#stable-branches13:35
milan_AJaeger, thx but isn't it actually what this one is about? https://review.openstack.org/#/c/517010/13:36
* milan_ a bit lost, sorry13:36
milan_aah, that one might be still missing a .zuul.yaml and other bits13:37
* milan_ checks13:37
*** thorst has joined #openstack-infra13:37
*** ramishra has quit IRC13:37
AJaegermilan_: I'm talking about *requirements* repo13:38
AJaegermilan_: since you miss the check-requirements job.13:38
* milan_ facepalm13:39
AJaegerBut you might want to wait for jeblair to wake up down-under and give his expertise13:39
milan_AJaeger, thanks!13:39
*** edmondsw has joined #openstack-infra13:40
AJaegermilan_: I would have expected it to work with check-requirements since that's specified in project-config - but job definition and template is in requirements repo.13:40
*** edmondsw has quit IRC13:44
*** armaan has quit IRC13:47
*** panada|ruck|brb is now known as panda|ruck13:47
*** armaan has joined #openstack-infra13:47
*** thorst has quit IRC13:47
*** kgiusti has joined #openstack-infra13:48
openstackgerritAntoine Musso proposed openstack-infra/openstack-zuul-jobs master: Jenkins plugins to xenial for java 8  https://review.openstack.org/51828713:51
*** jpena|lunch is now known as jpena13:54
*** amoralej is now known as amoralej|lunch13:55
*** alexchadin has quit IRC13:55
*** yamamoto has quit IRC13:56
*** signed8bit is now known as signed8bit_Zzz13:56
openstackgerritAntoine Musso proposed openstack-infra/project-config master: Switch Jenkins plugins to Xenial based jobs  https://review.openstack.org/51833313:56
*** signed8bit_Zzz has quit IRC13:57
*** andreas_s has quit IRC13:57
openstackgerritAntoine Musso proposed openstack-infra/openstack-zuul-jobs master: Jenkins plugins to xenial for java 8  https://review.openstack.org/51828713:57
*** kgiusti has left #openstack-infra13:58
*** AJaeger has quit IRC13:58
*** jaypipes has joined #openstack-infra13:58
*** udesale has joined #openstack-infra13:59
*** esberglu has joined #openstack-infra14:00
*** esberglu has quit IRC14:00
*** Liced has quit IRC14:01
*** esberglu has joined #openstack-infra14:01
*** alexchadin has joined #openstack-infra14:01
*** alexchadin has quit IRC14:02
*** catintheroof has quit IRC14:03
*** slaweq has joined #openstack-infra14:03
*** eharney has joined #openstack-infra14:03
*** mat128 has joined #openstack-infra14:05
milan_cool I guess I know what I'm going to be doing about it now :D so far I've reported https://bugs.launchpad.net/openstack-requirements/+bug/173067314:06
openstackLaunchpad bug 1730673 in OpenStack Global Requirements "check-requirements job is not running on stable/pike project branches" [Undecided,New]14:06
* milan_ digs into copying jobs now14:06
milan_vdrok, FYI ^14:06
* milan_ hopes it makes sense14:06
*** andreas_s has joined #openstack-infra14:07
*** AJaeger has joined #openstack-infra14:07
*** catintheroof has joined #openstack-infra14:10
*** yamamoto has joined #openstack-infra14:10
*** bobh has joined #openstack-infra14:11
*** yongwc has joined #openstack-infra14:13
*** yongwc has quit IRC14:14
*** edmondsw has joined #openstack-infra14:15
*** yamamoto has quit IRC14:15
*** andreas_s has quit IRC14:16
*** yamahata has quit IRC14:17
*** sree has quit IRC14:18
vdrokmilan_: it does :)14:18
milan_cool :)14:18
*** sree has joined #openstack-infra14:19
*** slaweq has quit IRC14:19
*** signed8bit has joined #openstack-infra14:19
*** edmondsw has quit IRC14:19
*** andreas_s has joined #openstack-infra14:20
*** sree has quit IRC14:23
*** smatzek has quit IRC14:25
*** smatzek has joined #openstack-infra14:25
*** slaweq has joined #openstack-infra14:26
*** sree has joined #openstack-infra14:26
*** smatzek has quit IRC14:29
*** sree has quit IRC14:30
*** dhill_ has quit IRC14:34
*** signed8bit has quit IRC14:37
*** signed8bit has joined #openstack-infra14:38
*** dhill_ has joined #openstack-infra14:41
*** jcoufal has quit IRC14:45
*** dsariel has joined #openstack-infra14:45
*** dsariel__ has quit IRC14:47
*** pcaruana has joined #openstack-infra14:47
*** Nil_ has joined #openstack-infra14:48
*** eumel8 has quit IRC14:49
*** ramishra has joined #openstack-infra14:50
*** amoralej|lunch is now known as amoralej14:51
*** ramishra has quit IRC15:00
*** spectr has joined #openstack-infra15:01
openstackgerritAttila Darazs proposed openstack-infra/openstack-zuul-jobs master: Call the proper playbook for puppet-syntax-3-centos-7  https://review.openstack.org/51834715:02
*** iyamahat has joined #openstack-infra15:03
openstackgerritAndreas Jaeger proposed openstack-infra/openstack-zuul-jobs master: Create openstack-tox-functional-py35 job  https://review.openstack.org/51834915:06
openstackgerritAndreas Jaeger proposed openstack-infra/openstack-zuul-jobs master: Remove obsolete functional-py35 jobs  https://review.openstack.org/51835015:06
openstackgerritAndreas Jaeger proposed openstack-infra/project-config master: Use functional-py35 job  https://review.openstack.org/51835115:06
*** ykarel is now known as ykarel|away15:06
*** ldnunes has quit IRC15:07
*** ramishra has joined #openstack-infra15:07
milan_AJaeger, ^^100 https://review.openstack.org/#/c/518348/115:08
*** vsaienk0 has quit IRC15:08
* milan_ hopes it makes sense15:08
*** martinkopec has quit IRC15:09
*** smatzek has joined #openstack-infra15:10
*** smatzek has quit IRC15:11
*** smatzek has joined #openstack-infra15:12
*** yamamoto has joined #openstack-infra15:13
AJaegermilan_: it does make sense, reviewed. Thanks.15:13
milan_AJaeger, no prob, I can update in a bit, just need to git blame once I'm out of a downstream mtg15:14
AJaegermilan_: sure, take your time.15:15
*** ykarel|away has quit IRC15:15
milan_or vdrok will :D15:16
milan_vdrok, ++15:16
AJaegerconfig-core, could we merge https://review.openstack.org/#/c/517761/ to remove some unused jobs, please?15:16
fricklerAJaeger: unless I'm mistaken, https://review.openstack.org/517761 removes only 6 out of 16 playbooks, is that intentional?15:17
AJaegermilan_, vdrok : team work ;)15:17
*** thorst has joined #openstack-infra15:17
AJaegerfrickler: let me check...15:17
milan_team work's the fastest way forward here! :D15:17
AJaegerfrickler: indeed ;(15:17
*** vsaienk0 has joined #openstack-infra15:18
AJaegerfrickler: 12 playbooks instead of 16 - which ones did I miss?15:19
openstackgerritAndreas Jaeger proposed openstack-infra/openstack-zuul-jobs master: Remove unused tox-functional jobs  https://review.openstack.org/51776115:19
openstackgerritAndreas Jaeger proposed openstack-infra/openstack-zuul-jobs master: Remove legacy tox-func jobs  https://review.openstack.org/51776615:20
AJaegerpatch ^15:20
*** ldnunes has joined #openstack-infra15:21
*** gcb has quit IRC15:22
*** edmondsw has joined #openstack-infra15:23
fricklerAJaeger: indeed, 12 is the right number. +215:23
*** thorst_ has joined #openstack-infra15:24
AJaegerthanks15:24
*** vsaienk0 has quit IRC15:25
*** yamamoto has quit IRC15:26
*** thorst has quit IRC15:26
*** ldnunes has quit IRC15:26
*** markus_z has quit IRC15:27
*** edmondsw has quit IRC15:27
*** camunoz has joined #openstack-infra15:27
AJaegerfrickler: could you review https://review.openstack.org/#/c/517758/ as well, please?15:30
*** rbrndt has joined #openstack-infra15:31
*** camunoz has quit IRC15:34
*** camunoz has joined #openstack-infra15:34
*** signed8bit is now known as signed8bit_Zzz15:35
*** signed8bit_Zzz has quit IRC15:35
*** kgiusti has joined #openstack-infra15:38
*** ldnunes has joined #openstack-infra15:39
*** signed8bit has joined #openstack-infra15:39
*** jascott1 has joined #openstack-infra15:39
*** signed8bit is now known as signed8bit_Zzz15:40
*** eharney has quit IRC15:40
*** signed8bit_Zzz is now known as signed8bit15:40
*** caphrim007 has quit IRC15:42
openstackgerritAndreas Scheuring proposed openstack/diskimage-builder master: Add zipl element as s390x architecture bootloader  https://review.openstack.org/44354815:44
*** jascott1 has quit IRC15:44
*** thorst_ has quit IRC15:45
fricklerAJaeger: I looked at that one but I'd rather leave it to someone else15:46
AJaegerfrickler: ok15:47
*** efried is now known as efried_N2O15:47
*** ccamacho has left #openstack-infra15:48
mwhahahaso we just say a mirror failure for OVH in the gate, http://logs.openstack.org/41/514741/2/gate/legacy-tripleo-ci-centos-7-nonha-multinode-oooq/a7fe6c0/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz#_2017-11-07_15_35_1915:53
*** eharney has joined #openstack-infra15:53
mwhahahaare 5xx from the mirrors being monitored somewhere in infra?15:53
openstackgerritAndreas Jaeger proposed openstack-infra/openstack-zuul-jobs master: Readd legacy-puppet-syntax-3-centos-7 playbook  https://review.openstack.org/51836215:53
*** xarses has joined #openstack-infra15:54
openstackgerritAndreas Jaeger proposed openstack-infra/openstack-zuul-jobs master: Readd legacy-puppet-syntax-3-centos-7 playbook  https://review.openstack.org/51836215:54
AJaegerfrickler, yolanda could you review this as well to unbreak some jobs, please?  ^15:54
*** edmondsw has joined #openstack-infra15:54
*** yamamoto has joined #openstack-infra15:55
*** janki has joined #openstack-infra15:56
openstackgerritMerged openstack-infra/project-config master: make a gentoo nodepool image  https://review.openstack.org/50453015:57
openstackgerritMerged openstack-infra/openstack-zuul-jobs master: Remove unused tox-functional jobs  https://review.openstack.org/51776115:57
openstackgerritMerged openstack-infra/openstack-zuul-jobs master: Create openstack-tox-functional-py35 job  https://review.openstack.org/51834915:57
*** slaweq has quit IRC15:58
*** edmondsw has quit IRC15:59
*** spectr has quit IRC16:00
openstackgerritMerged openstack-infra/openstack-zuul-jobs master: networking-midonet: Exclude centos-7 jobs from ocata  https://review.openstack.org/51789116:00
*** ihrachys has joined #openstack-infra16:01
openstackgerritMerged openstack-infra/openstack-zuul-jobs master: Remove legacy tox-func jobs  https://review.openstack.org/51776616:06
*** yamamoto has quit IRC16:06
openstackgerritMerged openstack-infra/project-config master: Add tripleo-common-tempest-plugin to zuul.d  https://review.openstack.org/51758516:07
openstackgerritMerged openstack-infra/project-config master: Add initial jobs for CloudKitty Tempest plugin  https://review.openstack.org/51667916:07
openstackgerritMerged openstack-infra/project-config master: Use functional-py35 job  https://review.openstack.org/51835116:07
openstackgerritAndreas Jaeger proposed openstack-infra/openstack-zuul-jobs master: Remove obsolete functional-py35 jobs  https://review.openstack.org/51835016:07
*** HeOS has quit IRC16:08
*** armaan has quit IRC16:09
*** HeOS has joined #openstack-infra16:09
openstackgerritJose Luis Franco proposed openstack-infra/tripleo-ci master: Run overcloud-upgrade tag only in upgrades jobs.  https://review.openstack.org/51836716:09
openstackgerritJose Luis Franco proposed openstack-infra/tripleo-ci master: Run overcloud-upgrade role only in upgrades jobs.  https://review.openstack.org/51836716:10
*** trown is now known as trown|brb16:11
*** purp has joined #openstack-infra16:11
*** thorst has joined #openstack-infra16:13
*** trown|brb is now known as trown16:14
*** nikhil has joined #openstack-infra16:17
openstackgerritAndreas Scheuring proposed openstack/diskimage-builder master: Add zipl element as s390x architecture bootloader  https://review.openstack.org/44354816:20
*** salv-orlando has joined #openstack-infra16:20
*** andreas_s has quit IRC16:24
*** edmondsw has joined #openstack-infra16:27
*** psachin has quit IRC16:28
*** ianychoi_ has quit IRC16:29
*** edmondsw has quit IRC16:32
dtantsurfolks, do we have to remove grenade from the oldest stable branch ourself?16:33
dtantsurI'm investigating a curious CI failure on https://review.openstack.org/517011 and the traces seem to lead to http://logs.openstack.org/11/517011/2/check/ironic-inspector-grenade-dsvm/410729f/logs/devstack-gate-setup-workspace-old.txt.gz#_2017-11-07_14_36_38_23416:33
dtantsurAJaeger: do you know how it ^^^ is supposed to work now?16:33
*** HeOS has quit IRC16:33
*** armaan has joined #openstack-infra16:34
*** yamamoto has joined #openstack-infra16:35
*** ramishra has quit IRC16:36
*** HeOS has joined #openstack-infra16:37
*** udesale has quit IRC16:38
*** milan_ has quit IRC16:41
*** yamamoto has quit IRC16:41
*** electrofelix has joined #openstack-infra16:44
*** gyee has joined #openstack-infra16:45
*** sree has joined #openstack-infra16:47
*** dhinesh has joined #openstack-infra16:49
*** dhinesh_ has joined #openstack-infra16:52
*** sree has quit IRC16:52
*** dhinesh has quit IRC16:53
*** Apoorva has joined #openstack-infra16:54
*** hamzy has quit IRC16:55
*** caphrim007 has joined #openstack-infra16:55
*** caphrim007_ has joined #openstack-infra16:56
*** andreas_s has joined #openstack-infra16:57
*** caphrim007_ has quit IRC16:58
*** caphrim007 has quit IRC16:58
*** caphrim007_ has joined #openstack-infra16:58
*** efried_N2O is now known as efried16:58
*** kmalloc has joined #openstack-infra16:59
*** caphrim007 has joined #openstack-infra16:59
*** caphrim007 has quit IRC17:00
*** caphrim007_ has quit IRC17:00
*** edmondsw has joined #openstack-infra17:01
fricklerdtantsur: yes, please submit a corresponding branch exclude for your project(s)17:03
*** bobh has quit IRC17:05
*** edmondsw has quit IRC17:05
*** jpich has quit IRC17:08
*** dsariel has quit IRC17:10
*** andreas_s has quit IRC17:10
*** dtantsur is now known as dtantsur|afk17:16
vdrokcould anyone help to debug functional job failures at https://review.openstack.org/518342 ? the requirements can't be installed for some reason, prior to zuulv3 these jobs did run fine. do we need to tweak something else?17:16
*** e0ne has quit IRC17:16
vdrokfailure is at http://logs.openstack.org/42/518342/1/check/ironicclient-dsvm-functional/3cbdabb/job-output.txt.gz#_2017-11-07_15_01_32_07699917:16
*** signed8bit is now known as signed8bit_Zzz17:17
*** lucasagomes is now known as lucas-afk17:18
fricklervdrok: http://logs.openstack.org/42/518342/1/check/ironicclient-dsvm-functional/3cbdabb/job-output.txt.gz#_2017-11-07_15_01_32_690554 is the error behind it, the original clone is owned by zuul and tox is being run as jenkins17:22
fricklervdrok: there have been fixes for similar situation, let me check if I can find them17:22
*** signed8bit_Zzz has quit IRC17:23
*** andreas_s has joined #openstack-infra17:24
vdrokfrickler: doh, we have that patch in master, sorry :)17:24
vdrokneed to backport https://review.openstack.org/512510 as well17:24
vdrokthank you!17:24
*** RupturedI0 has joined #openstack-infra17:25
*** thorst has quit IRC17:26
*** jascott1 has joined #openstack-infra17:27
*** jascott1 has quit IRC17:28
openstackgerritDavid Moreau Simard proposed openstack-infra/zuul-jobs master: WIP: Add a role to install and configure dstat to run in the background  https://review.openstack.org/51837417:29
*** tesseract has quit IRC17:30
*** janki has quit IRC17:30
*** janki has joined #openstack-infra17:31
*** RupturedI0 has quit IRC17:31
*** edmondsw has joined #openstack-infra17:31
openstackgerritMerged openstack/diskimage-builder master: Move to a common lock-file directory  https://review.openstack.org/51407917:32
*** thorst has joined #openstack-infra17:32
*** janki has quit IRC17:32
*** andreas_s has quit IRC17:32
*** ralonsoh has quit IRC17:33
*** thorst has quit IRC17:34
*** edmondsw has quit IRC17:35
*** hashar is now known as hasharAway17:38
*** tesseract has joined #openstack-infra17:40
*** signed8bit has joined #openstack-infra17:46
*** andreas_s has joined #openstack-infra17:47
*** tesseract has quit IRC17:49
*** andreas_s has quit IRC17:51
*** dhinesh_ has quit IRC17:52
*** armaan has quit IRC17:52
*** trown is now known as trown|lunch17:54
*** Apoorva has quit IRC17:55
*** sree has joined #openstack-infra17:57
*** sree has quit IRC18:02
*** signed8bit is now known as signed8bit_Zzz18:05
*** bobh has joined #openstack-infra18:05
*** andreas_s has joined #openstack-infra18:05
*** signed8bit_Zzz has quit IRC18:06
*** jpena is now known as jpena|off18:09
AJaegerdtantsur|afk: the job is now in-tree, so you need to add the branches as frickler said18:09
*** bobh has quit IRC18:10
*** amoralej is now known as amoralej|off18:11
*** signed8bit has joined #openstack-infra18:16
*** andreas_s has quit IRC18:18
*** andreas_s has joined #openstack-infra18:19
*** andreas_s has quit IRC18:23
*** nikhil has quit IRC18:26
*** rbrndt has quit IRC18:27
*** lukebrowning has joined #openstack-infra18:28
*** slaweq has joined #openstack-infra18:28
*** wenlock has joined #openstack-infra18:29
*** panda|ruck is now known as panda|ruck|bbl18:30
*** e0ne has joined #openstack-infra18:33
wenlock@mordred /wave been a while since we chatted, hope you remember me. I've been trying to catch up on zuul3 latest happenings to see how it looks these days. Glad to see you guys presenting on it, do you happen to have any recordings?18:35
*** andreas_s has joined #openstack-infra18:37
*** eharney has quit IRC18:37
*** edmondsw has joined #openstack-infra18:42
*** jascott1 has joined #openstack-infra18:43
*** sree has joined #openstack-infra18:44
*** dhinesh has joined #openstack-infra18:45
*** hamzy has joined #openstack-infra18:45
AJaegerwenlock: https://www.openstack.org/videos contains all the videos from the OpenStack summit18:47
*** edmondsw has quit IRC18:47
wenlockAwesome, ty AJaeger18:47
AJaegerwenlock: check https://www.openstack.org/videos/sydney-2017/migrating-your-job-from-jenkins-job-builder-to-ansible-playbooks-a-zuulv3-story and https://www.openstack.org/videos/barcelona-2016/zuul-v3-openstack-and-ansible-native-cicd18:47
AJaegerwait the latest is from barcelona ;(18:47
*** dhinesh_ has joined #openstack-infra18:48
wenlockIs there any pointers on the GitHub specific setup?18:48
*** sree has quit IRC18:49
AJaegerwenlock: https://docs.openstack.org/infra/zuul/feature/zuulv3/ is the documentation. I cannot tell more18:50
*** dhinesh has quit IRC18:50
*** derekh has quit IRC18:50
wenlockty18:50
*** andreas_s has quit IRC18:50
jlvillalSo I was looking at: http://zuulv3.openstack.org/ and in the "Gate" queue is my Ironic patch: 518039 and one job is still processing. But when I click the job name I get output that just says "End of Stream"18:51
jlvillalDoes that mean the job is done and the status page isn't detecting it? Or does it mean the output got messed up and I can't see it?18:52
*** eharney has joined #openstack-infra18:53
*** slaweq_ has joined #openstack-infra18:58
*** slaweq has quit IRC19:00
*** d0ugal has quit IRC19:01
*** e0ne has quit IRC19:03
*** hemna_ has quit IRC19:05
*** thorst has joined #openstack-infra19:05
*** thorst has quit IRC19:06
*** bobh has joined #openstack-infra19:06
*** trown|lunch is now known as trown19:07
*** slaweq_ has quit IRC19:07
*** slaweq has joined #openstack-infra19:09
*** bobh has quit IRC19:11
*** thorst has joined #openstack-infra19:12
*** rbrndt has joined #openstack-infra19:12
*** thorst has quit IRC19:16
*** dave-mccowan has joined #openstack-infra19:18
*** jamesden_ has joined #openstack-infra19:19
*** dave-mcc_ has joined #openstack-infra19:22
*** Guest71388 has quit IRC19:23
*** dave-mccowan has quit IRC19:24
*** dansmith has joined #openstack-infra19:24
*** dansmith is now known as Guest9870619:24
*** sree has joined #openstack-infra19:25
*** amoralej|off is now known as amoralej19:28
*** iyamahat has quit IRC19:29
*** sree has quit IRC19:29
*** sree has joined #openstack-infra19:31
openstackgerritAndrea Frittoli proposed openstack-infra/zuul-jobs master: Add a generic process-test-results role  https://review.openstack.org/50945919:32
*** sree has quit IRC19:36
*** camunoz has quit IRC19:42
*** jamesden_ has quit IRC19:43
*** hemna_ has joined #openstack-infra19:43
*** derekh has joined #openstack-infra19:44
*** amoralej is now known as amoralej|off19:45
*** edmondsw has joined #openstack-infra19:46
*** iyamahat has joined #openstack-infra19:48
*** derekh has quit IRC19:49
*** edmondsw has quit IRC19:50
*** e0ne has joined #openstack-infra19:54
*** slaweq has quit IRC19:55
*** bobh has joined #openstack-infra19:58
*** kmalloc has quit IRC19:59
*** Apoorva has joined #openstack-infra19:59
*** armaan has joined #openstack-infra20:00
dmsimarddirk: did you end up finding the encoding issue for opensuse ? I tried to see if I could have a fix in ara for it but I'm just really bad at this kind of thing.20:03
dirkdmsimard: yes20:03
dmsimarddirk: I guess it could be a legitimate issue/bug in ara.. I know where the fix would be but I don't know what the fix is :)20:04
dirkdmsimard: https://review.openstack.org/#/c/518226/220:04
dirkdmsimard: I'll fix the image build to have teh proper locale20:04
dmsimarddirk: ok but could that issue be a legit problem for a user ? like, should I fix anything in ara you think ?20:04
dirkdmsimard: it is a problem for whoever sets locale to POSIX. I don't think there exists anyone who does that though. and it is not even offered as an option for regular users20:06
dmsimarddirk: ok, I'll remove my attempted fix (which doesn't work anyway) and leave the opensuse job non-voting for now20:06
*** e0ne has quit IRC20:09
*** e0ne has joined #openstack-infra20:09
*** caphrim007 has joined #openstack-infra20:11
*** thorst has joined #openstack-infra20:11
*** sree has joined #openstack-infra20:12
*** ldnunes has quit IRC20:15
*** catintheroof has quit IRC20:15
*** thorst has quit IRC20:15
*** electrofelix has quit IRC20:16
dirkdmsimard: works for me. I'll work on the dib fix20:16
dirkdmsimard: I just decided to party yesterday instead and am now back to do things20:16
dmsimardpartying is fun too20:16
*** sree has quit IRC20:17
*** edmondsw has joined #openstack-infra20:17
openstackgerritMerged openstack-infra/project-config master: Use infra publish jobs  https://review.openstack.org/51775820:22
*** thorst has joined #openstack-infra20:23
pabelangerdirk: clarkb: lunch today wfm20:27
*** e0ne has quit IRC20:27
*** thorst has quit IRC20:28
clarkbI'm planning on being over near project update room early today in order to do last minute prep20:29
*** camunoz has joined #openstack-infra20:31
*** dhill_ has quit IRC20:31
*** armaan has quit IRC20:32
*** armaan has joined #openstack-infra20:33
pabelangerclarkb: sure, I can head over after LTS discussions20:33
pabelangerOh, maybe not. it conflicts20:34
*** markvoel_ has quit IRC20:38
*** dhill_ has joined #openstack-infra20:38
*** dhinesh_ has quit IRC20:40
jlvillalAnyone around with the power to restart my gate job?20:43
jlvillalSeems to be stuck and running for 5 hr 49 min20:43
pabelangerwhich one?20:43
jlvillal518039,4 in the "gate"20:43
jlvillalThe last "job" in it, seems to be stuck. I just see an "End of Stream" message.20:44
jlvillalFor the last two hours20:44
pabelangerk, we should see why that is before a reset20:44
pabelangercould be issue with zuul20:44
pabelangerit is possible web console is not working, and job is infact running20:45
jlvillalpabelanger: I don't think the job is running.20:45
*** catintheroof has joined #openstack-infra20:46
jlvillalpabelanger: That job should take about 45 minutes. It has been running for at least three hours now.20:46
jlvillalpabelanger: I actually asked about it about two hours ago on this channel.20:47
pabelangerjlvillal: right, we'll need to look at logs. I can try here in a bit, otherwise, you'll hold up for another infra-root to help debug20:47
jlvillalpabelanger: Okay. So basically stuck for now. Correct?20:48
clarkbpabelanger: ya I thi k those interested in lts should be there as it is an important one20:50
*** catintheroof has quit IRC20:51
pabelangerjlvillal: yah, if it is stuck, then there is an issue, and we should debug and see why20:51
jlvillalpabelanger: Okay. I'll be patient :)20:51
pabelangerjlvillal: thanks!20:51
*** harlowja has quit IRC20:52
jeblairwenlock: we're still working on deployment documentation, including github.  the link AJaeger gave you has all the info, but it's not organized well to guide you through a setup.  we should have something better soon (before we actually release v3)20:53
*** jkilpatr has quit IRC20:54
*** thorst has joined #openstack-infra20:54
jeblairjlvillal: that's probably a case where the job is timing out very slowly (we have some known bugs around that).  you can speed up the process by uploading a new patchset (with, say, a minor commit message change) which should kick it out of the gate and re-approve20:57
*** catintheroof has joined #openstack-infra20:58
jlvillaljeblair: Okay. So you don't need the log messages or anything?20:58
jeblairjlvillal: i don't think so this time -- we have known issues with the console log streaming breaking and slow timeouts.  that's about as far as we got before summit.  those sound like they cover at least the first layer of errors we're seeing here (and of course are masking the underlying problem, but we have to fix those first)21:00
jlvillaljeblair: Okay, thanks. I'll update the commit message.21:00
jlvillaljeblair: Ah, it finally timed out at 4h, 34m :)21:01
*** catintheroof has quit IRC21:02
jeblairyay? :)21:04
*** Apoorva has quit IRC21:04
*** panda|ruck|bbl is now known as panda|ruck21:08
*** erlon has joined #openstack-infra21:09
*** equi123 has joined #openstack-infra21:10
*** catintheroof has joined #openstack-infra21:11
*** edmondsw has quit IRC21:12
*** dhinesh has joined #openstack-infra21:13
*** jkilpatr has joined #openstack-infra21:13
*** equi123 has quit IRC21:14
*** catintheroof has quit IRC21:15
*** edmondsw has joined #openstack-infra21:18
dmsimardinfra-root: I see the logstash job queue trending in the wrong direction all of a sudden again21:23
*** dhinesh has quit IRC21:23
*** dave-mcc_ has quit IRC21:23
*** dhinesh_ has joined #openstack-infra21:24
*** dhinesh_ has quit IRC21:24
clarkblooks like we have 49/80 worker processes running, I wonder if some new file is ooming things like those million line libvirt logs21:24
AJaegerconfig-core, could you review https://review.openstack.org/518362 to fix some puppet jobs that I broke by accident, please?21:24
*** dhinesh_ has joined #openstack-infra21:24
*** andreas_s has joined #openstack-infra21:26
openstackgerritsebastian marcet proposed openstack-infra/openstackid-resources master: Make update/delete event etag optional  https://review.openstack.org/51839421:26
*** smatzek has quit IRC21:26
*** smatzek has joined #openstack-infra21:26
*** smatzek has quit IRC21:27
*** smatzek has joined #openstack-infra21:27
*** markvoelker has joined #openstack-infra21:28
*** rbrndt has quit IRC21:28
*** xingchao has joined #openstack-infra21:28
andreafjeblair, mordred, dmsimard: I updated the entire series https://review.openstack.org/#/q/status:open+branch:master+topic:zuulv3-tempest+owner:%22Andrea+Frittoli+%253Candrea.frittoli%2540gmail.com%253E%2221:29
openstackgerritMerged openstack-infra/openstack-zuul-jobs master: Readd legacy-puppet-syntax-3-centos-7 playbook  https://review.openstack.org/51836221:30
*** kgiusti has left #openstack-infra21:30
*** mriedem has joined #openstack-infra21:31
*** smatzek has quit IRC21:32
*** mriedem has quit IRC21:32
*** xingchao has quit IRC21:34
*** andreas_s has quit IRC21:35
*** eharney has quit IRC21:36
*** edmondsw has quit IRC21:40
*** rbrndt has joined #openstack-infra21:43
mwhahahais the max concurrent length of a queue configurable by the project somewhere?21:44
mwhahahaie if i wanted to reduce it is that something I could control or is that an infra thing21:44
*** andreas_s has joined #openstack-infra21:44
* mwhahaha thinks it isn't configurable externally21:44
clarkbI don't think it is configurable at all currently21:44
clarkbit would be weird to approve something and not have it enqueue21:45
clarkb(as an example)21:45
mwhahahaqueuing is fine21:45
mwhahaharunning i meant21:45
mwhahahaso like limit to the top 5 of the queue21:45
mwhahahai thought that was configurable but not outside of the zuul config itself21:45
clarkbI can't remembre if the window sizing supports an upper bound21:45
clarkbwhich probably means it doesn't21:46
mwhahahaie if i wanted to reduce the tripleo queue to the top 5 patches (because resets)21:46
mwhahaharather than continue to suffer from churn from resets, i was wondering if lowering the concurrency might help the overall system21:46
mwhahahaie for ever reset -1 concurrent length21:46
mwhahahas/ever/every21:46
clarkbya the window sizing already does that but with a lower bound of 20 currently iirc21:47
mwhahahaat this rate lower bound of 121:47
* mwhahaha sighs and cries into his keyboard21:47
clarkbas changes merge the limit is increased as changes fail and reset the limit is reduced but with a lower bound to prevent us from running no tests21:47
jeblairmwhahaha: what's your motivation for wanting to change that?21:47
*** andreas_s has quit IRC21:48
mwhahahatrying to reduce the imact on the overall system as i'm sure there's a penalty for starting/stoping/reset all of these jobs21:48
*** iyamahat has quit IRC21:49
*** esberglu has quit IRC21:49
jeblairmwhahaha: gotcha.  it's certainly true that since gate jobs have priority, a lot of gate resets can end up reducing nodes available for the check pipeline (if we're at quota, which, probably because it's summit week, we aren't, so we have a bit of headroom)21:50
jeblairmwhahaha: that is the reason that we established the active window21:50
jeblairmwhahaha: though we also set the lower bound where it is because we want to try to keep things moving as quickly as possible (machines are cheaper than devs)21:51
mwhahahayea i'm frustrated because we keep failing but for new reasons every time21:51
jeblairmwhahaha: so the biggest gain would be if the tests could be made more reliable21:51
mwhahahasome of which are infra related (nodes going away, mirrors, etc etc)21:51
EmilienMAJaeger: I'm confused why https://review.openstack.org/#/c/518210 isn't good21:52
EmilienMAJaeger: is it just easier to patch zuul-legacy-project-templates.yaml ?21:52
jeblairmwhahaha: we definitely want to make the infra part of it rock-solid.  though, probably more next week than this.21:53
jeblairmwhahaha: which mirrors are having problems?21:53
mwhahahajeblair: we've noticed issues with vexxhost in general21:53
mwhahahajeblair: but the ovh one 502'd earlier today21:53
*** edmondsw has joined #openstack-infra21:53
mwhahahajeblair: are 5xx from the mirrors monitored somewhere?21:53
mwhahahai asked like 6 hours ago and didn't get a response21:54
*** edmondsw has quit IRC21:54
*** edmondsw has joined #openstack-infra21:54
*** trown is now known as trown|outtypewww21:54
jeblairmwhahaha: which type of mirror? rhel....?21:54
*** edmondsw has quit IRC21:55
mwhahahajeblair: any? i guess the question is what monitoring is in place21:55
*** edmondsw has joined #openstack-infra21:55
mwhahahajeblair: specifically this was the one we use for rdo so the proxy21:55
*** dave-mccowan has joined #openstack-infra21:55
jeblairmwhahaha: so the proxy to the rdo archive?21:56
mwhahahajeblair: http://eavesdrop.openstack.org/irclogs/%23openstack-infra/%23openstack-infra.2017-11-07.log.html#t2017-11-07T15:53:0021:56
mwhahahahttp://mirror.bhs1.ovh.openstack.org:8080/buildlogs.centos/centos/7/cloud/x86_64/openstack-pike/common/python2-fasteners-0.14.1-6.el7.noarch.rpm: [Errno 14] HTTP Error 503 - Service Unavailable21:57
*** edmondsw_ has joined #openstack-infra21:57
*** Guest98706 is now known as dansmith21:57
*** edmondsw_ has quit IRC21:57
mwhahahaI would normally have some sort of monitoring around that so we know when we have connectivity issues or there's an increase. I didn't know if this info is currently being captured anywhere21:57
*** edmondsw_ has joined #openstack-infra21:57
*** edmondsw_ has quit IRC21:58
jeblairmwhahaha: there isn't any monitoring like that of the proxies, though if you have something in mind, i'm sure you could add it21:58
*** mriedem has joined #openstack-infra21:59
mwhahahawhat/where is the prefered place to do such things?21:59
*** edmondsw has quit IRC21:59
*** caphrim007_ has joined #openstack-infra22:00
jeblairmwhahaha: i expect that sort of error is due to the underlying centos archive not responding when the proxy performs a validity check.  i wonder if there's a way to tune apache mod_proxy to be more graceful about that.  or if maybe squid could handle it.22:00
mwhahahajeblair: I know why it can happen, but I guess the question is how often does it happen and when it does happen does anyone know it is occuring22:01
*** mat128 has quit IRC22:01
jeblairmwhahaha: for stats, there's a cacti server and a graphite/grafana system.  dmsimard was looking into some nagios or similar options, but we don't have an alerting system atm.22:01
*** edmondsw has joined #openstack-infra22:02
dmsimardWe haven't agreed on a monitoring solution yet, drafting a spec around what we need and available options is the first step22:03
jeblairmwhahaha: all the systems are configured with puppet from the system-config repository22:03
*** caphrim007 has quit IRC22:03
dmsimardI have some PTO soon, I'll try to catch up on the specs that are on my shoulders22:03
dmsimardneed to write the ara vs puppetboard one too.22:03
*** esberglu has joined #openstack-infra22:04
*** caphrim007_ has quit IRC22:04
*** kmalloc has joined #openstack-infra22:04
*** thorst_ has joined #openstack-infra22:05
clarkbmwhahaha: do you hvae monitoring of buildlogs? because ultimately fixing the issues there is how to solve this22:05
clarkbmwhahaha: our proxy is just passing along what it got from buildlogs22:05
mwhahaha503 wouldn't be from build logs22:06
mwhahahanecessarily22:06
clarkboh I thought you said 50222:06
clarkbya ovh 502'd you said22:06
mwhahahai did, it was a 503 when i pasted the actually log22:06
*** thorst has quit IRC22:07
*** esberglu has quit IRC22:07
*** wolverineav has quit IRC22:07
*** esberglu has joined #openstack-infra22:07
*** wolverineav has joined #openstack-infra22:07
clarkb503 seems likely a backend issue as well fwiw22:07
mwhahahaor a networking one depending on where the 503 was coming from22:08
*** hemna_ has quit IRC22:09
clarkbunfortunately this was a known limitation of using proxies instead of proper mirrors. Backends could still fail on us (regardless of where that failure happens, network/server), but was a compromise to not being able to reasonably mirror all the things22:11
*** gildub has joined #openstack-infra22:14
*** rbrndt has quit IRC22:15
jeblairi can't find a log entry for that 50322:15
jeblair158.69.84.248 - - [07/Nov/2017:15:07:21 +0000] "GET /centos/7/os/x86_64/Packages/usbredir-0.7.1-2.el7.x86_64.rpm HTTP/1.1" 200 48207 "-" "urlgrabber/3.10 yum/3.4.3"22:15
jeblairthat's the last entry for that ip22:15
*** andreas_s has joined #openstack-infra22:16
*** rbrndt has joined #openstack-infra22:16
*** gouthamr has joined #openstack-infra22:16
clarkbjeblair: that looks like the main port 80 vhost because we do properly mirror centos 722:16
clarkbjeblair: the proxy is on port 8080 iirc22:17
jeblairclarkb: oh, different log?22:17
clarkbya I think it may be a different log file22:17
*** smatzek has joined #openstack-infra22:17
jeblairyep that's a different story22:18
jeblairthere are *a lot* of [Tue Nov 07 15:24:52.633764 2017] [proxy:error] [pid 31380:tid 139977010640640] AH00940: HTTPS: disabled connection for (buildlogs.centos.org)22:19
*** dave-mccowan has quit IRC22:19
jeblairclarkb, mwhahaha: http://paste.openstack.org/show/625774/22:20
openstackgerritMerged openstack-infra/openstackid-resources master: Make update/delete event etag optional  https://review.openstack.org/51839422:20
openstackgerritwes hayutin proposed openstack-infra/openstack-zuul-jobs master: remove failing tripleo upgrade jobs from upstream  https://review.openstack.org/51840522:22
*** smatzek has quit IRC22:22
*** iyamahat has joined #openstack-infra22:23
mwhahaha101)Network is unreachable: AH00957: HTTPS: attempt to connect to [2607:1680:0:1::2]:443 (buildlogs.centos.org) failed22:23
mwhahahaso yea could have been network related as well22:24
mwhahahait's not still happening since that was from this morning22:24
*** andreas_s has quit IRC22:24
mwhahahabut my point was it would be nice to go looking then to find out what's up rather than later when now we don't actually know22:24
pabelangerreading backscroll, which region was the failure of buildlogs in?22:24
mwhahahapabelanger: bhs1.ovh22:25
mwhahahawherever that is22:25
fungisomewhere in france22:27
andreafjeblair, mordred: log continue to be empty on post-failures http://logs.openstack.org/68/509468/8/check/devstack-tempest/abaec96/job-output.txt.gz#_2017-11-07_22_20_28_31969422:29
*** andreas_s has joined #openstack-infra22:30
*** xingchao has joined #openstack-infra22:30
openstackgerritThomas Morin proposed openstack-infra/project-config master: n8g-bagpipe: skip release note testing for stable/ocata  https://review.openstack.org/51840722:30
*** Apoorva has joined #openstack-infra22:32
*** andreas_s has quit IRC22:34
*** Apoorva has quit IRC22:35
*** xingchao has quit IRC22:38
openstackgerritMonty Taylor proposed openstack-infra/project-config master: Add shade to #openstack-sdks  https://review.openstack.org/51840822:40
*** andreas_s has joined #openstack-infra22:43
openstackgerritJames E. Blair proposed openstack-infra/system-config master: Make the cache perform better on errors  https://review.openstack.org/51840922:44
jeblairmwhahaha, clarkb, pabelanger: ^ maybe some small improvements.  looks like the default is cachestaleonerror, so we should actually already be serving 'stale' data on error22:45
*** ramishra has joined #openstack-infra22:45
*** harlowja has joined #openstack-infra22:46
*** baoli has joined #openstack-infra22:46
*** baoli has quit IRC22:48
*** edmondsw has quit IRC22:50
*** edmondsw has joined #openstack-infra22:50
*** salv-orlando has quit IRC22:59
*** salv-orlando has joined #openstack-infra23:00
*** andreas_s has quit IRC23:01
*** calbers has quit IRC23:02
*** calbers has joined #openstack-infra23:03
*** salv-orlando has quit IRC23:04
*** baoli has joined #openstack-infra23:04
clarkbfor everyone here in sydney the summit/forum feedback session ins in C4.5 at 12:30 there will also be contributor awards too23:08
clarkbso that is where I will be grabbing lunch23:08
clarkbdirk: ^ fyi23:08
clarkbbut everyone else should be there too :)23:08
*** prad has joined #openstack-infra23:10
openstackgerritEmilien Macchi proposed openstack-infra/openstack-zuul-jobs master: Do not run baremetal scenarios after Ocata  https://review.openstack.org/51841323:14
*** jascott1 has quit IRC23:15
*** andreas_s has joined #openstack-infra23:15
*** baoli has quit IRC23:15
*** baoli has joined #openstack-infra23:15
*** iyamahat has quit IRC23:17
*** iyamahat has joined #openstack-infra23:17
dmsimardfungi: OVH BHS is actually in Quebec, east coast Canada :)23:17
openstackgerritEmilien Macchi proposed openstack-infra/openstack-zuul-jobs master: Do not run baremetal scenarios after Ocata  https://review.openstack.org/51841323:17
dmsimardMontreal suburb23:17
*** esberglu has quit IRC23:17
fungidmsimard: oh! right, sorry. i was thinking of their gra1 region23:18
openstackgerritEmilien Macchi proposed openstack-infra/openstack-zuul-jobs master: Do not run baremetal scenarios after Ocata  https://review.openstack.org/51841323:19
*** rbrndt has quit IRC23:19
*** rbrndt has joined #openstack-infra23:19
*** baoli has quit IRC23:20
*** rbrndt has quit IRC23:20
*** edmondsw has quit IRC23:21
*** prad has quit IRC23:21
openstackgerritEmilien Macchi proposed openstack-infra/openstack-zuul-jobs master: Do not run baremetal scenarios after Ocata  https://review.openstack.org/51841323:22
*** jamesmca_ has joined #openstack-infra23:23
*** andreas_s has quit IRC23:24
*** thorst_ has quit IRC23:24
*** edmondsw has joined #openstack-infra23:25
*** baoli has joined #openstack-infra23:26
*** sree has joined #openstack-infra23:26
openstackgerritRicardo Carrillo Cruz proposed openstack-infra/nodepool feature/zuulv3: Add username to build and upload information  https://review.openstack.org/45396823:27
openstackgerritRicardo Carrillo Cruz proposed openstack-infra/nodepool feature/zuulv3: Rename ssh_port to connection_port  https://review.openstack.org/50080023:27
openstackgerritRicardo Carrillo Cruz proposed openstack-infra/nodepool feature/zuulv3: Support username also for unmanaged cloud images  https://review.openstack.org/50080823:27
*** joadavis has joined #openstack-infra23:28
*** edmondsw has quit IRC23:30
*** baoli has quit IRC23:30
*** iyamahat has quit IRC23:31
joadavisI've hit a little snag with Zuul.  Seems it doesn't like git+https urls in the test-requirements.txt any more.  See https://review.openstack.org/#/c/518414/.  Was this a change introduced in Zuul v3?23:31
*** sree has quit IRC23:31
*** hasharAway has quit IRC23:31
*** bobh has quit IRC23:32
*** bobh has joined #openstack-infra23:32
clarkbjoadavis: I don't think so, the check requirements scrpt hsa never allowed that iirc23:32
*** gildub has quit IRC23:33
joadavisActually, it has been working for years.23:33
clarkbya thats just executing a script out of the requirements repo so not really zuulv3 specific23:33
clarkbjoadavis: it is possible something changed in the requirements repo23:33
clarkbbut iirc hte intent was if a req is listed in global requirements it must be retrieved from pypi23:33
*** andreas_s has joined #openstack-infra23:34
jeblairit only checks changes to specific lines, so that error only would have happened if that line was changes while the requirementts check script was running on the repo23:34
joadavisPossibly.  I have seen notes in other projects that pypi is where things should be coming from.23:34
jeblairso it could have slipped in perhaps when the job wasn't enabled, or maybe wasn't operating correctly23:35
*** jascott1 has joined #openstack-infra23:35
joadavisIs there any way to enable the permit_urls flag for the requirements? :)23:35
clarkbjoadavis: looking at it I think that is requirements tool just breaking entirely, you probably want to look at it and see what can be done and/or bring it up with the requirements team23:36
clarkbthat error is coming out of pkg_resources so its fairly low level breakage23:36
joadavisI tried changing the reference line to "ceilometer>=9.0.0,<10.0.0" but oddly got the same error message23:36
*** bobh has quit IRC23:37
jeblairthere's an #openstack-requirements irc channel, maybe the best place to ask?23:37
joadavisI tried emailing dirk yesterday about it (he actually was one of the last to work on the openstack/requirements code) but I thikn he is off to Sydney this week.23:37
clarkbits possible it needs the -e prefix? but ya requirements team would know best23:37
dirkjoadavis: I just don't read emails ;-)23:38
joadavisI tried the -e at one point also, also failed.  Didn't realize there was a #openstack-requirements channel :P23:38
joadavisNo worries dirk. I'm just trying to hack my way through it.23:38
*** andreas_s has quit IRC23:39
*** d0ugal has joined #openstack-infra23:39
*** LindaWang has quit IRC23:40
dirkjoadavis: I suggest to file a bugreport and we'll fix it23:40
dirkjoadavis: https://bugs.launchpad.net/openstack-requirements/23:40
*** markvoelker has quit IRC23:41
*** thorst has joined #openstack-infra23:42
*** stakeda has joined #openstack-infra23:42
joadavisOK, will do23:43
*** pahuang has joined #openstack-infra23:45
*** rodrigods has quit IRC23:51
*** rodrigods has joined #openstack-infra23:51
*** baoli has joined #openstack-infra23:52
joadavisFWIW - https://bugs.launchpad.net/openstack-requirements/+bug/173077623:54
openstackLaunchpad bug 1730776 in OpenStack Global Requirements "git+https url requirement line produces error" [Undecided,New]23:54
*** thorst has quit IRC23:54
*** baoli has quit IRC23:56
EmilienMmwhahaha, when you have time could you please review https://review.openstack.org/#/c/518413/ ( not sure it does what I want to do but can you ack the idea at least ) - ping pabelanger / clarkb if you can review this patch. Thanks23:57
*** sbezverk has joined #openstack-infra23:57
*** signed8bit is now known as signed8bit_Zzz23:57
*** signed8bit_Zzz has quit IRC23:58
*** xarses has quit IRC23:58
*** efried has quit IRC23:59
*** jamesmca_ has quit IRC23:59
*** edmondsw has joined #openstack-infra23:59

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!