Thursday, 2017-09-07

*** dingyichen has joined #openstack-infra00:01
*** armax has quit IRC00:02
*** priteau has quit IRC00:04
*** HenryG has joined #openstack-infra00:06
*** felipemonteiro has quit IRC00:11
*** rhallisey has quit IRC00:16
HenryGHey everyone! I am working with a private zuul and trying to get the log_processor stuff working based off openstack-infra/puppet-log_processor ...00:17
HenryGFor configuring the jenkins-log-worker I am adapting http://git.openstack.org/cgit/openstack-infra/system-config/tree/modules/openstack_project/templates/logstash/jenkins-log-worker.yaml.erb ...00:17
HenryGBut I don't know what the mqtt_* info is. How/where would I find it?00:17
*** aeng has quit IRC00:17
*** thorst has quit IRC00:18
*** thorst has joined #openstack-infra00:18
*** thorst has quit IRC00:23
openstackgerritDavid Moreau Simard proposed openstack-infra/zuul-jobs master: WIP: Make the base playbooks/roles work for every supported distro  https://review.openstack.org/50128100:24
*** Swami has quit IRC00:29
openstackgerritDavid Moreau Simard proposed openstack-infra/zuul-jobs master: WIP: Make the base playbooks/roles work for every supported distro  https://review.openstack.org/50128100:31
*** thorst has joined #openstack-infra00:32
*** LindaWang has joined #openstack-infra00:35
*** sdague has quit IRC00:36
*** LindaWang has quit IRC00:36
openstackgerritClark Boylan proposed openstack-infra/zuul feature/zuulv3: Use deepcopy when copying ansible logging config  https://review.openstack.org/50149900:36
*** jcoufal has quit IRC00:39
*** slaweq has joined #openstack-infra00:39
*** thorst has quit IRC00:39
*** thorst has joined #openstack-infra00:40
fungiHenryG: you should be able to just not set those? it's for if you're running an mqtt event broker like firehose.openstack.org00:43
fungiif we can't run the log processor without setting those, i consider that a bug00:43
*** slaweq has quit IRC00:44
*** thorst has quit IRC00:44
HenryGfungi: Thanks, I'll try that.00:46
*** harlowja has quit IRC00:48
*** claudiub has quit IRC00:49
*** esberglu has quit IRC00:50
*** Apoorva_ has quit IRC00:51
*** LindaWang has joined #openstack-infra00:55
openstackgerritDavid Moreau Simard proposed openstack-infra/zuul-jobs master: WIP: Make the base playbooks/roles work for every supported distro  https://review.openstack.org/50128101:01
*** cuongnv has joined #openstack-infra01:03
*** stakeda has joined #openstack-infra01:03
openstackgerritClark Boylan proposed openstack-infra/zuul feature/zuulv3: Use deepcopy when copying ansible logging config  https://review.openstack.org/50149901:03
*** baoli has joined #openstack-infra01:03
*** nunchuck has quit IRC01:05
*** thorst has joined #openstack-infra01:08
*** thorst has quit IRC01:09
*** liujiong has joined #openstack-infra01:13
*** zhurong has joined #openstack-infra01:15
*** bobh has joined #openstack-infra01:18
*** s-shiono has joined #openstack-infra01:22
*** s-shiono_ has joined #openstack-infra01:24
*** s-shiono has quit IRC01:26
*** aeng has joined #openstack-infra01:31
*** bobh has quit IRC01:33
openstackgerritDavid Moreau Simard proposed openstack-infra/zuul-jobs master: WIP: Make the base playbooks/roles work for every supported distro  https://review.openstack.org/50128101:35
*** krtaylor has joined #openstack-infra01:39
*** slaweq has joined #openstack-infra01:40
openstackgerritDavid Moreau Simard proposed openstack-infra/project-config master: Add the emit-ara-html to the base-minimal role  https://review.openstack.org/50151701:40
openstackgerritDavid Moreau Simard proposed openstack-infra/zuul-jobs master: WIP: Make the base playbooks/roles work for every supported distro  https://review.openstack.org/50128101:45
*** slaweq has quit IRC01:45
openstackgerritIsaku Yamahata proposed openstack-infra/project-config master: networking-odl: make rally/functional/fullstack with nitrogen voting  https://review.openstack.org/50152101:45
openstackgerritMerged openstack-infra/zuul-jobs master: Handle floating ips in multi-node-known-hosts  https://review.openstack.org/50145901:47
openstackgerritDavid Moreau Simard proposed openstack-infra/zuul-jobs master: WIP: Make the base playbooks/roles work for every supported distro  https://review.openstack.org/50128101:53
*** hongbin has joined #openstack-infra01:54
mtreinishHenryG, fungi: yeah you should be able to ignore/not set the mqtt options for the log worker and it won't do anything01:54
*** bobh has joined #openstack-infra01:56
openstackgerritDavid Moreau Simard proposed openstack-infra/zuul-jobs master: WIP: Make the base playbooks/roles work for every supported distro  https://review.openstack.org/50128101:57
openstackgerritDavid Moreau Simard proposed openstack-infra/zuul-jobs master: WIP: Make the base playbooks/roles work for every supported distro  https://review.openstack.org/50128102:02
*** gildub has joined #openstack-infra02:09
*** yamamoto_ has joined #openstack-infra02:09
dmsimardinfra-root: I'm not sure what's going on but something's fishy with v3, the zuul-status page has jobs that will frequently bug out/not finish with no visible progress02:10
*** markvoelker has quit IRC02:11
dmsimardThat tox-pep8 job has been sitting there for >2hrs02:13
dmsimardI've been noticing jobs get stuck for my zuul-jobs patchset as well but it's not as much of a problem since I've been iterating02:13
*** isviridov_away has quit IRC02:14
*** vaidy has quit IRC02:14
*** yamahata has quit IRC02:15
*** thorst has joined #openstack-infra02:15
*** iyamahat has quit IRC02:15
*** thorst has quit IRC02:15
*** bobh has quit IRC02:15
*** xarses_ has joined #openstack-infra02:24
*** andreww has joined #openstack-infra02:26
*** andreww has quit IRC02:27
*** xarses_ has quit IRC02:28
*** rlandy|bbl is now known as rlandy02:29
*** andreww has joined #openstack-infra02:29
*** rlandy has quit IRC02:33
*** adisky__ has joined #openstack-infra02:34
*** ijw has joined #openstack-infra02:35
*** shu-mutou-AWAY is now known as shu-mutou02:37
*** andreww has quit IRC02:38
*** vhosakot has quit IRC02:40
*** ijw has quit IRC02:40
*** slaweq has joined #openstack-infra02:41
*** slaweq has quit IRC02:46
*** vhosakot has joined #openstack-infra02:46
openstackgerritDavid Moreau Simard proposed openstack-infra/zuul-jobs master: Add integration test jobs for the configure-mirror role  https://review.openstack.org/50153402:46
openstackgerritDavid Moreau Simard proposed openstack-infra/zuul-jobs master: Streamline configure-mirrors and Ubuntu repository setup  https://review.openstack.org/50153502:46
openstackgerritDavid Moreau Simard proposed openstack-infra/zuul-jobs master: Add support for centos in configure-mirrors  https://review.openstack.org/50153602:47
openstackgerritDavid Moreau Simard proposed openstack-infra/zuul-jobs master: Add support for debian in configure-mirrors  https://review.openstack.org/50153702:47
openstackgerritDavid Moreau Simard proposed openstack-infra/zuul-jobs master: Add support for fedora in configure-mirrors  https://review.openstack.org/50153802:47
openstackgerritDavid Moreau Simard proposed openstack-infra/zuul-jobs master: Add support for opensuse in configure-mirrors  https://review.openstack.org/50153902:47
*** baoli has quit IRC02:50
*** baoli has joined #openstack-infra02:50
*** vhosakot has quit IRC02:52
openstackgerritDavid Moreau Simard proposed openstack-infra/zuul-jobs master: Add integration test jobs for the configure-mirror role  https://review.openstack.org/50153402:54
openstackgerritDavid Moreau Simard proposed openstack-infra/zuul-jobs master: Fix lint issue  https://review.openstack.org/50154002:54
openstackgerritDavid Moreau Simard proposed openstack-infra/zuul-jobs master: Streamline configure-mirrors and Ubuntu repository setup  https://review.openstack.org/50153502:59
openstackgerritDavid Moreau Simard proposed openstack-infra/zuul-jobs master: Add support for centos in configure-mirrors  https://review.openstack.org/50153602:59
openstackgerritDavid Moreau Simard proposed openstack-infra/zuul-jobs master: Add support for debian in configure-mirrors  https://review.openstack.org/50153702:59
openstackgerritDavid Moreau Simard proposed openstack-infra/zuul-jobs master: Add support for fedora in configure-mirrors  https://review.openstack.org/50153802:59
openstackgerritDavid Moreau Simard proposed openstack-infra/zuul-jobs master: Add support for opensuse in configure-mirrors  https://review.openstack.org/50153902:59
*** ramishra has joined #openstack-infra03:00
*** baoli has quit IRC03:01
*** nunchuck has joined #openstack-infra03:04
*** rossella_s has quit IRC03:08
*** rossella_s has joined #openstack-infra03:09
*** markvoelker has joined #openstack-infra03:11
openstackgerritDavid Moreau Simard proposed openstack-infra/zuul-jobs master: Add integration tests for validate-host  https://review.openstack.org/50154303:12
openstackgerritDavid Moreau Simard proposed openstack-infra/zuul-jobs master: Add integration tests for validate-host  https://review.openstack.org/50154303:13
openstackgerritDavid Moreau Simard proposed openstack-infra/zuul-jobs master: Streamline configure-mirrors and Ubuntu repository setup  https://review.openstack.org/50153503:13
openstackgerritDavid Moreau Simard proposed openstack-infra/zuul-jobs master: Add support for centos in configure-mirrors  https://review.openstack.org/50153603:14
openstackgerritDavid Moreau Simard proposed openstack-infra/zuul-jobs master: Add support for debian in configure-mirrors  https://review.openstack.org/50153703:14
openstackgerritDavid Moreau Simard proposed openstack-infra/zuul-jobs master: Add support for fedora in configure-mirrors  https://review.openstack.org/50153803:14
openstackgerritDavid Moreau Simard proposed openstack-infra/zuul-jobs master: Add support for opensuse in configure-mirrors  https://review.openstack.org/50153903:14
openstackgerritDavid Moreau Simard proposed openstack-infra/zuul-jobs master: Add integration tests for validate-host  https://review.openstack.org/50154303:14
dmsimardSorry for the spam, screwed up in a rebase :(03:14
dmsimardtwice.03:14
*** coolsvap has joined #openstack-infra03:19
openstackgerritMerged openstack-infra/zuul feature/zuulv3: Use deepcopy when copying ansible logging config  https://review.openstack.org/50149903:21
*** LindaWang has quit IRC03:21
*** LindaWang has joined #openstack-infra03:22
*** LindaWang has joined #openstack-infra03:25
*** LindaWang has quit IRC03:25
*** jamesmcarthur has quit IRC03:35
*** stakeda has quit IRC03:39
*** slaweq has joined #openstack-infra03:42
*** ykarel has joined #openstack-infra03:42
*** markvoelker has quit IRC03:46
*** slaweq has quit IRC03:47
*** udesale has joined #openstack-infra03:50
*** vaidy has joined #openstack-infra03:54
*** cshastri has joined #openstack-infra03:54
*** isviridov_away has joined #openstack-infra03:55
*** dhajare has joined #openstack-infra04:00
*** priteau has joined #openstack-infra04:01
*** cuongnv has quit IRC04:03
*** rossella_s has quit IRC04:04
*** rossella_s has joined #openstack-infra04:05
*** priteau has quit IRC04:05
*** harlowja has joined #openstack-infra04:06
*** armax has joined #openstack-infra04:08
openstackgerritMerged openstack-infra/zuul feature/zuulv3: Handle some common yaml syntax errors  https://review.openstack.org/50148604:09
*** yolanda has quit IRC04:15
*** thorst has joined #openstack-infra04:16
*** ianychoi_ has joined #openstack-infra04:18
*** liujiong_lj has joined #openstack-infra04:19
openstackgerritwes hayutin proposed openstack-infra/project-config master: trigger tripleo scen1-4 on tht/environments  https://review.openstack.org/50144304:19
*** liujiong has quit IRC04:19
*** stevemar has quit IRC04:19
*** charz has quit IRC04:19
*** ntpttr_ has joined #openstack-infra04:19
*** charz_ has joined #openstack-infra04:20
*** yamamot__ has joined #openstack-infra04:20
*** armax_ has joined #openstack-infra04:20
*** gagehugo has quit IRC04:20
*** spotz has quit IRC04:20
*** mudpuppy has quit IRC04:20
*** timrc has quit IRC04:20
*** jistr|off has quit IRC04:20
*** jmorgan1_ has joined #openstack-infra04:20
*** gagehugo has joined #openstack-infra04:20
*** timrc has joined #openstack-infra04:21
*** thorst has quit IRC04:21
*** armax has quit IRC04:21
*** dhajare has quit IRC04:21
*** armax_ is now known as armax04:21
*** xinliang has quit IRC04:21
*** ianychoi has quit IRC04:21
*** cinerama has quit IRC04:21
*** cinerama has joined #openstack-infra04:21
*** mudpuppy has joined #openstack-infra04:21
*** dhajare has joined #openstack-infra04:21
*** xinliang has joined #openstack-infra04:21
*** xinliang has quit IRC04:21
*** xinliang has joined #openstack-infra04:21
*** yamamoto_ has quit IRC04:21
*** jmorgan1 has quit IRC04:21
*** kevinbenton has quit IRC04:21
*** spotz has joined #openstack-infra04:22
*** filler has quit IRC04:22
*** gtmanfred has quit IRC04:22
*** ntpttr has quit IRC04:22
*** kevinbenton has joined #openstack-infra04:23
*** jistr has joined #openstack-infra04:24
*** gtmanfred has joined #openstack-infra04:25
*** filler has joined #openstack-infra04:25
*** stevemar has joined #openstack-infra04:26
*** hongbin has quit IRC04:26
*** bexelbie has quit IRC04:27
*** masayukig[m] has quit IRC04:27
*** sflanigan has quit IRC04:28
*** pahuang has quit IRC04:28
*** abelur_ has quit IRC04:28
*** askb has quit IRC04:28
*** sflanigan has joined #openstack-infra04:28
*** sflanigan has joined #openstack-infra04:28
*** abelur_ has joined #openstack-infra04:28
*** gouthamr has quit IRC04:31
*** cuongnv has joined #openstack-infra04:32
*** bexelbie has joined #openstack-infra04:33
*** zhurong has quit IRC04:38
*** dims has quit IRC04:40
*** askb has joined #openstack-infra04:41
*** igormarnat has quit IRC04:41
*** asilenkov has quit IRC04:42
*** pahuang has joined #openstack-infra04:42
*** masayukig[m] has joined #openstack-infra04:42
*** rakhmerov has quit IRC04:43
*** markvoelker has joined #openstack-infra04:43
*** asilenkov has joined #openstack-infra04:43
*** flwang has quit IRC04:44
*** rakhmerov has joined #openstack-infra04:44
*** caphrim007 has joined #openstack-infra04:44
*** igormarnat has joined #openstack-infra04:44
*** jtomasek has joined #openstack-infra04:51
*** psachin has joined #openstack-infra04:51
*** boris_42 has joined #openstack-infra04:52
*** bexelbie has quit IRC04:52
*** reed_ has joined #openstack-infra04:52
*** reed_ has quit IRC04:54
*** flwang has joined #openstack-infra04:55
*** bexelbie has joined #openstack-infra04:58
*** Sree_ has joined #openstack-infra05:01
*** Sree_ is now known as Guest7518105:01
*** pgadiya has joined #openstack-infra05:01
*** andreww has joined #openstack-infra05:05
*** lihi has quit IRC05:06
*** yamamot__ has quit IRC05:07
*** lihi has joined #openstack-infra05:07
*** yamamoto_ has joined #openstack-infra05:07
*** zhurong has joined #openstack-infra05:08
*** xarses_ has joined #openstack-infra05:08
*** andreww has quit IRC05:09
*** harlowja has quit IRC05:11
*** Nakato has left #openstack-infra05:12
openstackgerritAparna proposed openstack/diskimage-builder master: Change to install a package in 'proliant-tools'  https://review.openstack.org/50156805:13
*** pcaruana has joined #openstack-infra05:15
*** claudiub has joined #openstack-infra05:16
*** markvoelker has quit IRC05:16
*** thorst has joined #openstack-infra05:17
*** iyamahat has joined #openstack-infra05:18
*** iyamahat_ has joined #openstack-infra05:19
*** Guest75181 has quit IRC05:21
*** iyamahat has quit IRC05:21
openstackgerritMerged openstack-infra/project-config master: Remove unused variable from run-tox.sh  https://review.openstack.org/50146905:21
*** thorst has quit IRC05:22
*** xarses_ has quit IRC05:29
*** jamesmcarthur has joined #openstack-infra05:35
*** jaosorior has joined #openstack-infra05:39
*** jamesmcarthur has quit IRC05:40
*** udesale__ has joined #openstack-infra05:40
*** udesale has quit IRC05:42
*** udesale has joined #openstack-infra05:42
*** slaweq has joined #openstack-infra05:44
*** udesale__ has quit IRC05:45
*** rybridges1 has quit IRC05:47
*** slaweq has quit IRC05:49
openstackgerritMerged openstack-infra/zuul-jobs master: Delete unused run-cover role  https://review.openstack.org/50124405:51
openstackgerritAparna proposed openstack/diskimage-builder master: Change to install a package in 'proliant-tools'  https://review.openstack.org/50156805:56
openstackgerritJamie Lennox proposed openstack-infra/zuul-jobs master: Fix fetching tox output for empty dirs  https://review.openstack.org/50157205:57
*** oanson has quit IRC05:58
*** oanson has joined #openstack-infra05:59
*** dhajare has quit IRC05:59
*** jmorgan1_ has quit IRC06:01
*** jmorgan1 has joined #openstack-infra06:01
*** priteau has joined #openstack-infra06:02
*** iyamahat_ has quit IRC06:02
*** jascott1 has quit IRC06:03
*** rossella_s has quit IRC06:04
*** aeng has quit IRC06:05
*** dhajare has joined #openstack-infra06:06
*** priteau has quit IRC06:06
*** rossella_s has joined #openstack-infra06:06
*** gildub_ has joined #openstack-infra06:09
*** gildub_ has quit IRC06:09
*** liujiong has joined #openstack-infra06:11
*** liujiong_lj has quit IRC06:12
*** rossella_s has quit IRC06:12
*** markvoelker has joined #openstack-infra06:13
*** jianghuaw has joined #openstack-infra06:14
*** rossella_s has joined #openstack-infra06:14
openstackgerritJulia Kreger proposed openstack-infra/shade master: Migrate additional machine tests  https://review.openstack.org/50157606:16
*** thorst has joined #openstack-infra06:18
*** namnh has quit IRC06:19
openstackgerritIan Wienand proposed openstack-infra/openstack-zuul-jobs master: Add role to make /etc/ci/mirror_info.sh  https://review.openstack.org/50157806:19
*** namnh has joined #openstack-infra06:19
*** jascott1 has joined #openstack-infra06:19
*** thorst has quit IRC06:23
*** ccamacho has joined #openstack-infra06:24
*** iyamahat has joined #openstack-infra06:26
*** xarses_ has joined #openstack-infra06:30
*** andreww has joined #openstack-infra06:32
*** jaosorior has quit IRC06:33
*** xarses_ has quit IRC06:34
openstackgerritTristan Cacqueray proposed openstack-infra/zuul master: launcher: add cancel job function  https://review.openstack.org/50158106:35
*** andreww has quit IRC06:38
*** eranrom has joined #openstack-infra06:44
*** slaweq has joined #openstack-infra06:45
*** dhajare has quit IRC06:46
*** markvoelker has quit IRC06:47
*** slaweq has quit IRC06:50
*** rcernin has joined #openstack-infra06:53
*** LindaWang has joined #openstack-infra06:54
*** andreas_s has joined #openstack-infra06:56
*** dhajare has joined #openstack-infra07:01
*** armax has quit IRC07:02
boris_42Hi there to everybody07:02
boris_42so I am trying to debug why rally dsvm magnum job is failing07:02
boris_42and I see the strange difference between rally and tempest jobs07:02
boris_42for some reason source for downloading image is used different07:03
boris_42http://logs.openstack.org/66/501566/1/check/gate-rally-dsvm-magnum-rally-nv/d2f7b82/logs/devstack-early.txt.gz#_2017-09-07_05_22_04_261 here is for rally-magnum07:03
boris_42http://logs.openstack.org/46/473346/22/check/gate-functional-dsvm-magnum-api-ubuntu-xenial/1411aee/console.html.gz#_2017-08-21_12_32_22_726538 here is for tempest07:03
*** jpich has joined #openstack-infra07:03
boris_42couldn't find anything in magnum or project-config with the second one address07:03
*** alexchadin has joined #openstack-infra07:04
*** slaweq has joined #openstack-infra07:11
*** ianychoi_ is now known as ianychoi07:12
*** tesseract has joined #openstack-infra07:13
AJaegerboris_42: the second one is using our per region mirror.07:15
*** slaweq has quit IRC07:16
AJaegerboris_42: see the lines starting at http://logs.openstack.org/46/473346/22/check/gate-functional-dsvm-magnum-api-ubuntu-xenial/1411aee/console.html.gz#_2017-08-21_12_32_22_71793507:16
AJaegerboris_42: you should use the mirror for better download performance in tests07:17
*** flwang has quit IRC07:20
*** shardy has joined #openstack-infra07:22
*** dhajare has quit IRC07:23
*** stakeda has joined #openstack-infra07:24
boris_42@AJaeger so basically we should use this export NODEPOOL_FEDORA_MIRROR=http://mirror.regionone.infracloud-vanilla.openstack.org/fedora07:27
boris_42@AJaeger let me try to make patch07:27
boris_42@AJaeger but I don't see that usage https://github.com/openstack-infra/project-config/blob/master/jenkins/jobs/magnum.yaml07:28
*** rossella_s has quit IRC07:28
AJaegerboris_42: you should use the shell script with the mirrors in it...07:28
boris_42@AJaeger I don't get it...07:30
boris_42@AJaeger we are using in the same way magnum devstack plugin in gates07:30
boris_42@AJaeger in one case mirrors are used in another not ....07:30
AJaegerboris_42: no need for @ here, this is IRC07:30
AJaegerboris_42: http://logs.openstack.org/46/473346/22/check/gate-functional-dsvm-magnum-api-ubuntu-xenial/1411aee/console.html.gz#_2017-08-21_12_32_22_71705507:30
AJaegerThe magnum gate hook sources it07:31
AJaegeralso, check http://git.openstack.org/cgit/openstack-dev/devstack/tree/tools/fixup_stuff.sh#n7807:31
*** rossella_s has joined #openstack-infra07:32
AJaegerboris_42: http://git.openstack.org/cgit/openstack/magnum/tree/magnum/tests/contrib/gate_hook.sh#n4007:33
AJaegerboris_42: can't help further on all these - I suggest you check whether you call the gate_hook and how other projects do it.07:33
boris_42@AJaeger thanks07:33
boris_42AJaeger: yep going just to add one line to jobs that we have07:34
boris_42AJaeger: thanks for help07:34
AJaegerboris_42: you're welcome!07:34
*** dhajare has joined #openstack-infra07:36
*** eranrom has quit IRC07:38
*** jpena|off is now known as jpena07:38
*** hashar has joined #openstack-infra07:38
*** flwang has joined #openstack-infra07:40
*** gaelL has joined #openstack-infra07:41
*** iyamahat has quit IRC07:41
openstackgerritBoris Pavlovic proposed openstack-infra/project-config master: Use mirrors in rally dsvm jobs  https://review.openstack.org/50160707:41
boris_42AJaeger: ^ something like this should probably help07:41
boris_42?07:41
*** egonzalez has joined #openstack-infra07:41
*** markvoelker has joined #openstack-infra07:44
*** eranrom has joined #openstack-infra07:45
*** ralonsoh has joined #openstack-infra07:49
*** martinkopec has joined #openstack-infra07:54
*** eranrom has quit IRC08:00
*** rossella_s has quit IRC08:02
*** eranrom has joined #openstack-infra08:04
*** rossella_s has joined #openstack-infra08:05
*** shardy is now known as shardy_afk08:06
*** sflanigan has quit IRC08:06
*** andreas_s_ has joined #openstack-infra08:09
*** rossella_s has quit IRC08:10
AJaegerboris_42: not sure, better ask clarkb and pabelanger later today...08:10
*** slaweq has joined #openstack-infra08:12
*** andreas_s has quit IRC08:12
*** rossella_s has joined #openstack-infra08:13
*** eranrom has quit IRC08:14
*** gildub has quit IRC08:15
*** slaweq has quit IRC08:17
*** markvoelker has quit IRC08:17
*** jaosorior has joined #openstack-infra08:17
*** thorst has joined #openstack-infra08:20
openstackgerritTobias Henkel proposed openstack-infra/zuul feature/zuulv3: Use password supplied from nodepool  https://review.openstack.org/50082308:20
openstackgerritTobias Henkel proposed openstack-infra/zuul feature/zuulv3: Use username from node information if available  https://review.openstack.org/45398308:20
openstackgerritTobias Henkel proposed openstack-infra/zuul feature/zuulv3: Rename ssh_port to connection_port  https://review.openstack.org/50079908:20
*** priteau has joined #openstack-infra08:23
*** mwarad has joined #openstack-infra08:23
*** thorst has quit IRC08:24
*** eranrom has joined #openstack-infra08:28
*** efoley has joined #openstack-infra08:30
*** lucas-afk is now known as lucasagomes08:31
*** eranrom has quit IRC08:32
*** dingyichen has quit IRC08:33
*** gildub has joined #openstack-infra08:36
*** jamesmcarthur has joined #openstack-infra08:36
*** jamesmcarthur has quit IRC08:40
*** tosky has joined #openstack-infra08:41
*** shu-mutou is now known as shu-mutou-AWAY08:42
*** rossella_s has quit IRC08:44
*** derekh has joined #openstack-infra08:45
*** eranrom has joined #openstack-infra08:46
*** jascott1 has quit IRC08:46
*** rossella_s has joined #openstack-infra08:47
*** jaosorior has quit IRC08:50
*** oomichi has quit IRC08:53
*** oomichi has joined #openstack-infra08:54
*** mriedem has quit IRC08:55
*** rossella_s has quit IRC09:08
*** rossella_s has joined #openstack-infra09:10
*** liujiong_lj has joined #openstack-infra09:11
*** gildub has quit IRC09:13
openstackgerritMerged openstack-infra/nodepool feature/zuulv3: Fix nodepool's docs about config-drive  https://review.openstack.org/50039109:13
*** slaweq has joined #openstack-infra09:13
*** liujiong has quit IRC09:14
*** markvoelker has joined #openstack-infra09:14
*** e0ne has joined #openstack-infra09:15
*** liujiong_lj has quit IRC09:16
*** mwarad has quit IRC09:17
*** slaweq has quit IRC09:18
*** eranrom has quit IRC09:20
openstackgerritTobias Henkel proposed openstack-infra/zuul feature/zuulv3: DNM: test  https://review.openstack.org/50164309:20
*** yamahata has joined #openstack-infra09:22
*** sambetts|afk is now known as sambetts09:24
*** eranrom has joined #openstack-infra09:24
*** liujiong has joined #openstack-infra09:25
openstackgerritTobias Henkel proposed openstack-infra/zuul feature/zuulv3: DNM: test  https://review.openstack.org/50164309:25
*** yamamoto_ has quit IRC09:28
*** liujiong_lj has joined #openstack-infra09:30
*** liujiong has quit IRC09:31
*** liujiong has joined #openstack-infra09:32
*** liujiong_lj has quit IRC09:34
*** cshastri has quit IRC09:37
*** psachin has quit IRC09:43
*** liujiong_lj has joined #openstack-infra09:46
*** yamamoto has joined #openstack-infra09:46
*** liujiong_lj has quit IRC09:46
*** jaosorior has joined #openstack-infra09:47
*** markvoelker has quit IRC09:48
*** liujiong has quit IRC09:49
*** jascott1 has joined #openstack-infra09:50
*** s-shiono_ has quit IRC09:50
*** dhajare has quit IRC09:53
*** rossella_s has quit IRC09:56
*** cshastri has joined #openstack-infra09:57
*** rossella_s has joined #openstack-infra10:00
*** cuongnv has quit IRC10:01
*** dtantsur|afk is now known as dtantsur10:05
*** shardy_afk is now known as shardy10:05
*** dhajare has joined #openstack-infra10:09
*** slaweq has joined #openstack-infra10:14
*** yamamoto has quit IRC10:14
*** oanson has quit IRC10:16
*** oanson has joined #openstack-infra10:18
*** eranrom has quit IRC10:18
*** yamamoto has joined #openstack-infra10:19
*** slaweq has quit IRC10:19
*** thorst has joined #openstack-infra10:21
*** dhajare has quit IRC10:23
*** zhurong has quit IRC10:23
*** thorst has quit IRC10:26
*** sflanigan has joined #openstack-infra10:27
*** stakeda has quit IRC10:32
*** eranrom has joined #openstack-infra10:33
*** dhajare has joined #openstack-infra10:35
*** gildub has joined #openstack-infra10:39
*** jkilpatr has quit IRC10:40
*** markvoelker has joined #openstack-infra10:45
hwoaranghello. could someone please review https://review.openstack.org/#/c/501238/ to unblock the OSA gates? thank you!10:45
odyssey4mesomeone other than AJaeger you mean ;) not sure if ianw or yolanda are available10:46
*** rossella_s has quit IRC10:52
*** rossella_s has joined #openstack-infra10:52
*** jpena is now known as jpena|lunch10:57
fricklerinfra-root: the gerrit ride is getting pretty bumpy for me, seems to be close to needing its (bi-)weekly kick10:58
fricklerhttp://cacti.openstack.org/cacti/graph.php?action=view&local_graph_id=27&rra_id=all seems to say the same10:59
*** namnh has quit IRC11:01
*** udesale has quit IRC11:04
*** ccamacho has quit IRC11:06
*** sdague has joined #openstack-infra11:06
*** electrofelix has quit IRC11:07
*** cshastri has quit IRC11:07
*** szaher has quit IRC11:07
*** markmcd has quit IRC11:08
*** markmcd has joined #openstack-infra11:11
chandankumarclarkb: hello11:13
chandankumarclarkb: i have not found the ptl name for fuel and openstack UX, since it is not part of the governance.11:13
chandankumarclarkb: what to do with their goal update?11:13
*** slaweq has joined #openstack-infra11:15
*** psachin has joined #openstack-infra11:16
*** jkilpatr has joined #openstack-infra11:16
*** markvoelker has quit IRC11:17
*** zhurong has joined #openstack-infra11:19
chandankumarclarkb: same goes for community app catalog11:20
*** slaweq has quit IRC11:20
*** thorst has joined #openstack-infra11:22
*** cshastri has joined #openstack-infra11:22
*** Zara has quit IRC11:27
*** thorst has quit IRC11:30
*** lucasagomes is now known as lucas-hungry11:32
*** efoley has quit IRC11:34
*** efoley has joined #openstack-infra11:34
*** pbourke has quit IRC11:34
*** pbourke has joined #openstack-infra11:36
*** rhallisey has joined #openstack-infra11:37
*** srobert has joined #openstack-infra11:41
*** srobert has quit IRC11:42
*** srobert has joined #openstack-infra11:42
dmsimardAJaeger: Re: SUSE capitalization, the Ansible "ansible_os_family" fact returns "Suse", but ok :)11:47
fungichandankumar: that's probably more of a discussion for the #openstack-dev or #openstack-tc channel, but i expect what we should do is just remove those unofficial teams from the goals list. community goals tracking doesn't apply to unofficial (fuel) or nonexistent (app catalog, ux) teams11:58
*** szaher has joined #openstack-infra11:59
chandankumarfungi: thanks, sure, i will update the patches related to those projects11:59
*** thorst has joined #openstack-infra12:01
*** thorst_ has joined #openstack-infra12:03
AJaegerdmsimard: but "CentOS"? Strange bug... If you can use SUSE without major surgery - nice. I didn't gave a -1 on purpose ;)12:03
AJaegerfungi, could you review 501238, please?12:03
*** efoley has quit IRC12:04
dmsimardIt's a task name field so we can do whatever we want but the name of the file really needs to be "Suse.yaml" :p12:04
*** emmaloui_ has joined #openstack-infra12:04
openstackgerritMerged openstack-infra/project-config master: zuul: layout: Add experimental openSUSE jobs for OSA roles  https://review.openstack.org/50123812:04
AJaegerdmsimard: I see ;( Ok, won't fight it further...12:04
*** jpena|lunch is now known as jpena12:05
*** thorst__ has joined #openstack-infra12:05
*** thorst has quit IRC12:05
AJaegerfungi, thanks, didn't saw that you already did12:05
AJaegerhwoarang: odyssey4me ^12:05
*** wolverineav has joined #openstack-infra12:05
dmsimardAJaeger: send a pr to Ansible :)12:05
*** pgadiya has quit IRC12:06
AJaegerand break all Suse Support? ;/12:06
* AJaeger leaves that to others...12:06
dmsimardlol12:06
dmsimardsorry :(12:06
*** thorst_ has quit IRC12:07
*** dims has joined #openstack-infra12:07
dmsimardActually, even the ansible_os_distribution fact is problematic for SUSE12:07
AJaegerhwoarang: you're an ansible and SUSE expert, something for you ^12:08
dmsimardIt's reported as "openSUSE Leap" with that capitalization *AND* the space12:09
AJaegerhwoarang: background: https://review.openstack.org/#/c/50153912:09
dmsimardhttp://logs.openstack.org/67/499467/10/check/gate-tempest-dsvm-neutron-full-opensuse-423-nv/a25c73e/logs/ara/host/720da982-d1e4-415a-bead-ea4a5c4e8ef9/12:09
AJaegerdmsimard: that looks fine from a marketing point of few - not sure what problems it gives.12:09
AJaegerdmsimard: Let's see whether hwoarang and dirk know more about the above12:10
*** Zara has joined #openstack-infra12:10
*** lucas-hungry is now known as lucasagomes12:10
dmsimardAJaeger: It's a common pattern in Ansible to import or run OS-specific tasks based on the ansible_os_family and ansible_os_distribution facts12:11
dmsimardsee third example: http://docs.ansible.com/ansible/latest/include_vars_module.html#examples12:11
dirkdmsimard: and why is that problematic?12:11
dmsimardso if we used ansible_os_distribution, you'd need to name your file "openSUSE Leap.yaml"12:11
dmsimardwith a space :/12:11
dirkah, ok12:11
dirkwell, we set the "IS_LIKE" flag in /etc/os-release to suse iirc12:12
openstackgerritJeremy Stanley proposed openstack-infra/project-config master: Revert "Set OVH max-servers to 0"  https://review.openstack.org/50170512:12
dmsimardthus, for that particular case I used the ansible_os_family fact which reports "Suse" but apparently that ought to be "SUSE" :)12:12
dirkso if ansible could respect that one, we wouldn't have that issue. but the fact that we use spaces and the fact that we use versions with dot is breaking a lot these days12:12
dirkdmsimard: yes :)12:12
dirkdmsimard: can you isolate where that wrong capitalization is coming from?12:13
openstackgerritJeremy Stanley proposed openstack-infra/project-config master: Revert "Set OVH max-servers to 0"  https://review.openstack.org/50170512:13
dmsimarddirk: somewhere in here: https://github.com/ansible/ansible/blob/devel/lib/ansible/module_utils/facts/system/distribution.py12:13
dmsimardI'm not sure to what extent this is fixable by now -- fixing both to be consistent (and ideally without spaces) would be great but it'd probably break implementations going forward12:14
AJaegerfungi: great patch, thanks!12:14
*** markvoelker has joined #openstack-infra12:15
*** jaosorior has quit IRC12:15
dirkdmsimard: I see. well, "SuSE" is even worse ;)12:15
dmsimardlol12:15
AJaegerdirk: yeah, so 90ies ;)12:15
fungiinfra-root: project-config-core: 501705 brings ovh back online!12:16
dirkI personally think Suse is sort of fine (although looks ugly), "suse" and "SUSE" are probably valid choices12:16
*** slaweq has joined #openstack-infra12:16
fungiand SuSE is archaic, i suppose12:19
*** dave-mccowan has joined #openstack-infra12:19
dirkfungi: yep, SuSE was renamed to SUSE around 2001 or so12:20
* fungi feels old12:20
dirkit is a capitalization variant that is hard to get out of people's head though12:20
dirkansible has a scary amount of open pull requests12:21
*** slaweq has quit IRC12:21
dirklet me see if I can fix the os_family thing12:21
dirkfungi: well, what should I say ?!12:22
fungidirk: i am old, really, so not much to say i guess12:23
smcginnisI had no idea it was renamed either.12:24
*** markvoelker has quit IRC12:24
*** markvoelker has joined #openstack-infra12:24
*** alexchadin has quit IRC12:24
* dirk started with linux 1.1.912:24
*** martinkopec has quit IRC12:24
dirkwhich seems to have been around 1995 according to wikipedia12:25
fungidirk: 0.95 sources downloaded from usenet here12:25
smcginnisI can't remember the version, but I started with Red Hat a few years before Fedora or RHEL existed.12:25
*** zhurong has quit IRC12:25
fungithen softlanding/sls, then slack, then red hat linux (pre-rhel), then debian around potato and have stuck with debian ever since12:26
* smcginnis remembers many fond (hah!) hours trying to get a Toshiba laptop to run right12:26
*** jamesdenton has quit IRC12:27
fungiinfra-root: i'm travelling and away from the computer most of today and half of tomorrow, but may be able to check in briefly this evening12:27
dirkfungi: impressive. :)12:29
*** gildub has quit IRC12:30
*** rlandy has joined #openstack-infra12:33
*** jamesdenton has joined #openstack-infra12:33
*** trown|outtypewww is now known as trown12:34
kklimondawith diskimage-builder, how do I override variables set in environment.d ? centos7 is overriding DIB_RELEASE which is making my life harder.. :312:35
*** mat128 has joined #openstack-infra12:35
*** jamesmcarthur has joined #openstack-infra12:36
*** caphrim007 has quit IRC12:36
*** caphrim007 has joined #openstack-infra12:37
*** jamesmcarthur has quit IRC12:37
*** jamesmcarthur has joined #openstack-infra12:37
*** ccamacho has joined #openstack-infra12:39
*** dave-mcc_ has joined #openstack-infra12:39
*** esberglu has joined #openstack-infra12:40
*** caphrim007 has quit IRC12:41
*** dave-mccowan has quit IRC12:42
*** jamesmcarthur has quit IRC12:42
*** kgiusti has joined #openstack-infra12:43
*** jaosorior has joined #openstack-infra12:44
*** jtomasek has quit IRC12:48
*** jaypipes has joined #openstack-infra12:48
hwoarangAJaeger: let me read the backlog12:49
*** jtomasek has joined #openstack-infra12:49
dmsimardAJaeger: doh, it's already +W'd, I was going to fix it where possible :P12:49
dmsimardfungi: I never used usenet until I tried it like a year ago and dear god I was totally lost12:50
hwoarangAJaeger: dmsimard yeah ansible returns 'Suse' for SUSE distros12:50
hwoarangthat's just how it is...12:50
dmsimardhwoarang: and "openSUSE Leap" for the distro :/12:50
hwoarangyep :/12:50
dmsimardhwoarang: do you end up using that in OSA? or use the family ?12:51
dmsimardit'd be weird to have file names with spaces in them12:51
hwoarangdmsimard: we use the family for the variables12:51
dmsimardok, same here then12:51
hwoarangbut for the distro we simply replace space with _12:51
*** Goneri has joined #openstack-infra12:51
hwoarangif we need to use distro and not family stuff specifically12:51
dmsimardhwoarang: does that work ? can you do like openSUSE_Leap.yml ?12:51
hwoarangit should work but we never done it for yaml files. Just for naming folders and stuff12:52
dmsimardah, ok12:52
*** dprince has joined #openstack-infra12:54
*** cshastri has quit IRC12:57
*** bh526r has joined #openstack-infra12:57
*** sflanigan has quit IRC12:58
mordredfrickler, evrardjp, odyssey4me: I'm not sure that https://review.openstack.org/#/c/501664 is actually caused by a bug in shade ... is there a link to a failed job with logs so we can verify that versions of things got installed?12:58
mordredfrickler, evrardjp, odyssey4me: we can obviously land that revert to unblock a gate, but I'd like to figure out the root cause and fix it so that we don't think that a given release is broken12:58
*** gildub has joined #openstack-infra12:59
*** baoli has joined #openstack-infra13:02
fricklermordred: I'm not sure how I can help with that, did you mean to ping dirk instead since he approved the revert?13:02
*** felipemonteiro has joined #openstack-infra13:03
*** felipemonteiro_ has joined #openstack-infra13:05
evrardjphwoarang: | lower :D13:05
hwoarangwell yeah ;p13:05
evrardjpmordred: yeah I think we need to find the root cause of the issue, and the revert is just a workaround13:06
mordredfrickler: I did! whops13:06
evrardjpI'll have a look at the keystoneauth1 version13:06
mordredevrardjp: are there any build logs I can look at?13:07
*** udesale has joined #openstack-infra13:07
*** dhajare has quit IRC13:07
evrardjpI can show you where I extracted this13:07
evrardjphttp://logs.openstack.org/50/500850/2/check/gate-openstack-ansible-openstack-ansible-aio-ubuntu-xenial/a075c79/console.html13:07
*** iyamahat has joined #openstack-infra13:08
russellbCan someone op me in #openstack-neutron-ovn so that I can update the topic to reflect that the channel is deprecated?13:08
*** felipemonteiro has quit IRC13:09
*** mriedem has joined #openstack-infra13:09
evrardjpwe have very readable output too, with things like: http://logs.openstack.org/50/500850/2/check/gate-openstack-ansible-openstack-ansible-aio-ubuntu-xenial/a075c79/console.html#_2017-09-07_09_37_33_06361313:09
mordredrussellb: done13:09
russellbmordred: thank you sir!13:09
mordredevrardjp: oh that's nice :)13:09
mordredevrardjp: OH13:10
mordredevrardjp: you are ... you are installing some things from git/pip and some things from distro packages13:11
evrardjpwe build everything from source, and we run things in venvs13:11
mordredevrardjp: http://logs.openstack.org/50/500850/2/check/gate-openstack-ansible-openstack-ansible-aio-ubuntu-xenial/a075c79/console.html#_2017-09-07_09_37_33_06542413:11
evrardjpdistro packages are just for any requirements13:11
evrardjpthis is a pip package13:11
openstackgerritRussell Bryant proposed openstack-infra/project-config master: Remove gerrit IRC notifications from openstack-neutron-ovn.  https://review.openstack.org/50172213:12
mordredevrardjp: right - but you've got openstack client libs in that distro package list ... is there any way those are what is providing keystoneauth?13:12
mordredkk13:12
mordredevrardjp: OH sorry, I can't read :)13:12
evrardjpanyway it will never run because venvs :)13:12
evrardjpbut no it shouldn't :p13:12
evrardjpwhat I am showing you is an extract of what we call the "repo build" process, which will be refactored in the future, and is currently a fast way to build wheels for venvs13:13
mordredcool, and gotcha.13:15
evrardjp(Loading the repo build process log right now for your viewing pleasure)13:15
evrardjpdarn I can't pinpoint a line for you: http://logs.openstack.org/50/500850/2/check/gate-openstack-ansible-openstack-ansible-aio-ubuntu-xenial/a075c79/logs/openstack/aio1_repo_container-8186fec8/repo/repo_builder.log.txt.gz13:15
*** shardy has quit IRC13:15
evrardjpsummarized version, we are, in the repo build process, resolving the installation of shade to 1.23.013:16
evrardjpfor keystoneauth1, we are Using version 3.1.013:17
evrardjpwhich is the cause of the issue indeed.13:17
*** slaweq has joined #openstack-infra13:17
mordredyah - it makes me thing one of two things happened:13:17
*** jamesmcarthur has joined #openstack-infra13:18
evrardjp(I pasted a stable/pike job of yesterday, but the result would be the same with master, sorry we are debugging the wrong build)13:19
*** shardy has joined #openstack-infra13:19
evrardjpI can find another one13:19
evrardjpbut it would be the same thing13:19
mordreda) you got lucky and pulled a copy of the u-c file at a moment where it had shade===1.23.0 and keystoneauth1==3.1.0 (although I don't know how that could actually happen)13:19
mordredso I don't think it's a13:19
*** rossella_s has quit IRC13:19
evrardjpsuspense!13:20
mordredor b) somehow the u-c values are getting either ignored or overridden somewhere - since u-c for stable/pike should have keystoneauth pinned to 3.1.0 but that sohuld cause shade to be pinned to 1.22.3 - and u-c for master has 1.23.0 and 3.2.0  in it now13:21
* mordred keeps reading things13:21
evrardjplet me find another build, more close the current time13:22
*** slaweq has quit IRC13:22
evrardjpthis one: http://logs.openstack.org/69/500569/1/check/gate-openstack-ansible-openstack-ansible-aio-ubuntu-xenial/d9bcd0a/13:23
evrardjpran this morning on master.13:23
evrardjpsame os_image issue13:23
*** rossella_s has joined #openstack-infra13:24
evrardjpsame shade version (1.23) and same keystoneauth1<=3.1.013:25
*** dhajare has joined #openstack-infra13:25
dmsimardAJaeger, dirk, hwoarang: I'd like to troubleshoot this Ansible module that works everywhere except our opensuse images: https://github.com/openstack-infra/zuul-jobs/blob/master/roles/validate-host/library/zuul_debug_info.py .. I don't have meaningful debug output http://logs.openstack.org/43/501543/3/check/base-integration-opensuse423/9375b75/job-output.txt.gz#_2017-09-07_03_18_35_77651213:26
*** jamesmcarthur has quit IRC13:26
evrardjpmordred: ok odyssey4me gave me the solution13:26
dmsimardI was wondering if at first glance you might know what the issue is ? I'm suspecting perhaps a different syntax in the command map or something like that https://github.com/openstack-infra/zuul-jobs/blob/master/roles/validate-host/library/zuul_debug_info.py#L2313:26
evrardjptempest doesn't comply with upper constraints so we don't use them...13:27
* dmsimard downloads an opensuse image in the meantime13:27
mordredevrardjp: aha! so something in the tempest install is causing an old version f keystoneauth to get installed13:28
*** sshnaidm|off is now known as sshnaidm13:28
odyssey4meevrardjp mordred yeah, we don't apply u-c to the rally/tempest venvs because they're unfortunately not very good and complying all the time13:29
*** gouthamr has joined #openstack-infra13:29
AJaegerdmsimard: the map looks fine ;( hope dirk or hwoarang can help13:29
odyssey4meand if you don't give pip a constraint file, and the requirements are only a lower bound or no bound, then pip chooses the least applicable version IIRC13:30
*** felipemonteiro_ has quit IRC13:30
dmsimardAJaeger: hoping I can reproduce this on a vanilla opensuse image, don't feel building the entire DIB image :P13:30
mordredodyssey4me: can you put a version into tempest_requires_pip_packages: ?13:30
*** gildub has quit IRC13:31
dirkdmsimard: I have a dib image here. I bet you're missing some package13:32
evrardjpmordred: we could.13:32
dmsimarddirk: ok I'll let you know if I can't reproduce it locally, thanks13:33
*** slaweq has joined #openstack-infra13:33
*** slaweq has quit IRC13:33
mordredodyssey4me, evrardjp: I mean, I'm still quite curious as to what is making that build decide to pull shade 1.23.0 and ksa 3.1.0 - since shade depends on ksa >= 3.2.013:33
hwoarangdmsimard: maybe the traceroute binaries are missing?13:33
odyssey4memordred testing some things quickly13:34
evrardjpyes I checked the u-c for this master build and in requirements repo it's 3.2.013:34
mordreddo you treat tempest_requires_pip_packages as an ordered list? if so, the install of python-glanceclient or python-keystoneclient could be pulling an older version13:34
evrardjphttps://github.com/openstack/requirements/blob/0d42548f92d4cade177c17cb0b8815516ca1086d/upper-constraints.txt#L48113:34
mordredodyssey4me: cool13:34
mordredevrardjp: I proposed the reuqirements revert revert for when we get this sorted13:34
odyssey4memordred we prefer not to add versions into the pip packages list as we want constraints to manage the version used13:34
mordredodyssey4me: totally13:34
evrardjpmordred: thanks!13:34
mordredodyssey4me: I mean- shade declares the min version it needs here - but pip will ignore that if something _else_ caused ksa to get installed before pip13:35
odyssey4mein our repo build, however, we resolve everything needed down to a single set which should be based on u-c at the sha we have fixed13:35
dirkdmsimard: traceroute is not in the path for users normally13:35
dmsimarddirk: oh, where would it be ? we can try adding that path to os.sys.path13:35
dirkdmsimard: is that traceroute run as root or not? you might try /usr/sbin/traceroute (it is callable as non-root just fine though)13:36
openstackgerritHirofumi Ichihara proposed openstack-infra/project-config master: Add new project networking-lagopus  https://review.openstack.org/50173013:37
dirkdmsimard: actually the bug is even simpler13:37
dirkdmsimard: http://logs.openstack.org/43/501543/3/check/base-integration-opensuse423/9375b75/job-output.json -- search for "OSError"13:38
dirkdmsimard: traceroute6 isn't installed, and it isn't capturing that exception13:38
dmsimarddirk: ohhhh, good catch13:38
dmsimarddirk: hmm, so this supposedly works today .. maybe I'm missing something13:39
dmsimardhuh, the role doesn't run, I thought it did. Okay, so this is new then.13:41
*** udesale has quit IRC13:41
openstackgerritDirk Mueller proposed openstack-infra/zuul-jobs master: Expand PATH for SUSE systems to include /usr/sbin  https://review.openstack.org/50173713:42
dirkdmsimard: ^^13:42
dmsimarddirk: that traceroute6 is an ansible implementation of http://git.openstack.org/cgit/openstack-infra/project-config/tree/jenkins/jobs/macros.yaml#n76013:42
dirkdmsimard: can you make yours depends-on that one? then we should see13:42
dmsimarddirk: but in the macro it's non-fatal so I guess it always failed on opensuse13:42
*** electrofelix has joined #openstack-infra13:42
dmsimarddirk: would traceroute be installed you think ?13:43
dirkdmsimard: it should be13:43
dmsimardok13:43
dmsimardlet me rebase my patch13:43
dirkdmsimard: hmm, ok. so if its not that, what is actually failing? any idea?13:43
dmsimarddirk: it wouldn't fail in regular jobs, because there's || true13:44
dmsimarddirk: in the bash version13:44
dmsimarddirk: I can't really rebase my patch on top of yours because mine is nested in an unmerged tree :) can I rebase yours instead ?13:44
openstackgerritDirk Mueller proposed openstack-infra/zuul-jobs master: Expand PATH for SUSE systems to include /usr/sbin  https://review.openstack.org/50173713:45
dirkdmsimard: ah, ok. done13:45
dmsimarddirk: we'll need to switch things around because otherwise my patch won't pass the check jobs but this is a good test to see if it passes13:46
dmsimarddirk: I'm making sure the zuul v3 stuff works across all distros so I might reach out some more if I need help with SUSE :p13:47
openstackgerritMonty Taylor proposed openstack-infra/project-config master: Consume validate_host parameters from site-variables  https://review.openstack.org/50124213:48
openstackgerritMonty Taylor proposed openstack-infra/project-config master: Remove unneeded ensure-tox playbook  https://review.openstack.org/50174213:48
*** vhosakot has joined #openstack-infra13:48
dirkmordred: https://review.openstack.org/#/c/501727/ should be workflow wip right now, right? I'm not sure where we are with the investigations on this13:49
*** thegreenhundred has joined #openstack-infra13:50
*** vhosakot has quit IRC13:50
mordreddirk: done - I'll leave it there until odyssey4me gets back to us13:50
*** vhosakot has joined #openstack-infra13:50
*** bobh has joined #openstack-infra13:53
odyssey4memordred ok, I thought that it being an indirect requirement would change things up, but it's not - so I'm not really understanding where that has come from13:56
openstackgerritMonty Taylor proposed openstack-infra/zuul-jobs master: Make validate-host read from site-variables  https://review.openstack.org/50059213:57
openstackgerritMonty Taylor proposed openstack-infra/project-config master: Consume validate_host parameters from site-variables  https://review.openstack.org/50124213:57
*** coolsvap has quit IRC13:57
*** dave-mcc_ is now known as dave-mccowan13:57
mordredodyssey4me: yah - I'm very confused by what behaviors would cause that set of versions to get installed - it's a thing you'd normally have to try pretty hard to achieve13:58
mordredpabelanger, AJaeger: ^^ https://review.openstack.org/501242 https://review.openstack.org/50174 2https://review.openstack.org/500592 please13:59
odyssey4memordred yeah, this can happen sometimes if the reqyirements for some projects are out of whack (the updates haven't merged in all repositories)... we'll have to do a test build to take a better look see13:59
odyssey4meour gating info is not enough13:59
mordredodyssey4me: k. let me know if I can help in any way14:00
mordredpabelanger, AJaeger: ^^ bad copy pasta https://review.openstack.org/501742 https://review.openstack.org/50059214:03
*** trown is now known as trown|brb14:04
dmsimarddirk: oops, syntax error in your patch: http://logs.openstack.org/37/501737/2/check/base-integration-opensuse423/0a06ace/job-output.txt.gz14:05
openstackgerritDirk Mueller proposed openstack-infra/zuul-jobs master: Expand PATH for SUSE systems to include /usr/sbin  https://review.openstack.org/50173714:06
dirkdmsimard: *sigh*14:06
odyssey4memordred ok, understand the problem now :) it took a little bit more memory jostling to remember that pip ignores any requirement specifications when you give it a constraint14:07
*** eranrom has quit IRC14:07
odyssey4meso, for example, if you execute this in a venv - even though shade's requirements specifies a higher version of keystoneauth1, pip will not tell you that: pip install -c https://raw.githubusercontent.com/openstack/requirements/ee4c31dcc5a255b9b29ffdc5406d32a0ad4e3a75/upper-constraints.txt shade==1.23.014:07
evrardjpso I think that the inclusion of shade in requirements of stable/pike is ok, and the rollback of master is ok. Just a mess up on my side.14:09
odyssey4mein our case we are applying an unconstrainted shade version and trying to constrain its deps... which just won't work because we get the latest shade and incompatible deps14:09
openstackgerritDavid Shrewsbury proposed openstack-infra/zuul-jobs master: Create fetch-zuul-cloner role.  https://review.openstack.org/50174914:09
openstackgerritDavid Shrewsbury proposed openstack-infra/zuul feature/zuulv3: Remove zuul-cloner shim  https://review.openstack.org/50175014:09
odyssey4menow that we have u-c for shade in pike and master, we just need to update our SHA's14:09
*** trown|brb is now known as trown14:09
mordredodyssey4me: AHA! cool! that's great news14:09
mordredodyssey4me: and makes total sense14:10
mordreddirk: ^^ https://review.openstack.org/#/c/501727 is good to go back in14:10
odyssey4mepip is rather naughty14:10
mordredyah14:10
openstackgerritDavid Shrewsbury proposed openstack-infra/zuul feature/zuulv3: Remove zuul-cloner shim  https://review.openstack.org/50175014:10
odyssey4meit really should actually give you a nasty warning that you're breaking the requirements for a package14:11
*** ccamacho has left #openstack-infra14:11
odyssey4mebut we're also overcomplicating some things - but will hopefully fix that this cycle :p14:11
*** ykarel has quit IRC14:11
evrardjp++ this14:12
mordredodyssey4me: ++14:13
mordredodyssey4me: hopefully this cycle we're handing you new tools to make that easier14:13
evrardjpoh?14:13
evrardjpmordred: would be happy to hear about that.14:14
openstackgerritMerged openstack-infra/zuul-jobs master: Fix lint issue  https://review.openstack.org/50154014:15
clarkbfungi: we need to upgrade mirrors in ovh to xenial too14:16
clarkb(I can work on that in a bit)14:16
*** zhouyaguo has joined #openstack-infra14:17
zhouyaguoHi, Can anybody kindly help to merge this? https://review.openstack.org/#/c/500858/ , another oslo.db commit is blocked by this one. Thanks very much.14:18
*** baoli has quit IRC14:19
*** marst has joined #openstack-infra14:19
*** baoli has joined #openstack-infra14:19
*** kjackal_ has quit IRC14:23
*** andreas_s_ has quit IRC14:23
*** srobert has quit IRC14:24
*** kjackal_ has joined #openstack-infra14:24
*** bobh has quit IRC14:25
*** dhajare has quit IRC14:26
openstackgerritDavid Moreau Simard proposed openstack-infra/zuul-jobs master: Revert "Fix lint issue"  https://review.openstack.org/50175314:27
openstackgerritJames E. Blair proposed openstack-infra/zuul-jobs master: Revert "Fix lint issue"  https://review.openstack.org/50175414:28
*** mwarad has joined #openstack-infra14:29
evrardjpthat's a sync ^14:30
openstackgerritDavid Moreau Simard proposed openstack-infra/zuul-jobs master: Revert "Fix lint issue"  https://review.openstack.org/50175414:30
openstackgerritAndreas Jaeger proposed openstack-dev/cookiecutter master: Fix docs.o.o URLs  https://review.openstack.org/50175514:31
dmsimarddirk: looks like that path fix worked, I'll switch the base of the patch and let's work with that. Thanks a lot for your help :)14:31
openstackgerritDavid Moreau Simard proposed openstack-infra/zuul-jobs master: Expand PATH for SUSE systems to include /usr/sbin  https://review.openstack.org/50173714:32
openstackgerritDavid Moreau Simard proposed openstack-infra/zuul-jobs master: Add integration tests for validate-host  https://review.openstack.org/50154314:32
*** rbrndt has joined #openstack-infra14:32
dirkdmsimard: cool :)14:32
dirkdmsimard: now for a completely stupid question: what is this role being used for?14:33
dirke.g. where could it make a change now/can we enable something that we didn't have before?14:33
dmsimarddirk: a lot of things in zuul v3 are now explicit rather than implicit14:33
dmsimarddirk: for example, nodepool in v2 would configure the openstack-infra mirrors before handing the node back to zuul14:34
dmsimarddirk: now, the mirror configuration is part of the job14:34
*** slaweq has joined #openstack-infra14:34
openstackgerritAndreas Jaeger proposed openstack-dev/cookiecutter master: Fix docs.o.o URLs  https://review.openstack.org/50175514:34
mnaser(side question: is the temp. zuulv3 operation for this weekend still planned?)14:34
*** LindaWang has quit IRC14:34
dmsimarddirk: the node validation is part of that explicit process14:34
*** skelso has joined #openstack-infra14:35
*** emmaloui_ has quit IRC14:35
dmsimardmnaser: I haven't seen any emails saying the contrary so I would tend to think that things are still going according to plan, however, an email reminder to the MLs might be in order14:35
dmsimardmordred, jeblair, clarkb ^14:35
*** emmaloui_ has joined #openstack-infra14:35
openstackgerritMonty Taylor proposed openstack-infra/zuul-jobs master: Make validate-host read from site-variables  https://review.openstack.org/50059214:37
*** slaweq has quit IRC14:39
openstackgerritHirofumi Ichihara proposed openstack-infra/project-config master: Add new project networking-lagopus  https://review.openstack.org/50173014:42
*** hongbin has joined #openstack-infra14:42
openstackgerritMonty Taylor proposed openstack-infra/zuul feature/zuulv3: Update tests to use AF_INET6  https://review.openstack.org/50126614:45
*** hashar is now known as hasharAway14:47
*** jascott1 has quit IRC14:47
*** Swami has joined #openstack-infra14:50
*** jamesmcarthur has joined #openstack-infra14:53
*** skelso has quit IRC14:53
*** rossella_s has quit IRC14:56
*** xarses_ has joined #openstack-infra14:56
*** skelso has joined #openstack-infra14:57
*** zhouyaguo has quit IRC14:58
*** rossella_s has joined #openstack-infra14:58
*** felipemonteiro has joined #openstack-infra14:58
*** felipemonteiro_ has joined #openstack-infra14:59
*** flwang has quit IRC14:59
*** dhajare has joined #openstack-infra15:01
*** flwang has joined #openstack-infra15:01
*** felipemonteiro has quit IRC15:03
*** LindaWang has joined #openstack-infra15:06
*** wolverineav has quit IRC15:07
mordredclarkb: if you get a sec, https://review.openstack.org/#/c/501742  https://review.openstack.org/#/c/500592/ and https://review.openstack.org/#/c/50124215:07
*** mwarad has quit IRC15:09
clarkbmordred: I've got to do morning things but will pull those up when done15:10
openstackgerritMonty Taylor proposed openstack-infra/zuul-jobs master: Add UPPER_CONSTRAINTS_FILE file if it exists  https://review.openstack.org/50032015:10
mordredclarkb: kk. thanks15:10
mordredclarkb: also when you get back ^^ I squahsed the follow up patch which you had +2'd with the base patch which jlk had +2d15:11
*** Goneri has quit IRC15:13
*** wolverineav has joined #openstack-infra15:13
*** iyamahat has quit IRC15:16
openstackgerritMonty Taylor proposed openstack-infra/shade master: Convert test_baremetal_machine_patch to testscenarios  https://review.openstack.org/50176815:19
*** armax has joined #openstack-infra15:19
openstackgerritDavid Shrewsbury proposed openstack-infra/project-config master: Add fetch-zuul-cloner role to base job  https://review.openstack.org/50176915:20
*** armax has quit IRC15:20
openstackgerritIlya Shakhat proposed openstack-infra/openstackid-resources master: Extend serialized Member with EmailVerifiedDate  https://review.openstack.org/50177115:22
openstackgerritMerged openstack-infra/zuul-jobs master: Revert "Fix lint issue"  https://review.openstack.org/50175415:22
openstackgerritMerged openstack-infra/zuul feature/zuulv3: Update tests to use AF_INET6  https://review.openstack.org/50126615:23
*** gmann has quit IRC15:24
*** gmann has joined #openstack-infra15:24
*** bobh has joined #openstack-infra15:26
*** nicolasbock has joined #openstack-infra15:26
*** dprince has quit IRC15:28
*** bobh has quit IRC15:31
openstackgerritJames E. Blair proposed openstack-infra/zuul feature/zuulv3: Make test_dynamic_dependent_pipeline_failure more robust  https://review.openstack.org/50177815:34
*** slaweq has joined #openstack-infra15:35
*** Goneri has joined #openstack-infra15:39
openstackgerritDavid Shrewsbury proposed openstack-infra/project-config master: Add fetch-zuul-cloner role to base-test job  https://review.openstack.org/50176915:39
*** slaweq has quit IRC15:40
*** jamesmcarthur has quit IRC15:40
*** rlandy is now known as rlandy|PTO15:41
*** dhajare has quit IRC15:44
openstackgerritMerged openstack-infra/zuul feature/zuulv3: Fix spacer-lines to work with multi-node and items  https://review.openstack.org/50016215:46
*** baoli has quit IRC15:46
clarkbchandankumar: I don't think TC goals apply to projects like fuel that are not part of governance. But asking the TC is probably the best way to figure that out15:47
clarkbchandankumar: and app catalog is EOL/deprecated iirc15:47
*** baoli has joined #openstack-infra15:47
*** jamesmcarthur has joined #openstack-infra15:47
*** bobh has joined #openstack-infra15:48
clarkbAJaeger: boris_42 re mirror things youcan source it like that but unless your job knows how to use those values it won't change anything. Also we set the distro release appropriate values for you already (eg ubuntu mirror for ubuntu jobs and centos for centos)15:48
chandankumarclarkb: Thanks, patch already up :-)15:49
clarkbinfra-root I'll work on replacing ovh mirrors this morning and approve fungi's ovh max servers update change once that is done15:50
*** rossella_s has quit IRC15:52
openstackgerritMerged openstack-infra/zuul-jobs master: Create fetch-zuul-cloner role.  https://review.openstack.org/50174915:52
openstackgerritMerged openstack-infra/project-config master: Add the emit-ara-html to the base-minimal role  https://review.openstack.org/50151715:52
*** rossella_s has joined #openstack-infra15:54
*** shardy is now known as shardy_afk15:57
pabelangerclarkb: excellent15:57
openstackgerritMerged openstack-infra/zuul feature/zuulv3: Make test_dynamic_dependent_pipeline_failure more robust  https://review.openstack.org/50177815:57
openstackgerritMerged openstack-infra/project-config master: Remove unneeded ensure-tox playbook  https://review.openstack.org/50174215:59
*** LindaWang has quit IRC15:59
clarkbmordred: re https://review.openstack.org/#/c/500592/5/roles/validate-host/defaults/main.yaml what makes those site variablse that can't be overridden?16:01
clarkbmordred: is the variable prefix special?16:02
*** egonzalez has quit IRC16:03
*** srobert has joined #openstack-infra16:03
*** srobert has quit IRC16:03
*** srobert has joined #openstack-infra16:03
openstackgerritMerged openstack-infra/project-config master: Add fetch-zuul-cloner role to base-test job  https://review.openstack.org/50176916:05
*** bh526r has quit IRC16:07
*** persia has quit IRC16:07
*** Apoorva has joined #openstack-infra16:08
openstackgerritDavid Shrewsbury proposed openstack-infra/zuul-jobs master: DNM: testing cloner shim  https://review.openstack.org/50178916:10
mordredclarkb: the prefix is not special (altohugh I've taken to prefixing most of our site variables with "zuul_site")16:12
mordredclarkb: what makes them unable to be overridden is the way we provide them to ansible - we pass them in in a file with -e@site-variables.yaml16:12
mordredthat puts them at the top of the pecking order for variable precedence and makes them un-overridable16:13
clarkbmordred: but hwo does zuul know to do that? ist just a normal role defaults vars file16:14
clarkbI'm booting xenial ovh bhs1 mirror now16:14
clarkbusing the same flavor as before. 2 core but 7gb of ram16:14
mordredclarkb: the normal role defaults file works just lke normal16:14
mordredclarkb: so in the role defaults file it's just defining some parameters named zuul_site_traceroute_host - there is actually nothing special about them from a role POV16:15
*** e0ne has quit IRC16:16
mordredclarkb: BUT - the intent is for operators to set those variables in their site-variables.yaml file16:16
mordredclarkb: so that users can't override them in jobs16:16
clarkbmordred: gotcha so they could still be overridden in the role as is, you also need to go edit the special site-vars file16:16
clarkband once that is done anything in site vars file wins16:17
mordredoh - crap, I left out a file in that patch ...16:17
mordredclarkb: yah16:17
mordredclarkb: so it's possible for someone to use that role and just pass variables to it like normal16:17
mordredas long as a zuul admin hasn't defined those16:17
mordredbut if a zuul admin has defined site-variables, those will win16:17
clarkbre ovh, apparently we get ipv6 there but ping unworks. I believe the reason for this is that ovh assigns ipv6 data to instances but you have to statically configure it16:18
clarkbwhich may cause nodepool to just fail too16:18
openstackgerritMerged openstack-infra/shade master: Migrate additional machine tests  https://review.openstack.org/50157616:18
clarkbI'm going to remove the ipv6 ping check from launch-node locally so that I can get something that works and see what it looks like16:18
openstackgerritMonty Taylor proposed openstack-infra/zuul-jobs master: Make validate-host read from site-variables  https://review.openstack.org/50059216:18
mordredclarkb: sorry - I forgot a git add16:18
openstackgerritPaul Belanger proposed openstack-infra/nodepool master: Remove opensuse-42.2 and fedora-25 from nodepool dsvm jobs  https://review.openstack.org/50179316:19
clarkbmordred: you may be interested in the ovh ipv6 stuff once I learn more as this has potential to intersect with glean and shade16:20
* clarkb is hoping glean just works (tm)16:20
mordredclarkb: yes - I shall be16:21
mordredclarkb: also - did we ever figure out ipv6 with our friends at city?16:21
clarkbmordred: sort of, I figured out how to get a working setup on a test instance but then we never got it deployed. Part of the problem is only 2/4 regions support it iirc16:22
clarkbmordred: that will be a good post ptg post zuul post gerrit thing to dig into16:22
*** annegentle has joined #openstack-infra16:22
mordred++16:22
mordredinfra-root: I don't normally use the infra-root ping for social things -but I feel this is an exceptional case that is warranted ...16:23
mordredinfra-root: https://www.amazon.com/Savaged-Systemd-Erotic-Unix-Encounter-ebook/dp/B075DYXZW116:23
clarkbwow16:24
pabelangerlulz16:24
*** jaosorior has quit IRC16:30
*** pbourke has quit IRC16:34
openstackgerritNuman Siddique proposed openstack-infra/tripleo-ci master: FOR TESTING ONLY...TESTING ONLY  https://review.openstack.org/50180216:34
*** annegentle has quit IRC16:34
*** slaweq has joined #openstack-infra16:37
*** jpich has quit IRC16:38
openstackgerritPaul Belanger proposed openstack-infra/project-config master: Remove opensuse-42.2 and fedora-25 from nodepool dsvm  https://review.openstack.org/50180416:38
*** thorst__ has quit IRC16:39
*** annegentle has joined #openstack-infra16:40
*** slaweq has quit IRC16:41
*** tosky has quit IRC16:43
*** thorst has joined #openstack-infra16:43
*** armax has joined #openstack-infra16:44
*** rcernin has quit IRC16:45
*** marst has quit IRC16:46
*** thorst has quit IRC16:48
*** thorst_ has joined #openstack-infra16:48
openstackgerritDavid Shrewsbury proposed openstack-infra/zuul-jobs master: Use elevated privs for fetch-zuul-cloner  https://review.openstack.org/50180716:50
*** armax has quit IRC16:50
*** junbo has quit IRC16:50
clarkbmordred: ok second problem in launchnode we are using interface_ip which must be the ipv6 addr16:51
clarkbansible is failing to ssh, gonna try changing that tp public_ipv416:51
mordredclarkb: oh - because the nodes have ipv6 as far as openstack is concerned but we aren't getting the ipv6 configured yet16:51
*** lucasagomes is now known as lucas-afk16:51
mordredclarkb: since you're booting with a normal image and not with a dib image with glean in it16:52
*** dtantsur is now known as dtantsur|afk16:52
mordredclarkb: yah - try changing thatto public_ipv4 - OR you can set force_ipv4: true in the clouds.yaml entry for that cloud16:52
mordredclarkb: which will make interface_ip have the v4 address16:52
clarkbthanks16:53
mordredclarkb: depends on where we get with getting the v6 address configured16:53
mordredclarkb: (if it's just that we need to configure the v6 as a step in launch_node, then obviously changing launch-node makes more sense)16:53
openstackgerritDavid Shrewsbury proposed openstack-infra/zuul-jobs master: Fixes for fetch-zuul-cloner  https://review.openstack.org/50180716:53
clarkbya, right now I want to get an instance booted with config drive set without launch node deleting it on me and check that the instance knows16:54
*** junbo has joined #openstack-infra16:55
*** Swami has quit IRC16:56
*** ralonsoh has quit IRC16:58
*** baoli has quit IRC17:00
*** baoli has joined #openstack-infra17:00
*** thorre has quit IRC17:01
*** blznblzn2 has quit IRC17:01
*** thorre has joined #openstack-infra17:02
*** blznblzn2 has joined #openstack-infra17:03
*** dprince has joined #openstack-infra17:04
clarkbmordred: public_ipv4 is an attribute error17:04
*** charz_ has quit IRC17:04
clarkbits public_v4 looks like17:05
mordredclarkb: yes. sorry17:05
clarkbnah my fault we even use public_v4 elsewhere in the script17:06
*** charz has joined #openstack-infra17:07
*** iyamahat has joined #openstack-infra17:08
openstackgerritMerged openstack-infra/nodepool master: Remove opensuse-42.2 and fedora-25 from nodepool dsvm jobs  https://review.openstack.org/50179317:13
*** iyamahat_ has joined #openstack-infra17:13
openstackgerritMerged openstack-infra/zuul-jobs master: Fixes for fetch-zuul-cloner  https://review.openstack.org/50180717:15
*** persia has joined #openstack-infra17:16
*** dprince has quit IRC17:16
*** iyamahat has quit IRC17:16
odyssey4mejeblair mordred hmm, how is that for timing https://github.com/ansible/awx - I wonder how useful that could be to zuul?17:16
*** trown is now known as trown|lunch17:16
*** jpena is now known as jpena|off17:17
*** ramishra has quit IRC17:18
*** bexelbie has left #openstack-infra17:19
*** SumitNaiksatam has joined #openstack-infra17:19
*** harlowja has joined #openstack-infra17:19
*** baoli has quit IRC17:19
*** baoli has joined #openstack-infra17:20
*** tesseract has quit IRC17:23
openstackgerritMerged openstack-infra/devstack-gate master: Zuul v3: add a devstack-legacy job  https://review.openstack.org/49769917:23
*** chlong has joined #openstack-infra17:24
*** rbrndt has quit IRC17:25
clarkbmordred: 158.69.79.9317:25
clarkbmordred: nova api tells us what its ipv6 addr is but nothing in config drive (which is mounted at ~clarkb/mnt) I'm worried this will be a problem for nodepool too17:26
clarkbmordred: simplest thing is forcing ipv4 via clouds.yaml for now probably?17:26
*** sshnaidm is now known as sshnaidm|afk17:30
*** psachin has quit IRC17:31
*** gouthamr has quit IRC17:33
openstackgerritClark Boylan proposed openstack-infra/system-config master: Force OVH to use ipv4 in shade  https://review.openstack.org/50182217:33
clarkbinfra-root ^ I think that is a necessary prestep to reenabling ovh17:33
* clarkb goes to rebuild mirror one more time with assumption that we'll just be using ipv4 for now17:34
*** slaweq has joined #openstack-infra17:38
*** e0ne has joined #openstack-infra17:38
*** baoli has quit IRC17:39
*** baoli has joined #openstack-infra17:41
*** e0ne_ has joined #openstack-infra17:42
*** slaweq has quit IRC17:43
*** e0ne has quit IRC17:45
*** kjackal_ has quit IRC17:47
*** electrofelix has quit IRC17:53
*** bobh has quit IRC17:54
*** caphrim007 has joined #openstack-infra18:00
openstackgerritMerged openstack-infra/zuul-jobs master: Don't install bindep if there's no bindep file  https://review.openstack.org/50101818:00
clarkboh I derped didn't call it mirror01 /me tries again18:01
*** gouthamr has joined #openstack-infra18:01
*** marst has joined #openstack-infra18:03
*** derekh has quit IRC18:05
*** Swami has joined #openstack-infra18:06
*** caphrim007 has quit IRC18:07
clarkbI've got gra1 and bhs1 booting new mirror01 instances now. I think I got all the issues sorted so just going for it in both regions18:08
clarkbcan I also get reviews on https://review.openstack.org/501822 to address ipv6 situation before we enable the two regions again?18:09
*** emmaloui_ has quit IRC18:10
*** Apoorva has quit IRC18:11
*** trown|lunch is now known as trown18:13
*** caphrim007 has joined #openstack-infra18:16
pabelangerclarkb: +218:23
jeblairclarkb: +3; that seems reasonable until we have a chance to dig deeper18:33
clarkbthanks, I am updating mirror dns now so should be able to turn on ovh again momentarily18:33
*** dims has quit IRC18:34
*** dims has joined #openstack-infra18:36
*** florianf has quit IRC18:37
clarkbdns is done. Once that clouds.yaml update is in place on nodepool.yaml I will approve the cahgne to start using ovh again18:38
openstackgerritPaul Belanger proposed openstack-infra/openstack-zuul-jobs master: Add prepare-docs-for-afs role  https://review.openstack.org/50183518:38
*** slaweq has joined #openstack-infra18:39
openstackgerritMerged openstack-infra/system-config master: Force OVH to use ipv4 in shade  https://review.openstack.org/50182218:39
*** olaph has quit IRC18:40
*** flwang has quit IRC18:40
*** jascott1 has joined #openstack-infra18:40
*** dims has quit IRC18:41
*** olaph has joined #openstack-infra18:41
*** rbrndt has joined #openstack-infra18:41
*** flwang has joined #openstack-infra18:41
*** sdague has quit IRC18:42
*** yamahata has quit IRC18:42
openstackgerritPaul Belanger proposed openstack-infra/project-config master: Rework publish-openstack-python-docs(-infra) job  https://review.openstack.org/50136318:43
*** slaweq has quit IRC18:43
pabelangermordred: clarkb: fungi: AJaeger: new role to handle afs publishing for openstack docs^18:44
*** dims has joined #openstack-infra18:45
*** Apoorva has joined #openstack-infra18:46
openstackgerritDavid Moreau Simard proposed openstack-infra/zuul-jobs master: Add support for debian in configure-mirrors  https://review.openstack.org/50153718:47
openstackgerritDavid Moreau Simard proposed openstack-infra/zuul-jobs master: Add support for centos in configure-mirrors  https://review.openstack.org/50153618:47
openstackgerritDavid Moreau Simard proposed openstack-infra/zuul-jobs master: Add support for opensuse in configure-mirrors  https://review.openstack.org/50153918:47
openstackgerritDavid Moreau Simard proposed openstack-infra/zuul-jobs master: Add support for fedora in configure-mirrors  https://review.openstack.org/50153818:47
openstackgerritDavid Moreau Simard proposed openstack-infra/zuul-jobs master: Expand PATH for SUSE systems to include /usr/sbin  https://review.openstack.org/50173718:47
openstackgerritDavid Moreau Simard proposed openstack-infra/zuul-jobs master: Add integration tests for validate-host  https://review.openstack.org/50154318:47
openstackgerritDavid Moreau Simard proposed openstack-infra/zuul-jobs master: Add integration test jobs for the configure-mirror role  https://review.openstack.org/50153418:47
openstackgerritDavid Moreau Simard proposed openstack-infra/zuul-jobs master: Streamline configure-mirrors and Ubuntu repository setup  https://review.openstack.org/50153518:47
*** boris_42 has quit IRC18:50
*** chlong has quit IRC18:51
*** chlong_ has joined #openstack-infra18:51
*** dprince has joined #openstack-infra18:53
*** bobh has joined #openstack-infra18:55
*** rossella_s has quit IRC18:55
*** iyamahat_ has quit IRC18:56
*** rossella_s has joined #openstack-infra18:56
*** bobh has quit IRC19:00
openstackgerritPaul Belanger proposed openstack-infra/system-config master: Update regex for nb03.o.o / nb04.o.o  https://review.openstack.org/50183819:02
openstackgerritPaul Belanger proposed openstack-infra/system-config master: Add nb01.o.o / nb02.o.o as feature/zuulv3  https://review.openstack.org/50183919:02
*** e0ne_ has quit IRC19:03
*** chlong_ has quit IRC19:07
openstackgerritMerged openstack-infra/zuul feature/zuulv3: Enable maintainConnectionCache  https://review.openstack.org/50114419:07
*** chlong_ has joined #openstack-infra19:08
openstackgerritHongbin Lu proposed openstack-infra/project-config master: [Zun] Add zun-tempest-plugin repository  https://review.openstack.org/50131119:09
openstackgerritHongbin Lu proposed openstack-infra/project-config master: [Zun] Add zun-tempest-plugin repository  https://review.openstack.org/50131119:10
*** SumitNaiksatam has quit IRC19:10
openstackgerritMerged openstack-infra/zuul feature/zuulv3: Close command socket after sending stop  https://review.openstack.org/50075519:11
*** caphrim007 has quit IRC19:11
openstackgerritDavid Shrewsbury proposed openstack-infra/project-config master: Add fetch-zuul-cloner role to base job  https://review.openstack.org/50184319:12
*** iyamahat has joined #openstack-infra19:12
*** chlong__ has joined #openstack-infra19:12
*** slaweq has joined #openstack-infra19:12
*** chlong_ has quit IRC19:14
*** xyang1 has joined #openstack-infra19:15
*** nhicher_ has joined #openstack-infra19:15
*** jkilpatr has quit IRC19:17
clarkbI've approved the change to put ovh back into service19:17
*** patriciadomin has quit IRC19:18
*** nhicher_ has quit IRC19:18
clarkbthe only thing left to do there once that is going again is confirm new mirrors are in use and delete the old ones19:18
pabelangernice19:18
openstackgerritDavid Moreau Simard proposed openstack-infra/openstack-zuul-jobs master: Move openstack-specific jobs to openstack-zuul-jobs  https://review.openstack.org/50184619:19
pabelangerclarkb: we should also add some capacity to nodepoolv3.yaml too19:19
clarkbpabelanger: ya lets confirm v2 is happy first19:19
openstackgerritMerged openstack-infra/nodepool feature/zuulv3: Set base environment as python3  https://review.openstack.org/49625119:19
clarkbjust to double check networking and everything is working19:19
pabelanger++19:19
*** derekh has joined #openstack-infra19:22
*** patriciadomin has joined #openstack-infra19:22
*** petevg has quit IRC19:22
openstackgerritDavid Moreau Simard proposed openstack-infra/zuul-jobs master: Remove project pipeline definition from zuul-jobs  https://review.openstack.org/50184919:23
*** petevg has joined #openstack-infra19:23
openstackgerritDavid Moreau Simard proposed openstack-infra/project-config master: Move pipeline definition from zuul-jobs to project-config  https://review.openstack.org/50185019:23
openstackgerritDavid Moreau Simard proposed openstack-infra/openstack-zuul-jobs master: Move openstack-specific jobs to openstack-zuul-jobs  https://review.openstack.org/50184619:24
openstackgerritMerged openstack-infra/project-config master: Revert "Set OVH max-servers to 0"  https://review.openstack.org/50170519:24
*** Goneri has quit IRC19:24
*** chlong__ has quit IRC19:26
*** chlong_ has joined #openstack-infra19:27
openstackgerritDavid Moreau Simard proposed openstack-infra/project-config master: Move pipeline definition from zuul-jobs to project-config  https://review.openstack.org/50185019:27
*** skelso has quit IRC19:29
*** jamesmcarthur has quit IRC19:30
*** yamahata has joined #openstack-infra19:31
*** pcaruana has quit IRC19:31
*** chlong_ has quit IRC19:32
*** chlong_ has joined #openstack-infra19:33
pabelangerjeblair: Shrews: clarkb: https://review.openstack.org/499855/ is an easy review, promotes disabing facts on logs.o.o. tested with base-test today19:33
openstackgerritDavid Moreau Simard proposed openstack-infra/zuul-jobs master: Streamline configure-mirrors and Ubuntu repository setup  https://review.openstack.org/50153519:36
*** thorst_ has quit IRC19:37
openstackgerritDavid Moreau Simard proposed openstack-infra/zuul-jobs master: Streamline configure-mirrors and Ubuntu repository setup  https://review.openstack.org/50153519:37
openstackgerritMerged openstack-infra/project-config master: Add fetch-zuul-cloner role to base job  https://review.openstack.org/50184319:38
*** jkilpatr has joined #openstack-infra19:38
*** Goneri has joined #openstack-infra19:40
*** olaph1 has joined #openstack-infra19:40
*** chlong__ has joined #openstack-infra19:41
*** olaph has quit IRC19:42
*** chlong_ has quit IRC19:43
*** thorst has joined #openstack-infra19:43
*** stevebaker has quit IRC19:44
*** dmellado has quit IRC19:45
*** dmellado_ is now known as dmellado19:45
openstackgerritMerged openstack-infra/project-config master: Disable facts on logs.o.o  https://review.openstack.org/49985519:45
*** derekh has quit IRC19:45
openstackgerritJames E. Blair proposed openstack-infra/devstack-gate master: Zuul v3: create stack and tempest users  https://review.openstack.org/49695919:47
openstackgerritJames E. Blair proposed openstack-infra/devstack-gate master: Zuul v3: run devstack  https://review.openstack.org/50020219:47
openstackgerritJames E. Blair proposed openstack-infra/devstack-gate master: Zuul v3: Add devstack_local_conf ansible module  https://review.openstack.org/49630119:47
pabelangerclarkb: Shrews: mordred: jeblair: https://review.openstack.org/501838/ and https://review.openstack.org/501839 is a way we can support both master / feature/zuulv3 versions of nodepool-builder.  However, only 1 branch should be online at given time, since both use same zookeeper server19:47
openstackgerritMonty Taylor proposed openstack-infra/zuul feature/zuulv3: Be more permissive in configuring nodes  https://review.openstack.org/50185319:47
*** thorst has quit IRC19:47
*** Apoorva has quit IRC19:48
*** derekh has joined #openstack-infra19:48
pabelangerhttps://review.openstack.org/501835/ could also use a review, needed to finish up afs-docs for unified docs projects19:49
*** armax has joined #openstack-infra19:50
*** ijw has joined #openstack-infra19:51
openstackgerritMonty Taylor proposed openstack-infra/zuul feature/zuulv3: Add change_url to zuul dict passed into inventory  https://review.openstack.org/50149219:54
*** srobert_ has joined #openstack-infra19:54
*** bobh has joined #openstack-infra19:56
*** srobert has quit IRC19:58
*** srobert_ has quit IRC19:58
*** bobh has quit IRC20:01
pabelangermordred: okay, +3 on wheel builders stack20:02
*** iyamahat has quit IRC20:03
*** iyamahat has joined #openstack-infra20:03
jeblair/opt/stack/devstack/lib/neutron:556:install_mutnauq20:04
jeblairwow that takes me back :)20:04
purp=]20:05
openstackgerritJames E. Blair proposed openstack-infra/devstack-gate master: Zuul v3: run devstack  https://review.openstack.org/50020220:05
mordredjeblair: this process has been nothing if not fascinating from a historical cruft perspective20:06
jeblairmordred, purp: we should set up a museum of openstack at the next summit20:06
purpjeblair: +1, as long as you promise not to put me *in* it.20:07
jeblairthough something tells me that may not be a hit with the marketing group20:07
purp#afterstack20:07
mordred:)20:08
openstackgerritMerged openstack-infra/project-config master: Add wheel mirror jobs  https://review.openstack.org/49984320:10
mordredpabelanger: your https://review.openstack.org/#/c/501835/1 - the content seems to be the same as prepare-infra-docs ... is that just to get it in place?20:10
*** jamesmcarthur has joined #openstack-infra20:11
mordredpabelanger: (making sure I grok the plan20:11
openstackgerritMerged openstack-infra/project-config master: Ansiblify the wheel build a little more  https://review.openstack.org/49985720:11
pabelangermordred: ya, that is copypasta from prepare-infra-docs, but extra rename shell bits. Did I miss something?20:11
openstackgerritMerged openstack-infra/project-config master: Treat wheel builders more like build nodes  https://review.openstack.org/50021720:12
clarkbthere are used instances in ovh once again20:12
mordredpabelanger: one sec ...20:12
pabelangermordred: Oh, wait. some tagging stuff we deleted20:12
pabelangerI think that is missing20:12
pabelangerclarkb: Yay20:12
mordredpabelanger: but - unified-doc is completely different code20:12
pabelangermordred: if I understand, it still used run-docs.sh, but does additionally moving of directories20:13
mordredpabelanger: no - that's the thing- it doesn't use run-docs.sh20:13
pabelangerhmm20:13
clarkbdeleting old mirrors now20:13
mordredpabelanger: '{name}-docs-unified-{node}' in jenkins/jobs/openstack-publish-jobs.yaml20:14
pabelangermordred: http://git.openstack.org/cgit/openstack-infra/project-config/tree/jenkins/jobs/openstack-publish-jobs.yaml#n22 right?20:14
pabelangermordred: line 32, is the docs macro, which expands to run-docs.sh20:14
mordredpabelanger: yah - oh - ok, so it DOES use run-docs and then it additinally does that extra stuff20:14
pabelangerya20:15
openstackgerritMerged openstack-infra/project-config master: Add some Infra puppet module repos to Zuul v3  https://review.openstack.org/50062620:15
pabelangermordred: ya, I think post PTG, we can likely optimize that better with new roles20:15
mordredpabelanger: very much20:15
*** thorst has joined #openstack-infra20:16
mordredpabelanger: so - don't kill me ... and also feel free to ignore me20:16
pabelangermordred: but I _think_ I need to add back some tag logic20:16
mordredI don't think so -nobody uses that tags-only flag anymore20:16
pabelangerOh20:16
mordredthere are literally only three projects that do20:16
pabelangernice20:16
mordredyah20:16
pabelangerkk20:16
mordredpabelanger: SO - I think, tbh - we don't need to roles at all - the one we have now as prepare-infra-docs-for-afs or whatever we just renamed it to20:17
mordredpabelanger: is the same content as what you just addedin that new role, right?20:17
mordredpabelanger: what we need is an additional role that does the docs-unifed post processing20:17
mordredpabelanger: BUT20:17
mordredpabelanger: honestly - let's just move with thenew role you have that's a copy of the other role20:18
mordredpabelanger: and like you said, we cna collapse that / optimize it post ptg20:18
pabelangerwfm!20:18
mordredpabelanger: along with "shift infra projects to use docs-unified too"20:18
*** srobert has joined #openstack-infra20:18
*** thorst_ has joined #openstack-infra20:18
pabelangerYup, I don't think it will be too much work20:18
mordrednope20:19
*** srobert has quit IRC20:19
clarkbok old ovh mirrors are cleaned up. I think we are done with that task \o/20:19
*** srobert has joined #openstack-infra20:19
mordredpabelanger: you gonna do the followup to add the docs-unified post processing step? or want me to (i've gotit open right now so copy-pasta is easy)20:20
*** thorst has quit IRC20:20
mordredpabelanger: NEVERMIND20:21
mordredpabelanger: I'm caught up to where you are now :)20:21
pabelanger:)20:22
openstackgerritDavid Moreau Simard proposed openstack-infra/zuul-jobs master: Add support for centos in configure-mirrors  https://review.openstack.org/50153620:22
openstackgerritDavid Moreau Simard proposed openstack-infra/zuul-jobs master: Add support for debian in configure-mirrors  https://review.openstack.org/50153720:22
openstackgerritDavid Moreau Simard proposed openstack-infra/zuul-jobs master: Add support for fedora in configure-mirrors  https://review.openstack.org/50153820:22
openstackgerritDavid Moreau Simard proposed openstack-infra/zuul-jobs master: Add support for opensuse in configure-mirrors  https://review.openstack.org/50153920:22
openstackgerritDavid Moreau Simard proposed openstack-infra/zuul-jobs master: Remove project pipeline definition from zuul-jobs  https://review.openstack.org/50184920:22
*** thorst_ has quit IRC20:23
*** kgiusti has quit IRC20:23
*** thorst has joined #openstack-infra20:24
mordredpabelanger: changes look great20:24
pabelangercool20:25
dmsimardpabelanger: fyi rdo cloud is down right now20:27
openstackgerritMerged openstack-infra/zuul feature/zuulv3: Stop output start and end times for each task  https://review.openstack.org/50016320:28
dmsimardpabelanger: doesn't affect trunk or testing repos20:28
dmsimardpabelanger: but it might affect something, I dunno. maybe if rdoinfo/dlrn clone things from review.rdoproject.org20:28
*** jamesmcarthur has quit IRC20:28
openstackgerritMonty Taylor proposed openstack-infra/project-config master: Add tag-release job  https://review.openstack.org/49863420:29
mordredclarkb, pabelanger: if you get a sec, ^^ that one has been sitting around for about a week, just needed to rebase it :)20:29
pabelangerdmsimard: k, if we cached the thing on our mirror, I believe we are okay. If missing, guess we'll just 40420:30
clarkbhttp://grafana.openstack.org/dashboard/db/nodepool-ovh it lives again20:30
openstackgerritJames E. Blair proposed openstack-infra/devstack-gate master: Zuul v3: run devstack  https://review.openstack.org/50020220:31
openstackgerritMerged openstack-infra/zuul feature/zuulv3: Handle debug messages cleanly  https://review.openstack.org/50149020:31
*** Apoorva has joined #openstack-infra20:31
clarkbmordred: remind me, the localhost zuul executor bubble is not included in 'all' right?20:31
pabelanger+220:31
* fungi has internet for a few minutes, catching up20:31
jeblairclarkb: huzzah!20:31
jeblairclarkb: correct, localhost is not in all; but can be specified explicitly with 'localhost'.20:31
clarkbmordred: or is it?20:31
fungiclarkb: thanks for catching that we had upgraded all the mirrors while ovh was offline!20:31
clarkbjeblair: thanks!20:31
fungiclarkb: are you going to reply to j-d? i only have a few minutes before i have to bug out again20:33
clarkbfungi: I can20:33
fungii held off replying until we knew we were successfully running there again20:33
fungithanks a bunch!20:33
clarkbya let me just double check things in a bit then will respond20:33
openstackgerritKendall Nelson proposed openstack-infra/puppet-ptgbot master: Add City Guide  https://review.openstack.org/50186720:33
* fungi disappears back into the aether20:34
openstackgerritMonty Taylor proposed openstack-infra/zuul-jobs master: Add a role to emit an informative header for logs  https://review.openstack.org/50149520:34
clarkbmordred: pabelanger re https://review.openstack.org/#/c/498634/7/playbooks/release/tag.yaml where is ~/scripts coming from?20:34
*** bobh has joined #openstack-infra20:34
clarkbis that where legacy-copy-project-config-scripts puts them?20:35
*** jamesmcarthur has joined #openstack-infra20:35
openstackgerritMerged openstack-infra/zuul-jobs master: Add integration test jobs for the configure-mirror role  https://review.openstack.org/50153420:35
mordredclarkb: yup20:35
mordredclarkb: legacy-copy-project-config-scripts just puts the scripts dir in the home directory20:35
openstackgerritMerged openstack-infra/zuul-jobs master: Streamline configure-mirrors and Ubuntu repository setup  https://review.openstack.org/50153520:36
jeblairShrews: thanks, i cleaned up my held node20:36
mordredclarkb: http://git.openstack.org/cgit/openstack-infra/project-config/tree/roles/legacy-copy-project-config-scripts/tasks/main.yaml20:36
clarkbmordred: thanks20:36
*** caphrim007 has joined #openstack-infra20:36
pabelangermordred: clarkb: I personally like ~/.local/bin but ~/scripts wfm :)20:36
mordredclarkb: that way we get up-to-date versions of them rather than needing to wait for image rebuilds - but also don't have to rewrite all the things in scripts this instant :)20:36
clarkbya20:37
mordredpabelanger: well - in this case the scripts are things we intend to make DIAF20:37
pabelanger++20:37
mordredso putting them somewhere less pleasant is a feature ;)20:37
mordredpabelanger: https://review.openstack.org/#/c/501495 if you have a sec20:39
*** jamesmcarthur has quit IRC20:40
*** armax has quit IRC20:40
*** caphrim0_ has joined #openstack-infra20:40
*** armax has joined #openstack-infra20:40
*** armax has quit IRC20:40
*** caphrim0_ has quit IRC20:41
*** trown is now known as trown|outtypewww20:41
*** chlong__ has quit IRC20:42
*** caphrim007 has quit IRC20:44
*** caphrim007 has joined #openstack-infra20:44
*** ijw has quit IRC20:45
*** caphrim007 has quit IRC20:45
*** caphrim007 has joined #openstack-infra20:46
*** pcrews has quit IRC20:46
*** Goneri has quit IRC20:47
*** iyamahat has quit IRC20:47
*** iyamahat_ has joined #openstack-infra20:47
*** hamzy has quit IRC20:48
pabelangermordred: +2. feel free to +3 when ready20:50
*** pcrews has joined #openstack-infra20:50
mordredpabelanger: cool - thanks - need to wait on a zuul restart after a patch lands20:52
*** armax has joined #openstack-infra20:52
pabelanger++20:53
*** dave-mccowan has quit IRC20:55
openstackgerritMerged openstack-infra/project-config master: Add tag-release job  https://review.openstack.org/49863420:57
*** caphrim007 has quit IRC20:58
pabelangermordred: jeblair: Shrews: clarkb: the stack at https://review.openstack.org/501838/ needs some reviews please, how we can bring nodepool feature/zuulv3 builders online20:58
*** caphrim007 has joined #openstack-infra20:59
*** scottda_ has joined #openstack-infra20:59
*** caphrim0_ has joined #openstack-infra21:00
*** thorst has quit IRC21:01
*** jascott1 has quit IRC21:01
*** caphrim0_ has quit IRC21:01
*** jascott1 has joined #openstack-infra21:01
*** thorst has joined #openstack-infra21:01
*** caphrim0_ has joined #openstack-infra21:02
*** jascott1 has quit IRC21:02
*** caphrim0_ has joined #openstack-infra21:02
*** skelso has joined #openstack-infra21:03
*** caphrim007 has quit IRC21:03
*** jascott1 has joined #openstack-infra21:04
openstackgerritMerged openstack-infra/zuul-jobs master: Split the log_path creation into its own role  https://review.openstack.org/50149421:04
*** mwarad has joined #openstack-infra21:05
*** caphrim0_ has quit IRC21:05
*** thorst has quit IRC21:05
*** jascott1 has quit IRC21:06
*** caphrim007 has joined #openstack-infra21:06
*** alee has quit IRC21:06
*** ijw has joined #openstack-infra21:06
*** jascott1 has joined #openstack-infra21:07
*** caphrim007 has quit IRC21:07
*** caphrim007 has joined #openstack-infra21:08
*** devananda has joined #openstack-infra21:08
*** devananda has quit IRC21:08
*** caphrim007 has quit IRC21:09
*** jascott1 has quit IRC21:09
*** devananda has joined #openstack-infra21:09
*** caphrim007 has joined #openstack-infra21:09
*** mwarad has quit IRC21:09
*** devananda has quit IRC21:10
*** caphrim007 has quit IRC21:10
*** caphrim007 has joined #openstack-infra21:10
*** devananda has joined #openstack-infra21:10
*** mat128 has quit IRC21:11
*** rhallisey has quit IRC21:12
*** devananda has quit IRC21:14
*** sekelso has joined #openstack-infra21:14
*** devananda has joined #openstack-infra21:14
*** devananda has quit IRC21:15
*** tosky has joined #openstack-infra21:18
*** skelso has quit IRC21:18
*** skelso has joined #openstack-infra21:19
*** sekelso has quit IRC21:19
*** srobert has quit IRC21:21
*** dprince has quit IRC21:21
openstackgerritMerged openstack-infra/system-config master: Update regex for nb03.o.o / nb04.o.o  https://review.openstack.org/50183821:22
*** armax has quit IRC21:22
openstackgerritMerged openstack-infra/zuul feature/zuulv3: Add change_url to zuul dict passed into inventory  https://review.openstack.org/50149221:23
*** baoli has quit IRC21:25
*** armax has joined #openstack-infra21:25
*** slaweq has quit IRC21:27
*** annegentle has quit IRC21:27
*** slaweq has joined #openstack-infra21:27
openstackgerritJames E. Blair proposed openstack-infra/devstack-gate master: Zuul v3: run devstack  https://review.openstack.org/50020221:27
*** slaweq has quit IRC21:32
*** bobh has quit IRC21:33
openstackgerritMajor Hayden proposed openstack-infra/project-config master: Remove ansible-hardening Trusty gate  https://review.openstack.org/50188021:34
openstackgerritMatt Riedemann proposed openstack-infra/project-config master: Move gate-osc-placement-dsvm-functional-ubuntu-xenial to check  https://review.openstack.org/50188421:40
*** slaweq has joined #openstack-infra21:41
clarkbpabelanger: fyi I jsut rechecked the puppet change for nb01 and nb0221:41
clarkbhit the config drive infra root ssh keys aren't valid on disk problem21:42
clarkbshould try to finally hunt that down21:42
*** slaweq has quit IRC21:43
*** slaweq has joined #openstack-infra21:44
*** slaweq has quit IRC21:44
*** aeng has joined #openstack-infra21:46
*** slaweq has joined #openstack-infra21:46
*** felipemonteiro_ has quit IRC21:46
*** emmaloui has joined #openstack-infra21:47
*** bexelbie has joined #openstack-infra21:48
*** bexelbie has left #openstack-infra21:49
openstackgerritMajor Hayden proposed openstack-infra/project-config master: Disable ansible-hardening trusty gate in queens  https://review.openstack.org/50188021:51
*** ijw has quit IRC21:51
*** armax has quit IRC21:53
*** armax has joined #openstack-infra21:54
*** esberglu has quit IRC21:55
openstackgerritMonty Taylor proposed openstack-infra/project-config master: Add mapping file containing v2 to v3 mappings  https://review.openstack.org/49180421:55
openstackgerritMonty Taylor proposed openstack-infra/project-config master: Add all the rest of the pipelines  https://review.openstack.org/50188621:55
openstackgerritClark Boylan proposed openstack-infra/system-config master: Debug ssh key failures in puppet runs  https://review.openstack.org/50188721:56
clarkbpabelanger: ^ something like that should help us debug21:56
*** slaweq has quit IRC21:56
*** derekh has quit IRC21:57
openstackgerritMerged openstack-infra/system-config master: Add nb01.o.o / nb02.o.o as feature/zuulv3  https://review.openstack.org/50183921:59
*** armax has quit IRC21:59
jlvillalHello wonderful infra developers :) Our Ironic jobs are failing a lot due to slow nodes. Any chance we could get some reviews on: https://review.openstack.org/#/c/501315/  to increase the job timeout?22:01
openstackgerritMonty Taylor proposed openstack-infra/project-config master: Fix name of ansible-puppet  https://review.openstack.org/50188922:03
*** jaypipes has quit IRC22:05
*** priteau has quit IRC22:07
TheJuliajlvillal: Thanks for bringing that up. It would be nice if it landed since it would save resources22:09
openstackgerritGerman Eichberger proposed openstack-infra/project-config master: [WIP] Generate Octavia Amphora image artefact  https://review.openstack.org/50189022:11
*** thegreenhundred has quit IRC22:11
*** derekh has joined #openstack-infra22:17
clarkbjlvillal: TheJulia I've gone ahead and approved. Looking at http://logs.openstack.org/04/480904/9/check/gate-tempest-dsvm-ironic-ipa-wholedisk-bios-agent_ipmitool-tinyipa-ubuntu-xenial/7a790dd/logs/devstacklog.txt.gz from your example job there is a lot of unaccounted time. Might be worthwhile looking at your devstack logs to see where all that extra time is spent22:18
clarkbjlvillal: TheJulia is ironic using a devstack plugin? I wonder if that is slow?22:18
jlvillalclarkb: ironic does have its own devstack plugin, if that is what you mean.22:18
clarkbya22:18
jlvillalclarkb: And thanks! :)22:19
clarkbthough now I notice that job log doesn't have osc time logged (which is a big time sink)22:19
clarkbneed client that is fast22:19
jlvillalclarkb: What does that mean? "doesn't have osc time logged". Is that something we can turn on?22:20
clarkbjlvillal: devstack has some simple intrumentation code to keep track of how long apt-get and pip install etc take. There is also an osc version of that to track how much time we spend in openstackclient. You shouldn't have to enable it it should just be there. THough I notice that job run is about a month old so maybe it was before the timing data stuff merged?22:21
jlvillalclarkb: I think I understand. The very bottom with the 'DevStack Component Timing" section22:22
clarkbya that22:22
clarkbI don't think it ever gets close to adding up to the total time but gives reasonable idea of where time is going22:22
jlvillalclarkb: Here is a more recent run: http://logs.openstack.org/19/501419/2/check/gate-tempest-dsvm-ironic-lib-partition-pxe_ipmitool-ubuntu-xenial/88f9e7c/logs/devstacklog.txt.gz22:23
clarkbok ya osc is in that one22:24
jlvillalYep22:24
openstackgerritMerged openstack-infra/project-config master: Fix name of ansible-puppet  https://review.openstack.org/50188922:24
openstackgerritMonty Taylor proposed openstack-infra/project-config master: Add all the rest of the pipelines  https://review.openstack.org/50188622:25
clarkbjlvillal: that particular cloud region was just turned back on again so pip and apt etc caches may be cold22:25
clarkbI'd expect that ovh jobs will get quicker as that populates22:25
jlvillalThey ought to put in a: "Unknown  1319" or something in the timing field22:25
jlvillalclarkb: Cool, I like faster jobs :)22:26
mordredclarkb, ianw, pabelanger, jeblair: https://review.openstack.org/501886 adds all rest of the pipeline definitions to v3 that we have in v222:26
*** armax has joined #openstack-infra22:28
*** jamesmcarthur has joined #openstack-infra22:28
openstackgerritMerged openstack-infra/project-config master: Extend ironic timeouts  https://review.openstack.org/50131522:28
*** jamesmcarthur has quit IRC22:29
*** jamesmcarthur has joined #openstack-infra22:29
openstackgerritMonty Taylor proposed openstack-infra/project-config master: Add all the rest of the pipelines  https://review.openstack.org/50188622:29
mordredit helps when you spell pipeline right22:29
mikalDoes mirantis still run stackalytics? Or is it infra now?22:29
mordredmikal: still mirantis22:30
clarkbmikal: we have an instance at stackalytics.openstack.org but mirantis still controls the stackalytics.com or was it .org domain/host/service22:30
clarkbmordred: zuul still says you need to fix syntax22:30
clarkbI think your require: has to be scoped to gerrit22:31
openstackgerritMonty Taylor proposed openstack-infra/project-config master: Add all the rest of the pipelines  https://review.openstack.org/50188622:32
mordredclarkb: yup. you are correct22:32
mikalAhh, ta22:32
mordredclarkb: btw - have I mentioned how much I like that zuul auto-syntax-checks thatfor us?22:32
mikalThe .com is like three days behind22:32
clarkbmordred: ya those errors messages are nice22:32
*** annegentle has joined #openstack-infra22:32
mikalHuh, the openstack.org one says its data is incomplete?22:33
mordredyah. that one is a red-headed step child22:33
openstackgerritGerman Eichberger proposed openstack-infra/project-config master: [WIP] Generate Octavia Amphora image artefact  https://review.openstack.org/50189022:33
*** wolverineav has quit IRC22:34
*** tosky has quit IRC22:34
*** wolverineav has joined #openstack-infra22:35
openstackgerritMonty Taylor proposed openstack-infra/project-config master: Add all the rest of the pipelines  https://review.openstack.org/50188622:35
openstackgerritMonty Taylor proposed openstack-infra/project-config master: Add all the rest of the pipelines  https://review.openstack.org/50188622:37
*** wolverineav has quit IRC22:39
*** annegentle has quit IRC22:40
*** priteau has joined #openstack-infra22:43
*** priteau has quit IRC22:43
*** priteau has joined #openstack-infra22:44
*** ijw has joined #openstack-infra22:44
*** chlong has joined #openstack-infra22:44
mordredclarkb: woot. I seem to have passed the syntax stage: https://review.openstack.org/#/c/501886/22:46
mordredpabelanger: ^^22:46
*** rkukura_ has joined #openstack-infra22:47
*** priteau has quit IRC22:48
*** xarses_ has quit IRC22:48
*** marst has quit IRC22:49
pabelanger+222:49
*** rkukura has quit IRC22:50
*** rkukura_ is now known as rkukura22:50
*** chlong has quit IRC22:51
clarkbmordred: I've +2'd as well but not approved because I'm not sure how early you want that in place (it will theoretically send emails to people and stuff, not sure if ready for that)22:51
*** alee has joined #openstack-infra22:51
*** chlong has joined #openstack-infra22:52
*** iyamahat_ has quit IRC22:53
*** iyamahat has joined #openstack-infra22:53
*** rbrndt has quit IRC22:53
*** rbrndt has joined #openstack-infra22:53
*** rbrndt has quit IRC22:53
*** hasharAway has quit IRC22:54
*** thorst has joined #openstack-infra22:54
mordredclarkb: yah - it'sa good question ... at this point I'm not sure there's much downside to sending the emails, yeah?22:55
*** rossella_s has quit IRC22:56
*** rossella_s has joined #openstack-infra22:56
*** thorst has quit IRC22:59
*** caphrim007 has quit IRC22:59
clarkbprobably not22:59
clarkbworst case we apologize to smcginnis22:59
*** Apoorva_ has joined #openstack-infra22:59
pabelangerclarkb: do you mind reviewing https://review.openstack.org/501363/ and depends-on?  Would like to add that back for shade for testing22:59
*** claudiub has quit IRC23:00
mordredsmcginnis: I may need to apologize to you23:01
*** ijw has quit IRC23:01
*** rossella_s has quit IRC23:01
*** Apoorva has quit IRC23:02
*** chlong_ has joined #openstack-infra23:04
*** chlong has quit IRC23:04
*** armax has quit IRC23:05
*** rossella_s has joined #openstack-infra23:05
clarkbpabelanger: see comment on the depends on23:06
*** xyang1 has quit IRC23:06
openstackgerritMerged openstack-infra/zuul-jobs master: Add support for centos in configure-mirrors  https://review.openstack.org/50153623:07
*** chlong_ has quit IRC23:09
*** gouthamr has quit IRC23:09
openstackgerritMerged openstack-infra/project-config master: Add all the rest of the pipelines  https://review.openstack.org/50188623:10
*** caphrim007 has joined #openstack-infra23:15
*** caphrim007 has quit IRC23:16
*** caphrim007 has joined #openstack-infra23:16
smcginnismordred: Oh really?23:19
* smcginnis rubs his hands together in anticipation...23:19
*** rossella_s has quit IRC23:19
*** rossella_s has joined #openstack-infra23:20
smcginnismordred, clarkb: Not sure I'm following the scrollback. Or I scanned too quickly. What's the apology for?23:20
*** hichihara has joined #openstack-infra23:20
mordredsmcginnis: maybe nothing!23:21
mordredsmcginnis: but I merged zuulv3 patches added release pipelines and also uncommented the email reporters23:22
mordredsmcginnis: so it's POSSIBLE you might start getting spam from zuulv323:22
openstackgerritGerman Eichberger proposed openstack-infra/project-config master: [WIP] Generate Octavia Amphora image artefact  https://review.openstack.org/50189023:22
smcginnisAh, OK. No worries, we'll work though it.23:22
mordred\o/23:23
*** hongbin has quit IRC23:24
*** skelso has quit IRC23:30
*** Apoorva has joined #openstack-infra23:32
*** Apoorva_ has quit IRC23:32
*** xarses_ has joined #openstack-infra23:40
*** caphrim007 has quit IRC23:48
*** stakeda has joined #openstack-infra23:49
*** srobert has joined #openstack-infra23:49
*** srobert has quit IRC23:49
*** srobert has joined #openstack-infra23:50
*** dingyichen has joined #openstack-infra23:57
*** sflanigan has joined #openstack-infra23:57
*** sflanigan has joined #openstack-infra23:57
*** slaweq has joined #openstack-infra23:58
*** gouthamr has joined #openstack-infra23:59

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!