Wednesday, 2018-06-13

*** rlandy|rover is now known as rlandy|rover|bbl00:00
ianwfungi: do you just make up your own MIB to do snmp?00:04
*** pahuang has quit IRC00:05
*** SumitNaiksatam has quit IRC00:05
*** heyongli has quit IRC00:06
*** yamamoto has joined #openstack-infra00:06
*** heyongli has joined #openstack-infra00:06
*** felipemonteiro has quit IRC00:07
*** mriedem has quit IRC00:07
*** Swami has quit IRC00:09
*** masber has joined #openstack-infra00:10
*** aspiers[m] has joined #openstack-infra00:10
*** dhellmann[m] has joined #openstack-infra00:10
*** lbragstad[m] has joined #openstack-infra00:10
*** smcginnis[m] has joined #openstack-infra00:10
*** yamamoto has quit IRC00:10
openstackgerritMerged openstack-infra/system-config master: Ensure yum-cron is running  https://review.openstack.org/57448600:13
mtreinishclarkb: while I like it that way, it causes me issues with state inspections, because mechanics often write down the km as miles and if someone is sharp enough to catch it and switch the odometer back to miles it looks like tampering with the odometer00:13
*** masuberu has quit IRC00:13
mtreinishand the bolts on my mustang are a weird mix of metric and imperial too. I don't understand why00:15
*** heyongli has quit IRC00:16
*** heyongli has joined #openstack-infra00:16
fungiianw: there's a range of oids set aside for local/unofficial use00:17
fungiianw: generally you just define the oid(s) in the snmpd.conf along with the callout executable paths they should run00:18
fungiand then you configure your monitoring system to query those oids00:18
fungino need to define a mib for all of that unless you want to make it portable to other monitoring systems, generally00:18
fungiif i recall, the net-snmp docs have some examples, though it's been years since i did any of that00:19
fungiianw: the main reason i questioned the mirror-update server as a place to do that stat collection is in case we end up switching mirror updates to become zuul jobs in the future and stop having a persistent server for that00:22
*** pahuang has joined #openstack-infra00:22
fungibut it's pie-in-the-sky enough that i wouldn't block on that00:22
ianwfungi: we can move it to the fileservers, just have to install the client tools.  or indeed just run the stats gathering as a periodic job too00:23
openstackgerritIan Wienand proposed openstack-infra/openstack-zuul-jobs master: package-afs-centos: fix final copy  https://review.openstack.org/57492400:23
ianw^ anyone hold enough of the rsync eccentricities in their head to evaluate if that will do what i think it does?00:24
*** masuberu has joined #openstack-infra00:26
*** heyongli has quit IRC00:26
*** heyongli has joined #openstack-infra00:26
*** masber has quit IRC00:29
*** zhangfei has joined #openstack-infra00:31
*** gyee has quit IRC00:34
ianwpabelanger: i guess our wheel build jobs just got lucky enough that they didn't actually hit https://www.openafs.org/dl/openafs/1.6.22.3/RELNOTES-1.6.22.3 ?00:34
*** iyamahat has joined #openstack-infra00:34
*** heyongli has quit IRC00:36
fungiianw: yes, 574924 should do what you want00:37
*** heyongli has joined #openstack-infra00:37
fungii had to re-figure out rsync's trailing slashes behavior over the weekend, so reasonably fresh on the mind00:37
openstackgerritMerged openstack-infra/system-config master: mirror-update: install afsmon and run from cron  https://review.openstack.org/57349300:38
*** agopi has quit IRC00:38
*** agopi has joined #openstack-infra00:39
*** heyongli has quit IRC00:47
*** heyongli has joined #openstack-infra00:47
*** heyongli has quit IRC00:57
*** heyongli has joined #openstack-infra00:57
*** sandk has quit IRC01:01
*** heyongli has quit IRC01:07
*** heyongli has joined #openstack-infra01:07
*** heyongli has quit IRC01:17
*** felipemonteiro has joined #openstack-infra01:17
*** dingyichen has joined #openstack-infra01:18
*** heyongli has joined #openstack-infra01:18
*** pahuang has quit IRC01:21
*** hongbin has joined #openstack-infra01:23
*** yamahata has quit IRC01:25
*** agopi has quit IRC01:26
*** heyongli has quit IRC01:28
*** heyongli has joined #openstack-infra01:28
*** felipemonteiro has quit IRC01:30
*** iyamahat has quit IRC01:30
*** pahuang has joined #openstack-infra01:34
openstackgerritIan Wienand proposed openstack-infra/system-config master: afsmon: command is "statsd" not "stats"  https://review.openstack.org/57493201:34
*** heyongli has quit IRC01:38
*** heyongli has joined #openstack-infra01:38
*** SumitNaiksatam has joined #openstack-infra01:41
*** kiennt26 has joined #openstack-infra01:47
*** heyongli has quit IRC01:48
*** heyongli has joined #openstack-infra01:48
openstackgerritIan Wienand proposed openstack-infra/project-config master: Build wheels against constraints  https://review.openstack.org/57493801:49
ianwpabelanger / dhellmann : ^ not super confident that's the right thing to do, but there is an issue i think.  comments welcome :)01:49
ianw#status log yum-cron is now active on all git* hosts.  some may have not had package updates for a while, so look at that first in case of issues01:57
openstackstatusianw: finished logging01:57
*** heyongli has quit IRC01:58
*** heyongli has joined #openstack-infra01:59
*** rfolco_doctor is now known as rfolco02:00
ianwi wonder what spikes the git http connections every 10 minutes : http://grafana02.openstack.org/d/MYvSHcSiz/git-load-balancer?panelId=21&fullscreen&orgId=102:00
*** larainema has joined #openstack-infra02:08
*** heyongli has quit IRC02:09
*** heyongli has joined #openstack-infra02:09
*** roman_g has quit IRC02:14
*** heyongli has quit IRC02:19
*** heyongli has joined #openstack-infra02:19
*** agopi has joined #openstack-infra02:23
*** myoung|bbl is now known as myoung02:28
*** heyongli has quit IRC02:29
*** dhill_ has quit IRC02:29
*** heyongli has joined #openstack-infra02:29
*** kiennt26 has quit IRC02:31
*** heyongli has quit IRC02:39
*** heyongli has joined #openstack-infra02:40
*** annp has joined #openstack-infra02:40
*** bobh has joined #openstack-infra02:43
*** dtruong has quit IRC02:45
*** dtruong has joined #openstack-infra02:47
*** bobh has quit IRC02:49
*** heyongli has quit IRC02:50
*** heyongli has joined #openstack-infra02:50
*** vivsoni has joined #openstack-infra02:53
*** psachin has joined #openstack-infra02:57
*** eernst has joined #openstack-infra02:57
*** dave-mccowan has quit IRC02:57
*** rlandy|rover|bbl is now known as rlandy|rover02:59
*** rlandy|rover has quit IRC02:59
*** heyongli has quit IRC03:00
*** heyongli has joined #openstack-infra03:00
*** hemna_ has joined #openstack-infra03:05
*** heyongli has quit IRC03:10
*** heyongli has joined #openstack-infra03:10
*** heyongli has quit IRC03:20
*** heyongli has joined #openstack-infra03:21
*** SumitNaiksatam_ has joined #openstack-infra03:22
*** SumitNaiksatam has quit IRC03:25
*** SumitNaiksatam_ is now known as SumitNaiksatam03:25
*** hemna_ has quit IRC03:26
*** boris_42_ has quit IRC03:29
*** heyongli has quit IRC03:31
*** heyongli has joined #openstack-infra03:31
*** rajinir has joined #openstack-infra03:31
*** bhavik1 has joined #openstack-infra03:34
*** ramishra has joined #openstack-infra03:36
*** agopi has quit IRC03:36
*** heyongli has quit IRC03:41
*** heyongli has joined #openstack-infra03:41
*** agopi has joined #openstack-infra03:43
*** udesale has joined #openstack-infra03:45
*** ramishra has quit IRC03:45
*** zhangfei has quit IRC03:50
*** agopi has quit IRC03:51
*** heyongli has quit IRC03:51
*** aeng_ has joined #openstack-infra03:51
*** agopi has joined #openstack-infra03:51
*** heyongli has joined #openstack-infra03:51
*** germs has quit IRC04:00
*** germs has joined #openstack-infra04:00
*** germs has quit IRC04:00
*** germs has joined #openstack-infra04:00
*** agopi has quit IRC04:00
*** wacuuu has joined #openstack-infra04:01
*** heyongli has quit IRC04:01
*** zhangfei has joined #openstack-infra04:01
*** heyongli has joined #openstack-infra04:02
*** germs has quit IRC04:04
*** Bhujay has joined #openstack-infra04:04
*** auristor has quit IRC04:07
*** heyongli has quit IRC04:12
*** heyongli has joined #openstack-infra04:12
*** dmsimard has quit IRC04:13
*** hongbin has quit IRC04:13
*** wacuuu has quit IRC04:16
*** auristor has joined #openstack-infra04:16
*** wacuuu has joined #openstack-infra04:17
*** wacuuu has quit IRC04:17
*** bhavik1 has quit IRC04:19
*** ramishra has joined #openstack-infra04:20
*** heyongli has quit IRC04:22
*** heyongli has joined #openstack-infra04:22
*** links has joined #openstack-infra04:24
openstackgerritIan Wienand proposed openstack-infra/project-config master: Build wheels against constraints  https://review.openstack.org/57493804:30
*** heyongli has quit IRC04:32
*** heyongli has joined #openstack-infra04:32
openstackgerritMerged openstack-infra/system-config master: afsmon: command is "statsd" not "stats"  https://review.openstack.org/57493204:37
*** heyongli has quit IRC04:42
*** heyongli has joined #openstack-infra04:43
*** ykarel|away has joined #openstack-infra04:43
*** pcaruana has joined #openstack-infra04:50
*** eliqiao has quit IRC04:52
*** heyongli has quit IRC04:53
*** heyongli has joined #openstack-infra04:53
openstackgerritTony Breeds proposed openstack-infra/project-config master: Skip released that are close but not fully EOLd when building wheels  https://review.openstack.org/57498104:54
tonybianw: ^^ first attempt at filtering newton from the build_wheels script04:56
*** yamamoto has joined #openstack-infra05:01
*** felipemonteiro has joined #openstack-infra05:03
*** heyongli has quit IRC05:03
*** heyongli has joined #openstack-infra05:03
*** aeng_ has quit IRC05:09
openstackgerritMerged openstack-infra/openstack-zuul-jobs master: package-afs-centos: fix final copy  https://review.openstack.org/57492405:10
*** cshastri has joined #openstack-infra05:13
*** heyongli has quit IRC05:13
*** heyongli has joined #openstack-infra05:13
openstackgerritMerged openstack-infra/project-config master: fix release-openstack-python3 so it does what we mean  https://review.openstack.org/57480305:15
*** pcaruana has quit IRC05:18
*** yamahata has joined #openstack-infra05:19
*** ykarel|away is now known as ykarel05:20
ianwfungi: well i tried to launch a mirror node for you in packethost, but no luck : http://paste.openstack.org/show/723367/ ... not sure what network to use, none seemed to work.  infra account maybe can't get a floating ip?05:20
*** iyamahat has joined #openstack-infra05:21
*** eernst has quit IRC05:22
*** janki has joined #openstack-infra05:23
*** heyongli has quit IRC05:23
*** heyongli has joined #openstack-infra05:24
*** adreznec has quit IRC05:27
*** jbadiapa has joined #openstack-infra05:27
*** vaidy has quit IRC05:31
*** isviridov_away has quit IRC05:31
*** adreznec has joined #openstack-infra05:32
*** heyongli has quit IRC05:34
*** dhajare has joined #openstack-infra05:34
*** heyongli has joined #openstack-infra05:34
*** dhajare is now known as dhajare-brb05:34
*** rajinir has quit IRC05:39
*** janki has quit IRC05:42
*** felipemonteiro has quit IRC05:43
*** heyongli has quit IRC05:44
*** vaidy has joined #openstack-infra05:44
*** hjensas has quit IRC05:44
*** heyongli has joined #openstack-infra05:44
*** isviridov_away has joined #openstack-infra05:45
*** bhavik1 has joined #openstack-infra05:45
*** janki has joined #openstack-infra05:49
*** bhavik1 has quit IRC05:49
AJaegerconfig-core, could you merge https://review.openstack.org/574810 so that we can move forward with loci-* decommission, please?05:52
*** heyongli has quit IRC05:54
*** heyongli has joined #openstack-infra05:54
*** cshastri has quit IRC05:58
openstackgerritMerged openstack-infra/project-config master: Skip released that are close but not fully EOLd when building wheels  https://review.openstack.org/57498105:59
*** heyongli has quit IRC06:04
*** heyongli has joined #openstack-infra06:05
*** pcaruana has joined #openstack-infra06:06
openstackgerritMerged openstack-infra/project-config master: Add noop-jobs to decom loci-* repos  https://review.openstack.org/57481006:09
*** Bhujay has quit IRC06:13
openstackgerritIan Wienand proposed openstack-infra/system-config master: Add packethost mirror to cacti  https://review.openstack.org/57499906:14
*** heyongli has quit IRC06:15
*** cshastri has joined #openstack-infra06:15
ianwfungi: ^ ignore previous message, figured it out.  i removed the floating ip's so shade could make some.  i think it's ready to go now06:15
*** heyongli has joined #openstack-infra06:15
*** CrayZee has joined #openstack-infra06:22
*** slaweq has joined #openstack-infra06:24
*** heyongli has quit IRC06:25
*** heyongli has joined #openstack-infra06:26
*** lifeless has quit IRC06:26
*** lifeless has joined #openstack-infra06:26
*** florianf has joined #openstack-infra06:27
*** masber has joined #openstack-infra06:35
*** heyongli has quit IRC06:35
*** heyongli has joined #openstack-infra06:36
*** masuberu has quit IRC06:38
*** tosky has joined #openstack-infra06:40
*** masuberu has joined #openstack-infra06:41
*** heyongli has quit IRC06:45
*** masber has quit IRC06:45
*** heyongli has joined #openstack-infra06:46
*** lifeless_ has joined #openstack-infra06:48
*** lifeless has quit IRC06:48
*** cshastri has quit IRC06:49
*** jpena|off is now known as jpena06:51
*** masuberu has quit IRC06:54
*** masuberu has joined #openstack-infra06:54
*** masuberu has quit IRC06:55
*** masuberu has joined #openstack-infra06:55
*** heyongli has quit IRC06:56
*** heyongli has joined #openstack-infra06:56
*** masuberu has quit IRC06:57
*** masuberu has joined #openstack-infra06:57
*** masuberu has quit IRC06:58
*** masuberu has joined #openstack-infra06:59
*** rcernin has quit IRC07:00
*** masuberu has quit IRC07:00
*** masuberu has joined #openstack-infra07:00
*** masuberu has quit IRC07:01
*** masuberu has joined #openstack-infra07:01
*** masuberu has quit IRC07:02
*** masuberu has joined #openstack-infra07:03
*** cshastri has joined #openstack-infra07:06
*** heyongli has quit IRC07:06
*** heyongli has joined #openstack-infra07:06
*** tesseract has joined #openstack-infra07:07
*** ramishra has quit IRC07:07
*** heyongli has quit IRC07:16
*** heyongli has joined #openstack-infra07:16
*** threestrands has quit IRC07:21
*** hashar has joined #openstack-infra07:21
*** heyongli has quit IRC07:26
*** heyongli has joined #openstack-infra07:27
*** uberjay has quit IRC07:28
*** uberjay has joined #openstack-infra07:28
*** slaweq has quit IRC07:28
openstackgerritJeffrey Zhang proposed openstack-infra/irc-meetings master: Move kolla weekly meeting one hour earlier  https://review.openstack.org/57501107:30
*** fresta_ has quit IRC07:31
*** ccamacho has joined #openstack-infra07:31
*** fresta has joined #openstack-infra07:31
*** amoralej|off is now known as amoralej07:36
*** heyongli has quit IRC07:37
*** heyongli has joined #openstack-infra07:37
openstackgerritTobias Henkel proposed openstack-infra/zuul master: Add test for shell after include_role  https://review.openstack.org/57448707:37
*** zoli is now known as zoli|wfh07:38
*** zoli|wfh is now known as zoli07:38
ykarelany idea why https://review.openstack.org/#/c/574735/ is not going in gate queue07:38
ykarelshould i recheck07:39
*** jpich has joined #openstack-infra07:39
AJaegerykarel: two ideas: depends-on a not merged change? Based on another change that is not approved?07:40
AJaegerFor the later: See "Related changes" to the right07:40
ykarelAJaeger, correct it's rebased over https://review.openstack.org/#/c/574502/, which is not approved07:42
ykarelAJaeger, Thanks07:42
*** CrayZee has quit IRC07:43
AJaegerykarel: you're welcome07:44
*** heyongli has quit IRC07:47
*** heyongli has joined #openstack-infra07:47
*** lifeless has joined #openstack-infra07:52
*** lifeless_ has quit IRC07:52
openstackgerritTobias Henkel proposed openstack-infra/zuul master: Improve logging of GithubTriggerEvents  https://review.openstack.org/57501407:52
*** heyongli has quit IRC07:57
*** heyongli has joined #openstack-infra07:57
*** arxcruz|brb is now known as arxcruz|ruck07:59
*** fresta has quit IRC08:00
*** jcoufal has joined #openstack-infra08:00
*** iyamahat has quit IRC08:06
*** e0ne has joined #openstack-infra08:06
*** heyongli has quit IRC08:07
*** heyongli has joined #openstack-infra08:08
*** alexchadin has joined #openstack-infra08:09
*** ramishra has joined #openstack-infra08:10
*** aojea has joined #openstack-infra08:12
*** fresta has joined #openstack-infra08:13
openstackgerritIan Wienand proposed openstack-infra/project-config master: Add packethost us-west-1 to nodepool  https://review.openstack.org/57501908:13
*** electrofelix has joined #openstack-infra08:16
*** heyongli has quit IRC08:18
*** heyongli has joined #openstack-infra08:18
*** roman_g has joined #openstack-infra08:19
*** udesale_ has joined #openstack-infra08:21
*** rossella_s has quit IRC08:21
*** sree has joined #openstack-infra08:22
*** fresta_ has joined #openstack-infra08:22
*** slaweq has joined #openstack-infra08:23
*** udesale has quit IRC08:24
*** rossella_s has joined #openstack-infra08:24
*** fresta has quit IRC08:25
*** udesale__ has joined #openstack-infra08:26
*** heyongli has quit IRC08:28
*** heyongli has joined #openstack-infra08:28
*** udesale_ has quit IRC08:29
*** shardy has joined #openstack-infra08:29
*** fresta has joined #openstack-infra08:31
*** ykarel is now known as ykarel|lunch08:31
*** rossella_s has quit IRC08:32
*** derekh has joined #openstack-infra08:33
*** fresta_ has quit IRC08:33
*** rossella_s has joined #openstack-infra08:34
*** heyongli has quit IRC08:38
*** heyongli has joined #openstack-infra08:38
*** ramishra has quit IRC08:42
*** ramishra has joined #openstack-infra08:44
*** heyongli has quit IRC08:48
*** heyongli has joined #openstack-infra08:49
*** nicolasbock has joined #openstack-infra08:57
*** dtantsur|afk is now known as dtantsur08:58
openstackgerritMerged openstack/diskimage-builder master: Fix bootloader packages for rhel  https://review.openstack.org/57372608:58
*** heyongli has quit IRC08:59
*** heyongli has joined #openstack-infra08:59
*** dingyichen has quit IRC09:04
*** sshnaidm has quit IRC09:06
*** links has quit IRC09:08
*** sree has quit IRC09:08
*** sree has joined #openstack-infra09:08
*** heyongli has quit IRC09:09
*** heyongli has joined #openstack-infra09:09
*** nicolasbock has quit IRC09:12
*** sree has quit IRC09:13
openstackgerritMerged openstack-infra/project-config master: fix vmware-nsx jobs  https://review.openstack.org/57338609:18
*** heyongli has quit IRC09:19
*** heyongli has joined #openstack-infra09:19
*** links has joined #openstack-infra09:25
openstackgerritTobias Henkel proposed openstack-infra/zuul master: Clarify usage of the zuul_success variable  https://review.openstack.org/57505009:26
*** udesale_ has joined #openstack-infra09:26
*** ykarel|lunch is now known as ykarel09:26
*** udesale__ has quit IRC09:26
*** udesale__ has joined #openstack-infra09:28
*** heyongli has quit IRC09:29
*** heyongli has joined #openstack-infra09:30
*** udesale_ has quit IRC09:31
*** lifeless_ has joined #openstack-infra09:34
*** lifeless has quit IRC09:34
*** gfidente has joined #openstack-infra09:38
*** gfidente has joined #openstack-infra09:38
*** alexchadin has quit IRC09:38
*** alexchadin has joined #openstack-infra09:38
*** alexchadin has quit IRC09:39
*** alexchadin has joined #openstack-infra09:39
*** rossella_s has quit IRC09:39
*** alexchadin has quit IRC09:40
*** heyongli has quit IRC09:40
*** heyongli has joined #openstack-infra09:40
*** alexchadin has joined #openstack-infra09:40
*** alexchadin has quit IRC09:40
*** alexchadin has joined #openstack-infra09:41
*** alexchadin has quit IRC09:41
*** dpawlik has quit IRC09:41
*** slaweq has quit IRC09:41
*** rossella_s has joined #openstack-infra09:42
*** sshnaidm has joined #openstack-infra09:42
*** pbourke has quit IRC09:43
*** pbourke has joined #openstack-infra09:43
*** lifeless has joined #openstack-infra09:44
*** lifeless_ has quit IRC09:46
*** dpawlik has joined #openstack-infra09:50
*** heyongli has quit IRC09:50
*** heyongli has joined #openstack-infra09:50
*** rossella_s has quit IRC09:59
*** rossella_s has joined #openstack-infra10:00
*** heyongli has quit IRC10:00
*** heyongli has joined #openstack-infra10:00
*** stakeda has quit IRC10:03
*** rossella_s has quit IRC10:08
*** slaweq has joined #openstack-infra10:08
*** masuberu has quit IRC10:10
*** heyongli has quit IRC10:10
*** heyongli has joined #openstack-infra10:11
*** rossella_s has joined #openstack-infra10:12
*** links has quit IRC10:12
*** Nil_ has quit IRC10:13
*** alexchadin has joined #openstack-infra10:17
*** d0ugal has quit IRC10:17
*** yamamoto_ has joined #openstack-infra10:18
*** jbadiapa has quit IRC10:19
*** rossella_s has quit IRC10:20
*** heyongli has quit IRC10:21
*** heyongli has joined #openstack-infra10:21
*** yamamoto has quit IRC10:22
*** alexchadin has quit IRC10:22
*** lifeless has quit IRC10:23
*** rossella_s has joined #openstack-infra10:24
*** lifeless has joined #openstack-infra10:24
*** jpena is now known as jpena|off10:24
*** links has joined #openstack-infra10:25
*** udesale_ has joined #openstack-infra10:26
*** udesale__ has quit IRC10:29
*** rossella_s has quit IRC10:30
*** udesale__ has joined #openstack-infra10:30
*** jbadiapa has joined #openstack-infra10:30
*** heyongli has quit IRC10:31
*** heyongli has joined #openstack-infra10:31
openstackgerritThierry Carrez proposed openstack-infra/project-config master: Remove direct tagging from swift-bench ACL  https://review.openstack.org/57507110:32
*** lifeless_ has joined #openstack-infra10:32
*** rossella_s has joined #openstack-infra10:32
*** jpena|off is now known as jpena10:32
*** lifeless has quit IRC10:32
*** udesale_ has quit IRC10:33
*** zoli is now known as zoli|lunch10:33
openstackgerritThierry Carrez proposed openstack-infra/project-config master: Remove direct tagging from heat-cfntools ACL  https://review.openstack.org/57507210:35
*** d0ugal has joined #openstack-infra10:36
*** alexchadin has joined #openstack-infra10:38
*** heyongli has quit IRC10:41
*** heyongli has joined #openstack-infra10:41
openstackgerritThierry Carrez proposed openstack-infra/project-config master: Remove direct branching rights for murano-apps  https://review.openstack.org/57507410:42
*** nicolasbock has joined #openstack-infra10:46
*** alexchadin has quit IRC10:48
*** alexchadin has joined #openstack-infra10:48
*** alexchad_ has joined #openstack-infra10:50
*** alexchad_ has quit IRC10:50
*** heyongli has quit IRC10:51
*** hjensas has joined #openstack-infra10:52
*** hjensas has quit IRC10:52
*** hjensas has joined #openstack-infra10:52
*** heyongli has joined #openstack-infra10:52
*** alexchadin has quit IRC10:53
*** sree has joined #openstack-infra10:55
openstackgerritDarragh Bailey proposed openstack-infra/git-review master: support review URLs as download arguments  https://review.openstack.org/42482310:59
*** sree has quit IRC11:00
*** heyongli has quit IRC11:02
*** heyongli has joined #openstack-infra11:02
*** florianf has quit IRC11:04
*** florianf has joined #openstack-infra11:04
*** udesale_ has joined #openstack-infra11:07
*** udesale__ has quit IRC11:10
*** heyongli has quit IRC11:12
*** heyongli has joined #openstack-infra11:12
*** florianf has quit IRC11:15
*** florianf has joined #openstack-infra11:16
*** alexchadin has joined #openstack-infra11:21
*** heyongli has quit IRC11:22
*** heyongli has joined #openstack-infra11:22
*** alexchadin has quit IRC11:27
*** ldnunes has joined #openstack-infra11:28
*** heyongli has quit IRC11:32
*** heyongli has joined #openstack-infra11:33
*** zhangfei has quit IRC11:33
*** lifeless has joined #openstack-infra11:42
*** lifeless_ has quit IRC11:42
*** sree has joined #openstack-infra11:42
*** heyongli has quit IRC11:43
*** heyongli has joined #openstack-infra11:43
*** annp has quit IRC11:45
*** jpena is now known as jpena|lunch11:45
*** zoli|lunch is now known as zoli|wfh11:47
*** rlandy has joined #openstack-infra11:49
*** rlandy is now known as rlandy|rover11:50
flaper87would it be possible to lock the node used to run tripleo-ci-centos-7-scenario009-multinode-oooq for the PS 574233,6? I'm trying to debug an issue there and I could really use 1-1 time with the actual environment11:52
flaper87my key: https://github.com/flaper87.keys11:52
*** dhill_ has joined #openstack-infra11:53
*** heyongli has quit IRC11:53
*** heyongli has joined #openstack-infra11:53
openstackgerritMohammed Naser proposed openstack-infra/project-config master: Switch flavor for Kata containers  https://review.openstack.org/57508911:56
mnaserclarkb: ^11:56
*** alexchadin has joined #openstack-infra11:56
*** heyongli has quit IRC12:03
*** heyongli has joined #openstack-infra12:03
*** trown|outtypewww is now known as trown12:04
*** amoralej is now known as amoralej|lunch12:04
*** edmondsw has joined #openstack-infra12:07
openstackgerritMerged openstack-infra/project-config master: Fix ACLs for tripleo-ci and dib-utils  https://review.openstack.org/57372812:09
*** alexchad_ has joined #openstack-infra12:10
*** alexchadin has quit IRC12:11
*** heyongli has quit IRC12:13
*** heyongli has joined #openstack-infra12:14
*** eharney has quit IRC12:14
*** yamamoto_ has quit IRC12:22
*** udesale__ has joined #openstack-infra12:23
openstackgerritMerged openstack-infra/project-config master: Remove direct branching rights for murano-apps  https://review.openstack.org/57507412:23
*** heyongli has quit IRC12:24
*** heyongli has joined #openstack-infra12:24
*** udesale_ has quit IRC12:25
*** jamesdenton has quit IRC12:30
*** jpich has quit IRC12:31
*** udesale__ has quit IRC12:31
*** roman_g has quit IRC12:33
*** heyongli has quit IRC12:34
*** heyongli has joined #openstack-infra12:34
*** jamesdenton has joined #openstack-infra12:34
*** kgiusti has joined #openstack-infra12:36
*** sthussey has joined #openstack-infra12:37
*** rossella_s has quit IRC12:39
*** boden has joined #openstack-infra12:39
*** dave-mccowan has joined #openstack-infra12:41
*** rossella_s has joined #openstack-infra12:42
*** shardy has quit IRC12:42
*** heyongli has quit IRC12:44
*** heyongli has joined #openstack-infra12:44
*** jcoufal has quit IRC12:45
*** cshastri has quit IRC12:49
*** bobh has joined #openstack-infra12:54
*** heyongli has quit IRC12:54
*** heyongli has joined #openstack-infra12:55
fungiflaper87: i can add an autohold for openstack/tripleo-heat-templates 574233 tripleo-ci-centos-7-scenario009-multinode-oooq12:55
flaper87fungi: thank you12:55
fungiflaper87: the autohold is in place. next time you check experimental and get the failure result, the node will stick around and then i can add your ssh key12:59
fungii assume you've already fixed the broken dependency for that change12:59
*** shardy has joined #openstack-infra12:59
flaper87fungi: on it13:01
*** alexchadin has joined #openstack-infra13:03
*** heyongli has quit IRC13:05
*** alexchadin has quit IRC13:05
*** heyongli has joined #openstack-infra13:05
*** alexchad_ has quit IRC13:06
*** alexchadin has joined #openstack-infra13:06
flaper87fungi: done13:06
*** Goneri has joined #openstack-infra13:07
*** hemna_ has joined #openstack-infra13:07
*** sree has quit IRC13:11
*** sree has joined #openstack-infra13:11
*** jcoufal has joined #openstack-infra13:13
*** heyongli has quit IRC13:15
*** heyongli has joined #openstack-infra13:15
*** sree has quit IRC13:15
*** hemna_ has quit IRC13:18
*** yamamoto has joined #openstack-infra13:20
*** dave-mccowan has quit IRC13:21
*** rossella_s has quit IRC13:22
*** felipemonteiro has joined #openstack-infra13:22
*** hemna_ has joined #openstack-infra13:23
*** rossella_s has joined #openstack-infra13:23
*** felipemonteiro has quit IRC13:23
*** yamamoto_ has joined #openstack-infra13:24
*** heyongli has quit IRC13:25
*** heyongli has joined #openstack-infra13:25
*** yamamoto has quit IRC13:28
*** m1st3rwr0ng has joined #openstack-infra13:28
*** amoralej|lunch is now known as amoralej13:28
*** mriedem has joined #openstack-infra13:30
*** shardy has quit IRC13:30
*** yamamoto_ has quit IRC13:30
*** eernst has joined #openstack-infra13:31
*** hrybacki is now known as hrybacki|mtg13:31
*** yamamoto has joined #openstack-infra13:32
*** m1st3rwr0ng has quit IRC13:33
*** eharney has joined #openstack-infra13:33
*** heyongli has quit IRC13:35
*** heyongli has joined #openstack-infra13:36
*** iyamahat has joined #openstack-infra13:40
*** zhipeng has joined #openstack-infra13:42
*** roman_g has joined #openstack-infra13:44
*** felipemonteiro has joined #openstack-infra13:44
*** heyongli has quit IRC13:46
*** heyongli has joined #openstack-infra13:46
*** hemna_ has quit IRC13:46
*** slaweq has quit IRC13:47
*** slaweq has joined #openstack-infra13:51
*** slaweq has quit IRC13:51
*** slaweq has joined #openstack-infra13:52
dansmithis zuul auto-merge-conflicting things right now by chance?13:53
dansmithI just pushed up a review which got merge conflicted, but git tells me I'm up to date13:54
fungidansmith: not to my knowledge, but please link an example and i'll try to investigate13:54
dansmithfungi: https://review.openstack.org/#/c/574792/13:54
fungithanks! digging into it now13:55
*** heyongli has quit IRC13:56
*** bobh has quit IRC13:56
*** camunoz has joined #openstack-infra13:56
*** heyongli has joined #openstack-infra13:56
dansmithoh13:56
dansmithheh13:56
dansmithfungi: I guess because the dependent change can't merge?13:57
openstackgerritEd Leafe proposed openstack-infra/project-config master: Migrate the API-SIG to StoryBoard  https://review.openstack.org/57512013:57
fungiright, that's usually what that error means. either your change or one it depends on isn't able to merge, so zuul can't build up the tree of repositories it needs to test it13:57
dansmithokay I guess I was thinking that it would test the dependent one in place and not rebase it13:57
dansmithbut I guess that makes sense13:58
dansmithfungi: mah bad13:58
*** hemna_ has joined #openstack-infra13:58
fungiand yeah, 567876 looks like it needs a rebase with some merge conflict resolution or something13:58
dansmithyup13:58
fungino problem! i'd rather have the occasional false alarm than not know something's actually broken13:58
* dansmith notes that down13:59
fungireports from members of the community about suspected problems are always welcome13:59
*** dave-mccowan has joined #openstack-infra14:00
*** camunoz has quit IRC14:04
*** hashar is now known as hasharAway14:05
*** camunoz has joined #openstack-infra14:05
*** jpena|lunch is now known as jpena14:06
*** heyongli has quit IRC14:06
*** alexchadin has quit IRC14:06
*** heyongli has joined #openstack-infra14:06
*** alexchadin has joined #openstack-infra14:07
corvusin fact, they're especially welcome, as they're usually much easier to deal with than reports of *actual* problems.  :)14:14
*** florianf has quit IRC14:15
*** Nil_ has joined #openstack-infra14:16
*** heyongli has quit IRC14:16
*** dhajare-brb has quit IRC14:16
*** heyongli has joined #openstack-infra14:17
*** florianf has joined #openstack-infra14:19
openstackgerritDavid Shrewsbury proposed openstack-infra/nodepool master: Make a proper driver notification API  https://review.openstack.org/57489614:22
fungituoché!14:22
*** shardy has joined #openstack-infra14:25
*** heyongli has quit IRC14:27
*** heyongli has joined #openstack-infra14:27
*** felipemonteiro has quit IRC14:27
*** dmsimard has joined #openstack-infra14:29
*** dmsimard has quit IRC14:29
*** dmsimard has joined #openstack-infra14:29
openstackgerritSean McGinnis proposed openstack-infra/project-config master: Remove Rally tagging ACL  https://review.openstack.org/57513014:36
*** heyongli has quit IRC14:37
*** heyongli has joined #openstack-infra14:37
*** kiennt26 has joined #openstack-infra14:38
*** alexchadin has quit IRC14:40
*** alexchadin has joined #openstack-infra14:41
*** alexchadin has quit IRC14:41
*** alexchadin has joined #openstack-infra14:42
*** alexchadin has quit IRC14:42
*** alexchadin has joined #openstack-infra14:42
*** alexchadin has quit IRC14:43
*** alexchadin has joined #openstack-infra14:44
openstackgerritWitold Bedyk proposed openstack-infra/project-config master: Add monasca-transform to GerritBot  https://review.openstack.org/57513514:45
*** annp has joined #openstack-infra14:46
openstackgerritTobias Henkel proposed openstack-infra/zuul master: Retry queries for commits  https://review.openstack.org/57513714:47
*** heyongli has quit IRC14:47
*** heyongli has joined #openstack-infra14:47
openstackgerritMatt Riedemann proposed openstack-infra/elastic-recheck master: Add query for tempest multi-create cells v1 bug 1776684  https://review.openstack.org/57513914:51
openstackbug 1776684 in tempest "MultipleCreateTestJSON.test_multiple_create intermittently fails for cells v1 due to server name check change" [High,In progress] https://launchpad.net/bugs/1776684 - Assigned to Matt Riedemann (mriedem)14:51
spsuryaJeffrey4l: when we have meeting today 16:00 or 15:00 UTC14:53
*** yamamoto_ has joined #openstack-infra14:53
spsuryasorry !! please ignore,  wrong channel14:54
*** yamamoto_ has quit IRC14:54
*** aojea has quit IRC14:55
*** yamamoto has quit IRC14:57
*** heyongli has quit IRC14:57
*** heyongli has joined #openstack-infra14:58
*** ldnunes has quit IRC15:01
*** yamamoto has joined #openstack-infra15:03
*** hrybacki|mtg is now known as hrybacki15:04
*** zhipeng has quit IRC15:05
*** r-daneel has quit IRC15:05
*** agopi has joined #openstack-infra15:07
*** heyongli has quit IRC15:08
*** heyongli has joined #openstack-infra15:08
*** yamamoto has quit IRC15:08
*** jcoufal has quit IRC15:09
*** jcoufal has joined #openstack-infra15:10
*** hongbin has joined #openstack-infra15:11
*** heyongli has quit IRC15:18
*** heyongli has joined #openstack-infra15:18
*** yamamoto has joined #openstack-infra15:18
*** efried has quit IRC15:20
*** dmsimard has quit IRC15:21
*** rpioso|afk is now known as rpioso15:21
*** efried has joined #openstack-infra15:22
*** rajinir has joined #openstack-infra15:22
*** yamamoto has quit IRC15:23
fungianybody tried to use launch-node.py with ubuntu bionic images in rackspace yet?15:28
*** heyongli has quit IRC15:28
*** heyongli has joined #openstack-infra15:28
fungilooks like make_swap.sh invokes python directly pretty early in the process, and there is no python 2.7 preinstalled so dies with a command not found error on the python interpreter15:29
clarkbfungi: I expect python3 is available maybe just need to make it a python3 script15:30
fungitrying to decide between figuring out how to install the python package early enough in the process to work around that, or updating everything to use python3 (which i guess will have to be special-cased because that won't work on centos 7?)15:30
*** lifeless has quit IRC15:31
*** lifeless has joined #openstack-infra15:31
clarkbmnaser: can you see comment on https://review.openstack.org/#/c/575089/1 and double check that everything is happy on your end for that update?15:33
clarkbmnaser: I think I found one minor issue15:33
mnaserah15:33
mnaseryou're right15:33
clarkbfungi: good point about centos715:33
openstackgerritMohammed Naser proposed openstack-infra/project-config master: Switch flavor for Kata containers  https://review.openstack.org/57508915:33
*** ykarel is now known as ykarel|away15:33
*** yamamoto has joined #openstack-infra15:33
mnaserclarkb: ^ and AJaeger if you're around for the revision :>15:34
clarkbmnaser: thanks for checking. fungi might also review it for us too15:34
fungihappily15:34
*** links has quit IRC15:36
clarkbthat will require a restart of the nl03 launcher15:37
clarkbShrews: ^ we should be good to just do that though right?15:37
* Shrews reads sb15:37
*** yamamoto has quit IRC15:38
*** ramishra has quit IRC15:38
clarkbactually15:38
Shrewsclarkb: not seeing the context15:38
clarkbI take that back, we make a new provider when we update the provider config which should get new flavor data15:38
*** heyongli has quit IRC15:38
clarkbShrews: the issue is in some cases nodepool does not update its flavor list so if you add a new flavor nodepool doesn't necessarily see it15:39
*** heyongli has joined #openstack-infra15:39
clarkbShrews: but in this case because the new flavor is tied to a provider config update I think it will just work15:39
mnaserin the case last time, it was when the flavor had changed ids but same name15:39
clarkbit is only if you add the flavor to the cloud after nodepool's config is updated that is a problem15:39
mnaserso i think it had to recache the id15:39
clarkbmnaser: ya it was particular to the old case I think15:39
Shrewsyeah, i'm not certain about what will happen there15:40
flaper87fungi: ok, failure has been reported to the review: https://github.com/flaper87.keys15:43
clarkbShrews: if we have to restart then it should be safe at this point though right? new new changes to nodepool zk schema since the restart on monday?15:44
Shrewsclarkb: should be fine to restart15:44
*** kiennt26 has quit IRC15:46
*** dtantsur is now known as dtantsur|afk15:46
*** r-daneel has joined #openstack-infra15:46
openstackgerritDoug Hellmann proposed openstack-infra/openstack-zuul-jobs master: add test-release-openstack-python3 to publish-to-pypi-python3  https://review.openstack.org/57485315:47
openstackgerritDoug Hellmann proposed openstack-infra/openstack-zuul-jobs master: remove publish-openstack-python-tarball  https://review.openstack.org/57486015:47
fungiflaper87: okay, the two nodes containing the multinode set are 158.69.69.16 and 158.69.69.159. you should be able to ssh into them as root using your key15:48
fungilet me know when you're done investigating so i can release them back into the pool15:48
*** heyongli has quit IRC15:49
*** heyongli has joined #openstack-infra15:49
*** r-daneel_ has joined #openstack-infra15:49
*** sree has joined #openstack-infra15:49
flaper87thank you15:50
*** r-daneel has quit IRC15:51
*** r-daneel_ is now known as r-daneel15:51
*** gyee has joined #openstack-infra15:51
openstackgerritDoug Hellmann proposed openstack-infra/project-config master: remove publish-openstack-python-tarball  https://review.openstack.org/57485915:52
*** dhajare-brb has joined #openstack-infra15:53
*** sree has quit IRC15:54
*** myoung is now known as myoung|biaf15:58
clarkbfungi: we need python to execute ansible on the remote node or is it even earlier than that?15:58
*** heyongli has quit IRC15:59
*** heyongli has joined #openstack-infra15:59
*** weshay is now known as weshay|ruck16:00
*** florianf has quit IRC16:00
dhellmannI need some help with 3 reviews to finish setting up the first version of the python3 packaging jobs. I've put a list together in order in https://etherpad.openstack.org/p/QJkCvqzhzo for when folks have time to do reviews16:00
*** arxcruz|ruck is now known as arxcruz16:01
*** yamamoto has joined #openstack-infra16:03
fungiclarkb: it's the first thing the script hits which is trying to invoke `python`16:03
*** myoung|biaf is now known as myoung16:03
fungii've got a workaround i'm testing now16:04
openstackgerritWitold Bedyk proposed openstack-infra/project-config master: Update list of Monasca repos for GerritBot  https://review.openstack.org/57513516:04
clarkbfungi: converting to print() from print statement makes it python3 safe can probably just check for python3 and fallback to python2 if no python316:05
*** yamahata has quit IRC16:05
clarkbhowever I half expect that ansible might need python too but maybe it uses 3 if no other option?16:05
*** florianf has joined #openstack-infra16:05
*** rlandy|rover is now known as rlandy16:06
*** hemna_ has quit IRC16:06
fungiclarkb: the bigger problem is that we have shebangs and other direct `python` invocations too16:07
*** myoung is now known as myoung|biaf16:07
clarkbah16:07
openstackgerritsebastian marcet proposed openstack-infra/openstackid-resources master: Fix on selection plans routing  https://review.openstack.org/57515616:07
fungiso could either add a symlink/alias from python to python3 (ugly) or just install python 2.7 on our servers until we get to the point where we only care about platforms which have python3 installed/installable16:08
*** yamamoto has quit IRC16:08
fungii would have considered 3-ifying it all and making sure python3 is preinstalled, but that's hard to do on centos 716:08
*** heyongli has quit IRC16:09
funginext problem i'm hitting is "dpkg-deb: error: 'puppetlabs-release-bionic.deb' is not a Debian format archive"16:09
*** heyongli has joined #openstack-infra16:09
openstackgerritDavid Shrewsbury proposed openstack-infra/nodepool master: Pre-register static nodes  https://review.openstack.org/57489716:10
openstackgerritDavid Shrewsbury proposed openstack-infra/nodepool master: Pre-register static nodes  https://review.openstack.org/57489716:10
fungii think we wanted to use the ubuntu-packaged puppet packages on bionic instead?16:10
fungii'll see where to set that16:11
*** ykarel|away has quit IRC16:12
*** iyamahat has quit IRC16:12
openstackgerritMerged openstack-infra/elastic-recheck master: Add query for tempest multi-create cells v1 bug 1776684  https://review.openstack.org/57513916:13
openstackbug 1776684 in tempest "MultipleCreateTestJSON.test_multiple_create intermittently fails for cells v1 due to server name check change" [High,In progress] https://launchpad.net/bugs/1776684 - Assigned to Matt Riedemann (mriedem)16:13
openstackgerritDavid Shrewsbury proposed openstack-infra/nodepool master: Pre-register static nodes  https://review.openstack.org/57489716:13
fungilooks like setting PUPPET_VERSION=3 in the calling environment for the install_puppet.sh invocation may just do it16:13
fungier, export PUPPET_VERSION=4 i mean16:14
*** alexchadin has quit IRC16:16
*** r-daneel_ has joined #openstack-infra16:17
clarkbya I think if they have packages published for that version you should be set16:17
anteayadoes centos have a python3 plan?16:17
clarkbcmurphy got our base stuff working on it and we have some testing now :)16:17
fungiyes, but they're not talking about it much16:17
fungitechnically it's rhel's python 3 plan16:17
fungirumor is that rhel 8 will only have python 316:18
clarkbaiui they can't confirm that rhel will have an 8th release16:18
clarkbbut they can say that if the 8th releasehappens it will not have python2 and be python3 only16:18
fungioh, right, rhel next major release16:18
openstackgerritDavid Shrewsbury proposed openstack-infra/nodepool master: Clarify static node name uniqueness in docs  https://review.openstack.org/57515916:18
*** SumitNaiksatam has quit IRC16:18
clarkbbut they also can't say which version of python3 they will use16:18
*** r-daneel has quit IRC16:18
*** r-daneel_ is now known as r-daneel16:18
anteayawhy so tight lipped about it?16:18
fungiit's okay. it's not as if their users need to be able to plan for the future or anything16:18
anteayaexactly16:18
*** yamamoto has joined #openstack-infra16:18
fungianteaya: i expect that they're worried that if they say one thing and then need to change their minds about it at the last minute, some of their paying customers might demand compensation for work they did based on false predictions16:19
anteayawow16:19
*** heyongli has quit IRC16:19
fungieasier to just say nothing16:19
*** heyongli has joined #openstack-infra16:20
anteayafor them it is easier16:20
mordredanteaya: there is actually a weird US thing about companies making 'forward-looking' statements about unreleased products16:21
*** ccamacho has quit IRC16:21
mordredanteaya: it can affect revenue recognition for reasons I don't _fully_ understand16:22
anteayawhat is 'revenue recognition'?16:22
mordredbut most publicly traded us companies err on the side of "say nothing about what will be in a product until it is released"16:22
openstackgerritMerged openstack-infra/openstackid-resources master: Fix on selection plans routing  https://review.openstack.org/57515616:22
anteayahow long with the prior version be supported after the new thing is released?16:22
mordredanteaya: accounting something something about being able to actually show income on your balance sheets16:22
mordredanteaya: I think there _may_ actually even be SEC rules about it since the company is traded on the stock market16:23
*** agopi has quit IRC16:23
anteayamordred, thanks for making an attempt at clarity16:23
anteayareally?16:23
mordredwhich is me saying - while it's totally silly - there are some areas of it where I don't think people have very much choice16:23
*** yamamoto has quit IRC16:23
anteayaI'll look into that thanks16:23
*** florianf has quit IRC16:24
fungihttps://en.wikipedia.org/wiki/Forward-looking_statement16:24
*** ykarel|away has joined #openstack-infra16:25
fungiit's basically fallout from the great depression16:26
*** dmsimard has joined #openstack-infra16:26
*** dmsimard has quit IRC16:26
*** dmsimard has joined #openstack-infra16:26
* anteaya reads16:26
openstackgerritDavid Shrewsbury proposed openstack-infra/nodepool master: Clarify static node name uniqueness in docs  https://review.openstack.org/57515916:26
dhellmannit's easier to tell people not to say anything at all than to craft the subtle message that would be ok ("will include at least python version x.y and be released no sooner than $date")16:27
mordreddhellmann: ++16:27
dhellmannwhich is also easy to misconstrue as "on $date you will have python x.y"16:27
mordred"don't say anything" is easy to comply with16:27
dhellmannright16:27
dhellmannhighly annoying and makes for difficult collaboration16:28
mordredyup16:28
dhellmannbut "easy"16:28
clarkbI do think a lot of this pain would've been avoided if rhel added a python3 to the base install and straddles 2 and 3 like every other distro out there16:28
clarkband you can do that without SEC concerns16:28
*** jcoufal has quit IRC16:28
dtroyerSo infra-folk, I need to do a bit of ML debugging on starlingx-discuss.  It is working for me (from GMail) and other Intel accounts  but Wind River is getting bounces (http://paste.openstack.org/show/723398/, http://paste.openstack.org/show/723395/) that appear to be caused by lists.openstack.org.16:28
clarkbbut I neither do finance nor run a distro so  I shouldn't complain16:28
mordredclarkb: actually, the SEC also regulates python versions16:28
dhellmannI'm sure someone had reasons for not doing that, but they haven't shared them with me16:28
clarkbdtroyer: do they enforce DMARC?16:28
*** myoung|biaf is now known as myoung|lunch16:29
dtroyerCan we confirm if lists.o.o is actually seeing that and returning the error?  I wouldn't rule out some sort of 'transparent' proxy16:29
*** iyamahat has joined #openstack-infra16:29
anteayaI wonder if perhaps some of the US executive could be let in on the easy part of 'say nothing'16:29
clarkbdtroyer: ya we can take a look16:29
dtroyerclarkb: hmmm, good question16:29
dhellmannmordred : do you have some time today to take a look at a few py3 packaging job reviews? https://etherpad.openstack.org/p/QJkCvqzhzo16:29
*** heyongli has quit IRC16:30
*** heyongli has joined #openstack-infra16:30
mordreddtroyer: I do not see that message id in the mailing list server log16:30
*** r-daneel has quit IRC16:31
*** yamahata has joined #openstack-infra16:31
fungidtroyer: starlingx-discuss@lists.openstack.org is not a valid mailing list address16:31
*** r-daneel has joined #openstack-infra16:31
dhellmanncorvus : I could use your input on this ML thread about lib-forward-testing jobs when you have a few minutes. I think I have it worked out, but I'm not sure of the zuul variable http://lists.openstack.org/pipermail/openstack-dev/2018-June/131466.html16:31
dtroyermordred: ok, thanks.  the second of those bounces was sent to starlingx-discuss@lists.openstack.org so I wouldn't expect it to be DNS-related16:31
mordreddhellmann: yah16:31
dtroyerfungi: hmmm… I've been insug it from GMail :)16:32
mordreddtroyer, fungi: that said, I see emails from chris.friesen@windriver.com in the logs16:32
fungidtroyer: are you sure you're not using starlingx-discuss@lists.starlingx.io?16:33
dtroyerfungi: nevermind, not the o.o one16:33
clarkbhttp://paste.openstack.org/show/723398/ is to ^ though16:33
mordredcoming from mx1.edoxs1.iphmx.com16:33
dtroyerfungi: Chris tried both16:33
*** tesseract has quit IRC16:33
dhellmannmordred : ty16:33
clarkbI don't see w5DF8 in the exim4 mainlog16:33
fungiahh, okay, i looked at one and assumed wrongly they were both making the same mistake16:33
*** yamamoto has joined #openstack-infra16:33
fungiDiagnostic-Code: SMTP; 550 Unrouteable address16:34
dtroyermordred: that is interesting, not directly from WRS.16:34
mordreddtroyer: yah - all of the windriver stuff I see in the logs comes from that host16:34
*** hasharAway is now known as hashar16:34
clarkbfungi: though that one has a mix of lists.o.o and lists.starlingx which is weird16:34
*** ianychoi has quit IRC16:34
fungioh, yep16:34
fungii think that's because it's following the cname16:35
fungi550 5.1.1 <starlingx-discuss@lists.starlingx.io>... User unknown16:35
clarkbah16:35
mordredoth should work - yes, because of cname16:35
*** ianychoi has joined #openstack-infra16:35
clarkbmordred: well exim4 won't be able to deliver it if using the wrong domain since starlingx-discuss doesn't exist on lists.o.o16:35
mordredyah16:35
openstackgerritThierry Carrez proposed openstack-infra/project-config master: Remove direct tagging from heat-cfntools ACL  https://review.openstack.org/57507216:35
mordredI would expect exim to complain about the recipient - but I'd expect it to log that because it would have physically received the connection16:36
dtroyerone more bit of info from Chris:  I also noticed that the "To" address is displayed as "mailto:starlingx-discuss@lists.openstack.org" even though replying to the list uses "mailto:starlingx-discuss@lists.starlingx.io".  This seems odd.16:36
clarkbmordred: ya not seeing the id at all is wierd16:36
fungi2018-06-13 14:44:48 H=mail5.windriver.com (mail5.wrs.com) [192.103.53.11] F=<Brent.Rowsell@windriver.com> rejected RCPT <starlingx-discuss@lists.openstack.org>: Unrouteable address16:36
clarkbah ok so they are using the wrong address to send to probably based on ^16:37
fungiin the exim manilog16:37
*** ykarel|away has quit IRC16:37
mordredfungi: oh - good - that's what I was looking for and not finding16:37
fungii'm still looking for any where they sent to the lists.starlingx.io address16:38
*** yamamoto has quit IRC16:38
fungii'm also seeing what looks like address confirmation replies bouncing for them for similar reasons16:38
dtroyerfungi: the first bounce (http://paste.openstack.org/show/723398/) shows it leaving using lists.opensyack.org (line 68).  there we go16:39
corvuscnames can not appear in the recipient address in smtp.  mtas typically resolve this by rewriting the address.  so a user behind a well-behaved mta will have their envelope recipient rewritten to openstack.org.16:39
*** zul has quit IRC16:39
*** zul_ has joined #openstack-infra16:39
clarkbunrelated, but if anyone asks why zuul is "slow" today it looks like a large number of tripleo changes are in the gate adn they have reset the full queue at least once after a failure in the head change16:39
clarkbcorvus: aha so we have to update DNS?16:40
*** heyongli has quit IRC16:40
*** zul has joined #openstack-infra16:40
fungiyeah16:40
clarkblists.starlingx.io A $ip rather than lists.starlingx.io CNAME lists.openstack.org ?16:40
*** heyongli has joined #openstack-infra16:40
fungilooks like we need to fix dns for lists.airshipit.org too16:40
fungii can take care of it now16:41
corvusyep16:41
fungii probably did one or both of those mistakes16:41
corvus(it would be okay if we were routing only by localpart, but part of our design for the multi-domain hosting was to keep the domains independent)16:41
fungioh, i bet an mx record would also have been appropriate16:42
fungimx records _can_ appear as the domain part16:42
fungiwould we rather have mx or a/aaaa?16:42
corvusfungi: maybe let's try mx?16:42
fungion it16:42
clarkbMX is a name though not an IP?16:43
fungiright16:43
clarkbso it would still go through the cname if we keep that?16:43
fungioh, though we also want to use the same name for web content16:43
fungiso we need a/aaaa16:43
AJaegerconfig-core, let's retire loci-*, please - final change is https://review.openstack.org/54826816:43
clarkbI guess zuul-ci.org's bind config will illustrate how it should look16:44
fungicname solves the http conundrum but breaks (some) smtp. mx solves for smtp but doesn't get us http16:44
*** zul_ has quit IRC16:44
corvuslists.starlingx.io mx lists.openstack.org  ?16:44
corvuswhat breaks http?16:44
fungicorvus: we still need something to resolve lists.starlingx.io to an address somewhere so that http://lists.starlingx.io/ will work16:45
*** SumitNaiksatam has joined #openstack-infra16:45
corvusoh for archives16:45
clarkbya16:45
fungiyup16:45
fungiand web-based subscription and preferences manglement16:45
dtroyerI think you'll need both MX and A/AAAA16:45
corvusthen yeah, i think we're at A records16:45
clarkbAJaeger: I've approved it16:46
corvuswe don't need mx with A16:46
clarkbAJaeger: I guess all the zuul config has been removed making it safe to remove it from main.yaml?16:46
dtroyerthey're going to the same place?16:46
corvusdtroyer: yep16:46
clarkbAJaeger: that isn't actually self testing I think because it is in project-config which is trusted16:46
dtroyerroger  I'm not usually that lucky16:46
clarkbcorvus: ^ when not thinking about lists can you double check those statements about retiring loci-* from zuul main.yaml ?16:46
corvusfungi: sorry i didn't remember all this earlier16:46
AJaegerclarkb: yes, all looked fine16:47
fungihey, i'm pretty sure i was the one who stuck the cname in those domains, so fault's mine. i should have remembered that nugget of dns lore as well16:47
AJaegerclarkb: you wanted to discuss testing of playbooks or something like that? Do you have time now?16:47
corvusclarkb, AJaeger: it's not tested, but it's syntax validated, so should be ok to merge.16:48
fungi#status log switched lists.airshipit.org and lists.starlingx.io dns records from cname to a/aaaa for proper mail routing16:48
openstackstatusfungi: finished logging16:48
clarkbcorvus: cool16:48
fungidtroyer: ttl on the old cnames was 5 minutes, so should resolve itself in short order now16:48
*** yamamoto has joined #openstack-infra16:48
corvusfungi: well, we had a conversation a month ago where i remembered almost everything about this except i didn't make the connection that we wouldn't route the message correctly because we would receive it with the wrong domain.  we said we'd try it with airship and see if it worked.16:49
dtroyerfungi: thanks, I'll have them try again in a bit16:49
fungithree cheers for the robustness principle, i suppose16:50
*** heyongli has quit IRC16:50
*** heyongli has joined #openstack-infra16:50
*** ykarel|away has joined #openstack-infra16:52
*** yamamoto has quit IRC16:53
dtroyerfungi: one more quick question: who are the list moderators for those?16:54
dtroyerstarlingx-discuss and -announce16:54
fungidtroyer: it should say on the list summary pages for them16:54
fungidtroyer: looks like jbryce at the moment16:54
fungihttp://lists.starlingx.io/cgi-bin/mailman/listinfo/starlingx-discuss16:55
fungiat the bottom16:55
dtroyerI don't see that16:55
fungi"Starlingx-discuss list run by jonathan at openstack.org"16:55
jbrycei'm happy to add moderators/replace myself16:55
dtroyerduh, I searched for jbryce :)16:56
dtroyerjbryce: I can hold that baton while we figure out who really should have it16:56
jbryceok. i'll add you16:56
openstackgerritPaul Belanger proposed openstack-infra/zuul master: Allow zuul_return in untrusted jobs  https://review.openstack.org/57517316:57
jbrycedtroyer: added your gmail account16:58
dtroyerthanks16:58
clarkbanother tripleo gate reset16:58
*** Swami_ has joined #openstack-infra16:58
*** Swami has joined #openstack-infra16:58
clarkbmwhahaha: EmilienM ^ not sure if you are aware of that, but it looks like it may be a bumpy tripleo gate right now16:58
mwhahahayea containers16:58
mwhahahawe're aware16:58
EmilienMweshay|ruck ^16:58
mwhahahaappears to be some issues talking to docker.io16:59
*** eernst has quit IRC16:59
weshay|ruckit's redirecting16:59
*** eernst has joined #openstack-infra16:59
clarkbeveryone is trying that new docker desktop16:59
weshay|ruckhttps://registry-1.docker.io/v2/tripleomaster/centos-binary-tripleo-ui/tags/list16:59
weshay|ruck7 gate failures today in tripleo, not all related to this by any means17:00
*** heyongli has quit IRC17:00
*** heyongli has joined #openstack-infra17:01
*** iyamahat has quit IRC17:01
fungiclarkb: new wrinkle... ubuntu has puppet 5 in bionic. puppetlabs has a puppet5-release-bionic.deb (which is obviously 5) and a puppet-release-bionic.deb (which i suspect is 5 as well?)17:02
weshay|ruckcrud another one "2018-06-13 16:50:30.487644 | primary | /home/zuul/workspace/devstack-gate/functions.sh: line 184: declare: gate_hook: not found17:02
weshay|ruck"17:02
clarkbfungi: does puppetlabs publish 4 for bionic?17:03
*** e0ne has quit IRC17:03
*** derekh has quit IRC17:03
*** lseki has joined #openstack-infra17:03
fungiclarkb: i don't see one on http://apt.puppetlabs.com/17:03
fungiunless that's what the puppet-release-bionic.deb is17:03
clarkbfungi: I think puppet4 is largely forward compat with puppet5 but I think we'd have to update a lot of stuff to accept 5 too and add testing and all that17:05
clarkbcmurphy probably has more of it paged in than me17:05
*** shardy has quit IRC17:05
*** dhajare-brb has quit IRC17:06
cmurphyi've been told by a puppet employee that they are not going to do puppet 4 for bionic17:06
lsekihi17:07
fungihttp://apt.puppetlabs.com/pool/bionic/puppet/p/puppet-agent/ does indeed look like only 517:07
lsekiI'm requesting a couple of rechecks on this patch https://review.openstack.org/#/c/572188/17:07
lsekibut devstack-multinode always fails at the task orchestrate-devstack : Discover hosts17:07
lsekiit says IOError: [Errno 13] Permission denied: '/tmp/console-None.log'17:07
lsekido anyone know if it's an expected error?17:07
clarkblseki: that is a known side effect of the ansible 2.5 update. We are currently working to fix it17:08
fungicorvus: ^ looks like another instance of https://storyboard.openstack.org/#!/story/200252817:08
anteayalseki, and corvus had recently requested knowledge of new instances of the bug, so thanks for reporting17:09
clarkblseki: we should send out mail to the dev list once it is fixed to give everyone the all clear17:10
*** heyongli has quit IRC17:11
*** heyongli has joined #openstack-infra17:11
fungiclarkb: cmurphy: i'm giving a basic bionic server a shot with puppet 5 to see if enough of our core server puppetry will work17:12
lsekioh, ok. I'll subscribe to this story17:12
lsekithank you!17:12
cmurphyfungi: exciting17:13
fungii'm not getting my hopes up17:13
anteayafungi do you ever?17:13
clarkbI think our conditions may be all if 4 then this if 3 then that else fail17:13
clarkbwe can update that to be if <=3 then foo else if > 3 bar17:13
corvusclarkb, lseki, fungi, anteaya: thanks, that specific case is known and we're working on it.17:14
corvus(the devstack-multinode job)17:14
*** yamamoto has joined #openstack-infra17:14
*** yamamoto has quit IRC17:14
fungiahh, yep i see that's the one mentioned in the story description17:15
*** annp has quit IRC17:17
*** rossella_s has quit IRC17:18
*** amoralej is now known as amoralej|off17:18
*** myoung|lunch is now known as myoung17:19
*** rossella_s has joined #openstack-infra17:20
*** heyongli has quit IRC17:21
*** heyongli has joined #openstack-infra17:21
openstackgerritMerged openstack-infra/project-config master: Decom loci-* repos  https://review.openstack.org/54826817:21
*** trown is now known as trown|lunch17:24
*** jpena is now known as jpena|off17:24
*** agopi has joined #openstack-infra17:24
*** dhajare-brb has joined #openstack-infra17:29
*** heyongli has quit IRC17:31
*** heyongli has joined #openstack-infra17:31
*** eernst has quit IRC17:32
*** rossella_s has quit IRC17:34
fungiokay, this is weird. now the error i'm hitting is that `/etc/ansible/hosts/openstack --list` is broken on puppetmaster.o.o, with a 404 getting raised by https://auth.vexxhost.net/v2.0/tokens17:35
clarkbfungi: it needs inventory and that relies on apis being up17:35
fungii wonder if we have a misconfiguration in our clouds.yaml17:35
*** rossella_s has joined #openstack-infra17:36
fungioh, is vexxhost's keystone under maintenance17:36
fungi?17:36
clarkbI ran against vexxhost not too long ago to check the new flavor type17:36
clarkbso unless we changed somethign in the last 2 hours its probably not on our end17:36
clarkboh its using v2 there17:37
*** ykarel|away has quit IRC17:37
fungiyeah, i was thinking that should be v317:37
clarkbit works if I use our clouds.yaml and flavor list still17:37
clarkbI think whatever clouds.yaml you are using must be telling it to v2?17:37
*** zoli|wfh is now known as zoli|gone17:38
fungiare you able to `/etc/ansible/hosts/openstack --list` on puppetmaster.o.o at the moment?17:38
*** zoli|gone is now known as zoli17:39
*** lseki has left #openstack-infra17:39
*** yamamoto has joined #openstack-infra17:39
clarkbfungi: no, even if I set the clouds.yaml file to be the same fiel as what works with osc17:40
*** heyongli has quit IRC17:41
*** heyongli has joined #openstack-infra17:42
clarkbif I had to guess we were using v2 against vexxhost all along and vexxhost just removed v2 nowish17:43
*** Goneri has quit IRC17:43
fungiand shade/ksa won't auto-discover that it needs to talk v3?17:43
clarkbwe don't set a domain name so I guess not17:44
clarkbosc must be smart and try default orsimilar if no domain is set otherwise17:44
clarkbfungi:  Ithink if we add the domain info to the clouds.yaml it should work17:45
*** electrofelix has quit IRC17:45
clarkbI don't actually know what our domain is now though17:45
*** rossella_s has quit IRC17:45
*** yamamoto has quit IRC17:45
clarkband I can't list domains17:46
fungimordred: ^ you likely have a better handle on this17:46
fungii'm a bit out of my depth on this one17:46
clarkbdefault is apparently 'default' in osc so I think we try that as a domain name17:46
clarkbI can hand edit the file, give me a sec17:46
*** eernst has joined #openstack-infra17:46
*** germs has joined #openstack-infra17:47
*** germs has quit IRC17:47
*** germs has joined #openstack-infra17:47
*** rossella_s has joined #openstack-infra17:48
openstackgerritFelipe Monteiro proposed openstack-infra/project-config master: Add use-storyboard: True to Patrole  https://review.openstack.org/57518217:48
clarkbseems to not be crashing when I run the openstack --list command17:48
clarkbbut not returning quickly either17:48
clarkbthat fixed it will get a patch up17:48
mordredfungi, clarkb: reading scrollback17:49
mordredclarkb, fungi: we need to add17:49
mordred      user_domain_id: default17:49
mordred      project_domain_id: default17:49
*** camunoz has quit IRC17:50
*** yolanda has quit IRC17:50
clarkbyup that is what I tested I will get a patch up as soon as I can push to gerrit which is apparently an issue right now?17:50
fungiaha, cool17:50
mordredwoot17:51
clarkbdoes anyone else have dns problems looking up review.o.o17:51
funginope, but mine may be cached17:51
mordreddiscover of whether to use v2 or v3 for auth is based on whether you pass domain information in as part of your auth parameters or not17:51
cmurphyi'm loling that we were one of mnaser's last v2 users17:51
mordredalso nope - dns for review.o.o works fine for me17:51
clarkbya digging at my upstream works17:51
clarkbI wonder if we got into a blacklist I subscribe to17:52
*** heyongli has quit IRC17:52
clarkbthat would be interesting17:52
*** heyongli has joined #openstack-infra17:52
clarkblet me edit /etc/hosts for now17:52
fungii got a report that the edge-computing@l.o.o ml had a bunch of people unsubscribed for excessive bounces today, from a variety of domains17:53
mordredI can't resolve lists.openstack.org17:53
fungiwha?17:54
mordredwait - nevermind17:54
fungii'm resolving that fine17:54
mordredI can't type17:54
clarkbI can't resolve that either but usptream of me it resolves17:54
fungii usually have that problem17:54
mnasercmurphy: lol, what are the odds. I would frequently make runs to identify potential users from networks but I guess this was a small one17:54
openstackgerritGraham Hayes proposed openstack-infra/project-config master: Move openstack-python-jobs to os-api-ref repo  https://review.openstack.org/57518317:54
mnaserI’d suggest updating others providers to include domain info17:55
openstackgerritClark Boylan proposed openstack-infra/system-config master: Update vexxhost to use keystone v3 auth  https://review.openstack.org/57518417:55
clarkbfungi: ^ you may need to manually update clouds.yaml again after that merges to get puppet to run and apply it17:56
mnasermordred: does the auth_type: v3pssword change in profiles help this use case?17:56
clarkbI need to figure out why my dns broke17:56
clarkbmnaser: no, still have to provide the domain info which if provided will assume v3 aiui17:56
mordredmnaser: it does not - because v3password requires domain info17:56
fungiclarkb: thanks, noted17:56
mordredproviding v3password will just cause an error message to be printed aout missing paraemters17:56
mnaserOkay that’s a lot more straightforward than V2 40417:57
mordredyah17:57
mnaserSo we’ll continue wit that change17:57
mordred++17:57
mordredit's still an accurate change17:57
*** iyamahat has joined #openstack-infra17:58
*** iyamahat_ has joined #openstack-infra17:59
*** bobh has joined #openstack-infra17:59
*** heyongli has quit IRC18:02
*** heyongli has joined #openstack-infra18:02
*** akhilaki has joined #openstack-infra18:02
clarkbopenstack doesn't show up in my blocker logs hrm18:02
clarkbdns may just be broken then18:02
*** simondodsley_ has quit IRC18:03
openstackgerritPaul Belanger proposed openstack-infra/zuul master: Allow zuul_return in untrusted jobs  https://review.openstack.org/57517318:03
*** simondodsley has joined #openstack-infra18:03
*** iyamahat has quit IRC18:03
*** openstackgerrit has quit IRC18:04
*** yolanda has joined #openstack-infra18:05
fungiokay, progress. next i'm failing on https://git.openstack.org/cgit/openstack-infra/ansible-role-puppet/tree/tasks/main.yml#n2718:06
funginot sure what the best way is to test the launch-node.py script with a patched ansible-role-puppet18:07
clarkbdisabling dns over tls appears to have fixed it. cue conspiracy theories18:07
clarkbeither cloudflare decided to stop resolving openstack.org over tls or my isp is playing hardball18:08
clarkbI'll run without tls for now18:08
*** myoung is now known as myoung|biab18:08
clarkbreminder we are talking winterstack naming in just under an hour18:08
clarkbI'm gonna afk for a bit now prior to that18:08
fungiclarkb: one of the first casualties of the net neutrality repeal? ;)18:09
clarkbfungi: as much as I hope not it wouldn't surprise me18:09
*** harlowja has joined #openstack-infra18:10
fungiokay, looks like "office 365" has decided to start rejecting e-mail from our listserv18:11
*** r-daneel_ has joined #openstack-infra18:11
*** r-daneel has quit IRC18:11
*** r-daneel_ is now known as r-daneel18:11
clarkbI suppose it could be a bug in unbound after running for a month doing tls18:11
clarkbfungi: yes they dmarc18:11
clarkbkata ran itno this18:11
clarkbwe may need to globally apply the treat dmarc enforcers as special config18:12
fungi"Your mail server's IP address, that is, the address your mail server uses to identify itself on the Internet, was tagged as a potential threat to Office 365 for one of a variety of reasons."18:12
*** heyongli has quit IRC18:12
clarkbok really afk now. back before 190018:12
*** heyongli has joined #openstack-infra18:12
*** dave-mccowan has quit IRC18:15
*** kjackal has quit IRC18:16
*** larainema has quit IRC18:17
*** e0ne has joined #openstack-infra18:20
*** heyongli has quit IRC18:22
*** heyongli has joined #openstack-infra18:23
*** openstackgerrit has joined #openstack-infra18:23
openstackgerritPaul Belanger proposed openstack-infra/zuul master: Allow zuul_return in untrusted jobs  https://review.openstack.org/57517318:23
openstackgerritMerged openstack-infra/project-config master: Switch flavor for Kata containers  https://review.openstack.org/57508918:26
*** Goneri has joined #openstack-infra18:28
*** sree has joined #openstack-infra18:29
*** trown|lunch is now known as trown18:30
openstackgerritPaul Belanger proposed openstack-infra/zuul master: Allow zuul_return in untrusted jobs  https://review.openstack.org/57517318:31
openstackgerritPaul Belanger proposed openstack-infra/zuul master: Allow zuul_return in untrusted jobs  https://review.openstack.org/57517318:32
*** heyongli has quit IRC18:33
*** heyongli has joined #openstack-infra18:33
fungimailman3 is also packaged in debian stretch, and while puppetlabs only has puppet 5 for stretch, stretch itself has puppet 4!18:34
*** sree has quit IRC18:34
*** dhajare-brb has quit IRC18:35
fungiwell, technically mailman3 is in stretch-backports, but still18:38
clarkbI've realized that the above flavor update may break vexxhost in nodepool until the clouds.yaml update happens18:39
fungii'll just go ahead and emergency approve it18:39
clarkbor we can direct enqueue to the gate18:39
clarkbI'm happy either way18:39
fungiyeah, i was thinking the same18:40
fungihave to approve it to do that anyway18:40
clarkblooks like you enqueued it too, thanks18:41
openstackgerritGraham Hayes proposed openstack-infra/project-config master: Move openstack-python-jobs to os-api-ref repo  https://review.openstack.org/57518318:43
*** felipemonteiro has joined #openstack-infra18:43
*** heyongli has quit IRC18:43
*** heyongli has joined #openstack-infra18:43
*** boris_42_ has joined #openstack-infra18:44
*** mriedem has quit IRC18:46
*** yamamoto has joined #openstack-infra18:46
*** mriedem has joined #openstack-infra18:47
anteayastanding by for the discussion, thunderstorm warning issued and grumbly sky18:47
anteayahope I can remain connected18:47
*** yamamoto has quit IRC18:52
*** heyongli has quit IRC18:53
*** rossella_s has quit IRC18:53
*** heyongli has joined #openstack-infra18:53
*** rossella_s has joined #openstack-infra18:55
*** anteaya has quit IRC18:58
*** anteaya has joined #openstack-infra18:59
anteayadropped once already :(18:59
clarkbjbryce: 1900UTC wednesday is nowish18:59
clarkbjbryce: still a good time?18:59
jbryceyep. i'm around but wrapping up a call. probably need like....45 more seconds = )19:00
*** hashar is now known as hasharAway19:00
ianwmorning!19:00
clarkbianw: good morning19:00
clarkbanteaya: therewill be logs at the very least19:00
anteayaclarkb, that helps except I don't get to play19:01
anteayathe sky went all wizard of oz on me, I don't think I will be last long19:01
jbryceok, i'm ready if y'all are19:01
anteayavery fast19:01
anteayaready19:01
fungiwelcome!19:02
cmurphyo/19:02
clarkbfungi: you've been doing formal start meetings with the TC do we want to do that here?19:02
clarkbmay help wtih note taking?19:02
fungisure, if you like19:02
* mordred waves to jbryce19:02
fungimay be a little noisy of a log just by virtue of our gerritbot and whatnot, but can't hurt19:03
openstackgerritMerged openstack-infra/system-config master: Update vexxhost to use keystone v3 auth  https://review.openstack.org/57518419:03
clarkb#startmeeting winterstack_naming19:03
fungicase in point ^19:03
openstackMeeting started Wed Jun 13 19:03:11 2018 UTC and is due to finish in 60 minutes.  The chair is clarkb. Information about MeetBot at http://wiki.debian.org/MeetBot.19:03
openstackUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.19:03
*** openstack changes topic to " (Meeting topic: winterstack_naming)"19:03
openstackThe meeting name has been set to 'winterstack_naming'19:03
openstackgerritColleen Murphy proposed openstack-infra/puppet-cgit master: Update Gemfile for Zuulv3  https://review.openstack.org/57198719:03
jbryceso what if start out by just putting out there what i think we're talking about and trying to name/brand and y'all can tell me where i'm wrong, and then i can talk about some steps for working towards a name19:03
clarkbjbryce: sounds good19:03
mordred++19:03
*** heyongli has quit IRC19:03
*** heyongli has joined #openstack-infra19:04
*** hemna_ has joined #openstack-infra19:06
jbryceover the years, we've built up a set of tools and services to enable the "openstack way" of collaborating, including code management and communications tools. there's a feeling that these are too tightly coupled to the openstack project because of their existing naming schemes and we'd like to come up with another way to refer to them so that they are available to other projects that could benefit from the same tools19:07
*** anteaya has quit IRC19:07
fungithat sounds like an accurate summary to me19:07
openstackgerritColleen Murphy proposed openstack-infra/puppet-cgit master: Update Gemfile for Zuulv3  https://review.openstack.org/57198719:07
*** lsell has joined #openstack-infra19:08
clarkbyup that sounds right to me19:08
jbryceok cool19:08
jbryceand this name should stand on its own from the openstack project or openstack foundation19:09
ianwthis isn't about a "puppet-openstackci" type thing though, where we support "replicating" openstack-infra locally in your environment though, correct?  it's about traditionally non-openstack things using the existing infrastructure we have?19:09
mordredyes19:09
clarkbyes, I think one of the specific concerns by "others" is that they are not openstack and don't want to be openstack so something "neutral" is helpful19:09
clarkbmy yes was to jbryce but also yes to ianw19:10
mordredme too19:10
jbryceianw: my understanding is that we're talking about the actual hosted instances of the tools19:10
ianw++ thanks for clarifying19:10
fungiyes19:11
mnasero/19:11
mnaser(late but better than ever)19:11
jbrycewhen i think about those services, i obviously include git/gerrit services, but i also think things like etherpad/calc, storyboard and other things could be part of the overall "suite" of tools19:11
fungicase in point, the other day we were asked if etherpad.openstack.org was available by any other domain names because there was something going on at kubecon and they wanted to take some notes on our etherpad but didn't want to use something with openstack in the domain19:12
cmurphyi'm curious about the part about standing on its own free from the foundation, i'd been assuming that this team's mission was in large part about serving the projects presided over by the foundation19:12
fungiit's about serving those projects, but not about serving the foundation itself, in my opinion19:13
fungisubtle distinction, perhaps?19:13
cmurphyhmm okay19:13
fungithe services are nto being run by the openstack foundation, they're being run by volunteers19:13
fungier, s/nto/not/19:13
lsellbut also projects that are not hosted at the openstack foundation, right? i thought that might be cmurphy question19:13
mordredyah. I don't think it's so much about being separate from the foundation - as in being separate from the first/primary project (openstack) it grew to serve19:13
jbryceit's a good question. we've allowed related/stackforge projects to use git for years19:13
*** heyongli has quit IRC19:14
fungisure, that too certainly. what we used to refer to as "stackforge"19:14
mordredyup19:14
*** heyongli has joined #openstack-infra19:14
mordredI'd also like to consider the possibility of offering our services more broadly as we think about naming - even if we don't do so immediately19:14
jbrycemy guess is that the primary consumers would be foundation managed projects19:14
mordredso - if, say, drizzle wanted to ressurrect and use winterscale - that we'd be organized such that that would be decently feasible19:15
mordredbut yes, I agree with what jbryce just said19:15
fungiand the possible governance structure corvus has proposed involves representatives from those top-level foundation projects19:15
jbrycebut in terms of naming...like "osf-infra.org" might be to tightly coupled19:15
*** myoung|biab is now known as myoung19:15
corvusso in short, a name for a service which provides our traditional infrastructure tooling to all projects under the foundations umbrella, almost certainly projects informally related to those, and possibly, in the future, projects even less directly affiliated.19:16
mordredcorvus: ++19:16
fungiyep19:16
jbryceok cool19:16
jbryceso when thinking about branding and naming, there are all kinds of approaches to it19:17
jbrycein the thread i saw, there were a lot of domain names flying around, which is a good thing to think about eventually, but i think it might be good to get some of the higher level things we want to communicate first. i'm sure y'all have had some of these discussions already, but it would be helpful for me to hear about it19:18
jbrycei put together an etherpad earlier today where we could capture some ideas https://etherpad.openstack.org/p/infra-services-naming19:19
*** gfidente has quit IRC19:20
jbryceone of the best branding people i worked with always said that great names had some common characteristics they 1) are short, simple to say (or spell) 2) are memorable 3) imply the category and 4) imply the difference within that category19:21
jbrycehitting all 4 is really hard to do. especially if you want the domain name for it. = )19:21
clarkbno kidding19:21
jbrycebut i think they're good goals to shoot for, because ultimately, it means you're communicating a lot every time your name gets used anywhere19:22
jbrycehis favorite example was "thinsulate."  mine is probably "jet ski" but in our space "github" was actually pretty good as well19:23
mordredyup19:23
jbryceand as you start to work your way towards names, there are different types of names - you can have straight up descriptive names, symbolic names, whimsical names, or "empty vessel" names that have no meaning or are invented words (again because of domain names a lot of times)19:24
*** heyongli has quit IRC19:24
*** heyongli has joined #openstack-infra19:24
fungii recall one company i worked for renamed to a nonsense word because it would be easier to get a trademark on it (we already had the domain name for the old name which was an actual dictionary word)19:25
jbrycethe 1st 2 kinds are usually faster to build brand equity around than the last 2, but i think they can all work19:25
jbrycethat spiel is a bit of background about my thoughts in general on naming and branding. basically what i have as goals when trying to pick a name. any feedback on that part?19:27
*** sparkycollier___ has joined #openstack-infra19:27
mordredjbryce: sounds good to me and makes sense19:28
fungino questions on my end19:28
*** eharney has quit IRC19:28
jbrycecoo. if people think that part makes sense then it will give us some goal posts to talk about short listed names when we get to that point19:29
jbryceso the etherpad has 3 sections at the top that are really about describing the brand of these services19:29
jbrycethe first section is basically a place to throw words or phrases that you would love to have associated with the services. i see some good ones in there already19:30
jbrycethe second section is to try to list out some of the things that would make these services different than other alternatives like github/gitlab/etc (doesn't have to be "better than" just "different than")19:30
jbryceand the third section is to list out the kinds people or organizations that should be interested in it and anything that is identifying about them19:31
jbrycethe #freebrainstorm section is a place to put name proposals no matter how good, bad, taken, impractical they might be and the short list is something to gather top candidates in19:32
*** heyongli has quit IRC19:34
*** e0ne has quit IRC19:34
*** heyongli has joined #openstack-infra19:34
*** psachin has quit IRC19:36
*** rossella_s has quit IRC19:38
*** e0ne has joined #openstack-infra19:40
jbrycethere's some really good stuff in those sections19:40
*** rossella_s has joined #openstack-infra19:41
jbrycereading through, it makes me think about one of the things we saw leading into the last summit in vancouver. we do some basic advertising for the summit and some of the most effective ads had this theme of "let's do this"19:41
*** sree has joined #openstack-infra19:42
fungimordred sure loves his farm animals19:42
jbrycelike "let's build open infrastructure" or "let's secure the cloud" or things like that...the collaboration and working on things seemed to be appealing19:42
* mordred hands fungi a box full of what he is pretty sure are bunnies19:43
*** e0ne has quit IRC19:43
mordredjbryce: yes. I like that. there's another facet of that I'd love to capture but don't have good words for ...19:43
jbryceso it's interesting that's an really prevalent idea here too. the collaboration in the sense of enabling collaboration with the tools and services, but also in the sense that the services themselves are a collaboration19:43
*** janki has quit IRC19:43
clarkbI've now got a goat bleat playing in my head19:43
mnaserand collaboration across communities imho19:43
mordredjbryce: which is where "let's do this" diverges from "jfdi" - to me, "let's do this" is about getting stuff done but not burning the world in the process ... because long-term sustaintability is also important19:44
jbrycethe services are made up of other tools that were collaboratively developed across communities, they are operated collaboratively, and they enable collaboration19:44
jbrycemordred: yeah i agree19:44
jbryceit's also an invite19:44
*** heyongli has quit IRC19:44
mordredyes. let's do this ... together19:45
*** heyongli has joined #openstack-infra19:45
mordred"Let us go then, you and I."19:45
fungiwhen the evening is set out against the sky19:46
AJaegerIn an open way - "Let us go then, you and I and let's do it public"?19:46
mordredAJaeger: ++19:46
mordredfungi: ++19:46
*** sree has quit IRC19:46
jbryce"let us git"19:47
jbrycelet us gate19:47
fungiveering close to letsencrypt19:47
sparkycollier___Let's git, together19:47
jbryceand feel all right19:47
mordredfwiw, I mis-remembered the prufrock at first and got myself to ulysses: "Come, my friends, 'Tis not to late to seek a newer world."19:47
*** yamamoto has joined #openstack-infra19:48
*** bobh has quit IRC19:48
AJaegerseek - or build?19:48
mordredAJaeger: ++19:48
*** bobh has joined #openstack-infra19:48
ianwis the idea to move to a self-service model, al-la github/gitlab/git* ?  few clicks and you have repo and gerrit etc etc?  or maintain our current status quo of slightly more overview?19:48
*** lifeless_ has joined #openstack-infra19:49
fungiianw: i think more self-service has always been a goal, but i don't think we need to tie the two together19:49
*** lifeless has quit IRC19:49
clarkbI'd worry that if we tied them together the effort required initially may be large19:49
mordredyah. I'd like to have some more self-service available - but also have the ability for a project, such as OpenStack, to chose that it desires some amount of centralized oversight19:49
fungias long as the project is also willing to provide that oversight19:50
mordredbut eventually ... totally agree with clarkb that tying them together at the outset is rife for failure19:50
mordredfungi: yes19:50
ianwi do worry with more self service we tend towards things open projects often handle badly, such as monitoring for abuse etc19:50
mordredianw: ++19:50
fungiright, there will be a delicate balance19:51
lselli really like the "let's do this" messaging but also think it could be incorporated into a tagline if it doesn't fit into the name19:51
mordredianw: I think we should prioritize providing good service over attempting to be fully self-service19:51
*** roman_g has quit IRC19:51
mordredlsell: ++19:51
jbrycelsell: this is a #FREEBRAINSTORM! your favorite part of the process19:51
mordredI don't want to say many negaitves, but a non-goal is becoming a github clone19:51
fungianyway, the degree of future oversight is probably mostly orthogonal to the naming exercise19:52
lselloops sorry :)19:52
mordredfungi: sake-of-argument - white-glove service is a potential feature we could want to focus on that might influence naming19:53
fungiyes, i can imagine ways in which the two would be related, hence my hedge words ;)19:54
*** yamamoto has quit IRC19:54
*** eernst has quit IRC19:54
*** heyongli has quit IRC19:55
mordred:)19:55
*** heyongli has joined #openstack-infra19:55
*** eernst has joined #openstack-infra19:55
clarkbOur hour is almost up (though not sure we formally made this an hour long meeting), want to amke sure we wrap up with some future direction if we do have to end soon19:55
*** rossella_s has quit IRC19:56
jbrycewell...i like the stuff that's going into the etherpad. here's what i would suggest for moving forward from here. over the next couple of days, keep fleshing out the top 3 sections and also put potential names in the #freebrainstorm section19:56
jbrycei'll try to get some foundation staffers to look through it with their creative hats on too and throw some additional ideas or alternatives19:56
*** e0ne has joined #openstack-infra19:56
jbrycethen next week try to come up with a shortlist of 5-10 names that people like19:57
*** bobh has quit IRC19:57
fungithat sounds doable19:57
*** e0ne has quit IRC19:58
jbryceat that point, we can go a couple of directions...either a vote around it, or start to do some of the next level deeper research on things like domains, trademarks, inappropriate meanings in non-english, etc = )19:58
lselljbryce, could we also add a section in the etherpad with anticipated uses? for example, it was eye opening for me when I thought about the name in context of etherpad.XX.org or storyboard.XX.org etc?19:58
jbrycei was going to do that earlier, but......i couldn't find the other etherpad where we had started listing out the services19:59
lselland just to gut check that i'm thinking about it in the correct way...in terms of the broader services19:59
*** rossella_s has joined #openstack-infra19:59
jbrycebut yes, we should do that19:59
lsellok19:59
mnaserlsell: i think that's a good point, we can list a few of the basic services like gerrit/review, etherpad, ethercalc, storyboard, zuul19:59
fungiit's potentially just about all the services we're not already separately whiteboxing19:59
mnaserhttps://docs.openstack.org/infra/system-config/systems.html19:59
ianwshould we setup an indication-only vote to whittle it down to the short-list?  or delegate pruning it to someone(s)?  (both?)20:00
mnaseryay for docs20:00
corvusalso, the domain name may end up typed in a lot of shell commands.  eg: "git clone https://git.openstack.org/openstack/nova"20:00
mordredyah - I think we may want to offer some of the services optionally whitelabeled20:00
mnasercorvus: yes, that was a big important one for me, openstack is quite easy to type out generally20:00
fungier, whitelabelling, yes. i got my terms confused20:00
jbryceso git.thebestfreesoftwareinfrastructure.org is not ideal20:01
mnaser++20:01
clarkbmordred: ya in general I think we should assume that all services would be offered not white labeled20:01
clarkband then there would be optional whitelabeling where it makes sense?20:02
fungioh, that's a good point too20:02
funginot every project who wants these things is going to have (or even want) a domain name of their own anyway20:02
mordredclarkb: yah. at some point I think it might be a good idea to have a list of "it is possible to provide custom whitelabeled versions of X  Y and Z"20:02
mordredfungi: ++20:02
fungiso even for teh whitelabelled services we'll likely have one under our default label too20:02
jbrycei've got to run. thanks for humoring me on naming theory. feel free to ping me if you have other questions or ideas = )20:03
clarkbfungi: yup exactly20:03
mordredjbryce: thanks a ton!20:03
AJaegerjbryce: thanks!20:03
clarkbyes this was helpful20:03
fungithanks! this was great20:03
fungishall we end the meeting or did we want to continue?20:04
*** heyongli has quit IRC20:05
clarkbseems like we've been idel20:05
clarkbI can end it20:05
clarkb#endmeeting20:05
*** openstack changes topic to "Discussion of OpenStack Developer and Community Infrastructure | docs http://docs.openstack.org/infra/ | bugs https://storyboard.openstack.org/ | source https://git.openstack.org/cgit/openstack-infra/ | channel logs http://eavesdrop.openstack.org/irclogs/%23openstack-infra/"20:05
openstackMeeting ended Wed Jun 13 20:05:32 2018 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)20:05
openstackMinutes:        http://eavesdrop.openstack.org/meetings/winterstack_naming/2018/winterstack_naming.2018-06-13-19.03.html20:05
openstackMinutes (text): http://eavesdrop.openstack.org/meetings/winterstack_naming/2018/winterstack_naming.2018-06-13-19.03.txt20:05
*** sparkycollier___ has left #openstack-infra20:05
openstackLog:            http://eavesdrop.openstack.org/meetings/winterstack_naming/2018/winterstack_naming.2018-06-13-19.03.log.html20:05
*** heyongli has joined #openstack-infra20:05
*** dave-mccowan has joined #openstack-infra20:05
scasback to business. i presume it's a known thing that changes are backed up by an order of hours?20:07
clarkbscas: yes tripleo gate is threashing nodes20:07
*** boden has quit IRC20:08
scasi saw the pattern when checking on one of my changes. delicious.20:09
mordredscas: we like providing tasty things20:09
scasas do i, when the stove works20:10
clarkbthey are aware of the problems and aiui working to fix them20:10
fungii'm about to start whipping up some okonomiyaki20:10
fungispeaking of delicious20:10
Shrews/google okonomiyaki20:12
ianwfungi: not sure if you saw, but i think we can bring up packethost if you like?  https://review.openstack.org/#/c/575019/20:12
ianwi got the mirror up yesterday afternoon after i realised what was up with the floating ips20:12
fungiahh, yeah i've been mostly heads-down on trying to work out a suitable platform for a mailman 3 poc20:12
fungii saw your comments in scrollback, i hadn't seen that change though. thanks!20:12
ianwif we want to merge that for image uploads, i can keep an eye on it during today20:13
*** rossella_s has quit IRC20:14
ianwfungi: https://tarballs.openstack.org/project-config/package-afs-centos7/ seems the --delete didn't do what i thought it would do :/ (from https://review.openstack.org/#/c/574924/)20:14
fungiwhat were you expecting --delete to do?20:15
*** heyongli has quit IRC20:15
clarkbianw: +2 thanks20:15
*** heyongli has joined #openstack-infra20:15
fungi--delete should remove any files from the remote which are not in the local20:16
*** rossella_s has joined #openstack-infra20:16
ianwwell, that :)  remove the 1.6.16 packages and just leave 1.6.2220:17
fungioh, yeah that's curious. were the 1.6.16 packages still hanging around on the source side?20:17
ianwno, since the job is a fresh rpmbuild of the packages on a fresh host20:18
fungirules that out, i guess20:18
fungiianw: odd, looks like it still created https://tarballs.openstack.org/project-config/package-afs-centos7/x86_64/20:19
fungii wonder if the trailing backslash behavior isn't accurately reflected in the src/dest parameters to synchronize20:20
ianwhttp://logs.openstack.org/periodic/git.openstack.org/openstack-infra/project-config/master/project-config-build-openafs-centos/c32f9a0/job-output.txt.gz#_2018-06-13_06_55_59_13417320:20
ianwso it copied it correctly, the x86_64 folder is the old one that i hoped --delete would purge20:21
openstackgerritMerged openstack-infra/project-config master: Remove direct tagging from heat-cfntools ACL  https://review.openstack.org/57507220:23
*** bobh has joined #openstack-infra20:24
fungicould we be running a pre-2.6.7 rsync and not setting recursive?20:24
openstackgerritColleen Murphy proposed openstack-infra/puppet-cgit master: Update Gemfile for Zuulv3  https://review.openstack.org/57198720:25
ianwwhat synchronize: does ... i do not know :)20:25
fungimy rsync(1) manpage notes that prior to 2.6.7, --delete has no effect unless --recursive is enabled20:25
*** heyongli has quit IRC20:25
*** heyongli has joined #openstack-infra20:26
ianwi can play a bit more, it's not a big issue.  just might be good to have a working example20:26
fungioh, and starting with 2.6.7 you either need --recursive or --dirs enabled20:26
fungiso basically, i'm pretty much always running rsync with -a (which implies those) and so --delete does what i expect20:27
fungibut ansible synchronize is a bit of a black box20:27
openstackgerritDarragh Bailey proposed openstack-infra/git-review master: support review URLs as download arguments  https://review.openstack.org/42482320:29
ianwhttps://github.com/ansible/ansible/blob/devel/lib/ansible/modules/files/synchronize.py#L45 suggests archive is true20:29
ianwwell well well, it has a delete flag20:30
ianwhttps://github.com/ansible/ansible/blob/devel/lib/ansible/modules/files/synchronize.py#L6920:30
ianwmaybe i should have read the documentation20:30
fungilookie there20:30
openstackgerritColleen Murphy proposed openstack-infra/puppet-openstack_infra_spec_helper master: Use system-config script to install puppet  https://review.openstack.org/48194320:34
openstackgerritIan Wienand proposed openstack-infra/openstack-zuul-jobs master: package-afs-centos: use synchronize flags for delete  https://review.openstack.org/57522320:35
*** heyongli has quit IRC20:36
*** heyongli has joined #openstack-infra20:36
*** kgiusti has left #openstack-infra20:43
openstackgerritMerged openstack-infra/project-config master: Add packethost us-west-1 to nodepool  https://review.openstack.org/57501920:43
openstackgerritMerged openstack-infra/project-config master: Update list of Monasca repos for GerritBot  https://review.openstack.org/57513520:43
openstackgerritMerged openstack-infra/project-config master: Build wheels against constraints  https://review.openstack.org/57493820:46
openstackgerritMerged openstack-infra/project-config master: Add py35 and readthedocs jobs  https://review.openstack.org/57410220:46
*** heyongli has quit IRC20:46
*** heyongli has joined #openstack-infra20:46
*** jamesdenton has quit IRC20:48
*** eharney has joined #openstack-infra20:49
*** yamamoto has joined #openstack-infra20:50
*** SumitNaiksatam has quit IRC20:54
*** yamamoto has quit IRC20:55
openstackgerritClark Boylan proposed openstack-infra/zuul master: Log github delivery ids properly  https://review.openstack.org/57523120:56
*** heyongli has quit IRC20:56
*** heyongli has joined #openstack-infra20:56
openstackgerritMerged openstack-infra/project-config master: Remove networking-odl carbon jobs from stats  https://review.openstack.org/56731721:00
openstackgerritMerged openstack-infra/project-config master: Remove nitrogen from n-odl grafana  https://review.openstack.org/57240621:00
openstackgerritMerged openstack-infra/project-config master: Remove DragonFlow tagging ACL  https://review.openstack.org/57377221:00
openstackgerritMerged openstack-infra/project-config master: enable storyboard for whereto  https://review.openstack.org/57447121:00
openstackgerritMerged openstack-infra/project-config master: Fix up AFS dashboard  https://review.openstack.org/57353721:00
openstackgerritMerged openstack-infra/project-config master: remove reno job settings  https://review.openstack.org/57440221:00
openstackgerritMerged openstack-infra/project-config master: remove release-test job settings  https://review.openstack.org/57491521:00
*** trown is now known as trown|outtypewww21:01
*** openstackgerrit has quit IRC21:04
ianwoh good, looks like some images have made it into packethost already21:06
*** heyongli has quit IRC21:06
*** heyongli has joined #openstack-infra21:07
fungiwow, fast!21:10
*** slaweq has quit IRC21:12
*** slaweq has joined #openstack-infra21:12
*** openstackgerrit has joined #openstack-infra21:15
openstackgerritDarragh Bailey proposed openstack-infra/git-review master: support review URLs as download arguments  https://review.openstack.org/42482321:15
*** heyongli has quit IRC21:17
*** heyongli has joined #openstack-infra21:17
ianwthey're all ready, unexpectedly quickly :)21:18
clarkbzoom zoom ?21:18
fungiwell, they're all in the same republic. maybe fast pipes?21:18
*** hasharAway has quit IRC21:22
*** lifeless_ has quit IRC21:23
*** lifeless has joined #openstack-infra21:24
*** vivsoni has quit IRC21:24
ianwjust bringing up a xenial node to see what happens21:27
*** heyongli has quit IRC21:27
*** heyongli has joined #openstack-infra21:27
*** nicolasbock has quit IRC21:27
clarkbmtr says us-west is not a very good name for it (appears to be in newark)21:27
clarkbbut hey thats just a string anyway21:28
openstackgerritMerged openstack-dev/pbr master: Update python3 versions in tox.ini envlist  https://review.openstack.org/57465021:29
*** SumitNaiksatam has joined #openstack-infra21:30
*** bobh has quit IRC21:32
ianwError in creating the server: Exceeded maximum number of retries. Exceeded max scheduling attempts 3 for instance 83b3db4e-0c28-474a-8a0e-c8fa26e75dbe. Last exception: Multiple possible networks found, use a Network ID to be more specific.'21:32
ianwhmm21:32
clarkbianw: we have those in an email somewhere, we probably have to provide them I guess21:33
clarkblet me get you that info21:33
ianwi think it's the open-infra net21:33
*** edmondsw has quit IRC21:33
clarkbianw: yup thats the network and you floating ip on external21:34
*** anteaya has joined #openstack-infra21:35
*** edmondsw has joined #openstack-infra21:35
ianwdo we have to put that in nodepool config?21:36
*** felipemonteiro has quit IRC21:36
*** felipemonteiro has joined #openstack-infra21:36
openstackgerritGaetan Semet proposed openstack-dev/pbr master: pbr git-tag command  https://review.openstack.org/56173121:36
clarkbya if it doesn't work as is we probably need to. Sometimes it just works if there is only one network defined in neutron21:36
ianw147.75.38.140 is up, but doesn't seem to have keys21:36
*** lifeless_ has joined #openstack-infra21:36
*** lifeless has quit IRC21:37
clarkbya it doesn't like my key, did you tell it to config drive?21:37
*** heyongli has quit IRC21:37
clarkbglean will only read config drive, not metadata server and nova didn't config drive by default until recently so you have to tell it when booting to use it21:37
*** heyongli has joined #openstack-infra21:37
ianwi believe i did21:37
ianwcloud.create_server('test', image='ubuntu-xenial-1528923131', flavor=flavor, wait=True, auto_ip=True, config_drive=True, timeout=3600, network='open-infra')21:38
*** edmondsw has quit IRC21:40
ianwnot much of interest on the console.  can probably get in via the zuul hack to see what's up21:40
clarkbserver show shows it as config driving too21:41
clarkb++ to zuul hack for now, my guess is config drive didn't tell glean how to configure properly21:41
clarkbianw: fungi I also notice that both users are in the same project so they can see all the servers21:41
clarkbI think typically we want to isolate them so that nodepool doesn't see control plane and vice versa21:41
clarkb(something to follow up on)21:41
fungiyeah, i wondered if that would be a problem (different accounts but same project)21:43
ianw good start : /dev/sr0: UUID="2018-06-13-21-35-23-00" LABEL="config-2" TYPE="iso9660"21:43
fungii did mention separate projects in my original specification but thought maybe they had some secret mechanism of separating the quotas which weren't tied to the project21:43
*** dave-mccowan has quit IRC21:43
clarkbwhile we bootstrap I doubt it is a big issue21:44
clarkbbut probably worth understanding before we start running jobs on it21:44
ianwohhh, hang on, i wonder if we've actually deployed the keys into the cloud?21:44
fungii added the keys role onto that playbook we use for that21:45
clarkbI thought that was in a cron but maybe it is manual?21:45
clarkbspecifically running the clouds setup playbook21:46
ianwyeah, no keys in metadata.  can't remeber if it's manual or not either21:46
clarkbok lunch is here, I'll check back in after21:47
*** heyongli has quit IRC21:47
*** heyongli has joined #openstack-infra21:48
fungimaybe we manually run <tool i can't remember the name of> when turning up a new project/tenant?21:50
*** yamamoto has joined #openstack-infra21:51
ianwit's the cloud launcher ansible ... looking21:52
ianw2018-06-13 21:09:20,083 p=20967 u=root |  TASK [cloud-launcher : os_security_group] **************************************21:53
ianw2018-06-13 21:09:25,883 p=20967 u=root |  fatal: [localhost]: FAILED! => {"changed": false, "failed": true, "msg": "Multiple matches found for default"}21:53
openstackgerritJames E. Blair proposed openstack-infra/zuul master: Add test for shell after include_role  https://review.openstack.org/57448721:54
openstackgerritJames E. Blair proposed openstack-infra/zuul master: Temporarily override Ansible linear strategy  https://review.openstack.org/57524821:54
fungiianw: yeah, so i guess having two providers defined as separate accounts in the same tenant is breaking that too?21:55
clarkboh ya21:57
*** yamamoto has quit IRC21:57
*** rossella_s has quit IRC21:57
openstackgerritJames E. Blair proposed openstack-infra/zuul master: Temporarily override Ansible linear strategy (2/2)  https://review.openstack.org/57524821:58
openstackgerritJames E. Blair proposed openstack-infra/zuul master: Add test for shell after include_role  https://review.openstack.org/57448721:58
*** heyongli has quit IRC21:58
openstackgerritJames E. Blair proposed openstack-infra/zuul master: Temporarily override Ansible linear strategy (1/2)  https://review.openstack.org/57525021:58
*** heyongli has joined #openstack-infra21:58
ianwfungi / clarkb: maybe it's http://paste.openstack.org/show/723416/22:01
*** rossella_s has joined #openstack-infra22:01
*** sree has joined #openstack-infra22:04
*** Goneri has quit IRC22:06
*** heyongli has quit IRC22:08
*** sree has quit IRC22:08
ianwso i can just create another project?  this setup seems a little different22:08
*** heyongli has joined #openstack-infra22:08
*** harlowja has quit IRC22:11
*** rossella_s has quit IRC22:11
*** harlowja has joined #openstack-infra22:12
*** rossella_s has joined #openstack-infra22:14
*** heyongli has quit IRC22:18
*** heyongli has joined #openstack-infra22:18
*** myoung is now known as myoung|off22:20
*** harlowja has quit IRC22:21
openstackgerritFatema Khalid Sherif proposed openstack-infra/storyboard master: Partial-Bug: # 6142  https://review.openstack.org/55707022:24
openstackgerritFatema Khalid Sherif proposed openstack-infra/storyboard master: Changing 'Merged' to 'Resolved'.  https://review.openstack.org/55664822:24
*** rcernin has joined #openstack-infra22:26
*** rcernin is now known as rcernin|brekkie22:27
*** rcernin|brekkie is now known as rcernin22:27
*** heyongli has quit IRC22:28
clarkbianw: I thinkwe need admin for that (which we may have)22:28
*** heyongli has joined #openstack-infra22:29
ianwi can create and delete a project22:29
clarkbya judging by the fact that we can see all those security groups we may have admin? probably the thing to do if that is the case is make a new project for openstackzuul-packethost make that user not admin, then keep openstackci as admin on other project?22:29
ianwi guess if we are admins we can split the quota22:30
anteayaso in the discussion I missed, what is the definition of whitelabel?22:31
clarkbanteaya: it would be providing brand specific labeling on top of generic product22:32
anteayaah thank you22:33
*** slaweq has quit IRC22:33
anteayalike is happening with email lists currently, yes?22:33
clarkbso we could have etherpad.winterstack.org as the generic thing, but then also point etherpad.openstack.org at it22:33
clarkbanteaya: yup22:33
anteayathanks22:33
clarkbianw: thinking out loud here a bit more. Maybe we want ot create a third user and project to be our admin account. Then dial back the access of the other two accounts?22:34
anteayaif you point etherpad.o.o at etherpad.winterscale.org, what name is in the url for the user, etherpad.o.o?22:34
clarkbianw: that would be most similar to our existint setups just with addition of third psecial account22:34
clarkbanteaya: yes22:34
anteayacool, thanks22:34
clarkbanteaya: and since we already avoid any service specific branding each user group would feel like ti was theirs with minimal effort on our end22:35
clarkbthat is until they collided with etherpad names but eh22:35
anteayaa problem for tomorrow22:35
openstackgerritJames E. Blair proposed openstack-infra/zuul master: Temporarily override Ansible linear strategy (1/2)  https://review.openstack.org/57525022:38
openstackgerritJames E. Blair proposed openstack-infra/zuul master: Temporarily override Ansible linear strategy (2/2)  https://review.openstack.org/57524822:38
openstackgerritJames E. Blair proposed openstack-infra/zuul master: Add test for shell after include_role  https://review.openstack.org/57448722:38
*** heyongli has quit IRC22:39
*** heyongli has joined #openstack-infra22:39
clarkbianw: let me know if there is some specific task or tasks I can do to help but otherwise I will assume making changes to the accounts will just be getting in the way and stepping on toes22:39
*** mriedem has quit IRC22:40
ianwclarkb: hmm, yeah, i'm not really sure what to do here either.  just to test, i can create a project and assign it a rather large quota ... if that actually means anything i'm not sure22:40
clarkbianw: the more I think about it the more I like the idea of making an admin specific account then deescalating privs on old accounts22:41
ianwi'm just wondering if that was the intention from packethost22:41
ianwor if they're prefer it setup differently ... i think we should probably loop back with that via fungi and their admins?22:42
clarkbya that can't hurt22:42
*** felipemonteiro has quit IRC22:44
*** neiloy has quit IRC22:47
*** threestrands has joined #openstack-infra22:47
*** threestrands has quit IRC22:47
*** threestrands has joined #openstack-infra22:47
openstackgerritJames E. Blair proposed openstack-infra/zuul master: Allow zuul_return in untrusted jobs  https://review.openstack.org/57517322:48
*** heyongli has quit IRC22:50
*** vivsoni has joined #openstack-infra22:50
*** heyongli has joined #openstack-infra22:51
*** yamamoto has joined #openstack-infra22:53
*** slaweq has joined #openstack-infra22:53
*** yamamoto has quit IRC22:59
*** heyongli has quit IRC22:59
*** heyongli has joined #openstack-infra22:59
clarkbmnaser: https://zuul.openstack.org/stream.html?uuid=bae09735e26f44ed985e53b7b792faea&logfile=console.log its working :) the tests are failing and I have no idea how to debug those at this point. But The job seems to do useful work23:01
mnaserclarkb: do we want to propose moving them forward with CI because right now it’s this hacked up Jenkins23:02
*** eernst has quit IRC23:03
clarkbmnaser: we may want them to look over the above log to see if that is still CI related failures. I think if we want to switch them to zuul full time we also need a new tenant for them. I had expected this process to go a bit moreslowly :)23:03
clarkbI'm also running out of hours today as I need to help get zuul restarted for ansible fixes and then make dinner23:05
*** heyongli has quit IRC23:09
*** heyongli has joined #openstack-infra23:10
*** eernst has joined #openstack-infra23:10
openstackgerritMerged openstack-infra/zuul master: Fix broken command tasks in handlers  https://review.openstack.org/57478623:13
openstackgerritMerged openstack-infra/zuul master: Fix command tasks with free play strategy  https://review.openstack.org/57478723:13
openstackgerritMerged openstack-infra/zuul master: Add blocks to the zuul stream test  https://review.openstack.org/57464323:13
openstackgerritMerged openstack-infra/zuul master: Temporarily override Ansible linear strategy (1/2)  https://review.openstack.org/57525023:13
fungimnaser: you say "hacked up Jenkins" like there's some other kind ;)23:15
* fungi is kidding, of course23:15
fungiclarkb: what restarting do we need to be doing?23:15
mnaserfungi: haha, well, the story isn't all mine to tell but it seems some things have lead to others23:16
clarkbfungi: there are fixes for the ansible 2.5 logging issues, waiting for them to merge ^ some have merged just above23:16
mnaserand kata's ci is running on our cloud only right now23:16
clarkbthere are 2 more I think23:16
mnaserso running it via zuul doesn't change that much23:16
mnaseri had to set it all up yesterday :x23:16
mnaserwith help from their team to add the jobs23:16
clarkbmnaser: I dropped a note in their irc channel with someo of what I've got. I think my plan is to debug the failures tomorrow a bit more and then we can talk about future plans23:17
clarkb(because I'll have a better understanding of what is needed)23:17
fungimnaser: i caught some of that fire drill. i have no comment ;)23:17
mnaseri'm glad that things were lined up and they were able to get back on track in no time :)23:17
mnaserhttp://jenkins.katacontainers.io/23:17
* mnaser just remembered all the jenkins instances we were running23:18
mnaserhttps://docs.openstack.org/infra/publications/2012-jenkins-overview/#(8)23:18
mnaserhttps://docs.openstack.org/infra/publications/2012-jenkins-overview/ from the start23:18
mnaseroh my23:18
mnaserfunky screenshot at slide 1123:19
*** heyongli has quit IRC23:20
clarkbmnaser: ya we speak from experience :)23:20
*** heyongli has joined #openstack-infra23:20
mnasercorvus git review example is on quantum.git23:21
openstackgerritMerged openstack-infra/zuul master: Temporarily override Ansible linear strategy (2/2)  https://review.openstack.org/57524823:21
openstackgerritMerged openstack-infra/zuul master: Add test for shell after include_role  https://review.openstack.org/57448723:21
clarkbmnaser: that really dates it23:21
clarkbcorvus: I think that was the set of changes we needed for the ansible 2.5 fix23:22
clarkband I think we only need to restart the executors23:22
*** dave-mccowan has joined #openstack-infra23:22
mnaserclarkb: my guess is the reason for failures is old docker version23:23
fungiwant to divvy them up? we have 8 in total, right?23:23
clarkbmnaser: really? its using docker from bionic which I thought was very new23:23
clarkbmnaser: but that gives me something to look at thanks23:23
clarkbfungi: 1023:23
mnaserwhat bionic ships != what docker ships so you'll have to use something useful for you23:23
mnaserclarkb: https://github.com/kata-containers/ci/blob/master/jenkins/config.xml#L190-L21523:24
mnaseri'll stop distracting you from your restarts now :)23:24
*** tpsilva has quit IRC23:24
clarkbmnaser: ya when I looked docker didn't have bionic packages23:24
fungiclarkb: you want 01-05 then and i'll take 06-10? or do we just ansible the lot?23:24
openstackgerritMerged openstack-infra/zuul master: Log github delivery ids properly  https://review.openstack.org/57523123:24
clarkbfungi: I think maybe we just upadte git then ansible the lot23:25
fungik23:25
fungii'll pull git updates on 06-1023:25
clarkboh and we have to pip3 install them23:25
corvusclarkb, fungi: o/  sorry i got mesmerized by backscroll23:25
clarkbcorvus: plan above seem goo?23:25
corvusyep23:25
corvusi'll stand by and wait for a task assignment :)23:26
clarkbok looking at 01-0523:26
clarkbcorvus: you can drive ansible to start stop when we are done with git23:26
clarkband pip323:26
corvuskk23:26
*** larainema has joined #openstack-infra23:27
clarkber not zuul01, ze0123:27
* clarkb changes hosts23:27
fungiSuccessfully installed zuul-3.0.4.dev13823:28
clarkbfungi: you just did pip3 install /opt/zuul ?23:28
fungiyeah23:28
fungiafter doing a `git pull --ff-only`23:29
clarkbzuul==3.0.4.dev138  # git sha f4e97aa is what I get from pbr23:29
corvusf4e97aa5b2f97c5f5b0aa7f575708964629b3b0f is the sha we want23:29
*** heyongli has quit IRC23:30
*** heyongli has joined #openstack-infra23:30
fungiokay, done with 06-10 and all match that sha installed23:31
clarkb05 is my last one almost done23:32
clarkb01-05 report 'zuul==3.0.4.dev138  # git sha f4e97aa'23:32
corvusi'll restart now?23:33
fungiplease!23:33
clarkbyup I'm ready23:33
fungiall set23:33
corvuswaiting for shutdown now23:33
*** hongbin has quit IRC23:34
ianwfungi / clarkb: ok, so fiddling around, i've got two projects -- openstackzuul and openstackci, each with respective users assigned _member_ role -> http://paste.openstack.org/show/723421/23:38
*** heyongli has quit IRC23:40
*** heyongli has joined #openstack-infra23:40
fungithat seems reasonable, we just need to update our configs to use those i guess?23:41
clarkbya that looks more like what we typically expect23:41
*** owalsh_ has quit IRC23:41
clarkblooks like at least ze04 has stopped23:43
* fungi feels like he's watching a horse race23:44
clarkband 0523:44
anteayais the track muddy?23:44
tonybWhat's the right way to make a feature request for the zuul web frontend?  Open a story?23:44
clarkbtonyb: yes I think so23:44
tonybclarkb: cool23:45
* tonyb goes to do that23:45
tonybfungi: Thanks for looking at those election changes23:45
clarkbcorvus: fungi looks like 01-05 are done shutting down23:48
*** akhilaki has quit IRC23:49
fungitonyb: i can't admit to having tried them out yet23:50
fungibut there's still time for that ;)23:50
tonybfungi: :)23:50
*** heyongli has quit IRC23:50
corvusyep they're all stopped now.  starting23:50
tonybfungi: it does kinda seem to be a merge it and fix it later kind of repo23:51
*** heyongli has joined #openstack-infra23:51
*** tosky has quit IRC23:51
fungisoftware you use twice a year23:51
tonybfungi: but for the record I did generate a complete electorate with the HEAD of that series23:51
fungii figured you had23:51
tonybfungi: 4 times a year now23:51
fungidetails23:52
tonybfungi: + your random we need $list for the Foundation runs23:52
*** yamamoto has joined #openstack-infra23:55
fungiyup23:55
clarkbcorvus: it appears that jobs are running23:56
clarkbcorvus: https://zuul.openstack.org/stream.html?uuid=9a6e65995eac4eb5b0601a3825045bc6&logfile=console.log I think that may be our canary?23:58
clarkbneutron-tempest-multinode-full on 473718,2123:59

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!