Friday, 2017-12-15

*** ijw has joined #openstack-infra00:00
jeblairokay, i've finished the debug dumps00:00
*** ijw has quit IRC00:00
*** jkilpatr has joined #openstack-infra00:01
*** ijw has joined #openstack-infra00:01
*** ijw has quit IRC00:01
*** ijw_ has joined #openstack-infra00:01
*** andreww has quit IRC00:02
*** lennyb has joined #openstack-infra00:02
openstackgerritPaul Belanger proposed openstack-infra/system-config master: Add javascript alias to cacti.o.o for xenial  https://review.openstack.org/52813200:04
*** rbrndt has quit IRC00:04
openstackgerritMerged openstack-infra/system-config master: Update logstash gearman client firewall rules  https://review.openstack.org/52809700:05
*** ijw_ has quit IRC00:06
openstackgerritPaul Belanger proposed openstack-infra/system-config master: Clean up cacti.o.o node settings  https://review.openstack.org/52813300:09
openstackgerritMerged openstack-infra/system-config master: Remove npm mirroring components  https://review.openstack.org/52812700:12
*** masber has joined #openstack-infra00:12
*** ijw has joined #openstack-infra00:14
*** SumitNaiksatam has quit IRC00:15
*** ijw has quit IRC00:19
jeblairthere are 0 leaked layouts00:20
clarkbthat seems like a good thing but I guess we can't figure out that leak from before without more data00:21
jeblairnope.  the cacti graph showed some bumps recently, so i thought we might have something.00:23
jeblairthe most commonly used objects list doesn't have any red flags either.  about the numbef of objects i'd expect given we currently have 5 layouts in memory00:24
*** caphrim007_ has joined #openstack-infra00:26
*** tosky has quit IRC00:26
*** caphrim007 has quit IRC00:29
openstackgerritPaul Belanger proposed openstack-infra/system-config master: Update cacti host to files.o.o  https://review.openstack.org/52813500:29
*** caphrim007_ has quit IRC00:31
mrhillsmanis there a way to search for etherpads?00:31
clarkbmrhillsman: no00:32
mrhillsman:(00:32
mrhillsmanok, thx00:32
ianwjeblair: is something like 528120,2 supposed to be stuck(ish) or is this a new issue?00:33
clarkbthats largely a side effect of etherpad's design (it is all rendered on the fly so not really indexable)00:33
ianwthe log ends abruptly http://zuulv3.openstack.org/stream.html?uuid=0a956a596f6646f799723f7e97a710fa&logfile=console.log00:33
jeblairianw: another system-config change got similarly stuck a while ago00:35
jeblairianw: i feel certain zuul will timeout eventually.  but i was impatient and bumped it out with a commit message update00:35
jeblairianw: i didn't diagnose the underlying slowness00:36
*** markvoelker has quit IRC00:36
jeblairi'm going to restart zuul and zuul-web now00:36
jeblairianw: which will fix your problem :)00:36
ianwok :)00:37
jeblairyay! it loaded the config!  we're now protected from duplicate dictionary defs00:42
jeblairre-enqueueing00:42
clarkbyaml spec compliant since 2017!00:42
jeblairso glad we didn't wait 2 more weeks00:42
*** shu-mutou-AWAY is now known as shu-mutou00:44
openstackgerritIan Wienand proposed openstack-infra/puppet-etherpad_lite master: Add basic rspec test  https://review.openstack.org/52813000:44
jlvillalclarkb, That will sound more impressive in about 2.5 weeks :)00:44
ianwdon't worry, 2018 will be the year of the TOML00:45
jeblairdon't say that word00:45
ianwby 2020 we should be right back to xml where we started :)00:46
bkeroNew SOAP, I can't wait.00:46
openstackgerritJames E. Blair proposed openstack-infra/puppet-zuul master: Update zuulv3 rewrite rules for keys  https://review.openstack.org/52813800:49
clarkbwaiting for puppet to run is often like waiting for paint to dry00:50
jeblairclarkb, ianw: that's necessary for the version we're running now ^00:50
clarkbjeblair: that gives me something other than watching paint dry to do00:50
clarkbjeblair: reading those rules couldn't we just proxy pass everything to the @zuul_web_url?00:51
jeblairfyi watching plater dry is way more fun than paint -- it visibly changes over a week, making all kinds of beautiful patterns (and of course, continues to invisibly change for the next several years).  i highly recommend it.00:51
jeblairclarkb: i think we're getting there, but some static stuff is still served directly from the doc root00:52
clarkbjeblair: roger00:52
*** PramodJ has joined #openstack-infra00:52
jeblairzuul re-enqueue complete00:53
*** jascott1 has joined #openstack-infra00:53
*** psachin has joined #openstack-infra00:54
clarkbjeblair: is plan to have zuul serve the static stuff so that you can proxy pass? then if that doesn't perform well enough for you you can always do magic in front with apache/nginx/etc ?00:55
*** PramodJ has quit IRC00:55
jeblairclarkb: yeah.  i'd like zuul to serve it all so that's the simplest thing.  then if you wanted to layer '/javascript' rewrite rules or whatever on top of that you can00:56
*** Pramod has quit IRC00:56
jeblairthat means having zuul know about a static location that isn't its own python install directory, which is where mordred's yarn/webpack work comes in00:57
*** jkilpatr has quit IRC00:58
*** Swami has quit IRC00:58
clarkbjeblair: ok iptables updtaed on logstash.o.o in a way that looks correct00:59
jeblairclarkb: incidentally, next time you're waiting for puppet, you may be interested in https://review.openstack.org/527805 (and also it's child, but that's unrelated)00:59
jeblairclarkb: oh, and btw, it's thursday: https://review.openstack.org/52402401:00
clarkbjeblair: oh right so distracted by firewalls01:00
clarkbjeblair: approved01:01
openstackgerritJames E. Blair proposed openstack-infra/system-config master: Add dns servers  https://review.openstack.org/52752601:05
*** sree has joined #openstack-infra01:07
*** cuongnv has joined #openstack-infra01:08
openstackgerritMerged openstack-infra/infra-specs master: Add a spec for top-level project hosting  https://review.openstack.org/52402401:08
fungimrhillsman: worth noting, if there were an etherpad feature which allowed you to search across all pads, it would basically defeat the notion of semi-private pads and the usefulness of read-only urls for pads01:09
mrhillsmanunless there was an option to set a pad to read-only and private :)01:10
mrhillsmans/and/and\/or/01:10
fungiright, those are not (currently) etherpad features. also it has no ability to authenticate someone to have permissions to set a pad to read-only or private01:10
fungibasically no acls01:10
mrhillsmani thought etherpad did have auth01:11
fungiyou can auth usernames basically01:11
mrhillsmani know there is a search plugin01:11
*** rfolco has quit IRC01:12
*** sree has quit IRC01:12
jeblairinfra-root: i'd like to get started landing some project-hosting changes tomorrow.  i've prepared an etherpad as a guide to what's in gerrit so far.  if you could start taking a look at those, i'd appreciate it:  https://etherpad.openstack.org/p/project-hosting01:12
fungijeblair: thanks, pulled up for first thing tomorrow, but i'm about to pack it in for tonight01:14
*** HeOS has quit IRC01:14
jeblairfungi: perfect, thanks and goodnight :)01:14
mrhillsmangoodnight fungi01:15
fungithanks, you all too01:15
mrhillsmanmay your dreams be filled with 1s and 0s01:15
*** sree has joined #openstack-infra01:15
fungithey usually are. like bender, in my nightmares i sometimes see a 201:16
mrhillsman:)01:16
*** yamamoto has quit IRC01:18
*** sree has quit IRC01:20
*** liujiong has joined #openstack-infra01:23
*** r-daneel has quit IRC01:26
*** yamamoto has joined #openstack-infra01:27
*** sree has joined #openstack-infra01:27
openstackgerritMerged openstack-infra/system-config master: Add javascript alias to cacti.o.o for xenial  https://review.openstack.org/52813201:30
*** yamamoto has quit IRC01:32
*** sree has quit IRC01:32
*** jaypipes has quit IRC01:33
*** oomichi_afk is now known as oomichi01:36
*** abelur_ has joined #openstack-infra01:39
*** kota_ has joined #openstack-infra01:39
*** linkmark has quit IRC01:40
openstackgerritIan Wienand proposed openstack-infra/puppet-etherpad_lite master: Add basic rspec test  https://review.openstack.org/52813001:41
*** andreas_s has joined #openstack-infra01:43
*** Sukhdev has quit IRC01:44
*** andreas_s has quit IRC01:47
openstackgerritMerged openstack-infra/system-config master: xenial update for codesearch.o.o  https://review.openstack.org/52812001:48
*** liujiong has quit IRC01:53
*** liujiong has joined #openstack-infra01:54
*** yamamoto has joined #openstack-infra01:57
*** marst has quit IRC01:59
*** yamamoto has quit IRC02:02
*** sree has joined #openstack-infra02:04
*** yamamoto has joined #openstack-infra02:07
*** masber has quit IRC02:10
*** mriedem has quit IRC02:11
*** sree has quit IRC02:11
*** psachin has quit IRC02:16
openstackgerritIan Wienand proposed openstack-infra/puppet-hound master: Fix httpd ordering, add rspec test  https://review.openstack.org/52814202:26
*** cuongnv has quit IRC02:27
*** salv-orlando has joined #openstack-infra02:28
*** cuongnv has joined #openstack-infra02:28
*** stakeda has quit IRC02:28
openstackgerritIan Wienand proposed openstack-infra/puppet-ethercalc master: Update ethercalc to work with Ubuntu Xenial  https://review.openstack.org/52714402:28
openstackgerritIan Wienand proposed openstack-infra/puppet-ethercalc master: Add basic rspec test  https://review.openstack.org/52782202:28
*** stakeda has joined #openstack-infra02:29
*** yamamoto has quit IRC02:29
*** cuongnv_ has joined #openstack-infra02:30
*** yamamoto has joined #openstack-infra02:30
*** salv-orl_ has quit IRC02:31
*** cuongnv__ has joined #openstack-infra02:32
*** cuongnv has quit IRC02:33
*** Apoorva has quit IRC02:34
*** cuongnv_ has quit IRC02:35
*** markvoelker has joined #openstack-infra02:37
*** annp has joined #openstack-infra02:40
*** liujiong has quit IRC02:40
*** harlowja has joined #openstack-infra02:41
*** harlowja has quit IRC02:42
*** harlowja has joined #openstack-infra02:43
*** xarses_ has joined #openstack-infra02:44
*** xarses_ has quit IRC02:44
*** namnh has joined #openstack-infra02:45
openstackgerritIan Wienand proposed openstack-infra/puppet-hound master: Fix httpd ordering, add rspec test  https://review.openstack.org/52814202:46
*** xarses_ has joined #openstack-infra02:46
*** psachin has joined #openstack-infra02:50
*** jbadiapa has quit IRC02:52
*** ijw has joined #openstack-infra02:56
*** ijw has quit IRC02:57
*** ijw has joined #openstack-infra02:57
*** kiennt26 has joined #openstack-infra02:57
*** ijw has quit IRC02:58
*** ijw has joined #openstack-infra02:58
openstackgerritIan Wienand proposed openstack-infra/puppet-ethercalc master: Add basic rspec test  https://review.openstack.org/52782203:02
*** ijw has quit IRC03:03
*** ijw has joined #openstack-infra03:04
openstackgerritIan Wienand proposed openstack-infra/puppet-hound master: Fix httpd ordering, add rspec test  https://review.openstack.org/52814203:05
*** xarses_ has quit IRC03:08
*** ijw has quit IRC03:08
*** markvoelker has quit IRC03:11
*** harlowja has quit IRC03:15
openstackgerritIan Wienand proposed openstack-infra/puppet-hound master: Fix httpd ordering, add rspec test  https://review.openstack.org/52814203:16
*** bobh has quit IRC03:17
*** jappleii__ has joined #openstack-infra03:17
*** ramishra has joined #openstack-infra03:18
*** jappleii__ has quit IRC03:19
*** jappleii__ has joined #openstack-infra03:19
*** threestrands_ has quit IRC03:20
*** cshastri has joined #openstack-infra03:22
*** caphrim007 has joined #openstack-infra03:26
*** cshastri has quit IRC03:27
openstackgerritIan Wienand proposed openstack-infra/puppet-hound master: Fix httpd ordering, add rspec test  https://review.openstack.org/52814203:28
*** SumitNaiksatam has joined #openstack-infra03:30
*** caphrim007 has quit IRC03:31
*** liujiong has joined #openstack-infra03:34
*** masber has joined #openstack-infra03:38
*** sree has joined #openstack-infra03:41
*** andreas_s has joined #openstack-infra03:43
*** gyee has quit IRC03:43
*** ganso has quit IRC03:45
*** armax has quit IRC03:47
*** andreas_s has quit IRC03:48
openstackgerritMerged openstack-dev/pbr master: tests: Increase coverage of requirements parsing  https://review.openstack.org/51865603:49
*** r-daneel has joined #openstack-infra03:52
*** rlandy|rover has quit IRC03:53
openstackgerritIan Wienand proposed openstack-infra/puppet-hound master: Fix httpd ordering, add rspec test  https://review.openstack.org/52814203:56
*** xarses_ has joined #openstack-infra03:56
*** jappleii__ has quit IRC03:56
*** xarses_ has quit IRC04:00
*** xarses_ has joined #openstack-infra04:01
*** xarses_ has quit IRC04:02
*** xarses_ has joined #openstack-infra04:04
*** armax has joined #openstack-infra04:05
*** udesale has joined #openstack-infra04:07
*** r-daneel has quit IRC04:07
*** markvoelker has joined #openstack-infra04:08
*** xarses_ has quit IRC04:14
*** rmcall has joined #openstack-infra04:15
*** armax has quit IRC04:17
openstackgerritIan Wienand proposed openstack-infra/puppet-etherpad_lite master: Add basic rspec test  https://review.openstack.org/52813004:21
openstackgerritYAMAMOTO Takashi proposed openstack-infra/openstack-zuul-jobs master: networking-midonet: Remove some of legacy jobs  https://review.openstack.org/52247104:24
*** vivsoni_ has quit IRC04:24
*** dbecker has quit IRC04:24
*** dhajare has joined #openstack-infra04:25
*** adisky__ has joined #openstack-infra04:27
*** stevebaker has quit IRC04:27
*** dmellado has quit IRC04:27
*** bobh has joined #openstack-infra04:29
*** stevebaker has joined #openstack-infra04:31
*** s-shiono has joined #openstack-infra04:32
*** vivsoni has joined #openstack-infra04:33
*** dmellado has joined #openstack-infra04:35
*** harlowja has joined #openstack-infra04:36
ianwclarkb: 2017-12-15 04:34:45.888316 | primary |   Notice: /Stage[main]/Etherpad_lite/Exec[install_etherpad_dependencies]/returns: You're running a wrong version of node, or io.js is not installed. You're using v4.2.6, we need v0.10.x, v0.11.x or v0.12.x04:38
*** dbecker has joined #openstack-infra04:38
*** ykarel|afk has joined #openstack-infra04:41
*** markvoelker has quit IRC04:42
openstackgerritMerged openstack-infra/puppet-hound master: Fix httpd ordering, add rspec test  https://review.openstack.org/52814204:42
*** harlowja has quit IRC04:45
*** pgadiya has joined #openstack-infra04:48
openstackgerritIan Wienand proposed openstack-infra/puppet-etherpad_lite master: [WIP] try a later version  https://review.openstack.org/52815604:50
*** zhurong has joined #openstack-infra04:56
*** janki has joined #openstack-infra05:00
*** bobh has quit IRC05:01
*** bobh has joined #openstack-infra05:03
*** bobh has quit IRC05:08
*** jascott1 has quit IRC05:09
*** bbc1__ has quit IRC05:10
*** bobh has joined #openstack-infra05:12
*** rosmaita has quit IRC05:14
*** claudiub|2 has joined #openstack-infra05:15
*** bobh has quit IRC05:16
*** harlowja has joined #openstack-infra05:21
*** harlowja has quit IRC05:22
*** bobh has joined #openstack-infra05:24
*** harlowja has joined #openstack-infra05:24
*** bobh has quit IRC05:29
*** harlowja has quit IRC05:29
*** jascott1 has joined #openstack-infra05:32
*** bobh has joined #openstack-infra05:35
*** harlowja has joined #openstack-infra05:38
*** markvoelker has joined #openstack-infra05:39
*** amotoki has joined #openstack-infra05:39
*** bobh has quit IRC05:40
*** bobh has joined #openstack-infra05:44
*** wolverineav has joined #openstack-infra05:47
*** bobh has quit IRC05:48
*** wolverineav has quit IRC05:51
*** janki has quit IRC05:57
*** janki has joined #openstack-infra05:59
*** eumel8 has joined #openstack-infra05:59
*** ykarel|afk is now known as ykarel06:00
*** aeng has quit IRC06:03
*** udesale has quit IRC06:04
*** bobh has joined #openstack-infra06:06
*** udesale has joined #openstack-infra06:06
*** ykarel_ has joined #openstack-infra06:10
*** bobh has quit IRC06:11
*** markvoelker has quit IRC06:11
*** ykarel__ has joined #openstack-infra06:12
*** ykarel has quit IRC06:12
*** bobh has joined #openstack-infra06:13
*** ykarel_ has quit IRC06:14
*** bobh has quit IRC06:18
*** links has joined #openstack-infra06:18
AJaegerianw, frickler, could you review https://review.openstack.org/#/c/528083/ , https://review.openstack.org/526666  and https://review.openstack.org/526942  , please?06:22
*** harlowja has quit IRC06:32
*** kjackal has joined #openstack-infra06:35
*** bobh has joined #openstack-infra06:35
openstackgerritdongwenjuan proposed openstack-infra/zuul master: use local gearman for merger service  https://review.openstack.org/52816206:39
*** jbadiapa has joined #openstack-infra06:39
*** bobh has quit IRC06:40
*** cuongnv__ is now known as cuongnv06:41
*** andreas_s has joined #openstack-infra06:45
openstackgerritAndreas Jaeger proposed openstack-infra/project-config master: Add missing job descriptions  https://review.openstack.org/52816606:46
*** thorre_se has joined #openstack-infra06:47
*** rcernin has quit IRC06:47
openstackgerritMerged openstack-infra/zuul-jobs master: Update javascript jobs to take npm_command variable  https://review.openstack.org/52777006:49
*** thorre has quit IRC06:50
*** thorre_se is now known as thorre06:50
*** andreas_s has quit IRC06:50
*** bobh has joined #openstack-infra06:53
*** bobh has quit IRC06:58
*** ykarel__ is now known as ykarel|meeting07:02
openstackgerritAndreas Jaeger proposed openstack-infra/project-config master: Improve translation jobs  https://review.openstack.org/52816907:06
AJaegerconfig-core, please review to help fixing a few translation jobs ^07:06
*** markvoelker has joined #openstack-infra07:09
openstackgerritAndreas Jaeger proposed openstack-infra/project-config master: Improve zanata-cli download  https://review.openstack.org/52565807:09
*** andreas_s has joined #openstack-infra07:15
*** bobh has joined #openstack-infra07:21
*** udesale has quit IRC07:24
*** HeOS has joined #openstack-infra07:26
*** bobh has quit IRC07:26
*** caphrim007 has joined #openstack-infra07:28
*** andreas_s has quit IRC07:31
*** bobh has joined #openstack-infra07:32
*** caphrim007 has quit IRC07:32
*** kjackal has quit IRC07:33
openstackgerritMerged openstack-infra/project-config master: Update designate-dashboard jobs to *-horizon  https://review.openstack.org/52800407:35
*** claudiub|2 has quit IRC07:35
*** bobh has quit IRC07:37
*** makowals has quit IRC07:38
*** markvoelker has quit IRC07:42
*** slaweq has joined #openstack-infra07:43
*** ykarel_ has joined #openstack-infra07:51
*** udesale has joined #openstack-infra07:51
*** jchhatbar has joined #openstack-infra07:52
*** ykarel__ has joined #openstack-infra07:53
*** ykarel|meeting has quit IRC07:53
*** janki has quit IRC07:53
*** armaan has joined #openstack-infra07:54
*** zhurong has quit IRC07:54
*** makowals has joined #openstack-infra07:56
*** ykarel_ has quit IRC07:56
*** ykarel__ is now known as ykarel|lunch07:57
*** bobh has joined #openstack-infra07:58
*** shardy has joined #openstack-infra08:02
*** bobh has quit IRC08:06
*** florianf has joined #openstack-infra08:10
*** bobh has joined #openstack-infra08:11
*** bobh has quit IRC08:16
*** apetrich has quit IRC08:21
*** ralonsoh has joined #openstack-infra08:21
*** amoralej|off is now known as amoralej08:21
openstackgerritMerged openstack-infra/openstack-zuul-jobs master: Remove obsolete legacy npm lint/test jobs  https://review.openstack.org/52808308:21
*** shu-mutou has quit IRC08:21
*** armaan has quit IRC08:23
*** armaan_ has joined #openstack-infra08:23
*** armaan_ has quit IRC08:24
*** armaan has joined #openstack-infra08:24
*** shardy is now known as shardy_afk08:25
*** ccamacho has joined #openstack-infra08:31
*** xinliang has quit IRC08:32
openstackgerritMerged openstack-infra/project-config master: Improve translation jobs  https://review.openstack.org/52816908:33
*** s-shiono has quit IRC08:34
*** bobh has joined #openstack-infra08:36
*** jtomasek has joined #openstack-infra08:37
*** markvoelker has joined #openstack-infra08:39
*** bobh has quit IRC08:40
*** jpena|off is now known as jpena08:43
*** xinliang has joined #openstack-infra08:44
*** pblaho has joined #openstack-infra08:45
*** shardy_afk is now known as shardy08:48
*** jpich has joined #openstack-infra08:54
*** hashar has joined #openstack-infra08:54
*** salv-orl_ has joined #openstack-infra08:55
*** gibi is now known as giblet08:58
*** salv-orlando has quit IRC08:59
ttxpabelanger: design-summit-prep.o.o you can scrap09:03
*** armaan has quit IRC09:04
*** armaan has joined #openstack-infra09:05
*** lucas-afk is now known as lucasagomes09:07
*** stakeda has quit IRC09:08
*** slaweq has quit IRC09:11
*** markvoelker has quit IRC09:13
*** cuongnv_ has joined #openstack-infra09:17
*** cuongnv has quit IRC09:20
openstackgerritMerged openstack-infra/system-config master: Update elasticsearch firewall rules  https://review.openstack.org/52810109:20
*** armaan has quit IRC09:28
*** armaan has joined #openstack-infra09:28
*** andreas_s has joined #openstack-infra09:31
*** andreas_s has quit IRC09:36
*** apetrich has joined #openstack-infra09:42
*** e0ne has joined #openstack-infra09:43
andreafianw: yeah that's a good point but stack.sh is kind of monolithic so if we don't orchestrate that via ansible we have to orchestrate it in devstack directly09:48
andreafianw: fwiw controller first it's how we do it today in d-g, so perhaps we can start with that and do any optimisations later?09:49
*** derekh has joined #openstack-infra09:50
*** armaan_ has joined #openstack-infra09:52
*** armaan has quit IRC09:52
*** annp has quit IRC09:52
*** electrofelix has joined #openstack-infra09:53
*** tosky has joined #openstack-infra09:54
*** pgadiya has quit IRC09:59
*** cuongnv_ has quit IRC10:03
*** pgadiya has joined #openstack-infra10:04
*** gongysh has joined #openstack-infra10:04
*** jascott1 has quit IRC10:06
*** armaan_ has quit IRC10:06
*** jascott1 has joined #openstack-infra10:06
*** armaan has joined #openstack-infra10:07
*** kiennt26 has quit IRC10:07
*** ykarel|lunch is now known as ykarel10:07
*** liujiong has quit IRC10:09
*** Hal has joined #openstack-infra10:09
*** sree_ has joined #openstack-infra10:10
*** markvoelker has joined #openstack-infra10:10
*** sree_ is now known as Guest359210:10
*** jascott1 has quit IRC10:11
*** eumel8 has quit IRC10:13
*** sree has quit IRC10:13
*** gongysh has quit IRC10:17
*** bobh has joined #openstack-infra10:21
*** ldnunes has joined #openstack-infra10:24
*** bobh has quit IRC10:26
*** yamahata has quit IRC10:27
openstackgerritAndreas Jaeger proposed openstack-infra/storyboard-webclient master: WIP: Testing nodejs-jobs  https://review.openstack.org/52822310:29
*** namnh has quit IRC10:31
openstackgerritAndreas Jaeger proposed openstack-infra/zuul-jobs master: Fix npm-run-test job  https://review.openstack.org/52822410:32
AJaegerfrickler, could you review ^, please? All npm-run-test jobs are currently broken ;(10:32
*** daidv has quit IRC10:39
*** daidv has joined #openstack-infra10:39
*** dmellado has quit IRC10:39
*** dmellado has joined #openstack-infra10:44
*** markvoelker has quit IRC10:44
fricklerAJaeger: +210:48
openstackgerritAndreas Jaeger proposed openstack-infra/storyboard master: Create a StoryBoard gui manual  https://review.openstack.org/32547410:49
AJaegerthanks, frickler10:49
AJaegerconfig-core, infra-root, please review 528224  to fix all npm-run-test jobs.10:50
*** daidv has quit IRC10:50
*** daidv has joined #openstack-infra10:51
jheskethAJaeger: lgtm, but isn't the vars redundant?10:54
*** bobh has joined #openstack-infra10:57
*** Guest3592 has quit IRC10:57
*** sree has joined #openstack-infra10:58
*** daidv has quit IRC10:58
AJaegerjhesketh: yes, indeed. Shall I remove?11:00
*** yuanying has quit IRC11:00
jheskethAJaeger: I'm all for reduced complexity, but it's harmless... frickler: are you still around to re-review?11:01
*** bobh has quit IRC11:02
fricklerjhesketh: yup11:02
*** bobh has joined #openstack-infra11:02
jheskethAJaeger: I can re-do it quickly if you'd like?11:02
jheskethAJaeger: nevermind, you appear to be on it :-)11:03
openstackgerritAndreas Jaeger proposed openstack-infra/zuul-jobs master: Fix npm-run-test job  https://review.openstack.org/52822411:03
AJaegerjhesketh, frickler ^ thanks!11:03
*** sree has quit IRC11:03
jheskethAJaeger: cool, lgtm :-)11:03
*** wolverineav has joined #openstack-infra11:04
*** isq_ has quit IRC11:05
*** isq_ has joined #openstack-infra11:06
*** bobh has quit IRC11:07
*** rfolco has joined #openstack-infra11:12
openstackgerritAndreas Jaeger proposed openstack-infra/project-config master: Fix npm publishing  https://review.openstack.org/52823411:13
openstackgerritAndreas Jaeger proposed openstack-infra/project-config master: Fix npm publishing  https://review.openstack.org/52823411:14
openstackgerritAndreas Jaeger proposed openstack-infra/openstack-zuul-jobs master: Remove legacy-npm-upload job  https://review.openstack.org/52823511:14
AJaegermordred, fungi, you might be interested in those two - a bug in our auto conversion ^11:15
*** sambetts|afk is now known as sambetts11:18
*** slaweq has joined #openstack-infra11:18
*** udesale has quit IRC11:22
*** lucasagomes is now known as lucas-bbl11:23
*** apetrich has quit IRC11:34
openstackgerritMerged openstack-infra/zuul-jobs master: Fix npm-run-test job  https://review.openstack.org/52822411:34
*** yamamoto has quit IRC11:35
*** dtantsur|afk is now known as dtantsur11:38
*** jkilpatr has joined #openstack-infra11:38
*** markvoelker has joined #openstack-infra11:41
*** jtomasek has quit IRC11:44
*** jkilpatr has quit IRC11:51
*** jkilpatr has joined #openstack-infra11:52
*** migi_ is now known as migi11:59
*** bobh has joined #openstack-infra12:02
*** chrisyang_0660 has quit IRC12:04
*** erlon has joined #openstack-infra12:05
*** bobh has quit IRC12:07
*** jkilpatr has quit IRC12:07
*** yamamoto has joined #openstack-infra12:09
*** markvoelker has quit IRC12:13
chandankumarfrickler: https://review.openstack.org/527122 https://review.openstack.org/526863 https://review.openstack.org/526844 https://review.openstack.org/526836 please have a look at these reviews all need one more +212:16
chandankumaran d+w12:16
amotokiAJaeger: you updated npm-run-test job in https://review.openstack.org/#/c/528224/2/zuul.yaml but npm-run-test job now neither of parent and run....12:18
amotokiAJaeger: it is still broken12:18
*** dave-mccowan has joined #openstack-infra12:19
amotokiAJaeger: are you pareparing a fix?12:21
*** smatzek has joined #openstack-infra12:22
*** dave-mcc_ has joined #openstack-infra12:22
frickleramotoki: AJaeger: if we break things, we do it thoroughly it seems. will do a fix12:22
amotokifrickler: AJaeger: this is the new failure mode of npm-run-test https://review.openstack.org/#/c/525670/12:24
*** dave-mccowan has quit IRC12:24
openstackgerritAkihiro Motoki proposed openstack-infra/zuul-jobs master: Fix npm-run-test job  https://review.openstack.org/52824412:25
openstackgerritJens Harbott (frickler) proposed openstack-infra/zuul-jobs master: Fix npm-run-test job once more  https://review.openstack.org/52824512:26
*** kjackal has joined #openstack-infra12:26
frickleramotoki: yes. you were faster with the fix, I'm goind to approve this now, seems pretty obvious once you look at it12:27
*** caphrim007 has joined #openstack-infra12:27
amotokifrickler: thanks12:27
amotokibtw (openstack-)zuul-jobs refactoring breaks project gates several times like this12:28
amotokican't we check whether affected tests really work?12:28
*** jchhatbar has quit IRC12:30
*** catintheroof has joined #openstack-infra12:31
*** caphrim007 has quit IRC12:32
*** bobh has joined #openstack-infra12:32
*** wolverineav has quit IRC12:33
frickleramotoki: yes, we still need to improve at testing patches. at least we are able to test most changes via depends-on now12:33
*** wolverineav has joined #openstack-infra12:34
*** yolanda__ has joined #openstack-infra12:36
*** bobh has quit IRC12:37
*** wolverineav has quit IRC12:38
*** bobh has joined #openstack-infra12:42
*** bobh has quit IRC12:47
*** rosmaita has joined #openstack-infra12:47
*** yamamoto has quit IRC12:48
*** martinkopec has joined #openstack-infra12:50
openstackgerritMerged openstack-infra/zuul-jobs master: Fix npm-run-test job  https://review.openstack.org/52824412:52
*** jpena is now known as jpena|lunch12:55
*** markvoelker has joined #openstack-infra12:56
*** markvoelker has quit IRC12:58
*** claudiub has joined #openstack-infra13:02
*** cshastri has joined #openstack-infra13:03
*** jascott1 has joined #openstack-infra13:08
*** jcoufal has joined #openstack-infra13:12
*** jascott1 has quit IRC13:12
*** rlandy has joined #openstack-infra13:18
*** rlandy is now known as rlandy|rover13:19
*** trown|outtypewww is now known as trown13:20
*** trown is now known as trown|ruck13:20
*** cshastri has quit IRC13:20
*** bobh has joined #openstack-infra13:20
*** martinkopec has quit IRC13:21
*** isviridov_away has quit IRC13:22
*** vaidy has quit IRC13:22
*** flwang has quit IRC13:22
*** flwang has joined #openstack-infra13:23
*** melwitt has quit IRC13:23
*** bobh has quit IRC13:25
*** melwitt has joined #openstack-infra13:25
*** bobh has joined #openstack-infra13:25
*** melwitt is now known as Guest7554713:25
*** bobh_ has joined #openstack-infra13:26
*** isviridov_away has joined #openstack-infra13:27
*** jcoufal has quit IRC13:27
*** clayton has quit IRC13:29
*** pgadiya has quit IRC13:29
*** rhallisey has joined #openstack-infra13:29
*** bobh has quit IRC13:30
*** vaidy has joined #openstack-infra13:31
*** jcoufal has joined #openstack-infra13:31
openstackgerritFabien Boucher proposed openstack-infra/zuul feature/zuulv3: Git driver  https://review.openstack.org/52561413:33
*** yamamoto has joined #openstack-infra13:39
*** arxcruz is now known as arxcruz|off201813:45
dmsimardAJaeger: I'll +W https://review.openstack.org/#/c/526666/ ?13:46
*** mriedem has joined #openstack-infra13:51
*** amoralej is now known as amoralej|lunch13:53
*** jpena|lunch is now known as jpena13:58
*** ykarel is now known as ykarel|away13:59
*** Goneri has joined #openstack-infra14:05
*** ykarel|away has quit IRC14:06
fricklerdmsimard: AJaeger: do we have a patch where we can verify that one?14:07
*** psachin has quit IRC14:07
dmsimardfrickler: yeah it was verified with https://review.openstack.org/#/c/526668/14:08
*** dhajare has quit IRC14:11
openstackgerritMerged openstack-infra/project-config master: Fix npm publishing  https://review.openstack.org/52823414:15
*** apetrich has joined #openstack-infra14:20
*** baoli has joined #openstack-infra14:21
*** cshastri has joined #openstack-infra14:22
*** clayton has joined #openstack-infra14:22
*** signed8bit has joined #openstack-infra14:26
*** jaypipes has joined #openstack-infra14:28
*** jaypipes is now known as leakypipes14:28
openstackgerritMerged openstack-infra/openstack-zuul-jobs master: Remove legacy-npm-upload job  https://review.openstack.org/52823514:30
*** links has quit IRC14:31
*** markvoelker has joined #openstack-infra14:31
AJaegeramotoki, frickler : Thanks for fixing!14:40
AJaegerdmsimard: I +W the change myself now - thanks14:42
*** amoralej|lunch is now known as amoralej14:45
*** lucas-bbl is now known as lucasagomes14:46
openstackgerritMerged openstack-infra/project-config master: Create zuul-ci.org zone repo (1/3)  https://review.openstack.org/52753314:46
AJaegeramotoki: it's currently a manual test - we add a dnm change with depends-on - iff we see risk. The npm-run-test breakage(s) were not seen ;( We need to improve testing. For example, the first change removed a playbook that was in use - something we might be able to catch with "normal" tests. I'm just not sure how to do that yet.14:47
*** openstackgerrit has quit IRC14:48
*** cshastri has quit IRC14:48
*** dhajare has joined #openstack-infra14:48
*** jtomasek has joined #openstack-infra14:50
*** openstackgerrit has joined #openstack-infra14:51
openstackgerritMerged openstack-infra/system-config master: Add dns servers  https://review.openstack.org/52752614:51
*** jtomasek has quit IRC14:54
pabelangerttx: thanks14:54
AJaegerconfig-core, let's do final step for app catalog retirement, please: https://review.openstack.org/52694214:56
openstackgerritMonty Taylor proposed openstack-infra/zuul feature/zuulv3: Use yarn and webpack to manage status and streaming  https://review.openstack.org/48753814:57
openstackgerritMonty Taylor proposed openstack-infra/zuul feature/zuulv3: Add babel transpiling enabling use of ES6 features  https://review.openstack.org/52829514:57
openstackgerritMonty Taylor proposed openstack-infra/zuul feature/zuulv3: Add StandardJS linting and analysis  https://review.openstack.org/52829614:57
openstackgerritMonty Taylor proposed openstack-infra/zuul feature/zuulv3: Fix StandardJS warnings and turn them to errors  https://review.openstack.org/52829714:57
openstackgerritMonty Taylor proposed openstack-infra/zuul feature/zuulv3: Add bundle analysis to the lint target  https://review.openstack.org/52829814:57
*** rcernin has joined #openstack-infra14:57
*** xyang1 has joined #openstack-infra14:58
*** marst has joined #openstack-infra14:59
*** xyang1 has quit IRC14:59
openstackgerritMerged openstack-infra/zuul-jobs master: Revert "Revert "Add sphinx_python variable to sphinx role and job""  https://review.openstack.org/52666614:59
*** xyang1 has joined #openstack-infra14:59
*** myoung is now known as myoung|training15:00
*** xyang has joined #openstack-infra15:00
*** xyang has quit IRC15:01
*** xyang has joined #openstack-infra15:01
*** felipemonteiro_ has joined #openstack-infra15:02
*** jcoufal_ has joined #openstack-infra15:02
*** rlandy|rover is now known as rlandy|rover|brb15:02
*** yamahata has joined #openstack-infra15:03
*** signed8bit is now known as signed8bit_Zzz15:04
*** jcoufal has quit IRC15:04
dmsimardAJaeger, frickler: it should be easy to keep an eye if the release jobs are good with zuulv3.openstack.org/builds.html :)15:04
dmsimardjob name: build-openstack-releasenotes15:04
*** dhajare has quit IRC15:05
*** armaan has quit IRC15:05
*** pbourke has quit IRC15:05
*** xyang1 has quit IRC15:05
*** felipemonteiro__ has joined #openstack-infra15:06
*** Apoorva has joined #openstack-infra15:06
*** pbourke has joined #openstack-infra15:07
*** sree has joined #openstack-infra15:07
*** Goneri has quit IRC15:08
openstackgerritMerged openstack-infra/project-config master: Retiring App Catalog - Final step  https://review.openstack.org/52694215:09
*** felipemonteiro_ has quit IRC15:09
fungifrickler: good points on 52752615:10
*** jascott1 has joined #openstack-infra15:10
fungiin particular, i concur 53/tcp has purposes beyond axfr and signed records15:11
fungibut we'll especially want it once we get dnssec wired up, which hopefully is soon15:11
*** harlowja has joined #openstack-infra15:11
*** sree has quit IRC15:11
jeblairfungi, frickler: ah yep.  i'm not expecting that to be the last change for those servers -- i haven't done much testing of that module; i figured since this isn't in production yet, we can develop it in place.15:12
jeblairfungi: and yes, newer puppet-nsd module requires puppet 4.  1.x seems to be the puppet 3 branch15:12
*** harlowja has quit IRC15:13
fungithanks, that's what i was guessing from their puppet stdlib requirement on 0.2.x15:13
*** Goneri has joined #openstack-infra15:14
clarkbfinally reviewing the mailman multisite stuff is on my list for today15:14
openstackgerritJens Harbott (frickler) proposed openstack-infra/system-config master: Prepare for replacing elasticsearch02  https://review.openstack.org/52830515:14
clarkbjeblair: once we settle on a distribution of nameservers it would probably be a good idea to write that down in the system-cofnig docs (we run in 3 regions globally distributed) or whatever15:15
jeblairclarkb: ++15:15
openstackgerritMerged openstack-infra/project-config master: Create zuul-ci.org zone repo (2/3)  https://review.openstack.org/52753415:16
*** ricky_at_rh_madr has joined #openstack-infra15:16
openstackgerritPaul Belanger proposed openstack-infra/system-config master: Delete design-summit-prep node  https://review.openstack.org/52830615:17
jeblairclarkb, fungi, dmsimard, frickler: i was going to spin the first 2 up in dfw+ord since that's where everything else is... should i consider something else?15:18
*** electrofelix has quit IRC15:19
fungijeblair: that sounds reasonable, but maybe consider dfw and vexxhost or something similarly cross-provider?15:19
jeblairor ord + vexxhost?  (for quota reasons?)15:19
fungican always be a down-the-road thing too i guess15:19
clarkb+1 to vexxhost15:19
*** jascott1 has quit IRC15:19
clarkbwe've been trying to use them more and this is a good example of where that makes sense15:20
fungii mean, my personal nameservers are both in rax though i split them between iad and syd15:20
clarkbI think once we get ipv6 sorted out in ovh they will be in that mix too but I've not heard back from them on that yet15:20
fungifor wider geographic diversity15:20
fricklerrax-dfw seems pretty low on quota, see my remarks in -sprint earlier15:20
dmsimard+1 not to put everything at rax15:21
dmsimardwhether that means using vexxhost or ovh is up for debate15:21
dmsimardvexxhost is only in Montreal afaik, ovh has regions in europe which might be interesting15:21
fungivexxhost we need to remember to request reverse dns entries. ovh we still have ipv6 trouble in for now15:21
*** rbrndt has joined #openstack-infra15:23
fungioh, also i vaguely recall mnaser saying something about not having the ability to set reverse dns entries in ip6.arpa zones, but maybe i'm misremembering or perhaps that's solved now15:23
fungiat any rate, we don't have v6 reverse dns on mirror01.ca-ymq-1.vexxhost.openstack.org15:25
fungiHost 6.d.1.d.2.e.e.f.f.f.e.3.6.1.8.f.0.0.0.0.1.0.0.0.0.0.1.e.4.0.6.2.ip6.arpa not found: 3(NXDOMAIN)15:25
clarkbfungi: we typically don't have reverse records for the mirror nodes fwiw. Maybe have just never asked15:26
clarkb(at least outside of rax)15:26
fungisure, merits double-checking15:26
fungiwe do have v4 reverse dns for for that server, fwiw15:27
*** Apoorva has quit IRC15:28
*** sree has joined #openstack-infra15:28
fungisame story with nb03.openstack.org and planet01.openstack.org (our other two servers there)15:29
*** markvoelker has quit IRC15:29
*** armaan has joined #openstack-infra15:30
*** armax has joined #openstack-infra15:31
*** slaweq has quit IRC15:31
*** jcoufal_ has quit IRC15:33
jeblairit would be nice if our nameservers had working rdns... but i guess we can live without it for a while?15:33
*** sree has quit IRC15:33
clarkbI think so, there aren't expectations for rdns off the top of my head unless dnssec uses it somehow?15:35
*** jcoufal has joined #openstack-infra15:35
jeblairnot that i'm aware of15:36
openstackgerritTobias Henkel proposed openstack-infra/zuul feature/zuulv3: Correctly use project name in getGitUrl  https://review.openstack.org/52830915:38
openstackgerritTobias Henkel proposed openstack-infra/zuul feature/zuulv3: Initialize github auth in getGitUrl if needed  https://review.openstack.org/52831015:38
openstackgerritTobias Henkel proposed openstack-infra/zuul feature/zuulv3: Use configured github server in app mode  https://review.openstack.org/52831115:38
openstackgerritTobias Henkel proposed openstack-infra/zuul feature/zuulv3: Fix github app authentication in _getNeededByFromPR  https://review.openstack.org/52831215:38
openstackgerritTobias Henkel proposed openstack-infra/zuul feature/zuulv3: Add the project to GithubUser  https://review.openstack.org/52831315:38
jeblairPSA: if you're using firefox, you may have an unexpected extension automatically installed by mozilla: https://news.ycombinator.com/item?id=1593173015:39
*** claudiub|2 has joined #openstack-infra15:39
mordredjeblair: that's amazing15:40
clarkbjeblair: just what I've always wanted15:40
jeblairhttps://news.ycombinator.com/item?id=15932234   "At least it's an authentic immersion into the world of dubious computer ethics. "15:40
clarkbfirefox 58 beta also performs less well with gerrit reviews than 57 did15:41
*** rcernin has quit IRC15:41
AJaegerdmsimard: oh, yes! That page is a godsend!15:42
*** claudiub has quit IRC15:42
jeblairAJaeger: we just call him "tristanC"15:42
AJaegerdmsimard: this one is even better: http://zuulv3.openstack.org/builds.html?job_name=publish-openstack-releasenotes15:43
AJaegerall green ;)15:43
mordredjeblair: also - +1 to putting the nameservers in not-rax15:43
AJaegerand the one exception is ignoring my proposed fix ;(15:43
AJaegerjeblair: ;)15:44
* AJaeger thanks tristanC15:44
fungijeblair: clarkb: yeah, you _can_ run a nameserver without it having reverse dns. though we're generally not comfortable running any servers without reverse dns entries, and so missing them on (some of) an authoritative nameserver's addresses seems especially weird. but i agree we can live with it for at least a little while if there's no good alternative15:46
jeblairfungi: gandi supports dnssec on .org, so we should be able to try it out with zuul-ci.org15:46
mnaserWe can do reverse DNS for ipv4 and probably work something out for ipv615:46
mnaserIt is a manual process unfortunately. No API yet. That’s something which needs work on our side15:47
fungijeblair: cool. though, i mean, most registrars have dnssec support these days so i'm not surprised there15:47
jeblairfungi: ya.  the last time i touched dnssec that wasn't the case :)15:47
*** kiennt26 has joined #openstack-infra15:47
fungiheh. i even have an icelandic domain with working dnssec15:48
jeblairsomething something lookaside validation something15:48
*** sree has joined #openstack-infra15:48
fungimnaser: thanks for the confirmation. i was hoping i had imagined that, but i guess not. excited to know when you work out some solution though!15:49
mnaserfungi: I think the options are there we just need to work a bit on implementing hem15:50
mnaserThem*15:50
*** derekh has quit IRC15:50
fungimnaser: we're looking at sticking one of our new authoritative nameservers in our control plane tenant in vexxhost ca-ymq-1 as long as you don't have any concerns (should be a pretty tiny instance and won't generate much traffic at all)15:51
fungino recursive support, no open axfr15:51
*** sree has quit IRC15:52
*** rlandy|rover|brb is now known as rlandy|rover15:54
*** xarses_ has joined #openstack-infra15:54
mnaserfungi: absolutely no concerns at all15:55
mnaserIt looks like you’ve already addressed all the ones that are concerning :p15:55
mnaserSo you don’t end up being part of an amplification attack.15:55
*** makowals has quit IRC15:55
openstackgerritAndreas Jaeger proposed openstack-infra/storyboard-webclient master: WIP: Testing nodejs-jobs  https://review.openstack.org/52822315:56
fungimnaser: yup. we have, well, at least a _few_ people who have run very large public dns deployments over the years ;)16:01
dmsimardclarkb: I'm going to start splitting components for ara 1.0 into different modules (and git repositories) so that, for example, you don't end up installing a bunch of web application dependencies if you only want the callback. The question I have is, do I have to regroup those projects under a governance or something ?16:02
openstackgerritPaul Belanger proposed openstack-infra/system-config master: Clean up openstack_project::server for kdc01 / kdc02  https://review.openstack.org/52831916:02
mnaser😃16:02
dmsimardfungi: ^ perhaps a TC question actually16:02
mordreddmsimard: what's ara under now?16:02
dmsimardmordred: nothing16:02
mordreddmsimard: then no, you have no governance work to do :)16:02
fungidmsimard: you can do whatever you like with that16:03
fungias mordred says16:03
dmsimardmordred: ok so I just set up the group ACL and re-use it and that's it ?16:03
mordreddmsimard: you may want to make them all use the same gerrit acl config file16:03
mordreddmsimard: yup16:03
dmsimardyeah16:03
*** yamamoto has quit IRC16:03
fungiyep, that's it (assuming you're trying to avoid managing membership for per-repo groups)16:03
dmsimardok, I mean maybe one day the project would be under openstack-infra if that's what we want (I wouldn't particularly mind) but right now it's standalone16:04
dmsimardthanks16:04
*** e0ne has quit IRC16:05
dmsimardjeblair: wow that firefox thing is all kinds of messed up16:06
openstackgerritMerged openstack-infra/system-config master: Prepare for replacing elasticsearch02  https://review.openstack.org/52830516:06
clarkbfrickler: ^ that has merged, hopefully ansible puppet applies it soon though you can trigger puppet directly (not sure if you have done that yet and want more infos)16:07
*** sree has joined #openstack-infra16:07
pabelangermnaser: woah, that emjoi was rendered in my weechat client. Need to see how to disable16:08
mnaserHaha!16:08
clarkbI got a blank line16:09
dmsimardmnaser>😃16:09
clarkbalso in weechat, probably because I use old weechat16:09
openstackgerritMerged openstack-infra/system-config master: Clean up cacti.o.o node settings  https://review.openstack.org/52813316:09
dmsimardrendered in both weechat and the glowing bear frontend16:09
dmsimardalways surprised to see those every now and then16:09
*** sree has quit IRC16:12
dmsimardpabelanger: replied to your comments on the continuous deployment dashboard spec, thanks a lot for review16:12
*** ykarel|away has joined #openstack-infra16:13
openstackgerritMerged openstack-infra/system-config master: Delete design-summit-prep node  https://review.openstack.org/52830616:15
openstackgerritMerged openstack-infra/project-config master: Create zuul-ci.org zone repo (3/3)  https://review.openstack.org/52753516:15
*** Hal has quit IRC16:17
*** markvoelker has joined #openstack-infra16:18
*** Guest75547 is now known as melwitt16:18
TheJuliaout of curiosity, Has anything happened that would cause a host key error in a job?16:22
TheJuliahttp://logs.openstack.org/76/528276/1/gate/ironic-inspector-tox-func/d395de2/job-output.txt.gz#_2017-12-15_15_17_53_92319116:22
TheJuliaduring posts, specifically16:23
*** ykarel|away has quit IRC16:24
pabelangerTheJulia: we usually see that is there is a ghost instances still running in a region, it comes back online with same IP, and zuul-executor connects to it.  Let me see which cloud it is16:24
openstackgerritJames E. Blair proposed openstack-infra/system-config master: Add kerberos / afs dns info  https://review.openstack.org/52832316:24
pabelangerinap, so we might be able to ask mgagne to help debug16:25
TheJuliapabelanger: Okay, I won't proceed to freakout then :)16:25
pabelangerTheJulia: yah, for now a recheck would be in order. But thanks for pointing it out16:26
jeblairTheJulia: i feel like that error message has given you permission to freak out, should you feel it's helpful.  :)16:26
TheJulialol16:26
*** sree has joined #openstack-infra16:27
*** claudiub|2 is now known as claudiub16:27
*** rpittau has quit IRC16:30
*** sree has quit IRC16:31
*** dbecker has quit IRC16:32
*** dbecker has joined #openstack-infra16:32
*** dbecker has quit IRC16:32
*** dbecker has joined #openstack-infra16:32
fungiseems to happen semi-regularly in inap from what i've seen. nova loses track of a vm and it's still running and fighting (probably via arp-overwrite) with an address reassigned by nova to a newly-booted instance16:34
*** hashar has quit IRC16:35
fungii think they must have some separate/async cleanup pass catching those, because by the time we notice the job failures the address is no longer in use/responding16:35
ianychoiAJaeger, Hello, may I ask which part in a log file: http://logs.openstack.org/periodic/git.openstack.org/openstack/horizon/stable/pike/propose-translation-update/b014a70/job-output.txt.gz in http://lists.openstack.org/pipermail/openstack-i18n/2017-December/003163.html is related with Arabic language? I cannot find appropriate pointer on Arabic language even though I skimmed the log file..16:35
* fungi needs to go run some lunchtime errands, but will bbiaw16:36
*** caphrim007 has joined #openstack-infra16:36
openstackgerritTobias Henkel proposed openstack-infra/zuul feature/zuulv3: Correctly use project name in getGitUrl  https://review.openstack.org/52830916:36
AJaegerianychoi: http://logs.openstack.org/periodic/git.openstack.org/openstack/horizon/stable/pike/propose-translation-update/b014a70/job-output.txt.gz#_2017-12-12_06_18_59_03430016:37
AJaegerand further below "msgfmt: found 4 fatal errors"16:37
AJaegermordred: are you around?16:37
ianychoiOh stable/pike.. I see thanks!16:38
openstackgerritPaul Belanger proposed openstack-infra/system-config master: Add kdc04.o.o xenial node  https://review.openstack.org/52832816:40
openstackgerritAndreas Jaeger proposed openstack-infra/zuul-jobs master: npm-test needs xvfb etc  https://review.openstack.org/52832916:40
openstackgerritAndreas Jaeger proposed openstack-infra/zuul-jobs master: npm-test needs xvfb etc  https://review.openstack.org/52832916:42
openstackgerritJames E. Blair proposed openstack-infra/zone-zuul-ci.org master: Initial commit  https://review.openstack.org/52833116:42
openstackgerritAndreas Jaeger proposed openstack-infra/storyboard-webclient master: Migrate some jobs in-tree  https://review.openstack.org/52822316:42
jeblairfungi: ^ seem like a reasonable layout?    https://review.openstack.org/52833116:43
AJaegermordred - found and fixed it myself - see 528329  and 52822316:43
AJaegerfungi, amotoki, dmsimard sorry one more fix needed, testing now ^16:43
openstackgerritAndreas Jaeger proposed openstack-infra/storyboard-webclient master: Migrate some jobs in-tree  https://review.openstack.org/52822316:45
openstackgerritAndreas Jaeger proposed openstack-infra/project-config master: Remove some legacy nodejs storyboard-webclient jobs  https://review.openstack.org/52833316:45
*** d0ugal has quit IRC16:45
openstackgerritAndreas Jaeger proposed openstack-infra/openstack-zuul-jobs master: remove migrate storyboard-webclient jobs  https://review.openstack.org/52833416:46
*** ender948 has joined #openstack-infra16:47
ender948hi16:48
openstackgerritAndreas Jaeger proposed openstack-infra/storyboard-webclient master: Migrate some jobs in-tree  https://review.openstack.org/52822316:49
AJaegermnaser: is https://review.openstack.org/#/c/526983/ for the puppet PTL?16:50
mgagnefungi: our team is working on it16:52
ianychoiAJaeger, I fixed the Arabic string (Strangely, I just searched propose-translation-update-horizonmaster branch failure..), and I think the translation job will work fine for stable/pike branch.16:55
mgagnenow if someone can tell me if running_deleted_instance_action config in Nova is actually working or if it's bugged/broken...16:56
*** signed8bit_Zzz is now known as signed8bit16:57
AJaegerianychoi: btw. do you know http://zuulv3.openstack.org/builds.html?job_name=propose-translation-update - that's a nice overview ;)16:57
AJaegerianychoi: thanks, glad to hear!16:57
*** ricky_at_rh_madr has quit IRC16:58
*** kiennt26 has quit IRC16:59
ianychoiAJaeger, I started to observe some failure from http://status.openstack.org/openstack-health/#/test/propose-translation-update - I don't know why master branch jobs failed..16:59
*** tosky has quit IRC16:59
ianychoiAJaeger, I might have started from different failure situation rather than the e-mail16:59
AJaegerianychoi: ah, so master fails as well - let's check...17:00
AJaegerianychoi: "echo 'Job already approved, exiting'" for today's job17:01
openstackgerritTobias Henkel proposed openstack-infra/zuul feature/zuulv3: Initialize github auth in getGitUrl if needed  https://review.openstack.org/52831017:02
openstackgerritTobias Henkel proposed openstack-infra/zuul feature/zuulv3: Use configured github server in app mode  https://review.openstack.org/52831117:02
AJaegerianychoi: and indeed, see https://review.openstack.org/#/c/527310/ - zuul did not get the event. Let's recheck...17:02
ianychoiAJaeger, aha.. haha that also causes some failure.. :)17:02
*** jpich has quit IRC17:02
openstackgerritMonty Taylor proposed openstack-infra/zuul feature/zuulv3: Use yarn and webpack to manage status and streaming  https://review.openstack.org/48753817:02
openstackgerritMonty Taylor proposed openstack-infra/zuul feature/zuulv3: Add babel transpiling enabling use of ES6 features  https://review.openstack.org/52829517:02
openstackgerritMonty Taylor proposed openstack-infra/zuul feature/zuulv3: Add StandardJS linting and analysis  https://review.openstack.org/52829617:03
openstackgerritMonty Taylor proposed openstack-infra/zuul feature/zuulv3: Fix StandardJS warnings and turn them to errors  https://review.openstack.org/52829717:03
openstackgerritMonty Taylor proposed openstack-infra/zuul feature/zuulv3: Add bundle analysis to the lint target  https://review.openstack.org/52829817:03
*** pblaho has quit IRC17:03
*** yamamoto has joined #openstack-infra17:03
*** d0ugal has joined #openstack-infra17:04
openstackgerritTobias Henkel proposed openstack-infra/zuul feature/zuulv3: Fix github app authentication in _getNeededByFromPR  https://review.openstack.org/52831217:05
openstackgerritTobias Henkel proposed openstack-infra/zuul feature/zuulv3: Add the project to GithubUser  https://review.openstack.org/52831317:05
*** dtantsur is now known as dtantsur|afk17:05
mgagnepabelanger, fungi: the orphan instance got deleted17:06
*** ramishra has quit IRC17:07
openstackgerritAndreas Jaeger proposed openstack-infra/zuul-jobs master: npm-test needs xvfb etc  https://review.openstack.org/52832917:07
*** jpena is now known as jpena|off17:08
mordredAJaeger: ^^ that lgtm - but since I haven't been tracking all the things fully - is there a reason to not just add xvfb and friends to bindep.txt ?17:08
ender948Well, I will see all of you next Friday.17:09
AJaegermordred: some repos have not done it ;( But we also need to run xvfb and set DISPLAY:9917:09
AJaegermordred: and those two are the important ones17:09
mordredAJaeger: gotcha17:09
AJaegermordred: how are you today?17:10
mordredAJaeger: doing better - still a little iffy, but I think I'm past the worst of it and *possibly* human again17:10
AJaegerglad to hear17:10
mordredof course, I'm celebrating by subjecting people to javascript tooling patches17:10
AJaegerwhat is the status of the docs jobs? We need to move forward with them since publishing for some projects (all using horizon or neutron in required-projects) is still broken ;(17:11
*** yamamoto has quit IRC17:11
openstackgerritMerged openstack-infra/zuul-jobs master: Install yarn if needed in javascript jobs  https://review.openstack.org/52777117:11
*** amoralej is now known as amoralej|off17:11
AJaegermordred: yeah, took us three changes to fix one of your changes ;)17:12
AJaegerhope 52771 does not cause similar trouble :)17:12
AJaegermordred: I also cleaned up a few npm jobs. Now we need the npm docs *publishing* job - but before doing that, i wanted to see all your docs publishing changes in...17:13
mordredAJaeger: yes, I agree ... once we land the main docs change, we can get rid of the nodejs-npm-docs job - and just use the sphinx job17:14
AJaegermordred: really? Let's test that, please ;)17:15
mnaserAJaeger: checking with team first re: puppet zuul jobs17:16
openstackgerritTobias Henkel proposed openstack-infra/zuul feature/zuulv3: Use configured github server in app mode  https://review.openstack.org/52831117:16
openstackgerritTobias Henkel proposed openstack-infra/zuul feature/zuulv3: Fix github app authentication in _getNeededByFromPR  https://review.openstack.org/52831217:16
openstackgerritTobias Henkel proposed openstack-infra/zuul feature/zuulv3: Add the project to GithubUser  https://review.openstack.org/52831317:16
mordredAJaeger: yah - I mean, that's the ultimate goal- that we have one sphinx job that builds sphinx things regardless of what language the project happens to be written in ... but yes to demonstrating .... lemme push up a depends-on patch17:16
*** jascott1 has joined #openstack-infra17:16
AJaegermnaser: sure, thanks17:17
amotokimordred: AJaeger: regarding npm-run-test, i think adding chromium and xvfb to bindep.txt is the right solution, but previously they are installed during the test setup, so the sudden change is not good.17:17
AJaegerconfig-core, can we merge https://review.openstack.org/#/c/525690 , please?17:17
AJaegersorry, zuul-cores ^17:18
openstackgerritAndreas Jaeger proposed openstack-infra/zuul feature/zuulv3: Use python3 for docs publication  https://review.openstack.org/52571817:18
AJaegermordred: anything else that can go in besides 525690  and 525718 ?17:18
jeblairAJaeger: if you're ready for it, yep.  :)17:18
AJaegerjeblair: we hope we are - dependency is in, tests worked17:19
AJaegermordred: what is missing for https://review.openstack.org/521145 ?17:19
AJaegerthanks, jeblair17:19
jeblairAJaeger: 525718 depends on 521557 which you -117:19
amotokimordred: AJaeger: we need to add them to bindep.txt in each repo before dropping them. I haven't added them to horizon bindep.txt to horizon yet. is it better to start to add them to project bindep.txt?17:20
AJaegerjeblair: indeed...17:21
*** jascott1 has quit IRC17:21
AJaegeramotoki: we first would need to make the Xfvb invocation dependend on whether xfvb is installed (in zuul-jobs repo).17:21
AJaegeramotoki: so, right now adding them is nice but we cannot remove them yet.17:21
amotokiAJaeger: I see. that totally makes sense.17:22
amotokiAJaeger: I think we need to announce it to horizon plugins too (perhaps via the dev list)17:23
AJaegeramotoki: if you want to do it, go for it! Right now that cleanup has no priority for me. I need the job working and then will fix other things17:24
pabelangermgagne: woot, thanks!17:25
mgagnepabelanger: now to debug why running_deleted_instance_action=reap doesn't work for us...17:25
AJaegermordred: did you see my -1 on https://review.openstack.org/#/c/521557/ ?17:25
mordredAJaeger: https://review.openstack.org/528349 Add sphinx doc building job17:25
mordredAJaeger: looking17:25
pabelangermgagne: ++17:25
dmsimardjeblair, AJaeger: I just -W'd https://review.openstack.org/#/c/525690/17:26
*** ender948 has quit IRC17:26
dmsimarddon't let that merge, it's the wrong setting17:26
amotokiAJaeger: I can send a mail. I understand your situation and agree it is not a priority. merging changes in multiple repos will take time, so I just think it is better to request plugin maintainers to do that earilier.17:26
AJaegerdmsimard: oh? Please tell why...17:27
*** sree has joined #openstack-infra17:27
AJaegeramotoki: sure, appreciated!17:27
dmsimardAJaeger: adding a comment now17:27
mordredAJaeger: oh-  thnaks - that's a rebase issue17:27
AJaegerdmsimard: sure17:27
dmsimardAJaeger: commented17:28
AJaegerdmsimard: thanks! Will fix17:29
dmsimardnot sure if putting a -W vote on a +W patch actually prevents the merge17:29
jeblairit will17:29
jeblairfwiw, the docs still build17:29
jeblairi imagine they're just building with py217:29
dmsimardyeah17:30
jeblairhttp://logs.openstack.org/90/525690/5/gate/build-openstack-sphinx-docs/a6ea0c7/html/17:30
AJaegerdmsimard: indeed, we changed the dependent change but not this one ;(17:30
dmsimardno worries17:30
*** sree has quit IRC17:31
openstackgerritAndreas Jaeger proposed openstack-infra/zuul feature/zuulv3: Update sphinx jobs to use python3  https://review.openstack.org/52569017:31
AJaegerfix ^17:31
dmsimard+217:32
*** lukebrowning has joined #openstack-infra17:33
openstackgerritMonty Taylor proposed openstack-infra/project-config master: Use the new sphinx PTI for special publish jobs  https://review.openstack.org/52155717:33
openstackgerritMonty Taylor proposed openstack-infra/project-config master: Switch remaining docs publications jobs to sphinx  https://review.openstack.org/52573417:33
mordredAJaeger: ^^ there you go17:34
*** lucasagomes is now known as lucas-afk17:35
mordredamotoki, AJaeger: for javascript/sphinx integration, we have sphinx docs for narrative docs and jsdoc for SDK level docs - we can see using the second in legacy-js-openstack-lib-nodejs6-npm-sdk-docs17:38
AJaegerthanks, mordred17:38
mordredto my knowledge, nothing is using 'npm run docs' or 'npm docs' except for js-openstack-lib and js-generator-openstack17:39
mordredwhile working on the zuul javascript stuff, I came across https://pypi.python.org/pypi/sphinx-js/ - which allows one to incorporate jsdoc annotations in a set of sphinx docs like we do with python docs17:40
*** sambetts is now known as sambetts|afk17:40
*** dprince has joined #openstack-infra17:41
*** ender948 has joined #openstack-infra17:42
mordredamotoki, AJaeger: for now it doesn't seem like it's a problem we ACTUALLY need to solve collectively since there are only two projects (both of which are very unactive)17:43
AJaegermordred: 521557 LGTM - but something fishy is still going on with javascript-run-test; so will look at that now17:43
mordredamotoki, AJaeger: but I wanted to bring sphinx-js to your attention in case we *do* get to a point where we want to incorporate jsdoc annotations - it seems like potentially a nice way to do so17:43
*** ender948 has quit IRC17:43
AJaegermordred: 528223 is the javascript problem. Not sure whether it's your change or mine that is broken...17:44
mordredAJaeger: looking17:44
*** ender948 has joined #openstack-infra17:46
jeblairfungi: let me know when you're back... i have some dns questions for yo17:46
AJaegermordred: I'll take care of dinner in a few minutes...17:46
AJaegermordred: http://logs.openstack.org/23/528223/5/check/nodejs-npm4-run-test-unit/d8656ba/job-output.txt.gz#_2017-12-15_17_36_20_686331 "MODULE failure"?17:46
AJaegermordred: in apt-cache update???17:46
*** sree has joined #openstack-infra17:47
clarkbAJaeger: ara says 'sudo: a password is required'17:48
AJaegermordred: argh ;(17:48
AJaegerclarkb: thanks17:48
*** baoli has quit IRC17:48
mordredAJaeger: darnit. what's trying to run an apt-get update after we do revoke-sudo?17:49
clarkbAJaeger: sudo is revoked by the earlier pre playbook17:49
mordredbtw - important as it is, revoke-sudo makes composing things through inheritance VERY hard17:49
AJaegermordred: indeed - that's why we need the pre-test.yaml17:50
mordredyup17:50
AJaegerso, what exactly is needing sudo and fails?17:50
openstackgerritDavid Moreau Simard proposed openstack-infra/project-config master: Create the "ara-web" project  https://review.openstack.org/52835817:50
mordredAJaeger: the content of pre-test.yaml17:51
mordredAJaeger: we need to remove the 'parent: nodejs-npm' from nodejs-npm-run-test17:51
*** sree has quit IRC17:51
*** signed8bit is now known as signed8bit_Zzz17:52
AJaegermordred: argh, yes.17:52
AJaegerseen it - on it...17:52
AJaegerthanks17:52
openstackgerritDavid Moreau Simard proposed openstack-infra/project-config master: Add Zuul project layout for ara-web  https://review.openstack.org/52836017:52
mordredclarkb: have a sec to +3 https://review.openstack.org/#/c/525690/ ? it's ready17:54
openstackgerritMerged openstack-infra/system-config master: Clean up openstack_project::server for kdc01 / kdc02  https://review.openstack.org/52831917:54
openstackgerritAndreas Jaeger proposed openstack-infra/zuul-jobs master: npm-test needs xvfb etc  https://review.openstack.org/52832917:54
AJaegerclarkb, mordred ^17:54
*** lukebrowning_ has joined #openstack-infra17:55
*** ralonsoh has quit IRC17:55
*** ntpttr__ has joined #openstack-infra17:55
mordredAJaeger: ++17:55
* AJaeger rechecked https://review.openstack.org/#/c/528223/ for testing...17:56
*** ntpttr_ has quit IRC17:56
AJaegermordred: so, my first try to fix your javascript change was broken - and 528329 fixes my first one ;( Hope it's good now...17:56
* AJaeger prepares dinner instead of waiting for results ;)17:57
openstackgerritJames E. Blair proposed openstack-infra/zuul feature/zuulv3: Fix doc typo  https://review.openstack.org/52836117:58
mordredAJaeger: yay for dinner17:58
*** lukebrowning has quit IRC17:58
openstackgerritMerged openstack-infra/system-config master: Add kdc04.o.o xenial node  https://review.openstack.org/52832817:59
openstackgerritMerged openstack-infra/system-config master: Add kerberos / afs dns info  https://review.openstack.org/52832317:59
*** shardy has quit IRC18:00
*** rmcall has quit IRC18:00
openstackgerritDavid Moreau Simard proposed openstack-infra/project-config master: Create the "ara-web" project  https://review.openstack.org/52835818:01
openstackgerritDavid Moreau Simard proposed openstack-infra/project-config master: Add Zuul project layout for ara-web  https://review.openstack.org/52836018:01
*** baoli has joined #openstack-infra18:03
*** aarefiev has quit IRC18:04
*** jascott1 has joined #openstack-infra18:05
*** catintheroof has quit IRC18:07
*** catinthe_ has joined #openstack-infra18:07
*** sree has joined #openstack-infra18:08
AJaegermordred: please +W 528329 - the storyboard-webclient jobs are passing, so we're good...18:08
AJaegermordred: and feel free to review the rest of the stack (follow the needed-by), please18:08
mordredAJaeger: stack +3 from me18:10
AJaegermordred: thanks18:10
mgagnepabelanger: so I found another orphan instance. I'm gonna reserve the IP so Nova doesn't use it and use that orphan instance to debug the reaper.18:10
pabelangerack18:12
*** sree has quit IRC18:13
*** wolverineav has joined #openstack-infra18:13
openstackgerritMerged openstack-infra/zuul feature/zuulv3: Update sphinx jobs to use python3  https://review.openstack.org/52569018:14
openstackgerritMerged openstack-infra/zuul feature/zuulv3: Add implied-branches pragma directive  https://review.openstack.org/52780518:14
openstackgerritMerged openstack-infra/zuul feature/zuulv3: Add debug project-pipeline option  https://review.openstack.org/52782818:14
*** ender948 has left #openstack-infra18:14
*** rkukura has quit IRC18:16
*** ram5391 has joined #openstack-infra18:16
*** ram5391 has quit IRC18:17
openstackgerritMerged openstack-infra/zuul-jobs master: npm-test needs xvfb etc  https://review.openstack.org/52832918:22
*** lukebrowning_ has quit IRC18:24
*** thiagolib has quit IRC18:29
*** trown|ruck is now known as trown|lunch18:29
*** nicolasbock has joined #openstack-infra18:29
openstackgerritMerged openstack-infra/zuul feature/zuulv3: Fix doc typo  https://review.openstack.org/52836118:30
openstackgerritTobias Henkel proposed openstack-infra/zuul feature/zuulv3: Add support for protected jobs  https://review.openstack.org/52298518:31
openstackgerritMonty Taylor proposed openstack-infra/zuul feature/zuulv3: Add babel transpiling enabling use of ES6 features  https://review.openstack.org/52829518:32
openstackgerritMonty Taylor proposed openstack-infra/zuul feature/zuulv3: Add StandardJS linting and analysis  https://review.openstack.org/52829618:32
openstackgerritMonty Taylor proposed openstack-infra/zuul feature/zuulv3: Fix StandardJS warnings and turn them to errors  https://review.openstack.org/52829718:32
openstackgerritMonty Taylor proposed openstack-infra/zuul feature/zuulv3: Add bundle analysis to the lint target  https://review.openstack.org/52829818:32
*** rmcall has joined #openstack-infra18:36
*** rkukura has joined #openstack-infra18:38
*** armaan has quit IRC18:38
*** baoli has quit IRC18:42
*** ccamacho has quit IRC18:44
*** baoli has joined #openstack-infra18:46
*** rkukura has quit IRC18:49
*** mriedem has quit IRC18:51
openstackgerritAndreas Jaeger proposed openstack-infra/zuul-jobs master: translations: Check for translation-source first  https://review.openstack.org/52836918:56
mgagnepabelanger: so it appears that if you have cellsv1, you try to delete an instance, it's marked as deleted in API database but fails for reasons to delete in compute cell/database, nothing in Nova will try to reconcile the state of the instance in the compute database. The compute database will stay out of sync and instance reaper won't catch it because the instance is not deleted in the compute database.18:57
*** ihrachys has joined #openstack-infra18:57
AJaegermordred: javascript run-test jobs are passing again for those projects where I saw failures...18:57
mordredAJaeger: \o/18:59
*** e0ne has joined #openstack-infra19:00
*** signed8bit_Zzz is now known as signed8bit19:02
*** szaher has quit IRC19:02
*** lukebrowning has joined #openstack-infra19:02
*** gyee has joined #openstack-infra19:08
openstackgerritMonty Taylor proposed openstack-infra/zuul feature/zuulv3: Fix StandardJS warnings and turn them to errors  https://review.openstack.org/52829719:15
openstackgerritMonty Taylor proposed openstack-infra/zuul feature/zuulv3: Add bundle analysis to the lint target  https://review.openstack.org/52829819:15
openstackgerritMonty Taylor proposed openstack-infra/zuul feature/zuulv3: Fix source_url handling for jobs view  https://review.openstack.org/52837319:15
openstackgerritMonty Taylor proposed openstack-infra/zuul feature/zuulv3: Make bundle of build web content  https://review.openstack.org/52837419:15
*** szaher has joined #openstack-infra19:18
openstackgerritAndreas Jaeger proposed openstack-infra/infra-manual master: Explain that we need 3 changes for new projects  https://review.openstack.org/52837519:20
AJaegerjeblair, infra-root: Please review the document above for new project creation. We recently run into a race and thus jeblair suggested to split the first change for new projects ^19:20
*** catinthe_ has quit IRC19:21
openstackgerritMerged openstack-infra/storyboard-webclient master: Migrate some jobs in-tree  https://review.openstack.org/52822319:21
*** e0ne has quit IRC19:22
AJaegerinfra-root, config-core, please read 528375 so that you are aware of this when reviewing19:23
AJaegerdmsimard: or when creating new repos ^19:23
*** dprince has quit IRC19:23
AJaegerconfig-core, could you review https://review.openstack.org/#/c/528333/ - as followup to 528223 that just merged19:24
dmsimardAJaeger: I think I need to know what the underlying problem is to understand properly the doc change19:24
dmsimardAJaeger: what happened ? what's the race ?19:24
AJaegerdmsimard: jeblair talked in scrollback a few days ago about it.19:24
*** dprince has joined #openstack-infra19:25
dmsimardfew days ago :/19:25
AJaegerbasically: We have two changes: add to gerrit/projects and to zuul/main.yaml19:25
AJaegerso, zuul got the change before the repo was created19:25
dmsimardthree, because jobs need to be added only after main.yaml was updated19:25
*** bobh_ has quit IRC19:25
AJaegerdmsimard: the *first* change touches two files: gerrit/projects and zuul/main.yaml basically (so far)19:26
AJaegerWe need to merge first gerrit/projects so that the repo is created19:26
dmsimardhmm you said two changes and mentioned gerrit/projects and zuul/main.yaml separated so I assumed these were two separate changes19:26
AJaegerand then merge zuul/main.yaml (second step)19:26
dmsimardyeah ok19:26
AJaegerdmsimard: old way vs new. Sorry19:27
dmsimardbut the jobs can't be added in the same patch as main.yaml19:27
dmsimardso it's really 3 changes19:27
dmsimard2 changes was already bad but 3 changes is very meh19:27
AJaegerjeblair had to restart zuul since it cached the repo did not exist - and neer checked again.19:27
*** sree has joined #openstack-infra19:27
dmsimardyeah the problem makes sense to me now19:27
AJaegerdmsimard: I don't like it either ;(19:27
jeblairwe should theoretically be able to create repos and add to main.yaml in the same change, however, since project-config isn't version locked during the ansible run, it can change between gerrit and zuul.19:27
AJaegerdmsimard: I think out of 20 repos, it only hit us once - but was only fixable with zuul scheduler restart19:28
jeblairthat's the first thing for someone to fix :)19:28
jeblairAJaeger: it didn't cache the result.  it would have been fixed at the next config reload.19:28
dmsimardjeblair: yeah I understand the problem. My brain is fried for the week or I'd try to come up with something19:28
AJaegerjeblair: no, it was not.19:28
jeblairAJaeger: the next config reload never happened, because of a bug19:28
AJaegerjeblair: we merged a few changes and it did not hel19:28
jeblairAJaeger: but i promise, there's no caching involved19:28
AJaegerjeblair: I believe you - you know the code ;)19:29
*** trown|lunch is now known as trown19:29
jeblairAJaeger: i think it's important to know that there is not a general problem related to this.  it is always the case that such errors can be fixed by a full config reload.19:29
AJaegerjeblair: ah, ok. So, should we merge the existing changes for repo creation as is - and enforce it with future changes only?19:30
*** jcoufal has quit IRC19:30
*** rkukura has joined #openstack-infra19:30
jeblairAJaeger: if you're willing to tolerate the risk of the race, i think that's fine.19:30
AJaegerjeblair: then I need reviewers ;)19:31
AJaegerhttps://review.openstack.org/#/q/topic:goal-split-tempest-plugins+is:open+project:openstack-infra/project-config is one list - 4 of those repos can go in19:32
*** sree has quit IRC19:32
openstackgerritJames E. Blair proposed openstack-infra/zone-zuul-ci.org master: Initial commit  https://review.openstack.org/52833119:32
fungijeblair: i am back, fire away with dns questions19:32
*** andreas_s has joined #openstack-infra19:33
jeblairfungi: regarding dnssec -- do you have thoughts on key rotation?19:33
fungichecking out 528331 now19:33
jeblairfungi: i've used zkt in the past -- see "Setting up ZKT" in http://amo-probos.org/post/919:33
AJaegerdmsimard: questions on https://review.openstack.org/#/c/52835819:33
jeblairfungi: however, it's not in debuntu; it's ITP has dropped back to a RFP :(19:33
jeblairfungi: so there would be quite a bit of work to git it going19:34
*** trown is now known as trown|ruck19:34
dmsimardAJaeger: "groups: ara" is not necessary if the gerrit acl is specified ?19:35
jeblairfungi: (ignore the DLV stuff in that doc, as i mentioned, it's old... but i think the process is still the same)19:35
AJaegerdmsimard: groups is for storyboard19:35
dmsimardAJaeger: oh.19:35
AJaegerdmsimard: gerrit ACL is something different19:35
*** rhallisey has quit IRC19:35
AJaegerdmsimard: yeah, too many tools configured in one file ;)19:35
fungijeblair: oh, hrm i'll have to do a little research on possibilities for nsd. i've been relying on bind9's auto-dnssec maintenance with inline-signing19:36
AJaegerdmsimard: care to review the goal-split-tempest-plugins changes I linked above, please?19:36
jeblairfungi: oh, that's new to me19:36
fungijeblair: this stuff: https://deepthought.isc.org/article/AA-00711/0/In-line-Signing-With-NSEC3-in-BIND-9.9-A-Walk-through.html19:37
openstackgerritDavid Moreau Simard proposed openstack-infra/project-config master: Create the "ara-web" project  https://review.openstack.org/52835819:37
openstackgerritDavid Moreau Simard proposed openstack-infra/project-config master: Add Zuul project layout for ara-web  https://review.openstack.org/52836019:37
fungijeblair: a few years old, so possibly a bit dated now19:37
*** andreas_s has quit IRC19:37
dmsimardAJaeger: ^ added a note in commit message that we aren't importing from an upstream19:37
jeblairfungi: still written after my doc :)19:38
AJaegerdmsimard: ok, will review...19:38
AJaegerdmsimard: LGTM - if we take the race risk...19:38
dmsimardAJaeger: oh, right19:39
dmsimardAJaeger: let me split that ..19:39
dmsimardtrying to find which of the reviews you mentioned19:39
dmsimardok nevermind it's a topic19:39
dmsimardAJaeger: those changes are all guility of adding gerrit and zuul simultaneously19:40
jeblairfungi: oh apparently https://www.opendnssec.org/ can be used with nsd and is in ubuntu19:40
funginice!19:40
fungireading now19:40
dmsimardAJaeger: so what do we do ? ask reviewer to split ?19:40
fungijeblair: oh, yeah that looks pretty slick19:40
AJaegerdmsimard: yes, indeed. My suggestion above discussed with jeblair : Take them in - and reconfigure zuul if needed. But that's the last time ;)19:41
dmsimardok19:41
*** jascott1 has quit IRC19:41
AJaegerdmsimard: if you don't want to take the risk of the race: Fine with me as well.19:41
dmsimardI'll +W one at a time19:41
AJaegerok19:42
fungijeblair: yeah, looks like xenial has 1.4.919:42
dmsimardAJaeger: might as well do the same thing for ara-web at the end if we find that merging one a time doesn't seem too dangerous ..19:43
fungiso relevant docs are at https://wiki.opendnssec.org/display/DOCS19:43
fungier, https://wiki.opendnssec.org/display/DOCS/OpenDNSSEC+1.4+Documentation+Home19:43
fungii'm taking a look at the "new in 2.0" features to see if we're missing anything terribly important by using that19:44
openstackgerritMerged openstack-infra/project-config master: Remove some legacy nodejs storyboard-webclient jobs  https://review.openstack.org/52833319:44
*** esberglu has joined #openstack-infra19:44
fungi"In large part OpenDNSSEC 2.0 is similar to 1.4. Especially regarding the signer, workflow, policies and configuration."19:45
fungiso sounds like we're probably not missing much by just using the packages in xenial19:45
fungi2.0 lets you use a combined zsk+ksk19:46
fungi(a "csk")19:46
jeblairthat doesn't sound desirable?19:46
fungiright, i'm not sure what the reasoning is there, but it also sounds optional19:47
*** sree has joined #openstack-infra19:47
jeblairfungi: auto-dns looks a lot easier to set up...19:47
openstackgerritMerged openstack-infra/project-config master: Add separate repo for ec2-api tempest plugin  https://review.openstack.org/52684119:48
fungihuh, interesting design choice "you also need an HSM"19:49
jeblairfungi: which can be 'soft' i think19:49
fungipresumably their included soft hsm isn't too hard to maintain19:49
fungiyeah19:49
fungimore that i think it's novel that they just baked in the assumption you'll have an hsm and then given you a software-based one with it, rather than making hsm use optional. nice abstraction19:50
AJaegerconfig-core, final patchset for storyboard legacy job changes, please give me another +2 on https://review.openstack.org/52833419:51
*** sree has quit IRC19:51
openstackgerritPaul Belanger proposed openstack-infra/puppet-kerberos master: Add systemd support for krb5-kpropd  https://review.openstack.org/52838219:52
pabelangerinfra-root: ^adds systemd support for puppet-kerberos module, is a backport from artful19:52
*** hashar has joined #openstack-infra19:53
jeblairfungi: https://www.eriklundblad.com/log/post/automatic-dnssec-signing-in-bind/  looks to be the key info for zsk rollover with auto-dnssec19:54
*** jascott1 has joined #openstack-infra19:55
jeblairfungi: that seems to have specific key names on the cmdline... i'm still struggling with how automatic rollovers happen19:56
jeblairi guess automatic rollover isn't the same as automatic generation and maintenance19:57
*** Goneri has quit IRC19:58
mordredjeblair: it's automatic as long as you do the steps manually20:02
fungiyeah, i'm trying to untangle that20:02
fungiwith bind 9.9.5 i don't have any cronjob to do zsk rollover20:02
fungibeen a while since i've added a new zone so going back through my notes on what i did20:03
jeblairmordred: heh, actually yeah -- i'm wondering if perhaps 'make 24 keys in advance for the next 2 years' is a step...20:03
jlvillalI'm sad that I'm not authorized :( http://eavesdrop.openstack.org/20:03
jeblairjlvillal: i am too20:03
jlvillalThat's two of us :)20:04
jeblairpabelanger: ^ eavesdrop issues20:04
fungiyeah, i suspect something had a sad in the server replacement there20:04
fungimaybe missing a grant all or something20:04
pabelangerlooking20:06
jeblairi'm manually editing the config there20:06
jeblairlrwxrwxrwx 1 root root   25 Dec 14 20:19 index.html -> /srv/yaml2ical/index.html20:07
jeblairpabelanger: ^ that link is broken20:07
bkeroHm, where are zuul native tests defined? I looked in system-config/zuul.d, although don't see references to, for example, kolla-build-ubuntu-source.20:07
*** sree has joined #openstack-infra20:07
pabelangerokay20:07
jeblairpabelanger: probably need to either copy those over or run yaml2ical to regenerate20:07
AJaegerbkero: codesearch.openstack.org might help a swell20:07
AJaegerbkero: zuul v3 jobs can be defined in *any* repository20:08
AJaegerbkero: if they followed our naming conventions, it's in the kolla repo itself20:08
pabelangerjeblair: Oh, IIRC, it is because it only generates after we update ical20:08
mordredbkero: https://docs.openstack.org/infra/manual/zuulv3.html#where-jobs-are-defined-in-zuul-v320:08
pabelangernot periodically20:08
pabelangerlet me see if we have any option yaml2ical changes20:08
bkeroAJaeger, mordred: Ah thanks. I missed that bit.20:09
bkeroI instinctively looked in project-config, but I suppose that is wrong now.20:09
bkeroI found them :)20:09
jeblairfungi: i'm going to grab lunch; i'll ping you when i'm back20:10
fungiso, looking through the bind 9.9 docs, it does appear that ksk and zsk rollover is recommended but optional and manual (and perhaps automatable through scripting) but i've not bothered to do it on mine20:10
pabelangerjeblair: mind if we try and land https://review.openstack.org/523869/ to kick yaml2ical?20:10
fungithe auto-dnssec stuff is for rotating signatures before they expire20:10
pabelangerI can see about adding some sort of crontab check to generate if missing20:10
*** sree has quit IRC20:11
fungipabelanger: any idea how the symlink was being maintained on the old server?20:12
pabelangerfungi: http://git.openstack.org/cgit/openstack-infra/project-config/tree/playbooks/yaml2ical/post.yaml20:14
pabelangerfungi:  it is a post playbook that upload the info to eavesdrop server20:15
pabelangerwhich was outside of cinder volume20:15
pabelangerso, if we land 523869 it will kick of an upload, but need to check our hostkeys are correct20:15
fungiaha20:16
*** kjackal has quit IRC20:17
*** tosky has joined #openstack-infra20:19
openstackgerritPaul Belanger proposed openstack-infra/project-config master: Update ssh_known_hosts for eavesdrop.o.o  https://review.openstack.org/52838720:20
pabelangerfungi: jeblair: jlvillal apologies, we'll need ^ too to fix our publish jobs for yaml2ical also20:20
pabelangerthen we can land 52386920:21
*** jkilpatr has joined #openstack-infra20:22
pabelangerclarkb: ^20:22
openstackgerritMonty Taylor proposed openstack-infra/zuul feature/zuulv3: Fix source_url handling for jobs view  https://review.openstack.org/52837320:22
openstackgerritMonty Taylor proposed openstack-infra/zuul feature/zuulv3: Fix StandardJS warnings and turn them to errors  https://review.openstack.org/52829720:22
openstackgerritMonty Taylor proposed openstack-infra/zuul feature/zuulv3: Add bundle analysis to the lint target  https://review.openstack.org/52829820:22
openstackgerritMonty Taylor proposed openstack-infra/zuul feature/zuulv3: Make bundle of build web content  https://review.openstack.org/52837420:22
*** smatzek has quit IRC20:24
openstackgerritPaul Belanger proposed openstack-infra/puppet-kerberos master: Add systemd support for krb5-kpropd  https://review.openstack.org/52838220:24
pabelangerinfra-root: ^will also fix systemd on xenial for kerberos20:25
pabelangerhoping to launch kdc04.o.o today20:25
*** ldnunes has quit IRC20:25
*** rhallisey has joined #openstack-infra20:26
mordredpabelanger: woot20:26
*** armaan has joined #openstack-infra20:27
*** rkukura has quit IRC20:30
openstackgerritMerged openstack-infra/project-config master: Update ssh_known_hosts for eavesdrop.o.o  https://review.openstack.org/52838720:30
*** dprince has quit IRC20:36
*** lukebrowning has quit IRC20:36
openstackgerritMerged openstack-infra/project-config master: Add new repo for Vitrage tempest plugin  https://review.openstack.org/52683620:36
openstackgerritMonty Taylor proposed openstack-infra/zuul feature/zuulv3: Make bundle of build web content  https://review.openstack.org/52837420:38
pabelangerfungi: thanks, we should approve https://review.openstack.org/523869/ now to confirm uploads work20:38
*** lukebrowning_ has joined #openstack-infra20:39
*** kjackal has joined #openstack-infra20:40
*** e0ne has joined #openstack-infra20:40
fungidone20:40
*** e0ne has quit IRC20:42
openstackgerritPaul Belanger proposed openstack-infra/project-config master: Expose serial keyword to base-test playbook  https://review.openstack.org/52670820:43
*** smatzek has joined #openstack-infra20:43
pabelangermordred: dmsimard: ^is related to shared ansible_host in zuul, would be interested in a review if possible20:44
*** lukebrowning_ has quit IRC20:45
*** rhallisey has quit IRC20:45
openstackgerritMerged openstack-infra/irc-meetings master: Clean up inactive meetings  https://review.openstack.org/52386920:45
*** rhallisey has joined #openstack-infra20:45
openstackgerritMerged openstack-infra/project-config master: Add new repo for Monasca tempest plugin  https://review.openstack.org/52684420:45
*** trown|ruck is now known as trown|outtypewww20:45
*** rkukura has joined #openstack-infra20:46
*** lukebrowning has joined #openstack-infra20:46
*** smatzek has quit IRC20:48
*** openstackgerrit has quit IRC20:48
*** smatzek has joined #openstack-infra20:48
*** signed8bit is now known as signed8bit_Zzz20:48
*** smatzek has quit IRC20:49
*** smatzek has joined #openstack-infra20:50
*** lukebrowning has quit IRC20:52
*** openstackgerrit has joined #openstack-infra20:52
openstackgerritMonty Taylor proposed openstack-infra/zuul feature/zuulv3: Add bundle analysis to the lint target  https://review.openstack.org/52829820:52
openstackgerritMonty Taylor proposed openstack-infra/zuul feature/zuulv3: Make bundle of build web content  https://review.openstack.org/52837420:52
pabelangerwoot20:53
pabelangerhttp://eavesdrop.openstack.org/20:53
*** lukebrowning has joined #openstack-infra20:53
pabelangerso, we likely want to move that to cinder volume for the next time we migrate the server ;)20:53
fungior switch to an apache alias entry20:54
fungibut something, yes20:54
*** smatzek has quit IRC20:55
*** signed8bit_Zzz is now known as signed8bit20:55
dmsimardpabelanger: the patch in itself doesn't bother me20:57
dmsimardpabelanger: but I wanted to sleep on it because I was wondering if there was a better way to pass arbitrary args to the playbooks20:57
openstackgerritsebastian marcet proposed openstack-infra/openstackid-resources master: Added new Bulk events endpoints  https://review.openstack.org/52839020:57
dmsimardpabelanger: are we going to need to add any and all parameters like "serial" eventually ?20:57
*** lukebrowning has quit IRC20:58
openstackgerritAndreas Jaeger proposed openstack-infra/project-config master: Added initial jobs for vitrage tempest plugin  https://review.openstack.org/52683720:58
*** lukebrowning has joined #openstack-infra21:00
pabelangerdmsimard: I don't think so. The the case I am using, it is only the base playbooks that have the issue.21:00
pabelangerdmsimard: every other playbook in job, is written correctly to use the inventory file21:01
AJaegerdmsimard, jeblair - yeah, run into the race two times at least ;( http://git.openstack.org/cgit/openstack/monasca-tempest-plugin/ and http://git.openstack.org/cgit/openstack/vitrage-tempest-plugin/ both exist but zuul does not know about them.21:01
AJaegerjeblair: so, how to reconfigure in the best way - or should we get the rest in and then do it?21:01
pabelangerdmsimard: another option, in multi node jobs, you may only want to run base on 1 node of the inventory, then from that node, provision things that base does on others. For example, only needing git repos on 1 node in multinode jobs21:02
pabelangerbut, figured serial was the simplest way to test atm21:02
* AJaeger can also change his +2 to a -1 - but then let's merge the infra-manual change https://review.openstack.org/528375...21:02
jeblairAJaeger: if they're ready, merge them all and we'll do a manual reconfig if it's still needed at the end.21:04
fungijeblair: after consulting my notes it appears i never set up (or performed) zsk or ksk rotation (yet anyway). auto-dnssec merely handles refreshing of the rrsigs. bind 9.11 seems to have added a dnssec-keymgr tool designed to run out of cron or similar: https://ftp.isc.org/isc/bind9/9.11.0/doc/arm/man.dnssec-keymgr.html21:04
*** rkukura has quit IRC21:04
pabelangerwould appreciate a +3 on https://review.openstack.org/528382/ to fix xenial issues with puppet-kerberos21:05
jeblairfungi: cool, that looks like the missing link.21:05
fungijeblair: and dnssec with bind will work fine without rotating the zsks or ksk, though i agree rotating them is still a good idea21:05
*** lukebrowning has quit IRC21:05
*** rlandy|rover has quit IRC21:05
fungiin case they get leaked or guessed somehow21:05
AJaegerok, any config-cores to review these new projects: https://review.openstack.org/526863 https://review.openstack.org/528358 https://review.openstack.org/52712221:06
dmsimardjeblair: ok, checking if there's anything else to merge21:06
AJaegerthey all have one +2 by me, so need second reviewer21:06
AJaegerdmsimard: see above21:06
dmsimardAJaeger: I pinged gordc and sileht about https://review.openstack.org/#/c/526863/21:06
jeblairfungi: looks like 9.11 isn't in ubuntu yet21:06
AJaegerdmsimard: if there's more, tell me...21:06
dmsimardleft a question21:06
*** lukebrowning has joined #openstack-infra21:06
jeblairfungi: it is in sid21:07
AJaegerdmsimard: we can check that later as well ;) But yes, let's wait...21:07
AJaegerno urgency on that one21:07
*** rhallisey has quit IRC21:07
jeblairfungi: i'd like to have key rotation in place before we do anything important like sshfp records21:07
*** sree has joined #openstack-infra21:07
fungijeblair: i concur. mainly because if we _need_ to revoke/replace a key we'll be able to do it more or less seamlessly21:09
*** sdague has quit IRC21:09
funginot so much because i'm worried that having the key in use for longer periods of time will result in successful key oracle attacks against the nameserver or anything21:10
fungithough that is the theoretical concern driving frequent zsk rotation21:10
jeblairfungi: to try to summarize: zkt does signing+generation+rotation, with either server, but is not packaged, so it's easy to use but hard to install.  bind+auto-dnssec does signing, and semi-automatic rotation today; in the future it will include dnssec-keymgr to automate everything.  we could probably install dnssec-keymgr today simply -- it's python.  nsd+opendns will automate everything, but requires drinking a bunch of xml kool-aid.21:10
jeblairand hsm and ...21:11
*** lukebrowning has quit IRC21:11
*** kjackal has quit IRC21:11
*** sree has quit IRC21:12
fungithat seems like a good tl;dr21:12
fungii'm honestly fine with any of those solutions21:12
funginone is perfect, all are viable21:12
jeblairfungi: maybe bind + auto-dnssec without rotation for now, and a future upgrade to include rotation strikes the right effort/reward balance?21:12
AJaegeranybody to +2A dmsimard 's ara-web repo? https://review.openstack.org/52835821:13
*** lukebrowning has joined #openstack-infra21:13
dmsimardpabelanger: so in your case, serial: 1 would run still run several times on the same machine though, right ?21:13
openstackgerritMerged openstack-infra/project-config master: Add new repo for Trove tempest plugin  https://review.openstack.org/52712221:13
dmsimardexcept one after the other21:13
jeblairAJaeger: done21:13
pabelangerdmsimard: correct, first run does the things, everything is a noop21:13
pabelangerdmsimard: that is how the job runs under v221:14
fungijeblair: seems doable... also if you were wanting to take up your bind+nsd idea, we could operate the bind server as a silent master and the nsd servers as the published authoritative slaves (does nsd handle triggered transfers?)21:14
pabelangerdmsimard: http://git.openstack.org/cgit/openstack/windmill/tree/playbooks/bootstrap.yaml21:14
dmsimardpabelanger: idempotency is not really tested though, so I'm not sure everything is necessarily noop21:14
*** armaan has quit IRC21:14
dmsimardpabelanger: I mean, running the base jobs twice on a single node isn't tested21:14
fungijeblair: might be paranoid overkill, but could basically limit port 53 on the master to access from the slaves and not expose it otherwise21:15
pabelangerdmsimard: right, it is possible things might change, but we can fix that in follow up patch. Easy to do once in base-test21:15
jeblairfungi: yeah, i expect that to work21:15
*** armaan has joined #openstack-infra21:15
pabelangerdmsimard: but, even if they change, I am okay with that for now.21:15
jeblairfungi: aiui that's similar to how a certain institution of higher ed i have had a passing familiarity with ran their servers.21:16
*** rmcall has quit IRC21:16
jeblair(hidden bind master, mixed bind/nsd slaves)21:16
fungii had a similar setup in a professional capacity at one point, but with all bind, where the management gui for the front desk operators and customers fed a silent master and then only its slaves were in the tld glue and ns rrs21:16
fungiworked out pretty well21:17
fungiand in a dnssec scenario, adds an extra layer of protection since clients aren't querying the server shish holds the keys21:17
jeblairyeah, i rather like that aspect21:17
fungis/shish/which/21:17
*** openstackgerrit has quit IRC21:18
*** lukebrowning has quit IRC21:18
fungithe slaves only ever get the signatures and records21:18
dmsimardfungi, jeblair: all of your discussions have made me wonder... did we ever consider designate ?21:19
*** lukebrowning has joined #openstack-infra21:19
dmsimard(I don't think I've seen it mentioned in the spec)21:19
*** openstackgerrit has joined #openstack-infra21:19
openstackgerritMerged openstack-infra/project-config master: Create the "ara-web" project  https://review.openstack.org/52835821:19
fungidmsimard: it (and explanations for why we didn't go with it) at least came up in discussion21:19
dmsimardfungi: oh, must have missed them21:20
jeblairdmsimard: do you mean running our own?21:20
* dmsimard goes look21:20
dmsimardfungi: probably not in the review, unless ctrl+f designate is failing me21:21
dmsimardjeblair: I don't have an opinion whether we'd consume an existing designate or bring up our own, mostly just curious if we had discussed using it at all21:21
*** lukebrowning has quit IRC21:23
fungii'm trying to find where that discussion occurred21:24
dmsimardI know there's a puppet module for designate because I'm the one who did the legwork to make it work in puppet-openstack-integration and RDO21:24
*** Goneri has joined #openstack-infra21:24
dmsimardalthough I am not particularly familiar with it other than that21:24
openstackgerritAndreas Jaeger proposed openstack-infra/project-config master: Add initial jobs for trove tempest plugin  https://review.openstack.org/52712321:25
*** lukebrowning has joined #openstack-infra21:25
fungiit may have been in initial conversations we had before the spec was drafted21:25
dmsimardAJaeger: I think we're good for the zuul config reload to clear the race, wdyt ?21:25
jeblairi thought the cloud dns idea came up in the spec21:26
openstackgerritAndreas Jaeger proposed openstack-infra/project-config master: Add Zuul project layout for ara-web  https://review.openstack.org/52836021:26
dmsimardI may have mentioned cloudflare or ultradns21:26
*** rhallisey has joined #openstack-infra21:26
mordredjeblair: me too21:26
*** baoli has quit IRC21:27
*** sree has joined #openstack-infra21:27
mordreddmsimard: for me the multi-cloud story was the most important thing in favor of running it ourselves21:27
jeblairhttps://github.com/thias/puppet-bind21:27
jeblairdoes that look sane?21:27
AJaegerdmsimard: let me check something quickly...21:27
jeblairi'm basically just running down google results21:27
AJaegerdmsimard: wait until http://git.openstack.org/cgit/openstack/ara-web/ exists21:28
dmsimardjeblair: there's a minimal bind implementation you can perhaps start with here: https://github.com/openstack/puppet-openstack-integration/blob/master/manifests/bind.pp21:28
mordredjeblair: that looks not too insane - not a "use puppet DSL instead of bind config to manage your zones" type of module21:28
* mordred is not interested in writing zone files in puppet DSL :)21:29
jeblairdmsimard: what provides "::dns" ?21:29
dmsimardjeblair: https://github.com/openstack/puppet-openstack-integration/blob/master/Puppetfile#L233-L23521:29
jeblairmordred: ya exactly21:29
jeblairdmsimard: cool, that was like one or two google results down :)21:29
dmsimardtheforeman is pretty trustworthy imo21:29
*** lukebrowning has quit IRC21:30
dmsimardoh, huh, I even sent patches their way more than a year ago now21:30
* dmsimard once wrote a lot of puppet21:30
jeblairtheforeman looks similarly usable21:30
jeblairmaybe start with that due to local experience :)21:30
mordred++21:30
*** sree has quit IRC21:31
fungichecking21:31
*** lukebrowning has joined #openstack-infra21:31
fungithat looks pretty sane21:33
fungidmsimard: thanks for the example!21:33
jeblairfungi: thias or theforeman?21:34
fungitheforeman21:34
fungithias doesn't look bad either21:34
fungibut i'm still digging around in them21:34
fungitheforeman looks like it can be provided with custom config templates too21:35
jeblairi imagine the main thing is we'll want to supply the tsig key externally (via private hiera) so we can do the zone transfers21:35
fungiyup21:35
fungiwe could likely put the ksk in hiera too21:36
*** rcernin has joined #openstack-infra21:36
fungiunless we want to take a different route with it21:36
*** lukebrowning has quit IRC21:36
*** lukebrowning has joined #openstack-infra21:38
dmsimardI was pulling data from RDO's Zuul SQL reporter to get some minimal metrics -- I did some of it manually but in case you're curious: https://i.imgur.com/r276T9j.png21:42
dmsimarder, that was meant for #zuul T_T21:42
*** lukebrowning has quit IRC21:42
*** raissa has joined #openstack-infra21:43
*** lukebrowning has joined #openstack-infra21:44
*** sree has joined #openstack-infra21:47
*** openstackgerrit has quit IRC21:48
AJaegerdmsimard: now ara-web is created, time to reconfigure now21:48
dmsimardjeblair: ^ is that a full scheduler restart ?21:49
*** lukebrowning has quit IRC21:49
AJaegeror perhaps wait until the .gitreview file exists - repo is still empty21:49
AJaegerexists now...21:49
*** erlon has quit IRC21:50
jeblairAJaeger, dmsimard: wait for puppet to run the reconfigure first21:51
jeblairwhat time did the last repo create change land?21:51
AJaegerso, after reconfigure, we can +2A (for some after recheck) https://review.openstack.org/#/c/528360 https://review.openstack.org/#/c/527123/ https://review.openstack.org/526837 https://review.openstack.org/52684721:51
AJaegerjeblair: ara-web - 21:1921:52
AJaegerjeblair: see above, two minuts ago the repo was created21:52
*** sree has quit IRC21:52
fungiara-web merged at 21:19, trove-tempest-plugin before it at 21:1321:52
jeblairaccording to the "merger queue" graph on http://grafana.openstack.org/dashboard/db/zuul-status the most recent full reconfigure was at 21:0421:53
jeblairso there will be another one21:53
AJaegeroh, that hUGe spike...21:54
fungiyeah, monasca-tempest-plugin merged at something like 20:45 so was probably the last in the previous batch21:54
jeblairyep, that's 6000 git checkouts.21:54
AJaegerwow21:54
caphrim007anyone know what version of jenkins-job-builder has the !include-jinja2 syntax?21:54
* AJaeger calls it a day and wishes everybody a great weekend21:55
caphrim007in 2.0.0.0b2 it raises an error about "could not determine a constructor for the tag !include-jinja2"21:55
fungicaphrim007: you might get better answers in #openstack-jjb21:56
caphrim007fungi: thanks! didnt know it existed21:56
jeblairdmsimard: looks like we'll need 4.1.0 to be puppet3 friendly (or perhaps 5+ may just require a newer stdlib)21:59
dmsimarduh oh21:59
*** xarses_ has quit IRC22:00
*** sree has joined #openstack-infra22:07
*** mriedem has joined #openstack-infra22:07
*** esberglu has quit IRC22:08
*** dave-mcc_ has quit IRC22:10
*** nicolasbock has quit IRC22:11
*** sree has quit IRC22:12
jeblairdmsimard: it looks like theforeman doesn't have a way to set zone options that it doesn't know about, and it doesn't know about some dnssec stuff like 'key-directory': https://github.com/theforeman/puppet-dns/blob/master/templates/named.zone.erb22:12
*** lukebrowning has joined #openstack-infra22:12
jeblairor auto-dnssec22:12
dmsimardoh well :/22:12
dmsimardthe usage we do of it in puppet-openstack-integration is admittedly quite narrow in scope22:13
jeblairit looks like thias will pass through config lines verbatim22:13
fungiit looked like dns::config let you pass in custom configuration templates22:14
funginot ideal i guess, but workable22:14
dmsimardjeblair: I don't think I want to get into that kind of discussion on a friday evening as I'm about to sign off but I left a comment in the ARA dashboard spec -- I'm not very excited about writing new puppet things knowing it's more or less 100% technical debt out the door22:14
fungimaybe i misread the manifest22:14
dmsimardI planned on discussing it at the next infra meeting /me adds it to agenda22:14
jeblairdmsimard: is it tech debt?22:15
jeblairi mean, our system runs via puppet22:15
jeblairi've spent a lot of time this week writing puppet because that's what we have22:15
dmsimardjeblair: I mean in the context of writing puppet 3 things while we need to consider either upgrading to puppet 4 (or 5 by now) or a pabelanger's spec to switch to Ansible22:16
fungii've also not been especially impressed with ansible's model for configuration management. it's of course way better than puppet for complex orchestration, but the two seem complimentary to me22:16
dmsimardfungi: yeah, there's bound to be discussion in the spec IMO22:17
jeblairdmsimard: oh, yes, i agree, it's getting more difficult to be on puppet 3.  aiui, moving to xenial helps with puppet4/5, so we're starting to make headway there22:17
*** jcoufal has joined #openstack-infra22:17
*** lukebrowning has quit IRC22:17
*** rkukura has joined #openstack-infra22:17
fungii completely agree that puppet 3 is a problem, i think we all do22:17
*** lukebrowning has joined #openstack-infra22:19
jeblairi think a lot of puppet3 stuff is somewhat forward compatible22:19
jeblairmuch more so than 2->322:19
jeblairpuppet 3 is more restrictive than 4, but writing puppet 3 from scratch may not be accumulating too much debt.22:20
dmsimardhmm, I think when we upgraded from puppet 3 to 4 in puppet-openstack, a lot of the changes had to do with ordering of resources and... tip of my tongue... something around variable types22:20
clarkbok back from long lunch22:20
mordredclarkb: welcome back - we're discussing puppet versions22:20
clarkboh maybe I'll go back to lunch >_>22:21
* dmsimard runs away22:21
dmsimardclarkb: I did add a topic for next week though, regarding writing new puppet things in general22:21
*** florianf has quit IRC22:21
*** lukebrowning has quit IRC22:23
fungidmsimard: i think from that we ended up with some additional linting that validates parameter ordering and use of vague null types, so we may not be far off22:24
clarkbre 3 v 4 yes aiui that transition is much nicer then 2 to 322:25
jeblairdmsimard: anyway, i appreciate and sympathize with your feelings.  i'm hoping that you'll agree that overall the ability to maintain the system coherently as a team is more important than the immediate discomfort that entails.  if we hadn't done that so far, we would have systems split across chef, salt, puppet2, puppet3, puppet4, and ansible.  i am less interested in what we run, only that it be one thing.  hopefully soon it will ...22:25
jeblair... either all be puppet 4 or ansible.  :)22:25
*** lukebrowning has joined #openstack-infra22:25
pabelangerjeblair: +122:25
pabelangerI'm about to head out for some food, but would love a final +3 on https://review.openstack.org/528382/22:26
pabelangerI can work on bringing up kdc04.o.o later this evening22:27
clarkbdmsimard: did the last logstash workers get done?22:27
clarkb(I'd like to send out a summary email shortly so going to followup on what things got updated)22:27
dmsimardclarkb: I did one yesterday, I'll do the other two after dinner22:27
clarkbok22:27
*** sree has joined #openstack-infra22:27
dmsimardturns out there's other gotchas preventing even a limited automation22:27
pabelangerkeep in mind, we did run puppet 4 for a bit, when we did puppet on DIBs. That was on fedora, so the majority of our modules work I'd say on puppet 422:27
*** armaan has quit IRC22:28
*** catintheroof has joined #openstack-infra22:29
dmsimardjeblair: yeah don't get me wrong, I'll settle with the consensus here -- I just want to point out we're rolling out a significant amount of new things and we're investing in an outdated technology which tends to lead to this: https://en.wikipedia.org/wiki/Sunk_cost22:29
*** lukebrowning has quit IRC22:30
dmsimardso if anything, perhaps it'll make us priorize whatever path we choose -- whether that's puppet 4 or ansible22:30
*** rkukura has quit IRC22:30
clarkbthe only place it seems to really hurt is when using external dependencies. Other than that are there specific concerns? familiarity with the tool or ?22:31
*** lukebrowning has joined #openstack-infra22:31
jeblairdmsimard: yes, it's important to keep an eye on that, however, i don't think this is a sunk cost, especially considering the plan to move to puppet4 -- that upgrade is a marginal cost which is dwarfed by the cost of maintaining multiple systems.22:31
*** dteselkin has quit IRC22:31
*** sree has quit IRC22:32
jeblairdmsimard: if we were to adopt a plan to migrate to ansible, then i would agree that picemeal migration is warranted -- because then we can contain the cost of maintaining multiple systems to the migration period22:32
* dmsimard nods22:32
*** marst has quit IRC22:32
*** myoung|training is now known as myoung22:32
*** asilenkov has quit IRC22:33
*** asilenkov has joined #openstack-infra22:36
*** lukebrowning has quit IRC22:36
*** lukebrowning has joined #openstack-infra22:37
*** dteselkin has joined #openstack-infra22:39
jeblairfungi: so if we stick with theforeman, we'd just build our own named.conf and include all the zone info in it?22:41
*** rhallisey has quit IRC22:41
dmsimardgoing to eat and I'll come back to wrap up the two last logstash-workers later, have a nice weekend everyone22:42
fungiwell, zone info could go in named.conf.local or something and we could stick an include directive in the main config if we want22:42
*** lukebrowning has quit IRC22:42
jeblairyeah, though that's just more stuff for us to manually manage :|22:42
fungivery true22:43
clarkbis the problem configuring a dns server?22:43
jeblairs/manually manage/write our own puppet to manage/22:43
*** hashar has quit IRC22:43
jeblairclarkb: yes, the problem is finding a puppet module which allows us to configure the options needed to run a server with dnssec22:43
clarkbah22:43
*** lukebrowning has joined #openstack-infra22:44
fungiyeah, when it boils down to it there's not a ton of fancy to bind other than stanzas in its config and calls to its rpc socket22:44
jeblairyep.  it's such a simple problem that we have 20 not-quite-sufficient modules to choose from22:44
*** jcoufal has quit IRC22:44
fungiwell, the complex part being there are a bazillion possible options you could choose to configure22:45
*** claudiub has quit IRC22:45
fungiso if a puppet module wants to parameterize them all, first you must invent the universe22:46
clarkbare all of the v3 zuul/nodepool servers xenial at this point? (I guess they were before we started the sprint due to python requirements?22:46
fungiafaik22:46
mordredclarkb: did the nodepool servers get rebuilt? I know that was on Shrews' list at one point22:46
jeblairthe builders are xenial -- though i think they are running master and not v3.22:47
*** wolverineav has quit IRC22:47
jeblairi *think* that's the only part that's "lagging"22:47
clarkbya I just checked them all 4 ndoepool servers are xenial22:47
*** sree has joined #openstack-infra22:47
*** xarses_ has joined #openstack-infra22:48
*** lukebrowning has quit IRC22:49
*** lukebrowning has joined #openstack-infra22:50
*** andreww has joined #openstack-infra22:51
*** andreww has quit IRC22:51
*** sree has quit IRC22:52
*** xarses_ has quit IRC22:53
*** andreww has joined #openstack-infra22:54
*** lukebrowning has quit IRC22:55
*** lukebrowning has joined #openstack-infra22:56
*** openstackgerrit has joined #openstack-infra22:56
openstackgerritMonty Taylor proposed openstack-infra/storyboard-webclient master: Remove bower and add yarn support  https://review.openstack.org/52843622:56
*** signed8bit is now known as signed8bit_Zzz22:59
*** lukebrowning has quit IRC23:01
*** lukebrowning has joined #openstack-infra23:02
*** raissa has quit IRC23:04
*** tosky has quit IRC23:05
*** raissa has joined #openstack-infra23:05
*** raissa has quit IRC23:05
*** raissa has joined #openstack-infra23:06
*** raissa has quit IRC23:06
*** raissa has joined #openstack-infra23:07
*** raissa has joined #openstack-infra23:07
*** lukebrowning has quit IRC23:07
*** raissa has quit IRC23:08
*** raissa has joined #openstack-infra23:08
*** raissa has quit IRC23:09
*** lukebrowning has joined #openstack-infra23:09
*** raissa has joined #openstack-infra23:09
*** raissa has quit IRC23:09
*** andreww has quit IRC23:11
dmsimardclarkb: you could probably get a count with something like ansible -i inventory all -m setup -a "filter=os_distribution"23:11
*** xarses_ has joined #openstack-infra23:12
dmsimardFilter might not be quite right but something along those lines (on phone)23:12
clarkbdmsimard: ya though I'd still have to filter between before and this week (can check openstack api for that)23:12
clarkbI think I got the info right though23:12
*** lukebrowning has quit IRC23:13
*** lukebrowning has joined #openstack-infra23:15
openstackgerritMonty Taylor proposed openstack-infra/zuul feature/zuulv3: Remove use strict  https://review.openstack.org/52843723:19
*** lukebrowning has quit IRC23:19
*** lukebrowning has joined #openstack-infra23:21
*** ChanServ changes topic to "Discussion of OpenStack Developer and Community Infrastructure | docs http://docs.openstack.org/infra/ | bugs https://storyboard.openstack.org/ | source https://git.openstack.org/cgit/openstack-infra/ | channel logs http://eavesdrop.openstack.org/irclogs/%23openstack-infra/"23:22
*** lukebrowning has quit IRC23:26
*** bobh has joined #openstack-infra23:26
*** lukebrowning has joined #openstack-infra23:28
*** lukebrowning has quit IRC23:32
*** lukebrowning has joined #openstack-infra23:34
*** felipemonteiro__ has quit IRC23:35
*** efried_cya_jan has quit IRC23:37
*** wolverineav has joined #openstack-infra23:37
*** rwsu has quit IRC23:37
*** lukebrowning has quit IRC23:39
*** Swimingly has quit IRC23:40
*** lukebrowning has joined #openstack-infra23:40
*** rbrndt has quit IRC23:40
*** Swimingly has joined #openstack-infra23:41
*** Swimingly has quit IRC23:41
*** Swimingly has joined #openstack-infra23:41
*** wolverineav has quit IRC23:41
*** mriedem has quit IRC23:46
clarkbjeblair: does the puppet-exim change need to go in before the puppet-mailman change?23:46
clarkboh reading comit message seems like no23:46
clarkbits the system-config change that ties it all together with the deps, got it23:48
*** efried_cya_jan has joined #openstack-infra23:48
jeblairclarkb: correct23:49
*** lukebrowning has quit IRC23:49
clarkbjeblair: I've not approved the exim change though it looks fine to me, simply because its lateish on friday and its larissa's birthday so once I stop working tonight I'm actually stopping work :)23:50
clarkbfeel free to approve if you will be around23:50
jeblairclarkb: thanks; i may wait on that till next week too :)23:50
*** lukebrowning has joined #openstack-infra23:51
*** xarses_ has quit IRC23:52
*** Hal has joined #openstack-infra23:53
clarkbjeblair: what does 'require_files'     => '${lookup{${lc::$domain}}lsearch{/etc/mailman/sites}}/lists/${lc::$local_part}/config.pck' do?23:55
*** adisky__ has quit IRC23:56
*** lukebrowning has quit IRC23:56
clarkbI guess what is $lc?23:56
*** bobh has quit IRC23:57
clarkboh wait that  is exim not puppet23:57
clarkbnow it makes much more sense23:57
*** lukebrowning has joined #openstack-infra23:57
openstackgerritMerged openstack-infra/puppet-kerberos master: Add systemd support for krb5-kpropd  https://review.openstack.org/52838223:59
jeblairlowercase23:59

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!