| *** tjgresha has quit IRC | 00:00 | |
| *** mattw4 has quit IRC | 00:03 | |
| *** betherly has quit IRC | 00:04 | |
| *** armax has joined #openstack-infra | 00:10 | |
| *** sthussey has quit IRC | 00:14 | |
| anteaya | it's hard to get the wheels through the crust on the snowmower | 00:17 |
|---|---|---|
| *** rkukura has quit IRC | 00:18 | |
| *** Goneri has quit IRC | 00:22 | |
| *** tbachman has quit IRC | 00:23 | |
| *** lseki has quit IRC | 00:34 | |
| *** yamamoto has joined #openstack-infra | 00:48 | |
| *** tbachman has joined #openstack-infra | 00:51 | |
| *** yamamoto has quit IRC | 00:51 | |
| *** yamamoto has joined #openstack-infra | 00:58 | |
| *** yamamoto has quit IRC | 01:03 | |
| *** gyee has quit IRC | 01:03 | |
| TheJulia | question folks, where does multi-node-bridge get invoked, or where should it be invoked? | 01:10 |
| openstackgerrit | Merged openstack-infra/log_processor master: Replace openstack.org git:// URLs with https:// https://review.openstack.org/646456 | 01:11 |
| *** betherly has joined #openstack-infra | 01:11 | |
| openstackgerrit | Merged openstack-infra/infra-ansible master: Replace openstack.org git:// URLs with https:// https://review.openstack.org/646387 | 01:12 |
| openstackgerrit | Merged openstack-infra/groups-static-pages master: Replace openstack.org git:// URLs with https:// https://review.openstack.org/646378 | 01:12 |
| *** whoami-rajat has joined #openstack-infra | 01:12 | |
| TheJulia | I can see multi-node-firewall is getting invoked on a grenade run, but multi-node-bridge is not triggering | 01:13 |
| clarkb | TheJulia: I think the devstack base job(s) invoke it | 01:13 |
| TheJulia | they... seem... to only be configured for multi-node-firewall | 01:13 |
| openstackgerrit | Merged openstack-infra/gerritbot master: Replace openstack.org git:// URLs with https:// https://review.openstack.org/646346 | 01:13 |
| TheJulia | which seems... weird | 01:13 |
| *** gregoryo has joined #openstack-infra | 01:14 | |
| *** betherly has quit IRC | 01:16 | |
| clarkb | ya codesearch doesnt show it being used by devstack. We must not test nova net or neutron dvr multinode | 01:17 |
| TheJulia | I wonder how ironic worked until ~3 days ago | 01:17 |
| clarkb | oh wait maybe devstack inherits the mulyinode job? | 01:18 |
| *** mriedem has quit IRC | 01:18 | |
| TheJulia | it does | 01:18 |
| clarkb | http://git.openstack.org/cgit/openstack-infra/zuul-jobs/tree/playbooks/multinode/pre.yaml | 01:18 |
| TheJulia | http://git.openstack.org/cgit/openstack-infra/openstack-zuul-jobs/tree/playbooks/legacy/multinode-networking/pre.yaml is all that gets parsed | 01:18 |
| clarkb | ok that is where it comes from then | 01:18 |
| clarkb | the legacy jobs run devstack-gate whoch sets up the bridge on those jobs | 01:18 |
| TheJulia | hmmmm | 01:19 |
| clarkb | and the non legacy jobs inherit the multinode "base" job | 01:19 |
| *** eernst has joined #openstack-infra | 01:20 | |
| *** jamesmcarthur has joined #openstack-infra | 01:20 | |
| * TheJulia goes back to logs to see if https://github.com/openstack-infra/devstack-gate/blob/63e5e1dd9638173a8f959be07842e445bafcc837/playbooks/ovs_vxlan_bridge.yaml is getting parsed | 01:20 | |
| *** jamesmcarthur has quit IRC | 01:23 | |
| TheJulia | hmmmm | 01:24 |
| *** openstackgerrit has quit IRC | 01:30 | |
| *** eernst has quit IRC | 01:30 | |
| *** openstackgerrit has joined #openstack-infra | 01:34 | |
| openstackgerrit | Merged openstack-infra/storyboard master: Replace openstack.org git:// URLs with https:// https://review.openstack.org/647149 | 01:34 |
| TheJulia | clarkb: I think I've got it, the name was hard coded to devstack-gate incompatible and because it only really mattered for grenade once on a stable branch.. *boom* | 01:42 |
| *** roman_g has quit IRC | 01:44 | |
| ianw | mnaser: not really sure what you mean on https://review.openstack.org/#/c/646851 about merging will create other issues | 01:45 |
| *** nicolasbock has quit IRC | 01:45 | |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/nodepool master: Dockerfile: add support for arbritary uid https://review.openstack.org/651424 | 01:45 |
| ianw | other that that, can draw a line under the git:// -> https:// conversion at this point. as discussed i've merged the outstanding changes; the only remaining ones are a merge failure and a couple that were rebased ontop of other changes that haven't merged | 01:47 |
| *** yamamoto has joined #openstack-infra | 01:47 | |
| clarkb | TheJulia: the name of the bridge? | 01:49 |
| TheJulia | clarkb: yup! | 01:49 |
| *** betherly has joined #openstack-infra | 01:53 | |
| ianw | so a bunch of the arm64 images have now been deleting for 15 hours ... i'm guessing something's gone wrong there | 01:54 |
| *** betherly has quit IRC | 01:57 | |
| *** eernst has joined #openstack-infra | 02:03 | |
| fungi | okay, tc office hour and first contact sig meeting are over, i'll take a stab at resetting and recording these passwords for ewr1 now | 02:04 |
| *** ijw has quit IRC | 02:06 | |
| ianw | fungi: could you poke at https://review.openstack.org/#/c/651388/ and i'll watch it through ... we should have a LE staging cert pop out when that's in | 02:07 |
| ianw | i will manually delete the self-signed certs that we don't want on graphite01 | 02:07 |
| *** bhavikdbavishi has quit IRC | 02:11 | |
| fungi | ianw: that's an excellent improvement, approved! | 02:18 |
| *** rkukura has joined #openstack-infra | 02:27 | |
| *** hongbin has joined #openstack-infra | 02:29 | |
| *** owalsh_ has joined #openstack-infra | 02:34 | |
| *** eernst has quit IRC | 02:34 | |
| *** owalsh has quit IRC | 02:34 | |
| *** eernst has joined #openstack-infra | 02:34 | |
| *** adriant has joined #openstack-infra | 02:38 | |
| *** yamamoto has quit IRC | 02:40 | |
| *** eernst has quit IRC | 02:41 | |
| *** eernst has joined #openstack-infra | 02:41 | |
| *** yamamoto has joined #openstack-infra | 02:41 | |
| openstackgerrit | Merged openstack-infra/system-config master: letsencrypt: split staging and self-signed generation https://review.openstack.org/651388 | 02:44 |
| *** betherly has joined #openstack-infra | 02:45 | |
| *** betherly has quit IRC | 02:50 | |
| *** hwoarang has quit IRC | 02:57 | |
| *** bhavikdbavishi has joined #openstack-infra | 02:57 | |
| *** hwoarang has joined #openstack-infra | 02:58 | |
| fungi | ianw: passwords are reset and the ewr1 region details are now in the list (as a separate cloud because the keystone endpoint is different) | 03:00 |
| *** psachin has joined #openstack-infra | 03:00 | |
| fungi | i'm gonna knock off and get some shuteye before stein release begins in 9 hours | 03:01 |
| ianw | fungi: ok, cool, i'll see if i can take a look, just babysitting LE for the minute | 03:02 |
| fungi | don't feel compelled, just following up because you had asked about it | 03:04 |
| fungi | but thanks! | 03:05 |
| *** eernst has quit IRC | 03:17 | |
| *** armax has quit IRC | 03:17 | |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/nodepool master: Dockerfile: add support for arbritary uid https://review.openstack.org/651424 | 03:24 |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul master: Dockerfile: add support for arbritary uid https://review.openstack.org/650246 | 03:24 |
| *** udesale has joined #openstack-infra | 03:26 | |
| *** ricolin has joined #openstack-infra | 03:31 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/system-config master: [dmn] Stashing some scripts to make git:// -> https:// changes https://review.openstack.org/642314 | 03:33 |
| ianw | [Wed Apr 10 03:41:01 UTC 2019] Cert success. | 03:41 |
| ianw | yay! | 03:41 |
| *** hongbin has quit IRC | 03:42 | |
| *** ramishra has joined #openstack-infra | 03:44 | |
| *** rh-jelabarre has quit IRC | 03:44 | |
| *** rkukura_ has joined #openstack-infra | 03:53 | |
| *** rkukura has quit IRC | 03:57 | |
| *** rkukura_ is now known as rkukura | 03:57 | |
| openstackgerrit | Merged openstack-infra/system-config master: Add #openstack-uk to statusbot's list of channels https://review.openstack.org/644679 | 03:57 |
| *** imacdonn_ has quit IRC | 04:03 | |
| *** imacdonn_ has joined #openstack-infra | 04:03 | |
| *** betherly has joined #openstack-infra | 04:18 | |
| *** betherly has quit IRC | 04:23 | |
| *** diablo_rojo has quit IRC | 04:29 | |
| *** openstackstatus has quit IRC | 04:35 | |
| *** openstackstatus has joined #openstack-infra | 04:36 | |
| *** ChanServ sets mode: +v openstackstatus | 04:36 | |
| *** ykarel|away has joined #openstack-infra | 04:39 | |
| *** ykarel_ has joined #openstack-infra | 04:44 | |
| *** ykarel|away has quit IRC | 04:47 | |
| *** quiquell|off is now known as quiquell|rover | 04:48 | |
| *** ykarel_ is now known as ykarel | 04:56 | |
| *** yamamoto has quit IRC | 04:57 | |
| *** betherly has joined #openstack-infra | 05:00 | |
| *** betherly has quit IRC | 05:04 | |
| *** pcaruana has joined #openstack-infra | 05:06 | |
| *** yamamoto has joined #openstack-infra | 05:07 | |
| *** ykarel_ has joined #openstack-infra | 05:09 | |
| *** yamamoto has quit IRC | 05:10 | |
| *** yamamoto has joined #openstack-infra | 05:10 | |
| *** ykarel has quit IRC | 05:11 | |
| *** ricolin has quit IRC | 05:30 | |
| *** yamamoto has quit IRC | 05:49 | |
| *** yamamoto has joined #openstack-infra | 05:50 | |
| *** ykarel_ is now known as ykarel | 05:50 | |
| *** bhavikdbavishi has quit IRC | 05:54 | |
| *** bhavikdbavishi has joined #openstack-infra | 05:55 | |
| AJaeger | ianw, frickler, could we merge https://review.openstack.org/651360 , please? That allows to merge new repo creation reviews - the daily update job is broken right now | 06:00 |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config master: Some python yaml fixes https://review.openstack.org/651338 | 06:08 |
| *** hwoarang has quit IRC | 06:10 | |
| *** kopecmartin|off is now known as kopecmartin | 06:10 | |
| *** hwoarang has joined #openstack-infra | 06:15 | |
| *** janki has joined #openstack-infra | 06:19 | |
| openstackgerrit | Merged opendev/base-jobs master: Use tox-linters for opendev https://review.openstack.org/651240 | 06:20 |
| *** kjackal has joined #openstack-infra | 06:24 | |
| *** yamamoto has quit IRC | 06:26 | |
| *** yamamoto has joined #openstack-infra | 06:27 | |
| *** e0ne has joined #openstack-infra | 06:28 | |
| *** quiquell|rover is now known as quique|rover|brb | 06:28 | |
| *** ijw has joined #openstack-infra | 06:29 | |
| *** apetrich has joined #openstack-infra | 06:30 | |
| *** kjackal has quit IRC | 06:31 | |
| *** yamamoto has quit IRC | 06:32 | |
| openstackgerrit | Merged openstack-infra/project-config master: Remove upstream lines from gerrit/projects.yaml https://review.openstack.org/651360 | 06:32 |
| *** hwoarang has quit IRC | 06:33 | |
| *** hwoarang has joined #openstack-infra | 06:35 | |
| *** kmarc- has quit IRC | 06:35 | |
| *** kmarc_ has joined #openstack-infra | 06:37 | |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/nodepool master: Add python-path option to node https://review.openstack.org/637338 | 06:38 |
| *** yamamoto has joined #openstack-infra | 06:38 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/system-config master: yamlgroup: add regex match; exclude puppet4 for arm64 mirrors https://review.openstack.org/651442 | 06:40 |
| ianw | clarkb / cmurphy : ^ i do not like this ... but i don't have a lot of ideas? | 06:40 |
| ianw | mordred: ^ you're probably also interested in the yamlgroups regex change ... | 06:40 |
| *** pgaxatte has joined #openstack-infra | 06:43 | |
| *** yamamoto has quit IRC | 06:47 | |
| *** yamamoto has joined #openstack-infra | 06:48 | |
| *** e0ne has quit IRC | 06:48 | |
| *** kjackal has joined #openstack-infra | 06:51 | |
| openstackgerrit | Tony Breeds proposed openstack-infra/irc-meetings master: Move the release team meeting https://review.openstack.org/651443 | 06:52 |
| *** e0ne has joined #openstack-infra | 06:57 | |
| *** slaweq has joined #openstack-infra | 07:00 | |
| *** rpittau|afk is now known as rpittau | 07:05 | |
| *** ginopc has joined #openstack-infra | 07:05 | |
| *** sshnaidm|pto is now known as sshnaidm | 07:06 | |
| *** quique|rover|brb is now known as quiquell|rover | 07:11 | |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config master: Some python yaml fixes https://review.openstack.org/651338 | 07:12 |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config master: Some python yaml fixes https://review.openstack.org/651338 | 07:15 |
| *** owalsh_ is now known as owalsh | 07:17 | |
| *** gfidente has joined #openstack-infra | 07:25 | |
| openstackgerrit | Slawek Kaplonski proposed openstack-infra/project-config master: Add networking-midonet-tempest-aio-ml2-centos-7 to neutron dashboard https://review.openstack.org/651448 | 07:25 |
| *** tosky has joined #openstack-infra | 07:28 | |
| *** psachin has quit IRC | 07:32 | |
| *** e0ne has quit IRC | 07:33 | |
| *** pcaruana has quit IRC | 07:34 | |
| *** pcaruana has joined #openstack-infra | 07:35 | |
| *** psachin has joined #openstack-infra | 07:35 | |
| *** yamamoto has quit IRC | 07:37 | |
| *** yamamoto has joined #openstack-infra | 07:38 | |
| *** e0ne has joined #openstack-infra | 07:40 | |
| *** lpetrut has joined #openstack-infra | 07:41 | |
| *** ccamacho has joined #openstack-infra | 07:45 | |
| openstackgerrit | Merged openstack-infra/zuul master: tox: Fix indentation https://review.openstack.org/649040 | 07:48 |
| *** jpich has joined #openstack-infra | 07:48 | |
| *** e0ne has quit IRC | 07:48 | |
| *** gregoryo has quit IRC | 07:51 | |
| *** jpena|off is now known as jpena | 07:52 | |
| *** e0ne has joined #openstack-infra | 07:53 | |
| *** quiquell|rover is now known as quique|rover|bbl | 07:54 | |
| *** yamamoto has quit IRC | 07:56 | |
| openstackgerrit | Luigi Toscano proposed openstack-infra/zuul-jobs master: stage-output: fix dotfiles handling https://review.openstack.org/648658 | 07:58 |
| *** ykarel is now known as ykarel|lunch | 07:59 | |
| mgoddard | morning, I think my emails from Zuul have stopped. Last one was 12 hours ago | 08:01 |
| *** tkajinam has quit IRC | 08:04 | |
| frickler | mgoddard: I think you are talking about gerrit, but yes review.openstack.org seems to have aquired some bad reputation ... host [104.130.246.32] blocked using Spamhaus PBL. | 08:04 |
| frickler | infra-root: ^^ not sure how much we can do about this | 08:04 |
| mgoddard | frickler: you're correct, I do mean Gerrit. Still waking up | 08:04 |
| *** priteau has joined #openstack-infra | 08:05 | |
| openstackgerrit | Luigi Toscano proposed openstack-infra/zuul-jobs master: stage-output: fix dotfiles handling https://review.openstack.org/648658 | 08:05 |
| frickler | infra-root: spamhaus shows https://www.spamhaus.org/pbl/query/PBL1660620, I'll try to remove our IP | 08:06 |
| openstackgerrit | Merged openstack-infra/zuul master: Assert ara database is loaded from ansible venv https://review.openstack.org/650917 | 08:09 |
| *** yamamoto has joined #openstack-infra | 08:11 | |
| frickler | #status log successfully submitted a request to remove 104.130.246.32 (review01.openstack.org) from Spamhaus PBL | 08:15 |
| openstackstatus | frickler: finished logging | 08:15 |
| *** evrardjp has quit IRC | 08:18 | |
| *** evrardjp has joined #openstack-infra | 08:19 | |
| *** roman_g has joined #openstack-infra | 08:20 | |
| *** yamamoto has quit IRC | 08:22 | |
| *** bhavikdbavishi has quit IRC | 08:24 | |
| mgoddard | thanks frickler | 08:25 |
| mgoddard | frickler: while I'm here, I had some stable release job failures for kayobe. Is that something you could help with? | 08:26 |
| mgoddard | frickler: here's the email: http://lists.openstack.org/pipermail/release-job-failures/2019-April/001117.html | 08:27 |
| iurygregory | Moring infra team, It's possible to split a cherry-pick in two different commits for a stable branch? | 08:29 |
| frickler | mgoddard: hmm, that looks like an error in the job definition, possibly related to some recent changes on our side. "Unable to freeze job graph: Unable to modify final job" means that you are you are trying to create a variant from doesn't allow that | 08:29 |
| *** ricolin has joined #openstack-infra | 08:30 | |
| frickler | mgoddard: I'll try to dig more in a bit, but maybe that'll need to wait for some zuul specialist | 08:30 |
| *** lucasagomes has joined #openstack-infra | 08:30 | |
| mgoddard | frickler: right, it does make a bit more sense now I've stared at the message for a bit. I'll check the base job definition | 08:31 |
| frickler | mgoddard: IIUC you need to specify the vars like in this doc, instead of attaching directly to the job https://docs.openstack.org/infra/openstack-zuul-jobs/project-templates.html#project_template-docs-on-readthedocs | 08:34 |
| iurygregory | We have the following scenario in ironic, we had tests failures under stable/stein and we had only cherry-picked the necessary test from https://review.openstack.org/#/c/642474/ (the cherry pick was merged https://review.openstack.org/#/c/645146/ ) and now since we are cherry-picking zuulv3 (https://review.openstack.org/#/c/647774/ ) we want to have python3 job that is in master in the same commit that have the tests fixes | 08:34 |
| iurygregory | and I get " ! [remote rejected] HEAD -> refs/publish/stable/stein/py3 (change https://review.openstack.org/645146 closed " | 08:34 |
| mgoddard | frickler: I do that for docs, but also have release notes on RTD, so added the jobs manually as it didn't seem possible to add a template twice | 08:35 |
| *** derekh has joined #openstack-infra | 08:35 | |
| frickler | iurygregory: where do you get that error? splitting the cherry-pick is something you'd have to do manually I think | 08:36 |
| frickler | mgoddard: the templates should cover both | 08:36 |
| iurygregory | frickler, I'm doing manually let me post a paste with the steps I did | 08:36 |
| mgoddard | frickler: they're different RTD sites - kayobe. and kayobe-release-notes. - different webhook IDs | 08:36 |
| frickler | mgoddard: ah, I see. I guess then indeed we need to wait for someone who knows the details of that job better than me | 08:38 |
| mgoddard | frickler: no problem, thanks for your help | 08:40 |
| *** ginopc has quit IRC | 08:40 | |
| iurygregory | frickler, http://paste.openstack.org/show/749087/ | 08:42 |
| openstackgerrit | Pedro Alvarez Piedehierro proposed openstack-infra/system-config master: Changed config to add the new ewr1cloud * New cloud 'arm64ci-ewr1' (url: ewr1cloud.arm64ci.cloud) * Keeping the old cloud 'arm64ci' (url: arm64ci.cloud) for now for a bit of overlap. https://review.openstack.org/650021 | 08:43 |
| frickler | infra-root: pbl removal seems to have succeeded. where do bounces for review@o.o go? maybe it would make sense to clean up bouncing (e.g. non-existing) mail addresses in order to help our reputation in general? there also are lots of bounces for github@review01.openstack.org in the exim log | 08:44 |
| *** ginopc has joined #openstack-infra | 08:45 | |
| frickler | iurygregory: IIUC your patch has already been merged as https://review.openstack.org/#/c/645146/, so gerrit refuses for it to be submitted again when it is already present in that branch | 08:47 |
| *** e0ne has quit IRC | 08:47 | |
| iurygregory | frickler, yeah but https://review.openstack.org/#/c/645146/ is only one test that we cherry-picked from https://review.openstack.org/#/c/642474/ to unblock stable/stein | 08:48 |
| iurygregory | and now we want the other things that are in https://review.openstack.org/#/c/642474/ =( | 08:48 |
| *** gfidente has quit IRC | 08:50 | |
| frickler | iurygregory: ah, the issue is probably the change-id. amend the commit message of your new patch and remove it, then the git hook can create a new one | 08:52 |
| iurygregory | frickler, let me try | 08:53 |
| *** yamamoto has joined #openstack-infra | 08:54 | |
| openstackgerrit | Pedro Alvarez Piedehierro proposed openstack-infra/system-config master: Changed config to add the new ewr1cloud https://review.openstack.org/650021 | 08:57 |
| *** dtantsur|afk is now known as dtantsur | 08:58 | |
| *** e0ne has joined #openstack-infra | 08:58 | |
| iurygregory | frickler, tks for the help it worked | 09:00 |
| *** ykarel|lunch is now known as ykarel | 09:04 | |
| *** bhavikdbavishi has joined #openstack-infra | 09:04 | |
| *** ijw has quit IRC | 09:05 | |
| *** e0ne has quit IRC | 09:06 | |
| *** Lucas_Gray has joined #openstack-infra | 09:25 | |
| *** electrofelix has joined #openstack-infra | 09:28 | |
| *** yamamoto has quit IRC | 09:28 | |
| *** Lucas_Gray has quit IRC | 09:31 | |
| *** Lucas_Gray has joined #openstack-infra | 09:34 | |
| *** ociuhandu has quit IRC | 09:35 | |
| frickler | infra-root: for the github user, we could either create its home dir or make sure the cron doesn't generate mails here http://git.openstack.org/cgit/openstack-infra/puppet-github/tree/manifests/init.pp#n88 | 09:40 |
| *** gfidente has joined #openstack-infra | 09:43 | |
| frickler | user account is created at L32 in the same file, but without creating the homedir, which defaults to /home/github | 09:45 |
| *** rcernin has quit IRC | 09:47 | |
| *** quique|rover|bbl is now known as quiquell|rover | 09:50 | |
| *** kjackal has quit IRC | 09:56 | |
| *** yamamoto has joined #openstack-infra | 09:58 | |
| *** yamamoto has quit IRC | 10:01 | |
| *** yamamoto has joined #openstack-infra | 10:01 | |
| *** yamamoto has quit IRC | 10:05 | |
| *** kjackal has joined #openstack-infra | 10:08 | |
| zigo | ianw: Hi there! | 10:13 |
| zigo | What's the status for Buster in infra, and how may I help to make it go further? | 10:13 |
| *** tbachman has quit IRC | 10:13 | |
| fungi | frickler: pbl entries generally have nothing to do with reputation, it's a default *policy* set by the service provider (so in this case rackspace) reducing the number of spam complaints their abuse desk has to field | 10:35 |
| fungi | anyway, thanks for getting the exception filed. we end up playing whack-a-mole with these as rackspace adds another netblock to the pbl | 10:36 |
| *** yamamoto has joined #openstack-infra | 10:44 | |
| *** yamamoto has quit IRC | 10:50 | |
| *** tbachman has joined #openstack-infra | 10:50 | |
| *** nicolasbock has joined #openstack-infra | 10:52 | |
| *** bhavikdbavishi has quit IRC | 10:53 | |
| *** jamesdenton has quit IRC | 11:03 | |
| *** e0ne has joined #openstack-infra | 11:12 | |
| *** e0ne has quit IRC | 11:15 | |
| AJaeger | fungi, config-core, coming back to https://review.openstack.org/#/c/651338/ - I updated to use safe_load as clarkb suggested. Two open points are: Do we want the sorting - and why is the IRC job failing? I don't understand why it still fails... Any help welcome | 11:17 |
| *** e0ne has joined #openstack-infra | 11:19 | |
| *** e0ne has quit IRC | 11:20 | |
| *** jamesdenton has joined #openstack-infra | 11:20 | |
| *** udesale has quit IRC | 11:24 | |
| *** e0ne has joined #openstack-infra | 11:24 | |
| *** udesale has joined #openstack-infra | 11:24 | |
| *** yamamoto has joined #openstack-infra | 11:26 | |
| *** jpena is now known as jpena|lunch | 11:34 | |
| *** ginopc has quit IRC | 11:36 | |
| *** ginopc has joined #openstack-infra | 11:37 | |
| *** rh-jelabarre has joined #openstack-infra | 11:42 | |
| frickler | AJaeger: the failure is in front of that large dump: http://logs.openstack.org/38/651338/7/check/project-config-irc-access/c51d2cd/job-output.txt.gz#_2019-04-10_07_38_51_644720 | 11:43 |
| fungi | infra-root: config-core: infra-puppet-core: reminder, openstack stein release activity is beginning roughly now, so please refrain from approving anything we think could be remotely disruptive to release activities | 11:45 |
| jhesketh | :thumbsup: | 11:45 |
| fungi | hopefully done and dusted in under an hour | 11:45 |
| *** dpawlik has joined #openstack-infra | 11:47 | |
| AJaeger | frickler: but why? The change removed sort_keys and I wonder how it still shows up as an error... Something is going on that I don't understand? | 11:47 |
| AJaeger | frickler: I cannot reproduce locally ;( | 11:48 |
| *** roman_g has quit IRC | 11:48 | |
| frickler | AJaeger: hmm, maybe this isn't self-testing because it's a config project? that would probably need to make the check non-voting to merge this patch | 11:50 |
| *** bhavikdbavishi has joined #openstack-infra | 11:52 | |
| frickler | AJaeger: let me hold a node so we can check this directly | 11:53 |
| *** rlandy has joined #openstack-infra | 11:55 | |
| *** bobh has joined #openstack-infra | 11:55 | |
| *** rlandy is now known as rlandy|ruck | 11:56 | |
| *** udesale has quit IRC | 11:59 | |
| *** eharney has joined #openstack-infra | 12:06 | |
| *** tbachman has quit IRC | 12:06 | |
| frickler | AJaeger: indeed zuul.projects has p-c with "checkout: master", that overwrites the checked-out patch during mirror-workspace-git-repos although the log output is a bit misleading http://logs.openstack.org/38/651338/7/check/project-config-irc-access/c51d2cd/zuul-info/inventory.yaml | 12:06 |
| *** e0ne has quit IRC | 12:09 | |
| *** e0ne has joined #openstack-infra | 12:12 | |
| *** priteau has quit IRC | 12:12 | |
| *** tbachman has joined #openstack-infra | 12:13 | |
| *** e0ne has quit IRC | 12:13 | |
| *** priteau has joined #openstack-infra | 12:13 | |
| mordred | frickler: checking out master should be fine - master would be the speculative future state zuul has prepared for the master branch | 12:16 |
| *** dave-mccowan has joined #openstack-infra | 12:17 | |
| mordred | frickler: we actaully don't provide a ref corresponding to origin/master in the repos we push onto the nodes | 12:17 |
| mordred | (this doesn't explain what's going on of course) | 12:17 |
| *** bobh has quit IRC | 12:18 | |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul master: Dockerfile: add support for arbritary uid https://review.openstack.org/650246 | 12:19 |
| mordred | AJaeger: looking at your patch locally | 12:19 |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/nodepool master: Dockerfile: add support for arbritary uid https://review.openstack.org/651424 | 12:20 |
| frickler | mordred: oh, indeed, I wrongly assumed that master would be == origin/master | 12:21 |
| frickler | mordred: I still have the node held for debugging, if you want to take a look at the situation in our CI directly - 149.202.178.134 | 12:21 |
| mordred | kk, thanks | 12:23 |
| Shrews | fungi: aye, around to help run around wildly with my arms in the air if the fan starts to get covered with unpleasant things. though have to leave in a couple of hours for some unpleasant physical therapy | 12:27 |
| *** e0ne has joined #openstack-infra | 12:28 | |
| frickler | AJaeger: mordred: in the tox irc env we have PyYAML==5.1 while globally we have PyYAML==3.12. with the former I get the same error as in the CI | 12:30 |
| fungi | thanks Shrews! your kermit arms are most appreciated | 12:31 |
| mordred | frickler: I'm investigating just switching these to using projectconfig_ruamellib.py instead | 12:31 |
| mordred | frickler: since it understands preserving comments and ordering and whatnot | 12:31 |
| *** jpena|lunch is now known as jpena | 12:31 | |
| mordred | and we're already using it in other scripts | 12:32 |
| frickler | mordred: solving things at a higher level sounds almost magical ;) | 12:33 |
| *** kjackal has quit IRC | 12:33 | |
| *** udesale has joined #openstack-infra | 12:36 | |
| *** tbachman has quit IRC | 12:37 | |
| mnaser | infra-root: may I be added to vexxhost-core ? https://review.openstack.org/#/admin/groups/2021,members | 12:38 |
| frickler | mnaser: where does that group belong to? | 12:38 |
| mnaser | right now, vexxhost/ansible-role-wireguard | 12:39 |
| mnaser | frickler: https://review.openstack.org/#/c/650396/ | 12:39 |
| frickler | mnaser: ah, right, will add you in a minute | 12:40 |
| frickler | mnaser: and done | 12:41 |
| AJaeger | mordred, frickler , thanks for looking into it. | 12:41 |
| *** Goneri has joined #openstack-infra | 12:42 | |
| *** gfidente is now known as gfidente|afk | 12:42 | |
| *** tbachman has joined #openstack-infra | 12:42 | |
| *** kjackal has joined #openstack-infra | 12:43 | |
| *** ricolin has quit IRC | 12:50 | |
| *** ricolin has joined #openstack-infra | 12:51 | |
| *** kgiusti has joined #openstack-infra | 12:51 | |
| openstackgerrit | Tobias Henkel proposed openstack-infra/zuul master: WIP: Support emitting warnings via zuul_return https://review.openstack.org/651526 | 12:54 |
| frickler | AJaeger: actually the fix for your error would be not removing the sort_keys parameter, but adding it here http://paste.openstack.org/show/749109/ | 12:58 |
| frickler | but let's wait whether mordred comes up with a better solution | 12:58 |
| *** yolanda_ has joined #openstack-infra | 12:58 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/project-config master: Some python yaml fixes https://review.openstack.org/651338 | 13:00 |
| mordred | frickler, AJaeger: ^^ that works for me locally and results in less change to the projects.yaml file | 13:00 |
| mordred | only resulting change is that the long descriptions are wrapped slighty more aggressively | 13:01 |
| *** udesale has quit IRC | 13:01 | |
| *** lpetrut has quit IRC | 13:01 | |
| *** mriedem has joined #openstack-infra | 13:02 | |
| *** udesale has joined #openstack-infra | 13:03 | |
| *** irclogbot_0 has joined #openstack-infra | 13:03 | |
| *** aaronsheffield has joined #openstack-infra | 13:04 | |
| *** altlogbot_2 has joined #openstack-infra | 13:06 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/project-config master: Some python yaml fixes https://review.openstack.org/651338 | 13:07 |
| openstackgerrit | Monty Taylor proposed openstack-infra/project-config master: Let ruamel.yaml handle comments https://review.openstack.org/651528 | 13:07 |
| mordred | sorry - there was a bug in the first version - then I added a followup patch that removes some stuff we don't need to do any more | 13:07 |
| Shrews | because i'm proudly a geek, and this is historic: https://twitter.com/NSF/status/1115964620186030080 | 13:14 |
| mordred | Shrews: neat! | 13:16 |
| fungi | Shrews: absolutely! | 13:16 |
| fungi | an historic moment in astronomy | 13:16 |
| fungi | as well as astrophysics and relativity | 13:16 |
| AJaeger | mordred: interesting... Thanks a lot! | 13:17 |
| AJaeger | mordred: will review later... | 13:17 |
| *** dklyle has joined #openstack-infra | 13:17 | |
| mordred | AJaeger: I've got one more little cleanup patch coming | 13:18 |
| *** yamamoto has quit IRC | 13:19 | |
| *** yamamoto has joined #openstack-infra | 13:19 | |
| *** e0ne has quit IRC | 13:20 | |
| *** e0ne has joined #openstack-infra | 13:25 | |
| AJaeger | mordred: and the irc change does not pass yet, so needs some messaging of the files. But it's coming along nicely, thanks! | 13:29 |
| AJaeger | mordred: can we delete projectconfig_yamllib now? | 13:30 |
| *** bhavikdbavishi has quit IRC | 13:33 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/project-config master: Some python yaml fixes https://review.openstack.org/651338 | 13:33 |
| openstackgerrit | Monty Taylor proposed openstack-infra/project-config master: Add some helpers to projectconfig_ruamellib https://review.openstack.org/651532 | 13:33 |
| mordred | AJaeger: yes. also - maybe that one will be better | 13:34 |
| *** quiquell|rover is now known as quiquell|lunch | 13:38 | |
| *** lseki has joined #openstack-infra | 13:39 | |
| mordred | AJaeger: all green now | 13:47 |
| AJaeger | \o/ | 13:47 |
| *** tbachman has quit IRC | 13:47 | |
| *** tbachman has joined #openstack-infra | 13:47 | |
| AJaeger | fungi, frickler, mnaser, could you review 651338 and 651532 to unblock some of our jobs ,please? | 13:48 |
| *** yolanda_ has quit IRC | 13:49 | |
| mnaser | "sort_keys isn't supported for reasons surpassing understanding" | 13:53 |
| mnaser | ++++++++++1 | 13:53 |
| *** e0ne has quit IRC | 13:54 | |
| AJaeger | mnaser: yeah, a fun change with going to newer pyyaml ;( | 13:56 |
| *** e0ne has joined #openstack-infra | 13:57 | |
| AJaeger | thanks for reviewing, mnaser and fungi! | 13:59 |
| fungi | infra-root: config-core: infra-puppet-core: openstack stein release automation wrapped up quickly as hoped, so we ought to be able to return to normal review activities. thanks! | 14:01 |
| *** quiquell|lunch is now known as quiquell|rover | 14:02 | |
| AJaeger | thanks, fungi! | 14:02 |
| clarkb | fungi no expected straggler releases or tasks at this point? | 14:05 |
| fungi | nope | 14:06 |
| clarkb | great! time to apptove dmsimard's gerrit config change then plan yo restart gerrit soon? :) | 14:07 |
| openstackgerrit | Merged openstack-infra/project-config master: Some python yaml fixes https://review.openstack.org/651338 | 14:08 |
| openstackgerrit | Merged openstack-infra/project-config master: Add some helpers to projectconfig_ruamellib https://review.openstack.org/651532 | 14:08 |
| fungi | clarkb: sgtm | 14:09 |
| clarkb | sounds like one more change to merge based on release channrl irc? | 14:10 |
| *** ykarel is now known as ykarel|away | 14:11 | |
| fungi | yeah, 650365 officially switches us to train, so let's not restart gerrit until that merges | 14:12 |
| *** janki has quit IRC | 14:13 | |
| *** openstackgerrit has quit IRC | 14:14 | |
| *** slaweq has quit IRC | 14:16 | |
| smcginnis | Yes please. :) | 14:18 |
| *** roman_g has joined #openstack-infra | 14:25 | |
| *** ykarel|away has quit IRC | 14:35 | |
| *** yamamoto has quit IRC | 14:36 | |
| *** yamamoto has joined #openstack-infra | 14:40 | |
| *** yamamoto has quit IRC | 14:41 | |
| *** yamamoto has joined #openstack-infra | 14:42 | |
| *** sthussey has joined #openstack-infra | 14:43 | |
| *** openstackgerrit has joined #openstack-infra | 14:43 | |
| openstackgerrit | Stephen Finucane proposed openstack-dev/hacking master: Fix W605 from flake8 3.0+ https://review.openstack.org/651564 | 14:43 |
| openstackgerrit | Stephen Finucane proposed openstack-dev/hacking master: Bump flake8 version to something modern https://review.openstack.org/651565 | 14:43 |
| openstackgerrit | Stephen Finucane proposed openstack-dev/hacking master: General cleanups https://review.openstack.org/651566 | 14:43 |
| *** iurygregory has quit IRC | 14:44 | |
| *** iurygregory has joined #openstack-infra | 14:46 | |
| *** yamamoto has quit IRC | 14:47 | |
| *** e0ne has quit IRC | 14:50 | |
| *** e0ne has joined #openstack-infra | 14:54 | |
| *** slaweq has joined #openstack-infra | 14:54 | |
| *** ianychoi has quit IRC | 14:56 | |
| ironfoot | Hmf.. building an Amphora image for something other than x86 (aarch64) is not being easy... I take I'm possible the first one trying to do it | 14:58 |
| clarkb | ironfoot: Vorrtex in #openstack-dib is trying to do it for ppc too and struggling. I expect that you are right though that no one has done it for anything but x86 | 14:59 |
| ironfoot | oh, that's probably the best channel for this discussion, thanks clarkb | 15:00 |
| *** quiquell|rover is now known as quiquell|off | 15:01 | |
| *** diablo_rojo has joined #openstack-infra | 15:02 | |
| *** ykarel has joined #openstack-infra | 15:07 | |
| *** tbachman has quit IRC | 15:08 | |
| openstackgerrit | Merged openstack-infra/zuul-jobs master: Only alias registries on build nodes https://review.openstack.org/651393 | 15:08 |
| *** armax has joined #openstack-infra | 15:12 | |
| *** tbachman has joined #openstack-infra | 15:18 | |
| openstackgerrit | Clark Boylan proposed openstack-infra/zuul-jobs master: Revert "Only alias registries on build nodes" https://review.openstack.org/651579 | 15:22 |
| *** dave-mccowan has quit IRC | 15:23 | |
| *** dave-mccowan has joined #openstack-infra | 15:24 | |
| smcginnis | All release critical activities have completed for the stein cycle. | 15:25 |
| smcginnis | Feel free to do any restarts if needed. We still have other things, but nothing as critical. | 15:26 |
| *** gyee has joined #openstack-infra | 15:26 | |
| clarkb | smcginnis: thanks! | 15:26 |
| *** ccamacho has quit IRC | 15:28 | |
| *** efried has quit IRC | 15:28 | |
| *** jamesmcarthur has joined #openstack-infra | 15:32 | |
| anteaya | smcginnis: congratulations | 15:37 |
| smcginnis | Hey anteaya! o/ | 15:37 |
| *** tbachman has quit IRC | 15:38 | |
| anteaya | smcginnis: how are you? | 15:39 |
| anteaya | smcginnis: I'm going with some sense of relief? | 15:39 |
| smcginnis | anteaya: Yeah, pretty good overall. Good feeling to have some of these things done. How've you been? | 15:40 |
| anteaya | good thanks | 15:40 |
| anteaya | boiling down maple syrup today | 15:40 |
| anteaya | beautiful sunshiney day | 15:40 |
| smcginnis | Ooh, delicious. | 15:40 |
| anteaya | it has been a good season so far | 15:40 |
| anteaya | this is the third round | 15:40 |
| clarkb | anteaya: I just want to say that is very canadian of you :) | 15:41 |
| anteaya | ha ha ha | 15:41 |
| clarkb | fwiw I'm the only one in the family that likes the real maple syrup instead of the corn syrup based stuff. Makes me sad | 15:41 |
| anteaya | got to get my civic points for the year | 15:41 |
| anteaya | didn't play much hockey this season | 15:41 |
| anteaya | oh my | 15:41 |
| anteaya | that is very sad | 15:42 |
| anteaya | clarkb: I commend your good taste | 15:42 |
| anteaya | I just came in to check on things, heading back outside now | 15:43 |
| anteaya | I've got some smoke to stand in | 15:43 |
| clarkb | infra-root I have approved dmsimard replication config autoreload setting update | 15:44 |
| mordred | ++ | 15:44 |
| clarkb | I figure we are about an hour or so away from being able to restart gerrit for that | 15:44 |
| clarkb | Then once we are happy with that working I'll likely approve the upgrade review.openstack.org to puppet-4 change | 15:45 |
| clarkb | but one thing at a time today | 15:45 |
| *** pgaxatte has quit IRC | 15:45 | |
| *** iurygregory has quit IRC | 15:46 | |
| openstackgerrit | Merged openstack-infra/zuul-jobs master: Revert "Only alias registries on build nodes" https://review.openstack.org/651579 | 15:46 |
| *** efried has joined #openstack-infra | 15:47 | |
| *** yamamoto has joined #openstack-infra | 15:50 | |
| *** mattw4 has joined #openstack-infra | 15:51 | |
| *** rpittau is now known as rpittau|afk | 15:53 | |
| *** roman_g has quit IRC | 15:54 | |
| *** yamamoto has quit IRC | 15:59 | |
| *** geguileo has joined #openstack-infra | 16:00 | |
| *** _erlon_ has joined #openstack-infra | 16:02 | |
| *** bhavikdbavishi has joined #openstack-infra | 16:03 | |
| *** tbachman has joined #openstack-infra | 16:04 | |
| *** roman_g has joined #openstack-infra | 16:05 | |
| *** Lucas_Gray has quit IRC | 16:06 | |
| *** jamesmcarthur has quit IRC | 16:06 | |
| *** jamesmcarthur has joined #openstack-infra | 16:08 | |
| *** ociuhandu has joined #openstack-infra | 16:08 | |
| *** ociuhandu has quit IRC | 16:10 | |
| *** lucasagomes has quit IRC | 16:11 | |
| *** psachin has quit IRC | 16:14 | |
| *** efried is now known as efried_rollin | 16:14 | |
| *** dtantsur is now known as dtantsur|afk | 16:15 | |
| openstackgerrit | Merged openstack-infra/system-config master: Enable gerrit replication.autoReload for review https://review.openstack.org/650051 | 16:17 |
| *** derekh has quit IRC | 16:28 | |
| *** ramishra has quit IRC | 16:41 | |
| *** altlogbot_2 has quit IRC | 16:45 | |
| *** wolverineav has joined #openstack-infra | 16:53 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul master: Handle project not found exception better https://review.openstack.org/651609 | 16:54 |
| *** e0ne has quit IRC | 16:55 | |
| *** wolverineav has quit IRC | 16:56 | |
| *** wolverineav has joined #openstack-infra | 16:56 | |
| *** jpich has quit IRC | 17:00 | |
| *** ykarel is now known as ykarel|away | 17:03 | |
| *** kopecmartin is now known as kopecmartin|off | 17:03 | |
| zbr | ianw: please have another look at https://review.openstack.org/#/c/639951/ -- last version should address your concerns. | 17:05 |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul master: Handle github exceptions better when trying to get a PR https://review.openstack.org/651609 | 17:06 |
| *** jpena is now known as jpena|off | 17:07 | |
| *** slaweq has quit IRC | 17:14 | |
| *** ginopc has quit IRC | 17:18 | |
| fungi | need to go out to do some voting and get a late lunch, but should be back in a couple hours. happy to help with gerrit restart when i return | 17:21 |
| clarkb | fungi: thanks. I should find breakfast then | 17:21 |
| *** udesale has quit IRC | 17:23 | |
| *** priteau has quit IRC | 17:31 | |
| openstackgerrit | Merged openstack-infra/zuul master: Fix zuul-stream functional test https://review.openstack.org/650297 | 17:34 |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul master: Handle github exceptions better when trying to get a PR https://review.openstack.org/651609 | 17:36 |
| *** jamesmcarthur has quit IRC | 17:42 | |
| aspiers | hi folks, is it possible to add meetings to irc-meetings in non-fixed timezones (i.e. not UTC but stuff like Europe/London, which adapts to daylight savings)? | 17:45 |
| aspiers | if not, can I suggest this enhancement | 17:45 |
| aspiers | ? | 17:45 |
| aspiers | currently meetings shift times twice a year for a lot of people, which causes plenty of confusion | 17:46 |
| aspiers | of course this would be optional | 17:46 |
| clarkb | aspiers: I dont think the current tool makes that configurable | 17:48 |
| aspiers | that's what I thought | 17:48 |
| aspiers | could we support an optional extra timezone field? | 17:48 |
| clarkb | also the choice of UTC is somewhat intentional as it relieves confusion for when DST happens around the world. You only need to know your local change not everyone elses with utc | 17:49 |
| *** ricolin has quit IRC | 17:49 | |
| clarkb | north america and europe change at different times and souther hemisphere goes in the other direction | 17:49 |
| *** kjackal has quit IRC | 17:49 | |
| *** kjackal_v2 has joined #openstack-infra | 17:50 | |
| tosky | and few countries don't change at all | 17:50 |
| tosky | also EU may end up having different daylight dates (or no daylight) in different countries in the next years | 17:51 |
| aspiers | true, but NA/EMEA change only 1 week apart, and the ics feed makes it possible to reliably see the correct meeting time in your own calendar | 17:51 |
| tosky | so probably better stick with a neutral timezone | 17:51 |
| aspiers | self-healing SIG has two meeting times: one mainly for NA+EMEA, and one mainly for EMEA+APAC | 17:52 |
| aspiers | the former would benefit from respecting daylight savings | 17:52 |
| aspiers | the argument that this would be confusing doesn't really hold up IMHO, because there is already significant confusion caused by not respecting it | 17:53 |
| clarkb | aspiers: I think both cause confusion | 17:53 |
| aspiers | I agree :) but I think not following it can cause more | 17:54 |
| clarkb | but one causes less confusion if you understand utc and utc doesnt create a special group | 17:54 |
| tosky | I've been dealing with meetings in different timezones in the past 10 years, and I personally prefer the usage of UTC | 17:54 |
| clarkb | I dont think I would reject the feature if it was added but I dont think I would add or use it | 17:54 |
| aspiers | tosky: I think that's a slightly different topic. Aren't you talking about how to *specify* meeting times? | 17:54 |
| tosky | your mileage may vary, and I'm just a user here, of course | 17:55 |
| aspiers | tosky: I'm talking about whether times should shift automatically throughout the year | 17:55 |
| clarkb | aspiers: they do if you use utc or dont use utc | 17:55 |
| tosky | aspiers: understood, and that's fine | 17:55 |
| aspiers | This is what happens in practice with the meetings I lead: | 17:55 |
| clarkb | because dst isnt a global standard | 17:55 |
| tosky | sahara meetings were one our earlier until two weeks ago for me, now they are later, that's fine | 17:55 |
| aspiers | tosky: that might be fine for you and your audience, but it's not working well for self-healing and it didn't for HA either when those were happening | 17:56 |
| aspiers | What happens is: 1) everyone gets confused by first few meetings after DST change | 17:56 |
| tosky | (s/our/hour/) | 17:56 |
| clarkb | aspiers: Im guessing your meetinge are norther hemisphere dominant | 17:56 |
| aspiers | 2) soon after people say that the new time is not good for them | 17:56 |
| aspiers | 3) I submit a review changing the time by one hour | 17:57 |
| clarkb | othereise you'd still have large confusing shifts that go mulyiple hours instead of one | 17:57 |
| aspiers | 4) it gets merged, then people get confused yet again | 17:57 |
| aspiers | 5) repeat steps 1-4 twice a year | 17:57 |
| aspiers | if the shift happened automatically, I predict the period of confusion would still exist but be reduced | 17:57 |
| aspiers | since the ics feed would be accurate _all_year_round_ | 17:58 |
| aspiers | clarkb: yes they are | 17:58 |
| clarkb | isnt it accurate year round as ie? | 17:58 |
| clarkb | it just happens to cha ge relative to your local timezone twice a yea | 17:58 |
| aspiers | no because of step 3) | 17:58 |
| clarkb | eh | 17:59 |
| clarkb | ok | 17:59 |
| aspiers | the change means that if you look ahead (say) 3 months in your calendar, there's a reasonable chance it will tell you the wrong time | 17:59 |
| *** tjgresha has joined #openstack-infra | 17:59 | |
| aspiers | and maybe different software caches ics data for different durations | 18:00 |
| aspiers | also, I have two selfish reasons for being able to do this | 18:01 |
| aspiers | 1) it means I don't have to change the meeting twice a year (I guess I don't care about stackalytics numbers enough ;-) | 18:01 |
| *** hwoarang has quit IRC | 18:02 | |
| aspiers | 2) the two meeting times are carefully chosen to be at the extreme ends of my working day, so that I can lead both meetings. a 1-hour shift either way will put one of the meetings too early or too late for me, which causes the need for changing the meeting twice a year | 18:03 |
| aspiers | the idea was to have at least one person always attend both, to provide continuity of discussions | 18:03 |
| *** hwoarang has joined #openstack-infra | 18:03 | |
| aspiers | but again this is just me being selfish wanting to work too early or late ;-) | 18:04 |
| aspiers | food for thought anyway | 18:04 |
| clarkb | for me my biggest concern is it has the impression of telling people in the southern hemisphere that their schedule is lessimportant than mine | 18:04 |
| clarkb | but we also have southern hemisphere contributors in infra whereas others may not | 18:05 |
| aspiers | well I wasn't proposing to use this new feature for the later meeting | 18:05 |
| aspiers | so it wouldn't affect APAC | 18:05 |
| clarkb | as I said I dont wantthe feature but I wouldnt prevent adding it | 18:05 |
| aspiers | I'd probably only use it for NA/EMEA | 18:05 |
| aspiers | which are largely in sync (especially considering this is a fortnightly meeting) | 18:06 |
| aspiers | having said that, at least one of the two APAC attendees has said that 6pm/8pm can both work for him but 7pm can't due to dinner with family | 18:06 |
| clarkb | aspiers: fwiw the entire west coast of the usais in the process of moving towards permanent dst. Lots of lawmaking to get therebut that could also complicate things in the future | 18:06 |
| aspiers | so in fact the DST shift in the opposite direction actually works quite nicely :) | 18:06 |
| aspiers | I've heard similar rumblings in EU | 18:07 |
| aspiers | I'm crossing fingers! I hate winter time | 18:07 |
| aspiers | although who knows whether UK will still be in EU by that point | 18:07 |
| aspiers | but that's a whole other topic | 18:07 |
| aspiers | anyway, I've taken up too much of your time on this :) maybe it's something I could hack together quickly in Denver with a bit of help | 18:08 |
| aspiers | not urgent | 18:08 |
| *** tjgresha has quit IRC | 18:09 | |
| *** yamamoto has joined #openstack-infra | 18:12 | |
| *** jamesmcarthur has joined #openstack-infra | 18:12 | |
| clarkb | looks like it wouldn't happen before the end of 2020 | 18:13 |
| clarkb | us west coast dst that is | 18:13 |
| clarkb | California and Oregon waiting on washington to vote on it in 2020 | 18:13 |
| cmurphy | arizona already doesn't observe dst | 18:15 |
| clarkb | fungi: the autoreload change is in place on review.o.o but I'll wait for your return before restarting the service | 18:16 |
| clarkb | fungi: https://review.openstack.org/#/c/647876/3 would be the next thing in the topic:puppet-4 chain if you can review that as well | 18:17 |
| clarkb | I figure we'll start working through that stack today but want to do review.o.o on its own in case anything is unhappy | 18:18 |
| * clarkb pops out for a few | 18:19 | |
| *** tosky has quit IRC | 18:21 | |
| openstackgerrit | Tobias Henkel proposed openstack-infra/zuul master: Support emitting warnings via zuul_return https://review.openstack.org/651526 | 18:21 |
| *** Goneri has quit IRC | 18:24 | |
| *** electrofelix has quit IRC | 18:24 | |
| *** wolverineav has quit IRC | 18:25 | |
| *** ijw has joined #openstack-infra | 18:25 | |
| *** wolverineav has joined #openstack-infra | 18:25 | |
| *** gfidente|afk has quit IRC | 18:26 | |
| *** rkukura has quit IRC | 18:29 | |
| *** wolverineav has quit IRC | 18:29 | |
| *** wolverineav has joined #openstack-infra | 18:29 | |
| *** rkukura has joined #openstack-infra | 18:29 | |
| *** tobiash has quit IRC | 18:30 | |
| *** tobiash has joined #openstack-infra | 18:30 | |
| *** priteau has joined #openstack-infra | 18:32 | |
| jroll | fungi: have a few minutes to chat project renames? would you prefer here or another channel? | 18:34 |
| clarkb | jroll: I think he is out voting and grabbing food but should be back at some point | 18:35 |
| jroll | thanks | 18:35 |
| jroll | fungi: I'm free until 1930 or for a few minutes after 2030 (utc) | 18:35 |
| *** tobiash has quit IRC | 18:35 | |
| *** priteau has quit IRC | 18:37 | |
| *** tobiash has joined #openstack-infra | 18:40 | |
| openstackgerrit | Merged openstack-infra/nodepool master: Fix race with test_provider_removal unit test https://review.openstack.org/651339 | 18:42 |
| clarkb | aspiers: digging around a bit more, there is a 4 year old resolution from the TC stating that UTC is used for activities and events overseen by the TC | 18:42 |
| clarkb | whether that means meetings by official projects or just the meetings scheduled by the TC I don't know | 18:42 |
| clarkb | but something else to consider | 18:42 |
| jroll | I think the hard part about this feature is making sure that meetings which shift with DST don't end up conflicting with a meeting that doesn't shift, in terms of meeting room space | 18:46 |
| jroll | (not using meeting rooms is an easy way to solve that, ofc) | 18:46 |
| *** slaweq has joined #openstack-infra | 18:46 | |
| *** tobiash has quit IRC | 18:46 | |
| clarkb | ya could easily check that all scheduled meetings at $location use the same timezone to simplify that | 18:47 |
| clarkb | do a proper check is a fair bit more complicated and requires up to date timezone data | 18:47 |
| persia | I think that officially, all meetings should be scheduled in UTC, and all meetings should be permitted to be rescheduled. That a significant portion of meetings happen to be rescheduled when certain governments change official timezones should be regarded as coincidence. | 18:47 |
| clarkb | persia: we do allow the rescheduling but that specific bit seems to be part of aspiers issue | 18:47 |
| persia | There are too many different dates for timezone changes (and several governments have passed regulations changing the way in which timezone changes that apply as of a time prior to the regulation passing) | 18:48 |
| persia | clarkb: Yep. My points are that 1) there is no such date as "when DST applies", especially for folk who travel or work with folk in other timezones, and 2) that laws change regularly (and sometimes retroactively) to make software that tries to pretend about this stuff frequently wrong. | 18:49 |
| persia | (reading changelog for tzdata is amusing) | 18:49 |
| *** tobiash has joined #openstack-infra | 18:51 | |
| clarkb | yup and the region I live in is currently working to make the tzdata maintainers lives a little more difficult ;) | 18:52 |
| *** slaweq has quit IRC | 18:52 | |
| *** rkukura has quit IRC | 18:54 | |
| fungi | jroll: awesome! me too | 18:55 |
| jroll | fungi: hey :) | 18:55 |
| fungi | aspiers: calculatnig meeting conflicts between meetings which change times relative to one another at different points in the year could make for an amusing doctoral thesis, if you're in the market for one | 18:57 |
| fungi | aspiers: i'd argue that folks getting "confused" by meetings scheduled in a global context could stand to get accustomed to what it means to interact with people in other parts of the world | 18:59 |
| clarkb | fungi: if now is a good time (pre jroll discussion) for gerrit restart I'm ready and the zuul queues look ready too | 18:59 |
| persia | I suspect many organisations around the globe would be delighted to license any code that demonstrated such conflict resolution that might be produced along with the thesis. | 18:59 |
| openstackgerrit | Manjeet Singh Bhatia proposed openstack-infra/project-config master: Add a new project networking-omnipath https://review.openstack.org/651008 | 18:59 |
| *** ykarel|away has quit IRC | 19:00 | |
| fungi | clarkb: jroll: yep, caught up on irc scrollback, happy to put pins in the openstack namespacing plan | 19:01 |
| clarkb | does that mean I should also restart gerrit? I'm not super worried about it but two brains better than one if anything is unhappy | 19:02 |
| fungi | things to work out: official openstack deliverables currently span 3 (i think?) namespaces. what rules do we need to account for that? | 19:02 |
| clarkb | also happy to wait for this conversation to complete | 19:02 |
| fungi | clarkb: sure, gerrit restart now seems just dandy | 19:02 |
| clarkb | ok proceeding | 19:02 |
| fungi | i don't expect our conversation to depend on the continuity of gerrit | 19:02 |
| jroll | fungi: my proposal is, in this order: 1) opendev moves any repo it wants to continue owning, into whatever namespace opendev likes; 2) everything in projects.yaml goes into openstack namespace; 3) everything else goes into "unknown". | 19:03 |
| jroll | or rather, that's what the merged resolution says | 19:03 |
| clarkb | #status notice Restarting Gerrit on review.openstack.org to pick up new configuration for the replication plugin | 19:03 |
| openstackstatus | clarkb: sending notice | 19:03 |
| zbr | funny note that adding 🙏 in a gerrit comment make it give 500 Internal server error | 19:03 |
| fungi | jroll: okay, so non-opendev openstack-infra deliverables move into openstack namespace, qa deliverables in openstack-dev also move into openstack namespace? | 19:04 |
| jroll | fungi: yes | 19:04 |
| mnaser | zbr: yeah, I think it's been like that for a while | 19:04 |
| mordred | zbr: what is that? | 19:04 |
| jroll | fungi: as noted here: https://governance.openstack.org/tc/resolutions/20190322-namespace-unofficial-projects.html "This includes projects which are currently in the “openstack-dev” and “openstack-infra” namespaces which are not moving to another namespace (e.g. “opendev”)." | 19:04 |
| -openstackstatus- NOTICE: Restarting Gerrit on review.openstack.org to pick up new configuration for the replication plugin | 19:04 | |
| fungi | >>> unicodedata.name('🙏') | 19:05 |
| fungi | 'PERSON WITH FOLDED HANDS' | 19:05 |
| zbr | mordred: yeah. | 19:05 |
| mordred | ah. what does that communicate? | 19:05 |
| *** wolverineav has quit IRC | 19:05 | |
| fungi | i would hope gerrit doesn't reject that. i thought we switched it to 4-bute utf8> | 19:05 |
| jroll | mordred: https://emojipedia.org/person-with-folded-hands/ | 19:05 |
| * mordred cannot keep up with the current fad of using hieroglyphics instead of words | 19:05 | |
| fungi | 4-byte utf8? | 19:05 |
| clarkb | and gerrit is back now | 19:05 |
| clarkb | seems to have gone smoothly | 19:05 |
| mordred | jroll: so that's supposed to be "thanks"? | 19:06 |
| *** wolverineav has joined #openstack-infra | 19:06 | |
| jroll | thanks, prayers, etc | 19:06 |
| mordred | fascinating | 19:06 |
| fungi | "look at my hands" | 19:06 |
| mordred | "I have hands"? | 19:06 |
| zbr | ... at least is not look at my finger ;) | 19:06 |
| clarkb | zbr: did you happen to try and comment when I restarted gerrit? | 19:06 |
| Shrews | high five myself | 19:06 |
| openstackstatus | clarkb: finished sending notice | 19:06 |
| fungi | zbr: totally different codepoint, yes | 19:07 |
| clarkb | zbr: you may want to test it again now that the restart is complete | 19:07 |
| fungi | jroll: okay, so the idea being we retire the openstack-dev and openstack-infra namespaces in that case | 19:07 |
| jroll | fungi: indeed | 19:07 |
| clarkb | fungi: I think we've wanted to do that for -dev for a long time and the devstack case being difficult has prevented us from doing it. This is a great time to just fix the difficult :) | 19:08 |
| mordred | ++ | 19:08 |
| fungi | break all the thnigs, move forward once sufficiently unbroken again | 19:08 |
| clarkb | and as long as the redirect works our -infra puppetry shouldn't break | 19:08 |
| mordred | clarkb: if it's not on our list - we should probably move nodepool config and zuul/main.yaml to opendev/project-config so that global settings aren't in openstack/project-config | 19:08 |
| clarkb | so that should be fine too I think | 19:08 |
| clarkb | mordred: I think we can do that after? | 19:09 |
| mordred | yeah- mostly just noting that it's a thing we should probably do :) | 19:09 |
| clarkb | having puppet deploy from oepndev/project-config is a bit more work | 19:09 |
| zbr | nope, it still chokes on I try to reply from gui with emoji | 19:10 |
| *** wolverineav has quit IRC | 19:10 | |
| clarkb | then ya guessing 4 byte utf8 problem | 19:10 |
| mordred | _awesome_ | 19:11 |
| clarkb | the db we run for gerrit is like one version too old to do 4 byte utf8 iirc | 19:11 |
| zbr | clarkb: yeah, old java limitations. nevermind is not important. | 19:11 |
| clarkb | I don't think it is java | 19:12 |
| clarkb | it is mysql | 19:12 |
| clarkb | but ya part of the things that need updating | 19:12 |
| fungi | oh, i thought we had updated that already | 19:13 |
| *** rkukura has joined #openstack-infra | 19:13 | |
| fungi | maybe we merely tested it with review-dev but i thought it was taken care of last round of gerrit upgrading | 19:14 |
| clarkb | ya I don't think we've done it yet | 19:14 |
| clarkb | but we should double check :) | 19:14 |
| clarkb | we change enough stuff that it is easy to forget or misremember | 19:14 |
| clarkb | its possible we did the db move but not the table rewrite | 19:14 |
| fungi | jroll: okay, so all official openstack deliverable repos in the openstack namespace, no unofficial openstack repos in the openstack namespace... what does that mean for sigs? user committee teams? board working groups? governance repos? | 19:15 |
| *** ijw has quit IRC | 19:16 | |
| fungi | we have a lot of repositories we use for official openstack activities which aren't explicitly deliverables for openstack project teams | 19:16 |
| * clarkb has to pop out now. Larissa has an appointment so I'm watching the kids | 19:16 | |
| jroll | fungi: sorry, I meant to include those. I would think all of those should go to the openstack namespace for now, unless the sig/committee/etc says they should go elsewhere. but the TC hasn't recorded consensus on that. | 19:16 |
| fungi | mainly just want to make sure we have some set of rules we can use to come up with a definitive list of what's going in the openstack namespace and what isn't | 19:17 |
| jroll | agree | 19:17 |
| fungi | so deliverable repos tracked in https://opendev.org/openstack/governance/src/branch/master/reference/projects.yaml for sure | 19:18 |
| fungi | and also repos in https://opendev.org/openstack/governance/src/branch/master/reference/sigs-repos.yaml | 19:18 |
| clarkb | on a phone now, for the non openstack stuff do we need a stackforge/ or similar? | 19:18 |
| fungi | yeah, the tc recommended "unknown" but opendev needs to pick some sort of dumping ground for them | 19:19 |
| jroll | right | 19:19 |
| clarkb | unknown seems wrong | 19:19 |
| jroll | everyone agreed unknown was a bad name, but nobody agreed on anything better, I'm open to suggestions | 19:19 |
| fungi | i'm tempted to suggest something short and generic like "git" or "dev" or "x" | 19:19 |
| clarkb | stackforge :) | 19:20 |
| jroll | what about "_"? | 19:20 |
| fungi | jroll: maybe slightly out of scope, but what happens when a repository is retired? do we evict it at that point? or leave it in place? if the latter, do we keep retired official openstack stuff in the openstack namespace if it's listed in https://opendev.org/openstack/governance/src/branch/master/reference/legacy.yaml | 19:20 |
| clarkb | _ might be a good nil like compromise | 19:21 |
| clarkb | or maybe 'nil' | 19:21 |
| fungi | neni | 19:21 |
| fungi | nein | 19:21 |
| jroll | fungi: great question | 19:21 |
| * fungi is digging cobwebs uot of the corner cases now | 19:22 | |
| jroll | I tend to defer to "leave it" for now, but haven't really thought it through | 19:22 |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config master: Add a new project networking-omnipath https://review.openstack.org/651008 | 19:22 |
| *** yamamoto has quit IRC | 19:23 | |
| fungi | jroll: okay, so stuff in legacy.yaml stays in (or if necessary moves to) the openstack namespace | 19:23 |
| jroll | fungi: that's my uneducated opinion at the moment, yeah | 19:24 |
| *** yamamoto has joined #openstack-infra | 19:24 | |
| fungi | we likely need to hunt down a list of straggler repos not mentioned in any of the above files... governance, governance-uc, election | 19:25 |
| *** Goneri has joined #openstack-infra | 19:25 | |
| jroll | yeah, I'm happy to manually dig through the remainder | 19:25 |
| jroll | probably will ask a couple other TC folks to check my work | 19:25 |
| fungi | i'm happy to make suggestions, sure. mine start with those three ;) | 19:26 |
| fungi | so anyway, if you can summarize the above in a paragraph or so, maybe that needs to go out to the openstack-discuss ml for further recommendations | 19:26 |
| *** eharney has quit IRC | 19:28 | |
| jroll | fungi: sure, I'll send something before I take off today | 19:28 |
| jroll | thanks :) | 19:28 |
| fungi | this also reminds me why i didn't volunteer to be the openstack liaison for the migration. much harder to brainstorm this stuff with a rubber duck | 19:28 |
| fungi | thank you! | 19:29 |
| *** yamamoto has quit IRC | 19:29 | |
| *** tbachman has quit IRC | 19:29 | |
| clarkb | fungi: if you get a chance to review the topic:puppet-4 changes I can approve those as I am able to monitor them | 19:30 |
| fungi | ooh, awesome. will do | 19:30 |
| *** efried_rollin is now known as efried | 19:37 | |
| *** rlandy|ruck is now known as rlandy|ruck|brb | 19:41 | |
| *** owalsh has quit IRC | 19:43 | |
| *** bhavikdbavishi has quit IRC | 19:44 | |
| *** wolverineav has joined #openstack-infra | 19:45 | |
| *** ijw has joined #openstack-infra | 19:47 | |
| *** wolverineav has quit IRC | 19:49 | |
| *** owalsh has joined #openstack-infra | 19:50 | |
| *** tbachman has joined #openstack-infra | 19:51 | |
| *** jamesmcarthur has quit IRC | 19:59 | |
| *** wolverineav has joined #openstack-infra | 20:08 | |
| *** owalsh has quit IRC | 20:08 | |
| *** owalsh has joined #openstack-infra | 20:08 | |
| *** igordc has joined #openstack-infra | 20:08 | |
| *** rlandy|ruck|brb is now known as rlandy|ruck | 20:09 | |
| jroll | fungi: mind a quick review before I send? https://etherpad.openstack.org/p/opendev-rename-email | 20:10 |
| openstackgerrit | Matt McEuen proposed openstack-infra/project-config master: Add airship-governance project https://review.openstack.org/651342 | 20:10 |
| fungi | jroll: you bet! | 20:12 |
| fungi | jroll: bullet 1 and 2 are basically redundant with each other. also it's fine to move that toward the end. we should assume that if opendev is going to officially move a repo out of openstack it will propose a governance change to that end | 20:14 |
| * fungi will take it upon himself to check that has actually happened | 20:14 | |
| jroll | fungi: thanks, I'll drop bullet 2 and move bullet 1 to the end | 20:16 |
| fungi | we can also assume that in a conflict where a repository is under official openstack governance and is also listed in the spreadsheet for arbitrary moves, openstack has jurisdiction and should be the deciding choice | 20:16 |
| fungi | that is to say, if team x wants to move their repos out of the openstack namespace, under this plan they need to work that out with the tc first | 20:17 |
| jroll | ok | 20:17 |
| jroll | this is intended to be a top-to-bottom flowchart, so moving bullet 1 to the end will dictate that | 20:17 |
| fungi | OFFICIAL team x within openstack | 20:17 |
| fungi | yes, i agree, just clarifying | 20:18 |
| fungi | no need to spell it out in the e-mail, i was more explaining my reasoning for reordering the bullets | 20:18 |
| jroll | right, makes sense :) | 20:18 |
| fungi | looks good to me. i didn't actually follow the hyperlinks but am going to assume all those files do actually already exist | 20:19 |
| fungi | as a side note, we should also consider having a tc discussion for which of these files to include as repos for determining the tc electorate in the future | 20:20 |
| *** slaweq has joined #openstack-infra | 20:23 | |
| *** wolverineav has quit IRC | 20:31 | |
| jroll | indeed | 20:33 |
| *** priteau has joined #openstack-infra | 20:33 | |
| jroll | thanks again for the review :) | 20:33 |
| fungi | thanks for being the one to do the actual work | 20:33 |
| jroll | heh | 20:33 |
| jroll | did I just get signed up to write the script? | 20:33 |
| fungi | nah, that's simply me instructing computers to do other actual work | 20:35 |
| * fungi is no sucker | 20:35 | |
| fungi | though i do need to get some more done on that script now that i've got the rest of the redirects worked out | 20:36 |
| *** Goneri has quit IRC | 20:36 | |
| *** kjackal_v2 has quit IRC | 20:39 | |
| *** wolverineav has joined #openstack-infra | 20:40 | |
| *** wolverineav has quit IRC | 20:43 | |
| *** wolverineav has joined #openstack-infra | 20:43 | |
| *** priteau has quit IRC | 20:48 | |
| *** wolverineav has quit IRC | 20:48 | |
| *** Goneri has joined #openstack-infra | 20:49 | |
| *** Lucas_Gray has joined #openstack-infra | 20:51 | |
| mnaser | hey, is replication working right now? I know there was an update not long ago | 20:59 |
| mnaser | https://review.openstack.org/#/c/651561/ doesn't show up on GitHub at least | 21:00 |
| clarkb | mnaser: gerrit rereplicates everything after a restart so we usually have a couple hour lag | 21:03 |
| mnaser | oh gotcha | 21:04 |
| clarkb | I keep meaning to ask if we can make that optional in the plugin | 21:04 |
| clarkb | fungi areyou able to check the queue size? | 21:05 |
| *** nicolasbock has quit IRC | 21:05 | |
| fungi | i can take a look | 21:07 |
| fungi | 12114 tasks | 21:07 |
| fungi | so, not *that* many to go i guess? | 21:08 |
| *** wolverineav has joined #openstack-infra | 21:12 | |
| *** nicolasbock has joined #openstack-infra | 21:13 | |
| fungi | it's dropped to 9764 now | 21:20 |
| fungi | probably finished around 22:00z by by estimate | 21:20 |
| *** slaweq has quit IRC | 21:21 | |
| *** kgiusti has left #openstack-infra | 21:22 | |
| *** wolverineav has quit IRC | 21:24 | |
| clarkb | ok I'm back at a computer now | 21:24 |
| clarkb | I've approved the change to upgrade review.o.o to puppet-4 | 21:25 |
| *** wolverineav has joined #openstack-infra | 21:25 | |
| clarkb | review-dev was upgraded a while back and is happy so this should be completely fine | 21:25 |
| clarkb | but I'll watch the log and check and file diffs with the puppet file bucket if we end up with changes | 21:25 |
| *** wolverineav has quit IRC | 21:26 | |
| *** wolverineav has joined #openstack-infra | 21:26 | |
| clarkb | infra-root ^ fyi | 21:28 |
| openstackgerrit | Ian Wienand proposed openstack-infra/system-config master: yamlgroup: add regex match; exclude puppet4 for arm64 mirrors https://review.openstack.org/651442 | 21:28 |
| ianw | clarkb: speaking of puppet4 .... ^ :) | 21:28 |
| clarkb | ianw: oh wow so there are arm64 repos for puppet htey just don't have what we need that is ... disappointing | 21:29 |
| cmurphy | yeah :( | 21:29 |
| ianw | yeah, rather confusing to do that | 21:29 |
| clarkb | ianw: with the yaml stuff is there are reason to use Loader=SafeLoader over yaml.safe_load? | 21:31 |
| clarkb | I like yaml.safe_load as an easier on the eyes option but is there a functional difference? | 21:31 |
| ianw | oh sorry that was a late edition, i dunno i just copied from the warning it was spitting out | 21:31 |
| clarkb | ah I think AJaeger did the same with his change. I guess if that is what they have in the warning that explains it | 21:31 |
| *** ijw has quit IRC | 21:31 | |
| clarkb | oh I guess in this case we are doing a full load not a safe load? I Think we can safe load though /me writing comments as I go. | 21:33 |
| ianw | i mean, it seems more worrying for user-provided code, but this is only grabbing stuff that's passed gerrit review | 21:34 |
| clarkb | ya not really a big concern | 21:34 |
| clarkb | also suggestion to use ^ instead of /.../ to indicate a regex as the ^ is implied with re.match so you don't have to do string mangling (also zuul and gerrit use this as an indicator iirc) | 21:34 |
| clarkb | I can be convinced to +2 as is if no one else feels strongly about those suggestions though | 21:34 |
| *** ijw has joined #openstack-infra | 21:35 | |
| ianw | ahh, i like the ^ idea too, and cmurphy's / / ... both say regex to me | 21:35 |
| ianw | is there a similar ansible precedent? | 21:36 |
| clarkb | I don't know on the ansible side of the house. Maybe pabelanger or dmsimard know | 21:36 |
| *** eharney has joined #openstack-infra | 21:37 | |
| *** slaweq has joined #openstack-infra | 21:38 | |
| fungi | 5824 tasks and falling | 21:39 |
| *** bobh has joined #openstack-infra | 21:39 | |
| *** mriedem has quit IRC | 21:40 | |
| ianw | clarkb: i guess the "ansible" way would be '{{ ... | regex_replace }}' or similar ... ain't going to go for a full jinja pass | 21:41 |
| *** slaweq has quit IRC | 21:42 | |
| *** lmiccini has quit IRC | 21:42 | |
| ianw | starting with ^ simplifies it, will do that | 21:43 |
| *** wolverineav has quit IRC | 21:46 | |
| *** bobh has quit IRC | 21:47 | |
| *** wolverineav has joined #openstack-infra | 21:48 | |
| openstackgerrit | Merged openstack-infra/storyboard master: Use one database per test class rather than per test https://review.openstack.org/644000 | 21:48 |
| *** bobh has joined #openstack-infra | 21:48 | |
| *** wolverineav has quit IRC | 21:52 | |
| openstackgerrit | Merged openstack-infra/storyboard master: Add some tests for checking private story behaviour https://review.openstack.org/644579 | 21:54 |
| openstackgerrit | Merged openstack-infra/storyboard-webclient master: Remember scroll offset of lanes when refreshing board view https://review.openstack.org/637607 | 21:55 |
| fungi | 2626 tasks | 22:02 |
| openstackgerrit | Merged openstack-infra/system-config master: Update review.openstack.org to puppet 4 https://review.openstack.org/647876 | 22:02 |
| clarkb | puppet just ran on review.o.o so we are looking at half and hour to 45 minuets before ^ applies | 22:03 |
| openstackgerrit | Ian Wienand proposed openstack-infra/system-config master: yamlgroup: add regex match; exclude puppet4 for arm64 mirrors https://review.openstack.org/651442 | 22:04 |
| *** eharney has quit IRC | 22:06 | |
| *** rcernin has joined #openstack-infra | 22:06 | |
| ianw | mordred: ^ i'd like you to poke on that before we merge too, as i'm not sure if this is targeted to go as an upstream plugin too | 22:11 |
| *** bobh has quit IRC | 22:14 | |
| *** tjgresha has joined #openstack-infra | 22:15 | |
| openstackgerrit | sebastian marcet proposed openstack-infra/openstackid-resources master: Migrated Mail from native to Sendgrid API https://review.openstack.org/651405 | 22:19 |
| openstackgerrit | Merged openstack-infra/openstackid-resources master: Migrated Mail from native to Sendgrid API https://review.openstack.org/651405 | 22:21 |
| fungi | 1719 tasks | 22:23 |
| *** wolverineav has joined #openstack-infra | 22:25 | |
| *** tosky has joined #openstack-infra | 22:26 | |
| openstackgerrit | Merged openstack-infra/zuul master: Add database info for components graph https://review.openstack.org/649371 | 22:30 |
| *** wolverineav has quit IRC | 22:31 | |
| *** betherly has joined #openstack-infra | 22:32 | |
| *** Lucas_Gray has quit IRC | 22:35 | |
| *** betherly has quit IRC | 22:37 | |
| clarkb | review.o.o puppet-4ing should happen soon. I see /opt/puppetlabs and it has been 40 minutes since the last pulse | 22:40 |
| clarkb | ok review looks happy http://paste.openstack.org/show/749149/ | 22:44 |
| clarkb | the recreation of the rc.d files was expected. The puppet 4 install resulted in a cleanup of those files and then puppet puts them back again | 22:45 |
| clarkb | cmurphy: infra-root ^ fyi you may want to double check me on that but I think it looks good | 22:45 |
| cmurphy | lgtm | 22:46 |
| cmurphy | i thought the rc.d thing had been fixed? | 22:46 |
| clarkb | cmurphy: ya the fix was to stop reinstalling puppet 4. So it will do it the first time but then it shouldn't do it again | 22:46 |
| cmurphy | ah gotcha | 22:47 |
| clarkb | it is unavoidable the first time around due to whatever the puppet 4 packaging si doing to clean that up | 22:47 |
| *** tosky has quit IRC | 22:47 | |
| fungi | yep, looks clean to me | 22:47 |
| clarkb | I'll followup on it in an hour or so and confirm that it iddn't reapply the rc.d files unexpectedly | 22:48 |
| *** priteau has joined #openstack-infra | 22:49 | |
| clarkb | in the meantime I think the afs servers are next | 22:49 |
| *** slaweq has joined #openstack-infra | 22:49 | |
| clarkb | zoom zoom zoom | 22:49 |
| *** whoami-rajat has quit IRC | 22:51 | |
| *** tkajinam has joined #openstack-infra | 22:53 | |
| *** priteau has quit IRC | 22:53 | |
| *** slaweq has quit IRC | 22:53 | |
| mnaser | I hate to take up some of infra time on this.. but http://zuul.opendev.org/t/opendev/status doesn't show any jobs and for some reason I can't get it to pickup anything here: https://review.openstack.org/#/c/651664/2 and/or https://review.openstack.org/#/c/651665/2 | 23:02 |
| mnaser | the repo is listed here https://opendev.org/openstack-infra/project-config/src/branch/master/zuul/main.yaml | 23:04 |
| mnaser | and I added noop-jobs to get a +2 on to land the .gitreview change, as afaik we need it to run at least one job | 23:04 |
| clarkb | I'm nto sure the noop-jobs template exists in the opendev tenant | 23:05 |
| clarkb | I would've expected zuul to -1 saying that is unknown config though | 23:05 |
| mnaser | would the next change in the patch catch it at least then | 23:06 |
| *** wolverineav has joined #openstack-infra | 23:06 | |
| clarkb | 2019-04-10 22:59:35,400 DEBUG zuul.Pipeline.opendev.check: <QueueItem 0x7f0a883716a0 for <Change 0x7f0a8baeb278 vexxhost/ansible-role-wireguard 651665,2> in check> is a failing item because ['it has an invalid configuration'] | 23:07 |
| clarkb | (trying to figure out what the invalid config is now) | 23:07 |
| mnaser | I guess it's maybe the noop-jobs | 23:08 |
| clarkb | 2019-04-10 22:59:34,907 INFO zuul.Pipeline.opendev.check: Configuration syntax error in dynamic layout | 23:09 |
| clarkb | that seems to be the most I'm getting from it | 23:09 |
| mnaser | well noop-jobs indeed doesn't exist | 23:10 |
| clarkb | the noop jobs themselves are special in zuul and don't need to be defined iirc | 23:10 |
| mnaser | and I used `base-minimal` I wonder if that's a real thing or an openstack-infra thing | 23:10 |
| clarkb | so you should be able to spell it out and not try to use the template | 23:10 |
| *** hwoarang has quit IRC | 23:10 | |
| mnaser | yeah ill try to change it to that | 23:11 |
| clarkb | ya minimal doesn't exist in opendev base jobs | 23:11 |
| clarkb | should just be 'base' | 23:11 |
| *** wolverineav has quit IRC | 23:11 | |
| *** hwoarang has joined #openstack-infra | 23:12 | |
| *** betherly has joined #openstack-infra | 23:12 | |
| mnaser | went to https://review.openstack.org/#/c/651664/3/zuul.d/project.yaml and it's not exactly giving me much response :X | 23:13 |
| clarkb | hrm it still says there is a configuration error on ps3 (same message as above) | 23:14 |
| clarkb | ah right you need jobs: | 23:15 |
| clarkb | project: check: jobs: - noop | 23:15 |
| mnaser | sigh | 23:15 |
| mnaser | sorry | 23:15 |
| clarkb | (I don't know why zuul can't say that in a comment like it would normally) | 23:15 |
| clarkb | maybe there is a more fundamental error too, btu we should fix it to be valid with what we know at least | 23:15 |
| *** aaronsheffield has quit IRC | 23:15 | |
| mnaser | clarkb: well also I noticed mordred merged https://opendev.org/opendev/project-config/src/branch/master/zuul.d/pipelines.yaml just a few days ago | 23:16 |
| mnaser | so maybe there's something funky | 23:16 |
| clarkb | mnaser: yes this is the first usage of those pipelines | 23:16 |
| pabelanger | mnaser: clarkb: we should add a system-required project-template to opendev, like openstack: http://git.openstack.org/cgit/openstack-infra/openstack-zuul-jobs/tree/zuul.d/project-templates.yaml#n3 | 23:16 |
| pabelanger | I then think zuul would report errors on the patch mnaser linked | 23:17 |
| pabelanger | see comment in project-template | 23:17 |
| *** betherly has quit IRC | 23:17 | |
| clarkb | huh I guess since the queue mnaser is trying to add isn't valid it can't use it to report | 23:17 |
| clarkb | so ya that would likely fix it | 23:17 |
| mnaser | cool so | 23:18 |
| pabelanger | yah | 23:18 |
| mnaser | I got a +1 for the noop change | 23:18 |
| clarkb | mnaser: ok I think if you merge the noop change that would be enough that you'd start getting messages for the next change | 23:18 |
| mnaser | cool, the next change didn't get response, so I merged the noop one and ill try again | 23:18 |
| mnaser | will a recheck suffice? | 23:19 |
| mnaser | there we go | 23:19 |
| mnaser | I got an error! | 23:19 |
| mnaser | ok cool, nodeset not defined | 23:19 |
| clarkb | you can safely define those in your project. Though we should probably add a couple common ones (bionic, centos7?) to the project-config for opendev in addition to the template pabelanger points out | 23:20 |
| pabelanger | +1 | 23:20 |
| mnaser | yeah looks like I did and its going on now, its pretty cool, testing Wireguard VPN role in 2 nodes and then pinging across each other after setting it up D: | 23:21 |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul-jobs master: Add ansible-lint job https://review.openstack.org/532083 | 23:21 |
| *** _erlon_ has quit IRC | 23:21 | |
| clarkb | pabelanger: mnaser https://review.openstack.org/651667 that is the system-required template | 23:26 |
| clarkb | now for a couple nodesets | 23:26 |
| openstackgerrit | Merged openstack-infra/system-config master: Update AFS servers to puppet 4 https://review.openstack.org/650377 | 23:27 |
| clarkb | https://review.openstack.org/651668 i super basic nodeset start | 23:29 |
| fungi | mnaser: gerrit replication tasks are all caught up, still seeing anything missing? | 23:29 |
| ianw | fungi / clarkb: graphite.opendev.org /etc/letsencrypt-certs/graphite01.opendev.org/* look all about right? i'm going to propose we make a real cert and look at plugging it in | 23:30 |
| clarkb | ianw: I'll look in a sec. | 23:30 |
| clarkb | cmurphy: infra-root I have confirmed that the rc.d files were not touched on the second puppet run since the puppet-4 upgrade on review.o.o | 23:30 |
| ianw | checking /var/log/acme.sh/acme.sh.log it looks like it's skipping things as expected, and looks good from the base.yaml logs too (i.e. it's not going nuts) | 23:31 |
| clarkb | ianw: the key is world readable which we probably don't want ( will apache complain about that?) | 23:31 |
| clarkb | ianw: otherwise the files appear to have content that looks right (though I've not passed it through openssl to verify things after the base64ification) | 23:32 |
| ianw | hrm; it's written by root but i don't know if we want it exclusively owned by www-data | 23:32 |
| clarkb | can we do owner is root group is www-data? | 23:33 |
| clarkb | fungi: ^ you may have thoughts on whether ot not that is desireable and or necessary | 23:34 |
| ianw | we could ... i don't know if that should be hard-coded because th e idea is the certs should be usable for anything, not just apache | 23:34 |
| clarkb | thats a good point | 23:35 |
| fungi | i think if we want apache to read the key on a reload it needs read access | 23:35 |
| fungi | it may be able to read it on a restart if only readable by root via privilege separation | 23:35 |
| fungi | depends on how it's started | 23:36 |
| *** david-lyle has joined #openstack-infra | 23:36 | |
| openstackgerrit | Clint 'SpamapS' Byrum proposed openstack-infra/nodepool master: Implement max-servers for AWS driver https://review.openstack.org/649474 | 23:36 |
| clarkb | fungi: will it refuse to use a cert that is world readable? | 23:36 |
| *** dklyle has quit IRC | 23:36 | |
| clarkb | iirc ssh will refuse to do so with an ssh key | 23:36 |
| ianw | drwx------ 2 root ssl-cert 4096 Oct 16 20:17 private | 23:37 |
| clarkb | we could use a more generic group and then add any users needing to read the certs to that group. | 23:41 |
| fungi | certs can be world readable just fine | 23:41 |
| fungi | it's keys which need protection | 23:41 |
| clarkb | fungi: right sorry I said key before then said cert when I asked you more recently | 23:41 |
| ianw | yeah, everything is in the same directory | 23:42 |
| fungi | certs are already public data | 23:42 |
| clarkb | the key is currently world readable | 23:42 |
| clarkb | other than that I don't see any problems | 23:42 |
| ianw | i feel like it must work as root:root 600 ... that's how we have things configured on the other hosts ... | 23:43 |
| clarkb | ianw: apache does start as root on ubuntu then it descalates its privs in child processes | 23:43 |
| clarkb | so not surprising that works | 23:43 |
| ianw | yeah i think the question was does a "reload" then manage to pick up the new key? | 23:44 |
| ianw | (as opposed i guess to a restart) | 23:44 |
| clarkb | ianw: no reload does not work | 23:44 |
| clarkb | which I guess makes sense why if it relies on those root perms to read the files | 23:45 |
| clarkb | my wip change does a restart as a result | 23:45 |
| *** david-lyle has quit IRC | 23:46 | |
| ianw | what about something that doesn't have a root/drop pattern ... geard maybe for example | 23:46 |
| clarkb | ianw: for that using a letsencrypt group might be the most straightforward option | 23:46 |
| *** ianychoi has joined #openstack-infra | 23:46 | |
| clarkb | then we can add the geard user to the le group | 23:47 |
| clarkb | we could also assume a copy and let the pupept side figure out perms that it needs | 23:48 |
| clarkb | so the le roles write out to current path but then puppet (or ansible) could have tasks for $service that copy the file to a location with the perms it needs | 23:48 |
| clarkb | puppet and ansible both check the file hash before making copies so it should be mostly idempotent. But we'll need to update our puppetry for that which was somethign I know we wanted to avoid | 23:48 |
| clarkb | (for that I'm thinking the group may be the simplest option) | 23:49 |
| *** rcernin has quit IRC | 23:52 | |
| *** rlandy|ruck has quit IRC | 23:55 | |
| ianw | yeah, so /etc/letsencrypt-certs as root:letsencrypt with 2770 | 23:55 |
| ianw | or 2750 ... group doesn't need write | 23:55 |
| *** owalsh has quit IRC | 23:57 | |
| clarkb | do we need set group id? | 23:57 |
| clarkb | (it isn't executable so I think 0750 would work? | 23:58 |
| clarkb | er wait the 7 and 5 are executable. is this for the dir or something else:0 | 23:58 |
| clarkb | oh the dir | 23:58 |
| ianw | that's so letsencrypt creates the cert dirs underneath with letsencrypt group | 23:58 |
| clarkb | ya I think that should work | 23:58 |
| ianw | u=rwx,g=rx,g+s | 23:58 |
| *** dabukalam has joined #openstack-infra | 23:59 | |
| ianw | hrm, i think we then need to also run acme.sh with a umask so it doesn't make things world readable | 23:59 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!