| mordred | ianw: don't know if you saw - but teh multi-arch docker image building patch went green: https://review.opendev.org/#/c/722339 | 02:07 |
|---|---|---|
| mordred | ianw: once that lands we can run nb03 on containers too | 02:07 |
| ianw | mordred: cool, will look over, but i'm sure it's fine :) | 02:14 |
| ianw | we just need arm64 devstack for an end-to-end functional test | 02:15 |
| ianw | there might actually be enough support there for a basic build and boot test actually, despite tempest not fully working ... | 02:15 |
| *** diablo_rojo has quit IRC | 03:53 | |
| *** ykarel|away is now known as ykarel | 04:35 | |
| *** sgw has quit IRC | 04:54 | |
| *** ysandeep|away is now known as ysandeep | 05:49 | |
| *** dpawlik has joined #opendev | 05:59 | |
| *** tkajinam has joined #opendev | 06:04 | |
| openstackgerrit | Merged zuul/zuul-jobs master: Fix fetch-sphinx-tarball fails https://review.opendev.org/725210 | 06:05 |
| openstackgerrit | Andreas Jaeger proposed zuul/zuul-jobs master: DNM: TEst sphinx failures 1 https://review.opendev.org/725472 | 06:33 |
| openstackgerrit | Andreas Jaeger proposed zuul/zuul-jobs master: DNM: Test sphinx failure 2 https://review.opendev.org/725473 | 06:33 |
| openstackgerrit | Andreas Jaeger proposed zuul/zuul-jobs master: DNM: Test sphinx 3 https://review.opendev.org/725479 | 06:51 |
| *** ralonsoh has joined #opendev | 06:51 | |
| *** tkajinam has quit IRC | 06:54 | |
| *** ralonsoh has quit IRC | 07:09 | |
| *** rchurch has quit IRC | 07:09 | |
| *** ianw has quit IRC | 07:09 | |
| *** moppy has quit IRC | 07:09 | |
| *** iurygregory has quit IRC | 07:09 | |
| *** calcmandan has quit IRC | 07:09 | |
| *** dzho has quit IRC | 07:09 | |
| *** smcginnis has quit IRC | 07:09 | |
| *** hrw has quit IRC | 07:09 | |
| *** prometheanfire has quit IRC | 07:09 | |
| *** noonedeadpunk has quit IRC | 07:09 | |
| *** dirk has quit IRC | 07:09 | |
| *** AJaeger has quit IRC | 07:09 | |
| *** logan- has quit IRC | 07:10 | |
| *** elod has quit IRC | 07:10 | |
| *** jaicaa has quit IRC | 07:10 | |
| *** rosmaita has quit IRC | 07:10 | |
| *** yoctozepto has quit IRC | 07:10 | |
| *** mtreinish has quit IRC | 07:10 | |
| *** JayF has quit IRC | 07:10 | |
| *** dpawlik has quit IRC | 07:10 | |
| *** roman_g has quit IRC | 07:10 | |
| *** panda|pto has quit IRC | 07:10 | |
| *** Dmitrii-Sh has quit IRC | 07:10 | |
| *** ChanServ has quit IRC | 07:10 | |
| *** mnaser has quit IRC | 07:10 | |
| *** melwitt has quit IRC | 07:10 | |
| *** mugsie has quit IRC | 07:10 | |
| *** cmurphy has quit IRC | 07:10 | |
| *** mnasiadka has quit IRC | 07:10 | |
| *** Eighth_Doctor has quit IRC | 07:10 | |
| *** rm_work has quit IRC | 07:10 | |
| *** ttx has quit IRC | 07:10 | |
| *** rajinir has quit IRC | 07:10 | |
| *** donnyd has quit IRC | 07:10 | |
| *** jentoio has quit IRC | 07:10 | |
| *** jkt has quit IRC | 07:10 | |
| *** sshnaidm|afk has quit IRC | 07:10 | |
| *** dmsimard has quit IRC | 07:10 | |
| *** fdegir has quit IRC | 07:10 | |
| *** jhesketh has quit IRC | 07:10 | |
| *** tbarron has quit IRC | 07:10 | |
| *** corvus has quit IRC | 07:10 | |
| *** tristanC has quit IRC | 07:10 | |
| *** shubjero has quit IRC | 07:10 | |
| *** diablo_rojo_phon has quit IRC | 07:10 | |
| *** Open10K8S has quit IRC | 07:10 | |
| *** persia has quit IRC | 07:10 | |
| *** knikolla has quit IRC | 07:10 | |
| *** seongsoocho has quit IRC | 07:10 | |
| *** odyssey4me has quit IRC | 07:10 | |
| *** mgagne has quit IRC | 07:10 | |
| *** osmanlicilegi has quit IRC | 07:10 | |
| *** openstackgerrit has quit IRC | 07:10 | |
| *** frickler has quit IRC | 07:10 | |
| *** bolg has quit IRC | 07:10 | |
| *** ysandeep has quit IRC | 07:10 | |
| *** mrunge_ has quit IRC | 07:10 | |
| *** zbr has quit IRC | 07:10 | |
| *** dtantsur|afk has quit IRC | 07:10 | |
| *** jroll has quit IRC | 07:10 | |
| *** mordred has quit IRC | 07:10 | |
| *** vblando has quit IRC | 07:10 | |
| *** jrosser has quit IRC | 07:10 | |
| *** rpittau|afk has quit IRC | 07:10 | |
| *** johnsom has quit IRC | 07:10 | |
| *** SotK has quit IRC | 07:10 | |
| *** ykarel has quit IRC | 07:10 | |
| *** fungi has quit IRC | 07:10 | |
| *** stephenfin has quit IRC | 07:10 | |
| *** sean-k-mooney has quit IRC | 07:10 | |
| *** owalsh has quit IRC | 07:10 | |
| *** etp has quit IRC | 07:10 | |
| *** clarkb has quit IRC | 07:10 | |
| *** hillpd has quit IRC | 07:10 | |
| *** jbryce has quit IRC | 07:10 | |
| *** redrobot has quit IRC | 07:10 | |
| *** cgoncalves has quit IRC | 07:10 | |
| *** slittle1 has quit IRC | 07:10 | |
| *** andreykurilin has quit IRC | 07:10 | |
| *** amotoki has quit IRC | 07:10 | |
| *** ralonsoh has joined #opendev | 07:16 | |
| *** dpawlik has joined #opendev | 07:16 | |
| *** calcmandan has joined #opendev | 07:16 | |
| *** rchurch has joined #opendev | 07:16 | |
| *** hillpd has joined #opendev | 07:16 | |
| *** roman_g has joined #opendev | 07:16 | |
| *** redrobot has joined #opendev | 07:16 | |
| *** mrunge_ has joined #opendev | 07:16 | |
| *** smcginnis has joined #opendev | 07:16 | |
| *** odyssey4me has joined #opendev | 07:16 | |
| *** panda|pto has joined #opendev | 07:16 | |
| *** Dmitrii-Sh has joined #opendev | 07:16 | |
| *** jkt has joined #opendev | 07:16 | |
| *** ianw has joined #opendev | 07:16 | |
| *** moppy has joined #opendev | 07:16 | |
| *** iurygregory has joined #opendev | 07:16 | |
| *** elod has joined #opendev | 07:16 | |
| *** zbr has joined #opendev | 07:16 | |
| *** dzho has joined #opendev | 07:16 | |
| *** rosmaita has joined #opendev | 07:16 | |
| *** stephenfin has joined #opendev | 07:16 | |
| *** osmanlicilegi has joined #opendev | 07:16 | |
| *** openstackgerrit has joined #opendev | 07:16 | |
| *** sean-k-mooney has joined #opendev | 07:16 | |
| *** cgoncalves has joined #opendev | 07:16 | |
| *** dtantsur|afk has joined #opendev | 07:16 | |
| *** hrw has joined #opendev | 07:16 | |
| *** Eighth_Doctor has joined #opendev | 07:16 | |
| *** owalsh has joined #opendev | 07:16 | |
| *** andreykurilin has joined #opendev | 07:16 | |
| *** diablo_rojo_phon has joined #opendev | 07:16 | |
| *** ChanServ has joined #opendev | 07:16 | |
| *** AJaeger has joined #opendev | 07:16 | |
| *** dirk has joined #opendev | 07:16 | |
| *** noonedeadpunk has joined #opendev | 07:16 | |
| *** prometheanfire has joined #opendev | 07:16 | |
| *** logan- has joined #opendev | 07:16 | |
| *** jaicaa has joined #opendev | 07:16 | |
| *** jroll has joined #opendev | 07:16 | |
| *** mgagne has joined #opendev | 07:16 | |
| *** yoctozepto has joined #opendev | 07:16 | |
| *** sshnaidm|afk has joined #opendev | 07:16 | |
| *** mordred has joined #opendev | 07:16 | |
| *** mnaser has joined #opendev | 07:16 | |
| *** tepper.freenode.net sets mode: +o ChanServ | 07:16 | |
| *** vblando has joined #opendev | 07:16 | |
| *** jrosser has joined #opendev | 07:16 | |
| *** Open10K8S has joined #opendev | 07:16 | |
| *** dmsimard has joined #opendev | 07:16 | |
| *** slittle1 has joined #opendev | 07:16 | |
| *** fdegir has joined #opendev | 07:16 | |
| *** donnyd has joined #opendev | 07:16 | |
| *** jhesketh has joined #opendev | 07:16 | |
| *** tbarron has joined #opendev | 07:16 | |
| *** mugsie has joined #opendev | 07:16 | |
| *** cmurphy has joined #opendev | 07:16 | |
| *** melwitt has joined #opendev | 07:16 | |
| *** mnasiadka has joined #opendev | 07:16 | |
| *** knikolla has joined #opendev | 07:16 | |
| *** ttx has joined #opendev | 07:16 | |
| *** mtreinish has joined #opendev | 07:16 | |
| *** rpittau|afk has joined #opendev | 07:16 | |
| *** JayF has joined #opendev | 07:16 | |
| *** corvus has joined #opendev | 07:16 | |
| *** jentoio has joined #opendev | 07:16 | |
| *** rm_work has joined #opendev | 07:16 | |
| *** frickler has joined #opendev | 07:16 | |
| *** bolg has joined #opendev | 07:16 | |
| *** rajinir has joined #opendev | 07:16 | |
| *** ysandeep has joined #opendev | 07:16 | |
| *** ykarel has joined #opendev | 07:16 | |
| *** amotoki has joined #opendev | 07:16 | |
| *** persia has joined #opendev | 07:16 | |
| *** tristanC has joined #opendev | 07:16 | |
| *** shubjero has joined #opendev | 07:16 | |
| *** etp has joined #opendev | 07:16 | |
| *** seongsoocho has joined #opendev | 07:16 | |
| *** johnsom has joined #opendev | 07:16 | |
| *** jbryce has joined #opendev | 07:16 | |
| *** SotK has joined #opendev | 07:16 | |
| *** clarkb has joined #opendev | 07:16 | |
| *** fungi has joined #opendev | 07:16 | |
| *** tosky has joined #opendev | 07:32 | |
| *** rpittau|afk is now known as rpittau | 07:34 | |
| *** DSpider has joined #opendev | 07:43 | |
| openstackgerrit | Thierry GATINEAU proposed x/gearman-plugin master: Add new feature smooth disable https://review.opendev.org/725492 | 07:51 |
| *** ysandeep is now known as ysandeep|lunch | 08:17 | |
| *** ykarel is now known as ykarel|lunch | 08:33 | |
| openstackgerrit | Merged openstack/diskimage-builder master: functests: use ensure-virtualenv https://review.opendev.org/723316 | 08:40 |
| openstackgerrit | Merged zuul/zuul-jobs master: Enable yamllint https://review.opendev.org/725091 | 08:46 |
| *** dtantsur|afk is now known as dtantsur | 08:59 | |
| *** hashar has joined #opendev | 09:08 | |
| openstackgerrit | Sorin Sbarnea (zbr) proposed zuul/zuul-jobs master: yamlint: EOF newlines and comments indent https://review.opendev.org/725516 | 09:16 |
| *** sshnaidm|afk is now known as sshnaidm | 09:22 | |
| *** ykarel|lunch is now known as ykarel | 09:57 | |
| *** smcginnis has quit IRC | 10:29 | |
| *** smcginnis has joined #opendev | 10:29 | |
| *** dirk has quit IRC | 10:30 | |
| *** AJaeger has quit IRC | 10:30 | |
| *** hashar has quit IRC | 10:30 | |
| *** noonedeadpunk has quit IRC | 10:30 | |
| *** AJaeger has joined #opendev | 10:30 | |
| *** dirk has joined #opendev | 10:31 | |
| *** noonedeadpunk has joined #opendev | 10:31 | |
| *** ysandeep|lunch is now known as ysandeep | 10:38 | |
| *** rpittau is now known as rpittau|bbl | 10:52 | |
| *** lpetrut has joined #opendev | 10:54 | |
| *** hashar has joined #opendev | 11:51 | |
| *** mrunge_ is now known as mrunge | 11:57 | |
| *** rpittau|bbl is now known as rpittau | 12:06 | |
| mordred | mnaser: the keystone change passed | 12:20 |
| mordred | infra-root: if anybody has a chance, could you please review https://review.opendev.org/#/c/713972/ ? | 12:20 |
| openstackgerrit | Sorin Sbarnea (zbr) proposed zuul/zuul-jobs master: Made sequence indent consistent https://review.opendev.org/725538 | 12:33 |
| mnaser | mordred: nice, it did! | 12:43 |
| *** ysandeep is now known as ysandeep|brb | 12:47 | |
| *** ykarel is now known as ykarel|afk | 12:48 | |
| *** sgw has joined #opendev | 13:03 | |
| *** dtantsur is now known as dtantsur|brb | 13:18 | |
| dpawlik | corvus, hi! I see in grafana (http://grafana.openstack.org/d/ACtl1JSmz/afs?orgId=1) that mirror.centos seems to be OK for now, but what about mirror.fedora? It shows last update 7 days ago. Is it ok? | 13:18 |
| openstackgerrit | Merged zuul/zuul-jobs master: Support multi-arch image builds with docker buildx https://review.opendev.org/722339 | 13:22 |
| *** tobiash has joined #opendev | 13:23 | |
| *** ysandeep|brb is now known as ysandeep | 13:24 | |
| fungi | https://static.opendev.org/mirror/fedora/timestamp.txt confirms it last updated on 2020-04-28 so likely related to the same afs server outage | 13:26 |
| fungi | "VLDB: vldb entry is already locked" in /var/log/rsync-mirrors/fedora.log on the mirror-update.opendev.org server | 13:28 |
| fungi | i'll try to repeat yesterday's centos mirror fix for the fedora mirror | 13:28 |
| dpawlik | thank you fungi | 13:39 |
| *** lpetrut has quit IRC | 13:46 | |
| *** mlavalle has joined #opendev | 13:50 | |
| *** ykarel|afk is now known as ykarel | 14:03 | |
| openstackgerrit | Monty Taylor proposed zuul/zuul-jobs master: Write buildkitd.toml in use-buildset-registry https://review.opendev.org/724837 | 14:06 |
| *** lpetrut has joined #opendev | 14:27 | |
| openstackgerrit | Merged zuul/zuul-jobs master: Revert "Revert "Do not set buildset_fact if it's not present in results.json"" https://review.opendev.org/724132 | 14:35 |
| clarkb | infra-root zuul memory use remains stable. I've removed my WIP from https://review.opendev.org/#/c/725431/ as I expect we've got as much adata as is reasonable to show that is related | 14:46 |
| mordred | clarkb: +2 from me | 14:55 |
| mordred | clarkb: if you get a sec, mind +Aing https://review.opendev.org/#/c/713972/ - we tested it in https://review.opendev.org/#/c/713975/ | 14:56 |
| fungi | dpawlik: btw, the fedora mirror release is still processing. for some reason we haven't been able to figure out, fedora mirror updates require a lot of resynchronization even when there's no substantive change to their contents | 15:02 |
| clarkb | mordred: I am not sure that addresses the issue for openstack projects as they don't put upper constraints in the repos? | 15:02 |
| fungi | clarkb: unless something copies the constraints file into the tree before that runs | 15:03 |
| clarkb | mordred: keystone has no upper-constraints file so https://review.opendev.org/#/c/713975/ is a noop? | 15:03 |
| clarkb | fungi: true, though I don't see that in ^ | 15:03 |
| clarkb | oh wait its a pre job step hrm | 15:03 |
| clarkb | (I was looking for it in he dockerfile) https://review.opendev.org/#/c/713975/4/playbooks/pre.yaml | 15:03 |
| dpawlik | fungi, ack | 15:04 |
| clarkb | early morning code review is always iffy :) | 15:04 |
| fungi | for me, all code review is iffy ;) | 15:12 |
| openstackgerrit | Merged zuul/zuul-jobs master: Don't pull and retag in buildx workflow https://review.opendev.org/725380 | 15:14 |
| *** rchurch has quit IRC | 15:14 | |
| *** ysandeep is now known as ysandeep|afk | 15:15 | |
| *** rchurch has joined #opendev | 15:15 | |
| *** dtantsur|brb is now known as dtantsur | 15:20 | |
| dmsimard | Is the openstack-dev ML archive available somewhere ? I'm searching for something rather ancient :) | 15:38 |
| *** ysandeep|afk is now known as ysandeep | 15:38 | |
| fungi | dmsimard: http://lists.openstack.org/pipermail/openstack-dev/ | 15:39 |
| clarkb | dmsimard: same place its always been, just not directly linked to from the top level page. http://lists.openstack.org/pipermail/openstack-dev/ | 15:39 |
| clarkb | aiui that is because you can't "retire" a list from mailman | 15:39 |
| dmsimard | ah, yeah, I didn't see it at the top level page | 15:39 |
| clarkb | you have to remove it which removes it from the index but doesn't remove its archives | 15:39 |
| fungi | we've talked about maybe adding a page somewhere with a link to archives for retired mailing lists | 15:40 |
| fungi | but nobody's worked up an implementation | 15:40 |
| openstackgerrit | Merged opendev/system-config master: Add constraints support to python-builder https://review.opendev.org/713972 | 15:45 |
| clarkb | infra-root https://review.opendev.org/#/c/725431/ I think we should land that then work on scheduling restarts of things to be as unimpactful to openstack release as possible | 15:45 |
| clarkb | that should hopefully address our recent memory issues | 15:45 |
| *** panda|pto has quit IRC | 15:46 | |
| mordred | clarkb: yeah - I just put in the upper-constraints in pre to test that the builder found it | 15:49 |
| mordred | clarkb: thanks! | 15:49 |
| mordred | clarkb: ++ | 15:49 |
| *** rchurch has quit IRC | 15:55 | |
| *** rchurch has joined #opendev | 15:55 | |
| *** cgoncalves has quit IRC | 15:59 | |
| *** ysandeep is now known as ysandeep|away | 16:02 | |
| *** ykarel is now known as ykarel|away | 16:03 | |
| *** rchurch has quit IRC | 16:04 | |
| *** cgoncalves has joined #opendev | 16:05 | |
| *** cgoncalves has quit IRC | 16:09 | |
| *** rpittau is now known as rpittau|afk | 16:14 | |
| openstackgerrit | Monty Taylor proposed zuul/zuul-jobs master: Use tempfile in buildx build https://review.opendev.org/725387 | 16:19 |
| openstackgerrit | Monty Taylor proposed zuul/zuul-jobs master: Write buildkitd.toml in use-buildset-registry https://review.opendev.org/724837 | 16:19 |
| *** sgw has quit IRC | 16:20 | |
| mordred | corvus: wow. so - the nodepool multi-arch job did not work | 16:23 |
| mordred | corvus: and it's an ansible error- and looking at it I'm now unsure how this worked in the zuul-jobs tests :( | 16:23 |
| corvus | mordred: link? | 16:23 |
| mordred | https://zuul.opendev.org/t/zuul/build/8fbc673e52b84457ab640b3e2e9e1712 | 16:23 |
| mordred | corvus: amusingly, the issue at hand will be fixed by the patches above | 16:24 |
| mordred | but I'm more concerned with the hole in testing | 16:24 |
| mordred | corvus: oh! | 16:25 |
| mordred | corvus: I see what happened perhaps. in zuul-jobs we run an all-in-one - so I think the use-buildset-registry role loaded vars and they persisted so they were defined when we ran build-docker-image | 16:25 |
| mordred | corvus: in nodepool we're not running use-buildset-registry in the same playbook | 16:26 |
| corvus | mordred: yeah, that sounds likely | 16:26 |
| mordred | corvus: it's a real edge-case where we had copeid in vars from use- so I don't think I'm super worried about it (it's not how we tend to like to do things anyway and we've already have a patch up to stop doing that) | 16:26 |
| fungi | http://lists.openstack.org/pipermail/openstack-discuss/2020-May/014678.html | 16:27 |
| corvus | mordred: it'd be pretty groovy if we could scope ansible role inclusions :) | 16:28 |
| fungi | looks like the openstack operators group is going to be trying out their own deployment of jitsi-meet, i wonder if we should reach out to them about helping us test meetpad of if it's still too soon? | 16:28 |
| corvus | fungi: i have no idea what we're waiting for :) | 16:28 |
| fungi | or they might be interested in our patch to integrate etherpad at least | 16:29 |
| *** panda has joined #opendev | 16:29 | |
| fungi | cool, i'll reply to let them know it exists and could use some exercise, in that case ;) | 16:29 |
| corvus | ++ | 16:29 |
| openstackgerrit | Andreas Jaeger proposed zuul/zuul-jobs master: Remove some temporary files https://review.opendev.org/725650 | 16:30 |
| corvus | looks like the http->https redirect is in place | 16:30 |
| openstackgerrit | Monty Taylor proposed zuul/zuul-jobs master: Use tempfile in buildx build https://review.opendev.org/725387 | 16:33 |
| openstackgerrit | Monty Taylor proposed zuul/zuul-jobs master: Write buildkitd.toml in use-buildset-registry https://review.opendev.org/724837 | 16:33 |
| openstackgerrit | Monty Taylor proposed zuul/zuul-jobs master: use-buildset-registry: fix modify_registries_conf library idempotency https://review.opendev.org/725651 | 16:33 |
| clarkb | mordred: what is opendev's plan for executors if zuul drops python3.5? upgrade them all to bionic or focal? | 16:33 |
| mordred | clarkb: yes. I actually want to upgrade them all to focal anyway regardless of what zuul does | 16:34 |
| clarkb | as someone with 3.8 installed locally I don't personally get the urgency to drop 3.5. All of the useful bits in python3 seem to be in 3.5 including the dict sort behavior and typing support. | 16:34 |
| mordred | clarkb: so that we're not running one bit on 3.5 and the rest on 3.8 | 16:34 |
| mordred | clarkb: dict sort is in python 3.6 | 16:34 |
| clarkb | mordred: 3.6 codifies it but 3.5 implemented it aiui | 16:34 |
| mordred | 3.7 codifies it | 16:35 |
| mordred | 3.6 implements it | 16:35 |
| clarkb | oh am I off by one there? | 16:35 |
| mordred | yup | 16:35 |
| mordred | 3.6 also has f-strings and non-comment variable type annotations | 16:35 |
| clarkb | my major concern is that 3.5 was really stable once we got through a few bugs. And now we seem to be running into the 3.7 and 3.8 bugs | 16:35 |
| mordred | not that those are super important - it's mostly that 3.5 support is being dropped from more and more things and we're about to be in a place where nobody is running zuul on it | 16:36 |
| clarkb | mordred: re type annotations meh | 16:36 |
| mordred | yeah - none of those are reasons to upgrade | 16:36 |
| clarkb | the more I use them the more I'm unimpressed | 16:36 |
| mordred | I'm more concerned about wider python community dropping 3.5 from their min support | 16:36 |
| clarkb | I'm particularly annoyed there is no handling for the try import except system for different sources of similar tools | 16:37 |
| clarkb | (my mypy support update had to basically tell the type checker to ignore that situation and that is the official workaround from mypy) | 16:37 |
| mordred | yup | 16:37 |
| clarkb | mordred: have we seen libs drop 3.5? | 16:38 |
| clarkb | outside of openstack I mean | 16:38 |
| mordred | clarkb: no - but I'm holding 2 different openstack libs for zuul even though openstack dropped | 16:38 |
| mordred | so I won't be surprised if we start seeing it | 16:38 |
| mordred | now that focal is out, xenial is lts-2 | 16:39 |
| clarkb | thats true I guess now is when people start to make those changes | 16:39 |
| mordred | which is when we tend to see people stop caring about supporting it | 16:39 |
| mordred | yah | 16:39 |
| mordred | so - it's really more about recognizing where we're at and maybe getting ahead of it while we've got a major bump coming anyway | 16:39 |
| mordred | releasing v6 in a year just to drop 3.5 support seems ... weird | 16:40 |
| clarkb | and I guess with rhel8 running 3.6 we should expect it to be fairly well supported across python ecosystem libs | 16:40 |
| *** dpawlik has quit IRC | 16:40 | |
| mordred | yup | 16:40 |
| clarkb | (we saw similar with python2.6 on RHEL6) | 16:40 |
| mordred | I mean - even centos7 has python 3.6 | 16:40 |
| mordred | so really xenial is the only thing out there still on 3.5 | 16:41 |
| mordred | (that is a reaonable platform) | 16:41 |
| mordred | that's my main motivation. the other stuff- I mean, f'{x}' is less typing than '{x}'.format(x=x) - and dict is less typing than collections.OrderedDict - but I don't think either of those are motivations - they're just nice to haves once we have them | 16:43 |
| clarkb | ya | 16:45 |
| clarkb | (fwiw I'm happy to get off of xenial as quickly as possible too) | 16:49 |
| clarkb | I just wanted to understand what the plan is around that | 16:49 |
| openstackgerrit | Monty Taylor proposed zuul/zuul-jobs master: use-buildset-registry: fix modify_registries_conf library idempotency https://review.opendev.org/725651 | 16:59 |
| openstackgerrit | Monty Taylor proposed zuul/zuul-jobs master: Write buildkitd.toml in use-buildset-registry https://review.opendev.org/724837 | 16:59 |
| fungi | the fedora mirror release is *still* going | 17:00 |
| *** ysandeep|away is now known as ysandeep | 17:02 | |
| openstackgerrit | Monty Taylor proposed zuul/zuul-jobs master: use-buildset-registry: fix modify_registries_conf library idempotency https://review.opendev.org/725651 | 17:13 |
| openstackgerrit | Monty Taylor proposed zuul/zuul-jobs master: Write buildkitd.toml in use-buildset-registry https://review.opendev.org/724837 | 17:13 |
| mordred | clarkb: yeah - my first plan is just to get the executors off xenial, so that we're consistent across opendev as to what version of python we're running zuul on | 17:15 |
| mordred | clarkb: given that we still have trusty nodes, I'm under no illustions about getting completely off xenial in the near term :) | 17:15 |
| *** dtantsur is now known as dtantsur|afk | 17:16 | |
| openstackgerrit | Monty Taylor proposed zuul/zuul-jobs master: Use tempfile in buildx build https://review.opendev.org/725387 | 17:24 |
| openstackgerrit | Monty Taylor proposed zuul/zuul-jobs master: use-buildset-registry: fix modify_registries_conf library idempotency https://review.opendev.org/725651 | 17:24 |
| openstackgerrit | Monty Taylor proposed zuul/zuul-jobs master: Write buildkitd.toml in use-buildset-registry https://review.opendev.org/724837 | 17:24 |
| openstackgerrit | Monty Taylor proposed opendev/system-config master: Test zuul-executor on focal https://review.opendev.org/723528 | 17:29 |
| mordred | clarkb: mind bumping in https://review.opendev.org/#/c/724418/ ? | 17:30 |
| mordred | clarkb: it's needed by https://review.opendev.org/#/c/724419/ which you already approved | 17:30 |
| clarkb | mordred: done | 17:33 |
| mordred | clarkb: thanks | 17:34 |
| *** ralonsoh has quit IRC | 17:43 | |
| *** iurygregory has quit IRC | 17:49 | |
| openstackgerrit | Andreas Jaeger proposed zuul/zuul-jobs master: Remove some temporary files https://review.opendev.org/725650 | 17:51 |
| AJaeger | mordred: so, should we add py38 testing to zuul-jobs and zuul? | 17:54 |
| mordred | AJaeger: probably not a bad idea :) | 17:54 |
| AJaeger | so, add py38 - or add py38 and remove py37? | 17:55 |
| AJaeger | we currently have py35 and py37 - what should we use instead? | 17:56 |
| *** ysandeep is now known as ysandeep|away | 17:57 | |
| openstackgerrit | Merged opendev/ansible-role-puppet master: Add flag to control logging the rsyncs https://review.opendev.org/724418 | 17:58 |
| mordred | AJaeger: I think switch 37 to 38 - I think the original idea was that we test highest and lowest and we'll probably be fine | 17:59 |
| AJaeger | will do patches for zuul and zuul-jobs | 18:00 |
| openstackgerrit | Andreas Jaeger proposed zuul/zuul-jobs master: Add py38 testing https://review.opendev.org/725663 | 18:00 |
| clarkb | fungi: corvus do you have a moment to review the jemalloc removal? https://review.opendev.org/#/c/725431/ cacti shows are new stability http://cacti.openstack.org/cacti/graph.php?action=view&local_graph_id=64792&rra_id=all | 18:01 |
| AJaeger | mordred: zuul is already done | 18:02 |
| openstackgerrit | Andreas Jaeger proposed zuul/zuul-jobs master: Add py38 testing https://review.opendev.org/725663 | 18:03 |
| *** lpetrut has quit IRC | 18:04 | |
| mordred | AJaeger: I just pushed up one for zuul-registry too | 18:05 |
| AJaeger | mordred: thx | 18:07 |
| *** citizen_stig has joined #opendev | 18:11 | |
| corvus | clarkb: +3, graphs look good thanks! | 18:16 |
| corvus | clarkb: i'm going to have to miss the first half of the opendev meeting; hopefully can join for second half. | 18:17 |
| fungi | #status log unlocked mirror.fedora afs volume and manually performed vos release to clear stale lock from 2020-04-28 afs01.dfw outage | 18:18 |
| openstackstatus | fungi: finished logging | 18:18 |
| clarkb | fungi: do weneed to check all thr volumes for stale locks? | 18:19 |
| clarkb | corvus: rgr | 18:19 |
| fungi | clarkb: might not be a terrible idea | 18:19 |
| fungi | i'll see if i can figure out a good way to do that | 18:19 |
| fungi | interestingly, https://static.opendev.org/mirror/fedora/timestamp.txt still reports 2020-04-28 | 18:20 |
| openstackgerrit | Merged zuul/zuul-jobs master: Use tempfile in buildx build https://review.opendev.org/725387 | 18:22 |
| openstackgerrit | Andreas Jaeger proposed zuul/zuul-jobs master: Fix bare 'item' in build-container-image https://review.opendev.org/725298 | 18:22 |
| fungi | http://grafana.openstack.org/d/ACtl1JSmz/afs is also still showing mirror.fedora last updated 7 days ago | 18:24 |
| fungi | same for opensuse and yum-puppetlabs | 18:24 |
| clarkb | fungi: the statsd events are sent by mirror-update if you do it out of band I don't think we update those events | 18:24 |
| fungi | ohh, got it | 18:24 |
| fungi | but what about the timestamp file? | 18:25 |
| clarkb | timestamp file is also written by the scripts I think | 18:25 |
| fungi | looks like /usr/local/bin/fedora-mirror-update writes it before vos release is attempted | 18:26 |
| fungi | so /afs/.openstack.org/mirror/fedora/timestamp.txt says 2020-05-05 | 18:27 |
| fungi | but still only 2020-04-28 in /afs/openstack.org/mirror/fedora/timestamp.txt | 18:27 |
| *** hashar has quit IRC | 18:27 | |
| fungi | oh! | 18:27 |
| fungi | when i did vos release it said "This is a completion of a previous release" | 18:28 |
| clarkb | fungi: is it running a vos release now? | 18:28 |
| clarkb | ah | 18:28 |
| fungi | no, it completed | 18:28 |
| fungi | but it completed an old interrupted release | 18:28 |
| fungi | i'll do a second one nopw | 18:28 |
| fungi | now | 18:28 |
| fungi | or maybe i'll just wait, the next fedora mirror pulse should fire in 21 minutes anyway | 18:29 |
| fungi | 41 */2 * * * | 18:30 |
| fungi | 11 minutes i guess | 18:30 |
| * fungi isn't mathing well today | 18:30 | |
| clarkb | vos status shows no transactions right now | 18:33 |
| clarkb | whichI think means any current volume locks will be stale | 18:33 |
| clarkb | now to sort out how to list those | 18:33 |
| openstackgerrit | Albin Vass proposed zuul/zuul-jobs master: Fix bare 'item' in build-container-image https://review.opendev.org/725298 | 18:34 |
| openstackgerrit | Albin Vass proposed zuul/zuul-jobs master: ansible-lint: use matchplay instead of matchtask https://review.opendev.org/724910 | 18:34 |
| openstackgerrit | Albin Vass proposed zuul/zuul-jobs master: use zj_image instead of image as loopvar https://review.opendev.org/725012 | 18:34 |
| openstackgerrit | Albin Vass proposed zuul/zuul-jobs master: use zj_log_file instead of item as loop_var https://review.opendev.org/725013 | 18:34 |
| openstackgerrit | Albin Vass proposed zuul/zuul-jobs master: Check blocks recursively for loops https://review.opendev.org/724967 | 18:34 |
| clarkb | vos listvldb to see locks. mirror.yum-puppetlabs and mirror.opensuse are in the same istuation I think | 18:35 |
| clarkb | everything else looks fine | 18:35 |
| clarkb | I need to prep for the meeting now but can help with unlocking and restoring those after | 18:36 |
| openstackgerrit | Albin Vass proposed zuul/zuul-jobs master: ansible-lint: use matchplay instead of matchtask https://review.opendev.org/724910 | 18:37 |
| fungi | clarkb: yeah, i expect at least opensuse and yum-puppetlabs volumes need this done | 18:38 |
| fungi | i can poke at them shortly | 18:38 |
| openstackgerrit | Albin Vass proposed zuul/zuul-jobs master: ansible-lint: use matchplay instead of matchtask https://review.opendev.org/724910 | 18:42 |
| openstackgerrit | Albin Vass proposed zuul/zuul-jobs master: use zj_image instead of image as loopvar https://review.opendev.org/725012 | 18:43 |
| openstackgerrit | Albin Vass proposed zuul/zuul-jobs master: use zj_log_file instead of item as loop_var https://review.opendev.org/725013 | 18:43 |
| openstackgerrit | Albin Vass proposed zuul/zuul-jobs master: Check blocks recursively for loops https://review.opendev.org/724967 | 18:43 |
| *** roman_g has quit IRC | 18:47 | |
| *** panda is now known as panda|pto | 18:48 | |
| openstackgerrit | Merged opendev/system-config master: Stop using jemalloc in python base image https://review.opendev.org/725431 | 18:50 |
| *** iurygregory has joined #opendev | 18:53 | |
| openstackgerrit | Merged zuul/zuul-jobs master: use-buildset-registry: add Fedora certifacts vars https://review.opendev.org/724717 | 19:02 |
| openstackgerrit | Merged zuul/zuul-jobs master: Fix bare 'item' in build-container-image https://review.opendev.org/725298 | 19:02 |
| openstackgerrit | Merged zuul/zuul-jobs master: use-buildset-registry: fix modify_registries_conf library idempotency https://review.opendev.org/725651 | 19:15 |
| *** diablo_rojo has joined #opendev | 19:18 | |
| openstackgerrit | Monty Taylor proposed zuul/zuul-jobs master: Write buildkitd.toml in use-buildset-registry https://review.opendev.org/724837 | 19:22 |
| openstackgerrit | Monty Taylor proposed zuul/zuul-jobs master: Include distro-specific vars https://review.opendev.org/725668 | 19:22 |
| openstackgerrit | Merged opendev/system-config master: Clean up unused IRC channels https://review.opendev.org/724879 | 19:44 |
| openstackgerrit | Monty Taylor proposed zuul/zuul-jobs master: Write buildkitd.toml in use-buildset-registry https://review.opendev.org/724837 | 19:47 |
| openstackgerrit | Merged openstack/project-config master: Create new project for OpenDev Engagement Stats https://review.opendev.org/724886 | 19:49 |
| openstackgerrit | Merged openstack/project-config master: Update Neutron grafana dashboard https://review.opendev.org/725299 | 19:49 |
| openstackgerrit | Merged openstack/project-config master: Clean up unused IRC channels https://review.opendev.org/724878 | 19:49 |
| *** hashar has joined #opendev | 19:50 | |
| openstackgerrit | Merged zuul/zuul-jobs master: Include distro-specific vars https://review.opendev.org/725668 | 19:51 |
| mordred | infra-root: https://review.opendev.org/#/c/723528/ is green. it adds testing for focal, but also fixes a couple of things in base | 19:55 |
| openstackgerrit | Monty Taylor proposed opendev/system-config master: Stop running mcollective https://review.opendev.org/725103 | 20:00 |
| openstackgerrit | Monty Taylor proposed opendev/system-config master: Remove puppet on non-puppeted servers https://review.opendev.org/725104 | 20:00 |
| ianw | mordred: we dropped ntp from the test images, right? | 20:00 |
| mordred | ianw: I think we did - although I'm also not sure if ntp is on the base cloud images so I figured it was safer to keep the remove | 20:02 |
| openstackgerrit | Ian Wienand proposed opendev/system-config master: Add focal to system-config base job https://review.opendev.org/725676 | 20:08 |
| ianw | i'll look at bringing up mirror testing on focal too, then we can try a node | 20:09 |
| ianw | also look at arm64 builds | 20:09 |
| mordred | ianw: https://review.opendev.org/#/c/722483/ should get us nodepool-bulder arm docker images | 20:10 |
| mordred | ianw: which I'll recheck as soon as this last zuul-jobs patch lands | 20:11 |
| ianw | excellent! | 20:11 |
| ianw | i do hope docker works ok on arm64 ... i don't see why not but i'm sure there will be something interesting | 20:12 |
| mordred | ianw: it'll be "fine" :) | 20:12 |
| openstackgerrit | Merged zuul/zuul-jobs master: Write buildkitd.toml in use-buildset-registry https://review.opendev.org/724837 | 20:12 |
| openstackgerrit | Merged zuul/zuul-jobs master: ensure-pip: use python2-pip when running under Python 2 https://review.opendev.org/724777 | 20:12 |
| openstackgerrit | Merged zuul/zuul-jobs master: Add py38 testing https://review.opendev.org/725663 | 20:12 |
| openstackgerrit | Merged opendev/system-config master: Add focal integration tests https://review.opendev.org/724214 | 20:13 |
| mordred | ianw: k. nodepool patch rechecked | 20:15 |
| openstackgerrit | Albin Vass proposed zuul/zuul-jobs master: Add upload-artifactory role https://review.opendev.org/725678 | 20:17 |
| *** cgoncalves has joined #opendev | 20:17 | |
| openstackgerrit | Merged zuul/zuul-jobs master: ansible-lint: use matchplay instead of matchtask https://review.opendev.org/724910 | 20:18 |
| openstackgerrit | Merged zuul/zuul-jobs master: use-buildset-registry: do not update ca when not necessary https://review.opendev.org/724841 | 20:22 |
| openstackgerrit | Albin Vass proposed zuul/zuul-jobs master: Add upload-artifactory role https://review.opendev.org/725678 | 20:26 |
| clarkb | ianw: left some comments/thoughts on https://review.opendev.org/#/c/724788/12 do you thnk you can check that before we approve anything? | 20:27 |
| ianw | clarkb: hrm, can we reverse proxy a paa? | 20:30 |
| ianw | ppa even. | 20:30 |
| clarkb | ianw: I expect we can | 20:31 |
| clarkb | though I've not tried it | 20:31 |
| clarkb | I don't know that we need to do it to land this. I wanted to identify the risk and any potential mitigations people think would be reasonable if necessary | 20:31 |
| ianw | or i could install it via dib element; just that's what we're trying to avoid as much as possible | 20:31 |
| clarkb | ianw: can we cache the deb on the images but not install it? | 20:32 |
| clarkb | ianw: then in the jobs if we need it install it? | 20:32 |
| ianw | the only thing with reverse proxy is that would then introduce dependencies on configure-mirror ordering | 20:33 |
| clarkb | I guess that isn't very applicable outside of opendev images if we cache the deb | 20:33 |
| ianw | yeah, but then also if you're not using mirrors xenial's pip 8 is probably ok for you too... | 20:34 |
| clarkb | heh ya | 20:34 |
| ianw | none of it feels good, i know. but at least it's in jobs that we can test with | 20:34 |
| ianw | rather than image build, deploy, break production, revert cycles | 20:35 |
| ianw | i think removing it is a good idea | 20:37 |
| ianw | fungi: ^ you may have interest in 724788 too. the sticking point i got to was that even with pip installed from upstream, it's still broken because "python3 -m venv" uses the wheel pip installed | 20:37 |
| ianw | basically "python3 -m venv" is broken on our xenial images right now ... just nobody noticed. but it is very annoying when you try to make generic roles that use that on the assumption it is working | 20:38 |
| fungi | yep, venv module isn't going to install the system context pip, it'll install the packaged wheel bundle | 20:41 |
| openstackgerrit | Ian Wienand proposed zuul/zuul-jobs master: ensure-pip: Install backported pip for Xenial https://review.opendev.org/724788 | 20:42 |
| openstackgerrit | Ian Wienand proposed zuul/zuul-jobs master: Add plain nodes to testing https://review.opendev.org/724776 | 20:42 |
| ianw | clarkb: ^ that should remove it after | 20:42 |
| openstackgerrit | Merged zuul/zuul-jobs master: use zj_image instead of image as loopvar https://review.opendev.org/725012 | 20:45 |
| mordred | ianw: I have finally paged in all of the information that I was missing about this situation. I want to flip all of the world's tables - but I grok the need for that patch :) | 20:48 |
| ianw | with https://review.opendev.org/#/c/724198/ for tempest, the existing keystone jobs pass on opensuse-15-plain nodes (along with all the zuul-jobs testing) | 20:48 |
| ianw | mordred: yeah, i didn't realise that venv was broken on xenail, even despite pip-and-virtualenv's efforts | 20:52 |
| clarkb | ianw: +2'd I'll let you approve when happy with testing on the child change? | 20:55 |
| ianw | clarkb: thanks; yep will let that go through as it adds all the -plain nodes to the testing as well. | 20:55 |
| mordred | ianw: it's very impressive | 20:56 |
| openstackgerrit | Albin Vass proposed zuul/zuul-jobs master: Check blocks recursively for loops https://review.opendev.org/724967 | 20:57 |
| ianw | clarkb: ^ i've approved most of these changes; iirc it was you who originally wrote the policy bits about zj_ prefixing | 20:59 |
| clarkb | ianw: ya we had bugs where nested roles outside of zuul-jobs using zuul-jobs had all kinds of weird behaviors | 20:59 |
| clarkb | the idea being people should be able to write default ansible loops a layer above zuul-jobs without worrying about unexpected behavior | 20:59 |
| clarkb | unfortauntely that increases the burden on zuul-jobs | 21:00 |
| *** hashar has quit IRC | 21:00 | |
| ianw | yeah, i don't know if in some of these cases it's ever going to be a problem ... but i do see that inconsistency is not great | 21:01 |
| clarkb | fwiw I didn't expect the big pushto apply the rule so broadly | 21:01 |
| clarkb | it was more intended to keep new code from breaking in similar ways | 21:02 |
| openstackgerrit | Monty Taylor proposed zuul/zuul-jobs master: Set up siblings dirs for each build in the loop https://review.opendev.org/725683 | 21:13 |
| openstackgerrit | Monty Taylor proposed zuul/zuul-jobs master: Set up siblings dirs for each build in the loop https://review.opendev.org/725683 | 21:18 |
| openstackgerrit | Merged zuul/zuul-jobs master: use zj_log_file instead of item as loop_var https://review.opendev.org/725013 | 21:20 |
| clarkb | https://twitter.com/mrda_/status/1255701594059898881 its possible we'll see similar issues with meetpad so point it out here | 21:23 |
| clarkb | tldr wayland causes problems with screensharing | 21:23 |
| fungi | also a workaround could be in-browser terminal emulators | 21:25 |
| fungi | if i'm reading the problem correctky | 21:25 |
| fungi | correctly | 21:25 |
| clarkb | fungi: I read it as wayland clients are not able to be screenshared | 21:26 |
| clarkb | I think as long as you still have x11 compat stuff around you cna have it render with x11 instead | 21:26 |
| fungi | ahh, including browsers | 21:26 |
| mordred | what's that? the new x11 replacements aren't fully replacements for x11 yet? | 21:29 |
| mordred | I'm shocked, SHOCKED I tell you | 21:29 |
| fungi | i still just use xorg (not even from a login manager, just running startx in a vty) | 21:29 |
| mordred | fungi: you are computering correct | 21:29 |
| fungi | getty is the only dm i need | 21:30 |
| fungi | and a ~/.xinitrc | 21:30 |
| clarkb | ya I x11 without wayland | 21:31 |
| clarkb | I actually half expected tumbleweed to forcefully switch me but I think the x in xfce means x11 a lot more than I expected | 21:32 |
| *** DSpider has quit IRC | 21:38 | |
| *** roman_g has joined #opendev | 21:41 | |
| *** cgoncalves has quit IRC | 21:42 | |
| openstackgerrit | Monty Taylor proposed zuul/zuul-jobs master: Set up siblings dirs for each build in the loop https://review.opendev.org/725683 | 21:45 |
| fungi | clarkb: as opposed to w(t)fce? | 21:47 |
| clarkb | fungi: exactly :) | 21:47 |
| *** cgoncalves has joined #opendev | 21:49 | |
| *** cgoncalves has quit IRC | 21:54 | |
| openstackgerrit | Monty Taylor proposed zuul/zuul-jobs master: Set up siblings dirs for each build in the loop https://review.opendev.org/725683 | 22:08 |
| openstackgerrit | Monty Taylor proposed zuul/zuul-jobs master: Set up siblings dirs for each build in the loop https://review.opendev.org/725683 | 22:09 |
| *** mlavalle has quit IRC | 22:32 | |
| *** _mlavalle_1 has joined #opendev | 22:33 | |
| openstackgerrit | Monty Taylor proposed zuul/zuul-jobs master: Set up siblings dirs for each build in the loop https://review.opendev.org/725683 | 22:38 |
| clarkb | fwiw I've not heard back from the release teeam yet but have asked them about gerrit and zuul restarts | 22:52 |
| openstackgerrit | Monty Taylor proposed zuul/zuul-jobs master: Set up siblings dirs for each build in the loop https://review.opendev.org/725683 | 22:52 |
| *** roman_g has quit IRC | 22:53 | |
| clarkb | worst case I'll be able to ask them during their weekly meeting on thursday | 23:00 |
| clarkb | though I expect I should have an answer tomorrow morning | 23:00 |
| openstackgerrit | Clark Boylan proposed opendev/system-config master: Revert "Clear LD_PRELOAD variable on zuul-web containers" https://review.opendev.org/725730 | 23:08 |
| clarkb | infra-root as a pre step to the scheduler and gerrit outages I think we can land ^ then restart zuul-web on new jemalloc less images | 23:08 |
| clarkb | I need to start cooking dinner, but will plan to do that first thing tomorrow if I can get this change in | 23:08 |
| openstackgerrit | Merged zuul/zuul-jobs master: Set up siblings dirs for each build in the loop https://review.opendev.org/725683 | 23:17 |
| openstackgerrit | Merged zuul/zuul-jobs master: ensure-pip: Install backported pip for Xenial https://review.opendev.org/724788 | 23:18 |
| openstackgerrit | Merged zuul/zuul-jobs master: Add plain nodes to testing https://review.opendev.org/724776 | 23:26 |
| *** tosky has quit IRC | 23:27 | |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!