| *** wolverineav has joined #openstack-infra | 00:00 | |
| clarkb | I've also learned a lot about mailman | 00:01 |
|---|---|---|
| clarkb | heres an idea, we can reset the subscriber list for openstack-discuss on the new server then use it to test maybe? | 00:02 |
| clarkb | that would at least help narrow it down to list config if it continues to have the trusty behavior | 00:02 |
| clarkb | I won't go doing that with extra eyeballs as I don't want to spam a ton of people | 00:02 |
| clarkb | and I should step away for a bit to figure out dinner | 00:02 |
| clarkb | thanks again for the help. Much of this is new to me and I am learning a bunch :) | 00:02 |
| *** igordc has joined #openstack-infra | 00:05 | |
| *** wolverineav has quit IRC | 00:06 | |
| igordc | hi all, who can help me with deleting one of my gerrit's associated email addresses? | 00:07 |
| *** sthussey has quit IRC | 00:07 | |
| clarkb | igordc: you need an infra root for that. It helps if you can identify the active account so we can merge the openids of the other accounts into that one | 00:11 |
| clarkb | Im no longerat my computer but if you pass that info along we should be able to sort it out | 00:12 |
| igordc | clarkb, gerrit account that needs email address removed is "igordcard" | 00:13 |
| igordc | clarkb, thank you | 00:13 |
| clarkb | is that the one you actively use now? | 00:14 |
| *** zxiiro is now known as zxiiro-away | 00:20 | |
| *** armax has quit IRC | 00:24 | |
| *** jamesmcarthur has quit IRC | 00:24 | |
| *** hamzy has joined #openstack-infra | 00:28 | |
| *** wolverineav has joined #openstack-infra | 00:28 | |
| igordc | clarkb, that is the one I've used until now | 00:30 |
| igordc | clarkb, I want to switch | 00:30 |
| igordc | clarkb, and migrate the previous email address | 00:31 |
| openstackgerrit | Merged openstack-infra/nodepool master: Use yaml.safe_load instead of load https://review.openstack.org/648436 | 00:38 |
| *** jamesmcarthur has joined #openstack-infra | 00:55 | |
| *** jamesmcarthur has quit IRC | 00:55 | |
| *** jamesmcarthur has joined #openstack-infra | 00:56 | |
| *** wolverineav has quit IRC | 00:58 | |
| *** wolverineav has joined #openstack-infra | 01:02 | |
| *** wolverineav has quit IRC | 01:06 | |
| fungi | igordc: did you end up with an extra gerrit account? otherwise you should just be able to register the new address to your existing account and set it as preferred | 01:06 |
| igordc | fungi, the former | 01:06 |
| fungi | got it. i can associate the new openid with the old account and then deactivate the new account if that's preferable... do you have any active reviews or group memberships under the old account? | 01:08 |
| *** kmarc- has joined #openstack-infra | 01:11 | |
| *** benj_- has joined #openstack-infra | 01:11 | |
| *** lathiat_ has joined #openstack-infra | 01:12 | |
| *** manfred has joined #openstack-infra | 01:12 | |
| *** kmarc has quit IRC | 01:12 | |
| *** benj_ has quit IRC | 01:12 | |
| *** mudpuppy has quit IRC | 01:12 | |
| *** toabctl has quit IRC | 01:12 | |
| *** spotz has quit IRC | 01:12 | |
| *** lathiat has quit IRC | 01:12 | |
| *** gtmanfred has quit IRC | 01:12 | |
| *** manfred is now known as gtmanfred | 01:12 | |
| *** ijw has quit IRC | 01:12 | |
| *** rascasoft has quit IRC | 01:16 | |
| *** ijw has joined #openstack-infra | 01:16 | |
| *** rascasoft has joined #openstack-infra | 01:17 | |
| *** wolverineav has joined #openstack-infra | 01:18 | |
| *** ruffian_sheep has joined #openstack-infra | 01:20 | |
| *** ijw has quit IRC | 01:21 | |
| *** wolverineav has quit IRC | 01:22 | |
| ruffian_sheep | frickler:If I upload my driver of cinder,should I run all of the CI? | 01:23 |
| *** dtantsur|afk has quit IRC | 01:24 | |
| *** dtantsur has joined #openstack-infra | 01:25 | |
| ruffian_sheep | frickler:Like that :https://review.openstack.org/#/c/643519/ | 01:25 |
| igordc | fungi, so first I'm looking to move completely to the new account, in time, .. but yes there are still pending things on the old account | 01:27 |
| igordc | fungi, is it not possible simply execute gerrit set-account --delete-email from your side? | 01:28 |
| igordc | sorry I have to go now but will be back online | 01:29 |
| *** igordc has quit IRC | 01:29 | |
| *** wolverineav has joined #openstack-infra | 01:39 | |
| *** hongbin has joined #openstack-infra | 01:41 | |
| *** wolverineav has quit IRC | 01:43 | |
| *** whoami-rajat has joined #openstack-infra | 01:57 | |
| ruffian_sheep | whoami-rajat:morning | 01:58 |
| *** ykarel|away has joined #openstack-infra | 02:06 | |
| *** mriedem has quit IRC | 02:07 | |
| *** spsurya has joined #openstack-infra | 02:12 | |
| *** bhavikdbavishi has joined #openstack-infra | 02:26 | |
| *** bhavikdbavishi has quit IRC | 02:30 | |
| *** jamesmcarthur has quit IRC | 02:31 | |
| *** bhavikdbavishi has joined #openstack-infra | 02:37 | |
| openstackgerrit | Joshua Hesketh proposed openstack-infra/project-config master: Retire oslosphinx https://review.openstack.org/649072 | 02:59 |
| *** hongbin has quit IRC | 03:00 | |
| *** jamesmcarthur has joined #openstack-infra | 03:01 | |
| *** Sundar has quit IRC | 03:02 | |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: debian-minimal buster support https://review.openstack.org/649496 | 03:13 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: [WIP] add buster tests https://review.openstack.org/649497 | 03:13 |
| ianw | fungi / zigo : ^ so it's not straight forward; i don't really know who wants to be on the hook for driving this ... | 03:14 |
| *** psachin has joined #openstack-infra | 03:16 | |
| *** hwoarang has quit IRC | 03:17 | |
| *** hwoarang has joined #openstack-infra | 03:18 | |
| *** roman_g has quit IRC | 03:22 | |
| *** nicolasbock has quit IRC | 03:33 | |
| *** wolverineav has joined #openstack-infra | 03:40 | |
| *** armax has joined #openstack-infra | 03:41 | |
| *** wolverineav has quit IRC | 03:44 | |
| *** eernst has joined #openstack-infra | 03:45 | |
| *** udesale has joined #openstack-infra | 04:00 | |
| *** ramishra has joined #openstack-infra | 04:17 | |
| *** igordc has joined #openstack-infra | 04:18 | |
| *** hwoarang has quit IRC | 04:19 | |
| *** hwoarang has joined #openstack-infra | 04:21 | |
| *** ykarel|away has quit IRC | 04:26 | |
| *** ykarel|away has joined #openstack-infra | 04:42 | |
| *** whoami-rajat has quit IRC | 04:57 | |
| openstackgerrit | Merged openstack-infra/zuul master: Add web / fingergw connections for components graph https://review.openstack.org/645852 | 05:03 |
| *** eernst has quit IRC | 05:04 | |
| *** ykarel|away has quit IRC | 05:18 | |
| *** toabctl has joined #openstack-infra | 05:21 | |
| *** ykarel|away has joined #openstack-infra | 05:24 | |
| *** quiquell|off is now known as quiquell | 05:42 | |
| *** kjackal has joined #openstack-infra | 05:54 | |
| *** janki has joined #openstack-infra | 06:17 | |
| *** adam_g has joined #openstack-infra | 06:24 | |
| *** slaweq has joined #openstack-infra | 06:26 | |
| *** bhavikdbavishi1 has joined #openstack-infra | 06:32 | |
| *** bhavikdbavishi has quit IRC | 06:33 | |
| *** bhavikdbavishi1 is now known as bhavikdbavishi | 06:33 | |
| *** pcaruana has joined #openstack-infra | 06:36 | |
| *** pcaruana has quit IRC | 06:38 | |
| *** pcaruana has joined #openstack-infra | 06:38 | |
| *** pgaxatte has joined #openstack-infra | 06:44 | |
| *** dpawlik has joined #openstack-infra | 06:47 | |
| *** rpittau|afk is now known as rpittau | 06:50 | |
| jamespage | fungi, clarkb: hey - python-pip issues in bionic? is there a bug I can reference? | 06:50 |
| jamespage | happy to help drive an SRU through | 06:50 |
| *** jpena|off is now known as jpena | 06:55 | |
| *** quiquell is now known as quiquell|brb | 06:56 | |
| *** kopecmartin|off is now known as kopecmartin | 06:57 | |
| *** tkajinam has quit IRC | 06:58 | |
| zigo | jamespage: I've fixed it in Sid/Buster (currently waiting for migration), the patch from clarkb is quite strait forward. | 07:02 |
| zigo | Though maybe you'll prefer upstream patch... | 07:02 |
| zigo | I'm still waiting for approval for the Stretch P-U. | 07:03 |
| *** tkajinam has joined #openstack-infra | 07:03 | |
| openstackgerrit | Merged openstack-infra/nodepool master: Use opendev docker jobs https://review.openstack.org/649465 | 07:03 |
| zigo | jamespage: How about fixing debootstrap in Xenial/Bionic, so it can bootstrap Buster? | 07:03 |
| zigo | Could you also work on that? | 07:03 |
| zigo | jamespage: See https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=901977 ... | 07:04 |
| openstack | Debian bug 901977 in debootstrap "--variant=minbase + --exclude={tzdata,e2fsprogs,e2fslibs} causes install failure" [Normal,Fixed] | 07:04 |
| zigo | ianw: If the PPA is a faster solution, I can work on a patched package, would that work? | 07:07 |
| *** tosky has joined #openstack-infra | 07:09 | |
| *** whoami-rajat has joined #openstack-infra | 07:13 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/zuul-website master: Slide presentation for Zuul's OIP Confirmation https://review.openstack.org/649356 | 07:17 |
| *** ruffian_sheep has quit IRC | 07:17 | |
| *** xek has joined #openstack-infra | 07:19 | |
| *** jistr is now known as jistr|afk | 07:22 | |
| zigo | jamespage: When we're at it, Debian is't really affected because on Azure, we don't support cloud-init deployed images, but I still would like to fix #926043, and I can't find a patch. The launchpad bug is a mess, with multiple commits. How can I find out what commit to apply to fix CVE-2019-0816 then? | 07:25 |
| *** e0ne has joined #openstack-infra | 07:27 | |
| *** shachar has quit IRC | 07:30 | |
| *** yolanda has joined #openstack-infra | 07:33 | |
| *** lmiccini has quit IRC | 07:33 | |
| openstackgerrit | Merged openstack-infra/irc-meetings master: Remove neutron_upgrades meeting https://review.openstack.org/645181 | 07:34 |
| openstackgerrit | Merged openstack-infra/irc-meetings master: Update keystone meeting chair https://review.openstack.org/649411 | 07:34 |
| openstackgerrit | Monty Taylor proposed openstack-infra/zuul-website master: Slide presentation for Zuul's OIP Confirmation https://review.openstack.org/649356 | 07:41 |
| *** roman_g has joined #openstack-infra | 07:42 | |
| *** helenafm has joined #openstack-infra | 07:43 | |
| *** iurygregory has joined #openstack-infra | 07:45 | |
| *** snapiri has joined #openstack-infra | 07:46 | |
| *** quiquell|brb is now known as quiquell | 07:53 | |
| *** jpich has joined #openstack-infra | 07:56 | |
| *** igordc has quit IRC | 08:04 | |
| *** lennyb has joined #openstack-infra | 08:04 | |
| *** e0ne has quit IRC | 08:07 | |
| *** ramishra has quit IRC | 08:07 | |
| *** e0ne has joined #openstack-infra | 08:15 | |
| *** armax has quit IRC | 08:17 | |
| *** e0ne has quit IRC | 08:17 | |
| *** ramishra has joined #openstack-infra | 08:19 | |
| *** lucasagomes has joined #openstack-infra | 08:20 | |
| frickler | jamespage: I created https://bugs.launchpad.net/ubuntu/+source/python-pip/+bug/1822842 for the bionic pkg | 08:20 |
| openstack | Launchpad bug 1822842 in python-pip (Ubuntu) "pip fails to install package from source when extra-index-url returns 404" [Undecided,New] | 08:20 |
| jamespage | frickler: thanks! | 08:21 |
| * jamespage looks | 08:21 | |
| *** e0ne has joined #openstack-infra | 08:24 | |
| *** ccamacho has joined #openstack-infra | 08:25 | |
| *** e0ne has quit IRC | 08:26 | |
| ianw | zigo: it's not much, just being a single script + library file. i think if anything the sticking point might be updating so many versions in lts branches and other regressions | 08:27 |
| jamespage | frickler: I'm right in thinking this impacts all pip versions in ubuntu releases? | 08:28 |
| *** priteau has joined #openstack-infra | 08:28 | |
| ianw | zigo: a ppa can work, we have a infra user where we keep a bunch of other things that we use patched. it would have to go in there, then puppet would have to be updated to install on nodepool builders, and dib jobs updated to install it too | 08:29 |
| ianw | zigo: should probably get fungi's input, now we have more an idea what's going on too | 08:29 |
| frickler | jamespage: most likely yes, though I only checked myself on bionic | 08:30 |
| *** ykarel|away is now known as ykarel|lunch | 08:30 | |
| jrosser | is it possible to get wheels build for amd64 on the infra mirrors? | 08:33 |
| jrosser | argh | 08:33 |
| jrosser | *arm64 | 08:33 |
| jrosser | aarch64. i will get this right eventually :) | 08:34 |
| *** ykarel|lunch has quit IRC | 08:35 | |
| jrosser | someone asked me about aarch64 CI jobs yesterday, we did some work on aarch64 for openstack-ansible a while back but there seems to be little chance of getting a job to run within the time limit with nothing prebuilt | 08:37 |
| ianw | jrosser: we do? | 08:37 |
| jrosser | do we? i looked here http://mirror.dfw.rax.openstack.org/wheel/ | 08:38 |
| ianw | jrosser: https://git.openstack.org/cgit/openstack-infra/project-config/tree/zuul.d/jobs.yaml#n1049 | 08:38 |
| ianw | http://zuul.openstack.org/builds?job_name=build-wheel-mirror-ubuntu-xenial-arm64 hrm | 08:39 |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul master: web: add tags to jobs list https://review.openstack.org/633654 | 08:39 |
| *** kopecmartin is now known as kopecmartin|lunc | 08:40 | |
| ianw | jrosser: i'd say we never got to the "until the builds are tested bit" of https://review.openstack.org/#/c/549644/ | 08:41 |
| ianw | jrosser: but the answer should be yes, it should be possible, modulo debugging that job (and expanding for bionic) | 08:41 |
| jrosser | ianw: ahha, well ok. there is some renewed interest in this | 08:41 |
| jrosser | we've got successful deploys on aarch64 of openstack-ansible and all the patches to make that work exist | 08:42 |
| jrosser | just none of it has ever been tested in CI which is a bit sad | 08:42 |
| *** owalsh_ is now known as owalsh | 08:43 | |
| jrosser | nowster: ^^ see this re. aarch64 wheels | 08:44 |
| *** tkajinam has quit IRC | 08:45 | |
| *** wolverineav has joined #openstack-infra | 08:45 | |
| ianw | jrosser: ok ... it's a bit late for me now, but i can trigger that job tomorrow and get some fresh logs, and we can go from there. | 08:46 |
| ianw | jrosser: could you add a story on storyboard, against openstack-infra/project-config i guess, and we can keep track of it there? | 08:46 |
| jrosser | ianw: sure - there are some folks from codethink poking generally at the aarch64 stuff, if some extra input is needed they may be able to help | 08:46 |
| *** derekh has joined #openstack-infra | 08:46 | |
| ianw | jrosser: it's been a while since I've actively looked, i think our arm64 nodes are in ok shape and the daily image builds are working. | 08:47 |
| jrosser | we've certainly run the equivalent of a gate job on a vexxhost arm node and whilst very slow it does work | 08:48 |
| ianw | another infra-root can help with the job kick off too, but i think that's the place to start right now. get some fresh logs and evaluate what's going on | 08:48 |
| jrosser | great - thanks for the help | 08:48 |
| ianw | we'll also want a bionic variant, but that shouldn't be hard | 08:48 |
| ianw | ok, i gotta go, but i'm sure we can get progress on this | 08:49 |
| *** wolverineav has quit IRC | 08:50 | |
| zigo | ianw: Ok, I'll try to find time to make a patched version then. | 08:52 |
| *** ykarel|lunch has joined #openstack-infra | 09:00 | |
| chandankumar | ianw: please have a look at this patch https://review.openstack.org/#/c/647667/ when free, thanks! | 09:01 |
| nowster | morning jrosser, ianw | 09:15 |
| jrosser | nowster: good morning - i made this as requested to track the aarch64 stuff https://storyboard.openstack.org/#!/story/2005353 | 09:16 |
| nowster | I'm preparing a patch for Debian/Ubuntu to allow openafs to build in stretch/bionic. It's already in buster/cosmic. | 09:16 |
| nowster | (openafs on arm64/aarch64, that is) | 09:19 |
| *** xek has quit IRC | 09:20 | |
| *** xek has joined #openstack-infra | 09:21 | |
| *** xek has quit IRC | 09:22 | |
| *** jpich has quit IRC | 09:27 | |
| *** jpich has joined #openstack-infra | 09:28 | |
| openstackgerrit | Matthieu Huin proposed openstack-infra/zuul master: web: add tenant and project scoped, JWT-protected actions https://review.openstack.org/576907 | 09:28 |
| *** bhavikdbavishi has quit IRC | 09:30 | |
| slaweq | frickler: ianw: hi, I have one more time question to hold some nodes for me to debug | 09:34 |
| slaweq | frickler: ianw: can You do it for me once again? | 09:34 |
| slaweq | I need to debug why job tobiko-devstack-neutron-fedora is failing every time and same job based on ubuntu is running fine | 09:35 |
| *** dhellmann has quit IRC | 09:37 | |
| *** whoami-rajat has quit IRC | 09:37 | |
| *** dhellmann has joined #openstack-infra | 09:46 | |
| *** electrofelix has joined #openstack-infra | 09:49 | |
| *** dhellmann has quit IRC | 09:53 | |
| *** markvoelker has joined #openstack-infra | 09:55 | |
| *** yamamoto has quit IRC | 09:58 | |
| *** gfidente has joined #openstack-infra | 09:58 | |
| *** yamamoto has joined #openstack-infra | 10:01 | |
| *** dhellmann has joined #openstack-infra | 10:02 | |
| *** yamamoto has quit IRC | 10:03 | |
| *** e0ne has joined #openstack-infra | 10:03 | |
| dulek | infra-root: Hey, you can release 1a854d23-eecc-4d7a-97f8-f7769d6d53f7 on limestone-regionone (id 0004609144). I don't need it anymore, we reproduced the issue locally and already know partial root cause. | 10:07 |
| *** e0ne has quit IRC | 10:11 | |
| frickler | slaweq: do you have a special patch you want to check? | 10:13 |
| slaweq | frickler: no, it fails on every patch on this job | 10:14 |
| slaweq | but I can push some DNM patch if You want | 10:14 |
| frickler | slaweq: probably safer to avoid some potentially broken patch | 10:14 |
| slaweq | frickler: sure, give me a minute | 10:14 |
| frickler | dulek: thanks for the feedback, deleting that node now | 10:14 |
| *** e0ne has joined #openstack-infra | 10:15 | |
| *** jpena has quit IRC | 10:16 | |
| slaweq | frickler: so it's patch https://review.openstack.org/649557 | 10:17 |
| slaweq | job didn't start yet | 10:17 |
| frickler | slaweq: o.k., I'll set up the hold | 10:18 |
| slaweq | frickler: thx a lot | 10:18 |
| *** ykarel|lunch is now known as ykarel | 10:20 | |
| *** yamamoto has joined #openstack-infra | 10:22 | |
| openstackgerrit | Matthieu Huin proposed openstack-infra/zuul master: Allow operator to generate auth tokens through the CLI https://review.openstack.org/636197 | 10:23 |
| openstackgerrit | Matthieu Huin proposed openstack-infra/zuul master: Zuul CLI: allow access via REST https://review.openstack.org/636315 | 10:24 |
| *** markvoelker has quit IRC | 10:27 | |
| zbr | ianw: can you please have a look at https://review.openstack.org/#/c/639951/ ? | 10:27 |
| *** sshnaidm|rover is now known as sshnaidm|bbl | 10:27 | |
| *** jpena has joined #openstack-infra | 10:29 | |
| *** nicolasbock has joined #openstack-infra | 10:33 | |
| openstackgerrit | Matthieu Huin proposed openstack-infra/zuul master: Add Authorization Rules configuration https://review.openstack.org/639855 | 10:39 |
| openstackgerrit | Matthieu Huin proposed openstack-infra/zuul master: Web: plug the authorization engine https://review.openstack.org/640884 | 10:41 |
| openstackgerrit | Matthieu Huin proposed openstack-infra/zuul master: Zuul Web: add /api/user/authorizations endpoint https://review.openstack.org/641099 | 10:43 |
| openstackgerrit | Matthieu Huin proposed openstack-infra/zuul master: authentication config: add optional token_expiry https://review.openstack.org/642408 | 10:43 |
| dulek | Why do I see some combined log messages in logstash.openstack.org? Like SUCCESS,FAILURE and ironic-tempest-ipa-wholedisk-direct-tinyipa-multinode,kuryr-kubernetes-tempest? | 10:44 |
| dulek | Any way to search only for kuryr-kubernetes-tempest job without those combined ones? | 10:44 |
| *** wolverineav has joined #openstack-infra | 10:46 | |
| *** quiquell is now known as quiquell|lunch | 10:48 | |
| *** wolverineav has quit IRC | 10:51 | |
| *** tbachman has quit IRC | 10:51 | |
| *** e0ne has quit IRC | 10:53 | |
| *** ramishra has quit IRC | 10:56 | |
| *** jistr|afk is now known as jistr | 11:02 | |
| *** jpena is now known as jpena|lunch | 11:02 | |
| *** ramishra has joined #openstack-infra | 11:04 | |
| *** helenafm has quit IRC | 11:04 | |
| *** gfidente has quit IRC | 11:09 | |
| *** kopecmartin|lunc is now known as kopecmartin | 11:15 | |
| *** yamamoto has quit IRC | 11:15 | |
| openstackgerrit | Matthieu Huin proposed openstack-infra/zuul master: Add Authorization Rules configuration https://review.openstack.org/639855 | 11:19 |
| *** yamamoto has joined #openstack-infra | 11:20 | |
| *** gfidente has joined #openstack-infra | 11:21 | |
| *** quiquell|lunch is now known as quiquell | 11:24 | |
| *** gfidente has quit IRC | 11:24 | |
| *** markvoelker has joined #openstack-infra | 11:24 | |
| *** udesale has quit IRC | 11:26 | |
| *** dikonoor has joined #openstack-infra | 11:30 | |
| frickler | slaweq: nodes 104.130.69.165, 104.130.69.106 and 104.130.69.64 are waiting for you | 11:30 |
| slaweq | frickler: thx a lot | 11:30 |
| openstackgerrit | Matthieu Huin proposed openstack-infra/zuul master: Web: plug the authorization engine https://review.openstack.org/640884 | 11:31 |
| openstackgerrit | Matthieu Huin proposed openstack-infra/zuul master: Zuul Web: add /api/user/authorizations endpoint https://review.openstack.org/641099 | 11:32 |
| frickler | slaweq: always welcome, let me know if you need anything else | 11:37 |
| *** rcernin has quit IRC | 11:38 | |
| *** apetrich has quit IRC | 11:48 | |
| *** apetrich has joined #openstack-infra | 11:49 | |
| zbr | doc8 package seems unmaintained, anyone in infra-core willing to help with few reviews there? | 11:51 |
| *** rlandy has joined #openstack-infra | 11:55 | |
| *** markvoelker has quit IRC | 11:57 | |
| *** bhavikdbavishi has joined #openstack-infra | 11:59 | |
| *** jpena|lunch is now known as jpena | 12:02 | |
| *** apetrich has quit IRC | 12:05 | |
| *** rh-jelabarre has quit IRC | 12:06 | |
| *** rh-jelabarre has joined #openstack-infra | 12:06 | |
| *** trown|outtypewww is now known as trown | 12:07 | |
| *** ramishra has quit IRC | 12:10 | |
| *** tbachman has joined #openstack-infra | 12:12 | |
| *** odyssey4me has quit IRC | 12:12 | |
| *** ramishra has joined #openstack-infra | 12:12 | |
| *** quiquell is now known as quiquell|brb | 12:13 | |
| *** whoami-rajat has joined #openstack-infra | 12:19 | |
| *** e0ne has joined #openstack-infra | 12:20 | |
| *** apetrich has joined #openstack-infra | 12:23 | |
| *** odyssey4me has joined #openstack-infra | 12:26 | |
| *** jamesmcarthur has quit IRC | 12:26 | |
| *** jamesmcarthur has joined #openstack-infra | 12:27 | |
| *** eharney has quit IRC | 12:33 | |
| openstackgerrit | Ivan Kolodyazhny proposed openstack-infra/project-config master: Stop project gating before retirement https://review.openstack.org/631218 | 12:34 |
| *** dtantsur is now known as dtantsur|brb | 12:36 | |
| *** jamesmcarthur has quit IRC | 12:36 | |
| *** priteau has quit IRC | 12:36 | |
| *** dtantsur|brb is now known as dtantsur | 12:36 | |
| *** priteau has joined #openstack-infra | 12:37 | |
| *** janki has quit IRC | 12:38 | |
| *** kgiusti has joined #openstack-infra | 12:43 | |
| *** jamesmcarthur_ has joined #openstack-infra | 12:43 | |
| *** priteau has quit IRC | 12:44 | |
| *** wolverineav has joined #openstack-infra | 12:47 | |
| openstackgerrit | Liam Young proposed openstack-infra/project-config master: New charms & interface for Masakari integration https://review.openstack.org/649597 | 12:48 |
| *** wolverineav has quit IRC | 12:52 | |
| *** ricolin_phone has joined #openstack-infra | 12:53 | |
| *** helenafm has joined #openstack-infra | 12:54 | |
| *** quiquell|brb is now known as quiquell | 12:54 | |
| openstackgerrit | Matthieu Huin proposed openstack-infra/zuul master: authentication config: add optional token_expiry https://review.openstack.org/642408 | 12:59 |
| *** sshnaidm|bbl is now known as sshnaidm | 13:03 | |
| *** gfidente has joined #openstack-infra | 13:07 | |
| frickler | mnaser: I just had a post_failure in sjc1, possibly a duplicated node, if you want to look: http://logs.openstack.org/51/648951/1/gate/grenade-py3/9fc9f51/job-output.txt.gz#_2019-04-03_09_35_16_995635 | 13:08 |
| *** mriedem has joined #openstack-infra | 13:10 | |
| *** lseki has joined #openstack-infra | 13:11 | |
| *** wolverineav has joined #openstack-infra | 13:19 | |
| *** wolverineav has quit IRC | 13:23 | |
| *** ricolin_phone has quit IRC | 13:25 | |
| *** bhavikdbavishi has quit IRC | 13:27 | |
| *** ricolin has joined #openstack-infra | 13:30 | |
| nowster | https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=926321 | 13:30 |
| openstack | Debian bug 926321 in src:openafs "openafs: FTBFS on arm64" [Normal,Open] | 13:30 |
| *** dklyle has quit IRC | 13:30 | |
| *** dklyle has joined #openstack-infra | 13:31 | |
| *** elod_off has quit IRC | 13:31 | |
| *** elod_off has joined #openstack-infra | 13:32 | |
| *** e0ne has quit IRC | 13:35 | |
| *** ykarel has quit IRC | 13:41 | |
| *** e0ne has joined #openstack-infra | 13:48 | |
| *** shachar has joined #openstack-infra | 13:53 | |
| *** oanson has quit IRC | 13:55 | |
| *** eharney has joined #openstack-infra | 13:55 | |
| *** yolanda has quit IRC | 13:55 | |
| *** snapiri has quit IRC | 13:56 | |
| *** udesale has joined #openstack-infra | 13:56 | |
| *** igordc has joined #openstack-infra | 14:01 | |
| *** ricolin_phone has joined #openstack-infra | 14:02 | |
| *** serverascode has joined #openstack-infra | 14:03 | |
| *** ricolin_phone has quit IRC | 14:05 | |
| openstackgerrit | Stephen Finucane proposed openstack-infra/zuul master: tox: Integrate tox-docker https://review.openstack.org/649041 | 14:05 |
| *** yolanda has joined #openstack-infra | 14:12 | |
| *** dklyle has quit IRC | 14:15 | |
| *** ramishra has quit IRC | 14:16 | |
| *** e0ne has quit IRC | 14:22 | |
| frickler | infra-root: the telemetry team has recently been assigned a new PTL via the TC, who has now asked to be made core for some projects. I'd be willing to execute that request but I'd like to make sure that we agree on this, first. http://lists.openstack.org/pipermail/openstack-discuss/2019-April/004486.html | 14:23 |
| *** e0ne has joined #openstack-infra | 14:23 | |
| corvus | frickler: looks legit to me | 14:24 |
| pabelanger | agree | 14:24 |
| *** kjackal has quit IRC | 14:25 | |
| *** kjackal has joined #openstack-infra | 14:26 | |
| *** yamamoto has quit IRC | 14:26 | |
| *** yamamoto has joined #openstack-infra | 14:26 | |
| *** yamamoto has quit IRC | 14:26 | |
| *** yamamoto has joined #openstack-infra | 14:27 | |
| *** yamamoto has quit IRC | 14:27 | |
| *** eernst has joined #openstack-infra | 14:28 | |
| *** yamamoto has joined #openstack-infra | 14:28 | |
| *** ykarel has joined #openstack-infra | 14:28 | |
| frickler | o.k., I take that as 2 x +2 | 14:28 |
| frickler | #status log added Trinh Nguyen (new telemetry PTL) to gerrit groups {ceilometer,aodh,panko}-{core,stable-maint} http://lists.openstack.org/pipermail/openstack-discuss/2019-April/004486.html | 14:29 |
| openstackstatus | frickler: finished logging | 14:29 |
| *** ramishra has joined #openstack-infra | 14:32 | |
| openstackgerrit | Merged openstack-infra/nodepool master: Make local dib file cleanup method a static method https://review.openstack.org/649166 | 14:35 |
| *** armax has joined #openstack-infra | 14:35 | |
| *** e0ne has quit IRC | 14:37 | |
| *** bhavikdbavishi has joined #openstack-infra | 14:39 | |
| fungi | frickler: yeah, we can simply confirm from https://governance.openstack.org/tc/reference/projects/telemetry.html if in doubt | 14:39 |
| fungi | and thanks for getting that, it was on my to do list to grab if nobody beat me to it | 14:40 |
| *** dklyle has joined #openstack-infra | 14:41 | |
| *** dpawlik has quit IRC | 14:44 | |
| *** e0ne has joined #openstack-infra | 14:44 | |
| openstackgerrit | Nicolas Hicher proposed openstack-infra/zuul-jobs master: Propose submit-logstash role to export logs https://review.openstack.org/649426 | 14:45 |
| *** yolanda has quit IRC | 14:50 | |
| *** bhavikdbavishi has quit IRC | 14:51 | |
| *** bhavikdbavishi has joined #openstack-infra | 14:51 | |
| *** aaronsheffield has joined #openstack-infra | 14:52 | |
| *** ramishra has quit IRC | 14:57 | |
| *** yolanda has joined #openstack-infra | 14:57 | |
| openstackgerrit | Merged openstack-infra/zuul master: Prepend path with bin dir of ansible virtualenv https://review.openstack.org/649427 | 15:09 |
| *** sthussey has joined #openstack-infra | 15:19 | |
| openstackgerrit | Merged openstack-infra/zuul master: Add link to builds in job page https://review.openstack.org/648864 | 15:22 |
| *** artom has joined #openstack-infra | 15:22 | |
| clarkb | infra-root as an fyi I've been recontacted by the people/person wanting the 'nimble' package name on pypi. They still want the package transfer and are ready for it now. I've been asked to transfer nimble to https://pypi.org/user/spencer/ if there are no last minute objections I'll do that in a bit | 15:24 |
| clarkb | (I had previously got confirmation from Zhenguo Niu that the name is no longer used and can be transfered this went to the discuss list) | 15:25 |
| fungi | clarkb: sounds good, thanks | 15:25 |
| *** eernst has quit IRC | 15:28 | |
| corvus | clarkb: ++ | 15:28 |
| clarkb | also while I'm spinning the day up, corvus not sure if you saw my sumamry of what I/we learned about mailman yesterday. But I did confirm that trusty and xenial have the same utf8 -> base64 encoding behavior in python's email.message.Message | 15:29 |
| clarkb | I think my next step is to do a direct comparison of the installed Decorate.py code on trusty and xenial | 15:30 |
| clarkb | so far I've only compraed within bzr and that may not be accurate because well reality | 15:30 |
| fungi | clarkb: also i second your idea of wiping the subscriber list for openstack-discuss on th test server and adding the same members as the test list | 15:30 |
| clarkb | and ya ^ was going to be the other thing I try | 15:31 |
| corvus | clarkb: istr mailman having a vendored email package at some point | 15:34 |
| openstackgerrit | Artom Lifshitz proposed openstack-infra/project-config master: Add whitebox-tempest-plugin project https://review.openstack.org/649425 | 15:34 |
| *** bhavikdbavishi has quit IRC | 15:36 | |
| *** e0ne has quit IRC | 15:37 | |
| *** e0ne has joined #openstack-infra | 15:37 | |
| *** quiquell is now known as quiquell|off | 15:38 | |
| *** rlandy is now known as rlandy|ruck | 15:40 | |
| *** Dobroslaw is now known as Dobroslaw_afk | 15:40 | |
| *** anteaya has quit IRC | 15:45 | |
| mnaser | stephenfin: thanks for https://github.com/kallimachos/sphinxmark/issues/33 | 15:47 |
| stephenfin | mnaser: Just got to figure out why the tests are moaning now \o/ | 15:47 |
| mnaser | stephenfin: I guess we'll have to drop it for now in openstack ansible until it is unbroken and erleased | 15:48 |
| stephenfin | mnaser: I'd say so, yeah. What are you using it for? | 15:48 |
| clarkb | fungi: corvus: in comparing the Decorate files directly between installs if not header and not footer: return is in both of them | 15:49 |
| mnaser | stephenfin: im not a sphinx expert but.. https://github.com/openstack/openstack-ansible/blob/6db26df38e2af6afaebe1899fa1219c38a83c94a/doc/source/conf.py#L351-L357 | 15:49 |
| clarkb | this happens before the block that I believe to be resulting in base64 ification | 15:49 |
| clarkb | now wondering why -discuss seems to be hitting that and not getting converted but my test list isn't | 15:49 |
| clarkb | I'm pretty sure I've disabled the footer, but maybe header is not? | 15:50 |
| artom | So, coming from Nova where reviews are, ahem, hard to come by, should I be poking -infra for reviews? Or let things take their course? | 15:50 |
| *** pgaxatte has quit IRC | 15:50 | |
| mnaser | artom: infra core ping is usually helpful (with a - instead of a space between the two words) | 15:50 |
| artom | mnaser, much thanks - I'm blaming you if I get any heat for it ;) | 15:51 |
| fungi | clarkb: ought to be able to etll with a diff of the cli config dump | 15:51 |
| fungi | s/etll/tell/ | 15:51 |
| artom | infra-core, request to a add a new project here: https://review.openstack.org/#/c/649425/. Thanks in advance! | 15:51 |
| fungi | mnaser: artom: infra-root | 15:51 |
| artom | infra-root, request to a add a new project here: https://review.openstack.org/#/c/649425/. Thanks in advance! | 15:52 |
| fungi | but in the case of configuration changes, config-core is more relevant | 15:52 |
| stephenfin | mnaser: Feels like something we could do in openstackdocstheme. Maybe bring it up on #openstack-doc | 15:52 |
| fungi | (that's a broader set of reviewers) | 15:52 |
| stephenfin | mnaser: In any case, I'd remove your use of that extension across the board. It's pretty much dead | 15:53 |
| stephenfin | mnaser: Oh, btw, this is the important piece https://github.com/openstack/openstack-ansible/blob/6db26df38e2af6afaebe1899fa1219c38a83c94a/doc/source/conf.py#L51-L61 | 15:53 |
| *** iurygregory has quit IRC | 15:53 | |
| stephenfin | mnaser: I _think_ the header we have at the top of docs now gets us 90% of the way there, IMO | 15:53 |
| artom | fungi, cheers! | 15:53 |
| *** jamesmcarthur_ has quit IRC | 15:53 | |
| mnaser | stephenfin: ill try to dig and understand that a bit more when I can :> | 15:55 |
| *** rpittau is now known as rpittau|afk | 15:57 | |
| *** bhavikdbavishi has joined #openstack-infra | 15:58 | |
| clarkb | msg_header and msg_footer are both '' arg, I mean that explains why -discuss isn't getting transformed but -infra is for example. But doesn't explain why my test list isn't the same. | 15:58 |
| *** e0ne has quit IRC | 15:59 | |
| *** nicolasbock has quit IRC | 16:02 | |
| *** anteaya has joined #openstack-infra | 16:02 | |
| *** dpawlik has joined #openstack-infra | 16:02 | |
| *** ykarel is now known as ykarel|away | 16:02 | |
| *** dikonoor has quit IRC | 16:05 | |
| *** e0ne has joined #openstack-infra | 16:05 | |
| *** bhavikdbavishi has quit IRC | 16:05 | |
| *** e0ne has quit IRC | 16:05 | |
| *** bhavikdbavishi has joined #openstack-infra | 16:06 | |
| *** e0ne has joined #openstack-infra | 16:06 | |
| clarkb | fungi: corvus: ok I think most recent email (from a minute ago) produced logging that shows are aren't hitting that short circuit on xenial even though both header and footer appaer to be empty | 16:07 |
| *** lucasagomes has quit IRC | 16:07 | |
| corvus | clarkb: oh, wow, are you saying that openstack-infra currently b64s plain text? | 16:07 |
| clarkb | in particular footer appears to have an empty newline in it | 16:07 |
| clarkb | corvus: yes | 16:07 |
| corvus | (i just dug into my archives and found an example of that) | 16:08 |
| clarkb | corvus: basically this is only a regression for -discuss where we do not set footer or header | 16:08 |
| clarkb | for all the lists where we set footer this was existing behavior | 16:08 |
| corvus | clarkb: ack, so we're narrowing the field | 16:08 |
| clarkb | note that it only affects text/plain emails not multipart emails | 16:08 |
| corvus | yeah, i observe that in the archives too | 16:08 |
| corvus | (mail from fungi is never base64 encoded because it's always multipart :) | 16:09 |
| clarkb | yup I think I've narrowed it down to footer being '\n' and not '' once processed by decorate so the short circuit return I pasted above never hits | 16:09 |
| clarkb | I don't know why that is and I'm going to add a bit more debugging to actually be sure of that, but ya | 16:09 |
| *** trown is now known as trown|lunch | 16:10 | |
| fungi | well, mail from me is *usually* multipart. i sometimes don't sign my messages but usually if i'm sending to a public mailing list i do | 16:12 |
| openstackgerrit | Merged openstack-infra/nodepool master: Fix for image build leaks https://review.openstack.org/647599 | 16:12 |
| *** artom has quit IRC | 16:12 | |
| *** imacdonn has quit IRC | 16:12 | |
| clarkb | currently trying to sort out what additional debugging would be useful to avoid spamming yall with more emails than encessary | 16:12 |
| *** jamesmcarthur has joined #openstack-infra | 16:12 | |
| fungi | i think the zuul lists may also not set footer/header? so would be a regression for them as well | 16:13 |
| *** imacdonn has joined #openstack-infra | 16:13 | |
| corvus | clarkb: i don't mind the spam | 16:13 |
| fungi | same, i get vastly more actual spam anyway | 16:13 |
| clarkb | corvus: ok I won't worry too much about it then | 16:13 |
| *** jpena is now known as jpena|off | 16:14 | |
| *** jamesmcarthur has quit IRC | 16:15 | |
| *** gfidente is now known as gfidente|afk | 16:17 | |
| *** michael-beaver has joined #openstack-infra | 16:17 | |
| *** udesale has quit IRC | 16:19 | |
| *** michael-beaver has left #openstack-infra | 16:20 | |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul master: Use the buildset registry in zuul-quick-start https://review.openstack.org/649467 | 16:20 |
| clarkb | ok my debug logging says msg_footer is '\r\n' | 16:22 |
| clarkb | the value set in the config is '' | 16:22 |
| *** jamesmcarthur has joined #openstack-infra | 16:23 | |
| clarkb | that gets decorated down to '\n' whcih is not a false value in python so we go through the conversion | 16:23 |
| clarkb | finally we know what is causing the issue. Now to understand why | 16:23 |
| corvus | clarkb: when you say "the value set in the config is ''" which config? | 16:23 |
| clarkb | corvus: the value I get from config_list command is msgfooter = '' | 16:24 |
| clarkb | er msg_footer = '' | 16:24 |
| corvus | ack | 16:24 |
| *** dtantsur is now known as dtantsur|afk | 16:24 | |
| *** kopecmartin is now known as kopecmartin|off | 16:25 | |
| clarkb | corvus: However I added debug logging to /usr/lib/mailman/Mailman/Handlers/Decorate.py that syslog('error', 'clarkb decortate msg_footer raw %s', repr(mlist.msg_footer)) and I get '\r\n' in the error log | 16:25 |
| openstackgerrit | Jason Lee proposed openstack-infra/storyboard master: WORK IN PROGRESS: Added script for webscraping Launchpad Blueprint pages, generating a list of blueprints in a project. https://review.openstack.org/649666 | 16:26 |
| clarkb | fungi: your test emails had trailing newlines right? One thing I don't think mine have done is edned with a newline and I wouldn't be surprised if mailman thought it had to add them | 16:26 |
| clarkb | but I probably shouldn't worry about testing that until after I've reviewed the config processing for msg_footer | 16:27 |
| fungi | clarkb: i think your test emails will always have trailing newlines because you have to end the message with . on a line by itself | 16:27 |
| *** jpich has quit IRC | 16:27 | |
| clarkb | ok so smtp isn't filtering out that newline and . just the . | 16:28 |
| fungi | i mean, technically it's up to exim, but pretty sure it's passing through the trailing newline | 16:29 |
| *** ykarel|away has quit IRC | 16:30 | |
| *** yamamoto has quit IRC | 16:30 | |
| *** psachin has quit IRC | 16:34 | |
| openstackgerrit | Merged openstack-infra/zuul-sphinx master: Run opendev-release-python on release https://review.openstack.org/649456 | 16:35 |
| *** ginopc has quit IRC | 16:41 | |
| *** rh-jelabarre has quit IRC | 16:44 | |
| *** spsurya has quit IRC | 16:46 | |
| clarkb | ok that last email did what we wanted it to | 16:48 |
| clarkb | This must've been a serialization bug all along from the first time I removed the footer | 16:48 |
| clarkb | maybe I left a newline in the input box when saved? | 16:48 |
| clarkb | in any case I added a footer back then removed it and now things work as expected | 16:49 |
| clarkb | ugh so probably pebcak all along | 16:49 |
| *** rh-jelabarre has joined #openstack-infra | 16:49 | |
| clarkb | what is weird is that config_list showed '' | 16:49 |
| clarkb | but when I looked at the pickle file directly there was definitely a ^M in there | 16:49 |
| clarkb | I think this means that if we observe this issue in the future we have to reset the footer carefully | 16:50 |
| clarkb | and otherwise this should work as before and now I may need to go do something other than computer for a few minutes | 16:50 |
| Shrews | infra-root: any objections to me restarting nodepool-builder on nb01 to validate the new leak fix? | 16:51 |
| *** e0ne has quit IRC | 16:51 | |
| clarkb | Shrews: not from me | 16:51 |
| corvus | Shrews: ++ | 16:52 |
| clarkb | on the upside I think I know how mailman works now which might be worth something | 16:52 |
| *** jamesmcarthur has quit IRC | 16:52 | |
| clarkb | if there is a bug here it is in config_list showing the '\r\n' as '' | 16:52 |
| clarkb | that might be worth a report if I can debug it a bit more | 16:53 |
| corvus | clarkb: wow! i'm glad we understand that now | 16:53 |
| corvus | it sounds like the upgrade itself should be a non issue, but i'm glad we confirmed that; if that had been a behavior change it would have been an unpleasant surprise | 16:53 |
| clarkb | indeed | 16:53 |
| clarkb | so that leaves us with how do we want to handle the dmarc config settings | 16:53 |
| *** helenafm has quit IRC | 16:54 | |
| clarkb | which in my debugging of the other issues I think I found that if we remove WrapMessage from the global pipeline that some of thsoe functions end up being noops | 16:54 |
| fungi | Shrews: thanks! i say go for it | 16:54 |
| clarkb | so people could click on the shiny buttons but they won't do anything | 16:54 |
| fungi | clarkb: that's excellent news | 16:54 |
| clarkb | corvus: fungi ^ maybe you can take a look at that idea and see if I've missed anything? | 16:54 |
| clarkb | and now I am going to take a short break | 16:55 |
| *** jamesmcarthur has joined #openstack-infra | 16:56 | |
| *** derekh has quit IRC | 16:56 | |
| Shrews | i suppose i might as well restart all builders | 16:57 |
| *** wolverineav has joined #openstack-infra | 16:57 | |
| mordred | Shrews: since you're restarting nodepool-builders - it's a good moment to remind people that we cut an sdk release with taskmanager removal in it and might want to land this: https://review.openstack.org/#/c/649254/ until such a time as we have the other bits, including possibly the filter thing you were working on, sorted | 16:58 |
| mordred | corvus: ^^ | 16:58 |
| fungi | clarkb: msg['From'] = msgdata.get('add_header').get('From') and so on are how it seems to be getting the new versions of those headers and replacing them, so looks like it will take care of skipping that too if we omit it from the pipeline | 16:58 |
| *** rkukura has joined #openstack-infra | 16:59 | |
| *** trown|lunch is now known as trown | 17:00 | |
| Shrews | mordred: do you think we should have that in before restarting the builders (too late, already did, but can be undone)? | 17:01 |
| mordred | Shrews: no - I don't think it matters for the builders a ton. I do think we should do it before we restart launchers just to be safe - and also because of the statsd metrics | 17:03 |
| Shrews | mordred: +3d | 17:06 |
| mordred | Shrews: thanks! | 17:06 |
| *** artom has joined #openstack-infra | 17:14 | |
| *** e0ne has joined #openstack-infra | 17:14 | |
| *** e0ne has quit IRC | 17:15 | |
| *** yamamoto has joined #openstack-infra | 17:22 | |
| Shrews | #status log Nodepool builders restarted with new code for cleaning up leaked DIB builds | 17:22 |
| openstackstatus | Shrews: finished logging | 17:22 |
| fungi | that's exciting | 17:22 |
| openstackgerrit | Artom Lifshitz proposed openstack-infra/project-config master: Add whitebox-tempest-plugin project https://review.openstack.org/649425 | 17:23 |
| Shrews | fungi: it may take a while to actually see it in action. will watch the logs for a couple of days | 17:24 |
| *** spsurya has joined #openstack-infra | 17:28 | |
| openstackgerrit | Merged openstack-infra/nodepool master: Pin openstacsksdk to <0.27.0 https://review.openstack.org/649254 | 17:29 |
| clarkb | ok back | 17:29 |
| *** yamamoto has quit IRC | 17:32 | |
| *** yamamoto has joined #openstack-infra | 17:33 | |
| *** jamesmcarthur has quit IRC | 17:35 | |
| clarkb | fungi: reading more I think removing WrapMessage will only handle the wrap option not the munge option | 17:36 |
| clarkb | still not quite sure how munge is processed | 17:36 |
| *** ijw has joined #openstack-infra | 17:40 | |
| clarkb | fungi: corvus we could use a patched SpamDetect that seems to be the handler that does the first step in handing dmarc_moderation_action. For munge and wrap it sets from_is_list appropriately for subsequent handlers to process things | 17:44 |
| clarkb | CleanseDKIM is the other place where munge is handled along with WrapMessage which handles wrap and munge | 17:45 |
| *** dpawlik has quit IRC | 17:45 | |
| clarkb | I think removing WrapMessage gets us 90% of the way there | 17:46 |
| clarkb | fungi: kata is using munge not wrap right? and thats the bit where we'd 10% fail | 17:46 |
| clarkb | but maybe we can tell people "it doesn't work sorry" :) | 17:46 |
| *** apetrich has quit IRC | 17:46 | |
| *** electrofelix has quit IRC | 17:50 | |
| *** deray has joined #openstack-infra | 17:53 | |
| clarkb | ok infra-root I've written down dmarc_moderation_action handling options at https://etherpad.openstack.org/p/lists.o.o-trusty-to-xenial under bullet 5.2.6. Let me know what you think and if you have other ideas | 17:54 |
| *** wolverineav has quit IRC | 17:56 | |
| openstackgerrit | Tobias Henkel proposed openstack-infra/zuul master: Use a more visible selection color https://review.openstack.org/648865 | 17:56 |
| openstackgerrit | Tobias Henkel proposed openstack-infra/zuul master: Use a more visible selection color https://review.openstack.org/648865 | 17:57 |
| *** wolverineav has joined #openstack-infra | 17:57 | |
| *** yamamoto has quit IRC | 18:00 | |
| deray | I need some advice regarding oslo_concurrency/fasteners usage. My objective is to limit the number (some configurable no.) of short-lived processes | 18:03 |
| deray | (doing some operation) by using soem kind of a smart file lock (fcntl.lockf) which can have not just one process to exclusively acquire the lock but | 18:03 |
| deray | actually a specified no. (just like the concept of counting semaphore). Is that readily available out of the box or I need to handcraft it? | 18:03 |
| fungi | deray: i'm not sure this channel is the one you're looking for | 18:04 |
| fungi | this is where we run services to support the openstack community (code review system, continuous integration, mailing list servers, et cetera) | 18:05 |
| fungi | maybe you want #openstack-oslo? | 18:05 |
| deray | fungi, ok.. then could you tell me which channel I can ask this | 18:05 |
| deray | fungi, ok sure thx | 18:05 |
| clarkb | alrgith I'm going to context switch out of mailman things now that I think we have a good handle on stuff and just have to think through dmarc moderation action policy | 18:08 |
| clarkb | going to handle over the nimble pypi package now | 18:08 |
| *** bhavikdbavishi has quit IRC | 18:08 | |
| *** wolverineav has quit IRC | 18:09 | |
| *** wolverineav has joined #openstack-infra | 18:10 | |
| clarkb | infra-root I just killed a gpg-agent on bridge. Don't forget to use `edit-secrets` | 18:11 |
| fungi | what's going on with the nimble package? | 18:12 |
| clarkb | fungi: thats the package that we are transfering ownership for on pypi | 18:13 |
| clarkb | (I made metnion of it at 15:24UTC today) | 18:13 |
| fungi | oh, yes that one | 18:13 |
| clarkb | yup and now it is done | 18:13 |
| fungi | i had already forgotten that's what it was named | 18:13 |
| fungi | so much switching, so little context | 18:14 |
| clarkb | #status log Added PyPi user 'spencer' as owner on PyPi package 'nimble' as we werent using the name and were asked nicely to give it to another group. | 18:14 |
| openstackstatus | clarkb: finished logging | 18:14 |
| *** igordc has quit IRC | 18:14 | |
| anteaya | fungi: I'd like that on a t-shirt | 18:14 |
| fungi | that's my new career: selling shirts with glib phrases out of the back of a van in concert parking lots | 18:16 |
| anteaya | sounds like a stable choice | 18:17 |
| anteaya | should be able to withstand climate change | 18:17 |
| *** jamesmcarthur has joined #openstack-infra | 18:17 | |
| fungi | i'll just count on shorter sleeves gaining popularity | 18:18 |
| anteaya | sounds like it should take | 18:19 |
| clarkb | their website doesn't seem to be working properly but inspirobot is a bot that generates motivation poster quotes | 18:20 |
| clarkb | you need the fungi version of that stamping out tshirts then you can retire | 18:20 |
| anteaya | sounds awesome | 18:21 |
| *** jamesmcarthur has quit IRC | 18:21 | |
| *** samueldmq has joined #openstack-infra | 18:25 | |
| *** jamesmcarthur has joined #openstack-infra | 18:31 | |
| *** deray has quit IRC | 18:33 | |
| *** yamamoto has joined #openstack-infra | 18:37 | |
| *** ricolin has quit IRC | 18:38 | |
| *** yamamoto has quit IRC | 18:45 | |
| *** e0ne has joined #openstack-infra | 18:48 | |
| *** igordc has joined #openstack-infra | 18:50 | |
| *** nicolasbock has joined #openstack-infra | 18:51 | |
| openstackgerrit | Tobias Henkel proposed openstack-infra/zuul master: Remove custom key handler from xterm https://review.openstack.org/649694 | 18:53 |
| *** sshnaidm is now known as sshnaidm|off | 19:00 | |
| *** raissa has joined #openstack-infra | 19:02 | |
| *** tbachman has quit IRC | 19:08 | |
| *** tbachman has joined #openstack-infra | 19:10 | |
| *** wolverineav has quit IRC | 19:10 | |
| *** wolverineav has joined #openstack-infra | 19:10 | |
| *** wolverineav has quit IRC | 19:15 | |
| *** ijw has quit IRC | 19:20 | |
| *** rkukura has quit IRC | 19:21 | |
| *** e0ne has quit IRC | 19:30 | |
| *** sshnaidm_ has joined #openstack-infra | 19:36 | |
| *** sshnaidm|off has quit IRC | 19:36 | |
| slaweq | clarkb: hi | 19:37 |
| slaweq | clarkb: frickler hold for me nodes 104.130.69.165, 104.130.69.106 and 104.130.69.64 today | 19:37 |
| *** eharney has quit IRC | 19:37 | |
| slaweq | as he is probably not available now, You can clean them | 19:37 |
| slaweq | clarkb: frickler thx for help | 19:37 |
| clarkb | slaweq: thanks for letting us know. I'll get those cleaned up shortly | 19:37 |
| slaweq | Thank You! | 19:38 |
| *** krtaylor has joined #openstack-infra | 19:38 | |
| *** rkukura has joined #openstack-infra | 19:43 | |
| *** tosky has quit IRC | 19:44 | |
| openstackgerrit | James E. Blair proposed opendev/base-jobs master: Actually upload to pypi in the python release job https://review.openstack.org/649712 | 19:49 |
| openstackgerrit | Merged openstack-infra/project-config master: Add whitebox-tempest-plugin project https://review.openstack.org/649425 | 19:55 |
| *** jamesmcarthur has quit IRC | 19:55 | |
| *** wolverineav has joined #openstack-infra | 19:58 | |
| *** raissa has quit IRC | 19:58 | |
| *** mriedem has quit IRC | 20:01 | |
| corvus | fungi: mind pushing https://review.openstack.org/649712 through when you have a sec? | 20:02 |
| *** mriedem has joined #openstack-infra | 20:06 | |
| *** bobh has joined #openstack-infra | 20:08 | |
| *** mrhillsman is now known as mrhillsman_bbiab | 20:11 | |
| *** igordc has quit IRC | 20:18 | |
| fungi | will do. just gave up waiting on the islands to reconnect to the 'net and pulled out my travel cell modem | 20:18 |
| anteaya | fungi are you getting wind? | 20:20 |
| anteaya | wind knocked a tree over at my place | 20:20 |
| fungi | nope, all the wind from the nor'easter ended overnight | 20:21 |
| anteaya | yay, not due to wind for you then | 20:21 |
| fungi | now it's pleasant and sunny out and the internet decided it was a good day to go surfin' | 20:21 |
| anteaya | well I don't blame it | 20:21 |
| anteaya | pleasant and sunny sounds great to me | 20:21 |
| artom | Should I be worried about the infra-prod-zuul_reconfigure failure on https://review.openstack.org/#/c/649425/? | 20:23 |
| *** kgiusti has quit IRC | 20:23 | |
| clarkb | artom: no | 20:24 |
| clarkb | artom: that is an in progress set of hcnages and odesn't work yet. The cron job shoudl pick things up | 20:24 |
| artom | clarkb, ack, thanks :) | 20:25 |
| Shrews | mordred: when you not in the air and back in front of a computer, i'm seeing some weirdness from openstacksdk on nb03 (not nb01 or nb02 though) | 20:29 |
| *** whoami-rajat has quit IRC | 20:29 | |
| Shrews | mordred: mostly around cert failures for linaro | 20:29 |
| ianw | Shrews: we have a fake cert there | 20:30 |
| Shrews | hrm | 20:31 |
| openstackgerrit | Merged opendev/base-jobs master: Actually upload to pypi in the python release job https://review.openstack.org/649712 | 20:31 |
| ianw | Shrews: it was due to it originally being in .cn and the only explanation we had was a weird transparent proxy; switching to ssl fixed things. however, it is now running in the lon1 cloud | 20:31 |
| Shrews | mordred: fyi ^^^. thx ianw | 20:31 |
| ianw | and with LE work, we should "soon" :) be able to get certs (and i guess, switch them to .opendev names) | 20:31 |
| *** bgmccollum has joined #openstack-infra | 20:32 | |
| *** jamesmcarthur has joined #openstack-infra | 20:33 | |
| Shrews | this is probably unrelated to the release of openstacksdk. looks like we're still running 0.23.0 there (according to pip3 freeze) | 20:35 |
| Shrews | mordred: ianw: ok, yeah. this has been going on for a while according to logs | 20:36 |
| *** gfidente|afk has quit IRC | 20:37 | |
| ianw | Shrews: sorry i'm still not caffeinated; what is going on? | 20:37 |
| Shrews | i guess we haven't been uploading images to linaro for a bit. not sure how to correct it | 20:37 |
| *** bgmccollum has quit IRC | 20:38 | |
| Shrews | ianw: i restarted the builders today for the image leak fix. was just monitoring the logs and noticed this (we also had an openstacksdk release recently too) | 20:38 |
| *** bgmccollum has joined #openstack-infra | 20:39 | |
| Shrews | but doesn't look like we have the latest sdk there, so ruling that one out | 20:39 |
| ianw | Shrews: hrm, so the daily builds have been ok, but not the uploads huh? | 20:39 |
| *** jamesmcarthur has quit IRC | 20:39 | |
| Shrews | ianw: looks that way from the logs | 20:39 |
| *** jamesmcarthur has joined #openstack-infra | 20:41 | |
| Shrews | ianw: also, after much more caffeine, your input has been requested on https://review.openstack.org/640643 :) | 20:41 |
| mordred | Shrews, ianw we should be able to handle fake certs either by putting the ca/cert info into clouds.yaml or putting insecure: true | 20:43 |
| mordred | if needed | 20:43 |
| mordred | if we're doing that and it's still complaining, we should definitely make sure there's not an sdk bug | 20:44 |
| *** rcernin has joined #openstack-infra | 20:44 | |
| ianw | oh these were for http only though; the linaro cert is ok, and we don't do tls with zk so i think we're ok | 20:46 |
| *** artom has quit IRC | 20:47 | |
| Shrews | i don't see the 'insecure' option in clouds.yaml on nb03 or a cert. not sure if something changed recently there or not | 20:48 |
| *** wolverineav has quit IRC | 20:49 | |
| clarkb | the nb03 cert was for the webserver it shouldn't affect nodepool's builder | 20:49 |
| clarkb | those two things don't communicate | 20:49 |
| *** trown is now known as trown|outtypewww | 20:52 | |
| * Shrews needs to go pick up his jeep before the shop closes | 20:53 | |
| *** spsurya has quit IRC | 20:59 | |
| *** igordc has joined #openstack-infra | 20:59 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/zuul-website master: Add note to community page about code of conduct https://review.openstack.org/649730 | 21:04 |
| *** harlowja has quit IRC | 21:06 | |
| *** pcaruana has quit IRC | 21:06 | |
| *** owalsh has quit IRC | 21:07 | |
| openstackgerrit | Merged openstack-infra/zuul-website master: Slide presentation for Zuul's OIP Confirmation https://review.openstack.org/649356 | 21:08 |
| openstackgerrit | Merged openstack-infra/zuul-website master: Add note to community page about code of conduct https://review.openstack.org/649730 | 21:12 |
| *** owalsh has joined #openstack-infra | 21:16 | |
| *** bobh has quit IRC | 21:17 | |
| *** harlowja has joined #openstack-infra | 21:19 | |
| *** eharney has joined #openstack-infra | 21:21 | |
| zigo | ianw: I was thinking, would it be ok if I was to build the latest debootstrap from Buster in Bionic ? | 21:25 |
| zigo | clarkb: Your thoughts? | 21:27 |
| ianw | zigo: yeah, i mean for testing i just cloned from salsa and dpkg-buildpackaged and it was fine; it's not dependency heavy | 21:27 |
| clarkb | zigo: ianw I think I am missing some context, is bionic debootstrap unable to bootstrap a buster image? | 21:28 |
| zigo | ianw: So, can I just build it in sbuild, and then we get it to the Infra's PPA ? | 21:28 |
| fungi | clarkb: yeah, it'd just outdated basically | 21:28 |
| fungi | er, it's | 21:28 |
| zigo | clarkb: Right, due to a bug fixed in Debian but not backported to Ubuntu, basically... | 21:28 |
| clarkb | I see. I personally prefer to avoid building packages ourselves though we do this for the vhd image conversion tool. PPAs also don't work quite right in our existing tooling with respect to package updates | 21:29 |
| ianw | zigo: yeah, it's not hard to get into the ppa; we just have to carry the updated package though in nodepool builder puppet, the nodepool build jobs and dib | 21:29 |
| ianw | all those internal touch points for us are the annoying bit; so fixing upstream if we can is preferred ... | 21:30 |
| clarkb | we have to manually update PPA'd packages or change our unattended upgrade policy | 21:30 |
| ianw | but yeah, i can also understand that in these LTS releases putting in changes that come with changelogs "reopen <list of bugs>" is probably not that great | 21:30 |
| zigo | Right, though I don't have any rights to upload anything to Ubuntu ... | 21:32 |
| zigo | Ok, package built, now what? :) | 21:32 |
| ianw | well should we ask ubuntu about updating before we go hacking it in locally? | 21:34 |
| clarkb | getting the fix into ubuntu is definitely the best option | 21:34 |
| clarkb | assuming it can be done | 21:34 |
| zigo | ianw: It's going to take ages ... | 21:34 |
| zigo | If they even accept. | 21:34 |
| zigo | http://sid.gplhost.com/debootstrap-bionic/ <--- I uploaded it here. | 21:35 |
| ianw | zigo: well at any rate, i'd like to see buster booting in https://review.openstack.org/#/c/649214/ before we add it to the production builders | 21:36 |
| *** slaweq has quit IRC | 21:38 | |
| zigo | ianw: Sorry, I'm not following... what can I do to get things to a further step? :) | 21:39 |
| ianw | zigo: that change will test building a buster image, uploading it to a cloud, booting it with glean, talking to it and growing the root disk; so basically if that doesn't work, it's not going to work in production anyway | 21:40 |
| clarkb | zigo: ianw: can probably build debootstrap or install it from the url above in the job as a confirmation that fixes the entire process? | 21:40 |
| mordred | clarkb: jamespage was offering earlier to help us get the fix in to ubuntu | 21:41 |
| ianw | clarkb: sure, as initial hack we can pull it in from anywhere | 21:41 |
| ianw | but then obviously that needs to be rolled out to production hosts before the image will build | 21:41 |
| clarkb | ya that way we can see if there are any other issues to correct | 21:41 |
| clarkb | seems like a good next step | 21:41 |
| clarkb | and can run concurrently with fixing ubuntu | 21:41 |
| ianw | i can make a ppa of it under https://launchpad.net/~openstack-ci-core | 21:42 |
| *** rcernin has quit IRC | 21:42 | |
| zigo | Also, if there are any issues to fix in Buster itself, now is a good time to get these fixes in (as it's in freeze, we can still fix stuff...). | 21:43 |
| zigo | ianw: That's be great! | 21:43 |
| zigo | Thanks for all the help. | 21:43 |
| ianw | i've uploaded to https://launchpad.net/~openstack-ci-core/+archive/ubuntu/debootstrap and i guess it's processing | 21:53 |
| *** slaweq has joined #openstack-infra | 21:55 | |
| *** slaweq has quit IRC | 22:00 | |
| ianw | ... so back to nb03 for a bit ... | 22:03 |
| ianw | ssl.SSLError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed (_ssl.c:645) ... so this *is* ssl connection to the linaro api | 22:04 |
| clarkb | did the cert expire maybe? | 22:05 |
| clarkb | or did they not have a cert signed by a CA we trust? | 22:05 |
| ianw | it *was* working at one point ... | 22:06 |
| *** wolverineav has joined #openstack-infra | 22:06 | |
| *** rlandy|ruck is now known as rlandy | 22:08 | |
| *** weshay is now known as weshay|ruck | 22:08 | |
| *** rlandy is now known as rlandy|bbl | 22:09 | |
| ianw | ok, it fails to chat on bridge.o.o too; i wish the error gave you a clue as to what was wrong :/ | 22:10 |
| *** kjackal has quit IRC | 22:11 | |
| clarkb | ianw: openssl s_client is good for checking that stuff | 22:11 |
| *** wolverineav has quit IRC | 22:12 | |
| ianw | Verify return code: 10 (certificate has expired) | 22:13 |
| ianw | Mar 18 20:33:33 2019 GMT | 22:13 |
| ianw | it's actually a LE cert | 22:13 |
| *** jamesmcarthur has quit IRC | 22:14 | |
| ianw | i guess we can either set it to be ignored, or disable the cn1 cloud | 22:15 |
| clarkb | oh is it cn1? | 22:16 |
| clarkb | ianw: niedbalski pinged me when I was out last week and I mentioend that you could help with decommissioning cn1 | 22:16 |
| clarkb | cn1 is being turned off in favor of lon1 aiui | 22:16 |
| clarkb | so I think maybe this is expected? | 22:16 |
| ianw | or at least keys not being renewed. well let's remove it then. i think lon1 is fine | 22:24 |
| *** artom has joined #openstack-infra | 22:27 | |
| clarkb | alright I've been spinning my wheels for most of the day since sorting out the mailman thing. I think I'm going to pop out a bit early now that the zuul stuff I wanted to make sure was set is done. | 22:28 |
| clarkb | corvus: if you can weigh in on the dmarc/dkim stuff before you take your vacation that would be great. I'd like to try scheduling the server upgrade around the opendev work if possible and want to be prepared for dmarc changes when I do so | 22:29 |
| *** jamesmcarthur has joined #openstack-infra | 22:32 | |
| *** jamesmcarthur has quit IRC | 22:32 | |
| *** bobh has joined #openstack-infra | 22:33 | |
| ianw | ++ i need to run an errand to get a cat6 inline coupler ... bib | 22:34 |
| *** nicolasbock has quit IRC | 22:34 | |
| *** yamamoto has joined #openstack-infra | 22:43 | |
| *** yamamoto has quit IRC | 22:47 | |
| *** bobh has quit IRC | 22:47 | |
| *** yamamoto has joined #openstack-infra | 23:00 | |
| *** lathiat_ is now known as lathiat | 23:02 | |
| *** wolverineav has joined #openstack-infra | 23:02 | |
| *** tkajinam has joined #openstack-infra | 23:04 | |
| *** slaweq has joined #openstack-infra | 23:06 | |
| *** wolverineav has quit IRC | 23:06 | |
| *** slaweq has quit IRC | 23:10 | |
| openstackgerrit | Merged openstack-infra/zuul master: Fail jobs when requirements not met https://review.openstack.org/644392 | 23:31 |
| openstackgerrit | Ian Wienand proposed openstack-infra/nodepool master: Add Debian Buster boot tests https://review.openstack.org/649214 | 23:49 |
| *** hwoarang has quit IRC | 23:50 | |
| *** hwoarang has joined #openstack-infra | 23:51 | |
| *** lseki has quit IRC | 23:53 | |
| *** wolverineav has joined #openstack-infra | 23:56 | |
| *** tbachman has quit IRC | 23:58 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!