| *** mattw4 has joined #openstack-infra | 00:02 | |
| *** aaronsheffield has quit IRC | 00:06 | |
| *** gfhellma_ has joined #openstack-infra | 00:07 | |
| *** gfhellma_ has quit IRC | 00:09 | |
| *** weifan has quit IRC | 00:09 | |
| *** slaweq has joined #openstack-infra | 00:11 | |
| *** slaweq has quit IRC | 00:16 | |
| *** diablo_rojo has joined #openstack-infra | 00:21 | |
| *** gregoryo has joined #openstack-infra | 00:25 | |
| *** mattw4 has quit IRC | 00:32 | |
| *** gyee has quit IRC | 00:32 | |
| ianw | fungi: mind a poke at https://review.opendev.org/#/c/663804 ... fairly simple but will just mean a few rebases | 00:34 |
|---|---|---|
| *** tosky has quit IRC | 00:36 | |
| fungi | lookin' | 00:36 |
| fungi | looks like that depends on the bup playbook change | 00:38 |
| ianw | oh i thought i unstacked it | 00:39 |
| *** Goneri has quit IRC | 00:39 | |
| fungi | i may have just not refreshed it in gertty for some reason | 00:39 |
| fungi | nah, webui says it's still depending too | 00:42 |
| ianw | yeah ... ok i'll get all this back in order | 00:43 |
| mnaser | hmm | 00:46 |
| mnaser | https://review.opendev.org/#/c/665917/ | 00:46 |
| mnaser | how can we solve something like that? | 00:46 |
| mnaser | trying to rotate a secret which also exists in other branches | 00:47 |
| fungi | does it need to exist in the other branches? | 00:47 |
| fungi | this may be more of a #zuul topic though | 00:48 |
| mnaser | sure, i can take it there | 00:48 |
| fungi | just thinking if it needs brainstorming about possible behavior changes | 00:48 |
| fungi | the obvious solution is probably to just remove the secret from all the stable branches. i'm not sure branched secrets as a workflow was considered | 00:49 |
| fungi | i mean, obviously thought was put into catching when they diverge | 00:49 |
| fungi | but as far as how to replace them other than circuitous removal and readdition changes... | 00:50 |
| *** diablo_rojo has quit IRC | 00:51 | |
| *** mriedem_away has quit IRC | 01:01 | |
| *** diablo_rojo has joined #openstack-infra | 01:06 | |
| *** hwoarang has quit IRC | 01:10 | |
| *** hwoarang has joined #openstack-infra | 01:11 | |
| *** igordc has quit IRC | 01:16 | |
| openstackgerrit | Ian Wienand proposed opendev/system-config master: Ansible roles for backup https://review.opendev.org/662657 | 01:53 |
| ianw | fungi: ^ i stacked that on your change, although i guess it removes it :) | 01:54 |
| *** apetrich has quit IRC | 01:57 | |
| fungi | meh, i could also have simply abandoned my change | 01:58 |
| *** hongbin has joined #openstack-infra | 01:58 | |
| fungi | i didn't realize at the time that was also automating it for non-pure-ansible deployments | 01:58 |
| ianw | fungi: yep so my rough plan (pending reviews :) is to bring up a new backup server and then have all the hosts start backing up to that, then go through and remove the puppet setup from those hosts with it | 02:00 |
| ianw | they should co-exist | 02:00 |
| fungi | neat | 02:04 |
| fungi | that's a good way to transition | 02:04 |
| *** whoami-rajat has joined #openstack-infra | 02:08 | |
| *** tinwood has quit IRC | 02:08 | |
| *** tinwood has joined #openstack-infra | 02:10 | |
| *** slaweq has joined #openstack-infra | 02:11 | |
| ianw | fungi: is there a way to re-establish the console stream that you know of? | 02:14 |
| ianw | we get a ton of "waiting on logger" in the output, i figured this was a cost-of-doing business with reboot but had it on todo list to look into | 02:15 |
| ianw | http://logs.openstack.org/57/665057/24/check/system-config-run-mirror/3a3daca/job-output.txt.gz#_2019-06-18_00_22_02_191698 | 02:15 |
| *** slaweq has quit IRC | 02:16 | |
| auristor | ianw: a clarification of what dhowells said about reval vs inval kafs statistics. any extension of a directory on the server involves a change to the directory which will be reflected in the directory version number changing. | 02:40 |
| auristor | if the kafs client has an unexpired callback promise outstanding when the change occurs, the fileserver will notify kafs and the directory will be invalidated. | 02:41 |
| auristor | if the kafs client does not have an outstanding callback promise then the next attempt to use the directory will trigger a revalidation at which point it will discover that the directory version has changed and the contents of the new directory version will be fetched. | 02:42 |
| *** diablo_rojo has quit IRC | 02:49 | |
| *** ricolin has joined #openstack-infra | 02:55 | |
| *** markvoelker has joined #openstack-infra | 03:00 | |
| *** mattw4 has joined #openstack-infra | 03:00 | |
| *** markvoelker has quit IRC | 03:06 | |
| *** weifan has joined #openstack-infra | 03:08 | |
| *** slaweq has joined #openstack-infra | 03:11 | |
| *** weifan has quit IRC | 03:12 | |
| rajinir | mmedvede the ciwatch is not picking up the new patches, stuck on June14 http://ciwatch.mmedvede.net/project?project=ironic&time=48+hours | 03:13 |
| *** bhavikdbavishi has joined #openstack-infra | 03:13 | |
| *** slaweq has quit IRC | 03:15 | |
| *** bhavikdbavishi1 has joined #openstack-infra | 03:18 | |
| *** bhavikdbavishi has quit IRC | 03:20 | |
| *** bhavikdbavishi1 is now known as bhavikdbavishi | 03:20 | |
| *** ykarel|away has joined #openstack-infra | 03:21 | |
| *** psachin has joined #openstack-infra | 03:32 | |
| *** hwoarang has quit IRC | 03:50 | |
| *** hwoarang has joined #openstack-infra | 03:51 | |
| *** psachin has quit IRC | 04:01 | |
| *** markvoelker has joined #openstack-infra | 04:01 | |
| *** ramishra has joined #openstack-infra | 04:03 | |
| *** psachin has joined #openstack-infra | 04:03 | |
| *** markvoelker has quit IRC | 04:06 | |
| *** bhavikdbavishi has quit IRC | 04:24 | |
| *** hongbin has quit IRC | 04:25 | |
| *** hwoarang has quit IRC | 04:25 | |
| *** hwoarang has joined #openstack-infra | 04:25 | |
| *** raukadah is now known as chandankumar | 04:31 | |
| *** udesale has joined #openstack-infra | 04:31 | |
| *** bhavikdbavishi has joined #openstack-infra | 04:37 | |
| *** kei-ichi has joined #openstack-infra | 04:49 | |
| openstackgerrit | Tobias Henkel proposed zuul/zuul master: Evaluate CODEOWNERS settings during canMerge check https://review.opendev.org/644557 | 04:54 |
| openstackgerrit | Tobias Henkel proposed zuul/zuul master: Optionally support mitogen for job execution https://review.opendev.org/657024 | 05:07 |
| *** iokiwi has quit IRC | 05:11 | |
| *** slaweq has joined #openstack-infra | 05:11 | |
| *** iokiwi has joined #openstack-infra | 05:11 | |
| *** ykarel|away is now known as ykarel | 05:13 | |
| *** e0ne has joined #openstack-infra | 05:15 | |
| *** slaweq has quit IRC | 05:16 | |
| *** weifan has joined #openstack-infra | 05:17 | |
| *** e0ne has quit IRC | 05:20 | |
| *** weifan has quit IRC | 05:22 | |
| *** dklyle_ has joined #openstack-infra | 05:24 | |
| *** yamamoto_ has joined #openstack-infra | 05:24 | |
| *** kjackal has joined #openstack-infra | 05:25 | |
| *** david-lyle has quit IRC | 05:27 | |
| *** yamamoto has quit IRC | 05:27 | |
| *** freerunner has quit IRC | 05:27 | |
| *** freerunner has joined #openstack-infra | 05:28 | |
| *** _Cyclone_ has quit IRC | 05:30 | |
| *** irclogbot_3 has quit IRC | 05:30 | |
| *** irclogbot_3 has joined #openstack-infra | 05:31 | |
| *** mgoddard has quit IRC | 05:31 | |
| *** _Cyclone_ has joined #openstack-infra | 05:33 | |
| *** mgoddard has joined #openstack-infra | 05:33 | |
| *** ykarel is now known as ykarel|away | 05:40 | |
| *** ykarel|away has quit IRC | 05:48 | |
| *** ykarel|away has joined #openstack-infra | 06:02 | |
| *** tkajinam has quit IRC | 06:03 | |
| *** zhangfei has joined #openstack-infra | 06:04 | |
| *** ykarel|away is now known as ykarel | 06:05 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/project-config master: Normalize projects.yaml https://review.opendev.org/665869 | 06:07 |
| *** slaweq has joined #openstack-infra | 06:11 | |
| *** spsurya has joined #openstack-infra | 06:16 | |
| *** ricolin has quit IRC | 06:18 | |
| *** ricolin has joined #openstack-infra | 06:19 | |
| *** dpawlik has joined #openstack-infra | 06:22 | |
| *** rajinir has quit IRC | 06:22 | |
| *** lpetrut has joined #openstack-infra | 06:23 | |
| lpetrut | Hi, does anyone know if the "post" zuul jobs get logged anywhere? I'm particularly interested in the github mirror job, which seems to be a hit and miss | 06:26 |
| *** threestrands has joined #openstack-infra | 06:27 | |
| *** apetrich has joined #openstack-infra | 06:30 | |
| *** kopecmartin|off is now known as kopecmartin | 06:32 | |
| *** virendra has joined #openstack-infra | 06:35 | |
| ianw | lpetrut: yes they do | 06:35 |
| ianw | you should be able to get to them via http://zuul.openstack.org/builds | 06:35 |
| virendra | Hi, is there any issue with CI-WATCH "http://ciwatch.mmedvede.net/project?project=cinder&time=24+hours" ?? | 06:37 |
| virendra | unable to see latest patchset result on it. | 06:37 |
| lpetrut | ianw: that's great, thanks! from what I can tell, the post jobs were not triggered for one of the commits | 06:41 |
| lpetrut | http://zuul.openstack.org/builds?project=x%2Fcloudbase-init | 06:41 |
| lpetrut | I'd expect a couple of post jobs for 597324,16 | 06:41 |
| ianw | lpetrut: hrm, that seemed to merge a few days ago ... that's like a million years in CI years :) does it still happen? | 06:46 |
| lpetrut | not sure, we've recently set up the merge jobs and there aren't that many patches merging every day. we'll probably merge a few more patches today and check again | 06:47 |
| lpetrut | if that's still the case, is there any other particular place to check? | 06:48 |
| virendra | I have seen jobs are getting passed in CI but it is not updating in CI watch, niether latest patchset entry getting added to it. | 06:51 |
| *** rcernin has quit IRC | 06:51 | |
| lpetrut | good to know | 06:52 |
| lpetrut | probably a long shot, but I'm wondering if something like this might happen for older patches, which were submitted before the zuul mirror jobs were added | 06:52 |
| virendra | Normally atleast one or two patches getting added to it, but past 2 days i didn't see it updating. can't see any jobs is 48 hours section | 06:54 |
| lpetrut | which could make sense, considering that those zuul jobs are defined within the repo. perhaps there's a missing rebase. | 06:54 |
| virendra | is it showing same behaviour to all ? | 06:54 |
| *** pgaxatte has joined #openstack-infra | 06:55 | |
| lpetrut | not sure yet, I was told about it yesterday evening, after which another patch has merged, triggering a sync. I'll check again today | 06:55 |
| ianw | yeah, double check. also if you can hang around till us morning time, more zuul experts will appear :) | 06:58 |
| ykarel | lpetrut, so the patch u referenced was too old without a rebase, i think because of that the job that was added recently didn't ran | 06:59 |
| ykarel | i see 4 occurances of the job http://zuul.openstack.org/builds?project=x%2Fcloudbase-init&pipeline=post | 06:59 |
| lpetrut | yep, my thoughts as well. I guess we should rebase older patches before merging them, that should do it | 06:59 |
| ykarel | and 7 patches merged | 07:00 |
| ykarel | yes | 07:00 |
| lpetrut | sounds good, thanks for the heads up! | 07:00 |
| *** rpittau|afk is now known as rpittau | 07:02 | |
| *** igordc has joined #openstack-infra | 07:05 | |
| *** tkajinam has joined #openstack-infra | 07:05 | |
| *** jtomasek has joined #openstack-infra | 07:06 | |
| *** igordc has quit IRC | 07:10 | |
| *** tosky has joined #openstack-infra | 07:15 | |
| *** ralonsoh has joined #openstack-infra | 07:16 | |
| lpetrut | fwiw, I'm wondering if it would make sense for the zuul jobs to automatically do a rebase before using the .zuul.yaml file that's part of the repo. this might cause some raised eyebrows in other cases as well :) | 07:20 |
| *** tesseract has joined #openstack-infra | 07:20 | |
| *** iurygregory has joined #openstack-infra | 07:24 | |
| lpetrut | at a second thought, that's probably by design though, avoiding running unmerged/unapproved jobs | 07:25 |
| *** ccamacho has quit IRC | 07:27 | |
| *** ccamacho has joined #openstack-infra | 07:27 | |
| *** iurygregory has quit IRC | 07:35 | |
| *** virendra has quit IRC | 07:40 | |
| *** iurygregory has joined #openstack-infra | 07:40 | |
| *** iokiwi has quit IRC | 07:41 | |
| *** iokiwi has joined #openstack-infra | 07:41 | |
| *** jpena|off is now known as jpena | 07:43 | |
| openstackgerrit | Merged openstack/diskimage-builder master: Sync Sphinx requirement https://review.opendev.org/666023 | 07:48 |
| openstackgerrit | jacky06 proposed openstack/diskimage-builder master: Update hacking version to latest https://review.opendev.org/628466 | 07:52 |
| *** pkopec has joined #openstack-infra | 07:53 | |
| *** yamamoto_ has quit IRC | 07:54 | |
| *** dtantsur|afk is now known as dtantsur | 07:56 | |
| *** ykarel is now known as ykarel|lunch | 07:57 | |
| *** trident has quit IRC | 07:57 | |
| *** jpich has joined #openstack-infra | 07:59 | |
| *** threestrands has quit IRC | 07:59 | |
| *** trident has joined #openstack-infra | 08:01 | |
| *** Adri2000 has quit IRC | 08:01 | |
| *** Adri2000 has joined #openstack-infra | 08:03 | |
| *** dchen has quit IRC | 08:05 | |
| *** tkajinam has quit IRC | 08:06 | |
| *** ociuhandu has joined #openstack-infra | 08:15 | |
| *** yamamoto has joined #openstack-infra | 08:18 | |
| openstackgerrit | jacky06 proposed openstack/diskimage-builder master: Update hacking version to latest https://review.opendev.org/628466 | 08:18 |
| *** gregoryo has quit IRC | 08:19 | |
| zbr|ruck | pabelanger: hi! do you have some news regarding zuul/molecule? | 08:25 |
| *** pcaruana has quit IRC | 08:27 | |
| *** yboaron_ has joined #openstack-infra | 08:27 | |
| *** xek has joined #openstack-infra | 08:27 | |
| *** lucasagomes has joined #openstack-infra | 08:27 | |
| *** yamamoto has quit IRC | 08:29 | |
| *** yamamoto has joined #openstack-infra | 08:32 | |
| *** yamamoto has quit IRC | 08:32 | |
| *** e0ne has joined #openstack-infra | 08:34 | |
| *** dikonoor has joined #openstack-infra | 08:34 | |
| *** lpetrut has quit IRC | 08:39 | |
| *** imacdonn has quit IRC | 08:41 | |
| *** imacdonn has joined #openstack-infra | 08:41 | |
| *** pcaruana has joined #openstack-infra | 08:45 | |
| *** arxcruz is now known as arxcruz|brb | 08:47 | |
| *** markvoelker has joined #openstack-infra | 08:53 | |
| *** markvoelker has quit IRC | 08:58 | |
| *** mattw4 has quit IRC | 08:59 | |
| yoctozepto | mirror.iad.rax.opendev.org is down? | 09:00 |
| yoctozepto | failed several jobs | 09:00 |
| yoctozepto | looks like nfs ganesha is broken anyway in Ubuntu http://logs.openstack.org/30/666030/1/check/kolla-ansible-ubuntu-source-ceph/b705211/primary/logs/kolla/ceph/ceph-nfs.txt.gz | 09:07 |
| *** kaisers1 has quit IRC | 09:13 | |
| yoctozepto | guys, I found something odd | 09:16 |
| yoctozepto | do we use cron.json.j2 at all | 09:16 |
| *** kaisers has joined #openstack-infra | 09:16 | |
| yoctozepto | because later we seem to have an analogous task in ansible itself | 09:19 |
| yoctozepto | though they differ in the number of services added | 09:19 |
| *** ykarel|lunch is now known as ykarel | 09:19 | |
| *** Lucas_Gray has joined #openstack-infra | 09:26 | |
| yoctozepto | ok, I know now | 09:26 |
| yoctozepto | src/dest confused me | 09:26 |
| yoctozepto | though still they should not differ in the amount of services there | 09:26 |
| slaweq | hi infra-root | 09:29 |
| slaweq | infra-root: can You maybe hold for me nodes on which job networking-ovn-tempest-slow from patch https://review.opendev.org/#/c/658326/ is running? | 09:30 |
| slaweq | I'm still stugling with what is missing there to make it working on multinode job and would be very useful to log into nodes and check there :) | 09:30 |
| slaweq | thx in advance | 09:30 |
| yoctozepto | hey infra, sorry for the lines from 11:16 till 11:26 (+02:00) | 09:33 |
| yoctozepto | forgot to change channel ;-) | 09:33 |
| *** gfidente has joined #openstack-infra | 09:33 | |
| yoctozepto | (even from 11:07) | 09:34 |
| *** igordc has joined #openstack-infra | 09:37 | |
| *** derekh has joined #openstack-infra | 09:39 | |
| *** yolanda has quit IRC | 09:41 | |
| *** janki has joined #openstack-infra | 09:43 | |
| *** dikonoor has quit IRC | 09:47 | |
| *** tosky has quit IRC | 09:47 | |
| *** tosky has joined #openstack-infra | 09:48 | |
| *** yamamoto has joined #openstack-infra | 09:48 | |
| *** lpetrut has joined #openstack-infra | 09:49 | |
| dtantsur | hi folks! do we have beginner-friendly docs on various zuul queues (post vs check), etc? | 09:51 |
| *** markvoelker has joined #openstack-infra | 09:53 | |
| *** yamamoto has quit IRC | 09:57 | |
| *** markvoelker has quit IRC | 09:58 | |
| *** electrofelix has joined #openstack-infra | 10:03 | |
| *** electrofelix has quit IRC | 10:03 | |
| *** electrofelix has joined #openstack-infra | 10:09 | |
| openstackgerrit | Matthieu Huin proposed zuul/zuul master: Dequeue a change by its buildset UUID https://review.opendev.org/666258 | 10:12 |
| *** lpetrut has quit IRC | 10:13 | |
| *** rcernin has joined #openstack-infra | 10:18 | |
| openstackgerrit | Matthieu Huin proposed zuul/zuul master: Dequeue a change by its buildset UUID https://review.opendev.org/666258 | 10:21 |
| *** sshnaidm is now known as sshnaidm|afk | 10:24 | |
| *** yamamoto has joined #openstack-infra | 10:29 | |
| *** dave-mccowan has joined #openstack-infra | 10:31 | |
| *** lucasagomes has quit IRC | 10:37 | |
| *** lucasagomes has joined #openstack-infra | 10:41 | |
| yoctozepto | fungi, ianw: mirror.iad.rax.opendev.org is down, pinging you as it breaks lots of our tasks | 10:42 |
| *** Lucas_Gray has quit IRC | 10:45 | |
| *** priteau has joined #openstack-infra | 10:46 | |
| *** lpetrut has joined #openstack-infra | 10:51 | |
| *** markvoelker has joined #openstack-infra | 10:54 | |
| openstackgerrit | Tobias Urdin proposed opendev/system-config master: Mirror Ceph Nautilus for Debian based https://review.opendev.org/666263 | 10:58 |
| evrardjp | I just thought of something jhesketh corvus for the date_time. Right now it's nice to expose that fact for executors. But for the other nodes, they won't have the same fact. So it now involves a long series of | default( and is less user friendly... We might need to rethink userfriendliness there. | 10:59 |
| *** markvoelker has quit IRC | 10:59 | |
| jhesketh | evrardjp: yeah, that's not a bad point.. I'm happy to just call it ansible_date_time | 11:00 |
| evrardjp | jhesketh: I will make my patch to make that ansible_date_time, and we can vote. | 11:01 |
| jhesketh | ack | 11:01 |
| openstackgerrit | Tobias Urdin proposed opendev/system-config master: Mirror Ceph Nautilus for Debian based https://review.opendev.org/666263 | 11:03 |
| openstackgerrit | Matthieu Huin proposed zuul/zuul master: Dequeue a change by its buildset UUID https://review.opendev.org/666258 | 11:06 |
| *** zhangfei has quit IRC | 11:13 | |
| *** yolanda has joined #openstack-infra | 11:17 | |
| *** jpena is now known as jpena|lunch | 11:19 | |
| openstackgerrit | Jean-Philippe Evrard proposed zuul/zuul master: Expose ansible_date_time instead of date_time https://review.opendev.org/666268 | 11:25 |
| evrardjp | jhesketh: ^ | 11:25 |
| openstackgerrit | Jean-Philippe Evrard proposed zuul/zuul master: Expose ansible_date_time instead of date_time https://review.opendev.org/666268 | 11:30 |
| *** ykarel is now known as ykarel|afk | 11:33 | |
| evrardjp | jhesketh: commented because I am not sure to understand what you meant | 11:34 |
| evrardjp | I thought it would be better to discuss here than in the patch if you prefer | 11:34 |
| *** ykarel_ has joined #openstack-infra | 11:34 | |
| *** ykarel_ has quit IRC | 11:36 | |
| *** ykarel|afk has quit IRC | 11:37 | |
| jhesketh | evrardjp: I replied in the patch so we'd have the discussion for others to see | 11:37 |
| evrardjp | jhesketh: cool | 11:42 |
| evrardjp | thanks for the clarification | 11:42 |
| *** udesale has quit IRC | 11:53 | |
| *** arxcruz|brb is now known as arxcruz | 11:53 | |
| *** udesale has joined #openstack-infra | 11:53 | |
| *** rfolco has joined #openstack-infra | 11:54 | |
| *** markvoelker has joined #openstack-infra | 11:55 | |
| *** yamamoto has quit IRC | 11:57 | |
| *** rh-jelabarre has joined #openstack-infra | 11:59 | |
| *** markvoelker has quit IRC | 12:00 | |
| *** ykarel has joined #openstack-infra | 12:01 | |
| *** tdasilva has joined #openstack-infra | 12:05 | |
| *** dikonoor has joined #openstack-infra | 12:08 | |
| *** rkukura has joined #openstack-infra | 12:12 | |
| *** rkukura has quit IRC | 12:13 | |
| *** rcernin has quit IRC | 12:15 | |
| openstackgerrit | Matthieu Huin proposed zuul/zuul master: web: add tenant and project scoped, JWT-protected actions https://review.opendev.org/576907 | 12:16 |
| *** Lucas_Gray has joined #openstack-infra | 12:17 | |
| openstackgerrit | Matthieu Huin proposed zuul/zuul master: Dequeue a change by its buildset UUID https://review.opendev.org/666258 | 12:18 |
| slaweq | infra-root: hi, I have another question. How we can remove (or make it up to date) github mirror of tobiko project? It's in https://github.com/openstack/tobiko and it's not in the same state as https://opendev.org/x/tobiko | 12:20 |
| *** udesale has quit IRC | 12:20 | |
| *** udesale has joined #openstack-infra | 12:21 | |
| openstackgerrit | Matthieu Huin proposed zuul/zuul master: Allow operator to generate auth tokens through the CLI https://review.opendev.org/636197 | 12:21 |
| *** dikonoor has quit IRC | 12:21 | |
| *** goldyfruit has quit IRC | 12:25 | |
| *** udesale has quit IRC | 12:25 | |
| *** udesale has joined #openstack-infra | 12:25 | |
| *** priteau has quit IRC | 12:27 | |
| *** rlandy has joined #openstack-infra | 12:27 | |
| openstackgerrit | Matthieu Huin proposed zuul/zuul master: Zuul CLI: allow access via REST https://review.opendev.org/636315 | 12:28 |
| *** liuyulong has joined #openstack-infra | 12:28 | |
| liuyulong | ralonsoh, ping | 12:28 |
| *** sshnaidm|afk is now known as sshnaidm | 12:29 | |
| *** jpena|lunch is now known as jpena | 12:29 | |
| ralonsoh | liuyulong, hi | 12:30 |
| liuyulong | ralonsoh, hi, may I ask you a question about 'updating the VLAN network segmentation_id'? | 12:31 |
| ralonsoh | liuyulong, sure | 12:31 |
| openstackgerrit | Matthieu Huin proposed zuul/zuul master: Add Authorization Rules configuration https://review.opendev.org/639855 | 12:32 |
| liuyulong | ralonsoh, when we update the network segmentation_id, we need some extra work for the port? | 12:32 |
| ralonsoh | liuyulong, you can only change the segID of a network if | 12:33 |
| liuyulong | ralonsoh, then every port belong to this network in the agent side will be updated automatically? | 12:33 |
| ralonsoh | 1) There are no ports | 12:33 |
| ralonsoh | 2) those ports belongs to OVS | 12:34 |
| liuyulong | ralonsoh, no neutron ports? | 12:34 |
| ralonsoh | liuyulong, what does it means? | 12:34 |
| ralonsoh | liuyulong, if those ports are not bound to a driver, it doesn't matter | 12:35 |
| openstackgerrit | Matthieu Huin proposed zuul/zuul master: Web: plug the authorization engine https://review.opendev.org/640884 | 12:35 |
| openstackgerrit | Matthieu Huin proposed zuul/zuul master: Zuul Web: add /api/user/authorizations endpoint https://review.opendev.org/641099 | 12:36 |
| openstackgerrit | Matthieu Huin proposed zuul/zuul master: authentication config: add optional token_expiry https://review.opendev.org/642408 | 12:36 |
| liuyulong | ralonsoh, a example may be a better way to describe, if there are compute ports in this network, the update will not be allowed? | 12:36 |
| ralonsoh | liuyulong, yes: you can update the segmentation ID with ports with VIF type in [unbound, binding_failed, OVS] | 12:37 |
| ralonsoh | liuyulong, so yes, you can do it | 12:37 |
| ralonsoh | liuyulong, there is a bug solved by slaweq | 12:38 |
| ralonsoh | https://review.opendev.org/#/q/status:open+project:openstack/neutron+branch:master+topic:bug/1832985 | 12:38 |
| liuyulong | ralonsoh, or we do not care the neutron ports. Just update network segment id, all the port settings in agent side will be re-configured properly? | 12:38 |
| liuyulong | ralonsoh, yes, VLAN only | 12:38 |
| ralonsoh | if the port is not bound, there is no reconfiguration needed | 12:39 |
| *** ricolin_phone has joined #openstack-infra | 12:39 | |
| *** eharney has quit IRC | 12:40 | |
| liuyulong | ralonsoh, I have a patch here: https://review.opendev.org/#/c/665517/, which will use the physical VLAN id as some openflow identifying match rules. | 12:40 |
| openstackgerrit | Matthieu Huin proposed zuul/zuul master: [WIP] admin REST API: zuul-web integration https://review.opendev.org/643536 | 12:41 |
| liuyulong | ralonsoh, actually we have some dvr flows also based on such physical VLAN id. | 12:41 |
| aspiers | Just me or is author: completion totally broken in our Gerrit? | 12:41 |
| *** yamamoto has joined #openstack-infra | 12:41 | |
| liuyulong | ralonsoh, so update the network segment ID, we should take care these flow or not? | 12:41 |
| ralonsoh | liuyulong, yes we should | 12:42 |
| aspiers | it expands to author:"Firstname Lastname <email@address.com>" which doesn't match anything | 12:42 |
| *** ricolin_phone has quit IRC | 12:42 | |
| aspiers | infra-root: ^^ | 12:43 |
| liuyulong | ralonsoh, https://review.opendev.org/#/c/632984/28/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py@404 | 12:43 |
| liuyulong | ralonsoh, ^ this is main function in agent side for updating network segmentation_id | 12:44 |
| ralonsoh | yes | 12:44 |
| liuyulong | ralonsoh, I do not see much work on taking care of these flows. | 12:46 |
| liuyulong | ralonsoh, let me paste some example flows | 12:46 |
| liuyulong | seems we are in the wrong channel... | 12:47 |
| liuyulong | let's move to openstack-neutron | 12:48 |
| *** dciabrin has quit IRC | 12:49 | |
| *** ekultails has joined #openstack-infra | 12:52 | |
| *** ricolin_phone has joined #openstack-infra | 12:52 | |
| fungi | ianw: you've probably gone for the day, but from what i hear we just need to make sure the console stream process is restarted after the reboot | 12:55 |
| *** markvoelker has joined #openstack-infra | 12:56 | |
| openstackgerrit | Matthieu Huin proposed zuul/zuul master: Dequeue a change by its buildset UUID https://review.opendev.org/666258 | 12:56 |
| *** aaronsheffield has joined #openstack-infra | 12:57 | |
| fungi | lpetrut: ykarel: zuul always uses the latest state of merged configuration in the repository to run jobs (excepting in the check/gate pipelines for changes which contain certain self-testing job configuration). there should be absolutely no need to rebase changes to get them to run newer jobs. what's the job which you expected to run? maybe it has a files matcher in it or something? | 12:59 |
| fungi | yoctozepto: it does appear the iad mirror was in a shutoff state again, as of 2019-06-19T08:04:17Z | 13:00 |
| fungi | i was unable to get any console output from it (though maybe ianw's netconsole caught something?) | 13:00 |
| *** markvoelker has quit IRC | 13:00 | |
| fungi | i've started it and will get the /afs mount reestablished | 13:01 |
| pabelanger | zbr|ruck: zuul/molecule? | 13:02 |
| fungi | slaweq: anything in the openstack org on github which isn't an official openstack team deliverable is in the process of getting archived. if there's a different gh org you want it mirrored into we can work with you to transfer it so that gh will set up redirects from the old url, and then you can add a zuul job to mirror updates to it as soon as they merge | 13:03 |
| *** jcoufal has joined #openstack-infra | 13:03 | |
| fungi | aspiers: which author? anything you try entering? | 13:04 |
| fungi | #status started mirror.iad.rax.opendev.org which was in a shutoff state, loaded the kafs module and mounted /afs on it | 13:05 |
| openstackstatus | fungi: unknown command | 13:05 |
| zbr|ruck | pabelanger: mostly about https://github.com/ansible/molecule/pull/1982 ? | 13:06 |
| aspiers | fungi: looks like any author - try yourself | 13:07 |
| fungi | infra-root: this time, last log entry for mirror.iad.rax.opendev.org before it went into shutoff state: Jun 19 07:50:54 mirror01 snmpd[1167]: Connection from UDP/IPv6: [2001:4800:7821:105:be76:4eff:fe04:b9a5]:48765 | 13:07 |
| aspiers | https://review.opendev.org/#/q/author:%22Jeremy+Stanley+%253Cfungi%2540yuggoth.org%253E%22 | 13:07 |
| aspiers | that search was an auto-complete of author:fungi | 13:07 |
| pabelanger | zbr|ruck: oh, you can continue in #molecule, but zuul.ansible.com is ready. It is blocked on not technical side of things, last I checked | 13:07 |
| aspiers | fungi: the same problem does *not* exist for owner:, however | 13:07 |
| fungi | aspiers: oh, interesting, i don't think i've ever tried author. usually owner or reviewer | 13:07 |
| aspiers | I'm guessing "owner" is Gerrit-speak for git committer | 13:08 |
| zbr|ruck | pabelanger: sure, we can continue there but not right away, i have few more issues to deal with. | 13:08 |
| aspiers | ah, no it isn't | 13:08 |
| fungi | aspiers: strangely, https://review.opendev.org/#/q/author:fungi%2540yuggoth.org works | 13:08 |
| aspiers | fungi: yes I found that too. It's the full expansion which is broken | 13:09 |
| *** ricolin_phone has quit IRC | 13:09 | |
| aspiers | which is why I'm 100% confident this is a bug | 13:09 |
| fungi | might be fixed in newer gerrit, yeah | 13:09 |
| aspiers | I bet it's fixed in newer Gerrits | 13:09 |
| aspiers | speaking of which ... ;-) | 13:09 |
| mordred | aspiers: yeah. very much looking forward to upgrading | 13:09 |
| pabelanger | zbr|ruck: cool, we raise topic again, if you'd like. Honestly, molecule side needs to push more on it, but zuul is ready | 13:10 |
| aspiers | mordred: likewise. BTW I heard about https://distrotest.net/ earlier and thought of you with your laptop keyboard woes | 13:10 |
| aspiers | although I guess that wouldn't help in that particular case | 13:10 |
| aspiers | since the keyboard driver needs to be tested on raw hardware ... | 13:11 |
| *** mriedem has joined #openstack-infra | 13:11 | |
| * aspiers nips off for a few mins | 13:11 | |
| *** sthussey has joined #openstack-infra | 13:11 | |
| mordred | aspiers: I actually just completely gave up on laptops and am using a pixelbook now | 13:12 |
| aspiers | Ah yeah, I think I might have seen that one in Denver and quizzed you about it | 13:12 |
| mordred | aspiers: I figured since no laptop manufacturer makes a good keyboard anymore, and since systemd makes my laptop os unstable, and since nobody seems to care about either of those things, might as well get a thing that can play netflix | 13:13 |
| *** yolanda has quit IRC | 13:13 | |
| aspiers | mordred: well actually I have an awesome laptop keyboard ;-p https://youtu.be/iYIltqzj_8g | 13:14 |
| fungi | still enjoying the gpd pocket. has thinkpad-like chicklets (albeit smaller) and a trackpoint nub | 13:14 |
| *** Goneri has joined #openstack-infra | 13:14 | |
| *** ricolin_phone has joined #openstack-infra | 13:14 | |
| aspiers | combined with the Roost laptop stand it's a great mobile workstation | 13:15 |
| aspiers | albeit somewhat slow to set up | 13:15 |
| mordred | aspiers: oh - there's PLENTY of good keyboards that exist as independent items that are excellent for use on desks | 13:15 |
| mordred | my use case is being primarily a road warrior | 13:16 |
| mordred | fungi: your laptops never cease to amaze and astound me | 13:16 |
| evrardjp | mordred: we are two there. | 13:16 |
| aspiers | Yeah, fungi definitely deserves an Oscar for Best Road Warrior | 13:16 |
| aspiers | That thing would trigger my RSI in 3 seconds though | 13:17 |
| mordred | having started with low expectations, I can report that the linux subsystem on the pixelbook is actually ludicrously solid so far | 13:17 |
| *** ricolin_phone has quit IRC | 13:17 | |
| corvus | the new thinkpad keyboards are still better than anything else new, they're just not better than the old thinkpad keyboards | 13:17 |
| mordred | corvus: ++ | 13:17 |
| aspiers | corvus: they're still not ortholinear though :-( | 13:17 |
| *** yolanda has joined #openstack-infra | 13:17 | |
| mordred | my pixelbook keyboard is definitely not better than the old thinkpad keyboards | 13:17 |
| aspiers | Any traditional diagonal QWERTY layout is a disaster IMHO | 13:17 |
| evrardjp | mordred: keeping system or dual booting? | 13:17 |
| mordred | evrardjp: they support linux directly now - you just open a linux terminal and there it is | 13:18 |
| evrardjp | oh yeah I didn't upgrade my pixel yet | 13:18 |
| evrardjp | (I meant I didn't buy the hardware upgrade) | 13:18 |
| mordred | must consume more products!!! | 13:19 |
| evrardjp | stuck with old pixel which doesn't have those niceties! | 13:19 |
| corvus | aspiers: if you have some time, we could use some help upgrading gerrit | 13:19 |
| aspiers | corvus: I don't really, but I want it so bad I could *try* to make time somehow | 13:19 |
| aspiers | corvus: What kind of things need help? | 13:20 |
| corvus | i think the thing we need now is a written plan? like, given our current version, and latest gerrit, what steps do we need to do for the upgrade? there are database transitions (-> notedb, etc) involved.... | 13:20 |
| aspiers | worth doing a collective brain-dump into an etherpad as a first step? | 13:20 |
| corvus | fungi, pabelanger, mordred: ^ does that sound right, or do we already know that and i just don't remember? | 13:21 |
| mordred | corvus: yeah - I think that sounds right - plan is the main missing thing right now | 13:22 |
| mordred | last time I was thinking about this problem I was thinking about changing the current deploy to be docker-based (but without updating versions) so that we can build images of the newer gerrit versions because newer gerrit needs newer java than is on xenial | 13:23 |
| mordred | so maybe a braindump etherpad wouldn't be a bad idea - with the outcome we're aiming for being a plan | 13:23 |
| corvus | oh, yeah, that's a pre-req | 13:24 |
| corvus | i started on that work: https://review.opendev.org/630406 | 13:24 |
| mordred | awesome - I started on the 'make images' work :) | 13:24 |
| aspiers | https://etherpad.openstack.org/p/gerrit-upgrade ? | 13:25 |
| aspiers | OK, I *really* have to nip off. Back in 5 | 13:25 |
| *** goldyfruit has joined #openstack-infra | 13:26 | |
| mordred | https://review.opendev.org/#/c/610380/1 <-- I don't remember why I abandoned it - but that was the general idea. oh - I thnik because those dockerfiles should really just go into system-config | 13:29 |
| openstackgerrit | James E. Blair proposed zuul/nodepool master: WIP: new devstack-based functional job https://review.opendev.org/665023 | 13:33 |
| openstackgerrit | Tobias Henkel proposed zuul/zuul master: Add repl server for debug purposes https://review.opendev.org/579962 | 13:36 |
| *** rajinir has joined #openstack-infra | 13:40 | |
| *** lseki has joined #openstack-infra | 13:40 | |
| rajinir | mmedvede the ciwatch is not picking up the new patches, stuck on June14 http://ciwatch.mmedvede.net/project?project=ironic&time=48+hours | 13:40 |
| *** bhavikdbavishi has quit IRC | 13:45 | |
| *** ykarel is now known as ykarel|afk | 13:45 | |
| *** fresta has joined #openstack-infra | 13:46 | |
| openstackgerrit | Matthieu Huin proposed zuul/zuul master: URLTrigger driver time based https://review.opendev.org/635567 | 13:47 |
| openstackgerrit | Fabien Boucher proposed zuul/zuul master: A reporter for Elasticsearch https://review.opendev.org/644927 | 13:48 |
| *** eharney has joined #openstack-infra | 13:50 | |
| fungi | mordred: corvus: i thought it was that newer gerrit needed newer java than is on trusty, so we upgraded to xenial in preparation. last i heard that java version still works | 13:51 |
| fungi | but maybe that's no longer true for gerrit 3? | 13:51 |
| corvus | i will update the etherpad to indicate that's a question :) | 13:51 |
| clarkb | mordred: newer gerrit does not need newer java | 13:52 |
| mordred | fungi: yeah - I believe it may be no longer true for >2.15 - but in general I think it'll be a simplification step because right now our puppet does a bunch of java library bundling | 13:52 |
| clarkb | java 8 is the low version they test | 13:53 |
| clarkb | they dropped 7 after confirming we and others are on 8 | 13:53 |
| mordred | ah - ok. so it's not java version driven. I'll mostly keep advocating for it as a step-one just to simplify things | 13:53 |
| mordred | (there's a ton in puppet that can be done as part of image build - and then we've got less moving parts during rollout - and I think it should make it easier for people like aspiers to help us out) | 13:54 |
| clarkb | sure just dont want to confuse java versions. 8 is fine last I checked (and that was when they checked directly with us) | 13:55 |
| mordred | ++ | 13:56 |
| *** janki has quit IRC | 13:57 | |
| *** markvoelker has joined #openstack-infra | 13:57 | |
| aspiers | BTW https://www.gerritcodereview.com/2019-06-18-user-summit-sunnyvale-registration-open.html | 13:58 |
| aspiers | Sunnyvale mid-November, Sweden end of August | 13:59 |
| clarkb | there are even bugs reported that some versions of newer gerrit fail under java 9 and 10 | 13:59 |
| clarkb | .14 and .15 specifically require 8 | 14:01 |
| *** liuyulong has quit IRC | 14:01 | |
| *** markvoelker has quit IRC | 14:01 | |
| *** ginopc has quit IRC | 14:04 | |
| *** ginopc has joined #openstack-infra | 14:04 | |
| *** dciabrin has joined #openstack-infra | 14:05 | |
| *** jamesmcarthur has joined #openstack-infra | 14:05 | |
| mordred | aspiers: fwiw, corvus and I will be attending the sweden summit | 14:08 |
| aspiers | mordred: awesome! wish I could come | 14:08 |
| aspiers | well, who knows, maybe I can | 14:08 |
| *** roman_g has quit IRC | 14:08 | |
| *** dpawlik has quit IRC | 14:11 | |
| openstackgerrit | Matthieu Huin proposed zuul/zuul master: Get executor job params https://review.opendev.org/607078 | 14:12 |
| *** Lucas_Gray has quit IRC | 14:12 | |
| *** Lucas_Gray has joined #openstack-infra | 14:13 | |
| *** lpetrut has quit IRC | 14:14 | |
| *** yboaron_ has quit IRC | 14:22 | |
| openstackgerrit | Francis Deslauriers proposed opendev/git-review master: Add labels on change submission https://review.opendev.org/666301 | 14:22 |
| *** sreejithp has joined #openstack-infra | 14:25 | |
| openstackgerrit | James E. Blair proposed zuul/nodepool master: WIP: new devstack-based functional job https://review.opendev.org/665023 | 14:30 |
| openstackgerrit | Tobias Henkel proposed zuul/zuul master: Add repl server for debug purposes https://review.opendev.org/579962 | 14:33 |
| openstackgerrit | Tobias Henkel proposed zuul/zuul master: Add command processor to zuul-web https://review.opendev.org/666307 | 14:33 |
| openstackgerrit | Tobias Henkel proposed zuul/zuul master: Add command processor to zuul-web https://review.opendev.org/666307 | 14:34 |
| openstackgerrit | Tobias Henkel proposed zuul/zuul master: Add repl server for debug purposes https://review.opendev.org/579962 | 14:34 |
| *** nfakhir has joined #openstack-infra | 14:36 | |
| *** jcoufal has quit IRC | 14:42 | |
| *** dklyle_ has quit IRC | 14:42 | |
| *** ykarel|afk is now known as ykarel | 14:42 | |
| *** dklyle has joined #openstack-infra | 14:42 | |
| *** gfhellma has joined #openstack-infra | 14:45 | |
| fungi | gotta run some errands and grab lunch, but should return in an hour or two... bbiaw | 14:51 |
| *** iurygregory has quit IRC | 14:52 | |
| *** ykarel has quit IRC | 14:55 | |
| *** ykarel has joined #openstack-infra | 14:55 | |
| openstackgerrit | Stephen Finucane proposed opendev/git-review master: Corrected git-review project organization https://review.opendev.org/661800 | 14:57 |
| *** liuyulong has joined #openstack-infra | 14:57 | |
| *** ykarel has quit IRC | 14:57 | |
| *** ykarel has joined #openstack-infra | 14:57 | |
| openstackgerrit | Tobias Henkel proposed zuul/zuul master: Add repl server for debug purposes https://review.opendev.org/579962 | 14:57 |
| *** markvoelker has joined #openstack-infra | 14:58 | |
| *** lpetrut has joined #openstack-infra | 14:58 | |
| *** lpetrut has quit IRC | 14:59 | |
| *** lpetrut has joined #openstack-infra | 14:59 | |
| *** markvoelker has quit IRC | 15:02 | |
| *** michael-beaver has joined #openstack-infra | 15:05 | |
| *** tdasilva_ has joined #openstack-infra | 15:06 | |
| *** raissa has joined #openstack-infra | 15:06 | |
| *** tdasilva has quit IRC | 15:07 | |
| jrist | just need a workflow +1 when someone gets a chance | 15:09 |
| jrist | https://review.opendev.org/#/c/665259/1 | 15:09 |
| *** raissa has quit IRC | 15:11 | |
| *** mattw4 has joined #openstack-infra | 15:11 | |
| *** raissa has joined #openstack-infra | 15:12 | |
| *** yamamoto has quit IRC | 15:15 | |
| *** iurygregory has joined #openstack-infra | 15:18 | |
| *** gfidente has quit IRC | 15:18 | |
| openstackgerrit | Jean-Philippe Evrard proposed zuul/zuul master: Expose ansible_date_time instead of date_time https://review.opendev.org/666268 | 15:25 |
| openstackgerrit | Merged opendev/git-review master: Push with --no-follow-tags https://review.opendev.org/648646 | 15:28 |
| openstackgerrit | Merged opendev/git-review master: Corrected git-review project organization https://review.opendev.org/661800 | 15:28 |
| *** lpetrut has quit IRC | 15:30 | |
| yoctozepto | > <fungi> yoctozepto: it does appear the iad mirror was in a shutoff state again, as of 2019-06-19T08:04:17Z | 15:32 |
| yoctozepto | thanks! | 15:32 |
| yoctozepto | (for reboot) | 15:32 |
| *** gyee has joined #openstack-infra | 15:32 | |
| *** gfidente has joined #openstack-infra | 15:34 | |
| *** thiago__ has joined #openstack-infra | 15:39 | |
| openstackgerrit | Matthieu Huin proposed zuul/zuul master: Dequeue a change by its buildset UUID https://review.opendev.org/666258 | 15:39 |
| *** gfhellma has quit IRC | 15:40 | |
| *** tdasilva_ has quit IRC | 15:42 | |
| *** iurygregory_ has joined #openstack-infra | 15:45 | |
| *** iurygregory has quit IRC | 15:46 | |
| *** mattw4 has quit IRC | 15:47 | |
| *** mattw4 has joined #openstack-infra | 15:47 | |
| mnaser | how does infra inject ssh keys and create the zuul user in nodepool? | 15:48 |
| clarkb | mnaser with dib | 15:50 |
| guilhermesp | maybe https://docs.openstack.org/diskimage-builder/latest/elements/dynamic-login/README.html clarkb ? | 15:51 |
| clarkb | there is an element in openstack/project-config | 15:51 |
| clarkb | guilhermesp: we dont use that one but we could | 15:51 |
| pabelanger | https://opendev.org/openstack/project-config/src/branch/master/nodepool/elements/zuul-worker | 15:51 |
| corvus | clarkb: are you back? | 15:52 |
| guilhermesp | oh thanks clarkb and pabelanger! | 15:52 |
| clarkb | corvus: no, not until friday | 15:52 |
| mnaser | i wonder if https://docs.openstack.org/diskimage-builder/latest/elements/devuser/README.html might be good too | 15:52 |
| *** jcoufal has joined #openstack-infra | 15:52 | |
| clarkb | just having a slow morning before visiting the high desert museum | 15:52 |
| corvus | clarkb: shoo! :) | 15:52 |
| clarkb | ha k | 15:52 |
| ykarel | fungi, cbsl-init-upload-git-mirror job, job def https://opendev.org/x/cloudbase-init/src/branch/master/.zuul.yaml#L14-L23, no files: directive | 15:53 |
| *** mattw4 has quit IRC | 15:55 | |
| *** pgaxatte has quit IRC | 15:56 | |
| *** ykarel is now known as ykarel|away | 15:58 | |
| *** markvoelker has joined #openstack-infra | 15:58 | |
| *** mattw4 has joined #openstack-infra | 15:59 | |
| *** diablo_rojo has joined #openstack-infra | 16:00 | |
| *** markvoelker has quit IRC | 16:03 | |
| openstackgerrit | Tobias Henkel proposed zuul/zuul master: Add command processor to zuul-web https://review.opendev.org/666307 | 16:08 |
| *** rkukura has joined #openstack-infra | 16:09 | |
| *** rpittau is now known as rpittau|afk | 16:10 | |
| *** lpetrut has joined #openstack-infra | 16:10 | |
| *** ramishra has quit IRC | 16:11 | |
| *** _erlon_ has joined #openstack-infra | 16:12 | |
| *** udesale has quit IRC | 16:12 | |
| *** spsurya has quit IRC | 16:18 | |
| *** thiago__ is now known as tdasilva | 16:19 | |
| *** chandankumar is now known as raukadah | 16:21 | |
| *** liuyulong has quit IRC | 16:22 | |
| *** rfolco has quit IRC | 16:25 | |
| pabelanger | ianw: wanted to see if you had bandwidth to look into fedora-30? | 16:26 |
| *** rfolco has joined #openstack-infra | 16:26 | |
| pabelanger | just popped up on my radar again | 16:26 |
| openstackgerrit | jacky06 proposed openstack/os-performance-tools master: Sync Sphinx requirement https://review.opendev.org/666383 | 16:27 |
| *** jpich has quit IRC | 16:27 | |
| *** kopecmartin is now known as kopecmartin|off | 16:31 | |
| *** mattw4 has quit IRC | 16:37 | |
| *** mattw4 has joined #openstack-infra | 16:37 | |
| *** ginopc has quit IRC | 16:40 | |
| *** mattw4 has quit IRC | 16:42 | |
| *** sreejithp has quit IRC | 16:43 | |
| *** sreejithp has joined #openstack-infra | 16:44 | |
| *** gfhellma has joined #openstack-infra | 16:44 | |
| *** jpena is now known as jpena|off | 16:45 | |
| *** tosky has quit IRC | 16:47 | |
| *** ricolin has quit IRC | 16:48 | |
| *** weifan has joined #openstack-infra | 16:49 | |
| *** lpetrut has quit IRC | 16:49 | |
| *** gfhellma_ has joined #openstack-infra | 16:50 | |
| *** gfidente has quit IRC | 16:51 | |
| *** gfhellma has quit IRC | 16:53 | |
| *** diablo_rojo has quit IRC | 16:56 | |
| *** dtantsur is now known as dtantsur|afk | 16:56 | |
| openstackgerrit | James E. Blair proposed zuul/nodepool master: WIP: new devstack-based functional job https://review.opendev.org/665023 | 16:56 |
| *** Lucas_Gray has quit IRC | 16:58 | |
| fungi | okay, back and catching up again | 16:58 |
| *** markvoelker has joined #openstack-infra | 16:59 | |
| *** lucasagomes has quit IRC | 16:59 | |
| *** derekh has quit IRC | 17:00 | |
| *** trident has quit IRC | 17:02 | |
| *** markvoelker has quit IRC | 17:04 | |
| fungi | ykarel|away: lpetrut (is not around at the moment): https://zuul.opendev.org/t/openstack/builds?job_name=cbsl-init-upload-git-mirror indicates it ran 5 times already between 2019-06-07 and today | 17:04 |
| fungi | most recent push is logged at http://logs.openstack.org/ed/ed8a41fc49e176f21c1378e5e5047019f921139b/post/cbsl-init-upload-git-mirror/6e28e25/job-output.txt.gz#_2019-06-19_07_36_33_643874 and i see current commit dates in https://github.com/cloudbase/cloudbase-init/commits/master | 17:04 |
| *** trident has joined #openstack-infra | 17:04 | |
| fungi | am i misunderstanding the problem? | 17:04 |
| ykarel|away | fungi, 8 patches merged including the patch that added job, and job ran 5 times | 17:10 |
| * ykarel|away need to leave, will check irc logs tomorrow | 17:19 | |
| *** e0ne has quit IRC | 17:20 | |
| *** adriancz has quit IRC | 17:20 | |
| *** tesseract has quit IRC | 17:21 | |
| *** raissa has quit IRC | 17:23 | |
| *** eharney has quit IRC | 17:25 | |
| *** ykarel|away has quit IRC | 17:25 | |
| *** mgoddard has quit IRC | 17:25 | |
| *** diablo_rojo has joined #openstack-infra | 17:26 | |
| *** mgoddard has joined #openstack-infra | 17:27 | |
| *** tesseract has joined #openstack-infra | 17:36 | |
| *** mattw4 has joined #openstack-infra | 17:36 | |
| *** eharney has joined #openstack-infra | 17:38 | |
| sean-k-mooney | quick question | 17:39 |
| sean-k-mooney | there was an issue with python 2.7.15 in the gate recently | 17:40 |
| openstackgerrit | Nicolas Hicher proposed opendev/puppet-openstackci master: Add AFS mirror support for RHEL/CentOS https://review.opendev.org/528739 | 17:40 |
| sean-k-mooney | do ye recall what it was? | 17:40 |
| openstackgerrit | James E. Blair proposed zuul/nodepool master: WIP: new devstack-based functional job https://review.opendev.org/665023 | 17:40 |
| fungi | if ykarel or lpetrut come back, someone can explain the supercedent pipeline to them | 17:41 |
| fungi | supercedent pipeline concept | 17:41 |
| fungi | sean-k-mooney: that's not enough context for me to go on, sorry | 17:43 |
| fungi | maybe someone else can remember | 17:43 |
| sean-k-mooney | fungi: i recal there was a failure in the nova gate related to a new release of pyton in ubuntu bionic like a week ago that was blocking everything but i was wondingin if it could be related to an issue i was trhying to debug on the nova irc | 17:44 |
| sean-k-mooney | anyway its fine it was just a guess that it might be related. | 17:45 |
| fungi | huh, new python interpreter in bionic? checking the update timeline now | 17:47 |
| *** psachin has quit IRC | 17:48 | |
| fungi | changelog for the current version in bionic-updates: http://changelogs.ubuntu.com/changelogs/pool/main/p/python2.7/python2.7_2.7.15-4ubuntu4~18.04/changelog (warning: the dates you see there aren't necessarily indicative of when they finally appeared in the archive) | 17:48 |
| openstackgerrit | Nicolas Hicher proposed opendev/puppet-openstackci master: Add AFS mirror support https://review.opendev.org/529376 | 17:49 |
| openstackgerrit | Nicolas Hicher proposed opendev/puppet-openstackci master: Add AFS mirror support for RHEL/CentOS https://review.opendev.org/528739 | 17:49 |
| *** factor__ has joined #openstack-infra | 17:49 | |
| *** icarusfactor has quit IRC | 17:49 | |
| fungi | sean-k-mooney: that entry mentions bug 1797386 which has some ongoing discussion but was marked "fix released" for bionic's python2.7 package on 2019-06-10 | 17:51 |
| openstack | bug 1797386 in python-tornado (Ubuntu Bionic) "[SRU] OpenSSL 1.1.1 to 18.04 LTS" [Undecided,Fix committed] https://launchpad.net/bugs/1797386 | 17:51 |
| sean-k-mooney | hum i doubt it related to ssl but thanks for looking in anycase | 17:54 |
| fungi | sean-k-mooney: discussion starts here: http://eavesdrop.openstack.org/irclogs/%23openstack-infra/%23openstack-infra.2019-06-11.log.html#t2019-06-11T16:11:10 | 17:54 |
| *** melwitt is now known as jgwentworth | 17:55 | |
| fungi | sean-k-mooney: problem seemed to be lower constraints in kolla (and possibly elsewhere) specifying too old of a pyca/cryptography for the updated libssl the new python interpreters were built against | 17:56 |
| sean-k-mooney | ya that seam unrealated to the nova issue im chating about on the nova channel currently | 17:57 |
| fungi | sean-k-mooney: the symptom was a cryptic ascii encoding failure emitted by gcc while building c extensions for the cryptography package | 17:57 |
| sean-k-mooney | they are seeeing the compute agent hang for a long time trying to update the resouce inventoies on the host | 17:57 |
| fungi | yeah, i suppose it could be something to do with recent interpreter package updates, hard to say | 17:58 |
| fungi | if it cropped up ~8 days ago then maybe related? | 17:58 |
| *** markvoelker has joined #openstack-infra | 18:00 | |
| *** ociuhandu has quit IRC | 18:02 | |
| *** gfhellma__ has joined #openstack-infra | 18:03 | |
| *** markvoelker has quit IRC | 18:05 | |
| *** diablo_rojo has quit IRC | 18:05 | |
| *** gfhellma_ has quit IRC | 18:06 | |
| *** electrofelix has quit IRC | 18:08 | |
| openstackgerrit | Matthieu Huin proposed zuul/zuul master: Dequeue a change by its buildset UUID https://review.opendev.org/666258 | 18:10 |
| *** pcaruana has quit IRC | 18:11 | |
| *** brett-soric has joined #openstack-infra | 18:12 | |
| *** sreejithp has quit IRC | 18:16 | |
| *** sreejithp has joined #openstack-infra | 18:16 | |
| *** tdasilva has quit IRC | 18:17 | |
| *** Goneri has quit IRC | 18:24 | |
| *** diablo_rojo has joined #openstack-infra | 18:31 | |
| *** tdasilva has joined #openstack-infra | 18:35 | |
| *** e0ne has joined #openstack-infra | 18:35 | |
| *** e0ne has quit IRC | 18:36 | |
| *** jamesmcarthur has quit IRC | 18:40 | |
| *** jamesmcarthur has joined #openstack-infra | 18:41 | |
| openstackgerrit | James E. Blair proposed zuul/nodepool master: WIP: new devstack-based functional job https://review.opendev.org/665023 | 18:45 |
| *** pkopec has quit IRC | 18:45 | |
| *** jamesmcarthur has quit IRC | 18:46 | |
| *** diablo_rojo has quit IRC | 18:46 | |
| *** tesseract has quit IRC | 18:49 | |
| cloudnull | hey everyone - qq - does anyone know if we have anything caching registry.access.redhat.com? something similar to what's there for docker.io? | 18:50 |
| cloudnull | I'm looking to test using the UBI8 images (rhel8) and it'd be great if there was a proxy or an internal cache. | 18:51 |
| cloudnull | RE: https://review.opendev.org/#/c/665677/12/tripleo_ansible/roles/aide/molecule/default/molecule.yml | 18:51 |
| fungi | cloudnull: nothing i'm aware of but if we are you'll find it in https://opendev.org/opendev/system-config/src/branch/master/modules/openstack_project/templates/mirror.vhost.erb | 18:56 |
| fungi | and if we're not, you can add it to the same? | 18:56 |
| *** raissa has joined #openstack-infra | 18:57 | |
| *** diablo_rojo has joined #openstack-infra | 18:57 | |
| pabelanger | we likely need a new vhost, port 8003 maybe, for registry.access.redhat.com | 18:58 |
| pabelanger | we also likely need to fireup tcpdump to figure our CDN info | 18:58 |
| pabelanger | for reverse proxy cache | 18:59 |
| cloudnull | pabelanger fungi I'm happy to push up a change for the mirror.vhost, though Im not sure what to do with the CDN info part? | 19:00 |
| *** markvoelker has joined #openstack-infra | 19:01 | |
| *** brett-soric has left #openstack-infra | 19:01 | |
| pabelanger | cloudnull: so we don't mirror docker, we cache the requests. We did that by sniffing the traffic via apache, to figure out which CDN they were using. See: https://opendev.org/opendev/system-config/src/branch/master/modules/openstack_project/templates/mirror.vhost.erb#L336 | 19:01 |
| pabelanger | we'd have to do the same for registry.access.redhat.com, and hope they don't change the cdn every so often | 19:02 |
| pabelanger | should be able to do it locally, but need tcpdump to figure it out | 19:02 |
| fungi | unless that registry isn't using as aggressive a cdn as dockerhub | 19:03 |
| pabelanger | right | 19:03 |
| pabelanger | but I know redhat does have a CDN network | 19:03 |
| pabelanger | another option, is ask to mirror to hub.docker.com | 19:04 |
| *** jamesmcarthur has joined #openstack-infra | 19:04 | |
| pabelanger | then we get it for free | 19:04 |
| *** e0ne has joined #openstack-infra | 19:05 | |
| *** tdasilva has quit IRC | 19:06 | |
| *** Goneri has joined #openstack-infra | 19:10 | |
| *** jamesmcarthur has quit IRC | 19:10 | |
| cloudnull | looks like its all "registry.access.redhat.com.edgekey.net." which is an akamai CNAME https://pasted.tech/pastes/0d2ba50a7950333d4db3f140a23f76c3ac45dde2.raw | 19:11 |
| openstackgerrit | Kevin Carter (cloudnull) proposed opendev/system-config master: Add proxy for registry.access.redhat https://review.opendev.org/666423 | 19:17 |
| cloudnull | pabelanger fungi ^ maybe that will work ? | 19:17 |
| cloudnull | I could also add the akamai edge node "e14353.d.akamaiedge.net" ? | 19:18 |
| pabelanger | cloudnull: we need a tcpdump of docker to see what the client is redirected too | 19:20 |
| pabelanger | that will tell us what proxypass values we need | 19:20 |
| *** markvoelker has quit IRC | 19:20 | |
| openstackgerrit | Nicolas Hicher proposed opendev/puppet-openstackci master: Add AFS mirror support for RHEL/CentOS https://review.opendev.org/528739 | 19:20 |
| pabelanger | cloudnull: we also likely need something like: https://opendev.org/opendev/system-config/src/branch/master/modules/openstack_project/templates/mirror.vhost.erb#L409 | 19:20 |
| pabelanger | but for redhat registry | 19:20 |
| *** jamesmcarthur has joined #openstack-infra | 19:23 | |
| *** raissa has quit IRC | 19:23 | |
| *** phughk has joined #openstack-infra | 19:24 | |
| mriedem | trivial d-g cleanup patch with a +2 that's been hanging in my queue since 2017 https://review.opendev.org/#/c/507974/ | 19:32 |
| mriedem | if someone can hit that | 19:32 |
| yoctozepto | guys, mirror.iad.rax.o.o is seriously broken, now getting errors like Failed to fetch http://mirror.iad.rax.opendev.org/ubuntu/pool/main/s/sqlite3/sqlite3_3.22.0-1ubuntu0.1_amd64.deb | 19:40 |
| yoctozepto | running jobs in CI requires a prayer that it does not use mirror.iad.rax.o.o or else it is surely doomed | 19:40 |
| yoctozepto | :P | 19:40 |
| yoctozepto | other times: Depends: sqlite3 but it is not going to be installed | 19:41 |
| fungi | i agree that's not in the mirror. i'll check the update log to see if that changed in a recent reprepro pull | 19:46 |
| *** eharney has quit IRC | 19:47 | |
| fungi | aptmethod got 'http://security.ubuntu.com/ubuntu/pool/main/s/sqlite3/sqlite3-doc_3.22.0-1ubuntu0.1_all.deb' | 19:48 |
| fungi | aptmethod got 'http://security.ubuntu.com/ubuntu/pool/main/s/sqlite3/sqlite3_3.22.0-1ubuntu0.1_amd64.deb' | 19:49 |
| fungi | i guess that's the one technically | 19:49 |
| fungi | was included in a vos release which completed at 2019-06-19T16:46:32 | 19:49 |
| fungi | so this suggests that kafs has stale (negative at least) caching by several hours already | 19:49 |
| fungi | ianw: ^ more kafs excitement | 19:49 |
| yoctozepto | fungi: more kafs hate here ;D | 19:51 |
| *** jgwentworth is now known as melwitt | 19:52 | |
| fungi | for comparison http://mirror.dfw.rax.opendev.org/ubuntu/pool/main/s/sqlite3/ does have it (that's the openafs 1.8.3 server) | 19:53 |
| *** ralonsoh has quit IRC | 19:53 | |
| openstackgerrit | Kevin Carter (cloudnull) proposed opendev/system-config master: Add proxy for registry.access.redhat https://review.opendev.org/666423 | 19:58 |
| *** jcoufal has quit IRC | 20:04 | |
| *** gfhellma__ has quit IRC | 20:07 | |
| openstackgerrit | James E. Blair proposed zuul/nodepool master: WIP: new devstack-based functional job https://review.opendev.org/665023 | 20:09 |
| *** e0ne has quit IRC | 20:11 | |
| *** jamesmcarthur has quit IRC | 20:13 | |
| openstackgerrit | Kendall Nelson proposed opendev/storyboard-webclient master: Converting a search query into a browse https://review.opendev.org/644424 | 20:14 |
| *** jamesmcarthur has joined #openstack-infra | 20:15 | |
| *** hwoarang has quit IRC | 20:16 | |
| *** markvoelker has joined #openstack-infra | 20:17 | |
| *** hwoarang has joined #openstack-infra | 20:17 | |
| openstackgerrit | Kendall Nelson proposed opendev/storyboard-webclient master: Allowing the user to choose what Columns are seen https://review.opendev.org/651270 | 20:22 |
| *** jamesmcarthur has quit IRC | 20:23 | |
| *** rkukura has quit IRC | 20:30 | |
| openstackgerrit | Kendall Nelson proposed opendev/storyboard-webclient master: Enabling suggestions on all user fields https://review.opendev.org/648525 | 20:30 |
| openstackgerrit | Adam Spiers proposed openstack/cookiecutter master: Add a testenv for lower-constraints https://review.opendev.org/660732 | 20:35 |
| *** eharney has joined #openstack-infra | 20:36 | |
| *** markvoelker has quit IRC | 20:36 | |
| *** jtomasek has quit IRC | 20:38 | |
| corvus | it would be really cool if i could highlight a commit on the list of commits in gitea | 20:39 |
| *** whoami-rajat has quit IRC | 20:47 | |
| fungi | i concur | 20:50 |
| fungi | it would also be really cool if half the gitea urls i pulled up in my browser didn't just give me a "corrupted content" error until i force refresh them | 20:51 |
| fungi | it can't be just me experiencing that, but i have yet to figure out the cause | 20:51 |
| * fungi looks sideways at javascript service workers | 20:52 | |
| fungi | i would file a bug with gitea if i had even the first clue what causes it | 20:52 |
| fungi | probably some interaction with one of the handful of ff plugins i run | 20:53 |
| fungi | it at least became less annoying once i figured out a force refresh makes it go away | 20:53 |
| *** e0ne has joined #openstack-infra | 20:55 | |
| *** dirk has quit IRC | 20:55 | |
| corvus | i've only seen that when we've had a service issue (like when we lost gitea06 or restarted the LB); once corrected i haven't seen it in typical use. | 20:58 |
| corvus | that's with ff+ublockorigin | 20:58 |
| corvus | oh, and deleting almost all data on exit :) | 20:59 |
| corvus | (but i don't think that includes service workers) | 20:59 |
| *** e0ne has quit IRC | 20:59 | |
| *** e0ne has joined #openstack-infra | 21:00 | |
| *** sreejithp has quit IRC | 21:02 | |
| *** sreejithp_ has joined #openstack-infra | 21:03 | |
| openstackgerrit | Michael Johnson proposed openstack/diskimage-builder master: Add DIB_UBUNTU_KERNEL to ubuntu-minimal https://review.opendev.org/666063 | 21:09 |
| *** rkukura has joined #openstack-infra | 21:10 | |
| openstackgerrit | Michael Johnson proposed openstack/diskimage-builder master: Add DIB_UBUNTU_KERNEL to ubuntu-minimal https://review.opendev.org/666063 | 21:11 |
| openstackgerrit | Michael Johnson proposed openstack/diskimage-builder master: Add DIB_UBUNTU_KERNEL to ubuntu-minimal https://review.opendev.org/666063 | 21:12 |
| *** rfolco is now known as rfolco_off | 21:26 | |
| *** _erlon_ has quit IRC | 21:31 | |
| *** markvoelker has joined #openstack-infra | 21:33 | |
| *** e0ne has quit IRC | 21:39 | |
| fungi | i haven't tried ublockorigin, just setting dnt in ff and using eff privacy badger and ddg privacy essentials | 21:39 |
| fungi | i also nearly never exit the browser on my workstation, i have a screen mostly dedicated to it | 21:40 |
| *** jamesmcarthur has joined #openstack-infra | 21:40 | |
| *** kjackal has quit IRC | 21:48 | |
| *** jamesmcarthur has quit IRC | 21:51 | |
| *** yamamoto has joined #openstack-infra | 21:51 | |
| *** markvoelker has quit IRC | 21:53 | |
| *** goldyfruit has quit IRC | 21:54 | |
| *** yamamoto has quit IRC | 21:56 | |
| *** mriedem has quit IRC | 21:59 | |
| cloudnull | if any infra core are around, mind giving https://review.opendev.org/#/c/665237/ a nudge ? | 22:01 |
| *** xek has quit IRC | 22:02 | |
| cloudnull | also fungi pabelanger (anyone else) when you get a chance, mind taking a look at https://review.opendev.org/#/c/666423 - I'd appreciate it | 22:02 |
| johnsom | FYI, it looks like the iad rax mirror is bad again: http://logs.openstack.org/61/665861/4/check/octavia-v2-dsvm-scenario/0075ea0/job-output.txt.gz#_2019-06-19_21_38_48_606892 | 22:03 |
| *** eernst has joined #openstack-infra | 22:04 | |
| johnsom | I know that libsqlite3 package was a new update today. | 22:05 |
| johnsom | I patched one of my VMs and that was the package. | 22:05 |
| *** diablo_rojo has quit IRC | 22:05 | |
| fungi | ianw: corvus: i see http://mirror.iad.rax.opendev.org/ubuntu/pool/main/s/sqlite3/ still doesn't have sqlite3_3.22.0-1ubuntu0.1_amd64.deb some hours later... is there something we should try to force a cache update, or should we just update dns to go back to the old mirror server? | 22:06 |
| fungi | nothing exciting in dmesg or syslog since the reboot | 22:08 |
| corvus | fungi: i think it's time to call it and switch back (unless ianw finds something amazing in the netcons) | 22:09 |
| openstackgerrit | Michael Johnson proposed openstack/diskimage-builder master: Add DIB_UBUNTU_KERNEL to ubuntu-minimal https://review.opendev.org/666063 | 22:10 |
| corvus | i find the second reboot to be compelling | 22:10 |
| ianw | i didn't setup netconsole yet ... but can now | 22:11 |
| ianw | i'm just chatting with dhowells, if we have a negative cache situation might be worth pinging him before we reboot | 22:12 |
| ianw | sorry i gotta disappear for 20 minutes, will be back | 22:12 |
| ianw | we also have some changes to try on the afs-next branch from what we've reported. i think it's probably worth a little time with that and trying to ensure we get a netconsole | 22:16 |
| fungi | corvus: ianw: okay, so this is interesting... i restarted apache and now there's fresh content | 22:16 |
| *** sgw has quit IRC | 22:17 | |
| *** zbr|ruck has quit IRC | 22:17 | |
| corvus | ianw, fungi: okay, if there's more to try, i'm game for learning more and helping dhowells | 22:18 |
| fungi | suggesting that it may have been a stale handle? when i looked in /afs from the server's perspective the files were there | 22:18 |
| fungi | so now the question is why would apache cease noticing changes on the volume? | 22:18 |
| corvus | i wonder if somethign weird happened with the automatic mounting/unmounting | 22:19 |
| *** rlandy is now known as rlandy|bbl | 22:24 | |
| openstackgerrit | James E. Blair proposed zuul/nodepool master: WIP: new devstack-based functional job https://review.opendev.org/665023 | 22:29 |
| *** sreejithp_ has quit IRC | 22:31 | |
| *** diablo_rojo has joined #openstack-infra | 22:35 | |
| *** sgw has joined #openstack-infra | 22:37 | |
| *** dchen has joined #openstack-infra | 22:40 | |
| openstackgerrit | Kendall Nelson proposed opendev/storyboard-webclient master: Converting a search query into a browse https://review.opendev.org/644424 | 22:44 |
| *** markvoelker has joined #openstack-infra | 22:50 | |
| *** rh-jelabarre has quit IRC | 22:51 | |
| *** rfolco_off has quit IRC | 22:56 | |
| fungi | #status log apache restarted on mirror.iad.rax.opendev.org at 22:16 utc, clearing stale content state | 22:58 |
| openstackstatus | fungi: finished logging | 22:58 |
| ianw | ok, i'm building afs-next now on iad | 23:02 |
| *** markvoelker has quit IRC | 23:05 | |
| *** tkajinam has joined #openstack-infra | 23:06 | |
| *** dmsimard0 has joined #openstack-infra | 23:08 | |
| *** dmsimard has quit IRC | 23:08 | |
| *** rcernin has joined #openstack-infra | 23:16 | |
| *** aaronsheffield has quit IRC | 23:17 | |
| openstackgerrit | Kendall Nelson proposed opendev/storyboard-webclient master: Converting a search query into a browse https://review.opendev.org/644424 | 23:20 |
| *** lseki has quit IRC | 23:29 | |
| openstackgerrit | Michael Johnson proposed openstack/diskimage-builder master: Add DIB_UBUNTU_KERNEL to ubuntu-minimal https://review.opendev.org/666063 | 23:39 |
| *** sthussey has quit IRC | 23:41 | |
| *** slaweq has quit IRC | 23:47 | |
| *** yamamoto has joined #openstack-infra | 23:53 | |
| *** ekultails has quit IRC | 23:58 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!