| *** Daisy_ has quit IRC | 00:03 | |
| ianw | cmurphy: http://zuul.openstack.org/stream.html?uuid=48faec91f69e452aae8cf2f156d0f009&logfile=console.log ... it does seem stuck again | 00:06 |
|---|---|---|
| *** xarses_ has quit IRC | 00:06 | |
| ianw | we've got two stack.sh's that are orphans -> http://paste.openstack.org/show/666852/ | 00:17 |
| *** hamzy_ has joined #openstack-infra | 00:17 | |
| *** felipemonteiro_ has joined #openstack-infra | 00:17 | |
| *** caphrim007_ has joined #openstack-infra | 00:21 | |
| *** gongysh has joined #openstack-infra | 00:21 | |
| *** dave-mccowan has joined #openstack-infra | 00:22 | |
| ianw | http://paste.openstack.org/show/666854/ -> [Zuul] standard output/error still open after child exited | 00:24 |
| ianw | i can only seem to see that in the /tmp/ file log | 00:24 |
| *** caphrim007 has quit IRC | 00:24 | |
| *** caphrim007_ has quit IRC | 00:25 | |
| *** threestrands has joined #openstack-infra | 00:27 | |
| *** threestrands has quit IRC | 00:27 | |
| *** threestrands has joined #openstack-infra | 00:27 | |
| *** ijw has quit IRC | 00:32 | |
| *** efoley has quit IRC | 00:34 | |
| *** matbu_ has joined #openstack-infra | 00:36 | |
| *** zhurong has joined #openstack-infra | 00:46 | |
| *** xinliang has joined #openstack-infra | 00:48 | |
| *** xinliang has quit IRC | 00:48 | |
| *** xinliang has joined #openstack-infra | 00:48 | |
| *** ijw has joined #openstack-infra | 00:48 | |
| *** matbu_ has quit IRC | 00:51 | |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul master: WIP Add zuul from scratch doc https://review.openstack.org/542518 | 00:52 |
| EmilienM | corvus: now I'm curious. Do you have a script that generate all the patches for "Zuul: Remove project name" with a sleep between? | 00:52 |
| *** gongysh has quit IRC | 00:52 | |
| ianw | cmurphy/mordred: started https://storyboard.openstack.org/#!/story/2001528 about this hang. i feel like our ansible_module_command.py but then there's a stuck swift process too? | 00:53 |
| ianw | i'll try another run and see if it's the same thing .... | 00:53 |
| corvus | EmilienM: yes, 20 minute sleep in between | 00:54 |
| *** VW has quit IRC | 00:54 | |
| EmilienM | corvus: nice :) | 00:54 |
| corvus | it has 171 patches left to go | 00:54 |
| EmilienM | corvus: much better than my bash script that run all in once. Next time I'll add sleeps | 00:54 |
| *** VW has joined #openstack-infra | 00:54 | |
| corvus | EmilienM: at AJaeger's suggestion, it does all master branches first, then others (so hopefully some changes will land on queens in time) | 00:54 |
| corvus | i also shuffiled the projects, so not all of the puppet projects get changes in sequence. that way you don't have to worry as much about when to approve -- you can just approve them as they come in | 00:55 |
| EmilienM | cool | 00:55 |
| *** ijw has quit IRC | 00:56 | |
| corvus | i have some ideas about how to make the configs more memory efficient, but i won't be able to get to that until probably late march or april at the earliest, so we deal with it the best we can for now :) | 00:56 |
| *** harlowja has joined #openstack-infra | 00:57 | |
| EmilienM | sleep driven deployment | 00:57 |
| EmilienM | welcome to tripleo | 00:57 |
| EmilienM | :) | 00:57 |
| corvus | heh | 00:57 |
| corvus | miraculously, i think i've uploaded 490 changes, and 378 of them are already closed | 00:59 |
| *** daidv_ has quit IRC | 01:05 | |
| *** dhill_ has quit IRC | 01:05 | |
| *** slaweq has joined #openstack-infra | 01:06 | |
| openstackgerrit | James E. Blair proposed openstack-infra/nodepool master: Default min-ready to 0 https://review.openstack.org/542410 | 01:06 |
| openstackgerrit | James E. Blair proposed openstack-infra/nodepool master: Store build logs automatically https://review.openstack.org/542386 | 01:06 |
| *** xinliang has quit IRC | 01:07 | |
| *** aviau has quit IRC | 01:08 | |
| *** aviau has joined #openstack-infra | 01:08 | |
| *** tosky has quit IRC | 01:09 | |
| *** slaweq has quit IRC | 01:10 | |
| *** zhurong has quit IRC | 01:11 | |
| *** verdurin has quit IRC | 01:12 | |
| *** verdurin_ has joined #openstack-infra | 01:12 | |
| *** zhurong has joined #openstack-infra | 01:14 | |
| *** xinliang has joined #openstack-infra | 01:20 | |
| *** xinliang has quit IRC | 01:20 | |
| *** xinliang has joined #openstack-infra | 01:20 | |
| *** xarses has joined #openstack-infra | 01:21 | |
| *** xinliang has quit IRC | 01:26 | |
| *** threestrands has quit IRC | 01:29 | |
| *** hongbin has joined #openstack-infra | 01:32 | |
| *** caphrim007 has joined #openstack-infra | 01:34 | |
| *** Jeffrey4l has joined #openstack-infra | 01:34 | |
| *** Daisy_ has joined #openstack-infra | 01:37 | |
| *** caphrim007 has quit IRC | 01:38 | |
| *** Nil_ has quit IRC | 01:38 | |
| openstackgerrit | Kendall Nelson proposed openstack-infra/project-config master: Enable StoryBoard Use for Election Repo https://review.openstack.org/542528 | 01:39 |
| *** Daisy_ has quit IRC | 01:39 | |
| openstackgerrit | Hongbin Lu proposed openstack-infra/irc-meetings master: Zun holds team meeting at #openstack-zun https://review.openstack.org/542529 | 01:39 |
| *** Daisy_ has joined #openstack-infra | 01:39 | |
| *** olaph has quit IRC | 01:41 | |
| *** olaph has joined #openstack-infra | 01:41 | |
| *** xinliang has joined #openstack-infra | 01:43 | |
| *** xinliang has quit IRC | 01:43 | |
| *** xinliang has joined #openstack-infra | 01:43 | |
| *** r-daneel has quit IRC | 01:45 | |
| *** Jeffrey4l_ has joined #openstack-infra | 01:46 | |
| *** Jeffrey4l has quit IRC | 01:47 | |
| dmsimard | corvus: your patch for the project name in ara made me realize about a regression I hadn't seen because no patches were sent for a while :/ | 01:48 |
| dmsimard | So corvus++ | 01:48 |
| *** caphrim007 has joined #openstack-infra | 01:48 | |
| *** Swami has quit IRC | 01:51 | |
| ianw | cmurphy / AJaeger : i strongly suspect that swift-init does not daemonize correctly; https://review.openstack.org/#/c/542535/ should (maybe?) tell us. this poses a range of questions; like why only on suse, why ansible doesn't clean up, etc etc | 01:52 |
| *** cuongnv has joined #openstack-infra | 01:54 | |
| *** salv-orlando has quit IRC | 01:56 | |
| notmyname | ianw: FWIW mattoliverau is taking a look | 02:00 |
| mattoliverau | ianw: I'll go throw up a suse swift dev env and have a poke | 02:01 |
| ianw | hmm, let me see if i can hold this node | 02:01 |
| ianw | well maybe it will be held when it fails i hope, not too sure | 02:05 |
| ianw | mattoliverau want to give me a public key and i can give you login? | 02:05 |
| mattoliverau | I can at least test swift-init on a suse vm and see if it also has problems with container-sync. | 02:07 |
| *** slaweq has joined #openstack-infra | 02:11 | |
| *** slaweq has quit IRC | 02:16 | |
| ianw | ohh, 542535 stuffs up and doesn't actually start the container-sync process ... but it does show that if it *isn't* running things work, so, yeah | 02:26 |
| *** liujiong has joined #openstack-infra | 02:30 | |
| *** namnh has joined #openstack-infra | 02:37 | |
| *** mriedem has quit IRC | 02:44 | |
| *** kiennt26 has joined #openstack-infra | 02:46 | |
| *** slaweq has joined #openstack-infra | 02:49 | |
| *** hamzy_ has quit IRC | 02:53 | |
| *** slaweq has quit IRC | 02:53 | |
| *** hamzy_ has joined #openstack-infra | 02:58 | |
| *** annp has joined #openstack-infra | 03:07 | |
| *** VW has quit IRC | 03:08 | |
| *** VW has joined #openstack-infra | 03:09 | |
| *** cuongnv has quit IRC | 03:09 | |
| *** cuongnv has joined #openstack-infra | 03:09 | |
| *** jlabarre has quit IRC | 03:21 | |
| *** olaph1 has joined #openstack-infra | 03:26 | |
| *** olaph has quit IRC | 03:29 | |
| *** suhdood has joined #openstack-infra | 03:29 | |
| openstackgerrit | Merged openstack-infra/irc-meetings master: Zun holds team meeting at #openstack-zun https://review.openstack.org/542529 | 03:30 |
| *** RuiChen has quit IRC | 03:37 | |
| *** Daisy_ has quit IRC | 03:39 | |
| *** nicolasbock has quit IRC | 03:39 | |
| *** Daisy_ has joined #openstack-infra | 03:39 | |
| prometheanfire | tonyb: regarding your email, shouldn't you ask here? | 03:42 |
| *** Daisy_ has quit IRC | 03:44 | |
| *** ykarel|away has joined #openstack-infra | 03:44 | |
| *** ykarel|away is now known as ykarel | 03:45 | |
| tonyb | prometheanfire: Perhaps I thought the norm now was to do it over there | 03:46 |
| *** liujiong has quit IRC | 03:46 | |
| *** dave-mccowan has quit IRC | 03:48 | |
| prometheanfire | eh, I'd do both, especially as the releases are more time sensitive now | 03:48 |
| *** nicolasbock has joined #openstack-infra | 03:49 | |
| *** yee37934 has joined #openstack-infra | 03:51 | |
| *** yee379 has quit IRC | 03:51 | |
| tonyb | prometheanfire: this is for ocata so isn't time-sensitive | 03:55 |
| prometheanfire | ah, k then | 03:55 |
| *** nicolasbock has quit IRC | 03:56 | |
| *** ramishra has joined #openstack-infra | 03:59 | |
| *** rosmaita has quit IRC | 04:02 | |
| *** gongysh has joined #openstack-infra | 04:04 | |
| *** psachin has joined #openstack-infra | 04:04 | |
| *** felipemonteiro__ has joined #openstack-infra | 04:05 | |
| *** felipemonteiro__ has quit IRC | 04:05 | |
| *** felipemonteiro__ has joined #openstack-infra | 04:06 | |
| *** felipemonteiro_ has quit IRC | 04:08 | |
| *** kiennt26 has quit IRC | 04:11 | |
| *** namnh has quit IRC | 04:13 | |
| *** cuongnv has quit IRC | 04:13 | |
| *** cuongnv has joined #openstack-infra | 04:16 | |
| *** slaweq has joined #openstack-infra | 04:16 | |
| *** slaweq has quit IRC | 04:21 | |
| *** cuongnv has quit IRC | 04:23 | |
| *** cuongnv has joined #openstack-infra | 04:24 | |
| *** gongysh has quit IRC | 04:26 | |
| *** gongysh has joined #openstack-infra | 04:26 | |
| *** kiennt26 has joined #openstack-infra | 04:27 | |
| *** gongysh has quit IRC | 04:27 | |
| *** slaweq has joined #openstack-infra | 04:29 | |
| *** felipemonteiro__ has quit IRC | 04:33 | |
| *** slaweq has quit IRC | 04:34 | |
| *** zhurong has quit IRC | 04:35 | |
| *** cuongnv has quit IRC | 04:37 | |
| *** suhdood has quit IRC | 04:37 | |
| ianw | tonyb: should be enqueued | 04:38 |
| tonyb | ianw: Thanks | 04:38 |
| ianw | corvus: i also might have noticed something; while zuul enqueue-ref was waiting, it seems like the status page was inaccessible? both rpc calls right; does one block the other? | 04:39 |
| *** VW has quit IRC | 04:48 | |
| *** VW has joined #openstack-infra | 04:49 | |
| ianw | tonyb: actually, trying again in release-post ... | 04:50 |
| *** VW has quit IRC | 04:50 | |
| *** VW has joined #openstack-infra | 04:50 | |
| *** links has joined #openstack-infra | 04:52 | |
| *** links has quit IRC | 04:54 | |
| *** gongysh has joined #openstack-infra | 04:54 | |
| *** dhajare has joined #openstack-infra | 04:57 | |
| *** ijw has joined #openstack-infra | 05:01 | |
| *** Daisy_ has joined #openstack-infra | 05:02 | |
| *** Daisy_ has quit IRC | 05:02 | |
| *** Daisy_ has joined #openstack-infra | 05:02 | |
| *** links has joined #openstack-infra | 05:03 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/project-config master: tools/build_image.sh : add some arm64 notes https://review.openstack.org/542591 | 05:03 |
| *** ijw has quit IRC | 05:06 | |
| *** links has quit IRC | 05:10 | |
| *** harlowja has quit IRC | 05:10 | |
| *** coolsvap has joined #openstack-infra | 05:10 | |
| *** andreas_s has joined #openstack-infra | 05:11 | |
| *** links has joined #openstack-infra | 05:12 | |
| *** claudiub|2 has joined #openstack-infra | 05:13 | |
| *** hongbin has quit IRC | 05:13 | |
| *** gongysh has quit IRC | 05:15 | |
| *** andreas_s has quit IRC | 05:17 | |
| *** VW has quit IRC | 05:18 | |
| *** VW has joined #openstack-infra | 05:19 | |
| *** salv-orlando has joined #openstack-infra | 05:21 | |
| *** VW has quit IRC | 05:23 | |
| *** auristor has quit IRC | 05:23 | |
| *** jchhatbar has joined #openstack-infra | 05:24 | |
| *** salv-orlando has quit IRC | 05:26 | |
| *** auristor has joined #openstack-infra | 05:26 | |
| *** harlowja has joined #openstack-infra | 05:35 | |
| *** slaweq has joined #openstack-infra | 05:35 | |
| *** zhurong has joined #openstack-infra | 05:36 | |
| *** jchhatbar is now known as janki | 05:37 | |
| *** harlowja has quit IRC | 05:39 | |
| *** slaweq has quit IRC | 05:40 | |
| *** dhajare has quit IRC | 05:53 | |
| *** aeng has quit IRC | 05:55 | |
| *** salv-orlando has joined #openstack-infra | 05:59 | |
| *** VW has joined #openstack-infra | 06:01 | |
| *** pgadiya has joined #openstack-infra | 06:03 | |
| *** e0ne has joined #openstack-infra | 06:05 | |
| *** VW has quit IRC | 06:06 | |
| *** e0ne has quit IRC | 06:06 | |
| dirk | AJaeger: cmurphy : sorry, I preferred sleeping. What's the conclusion so far? | 06:18 |
| AJaeger | dirk: best ask mattoliverau as well, looked like a swift init problem. I just glanced over scrollback | 06:23 |
| *** pcichy has joined #openstack-infra | 06:24 | |
| *** pbourke has quit IRC | 06:30 | |
| *** VW has joined #openstack-infra | 06:30 | |
| dirk | AJaeger: mattoliverau : ah, that rings a bell.. we had issues with Swift-init already in the past | 06:30 |
| *** VW has quit IRC | 06:35 | |
| openstackgerrit | Kota Tsuyuzaki proposed openstack-infra/project-config master: Add release-note-job to storlets project https://review.openstack.org/542626 | 06:35 |
| *** VW has joined #openstack-infra | 06:38 | |
| *** salv-orlando has quit IRC | 06:39 | |
| *** dhajare has joined #openstack-infra | 06:39 | |
| *** cuongnv has joined #openstack-infra | 06:40 | |
| *** VW has quit IRC | 06:42 | |
| openstackgerrit | Merged openstack-infra/nodepool master: Add default logging configuration https://review.openstack.org/541921 | 06:43 |
| *** slaweq has joined #openstack-infra | 06:45 | |
| *** slaweq has quit IRC | 06:50 | |
| openstackgerrit | Merged openstack-infra/nodepool master: Exit launchers and builders immediately https://review.openstack.org/541930 | 06:53 |
| openstackgerrit | Merged openstack-infra/nodepool master: Exercise pidfile before daemonizing https://review.openstack.org/542315 | 06:53 |
| openstackgerrit | Merged openstack-infra/nodepool master: Resolve paths before demonization https://review.openstack.org/542353 | 06:53 |
| openstackgerrit | Merged openstack-infra/nodepool master: Default min-ready to 0 https://review.openstack.org/542410 | 06:53 |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config master: Move release-tools out of jenkins/scripts https://review.openstack.org/542639 | 06:55 |
| *** xarses has quit IRC | 07:01 | |
| *** andreas_s has joined #openstack-infra | 07:03 | |
| *** namnh has joined #openstack-infra | 07:03 | |
| *** olaph has joined #openstack-infra | 07:04 | |
| *** olaph1 has quit IRC | 07:05 | |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/openstack-zuul-jobs master: Consolidate legacy scripts https://review.openstack.org/542648 | 07:08 |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/openstack-zuul-jobs master: Move more slave scripts over from project-config https://review.openstack.org/542649 | 07:08 |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config master: Remove some moved slave scripts https://review.openstack.org/542651 | 07:09 |
| *** olaph1 has joined #openstack-infra | 07:10 | |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/openstack-zuul-jobs master: Move more slave scripts over from project-config https://review.openstack.org/542649 | 07:11 |
| *** olaph has quit IRC | 07:12 | |
| *** VW has joined #openstack-infra | 07:12 | |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config master: Remove some moved slave scripts https://review.openstack.org/542651 | 07:15 |
| ianw | dirk: yep, see https://review.openstack.org/#/c/542535/ and the storyboard bug in there | 07:16 |
| *** rcernin has quit IRC | 07:17 | |
| *** VW has quit IRC | 07:17 | |
| ianw | corvus: another potential issue; i'm not sure if TIMED_OUT nodes get caught by the autohold matching. at least it didn't seem to for the suse one i've setup | 07:18 |
| *** snapiri has quit IRC | 07:19 | |
| AJaeger | ianw: you've given a -1 on https://review.openstack.org/#/c/539686/ - but that has a depends-on, so should be fine to not merge by accident. Or do you wait for another change? | 07:20 |
| ianw | AJaeger: oh, what i meant was that the change actually has to be in executors, which requires restarting them all? | 07:21 |
| AJaeger | ianw: I would +2A andreaf's https://review.openstack.org/#/c/540485/ | 07:22 |
| AJaeger | ianw: really? that's a zuul-jobs change. | 07:22 |
| ianw | oh, maybe i misread it | 07:23 |
| AJaeger | please double check - and if you agree, let's merge 540485 | 07:23 |
| ianw | yep, thanks | 07:23 |
| ianw | ok, i'm about to disappear so don't want to merge zuul-jobs :) too scary | 07:24 |
| AJaeger | ianw: have a nice weekend! | 07:24 |
| ianw | cheers, ttyl | 07:24 |
| *** slaweq has joined #openstack-infra | 07:25 | |
| *** eumel8 has joined #openstack-infra | 07:26 | |
| *** e0ne has joined #openstack-infra | 07:27 | |
| *** pcaruana has joined #openstack-infra | 07:35 | |
| *** florianf has joined #openstack-infra | 07:36 | |
| *** gongysh has joined #openstack-infra | 07:38 | |
| mattoliverau | Yeah, I gave some suggestions, try with a -w so swift-ring-builder doesn't try bad hold a pipe to the daemon it's launching and see if that helps, or use run_process or whatever it's called in devstack (on my phone so can't look it up) | 07:39 |
| mattoliverau | Sorry, swift-init. | 07:39 |
| mattoliverau | Somehow swift-ring-builder autocompletes in my phone.. curse of a swift dev me thinks :p | 07:40 |
| openstackgerrit | Merged openstack-infra/zuul-jobs master: Change the list of extensions to a dict https://review.openstack.org/540485 | 07:47 |
| AJaeger | andreaf: ^ | 07:48 |
| *** alexchadin has joined #openstack-infra | 07:48 | |
| *** VW has joined #openstack-infra | 07:49 | |
| *** VW has quit IRC | 07:54 | |
| openstackgerrit | Frank Kloeker proposed openstack-infra/project-config master: Setup translation jobs for Queens https://review.openstack.org/542146 | 07:58 |
| eumel8 | good morning, eu-infra: ^^ Horizon has release branch and we want to setup translation jobs asap, thx :) | 07:59 |
| openstackgerrit | Spyros Trigazis (strigazi) proposed openstack-infra/project-config master: Switch magnum to release-openstack-server https://review.openstack.org/542703 | 08:04 |
| *** snapiri has joined #openstack-infra | 08:06 | |
| *** kjackal has joined #openstack-infra | 08:06 | |
| *** dtantsur|afk is now known as dtantsur | 08:08 | |
| *** vaidy has quit IRC | 08:08 | |
| *** isviridov_away has quit IRC | 08:08 | |
| *** jpena|off is now known as jpena | 08:10 | |
| openstackgerrit | Hoang Trung Hieu proposed openstack/diskimage-builder master: Add iscsi-boot element https://review.openstack.org/542708 | 08:11 |
| *** pcichy has quit IRC | 08:13 | |
| *** pcichy has joined #openstack-infra | 08:14 | |
| *** amoralej|off is now known as amoralej | 08:16 | |
| *** ralonsoh has joined #openstack-infra | 08:17 | |
| *** olaph has joined #openstack-infra | 08:18 | |
| *** aviau has quit IRC | 08:19 | |
| *** olaph1 has quit IRC | 08:19 | |
| *** aviau has joined #openstack-infra | 08:19 | |
| AJaeger | eumel8: http://lists.openstack.org/pipermail/openstack-dev/2018-January/126836.html - I suggest to remove neutron-lbaas-dashboard from the list | 08:23 |
| *** makowals has quit IRC | 08:23 | |
| *** tesseract has joined #openstack-infra | 08:26 | |
| *** jchhatbar has joined #openstack-infra | 08:27 | |
| *** namnh has quit IRC | 08:27 | |
| *** VW has joined #openstack-infra | 08:28 | |
| *** janki has quit IRC | 08:29 | |
| *** d0ugal has quit IRC | 08:33 | |
| *** VW has quit IRC | 08:34 | |
| eumel8 | AJaeger: just wondering why there are a stable/queens branch in the repo | 08:35 |
| *** jchhatbar has quit IRC | 08:41 | |
| *** jchhatbar has joined #openstack-infra | 08:41 | |
| *** rossella_s has quit IRC | 08:42 | |
| *** hashar has joined #openstack-infra | 08:43 | |
| *** d0ugal has joined #openstack-infra | 08:47 | |
| AJaeger | eumel8: it's not dead yet. So, translation is fine - I just would not put it into the priority list. Your call... | 08:49 |
| *** jchhatbar has quit IRC | 08:54 | |
| *** armaan has joined #openstack-infra | 08:54 | |
| *** jchhatbar has joined #openstack-infra | 08:54 | |
| openstackgerrit | Frank Kloeker proposed openstack-infra/project-config master: Setup translation jobs for Queens https://review.openstack.org/542146 | 08:55 |
| eumel8 | AJaeger: got it, thx | 08:55 |
| *** gfidente has joined #openstack-infra | 08:56 | |
| *** pbourke has joined #openstack-infra | 08:57 | |
| *** jchhatbar has quit IRC | 09:01 | |
| *** jchhatbar has joined #openstack-infra | 09:01 | |
| AJaeger | eumel8: in the past we stopped translation of oldest releases when new one opened - do you want to keep ocata translations? There might not be releases done for those anymore | 09:01 |
| *** jpich has joined #openstack-infra | 09:02 | |
| *** VW has joined #openstack-infra | 09:03 | |
| eumel8 | AJaeger: I want to recheck all repos later the day. Ocata EOL is 2018-02-26. Then we would remove the sync as usualy. | 09:07 |
| *** alexchadin has quit IRC | 09:07 | |
| *** VW has quit IRC | 09:08 | |
| AJaeger | ok | 09:08 |
| *** alexchadin has joined #openstack-infra | 09:08 | |
| *** ykarel is now known as ykarel|lunch | 09:08 | |
| *** ajo has quit IRC | 09:14 | |
| *** ajo has joined #openstack-infra | 09:14 | |
| *** zhurong has quit IRC | 09:16 | |
| *** Jeffrey4l_ has quit IRC | 09:17 | |
| *** Jeffrey4l has joined #openstack-infra | 09:18 | |
| openstackgerrit | liumengke proposed openstack-infra/system-config master: fix somes typos in doc file. https://review.openstack.org/542740 | 09:18 |
| *** Daisy_ has quit IRC | 09:21 | |
| *** hoangcx has joined #openstack-infra | 09:22 | |
| strigazi | AJaeger: a lot of spam in openstack-container | 09:22 |
| strigazi | AJaeger: a lot of spam in openstack-containers | 09:22 |
| strigazi | :) | 09:22 |
| AJaeger | strigazi: sorry to hear ;( Nothing I can help with... | 09:23 |
| *** dbecker has joined #openstack-infra | 09:23 | |
| Diabelko | fungi: circling back to our discussion from yesterday - would multi-node setup or bigger flavor be possible to have? | 09:23 |
| strigazi | AJaeger: who should I ping? I though someone from infra team was blocking them, no? | 09:24 |
| AJaeger | strigazi: irc channel or mailing list? | 09:25 |
| strigazi | AJaeger channel | 09:25 |
| AJaeger | strigazi: we've done some temporary blocking of not authenticated users - no idea how ;( | 09:26 |
| *** hjensas|afk is now known as hjensas | 09:26 | |
| *** jchhatbar has quit IRC | 09:27 | |
| *** jchhatbar has joined #openstack-infra | 09:27 | |
| AJaeger | strigazi, run /msg chanserv access #openstack-containers list | 09:27 |
| AJaeger | it shows who's op and can block people | 09:27 |
| AJaeger | strigazi: and there's https://docs.openstack.org/infra/system-config/irc.html#banning-disruptive-users | 09:28 |
| strigazi | AJaeger: ttx and yolanda are in the list and in this timezone, can I add myself in project-config? | 09:29 |
| AJaeger | strigazi: you should ask one of them to give you the permissions for that specific channel | 09:30 |
| strigazi | AJaeger: thanks | 09:30 |
| AJaeger | I see it's silent again - but let's be prepared for next time... | 09:30 |
| strigazi | AJaeger: thanks again Andreas, you're very helpful as always | 09:31 |
| AJaeger | strigazi: you're welcome | 09:31 |
| *** jchhatbar has quit IRC | 09:34 | |
| *** efoley has joined #openstack-infra | 09:34 | |
| *** jchhatbar has joined #openstack-infra | 09:34 | |
| *** VW has joined #openstack-infra | 09:36 | |
| *** jchhatbar is now known as janki | 09:37 | |
| *** edmondsw has joined #openstack-infra | 09:40 | |
| *** VW has quit IRC | 09:41 | |
| Diabelko | fungi: I'm asking, because right now we use 10vCPU/32GB for our unittests/systets, however we should be able to fit into something like 4-8vCPU and 16GB of RAM | 09:41 |
| *** dprince has joined #openstack-infra | 09:41 | |
| Diabelko | (and we use full deployment for those) | 09:42 |
| Diabelko | and if multinode is possible, two 8vcpu/8gb nodes would be fine | 09:42 |
| AJaeger | Diabelko: fungi is US east coast based, he won't be around normally before 14:00 UTC | 09:43 |
| Diabelko | I know ;) | 09:43 |
| AJaeger | Diabelko: he might read backscroll and then answer asynchronously ;) | 09:43 |
| Diabelko | I'm just writing that so I won't forget | 09:43 |
| AJaeger | Diabelko: Sure, go ahead... | 09:43 |
| *** olaph1 has joined #openstack-infra | 09:43 | |
| Diabelko | that's fine, I'll be available in the evening too, so we'll talk later | 09:43 |
| *** olaph has quit IRC | 09:44 | |
| *** edmondsw has quit IRC | 09:45 | |
| *** shardy has joined #openstack-infra | 09:49 | |
| *** sambetts|afk is now known as sambetts | 09:50 | |
| *** tpsilva has joined #openstack-infra | 09:50 | |
| *** pcichy has quit IRC | 09:53 | |
| *** pgadiya has quit IRC | 09:54 | |
| *** pgadiya has joined #openstack-infra | 09:54 | |
| *** derekh has joined #openstack-infra | 10:01 | |
| *** hoangcx has quit IRC | 10:03 | |
| *** pcichy has joined #openstack-infra | 10:04 | |
| *** gongysh has quit IRC | 10:06 | |
| *** ihrachys has quit IRC | 10:11 | |
| *** ykarel|lunch is now known as ykarel | 10:11 | |
| cmurphy | I'm so popular today | 10:14 |
| *** VW has joined #openstack-infra | 10:16 | |
| *** VW has quit IRC | 10:20 | |
| *** dprince has quit IRC | 10:20 | |
| *** pcichy has quit IRC | 10:21 | |
| *** cuongnv has quit IRC | 10:22 | |
| *** annp has quit IRC | 10:22 | |
| *** kjackal has quit IRC | 10:23 | |
| *** kjackal has joined #openstack-infra | 10:24 | |
| *** zoli is now known as zoli|lunch | 10:28 | |
| *** zoli|lunch is now known as zoli | 10:28 | |
| *** ldnunes has joined #openstack-infra | 10:29 | |
| *** alexchadin has quit IRC | 10:31 | |
| *** gongysh has joined #openstack-infra | 10:35 | |
| openstackgerrit | Balazs Gibizer proposed openstack-infra/project-config master: consolidate nova job definitions https://review.openstack.org/538908 | 10:35 |
| *** efoley has quit IRC | 10:36 | |
| *** dtantsur is now known as dtantsur|bbl | 10:43 | |
| *** efoley has joined #openstack-infra | 10:43 | |
| *** ihrachys has joined #openstack-infra | 10:44 | |
| *** efoley_ has joined #openstack-infra | 10:44 | |
| *** efoley has quit IRC | 10:44 | |
| andreaf | AJaeger \o/ thanks :) | 10:45 |
| *** armaan has quit IRC | 10:46 | |
| AJaeger | andreaf: let's get the three changes in quickly - before we branch those repos ;) | 10:46 |
| *** VW has joined #openstack-infra | 10:47 | |
| *** kjackal has quit IRC | 10:47 | |
| andreaf | AJaeger: heh we won't branch tempest - but good yeah I'm all for getting them merged in | 10:48 |
| andreaf | AJaeger: I think there are enough +1 / +2 on the devstack one, I'll just approve it | 10:49 |
| *** VW has quit IRC | 10:52 | |
| *** chandankumar has quit IRC | 10:54 | |
| *** tosky has joined #openstack-infra | 10:54 | |
| *** gongysh has quit IRC | 10:56 | |
| AJaeger | andreaf: the networking-odl one is important as well - see https://review.openstack.org/#/c/539854/ | 10:56 |
| *** lucas-afk is now known as lucasagomes | 10:57 | |
| andreaf | AJaeger: yeah well I have no +2 power there but I left a comment | 10:58 |
| *** d0ugal has quit IRC | 10:59 | |
| AJaeger | andreaf: thanks - mpeterson, do you want to ask the networking-odl cores? I just added them to the review... | 11:00 |
| andreaf | AJaeger: I'm looking to add qa-release to devstack-container-plugin ACLs once https://review.openstack.org/#/c/540906/ merges | 11:05 |
| andreaf | AJaeger: but I cannot find qa-release anywhere in the ACLs in git | 11:05 |
| andreaf | AJaeger: could it be that it has been added manually to other repos and not reflected in git? is there a way to search in gerrit for that? | 11:06 |
| andreaf | AJaeger: because I think qa-release is how QA PTLs get +2 on all qa repos so I think it is used | 11:07 |
| AJaeger | andreaf: indeed, qa-release does not appear in project-config - and neither in its history | 11:08 |
| *** pbourke has quit IRC | 11:08 | |
| AJaeger | andreaf: what is causing a problem for you here? | 11:09 |
| andreaf | AJaeger: I guess it's because it's added to the projects release group https://review.openstack.org/#/admin/groups/416,members | 11:10 |
| andreaf | AJaeger: no I was just wondering how to make sure QA PTLs have +2 on the new QA project but I guess it will just be a matter of adding the qa-release group to their release group | 11:10 |
| AJaeger | wait. Why do you need release group for the repo? | 11:11 |
| AJaeger | as it's soon an official team, the release team can tag for you - no need to setup release ACLs anymore | 11:12 |
| AJaeger | andreaf: for +2: https://review.openstack.org/#/admin/groups/1751,members | 11:12 |
| AJaeger | It includes devstack-core - so, all should be set, isn't it? | 11:13 |
| AJaeger | (and devstack-core includes qa-release) | 11:13 |
| AJaeger | But you can add other groups there *already* manually | 11:13 |
| AJaeger | So, looks like nothing needs to be done - agreed? | 11:14 |
| andreaf | AJaeger: ah yeah it's already there | 11:14 |
| andreaf | AJaeger never mind sorry to bother you for nothing :P | 11:14 |
| andreaf | thanks! | 11:14 |
| *** d0ugal has joined #openstack-infra | 11:16 | |
| *** kiennt26 has quit IRC | 11:16 | |
| *** chandankumar has joined #openstack-infra | 11:17 | |
| *** VW has joined #openstack-infra | 11:20 | |
| *** pbourke has joined #openstack-infra | 11:20 | |
| robcresswell | @AJaeger Hey, just an observation; the twitter bouncer for the Infra updates splits messages at the old ~140 char limit. I think 280 is standard for everyone now, so that could be adjusted to make consumption of those messages a little nicer. Not sure who / how thats managed. If its open, I can take a look. | 11:23 |
| *** eroux has quit IRC | 11:24 | |
| *** VW has quit IRC | 11:24 | |
| *** alexchadin has joined #openstack-infra | 11:28 | |
| *** rfolco|off is now known as rfolco|rover | 11:30 | |
| AJaeger | robcresswell: see https://review.openstack.org/#/c/368238/ | 11:32 |
| AJaeger | robcresswell: that's all I know - and 280 char support would be appreciated! | 11:32 |
| *** kiennt26 has joined #openstack-infra | 11:32 | |
| *** eroux has joined #openstack-infra | 11:34 | |
| *** armaan has joined #openstack-infra | 11:39 | |
| *** kiennt26 has quit IRC | 11:41 | |
| robcresswell | AJaeger: Looks like its in an upstream lib: https://github.com/openstack-infra/statusbot/commit/d01cfd3994c79fa060a5139549afaf0ff19803de#diff-7cd243fc364361e5be4ca858dfa1f7a0 | 11:43 |
| robcresswell | I'll go digging :) | 11:44 |
| *** hjensas has quit IRC | 11:44 | |
| AJaeger | thanks, robcresswell | 11:45 |
| *** hjensas has joined #openstack-infra | 11:45 | |
| *** hjensas has quit IRC | 11:45 | |
| *** hjensas has joined #openstack-infra | 11:45 | |
| *** kjackal has joined #openstack-infra | 11:46 | |
| *** olaph has joined #openstack-infra | 11:47 | |
| *** nicolasbock has joined #openstack-infra | 11:47 | |
| *** olaph1 has quit IRC | 11:47 | |
| robcresswell | AJaeger: Just to report back; feature was added in https://github.com/bear/python-twitter/pull/525 but PyPI doesn't have 3.3.1. There's an open issue (https://github.com/bear/python-twitter/issues/516) to publish the new version. So it's supported, just waiting on a release. Thanks for the earlier link, that really helped get me started. | 11:51 |
| *** VW has joined #openstack-infra | 11:54 | |
| *** VW has quit IRC | 11:59 | |
| *** alexchadin has quit IRC | 12:11 | |
| *** alexchadin has joined #openstack-infra | 12:12 | |
| *** jlabarre has joined #openstack-infra | 12:13 | |
| *** alexchadin has quit IRC | 12:16 | |
| *** alexchadin has joined #openstack-infra | 12:17 | |
| *** alexchadin has quit IRC | 12:20 | |
| *** alexchadin has joined #openstack-infra | 12:21 | |
| *** VW has joined #openstack-infra | 12:25 | |
| AJaeger | robcresswell: thanks for digging into this! | 12:26 |
| robcresswell | You're welcome :) | 12:27 |
| *** VW has quit IRC | 12:30 | |
| *** simonmcc has quit IRC | 12:34 | |
| *** simonmcc has joined #openstack-infra | 12:35 | |
| *** aviau has quit IRC | 12:35 | |
| *** aviau has joined #openstack-infra | 12:36 | |
| *** efoley_ has quit IRC | 12:37 | |
| *** dtantsur|bbl is now known as dtantsur | 12:40 | |
| *** dangers_away has quit IRC | 12:42 | |
| *** vabada has joined #openstack-infra | 12:46 | |
| *** ramishra has quit IRC | 12:48 | |
| *** serverascode has quit IRC | 12:48 | |
| *** serverascode has joined #openstack-infra | 12:49 | |
| *** ameade has quit IRC | 12:50 | |
| *** ameade has joined #openstack-infra | 12:51 | |
| *** olaph1 has joined #openstack-infra | 12:52 | |
| *** olaph has quit IRC | 12:53 | |
| *** armaan has quit IRC | 12:56 | |
| *** VW has joined #openstack-infra | 13:03 | |
| *** agopi_out has quit IRC | 13:05 | |
| *** VW has quit IRC | 13:07 | |
| *** jcoufal has joined #openstack-infra | 13:08 | |
| *** kiennt26 has joined #openstack-infra | 13:08 | |
| *** rfolco|rover is now known as rfolco|lunch | 13:12 | |
| *** tesseract has quit IRC | 13:12 | |
| *** kiennt26 has quit IRC | 13:12 | |
| *** vabada has quit IRC | 13:14 | |
| *** fdegir has quit IRC | 13:14 | |
| *** jpena is now known as jpena|lunch | 13:15 | |
| *** fdegir has joined #openstack-infra | 13:15 | |
| *** kklimonda has quit IRC | 13:15 | |
| *** kklimonda has joined #openstack-infra | 13:16 | |
| *** ramishra has joined #openstack-infra | 13:17 | |
| *** psachin has quit IRC | 13:22 | |
| *** psachin has joined #openstack-infra | 13:24 | |
| *** kiennt26 has joined #openstack-infra | 13:26 | |
| *** ameeda has quit IRC | 13:28 | |
| *** xyang has quit IRC | 13:33 | |
| *** xyang has joined #openstack-infra | 13:34 | |
| *** betherly has quit IRC | 13:34 | |
| *** betherly has joined #openstack-infra | 13:35 | |
| *** olaph has joined #openstack-infra | 13:36 | |
| *** olaph1 has quit IRC | 13:36 | |
| *** alexchadin has quit IRC | 13:39 | |
| *** gibi is now known as giblet | 13:43 | |
| *** tpsilva has quit IRC | 13:43 | |
| *** tpsilva has joined #openstack-infra | 13:43 | |
| *** olaph1 has joined #openstack-infra | 13:44 | |
| *** alexchadin has joined #openstack-infra | 13:44 | |
| *** bauzas is now known as bauwser | 13:45 | |
| openstackgerrit | Marc Aubry proposed openstack-infra/project-config master: Create stable/* specific ACL https://review.openstack.org/542464 | 13:45 |
| *** dave-mccowan has joined #openstack-infra | 13:46 | |
| *** olaph has quit IRC | 13:46 | |
| *** alexchadin has quit IRC | 13:47 | |
| *** alexchadin has joined #openstack-infra | 13:49 | |
| *** trown|outtypewww is now known as trown | 13:49 | |
| *** psachin has quit IRC | 13:49 | |
| *** alexchadin has quit IRC | 13:52 | |
| *** vdrok has quit IRC | 13:52 | |
| *** vdrok has joined #openstack-infra | 13:53 | |
| *** dave-mcc_ has joined #openstack-infra | 13:53 | |
| *** edmondsw has joined #openstack-infra | 13:54 | |
| *** dsariel has quit IRC | 13:55 | |
| *** dave-mccowan has quit IRC | 13:55 | |
| *** yamamoto has quit IRC | 13:56 | |
| *** NobodyCam has quit IRC | 13:56 | |
| *** NobodyCam has joined #openstack-infra | 13:56 | |
| *** yamamoto has joined #openstack-infra | 13:56 | |
| *** links has quit IRC | 13:56 | |
| *** yamamoto has quit IRC | 13:57 | |
| *** yamamoto has joined #openstack-infra | 13:57 | |
| *** mriedem has joined #openstack-infra | 13:57 | |
| *** dhajare has quit IRC | 13:58 | |
| *** agopi_out has joined #openstack-infra | 14:00 | |
| *** alexchadin has joined #openstack-infra | 14:01 | |
| *** TheJulia has quit IRC | 14:02 | |
| *** TheJulia has joined #openstack-infra | 14:02 | |
| openstackgerrit | Merged openstack-infra/grafyaml master: Add support to change the default time filter range https://review.openstack.org/530798 | 14:03 |
| *** johnsom has quit IRC | 14:03 | |
| *** rosmaita has joined #openstack-infra | 14:03 | |
| *** Goneri has joined #openstack-infra | 14:04 | |
| *** johnsom has joined #openstack-infra | 14:04 | |
| *** vaidy has joined #openstack-infra | 14:05 | |
| *** isviridov_away has joined #openstack-infra | 14:06 | |
| *** agopi_out has quit IRC | 14:08 | |
| *** dsariel has joined #openstack-infra | 14:08 | |
| AJaeger | config-core, what do you think of these further slave_scripts cleanups? https://review.openstack.org/#/c/542648/ and https://review.openstack.org/#/c/542649/ - and then https://review.openstack.org/542651 . Reviews wwelcome | 14:10 |
| openstackgerrit | Merged openstack-infra/grafyaml master: Add yaxes format for newer versions of Grafana https://review.openstack.org/541825 | 14:11 |
| *** rfolco|lunch is now known as rfolco|rover | 14:14 | |
| *** ethfci_ has joined #openstack-infra | 14:15 | |
| *** ethfci has quit IRC | 14:15 | |
| *** dave-mcc_ has quit IRC | 14:17 | |
| *** jpena|lunch is now known as jpena | 14:18 | |
| pabelanger | We have a snowstorm rolling through today, in case i disappear for a while | 14:19 |
| *** amoralej is now known as amoralej|lunch | 14:20 | |
| *** ethfci_ has quit IRC | 14:21 | |
| *** olaph has joined #openstack-infra | 14:22 | |
| *** ethfci has joined #openstack-infra | 14:22 | |
| *** pgadiya has quit IRC | 14:23 | |
| *** olaph1 has quit IRC | 14:23 | |
| *** weshay is now known as weshay|ruck | 14:24 | |
| *** sshnaidm has quit IRC | 14:24 | |
| *** tesseract has joined #openstack-infra | 14:28 | |
| *** slaweq has quit IRC | 14:28 | |
| *** slaweq has joined #openstack-infra | 14:29 | |
| *** david-lyle has quit IRC | 14:29 | |
| *** dave-mccowan has joined #openstack-infra | 14:30 | |
| *** VW has joined #openstack-infra | 14:30 | |
| *** VW has quit IRC | 14:30 | |
| *** ramishra has quit IRC | 14:31 | |
| *** VW has joined #openstack-infra | 14:31 | |
| *** coolsvap has quit IRC | 14:33 | |
| *** slaweq has quit IRC | 14:33 | |
| *** dsariel has quit IRC | 14:35 | |
| *** eharney has joined #openstack-infra | 14:36 | |
| *** stephenfin is now known as finucannot | 14:38 | |
| *** pcichy has joined #openstack-infra | 14:40 | |
| *** kmalloc has quit IRC | 14:40 | |
| *** dave-mccowan has quit IRC | 14:40 | |
| *** kmalloc has joined #openstack-infra | 14:40 | |
| *** lucasagomes is now known as lucas-hungry | 14:43 | |
| *** berendt has quit IRC | 14:46 | |
| *** berendt has joined #openstack-infra | 14:46 | |
| dhellmann | pabelanger : do you have a second to take a look at https://review.openstack.org/#/c/542703/ before that blizzard hits? | 14:51 |
| *** hogepodge has quit IRC | 14:51 | |
| pabelanger | sure | 14:52 |
| *** vabada has joined #openstack-infra | 14:52 | |
| *** hogepodge has joined #openstack-infra | 14:52 | |
| *** wolverineav has joined #openstack-infra | 14:52 | |
| *** vabada has quit IRC | 14:52 | |
| *** vabada has joined #openstack-infra | 14:53 | |
| *** vabada has quit IRC | 14:53 | |
| *** kiennt26 has quit IRC | 14:54 | |
| AJaeger | pabelanger: could you review https://review.openstack.org/#/c/542648/ as well, please? | 14:54 |
| *** vabada has joined #openstack-infra | 14:54 | |
| *** kiennt26 has joined #openstack-infra | 14:54 | |
| *** ykarel is now known as ykarel|away | 14:56 | |
| *** r-daneel has joined #openstack-infra | 14:57 | |
| openstackgerrit | Merged openstack-infra/project-config master: Switch magnum to release-openstack-server https://review.openstack.org/542703 | 14:57 |
| *** salv-orlando has joined #openstack-infra | 14:59 | |
| *** salv-orlando has quit IRC | 14:59 | |
| fungi | Diabelko: i'm still catching up on scrollback, but yes we have plenty of jobs which utilize multiple nodes (for a variety of reasons, but distributing work across them would certainly be a valid one). zuul now supports jobs defining arbitrarily large sets of nodes for a job | 15:00 |
| *** hjensas is now known as hjensas|afk | 15:00 | |
| *** efoley has joined #openstack-infra | 15:01 | |
| *** dangers_away has joined #openstack-infra | 15:01 | |
| *** ykarel|away has quit IRC | 15:01 | |
| fungi | robcresswell: AJaeger: yeah, i don't know how clearly we've documented the fact but we have been waiting for upstream support to appear in the package on pypi before we can up the message length. known issue, sorry it wasn't more readily discoverable :/ | 15:01 |
| *** agopi_out has joined #openstack-infra | 15:02 | |
| *** andreas_s has quit IRC | 15:03 | |
| *** dave-mccowan has joined #openstack-infra | 15:03 | |
| openstackgerrit | Alex Krzos proposed openstack-infra/grafyaml master: Allow dashboards to be tagged https://review.openstack.org/541898 | 15:04 |
| *** andreas_s has joined #openstack-infra | 15:04 | |
| *** auristor has quit IRC | 15:04 | |
| AJaeger | thanks, pabelanger | 15:05 |
| *** hongbin has joined #openstack-infra | 15:06 | |
| *** agopi_out is now known as agopi | 15:07 | |
| *** amoralej|lunch is now known as amoralej | 15:07 | |
| *** alexchadin has quit IRC | 15:08 | |
| *** andreas_s has quit IRC | 15:08 | |
| *** felipemonteiro__ has joined #openstack-infra | 15:12 | |
| AJaeger | fungi, could you review https://review.openstack.org/#/c/542648/ as well, please? | 15:13 |
| *** caphrim007 has quit IRC | 15:13 | |
| *** auristor has joined #openstack-infra | 15:13 | |
| fungi | sure, may happen after the release meeting | 15:16 |
| openstackgerrit | Doug Hellmann proposed openstack-infra/project-config master: tacker-horizon seems to need the horizon-specific release jobs https://review.openstack.org/542879 | 15:17 |
| fungi | AJaeger: i'll trade you for 542879 ;) | 15:19 |
| fungi | release blocker, looks like | 15:19 |
| * fungi checks for the failed job logs | 15:20 | |
| *** felipemonteiro_ has joined #openstack-infra | 15:21 | |
| openstackgerrit | Merged openstack-infra/grafyaml master: Allow dashboards to be tagged https://review.openstack.org/541898 | 15:21 |
| fungi | dhellmann: was tacker-horizon caught through manual inspection? i don't see it on the release-job-failures ml | 15:22 |
| dhellmann | fungi : the auto-validation detected the potential issue, and inspecting the repo I see horizon in the tox.ini deps list | 15:22 |
| fungi | dhellmann: thanks for confirming! | 15:23 |
| dhellmann | fungi : thanks for checking my math, so to speak | 15:23 |
| *** felipemonteiro__ has quit IRC | 15:25 | |
| *** slaweq has joined #openstack-infra | 15:25 | |
| openstackgerrit | Alex Krzos proposed openstack-infra/grafyaml master: Add links to GrafYaml https://review.openstack.org/542395 | 15:27 |
| *** slaweq has quit IRC | 15:30 | |
| *** david-lyle has joined #openstack-infra | 15:30 | |
| *** lucas-hungry is now known as lucasagomes | 15:36 | |
| openstackgerrit | Merged openstack-infra/openstack-zuul-jobs master: Consolidate legacy scripts https://review.openstack.org/542648 | 15:38 |
| openstackgerrit | Merged openstack-infra/openstack-zuul-jobs master: Move more slave scripts over from project-config https://review.openstack.org/542649 | 15:39 |
| *** salv-orlando has joined #openstack-infra | 15:47 | |
| *** slaweq has joined #openstack-infra | 15:48 | |
| openstackgerrit | James E. Blair proposed openstack-infra/nodepool master: Store build logs automatically https://review.openstack.org/542386 | 15:50 |
| *** david-lyle has quit IRC | 15:51 | |
| *** camunoz has joined #openstack-infra | 15:53 | |
| *** hashar is now known as hasharAway | 15:54 | |
| *** david-lyle has joined #openstack-infra | 15:55 | |
| *** kiennt26 has quit IRC | 15:56 | |
| mtreinish | infra-root: we pushed a new subunit2sql release last night, and I think the subunit gearman workers have all fallen over | 15:57 |
| mtreinish | I'm not seeing any events on firehose from the workers any more and the db doesn't have any recent entries | 15:57 |
| mtreinish | infra-root: if someone gets a sec could they take a look | 15:58 |
| *** r-daneel has quit IRC | 15:59 | |
| *** ijw has joined #openstack-infra | 16:00 | |
| *** hasharAway has quit IRC | 16:00 | |
| fungi | infra-root: i've confirmed the mailman versions listed at https://people.canonical.com/~ubuntu-security/cve/2018/CVE-2018-5950.html are installed on lists.openstack.org and lists.katacontainers.io now (unattended-upgrades for the former, i manually did the latter preemptively) | 16:01 |
| *** pcaruana has quit IRC | 16:01 | |
| fungi | mtreinish: i'm freed up to take a look now | 16:01 |
| mtreinish | fungi: ok cool, thanks | 16:01 |
| *** witek has quit IRC | 16:02 | |
| fungi | mtreinish: the log has recent entries | 16:02 |
| fungi | 2018-02-09 16:02:15,340 Converting Subunit V2 stream: <_io.BytesIO object at 0x7fe184a00650> to SQL | 16:03 |
| fungi | that's on subunit-worker01 | 16:03 |
| mtreinish | fungi: hmm, yeah I see events on the bus now | 16:03 |
| mtreinish | maybe I just jumped the gun and assumed it broke when I didn't see any events for a couple minutes | 16:03 |
| fungi | checking 02 noqw | 16:03 |
| fungi | 2018-02-09 16:01:37,010 Converting Subunit V2 stream: <_io.BytesIO object at 0x7fe045046770> to SQL | 16:04 |
| fungi | so yeah, both were doing things in the last few minutes | 16:04 |
| AJaeger | fungi: now on 542879 - accepted trade ;) | 16:04 |
| mtreinish | ok, yeah that's my bad. Sorry for sounding the alarms for no reason | 16:04 |
| fungi | mtreinish: no worries. lmk if the volume seems to be unexpectedly low | 16:04 |
| mtreinish | fungi: is it running the new version, 1.9.0, yet? There isn't any functional difference I'm just curious if the update triggered automagically | 16:05 |
| mtreinish | *any functional difference for the workers | 16:05 |
| *** witek has joined #openstack-infra | 16:05 | |
| fungi | subunit2sql (1.9.0) | 16:06 |
| fungi | is what's installed per pip list | 16:06 |
| *** e0ne has quit IRC | 16:06 | |
| fungi | subunit 5061 21.0 1.4 337184 122120 ? Rl 15:42 5:05 /usr/bin/python2 /usr/local/bin/subunit-gearman-worker.py -c /etc/subunit2sql/jenkins-subunit-worker-A.yaml -d /var/log/subunit2sql/subunit-worker-A-debug.log -p /var/run/jenkins-subunit-worker-A/jenkins-subunit-worker-A.pid | 16:06 |
| fungi | so seems to have restarted at 15:42 | 16:06 |
| fungi | that's recent | 16:06 |
| fungi | maybe that could explain the lag | 16:06 |
| *** adarazs is now known as adarazs_brb | 16:07 | |
| mtreinish | ok cool | 16:07 |
| mtreinish | yeah it might be working through a backlog or something | 16:07 |
| *** salv-orlando has quit IRC | 16:07 | |
| fungi | -rw-r--r-- 1 subunit subunit 5 Feb 9 15:42 /var/run/jenkins-subunit-worker-A/jenkins-subunit-worker-A.pid | 16:07 |
| mtreinish | but as long as it's running that's good | 16:07 |
| fungi | 15:42 for the pidfile on 02 as well | 16:08 |
| Marx314 | question about branch creation: is this document still relevant? https://docs.openstack.org/infra/manual/drivers.html#release-management | 16:08 |
| pabelanger | fungi: ack (mailman) | 16:08 |
| *** salv-orlando has joined #openstack-infra | 16:08 | |
| fungi | Marx314: it's relevant for teams whose deliverables are not under central openstack release management | 16:09 |
| AJaeger | Marx314: for almanach - which is not an official project - it should be relevant | 16:09 |
| AJaeger | Marx314: and almanach has the permissions to create branches, see "pushSignedTag = group almanach-release" | 16:09 |
| AJaeger | Marx314: ignore me! | 16:10 |
| *** kiennt26 has joined #openstack-infra | 16:10 | |
| AJaeger | Marx314: that is permission for tags | 16:10 |
| Marx314 | good so how can I create a branch stable/queens I don't seem to have access to the review.openstack.org | 16:10 |
| *** jamesdenton has joined #openstack-infra | 16:10 | |
| AJaeger | Marx314: let me get you a few links... | 16:10 |
| *** jaosorior has quit IRC | 16:10 | |
| Marx314 | thanks | 16:11 |
| AJaeger | https://docs.openstack.org/infra/manual/creators.html#creation-of-branches - ACL set up for branch creation | 16:11 |
| AJaeger | Marx314: and you're part of https://review.openstack.org/#/admin/groups/1527,members - which is the almanach-release group | 16:12 |
| AJaeger | Marx314: send a patch to add the "create " line to you ACLs and you should be set | 16:12 |
| *** armaan has joined #openstack-infra | 16:13 | |
| openstackgerrit | Merged openstack-infra/project-config master: tacker-horizon seems to need the horizon-specific release jobs https://review.openstack.org/542879 | 16:14 |
| AJaeger | config-core, we can now remove some more files from jenkins/scripts, please review https://review.openstack.org/#/c/542651/ | 16:14 |
| openstackgerrit | Marc Aubry proposed openstack-infra/project-config master: Add create ACL for almanach https://review.openstack.org/542464 | 16:14 |
| Marx314 | Thanks AJaeger! | 16:15 |
| AJaeger | Marx314: I can review much better if you tell me what exactly you do. I suggest to extend your commit message to include: The almanach team wants to create new stable branches, add permissions for that." That would have saved a few iterations ;) | 16:15 |
| AJaeger | Marx314: reviewed - time for next iteration, please | 16:16 |
| Marx314 | reacting to -> http://lists.openstack.org/pipermail/openstack-dev/2018-February/127163.html I wanted to create a branch stable/queens | 16:16 |
| AJaeger | Marx314: perfectly fine ;) Just say it clearly in the commit message | 16:17 |
| mnaser | AJaeger: do you have a review which tests legacy-copy-jenkins-scripts ? | 16:17 |
| mnaser | AJaeger: i see the review it depends on added the role but doesnt run it anywhere | 16:17 |
| *** yamahata has quit IRC | 16:17 | |
| mnaser | of we already run legacy-copy-jenkins-scripts, my bad | 16:17 |
| AJaeger | mnaser: checking... | 16:18 |
| AJaeger | mnaser: playbooks/legacy/pre.yaml adds it | 16:18 |
| fungi | mnaser: yeah, 542648 added it to the legacy pre phase playbook | 16:18 |
| openstackgerrit | Marc Aubry proposed openstack-infra/project-config master: Add create ACL for almanach https://review.openstack.org/542464 | 16:18 |
| AJaeger | mnaser: https://review.openstack.org/#/c/542648/1/playbooks/legacy/pre.yaml | 16:18 |
| mnaser | ok cool perfect :) | 16:19 |
| AJaeger | mnaser: I should have tested but didn't ;( | 16:19 |
| openstackgerrit | Marc Aubry proposed openstack-infra/project-config master: Add create ACL for almanach https://review.openstack.org/542464 | 16:19 |
| mnaser | AJaeger: i figure the role is already being tested in `legacy-copy-jenkins-scripts` so adding those files shouldn't break too much afiak | 16:20 |
| mnaser | afaik* | 16:20 |
| AJaeger | ;) | 16:20 |
| AJaeger | Marx314: +2A | 16:21 |
| Marx314 | awesome! | 16:22 |
| AJaeger | mnaser: just checked a running job - copying works fine... | 16:22 |
| *** adarazs_brb is now known as adarazs | 16:25 | |
| tosky | if I removed few legacy jobs from some repositories, but not from all repositories where they are used, can I submit the patch to project-config for now without the dependent patch on openstack-zuul-jobs ? | 16:26 |
| AJaeger | andreaf: could you resolve the merge conflict for https://review.openstack.org/540890 , please? | 16:26 |
| AJaeger | tosky: why would you do that? | 16:26 |
| tosky | AJaeger: to remove the duplicated jobs from the repositories which have already the new jobs | 16:26 |
| AJaeger | tosky: why not change everything? | 16:27 |
| tosky | AJaeger: in progress | 16:27 |
| tosky | ok, I will wait | 16:27 |
| AJaeger | tosky: ah, so you're moving in-tree for several repos? | 16:27 |
| AJaeger | tosky: In that case: send a first patch if you have a high-volume repo and it takes to get those in... | 16:28 |
| tosky | AJaeger: sahara jobs were shared between sahara, sahara-tests and python-saharaclient; sahara-tests and python-saharaclient have native jobs now, sahara is almost done | 16:28 |
| AJaeger | tosky: define a template: Use that template everywhere and adopt the template ;) | 16:29 |
| AJaeger | still, you need to push the template in... | 16:29 |
| tosky | for two jobs? Uhm | 16:30 |
| tosky | it's a bit more complicated | 16:30 |
| AJaeger | as always ;) | 16:30 |
| tosky | but that's not the big issue anway | 16:30 |
| tosky | anyway* | 16:30 |
| tosky | now, what did I miss with this backport to stable/queens? Shouldn't I see the new jobs? https://review.openstack.org/#/c/542847/ | 16:31 |
| AJaeger | tosky: you might need debugging help... | 16:34 |
| AJaeger | tosky: I don't see anything obvious | 16:34 |
| tosky | AJaeger: what is the magic incantation for debugging help? | 16:34 |
| *** felipemonteiro_ has quit IRC | 16:34 | |
| AJaeger | tosky: shall I edit it for you? | 16:34 |
| *** felipemonteiro_ has joined #openstack-infra | 16:34 | |
| * tosky tries to autocomplete jebl but no results :) | 16:34 | |
| AJaeger | https://docs.openstack.org/infra/zuul/user/config.html#attr-project.%3Cpipeline%3E.debug | 16:34 |
| tosky | AJaeger: oh, I didn't know that, let me try | 16:35 |
| AJaeger | tosky: try corvus instead of jebl<tab> | 16:35 |
| AJaeger | So, add "debug: true" for check pipeline | 16:35 |
| tosky | oh, a tactical change of nickname | 16:35 |
| tosky | :D | 16:35 |
| * corvus ducks | 16:35 | |
| AJaeger | and once all tests finish, "toggle CI" to see the debug output in all its glory | 16:36 |
| AJaeger | and then check whether jebl<tab> is still hiding ;) | 16:36 |
| pabelanger | dmsimard: looks like ARA has non-voting jobs in gate pipeline, could you remove them? | 16:36 |
| dmsimard | pabelanger: yes, I can do that | 16:37 |
| pabelanger | dmsimard: tyty | 16:38 |
| AJaeger | pabelanger: could I trouble you with https://review.openstack.org/#/c/542651/ to remove jenkins slave scripts, please? | 16:38 |
| *** caphrim007 has joined #openstack-infra | 16:38 | |
| corvus | andreaf: why the WIP on https://review.openstack.org/540890 ? | 16:38 |
| AJaeger | config-core and moving wheel scripts around: https://review.openstack.org/#/c/541868/ , please review | 16:39 |
| *** hjensas|afk is now known as hjensas | 16:39 | |
| pabelanger | AJaeger: left -1 with comment | 16:40 |
| pabelanger | AJaeger: never mind | 16:41 |
| pabelanger | AJaeger: just seen commit message | 16:41 |
| AJaeger | pabelanger: yeah, that one is completely unused - checked codesearch and also old project-copy Zuul v2 files. | 16:41 |
| AJaeger | pabelanger: thanks | 16:42 |
| andreaf | corvus: ok - dmsimard was mentioning that zuul is not for openstack only so we should make backward compatible changes so I wasn't sure we wanted this anymore | 16:47 |
| corvus | andreaf: yeah, that's true, but i think this is still new enough it probably hasn't grown past the openstack usage | 16:48 |
| andreaf | corvus: but if we still want it I'd change this a bit since by new implementation also handles the case of empty value and this doesn't | 16:48 |
| corvus | andreaf: ok. i think we should nail down the api soon :) | 16:48 |
| dmsimard | I think we need to discuss backwards (in)compatibility in general for zuul-jobs, whether it's through tagging versions or other ways | 16:49 |
| *** links has joined #openstack-infra | 16:49 | |
| corvus | dmsimard: yep. this warrants a formal policy. | 16:50 |
| openstackgerrit | Matthew Treinish proposed openstack-infra/system-config master: Add subunit2sql check database server and workers https://review.openstack.org/520192 | 16:51 |
| *** armaan has quit IRC | 16:54 | |
| mtreinish | infra-root: I'm getting a 500 from the o-h api server at: http://health.openstack.org/runs/key/project/openstack/nova?datetime_resolution=hour&start_date=2018-01-26T17:00:00.000Z&stop_date=2018-02-09T17:00:00.000Z&callback=angular.callbacks._0 | 16:55 |
| mtreinish | if someone gets a sec can you pull the traceback from the logs so I can see what's going on | 16:55 |
| dmsimard | mtreinish: let me get that for you | 16:56 |
| *** HeOS has quit IRC | 16:56 | |
| dmsimard | mtreinish: want the whole thing? it's about 10k lines | 16:57 |
| fungi | a 10k line traceback?!? | 16:57 |
| mnaser | that's gotta be some sort of record | 16:58 |
| dmsimard | well, no, the traceback by itself isn't 10k lines.. but there's 10k lines worth of tracebacks in the error log :) | 16:58 |
| fungi | probably just the most recent one | 16:58 |
| *** armaan has joined #openstack-infra | 16:58 | |
| openstackgerrit | Merged openstack-infra/project-config master: Add create ACL for almanach https://review.openstack.org/542464 | 16:59 |
| fungi | or the earliest one | 16:59 |
| openstackgerrit | Merged openstack-infra/project-config master: Remove some moved slave scripts https://review.openstack.org/542651 | 16:59 |
| *** neiljerram has joined #openstack-infra | 16:59 | |
| *** armaan has quit IRC | 16:59 | |
| fungi | but i doubt we need them all | 16:59 |
| * fungi needs to disappear to run some errands but will be back in an hour or so | 16:59 | |
| dmsimard | I figured the other ones might have been worthwhile :) | 16:59 |
| dmsimard | mtreinish: here's the latest ones: http://paste.openstack.org/raw/666946/ let me know if you need more | 16:59 |
| andreaf | corvus, AJaeger: is it ok to host project-templates outside of openstack-zuul-job? | 16:59 |
| AJaeger | andreaf: yes! | 16:59 |
| *** danpawlik has quit IRC | 16:59 | |
| *** armaan has joined #openstack-infra | 17:00 | |
| dmsimard | mtreinish: there's a good couple of those too: ReadTimeout: HTTPConnectionPool(host='logstash.openstack.org', port=80): Read timed out. (read timeout=60) | 17:00 |
| AJaeger | andreaf: in general ;) What is your plan? | 17:00 |
| mtreinish | dmsimard: thanks, that traceback should give me enough to debug the fialure | 17:00 |
| andreaf | AJaeger: ok - I'm looking at devstack-plugin-ceph - every repo that runs their integration jobs has the py27 job non voting on check and the py35 job on experimental | 17:01 |
| mtreinish | dmsimard: hmm that's probably the e-r query side of the api timing out on a cache update | 17:01 |
| andreaf | AJaeger: so I was thinking of defining a template (along with the jobs) in devstack-plugin-ceph | 17:01 |
| mtreinish | as long as it eventually works it shouldn't be a problem | 17:01 |
| andreaf | AJaeger: and then use it in project-config for all relevant repos | 17:01 |
| AJaeger | andreaf: and then use it *in-tree* for all repos ;) | 17:02 |
| AJaeger | andreaf: that's the approach I suggest - use the template in-tree with those users. | 17:02 |
| andreaf | AJaeger: but it may become complicated to discover where a template is defined | 17:02 |
| andreaf | AJaeger: and if you use it in-tree it's also complicated to know who uses it | 17:03 |
| AJaeger | let's hear what the rest of the team thinks... | 17:03 |
| AJaeger | andreaf: codesearch.openstack.org... | 17:03 |
| AJaeger | andreaf: for some of these we're still looking at best practices | 17:03 |
| andreaf | AJaeger: yeah sure I can figure out from there but it's far from perfect | 17:03 |
| AJaeger | let's see whether pabelanger, clarkb, corvus, fungi etc have any suggestions how to architect this best, andreaf ^ | 17:04 |
| *** myoung is now known as myoung|food | 17:04 | |
| openstackgerrit | Merged openstack-infra/nodepool master: Store build logs automatically https://review.openstack.org/542386 | 17:04 |
| AJaeger | andreaf: so, start with the template - and collect some more ideas here | 17:04 |
| andreaf | AJaeger, corvus, mordred: I think we would need a tool from zuul that can resolved this i.e. find where something is defined and / or used | 17:04 |
| tobiash | andreaf: tristanC is working on improvements in zuul-web for that | 17:05 |
| andreaf | nice | 17:09 |
| *** auristor has quit IRC | 17:10 | |
| tobiash | andreaf: you can get an early impression there: https://softwarefactory-project.io/zuul3/local/jobs.html | 17:10 |
| *** jcoufal_ has joined #openstack-infra | 17:13 | |
| *** jcoufal has quit IRC | 17:15 | |
| *** links has quit IRC | 17:15 | |
| mtreinish | dmsimard, fungi: hmm it looks like the error is caused by a db entry missing a 'build_name' for the run | 17:16 |
| mtreinish | I wonder if something got lost because of the service restart with the new subunit2sql release | 17:16 |
| *** ldnunes has quit IRC | 17:16 | |
| *** janki has quit IRC | 17:20 | |
| *** camunoz has quit IRC | 17:20 | |
| *** camunoz has joined #openstack-infra | 17:21 | |
| andreaf | AJaeger: is there a job naming convention I should follow? | 17:23 |
| andreaf | AJaeger: for instance, if the parent job is tempest-full, and the job is defined in devstack-plugin-ceph, is devstack-plugin-ceph-tempest-full a good name or tempest-full-devstack-plugin-ceph like we used to do? | 17:24 |
| mtreinish | dmsimard, fungi: https://review.openstack.org/#/c/542953/ should fix the 500 | 17:25 |
| openstackgerrit | sebastian marcet proposed openstack-infra/openstackid-resources master: Updated get events by summit filters https://review.openstack.org/542954 | 17:25 |
| openstackgerrit | Merged openstack-infra/openstackid-resources master: Updated get events by summit filters https://review.openstack.org/542954 | 17:28 |
| *** ldnunes has joined #openstack-infra | 17:29 | |
| AJaeger | andreaf: https://docs.openstack.org/infra/manual/drivers.html#consistent-naming-for-jobs-with-zuul-v3 documents naming | 17:31 |
| AJaeger | andreaf: so, if the job is in devstack-plugin-ceph, calling it devstack-plugin-ceph-tempest-full is perfectly fine | 17:31 |
| AJaeger | andreaf: I expect a job named tempest-X to be defined in tempest repo | 17:32 |
| AJaeger | andreaf: that naming convention helps you to find where a job is defined... | 17:32 |
| *** jpich has quit IRC | 17:32 | |
| *** caphrim007 has quit IRC | 17:33 | |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config master: Move wheel-build scripts out of jenkins/scripts https://review.openstack.org/541868 | 17:33 |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config master: Move release-tools out of jenkins/scripts https://review.openstack.org/542639 | 17:33 |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config master: Install proposal scripts only when needed https://review.openstack.org/541795 | 17:33 |
| *** VW_ has joined #openstack-infra | 17:34 | |
| AJaeger | mordred, pabelanger, dmsimard, mnaser, fungi, this is the rest of cleaning up jenkins/scripts . it leaves only afs-slug.sh in that directory. | 17:34 |
| AJaeger | please carefully review the copying around | 17:35 |
| *** yamamoto has quit IRC | 17:35 | |
| *** armaan has quit IRC | 17:35 | |
| *** sambetts is now known as sambetts|afk | 17:36 | |
| *** armaan has joined #openstack-infra | 17:36 | |
| andreaf | AJaeger ok cool | 17:36 |
| *** VW__ has joined #openstack-infra | 17:36 | |
| *** VW_ has quit IRC | 17:37 | |
| *** harlowja has joined #openstack-infra | 17:37 | |
| *** yamamoto has joined #openstack-infra | 17:37 | |
| *** VW__ has quit IRC | 17:37 | |
| *** armaan has quit IRC | 17:37 | |
| *** VW has quit IRC | 17:37 | |
| *** VW has joined #openstack-infra | 17:38 | |
| *** armaan has joined #openstack-infra | 17:38 | |
| *** yamamoto has quit IRC | 17:39 | |
| *** florianf has quit IRC | 17:44 | |
| *** r-daneel has joined #openstack-infra | 17:48 | |
| *** dhill_ has joined #openstack-infra | 17:48 | |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config master: Install proposal scripts only when needed https://review.openstack.org/541795 | 17:50 |
| *** david-lyle has quit IRC | 17:50 | |
| *** olaph1 has joined #openstack-infra | 17:51 | |
| *** shardy has quit IRC | 17:51 | |
| *** auristor has joined #openstack-infra | 17:52 | |
| *** olaph has quit IRC | 17:52 | |
| *** gordc has joined #openstack-infra | 17:54 | |
| gordc | hi, anyone know where run-tox.sh exists? i'm seeing an error that's its not found on stable/pike: http://logs.openstack.org/42/542142/1/check/panko-tox-py27-mongodb/329457a/job-output.txt.gz#_2018-02-08_11_40_18_721971 | 17:55 |
| *** dhill_ has quit IRC | 17:55 | |
| *** dave-mccowan has quit IRC | 17:57 | |
| *** salv-orlando has quit IRC | 17:57 | |
| *** dave-mccowan has joined #openstack-infra | 17:58 | |
| *** salv-orl_ has joined #openstack-infra | 17:58 | |
| *** ldnunes has quit IRC | 17:59 | |
| *** derekh has quit IRC | 18:00 | |
| *** ldnunes has joined #openstack-infra | 18:00 | |
| eumel8 | gordc: https://review.openstack.org/#/c/540609/ | 18:04 |
| AJaeger | gordc: we removed it - you need to backport the change to use zuul v3 native jobs | 18:04 |
| AJaeger | gordc: sorry, wasn't aware that it was not backported ;( | 18:04 |
| AJaeger | gordc: I'll sent you a change | 18:05 |
| gordc | eumel8: thanks, will look | 18:05 |
| gordc | AJaeger: no worries. i just noticed it was failing on stable/* | 18:05 |
| *** efoley has quit IRC | 18:05 | |
| AJaeger | gordc: https://review.openstack.org/#/c/542966/ | 18:06 |
| gordc | that was quick. | 18:06 |
| AJaeger | gordc: and https://review.openstack.org/#/c/542967/ | 18:06 |
| gordc | AJaeger: thanks! so stable/queens should be fine? i'll just do the same if it isn't | 18:07 |
| gordc | thanks for quick help folks. | 18:07 |
| AJaeger | gordc: the master change merged before christmas, so all fine | 18:07 |
| gordc | awesome. | 18:07 |
| *** salv-orl_ has quit IRC | 18:08 | |
| *** myoung|food is now known as myoung | 18:14 | |
| *** caphrim007 has joined #openstack-infra | 18:14 | |
| fungi | that's one of the places codesearch won't help us | 18:15 |
| fungi | finding uses on non-master branches | 18:15 |
| fungi | afaik it only indexes content of master branches | 18:16 |
| gordc | :) that's what i used. | 18:16 |
| *** ralonsoh has quit IRC | 18:16 | |
| fungi | i mean as far as finding uses of run-tox.sh by non-master branches of projects with in-tree job definitions | 18:17 |
| fungi | so that we know when it's safe to remove | 18:17 |
| pabelanger | I do think there is a PR upstream to fix that in hound | 18:18 |
| fungi | though pattern-searching the entire body of loaded zuul configuration is probably something we can also add to the dashboard once the config browser lands | 18:18 |
| fungi | mmm, or maybe not since that would probably not include the ansible role/playbook content | 18:19 |
| *** neiljerram has quit IRC | 18:20 | |
| AJaeger | only a few repos had in-tree run-tox in master and I thought I checked for needed backports everywhere. Seems I missed some ;( | 18:20 |
| *** kgiusti has joined #openstack-infra | 18:24 | |
| * AJaeger quickly double checked - didn't find any missing backports | 18:25 | |
| AJaeger | Some repos did not yet backport zuul.yaml files | 18:26 |
| pabelanger | https://github.com/etsy/hound/pull/275 was the PR for hound I was thinking of. Must have seen it from dmsimard | 18:26 |
| dmsimard | pabelanger: I have a fork with that PR in it, it's what I used when building a POC deployment for RDO because we have repositories with no master branches | 18:26 |
| dmsimard | pabelanger: it's tricky to build forked go stuff, I really had to fork because of https://github.com/dmsimard/hound/commit/8be668c6e1a892eaa95cc4fc167ad6d79e407b66 | 18:27 |
| pabelanger | yah | 18:28 |
| dmsimard | pabelanger: I don't know if it's possible to have hound index multiple branches of a single repository though | 18:28 |
| dmsimard | pabelanger: that PR allows you to specify a branch that is not hardcoded to master and that's it | 18:28 |
| fungi | any guesses why ze10 seems to run around half the available ram that the other executors do? | 18:28 |
| *** yamahata has joined #openstack-infra | 18:28 | |
| fungi | oh, or is that ze02 | 18:29 |
| fungi | the colors are very close | 18:29 |
| pabelanger | fungi: yah, I confused that the other day myself | 18:29 |
| fungi | okay, so that's ze02 with the newer kernel | 18:30 |
| fungi | nevermind! | 18:30 |
| pabelanger | Yup! | 18:30 |
| *** VW has quit IRC | 18:33 | |
| *** VW has joined #openstack-infra | 18:34 | |
| AJaeger | fungi, pabelanger, dmsimard, could you put the stack starting at https://review.openstack.org/541868 on your review list, please? | 18:34 |
| dmsimard | yes | 18:35 |
| *** tosky has quit IRC | 18:37 | |
| *** trown is now known as trown|lunch | 18:38 | |
| mtreinish | hmm, has anyone seen gerrit do this before: https://i.imgur.com/7CSoQ5L.png | 18:38 |
| dmsimard | o_O | 18:39 |
| dmsimard | no | 18:39 |
| *** yamamoto has joined #openstack-infra | 18:40 | |
| dmsimard | fungi: re: pattern searching.. I know we wrote something before to parse gerrit changes -- RDO was interested in knowing if there were changes to reqs.txt. I wonder if we could re-use that to search for zuul.yaml changes in non-master branches. | 18:40 |
| mtreinish | hmm, restarted firefox and it seems to have fixed itself | 18:40 |
| mtreinish | but that was weird | 18:40 |
| fungi | mtreinish: wow, no i've never seen mojibake in the interface parts of the gerrit webui | 18:42 |
| fungi | that's amazingly nutty | 18:42 |
| *** kjackal has quit IRC | 18:44 | |
| *** dtantsur is now known as dtantsur|afk | 18:45 | |
| *** jcoufal_ has quit IRC | 18:45 | |
| *** slaweq has quit IRC | 18:45 | |
| *** yamamoto has quit IRC | 18:47 | |
| *** hashar has joined #openstack-infra | 18:48 | |
| pabelanger | yah, never seen that before | 18:58 |
| pabelanger | must be client side, patchset looks proper here | 18:59 |
| *** tosky has joined #openstack-infra | 19:01 | |
| *** david-lyle has joined #openstack-infra | 19:02 | |
| *** jpena is now known as jpena|off | 19:05 | |
| mtreinish | pabelanger: I assumed as much when the firefox restart fixed it for me | 19:06 |
| *** mriedem is now known as mriedem_afk | 19:06 | |
| openstackgerrit | Alex Krzos proposed openstack-infra/grafyaml master: Allow hidden templated vars https://review.openstack.org/542979 | 19:06 |
| *** lucasagomes is now known as lucas-afk | 19:07 | |
| pabelanger | mrhillsman: indeed | 19:09 |
| *** camunoz has quit IRC | 19:12 | |
| mrhillsman | what did I do? | 19:17 |
| mrhillsman | oh maybe that was for matt | 19:17 |
| *** lbragstad has quit IRC | 19:18 | |
| fungi | yeah, i think pabelanger meant to be replying to mtreinish | 19:18 |
| pabelanger | yes, that | 19:20 |
| *** camunoz has joined #openstack-infra | 19:29 | |
| *** ijw has quit IRC | 19:32 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/project-config master: Remove intree jobs for openstack/windmill https://review.openstack.org/542993 | 19:36 |
| *** lbragstad has joined #openstack-infra | 19:37 | |
| *** gfidente has quit IRC | 19:41 | |
| *** ijw has joined #openstack-infra | 19:48 | |
| *** tesseract has quit IRC | 20:00 | |
| *** rfolco|rover is now known as rfolco|off | 20:10 | |
| *** thorre_se has joined #openstack-infra | 20:13 | |
| *** ldnunes has quit IRC | 20:14 | |
| *** trown|lunch is now known as trown | 20:14 | |
| *** thorre has quit IRC | 20:16 | |
| *** thorre_se is now known as thorre | 20:16 | |
| tosky | corvus: ehm... the patch now does not enter the zuul queue at all, and nothing is printed: https://review.openstack.org/#/c/542847/ | 20:16 |
| *** gordc has left #openstack-infra | 20:16 | |
| *** e0ne has joined #openstack-infra | 20:18 | |
| *** e0ne has quit IRC | 20:20 | |
| *** agopi is now known as agopi_out | 20:20 | |
| *** agopi_out has quit IRC | 20:24 | |
| *** slaweq has joined #openstack-infra | 20:25 | |
| *** VW has quit IRC | 20:26 | |
| *** VW has joined #openstack-infra | 20:26 | |
| *** yolanda has quit IRC | 20:28 | |
| *** hashar has quit IRC | 20:28 | |
| *** ijw has quit IRC | 20:30 | |
| *** amoralej is now known as amoralej|off | 20:30 | |
| *** pcichy has quit IRC | 20:33 | |
| *** jcoufal has joined #openstack-infra | 20:35 | |
| *** ijw has joined #openstack-infra | 20:38 | |
| *** dave-mccowan has quit IRC | 20:39 | |
| *** jcoufal has quit IRC | 20:41 | |
| *** ijw has quit IRC | 20:42 | |
| *** olaph has joined #openstack-infra | 20:44 | |
| *** olaph1 has quit IRC | 20:46 | |
| *** ijw has joined #openstack-infra | 20:46 | |
| *** e0ne has joined #openstack-infra | 20:47 | |
| *** camunoz has quit IRC | 20:48 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/openstack-zuul-jobs master: Add fedora-27 nodeset https://review.openstack.org/543019 | 20:48 |
| pabelanger | config-core: easy review to add fedora-27 nodeset ^ | 20:49 |
| pabelanger | opps | 20:49 |
| pabelanger | typo | 20:49 |
| openstackgerrit | Paul Belanger proposed openstack-infra/openstack-zuul-jobs master: Add fedora-27 nodeset https://review.openstack.org/543019 | 20:50 |
| *** ijw has quit IRC | 20:51 | |
| *** xinliang has quit IRC | 21:02 | |
| *** HeOS has joined #openstack-infra | 21:03 | |
| *** xinliang has joined #openstack-infra | 21:04 | |
| *** xinliang has quit IRC | 21:04 | |
| *** xinliang has joined #openstack-infra | 21:04 | |
| corvus | tosky: i'm not sure, but i suspect that the debug log for that change was too long... i think there's a bug in zuul where if it sits in queue too long it records multiple debug entries... let me copy it out of the logs for you. | 21:11 |
| *** agopi_out has joined #openstack-infra | 21:13 | |
| corvus | tosky: http://paste.openstack.org/show/666965/ | 21:13 |
| *** e0ne has quit IRC | 21:13 | |
| tosky | corvus: thanks! | 21:15 |
| tosky | now I need to understand the error message | 21:16 |
| *** olaph1 has joined #openstack-infra | 21:17 | |
| SamYaple | pabelanger: re: apache docker mirroring stuff. previously, did you actually see the cache polutlating? | 21:18 |
| *** olaph has quit IRC | 21:19 | |
| tosky | an error with matching not on the first dependency (the jobs in sahara-tests) but the job in devstack? | 21:19 |
| *** armaan has quit IRC | 21:23 | |
| corvus | tosky: which job? | 21:23 |
| *** armaan has joined #openstack-infra | 21:24 | |
| tosky | corvus: https://review.openstack.org/#/c/542847/ - please note that the ancestors are defined only in sahara-tests/master (but that does not seem to be the problem) | 21:29 |
| tosky | and the logs that you pasted shows that zuul bails up on "No matching parents for 'devstack'" | 21:31 |
| *** armaan has quit IRC | 21:33 | |
| corvus | tosky: sorry i mean which job are you investigating? | 21:34 |
| corvus | tosky: i'm guessing python-saharaclient-tempest and -scenario? | 21:35 |
| corvus | tosky: assuming so, it's because the new devstack job doesn't exist on stable/pike yet -- we need to backport it | 21:35 |
| corvus | tosky: er rather stable/queens, not pike | 21:36 |
| corvus | (it *does* exist for pike, it doesn't exist for queens) | 21:36 |
| fungi | well, devstack doesn't _have_ a stable/queens branch yet | 21:37 |
| corvus | fungi: a notable impediment | 21:37 |
| corvus | as soon as it does, this should all work | 21:37 |
| corvus | (since, when it's created, it'll be forked from master which has the job already) | 21:37 |
| tosky | corvus: yep, sorry, those two jobs (the failing ones) | 21:38 |
| tosky | corvus: but shouldn't fallback? Or does it fall back only if the branch does not exist? | 21:38 |
| corvus | i think we need a slight tweak for the branch creation ordering for next time | 21:38 |
| tosky | (fall back to master) | 21:39 |
| *** trown is now known as trown|outtypewww | 21:39 | |
| tosky | and also: does it mean that the devstack job does not exist also on stable/pike yet, and then I would hit the same issue with the next backport to pike? | 21:40 |
| tosky | (and why am I the first one to hit this? :) | 21:40 |
| corvus | tosky: there isn't a fallback for job definitions as such; there are ways to work around this for other kinds of branch mismatches, but in this case, we intend to have a devstack queens branch, so the right thing is to wait for it to exist. | 21:40 |
| corvus | tosky: no it *does* exist on stable/pike, i mis-spoke earlier | 21:40 |
| corvus | tosky: lines 113 and 114 in http://paste.openstack.org/show/666965/ tell us this | 21:40 |
| corvus | tosky: it exists on master and stable/pike | 21:41 |
| corvus | tosky: then line 115 is the error that tells us that there is no matching devstack job for the current change, whis is on queens | 21:41 |
| tosky | I see | 21:41 |
| tosky | I guess that the stable/queens of devstack will be created soon | 21:42 |
| tosky | with the other branches | 21:42 |
| tosky | or does it branch later? | 21:42 |
| tosky | well, it can't branch later, or all the jobs which use devstack as base would be broken for backports on queens | 21:42 |
| fungi | probably a question for #openstack-release or #openstack-qa but i expect it branches asap now that we've discovered this catch-22 | 21:43 |
| tosky | andreaf, mtreinish, gmann_ : ^^ | 21:43 |
| corvus | according to https://docs.openstack.org/project-team-guide/release-management.html it branches next week | 21:44 |
| corvus | i'd like to discuss moving that up a stage or two at the ptg | 21:45 |
| tosky | yeah, but... | 21:45 |
| corvus | aiui the reasoning was to get as many fixes needed for RCs of the services into devstack before the branch point, to reduce backports. so i think the thing to discuss is how far we can push that. | 21:47 |
| corvus | *ideally* we would invert this, so that devstack branched first | 21:48 |
| *** yamahata has quit IRC | 21:48 | |
| *** DuncanT has quit IRC | 21:49 | |
| tosky | or add some fall back rules for such cases | 21:49 |
| *** DuncanT has joined #openstack-infra | 21:50 | |
| *** salv-orlando has joined #openstack-infra | 21:50 | |
| fungi | we may be in a tight spot with release management. i think dhellmann and smcginnis are out this afternoon and ttx has likely already packed it in for the weekend. dims may be around here somewhere | 21:51 |
| corvus | yes, if we can't do this in the right sequence, we can alter the branch matchers on devstack/master to compensate. it's not an ideal solution, but it's possible. i'd like us to get to the point where we have affirmitively decided that we must branch other projects before devstack and have their jobs work before we do that though. | 21:54 |
| corvus | one way or the other, we'll have something better by rocky | 21:55 |
| dims | o/ | 21:56 |
| *** thorre_se has joined #openstack-infra | 22:01 | |
| *** dprince has joined #openstack-infra | 22:03 | |
| *** thorre has quit IRC | 22:04 | |
| *** thorre_se is now known as thorre | 22:04 | |
| *** salv-orlando has quit IRC | 22:04 | |
| fungi | so from an ordering standpoint, i guess if project A defines a variant of a job defined in project B then we need to create the stable branch for project B before project A | 22:05 |
| fungi | this could get messy if we get a tangle of projects declaring variants of jobs in other projects | 22:05 |
| *** ijw has joined #openstack-infra | 22:05 | |
| *** kong has quit IRC | 22:05 | |
| fungi | to the point where we end up having to branch them all simultaneously | 22:05 |
| *** kong has joined #openstack-infra | 22:06 | |
| *** myoung is now known as myoung|off | 22:06 | |
| fungi | though we may be able to draw a job graph which indicates which projects need to branch before which other projects? | 22:08 |
| *** r-daneel has quit IRC | 22:09 | |
| *** kgiusti has left #openstack-infra | 22:10 | |
| *** slaweq has quit IRC | 22:10 | |
| *** ijw has quit IRC | 22:10 | |
| *** tpsilva has quit IRC | 22:13 | |
| *** ildikov has quit IRC | 22:13 | |
| *** ildikov has joined #openstack-infra | 22:14 | |
| *** jcoufal has joined #openstack-infra | 22:19 | |
| *** olaph1 is now known as olaph | 22:19 | |
| openstackgerrit | Frank Kloeker proposed openstack-infra/project-config master: Setup translation jobs for Queens (no priority) https://review.openstack.org/543040 | 22:21 |
| *** ijw has joined #openstack-infra | 22:22 | |
| corvus | fungi: s/defines a variant of/inherits from/ | 22:23 |
| corvus | fungi: i suspect it's not actually going to be that tangled | 22:24 |
| *** jcoufal has quit IRC | 22:24 | |
| corvus | fungi: but if there are cases where it is, then yeah, we should basically try to branch them as close to simultaneously as possible | 22:24 |
| corvus | fungi: note however, that this is a pretty soft fail. if these conditions aren't met, the jobs just don't run. so it's not like things are broken, just not tested. (of course, if you land a change without testing, *then* things are broken :) | 22:25 |
| *** patrickeast has quit IRC | 22:26 | |
| corvus | fungi: but it's not like we have to calculate a strict ordering to unwedge anything | 22:26 |
| *** patrickeast has joined #openstack-infra | 22:26 | |
| eumel8 | actually I wanted to test the job first with some few repo, but now all projects are in: https://review.openstack.org/#/q/topic:translation-jobs-queens | 22:28 |
| andreaf | corvus fungi dims tosky it's getting pretty late for me but if you need anything urgent from me ping me on IRC or even better via email I can help | 22:28 |
| *** yamahata has joined #openstack-infra | 22:28 | |
| tosky | andreaf: nothing that need to be done right now, just tl;dr the dependency system in zuul requires an earlier branching of devstack, and that requires some discussion; check the past logs when you can | 22:29 |
| tosky | corvus: but if jobs aren't run, there is no +v either | 22:30 |
| tosky | I think | 22:30 |
| andreaf | tosky: so for the integrated gate on pike we still run the legacy job - I did not have time to backport stuff yet, not sure it's worth it even | 22:31 |
| corvus | tosky: some jobs are still run, so you'll get the +v. i think you're just not getting reports on that change because of the debug: true thing. | 22:31 |
| andreaf | for stable/queens one we have a stable branch on devstack everything should work | 22:31 |
| andreaf | we merged the extensions as dict patch this afternoon so we didn't have to backport | 22:32 |
| pabelanger | SamYaple: yes, required debug mode for apache to see | 22:33 |
| andreaf | I think there is quite a bit of work to be done over time when cutting the branch also on grenade job configurations and test matrix setup etc... I haven't done it myself in the past but I guess I know most of the bits and pieces | 22:33 |
| pabelanger | SamYaple: but will show up in logs | 22:34 |
| *** ijw has quit IRC | 22:34 | |
| pabelanger | SamYaple: can also run tcpdump and look at HTTP traffic and see it use mirrors | 22:34 |
| *** salv-orlando has joined #openstack-infra | 22:38 | |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul master: Add zuul from scratch doc https://review.openstack.org/542518 | 22:39 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul master: Reclassify some debug log lines as info https://review.openstack.org/543044 | 22:39 |
| *** fultonj has quit IRC | 22:40 | |
| *** dave-mccowan has joined #openstack-infra | 22:40 | |
| *** olaph1 has joined #openstack-infra | 22:42 | |
| *** armaan has joined #openstack-infra | 22:43 | |
| *** olaph has quit IRC | 22:43 | |
| SamYaple | pabelanger: ok was just curious. so there is nothing beyond just that "validate" function that blocks it. shame | 22:46 |
| SamYaple | maybe ill try to get a PR up to support it | 22:46 |
| fungi | corvus: oh, i missed that bit... so we're simply not selecting the jobs which inherit from the nonexistent branch on the other repo? from a release workflow standpoint i agree that's less terrible because in theory changes during rc must be tested and merged in master and only then backported | 22:49 |
| corvus | fungi: yep -- it's just not obvious in this case because that change was also getting hit with the debug:true problem and not reporting. | 22:50 |
| corvus | turns out we have have some protection against 4000-line review comments | 22:50 |
| fungi | go figure | 22:53 |
| *** cargonza has quit IRC | 22:53 | |
| *** cargonza has joined #openstack-infra | 22:54 | |
| *** dprince has quit IRC | 22:54 | |
| *** edmondsw has quit IRC | 22:59 | |
| andreaf | corvus mordred this kind of import fails miserably in zuul (with no logging again) https://review.openstack.org/#/c/530642/12/playbooks/devstack-tempest.yaml | 23:00 |
| andreaf | we run ansible 2.3.3 so it may be a version thing | 23:00 |
| andreaf | do you know how I could do something like that this that would keep ansible / zuul happy? | 23:00 |
| corvus | dmsimard: is that the include_role bug you were working on showing up again ^ ? | 23:01 |
| *** VW_ has joined #openstack-infra | 23:02 | |
| dmsimard | corvus: sounds like it, yes | 23:03 |
| corvus | dmsimard: i was just looking up the logs -- f994a7dd2b064194b65876a8a278bae8 on ze02 | 23:04 |
| *** agopi_out has quit IRC | 23:04 | |
| *** VW has quit IRC | 23:05 | |
| *** armaan has quit IRC | 23:06 | |
| dmsimard | corvus: I haven't had the chance to revisit that yet. I'll put it on the top of my list. Last I looked I wasn't able to reproduce it so I've added that review to the story https://storyboard.openstack.org/#!/story/2001329 | 23:06 |
| corvus | dmsimard: er, i think that's the wrong bulid sorry | 23:06 |
| corvus | andreaf: it should be the tempest-full job, right? | 23:07 |
| *** VW_ has quit IRC | 23:07 | |
| corvus | that's e4fdb1c004fe47478a5468bb6318ad66 on ze03 | 23:07 |
| andreaf | corvus yeah | 23:07 |
| andreaf | corvus if I downgrade ansible to 2.3.3 on my laptop the task fails for me as well so I think it's an ansible thing | 23:08 |
| corvus | andreaf, dmsimard: http://paste.openstack.org/show/666984/ | 23:08 |
| andreaf | corvus: ansible seems to be doing a poor job in evaluating conditionals before other things - like with the with_dict, there is no way to make a when stop with_dict from checking the variable type | 23:09 |
| *** jlabarre has quit IRC | 23:09 | |
| *** jtomasek has quit IRC | 23:11 | |
| *** zaro_ has quit IRC | 23:11 | |
| *** zaro_ has joined #openstack-infra | 23:11 | |
| *** csatari has quit IRC | 23:14 | |
| *** csatari has joined #openstack-infra | 23:15 | |
| *** mriedem_afk has quit IRC | 23:16 | |
| *** geekinutah has quit IRC | 23:16 | |
| *** geekinutah has joined #openstack-infra | 23:16 | |
| *** salv-orlando has quit IRC | 23:18 | |
| *** salv-orlando has joined #openstack-infra | 23:20 | |
| *** slaweq has joined #openstack-infra | 23:23 | |
| andreaf | corvus, dmsimard: this seems to work, at least on my laptop https://review.openstack.org/#/c/530642/14 - ansible is not happy only if the variable is not defined - if it is will happily process the when condition and not include the role when applicable | 23:23 |
| *** salv-orlando has quit IRC | 23:24 | |
| *** slaweq has quit IRC | 23:27 | |
| *** salv-orlando has joined #openstack-infra | 23:28 | |
| pabelanger | andreaf: why don't you use a filter, when: tempest_post_devstack | default(omit) | 23:29 |
| pabelanger | at least I think that works with when statements | 23:29 |
| pabelanger | or maybe default(False) | 23:29 |
| *** esberglu has quit IRC | 23:37 | |
| notmyname | are project coverage reports published anywhere beyond the job results for a patch? | 23:42 |
| *** agopi_out has joined #openstack-infra | 23:43 | |
| *** eumel8 has quit IRC | 23:45 | |
| fungi | notmyname: not presently, though there has been discussion in the past of trying to do trending. might make sense for the health dashboard | 23:46 |
| fungi | you can find them through the builds tab of the zuul status dashboard but that's not commit-to-commit trending of course | 23:47 |
| * fungi disappears for dinner | 23:47 | |
| *** lbragstad has quit IRC | 23:49 | |
| *** wolverineav has quit IRC | 23:56 | |
| *** wolverineav has joined #openstack-infra | 23:57 | |
| *** ijw has joined #openstack-infra | 23:57 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!
