| openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul master: executor: use node python path https://review.openstack.org/637339 | 00:03 |
|---|---|---|
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/nodepool master: Add python-path option to node https://review.openstack.org/637338 | 00:12 |
| openstackgerrit | Ian Wienand proposed openstack-infra/system-config master: [WIP] letsencrypt support https://review.openstack.org/636759 | 00:14 |
| *** jamesmcarthur has quit IRC | 00:27 | |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul master: executor: enable zuul_return to update Ansible inventory https://review.openstack.org/590092 | 00:38 |
| openstackgerrit | Kendall Nelson proposed openstack-infra/storyboard-webclient master: Provide -Assign to self- button for story tasks. https://review.openstack.org/643427 | 00:40 |
| *** jbadiapa has joined #openstack-infra | 00:41 | |
| openstackgerrit | Kendall Nelson proposed openstack-infra/storyboard-webclient master: Provide -Assign to self- button for story tasks. https://review.openstack.org/643427 | 00:41 |
| *** gyee has quit IRC | 00:48 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/system-config master: [WIP] letsencrypt support https://review.openstack.org/636759 | 00:48 |
| *** jamesmcarthur has joined #openstack-infra | 00:58 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/system-config master: [WIP] letsencrypt support https://review.openstack.org/636759 | 00:58 |
| *** rascasoft has joined #openstack-infra | 00:59 | |
| *** rascasoft has quit IRC | 01:09 | |
| *** jamesmcarthur has quit IRC | 01:15 | |
| *** jamesmcarthur has joined #openstack-infra | 01:16 | |
| openstackgerrit | Merged openstack-infra/irc-meetings master: nova-scheduler-meeting => placement-team-meeting https://review.openstack.org/644992 | 01:18 |
| *** imacdonn has quit IRC | 01:19 | |
| *** mriedem has quit IRC | 01:26 | |
| *** ricolin has joined #openstack-infra | 01:29 | |
| *** jamesmcarthur has quit IRC | 01:39 | |
| *** jamesmcarthur has joined #openstack-infra | 01:40 | |
| *** mattw4 has quit IRC | 01:42 | |
| *** jamesmcarthur has quit IRC | 01:44 | |
| openstackgerrit | Merged openstack-infra/storyboard master: Updated_at content modified https://review.openstack.org/638840 | 01:49 |
| openstackgerrit | Merged openstack-infra/storyboard master: Creates the tag with project name and priority https://review.openstack.org/640793 | 01:49 |
| *** roman_g has quit IRC | 01:52 | |
| *** roman_g has joined #openstack-infra | 01:55 | |
| mnaser | have we built out infra to be able to host mailing lists under opendev? | 01:57 |
| fungi | yep, it has one already at lists.opendev.org | 02:17 |
| *** jamesmcarthur has joined #openstack-infra | 02:35 | |
| *** markvoelker has joined #openstack-infra | 02:43 | |
| *** janki has quit IRC | 02:44 | |
| *** wolverineav has joined #openstack-infra | 02:55 | |
| *** rascasoft has joined #openstack-infra | 02:58 | |
| *** jamesmcarthur has quit IRC | 02:59 | |
| *** yamamoto has joined #openstack-infra | 03:01 | |
| *** jamesmcarthur has joined #openstack-infra | 03:04 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/system-config master: [WIP] letsencrypt support https://review.openstack.org/636759 | 03:06 |
| *** rascasoft has quit IRC | 03:07 | |
| *** jamesmcarthur has quit IRC | 03:18 | |
| *** jamesmcarthur has joined #openstack-infra | 03:19 | |
| *** rh-jelabarre has quit IRC | 03:21 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/system-config master: [WIP] letsencrypt support https://review.openstack.org/636759 | 03:29 |
| *** jamesmcarthur has quit IRC | 03:49 | |
| *** nicolasbock has quit IRC | 03:53 | |
| *** Lucas_Gray has joined #openstack-infra | 03:54 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/system-config master: [WIP] letsencrypt support https://review.openstack.org/636759 | 03:57 |
| *** janki has joined #openstack-infra | 04:00 | |
| *** rascasoft has joined #openstack-infra | 04:01 | |
| *** yamamoto has quit IRC | 04:03 | |
| *** rascasoft has quit IRC | 04:06 | |
| *** whoami-rajat has joined #openstack-infra | 04:10 | |
| *** diablo_rojo has quit IRC | 04:12 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/system-config master: [WIP] letsencrypt support https://review.openstack.org/636759 | 04:14 |
| *** betherly has joined #openstack-infra | 04:19 | |
| *** betherly has quit IRC | 04:24 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/system-config master: [WIP] letsencrypt support https://review.openstack.org/636759 | 04:28 |
| *** rascasoft has joined #openstack-infra | 04:37 | |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul master: zuul-runner: add command line interface https://review.openstack.org/644770 | 04:37 |
| *** rascasoft has quit IRC | 04:44 | |
| openstackgerrit | Merged openstack-infra/irc-meetings master: Update the nova team meeting chair to efried https://review.openstack.org/644987 | 04:49 |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul master: webtrigger: add support for parameterized trigger https://review.openstack.org/644484 | 04:54 |
| *** lpetrut has joined #openstack-infra | 04:54 | |
| *** lseki has quit IRC | 04:59 | |
| *** wolverineav has quit IRC | 05:02 | |
| *** wolverineav has joined #openstack-infra | 05:02 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/system-config master: [WIP] letsencrypt support https://review.openstack.org/636759 | 05:03 |
| *** wolverineav has quit IRC | 05:08 | |
| *** ricolin has quit IRC | 05:15 | |
| *** lpetrut has quit IRC | 05:15 | |
| *** janki has quit IRC | 05:20 | |
| *** ricolin has joined #openstack-infra | 05:32 | |
| *** wolverineav has joined #openstack-infra | 05:34 | |
| *** janki has joined #openstack-infra | 05:51 | |
| *** jbadiapa has quit IRC | 05:51 | |
| *** kjackal has joined #openstack-infra | 06:03 | |
| *** e0ne has joined #openstack-infra | 06:06 | |
| *** e0ne has quit IRC | 06:07 | |
| *** wolverineav has quit IRC | 06:07 | |
| *** pcaruana has joined #openstack-infra | 06:11 | |
| *** kjackal has quit IRC | 06:28 | |
| *** rascasoft has joined #openstack-infra | 06:30 | |
| *** wolverineav has joined #openstack-infra | 06:41 | |
| *** rascasoft has quit IRC | 06:42 | |
| *** slaweq has quit IRC | 06:45 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/system-config master: [WIP] letsencrypt support https://review.openstack.org/636759 | 06:46 |
| *** Lucas_Gray has quit IRC | 06:48 | |
| *** kjackal has joined #openstack-infra | 06:59 | |
| *** lpetrut has joined #openstack-infra | 07:02 | |
| *** rascasoft has joined #openstack-infra | 07:08 | |
| *** rcernin has quit IRC | 07:24 | |
| *** dpawlik_ is now known as dpawlik | 07:30 | |
| *** xek_ has joined #openstack-infra | 07:41 | |
| *** slaweq has joined #openstack-infra | 07:41 | |
| *** soumplis has joined #openstack-infra | 07:42 | |
| *** soumplis has left #openstack-infra | 07:42 | |
| *** e0ne has joined #openstack-infra | 07:45 | |
| *** wolverineav has quit IRC | 07:54 | |
| *** kjackal has quit IRC | 07:58 | |
| *** yamamoto has joined #openstack-infra | 08:01 | |
| *** yamamoto has quit IRC | 08:05 | |
| *** pgaxatte has joined #openstack-infra | 08:07 | |
| *** openstackgerrit has quit IRC | 08:17 | |
| *** kopecmartin|off is now known as kopecmartin | 08:18 | |
| *** kopecmartin is now known as randarah | 08:19 | |
| *** randarah is now known as kopecmartin | 08:19 | |
| *** gfidente has joined #openstack-infra | 08:24 | |
| *** dtantsur|afk is now known as dtantsur | 08:24 | |
| *** tosky has joined #openstack-infra | 08:27 | |
| *** ginopc has joined #openstack-infra | 08:28 | |
| *** jpich has joined #openstack-infra | 08:31 | |
| *** jtomasek has quit IRC | 08:32 | |
| *** kjackal has joined #openstack-infra | 08:33 | |
| *** slaweq_ has joined #openstack-infra | 08:36 | |
| *** slaweq has quit IRC | 08:38 | |
| *** helenafm has joined #openstack-infra | 08:39 | |
| *** jpena|off is now known as jpena | 08:45 | |
| *** slaweq_ has quit IRC | 08:47 | |
| *** e0ne has quit IRC | 08:48 | |
| *** e0ne has joined #openstack-infra | 08:51 | |
| cmurphy | infra-root: all the nodepool builders are having some kind of disk space issue https://nb01.openstack.org/ubuntu-bionic-0000022229.log although they look fine in cacti | 08:58 |
| frickler | cmurphy: /opt is full, which is a different partition, thanks for alerting us. and we should probably add that to cacti monitoring, it's not the first time this has happened. /me goes to look into cleaning up | 09:07 |
| cmurphy | thanks frickler | 09:08 |
| *** whoami-rajat has quit IRC | 09:10 | |
| *** jbadiapa has joined #openstack-infra | 09:13 | |
| *** whoami-rajat has joined #openstack-infra | 09:18 | |
| *** priteau has joined #openstack-infra | 09:37 | |
| *** Lucas_Gray has joined #openstack-infra | 09:40 | |
| *** derekh has joined #openstack-infra | 09:43 | |
| *** pcaruana has quit IRC | 09:45 | |
| *** pcaruana has joined #openstack-infra | 09:46 | |
| *** wolverineav has joined #openstack-infra | 09:51 | |
| *** jbadiapa has quit IRC | 09:55 | |
| frickler | infra-root: there seem to be lots of "old" (as in previous days) images in /opt/nodepool_dib but I'm unsure how to select which to delete, any ideas? | 10:00 |
| *** slaweq_ has joined #openstack-infra | 10:03 | |
| *** zbr has quit IRC | 10:08 | |
| *** zbr has joined #openstack-infra | 10:09 | |
| *** e0ne has quit IRC | 10:14 | |
| *** jbadiapa has joined #openstack-infra | 10:15 | |
| *** zbr has quit IRC | 10:16 | |
| *** jbadiapa has quit IRC | 10:16 | |
| *** electrofelix has joined #openstack-infra | 10:16 | |
| *** e0ne has joined #openstack-infra | 10:17 | |
| *** slaweq_ is now known as slaweq | 10:18 | |
| *** jbadiapa has joined #openstack-infra | 10:18 | |
| *** zbr has joined #openstack-infra | 10:21 | |
| *** zbr has quit IRC | 10:22 | |
| *** jbadiapa has quit IRC | 10:25 | |
| *** wolverineav has quit IRC | 10:25 | |
| *** jbadiapa has joined #openstack-infra | 10:37 | |
| frickler | #status log restarted gerritbot which seems to have dropped out at 08:24:30,089 and not recovered after that | 10:48 |
| openstackstatus | frickler: finished logging | 10:48 |
| *** jaosorior has quit IRC | 10:53 | |
| *** e0ne has quit IRC | 10:58 | |
| *** nicolasbock has joined #openstack-infra | 10:58 | |
| *** e0ne has joined #openstack-infra | 10:59 | |
| *** eharney has quit IRC | 11:16 | |
| *** priteau has quit IRC | 11:19 | |
| *** wolverineav has joined #openstack-infra | 11:23 | |
| *** nickv1985 has quit IRC | 11:27 | |
| *** nickv1985 has joined #openstack-infra | 11:28 | |
| *** whoami-rajat has quit IRC | 11:30 | |
| *** whoami-rajat has joined #openstack-infra | 11:34 | |
| *** zbr has joined #openstack-infra | 11:38 | |
| *** wolverineav has quit IRC | 11:40 | |
| *** eharney has joined #openstack-infra | 11:43 | |
| roman_g | Hello everyone. We are seeing the following issue with Zuul jobs starting from 19-20th of March: "The field 'environment' has an invalid value, which includes an undefined variable. The error was: 'dict object' has no attribute 'newrev'." We are using 'zuul.newrev' variable during check and other jobs, and since recent time (1-2 days) it has started to pop the error message, which maked gates | 11:43 |
| roman_g | failing. Variable should have contained Git commit ID (https://zuul-ci.org/docs/zuul/user/jobs.html#var-zuul.newrev). Could we know what has been changed and an advice on how to get issue resolved? Thank you. | 11:44 |
| frickler | roman_g: the ansible version that is run by zuul was updated from 2.5 to 2.7, there was a mail on the ml about that | 11:47 |
| frickler | roman_g: what was only a (hidden) warning is now an error | 11:47 |
| *** dave-mccowan has joined #openstack-infra | 11:49 | |
| frickler | roman_g: do you have a pointer to the failure? best approach is to fix your job if possible | 11:49 |
| roman_g | frickler: good to know, thank you. But variable is documented in Zuul docs. | 11:50 |
| roman_g | http://logs.openstack.org/58/644958/3/check/airship-pegleg-docker-build-gate/5069cc0/ara-report/result/8fab5ca2-e584-4a37-b37d-7646d7eb0914/ | 11:50 |
| roman_g | http://logs.openstack.org/58/644958/3/check/airship-pegleg-docker-build-gate/5069cc0/ara-report/file/c7054db2-853d-4a34-b87d-7c4d0466a902/#line-30 | 11:50 |
| *** jaosorior has joined #openstack-infra | 11:51 | |
| *** rh-jelabarre has joined #openstack-infra | 11:51 | |
| *** panda is now known as panda|lunch | 11:52 | |
| *** dave-mccowan has quit IRC | 11:53 | |
| *** jpena is now known as jpena|lunch | 12:01 | |
| frickler | roman_g: iiuc .oldrev and .newrev are only set for merges or pushes, not for changes being tested in the check queue, where these values will be undefined. so your job definition should allow for that to happen by e.g. adding "|| default('')" or similar | 12:04 |
| *** kjackal has quit IRC | 12:05 | |
| roman_g | frickler: yes, I see. thank you for the explanation. | 12:07 |
| *** eharney has quit IRC | 12:09 | |
| *** jbadiapa has quit IRC | 12:10 | |
| *** jamesmcarthur has joined #openstack-infra | 12:11 | |
| *** jtomasek has joined #openstack-infra | 12:11 | |
| *** rf0lc0 is now known as rfolco | 12:16 | |
| *** markvoelker has quit IRC | 12:22 | |
| *** openstackgerrit has joined #openstack-infra | 12:22 | |
| openstackgerrit | Riju Khatri proposed openstack-infra/storyboard-webclient master: Show all stories created and allows them to filter according to status https://review.openstack.org/642370 | 12:22 |
| Shrews | frickler: which images are "old"? | 12:22 |
| Shrews | hrm, we do seem to have more images than we should | 12:27 |
| *** kjackal has joined #openstack-infra | 12:27 | |
| *** jamesmcarthur has quit IRC | 12:30 | |
| *** jamesmcarthur has joined #openstack-infra | 12:31 | |
| *** trown|outtypewww is now known as trown | 12:32 | |
| *** rh-jelabarre has quit IRC | 12:34 | |
| *** Wryhder has joined #openstack-infra | 12:35 | |
| *** jamesmcarthur has quit IRC | 12:35 | |
| *** Lucas_Gray has quit IRC | 12:36 | |
| *** Wryhder is now known as Lucas_Gray | 12:36 | |
| Shrews | frickler: i think this is why: http://paste.openstack.org/show/748166/ | 12:38 |
| *** mriedem has joined #openstack-infra | 12:38 | |
| Shrews | we are repeatedly trying to upload a newer image, but failing. in the mean time, newer images keep getting built and taking up space | 12:39 |
| Shrews | that file is... 15G? geez | 12:41 |
| *** kgiusti has joined #openstack-infra | 12:42 | |
| *** yamamoto has joined #openstack-infra | 12:42 | |
| *** yamamoto has quit IRC | 12:43 | |
| fungi | we ought to take that whole provider out of our configuration. it's not been around for a while, though may get rebuilt at some point in the future | 12:44 |
| Shrews | fungi: it seems to be the only one having an issue with this | 12:45 |
| fungi | yeah, and it's been offline since october: http://grafana.openstack.org/d/U462abNik/nodepool-packethost?orgId=1&from=now-6M&to=now | 12:46 |
| fungi | so doesn't really do us much good uploading to it every night since then | 12:46 |
| Shrews | agreed | 12:46 |
| *** yolanda has joined #openstack-infra | 12:46 | |
| Shrews | i *think* if we remove it, things should fix themselves (he says, crossing his fingers) | 12:47 |
| fungi | that said, if the fedora images are anomalously larger than the rest, we probably want to know why | 12:47 |
| Shrews | well, that size does seem to be about the same across other distros for the .raw file | 12:48 |
| Shrews | http://paste.openstack.org/show/748167/ | 12:48 |
| fungi | in that case probably just removing packethost-us-west-1 from configuration (and then maybe cleaning up if nodepool doesn't) is probably sufficient | 12:49 |
| *** e0ne has quit IRC | 12:51 | |
| *** yamamoto has joined #openstack-infra | 12:51 | |
| *** dtantsur is now known as dtantsur|brb | 12:52 | |
| *** lseki has joined #openstack-infra | 12:53 | |
| *** eharney has joined #openstack-infra | 12:56 | |
| openstackgerrit | David Shrewsbury proposed openstack-infra/project-config master: Remove packethost from nodepool builders https://review.openstack.org/645168 | 12:58 |
| Shrews | fungi: frickler: ^ | 12:59 |
| openstackgerrit | Riju Khatri proposed openstack-infra/storyboard master: Projects can be browsed using stories https://review.openstack.org/645169 | 12:59 |
| *** yamamoto has quit IRC | 13:05 | |
| *** yamamoto has joined #openstack-infra | 13:05 | |
| *** yamamoto has quit IRC | 13:06 | |
| *** panda|lunch is now known as panda|sick | 13:07 | |
| *** irclogbot_2 has quit IRC | 13:07 | |
| *** irclogbot_1 has joined #openstack-infra | 13:08 | |
| fungi | thanks Shrews! | 13:09 |
| *** jamesmcarthur has joined #openstack-infra | 13:10 | |
| Shrews | 413 Request Entity Too Large: Image storage media is full: There is not enough disk space on the image storage media. | 13:12 |
| Shrews | that's just fyi :) | 13:13 |
| Shrews | poor ol' packethost | 13:14 |
| *** sthussey has joined #openstack-infra | 13:14 | |
| openstackgerrit | Merged openstack-infra/project-config master: Remove packethost from nodepool builders https://review.openstack.org/645168 | 13:17 |
| *** jpena|lunch is now known as jpena | 13:20 | |
| *** altlogbot_2 has quit IRC | 13:23 | |
| *** e0ne has joined #openstack-infra | 13:23 | |
| *** altlogbot_0 has joined #openstack-infra | 13:24 | |
| fungi | honestly, i'm surprised the glance api is still accepting uploads at all | 13:27 |
| frickler | Shrews: we probably still need to clean up the builders manually now? | 13:28 |
| *** janki has quit IRC | 13:28 | |
| Shrews | frickler: i think nodepool should recognize it no longer needs to upload the newer images to packethost and then automatically clean up older images | 13:29 |
| *** jbadiapa has joined #openstack-infra | 13:29 | |
| Shrews | frickler: packethost itself needs manual cleanup to remove any uploaded images, if you want to do that | 13:29 |
| pabelanger | Shrews: frickler that isn't goint to work is it? packethost still is defined in provider section (with diskimages) in nl02 | 13:30 |
| *** yamamoto has joined #openstack-infra | 13:30 | |
| pabelanger | removing the images there should stop uploads from happening | 13:31 |
| Shrews | pabelanger: provider uploads don't depend on the launcher config in any way (at least, they shouldn't) | 13:33 |
| frickler | Shrews: I'm not sure it will update the upload list for images that have already been built, but I think we can wait a bit and see if it cleans anything up | 13:35 |
| *** wolverineav has joined #openstack-infra | 13:37 | |
| *** e0ne has quit IRC | 13:37 | |
| *** altlogbot_0 has quit IRC | 13:39 | |
| *** whoami-rajat has quit IRC | 13:40 | |
| *** altlogbot_1 has joined #openstack-infra | 13:40 | |
| Shrews | frickler: it should skip uploading for any providers not in the config: https://git.openstack.org/cgit/openstack-infra/nodepool/tree/nodepool/builder.py#n1060 | 13:41 |
| Shrews | frickler: although, hrm... you might be right about how the upload recency table sees providers. i'll have to look at that (since it would be a bug) | 13:44 |
| Shrews | that might affect the cleanup phase | 13:44 |
| pabelanger | https://zuul-ci.org/docs/nodepool/operation.html#removing-a-provider is usually the step I follow, with deleting builder configuration last | 13:45 |
| *** irclogbot_1 has quit IRC | 13:45 | |
| *** e0ne has joined #openstack-infra | 13:45 | |
| *** irclogbot_3 has joined #openstack-infra | 13:46 | |
| frickler | pabelanger: Shrews: indeed, the key point in that step might be setting max-servers to -1 instead of 0, which is claimed to also stop uploads | 13:47 |
| *** yamamoto has quit IRC | 13:48 | |
| pabelanger | I don't think -1 does anything in nodepoolv3 any more, I know removing label from pools section does | 13:48 |
| pabelanger | should know more in a few, once puppet runs | 13:49 |
| openstackgerrit | Merged openstack-infra/elastic-recheck master: Remove old queries for stale and/or fixed bugs https://review.openstack.org/645040 | 13:49 |
| *** yamamoto has joined #openstack-infra | 13:50 | |
| *** rh-jelabarre has joined #openstack-infra | 13:50 | |
| Shrews | pabelanger: oh, i suppose removing diskimages portion for nb02 first would have been the "proper" way. | 13:50 |
| Shrews | that would have removed existing uploads | 13:51 |
| *** adriant has quit IRC | 13:51 | |
| *** adriant has joined #openstack-infra | 13:52 | |
| Shrews | pabelanger: we could still do that. maybe we should? | 13:52 |
| *** jistr is now known as jistr|call | 13:52 | |
| fungi | in this case i don't think we care since last we heard that environment is abandoned and going to be eventually wiped and rebuilt anyway | 13:52 |
| fungi | it was just a private cloud deployment they were managing for our use | 13:53 |
| Shrews | fungi: but i think that would have solved the cleanup issue though (zk still registers the uploads, so ondisk files won't be deleted). i think i can fix that manually though | 13:54 |
| fungi | ahh, yeah i suppose we do want it to clean up the data in /opt and in zk? | 13:55 |
| pabelanger | yah, my gut says if we revert and do nl02 first, everything should delete automatically. I am not sure what will happen if we delete diskimages in nodepool-builder first | 13:55 |
| openstackgerrit | Nate Johnston proposed openstack-infra/irc-meetings master: Remove neutron_upgrades meeting https://review.openstack.org/645181 | 13:56 |
| Shrews | pabelanger: nl02 should have 0 impact on the builder, only instances (are there shouldn't be any of those) | 13:56 |
| *** jistr|call is now known as jistr | 14:00 | |
| openstackgerrit | David Shrewsbury proposed openstack-infra/project-config master: Cleanup packethost zk data https://review.openstack.org/645184 | 14:00 |
| Shrews | pabelanger: i think ^ that's right? | 14:00 |
| *** lpetrut has quit IRC | 14:06 | |
| *** lpetrut has joined #openstack-infra | 14:07 | |
| pabelanger | Shrews: I am unsure, I don't think I have every tried that | 14:12 |
| *** wolverineav has quit IRC | 14:12 | |
| *** jaosorior has quit IRC | 14:15 | |
| fungi | project-config-nodepool chokes on it | 14:16 |
| fungi | Shrews: i left an inline comment, looks like it wants something like diskimages: [] there | 14:17 |
| openstackgerrit | David Shrewsbury proposed openstack-infra/project-config master: Cleanup packethost zk data https://review.openstack.org/645184 | 14:19 |
| Shrews | fungi: ah yeah. thx | 14:19 |
| Shrews | i'm also confused as to why the builder is still trying to upload images to packethost when it doesn't exist in the config :/ | 14:20 |
| *** whoami-rajat has joined #openstack-infra | 14:23 | |
| openstackgerrit | Matt Riedemann proposed openstack-infra/elastic-recheck master: Add query for neutron functional ansible bug 1820993 https://review.openstack.org/645193 | 14:26 |
| openstack | bug 1820993 in neutron "Functional and fullstack tests job definition is broken" [Critical,In progress] https://launchpad.net/bugs/1820993 - Assigned to Slawek Kaplonski (slaweq) | 14:26 |
| Shrews | oh, it isn't. those were uploads that were in progress when the config changed | 14:28 |
| *** jamesmcarthur has quit IRC | 14:29 | |
| sshnaidm|rover | how the zuul containers are built now? | 14:32 |
| corvus | sshnaidm|rover: https://opendev.org/openstack-infra/zuul/src/branch/master/Dockerfile | 14:33 |
| *** gfidente has quit IRC | 14:33 | |
| sshnaidm|rover | corvus, thanks, and where are scripts that execute it? Do we push it somewhere? | 14:34 |
| Shrews | pabelanger: so, packethost on nl02 was already disabled so time ago. that caused all instances to be removed, so there is no need to worry about that. images are the only concern now, if that clears up any confusion | 14:34 |
| *** jamesmcarthur has joined #openstack-infra | 14:35 | |
| *** altlogbot_1 has quit IRC | 14:35 | |
| mordred | sshnaidm|rover: https://hub.docker.com/u/zuul | 14:36 |
| *** altlogbot_0 has joined #openstack-infra | 14:36 | |
| corvus | sshnaidm|rover: https://opendev.org/opendev/base-jobs/src/branch/master/doc/source/docker-image.rst is the set of jobs to use to build images | 14:36 |
| *** yamamoto has quit IRC | 14:36 | |
| corvus | hrm. that doesn't look great rendered like that | 14:36 |
| corvus | sshnaidm|rover: https://opendev.org/opendev/base-jobs/raw/branch/master/doc/source/docker-image.rst | 14:37 |
| corvus | we still need to publish that somewhere :) | 14:37 |
| mordred | yeah | 14:37 |
| *** dtantsur|brb is now known as dtantsur | 14:37 | |
| *** yamamoto has joined #openstack-infra | 14:37 | |
| *** irclogbot_3 has quit IRC | 14:38 | |
| *** gfidente has joined #openstack-infra | 14:38 | |
| *** irclogbot_1 has joined #openstack-infra | 14:39 | |
| *** yamamoto has quit IRC | 14:42 | |
| clarkb | to clarify the correct way to automatically clean up a provider is to set max servers to 0 then the provider diskimages to empty list. If there are unused labels you might need to manually delete a few nodes. Then thereshould be no zk or disk respurces tied to the provider and the provider config can be removed | 14:46 |
| corvus | fungi, jamesmcarthur: i just got this when updating a wiki page: http://paste.openstack.org/show/748176/ the update did work | 14:47 |
| clarkb | if you remove the providwr config before the resources are removed then nodepool.gets angry trying to manage those resources without a config | 14:47 |
| fungi | corvus: that's certainly neat. i expect it's trove being slow | 14:48 |
| fungi | we haven't upgraded mediawiki there in faaar too long, so i have a feeling it's not a forgotten db migration | 14:49 |
| corvus | fungi: yeah, could be nothin'. maybe see if it happens again :) | 14:49 |
| jamesmcarthur | fun! | 14:50 |
| *** panda|sick is now known as panda|drappt | 14:50 | |
| frickler | #status log frickler force-merging https://review.openstack.org/644842 in order to unblock neutron after ansible upgrade | 14:53 |
| openstackstatus | frickler: finished logging | 14:53 |
| openstackgerrit | Merged openstack-infra/elastic-recheck master: Add query for neutron functional ansible bug 1820993 https://review.openstack.org/645193 | 14:54 |
| openstack | bug 1820993 in neutron "Functional and fullstack tests job definition is broken" [Critical,In progress] https://launchpad.net/bugs/1820993 - Assigned to Slawek Kaplonski (slaweq) | 14:54 |
| fungi | frickler: what was the deadlock with 644842? | 14:54 |
| frickler | fungi: it failed due to other unstable neutron jobs. but no fixes for those can get merged since our ansible update | 14:55 |
| frickler | failed like 6 times now | 14:55 |
| frickler | or 24h | 14:55 |
| fungi | bypassing ci rather than just disabling the unstable jobs is a questionable choice | 14:56 |
| frickler | fungi: please have a look at the patch, it seems like a very obvious fix only affecting zuul config | 14:57 |
| fungi | i get that, just if you can't get that fix merged due to unstable jobs, there were other less drastic options like temporarily removing the unstable jobs or squashing that fix with the fixes for the other jobs | 14:58 |
| fungi | and more to the point, they're solutions available to everyone rather than requiring intervention of a gerrit administrator | 15:01 |
| frickler | fungi: o.k., I've forwarded that feedback to the neutron folks, thanks | 15:08 |
| *** wolverineav has joined #openstack-infra | 15:08 | |
| *** dpawlik is now known as dpawlik_ | 15:13 | |
| *** pcrews has joined #openstack-infra | 15:13 | |
| *** eharney has quit IRC | 15:22 | |
| *** jbadiapa has quit IRC | 15:26 | |
| *** jamesmcarthur has quit IRC | 15:27 | |
| openstackgerrit | James E. Blair proposed openstack-infra/system-config master: Periodically release project.opendev volume https://review.openstack.org/645206 | 15:28 |
| clarkb | corvus: re ^ can we set up a RO volume on afs02.dfw too? | 15:29 |
| corvus | clarkb: i did | 15:29 |
| clarkb | I'm assuming that is implied otherwise why release but wanted to make sure we did | 15:29 |
| clarkb | great! | 15:29 |
| corvus | it's now the standard 2-replica setup | 15:30 |
| pabelanger | mordred: ianw: any interest on pushing http://git.openstack.org/cgit/openstack-infra/system-config/tree/playbooks/filter_plugins/getaddrinfo.py upstream to ansible? Or objections is I do? I think it is pretty neat little filter | 15:30 |
| mordred | pabelanger: we need to relicense it - so we need to check who worked on it | 15:31 |
| openstackgerrit | Natal Ngétal proposed openstack-dev/pbr master: Change python3.5 job to python3.7 job on Stein+ https://review.openstack.org/610659 | 15:31 |
| *** Lucas_Gray has quit IRC | 15:31 | |
| pabelanger | mordred: so far you and ianw :) | 15:32 |
| mordred | pabelanger: looks like ianw, corvus and I - all while at RH - so I imagine doing such a thing as part of submitting it should be fine - but we should email fontana to get an ack | 15:32 |
| clarkb | mordred: fwiw apache2 is compat with gplv3 so if ansible is ok with that interpretation of the code they care it should be ok as is? (I'm not a lawyer) | 15:32 |
| mordred | clarkb: I think I'd rather just get the ack from fontana and make it gpl :) | 15:33 |
| pabelanger | oh, I missed corvus | 15:33 |
| corvus | mordred, pabelanger: i'm okay relicensing | 15:33 |
| clarkb | corvus: fungi: Thinking back to the last lists.o.o upgrade we did: If I make a snapshot of the server then walk through a do-unattended-upgrade do I need to run exim queues to zero first or any other special considerations to prevent sending duplicate emails (or email at all)? | 15:35 |
| pabelanger | corvus: mordred: ianw: okay, I'll propose a patch to relicense, get approval from everybody, then cc fontana | 15:35 |
| clarkb | I'd like to start making progress on testing an upgrade of that server | 15:35 |
| mordred | pabelanger, clarkb: I have emailed fontana asking for an ack | 15:36 |
| pabelanger | thanks! | 15:36 |
| *** mattw4 has joined #openstack-infra | 15:36 | |
| mordred | pabelanger: oh - maybe reply to the rh email I just sent with the patch? | 15:36 |
| pabelanger | sure | 15:36 |
| mordred | pabelanger: actually, I do not believe ianw, corvus or I have legal standing to approve or deny it, we don't hold any copyright | 15:37 |
| fungi | clarkb: in theory you shouldn't need to take any special steps. when the mm queue runners and exim daemons are stopped and then started again later stuff should just pick back up | 15:37 |
| mordred | so just fontana/rh ack should be sufficient | 15:37 |
| clarkb | fungi: right I don't want it to pick things up when I boot the snapshot do I/ | 15:37 |
| fungi | oh, i see what you mean | 15:37 |
| clarkb | Most mail servers will likely end up rejecting the emails as I won't have dns set up for the snapshot, but if I can be a better email citizen I am happy to do so | 15:39 |
| *** pgaxatte has quit IRC | 15:39 | |
| fungi | maybe temporarily configure exim and mailman not to start, then take the snapshot, then undo the temporary configuration? | 15:40 |
| fungi | that way they won't suddenly start trying to deliver copies of things when you boot the snapshot | 15:41 |
| openstackgerrit | Merged openstack-infra/system-config master: Update more servers to puppet 4 https://review.openstack.org/643713 | 15:41 |
| clarkb | ya that may work. One concern with that is the upstart -> systemd transition seems to ignore whether or not a services was previously disabled. But we could clear queues on the snapshot host after first boot and before the upgrade | 15:41 |
| *** wolverineav has quit IRC | 15:42 | |
| fungi | wfm | 15:42 |
| clarkb | ok I'll start on that after the puppet 4 changes that just merged are applied and happy | 15:43 |
| fungi | also worth keeping in mind, this will be the same newer mm version in use on lists.katacontainers.io and corvus has expressed some concern with availability of new dmarc mitigation options provided to list owners, so there may also be some preliminary reconfiguration we want to consider for mm as part of the production upgrade | 15:43 |
| *** luizbag has left #openstack-infra | 15:43 | |
| clarkb | do we expect mailman to default into those settings on the newer version? | 15:44 |
| clarkb | I guess we can check on the test node | 15:44 |
| fungi | it won't default to them afaik, but it will allow list owners to select them | 15:44 |
| *** mattw4 has quit IRC | 15:44 | |
| *** jamesmcarthur has joined #openstack-infra | 15:45 | |
| *** mattw4 has joined #openstack-infra | 15:48 | |
| *** hwoarang has quit IRC | 15:49 | |
| *** jamesmcarthur has quit IRC | 15:50 | |
| *** hwoarang has joined #openstack-infra | 15:51 | |
| *** jamesmcarthur has joined #openstack-infra | 15:54 | |
| openstackgerrit | Merged openstack-dev/pbr master: Fix nits and typos on release note message. https://review.openstack.org/644563 | 15:55 |
| *** gyee has joined #openstack-infra | 15:57 | |
| openstackgerrit | David Shrewsbury proposed openstack-infra/nodepool master: Update docs for provider removal. https://review.openstack.org/645220 | 15:59 |
| Shrews | pabelanger: clarkb: that doc update ^ may be helpful for us in the future | 16:00 |
| *** diablo_rojo has joined #openstack-infra | 16:01 | |
| *** hwoarang has quit IRC | 16:05 | |
| *** hwoarang has joined #openstack-infra | 16:06 | |
| *** e0ne has quit IRC | 16:10 | |
| *** adriancz has quit IRC | 16:12 | |
| *** eharney has joined #openstack-infra | 16:14 | |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul master: Fix Ansible 2.7 uri module https://review.openstack.org/645034 | 16:18 |
| *** imacdonn has joined #openstack-infra | 16:19 | |
| *** mattw4 has quit IRC | 16:21 | |
| *** jaosorior has joined #openstack-infra | 16:27 | |
| clarkb | Shrews: one thing on https://review.openstack.org/#/c/645220/1 otherwise lgtm | 16:28 |
| *** jamesmcarthur has quit IRC | 16:29 | |
| clarkb | well that is curious. puppet4 on grafana.o.o downgraded grafana from 5.4.2 to 5.1.3 | 16:30 |
| clarkb | the service still works though I'll look into why that has happened | 16:30 |
| clarkb | also groups.o.o doesn't appear to be puppet4'ing I Think because it is trusty | 16:30 |
| clarkb | cmurphy: ^ fyi | 16:30 |
| mriedem | booya this looks pretty good http://status.openstack.org/elastic-recheck/data/integrated_gate.html | 16:31 |
| mriedem | Overall Categorization Rate: 71.3% | 16:31 |
| fungi | i think we can just ignore groups.o.o at this point | 16:31 |
| clarkb | fungi: yup | 16:31 |
| *** lpetrut has quit IRC | 16:32 | |
| clarkb | looking at our puppet we actually do request grafana 5.1.3 so I think it was doing the unexpected thing before | 16:32 |
| clarkb | perhaps improvments to the pip module were made | 16:32 |
| *** tobias-urdin has quit IRC | 16:32 | |
| clarkb | ianw: ^ when your day starts is the grafana version selector something we can cleanup in puppet? It has an explicity check for grafana02 being the host name which we can remove I think. Then maybe we consider updating to 5.4.2 since that is apparently what we were running before | 16:33 |
| fungi | yeah, i'd take that as an indication it's safe to update ;) | 16:34 |
| fungi | how do we install it? vcsrepo? there were some changes around how it handles tags coupled with latest | 16:34 |
| clarkb | fungi: I think via pip | 16:34 |
| fungi | oh, interesting | 16:35 |
| clarkb | I'm double checking it is in a community module not one of ours | 16:35 |
| fungi | could be behavior changes in the pip package provider in that case | 16:35 |
| clarkb | deb https://packagecloud.io/grafana/stable/debian wheezy main | 16:37 |
| clarkb | we install it from that deb repo | 16:37 |
| clarkb | possibly a bug in version handling | 16:37 |
| clarkb | in any case we have the version specified now and I think we can bump that version back up to 5.4.2 as well as cleanup our version selector code in system-config's grafana.pp | 16:38 |
| clarkb | but will double check with ianw later today | 16:38 |
| fungi | https://packagecloud.io/grafana/stable | 16:39 |
| fungi | yeah, and should probably use the stretch one | 16:39 |
| fungi | or at least jessie | 16:40 |
| clarkb | fungi: https://github.com/voxpupuli/puppet-grafana/blob/v2.6.1/manifests/install.pp#L78 seems to be hardcoded. For that we probably have to bump the grafana module version up (also potentially doable) | 16:40 |
| fungi | since stretch was released in june 2017 and ubuntu grabs packages out of testing generally, that's probably the most contemporary to 16.04 | 16:41 |
| fungi | as jessie predated xenial by a year | 16:42 |
| fungi | oh, and looks like http://docs.grafana.org/installation/debian/ is the new home of their packages anyway | 16:43 |
| clarkb | I think the longer term plan from ianw was to deploy with docker | 16:44 |
| clarkb | and they publish docker images iirc | 16:44 |
| fungi | oh, nice | 16:44 |
| mordred | ++ | 16:44 |
| openstackgerrit | Merged openstack-infra/system-config master: Periodically release project.opendev volume https://review.openstack.org/645206 | 16:54 |
| *** rpittau is now known as rpittau|afk | 16:55 | |
| clarkb | infra-root I've started taking notes of lists.o.o upgrade testing process https://etherpad.openstack.org/p/lists.o.o-trusty-to-xenial can you review my snapshot taking detaisl there to make sure I've not missed anything? | 16:55 |
| *** jamesmcarthur has joined #openstack-infra | 16:55 | |
| *** helenafm has quit IRC | 16:58 | |
| *** ricolin has quit IRC | 16:58 | |
| *** jamesmcarthur has quit IRC | 17:01 | |
| fungi | clarkb: is it assumed that after 1.1 you'll wait for any running configuration management pulse to complete before proceeding to 1.2? | 17:03 |
| clarkb | fungi: yes, however we should call that out | 17:04 |
| fungi | good call. that has caught me a few times | 17:04 |
| corvus | clarkb: lgtm... i didn't see anything about the dmarc configuration in there, so i added a step 7 if we want to do that. | 17:04 |
| clarkb | ++ though I'm not trying to get too far ahead as I may learn things in the earlier steps. But some high level goals for testing and config updates would be good | 17:05 |
| clarkb | fungi: corvus: how does 5.1 look? | 17:06 |
| fungi | wfm | 17:07 |
| fungi | also, anybody happen to know if etherpad configuration cookies periodically expire? wondering why i need to semi-regularly set my name and color again | 17:07 |
| clarkb | I've added lists.o.o to the emergency file and will pick upt he subsequent takss when it is safe to do so | 17:08 |
| openstackgerrit | Fabien Boucher proposed openstack-infra/zuul master: wip - Elasticsearch Zuul reporter https://review.openstack.org/644927 | 17:10 |
| * clarkb finds some breakfast | 17:10 | |
| openstackgerrit | Fabien Boucher proposed openstack-infra/zuul master: wip - Elasticsearch Zuul reporter https://review.openstack.org/644927 | 17:11 |
| openstackgerrit | Luigi Toscano proposed openstack-infra/zuul-jobs master: DNM Debug stage-output https://review.openstack.org/645239 | 17:12 |
| *** trown is now known as trown|lunch | 17:12 | |
| mordred | clarkb: they don't bring you breakfast an hour before you land? oh wait - that's me | 17:15 |
| *** mriedem is now known as mriedem_grooming | 17:16 | |
| openstackgerrit | David Shrewsbury proposed openstack-infra/nodepool master: Update docs for provider removal. https://review.openstack.org/645220 | 17:21 |
| *** psachin has joined #openstack-infra | 17:22 | |
| *** jpich has quit IRC | 17:23 | |
| *** iurygregory has quit IRC | 17:25 | |
| openstackgerrit | Merged openstack-infra/zuul master: Add missing Ansible invocation debug env variables https://review.openstack.org/645035 | 17:28 |
| *** psachin has quit IRC | 17:29 | |
| *** dtantsur is now known as dtantsur|afk | 17:30 | |
| *** psachin has joined #openstack-infra | 17:31 | |
| *** mattw4 has joined #openstack-infra | 17:32 | |
| *** Vadmacs has joined #openstack-infra | 17:33 | |
| *** psachin has quit IRC | 17:34 | |
| *** gmann is now known as gmann_afk | 17:43 | |
| cmurphy | clarkb: anything you need my help with? are we ignoring groups.o.o? | 17:43 |
| clarkb | cmurphy: I think we are goign to ignore groups.o.o since that service is being sunsetted | 17:44 |
| clarkb | cmurphy: maybe we should just remove them from the puppet4 list for now? | 17:44 |
| clarkb | other than that I think we are good to keep continuing | 17:44 |
| cmurphy | are there other trusty servers that will have the same problem that we need to worry about? | 17:44 |
| * cmurphy would have thought the script worked on trusty | 17:45 | |
| clarkb | cmurphy: https://etherpad.openstack.org/p/201808-infra-server-upgrades-and-cleanup has the current list of outstanding trusty servers | 17:45 |
| clarkb | ya I'm not sure why it didn't run there yet, but it definitely seems to have not run the upgrade on groups | 17:46 |
| clarkb | infra-root I'm running the update-rc.d disables on lists.o.o now. WIll let you all know when I've reenabled things | 17:46 |
| fungi | cmurphy: also obviously groups-dev is similarly ignorable | 17:49 |
| clarkb | snapshot is being created now | 17:50 |
| *** derekh has quit IRC | 18:02 | |
| *** e0ne has joined #openstack-infra | 18:05 | |
| *** ginopc has quit IRC | 18:07 | |
| *** e0ne has quit IRC | 18:12 | |
| *** gfidente has quit IRC | 18:14 | |
| clarkb | infra-root can I get a second reviewer on https://review.openstack.org/#/c/643714/1 I can watch that go in while I wait for lsits.o.o to snapshot | 18:14 |
| clarkb | fungi: thanks! | 18:18 |
| fungi | any time | 18:19 |
| *** trown|lunch is now known as trown | 18:22 | |
| *** jpena is now known as jpena|off | 18:22 | |
| *** whoami-rajat has quit IRC | 18:23 | |
| clarkb | mordred: re breakfast when I fly I tend to not get breakfast delivered because I fly in cattle class | 18:24 |
| clarkb | One of my favorite instances of this was the flight to sydney. American's food supplier in LAX had some foodbourne disease outbreak so we basically got no food | 18:24 |
| clarkb | they didn't even tell us preboarding when I could have walkred to the store 100' away and got food | 18:25 |
| *** yamamoto has joined #openstack-infra | 18:27 | |
| *** yamamoto has quit IRC | 18:31 | |
| openstackgerrit | Riju Khatri proposed openstack-infra/storyboard master: Search bars handle queries as if they have a * at the end https://review.openstack.org/644487 | 18:37 |
| openstackgerrit | Fabien Boucher proposed openstack-infra/zuul master: wip - Elasticsearch Zuul reporter https://review.openstack.org/644927 | 18:39 |
| corvus | clarkb: one of my favorite details from gene wolfe's _book of the long sun_ is that the protagonists are called "cargo", but they don't know why :) | 18:40 |
| *** gmann_afk is now known as gmann | 18:40 | |
| clarkb | I probably should resign to being cargo when flying :/ | 18:43 |
| *** electrofelix has quit IRC | 18:43 | |
| *** kopecmartin is now known as kopecmartin|off | 18:43 | |
| efried | mordred: Sorry to have forgotten about this, but ubuntu-bionic-ovh-gra1-0003816856 should be returned to the node pool. That'll make the gate start flying, right? | 18:44 |
| openstackgerrit | Riju Khatri proposed openstack-infra/storyboard master: Projects can be browsed using stories https://review.openstack.org/645169 | 18:44 |
| efried | (mordred: this is the one we stopped last week when we were PoCing the ironicclient business) | 18:44 |
| Shrews | efried: i can delete that for you | 18:46 |
| clarkb | lists.o.o snapshot is still queued | 18:46 |
| efried | Shrews: Thanks | 18:46 |
| clarkb | I see that this host's disk is not small | 18:46 |
| clarkb | probably related | 18:46 |
| Shrews | corvus: do you still need the 7 nodes you have in hold? some are a month old | 18:49 |
| corvus | Shrews: nope, if you want to delete them while you're there, i thank you | 18:51 |
| Shrews | corvus: will do | 18:51 |
| *** mriedem_grooming is now known as mriedem | 18:53 | |
| *** sshnaidm|rover is now known as sshnaidm|off | 19:03 | |
| openstackgerrit | Merged openstack-infra/system-config master: Update more servers to puppet 4 https://review.openstack.org/643714 | 19:03 |
| clarkb | fungi: openstackid01.openstack.org has the node symlink issue and that is making puppet unhappy (this is pre puppet 4) | 19:07 |
| clarkb | fungi: I'm going to apt-get install --reinstall nodejs to correct it | 19:08 |
| fungi | clarkb: thanks. it previously had looked like it wasn't affected, but somewhat relieved to find out it was consistent after all | 19:08 |
| clarkb | as expected reinstalling nodejs has corrected the issue | 19:09 |
| clarkb | or at least the link loop issue. Yet to see if puppet becomes happy | 19:09 |
| openstackgerrit | Fabien Boucher proposed openstack-infra/zuul master: wip - Elasticsearch Zuul reporter https://review.openstack.org/644927 | 19:13 |
| openstackgerrit | Merged openstack-infra/zuul master: Fix Ansible 2.7 uri module https://review.openstack.org/645034 | 19:21 |
| *** sthussey has quit IRC | 19:23 | |
| *** whoami-rajat has joined #openstack-infra | 19:25 | |
| *** e0ne has joined #openstack-infra | 19:30 | |
| openstackgerrit | Riju Khatri proposed openstack-infra/storyboard master: Search bars handle queries as if they have a * at the end https://review.openstack.org/644487 | 19:32 |
| clarkb | fungi: that does seem to have made puppet happy | 19:34 |
| clarkb | next run should be puppet4 | 19:34 |
| smcginnis | We might have a zuul upgrade issue on one of the auto-generated branching patches. | 19:42 |
| smcginnis | edmondsw pointed out this failure: http://logs.openstack.org/45/645245/1/check/openstack-tox-lower-constraints/dbd4f19/job-output.txt.gz#_2019-03-21_17_38_26_801860 | 19:43 |
| smcginnis | "AttributeError: module 'appdirs' has no attribute 'system'" ring any bells for anyone? | 19:43 |
| edmondsw | seeing that on both of the automatic patches to stable/stein since the branch was created | 19:43 |
| fungi | just on specific projects, or all of them? | 19:43 |
| edmondsw | e.g. anyone else seeing openstack-tox-lower-constraints failing with "AttributeError: module 'appdirs' has no attribute 'system'"? | 19:44 |
| smcginnis | I've seen other ones pass fine. | 19:44 |
| edmondsw | just the networking-powervm | 19:44 |
| smcginnis | Quite a few have merged in the last couple days. Really odd this would only show up here and only on these stable/stein patches. | 19:44 |
| edmondsw | ceilometer-powervm seems to be fine | 19:44 |
| pabelanger | mnaser: clarkb: vexxhost-sjc1 doesn't look happy, do we have any idea what is going on? http://grafana.openstack.org/dashboard/db/nodepool-vexxhost | 19:44 |
| pabelanger | I can look now if needed | 19:44 |
| edmondsw | and I've got a different problem to track down for nova-powervm: "Error: could not determine PostgreSQL version from '10.6'" | 19:45 |
| mnaser | oof | 19:45 |
| mnaser | hmm | 19:45 |
| mnaser | ok this seems to have started more recnetly | 19:45 |
| Shrews | fungi: care to push this through? https://review.openstack.org/645184 | 19:45 |
| mnaser | i wonder if its stuff that wasn't deleted | 19:45 |
| mnaser | and volume quota limits are being hit | 19:45 |
| fungi | thanks for the reminder, Shrews | 19:45 |
| clarkb | fungi: smcginnis edmondsw thst fail is not in zuul but in the pip install of the package | 19:46 |
| fungi | oh, right, appdirs is a python package | 19:46 |
| fungi | so possible this is from an update of a depenency | 19:47 |
| fungi | isn't appdirs a dep of pip or setuptools or something like that? | 19:47 |
| clarkb | ya of pip iirc | 19:47 |
| *** rkukura has quit IRC | 19:47 | |
| clarkb | it is vendored too | 19:47 |
| edmondsw | lower-constraints.txt does have "appdirs==1.3.0" though I'm not sure why | 19:48 |
| edmondsw | we don't use appdirs directly anywhere in networking-powervm | 19:49 |
| pabelanger | mnaser: clarkb: sadly, all I see in launcher-debug logs: http://paste.openstack.org/show/748206/ | 19:49 |
| smcginnis | edmondsw: FWIW, cinder has appdirs==1.4.3, so maybe that needs to be raised. | 19:49 |
| smcginnis | Odd that it's not showing up in master though. | 19:49 |
| *** e0ne has quit IRC | 19:49 | |
| mnaser | "Ignoring volume cleanup failure due to 'NoneType' object has no attribute 'get'" | 19:49 |
| mnaser | ok there nova | 19:49 |
| edmondsw | smcginnis could be it would also happen in master and I just haven't noticed yet | 19:50 |
| edmondsw | is there a tool to generate lower-constraints.txt? | 19:51 |
| smcginnis | edmondsw: I guess either drop it or raise it up. There was some reason for including dependency dependencies, but I'm not sure why. | 19:51 |
| smcginnis | Could maybe ask in -requirements. | 19:51 |
| smcginnis | We used to sync, but now it is per-project to do. | 19:51 |
| edmondsw | ah, yes, the 3rd channel where this conversation may belong :) | 19:52 |
| edmondsw | good call | 19:52 |
| smcginnis | We'll find the right one eventually! ;) | 19:52 |
| *** e0ne has joined #openstack-infra | 19:52 | |
| openstackgerrit | Merged openstack-infra/project-config master: Cleanup packethost zk data https://review.openstack.org/645184 | 19:57 |
| clarkb | cmurphy: fungi fwiw refstack does seem to be puppet4ing so I don't think groups problem is trusty | 20:02 |
| clarkb | all of the hosts in the last puppet4 update are happy except for paste. Paste has the pip warning issue. I will fix that | 20:03 |
| cmurphy | hmm | 20:04 |
| clarkb | lists.o.o snapshot is "saving" now | 20:04 |
| *** e0ne has quit IRC | 20:04 | |
| clarkb | ok pip issue should be fixed on paste (had to upgrade pyopenssl and cryptography again) | 20:05 |
| cmurphy | is it a regex/globbing issue? there's both groups*.open*.org and groups[0-9]*.open*.org in groups.yaml | 20:06 |
| clarkb | oh ya actually that may be it. It is only groups.openstack.org right now iirc | 20:07 |
| cmurphy | groups01.openstack.org resolves for me? | 20:07 |
| cmurphy | but not to the same address as groups.openstack.org | 20:07 |
| clarkb | dig groups01.openstack.org doesn't resolve for me unless I have a typo somewhere | 20:08 |
| fungi | same for me | 20:08 |
| smcginnis | Not resolving here. | 20:09 |
| smcginnis | I can get to groups.o.o though. | 20:09 |
| cmurphy | ;; ANSWER SECTION: | 20:09 |
| cmurphy | groups01.openstack.org. 3401 IN A 62.138.239.45 | 20:09 |
| cmurphy | maybe it's my isp being helpful | 20:10 |
| cmurphy | yeah it is | 20:10 |
| *** rkukura has joined #openstack-infra | 20:10 | |
| dustinc | does not resolve for me | 20:10 |
| corvus | dnssec ftw | 20:11 |
| cmurphy | lol yep | 20:11 |
| *** roman_g has quit IRC | 20:12 | |
| clarkb | fwiw openstackid puppet moduel complains that the sysctl module isn't version v0.0.11 even though the metadata for that sysctl module says version = 0.0.1 | 20:14 |
| clarkb | er 0.0.11 | 20:14 |
| clarkb | I don't think this is a problem other than we get the really annoying warnings for it | 20:15 |
| clarkb | cmurphy: fwiw other than the pip issue with the puppet pip module parsing pip warnings (and failing at it) this transition has gone really smoothly so far | 20:16 |
| clarkb | thanks for all the work getting things tested and moving us incrementally (future parser helped a bunch I expect) | 20:16 |
| openstackgerrit | Colleen Murphy proposed openstack-infra/system-config master: Fix groups.openstack.org glob https://review.openstack.org/645326 | 20:16 |
| cmurphy | clarkb: awesome | 20:17 |
| cmurphy | i'm surprised the future parser didn't catch the pip issues though | 20:17 |
| clarkb | cmurphy: the issue is in the actual ruby code for that provider | 20:17 |
| cmurphy | clarkb: was it the openstack_pip provider or the actual pip provider? | 20:17 |
| clarkb | so I think even with futureparser we were running the old puppet3 that wasn't having a hard time with stderr | 20:17 |
| clarkb | cmurphy: its the actual pip provider | 20:17 |
| cmurphy | ah | 20:17 |
| clarkb | the fix is pretty straightforward: fix whatever pip is complaining about | 20:18 |
| mnaser | clarkb: it may seem like we might have hit disk quota in sjc1 | 20:18 |
| mnaser | because of extra volumes possibly? | 20:18 |
| clarkb | mnaser: due to leaked volumes? | 20:19 |
| mnaser | clarkb: possibly.. which in turn finds a nvoa bug | 20:19 |
| mnaser | nova | 20:19 |
| clarkb | ok, volume list doesn't show us to ahve leaked badly. There are only ~41 volumes | 20:19 |
| clarkb | each 80GB in size | 20:20 |
| clarkb | mnaser: let me know if there is something you think I/we can do on our side | 20:23 |
| mnaser | clarkb: odd, maybe the quotas went out of sync.. | 20:23 |
| clarkb | fungi: if https://review.openstack.org/#/c/643715/1 doesn't interfere with your wiki work maybe we can get that one in nowish too? (I don't see any reason to slow down on these updates since they have gone well so far) | 20:25 |
| fungi | yeah, should be fine. wiki.o.o (which isn't the instance's name anyway) is in the emergency disable list | 20:26 |
| *** e0ne has joined #openstack-infra | 20:28 | |
| ianw | clarkb: yeah, we can remove the old grafana ... did we decide why that match wasn't working? | 20:32 |
| *** armax has joined #openstack-infra | 20:32 | |
| ianw | grafana seems pretty stable api wise and packaged pretty well, we could consider just leaving it at "latest" | 20:32 |
| clarkb | ianw: no I decided not to worry about debugging old puppet too much now that new puppet is doing what we want and it seems to be working | 20:33 |
| ianw | ++ :) | 20:35 |
| fungi | no looking back | 20:35 |
| openstackgerrit | Clark Boylan proposed openstack-infra/system-config master: Remove code to handle grafana 2.x installations https://review.openstack.org/645339 | 20:37 |
| openstackgerrit | Clark Boylan proposed openstack-infra/system-config master: Upgrade grafana to 5.4.2 https://review.openstack.org/645340 | 20:37 |
| clarkb | theres two changes to clean this up a bit | 20:37 |
| *** kgiusti has left #openstack-infra | 20:40 | |
| ianw | clarkb: what do you think about just "latest"? i think we inadvertently have proved it's likely ok | 20:40 |
| clarkb | ianw: I'm not sure the grafana puppet module supprts that? let me look | 20:41 |
| clarkb | https://github.com/voxpupuli/puppet-grafana/blob/v2.6.1/manifests/install.pp#L67-L92 is the code that seems to do the install for us. | 20:42 |
| clarkb | and ya latest should do it | 20:42 |
| * clarkb pushes a new patchset | 20:42 | |
| ianw | yeah i remember debating whether to do it at the time | 20:44 |
| openstackgerrit | Clark Boylan proposed openstack-infra/system-config master: Install latest grafana https://review.openstack.org/645340 | 20:44 |
| clarkb | hows that | 20:44 |
| *** trown is now known as trown|outtypewww | 20:44 | |
| ianw | clarkb: +2 ... i reckon let's try it till it doesn't work :) | 20:45 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul-jobs master: Add fetch-sphinx-tarball role https://review.openstack.org/645346 | 20:51 |
| clarkb | ok lists.o.o snapshot is complete. I am going to update-rc.d enable all the services I disabled | 20:51 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul-jobs master: DNM: test fetch-sphinx-tarball https://review.openstack.org/645347 | 20:51 |
| openstackgerrit | Merged openstack-infra/system-config master: Update more servers to puppet 4 https://review.openstack.org/643715 | 20:51 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul-jobs master: Add fetch-sphinx-tarball role https://review.openstack.org/645346 | 20:52 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul-jobs master: DNM: test fetch-sphinx-tarball https://review.openstack.org/645347 | 20:52 |
| *** Lucas_Gray has joined #openstack-infra | 20:53 | |
| clarkb | infra-root as an FYI I have put lists.o.o back into the state I found it as my snapshot has completed. I have also removed it from the ansible mergency file | 20:53 |
| clarkb | I'm going to boot the snapshot next | 20:53 |
| *** jtomasek has quit IRC | 20:55 | |
| *** Lucas_Gray has quit IRC | 20:55 | |
| clarkb | the snapshot is booting now | 20:55 |
| *** Lucas_Gray has joined #openstack-infra | 20:55 | |
| *** Lucas_Gray has quit IRC | 20:57 | |
| *** Lucas_Gray has joined #openstack-infra | 20:58 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/system-config master: [WIP] letsencrypt support https://review.openstack.org/636759 | 20:58 |
| *** Lucas_Gray has quit IRC | 21:00 | |
| *** armax has quit IRC | 21:00 | |
| *** Lucas_Gray has joined #openstack-infra | 21:01 | |
| mnaser | clarkb: has the code around nodepool changed by any chance | 21:01 |
| mnaser | 2019-03-21 20:56:24.619 20698 INFO nova.virt.block_device [req-b28bd0ca-6d33-4377-a047-6995eb306f96 de81838458254d87a9ef66cc89e22308 86bbbcfa8ad043109d2d7af530225c72 - default default] [instance: da6e9876-bd07-4001-abaf-5278a1eb431c] Booting with blank volume at /dev/vda | 21:01 |
| mnaser | oh thats a nova bug. | 21:02 |
| *** Lucas_Gray has quit IRC | 21:02 | |
| clarkb | mnaser: I don't think nodepool's code has but shade/sdk may have | 21:02 |
| mnaser | yeah it looks like a bug in logging things | 21:03 |
| *** Lucas_Gray has joined #openstack-infra | 21:03 | |
| *** rh-jelabarre has quit IRC | 21:04 | |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul-jobs master: Add fetch-sphinx-tarball role https://review.openstack.org/645346 | 21:04 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul-jobs master: DNM: test fetch-sphinx-tarball https://review.openstack.org/645347 | 21:04 |
| *** Lucas_Gray has quit IRC | 21:05 | |
| *** Lucas_Gray has joined #openstack-infra | 21:05 | |
| *** Lucas_Gray has quit IRC | 21:06 | |
| *** Lucas_Gray has joined #openstack-infra | 21:09 | |
| *** Lucas_Gray has quit IRC | 21:11 | |
| *** Lucas_Gray has joined #openstack-infra | 21:12 | |
| *** rkukura has quit IRC | 21:16 | |
| *** e0ne has quit IRC | 21:17 | |
| *** Lucas_Gray has quit IRC | 21:17 | |
| *** armax has joined #openstack-infra | 21:17 | |
| *** Lucas_Gray has joined #openstack-infra | 21:23 | |
| *** Lucas_Gray has quit IRC | 21:24 | |
| clarkb | next group of puppet4 servers looks happy. One issue is static and status like groups doesn't have the digit suffix yet | 21:29 |
| clarkb | otherwise everything is happy | 21:30 |
| clarkb | cmurphy: ^ fyi | 21:30 |
| *** pcaruana has quit IRC | 21:33 | |
| *** kjackal has quit IRC | 21:35 | |
| openstackgerrit | Clark Boylan proposed openstack-infra/system-config master: Fix groups.openstack.org glob https://review.openstack.org/645326 | 21:41 |
| openstackgerrit | Clark Boylan proposed openstack-infra/system-config master: Groups-dev to puppet4 https://review.openstack.org/645371 | 21:41 |
| openstackgerrit | Clark Boylan proposed openstack-infra/system-config master: Run static and status under futureparser https://review.openstack.org/645372 | 21:41 |
| openstackgerrit | Clark Boylan proposed openstack-infra/system-config master: Run static and status under puppet4 https://review.openstack.org/645373 | 21:41 |
| clarkb | cmurphy: fungi ^ that stack of changes should allow us to ensure each of those is happy before we take the puppet 4 plunge | 21:42 |
| clarkb | infra-root ^ if we can get reviews on those I am happy to approve as I am able to monitor | 21:42 |
| clarkb | progress value on test lists server went from 10 to 40 | 21:42 |
| *** Vadmacs has quit IRC | 21:43 | |
| efried | diablo_rojo (or whoever): where does one submit changes to https://www.openstack.org/assets/software/projectmap/openstack-map.pdf ? | 21:44 |
| openstackgerrit | Clark Boylan proposed openstack-infra/system-config master: Update even more servers to puppet4 https://review.openstack.org/645375 | 21:44 |
| clarkb | efried: the foundation's designers put that together. You can probably get changes done by sending an email to the foundation | 21:45 |
| * clarkb finds an email address for that | 21:45 | |
| fungi | are you sure it's not https://opendev.org/openstack/openstack-map ? | 21:45 |
| *** whoami-rajat has quit IRC | 21:45 | |
| *** armax has quit IRC | 21:45 | |
| clarkb | fungi: I think the diagram is hand edited or at least I got that impression from wes once upon a time | 21:46 |
| efried | fungi: I looked in there and didn't see what I sought. | 21:46 |
| efried | namely, the tagline over "Cyborg" that currently reads "GPUS" | 21:46 |
| diablo_rojo | efried, fungi I think the plan is to have it live there but it doesnt yet? | 21:46 |
| efried | I think (and Sundar agrees) that it should say "ACCELERATORS" | 21:47 |
| * diablo_rojo goes to bother jimmy | 21:47 | |
| efried | https://github.com/openstack/openstack-map/blob/master/openstack_components.yaml#L107 | 21:47 |
| efried | ...is all I could find in openstack-map | 21:47 |
| diablo_rojo | efried, yeah thats all I can find in that repo too.. | 21:49 |
| diablo_rojo | Maybe somewhere in here? https://github.com/jimmytipit/openstack-org | 21:50 |
| diablo_rojo | If its not there I will make sure it gets passed along efried | 21:51 |
| *** rkukura has joined #openstack-infra | 21:51 | |
| efried | diablo_rojo: If it's in there, it's not in text. | 21:54 |
| diablo_rojo | Yeah I'm not seeing it either. | 21:54 |
| *** xek_ has quit IRC | 21:55 | |
| efried | diablo_rojo: Thanks for the help. Sundar is the buck-stop for this, should ack any changes before they're made. | 21:55 |
| efried | (as the cyborg PTL and whatnot) | 21:55 |
| diablo_rojo | Sounds good. I'll wait for the +2 before passing it along then. | 21:55 |
| *** Sundar has joined #openstack-infra | 21:57 | |
| Sundar | Hi | 21:57 |
| diablo_rojo | efried, jimmy says here: https://git.openstack.org/cgit/openstack/openstack-map?_ga=2.32845182.1944602067.1553205362-1305848346.1543883146 | 21:57 |
| efried | Sundar: ^ | 21:58 |
| Sundar | Looking at: https://git.openstack.org/cgit/openstack/openstack-map/tree/openstack_components.yaml#n107, it seems to be about right | 21:59 |
| Sundar | Guess we need to find where it talks about GPUs | 21:59 |
| efried | diablo_rojo: what am I missing there? | 22:00 |
| efried | efried@efried-ThinkPad-W520:~/openstack/openstack-map$ git grep -i gpus | 22:00 |
| efried | efried@efried-ThinkPad-W520:~/openstack/openstack-map$ git grep -i cyborg | 22:00 |
| efried | openstack_components.yaml: - name: cyborg | 22:00 |
| efried | openstack_components.yaml: docs-url: https://docs.openstack.org/cyborg/latest/ | 22:00 |
| efried | openstack_components.yaml: Cyborg provides a general purpose management framework for | 22:00 |
| efried | openstack_components.yaml: project-team: cyborg | 22:00 |
| clarkb | I think it is just a misunderstanding. They try to incorporate chanages to that doc in the image but thats already been done | 22:01 |
| corvus | is there a more appropriate channel for this topic? | 22:01 |
| efried | Sorry, I never know where to go with stuff like this. | 22:02 |
| corvus | efried: no need to apologize, i'm always happy to have folks start here anyway. but i don't have a better suggestion... i just hope someone does since it doesn't seem to be related to the community-run project infrastructure. | 22:03 |
| Sundar | Should we contact the documentation team (PTL Stephen Finucane)? | 22:04 |
| efried | corvus: To me, everything that isn't "code" is "infra" :P | 22:04 |
| *** irclogbot_1 has quit IRC | 22:05 | |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul-jobs master: DNM: test fetch-sphinx-tarball and download-artifact https://review.openstack.org/645347 | 22:06 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul-jobs master: Add download artifact role https://review.openstack.org/645384 | 22:06 |
| diablo_rojo | efried, I probably would have gone to dev with it but this is fine. | 22:07 |
| diablo_rojo | Sundar, no I think its something the foundation needs to fix, not a thing for the docs team | 22:07 |
| *** corvus has left #openstack-infra | 22:07 | |
| diablo_rojo | I just asked jimmy to join | 22:07 |
| efried | corvus took his ball and went home | 22:08 |
| efried | "Damn kids polluting my channel" | 22:08 |
| *** mgoddard has quit IRC | 22:08 | |
| *** armax has joined #openstack-infra | 22:09 | |
| *** mgoddard has joined #openstack-infra | 22:09 | |
| anteaya | efried: I'd recommend caution attributing words to someone that they didn't actually say | 22:11 |
| anteaya | most infro team members juggle about 6 issues at any given time | 22:11 |
| anteaya | the most likely explaination for any time of silence is something more pressing is being attended to | 22:12 |
| efried | anteaya: I would hope it is understood as the joke it was intended as. | 22:12 |
| anteaya | I'd didn't understand it as such | 22:12 |
| anteaya | and I have found that most 'jokes' are actually not kind thoughts packed in a pretty wrapper | 22:13 |
| anteaya | I've found kindess goes a long way | 22:13 |
| anteaya | personally | 22:13 |
| anteaya | bud it is just a suggestion | 22:13 |
| diablo_rojo | Sundar, would you rather it say accelerators than GPUs? | 22:16 |
| Sundar | diablo_rojo: Yes | 22:17 |
| *** rcernin has joined #openstack-infra | 22:19 | |
| fungi | efried: Sundar: diablo_rojo: probably the #openstack-foundation channel would be a more appropriate place to reach out to the maintainers of www.openstack.org in the future | 22:20 |
| efried | fungi: ah, thanks. | 22:20 |
| *** armax has quit IRC | 22:20 | |
| fungi | keep in mind that, for the moment at least, www.openstack.org is the website of the openstack foundation, not the openstack project, and just happens to have some openstack project oriented content on it but it's not generally maintained by the openstack community | 22:21 |
| efried | I've gotten so used to being able to propose a patch for anything I want to change anywhere, I'm spoiled :) | 22:22 |
| fungi | a lot of the stuff on that site is comaintained by folks who are familiar with updating content through a cms or blogging platform, so doing things through code review is a bit foreign to them (though the gerrit backend for netlify may make some major inroads to bridging that gap) | 22:24 |
| *** armax has joined #openstack-infra | 22:27 | |
| *** armax has quit IRC | 22:32 | |
| openstackgerrit | Clark Boylan proposed openstack-infra/system-config master: Update even more servers to puppet4 https://review.openstack.org/645375 | 22:35 |
| *** armax has joined #openstack-infra | 22:35 | |
| *** armax has quit IRC | 22:38 | |
| openstackgerrit | James E. Blair proposed opendev/base-jobs master: Add opendev docs build/promote jobs https://review.openstack.org/645391 | 22:41 |
| ianw | infra-root: planned commit message for the git:// -> https:// transition is @ http://paste.openstack.org/show/748218/ . i will send a follow-up email to that thread; also i have removed the storyboard #'s as suggested to avoid killing SB | 22:43 |
| ianw | my plan is to add a comment noting our planned merge of outstanding changes on the 19th | 22:44 |
| *** corvus has joined #openstack-infra | 22:44 | |
| corvus | infra-root: i'm going to restart the zuul executors now to pick up the uri module fix | 22:44 |
| ianw | i will also use opendev-gerrit-git as the topic, so we can keep them separate | 22:44 |
| clarkb | ianw: commit message lgtm | 22:45 |
| clarkb | corvus: rgr | 22:45 |
| *** timothyb89 has quit IRC | 22:46 | |
| corvus | ianw: maybe use the word 'update' instead of 'review'? | 22:46 |
| ianw | corvus: sure, done | 22:47 |
| corvus | ftr, the main reason we're dropping git is that we can't do redirects. but it's *also* true that gitea doesn't support it. :) | 22:49 |
| corvus | (if gitea did, we still wouldn't be able to because of the redirect issue) | 22:49 |
| corvus | i'm not sure that requires a change to the commit message, just thought i'd throw it out there | 22:49 |
| clarkb | update on PTG scheduling. The current proposed schedule has infra/qa room happening thursday and friday | 22:49 |
| clarkb | everyone but fungi gets their saturday back probably :P | 22:50 |
| *** mriedem is now known as mriedem_afk | 22:50 | |
| corvus | and we don't have to fight over fungi on saturday! | 22:50 |
| ianw | corvus: as in git wire protocol has no concept of a 301-type redirect? | 22:51 |
| corvus | ianw: yeah | 22:51 |
| corvus | i think the commit message is "true enough" to stick with that for now though :) | 22:52 |
| corvus | clarkb, fungi, ianw, mordred: when you have a moment, i have a proposal for opendev docs jobs in https://review.openstack.org/645391 and its 2 dependencies | 22:53 |
| *** tkajinam has joined #openstack-infra | 22:56 | |
| *** rpioso is now known as rpioso|afk | 22:58 | |
| *** tosky has quit IRC | 22:59 | |
| ianw | corvus: if you like, i can add something to the update email like -> http://paste.openstack.org/show/748220/ ... or, nobody's really complained anyway, just say nothing :) | 23:05 |
| corvus | ianw: that's good info, but also, probably nobody really minds so we could just save that until someone asks. up to you :) | 23:07 |
| corvus | the executors have been restarted | 23:08 |
| corvus | #status log restarted zuul executors at git commit efae4deec5b538e90b88d690346a58538bd5cfff | 23:08 |
| openstackstatus | corvus: finished logging | 23:08 |
| clarkb | corvus: for the tox role do we not needto provide a target to build? | 23:09 |
| *** armax has joined #openstack-infra | 23:09 | |
| corvus | clarkb: it's in the job vars | 23:09 |
| corvus | zuul.yaml line 233 | 23:10 |
| *** mattw4 has quit IRC | 23:10 | |
| clarkb | ah in the next file :) | 23:10 |
| *** Lucas_Gray has joined #openstack-infra | 23:15 | |
| *** rascasoft has quit IRC | 23:19 | |
| ianw | corvus: so i've understood the change correctly, the essential new insight is that instead of building again in the post pipeline, we take the results of the successful gate run and publish that? | 23:19 |
| ianw | facilitated by zuul's artifact tracking api | 23:19 |
| *** Lucas_Gray has quit IRC | 23:20 | |
| clarkb | ianw: yup, similar to how docker image promotion works | 23:20 |
| ianw | cool, i like it when what i'm thinking somewhat aligns with reality :) | 23:20 |
| corvus | the executor restart with the uri module fix seems to have worked, so the docker promote jobs should be working again now (https://hub.docker.com/u/zuul was updated) | 23:25 |
| *** armax has quit IRC | 23:26 | |
| openstackgerrit | Merged openstack-infra/system-config master: Groups-dev to puppet4 https://review.openstack.org/645371 | 23:30 |
| *** wolverineav has joined #openstack-infra | 23:40 | |
| ianw | 7 days until somebody comes to run a cable so i can get off this annoying cgnat wireless broadband that keeps timing out ssh connections. because .au has managed to get our networks so screwed up, i will actually be getting *slower* speeds through the cable, sigh | 23:41 |
| *** wolverineav has quit IRC | 23:45 | |
| *** jamesmcarthur has joined #openstack-infra | 23:58 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!