| corvus | nodepool seems to be building nodes and transitioning them to ready | 00:00 |
|---|---|---|
| pabelanger | agree | 00:01 |
| *** sree has joined #openstack-infra | 00:01 | |
| openstackstatus | corvus: finished sending notice | 00:01 |
| corvus | web console streaming seems to work | 00:02 |
| *** yamamoto has joined #openstack-infra | 00:02 | |
| pabelanger | should we see if an PR to ansible/ansible kicks shade jobs? | 00:02 |
| corvus | pabelanger: well, i'd rather not test on that repo; i think we still have gtest-org in there? but i'm also not certain if we currently expect that to work | 00:03 |
| pabelanger | yah, gtest-org should still be setup. but I haven't tried in some time | 00:04 |
| corvus | yeah gtest-org/ansible is there | 00:04 |
| *** iyamahat has quit IRC | 00:04 | |
| corvus | pabelanger: want to throw a recheck on https://github.com/gtest-org/ansible/pulls and see what happens? | 00:04 |
| corvus | i'll watch logs | 00:05 |
| pabelanger | sure | 00:05 |
| pabelanger | recheck on PR/1 | 00:05 |
| *** sree has quit IRC | 00:06 | |
| *** bobh has quit IRC | 00:06 | |
| corvus | 404 -- The requested URL /connection/github/payload was not found on this server. | 00:07 |
| corvus | i think we need to update that | 00:07 |
| pabelanger | on the github side? | 00:07 |
| *** felipemonteiro has joined #openstack-infra | 00:07 | |
| corvus | yeah, to match recent zuul-webchanges | 00:08 |
| *** yamamoto has quit IRC | 00:08 | |
| pabelanger | k, I'm not sure what it would be. let me see check docs | 00:08 |
| *** Swami has quit IRC | 00:09 | |
| corvus | welp. i think it's supposed to be /api/connection/github/payload | 00:09 |
| corvus | but the docs have not been updated | 00:09 |
| corvus | so i guess we have another release blocker | 00:09 |
| corvus | let me update our github config and confirm | 00:10 |
| corvus | okay, it's seeing events from ansible now | 00:13 |
| corvus | 2018-03-29 00:10:34,556 DEBUG zuul.GithubConnection: Got PR ansible/ansible#38022 | 00:13 |
| pabelanger | corvus: k, do we need a doc update? | 00:13 |
| pabelanger | https://zuul-ci.org/docs/zuul/admin/zuul-from-scratch.html#configure-github still shows old URL | 00:14 |
| corvus | yep | 00:15 |
| corvus | patch incoming | 00:15 |
| openstackgerrit | zhongshengping proposed openstack-infra/project-config master: Prefix the project description with RETIRED for retired projects https://review.openstack.org/557166 | 00:15 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul master: Update github payload location docs https://review.openstack.org/557550 | 00:15 |
| pabelanger | +2 | 00:16 |
| pabelanger | yup, looks better. seems to be failing merge-check, which is expected given how old it is | 00:21 |
| corvus | long as it's doing something :) | 00:21 |
| pabelanger | \o/ | 00:21 |
| clarkb | I've alproved docs update | 00:21 |
| clarkb | I do have wifi (well an hour of it anyway) | 00:21 |
| corvus | \o/ | 00:22 |
| pabelanger | the future is now | 00:22 |
| *** eernst has joined #openstack-infra | 00:23 | |
| *** salv-orlando has joined #openstack-infra | 00:23 | |
| corvus | should i go ahead and push the nodepool tag? | 00:25 |
| fungi | cool with me, seems in sane shape | 00:25 |
| pabelanger | Yah! | 00:26 |
| corvus | nodepool 3.0.0 tagged | 00:27 |
| pabelanger | \o/ | 00:27 |
| corvus | http://zuul.openstack.org/stream.html?uuid=1bb12f148e98419ab7d9c4a4cd677d60&logfile=console.log | 00:27 |
| *** salv-orlando has quit IRC | 00:28 | |
| corvus | https://pypi.python.org/pypi/nodepool/3.0.0 exists | 00:31 |
| *** gyankum has joined #openstack-infra | 00:32 | |
| corvus | zuul change is in gate | 00:32 |
| *** zhurong has joined #openstack-infra | 00:33 | |
| *** olaph1 has joined #openstack-infra | 00:33 | |
| pabelanger | how does the javascript work? is that included into wheel and uploaded to pypi? Or do we also need to publish that some other place? | 00:33 |
| corvus | pabelanger: it's built on python installation (or optionally can be built separately) | 00:34 |
| *** hemna_ has quit IRC | 00:34 | |
| corvus | pabelanger: we might later also publish it independently | 00:34 |
| *** olaph has quit IRC | 00:34 | |
| pabelanger | cool, that would be nice. To avoid build dependencies, I haven't tried that locally yet | 00:35 |
| corvus | yeah, the build needs the npm toolchain | 00:35 |
| corvus | but, i reckon we'd at least need some of that if we were downloading it from npm :| | 00:35 |
| pabelanger | yah | 00:36 |
| *** priteau has joined #openstack-infra | 00:36 | |
| *** priteau has quit IRC | 00:40 | |
| openstackgerrit | Vaishnavi Pamulapati proposed openstack-infra/storyboard-webclient master: Fixes incorrect usage of page size preference key https://review.openstack.org/557553 | 00:41 |
| *** caphrim007 has joined #openstack-infra | 00:44 | |
| *** gyankum has quit IRC | 00:44 | |
| openstackgerrit | Merged openstack-infra/zuul master: Update github payload location docs https://review.openstack.org/557550 | 00:45 |
| corvus | i'll tag zuul now | 00:45 |
| corvus | zuul 3.0.0 tagged | 00:46 |
| *** iranzo has joined #openstack-infra | 00:47 | |
| corvus | http://zuul.openstack.org/stream.html?uuid=6f8d1898ad63421f951b6a338b1f49d9&logfile=console.log | 00:47 |
| openstackgerrit | Vaishnavi Pamulapati proposed openstack-infra/storyboard-webclient master: Fixes incorrect usage of page size preference key https://review.openstack.org/557553 | 00:48 |
| *** caphrim007 has quit IRC | 00:49 | |
| *** jamesmcarthur has joined #openstack-infra | 00:49 | |
| *** jcoufal has quit IRC | 00:51 | |
| openstackgerrit | Vaishnavi Pamulapati proposed openstack-infra/storyboard-webclient master: Fix incorrect usage of page size preference key https://review.openstack.org/557553 | 00:51 |
| openstackgerrit | Vaishnavi Pamulapati proposed openstack-infra/storyboard-webclient master: Fix incorrect usage of page size preference key https://review.openstack.org/557553 | 00:52 |
| *** odyssey4me has quit IRC | 00:53 | |
| *** odyssey4me has joined #openstack-infra | 00:53 | |
| corvus | https://pypi.python.org/pypi/zuul/3.0.0 exists | 00:54 |
| *** rossella_s has quit IRC | 00:54 | |
| *** dayou has quit IRC | 00:56 | |
| *** ihrachys_ has quit IRC | 00:57 | |
| *** jamesmcarthur has quit IRC | 00:57 | |
| *** hongbin has joined #openstack-infra | 00:57 | |
| *** ihrachys_ has joined #openstack-infra | 00:57 | |
| *** jamesmcarthur has joined #openstack-infra | 00:58 | |
| *** yamamoto has joined #openstack-infra | 01:04 | |
| *** jamesmcarthur has quit IRC | 01:08 | |
| *** yamamoto has quit IRC | 01:09 | |
| *** jamesmcarthur has joined #openstack-infra | 01:09 | |
| *** eernst has quit IRC | 01:10 | |
| *** r-daneel has quit IRC | 01:11 | |
| *** gyankum has joined #openstack-infra | 01:12 | |
| *** s-shiono has joined #openstack-infra | 01:12 | |
| *** jamesmcarthur has quit IRC | 01:13 | |
| *** cshastri has joined #openstack-infra | 01:16 | |
| *** jamesmcarthur has joined #openstack-infra | 01:18 | |
| *** caphrim007 has joined #openstack-infra | 01:19 | |
| *** zhipeng has joined #openstack-infra | 01:19 | |
| *** caphrim007_ has joined #openstack-infra | 01:23 | |
| *** salv-orlando has joined #openstack-infra | 01:24 | |
| *** caphrim007 has quit IRC | 01:26 | |
| *** jamesmcarthur has quit IRC | 01:27 | |
| *** salv-orlando has quit IRC | 01:29 | |
| *** jamesmcarthur has joined #openstack-infra | 01:35 | |
| *** eernst has joined #openstack-infra | 01:37 | |
| *** jamesmcarthur has quit IRC | 01:38 | |
| *** zhongjun_ has joined #openstack-infra | 01:41 | |
| *** zhangfei has joined #openstack-infra | 01:41 | |
| *** dayou has joined #openstack-infra | 01:43 | |
| *** jamesmcarthur has joined #openstack-infra | 01:43 | |
| openstackgerrit | Vaishnavi Pamulapati proposed openstack-infra/storyboard-webclient master: The task list of a story should be sorted by ID, instead of status so that a user can quickly navigate to a specific task https://review.openstack.org/557569 | 01:43 |
| openstackgerrit | Vaishnavi Pamulapati proposed openstack-infra/storyboard-webclient master: Sort task list by ID instead of status https://review.openstack.org/557569 | 01:45 |
| pabelanger | ianw: i think I might be seeing dns issues in rax-iad, but haven't confirmed yet. Just had 2 jobs fail updating apt | 01:45 |
| *** eernst has quit IRC | 01:45 | |
| pabelanger | trying to see if related to ipv6 changes | 01:45 |
| pabelanger | but was limited to bionic, so could also just be out of sync repl | 01:47 |
| pabelanger | repo( | 01:47 |
| pabelanger | woah | 01:50 |
| pabelanger | http://paste.openstack.org/show/716888/ | 01:51 |
| pabelanger | that is on bionic | 01:51 |
| pabelanger | seems systemd is taking over | 01:51 |
| *** kiennt26 has joined #openstack-infra | 01:51 | |
| pabelanger | setting nameserver back to 127.0.0.1 fixes it | 01:52 |
| pabelanger | systemd+ 2750 0.0 0.0 70592 5456 ? Ss 01:48 0:00 /lib/systemd/systemd-resolved | 01:53 |
| pabelanger | so, we'll need to blacklist that on bionic | 01:53 |
| pabelanger | I can look more into it tomorrow | 01:53 |
| *** jamesmcarthur has quit IRC | 01:54 | |
| *** jamesmcarthur has joined #openstack-infra | 01:56 | |
| pabelanger | okay, here is the fix | 01:58 |
| pabelanger | DNSStubListener=no | 01:58 |
| pabelanger | in /etc/systemd/resolved.conf | 01:58 |
| pabelanger | will stop it from booting | 01:58 |
| pabelanger | so, we can update out elements in DIB to do that, until we decided if we want to start using systemd-resolved over unbound | 01:59 |
| *** yamamoto has joined #openstack-infra | 02:05 | |
| *** jamesmcarthur has quit IRC | 02:06 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/project-config master: Stop systemd-resolve from booting on our images https://review.openstack.org/557571 | 02:08 |
| pabelanger | clarkb: ianw: ^fun one for the morning, but that fixes bionic. But I haven't looked at other images yet | 02:08 |
| *** iyamahat has joined #openstack-infra | 02:09 | |
| *** yamamoto has quit IRC | 02:11 | |
| openstackgerrit | Merged openstack-infra/system-config master: Fix mariadb sync https://review.openstack.org/553085 | 02:17 |
| *** ykarel|away has joined #openstack-infra | 02:20 | |
| openstackgerrit | Vaishnavi Pamulapati proposed openstack-infra/storyboard-webclient master: Set default project for new story dialog from header https://review.openstack.org/557575 | 02:22 |
| *** salv-orlando has joined #openstack-infra | 02:25 | |
| *** VW has joined #openstack-infra | 02:27 | |
| *** ykarel|away has quit IRC | 02:30 | |
| *** felipemonteiro has quit IRC | 02:31 | |
| *** salv-orlando has quit IRC | 02:31 | |
| *** iyamahat has quit IRC | 02:31 | |
| *** ykarel|away has joined #openstack-infra | 02:32 | |
| ianw | yay :) | 02:36 |
| *** rkukura has joined #openstack-infra | 02:37 | |
| *** priteau has joined #openstack-infra | 02:37 | |
| *** ykarel|away has quit IRC | 02:38 | |
| *** priteau has quit IRC | 02:41 | |
| *** olaph has joined #openstack-infra | 02:43 | |
| *** olaph1 has quit IRC | 02:45 | |
| *** gongysh has joined #openstack-infra | 02:45 | |
| *** yamamoto has joined #openstack-infra | 02:47 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/system-config master: Add new mariadb signing key https://review.openstack.org/557579 | 02:58 |
| *** psachin has joined #openstack-infra | 03:02 | |
| *** zhipeng has quit IRC | 03:06 | |
| *** daidv has quit IRC | 03:09 | |
| *** jrist has quit IRC | 03:11 | |
| *** jrist has joined #openstack-infra | 03:12 | |
| *** links has joined #openstack-infra | 03:12 | |
| *** wxy has left #openstack-infra | 03:13 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/system-config master: Offset cron jobs slightly https://review.openstack.org/553894 | 03:14 |
| *** VW_ has joined #openstack-infra | 03:21 | |
| *** olaph1 has joined #openstack-infra | 03:22 | |
| *** olaph has quit IRC | 03:23 | |
| *** VW has quit IRC | 03:23 | |
| *** harlowja has quit IRC | 03:24 | |
| *** daidv has joined #openstack-infra | 03:24 | |
| *** salv-orlando has joined #openstack-infra | 03:27 | |
| openstackgerrit | Merged openstack-infra/system-config master: Add new mariadb signing key https://review.openstack.org/557579 | 03:29 |
| *** udesale has joined #openstack-infra | 03:29 | |
| openstackgerrit | Bernd Bausch proposed openstack-infra/zuul master: Add clarity to *Zuul from Scratch* instructions https://review.openstack.org/556344 | 03:30 |
| *** salv-orlando has quit IRC | 03:31 | |
| *** olaph has joined #openstack-infra | 03:34 | |
| *** olaph1 has quit IRC | 03:35 | |
| openstackgerrit | Vaishnavi Pamulapati proposed openstack-infra/storyboard-webclient master: Set default project for new story dialog from header https://review.openstack.org/557575 | 03:44 |
| *** ianychoi__ has joined #openstack-infra | 03:47 | |
| *** nicolasbock has quit IRC | 03:47 | |
| *** purp has quit IRC | 03:49 | |
| *** zeus has quit IRC | 03:49 | |
| *** annp has quit IRC | 03:49 | |
| *** psachin` has joined #openstack-infra | 03:49 | |
| *** ianychoi_ has quit IRC | 03:50 | |
| *** patriciadomin has quit IRC | 03:50 | |
| *** purp has joined #openstack-infra | 03:50 | |
| *** psachin has quit IRC | 03:50 | |
| *** patriciadomin has joined #openstack-infra | 03:51 | |
| *** zeus has joined #openstack-infra | 03:51 | |
| *** zeus is now known as Guest88902 | 03:51 | |
| *** udesale has quit IRC | 03:51 | |
| *** gtmanfred has quit IRC | 03:51 | |
| *** Krenair has quit IRC | 03:51 | |
| *** gtmanfred has joined #openstack-infra | 03:54 | |
| *** Krenair has joined #openstack-infra | 03:54 | |
| *** ramishra has joined #openstack-infra | 03:55 | |
| *** dave-mccowan has quit IRC | 03:56 | |
| *** bhavik1 has joined #openstack-infra | 03:57 | |
| *** dave-mccowan has joined #openstack-infra | 03:58 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/system-config master: Enable shared volumes in reprepro-mirror-update https://review.openstack.org/557588 | 03:58 |
| *** harlowja has joined #openstack-infra | 03:59 | |
| *** germs has quit IRC | 04:04 | |
| *** germs has joined #openstack-infra | 04:04 | |
| *** germs has quit IRC | 04:04 | |
| *** germs has joined #openstack-infra | 04:04 | |
| *** germs has quit IRC | 04:04 | |
| *** germs has joined #openstack-infra | 04:05 | |
| *** germs has quit IRC | 04:05 | |
| *** germs has joined #openstack-infra | 04:05 | |
| openstackgerrit | Merged openstack/diskimage-builder master: Fix element-provides in debian element https://review.openstack.org/556556 | 04:06 |
| *** jamesmcarthur has joined #openstack-infra | 04:07 | |
| *** germs has quit IRC | 04:09 | |
| *** jamesmcarthur has quit IRC | 04:11 | |
| *** hongbin has quit IRC | 04:12 | |
| openstackgerrit | Tony Breeds proposed openstack/diskimage-builder master: debootstrap: Call update-initramfs explicitly https://review.openstack.org/504588 | 04:14 |
| *** dave-mcc_ has joined #openstack-infra | 04:16 | |
| *** sree has joined #openstack-infra | 04:16 | |
| *** dave-mccowan has quit IRC | 04:16 | |
| *** VW_ has quit IRC | 04:16 | |
| *** ykarel|away has joined #openstack-infra | 04:17 | |
| *** janki has joined #openstack-infra | 04:17 | |
| *** yamahata has joined #openstack-infra | 04:18 | |
| *** bhujay has joined #openstack-infra | 04:21 | |
| *** ykarel_ has joined #openstack-infra | 04:22 | |
| *** ykarel|away has quit IRC | 04:24 | |
| *** dklyle has quit IRC | 04:26 | |
| *** daidv has quit IRC | 04:28 | |
| *** daidv has joined #openstack-infra | 04:28 | |
| *** ianychoi__ is now known as ianychoi | 04:29 | |
| prometheanfire | ianw: you have +W on glean? | 04:39 |
| prometheanfire | already have 2 +2 on it :| | 04:39 |
| *** dhajare_ has joined #openstack-infra | 04:39 | |
| prometheanfire | ianw: it's the dependant patch for the nodepool change | 04:39 |
| *** olaph has quit IRC | 04:43 | |
| *** pgadiya has joined #openstack-infra | 04:44 | |
| prometheanfire | thanks | 04:46 |
| *** dave-mcc_ has quit IRC | 04:46 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/project-config master: Remove etcd version workaround for arm64 https://review.openstack.org/557594 | 04:49 |
| ianw | tonyb: ^ of interest | 04:49 |
| *** daidv has quit IRC | 04:50 | |
| tonyb | ianw: nice :) | 04:50 |
| *** daidv has joined #openstack-infra | 04:50 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/project-config master: tools/build_image.sh : add some arm64 notes https://review.openstack.org/542591 | 04:55 |
| openstackgerrit | Bernd Bausch proposed openstack-infra/zuul master: Add clarity to *Zuul from Scratch* instructions https://review.openstack.org/556344 | 04:57 |
| *** rcernin_ has joined #openstack-infra | 04:59 | |
| *** rcernin has quit IRC | 05:00 | |
| *** pgadiya has quit IRC | 05:03 | |
| *** udesale has joined #openstack-infra | 05:04 | |
| *** zhurong has quit IRC | 05:04 | |
| *** pgadiya has joined #openstack-infra | 05:05 | |
| *** salv-orlando has joined #openstack-infra | 05:08 | |
| *** bhujay has quit IRC | 05:08 | |
| *** claudiub has joined #openstack-infra | 05:11 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/project-config master: tools/build_image.sh : add some arm64 notes https://review.openstack.org/542591 | 05:18 |
| *** bhujay has joined #openstack-infra | 05:23 | |
| openstackgerrit | Bernd Bausch proposed openstack-infra/zuul master: Add clarity to *Zuul from Scratch* instructions https://review.openstack.org/556344 | 05:27 |
| *** shu-mutow-AWAY is now known as shu-mutow | 05:28 | |
| openstackgerrit | Joshua Hesketh proposed openstack-infra/zuul master: Add clarity to *Zuul from Scratch* instructions https://review.openstack.org/556344 | 05:29 |
| openstackgerrit | Merged openstack/diskimage-builder master: Clean up dib-python symlink https://review.openstack.org/455486 | 05:33 |
| openstackgerrit | Merged openstack/diskimage-builder master: zypper-minimal: Set default locale env to C.UTF-8 https://review.openstack.org/518447 | 05:33 |
| openstackgerrit | Merged openstack/diskimage-builder master: Change the GENTOO_PORTAGE_CLEANUP variable default https://review.openstack.org/556749 | 05:33 |
| openstackgerrit | Ian Wienand proposed openstack-infra/nodepool master: add gentoo systemd image for testing https://review.openstack.org/556661 | 05:37 |
| openstackgerrit | Ian Wienand proposed openstack-infra/nodepool master: Test growroot in boot tests https://review.openstack.org/555103 | 05:37 |
| *** r-daneel has joined #openstack-infra | 05:38 | |
| *** iyamahat has joined #openstack-infra | 05:38 | |
| prometheanfire | ianw: ? | 05:39 |
| ianw | oh, doh, sorry i rebased that on master | 05:40 |
| ianw | i just meant to rebase the growroot test on it | 05:41 |
| prometheanfire | ianw: it can probably go away to be honest, not that we got our testing done | 05:41 |
| openstackgerrit | Merged openstack-infra/glean master: Add networkd support https://review.openstack.org/548604 | 05:42 |
| prometheanfire | anyway, nn | 05:42 |
| *** r-daneel has quit IRC | 05:42 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/openstack-zuul-jobs master: Always generate ara reports for integration tests https://review.openstack.org/526590 | 05:47 |
| *** zhurong has joined #openstack-infra | 05:47 | |
| *** anticw has quit IRC | 06:00 | |
| *** anticw has joined #openstack-infra | 06:00 | |
| *** iyamahat has quit IRC | 06:00 | |
| openstackgerrit | Merged openstack/diskimage-builder master: debootstrap: Call update-initramfs explicitly https://review.openstack.org/504588 | 06:02 |
| *** germs has joined #openstack-infra | 06:05 | |
| *** germs has quit IRC | 06:05 | |
| *** germs has joined #openstack-infra | 06:05 | |
| *** harlowja has quit IRC | 06:06 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/project-config master: tools/build_image.sh : add some arm64 notes https://review.openstack.org/542591 | 06:06 |
| *** agopi|out has quit IRC | 06:07 | |
| *** sree_ has joined #openstack-infra | 06:07 | |
| *** sree_ is now known as Guest90515 | 06:07 | |
| *** ethfci has quit IRC | 06:10 | |
| *** germs has quit IRC | 06:10 | |
| *** sree has quit IRC | 06:10 | |
| *** udesale_ has joined #openstack-infra | 06:13 | |
| *** rcernin_ has quit IRC | 06:14 | |
| *** udesale has quit IRC | 06:16 | |
| *** rcernin has joined #openstack-infra | 06:17 | |
| *** yamahata has quit IRC | 06:18 | |
| *** dbecker has quit IRC | 06:30 | |
| openstackgerrit | Merged openstack-infra/nodepool master: add gentoo systemd image for testing https://review.openstack.org/556661 | 06:31 |
| *** e0ne has joined #openstack-infra | 06:32 | |
| *** andreas_s has joined #openstack-infra | 06:32 | |
| *** ykarel__ has joined #openstack-infra | 06:34 | |
| *** ykarel_ has quit IRC | 06:36 | |
| openstackgerrit | Merged openstack-dev/pbr master: Explicitly read setup.cfg as utf-8 on Python 3 https://review.openstack.org/555366 | 06:37 |
| *** udesale_ has quit IRC | 06:38 | |
| *** udesale has joined #openstack-infra | 06:39 | |
| *** d0ugal_ has joined #openstack-infra | 06:39 | |
| *** ramishra has quit IRC | 06:40 | |
| *** pahuang_ has quit IRC | 06:40 | |
| *** d0ugal has quit IRC | 06:42 | |
| *** dhajare_ has quit IRC | 06:44 | |
| *** dbecker has joined #openstack-infra | 06:45 | |
| *** ramishra has joined #openstack-infra | 06:52 | |
| *** kiennt26 has quit IRC | 06:53 | |
| *** e0ne has quit IRC | 06:56 | |
| *** salv-orlando has quit IRC | 06:58 | |
| *** florianf has joined #openstack-infra | 06:58 | |
| *** salv-orlando has joined #openstack-infra | 06:59 | |
| *** armaan has joined #openstack-infra | 07:00 | |
| *** sree has joined #openstack-infra | 07:01 | |
| *** rcernin has quit IRC | 07:03 | |
| *** udesale_ has joined #openstack-infra | 07:03 | |
| *** gyan_ has joined #openstack-infra | 07:03 | |
| *** ykarel_ has joined #openstack-infra | 07:03 | |
| *** cshastri_ has joined #openstack-infra | 07:03 | |
| *** pgadiya_ has joined #openstack-infra | 07:04 | |
| *** chkumar246 has joined #openstack-infra | 07:04 | |
| *** Guest90515 has quit IRC | 07:04 | |
| *** gyankum has quit IRC | 07:04 | |
| *** chandankumar has quit IRC | 07:04 | |
| *** ykarel__ has quit IRC | 07:04 | |
| *** pgadiya has quit IRC | 07:04 | |
| *** gyan__ has joined #openstack-infra | 07:05 | |
| *** links has quit IRC | 07:05 | |
| *** udesale__ has joined #openstack-infra | 07:05 | |
| *** links has joined #openstack-infra | 07:06 | |
| *** ykarel__ has joined #openstack-infra | 07:06 | |
| *** cshastri has quit IRC | 07:07 | |
| *** stakeda has joined #openstack-infra | 07:07 | |
| *** udesale has quit IRC | 07:07 | |
| *** priteau has joined #openstack-infra | 07:08 | |
| *** chandankumar has joined #openstack-infra | 07:08 | |
| *** pgadiya_ has quit IRC | 07:08 | |
| *** chkumar246 has quit IRC | 07:09 | |
| *** ykarel_ has quit IRC | 07:09 | |
| *** gyan_ has quit IRC | 07:09 | |
| *** cshastri_ has quit IRC | 07:09 | |
| *** udesale_ has quit IRC | 07:09 | |
| openstackgerrit | Shu Muto proposed openstack-infra/project-config master: Remove non-voting of nodejs-npm-run-lint job for zaqar-ui https://review.openstack.org/557628 | 07:13 |
| *** aviau has quit IRC | 07:19 | |
| *** aviau has joined #openstack-infra | 07:19 | |
| *** salv-orlando has quit IRC | 07:20 | |
| *** pgadiya_ has joined #openstack-infra | 07:20 | |
| *** salv-orlando has joined #openstack-infra | 07:20 | |
| *** cshastri_ has joined #openstack-infra | 07:20 | |
| *** yamamoto has quit IRC | 07:22 | |
| *** tesseract has joined #openstack-infra | 07:22 | |
| *** yamamoto has joined #openstack-infra | 07:23 | |
| *** salv-orlando has quit IRC | 07:24 | |
| *** jrist has quit IRC | 07:27 | |
| *** jrist has joined #openstack-infra | 07:28 | |
| openstackgerrit | Rishabh Dave proposed openstack-infra/openstack-zuul-jobs master: Remove the job manila-ui-dsvm to move it in in-tree https://review.openstack.org/557635 | 07:30 |
| *** dhajare_ has joined #openstack-infra | 07:30 | |
| *** alexchadin has joined #openstack-infra | 07:31 | |
| *** yamamoto_ has joined #openstack-infra | 07:32 | |
| *** yamamoto has quit IRC | 07:34 | |
| *** udesale has joined #openstack-infra | 07:45 | |
| *** daidv has quit IRC | 07:46 | |
| *** udesale__ has quit IRC | 07:47 | |
| *** ykarel__ is now known as ykarel | 07:49 | |
| *** jpich has joined #openstack-infra | 07:49 | |
| *** ykarel_ has joined #openstack-infra | 07:51 | |
| *** bmace has quit IRC | 07:52 | |
| *** bmace has joined #openstack-infra | 07:52 | |
| *** tosky has joined #openstack-infra | 07:53 | |
| *** HeOS has joined #openstack-infra | 07:53 | |
| *** ykarel has quit IRC | 07:53 | |
| *** ralonsoh has joined #openstack-infra | 07:54 | |
| *** electrofelix has joined #openstack-infra | 07:54 | |
| *** salv-orlando has joined #openstack-infra | 07:56 | |
| *** krenczewski has joined #openstack-infra | 07:57 | |
| *** janki has quit IRC | 08:02 | |
| *** daidv has joined #openstack-infra | 08:03 | |
| *** germs has joined #openstack-infra | 08:06 | |
| *** germs has quit IRC | 08:06 | |
| *** germs has joined #openstack-infra | 08:06 | |
| *** bhujay has quit IRC | 08:07 | |
| openstackgerrit | Rishabh Dave proposed openstack-infra/project-config master: Remove the job manila-ui-dsvm to move it in in-tree https://review.openstack.org/557645 | 08:07 |
| krenczewski | IS there any base zuul job that I can use to setup vm with devstack+patch_under_test? | 08:08 |
| openstackgerrit | Rishabh Dave proposed openstack-infra/openstack-zuul-jobs master: Remove the job manila-ui-dsvm to move it in in-tree https://review.openstack.org/557635 | 08:10 |
| mpeterson | krenczewski: the job devstack? https://github.com/openstack-dev/devstack/blob/master/.zuul.yaml | 08:10 |
| *** germs has quit IRC | 08:11 | |
| krenczewski | mpeterson: Looks like I've missed that one, thanks | 08:12 |
| mpeterson | krenczewski: this might be relevant http://lists.openstack.org/pipermail/openstack-dev/2018-February/127453.html | 08:14 |
| *** lucas-afk is now known as lucasagomes | 08:14 | |
| mpeterson | krenczewski: although you only asked for devstack only, not tempest ... still just in case :) | 08:15 |
| *** arxcruz|off is now known as arxcruz|rover | 08:15 | |
| *** e0ne has joined #openstack-infra | 08:15 | |
| krenczewski | mpeterson: Many thanks :-) It is useful! | 08:16 |
| *** e0ne has quit IRC | 08:16 | |
| *** hashar has joined #openstack-infra | 08:21 | |
| *** HeOS has quit IRC | 08:25 | |
| *** e0ne has joined #openstack-infra | 08:30 | |
| *** xarses_ has joined #openstack-infra | 08:31 | |
| *** sshnaidm is now known as sshnaidm|afk | 08:33 | |
| *** derekh has joined #openstack-infra | 08:33 | |
| *** andreww has quit IRC | 08:34 | |
| *** bhujay has joined #openstack-infra | 08:35 | |
| mpeterson | If I understand correctly require-projects should allow to override the installation of those packages from the repo instead of their pypi published versions, right? AFAIU this only applies when using the tox role and tox_install_siblings=True | 08:41 |
| *** rcernin has joined #openstack-infra | 08:48 | |
| *** bhujay has quit IRC | 08:49 | |
| *** gfidente has joined #openstack-infra | 08:56 | |
| *** gfidente has joined #openstack-infra | 08:56 | |
| *** zhurong has quit IRC | 09:00 | |
| *** kukacz_ has joined #openstack-infra | 09:10 | |
| *** bhujay has joined #openstack-infra | 09:10 | |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul master: zuul-changes: update for the new api url https://review.openstack.org/557656 | 09:13 |
| *** HeOS has joined #openstack-infra | 09:16 | |
| *** panda|off is now known as panda | 09:21 | |
| aspiers | does anyone know why etherpad author names and colours never seem to last more than a few days? why can't it persist a client-side cookie with name and colour forever? | 09:26 |
| *** bhujay has quit IRC | 09:27 | |
| *** bhujay has joined #openstack-infra | 09:27 | |
| *** s-shiono has quit IRC | 09:33 | |
| *** kukacz_ has quit IRC | 09:41 | |
| *** kukacz_ has joined #openstack-infra | 09:42 | |
| *** zoli is now known as zoli|lunch | 09:43 | |
| *** ykarel_ is now known as ykarel | 09:51 | |
| *** kukacz_ is now known as kukacz | 09:52 | |
| *** cshastri_ has quit IRC | 10:05 | |
| *** germs has joined #openstack-infra | 10:07 | |
| *** germs has quit IRC | 10:07 | |
| *** germs has joined #openstack-infra | 10:07 | |
| *** gyan__ has quit IRC | 10:09 | |
| *** janki has joined #openstack-infra | 10:11 | |
| *** germs has quit IRC | 10:12 | |
| *** alexchadin has quit IRC | 10:22 | |
| *** sshnaidm|afk is now known as sshnaidm | 10:23 | |
| *** alexchadin has joined #openstack-infra | 10:27 | |
| *** zhangfei has quit IRC | 10:27 | |
| *** pgadiya_ has quit IRC | 10:27 | |
| *** nicolasbock has joined #openstack-infra | 10:32 | |
| *** pgadiya has joined #openstack-infra | 10:33 | |
| *** alexchadin has quit IRC | 10:36 | |
| *** cshastri_ has joined #openstack-infra | 10:44 | |
| *** pbourke has quit IRC | 10:45 | |
| *** pbourke has joined #openstack-infra | 10:45 | |
| *** pgadiya has quit IRC | 10:47 | |
| *** stakeda has quit IRC | 10:49 | |
| *** bhavik1 has quit IRC | 10:51 | |
| *** dtantsur|afk is now known as dtantsur | 10:55 | |
| *** sambetts|afk is now known as sambetts | 10:58 | |
| *** alexchadin has joined #openstack-infra | 10:58 | |
| *** yamamoto has joined #openstack-infra | 11:01 | |
| *** andreas_s has quit IRC | 11:02 | |
| *** andreas_s has joined #openstack-infra | 11:03 | |
| *** alexchadin has quit IRC | 11:03 | |
| *** yamamoto_ has quit IRC | 11:05 | |
| *** dsariel has quit IRC | 11:06 | |
| *** andreas_s has quit IRC | 11:07 | |
| *** lucasagomes is now known as lucas-hungry | 11:07 | |
| *** alexchadin has joined #openstack-infra | 11:10 | |
| *** pblaho has joined #openstack-infra | 11:11 | |
| *** pblaho has quit IRC | 11:12 | |
| *** pblaho has joined #openstack-infra | 11:13 | |
| *** zoli|lunch is now known as zoli | 11:13 | |
| *** numans has quit IRC | 11:15 | |
| *** cshastri_ has quit IRC | 11:18 | |
| *** numans has joined #openstack-infra | 11:18 | |
| *** dsariel has joined #openstack-infra | 11:20 | |
| *** dsariel has quit IRC | 11:26 | |
| *** dsariel has joined #openstack-infra | 11:26 | |
| *** jcoufal has joined #openstack-infra | 11:28 | |
| *** panda is now known as panda|lunch | 11:29 | |
| *** edmondsw has joined #openstack-infra | 11:30 | |
| *** dprince has joined #openstack-infra | 11:32 | |
| *** pgadiya has joined #openstack-infra | 11:39 | |
| *** udesale has quit IRC | 11:46 | |
| *** ykarel has quit IRC | 11:46 | |
| *** ykarel has joined #openstack-infra | 11:46 | |
| *** udesale has joined #openstack-infra | 11:46 | |
| *** armaan has quit IRC | 11:48 | |
| *** armaan has joined #openstack-infra | 11:48 | |
| *** links has quit IRC | 11:49 | |
| *** andreas_s has joined #openstack-infra | 11:51 | |
| *** gongysh has quit IRC | 11:53 | |
| *** links has joined #openstack-infra | 11:54 | |
| *** nicolasbock has quit IRC | 11:54 | |
| *** lucas-hungry is now known as lucasagomes | 11:55 | |
| *** andreas_s has quit IRC | 11:56 | |
| *** vivsoni has quit IRC | 11:57 | |
| *** vivsoni has joined #openstack-infra | 11:58 | |
| dulek | Is anyone able to point me to an example of a job that copies custom logs/command outputs into the results? | 11:59 |
| *** jlabarre has joined #openstack-infra | 12:01 | |
| *** rcernin has quit IRC | 12:05 | |
| *** rfolco|off is now known as rfolco|ruck | 12:05 | |
| *** danpawlik has joined #openstack-infra | 12:07 | |
| *** germs has joined #openstack-infra | 12:08 | |
| *** germs has quit IRC | 12:08 | |
| *** germs has joined #openstack-infra | 12:08 | |
| *** HeOS has quit IRC | 12:08 | |
| *** armaan has quit IRC | 12:11 | |
| *** armaan has joined #openstack-infra | 12:11 | |
| *** germs has quit IRC | 12:12 | |
| *** ykarel is now known as ykarel|afk | 12:13 | |
| *** udesale_ has joined #openstack-infra | 12:14 | |
| *** udesale has quit IRC | 12:16 | |
| *** panda|lunch is now known as panda | 12:18 | |
| *** udesale_ has quit IRC | 12:19 | |
| *** eharney has joined #openstack-infra | 12:26 | |
| dmsimard | dulek: http://git.openstack.org/cgit/openstack/puppet-openstack-integration/tree/playbooks/upload-logs.yaml ? | 12:26 |
| dmsimard | The custom logs are recovered with http://git.openstack.org/cgit/openstack/puppet-openstack-integration/tree/copy_logs.sh | 12:26 |
| *** pgadiya has quit IRC | 12:28 | |
| *** ldnunes has joined #openstack-infra | 12:30 | |
| *** alexchadin has quit IRC | 12:35 | |
| *** alexchadin has joined #openstack-infra | 12:35 | |
| *** alexchadin has quit IRC | 12:36 | |
| *** HeOS has joined #openstack-infra | 12:36 | |
| *** alexchadin has joined #openstack-infra | 12:36 | |
| *** alexchadin has quit IRC | 12:36 | |
| *** alexchadin has joined #openstack-infra | 12:37 | |
| dulek | dmsimard: Thanks! | 12:37 |
| *** alexchadin has quit IRC | 12:37 | |
| *** alexchadin has joined #openstack-infra | 12:38 | |
| *** alexchadin has quit IRC | 12:38 | |
| *** alexchadin has joined #openstack-infra | 12:39 | |
| *** alexchadin has quit IRC | 12:39 | |
| *** alexchadin has joined #openstack-infra | 12:39 | |
| pabelanger | infra-root: I point you to https://review.openstack.org/557571/ our latest adventure in stopping something from changing /etc/resolv.conf on images. This time it is systemd on bionic. | 12:41 |
| *** alexchadin has quit IRC | 12:43 | |
| *** electrofelix has quit IRC | 12:46 | |
| *** kgiusti has joined #openstack-infra | 12:48 | |
| *** alexchadin has joined #openstack-infra | 12:50 | |
| *** pblaho has quit IRC | 12:51 | |
| openstackgerrit | David Shrewsbury proposed openstack-infra/zuul master: Reorganzie "Zuul From Scratch" document https://review.openstack.org/556988 | 12:53 |
| *** alexchadin has quit IRC | 12:54 | |
| *** odyssey4me has quit IRC | 12:57 | |
| *** odyssey4me has joined #openstack-infra | 12:57 | |
| *** rosmaita has joined #openstack-infra | 12:58 | |
| *** edmondsw has quit IRC | 12:58 | |
| *** edmondsw has joined #openstack-infra | 12:59 | |
| openstackgerrit | David Shrewsbury proposed openstack-infra/zuul master: Reorganize "Zuul From Scratch" document https://review.openstack.org/556988 | 13:00 |
| *** andreas_s has joined #openstack-infra | 13:01 | |
| *** edmondsw has quit IRC | 13:03 | |
| *** ykarel|afk is now known as ykarel | 13:03 | |
| *** edmondsw has joined #openstack-infra | 13:05 | |
| *** andreas_s has quit IRC | 13:05 | |
| *** jamesmcarthur has joined #openstack-infra | 13:08 | |
| *** olaph has joined #openstack-infra | 13:10 | |
| *** alexchadin has joined #openstack-infra | 13:10 | |
| *** trown|outtypewww is now known as trown | 13:10 | |
| *** mriedem has joined #openstack-infra | 13:10 | |
| *** ihrachys_ has quit IRC | 13:10 | |
| *** ihrachys has joined #openstack-infra | 13:12 | |
| *** ihrachys has quit IRC | 13:12 | |
| *** jamesmcarthur has quit IRC | 13:13 | |
| *** vivsoni has quit IRC | 13:14 | |
| *** vivsoni has joined #openstack-infra | 13:14 | |
| *** alexchadin has quit IRC | 13:14 | |
| *** zhipeng has joined #openstack-infra | 13:16 | |
| *** salv-orlando has quit IRC | 13:18 | |
| *** salv-orlando has joined #openstack-infra | 13:18 | |
| *** bobh has joined #openstack-infra | 13:19 | |
| *** salv-orlando has quit IRC | 13:23 | |
| *** efried has quit IRC | 13:24 | |
| *** alexchadin has joined #openstack-infra | 13:24 | |
| *** efried has joined #openstack-infra | 13:25 | |
| *** pickle has joined #openstack-infra | 13:26 | |
| *** esberglu has joined #openstack-infra | 13:28 | |
| *** adarazs is now known as adarazs_afk | 13:30 | |
| *** VW has joined #openstack-infra | 13:31 | |
| openstackgerrit | Colleen Murphy proposed openstack-infra/project-config master: Fix ansible-lint job https://review.openstack.org/557709 | 13:36 |
| *** ykarel is now known as ykarel|away | 13:37 | |
| *** psachin` has quit IRC | 13:38 | |
| dmsimard | I did a fairly special talk this week about how people can contribute to openstack-infra in case you have time to kill over this long weekend: http://lists.openstack.org/pipermail/openstack-infra/2018-March/005885.html | 13:41 |
| dmsimard | Of course if you're here you might not be the target audience but there's a couple fun recursive/meta references :) | 13:41 |
| *** alexchadin has quit IRC | 13:41 | |
| *** alexchadin has joined #openstack-infra | 13:42 | |
| *** ykarel|away has quit IRC | 13:42 | |
| *** eharney has quit IRC | 13:43 | |
| *** felipemonteiro_ has joined #openstack-infra | 13:46 | |
| openstackgerrit | Merged openstack-infra/openstack-zuul-jobs master: Fix ansible-lint job https://review.openstack.org/557514 | 13:47 |
| *** salv-orlando has joined #openstack-infra | 13:48 | |
| *** hongbin has joined #openstack-infra | 13:49 | |
| *** felipemonteiro_ has quit IRC | 13:51 | |
| openstackgerrit | Merged openstack-infra/zuul-jobs master: Fix ansible-lint job https://review.openstack.org/557507 | 13:52 |
| *** eernst has joined #openstack-infra | 13:53 | |
| *** udesale has joined #openstack-infra | 13:53 | |
| *** eharney has joined #openstack-infra | 13:58 | |
| *** r-daneel has joined #openstack-infra | 13:58 | |
| *** adarazs_afk is now known as adarazs | 13:58 | |
| *** udesale has quit IRC | 13:59 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/zuul master: Upgrade from angularjs (v1) to angular (v5) https://review.openstack.org/551989 | 13:59 |
| openstackgerrit | Monty Taylor proposed openstack-infra/zuul master: Use glyphicons for status balls https://review.openstack.org/551992 | 13:59 |
| openstackgerrit | Monty Taylor proposed openstack-infra/zuul master: Stop falling back to job name for missing url https://review.openstack.org/554056 | 13:59 |
| openstackgerrit | Monty Taylor proposed openstack-infra/zuul master: Remove dashboard workaround for missing log_url https://review.openstack.org/554066 | 13:59 |
| openstackgerrit | Monty Taylor proposed openstack-infra/zuul master: Add zuul-build-dashboard-multi-tenant https://review.openstack.org/557713 | 13:59 |
| *** dave-mccowan has joined #openstack-infra | 14:02 | |
| openstackgerrit | Merged openstack-infra/project-config master: Remove etcd version workaround for arm64 https://review.openstack.org/557594 | 14:03 |
| *** armaan has quit IRC | 14:03 | |
| *** r-daneel_ has joined #openstack-infra | 14:04 | |
| *** r-daneel has quit IRC | 14:04 | |
| *** r-daneel_ is now known as r-daneel | 14:04 | |
| *** andreas_s has joined #openstack-infra | 14:04 | |
| *** ykarel|away has joined #openstack-infra | 14:05 | |
| *** germs has joined #openstack-infra | 14:09 | |
| *** germs has quit IRC | 14:09 | |
| *** germs has joined #openstack-infra | 14:09 | |
| *** andreas_s has quit IRC | 14:10 | |
| *** annp has joined #openstack-infra | 14:11 | |
| openstackgerrit | sebastian marcet proposed openstack-infra/openstackid-resources master: Added endpoints to create/update RSVP templates by summit https://review.openstack.org/557718 | 14:12 |
| *** germs has quit IRC | 14:13 | |
| *** ykarel|away is now known as ykarel | 14:14 | |
| openstackgerrit | Merged openstack-infra/openstackid-resources master: Added endpoints to create/update RSVP templates by summit https://review.openstack.org/557718 | 14:14 |
| *** jlvillal has quit IRC | 14:15 | |
| *** vkmc has quit IRC | 14:15 | |
| *** links has quit IRC | 14:26 | |
| dulek | dmsimard: Okay, I've prepared the script that will copy the outputs I need into the workspace/logs. But how do I inject it to run after tests? | 14:26 |
| dulek | dmsimard: What I'm actually trying to do is to include some additional outputs in a devstack-tempest job results. | 14:26 |
| dmsimard | dulek: logs are typically recovered (and later uploaded) in a post playbook | 14:27 |
| dmsimard | dulek: there's three "stages", pre, run and post | 14:27 |
| dulek | Yup. | 14:27 |
| dmsimard | dulek: which job are you trying to do this for ? | 14:27 |
| *** armaan has joined #openstack-infra | 14:27 | |
| dulek | dmsimard: Sure, but if I change the post-run property of the job it will be overwritten. | 14:27 |
| dulek | dmsimard: https://github.com/openstack/kuryr-kubernetes/blob/183aeebf5cc6369ac5cce0365af555768d6fb20f/.zuul.yaml#L55 | 14:28 |
| dulek | dmsimard: Exactly this job, which inherits from devstack-tempest. | 14:28 |
| *** danpawlik has quit IRC | 14:29 | |
| *** VW has quit IRC | 14:30 | |
| *** vkmc has joined #openstack-infra | 14:30 | |
| fungi | infra-root: heads up, i just found an interesting POST_FAILURE where a release job hit a changed ssh host key. i know we've seen that happen before, but this is the first time i've ever seen it happen in rax (this was rax-ord specifically) http://logs.openstack.org/c0/c03002e01782e672521acf1ca449ac92fc96c7d3/release/release-openstack-puppet/4195daf/ara/result/fa1cfc37-93e5-4135-8cc7-5475b822111b/ | 14:31 |
| fungi | may want to keep an eye out for similar disruption | 14:32 |
| pabelanger | fungi: I believe I've see that on rax before, but not recently | 14:32 |
| pabelanger | I know at one time I had a patch up to store the hostkeys, in an effort to try and compare them | 14:33 |
| mpeterson | dulek: you need to copy some log files? | 14:34 |
| dmsimard | dulek: you can add another post playbook, it won't overwrite the one from devstack-tempest | 14:35 |
| dulek | mpeterson: Rather some `kubectl <something>` outputs. | 14:35 |
| dmsimard | dulek: http://git.openstack.org/cgit/openstack/tempest/tree/.zuul.yaml#n1 | 14:35 |
| dmsimard | That's the devstack-tempest job you are inheriting from | 14:35 |
| *** rossella_s has joined #openstack-infra | 14:35 | |
| dmsimard | if you add a post-run in your own job, it will just add it to the list of post playbooks that should be run | 14:35 |
| dulek | dmsimard: Oh, awesome. And what's the order of running them? | 14:36 |
| pabelanger | fungi: Oh, we get them for free now: http://logs.openstack.org/71/557571/1/check/openstack-zuul-jobs-linters/c1b7ced/zuul-info/host-info.ubuntu-xenial.yaml we should be able to query logstash.o.o to find the inventory file which used that before | 14:37 |
| dmsimard | dulek: kinda hard to put into writing (whiteboard material), it's in order of appearance/inheritance I believe. So for example the "base" job has post playbook and since it's the very first job to run, it'll also be the very last job to run | 14:37 |
| mpeterson | dulek: then you need to create your own post steps, we are doing something like that for our jobs in networking-odl https://github.com/openstack/networking-odl/blob/master/playbooks/tempest/post.yaml#L4 | 14:37 |
| dmsimard | dulek: and then it kinda sandwhiches that way | 14:37 |
| *** krenczewski has quit IRC | 14:37 | |
| fungi | pabelanger: do we actually index the host-info file in logstash? | 14:37 |
| mpeterson | dulek: and https://github.com/openstack/networking-odl/blob/97a7d35dbdc5f5b910f08139c008e23a48c9fdf2/.zuul.d/jobs.yaml#L78 | 14:38 |
| pabelanger | fungi: I'm unsure currently | 14:38 |
| *** Goneri has joined #openstack-infra | 14:38 | |
| *** ramishra has quit IRC | 14:38 | |
| dmsimard | dulek: if you look at the example I gave you earlier this morning (puppet-openstack-integration), they have this in their jobs: http://git.openstack.org/cgit/openstack/puppet-openstack-integration/tree/.zuul.yaml#n55 | 14:38 |
| dulek | dmsimard: Okay, so if put post-run in kuryr-kubernetes-tempest-base, that copies the logs, it will be run before DevStack's job copying the logs. :) | 14:39 |
| dmsimard | dulek: and then if you look at the playbook execution order, it's there as "upload-logs.yaml": http://logs.openstack.org/87/511687/7/check/puppet-openstack-integration-4-scenario003-tempest-centos-7/e9dbee5/ara/ | 14:39 |
| *** dhajare_ has quit IRC | 14:40 | |
| dmsimard | dulek: I'm not 100% positive -- by all means try it out. You can test it just by sending a patch and Zuul will live test your change. | 14:40 |
| dulek | dmsimard: Sure, that's something I know. :) | 14:40 |
| openstackgerrit | Matthew Thode proposed openstack-infra/irc-meetings master: Update requirements meeting time https://review.openstack.org/557453 | 14:40 |
| dulek | dmsimard: Okay, thanks a lot for helping. | 14:40 |
| dmsimard | np ! | 14:41 |
| dulek | And you mpeterson, those examples are useful! | 14:41 |
| *** Swami has joined #openstack-infra | 14:41 | |
| dmsimard | fungi: we've seen that happen in inap before I think ? | 14:41 |
| *** sree has quit IRC | 14:41 | |
| *** tpsilva has joined #openstack-infra | 14:41 | |
| *** sree has joined #openstack-infra | 14:42 | |
| fungi | dmsimard: right | 14:42 |
| fungi | and so i was expecting to find that's where the job ran, but was surprised to see it was rax | 14:42 |
| prometheanfire | pabelanger: while you are looking... https://review.openstack.org/556652 | 14:44 |
| prometheanfire | pabelanger: I think that's the last change needed to get gentoo images available? | 14:44 |
| *** david-lyle has joined #openstack-infra | 14:45 | |
| *** hamzy has quit IRC | 14:46 | |
| *** sree has quit IRC | 14:47 | |
| pabelanger | prometheanfire: yah, -1 for some changes we'll need to build them, but looks good | 14:47 |
| pabelanger | we should be able to tag glean today, cc _Cyclone_ | 14:48 |
| pabelanger | _Cyclone_: sorry | 14:48 |
| pabelanger | clarkb: ^ | 14:48 |
| prometheanfire | will use gentoo-17_0-systemd as the version | 14:48 |
| pabelanger | prometheanfire: would we ever bring gentoo-17_0 online without systemd? | 14:49 |
| *** zhipeng has quit IRC | 14:49 | |
| prometheanfire | possible, that was the plan before the ptg | 14:50 |
| prometheanfire | might try musl or something as well | 14:50 |
| prometheanfire | it's useful to have some profile identifier along with the profile version | 14:50 |
| pabelanger | gentoo-17-0-systemd should be fine | 14:51 |
| prometheanfire | no underscores? | 14:51 |
| pabelanger | yah, we don't have any images using underscores ATM | 14:51 |
| prometheanfire | k | 14:51 |
| pabelanger | so, to keep them the same | 14:51 |
| dmsimard | config-core: I have a small project-config patch that needs a +3 for ARA 1.0 things: https://review.openstack.org/#/c/556528/ | 14:51 |
| pabelanger | gentoo-170-systemd | 14:51 |
| pabelanger | your call | 14:51 |
| prometheanfire | that just looks weird :P | 14:52 |
| mpeterson | Depends-On applies the patches it depends on in src/git.openstack.org/openstack/.* ? it's that part of a system pre-run playbook? | 14:52 |
| *** sree has joined #openstack-infra | 14:52 | |
| pabelanger | mpeterson: yes all projects in git.o.o | 14:53 |
| *** caphrim007_ has quit IRC | 14:53 | |
| pabelanger | and some github.com projects | 14:53 |
| mpeterson | pabelanger: and does that after processing requires-projects, right? | 14:53 |
| *** caphrim007 has joined #openstack-infra | 14:53 | |
| pabelanger | required-projects, yah | 14:54 |
| openstackgerrit | Merged openstack-infra/project-config master: Add non-voting job nodepool-functional-py35-gentoo-src https://review.openstack.org/557443 | 14:54 |
| openstackgerrit | Thierry Carrez proposed openstack-infra/project-config master: Remove direct tag / branch ACLs for official projects https://review.openstack.org/557730 | 14:54 |
| mpeterson | pabelanger: I'm wondering if then the pip.conf shouldn't be modified CI wide to look there first, before pypi? | 14:54 |
| pabelanger | mpeterson: what is the issue you are trying to solve? We have some tooling in play today for tox jobs (tox-siblings) to properly deal with depends-on headers | 14:55 |
| *** danpawlik has joined #openstack-infra | 14:55 | |
| *** bhujay has quit IRC | 14:56 | |
| mpeterson | pabelanger: right, but that applies to the tox role only. What I'm seeing is that when using devstack jobs then devstack is started with pypi versions of the code | 14:56 |
| mpeterson | pabelanger: https://review.openstack.org/#/c/555268/ for example has a Depends-On but fails to pass the functional, for example. | 14:57 |
| openstackgerrit | Matthew Thode proposed openstack-infra/project-config master: make Gentoo use the systemd profile https://review.openstack.org/556652 | 14:57 |
| *** sree has quit IRC | 14:57 | |
| fungi | mpeterson: see corvus's post to the dev ml yesterday about tying implicit $LIBS_FROM_GIT generation to zuul required-projects lists | 14:58 |
| mpeterson | pabelanger: also, there are pip_install helpers in devstack that might be used in e.g. devstack/entry_point, in which case it would rely on pypi | 14:58 |
| *** caphrim007 has quit IRC | 14:58 | |
| *** rossella_s has quit IRC | 14:59 | |
| fungi | mpeterson: http://lists.openstack.org/pipermail/openstack-dev/2018-March/128844.html | 14:59 |
| pabelanger | yah, I think LIBS_FROM_GIT is missing here, per fungi / corvus | 14:59 |
| *** rossella_s has joined #openstack-infra | 14:59 | |
| *** adarazs has left #openstack-infra | 14:59 | |
| *** danpawlik has quit IRC | 15:00 | |
| mpeterson | fungi: nice! | 15:00 |
| corvus | mpeterson: you can get the new behavior if you depends-on the patch in my message; but it probably won't land until next week | 15:01 |
| mpeterson | corvus: nice you caught that :) | 15:02 |
| mpeterson | fungi, pabelanger: thanks for the input too | 15:02 |
| *** eernst has quit IRC | 15:02 | |
| openstackgerrit | Thierry Carrez proposed openstack-infra/project-config master: Remove leftover stable/queens pre-release ACL https://review.openstack.org/557733 | 15:02 |
| *** eernst has joined #openstack-infra | 15:02 | |
| openstackgerrit | Merged openstack-infra/project-config master: Add basic Zuul layout for ara-clients, ara-plugins, ara-server https://review.openstack.org/556528 | 15:04 |
| *** apetrich has quit IRC | 15:06 | |
| *** apetrich has joined #openstack-infra | 15:08 | |
| *** felipemonteiro_ has joined #openstack-infra | 15:09 | |
| *** annp has quit IRC | 15:11 | |
| *** jlvillal has joined #openstack-infra | 15:12 | |
| openstackgerrit | Thierry Carrez proposed openstack-infra/project-config master: Remove leftover stable/queens pre-release ACL https://review.openstack.org/557733 | 15:14 |
| openstackgerrit | Paul Belanger proposed openstack-infra/nodepool master: Update pypi metadata https://review.openstack.org/557738 | 15:14 |
| *** salv-orlando has quit IRC | 15:15 | |
| openstackgerrit | Thierry Carrez proposed openstack-infra/project-config master: Remove leftover stable/queens pre-release ACL https://review.openstack.org/557733 | 15:15 |
| *** sree has joined #openstack-infra | 15:16 | |
| *** salv-orlando has joined #openstack-infra | 15:16 | |
| openstackgerrit | Thierry Carrez proposed openstack-infra/project-config master: Remove direct tag / branch ACLs for official projects https://review.openstack.org/557730 | 15:16 |
| *** VW has joined #openstack-infra | 15:17 | |
| mpeterson | corvus: that still doesn't solve the problem where there is a -e git+https://... requirement in requirements.txt, does it? In that case pip wouldn't find that package | 15:17 |
| *** VW_ has joined #openstack-infra | 15:17 | |
| *** e0ne has quit IRC | 15:18 | |
| *** janki has quit IRC | 15:19 | |
| mpeterson | issue that can be seen in https://review.openstack.org/#/c/557370/1 and that I fixed by a workaround in patch #3 | 15:19 |
| *** VW_ has quit IRC | 15:20 | |
| *** VW_ has joined #openstack-infra | 15:20 | |
| *** salv-orlando has quit IRC | 15:20 | |
| *** sree has quit IRC | 15:21 | |
| *** VW has quit IRC | 15:21 | |
| *** zoli is now known as zoli|gone | 15:21 | |
| *** zoli|gone is now known as zoli | 15:21 | |
| *** hamzy has joined #openstack-infra | 15:22 | |
| *** rossella_s has quit IRC | 15:22 | |
| *** VW_ has quit IRC | 15:23 | |
| *** rossella_s has joined #openstack-infra | 15:24 | |
| *** imacdonn has quit IRC | 15:27 | |
| *** imacdonn has joined #openstack-infra | 15:27 | |
| clarkb | fungi: we discovered that syncrhonize tasks don't use the controlmaster ssh process for their conenctivity which makes them more susceptible to ssh failures during the jobs than the normal tasks are | 15:29 |
| *** rossella_s has quit IRC | 15:29 | |
| clarkb | fungi: is it posible something is changing the host key between job start (and controlmaster starting) and that synhronize running? | 15:29 |
| fungi | mpeterson: i think the idea is that as soon as we get everything publishing to pypi, projects can _stop_ listing -e git+https://... requirements | 15:29 |
| mpeterson | fungi: yes, that would be ideal :) | 15:30 |
| fungi | clarkb: doubtful... the job generates a tarball of a puppet module and then the post task copies it to tarballs.o.o | 15:30 |
| pabelanger | clarkb: oh, forgot about that. Do we have a patch someplace upstream or in zuul to enable that | 15:30 |
| *** alexchadin has quit IRC | 15:31 | |
| mpeterson | fungi: we only have one dependency that's not publishing to pypi (ceilometer), is there anything I can do to help that happening? | 15:31 |
| *** agopi has joined #openstack-infra | 15:32 | |
| clarkb | pabelanger: you can tell synchronize tasks individually to use_ssh_args aiui but not globally | 15:32 |
| fungi | mpeterson: talk to the release team, but i believe ultimately it's just getting the telemetry team to agree to change which release job they utilize | 15:33 |
| *** danpawlik has joined #openstack-infra | 15:34 | |
| *** witek has quit IRC | 15:34 | |
| *** sree has joined #openstack-infra | 15:38 | |
| *** armaan has quit IRC | 15:38 | |
| pabelanger | clarkb: yah, same with verify_host for host keys | 15:38 |
| *** danpawlik has quit IRC | 15:39 | |
| pabelanger | so, we should be able to update our playbooks and test that | 15:39 |
| *** iranzo has quit IRC | 15:40 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/zuul master: Upgrade to webpack 4 https://review.openstack.org/551987 | 15:41 |
| openstackgerrit | Monty Taylor proposed openstack-infra/zuul master: Upgrade from angularjs (v1) to angular (v5) https://review.openstack.org/551989 | 15:41 |
| openstackgerrit | Monty Taylor proposed openstack-infra/zuul master: Use glyphicons for status balls https://review.openstack.org/551992 | 15:41 |
| pabelanger | clarkb: are you primed up to look at https://review.openstack.org/557571/ systemd and dns for bionic | 15:42 |
| pabelanger | a great topic | 15:42 |
| clarkb | pabelanger: ya I waas just looking at that. Why not disable the unit entirely instead? | 15:42 |
| *** sree has quit IRC | 15:42 | |
| pabelanger | clarkb: no reason not too, that was the minimal fix from testing yesterday | 15:43 |
| clarkb | pabelanger: on line 186 ish you just systemctl disable resolvd.service | 15:43 |
| clarkb | I guess that would error if the service isn't present? | 15:43 |
| pabelanger | yah, I think so | 15:44 |
| pabelanger | we'd need to check if service existed first | 15:44 |
| pabelanger | let me see how to do that | 15:44 |
| clarkb | ya I just checked locally and it would fail | 15:44 |
| clarkb | pabelanger: systemctl is-enabled foo | 15:45 |
| pabelanger | k | 15:46 |
| clarkb | pabelanger: so it becomes `if systemctl is-enabled resolvd.service ; then systemctl disable resolvd.service ; fi` | 15:46 |
| pabelanger | yah | 15:46 |
| clarkb | pabelanger: and I think disabling it entirely is worthwhile so that we don't run into confusion later trying to figure out which dns server is actually in use on the instances | 15:47 |
| clarkb | some people might assume one or the other if running a ps and seeing them and not actually check lsof or whatever | 15:47 |
| *** dprince has quit IRC | 15:48 | |
| *** ldnunes has quit IRC | 15:49 | |
| openstackgerrit | Thierry Carrez proposed openstack-infra/irc-meetings master: Add general intro about IRC + channel list https://review.openstack.org/557745 | 15:49 |
| *** ldnunes has joined #openstack-infra | 15:50 | |
| logan- | small heads up. i noticed limestone has no nodes running. that is because I pulled a stupid and forgot to disable invoicing on the nodepool servers once I got back from the ptg, and it has now been a month since we set them up so the bill is due! (and the network ports disabled!) they will be popping back online here in a bit.. sorry about that. | 15:50 |
| clarkb | logan-: no problem, nodepool should handle that relatively well and just shift load elsewhere | 15:51 |
| *** inc0 has joined #openstack-infra | 15:52 | |
| *** inc0 has quit IRC | 15:52 | |
| openstackgerrit | Vaishnavi Pamulapati proposed openstack-infra/storyboard-webclient master: Set default project for new story dialog from header https://review.openstack.org/557575 | 15:54 |
| *** links has joined #openstack-infra | 15:54 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/project-config master: Stop systemd-resolve from booting on our images https://review.openstack.org/557571 | 15:56 |
| pabelanger | clarkb: ^works locally | 15:56 |
| pabelanger | clarkb: logan-: no, I see an issue | 15:56 |
| pabelanger | http://grafana.openstack.org/dashboard/db/nodepool-limestone | 15:56 |
| pabelanger | we are erroring | 15:56 |
| pabelanger | let me check | 15:56 |
| *** Swami has quit IRC | 15:56 | |
| fungi | logan-: you're also far from the first donor to run into this problem ;) | 15:56 |
| *** nhandler has joined #openstack-infra | 15:57 | |
| fungi | one of our larger donors requires us to go hit a switch every ~6 months to refresh our donation exemption in their billing system | 15:57 |
| pabelanger | logan-: clarkb: http://paste.openstack.org/show/717919/ | 15:57 |
| pabelanger | I don't see an ipv6 address there | 15:58 |
| *** trown is now known as trown|lunch | 15:58 | |
| pabelanger | did something change at 12:00 UTC? | 15:58 |
| pabelanger | ah, I see | 15:59 |
| pabelanger | billing removed ips? | 15:59 |
| fungi | pabelanger: yeah, see scrollback | 15:59 |
| pabelanger | Ah, I see now | 15:59 |
| openstackgerrit | Vaishnavi Pamulapati proposed openstack-infra/storyboard-webclient master: Set default project for new story dialog from header https://review.openstack.org/557575 | 16:00 |
| openstackgerrit | Vaishnavi Pamulapati proposed openstack-infra/storyboard-webclient master: Fix incorrect usage of page size preference key https://review.openstack.org/557553 | 16:04 |
| *** yamamoto has quit IRC | 16:04 | |
| *** danpawlik has joined #openstack-infra | 16:06 | |
| *** yamamoto has joined #openstack-infra | 16:07 | |
| openstackgerrit | Stephen Finucane proposed openstack-dev/pbr master: add lower-constraints job https://review.openstack.org/555297 | 16:07 |
| *** germs has joined #openstack-infra | 16:09 | |
| *** germs has quit IRC | 16:09 | |
| *** germs has joined #openstack-infra | 16:09 | |
| *** sambetts is now known as sambetts|afk | 16:09 | |
| *** danpawlik has quit IRC | 16:10 | |
| logan- | fungi: ahh yeah the joys of billing systems :P will ping back here in a while once things are straightened out | 16:11 |
| *** dsariel has quit IRC | 16:12 | |
| fungi | thanks! | 16:13 |
| *** caphrim007 has joined #openstack-infra | 16:13 | |
| pabelanger | fungi: do you also mind looking at https://review.openstack.org/557571/ per clarkb suggested changes | 16:14 |
| *** germs has quit IRC | 16:14 | |
| openstackgerrit | Thierry Carrez proposed openstack-infra/irc-meetings master: Add general intro about IRC + channel list https://review.openstack.org/557745 | 16:15 |
| clarkb | pabelanger: I think you should move that block to between lines 181 and 182 of that patch | 16:16 |
| clarkb | pabelanger: since we don't need to systemctl if not systemding | 16:16 |
| pabelanger | wfm | 16:18 |
| openstackgerrit | Paul Belanger proposed openstack-infra/project-config master: Stop systemd-resolve from booting on our images https://review.openstack.org/557571 | 16:18 |
| clarkb | pabelanger: lgtm thanks | 16:20 |
| *** dprince has joined #openstack-infra | 16:22 | |
| *** links has quit IRC | 16:22 | |
| *** yamamoto has quit IRC | 16:24 | |
| *** camunoz has joined #openstack-infra | 16:28 | |
| *** yamamoto has joined #openstack-infra | 16:29 | |
| openstackgerrit | Merged openstack-infra/project-config master: Stop systemd-resolve from booting on our images https://review.openstack.org/557571 | 16:32 |
| *** lucasagomes is now known as lucas-pto | 16:33 | |
| *** yamamoto has quit IRC | 16:34 | |
| *** jamesmcarthur has joined #openstack-infra | 16:35 | |
| pabelanger | clarkb: thanks! | 16:37 |
| pabelanger | fungi: you to | 16:37 |
| *** camunoz has quit IRC | 16:37 | |
| openstackgerrit | Clark Boylan proposed openstack-infra/infra-specs master: Mark zuul v3 work as done https://review.openstack.org/557772 | 16:37 |
| *** camunoz has joined #openstack-infra | 16:37 | |
| clarkb | infra-root ^ fyi I'm putting that up now | 16:37 |
| * fungi cheers again | 16:38 | |
| pabelanger | Hmm, image builds might be broken | 16:39 |
| *** florianf has quit IRC | 16:39 | |
| fungi | hopefully that isn't a sign that we'll be releasing nodepool 3.0.1 later today | 16:40 |
| pabelanger | 2018-03-29 02:42:14.155 | Did not get /opt/dib_cache/source-repositories/repositories_flock: Thu Mar 29 02:42:14 UTC 2018 | 16:41 |
| pabelanger | http://nb01.openstack.org/centos-7-0000008554.log | 16:41 |
| pabelanger | perhaps we leaked a lock | 16:42 |
| clarkb | pabelanger: if I had to guess the builder was restarted with the lock held and dib doesn't clean that up gracefully | 16:42 |
| clarkb | pabelanger: its safe to completely delete the cache dir and have it start over though as long as dib isn't currently running | 16:42 |
| pabelanger | yah | 16:42 |
| pabelanger | I think that is it | 16:42 |
| pabelanger | I see 2 diskimage-builder processes running | 16:42 |
| corvus | is that something we can/should check on startup? | 16:42 |
| corvus | oh, did it not shut down properly? | 16:43 |
| *** inc0 has joined #openstack-infra | 16:43 | |
| clarkb | corvus: or maybe make more robust in dib itself (it is typically good with its at exit handling but maybe this particular case is broken) | 16:43 |
| *** danpawlik has joined #openstack-infra | 16:43 | |
| pabelanger | maybe, the hung diskimage-build process is Mar28 | 16:43 |
| pabelanger | wonder it was buliding an image when we restarted things | 16:43 |
| pabelanger | I am going stop nb01 and see if I can clean it up | 16:44 |
| pabelanger | okay, there was an git fetch-pack to https://git.o.o that might have been hung. killing that process cleaned up DIB | 16:45 |
| pabelanger | I want to say we added something to zuul to deal with that for the git client, some environmental vars | 16:46 |
| *** jpich has quit IRC | 16:46 | |
| *** armaan has joined #openstack-infra | 16:47 | |
| pabelanger | same, hung git process on nb02 | 16:47 |
| *** danpawlik has quit IRC | 16:48 | |
| pabelanger | I'll see if I can find those settings and update builders | 16:48 |
| *** gyee has joined #openstack-infra | 16:49 | |
| *** sshnaidm has quit IRC | 16:50 | |
| *** danpawlik has joined #openstack-infra | 16:53 | |
| *** florianf has joined #openstack-infra | 16:55 | |
| *** derekh has quit IRC | 16:55 | |
| *** jaosorior has quit IRC | 16:56 | |
| clarkb | pabelanger: logan- looks like we are still not booting limestone instances so I'll go take a look | 16:57 |
| *** immune2iocane has joined #openstack-infra | 16:57 | |
| openstackgerrit | David Moreau Simard proposed openstack-infra/openstack-zuul-jobs master: Do not merge: Re-parent integration jobs to base-test https://review.openstack.org/553663 | 16:58 |
| *** danpawlik has quit IRC | 16:58 | |
| clarkb | pabelanger: logan- looks like instances are still going to an error state | 16:59 |
| openstackgerrit | Merged openstack-infra/nodepool master: Add host-key-checking option to openstack providers https://review.openstack.org/556624 | 17:00 |
| ssbarnea | is there a way to prevent git-review from pushing a review if "too many commit message lines longer than 72"? now it does display the warning after creating the CR which is kinda too late. | 17:00 |
| *** Goneri has quit IRC | 17:02 | |
| clarkb | ssbarnea: that warning actually comes from gerrit I think. So you can configure gerrit to make that an error rather than a warning | 17:02 |
| clarkb | dmsimard: ^ let me know if I can help with the ara-report and sqlite middleware at all. Would be excellent to get ara reports on all jobs again :) | 17:02 |
| dmsimard | clarkb: yup, I'm spending some time on ARA in general today (also wrapped up some initial imports on 1.0 prototype work) | 17:03 |
| dmsimard | clarkb: setting the table for a four day weekend -- cool thing about time off is that I can choose what to work on :P | 17:03 |
| fungi | clarkb: pabelanger: logan- said he would let us know once he has the billing thing resolved. i don't think he's popped back in to say it is yet | 17:03 |
| clarkb | oh I had read the earlier message as it should be resolved for some reason, thank you for clarifying | 17:04 |
| clarkb | dmsimard: that sounds nice. Considering I worked all last weekend I may try to do similar if I can get caught up to a reasonably spot today | 17:04 |
| *** rkukura has quit IRC | 17:07 | |
| *** rkukura has joined #openstack-infra | 17:08 | |
| *** chkumar246 has joined #openstack-infra | 17:09 | |
| *** chandankumar has quit IRC | 17:10 | |
| *** gfidente has quit IRC | 17:10 | |
| *** gfidente has joined #openstack-infra | 17:11 | |
| *** gfidente has joined #openstack-infra | 17:11 | |
| *** gfidente has quit IRC | 17:11 | |
| fungi | yeah, i'm similarly prepping for friends who arrive tonight and are staying through the weekend | 17:12 |
| *** chkumar246 has quit IRC | 17:14 | |
| *** danpawlik has joined #openstack-infra | 17:14 | |
| *** ldnunes has quit IRC | 17:14 | |
| *** david-lyle has quit IRC | 17:15 | |
| *** dtantsur is now known as dtantsur|afk | 17:15 | |
| *** Goneri has joined #openstack-infra | 17:17 | |
| *** trown|lunch is now known as trown | 17:17 | |
| *** salv-orlando has joined #openstack-infra | 17:18 | |
| ssbarnea | clarkb: no way, i have no control over gerrithub.io, i was curious if gerrit-review could make a test/check attempt, before doing the real push. but if gerrit does not supports this we are out of luck. | 17:18 |
| *** ralonsoh has quit IRC | 17:19 | |
| *** danpawlik has quit IRC | 17:19 | |
| clarkb | ssbarnea: I think ideally we would avoid adding that to git-review. However you might be able to make it a commit hookin your git | 17:20 |
| fungi | maybe git-review could be extended to retrieve additional commit hooks recommended (somehow) by a repo? | 17:21 |
| ssbarnea | clarkb: i don't want to touch these hooks, got me more troubles than preventing them. | 17:21 |
| *** salv-orlando has quit IRC | 17:22 | |
| pabelanger | okay, ubuntu-bionic DIB just finished building | 17:25 |
| clarkb | pabelanger: did that include the dns fix? | 17:26 |
| pabelanger | clarkb: checking | 17:26 |
| *** chkumar246 has joined #openstack-infra | 17:27 | |
| pabelanger | clarkb: no, looks like it missed it | 17:27 |
| pabelanger | I'll rebuild the images here once nodepool-builder is caught up | 17:27 |
| *** ldnunes has joined #openstack-infra | 17:28 | |
| *** felipemonteiro__ has joined #openstack-infra | 17:30 | |
| *** yamamoto has joined #openstack-infra | 17:30 | |
| *** eernst has quit IRC | 17:31 | |
| *** eernst has joined #openstack-infra | 17:31 | |
| clarkb | ssbarnea: fungi my concern with putting it into git-review is there are laready at least 2 places you can solve this problem (gerrit and the git commit hook) adding another would potentially be confusing. If we do add teh feature we should be careful to avoid the bug that https://review.openstack.org/#/c/554730/ fixes | 17:31 |
| *** felipemonteiro_ has quit IRC | 17:34 | |
| ssbarnea | clarkb: true. forget about my question. | 17:34 |
| *** yamamoto has quit IRC | 17:37 | |
| dmsimard | pabelanger: is there any dns testing going on in base-test right now ? | 17:39 |
| dmsimard | pabelanger: seeing failures unrelated to the stuff I'm testing http://logs.openstack.org/63/553663/3/check/openstack-infra-base-integration-ubuntu-xenial/a659871/ara/result/751483dd-2e6b-4ebd-addf-7ce5d91b19c9/ | 17:39 |
| dmsimard | from http://logs.openstack.org/63/553663/3/check/openstack-infra-base-integration-ubuntu-xenial/a659871/ara/file/d1145b73-c7ac-42f6-8a84-75128be79da6/#line-22 | 17:40 |
| dmsimard | (It's actually failing every job: https://review.openstack.org/#/c/553663/ ) | 17:40 |
| pabelanger | dmsimard: only DNS issue I know of is on bionic | 17:40 |
| dmsimard | pabelanger: it's not so much a DNS issue as it is a regression of a role that's integration tested | 17:41 |
| dmsimard | unless it's a regression in the test(s) themselves which is not out of the question either | 17:41 |
| pabelanger | oh, did we miss something? | 17:41 |
| dmsimard | pabelanger: I was trying to test the ara sqlite middleware stuff and the new role, not sure yet | 17:42 |
| *** armaan has quit IRC | 17:42 | |
| *** armaan has joined #openstack-infra | 17:43 | |
| pabelanger | dmsimard: looks like you are configuring unbound twice | 17:43 |
| dmsimard | pabelanger: oh, I know what's happening now. | 17:44 |
| dmsimard | Those jobs are meant to run against base-minimal, not base-test | 17:44 |
| pabelanger | yah | 17:44 |
| dmsimard | because some of the base roles are tested so my test patch has them run twice | 17:44 |
| dmsimard | good catch | 17:44 |
| dmsimard | ok, I'll hack something up just for the sake of testing the role, thanks | 17:44 |
| pabelanger | guess we need to make the testing idempotent there, regardless how many times your run a role | 17:45 |
| *** germs has joined #openstack-infra | 17:45 | |
| *** germs has quit IRC | 17:45 | |
| *** germs has joined #openstack-infra | 17:45 | |
| *** germs has quit IRC | 17:45 | |
| dmsimard | yeah we should be testing idempotency indeed | 17:45 |
| *** danpawlik has joined #openstack-infra | 17:46 | |
| *** germs has joined #openstack-infra | 17:46 | |
| *** germs has quit IRC | 17:46 | |
| *** germs has joined #openstack-infra | 17:46 | |
| dmsimard | we can add that to the bucket list :) | 17:47 |
| dmsimard | well it turns out the new ara-report role had been running for a while already with base-test | 17:48 |
| dmsimard | https://i.imgur.com/TMVSQO1.png | 17:49 |
| dmsimard | so I guess the defaults are correctly mirroring the current defaults we have in base | 17:50 |
| dmsimard | so I'll test the parameters to switch that over to the middleware now. | 17:50 |
| *** jamesmcarthur has quit IRC | 17:50 | |
| *** danpawlik has quit IRC | 17:51 | |
| *** r-daneel_ has joined #openstack-infra | 17:51 | |
| *** r-daneel has quit IRC | 17:52 | |
| *** r-daneel_ is now known as r-daneel | 17:52 | |
| openstackgerrit | David Moreau Simard proposed openstack-infra/openstack-zuul-jobs master: Do not merge: test ara-report parameters https://review.openstack.org/553663 | 17:52 |
| *** dprince has quit IRC | 17:55 | |
| *** dprince has joined #openstack-infra | 17:55 | |
| *** dhajare_ has joined #openstack-infra | 17:55 | |
| *** r-daneel has quit IRC | 17:56 | |
| *** r-daneel has joined #openstack-infra | 17:57 | |
| *** iyamahat has joined #openstack-infra | 17:57 | |
| dmsimard | fungi, clarkb, pabelanger: I always get a bit confused regarding the "PTI" standards. Is it expected that base jobs like py27/py35/pep8/docs always be defined in project-config rather than in-tree in projects ? | 17:58 |
| dmsimard | (It's for ARA which in theory is not subject to PTI but asking anyway) | 17:58 |
| clarkb | dmsimard: I think we've decided its ok for projects to define them in tree as long as they follow the PTI | 17:58 |
| dmsimard | ok so in practice, project-config is there to enforce the system-required template | 17:59 |
| dmsimard | (at a bare minimum, I mean) | 17:59 |
| fungi | we're also supposed to be able to get rid of the system-required template. it's empty (i think) and zuul grew a way to add implicit jobs | 18:00 |
| fungi | or maybe that didn't merge yet... i haven't kept close tabs on it | 18:00 |
| fungi | dmsimard: also, ara isn't required to follow the pti. that's an official openstack deliverables requirement, but entirely voluntary for unofficial projects | 18:01 |
| dmsimard | fungi: I know that ara isn't expected to follow the PTI but if it can without being a burden, why not? :D | 18:01 |
| *** harlowja has joined #openstack-infra | 18:01 | |
| dmsimard | something something being a good citizen of the community | 18:02 |
| fungi | sure, just pointing out that if it's a burden, you should consider whatever option is most convenient | 18:02 |
| fungi | don't feel held to openstack-specific standards | 18:02 |
| dmsimard | So you mean I don't need any of that unit test and pep8 nonsense? :P | 18:04 |
| dmsimard | OpenStack standards are high and I like that :) | 18:04 |
| *** david-lyle has joined #openstack-infra | 18:05 | |
| fungi | what i'm saying is if it's not an openstack project, make decisions based on what makes the most sense for that project. it may be entirely reasonable to not run pep8/flake8 if your style choices conflict with what it demands, for example | 18:06 |
| dmsimard | sure | 18:08 |
| *** HeOS has quit IRC | 18:09 | |
| pabelanger | hmm, I am not seeing API requests in nodepool-builder logs | 18:12 |
| pabelanger | I think our loggers section might no longer be correct | 18:12 |
| *** panda is now known as panda|off | 18:13 | |
| *** danpawlik has joined #openstack-infra | 18:17 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/nodepool master: Reduce logging in _cleanupCurrentProviderUploads function https://review.openstack.org/557791 | 18:17 |
| *** salv-orlando has joined #openstack-infra | 18:18 | |
| clarkb | pabelanger: I think we disable the full python requests logging by default | 18:19 |
| clarkb | pabelanger: so you get the shade level summaries | 18:19 |
| *** dhajare_ has quit IRC | 18:19 | |
| dmsimard | clarkb: http://logs.openstack.org/63/553663/4/check/openstack-infra-base-integration-ubuntu-trusty/d846e56/ara-report/ | 18:20 |
| dmsimard | http://logs-dev.openstack.org/63/553663/4/check/openstack-infra-base-integration-ubuntu-trusty/d846e56/ara-report/ | 18:20 |
| dmsimard | logs vs logs-dev | 18:20 |
| dmsimard | infra-root ^ | 18:20 |
| clarkb | nice! | 18:20 |
| clarkb | http://logs-dev.openstack.org/63/553663/4/check/openstack-infra-base-integration-ubuntu-trusty/d846e56/ara-report/file/3c4e9d79-0da8-41dd-a69b-6167e1295845/#line-22 deep linking works too | 18:21 |
| pabelanger | clarkb: hmm, Id expect http://git.openstack.org/cgit/openstack-infra/puppet-nodepool/tree/templates/nodepool-builder.logging.conf.erb | 18:21 |
| clarkb | dmsimard: time to ship it to production? | 18:21 |
| pabelanger | but that isn't on nb01, trying to see why | 18:21 |
| dmsimard | clarkb: yeah everything should work but I'll poke around | 18:21 |
| pabelanger | dmsimard: cool | 18:21 |
| dmsimard | clarkb: I got an "ara bootstrap failure" when clicking on a file link but the second time it worked.. I'll investigate | 18:22 |
| clarkb | dmsimard: performance seems to be good too, I bet it helps the fs doesn't have to read a bunch of files and can cache this single db | 18:22 |
| clarkb | dmsimard: also how large are these files? | 18:22 |
| pabelanger | dmsimard: what is somebody wanted to download the database locally? | 18:22 |
| clarkb | oh only 172k? winning | 18:22 |
| pabelanger | http://logs-dev.openstack.org/63/553663/4/check/openstack-infra-base-integration-ubuntu-trusty/d846e56/ara-report/ansible.sqlite doesnt' seem to work | 18:22 |
| *** danpawlik has quit IRC | 18:22 | |
| pabelanger | but looks cool otherwise | 18:22 |
| dmsimard | clarkb: there's a diff/delta with a fairly large report documeted here: https://ara.readthedocs.io/en/latest/advanced.html | 18:23 |
| *** salv-orlando has quit IRC | 18:23 | |
| clarkb | pabelanger: dmsimard for downloading we can inspect the client headers maybe | 18:23 |
| clarkb | hrm though then you'd have to use curl and not firefox | 18:23 |
| clarkb | maybe just use a second path that is a rewrite that avoids the middleware | 18:23 |
| pabelanger | yah, rewrite rule for direct access seems fine | 18:24 |
| dmsimard | sure, I can try something out. Okay to put logs.o.o in emergency file to iterate on logs-dev rewrite rules ? | 18:24 |
| dmsimard | I 100% never get rewrite rules right the first time | 18:25 |
| clarkb | dmsimard: ya I think so, just don't forget to cleanup after :) | 18:25 |
| pabelanger | wfm | 18:25 |
| dmsimard | this would be.... static.o.o right ? | 18:25 |
| clarkb | also general note to the channel I've sent and email to the infra list with a recap of the cross community infra/ci/cd event from last weekend | 18:25 |
| clarkb | dmsimard: yes, you can check dns to confirm `dig logs.openstack.org` should cname static.o.o | 18:26 |
| pabelanger | dmsimard: clarkb: btw, we still need to land https://review.openstack.org/555790/ to launch review01.o.o server, think we can do that today | 18:26 |
| dmsimard | clarkb: from the pictures I've seen it looks like we've missed out on a bunch of fun :P | 18:27 |
| clarkb | pabelanger: I've +2'd but not approved as I did leave a comment that you should read before merging | 18:28 |
| pabelanger | k | 18:28 |
| clarkb | pabelanger: but feel free to decide its not worth doing and approve as is | 18:29 |
| *** camunoz has quit IRC | 18:29 | |
| pabelanger | clarkb: yah, left it out to be safe not to update review.o.o | 18:31 |
| pabelanger | but once we remove the server, I think your changes should be made | 18:31 |
| *** tesseract has quit IRC | 18:31 | |
| clarkb | ok fine by me then | 18:31 |
| pabelanger | great, will +3 | 18:31 |
| *** iyamahat has quit IRC | 18:33 | |
| *** yamamoto has joined #openstack-infra | 18:33 | |
| dmsimard | clarkb: thanks for sharing those notes | 18:34 |
| dmsimard | Was there anyone involved in OpenShift in there ? Just curious because openshift.io is basically CI/CD as a service. | 18:35 |
| fungi | interesting. i assumed openshift was just a contanier-based cloud platform | 18:36 |
| *** sshnaidm has joined #openstack-infra | 18:37 | |
| dmsimard | openshift is basically k8s with some nice things on top | 18:37 |
| fungi | yep, that matches what i recall then | 18:38 |
| dmsimard | openshift.io leverages openshift for containers/registry/workloads but they also have jenkins integration and eclipse che (collaborative code editor in your browser) | 18:38 |
| fungi | or at least the current iteration (seems like the "shift" in the name is appropriate as it's been at least three different things that i remember over the years) | 18:38 |
| dmsimard | under the premise that you can develop, test and ship your app from this single platform | 18:38 |
| *** yamamoto has quit IRC | 18:38 | |
| fungi | got it. so openshift.io != openshift.com | 18:39 |
| dmsimard | https://openshift.io/features.html | 18:39 |
| dmsimard | yeah there's different offerings of openshift, like either hosted/operated by red hat on you can also host your own -- openshift.io is kind of like a SaaS offering of different things mixed together as a platform to ship things | 18:40 |
| *** rmcall has joined #openstack-infra | 18:40 | |
| dmsimard | was announced at the last red hat summit, I suppose it's still not general availability yet | 18:40 |
| *** priteau has quit IRC | 18:40 | |
| clarkb | dmsimard: not that I know of | 18:41 |
| dmsimard | clarkb: ok, I'll reach out to someone I know and tell them about it -- they might be interested by what's in there | 18:42 |
| clarkb | dmsimard: there were quite a few red hatters so it is possible but I don't recall anyone identifying as redhat + openshift | 18:42 |
| *** gouthamr has joined #openstack-infra | 18:43 | |
| *** esberglu has quit IRC | 18:43 | |
| *** camunoz has joined #openstack-infra | 18:46 | |
| openstackgerrit | Merged openstack-infra/system-config master: Create review group for hieradata https://review.openstack.org/555790 | 18:48 |
| *** e0ne has joined #openstack-infra | 18:49 | |
| *** jamesmcarthur has joined #openstack-infra | 18:49 | |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/storyboard master: Increase unit test job timeout to an hour https://review.openstack.org/557801 | 18:50 |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/project-config master: Remove python job templates for storyboard https://review.openstack.org/557802 | 18:50 |
| openstackgerrit | Brian Rosmaita proposed openstack-infra/openstack-zuul-jobs master: Remove glance legacy job https://review.openstack.org/526952 | 18:51 |
| *** claudiub has quit IRC | 18:53 | |
| *** rkukura has quit IRC | 18:53 | |
| *** danpawlik has joined #openstack-infra | 18:53 | |
| *** danpawlik has quit IRC | 18:59 | |
| *** eernst has quit IRC | 19:00 | |
| openstackgerrit | Tobias Henkel proposed openstack-infra/nodepool master: Reduce logging in _cleanupCurrentProviderUploads function https://review.openstack.org/557791 | 19:00 |
| *** salv-orlando has joined #openstack-infra | 19:03 | |
| *** iranzo has joined #openstack-infra | 19:07 | |
| *** jamesmca_ has joined #openstack-infra | 19:11 | |
| *** eernst has joined #openstack-infra | 19:12 | |
| *** jamesmcarthur has quit IRC | 19:14 | |
| *** r-daneel_ has joined #openstack-infra | 19:14 | |
| *** eernst has quit IRC | 19:15 | |
| *** eernst_ has joined #openstack-infra | 19:15 | |
| *** r-daneel has quit IRC | 19:16 | |
| *** r-daneel_ is now known as r-daneel | 19:16 | |
| *** nhandler has quit IRC | 19:18 | |
| dmsimard | clarkb, pabelanger: looks like I got the ansible.sqlite thing. | 19:21 |
| dmsimard | http://logs-dev.openstack.org/63/553663/4/check/openstack-infra-base-integration-ubuntu-trusty/d846e56/ara-report/ vs http://logs-dev.openstack.org/63/553663/4/check/openstack-infra-base-integration-ubuntu-trusty/d846e56/ara-report/ansible.sqlite | 19:22 |
| clarkb | dmsimard: yup seems to work | 19:22 |
| dmsimard | I'll send a patch. | 19:22 |
| *** olaph1 has joined #openstack-infra | 19:25 | |
| pabelanger | yah, wfm | 19:25 |
| *** olaph has quit IRC | 19:26 | |
| *** iranzo has quit IRC | 19:26 | |
| *** weshay is now known as weshay_brb | 19:30 | |
| *** weshay_brb is now known as weshay | 19:31 | |
| *** immune2iocane has left #openstack-infra | 19:31 | |
| *** dbecker has quit IRC | 19:31 | |
| *** dbecker has joined #openstack-infra | 19:32 | |
| *** danpawlik has joined #openstack-infra | 19:33 | |
| dmsimard | I'll prepare an email for openstack-dev to tell people about the upcoming changes for ara reports | 19:33 |
| *** rkukura has joined #openstack-infra | 19:33 | |
| *** camunoz has quit IRC | 19:34 | |
| *** salv-orlando has quit IRC | 19:34 | |
| *** salv-orlando has joined #openstack-infra | 19:35 | |
| *** yamamoto has joined #openstack-infra | 19:35 | |
| openstackgerrit | Merged openstack-infra/nodepool master: Add reno releasenotes support https://review.openstack.org/536861 | 19:36 |
| openstackgerrit | David Moreau Simard proposed openstack-infra/puppet-openstackci master: Don't redirect/rewrite direct requests to the ARA database https://review.openstack.org/557815 | 19:37 |
| openstackgerrit | David Moreau Simard proposed openstack-infra/puppet-openstackci master: Promote /ara-report/ middleware redirection to logs.openstack.org https://review.openstack.org/557816 | 19:37 |
| *** danpawlik has quit IRC | 19:38 | |
| *** salv-orlando has quit IRC | 19:39 | |
| *** yamamoto has quit IRC | 19:40 | |
| *** florianf has quit IRC | 19:40 | |
| *** salv-orlando has joined #openstack-infra | 19:43 | |
| *** gouthamr has quit IRC | 19:44 | |
| clarkb | #status log Clarkb has added zxiiro to the python-jenkins-core and release groups. ssbarnea and waynr added to the python-jenkins-core group after mailing list thread did not lead to any objections. I will let them coordinate and decide if other individuals are appropriate to add to python-jenkins-core | 19:45 |
| openstackstatus | clarkb: finished logging | 19:45 |
| *** eharney has quit IRC | 19:45 | |
| clarkb | note I spoke to zxiiro in LA and sounded like this was fairly important so didn't want to let that thread drag out any longer | 19:45 |
| zxiiro | clarkb: ack. Thanks! | 19:46 |
| clarkb | zxiiro: I've also responded to the ml so that everyone can see the update with the original discussion | 19:48 |
| ssbarnea | clarkb: thanks! | 19:50 |
| *** jamesmca_ has quit IRC | 19:52 | |
| ssbarnea | unrelated, did any of you had time to check http://mitogen.readthedocs.io/en/latest/ansible.html ? -- I gave it a try two hours ago and it did run 4x faster a 60 tasks playbook :D | 19:53 |
| openstackgerrit | David Moreau Simard proposed openstack-infra/project-config master: Promote ara-report role and ARA middleware to base-[minimal,test] https://review.openstack.org/557817 | 19:54 |
| *** jamesmcarthur has joined #openstack-infra | 19:54 | |
| *** olaph has joined #openstack-infra | 19:54 | |
| clarkb | ssbarnea: ya I briefly looked at it. Its basically fork over the wire | 19:54 |
| clarkb | whcih is cool and probably worth investigating further | 19:54 |
| ssbarnea | clarkb: i bet i was lucky to get is working in the first attempt, but made me curious to see where it breaks. | 19:55 |
| *** olaph1 has quit IRC | 19:55 | |
| openstackgerrit | David Moreau Simard proposed openstack-infra/project-config master: Promote new ara-report role and ARA middleware to base job https://review.openstack.org/557818 | 19:56 |
| *** jamesmcarthur has quit IRC | 19:59 | |
| *** hashar is now known as quibble | 19:59 | |
| *** jamesmcarthur has joined #openstack-infra | 20:00 | |
| *** nhandler has joined #openstack-infra | 20:02 | |
| *** agopi has quit IRC | 20:03 | |
| *** jamesmcarthur has quit IRC | 20:04 | |
| openstackgerrit | Merged openstack-infra/zuul master: Use reno for release notes https://review.openstack.org/262597 | 20:07 |
| clarkb | dmsimard: https://review.openstack.org/#/c/557815/1 has a comment | 20:07 |
| dmsimard | clarkb: I don't follow -- you mean an end of line declaration ? | 20:08 |
| clarkb | dmsimard: ya $ wont match the ansible.sqlite either | 20:09 |
| clarkb | says stop here | 20:09 |
| dmsimard | clarkb: it's actually important to match stuff after ara-report | 20:10 |
| dmsimard | clarkb: so it gets routed back to the wsgi app | 20:10 |
| dmsimard | but I can do something like ^.*/ara-report(?!/ansible.sqlite).*$ or something like that | 20:11 |
| clarkb | isnt the only thing there the sqlite file? | 20:12 |
| clarkb | what else would be in that dir? | 20:12 |
| *** danpawlik has joined #openstack-infra | 20:12 | |
| *** danpawlik has quit IRC | 20:18 | |
| *** agopi has joined #openstack-infra | 20:19 | |
| dmsimard | clarkb: the urls need to be routed back to the wsgi app | 20:25 |
| dmsimard | like http://logs-dev.openstack.org/63/553663/4/check/openstack-infra-base-integration-ubuntu-trusty/d846e56/ara-report/result/a7c31cc1-4166-4978-80e6-33568aa9e859/ | 20:25 |
| dmsimard | >> result/a7c31cc1-4166-4978-80e6-33568aa9e859/ | 20:25 |
| clarkb | dmsimard: oh right | 20:25 |
| clarkb | dmsimard: in that case your change is probably fine as is I'll update my review | 20:26 |
| dmsimard | there's no real files there, it's just a matter of needing to send that request to the app | 20:26 |
| clarkb | ya that was the piece my brain wasn't making the conenction too | 20:26 |
| dmsimard | with the exception of ansible.sqlite of course | 20:26 |
| clarkb | right | 20:27 |
| *** HeOS has joined #openstack-infra | 20:27 | |
| *** agopi has quit IRC | 20:28 | |
| *** agopi has joined #openstack-infra | 20:29 | |
| pabelanger | clarkb: dmsimard: +3 | 20:29 |
| pabelanger | what is the next step to move that to logs.o.o? Set a flag? | 20:29 |
| dmsimard | there's a string of patches with the ara-sqlite-middleware topic: https://review.openstack.org/#/q/topic:ara-sqlite-middleware | 20:30 |
| clarkb | pabelanger: there is a set of changes above. I'm getting through them slowly | 20:30 |
| dmsimard | for logs.o.o it's just a vhost change | 20:30 |
| clarkb | https://review.openstack.org/#/c/557816/ next | 20:30 |
| pabelanger | k, let me get coffee and review too | 20:31 |
| *** hemna_ has joined #openstack-infra | 20:31 | |
| openstackgerrit | David Moreau Simard proposed openstack-infra/zuul-jobs master: Deprecate the emit-ara-html role https://review.openstack.org/557824 | 20:32 |
| *** trown is now known as trown|outtypewww | 20:32 | |
| clarkb | dmsimard: stack lgtm I've +2'd all that I Think are necessary to update logs.o.o and our base jobs | 20:34 |
| dmsimard | clarkb: I already have patches up for that too ? | 20:34 |
| clarkb | dmsimard: ya I mean I've reviewed all of those ones | 20:35 |
| *** kgiusti has left #openstack-infra | 20:35 | |
| clarkb | but not the deprecation or do not merge test change | 20:35 |
| dmsimard | oh | 20:35 |
| dmsimard | right | 20:35 |
| dmsimard | sorry, I misread that | 20:35 |
| clarkb | my typing was also bad with the T in the middle breaking the sentence up | 20:36 |
| dmsimard | yeah I thought it was a question or something | 20:36 |
| dmsimard | no worries | 20:36 |
| *** yamamoto has joined #openstack-infra | 20:37 | |
| pabelanger | dmsimard: clarkb: I +2'd too, so +A when you are ready to roll them out | 20:38 |
| clarkb | pabelanger: dmsimard I think its safe to go ahead and approve the logs.o.o vhost update | 20:39 |
| clarkb | then we can verify it is in place and approve the job changes | 20:39 |
| dmsimard | yeah everything except the base job update is fair game | 20:39 |
| dmsimard | the base-minimal and base-test update should go in so we can make sure it's all good and then we can update base | 20:39 |
| dmsimard | I'm still working on the email to openstack-dev/zuul-announce right now though | 20:39 |
| *** tosky__ has joined #openstack-infra | 20:40 | |
| clarkb | sounds like a plan I'll approve the vhost change now | 20:40 |
| pabelanger | ++ | 20:40 |
| *** tosky has quit IRC | 20:40 | |
| *** yamamoto has quit IRC | 20:42 | |
| *** anticw has left #openstack-infra | 20:44 | |
| *** ykarel is now known as ykarel|away | 20:45 | |
| *** VW has joined #openstack-infra | 20:46 | |
| *** edmondsw has quit IRC | 20:47 | |
| openstackgerrit | Mike Fedosin proposed openstack-infra/zuul master: Set default speed_limit and speed_time for the merger https://review.openstack.org/557826 | 20:47 |
| openstackgerrit | Merged openstack-infra/puppet-openstackci master: Don't redirect/rewrite direct requests to the ARA database https://review.openstack.org/557815 | 20:47 |
| *** edmondsw has joined #openstack-infra | 20:47 | |
| *** danpawlik has joined #openstack-infra | 20:48 | |
| *** hamzy has quit IRC | 20:50 | |
| pabelanger | clarkb: ubuntu-bionic dib finally rebuilt, with DNS changes | 20:50 |
| pabelanger | uploading now | 20:51 |
| *** edmondsw has quit IRC | 20:52 | |
| *** danpawlik has quit IRC | 20:53 | |
| *** VW has quit IRC | 20:54 | |
| *** esberglu has joined #openstack-infra | 20:55 | |
| *** quibble has quit IRC | 20:56 | |
| openstackgerrit | Merged openstack-infra/puppet-openstackci master: Promote /ara-report/ middleware redirection to logs.openstack.org https://review.openstack.org/557816 | 20:58 |
| *** esberglu has quit IRC | 21:00 | |
| clarkb | dmsimard: pabelanger I'm watching puppet run all log to see when ^ goes in then I'll approve the base-test/minimal update | 21:03 |
| dmsimard | I suppose I should remove static.o.o from the emergency file :) | 21:03 |
| * dmsimard does that | 21:03 | |
| dmsimard | done | 21:03 |
| openstackgerrit | Colleen Murphy proposed openstack-infra/openstack-zuul-jobs master: [debug]Convert infra-puppet-apply jobs to non-legacy https://review.openstack.org/557011 | 21:05 |
| *** dsariel has joined #openstack-infra | 21:05 | |
| anteaya | pabelanger, I like the name Stein, thank you for conducting the naming poll | 21:09 |
| pabelanger | anteaya: thanks, was a fun task | 21:10 |
| anteaya | glad you enjoyed it :) | 21:10 |
| * mtreinish hopes the summit swag in berlin is an openstack stein | 21:10 | |
| anteaya | ha ha ha | 21:11 |
| anteaya | but how to pack it for the jouney home? | 21:11 |
| *** rmcall has quit IRC | 21:12 | |
| *** iyamahat has joined #openstack-infra | 21:12 | |
| *** esberglu has joined #openstack-infra | 21:17 | |
| *** rwsu has quit IRC | 21:17 | |
| *** olaph has quit IRC | 21:18 | |
| *** olaph has joined #openstack-infra | 21:19 | |
| *** ldnunes has quit IRC | 21:19 | |
| *** danpawlik has joined #openstack-infra | 21:19 | |
| openstackgerrit | Colleen Murphy proposed openstack-infra/openstack-zuul-jobs master: [debug]Convert infra-puppet-apply jobs to non-legacy https://review.openstack.org/557011 | 21:21 |
| *** rfolco|ruck is now known as rfolco|off | 21:22 | |
| *** esberglu has quit IRC | 21:22 | |
| *** esberglu has joined #openstack-infra | 21:23 | |
| *** danpawlik has quit IRC | 21:23 | |
| *** esberglu has quit IRC | 21:28 | |
| *** inc0 has quit IRC | 21:29 | |
| clarkb | ok ara middleware is in place on logs.o.o vhost. I'm gonna approve the base-minimal and base-test updates | 21:30 |
| clarkb | dmsimard: pabelanger ^ fyi that has been done | 21:32 |
| mtreinish | ooh, the test_runs table in the subunit2sql db has 466990544 rows in it. That's a lot of tests | 21:32 |
| *** iyamahat has quit IRC | 21:32 | |
| *** jamesmcarthur has joined #openstack-infra | 21:32 | |
| *** Bonjourm8 has joined #openstack-infra | 21:33 | |
| clarkb | mtreinish: half a billion tests you say | 21:33 |
| mtreinish | yeah, the count query took ~5min: http://paste.openstack.org/show/717967/ | 21:34 |
| mtreinish | err, ~6min | 21:34 |
| *** HeOS has quit IRC | 21:35 | |
| *** felipemonteiro__ has quit IRC | 21:37 | |
| *** yamamoto has joined #openstack-infra | 21:38 | |
| *** yamahata has joined #openstack-infra | 21:39 | |
| clarkb | pabelanger: dmsimard what changes can we recheck to test the base-minimal and base-test results before we update the main base job? | 21:40 |
| dmsimard | clarkb: I'll use the same change we had, sec | 21:41 |
| openstackgerrit | Merged openstack-infra/project-config master: Promote ara-report role and ARA middleware to base-[minimal,test] https://review.openstack.org/557817 | 21:41 |
| clarkb | dmsimard: ^ its ready for you when you are | 21:41 |
| pabelanger | +1 | 21:42 |
| openstackgerrit | David Moreau Simard proposed openstack-infra/openstack-zuul-jobs master: Do not merge: test ara-report with base-minimal/base-test https://review.openstack.org/553663 | 21:42 |
| dmsimard | clarkb, pabelanger: ^ | 21:42 |
| *** yamamoto has quit IRC | 21:44 | |
| *** tosky__ has quit IRC | 21:49 | |
| *** dprince has quit IRC | 21:49 | |
| *** agopi has quit IRC | 21:50 | |
| *** tosky__ has joined #openstack-infra | 21:52 | |
| pabelanger | http://logs.openstack.org/63/553663/5/check/openstack-infra-multinode-integration-centos-7/987d4aa/ara-report/ | 21:53 |
| dmsimard | oh no, gerrit is following me on twitter now | 21:53 |
| pabelanger | seems to work | 21:53 |
| dmsimard | what have I done | 21:53 |
| pabelanger | clarkb: dmsimard: ^ | 21:53 |
| pabelanger | well, ara-report worked but playbook failed | 21:53 |
| dmsimard | yeah it's normal that it fails, like we discussed earlier the double execution thing | 21:54 |
| pabelanger | yup | 21:54 |
| clarkb | we good to push it everywhere then? | 21:55 |
| pabelanger | dmsimard: and can't remember is there any caching when ara-report is loaded? I'm guessing it is all dynamic each time I refresh | 21:55 |
| pabelanger | clarkb: yah, think so | 21:55 |
| dmsimard | need to check a single node too | 21:55 |
| dmsimard | first | 21:55 |
| dmsimard | I made it so multinode was base-minimal and single node base-test | 21:55 |
| pabelanger | http://logs.openstack.org/63/553663/5/check/openstack-infra-base-integration-ubuntu-bionic/f42b444/ara-report/ | 21:56 |
| clarkb | pabelanger: os will cache the file | 21:56 |
| pabelanger | is green across board | 21:56 |
| *** danpawlik has joined #openstack-infra | 21:56 | |
| dmsimard | pabelanger: I suppose there is apache and browser caching of the static components, not sure about the rest | 21:56 |
| dmsimard | Should be loaded dynamically | 21:56 |
| pabelanger | clarkb: unsure, does seem to take a bit to reload on refresh | 21:56 |
| pabelanger | yah | 21:56 |
| pabelanger | nothing major | 21:56 |
| dmsimard | There's an initial bootstrap cost | 21:56 |
| pabelanger | yah, guess we track that via cacti.o.o and see if there is impact | 21:57 |
| dmsimard | All things considered, the middleware is fairly simple and definitely open to suggestions if there's any improvements: http://git.openstack.org/cgit/openstack/ara/tree/ara/wsgi_sqlite.py | 21:57 |
| dmsimard | What I just thought about though, is that we should probably try and make sure those aren't indexed by silly robots | 21:58 |
| *** jamesmcarthur has quit IRC | 21:58 | |
| dmsimard | (If we're not doing so already) | 21:58 |
| clarkb | pretty sure they arent | 21:58 |
| dmsimard | cool | 21:58 |
| clarkb | because the file structure makes big listings painful | 21:58 |
| pabelanger | http://logs.openstack.org/robots.txt | 21:59 |
| dmsimard | I'll go finish my openstack-dev email then | 21:59 |
| *** danpawlik has quit IRC | 22:00 | |
| clarkb | dmsimard: you want to hit approve when ready too? | 22:01 |
| dmsimard | sure | 22:01 |
| dmsimard | let me finish that email :) | 22:01 |
| *** Goneri has quit IRC | 22:03 | |
| clarkb | dmsimard: oh one last thing that just occured to me, we don't store the old reports in ara-report so they will keep working right? | 22:03 |
| dmsimard | clarkb: <root>/ara will keep working as usual, <root>/ara-report (and .*/ara-report, actually) will use the middleware | 22:04 |
| dmsimard | the ara-report role default settings generates the html report in the "ara" directory | 22:04 |
| dmsimard | fwiw the zuul-announce draft: https://etherpad.openstack.org/p/GEOCeAuKhU | 22:05 |
| clarkb | perfect | 22:05 |
| pabelanger | ugh | 22:06 |
| pabelanger | lrwxrwxrwx 1 root root 39 Mar 29 20:11 resolv.conf -> ../run/systemd/resolve/stub-resolv.conf | 22:06 |
| pabelanger | that is bionic | 22:06 |
| pabelanger | and when we stop systemd-resolved from starting on boot, you guessed it ../run/systemd/resolve/stub-resolv.conf doesn't exist | 22:06 |
| pabelanger | sigh | 22:07 |
| pabelanger | clarkb: ^ | 22:07 |
| clarkb | don't we explicitly write out resolv.conf to be something else though? | 22:07 |
| pabelanger | yes | 22:07 |
| openstackgerrit | Merged openstack-infra/irc-meetings master: Add general intro about IRC + channel list https://review.openstack.org/557745 | 22:07 |
| pabelanger | it is looks to be overwritten | 22:07 |
| pabelanger | will need to see how that symlink is setup | 22:07 |
| pabelanger | but, DNS does work | 22:07 |
| pabelanger | with proper nameserver | 22:08 |
| pabelanger | so not sure how that is getting setup ATM | 22:08 |
| clarkb | pabelanger: I wonder if that symlink is baked in then when we write 127.0.0.1 to /etc/resolv.conf its just following the symlink and writing there (or trying to write there) | 22:08 |
| clarkb | does > follow symlinks? | 22:09 |
| * clarkb tests | 22:09 | |
| clarkb | it does follow them | 22:09 |
| pabelanger | clarkb: to an empty file? | 22:10 |
| clarkb | pabelanger: I've only tested overwriting an existing file. Let me try a broken link | 22:10 |
| pabelanger | /run is tmpfs and empty on boot | 22:10 |
| pabelanger | but we also have rc.local, but not sure if that runs any more with systemd | 22:11 |
| clarkb | pabelanger: ya it will write to a broken symlink and make file on the other end | 22:11 |
| *** bobh has quit IRC | 22:11 | |
| clarkb | pabelanger: it must because it works on xenial and centos | 22:11 |
| clarkb | unless installing unbound there implicitly means use localhost | 22:11 |
| pabelanger | okay, so being tmpfs I think explains why it doesn't exist on bionic boot | 22:11 |
| pabelanger | clarkb: I think that might be happening | 22:12 |
| pabelanger | /etc/resolvconf/update.d/unbound | 22:12 |
| pabelanger | is a thing | 22:12 |
| clarkb | I think we can just remove the link then write the file | 22:12 |
| pabelanger | but, I should really see how the systemd way of setting nameserver to 127.0.0.1 is, maybe we can remove some code | 22:13 |
| *** inc0 has joined #openstack-infra | 22:13 | |
| clarkb | pabelanger: resolv.conf is the way | 22:13 |
| clarkb | pabelanger: thats why they are jumping through hoops here so they can manage it | 22:13 |
| pabelanger | clarkb: not sure any more, because it doesn't exist and DNS works | 22:13 |
| clarkb | pabelanger: how are you testing? | 22:14 |
| *** efoley has joined #openstack-infra | 22:14 | |
| clarkb | but ya I imagine the reason they symlink it like that is libc still looks for /etc/resolv.conf | 22:14 |
| *** dsariel has quit IRC | 22:14 | |
| dmsimard | sent openstack-dev email: http://lists.openstack.org/pipermail/openstack-dev/2018-March/128902.html | 22:14 |
| clarkb | but systemd wants to manage it | 22:14 |
| dmsimard | approving | 22:14 |
| *** bobh has joined #openstack-infra | 22:14 | |
| pabelanger | clarkb: ssh root@104.239.149.240 | 22:14 |
| *** salv-orlando has quit IRC | 22:15 | |
| pabelanger | see no /etc/resolv.conf | 22:15 |
| pabelanger | dig google.ca | 22:15 |
| pabelanger | or nslookup | 22:15 |
| *** salv-orlando has joined #openstack-infra | 22:15 | |
| *** e0ne has quit IRC | 22:16 | |
| clarkb | pabelanger: dig +trace seems to indicate it looks up against localhost implicitly? | 22:16 |
| pabelanger | yah | 22:16 |
| pabelanger | is that because unbound is doing that now | 22:16 |
| pabelanger | vi /etc/resolvconf ? | 22:17 |
| clarkb | ya could be. I think we should still make it explict. I'm hacking a quick patch | 22:17 |
| pabelanger | k | 22:17 |
| pabelanger | clarkb: that is live node, FYI | 22:18 |
| clarkb | pabelanger: ya I ssh'd into it | 22:18 |
| pabelanger | kk | 22:18 |
| clarkb | I'm not modifying the node | 22:18 |
| pabelanger | k | 22:18 |
| pabelanger | didn't want it to delete under you | 22:18 |
| *** salv-orlando has quit IRC | 22:19 | |
| *** edmondsw has joined #openstack-infra | 22:20 | |
| *** bobh has quit IRC | 22:20 | |
| openstackgerrit | Clark Boylan proposed openstack-infra/project-config master: Write resolv.conf safely during image build https://review.openstack.org/557842 | 22:21 |
| clarkb | pabelanger: something like ^ | 22:21 |
| clarkb | I think you can delete the node if you need to | 22:21 |
| pabelanger | k, will do to be safe | 22:22 |
| openstackgerrit | Merged openstack-infra/project-config master: Promote new ara-report role and ARA middleware to base job https://review.openstack.org/557818 | 22:24 |
| *** edmondsw has quit IRC | 22:25 | |
| pabelanger | clarkb: ah, reading http://manpages.ubuntu.com/manpages/bionic/man8/resolvconf.8.html This link is normally created on installation of the resolvconf package. | 22:25 |
| pabelanger | so think that is right | 22:25 |
| *** inc0_ has joined #openstack-infra | 22:26 | |
| dmsimard | pabelanger, clarkb: there's one last patch for ara https://review.openstack.org/#/c/557824/ | 22:26 |
| clarkb | pabelanger: would probably be a good one for ianw to weigh in on, but my personal take on it is we only ever want localhost resolver so lets just make that the case | 22:27 |
| *** inc0 has quit IRC | 22:27 | |
| *** danpawlik has joined #openstack-infra | 22:28 | |
| pabelanger | clarkb: left comment | 22:29 |
| pabelanger | dmsimard: +3 | 22:30 |
| clarkb | pabelanger: gotcha so remove the file during image build instead of boot | 22:31 |
| *** danpawlik has quit IRC | 22:33 | |
| pabelanger | yah | 22:33 |
| pabelanger | then follow up, we can maybe see about removing rc.local hack | 22:33 |
| pabelanger | but, not today | 22:33 |
| * clarkb moves things around | 22:34 | |
| *** hongbin has quit IRC | 22:34 | |
| *** yamahata has quit IRC | 22:35 | |
| dmsimard | EOD here, I'll check in a bit later to see if things are still under control for the middleware | 22:36 |
| openstackgerrit | Clark Boylan proposed openstack-infra/project-config master: Write resolv.conf safely during image build https://review.openstack.org/557842 | 22:38 |
| clarkb | pabelanger: ^ hows that | 22:38 |
| clarkb | dmsimard: cool, I'll keep an eye on it through the end of my day as well | 22:39 |
| *** ykarel|away has quit IRC | 22:39 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/project-config master: Add git timeout setting for diskimage-builder https://review.openstack.org/557845 | 22:39 |
| *** ykarel|away has joined #openstack-infra | 22:39 | |
| clarkb | http://logs.openstack.org/44/557844/1/check/openstack-tox-pep8/9028951/ara-report/ seems to be working there and we have ara on successful jobs once again | 22:39 |
| pabelanger | clarkb: wfm | 22:39 |
| *** yamamoto has joined #openstack-infra | 22:40 | |
| pabelanger | clarkb: corvus: ^maybe a way to help protect git HTTP task from hanging on nodepool-builders. | 22:40 |
| *** inc0_ has quit IRC | 22:41 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/project-config master: Add git timeout setting for nodepool-builder https://review.openstack.org/557845 | 22:41 |
| *** tpsilva has quit IRC | 22:41 | |
| pabelanger | confirmed, http://logs.openstack.org/24/557824/1/gate/openstack-zuul-jobs-linters/b6347b5/ara-report/ | 22:42 |
| pabelanger | ara looks working | 22:42 |
| pabelanger | dmsimard: great work | 22:42 |
| *** yamamoto has quit IRC | 22:45 | |
| openstackgerrit | Merged openstack-infra/zuul-jobs master: Deprecate the emit-ara-html role https://review.openstack.org/557824 | 22:48 |
| *** rkukura has quit IRC | 22:49 | |
| *** tosky__ has quit IRC | 22:51 | |
| clarkb | agreed! this should not only make our users happier (ara on all jobs once again) but simplify job uploads and filesystem demands. thank you dmsimard | 22:52 |
| *** r-daneel has quit IRC | 22:52 | |
| dmsimard | I only needed to sit down a day without being interrupted to wrap things up, this has been half finished for months.. sorry I didn't get around to it sooner :( | 22:53 |
| *** andreas_s has joined #openstack-infra | 22:53 | |
| *** andreas_s has quit IRC | 22:58 | |
| *** agopi has joined #openstack-infra | 22:59 | |
| *** jamesmcarthur has joined #openstack-infra | 23:00 | |
| *** danpawlik has joined #openstack-infra | 23:02 | |
| *** rwsu has joined #openstack-infra | 23:04 | |
| *** jamesmcarthur has quit IRC | 23:04 | |
| *** ykarel|away has quit IRC | 23:06 | |
| *** danpawlik has quit IRC | 23:07 | |
| *** olaph1 has joined #openstack-infra | 23:09 | |
| *** olaph has quit IRC | 23:10 | |
| *** pickle has quit IRC | 23:15 | |
| *** jamesmcarthur has joined #openstack-infra | 23:16 | |
| *** jamesmcarthur has quit IRC | 23:23 | |
| *** jamesmca_ has joined #openstack-infra | 23:24 | |
| *** Bonjourm8_ has joined #openstack-infra | 23:29 | |
| *** iyamahat has joined #openstack-infra | 23:32 | |
| *** Bonjourm8 has quit IRC | 23:32 | |
| *** andreas_s has joined #openstack-infra | 23:33 | |
| *** jroll has quit IRC | 23:37 | |
| *** andreas_s has quit IRC | 23:38 | |
| *** danpawlik has joined #openstack-infra | 23:40 | |
| *** caphrim007_ has joined #openstack-infra | 23:41 | |
| *** yamamoto has joined #openstack-infra | 23:41 | |
| *** caphrim007_ has quit IRC | 23:43 | |
| *** Bonjourm8_ has quit IRC | 23:43 | |
| *** caphrim007 has quit IRC | 23:44 | |
| *** Bonjourm8 has joined #openstack-infra | 23:44 | |
| *** danpawlik has quit IRC | 23:45 | |
| *** Bonjourm8 has quit IRC | 23:45 | |
| *** ediardo has joined #openstack-infra | 23:45 | |
| *** caphrim007 has joined #openstack-infra | 23:45 | |
| *** Bonjourm8 has joined #openstack-infra | 23:45 | |
| *** iyamahat has quit IRC | 23:45 | |
| *** bobh has joined #openstack-infra | 23:47 | |
| *** yamamoto has quit IRC | 23:47 | |
| *** caphrim007 has quit IRC | 23:50 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/project-config master: base-test: Run emit-job-header on any host, but localhost https://review.openstack.org/557849 | 23:51 |
| pabelanger | clarkb: dmsimard: was looking at ARA report for successful jobs and noticed^. If we eventually want to add back the node name in emit-job-header, I think we need to run it from a remote node all the time. | 23:52 |
| *** mihalis68 has quit IRC | 23:52 | |
| pabelanger | I'd like to test that and see how it works, then propose patch to add back node name info | 23:52 |
| *** iyamahat has joined #openstack-infra | 23:52 | |
| clarkb | pabelanger: do you also need to limit it to a single node? all could include more than one node | 23:53 |
| dmsimard | pabelanger: I think we already tried that and defined we still wanted it to run on localhost | 23:53 |
| pabelanger | clarkb: yah, the role does that by default, but we could be explicit in the playbook | 23:53 |
| pabelanger | dmsimard: oh, why was that? | 23:54 |
| dmsimard | That's why in the role there are some "ifs" | 23:54 |
| dmsimard | Memory fails and I'm on my phone, there was a mega revert | 23:54 |
| dmsimard | Sec | 23:54 |
| clarkb | iirc one reason is that some jobs don't run anywhere but localhost | 23:54 |
| clarkb | so it broke things like rtfd updates and such | 23:55 |
| pabelanger | localhost is never going to have nodepool info | 23:55 |
| pabelanger | we don't write it | 23:55 |
| dmsimard | https://review.openstack.org/#/c/514489/ ? | 23:55 |
| clarkb | ya I think one suggestion was to have a task that was localhost specific for the common data then write the nodepool stuff using a task that runs against all and fails when false | 23:55 |
| pabelanger | yah, I would expect 514489 to alway fail nodepool.provider isn't set on localhost | 23:57 |
| dmsimard | It wouldn't, it would default to N/A | 23:57 |
| dmsimard | Which is appropriate | 23:57 |
| pabelanger | filters don't work on dict | 23:57 |
| dmsimard | Eventually I want to merge emit-job-header in executor proper | 23:57 |
| pabelanger | foo.bar | default('blah') will syntax error if nodepool variable is missing | 23:58 |
| dmsimard | Because I feel some of this will eventually vary per nodepool driver | 23:58 |
| dmsimard | Ok then we can do if "bar" in foo | 23:58 |
| dmsimard | Or something | 23:58 |
| pabelanger | right | 23:58 |
| pabelanger | but, I think that will always be N/A because we force localhost | 23:59 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!
