| *** slaweq has joined #openstack-infra | 00:11 | |
| fungi | #status log started phase 2 of openstack-discuss ml combining as described at http://lists.openstack.org/pipermail/openstack-dev/2018-September/134911.html | 00:23 |
|---|---|---|
| openstackstatus | fungi: finished logging | 00:23 |
| *** slaweq has quit IRC | 00:24 | |
| *** rcarrillocruz has quit IRC | 00:30 | |
| *** xarses_ has joined #openstack-infra | 00:36 | |
| *** xarses has quit IRC | 00:38 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul master: WIP Add support for zones in executors https://review.openstack.org/549197 | 00:49 |
| *** tosky has quit IRC | 00:49 | |
| *** longkb has joined #openstack-infra | 00:53 | |
| *** longkb has quit IRC | 00:57 | |
| *** jamesmcarthur has joined #openstack-infra | 00:59 | |
| *** jamesmcarthur has quit IRC | 01:04 | |
| *** slaweq has joined #openstack-infra | 01:16 | |
| *** jamesmcarthur has joined #openstack-infra | 01:23 | |
| *** slaweq has quit IRC | 01:24 | |
| *** shrasool has quit IRC | 01:26 | |
| *** eumel8 has quit IRC | 01:49 | |
| *** yamamoto has joined #openstack-infra | 01:51 | |
| *** yamamoto has quit IRC | 01:55 | |
| *** felipemonteiro has joined #openstack-infra | 01:56 | |
| openstackgerrit | Merged openstack/diskimage-builder master: fix some errors for ill-syntax in README.rst https://review.openstack.org/617502 | 01:59 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: move selinux-permissive configure to pre-install phase https://review.openstack.org/615519 | 02:14 |
| *** slaweq has joined #openstack-infra | 02:16 | |
| *** jamesmcarthur has quit IRC | 02:16 | |
| *** felipemonteiro has quit IRC | 02:21 | |
| *** slaweq has quit IRC | 02:24 | |
| *** mrsoul has quit IRC | 02:35 | |
| openstackgerrit | Trinh Nguyen proposed openstack-infra/irc-meetings master: Change Searchlight team meeting https://review.openstack.org/618663 | 02:38 |
| openstackgerrit | Trinh Nguyen proposed openstack-infra/irc-meetings master: Change Searchlight team meeting https://review.openstack.org/618663 | 02:42 |
| *** owalsh_ has joined #openstack-infra | 02:44 | |
| *** psachin has joined #openstack-infra | 02:46 | |
| openstackgerrit | Merged openstack/diskimage-builder master: delete the duplicate words in package-outside-debootstrap-ac93e9ce991819f1.yaml https://review.openstack.org/617501 | 02:47 |
| *** owalsh has quit IRC | 02:48 | |
| *** jamesmcarthur has joined #openstack-infra | 02:54 | |
| *** jamesmcarthur has quit IRC | 03:03 | |
| *** slaweq has joined #openstack-infra | 03:11 | |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul master: executor: enable zuul_return to update Ansible inventory https://review.openstack.org/590092 | 03:17 |
| *** ykarel|away has joined #openstack-infra | 03:22 | |
| *** slaweq has quit IRC | 03:25 | |
| *** udesale has joined #openstack-infra | 03:51 | |
| *** ramishra has joined #openstack-infra | 03:56 | |
| *** ramishra_ has joined #openstack-infra | 03:58 | |
| *** ramishra has quit IRC | 04:01 | |
| *** ramishra_ is now known as ramishra | 04:10 | |
| *** slaweq has joined #openstack-infra | 04:14 | |
| *** ykarel|away has quit IRC | 04:20 | |
| *** ramishra has quit IRC | 04:21 | |
| *** janki has joined #openstack-infra | 04:24 | |
| *** slaweq has quit IRC | 04:25 | |
| *** ramishra has joined #openstack-infra | 04:29 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/nodepool master: Add Fedora 29 testing https://review.openstack.org/618671 | 04:45 |
| *** ykarel has joined #openstack-infra | 04:49 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/project-config master: Add Fedora 29 nodes https://review.openstack.org/618672 | 04:57 |
| *** jamesmcarthur has joined #openstack-infra | 04:59 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/openstack-zuul-jobs master: Update fedora-latest to Fedora 29 https://review.openstack.org/618673 | 04:59 |
| openstackgerrit | Ian Wienand proposed openstack-infra/nodepool master: Logs stats for nodepool automated cleanup https://review.openstack.org/614074 | 05:04 |
| *** chandankumar has joined #openstack-infra | 05:09 | |
| *** chandankumar is now known as chkumar|rcuk | 05:11 | |
| *** chkumar|rcuk is now known as chkumar|ruck | 05:11 | |
| *** slaweq has joined #openstack-infra | 05:16 | |
| *** slaweq has quit IRC | 05:24 | |
| *** eernst has joined #openstack-infra | 05:24 | |
| *** eernst has quit IRC | 05:44 | |
| openstackgerrit | neilsun proposed openstack-infra/zuul master: Add type check for zuul conf https://review.openstack.org/591917 | 05:50 |
| AJaeger | ianw, jhesketh, frickler, could you review a bindep change for openSUSE, please? https://review.openstack.org/617282 | 06:00 |
| jhesketh | sure | 06:00 |
| AJaeger | thanks! | 06:00 |
| jhesketh | AJaeger: lgtm :-) | 06:01 |
| AJaeger | nice | 06:01 |
| *** ramishra_ has joined #openstack-infra | 06:04 | |
| *** ramishra has quit IRC | 06:07 | |
| *** slaweq has joined #openstack-infra | 06:11 | |
| *** e0ne has joined #openstack-infra | 06:12 | |
| *** e0ne has quit IRC | 06:17 | |
| openstackgerrit | Merged openstack-infra/bindep master: Add openSUSE 15.0 testing https://review.openstack.org/617282 | 06:21 |
| *** ahosam has joined #openstack-infra | 06:21 | |
| *** slaweq has quit IRC | 06:24 | |
| *** apetrich has quit IRC | 06:41 | |
| *** apetrich has joined #openstack-infra | 06:56 | |
| *** ifat_afek has joined #openstack-infra | 06:57 | |
| *** gagehugo has quit IRC | 07:11 | |
| *** ramishra_ is now known as ramishra | 07:12 | |
| *** dhill_ has quit IRC | 07:13 | |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul master: executor: add support for generic build resource https://review.openstack.org/570668 | 07:18 |
| *** mrsoul has joined #openstack-infra | 07:18 | |
| *** ahosam has quit IRC | 07:20 | |
| *** ccamacho has joined #openstack-infra | 07:20 | |
| *** pcaruana has joined #openstack-infra | 07:24 | |
| *** quiquell has joined #openstack-infra | 07:24 | |
| *** gagehugo has joined #openstack-infra | 07:30 | |
| *** quiquell has quit IRC | 07:32 | |
| *** quiquell has joined #openstack-infra | 07:33 | |
| *** adriancz has joined #openstack-infra | 07:33 | |
| *** kjackal has joined #openstack-infra | 07:33 | |
| *** ifat_afek has quit IRC | 07:34 | |
| *** ykarel is now known as ykarel|lunch | 07:47 | |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul master: quick-start: remove ssh key command https://review.openstack.org/618707 | 07:50 |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul master: quick-start: remove ssh key comment https://review.openstack.org/618707 | 07:51 |
| *** yamamoto has joined #openstack-infra | 07:53 | |
| *** shardy has joined #openstack-infra | 07:58 | |
| *** yamamoto has quit IRC | 07:58 | |
| *** rpittau has joined #openstack-infra | 07:59 | |
| *** yamamoto has joined #openstack-infra | 08:01 | |
| *** ginopc has joined #openstack-infra | 08:05 | |
| *** aojea has joined #openstack-infra | 08:05 | |
| *** noama has joined #openstack-infra | 08:10 | |
| *** slaweq has joined #openstack-infra | 08:11 | |
| *** jtomasek has joined #openstack-infra | 08:14 | |
| *** slaweq has quit IRC | 08:16 | |
| *** eumel8 has joined #openstack-infra | 08:17 | |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul master: quick-start: remove ssh key comment and for ce rsa type https://review.openstack.org/618707 | 08:17 |
| *** yamamoto has quit IRC | 08:23 | |
| *** xek has joined #openstack-infra | 08:25 | |
| *** fdegir has quit IRC | 08:26 | |
| *** fdegir has joined #openstack-infra | 08:26 | |
| *** yboaron has quit IRC | 08:27 | |
| *** arxcruz|summit is now known as arxcruz | 08:31 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/nodepool master: Add Fedora 29 testing https://review.openstack.org/618671 | 08:36 |
| *** roman_g has joined #openstack-infra | 08:40 | |
| *** yamamoto has joined #openstack-infra | 08:47 | |
| *** jpena|off is now known as jpena | 08:48 | |
| *** kashyap has joined #openstack-infra | 08:49 | |
| *** tosky has joined #openstack-infra | 08:50 | |
| *** gfidente has joined #openstack-infra | 08:51 | |
| *** ykarel|lunch is now known as ykarel | 08:58 | |
| *** ifat_afek has joined #openstack-infra | 08:59 | |
| *** yboaron has joined #openstack-infra | 09:09 | |
| *** lamt has joined #openstack-infra | 09:09 | |
| *** kukacz has quit IRC | 09:10 | |
| *** rossella_s has joined #openstack-infra | 09:11 | |
| *** slaweq has joined #openstack-infra | 09:11 | |
| *** kukacz has joined #openstack-infra | 09:13 | |
| *** owalsh_ is now known as owalsh | 09:15 | |
| *** jpich has joined #openstack-infra | 09:17 | |
| *** shrasool has joined #openstack-infra | 09:21 | |
| *** kashyap has left #openstack-infra | 09:29 | |
| *** kashyap has joined #openstack-infra | 09:29 | |
| kashyap | Hi folks; I don't see a way to upload the slides to Berlin Summit on the website | 09:29 |
| kashyap | Anyone got a link? | 09:30 |
| eumel8 | kashyap: asked the speaker support and they want to provide instructions later the week | 09:33 |
| kashyap | eumel8: Thanks; people walked up to me for slides, I had them, but not sure what's the official location was. | 09:34 |
| kashyap | I'll wait for the email, then | 09:34 |
| *** derekh has joined #openstack-infra | 09:34 | |
| eumel8 | kashyap: I know, a little bit late, but the videos are also not published yet | 09:35 |
| kashyap | eumel8: Yeah, I'd expect for the videos to take a couple more weeks? | 09:36 |
| eumel8 | kashyap: I know, a little bit late, but the videos are also not published yet | 09:36 |
| eumel8 | oops, no, sorry. In Vancouver is was nearly in real time. So I would expect days | 09:37 |
| kashyap | I see | 09:39 |
| eumel8 | maybe Mr. Trump must review all that stuff first :) | 09:40 |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul master: quick-start: split the admin ssh key https://review.openstack.org/618707 | 09:40 |
| *** jaosorior has joined #openstack-infra | 09:41 | |
| *** shrasool has quit IRC | 09:43 | |
| *** shrasool has joined #openstack-infra | 09:44 | |
| *** ykarel_ has joined #openstack-infra | 09:45 | |
| *** ykarel has quit IRC | 09:48 | |
| *** dhill_ has joined #openstack-infra | 09:52 | |
| *** ykarel_ is now known as ykarel | 09:52 | |
| *** sshnaidm has quit IRC | 09:55 | |
| *** sshnaidm has joined #openstack-infra | 09:57 | |
| *** e0ne has joined #openstack-infra | 09:57 | |
| *** e0ne_ has joined #openstack-infra | 09:59 | |
| *** e0ne has quit IRC | 10:02 | |
| *** ifat_afek has quit IRC | 10:03 | |
| eumel8 | AJaeger: is there a legal way to get a new project into StoryBoard? | 10:04 |
| *** shrasool has quit IRC | 10:12 | |
| AJaeger | eumel8: legal? | 10:12 |
| AJaeger | eumel8: add it to project-config like in https://docs.openstack.org/infra/manual/creators.html#add-the-project-to-the-master-projects-list | 10:12 |
| *** eglute has quit IRC | 10:13 | |
| *** eglute has joined #openstack-infra | 10:13 | |
| eumel8 | AJaeger: c | 10:13 |
| eumel8 | AJaeger: Ah, in gerrit, That's legal ;) | 10:13 |
| *** shrasool has joined #openstack-infra | 10:14 | |
| AJaeger | eumel8: want to migrate content from launchpad to storyboard? Then coordinate with Kendall and fungi | 10:14 |
| AJaeger | eumel8: there should be some mails on openstack-dev | 10:14 |
| eumel8 | AJaeger: I know, thanks. I think it's a new one | 10:19 |
| openstackgerrit | Frank Kloeker proposed openstack-infra/project-config master: Add operations-guide to storyboard https://review.openstack.org/618722 | 10:19 |
| eumel8 | ^^ | 10:19 |
| *** dhill_ has quit IRC | 10:22 | |
| AJaeger | eumel8: is fine - but let's discuss semantics a bit, left a question | 10:24 |
| AJaeger | eumel8: so, instead of making "operations-guide" a top-level, I would make "operations-doc" a top-level project that has operations-guide and ha-guide in it. | 10:25 |
| *** betherly has joined #openstack-infra | 10:27 | |
| *** shrasool has quit IRC | 10:29 | |
| *** lucasagomes has joined #openstack-infra | 10:30 | |
| eumel8 | AJaeger: ah, ok, that sounds better | 10:31 |
| openstackgerrit | Frank Kloeker proposed openstack-infra/project-config master: Add operations-docs to storyboard https://review.openstack.org/618722 | 10:31 |
| *** toabctl has quit IRC | 10:33 | |
| *** yamamoto has quit IRC | 10:36 | |
| eumel8 | AJaeger: will send out an e-mail for the new projects on Storyboard to catch the Ops guys. | 10:38 |
| *** panda|rover|off is now known as panda|rover | 10:49 | |
| *** ifat_afek has joined #openstack-infra | 10:52 | |
| *** rfolco has joined #openstack-infra | 10:57 | |
| *** ahosam has joined #openstack-infra | 10:57 | |
| *** tosky has quit IRC | 11:03 | |
| *** tosky has joined #openstack-infra | 11:06 | |
| *** udesale has quit IRC | 11:06 | |
| *** yamamoto has joined #openstack-infra | 11:07 | |
| *** florianf is now known as florianf|afk | 11:08 | |
| AJaeger | eumel8: ok - want to WIP your change? I'll wait a few days with reviewing... | 11:17 |
| AJaeger | eumel8: change is fine | 11:17 |
| *** janki has quit IRC | 11:18 | |
| openstackgerrit | Frank Kloeker proposed openstack-infra/project-config master: [WIP] Add operations-docs to storyboard https://review.openstack.org/618722 | 11:19 |
| eumel8 | AJaeger, ok, wipped | 11:19 |
| AJaeger | eumel8: no - remove [WIP] and set "workflow to -1" | 11:19 |
| AJaeger | That way you don't need to push up again and lose votes... | 11:20 |
| openstackgerrit | Frank Kloeker proposed openstack-infra/project-config master: Add operations-docs to storyboard https://review.openstack.org/618722 | 11:20 |
| eumel8 | narf ;) | 11:20 |
| *** kjackal has quit IRC | 11:20 | |
| arxcruz | mtreinish: do you mind take a look at https://review.openstack.org/#/c/475788/ when you have time? :) | 11:20 |
| AJaeger | your change is ready for review... just not ready to merge yet | 11:20 |
| *** kjackal has joined #openstack-infra | 11:20 | |
| eumel8 | done :) | 11:21 |
| *** ahosam has quit IRC | 11:23 | |
| *** ahosam has joined #openstack-infra | 11:29 | |
| *** rpittau_ has joined #openstack-infra | 11:31 | |
| *** rpittau has quit IRC | 11:34 | |
| *** ginopc has quit IRC | 11:36 | |
| *** janki has joined #openstack-infra | 11:49 | |
| *** ginopc has joined #openstack-infra | 11:59 | |
| egonzalez | hi, any idea why opstools mirror is not synced with http://mirror.dfw.rax.openstack.org/centos/7/opstools/x86_64/perfmon/ ? | 12:02 |
| *** ramishra has quit IRC | 12:09 | |
| *** yamamoto has quit IRC | 12:10 | |
| *** ramishra has joined #openstack-infra | 12:13 | |
| *** shrasool has joined #openstack-infra | 12:14 | |
| *** jpena is now known as jpena|lunch | 12:31 | |
| *** ccamacho has quit IRC | 12:31 | |
| *** apetrich has quit IRC | 12:31 | |
| *** dkehn has quit IRC | 12:33 | |
| *** ccamacho has joined #openstack-infra | 12:33 | |
| *** yamamoto has joined #openstack-infra | 12:40 | |
| *** felipemonteiro has joined #openstack-infra | 12:43 | |
| *** felipemonteiro has quit IRC | 12:44 | |
| *** apetrich has joined #openstack-infra | 12:45 | |
| *** rh-jelabarre has joined #openstack-infra | 12:45 | |
| sshnaidm | what is the platform used for https://ask.openstack.org ? | 12:54 |
| frickler | yboaron: sorry for the delay, you should be able to ssh to root@198.72.124.92 now. note that this is for the kuryr-kubernetes-tempest-daemon-openshift-octavia job you mentioned earlier, not kuryr-kubernetes-tempest-daemon-containerized-octavia | 12:54 |
| ssbarnea|bkp2 | fungi: hi! are you here? | 12:55 |
| frickler | yboaron: please let us know once you have finished debugging that node | 12:55 |
| *** mriedem has joined #openstack-infra | 12:55 | |
| *** chkumar|ruck has quit IRC | 12:57 | |
| *** dave-mccowan has joined #openstack-infra | 12:57 | |
| *** rlandy has joined #openstack-infra | 12:57 | |
| sshnaidm | ssbarnea|bkp2, I can't change username, it should be removed from gerrit only | 12:58 |
| sshnaidm | ssbarnea|bkp2, because LP bugs are on my different account that I use in gerrit.. Such a mess | 12:59 |
| sshnaidm | ssbarnea|bkp2, need just to delete my account in gerrit with "sshnaidm" username | 12:59 |
| ssbarnea|bkp2 | sshnaidm: fungi I stated that on https://tree.taiga.io/project/tripleo-ci-board/issue/392?kanban-status=2027733 -- now we only need a gerrit admin to perform the magic sql update fix. | 13:00 |
| sshnaidm | ssbarnea|bkp2, ha! I think I fixed it | 13:02 |
| ssbarnea|bkp2 | sshnaidm: brilliant! how you managed to do it? it works. only downside is that I cannot lookup you by "ssh" which was my fav way of doing it. Still, this is a bug in *our* gerrit which was fixed in newer versions: that lookup fails to look inside email address (only username). | 13:04 |
| sshnaidm | ssbarnea|bkp2, yeah, can't find by ssh and still have wrong account there.. I renamed my account to different name | 13:05 |
| ssbarnea|bkp2 | workaround would be to include you irc as part of the "full name" | 13:05 |
| ssbarnea|bkp2 | this is what I would do, but in my case i don' thave to do it because is the same. | 13:06 |
| fungi | sshnaidm: ssbarnea|bkp2: thanks for collecting the details on that duplicate account. i've marked 14982 inactive, so hopefully this solves it for good | 13:06 |
| ssbarnea|bkp2 | this only makes me want to upgrade gerrit even more. | 13:06 |
| fungi | yes, i believe we're all eager to get gerrit upgraded | 13:06 |
| *** udesale has joined #openstack-infra | 13:08 | |
| fungi | sshnaidm: if you're in the gerrit webui, check https://review.openstack.org/#/settings/ and make sure it says your Account ID is 10969 | 13:08 |
| sshnaidm | fungi, yeah, it's 10969 | 13:09 |
| *** udesale has quit IRC | 13:11 | |
| *** udesale has joined #openstack-infra | 13:11 | |
| fungi | perfect! | 13:11 |
| fungi | let me know if you run into any issues you think might be related | 13:12 |
| *** trown|outtypewww is now known as trown | 13:12 | |
| fungi | and once weshay_pto is around to let us know what needs to happen with his accounts i'm happy to take care of that as well | 13:12 |
| *** phausman_ has joined #openstack-infra | 13:13 | |
| *** phausman_ has quit IRC | 13:13 | |
| *** phausman_ has joined #openstack-infra | 13:14 | |
| *** phausman_ has quit IRC | 13:14 | |
| *** boden has joined #openstack-infra | 13:16 | |
| *** dhill_ has joined #openstack-infra | 13:17 | |
| *** ifat_afek has quit IRC | 13:18 | |
| fungi | infra-root: things seems to be going okay with the openstack-discuss ml merging so far. an unanticipated upshot is that anyone who isn't a subscriber to -discuss and sends a message to one of the other lists it's subscribed to ends up with their message stuck in the moderation queue until a approve it (because the lists don't alter the from header). i think this creates an excellent reminder to | 13:22 |
| fungi | people to subscribe to the new ml, but does mean i need to keep a closer eye on the moderation queue for the next few weeks | 13:22 |
| AJaeger | fungi, hope that's not too much of moderation surprise | 13:23 |
| fungi | nah | 13:23 |
| AJaeger | cool | 13:24 |
| *** chandankumar has joined #openstack-infra | 13:25 | |
| fungi | i'll try to keep on top of it, but need to disappear for the next few hours to run some errands. if anyone comes looking for an urgent moderation approval on the -discuss ml, any infra-root can add themselves to the moderators for it by using the /usr/lib/mailman/bin/change_pw utility on the server | 13:26 |
| *** rpittau_ is now known as rpittau | 13:26 | |
| *** yboaron has quit IRC | 13:26 | |
| fungi | well, i guess technically that doesn't add them to the moderators list, just lets them change the list admin password so they can get into the moderation controls and take care of it | 13:26 |
| fungi | but good enough at any rate | 13:26 |
| ssbarnea|bkp2 | fungi: thanks for helping with gerrit, i will try to get the answer from wes. | 13:26 |
| fungi | my pleasure! | 13:27 |
| * fungi vanishes for the next few hours | 13:27 | |
| *** chandankumar is now known as chkumar|ruck | 13:28 | |
| *** yboaron has joined #openstack-infra | 13:28 | |
| openstackgerrit | Sorin Sbarnea proposed openstack-infra/elastic-recheck master: fix tox python3 overrides https://review.openstack.org/605618 | 13:28 |
| *** jpena|lunch is now known as jpena | 13:29 | |
| ssbarnea|bkp2 | fungi: clarkb: https://review.openstack.org/#/c/617365/ needs review. | 13:31 |
| *** dave-mccowan has quit IRC | 13:36 | |
| *** kgiusti has joined #openstack-infra | 13:37 | |
| *** psachin has quit IRC | 13:37 | |
| *** ahosam has quit IRC | 13:44 | |
| *** shrasool has quit IRC | 13:48 | |
| *** sthussey has joined #openstack-infra | 13:58 | |
| *** quiquell has quit IRC | 14:00 | |
| *** quiquell has joined #openstack-infra | 14:00 | |
| *** yboaron_ has joined #openstack-infra | 14:01 | |
| *** ccamacho has quit IRC | 14:04 | |
| *** yboaron has quit IRC | 14:04 | |
| *** pbourke has quit IRC | 14:04 | |
| *** pbourke has joined #openstack-infra | 14:06 | |
| *** agopi is now known as agopi|brb | 14:08 | |
| *** ccamacho has joined #openstack-infra | 14:08 | |
| *** lbragstad has joined #openstack-infra | 14:09 | |
| *** chkumar|ruck has quit IRC | 14:10 | |
| *** agopi|brb has quit IRC | 14:12 | |
| *** ykarel is now known as ykarel|away | 14:27 | |
| *** ykarel|away has quit IRC | 14:31 | |
| *** agopi|brb has joined #openstack-infra | 14:37 | |
| *** agopi|brb is now known as agopi | 14:37 | |
| *** ykarel|away has joined #openstack-infra | 14:37 | |
| *** bobh has joined #openstack-infra | 14:43 | |
| *** quiquell is now known as quiquell|lunch | 14:49 | |
| *** ykarel|away has quit IRC | 14:52 | |
| *** yboaron_ has quit IRC | 14:58 | |
| pabelanger | AJaeger: fungi: clarkb: mordred: https://review.openstack.org/618633/ should fix the branch-tarball jobs in zuul. Without it, we are missing things like yarn being installed | 15:00 |
| pabelanger | it also drops the openstack specific job | 15:00 |
| *** yboaron_ has joined #openstack-infra | 15:04 | |
| *** slaweq_ has joined #openstack-infra | 15:10 | |
| *** slaweq has quit IRC | 15:12 | |
| *** sshnaidm is now known as sshnaidm|afk | 15:13 | |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul master: Quick-start: set content-type header on ssh key upload https://review.openstack.org/618766 | 15:15 |
| *** ijw has quit IRC | 15:18 | |
| *** bobh has quit IRC | 15:18 | |
| *** ddurst has quit IRC | 15:19 | |
| *** ddurst has joined #openstack-infra | 15:20 | |
| ssbarnea|bkp2 | fungi: i identified wes active account: weshayutin -- if you can disable whayutin one it would be great. | 15:25 |
| *** bobh has joined #openstack-infra | 15:29 | |
| *** sshnaidm|afk is now known as sshnaidm | 15:36 | |
| *** quiquell|lunch is now known as quiquell|off | 15:39 | |
| *** ykarel|away has joined #openstack-infra | 15:40 | |
| *** dougsz has joined #openstack-infra | 15:45 | |
| dougsz | Has anyone lost https://review.openstack.org ? | 15:46 |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul master: Add support for zones in executors https://review.openstack.org/549197 | 15:46 |
| gagehugo | yeah I'm having issues connecting | 15:47 |
| dougsz | And just like that it's back up :) | 15:47 |
| sshnaidm | dougsz, still down for me | 15:47 |
| sshnaidm | actually it's up, but very slow.. | 15:48 |
| *** ddurst has quit IRC | 15:50 | |
| ssbarnea|bkp2 | i have the impression that gerrit is .... down. | 15:50 |
| *** phausman has joined #openstack-infra | 15:50 | |
| *** ddurst has joined #openstack-infra | 15:50 | |
| *** priteau has joined #openstack-infra | 15:51 | |
| jungleboyj | It is having issues. It was breifly down and now it is very slow. | 15:51 |
| *** slaweq_ has quit IRC | 15:54 | |
| clarkb | looking at it from here javamelody doesnt show anything that seems abnirmal. memory use is low and there is no GCing | 15:54 |
| clarkb | its also not noticeably slow. What are you seeing to indicate it is down and or slow? | 15:54 |
| clarkb | is apache returning 500 errors or maybe no errors at all? | 15:54 |
| *** slaweq_ has joined #openstack-infra | 15:55 | |
| *** yamamoto has quit IRC | 15:55 | |
| *** dklyle has quit IRC | 15:55 | |
| *** yamamoto has joined #openstack-infra | 15:56 | |
| ttx | kata-dev | 15:56 |
| ttx | oops | 15:56 |
| jungleboyj | :-) | 15:57 |
| clarkb | in any ase if we can get a bit more info on what gerrit is down means that will help further investigation | 15:57 |
| jungleboyj | For me it just failed to connect. Looked like a DNS failure but now it is working. | 15:57 |
| *** bobh has quit IRC | 15:58 | |
| *** dklyle has joined #openstack-infra | 16:03 | |
| *** pcaruana has quit IRC | 16:07 | |
| clarkb | corvus: fungi: is there a good way to confirm that dmarc isn't a problem for -discuss? Maybe we need someone with a filtering email provider to subscribe and confirm it is happy for them? | 16:12 |
| *** shrasool has joined #openstack-infra | 16:13 | |
| *** shrasool has quit IRC | 16:14 | |
| corvus | clarkb: the 'ask a volunteer' approach would be to ask a user from a highly-restritive dmarc domain to send a message to the list, then verify that it was delivered to dmarc-obeying sites. | 16:15 |
| corvus | clarkb: (can't just ask them to subscribe and see if they get messages, they have to send one) | 16:15 |
| clarkb | got it | 16:16 |
| *** udesale has quit IRC | 16:16 | |
| *** e0ne_ has quit IRC | 16:16 | |
| clarkb | I don't supsect any issues but would be good to confirm their absence as early as possible | 16:16 |
| clarkb | re review.o.o outages. I do see some packet loss over ipv6 to that host from my ovh instance | 16:17 |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/system-config master: Blackhole messages to openstack-sigs-owner@l.o.o https://review.openstack.org/618777 | 16:17 |
| *** jamesdenton has joined #openstack-infra | 16:17 | |
| clarkb | fungi: ^ maybe you can check from your he tunnel? | 16:18 |
| *** e0ne has joined #openstack-infra | 16:21 | |
| fungi | back from the computer again real quick, will take a look | 16:23 |
| fungi | ssbarnea|bkp2: upi | 16:23 |
| fungi | er | 16:23 |
| fungi | ssbarnea|bkp2: you're sure he's neither pushing changes with nor using the webui as that account? | 16:24 |
| ssbarnea|bkp2 | fungi: 99% sure, weshay_pto knows about the issue and I was not able to see any activity from his other account. | 16:25 |
| fungi | ssbarnea|bkp2: fair enough. i'll knock it out in just a sec | 16:25 |
| *** roman_g has quit IRC | 16:25 | |
| *** janki has quit IRC | 16:26 | |
| fungi | clarkb: i got 0% icmp packet loss over ipv6 with a 50-ping run at 1s intervals, but can do a more substantial test if it helps | 16:26 |
| fungi | that's via hurricane electric gre tunnel terminating in their iad pop | 16:26 |
| *** e0ne has quit IRC | 16:27 | |
| fungi | ssbarnea|bkp2: weshay_pto: i've set gerrit account id 8997 inactive, and left 9592 intact | 16:28 |
| ssbarnea|bkp2 | fungi: thanks! i confirm that now it works adding him. I also added that info to the ticket tracking this, so he will get an email. | 16:30 |
| clarkb | ssbarnea|bkp2: did you see my note about gertty? I don't expect the infra meeting to be a useful place to discuss that. Gertty is not an infra project | 16:31 |
| *** jamesmcarthur has quit IRC | 16:32 | |
| *** jamesmcarthur has joined #openstack-infra | 16:32 | |
| ssbarnea|bkp2 | clarkb: sure, feel free to drop it. it was more of a question for corvus, just for practical reasons. gertty is quite a popular tool around and may deserve few fixes. | 16:32 |
| corvus | oh hi, what's the question? | 16:33 |
| ssbarnea|bkp2 | corvus: it was about having more than yourself as reviewers on gertty, just not to abuse your time. | 16:33 |
| ssbarnea|bkp2 | corvus: i really like gertty and i know that is part of others daily workflow. | 16:35 |
| *** rpittau has quit IRC | 16:36 | |
| *** gfidente has quit IRC | 16:36 | |
| corvus | ssbarnea|bkp2: oh thanks! please do review patches to gertty -- i find those very helpful. i really value the stability of gertty and the current organization/style of the code (hacking on gertty is what i do to relax :), so i'm hesitant to add more core reviewers right now. | 16:37 |
| corvus | but maybe this is a good week to go through the backlog | 16:37 |
| ssbarnea|bkp2 | corvus: that would be great. my only interest was to cleanup the review queue and make it work with py3... as I am switching to it (like others). that is why it may need few changes around testing jobs but I will glad to help around. | 16:39 |
| ssbarnea|bkp2 | the fact that its only job on zuul is named "noop" is not really cool. | 16:39 |
| corvus | ssbarnea|bkp2: if you can figure out a way to *effectively* test it, i'd be all for it. but i don't know of one, and i don't plan on adding jobs just to have jobs. pep8 is not ok, but pyflakes would be. | 16:40 |
| *** gfidente has joined #openstack-infra | 16:40 | |
| fungi | yeah, i too try to go through open gertty changes from time to time and try them out/leave feedback. pretty sure corvus knows who a lot of the regulars are and takes our reviews into account regardless of gerrit permissions | 16:40 |
| corvus | ssbarnea|bkp2: i just tested out https://review.openstack.org/617120 -- good idea, but it seems to have a problem | 16:42 |
| openstackgerrit | Merged openstack-infra/zuul master: Quick-start: set content-type header on ssh key upload https://review.openstack.org/618766 | 16:42 |
| *** apetrich has quit IRC | 16:43 | |
| ssbarnea|bkp2 | corvus: sure, I will have a look at it. | 16:43 |
| openstackgerrit | Merged openstack/gertty master: typo - s/fileojb/fileobj/ https://review.openstack.org/608155 | 16:44 |
| clarkb | re Gerrit outages/slowness apache seems to be configured to allow 150 concurrent connections. We only have ~14 right now so I think that is fine. We do have ~570 ssh connections though | 16:44 |
| corvus | clarkb: any interesting patterns there? ci systems? rogue ci systems? | 16:44 |
| *** kjackal has quit IRC | 16:44 | |
| clarkb | corvus: http://cacti.openstack.org/cacti/graph.php?action=view&local_graph_id=30&rra_id=all seems to indicate it is a leaky set of connections at least. I haven't asked gerrit for the user info yet | 16:45 |
| *** kjackal has joined #openstack-infra | 16:45 | |
| fungi | i need to pop back out to grab lunch now but will be around the rest of the day once i return. can help dig into gerrit connectivity/response issues as soon as i get back | 16:45 |
| * fungi disappears again | 16:45 | |
| *** ccamacho has quit IRC | 16:46 | |
| *** ccamacho has joined #openstack-infra | 16:46 | |
| clarkb | corvus: there are a number of users that have a number of connections 14595 for example | 16:47 |
| clarkb | 9008 too | 16:48 |
| mtreinish | clarkb: germqtt to the rescue? | 16:48 |
| clarkb | mtreinish: possibly? I'm not sure it is an actual cause for concern other than why are there so many ibm connections and maybe we can help them tcp better | 16:49 |
| clarkb | I wonder if these are just legions of old zuul that didn't have the paramiko close fix in them | 16:51 |
| *** yboaron_ has quit IRC | 16:52 | |
| clarkb | our zuul has 3 connections to put things into perspective | 16:53 |
| clarkb | two from zuul01 and one from ze10 | 16:54 |
| corvus | clarkb: if we think this is a problem, maybe we can kill all the old connections? or just restart gerrit? or do you think it's a red herring? | 16:56 |
| egonzalez | hi, any idea why opstools mirror is not synced with http://mirror.dfw.rax.openstack.org/centos/7/opstools/x86_64/perfmon/ ? | 16:57 |
| clarkb | corvus: I'm beginning to think it is a red herring | 16:57 |
| clarkb | I don't suspect it is the cuase of the outage people seem to have noticed | 16:58 |
| openstackgerrit | Merged openstack/gertty master: [Documentation] Change the fedora install. https://review.openstack.org/607527 | 16:58 |
| openstackgerrit | Merged openstack/gertty master: Add ability to set lock file in config https://review.openstack.org/596318 | 16:58 |
| *** agopi is now known as agopi|food | 16:59 | |
| clarkb | egonzalez: is the content there not up to date? | 16:59 |
| *** priteau has quit IRC | 17:00 | |
| *** apetrich has joined #openstack-infra | 17:01 | |
| *** ginopc has quit IRC | 17:02 | |
| clarkb | egonzalez: http://mirror.dfw.rax.openstack.org/centos/7/opstools/x86_64/perfmon/?C=M;O=D compared to http://mirror.centos.org/centos/7/opstools/x86_64/perfmon/?C=M;O=D makes it seem up to date | 17:02 |
| egonzalez | clarkb my fault, had a cached version | 17:02 |
| *** aojea has quit IRC | 17:02 | |
| *** auristor has quit IRC | 17:04 | |
| *** auristor has joined #openstack-infra | 17:07 | |
| openstackgerrit | Will Szumski proposed openstack-infra/project-config master: Add openstack/tenks Ansible dependencies https://review.openstack.org/618511 | 17:08 |
| *** ijw has joined #openstack-infra | 17:15 | |
| *** imacdonn has quit IRC | 17:17 | |
| *** shrasool has joined #openstack-infra | 17:17 | |
| *** imacdonn has joined #openstack-infra | 17:17 | |
| *** ijw has quit IRC | 17:18 | |
| *** shrasool has quit IRC | 17:18 | |
| *** kgiusti has quit IRC | 17:24 | |
| *** trown is now known as trown|lunch | 17:24 | |
| openstackgerrit | Matt Riedemann proposed openstack-infra/elastic-recheck master: Move all zuul jobs definitions inside repo https://review.openstack.org/616582 | 17:28 |
| openstackgerrit | Matt Riedemann proposed openstack-infra/elastic-recheck master: Move all zuul jobs definitions inside repo https://review.openstack.org/616582 | 17:29 |
| openstackgerrit | Matt Riedemann proposed openstack-infra/project-config master: Move elastic-recheck zuul jobs definitions inside project repo https://review.openstack.org/616583 | 17:29 |
| openstackgerrit | Merged openstack-infra/elastic-recheck master: Remove ceiling of python-daemon https://review.openstack.org/617365 | 17:34 |
| *** noama has quit IRC | 17:36 | |
| *** agopi|food is now known as agopi | 17:39 | |
| clarkb | infra-root fungi re moderating openstack-discuss the master mailman passwd is in the master passwds file | 17:39 |
| clarkb | you can use that to manage any list through the web ui | 17:40 |
| *** pcaruana has joined #openstack-infra | 17:44 | |
| clarkb | sshnaidm: askbot is used for ask.openstack.org | 17:44 |
| *** jamesmcarthur has quit IRC | 17:44 | |
| *** ykarel|away has quit IRC | 17:46 | |
| *** jpich has quit IRC | 17:49 | |
| sshnaidm | clarkb, thanks | 17:49 |
| openstackgerrit | Merged openstack-infra/system-config master: Blackhole messages to openstack-sigs-owner@l.o.o https://review.openstack.org/618777 | 17:51 |
| clarkb | ttx: ^ fyi | 17:54 |
| *** xek has quit IRC | 17:58 | |
| *** xek has joined #openstack-infra | 17:59 | |
| *** derekh has quit IRC | 18:00 | |
| *** kjackal has quit IRC | 18:02 | |
| *** jpena is now known as jpena|off | 18:03 | |
| fungi | clarkb: oh! great point, thanks for the sanity | 18:03 |
| *** rpioso is now known as rpioso|afk | 18:07 | |
| *** dtantsur is now known as dtantsur|afk | 18:09 | |
| openstackgerrit | Merged openstack-infra/elastic-recheck master: Move all zuul jobs definitions inside repo https://review.openstack.org/616582 | 18:09 |
| *** jcoufal has joined #openstack-infra | 18:13 | |
| *** jamesmcarthur has joined #openstack-infra | 18:15 | |
| *** roman_g has joined #openstack-infra | 18:31 | |
| *** Goneri has joined #openstack-infra | 18:34 | |
| *** e0ne has joined #openstack-infra | 18:47 | |
| clarkb | fungi: overall the ml transition seems to be working? the only confusion I've seen so far is over the dmarc stuff not rewriting emails so you have to moderate emails as well as the forwards to the other lists being bounced | 18:47 |
| openstackgerrit | Sorin Sbarnea proposed openstack-infra/gerritbot master: Avoid silent execution failures https://review.openstack.org/618802 | 18:48 |
| openstackgerrit | Tobias Henkel proposed openstack-infra/nodepool master: Cache node request zNodes https://review.openstack.org/618806 | 18:50 |
| openstackgerrit | Tobias Henkel proposed openstack-infra/nodepool master: Update node request during locking https://review.openstack.org/618807 | 18:50 |
| *** e0ne has quit IRC | 18:51 | |
| fungi | clarkb: yeah, i'm looking into skm's comment. he seems to have subscribed to openstack-discuss at 10:39:16 utc today and then e-mailed the general openstack ml at 18:10:35 utc and it hit the openstack-discuss moderation queue anyway. i suspect "Reason: Message has implicit destination" is hinting the actual cause (mm doesn't like that the list address isn't in the to or cc i guess?) | 18:54 |
| fungi | https://wiki.list.org/DOC/What%20does%20%22message%20has%20implicit%20destination%22%20mean%3F has some suggestions | 18:55 |
| *** trown|lunch is now known as trown | 18:55 | |
| fungi | go to Privacy Options / Recipient Filters / Alias Names, and enter the name of the [other] list as a valid alias | 18:55 |
| fungi | i'll give that a shot now | 18:55 |
| corvus | fungi: ++ | 18:59 |
| *** e0ne has joined #openstack-infra | 19:00 | |
| AJaeger | zuul-jobs reviewers, could you look at https://review.openstack.org/#/c/615698/, please? - looks fine to me and I would +2A but wanted to ask first here - and wanted to approve only when others are around... | 19:05 |
| *** eernst has joined #openstack-infra | 19:06 | |
| *** eernst has quit IRC | 19:06 | |
| fungi | corvus: skm also points out that messages from the old lists sent via the new list don't rewrite the old addresses nor set a reply-to, so subscribers to only the new list are in effect replying to the old lists as a result. do you happen to know of any easy solution to this in mm configuration? | 19:06 |
| AJaeger | and two zuul-jobs reviews by tobiash - https://review.openstack.org/616941 and https://review.openstack.org/613036 | 19:06 |
| fungi | i'm looking for something like a selective pattern-based address rewrite | 19:07 |
| AJaeger | plus one by tristanC https://review.openstack.org/610888 | 19:07 |
| fungi | but not sure what other solutions might also be viable | 19:07 |
| AJaeger | reviews welcome! | 19:07 |
| AJaeger | fungi: what fun ;( | 19:07 |
| clarkb | AJaeger: I should be around today if you want to approve it (and I've already +2'd it) | 19:07 |
| AJaeger | clarkb: ok, will do - thanks | 19:08 |
| clarkb | AJaeger: for https://review.openstack.org/#/c/613036/4 do we need to clean up our use of similar in project-config? I worry they may conflict and either do too much work or fail | 19:09 |
| *** kjackal has joined #openstack-infra | 19:10 | |
| tobiash | clarkb: you probably want to switch that after it landed but note that that version requires the repos in the image to be stored with the canonical project name in the path | 19:11 |
| tobiash | s/switch that/switch to using that/ | 19:11 |
| fungi | corvus: so far reply_goes_to_list or using reply_to_address to similar effect are the only solutions i'm coming up with, and that seems like a questionable solution (though perhaps if it's only for three weeks that's an acceptable compromise?) | 19:11 |
| tobiash | clarkb: that role is supposed to be the generic zuul-jobs way of caching repos in the node image | 19:12 |
| corvus | fungi: pondering. | 19:12 |
| clarkb | tobiash: right so in our case they are not canonical names on the image so we will create an empty repo then set the remote. Then our existing thing will run and it should be fine? | 19:13 |
| *** Swami has joined #openstack-infra | 19:13 | |
| clarkb | tobiash: then if/when we update our images to use the canonical name path itwill switch to using the generic version and just work? | 19:13 |
| tobiash | clarkb: if you don't change anything, it will be fine because it won't be used by your base job, when you switch to the generic way you need to move the repos in the node image (but still it won't break if the cached repos are not found) | 19:14 |
| tobiash | clarkb: so yes | 19:14 |
| clarkb | oh I see this is a new role not updating existing one so ya | 19:14 |
| clarkb | the bit that had me most worried was the sync at the end which if we used that role today would result in copying the entire git repo contents and not the cache delta | 19:15 |
| tobiash | yes, so you can optimize your switch by double caching the repos -> switch to new role -> remove double caching | 19:15 |
| clarkb | so ya those should be safe then we can work on switching over to the zuul-jobs version from our current stuff | 19:16 |
| tobiash | clarkb: btw, there is also a new role that can be used for preparing the correct layout of cached repos: https://review.openstack.org/616946 | 19:16 |
| clarkb | tobiash: in our case we would update the dib element to cache to the new location then add symlinks from the old location I think | 19:17 |
| tobiash | if you use zuul for populating the cache | 19:17 |
| tobiash | clarkb: makes sense | 19:17 |
| clarkb | home/zuul/src/git.openstack.org/openstack/nova would be nova in canonical form on disk right? | 19:18 |
| clarkb | so we need /opt/git/nova -> /opt/git/git.openstack.org/openstack/nova ? | 19:18 |
| corvus | fungi: yes... or, we could allow anyone subscribed to -discuss to post to the old lists, so that replying to the old list just works | 19:19 |
| clarkb | part of me wonders if https://review.openstack.org/#/c/610888/1 would be better off as command is script that runs within that context rather than put the shell script as list in ansible yaml | 19:19 |
| corvus | fungi: (even for folks who have unsubscribed from the old lists) | 19:19 |
| corvus | fungi: i think i kind of like that option as it means no behavior change to -discuss which might need to be altered later | 19:20 |
| clarkb | a list of commands in ansible doesn't really tell you much about their semantics when executed. Will all commands run? do they stop after first failure? etc | 19:20 |
| fungi | corvus: i think that doesn't solve the underlying problem though, which is that we'd like to get most of the active threads from the old lists retrained onto the new list when people are replying there | 19:20 |
| fungi | otherwise they keep receiving threads via the new ml and replying to the old ones until the day we turn them off, and then potentially get a lot more replies rejected | 19:21 |
| fungi | still tractable | 19:21 |
| fungi | if we want to do what you suggest, where do we set that? | 19:21 |
| corvus | fungi: i agree my proposed solution doesn't address that, but i'm not sure any solution will cause people to change their behavior now (ie, forcing reply-to also doesn't cause any real behavior change). | 19:21 |
| corvus | fungi: i think you do @list in sender filters; i'll look it up | 19:22 |
| fungi | ooh, magic! | 19:22 |
| AJaeger | clarkb , there's another one from tobiash in the stack https://review.openstack.org/#/c/616946/ - reviewing now... | 19:22 |
| corvus | fungi: http://lists.openstack.org/cgi-bin/mailman/admin/openstack-discuss/?VARHELP=privacy/sender/accept_these_nonmembers | 19:22 |
| fungi | thanks! | 19:24 |
| clarkb | AJaeger: tobiash I left a couple of notes/questions on that one | 19:24 |
| fungi | corvus: i suppose we need to do it in reverse though (or maybe both directions) to solve for the case in question | 19:25 |
| corvus | fungi: er, yes, sorry. i think we want to add @openstack-discuss to accept_these_nonmembers on openstack-dev (and friends) | 19:26 |
| fungi | the main issue right now is that, e.g. subscribers to openstack-discuss are receiving messages through that ml which claim to be from openstack-dev so they reply to openstack-dev from which they've since unsubscribed | 19:26 |
| fungi | yep, awesome | 19:26 |
| corvus | fungi: i don't think we want to change that field in openstack-discuss (because we want people to join that, so we want them to get a notice if they send to it when not subscribed) | 19:26 |
| fungi | right. it would solve _a_ problem but i'm seeing that particular problem as more of a feature in this case | 19:26 |
| corvus | fungi: two plague-stricken jetlagged admins ought to be able to work this out. :) | 19:27 |
| fungi | or we could just get drunk | 19:27 |
| *** shardy has quit IRC | 19:27 | |
| fungi | equally tempting at this point | 19:27 |
| fungi | er, i mean, consume our body weight in cold meds | 19:27 |
| clarkb | which would be more mind altering? | 19:30 |
| clarkb | probably depends on whether or not your state allows ephedrine in cold meds without a prescription | 19:30 |
| tobiash | clarkb: responded | 19:30 |
| fungi | also depends on how you define "cold meds" | 19:30 |
| fungi | mine come in a bottle with the word "rum" on the label | 19:30 |
| *** emerson has quit IRC | 19:31 | |
| ssbarnea|bkp2 | clarkb: ianw: can you please check https://review.openstack.org/#/c/618186/ on elastic-recheck and tell me if is ok? initial counting of timeouts. | 19:31 |
| clarkb | tobiash: gotcha so less in place and more "here is a thing that can be moved around" | 19:31 |
| tobiash | yes | 19:31 |
| tobiash | maybe I can improve the docs to accomodate that | 19:32 |
| clarkb | ssbarnea|bkp2: I think we already track that | 19:32 |
| clarkb | ssbarnea|bkp2: http://status.openstack.org/elastic-recheck/#1783405 and http://status.openstack.org/elastic-recheck/#1686542 | 19:32 |
| clarkb | fungi: ha | 19:33 |
| openstackgerrit | Merged openstack-infra/zuul-jobs master: validate-host: retry network tests and include unbound logs https://review.openstack.org/615698 | 19:34 |
| ssbarnea|bkp2 | clarkb: where does "1686542" come from because clearly is not listed in elastic-recheck repository. | 19:35 |
| fungi | corvus: okay, i've appended @openstack-discuss to the accept_these_nonmembers field of the four old lists | 19:35 |
| fungi | fingers crossed | 19:35 |
| clarkb | ssbarnea|bkp2: e-r gets the bug number from the queries/ file names | 19:36 |
| clarkb | ssbarnea|bkp2: in this case queries/1686542.yaml | 19:36 |
| tobiash | AJaeger: thanks for picking up these changes :) | 19:37 |
| ssbarnea|bkp2 | clarkb: oops, I forgot to grep on file-*names*, only did "ag" which looks inside. | 19:37 |
| ssbarnea|bkp2 | now the reality is that 1686542 query returns considerably less results than the read number of generic timeouts, which based on logstash is ~5 per hour. | 19:38 |
| clarkb | ssbarnea|bkp2: ya its looking at the devstack timeouts only based on the query I think | 19:38 |
| ssbarnea|bkp2 | clarkb: see https://review.openstack.org/#/c/618186/3/queries/1803560.yaml --- that is what I used, covers considerably more. | 19:39 |
| clarkb | ssbarnea|bkp2: since the timeout tool returns a specific error code. We can probably update that query to capture what your query checks for too (so check both things) | 19:39 |
| AJaeger | tobiash: you're welcome - just gave a +2A... | 19:39 |
| tobiash | :) | 19:39 |
| AJaeger | tobiash: https://review.openstack.org/588150 is that really application/folder? Couldn't find that in a standard... | 19:40 |
| openstackgerrit | Merged openstack-infra/zuul-jobs master: Add prepare-workspace-git role https://review.openstack.org/613036 | 19:40 |
| AJaeger | tobiash: I will comment... | 19:40 |
| ssbarnea|bkp2 | clarkb: this query is like a BFG but, to me, it look like a valid candidate to spot generic timeouts. obviously that now that I know about an existing bug, i should close mine and update the exiting query, right? | 19:41 |
| clarkb | ssbarnea|bkp2: yes I think it would be best to use the existing bug and query. Just update both as necessary to capture the additional timeouts | 19:41 |
| ssbarnea|bkp2 | clarkb: thanks. i will do so. we don't want to spam the number of graphs. | 19:41 |
| tobiash | AJaeger: I could swear I read that somewhere | 19:42 |
| tobiash | AJaeger: re-googling | 19:42 |
| *** jcoufal has quit IRC | 19:42 | |
| AJaeger | tobiash: I found https://stackoverflow.com/questions/18869772/mime-type-for-a-directory | 19:42 |
| AJaeger | tobiash: if our tools produce that - ok... I just would be surprised... | 19:43 |
| openstackgerrit | Merged openstack-infra/zuul master: Handle existing .ssh dir on merger https://review.openstack.org/617955 | 19:43 |
| AJaeger | tobiash my /etc/mime.types has "inode/directory" | 19:43 |
| clarkb | ssbarnea|bkp2: we need to keep the error code checks because tools like devstack use the timeout tool to exit before the job timeout so that they can handle logging and stuff internally first | 19:44 |
| *** kgiusti has joined #openstack-infra | 19:45 | |
| clarkb | ssbarnea|bkp2: then there are the jobs that timeout without doing that which your new query will find. So we want both I think | 19:45 |
| tobiash | AJaeger: you're right: "file --mime-type /home" returns "/home: inode/directory" | 19:46 |
| tobiash | AJaeger: so this might not be that deterministic | 19:46 |
| AJaeger | tobiash: same result on my system - now that I know what to run ;) | 19:47 |
| openstackgerrit | Sorin Sbarnea proposed openstack-infra/elastic-recheck master: Improve generic zuul timeouts identification: RESULT_TIMED_OUT https://review.openstack.org/618186 | 19:48 |
| openstackgerrit | Merged openstack-infra/zuul-jobs master: mirror-workspace-git: use port when pushing git repo through ssh https://review.openstack.org/616941 | 19:48 |
| *** kjackal has quit IRC | 19:53 | |
| *** apetrich has quit IRC | 19:54 | |
| tobiash | AJaeger: folders don't get a mimetype in python so the script sets application/directory in line 171 (see comment) | 19:55 |
| tobiash | so we need to compare it with the artificial mimetype we've set there | 19:55 |
| *** apetrich has joined #openstack-infra | 19:55 | |
| AJaeger | tobiash: ah! should we change that to inode/directory for consistency? Or leave as is...Me checks whole file now... | 19:56 |
| openstackgerrit | Merged openstack-infra/zuul-jobs master: Add role git-prepare-nodecache https://review.openstack.org/616946 | 19:57 |
| tobiash | AJaeger: inode/directory sounds very linux specific and not generic for web | 19:57 |
| tobiash | there doesn't seem to be a real standard on this though | 19:58 |
| AJaeger | tobiash: yeah, I'm fine leaving it seeing now how it's used. Still left a question on the code... | 20:02 |
| *** jcoufal has joined #openstack-infra | 20:03 | |
| *** jcoufal has quit IRC | 20:03 | |
| tobiash | AJaeger: actually I have no idea, I just fixed that mimetype comparison ;) | 20:04 |
| *** jcoufal has joined #openstack-infra | 20:04 | |
| *** e0ne has quit IRC | 20:07 | |
| openstackgerrit | Sorin Sbarnea proposed openstack-infra/elastic-recheck master: Preparatory fixes for py3 https://review.openstack.org/616578 | 20:07 |
| AJaeger | tobiash: let's ask ianw what he thinks - if he's fine with it, I'll +2A tomorrow... ianw, could you comment on https://review.openstack.org/#/c/588150/2 , please? See my most recent questoin about the code | 20:07 |
| AJaeger | corvus: you might know as well about zuul swift-upload ^ | 20:07 |
| ssbarnea|bkp2 | clarkb: https://review.openstack.org/#/c/618186/ is updated to include all patterns for timeouts. | 20:08 |
| tobiash | AJaeger: my deployment still runs with the broken mimetype comparison and displays '4.0K' as the size of a folder while the mimetype fix would switch that probably to '4096' | 20:09 |
| tobiash | AJaeger: so actually I don't really mind if we fix the mimetype or remove the condition completely | 20:10 |
| *** e0ne has joined #openstack-infra | 20:10 | |
| *** e0ne has quit IRC | 20:10 | |
| corvus | tobiash, AJaeger: i'm happy with either; i lean towards removing the check | 20:12 |
| tobiash | corvus: just thought the same | 20:13 |
| *** jamesmcarthur has quit IRC | 20:13 | |
| *** jamesmcarthur has joined #openstack-infra | 20:13 | |
| AJaeger | thanks, tobiash | 20:18 |
| openstackgerrit | Tobias Henkel proposed openstack-infra/zuul-jobs master: Remove mimetype check when calculating size https://review.openstack.org/588150 | 20:21 |
| tobiash | AJaeger, corvus: removed the check ^ | 20:21 |
| AJaeger | tobiash: thanks - +2 | 20:22 |
| clarkb | ssbarnea|bkp2: looks good thanks | 20:37 |
| ssbarnea|bkp2 | clarkb: i have a goal to limit the number of uncategorized failures on tripleo jobs, so expect more queries. | 20:38 |
| clarkb | ssbarnea|bkp2: great. I think that will really help both infra and tripleo identify which specific changes can be made to make the testing more reliable overall | 20:40 |
| fungi | ssbarnea|bkp2: amusing that clarkb actually also suggested that or something like it as a potential cycle goal | 20:40 |
| jrosser | i've been trying some arm64 jobs, they take a long time to start, is that expected? | 20:42 |
| clarkb | jrosser: I think we have a min ready of 1 on those node types so if there is more than one job there will be the boot time lag at startup yes | 20:42 |
| clarkb | jrosser: our available quota remains somewhat small so we probably won't bump that up much until the quotas are bigger | 20:43 |
| corvus | clarkb: are there any other node types in those providers to compete? | 20:43 |
| jrosser | ok, i've just been watching one of my jobs and it seems there are nodes available but i'm 40mins queued | 20:43 |
| fungi | also min-ready is likely pretty low so those nodes ar probably being spun up on demand in some cases? | 20:44 |
| clarkb | corvus: no, just the arm64 types for debian, and two flavors of ubuntu | 20:44 |
| clarkb | jrosser: have an example we can look at? | 20:44 |
| corvus | clarkb: oh, but the 3 flavors are competing; so unless there's a clear favorite there, it probably would be best to keep min-ready low | 20:45 |
| clarkb | corvus: yup | 20:45 |
| jrosser | clarkb: https://review.openstack.org/#/c/618305/ | 20:45 |
| *** bdodd_ has joined #openstack-infra | 20:45 | |
| corvus | request id 300-0000383278 | 20:47 |
| *** dougsz has quit IRC | 20:47 | |
| clarkb | that nodeset exists in ozj and there is an ubunti-bionic-amr64 node ready in the london cloud | 20:48 |
| *** bdodd has quit IRC | 20:48 | |
| clarkb | there are no building nodes in other clouds | 20:48 |
| corvus | it failed in linaro-cn1 | 20:50 |
| corvus | and london | 20:50 |
| corvus | and images were not available in arm64 | 20:51 |
| corvus | it apparently just hasn't reported node_failure yet because it's waiting for something else (?) to decline it | 20:51 |
| clarkb | the image is available in arm64 according to image-list | 20:52 |
| corvus | we should have nodepool-launcher output the list of launchers which might still handle a request | 20:52 |
| corvus | 2018-11-19 20:43:16,740 DEBUG nodepool.driver.NodeRequestHandler[nl03-13009-PoolWorker.vexxhost-sjc1-vexxhost-specific]: Declining node request 300-0000383278 because node type(s) [ubuntu-bionic-arm64] not available | 20:52 |
| corvus | oops wrong one | 20:53 |
| clarkb | | 0000000026 | 0000000001 | arm64ci-nrt1 | ubuntu-bionic-arm64 | ubuntu-bionic-arm64-1542565769 | 97fd7db9-f8dd-4243-95ae-63402f157c02 | ready | 01:02:02:37 | | 20:53 |
| corvus | 2018-11-19 20:43:19,044 DEBUG nodepool.driver.NodeRequestHandler[nl03-13009-PoolWorker.linaro-arm64ci-main]: Declining node request 300-0000383278 because images are not available | 20:53 |
| clarkb | oh do we have a mismatch in config? linaro-arm64ci-main vs amr64ci-nrt1 | 20:53 |
| ianw | hrm, when did "-main" get in there? | 20:54 |
| corvus | that's just the name of the poolworker (the pool name is main) | 20:55 |
| clarkb | linaro-arm64ci is the nl03 provider | 20:55 |
| clarkb | arm64ci-nrt1 is the nb03 name | 20:55 |
| ianw | oh right, sorry | 20:55 |
| corvus | clarkb: ah, yes, *that* mismatch could be important | 20:55 |
| clarkb | so I think that explains some of it. Then the rest of it is just waiting for the other clouds to finish denying the request so the job can fail? | 20:55 |
| corvus | clarkb: yep | 20:55 |
| corvus | the fact that is taking a long time could mean we have a stuck poolworker somewhere | 20:56 |
| *** kjackal has joined #openstack-infra | 20:56 | |
| corvus | but figuring out which is difficult without the extra information i suggested earlier | 20:56 |
| clarkb | ianw: corvus I think we want to use arm64ci-nrt1 then we don't have to reupload images | 20:57 |
| clarkb | if we go the other way around we'd have more cleanup to do | 20:57 |
| corvus | clarkb: hrm. having linaro in the name was really useful just now. | 20:57 |
| corvus | clarkb: otherwise there's no intersection between the names of the 3 clouds | 20:57 |
| clarkb | corvus: well I don't think this cloud is linaro? | 20:58 |
| clarkb | corvus: there are the linaro resources and then this arm backed cloud that doesn't come from linaro | 20:58 |
| corvus | oh, well, in that case we shouldn't call it that. :) | 20:58 |
| corvus | who is providing the cloud? | 20:59 |
| ianw | hang on, "linaro-arm64ci" ... it shouldn't be called that. sorry i'm catching up here, maybe i typoed something | 20:59 |
| clarkb | corvus: gary_perkins is doing the work to deploy openstack on top of packethost for us, but I think it is arm itself that backs the resources | 20:59 |
| ianw | they've requested it just be called arm64ci | 20:59 |
| corvus | clarkb, ianw: then i agree the builder name is better | 21:00 |
| ianw | yeah, that "linaro-" prefix is just my copy-paste typo | 21:00 |
| *** jamesmcarthur has quit IRC | 21:02 | |
| clarkb | I'm going to find lunch now but can write that change or review it if someone else writes it after | 21:03 |
| openstackgerrit | Ian Wienand proposed openstack-infra/project-config master: Fix arm64ci cloud names https://review.openstack.org/618833 | 21:04 |
| corvus | sjc1-main is the missing provider which hasn't declined the request | 21:04 |
| corvus | ah, it finally declined and reported node_failure | 21:05 |
| clarkb | jrosser: thank you for calling that out. clearly there are/were bugs and hopefully we get it moving for you shortly | 21:05 |
| corvus | so 618833 should be the only fix needed | 21:05 |
| corvus | approved | 21:05 |
| jrosser | clarkb: excellent, thankyou. theres been a bit of interest in arm64 from a couple of folks in #osa so i was trying to find the low hanging fruit and see how far we could get with a build | 21:06 |
| ianw | hrm, i also just noticed we're setting the build mirrors on the builders to linaro-london unconditionally | 21:06 |
| ianw | oh no, that's ok, the builder only runs in london, doh | 21:07 |
| ianw | i think i need a coffee | 21:07 |
| *** jamesmcarthur has joined #openstack-infra | 21:08 | |
| ianw | jrosser: i've had a couple of plays with arm64 fedora nodes nodes too, LMN if that's an environment you'd like. needs dib support but i think we could do it | 21:10 |
| jrosser | ianw: for the time being just getting bionic to complete a build would be excellent - i'm reasonably confident there are arm64 packages for everything we need there, but haven't looked at other distros yet | 21:14 |
| jrosser | i have a hunch that the storage is slow on those arm64 nodes too | 21:15 |
| *** jamesmcarthur has quit IRC | 21:16 | |
| *** uberjay has quit IRC | 21:16 | |
| *** uberjay has joined #openstack-infra | 21:17 | |
| ianw | jrosser: that could be right. we've also noticed things a bit slow on the mirror as the AFS cache isn't primed, but running more jobs will help there | 21:22 |
| *** bdodd has joined #openstack-infra | 21:25 | |
| *** bdodd_ has quit IRC | 21:26 | |
| openstackgerrit | Matt Riedemann proposed openstack-infra/elastic-recheck master: Add query for nova test_check_doubled_words py36 bug 1804062 https://review.openstack.org/618839 | 21:27 |
| openstack | bug 1804062 in OpenStack Compute (nova) "test_hacking fails for python 3.6.7 and newer" [Undecided,Confirmed] https://launchpad.net/bugs/1804062 | 21:27 |
| *** gfidente has quit IRC | 21:28 | |
| openstackgerrit | Merged openstack-infra/project-config master: Fix arm64ci cloud names https://review.openstack.org/618833 | 21:29 |
| openstackgerrit | Merged openstack-infra/zuul-jobs master: Remove mimetype check when calculating size https://review.openstack.org/588150 | 21:29 |
| *** e0ne has joined #openstack-infra | 21:35 | |
| *** e0ne has quit IRC | 21:36 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul-jobs master: Revert "validate-host: retry network tests and include unbound logs" https://review.openstack.org/618844 | 21:43 |
| openstackgerrit | Logan V proposed openstack-infra/zuul-jobs master: Skip traceroute when no host is specified https://review.openstack.org/618846 | 21:47 |
| *** kjackal has quit IRC | 21:49 | |
| openstackgerrit | Merged openstack-infra/elastic-recheck master: Add query for nova test_check_doubled_words py36 bug 1804062 https://review.openstack.org/618839 | 21:50 |
| openstackgerrit | Logan V proposed openstack-infra/zuul-jobs master: Skip traceroute when no host is specified https://review.openstack.org/618846 | 21:50 |
| openstack | bug 1804062 in OpenStack Compute (nova) "test_hacking fails for python 3.6.7 and newer" [High,Confirmed] https://launchpad.net/bugs/1804062 | 21:50 |
| *** pcaruana has quit IRC | 21:51 | |
| *** jcoufal has quit IRC | 21:59 | |
| dhellmann | I'm seeing a bunch of release failures while the job syncs the git repo. They look like ipv6 issues: ssh: Could not resolve hostname 2607:ff68:100:54:f816:3eff:fe07:342:22: Name or service not known | 22:03 |
| clarkb | dhellmann: can you link to the failure? | 22:03 |
| dhellmann | http://lists.openstack.org/pipermail/release-job-failures/2018-November/thread.html | 22:03 |
| clarkb | that hostname has the ssh port in the suffix | 22:03 |
| clarkb | and needs the ipv6 addr wrapped in []s | 22:03 |
| dhellmann | http://logs.openstack.org/00/001dbb012a3063795342c641f346c2af5e7db542/tag/publish-openstack-releasenotes-python3/44559b5/ | 22:04 |
| dhellmann | some of the releases worked, and some failed | 22:04 |
| dhellmann | I'm not sure what's different about the jobs | 22:04 |
| clarkb | dhellmann: it would work if it was ipv4 address | 22:04 |
| dhellmann | maybe where they ran? | 22:04 |
| dhellmann | yeah | 22:04 |
| clarkb | ok I know where the problem is | 22:05 |
| clarkb | 2/3 so far today ugh | 22:05 |
| dhellmann | clarkb : on that archives page, the first 1 from today is puppet-cloudkitty | 22:05 |
| openstackgerrit | Clark Boylan proposed openstack-infra/zuul-jobs master: Revert "mirror-workspace-git: use port when pushing git repo through ssh" https://review.openstack.org/618849 | 22:06 |
| clarkb | dhellmann: ^ that will fix it | 22:06 |
| clarkb | tobiash: ^ fyi | 22:06 |
| * clarkb tests if ipv4 addresses can be wrapped in []s | 22:07 | |
| clarkb | nope | 22:08 |
| dhellmann | whee | 22:08 |
| clarkb | infra-root can you take a quick look at 618849 to fix the repo syncing? | 22:09 |
| *** trown is now known as trown|outtypewww | 22:10 | |
| dhellmann | clarkb : https://docs.ansible.com/ansible/2.7/user_guide/playbooks_filters_ipaddr.html has a thing to wrap the IP | 22:11 |
| *** HenryG has quit IRC | 22:12 | |
| clarkb | ah cool | 22:12 |
| clarkb | let me push up a fix then | 22:12 |
| pabelanger | +2 | 22:13 |
| *** agopi is now known as agopi|brb | 22:13 | |
| clarkb | actually let me go ahead and approve the revert and then base fix on top of that | 22:13 |
| clarkb | since I think jobs must be unhappy as is | 22:13 |
| *** HenryG has joined #openstack-infra | 22:14 | |
| dhellmann | https://etherpad.openstack.org/p/L8b5m4HuiJ has a list of the failures with the "triggered by" urls. Only 3 will need to be re-enqueued | 22:16 |
| openstackgerrit | Clark Boylan proposed openstack-infra/zuul-jobs master: mirror-workspace-git: use port when pushing git repo through ssh https://review.openstack.org/618859 | 22:17 |
| clarkb | and there is the followup with the ipwrap fix | 22:17 |
| dhellmann | lgtm | 22:18 |
| clarkb | dhellmann: ok once the fix is in it should go into effect immediately and we can reenqueue any that need that | 22:18 |
| *** agopi|brb has quit IRC | 22:18 | |
| dhellmann | great, thanks! | 22:18 |
| clarkb | I feel like this is Zuul's way of telling us "go home you're still jet lagged" | 22:19 |
| dhellmann | I blame the w3c or whoever came up with that silly url syntax in the first place | 22:22 |
| dhellmann | or the ipv6 addressing syntax | 22:23 |
| dhellmann | either way, clearly it's someone else's fault | 22:23 |
| clarkb | ya its frustrating that it conflicts with a common syntax for specifying port numbers | 22:23 |
| dhellmann | it would probably be too much of a hassle to create an /etc/hosts entry for every host we need to contact instead of passing IP addresses around | 22:25 |
| clarkb | dhellmann: we do do it for multinode jobs on the test nodes. In this case though its zuul executor to test node and that would get complicated I expect | 22:26 |
| dhellmann | yeah | 22:26 |
| *** jtomasek has quit IRC | 22:30 | |
| clarkb | if the unittests pass on that revert I"m just going to merge it. I think part of the trouble getting the jobs to run is the bug the revert fixes | 22:33 |
| *** boden has quit IRC | 22:34 | |
| clarkb | the "good" news is that I think most of the failures would be in pre run | 22:36 |
| *** trown has joined #openstack-infra | 22:37 | |
| *** dklyle has quit IRC | 22:37 | |
| *** dayou_ has joined #openstack-infra | 22:37 | |
| *** slaweq__ has joined #openstack-infra | 22:37 | |
| *** dklyle has joined #openstack-infra | 22:38 | |
| *** mgoddard has quit IRC | 22:39 | |
| *** kgiusti has quit IRC | 22:39 | |
| *** slaweq_ has quit IRC | 22:39 | |
| *** dayou has quit IRC | 22:39 | |
| *** jesusaur has quit IRC | 22:39 | |
| *** jbadiapa has quit IRC | 22:39 | |
| *** dhellmann has quit IRC | 22:39 | |
| *** bandini has quit IRC | 22:39 | |
| *** imacdonn has quit IRC | 22:39 | |
| *** mriedem has quit IRC | 22:39 | |
| *** trown|outtypewww has quit IRC | 22:39 | |
| *** manjeets has quit IRC | 22:39 | |
| *** dhellmann has joined #openstack-infra | 22:40 | |
| *** jbadiapa has joined #openstack-infra | 22:40 | |
| openstackgerrit | Merged openstack-infra/zuul-jobs master: Revert "mirror-workspace-git: use port when pushing git repo through ssh" https://review.openstack.org/618849 | 22:41 |
| *** jesusaur has joined #openstack-infra | 22:41 | |
| *** imacdonn has joined #openstack-infra | 22:41 | |
| clarkb | #status log clarkb force merged https://review.openstack.org/618849 to fix a bug in zuul-jobs that was effecting many jobs. Long story short we have to accomdoate ipv6 addresses in zuul-jobs. | 22:41 |
| openstackstatus | clarkb: finished logging | 22:41 |
| clarkb | dhellmann: so ya if you get us a list of things that need fixing for the release team we can reenqueue | 22:42 |
| *** mgoddard has joined #openstack-infra | 22:45 | |
| dhellmann | clarkb : top of https://etherpad.openstack.org/p/L8b5m4HuiJ | 22:45 |
| dhellmann | 3 releases | 22:45 |
| dhellmann | if that's not enough detail (like if you need version numbers, let me know and i can pull those) | 22:46 |
| clarkb | dhellmann: I can probably work backward from that | 22:46 |
| clarkb | dhellmann: why don't I add the zuul enqueue ref commands to the etherpad and you can double check they look good then I will run them | 22:47 |
| fungi | clarkb: don | 22:49 |
| fungi | er | 22:49 |
| fungi | don't forget you can also just feed them to the script in https://review.openstack.org/613676 | 22:49 |
| clarkb | oh neat. well I think I have constructed the commands already | 22:50 |
| clarkb | dhellmann: care to review that list and I'll run them as soon as you are happy with them | 22:50 |
| *** rpioso|afk is now known as rpioso | 22:53 | |
| ianw | discussing the fedora mirroring issues (https://review.openstack.org/618504) in #fedora-admin, looks like upstream still setting setgid bits which we can't handle | 22:57 |
| clarkb | ianw: and that isn't a bug on their end? | 22:58 |
| dhellmann | clarkb : those version numbers look right but I'm not sure about the SHAs. are those from the signed tags? | 22:59 |
| clarkb | dhellmann: yes that is the sha for the tag itself | 22:59 |
| dhellmann | ok, then those look ok | 23:00 |
| ianw | clarkb: yeah it does appear it's unintended on their end | 23:02 |
| clarkb | dhellmann: alright those should be enqueued now | 23:02 |
| dhellmann | I see them | 23:02 |
| *** Goneri has quit IRC | 23:03 | |
| clarkb | ianw: I'm ok with dropping -p since we basically only have to ensure that apache can read the files and that doesn't require a -p | 23:03 |
| ianw | yeah, me too -- but it's just such a weird thing to have randomly set i thought upstream might like to root cause what's going on | 23:04 |
| ianw | i was chatting with auristor and mentioned that kafs enabled kernels are making it into fedora | 23:05 |
| ianw | so that's what was prompting me that we could have a CI job bringing up a ansible-only kafs mirror node | 23:06 |
| clarkb | ianw: to test our deployment or to serve as a per job mirror? | 23:09 |
| ianw | clarkb: as in using kafs for the next generation of puppet-less mirrors | 23:10 |
| clarkb | got it | 23:11 |
| clarkb | that would simplify things for arm in particular right? | 23:11 |
| clarkb | (since it is in tree) | 23:11 |
| ianw | sort of ... except if we're going down the fedora path we don't have dib building arm64 fedora images (see previous discussions :) | 23:12 |
| ianw | but presumably it will be available in ubuntu same in whatever form | 23:12 |
| ianw | i think phase 1 is just to be able to get it up and do a "ls" | 23:13 |
| *** jamesmcarthur has joined #openstack-infra | 23:16 | |
| ianw | clarkb: if you have a moment though, https://review.openstack.org/#/c/614375/ and https://review.openstack.org/#/c/618416/ would be good so we can remove f27 and get a bit of space back on the afs volumes | 23:17 |
| ianw | i'll bring up pypi removal at the meeting tomorrow | 23:17 |
| clarkb | both lgtm | 23:20 |
| *** agopi|brb has joined #openstack-infra | 23:20 | |
| *** jamesmcarthur has quit IRC | 23:21 | |
| clarkb | do we know why https://review.openstack.org/#/c/618671/2 seems to be unhappy? is it the lack of the 29 mirror? | 23:22 |
| *** agopi|brb is now known as agopi | 23:22 | |
| *** rh-jelabarre has quit IRC | 23:32 | |
| *** xek_ has joined #openstack-infra | 23:33 | |
| *** xek has quit IRC | 23:35 | |
| *** lbragstad has quit IRC | 23:40 | |
| *** xek__ has joined #openstack-infra | 23:49 | |
| *** xek_ has quit IRC | 23:52 | |
| dhellmann | clarkb : those releases worked this time, thanks for the help! | 23:54 |
| *** jamesmcarthur has joined #openstack-infra | 23:55 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!