| clarkb | ianw: no objection from me but I've got to pop off here shortly | 00:00 |
|---|---|---|
| clarkb | the dfw image cleanup is running in screen in dfw so that can run in the background and will take time | 00:00 |
| *** jamesmcarthur has joined #openstack-infra | 00:01 | |
| ianw | oh we still leaking? i need to read scroll back | 00:01 |
| fungi | sdk regression | 00:02 |
| * mordred is also trying to figure that out | 00:02 | |
| ianw | clarkb: i also missed the cut off just for meeting but i'd like to sneak in an item for my plans update backup server if ok, i'll add it in a sec | 00:04 |
| clarkb | ianw: ok | 00:04 |
| fungi | should the announcements include the spf change? | 00:05 |
| fungi | i was unsure | 00:05 |
| clarkb | fungi: announcements? | 00:05 |
| fungi | announcements portion of the meeting | 00:06 |
| fungi | oh, may also want to announce the service-announce ml | 00:06 |
| clarkb | re spf I'm not sure we need to announce it broadly considering we are only enforcing failures | 00:06 |
| clarkb | so doing what was asked of us | 00:06 |
| clarkb | announcing the other mailing list would probably be a good idea | 00:07 |
| fungi | yup, that's why i was unsure | 00:07 |
| fungi | about spf | 00:07 |
| fungi | being announcement-worthy | 00:07 |
| *** michael-beaver has quit IRC | 00:09 | |
| *** goldyfruit has joined #openstack-infra | 00:10 | |
| *** markvoelker has joined #openstack-infra | 00:16 | |
| *** nicolasbock has quit IRC | 00:16 | |
| *** weifan has quit IRC | 00:21 | |
| *** weifan has joined #openstack-infra | 00:22 | |
| *** lseki has quit IRC | 00:25 | |
| *** weifan has quit IRC | 00:26 | |
| *** rcernin_ has quit IRC | 00:41 | |
| *** rcernin has joined #openstack-infra | 00:41 | |
| *** smarcet has joined #openstack-infra | 00:44 | |
| *** yamamoto has joined #openstack-infra | 00:46 | |
| openstackgerrit | Kevin Carter (cloudnull) proposed zuul/zuul-jobs master: Add sanity checks https://review.opendev.org/664471 | 00:48 |
| *** markvoelker has quit IRC | 00:49 | |
| *** jamesmcarthur has quit IRC | 00:52 | |
| *** igordc has quit IRC | 00:56 | |
| *** mattw4 has quit IRC | 00:57 | |
| *** gregoryo has joined #openstack-infra | 00:58 | |
| ianw | dmsimard: re ERROR! Unexpected Exception, this is probably a bug: Unable to import Django: the server dependencies can be installed with 'pip install ara[server]' errors in devel job, is django really required? | 00:59 |
| *** icarusfactor has joined #openstack-infra | 01:00 | |
| ianw | the other thing -- "The TRANSFORM_INVALID_GROUP_CHARS settings is set to allow bad characters in group names by default, this will change, but still be user configurable on deprecation." sounds like a big mess even reading the github issue | 01:01 |
| *** factor has quit IRC | 01:02 | |
| *** smarcet has quit IRC | 01:07 | |
| *** ricolin has joined #openstack-infra | 01:10 | |
| openstackgerrit | Tristan Cacqueray proposed opendev/gerritbot master: Support missing daemon lib https://review.opendev.org/664472 | 01:12 |
| ianw | ok, ara django changes make more sense if not looking at a super old checkout pre opendev.org change | 01:12 |
| *** icarusfactor has quit IRC | 01:19 | |
| *** factor__ has joined #openstack-infra | 01:19 | |
| *** factor__ has quit IRC | 01:24 | |
| *** factor__ has joined #openstack-infra | 01:25 | |
| *** sshnaidm has quit IRC | 01:33 | |
| openstackgerrit | Ian Wienand proposed opendev/system-config master: Add "server" extras for ARA https://review.opendev.org/664478 | 01:34 |
| *** gyee has quit IRC | 01:34 | |
| *** sshnaidm has joined #openstack-infra | 01:35 | |
| *** jamesmcarthur has joined #openstack-infra | 01:35 | |
| *** jamesmcarthur has quit IRC | 01:37 | |
| *** markvoelker has joined #openstack-infra | 01:46 | |
| openstackgerrit | Merged opendev/system-config master: bridge.opendev.org: use Ansible 2.8.0 stable https://review.opendev.org/662662 | 01:48 |
| openstackgerrit | Merged opendev/system-config master: Update to ansible-lint 4.1.0 https://review.opendev.org/663501 | 01:48 |
| *** yamamoto has quit IRC | 01:48 | |
| *** factor__ has quit IRC | 01:49 | |
| *** factor__ has joined #openstack-infra | 01:50 | |
| *** diablo_rojo has joined #openstack-infra | 02:03 | |
| *** bhavikdbavishi has joined #openstack-infra | 02:05 | |
| *** whoami-rajat has joined #openstack-infra | 02:09 | |
| *** bhavikdbavishi has quit IRC | 02:09 | |
| *** michael-beaver has joined #openstack-infra | 02:12 | |
| *** smarcet has joined #openstack-infra | 02:13 | |
| openstackgerrit | Kevin Carter (cloudnull) proposed zuul/zuul-jobs master: Update the readme for new role options https://review.opendev.org/664484 | 02:14 |
| *** factor__ has quit IRC | 02:17 | |
| *** factor__ has joined #openstack-infra | 02:18 | |
| *** factor__ has quit IRC | 02:18 | |
| *** markvoelker has quit IRC | 02:20 | |
| openstackgerrit | Kevin Carter (cloudnull) proposed zuul/zuul-jobs master: Add variable to set the docker download url https://review.opendev.org/664485 | 02:22 |
| *** hongbin has joined #openstack-infra | 02:25 | |
| openstackgerrit | Kevin Carter (cloudnull) proposed zuul/zuul-jobs master: Update the readme for new role options https://review.opendev.org/664484 | 02:49 |
| openstackgerrit | Kevin Carter (cloudnull) proposed zuul/zuul-jobs master: Add variable to set the docker download url https://review.opendev.org/664485 | 02:49 |
| *** yamamoto has joined #openstack-infra | 02:50 | |
| *** bhavikdbavishi has joined #openstack-infra | 02:56 | |
| *** bhavikdbavishi1 has joined #openstack-infra | 02:59 | |
| *** bhavikdbavishi has quit IRC | 03:01 | |
| *** bhavikdbavishi1 is now known as bhavikdbavishi | 03:01 | |
| *** bnemec has quit IRC | 03:07 | |
| *** bnemec has joined #openstack-infra | 03:08 | |
| openstackgerrit | Kevin Carter (cloudnull) proposed zuul/zuul-jobs master: Update the readme for new role options https://review.opendev.org/664484 | 03:12 |
| *** diablo_rojo has quit IRC | 03:14 | |
| *** markvoelker has joined #openstack-infra | 03:17 | |
| *** bhavikdbavishi1 has joined #openstack-infra | 03:18 | |
| *** bhavikdbavishi has quit IRC | 03:20 | |
| *** bhavikdbavishi1 is now known as bhavikdbavishi | 03:20 | |
| *** psachin has joined #openstack-infra | 03:39 | |
| openstackgerrit | Ian Wienand proposed opendev/system-config master: Update to ARA 1.0.1 https://review.opendev.org/664478 | 03:42 |
| *** markvoelker has quit IRC | 03:50 | |
| *** ramishra has joined #openstack-infra | 03:59 | |
| openstackgerrit | Ian Wienand proposed opendev/system-config master: Update to ARA 1.0.1 https://review.opendev.org/664478 | 03:59 |
| *** hongbin has quit IRC | 04:01 | |
| *** udesale has joined #openstack-infra | 04:05 | |
| *** janki has joined #openstack-infra | 04:10 | |
| *** apetrich has joined #openstack-infra | 04:13 | |
| *** verdurin has quit IRC | 04:19 | |
| openstackgerrit | Ian Wienand proposed opendev/system-config master: Update to ARA 1.0.1 https://review.opendev.org/664478 | 04:21 |
| *** dave-mccowan has quit IRC | 04:23 | |
| *** verdurin has joined #openstack-infra | 04:28 | |
| openstackgerrit | Ian Wienand proposed opendev/system-config master: Update to ARA 1.0.1 https://review.opendev.org/664478 | 04:43 |
| *** markvoelker has joined #openstack-infra | 04:47 | |
| *** michael-beaver has quit IRC | 05:02 | |
| *** e0ne has joined #openstack-infra | 05:15 | |
| *** bhavikdbavishi1 has joined #openstack-infra | 05:19 | |
| *** bhavikdbavishi has quit IRC | 05:19 | |
| *** bhavikdbavishi1 is now known as bhavikdbavishi | 05:19 | |
| *** kjackal has joined #openstack-infra | 05:19 | |
| *** weifan has joined #openstack-infra | 05:20 | |
| *** markvoelker has quit IRC | 05:21 | |
| *** bhavikdbavishi has quit IRC | 05:23 | |
| *** ykarel has joined #openstack-infra | 05:23 | |
| *** weifan has quit IRC | 05:26 | |
| *** lpetrut has joined #openstack-infra | 05:28 | |
| *** weifan has joined #openstack-infra | 05:35 | |
| *** udesale has quit IRC | 05:35 | |
| *** udesale has joined #openstack-infra | 05:36 | |
| *** ykarel_ has joined #openstack-infra | 05:36 | |
| openstackgerrit | Ian Wienand proposed opendev/system-config master: Update to ARA 1.0.1 https://review.opendev.org/664478 | 05:38 |
| *** ykarel has quit IRC | 05:39 | |
| *** bhavikdbavishi has joined #openstack-infra | 05:41 | |
| *** e0ne has quit IRC | 05:42 | |
| *** lpetrut has quit IRC | 05:43 | |
| *** weifan has quit IRC | 05:44 | |
| openstackgerrit | Tristan Cacqueray proposed zuul/nodepool master: static: enable using a single host with different user or port https://review.opendev.org/659209 | 05:47 |
| openstackgerrit | Merged zuul/zuul master: Annotate logs around build states https://review.opendev.org/661489 | 05:51 |
| *** threestrands has joined #openstack-infra | 05:52 | |
| *** threestrands has quit IRC | 05:53 | |
| openstackgerrit | Tristan Cacqueray proposed zuul/nodepool master: static: document multiple labels shortcomming https://review.opendev.org/662954 | 05:55 |
| *** dchen has quit IRC | 06:12 | |
| openstackgerrit | Merged zuul/zuul master: Annotate logs around reporting https://review.opendev.org/661490 | 06:12 |
| *** dchen has joined #openstack-infra | 06:15 | |
| *** markvoelker has joined #openstack-infra | 06:18 | |
| *** smarcet has quit IRC | 06:22 | |
| *** ykarel__ has joined #openstack-infra | 06:29 | |
| *** pgaxatte has joined #openstack-infra | 06:31 | |
| *** ykarel_ has quit IRC | 06:31 | |
| *** udesale has quit IRC | 06:32 | |
| *** udesale has joined #openstack-infra | 06:32 | |
| openstackgerrit | Merged zuul/zuul master: Annotate logs around finished builds https://review.opendev.org/661491 | 06:33 |
| *** ccamacho has joined #openstack-infra | 06:36 | |
| *** yamamoto has quit IRC | 06:40 | |
| *** lpetrut has joined #openstack-infra | 06:46 | |
| *** markvoelker has quit IRC | 06:51 | |
| *** ginopc has joined #openstack-infra | 06:54 | |
| *** pcaruana has joined #openstack-infra | 06:55 | |
| *** slaweq has joined #openstack-infra | 06:56 | |
| *** nicolasbock has joined #openstack-infra | 06:57 | |
| *** yamamoto has joined #openstack-infra | 06:58 | |
| *** jtomasek has joined #openstack-infra | 07:05 | |
| *** rpittau|afk is now known as rpittau | 07:08 | |
| *** rcernin has quit IRC | 07:08 | |
| *** tesseract has joined #openstack-infra | 07:08 | |
| *** rh-jelabarre has quit IRC | 07:11 | |
| *** ramishra has quit IRC | 07:13 | |
| *** tosky has joined #openstack-infra | 07:17 | |
| *** slaweq has quit IRC | 07:20 | |
| *** e0ne has joined #openstack-infra | 07:20 | |
| openstackgerrit | Mark Meyer proposed zuul/zuul master: Extend event reporting https://review.opendev.org/662134 | 07:22 |
| *** dayou has quit IRC | 07:23 | |
| *** ykarel__ is now known as ykarel|lunch | 07:24 | |
| *** ramishra has joined #openstack-infra | 07:30 | |
| *** dayou has joined #openstack-infra | 07:37 | |
| *** yboaron has joined #openstack-infra | 07:42 | |
| *** jpena|off is now known as jpena | 07:46 | |
| *** markvoelker has joined #openstack-infra | 07:48 | |
| *** kopecmartin|off is now known as kopecmartin | 07:51 | |
| *** udesale has quit IRC | 07:53 | |
| *** udesale has joined #openstack-infra | 07:53 | |
| *** jpich has joined #openstack-infra | 08:02 | |
| *** gfidente has joined #openstack-infra | 08:02 | |
| *** dtantsur|afk is now known as dtantsur | 08:02 | |
| *** nicolasbock has quit IRC | 08:04 | |
| *** dchen has quit IRC | 08:04 | |
| *** tkajinam has quit IRC | 08:05 | |
| openstackgerrit | Mark Meyer proposed zuul/zuul master: Extend event reporting https://review.opendev.org/662134 | 08:07 |
| *** lucasagomes has joined #openstack-infra | 08:07 | |
| *** ociuhandu has joined #openstack-infra | 08:07 | |
| openstackgerrit | Ian Wienand proposed opendev/system-config master: Pin ARA on devel job to stable branch https://review.opendev.org/664522 | 08:08 |
| *** ralonsoh has joined #openstack-infra | 08:09 | |
| *** gregoryo has quit IRC | 08:12 | |
| *** liuyulong has joined #openstack-infra | 08:16 | |
| *** ykarel|lunch is now known as ykarel | 08:18 | |
| evrardjp | corvus: I know I am painful to reiterate on https://review.opendev.org/#/c/662828/ -- but do you have time to chat about this today? Having an out of the box thinking/solution for example :) | 08:19 |
| *** markvoelker has quit IRC | 08:22 | |
| openstackgerrit | Merged openstack/project-config master: Add api-ref for Qinling https://review.opendev.org/664030 | 08:25 |
| *** dayou has quit IRC | 08:28 | |
| *** yboaron has quit IRC | 08:33 | |
| *** yboaron has joined #openstack-infra | 08:33 | |
| openstackgerrit | Mark Meyer proposed zuul/zuul master: Extend event reporting https://review.opendev.org/662134 | 08:35 |
| *** roman_g has joined #openstack-infra | 08:36 | |
| *** imacdonn has quit IRC | 08:38 | |
| *** imacdonn has joined #openstack-infra | 08:38 | |
| openstackgerrit | Tobias Henkel proposed zuul/zuul master: Parallelize github event processing https://review.opendev.org/662818 | 08:39 |
| *** derekh has joined #openstack-infra | 08:40 | |
| *** dayou has joined #openstack-infra | 08:41 | |
| openstackgerrit | Tobias Henkel proposed zuul/zuul master: Allow to select the merge method in Github https://review.opendev.org/617949 | 08:52 |
| openstackgerrit | Tobias Henkel proposed zuul/zuul master: Support squash merge in Github https://review.opendev.org/661096 | 08:52 |
| *** priteau has joined #openstack-infra | 08:57 | |
| *** udesale has quit IRC | 08:59 | |
| *** rcernin has joined #openstack-infra | 09:02 | |
| *** udesale has joined #openstack-infra | 09:07 | |
| *** liuyulong has quit IRC | 09:11 | |
| *** iurygregory has quit IRC | 09:17 | |
| *** dayou has quit IRC | 09:18 | |
| *** markvoelker has joined #openstack-infra | 09:19 | |
| *** tobberydberg has quit IRC | 09:22 | |
| openstackgerrit | Mark Meyer proposed zuul/zuul master: Extend event reporting https://review.opendev.org/662134 | 09:25 |
| *** iurygregory has joined #openstack-infra | 09:26 | |
| *** nicolasbock has joined #openstack-infra | 09:26 | |
| *** iurygregory has quit IRC | 09:29 | |
| *** tobberydberg has joined #openstack-infra | 09:31 | |
| *** dayou has joined #openstack-infra | 09:32 | |
| *** yamamoto has quit IRC | 09:32 | |
| *** yamamoto has joined #openstack-infra | 09:37 | |
| openstackgerrit | Mark Meyer proposed zuul/zuul master: Extend event reporting https://review.opendev.org/662134 | 09:45 |
| openstackgerrit | Divya K Konoor proposed opendev/irc-meetings master: Update PowerVM Meeting timing https://review.opendev.org/664536 | 09:47 |
| *** panda has quit IRC | 09:47 | |
| *** slaweq has joined #openstack-infra | 09:47 | |
| *** panda has joined #openstack-infra | 09:49 | |
| *** markvoelker has quit IRC | 09:52 | |
| *** ykarel is now known as ykarel|afk | 09:57 | |
| openstackgerrit | Mark Meyer proposed zuul/zuul master: Extend event reporting https://review.opendev.org/662134 | 09:59 |
| *** yamamoto has quit IRC | 10:03 | |
| *** yamamoto has joined #openstack-infra | 10:07 | |
| openstackgerrit | Tobias Henkel proposed zuul/zuul master: Allow to select the merge method in Github https://review.opendev.org/617949 | 10:08 |
| openstackgerrit | Tobias Henkel proposed zuul/zuul master: Support squash merge in Github https://review.opendev.org/661096 | 10:08 |
| openstackgerrit | Fabien Boucher proposed zuul/zuul master: Disable gc in test_scheduler.TestExecutor https://review.opendev.org/661316 | 10:13 |
| openstackgerrit | Fabien Boucher proposed zuul/zuul master: Disable gc in test_scheduler.TestExecutor https://review.opendev.org/661316 | 10:14 |
| openstackgerrit | Fabien Boucher proposed zuul/zuul master: Pagure driver - https://pagure.io/pagure/ https://review.opendev.org/604404 | 10:14 |
| *** pcaruana has quit IRC | 10:19 | |
| *** yamamoto has quit IRC | 10:24 | |
| *** tdasilva_ has quit IRC | 10:25 | |
| openstackgerrit | Mark Meyer proposed zuul/zuul master: Extend event reporting https://review.opendev.org/662134 | 10:31 |
| *** slaweq has quit IRC | 10:31 | |
| *** bhavikdbavishi has quit IRC | 10:39 | |
| *** slaweq has joined #openstack-infra | 10:40 | |
| *** iurygregory has joined #openstack-infra | 10:44 | |
| *** markvoelker has joined #openstack-infra | 10:49 | |
| *** jchhatbar has joined #openstack-infra | 10:55 | |
| *** yamamoto has joined #openstack-infra | 10:56 | |
| *** janki has quit IRC | 10:56 | |
| *** ykarel|afk is now known as ykarel | 10:57 | |
| openstackgerrit | Stephen Finucane proposed openstack/openstack-zuul-jobs master: Add support for building PDFs https://review.opendev.org/664555 | 10:58 |
| *** slaweq has quit IRC | 10:59 | |
| *** jchhatbar has quit IRC | 10:59 | |
| *** janki has joined #openstack-infra | 10:59 | |
| *** janki has quit IRC | 11:00 | |
| *** yamamoto has quit IRC | 11:00 | |
| *** janki has joined #openstack-infra | 11:01 | |
| *** pcaruana has joined #openstack-infra | 11:09 | |
| *** udesale has quit IRC | 11:20 | |
| *** markvoelker has quit IRC | 11:21 | |
| *** dave-mccowan has joined #openstack-infra | 11:22 | |
| openstackgerrit | Mark Meyer proposed zuul/zuul master: Extend event reporting https://review.opendev.org/662134 | 11:31 |
| *** jpena is now known as jpena|lunch | 11:38 | |
| *** Goneri has quit IRC | 11:39 | |
| *** rcernin has quit IRC | 11:43 | |
| *** bhavikdbavishi has joined #openstack-infra | 11:45 | |
| *** janki has quit IRC | 11:51 | |
| *** janki has joined #openstack-infra | 11:51 | |
| *** yamamoto has joined #openstack-infra | 11:56 | |
| *** rlandy has joined #openstack-infra | 11:58 | |
| *** rlandy is now known as rlandy|ruck | 11:59 | |
| openstackgerrit | Mark Meyer proposed zuul/zuul master: Extend event reporting https://review.opendev.org/662134 | 12:02 |
| *** yamamoto has quit IRC | 12:04 | |
| *** dave-mccowan has quit IRC | 12:05 | |
| *** jcoufal has joined #openstack-infra | 12:12 | |
| *** goldyfruit has quit IRC | 12:17 | |
| *** jchhatbar has joined #openstack-infra | 12:21 | |
| openstackgerrit | Kevin Carter (cloudnull) proposed zuul/zuul-jobs master: Add variable to set the docker download url https://review.opendev.org/664485 | 12:24 |
| *** pkopec has joined #openstack-infra | 12:24 | |
| *** pkopec has quit IRC | 12:24 | |
| *** janki has quit IRC | 12:24 | |
| openstackgerrit | Merged opendev/irc-meetings master: Update PowerVM Meeting timing https://review.opendev.org/664536 | 12:24 |
| *** ricolin_ has joined #openstack-infra | 12:27 | |
| *** jchhatbar has quit IRC | 12:27 | |
| *** jchhatbar has joined #openstack-infra | 12:27 | |
| *** ricolin has quit IRC | 12:29 | |
| *** slaweq has joined #openstack-infra | 12:30 | |
| *** gfidente has quit IRC | 12:32 | |
| *** rfarr__ has joined #openstack-infra | 12:32 | |
| *** gfidente has joined #openstack-infra | 12:34 | |
| *** rfarr_ has joined #openstack-infra | 12:35 | |
| *** rfarr__ has quit IRC | 12:38 | |
| *** eharney has quit IRC | 12:39 | |
| *** smarcet has joined #openstack-infra | 12:41 | |
| *** jpena|lunch is now known as jpena | 12:43 | |
| *** zbr|ruck is now known as zbr|rover | 12:44 | |
| *** slaweq has quit IRC | 12:46 | |
| *** jamesmcarthur has joined #openstack-infra | 12:51 | |
| openstackgerrit | Sorin Sbarnea proposed zuul/zuul-jobs master: Adds tox-molecule job https://review.opendev.org/664230 | 12:54 |
| *** udesale has joined #openstack-infra | 12:55 | |
| *** ekultails has joined #openstack-infra | 12:56 | |
| openstackgerrit | Sorin Sbarnea proposed openstack/openstack-zuul-jobs master: Adds openstack-tox-molecule template https://review.opendev.org/663599 | 12:56 |
| openstackgerrit | Sorin Sbarnea proposed openstack/openstack-zuul-jobs master: Adds openstack-tox-molecule template https://review.opendev.org/663599 | 13:01 |
| *** aaronsheffield has joined #openstack-infra | 13:01 | |
| *** rh-jelabarre has joined #openstack-infra | 13:01 | |
| *** jamesmcarthur has quit IRC | 13:02 | |
| cloudnull | if folks have a moment to review this set https://review.opendev.org/#/q/topic:docker-multi-distro+status:open - I would greatly appreciate it | 13:03 |
| openstackgerrit | Sorin Sbarnea proposed openstack/openstack-zuul-jobs master: Adds openstack-tox-molecule template https://review.opendev.org/663599 | 13:04 |
| ildikov | saw this on a docs build job output: "ERROR: Sphinx requires Python '>=3.5' but the running Python is 2.7.15" | 13:05 |
| ildikov | full log: http://logs.openstack.org/05/664405/3/check/build-tox-manuals-checkbuild/07cc6e2/job-output.txt.gz | 13:06 |
| ildikov | patch: https://review.opendev.org/#/c/664405/ | 13:06 |
| ildikov | can anyone help figuring out if this is environment related or some messed up settings in the repo? | 13:07 |
| ildikov | if it was brought up already then apologies :) | 13:07 |
| *** nicolasbock has quit IRC | 13:07 | |
| *** nicolasbock has joined #openstack-infra | 13:08 | |
| zbr|rover | ildikov: sphinx 2 dropped support for py27. only two workarounds: either change jobs to use py3 or limit sphinx version. | 13:09 |
| openstackgerrit | Tobias Henkel proposed zuul/zuul master: Evaluate CODEOWNERS settings during canMerge check https://review.opendev.org/644557 | 13:10 |
| ildikov | zbr|rover: ah ok, that was one of my guesses, but wasn't sure | 13:10 |
| ildikov | zbr|rover: thanks! | 13:10 |
| *** lseki has joined #openstack-infra | 13:14 | |
| *** mriedem has joined #openstack-infra | 13:16 | |
| *** tdasilva has joined #openstack-infra | 13:17 | |
| ildikov | zbr|rover: quick dumb question | 13:18 |
| ildikov | zbr|rover: I saw in tox.ini that there's a basepython set to python3: https://opendev.org/openstack/training-guides/src/branch/master/tox.ini | 13:18 |
| *** markvoelker has joined #openstack-infra | 13:18 | |
| ildikov | zbr|rover: if I need to fix up something with the jobs themselves (https://opendev.org/openstack/training-guides/src/branch/master/.zuul.yaml) where can I locate where the changes need to be made? | 13:19 |
| zbr|rover | ildikov: you need to add basepython = python3 to the tox env that fails (did not check which one is used) | 13:22 |
| *** markvoelker has quit IRC | 13:23 | |
| ildikov | zbr|rover: is the problem that basepython is specified under [testenv:venv] as opposed to just [testenv]? | 13:23 |
| ildikov | zbr|rover: as I assumed there're some dependencies between those sections | 13:24 |
| zbr|rover | ildikov: don't touch the default one, venv is useless for CI. | 13:24 |
| ildikov | zbr|rover: the one that fails is checkbuild, but others will fail eventually too | 13:24 |
| zbr|rover | ildikov: no deps unless manually added | 13:24 |
| *** Goneri has joined #openstack-infra | 13:25 | |
| ildikov | zbr|rover: for openstack-manuals the basepython is defined under [testenv] and only there: https://opendev.org/openstack/openstack-manuals/src/branch/master/tox.ini | 13:25 |
| ildikov | zbr|rover: so I assumed we would need to follow that model as well | 13:25 |
| *** goldyfruit has joined #openstack-infra | 13:26 | |
| *** jamesmcarthur has joined #openstack-infra | 13:26 | |
| *** signed8bit has joined #openstack-infra | 13:26 | |
| *** eharney has joined #openstack-infra | 13:26 | |
| zbr|rover | i guess that for manuals nobody will complain if we force python3 on all environments. | 13:27 |
| zbr|rover | we already have goal of python3 first,.... | 13:27 |
| fungi | you _can_ set basepython=python3 in the main [testenv] definition but you need ignore_basepython_conflict=True set in the [tox] section to still be able to run things for other python interpreter versions which aren't your default python3 | 13:28 |
| zbr|rover | but unless you mention the basepython, tox may pick py27 on some platforms. | 13:28 |
| openstackgerrit | Mark Meyer proposed zuul/zuul master: Extend event reporting https://review.opendev.org/662134 | 13:28 |
| fungi | pretty sure the official openstack projects already got their docs jobs switched to run in python3 a while back | 13:28 |
| ildikov | we didn't pick up on that in training-guides | 13:28 |
| fungi | possible the training-guides repo is not though | 13:28 |
| ildikov | I assume people thought the [testenv:venv] section is going to cut it | 13:29 |
| *** yamamoto has joined #openstack-infra | 13:29 | |
| fungi | ahh, yeah not many projects use the build-tox-manuals job, so that one may simply have been missed in the python3 transition | 13:29 |
| fungi | and the projects which do may still be pinning sphinx<2 | 13:29 |
| ildikov | fungi: what's the best way forward? | 13:29 |
| ildikov | I don't want to pin the sphinx version unless we really need to | 13:30 |
| ildikov | as it'll be forgotten just like the prep work for the python 3 transition... | 13:31 |
| fungi | i believe there's a variable we set in job definitions if we want to tell tox to use python3 | 13:31 |
| fungi | finding an example now | 13:32 |
| ildikov | now I only need a little guidance on where that might be :) | 13:32 |
| *** bhavikdbavishi has quit IRC | 13:33 | |
| *** slittle1 has joined #openstack-infra | 13:34 | |
| *** sthussey has joined #openstack-infra | 13:34 | |
| slittle1 | Are there any infrastructure cores that can take a look at ... https://review.opendev.org/#/c/663954/ ... Thanks, Scott | 13:35 |
| fungi | ildikov: i see in some job variants we're passing in "sphinx_python: python3" for vars, but not seeing it set on normal docs jobs | 13:37 |
| ildikov | fungi: do those use what's set in [testenv]? | 13:38 |
| ildikov | as I saw basepython set to python3 there | 13:38 |
| *** ykarel is now known as ykarel|away | 13:39 | |
| fungi | ildikov: yeah, so from what i can tell the docs jobs are running `tox -e docs` and, in nova for example, the [testenv:docs] section is just inheriting basepython = python3 from [testenv] | 13:39 |
| ildikov | fungi: so setting it in [testenv] for training-guides might not hurt either then? | 13:39 |
| fungi | just make sure ignore_basepython_conflict = True is set in the [tox] section and also increase minversion to something like 3.1.1 | 13:39 |
| fungi | (i think that's the first version which added the ignore_basepython_conflict option anyway) | 13:40 |
| ildikov | noted, thanks! | 13:40 |
| fungi | ildikov: give it a try and see what happens, anyway | 13:40 |
| openstackgerrit | Mark Meyer proposed zuul/zuul master: Extend event reporting https://review.opendev.org/662134 | 13:42 |
| *** electrofelix has joined #openstack-infra | 13:44 | |
| ildikov | fungi: gave it an attempt: https://review.opendev.org/664595 | 13:45 |
| ildikov | fungi: there's another attempt here, but I would hope it's not that complicated to fix this: https://review.opendev.org/#/c/664545/ | 13:48 |
| *** ChosSimbaOne has joined #openstack-infra | 13:48 | |
| *** ChosSimbaOne has quit IRC | 13:48 | |
| *** ChosSimbaOne has joined #openstack-infra | 13:49 | |
| fungi | yeah, that's basically pinning it for python 2.7 | 13:51 |
| fungi | the two approaches can also be combined | 13:51 |
| *** jchhatbar has quit IRC | 13:52 | |
| *** tdasilva has quit IRC | 13:54 | |
| *** tdasilva has joined #openstack-infra | 13:55 | |
| *** ykarel|away has quit IRC | 13:55 | |
| ildikov | ok, cool | 13:56 |
| ildikov | just realized that patch is for contributor-guide :) | 13:56 |
| *** slaweq has joined #openstack-infra | 13:56 | |
| ildikov | good to know that we can make it bullet proof :) | 13:57 |
| ildikov | thanks fungi and zbr|rover !! | 13:57 |
| *** sreejithp has joined #openstack-infra | 13:58 | |
| *** pcaruana has quit IRC | 14:04 | |
| *** liuyulong has joined #openstack-infra | 14:04 | |
| openstackgerrit | Mark Meyer proposed zuul/zuul master: Extend event reporting https://review.opendev.org/662134 | 14:10 |
| *** michael-beaver has joined #openstack-infra | 14:10 | |
| openstackgerrit | Mark Meyer proposed zuul/zuul master: Extend event reporting https://review.opendev.org/662134 | 14:11 |
| *** jpena is now known as jpena|afk | 14:14 | |
| *** iurygregory_ has joined #openstack-infra | 14:15 | |
| *** yamamoto has quit IRC | 14:15 | |
| *** yamamoto has joined #openstack-infra | 14:16 | |
| *** yamamoto has quit IRC | 14:16 | |
| *** iurygregory has quit IRC | 14:18 | |
| *** chandankumar is now known as raukadah | 14:23 | |
| rpioso | jamesmcarthur: Have you seen the email I sent you? | 14:26 |
| rpioso | jamesmcarthur: It's about a change to driverlog which merged early Friday morning EDT -- https://review.opendev.org/#/c/663460/ | 14:27 |
| jamesmcarthur | rpioso: yes sir. On my list :) | 14:27 |
| rpioso | jamesmcarthur: Thank you, Jimmy! | 14:27 |
| *** slaweq has quit IRC | 14:28 | |
| *** pkopec has joined #openstack-infra | 14:30 | |
| *** pcaruana has joined #openstack-infra | 14:30 | |
| *** dave-mccowan has joined #openstack-infra | 14:30 | |
| *** yamamoto has joined #openstack-infra | 14:30 | |
| *** pcaruana has quit IRC | 14:31 | |
| *** pcaruana has joined #openstack-infra | 14:31 | |
| corvus | evrardjp, clarkb, pabelanger: i'm trying to think of alternate approaches to https://review.opendev.org/662828 -- i'm frustrated that the date/time is not available to an untrusted zero-node job. that seems like it would be generally very useful. perhaps we should consider modifying zuul to stick that into the executor's fact cache? or, add a new zuul. variable? | 14:32 |
| openstackgerrit | Mark Meyer proposed zuul/zuul master: Extend event reporting https://review.opendev.org/662134 | 14:32 |
| corvus | actually, let me repeat that in #zuul | 14:32 |
| evrardjp | corvus: ok let me join there | 14:33 |
| *** iurygregory_ is now known as iurygregory | 14:40 | |
| slittle1 | Are there any infrastructure cores that can take a look at ... https://review.opendev.org/#/c/663954/ ... Thanks | 14:44 |
| *** happyhemant has joined #openstack-infra | 14:44 | |
| openstackgerrit | Mark Meyer proposed zuul/zuul master: Extend event reporting https://review.opendev.org/662134 | 14:45 |
| *** yamamoto has quit IRC | 14:45 | |
| *** yamamoto has joined #openstack-infra | 14:49 | |
| *** jpena|afk is now known as jpena | 14:51 | |
| *** yamamoto has quit IRC | 14:53 | |
| *** yboaron_ has joined #openstack-infra | 15:00 | |
| *** pkopec has quit IRC | 15:01 | |
| clarkb | cloudnull: on the docker instal role the readme update was abandoned but the base change was not updated | 15:02 |
| *** diablo_rojo has joined #openstack-infra | 15:02 | |
| *** yboaron has quit IRC | 15:02 | |
| cloudnull | I'm rebasing all of that right now | 15:03 |
| cloudnull | there were a couple things folks wanted changed so I figured i'd just squash the commits | 15:03 |
| openstackgerrit | Kevin Carter (cloudnull) proposed zuul/zuul-jobs master: Add multi-distro support to install-docker https://review.opendev.org/664455 | 15:05 |
| openstackgerrit | Kevin Carter (cloudnull) proposed zuul/zuul-jobs master: Add variable to set the docker download url https://review.opendev.org/664485 | 15:05 |
| cloudnull | now just the two prs ^ | 15:05 |
| cloudnull | ianw: that last one implements the mirror fqdn replacement variable you noted in review 1 | 15:06 |
| *** slaweq has joined #openstack-infra | 15:08 | |
| *** Lucas_Gray has joined #openstack-infra | 15:09 | |
| openstackgerrit | Arnaud Morin proposed openstack/project-config master: Remove glean config for OVH nodes https://review.opendev.org/664617 | 15:12 |
| *** lpetrut has quit IRC | 15:12 | |
| amorin | hey all, about ^ | 15:13 |
| amorin | feel free to test it before | 15:13 |
| clarkb | amorin: ooh did that get fixed? tyty | 15:13 |
| amorin | to be sure that glean is working correctly with OVH network metadata | 15:13 |
| amorin | yes clarkb :p | 15:13 |
| clarkb | We can test it easily before we update the nodepool config (by booting the image by hand) so we should do that | 15:13 |
| amorin | yes, please | 15:13 |
| *** yamamoto has joined #openstack-infra | 15:15 | |
| *** yamamoto has quit IRC | 15:15 | |
| *** yamamoto has joined #openstack-infra | 15:16 | |
| *** hamzy_ is now known as hamzy | 15:17 | |
| *** pcaruana has quit IRC | 15:17 | |
| *** yamamoto has quit IRC | 15:20 | |
| *** bhavikdbavishi has joined #openstack-infra | 15:21 | |
| *** yamamoto has joined #openstack-infra | 15:22 | |
| *** yamamoto has quit IRC | 15:22 | |
| openstackgerrit | Paul Belanger proposed zuul/zuul master: WIP: Remove fact cache restriction for localhost (zuul-executor) https://review.opendev.org/664620 | 15:24 |
| *** ociuhandu_ has joined #openstack-infra | 15:25 | |
| *** ociuhand_ has joined #openstack-infra | 15:25 | |
| *** ociuhandu_ has quit IRC | 15:26 | |
| *** yamamoto has joined #openstack-infra | 15:26 | |
| *** yamamoto has quit IRC | 15:26 | |
| *** ociuhandu has quit IRC | 15:28 | |
| *** ociuhand_ has quit IRC | 15:29 | |
| *** ociuhandu has joined #openstack-infra | 15:30 | |
| *** tdasilva has quit IRC | 15:31 | |
| *** tdasilva has joined #openstack-infra | 15:31 | |
| *** pgaxatte has quit IRC | 15:33 | |
| clarkb | just waiting for clarkb-test to boot in BHS1 now | 15:33 |
| *** e0ne has quit IRC | 15:36 | |
| fungi | amorin: is there any hope of including ipv6 configuration included in metadata? or does that still require manual configuration to use? | 15:37 |
| clarkb | cloudnull: one thing on the fqdn override. let me know what you think | 15:41 |
| amorin | fungi: hum good question | 15:41 |
| amorin | I think ipv6 should be ok also | 15:41 |
| mriedem | looks like this can be abandoned now - i think it was an osic effort https://review.opendev.org/#/c/394659/ | 15:41 |
| amorin | need to be tested | 15:41 |
| fungi | amorin: neat! i'm going to reboot one of my personal ovh instances and check that out | 15:42 |
| *** udesale has quit IRC | 15:42 | |
| *** pcaruana has joined #openstack-infra | 15:43 | |
| clarkb | mriedem: done | 15:44 |
| mriedem | thanks | 15:44 |
| openstackgerrit | James E. Blair proposed zuul/zuul-jobs master: download-artifacts: only consider the most recent build https://review.opendev.org/664624 | 15:44 |
| *** igordc has joined #openstack-infra | 15:44 | |
| clarkb | infra-root 158.69.76.93 was booted in bhs1 without setting the metadata flag and it got its IP configured | 15:45 |
| clarkb | the netmask is 255.255.255.255 too as expected | 15:46 |
| openstackgerrit | Merged openstack/project-config master: Add ansible-playbook repo to starlingx https://review.opendev.org/663954 | 15:46 |
| *** eharney has quit IRC | 15:46 | |
| clarkb | I don't see ipv6 data in the network_data.json | 15:46 |
| fungi | yeah, not finding it myself either | 15:47 |
| clarkb | (so unless we need to wait for an RA I don't think that is ready yet) | 15:47 |
| clarkb | but I think we can merge amorin's change safely /me +2's now | 15:47 |
| fungi | agreed | 15:47 |
| fungi | thanks again, amorin! | 15:47 |
| cloudnull | clarkb so that would do a full string replacement for "https://download.docker.com/linux/fedora" with "{{ docker_mirror_base_url }}" | 15:48 |
| cloudnull | and each distro would contain a default? | 15:48 |
| clarkb | cloudnull: ya I think so | 15:49 |
| cloudnull | cool | 15:49 |
| cloudnull | will do | 15:49 |
| *** jcoufal has quit IRC | 15:50 | |
| clarkb | fungi: are you done looking at the test instance? I'll delete it if so | 15:50 |
| fungi | clarkb: yep, i was looking at a personal instance anyway | 15:52 |
| clarkb | done | 15:52 |
| *** pcaruana has quit IRC | 15:55 | |
| mriedem | clarkb: this one as well https://review.opendev.org/#/c/278415/ | 15:55 |
| openstackgerrit | Merged openstack/project-config master: Remove glean config for OVH nodes https://review.opendev.org/664617 | 15:56 |
| clarkb | mriedem: ack | 15:57 |
| clarkb | I'm going to try and get through project-config reviews this morning as we've had several pings about them recently (people notice when ajaeger has vacation time) | 15:57 |
| *** tdasilva_ has joined #openstack-infra | 15:58 | |
| *** eharney has joined #openstack-infra | 15:58 | |
| clarkb | fungi: https://review.opendev.org/#/c/636574/ needs a rebase? should we just go ahead and do that and reapprove? | 16:00 |
| openstackgerrit | Michal Nasiadka proposed opendev/system-config master: Add bionic to deb-docker releases in mirror_update https://review.opendev.org/664625 | 16:00 |
| *** tdasilva has quit IRC | 16:00 | |
| *** gfidente has quit IRC | 16:01 | |
| fungi | clarkb: i'll add a project group for that if we're rebasing anyway | 16:02 |
| *** iurygregory has quit IRC | 16:02 | |
| *** yboaron_ has quit IRC | 16:03 | |
| *** gfidente has joined #openstack-infra | 16:03 | |
| openstackgerrit | Jeremy Stanley proposed openstack/project-config master: Update karbor to use storyboard https://review.opendev.org/636574 | 16:08 |
| yoctozepto | guys, we are seeing strange failures in kolla, related to tox job for lower constraints, examples: | 16:11 |
| yoctozepto | http://logs.openstack.org/16/642416/11/check/openstack-tox-lower-constraints/c713b37/ara-report/ | 16:11 |
| yoctozepto | http://logs.openstack.org/80/664580/2/check/openstack-tox-lower-constraints/53dcd2d/ara-report/ | 16:11 |
| clarkb | fungi: care to review the stack starting at https://review.opendev.org/#/c/663854/ ? I don't think we want to approve that one until the child changes merge and new mirrors are booted, but that change has the pointers to the children | 16:11 |
| *** ykarel|away has joined #openstack-infra | 16:11 | |
| yoctozepto | nothing related is changed, the errors seems to be irrelevant | 16:11 |
| yoctozepto | (success with a failure) | 16:11 |
| *** ykarel|away has quit IRC | 16:12 | |
| clarkb | yoctozepto: I think that means there is utf8 (or other unicode) output from the installation of packages perofrmed by tox and it can't print that | 16:13 |
| *** lucasagomes has quit IRC | 16:13 | |
| openstackgerrit | Kevin Carter (cloudnull) proposed zuul/zuul-jobs master: Add variable to set the docker download url https://review.opendev.org/664485 | 16:13 |
| clarkb | I would expect that to be locally reproduceable | 16:13 |
| *** ykarel has joined #openstack-infra | 16:13 | |
| *** ykarel is now known as ykarel|away | 16:13 | |
| yoctozepto | clarkb: thanks, unfortunately it is not | 16:13 |
| *** ginopc has quit IRC | 16:14 | |
| yoctozepto | seems like our master suddenly stopped passing this | 16:14 |
| openstackgerrit | Merged zuul/zuul-jobs master: download-artifacts: only consider the most recent build https://review.opendev.org/664624 | 16:14 |
| yoctozepto | I will try your hint manually to find the culprit | 16:14 |
| yoctozepto | but it does not solve the issue really | 16:14 |
| clarkb | yoctozepto: see http://logs.openstack.org/16/642416/11/check/openstack-tox-lower-constraints/c713b37/tox/lower-constraints-1.log | 16:15 |
| *** gfidente has quit IRC | 16:15 | |
| fungi | yoctozepto: last successful build started at 17:03:40 yesterday, first failure started at 09:14:49 today according to http://zuul.opendev.org/t/openstack/builds?project=openstack%2Fkolla&job_name=openstack-tox-lower-constraints | 16:16 |
| *** pkopec has joined #openstack-infra | 16:17 | |
| fungi | my guess is updated image builds brought in some new behavior for libssl | 16:17 |
| *** tesseract has quit IRC | 16:18 | |
| corvus | and smart quotes | 16:18 |
| *** tdasilva has joined #openstack-infra | 16:18 | |
| fungi | yeah, fun that | 16:18 |
| fungi | yeah, maybe it's gcc switching to non-ascii quoting characters in warning messages? | 16:19 |
| clarkb | b'conflicting types for \xe2\x80\x98BIO_callback_ctrl\xe2\x80\x99\n l' is the first substring it is breaking on | 16:19 |
| fungi | that seems like a strange behavior for a tls distro | 16:19 |
| fungi | er, lts | 16:19 |
| clarkb | (I loaded the log file into python then decoded as ascii and boom with an index) | 16:19 |
| fungi | (ssl on the brain!_ | 16:19 |
| yoctozepto | fungi, clarkb: very strange indeed, thank you guys for help | 16:20 |
| fungi | but yeah, that seems more like it would be a gcc thing | 16:20 |
| clarkb | does tox not respect our locale which is en_US.utf8 on our ubuntu systems? | 16:20 |
| *** tdasilva_ has quit IRC | 16:20 | |
| yoctozepto | clarkb: then it respects it | 16:21 |
| fungi | possible it's missing from the environment | 16:21 |
| yoctozepto | utf8 makes gcc unicode :-) | 16:21 |
| yoctozepto | I believe LANG=C would help here, though there is something broken anyway | 16:21 |
| fungi | tox does strip out a lot of envvars | 16:21 |
| clarkb | yoctozepto: no, tox itself is trying to encode the data from the exec as ascii | 16:22 |
| clarkb | yoctozepto: which isn't respecting that | 16:22 |
| yoctozepto | clarkb: yeah, tox is not, I meant gcc | 16:22 |
| yoctozepto | it should not produce unicode output with non-UTF8 locale | 16:22 |
| yoctozepto | (unless another bug) | 16:22 |
| fungi | yeah, i expect gcc sees a utf8-based locale or it wouldn't be generating non-ascii output... but tox is clearly expecting ascii for some reason | 16:24 |
| *** pkopec has quit IRC | 16:25 | |
| openstackgerrit | Sorin Sbarnea proposed zuul/zuul-jobs master: Adds tox-molecule job https://review.opendev.org/664230 | 16:25 |
| openstackgerrit | Sorin Sbarnea proposed zuul/zuul-jobs master: Adds tox-molecule job https://review.opendev.org/664230 | 16:25 |
| clarkb | yoctozepto: fungi it could be a new tox bug | 16:26 |
| clarkb | or at least the hiding of the data | 16:26 |
| clarkb | the compile issue is likely unrelated to tox itself :) | 16:27 |
| fungi | maybe fixed in https://github.com/tox-dev/tox/pull/1237 (tox 3.8.4 and later)? are we using latest tox? | 16:27 |
| *** pkopec has joined #openstack-infra | 16:28 | |
| fungi | though i guess comparing to a successful build like http://zuul.opendev.org/t/openstack/build/8bd457005a29437fb67623b59d0b3f0f may help | 16:28 |
| *** smarcet has quit IRC | 16:28 | |
| yoctozepto | clarkb: the compile obviously not, thanks for spotting, the creepy output scared me :-) | 16:28 |
| clarkb | fungi: I think dib is supposed to install latest tox | 16:29 |
| clarkb | er actually no we don't install tox there anymore do we | 16:29 |
| fungi | http://logs.openstack.org/06/634706/3/check/openstack-tox-lower-constraints/8bd4570/tox/lower-constraints-1.log does not show the compile errors for pyca/cryptography dependencies | 16:29 |
| fungi | so that could be what changed | 16:29 |
| *** pkopec_ has joined #openstack-infra | 16:31 | |
| *** eernst has joined #openstack-infra | 16:31 | |
| fungi | and since kolla's lower constraint for cryptography presumably has not been updated, this brings us back to new ubuntu packages in a recent image upload | 16:32 |
| *** jamesmcarthur has quit IRC | 16:32 | |
| *** pkopec has quit IRC | 16:33 | |
| *** pkopec__ has joined #openstack-infra | 16:33 | |
| *** jpich has quit IRC | 16:33 | |
| fungi | the successful build compiled extensions for cryptography-1.9 and the failing build was also using the cryptography-1.9 sdist | 16:33 |
| yoctozepto | fungi: yeah | 16:34 |
| yoctozepto | just let know other kollars :-) | 16:34 |
| yoctozepto | screwed overnight | 16:34 |
| openstackgerrit | Merged openstack/project-config master: Update karbor to use storyboard https://review.opendev.org/636574 | 16:34 |
| fungi | http://changelogs.ubuntu.com/changelogs/pool/main/o/openssl/openssl_1.1.1-1ubuntu2.1~18.04.1/changelog doesn't indicate any changes to the openssl source package since december | 16:35 |
| *** yamamoto has joined #openstack-infra | 16:36 | |
| *** ccamacho has quit IRC | 16:36 | |
| *** pkopec_ has quit IRC | 16:36 | |
| yoctozepto | fungi: it did not try to compile | 16:37 |
| yoctozepto | then | 16:37 |
| yoctozepto | damned manylinux1 | 16:37 |
| yoctozepto | it brought binary package | 16:37 |
| fungi | or the failures are being introduced elsewhere and not by a change to openssl | 16:37 |
| yoctozepto | seems like ubuntu stopped being recognized as compatible | 16:37 |
| fungi | though i just checked libffi-dev and it's also not seen changes since january | 16:38 |
| yoctozepto | for manylinux1 | 16:38 |
| *** whoami-rajat has quit IRC | 16:38 | |
| *** ociuhandu_ has joined #openstack-infra | 16:39 | |
| *** ociuhandu has quit IRC | 16:39 | |
| yoctozepto | or well, maybe not | 16:39 |
| yoctozepto | it was building wheel | 16:39 |
| yoctozepto | but succeeded | 16:39 |
| fungi | right | 16:39 |
| yoctozepto | so many question, so little answers | 16:39 |
| *** Lucas_Gray has quit IRC | 16:39 | |
| fungi | which is why i'm suspecting an image update changing something about the c toolchain or libs | 16:39 |
| fungi | just trying to work out what that might have been | 16:40 |
| clarkb | if this wasn't lower constraints I would suspect a new sdist without a whl | 16:40 |
| clarkb | we've seen that from cryptography and friends where an sdist gets uploaded up to a day or two in advance of the wheels | 16:40 |
| clarkb | but with lower constraints we should be using older package versions | 16:41 |
| yoctozepto | we get msgpack and cffi from manylinux1 | 16:41 |
| fungi | there won't be a manylinux1 wheel in this case | 16:41 |
| yoctozepto | and then did so too | 16:41 |
| fungi | remember, lower constraints generally means "old" | 16:42 |
| fungi | https://pypi.org/project/cryptography/1.9/#files | 16:42 |
| fungi | no manulinux1 | 16:42 |
| yoctozepto | yeah, I confirmed that, my bad there above | 16:42 |
| clarkb | aha so predates their wheel builds | 16:42 |
| fungi | this is from 2 years ago | 16:42 |
| clarkb | (for linux at least) | 16:42 |
| *** gfidente has joined #openstack-infra | 16:42 | |
| *** yamamoto has quit IRC | 16:42 | |
| *** roman_g has quit IRC | 16:44 | |
| corvus | i'm not having great success using paste | 16:45 |
| *** Lucas_Gray has joined #openstack-infra | 16:45 | |
| *** ykarel|away has quit IRC | 16:49 | |
| *** slaweq has quit IRC | 16:49 | |
| *** pcaruana has joined #openstack-infra | 16:49 | |
| fungi | as in getting it to load? or getting it to save? or...? | 16:49 |
| *** pkopec__ has quit IRC | 16:50 | |
| *** dtantsur is now known as dtantsur|afk | 16:51 | |
| slittle1 | How do I get added to group starlingx-ansible-playbooks-core ? | 16:51 |
| slittle1 | Just created via https://review.opendev.org/#/c/663954/ | 16:52 |
| *** slaweq has joined #openstack-infra | 16:52 | |
| fungi | slittle1: the fastest way is by asking in here ;) | 16:54 |
| slittle1 | yes please | 16:54 |
| slittle1 | kinda assumed I'd be a member by default, being the one that requested it's creation :) | 16:54 |
| *** rpittau is now known as rpittau|afk | 16:55 | |
| fungi | we lack automation for setting initial group members, so it's a manual process. just a sec | 16:55 |
| slittle1 | great, thanks | 16:55 |
| *** slaweq has quit IRC | 16:56 | |
| fungi | slittle1: done. lmk if you need anything else | 16:57 |
| slittle1 | another question if I may | 16:57 |
| fungi | sure! | 16:57 |
| fungi | ask away | 16:57 |
| slittle1 | I'm trying to add the new project to a storyboard | 16:58 |
| slittle1 | And a first task, assigned to myself | 16:59 |
| slittle1 | it just seems to hang when I hit 'save' | 16:59 |
| slittle1 | I'm logged in | 17:00 |
| fungi | this one? https://storyboard.openstack.org/#!/story/2004695 | 17:00 |
| slittle1 | Same result from firefox and Chrome | 17:00 |
| slittle1 | yes | 17:00 |
| *** derekh has quit IRC | 17:01 | |
| fungi | the task without the assignee is the one hanging when you try to assign it to yourself? | 17:01 |
| yoctozepto | clarkb, fungi: https://www.ubuntuupdates.org/package/core/bionic/main/updates/openssl looks like they bumped up version | 17:01 |
| yoctozepto | eh | 17:01 |
| fungi | slittle1: i guess all of the | 17:02 |
| fungi | er | 17:02 |
| slittle1 | I'm trying to create the task with myself as assignee | 17:02 |
| fungi | slittle1: i guess all of the "Initial Zuul and TOX setup" tasks repeated there are from multiple attempts? | 17:02 |
| slittle1 | yes, probably | 17:02 |
| *** weifan has joined #openstack-infra | 17:03 | |
| fungi | so i guess the creation task call to the api is at least making it in | 17:03 |
| openstackgerrit | Merged zuul/zuul-jobs master: Adds tox-molecule job https://review.opendev.org/664230 | 17:03 |
| slittle1 | saw a pop up complaining about title='u' on first attempt | 17:03 |
| slittle1 | had a '/' in the task title on the first try | 17:04 |
| *** whoami-rajat has joined #openstack-infra | 17:05 | |
| fungi | ahh, i'm surprised / is disallowed on task titles | 17:05 |
| slittle1 | not sure if that buggered up some behind the scenes database or scripting | 17:06 |
| fungi | anyway, i just added a task on that story for myself (via firefox), though i did have to wait a few seconds... we're trying to improve some of the sql queries as they can take a lot of time to return | 17:06 |
| *** jcoufal has joined #openstack-infra | 17:07 | |
| fungi | the task with the / in its title is also showing up so i doubt it's disallowed | 17:07 |
| slittle1 | oh!!!! | 17:07 |
| *** ramishra has quit IRC | 17:07 | |
| slittle1 | it reload, now I see all my failed atempts... perhaps not failed after all | 17:07 |
| fungi | it's possible something went sideways with that first addition and caused the webclient to stop updating for you | 17:08 |
| slittle1 | the browser just never scrolled or reformatted to show the new entries I had created after hitting 'save' | 17:08 |
| fungi | it did for me when i added a task, though it took 2-3 seconds | 17:09 |
| slittle1 | perhaps it wasn't hung after all | 17:09 |
| slittle1 | so I should expect it to scroll to the new entry ? | 17:10 |
| *** kopecmartin is now known as kopecmartin|off | 17:10 | |
| *** jamesmcarthur has joined #openstack-infra | 17:10 | |
| fungi | are you adding it via the "Add task affecting this project" link below the existing tasks? | 17:11 |
| slittle1 | So now I have unwanted entries to clean up | 17:11 |
| slittle1 | No, first attempt was via '+ Affects other project' | 17:11 |
| fungi | ahh, right, so it's possible the problem is coming from that widget | 17:12 |
| slittle1 | when that through an error, I retired the same on each retry. | 17:12 |
| fungi | on the unwanted tasks you can expand themm with the little red triangle to their left and there should be a delete button (which will pop up a confirmation modal for you to accept) | 17:12 |
| slittle1 | so yah, no scroll or obvious redraw after '+ affects other projects' on success or fail | 17:14 |
| fungi | i have a feeling this particular story is pushing the limits of usability with our current slow sql query issues, given there are a couple dozen tasks and hundreds of timeline entries | 17:15 |
| fungi | corvus helped us get slow query logging turned on and mordred pitched in with some analysis tools and we've got an outreachy intern coming up to speed to work on query optimization for the api | 17:16 |
| fungi | so hopefully this will speed up soon for largeish stories like that one | 17:17 |
| *** jpena is now known as jpena|off | 17:17 | |
| slittle1 | did it again, sort of | 17:18 |
| slittle1 | '+ Affects other project' to add starlingx/manifest, then fill in a first task and assign to myself, then click 'save'. | 17:19 |
| slittle1 | No scroll, or redraw, or any other indicatin that the 'save' did anything | 17:20 |
| fungi | could be the save is still trying to finish. did the modal go away? | 17:20 |
| slittle1 | but if I scroll up i see my new project and task, but it's unassigned | 17:21 |
| fungi | oh, right, there's no separate modal, it's just in-list input controls | 17:21 |
| slittle1 | I hadn't gone away when I scrolled up | 17:21 |
| *** smarcet has joined #openstack-infra | 17:21 | |
| slittle1 | I hit refresh to see if the assignee would appear. It didn't, so a re-added it | 17:22 |
| *** bhavikdbavishi has quit IRC | 17:22 | |
| slittle1 | so scrolling down now... it is of course gone | 17:23 |
| fungi | it also wants to reload all the story content for me when i add a task, which on that story takes a good 10-20 seconds | 17:23 |
| openstackgerrit | Matt McEuen proposed openstack/project-config master: Add airship/election https://review.opendev.org/664641 | 17:23 |
| fungi | presumably because of the associated timeline events | 17:23 |
| slittle1 | k, maybe just not waiting long enough | 17:23 |
| *** jamesmcarthur has quit IRC | 17:26 | |
| *** jamesmcarthur has joined #openstack-infra | 17:26 | |
| *** electrofelix has quit IRC | 17:27 | |
| fungi | it doesn't do a good job in some places of indicating when it's still waiting for content to come back from an api call in the webclient | 17:27 |
| fungi | coupled with really long waits for that on some larger stories it can seem like it's completely gone out to lunch | 17:28 |
| fungi | which, as i mentioned, we're hoping will be fixed soon | 17:28 |
| clarkb | yoctozepto: and I'm guessing the version of cryptography in lower constraints is too old to build against that? | 17:29 |
| fungi | the api implementation has grown some really inefficient db queries which weren't apparent until we started loading increasing amounts of data in | 17:29 |
| *** tosky has quit IRC | 17:30 | |
| yoctozepto | clarkb: exactly | 17:31 |
| yoctozepto | fortunately this is some old issue, cryptography is not used in kolla | 17:32 |
| yoctozepto | probably remainder after split | 17:32 |
| fungi | yoctozepto: oh! indeed, http://changelogs.ubuntu.com/changelogs/pool/main/o/openssl/openssl_1.1.1-1ubuntu2.1~18.04.1/changelog shows that changelog entry as being from december, which is why i didn't think it had updated recently. i guess it just took half a year to make it in | 17:32 |
| yoctozepto | fungi: maybe they even warned users via some channels :-) | 17:32 |
| *** jcoufal has quit IRC | 17:32 | |
| fungi | but yeah, we should be prepared for some things to suddenly stop being able to compile against openssl on bionic | 17:33 |
| *** Lucas_Gray has quit IRC | 17:33 | |
| fungi | yoctozepto: looking through https://bugs.launchpad.net/ubuntu/+source/openssl/+bug/1797386 it took 6 months to solve compatibility issues in openssl-linked packages in bionic | 17:35 |
| openstack | Launchpad bug 1797386 in python-tornado (Ubuntu Bionic) "[SRU] OpenSSL 1.1.1 to 18.04 LTS" [Undecided,Fix committed] | 17:35 |
| fungi | and comment #27 covers when it was fixed there with python-cryptography 2.1.4-1ubuntu1.3 | 17:37 |
| *** Lucas_Gray has joined #openstack-infra | 17:40 | |
| *** Lucas_Gray has quit IRC | 17:48 | |
| *** jcoufal has joined #openstack-infra | 17:50 | |
| *** ralonsoh has quit IRC | 17:53 | |
| *** priteau has quit IRC | 17:54 | |
| *** ociuhandu has joined #openstack-infra | 17:54 | |
| *** ociuhandu_ has quit IRC | 17:57 | |
| clarkb | fungi: is https://review.opendev.org/#/c/631509/1 the sort of thing that requires a gerrit restart? | 17:58 |
| clarkb | maybe we should get that in and the opendev gitweb links change(s) in then schedule a restart for maybe friday? | 17:58 |
| clarkb | mordred: ^ | 17:58 |
| *** ociuhandu has quit IRC | 17:59 | |
| *** jcoufal has quit IRC | 18:00 | |
| *** weifan has quit IRC | 18:02 | |
| fungi | yes, i think commentlinks configuration requires a service restart | 18:03 |
| *** weifan has joined #openstack-infra | 18:03 | |
| fungi | friday seems as good a time as any | 18:03 |
| yoctozepto | into production on Friday evening :-) | 18:05 |
| *** eernst has quit IRC | 18:07 | |
| clarkb | yoctozepto: problem is gerrit rereplicates all refs on restart so it is quite slow to recover after we restart it so best do it when it should be quiet | 18:07 |
| fungi | basically any change updated or merged after the restart don't replicate to the opendev.org gitea environment until the full replication backlog from the restart clears, which can take hours | 18:12 |
| *** eernst has joined #openstack-infra | 18:13 | |
| *** weifan has quit IRC | 18:14 | |
| yoctozepto | I see, sad :-( | 18:14 |
| *** weifan has joined #openstack-infra | 18:16 | |
| *** eernst has quit IRC | 18:17 | |
| *** eernst has joined #openstack-infra | 18:17 | |
| *** eernst has quit IRC | 18:18 | |
| fungi | clarkb: should we add something like https://opendev.org/opendev/system-config/src/branch/master/playbooks/roles/gitea-git-repos/tasks/setup-repo.yaml#L27-L30 to https://opendev.org/opendev/system-config/src/branch/master/playbooks/gitea-rename-tasks.yaml or is that step covered somewhere i'm not finding? | 18:21 |
| clarkb | fungi: we probably do want that actually | 18:21 |
| fungi | though i guess the rename_repos playbook doesn't utilize projects.yaml so we may need another way to get at that conditional case | 18:22 |
| clarkb | could be a flag in the rename.yaml | 18:23 |
| *** smarcet has quit IRC | 18:23 | |
| openstackgerrit | David Shrewsbury proposed zuul/zuul master: Add caching of autohold requests https://review.opendev.org/663412 | 18:23 |
| openstackgerrit | David Shrewsbury proposed zuul/zuul master: Add autohold-info CLI command https://review.opendev.org/662487 | 18:23 |
| openstackgerrit | David Shrewsbury proposed zuul/zuul master: Record held node IDs with autohold request https://review.opendev.org/662498 | 18:23 |
| openstackgerrit | David Shrewsbury proposed zuul/zuul master: Auto-delete expired autohold requests https://review.opendev.org/663762 | 18:23 |
| openstackgerrit | David Shrewsbury proposed zuul/zuul master: Mark nodes as USED when deleting autohold https://review.opendev.org/664060 | 18:23 |
| fungi | clarkb: oh, also i guess since there's no actual api for this, we have to pretty much include all of the "Adjust repo settings" task dependencies | 18:24 |
| *** weifan has quit IRC | 18:24 | |
| fungi | which depend on a variety of data from projects.yaml | 18:24 |
| fungi | maybe it's easier to just rerun https://opendev.org/opendev/system-config/src/branch/master/playbooks/sync-gitea-projects.yaml instead? | 18:25 |
| fungi | as a separate step? | 18:25 |
| *** ekultails has quit IRC | 18:25 | |
| clarkb | ya and we can give it a subset of the data too | 18:26 |
| clarkb | so that it doesn't take 4 hours | 18:26 |
| *** smarcet has joined #openstack-infra | 18:26 | |
| *** weifan has joined #openstack-infra | 18:29 | |
| openstackgerrit | David Shrewsbury proposed zuul/zuul master: Auto-delete expired autohold requests https://review.opendev.org/663762 | 18:30 |
| openstackgerrit | David Shrewsbury proposed zuul/zuul master: Mark nodes as USED when deleting autohold https://review.opendev.org/664060 | 18:30 |
| *** ChosSimbaOne has quit IRC | 18:32 | |
| fungi | anybody know why we would have been getting "E: Failed to fetch http://mirror.dfw.rax.opendev.org/ubuntu/dists/xenial-updates/main/binary-amd64/Packages.gz Hash Sum mismatch" early today? | 18:32 |
| clarkb | fungi: thats the afs issue again | 18:33 |
| *** ChosSimbaOne has joined #openstack-infra | 18:33 | |
| fungi | looks like there were some for xenial-security as well | 18:33 |
| clarkb | I don't think we know why it is happening | 18:33 |
| fungi | oh, right | 18:33 |
| clarkb | but that removingthose files from the afs cache fixes it | 18:33 |
| fungi | okay, so it's recurrent anyway | 18:33 |
| fungi | ianw was looking into custom afsclient packages? | 18:34 |
| *** smarcet has quit IRC | 18:34 | |
| fungi | for newer source? | 18:34 |
| clarkb | I think the next step was deploying a couple more mirrors to see if it happens to them too | 18:34 |
| clarkb | that was the change I asked people to review earlier /me finds | 18:34 |
| fungi | yep, sorry, it's somewhere in my backlog then | 18:35 |
| clarkb | https://review.opendev.org/#/c/663854/ its parents | 18:35 |
| clarkb | the change itself shouldn't be merged until we have the new mirrors up | 18:35 |
| fungi | stack starting at 663854 you said earlier | 18:35 |
| fungi | just found in scrollback | 18:35 |
| openstackgerrit | David Shrewsbury proposed zuul/zuul master: Auto-delete expired autohold requests https://review.opendev.org/663762 | 18:36 |
| openstackgerrit | David Shrewsbury proposed zuul/zuul master: Mark nodes as USED when deleting autohold https://review.opendev.org/664060 | 18:36 |
| *** ricolin_ has quit IRC | 18:38 | |
| openstackgerrit | Tobias Henkel proposed zuul/zuul master: Add spec for enhanced regional executor distribution https://review.opendev.org/663413 | 18:38 |
| openstackgerrit | Merged opendev/system-config master: Pin ARA on devel job to stable branch https://review.opendev.org/664522 | 18:39 |
| *** pcaruana has quit IRC | 18:39 | |
| openstackgerrit | David Shrewsbury proposed zuul/zuul master: Auto-delete expired autohold requests https://review.opendev.org/663762 | 18:39 |
| openstackgerrit | David Shrewsbury proposed zuul/zuul master: Mark nodes as USED when deleting autohold https://review.opendev.org/664060 | 18:39 |
| *** jamesmcarthur has quit IRC | 18:40 | |
| *** ekultails has joined #openstack-infra | 18:42 | |
| *** tdasilva has quit IRC | 18:45 | |
| openstackgerrit | Matt Riedemann proposed opendev/elastic-recheck master: Add query for test_check_doubled_words py27 fail bug 1832392 https://review.opendev.org/664661 | 18:46 |
| openstack | bug 1804062 in nova (Ubuntu Eoan) "duplicate for #1832392 test_hacking fails for python 3.6.7 and newer" [High,Triaged] https://launchpad.net/bugs/1804062 | 18:46 |
| openstackgerrit | Sean McGinnis proposed zuul/zuul master: Fix minor typos in Nodepool OpenStack instructions https://review.opendev.org/664665 | 18:49 |
| *** smarcet has joined #openstack-infra | 18:50 | |
| openstackgerrit | Paul Belanger proposed zuul/zuul master: Bump default_read_timeout for github driver to 300 https://review.opendev.org/664667 | 18:52 |
| openstackgerrit | Paul Belanger proposed zuul/zuul master: WIP: Bump default_read_timeout for github driver to 300 https://review.opendev.org/664667 | 18:52 |
| *** priteau has joined #openstack-infra | 18:54 | |
| *** priteau has quit IRC | 18:54 | |
| *** markvoelker has joined #openstack-infra | 18:55 | |
| clarkb | We'll have our meeting in ~5 minutes. Join us in #openstack-meeting | 18:55 |
| *** smarcet has quit IRC | 18:58 | |
| diablo_rojo | fungi, as a heads up I wont be around for the infra meeting to help with the sb update. | 18:58 |
| fungi | no worries, and thanks for the heads up! | 18:59 |
| *** jamesmcarthur has joined #openstack-infra | 18:59 | |
| openstackgerrit | Matt McEuen proposed openstack/project-config master: Add airship/election https://review.opendev.org/664641 | 19:01 |
| *** jamesmcarthur has quit IRC | 19:01 | |
| *** jamesmcarthur has joined #openstack-infra | 19:03 | |
| *** jamesmcarthur has quit IRC | 19:05 | |
| *** jamesmcarthur has joined #openstack-infra | 19:07 | |
| openstackgerrit | Jean-Philippe Evrard proposed zuul/zuul master: Expose date time as facts https://review.opendev.org/664674 | 19:09 |
| openstackgerrit | Jeremy Stanley proposed openstack/project-config master: Replace the old Stein cycle signing key with Train https://review.opendev.org/664675 | 19:10 |
| openstackgerrit | Merged zuul/zuul master: Parallelize github event processing https://review.opendev.org/662818 | 19:14 |
| *** jamesmcarthur has quit IRC | 19:15 | |
| fungi | looks like those xenial package indices are still broken judging from http://logs.openstack.org/70/662870/8/check/zuul-stream-functional-2.5/301f28a/ | 19:17 |
| clarkb | fungi: you could try doingthe fs flush on those paths | 19:18 |
| fungi | yeah, i was just extracting them out of root's shell hist | 19:19 |
| openstackgerrit | Merged opendev/elastic-recheck master: Add query for test_check_doubled_words py27 fail bug 1832392 https://review.opendev.org/664661 | 19:20 |
| openstack | bug 1804062 in nova (Ubuntu Eoan) "duplicate for #1832392 test_hacking fails for python 3.6.7 and newer" [High,Triaged] https://launchpad.net/bugs/1804062 | 19:20 |
| *** igordc has quit IRC | 19:26 | |
| *** markvoelker has quit IRC | 19:29 | |
| *** diablo_rojo has quit IRC | 19:34 | |
| openstackgerrit | Merged opendev/system-config master: Switch mirror Apache logs to ISO8601 https://review.opendev.org/663806 | 19:34 |
| openstackgerrit | Merged opendev/system-config master: Add RAX IAD/ORD opendev.org mirrors https://review.opendev.org/663852 | 19:34 |
| *** jamesmcarthur has joined #openstack-infra | 19:34 | |
| fungi | #status log flushed /afs/openstack.org/mirror/ubuntu/dists/xenial-{security,updates}/main/binary-amd64/Packages.gz on mirror.dfw.rax | 19:37 |
| openstackstatus | fungi: finished logging | 19:37 |
| *** alobbs has joined #openstack-infra | 19:38 | |
| jamesmcarthur | rpioso: It appears both sets of drivers are still in the yaml: https://opendev.org/x/driverlog/raw/branch/master/etc/default_data.json | 19:42 |
| jamesmcarthur | rpioso: Can you add a patch to remove the old OpenStack Community drivers? | 19:42 |
| rpioso | jamesmcarthur: We want both pairs to exist. | 19:43 |
| rpioso | jamesmcarthur: More than one vendor can support a driver. | 19:45 |
| *** eernst has joined #openstack-infra | 19:48 | |
| * rpioso will brb | 19:50 | |
| *** woojay has quit IRC | 19:52 | |
| fungi | or more than one driver can support the same vendor's hardware presumably | 19:52 |
| *** eernst has quit IRC | 19:52 | |
| fungi | for example when there's a basic driver included in the service but the vendor also maintains an out-of-tree driver with additional capabilities not suitable for inclusion upstream | 19:53 |
| jamesmcarthur | rpioso: Understood. That's going to require an update on our side. At the moment it's one vendor per driver. | 19:54 |
| fungi | so users may choose one over the other depending on what features they need out of it | 19:54 |
| *** eernst has joined #openstack-infra | 19:54 | |
| *** woojay has joined #openstack-infra | 19:54 | |
| jamesmcarthur | We should be able to make it work :) | 19:55 |
| fungi | yeah, vendors<->drivers is a many:many relationship | 20:00 |
| fungi | at least in the real world | 20:00 |
| *** psachin has quit IRC | 20:02 | |
| *** jamesmcarthur has quit IRC | 20:03 | |
| openstackgerrit | Sean McGinnis proposed zuul/zuul master: Limit jobs runs with standard set of irrelevant files https://review.opendev.org/664680 | 20:07 |
| *** tdasilva has joined #openstack-infra | 20:08 | |
| openstackgerrit | Evgeniy L proposed zuul/nodepool master: Add `floating-ip-pool` option to specify custom pool name https://review.opendev.org/664681 | 20:11 |
| *** efried has joined #openstack-infra | 20:12 | |
| *** alobbs has quit IRC | 20:12 | |
| efried | Hey folks. Any way we can get nova-tox-functional a node for 664622 ? This is a gate unblocker. All the other jobs are done and green, but this one's still queued. | 20:13 |
| openstackgerrit | Clark Boylan proposed opendev/system-config master: Check spamhaus pbl when launching new servers https://review.opendev.org/664682 | 20:13 |
| clarkb | lunch is apparently going to be a few minuts so put ^ together | 20:13 |
| clarkb | efried: the way nodepool works, it will have to wait its turn | 20:13 |
| *** smarcet has joined #openstack-infra | 20:13 | |
| efried | okay, thanks | 20:13 |
| clarkb | (we can't directly assign a node to a job, instead nodepool gives each provider three chances to successfully boot a node for each job before giving up. Chances are it is working through tryingto get a valid node) | 20:14 |
| openstackgerrit | Sean McGinnis proposed zuul/zuul master: Limit jobs runs with standard set of irrelevant files https://review.opendev.org/664680 | 20:15 |
| efried | okay | 20:16 |
| ianw | clarkb: i'll get onto the openafs packages and keep track of thingsin https://etherpad.openstack.org/p/opendev-mirror-afs | 20:16 |
| ianw | have to see about putting them in ppa; i don't want to mess up the existing arm64 packages in there | 20:17 |
| rpioso | jamesmcarthur: Gotcha and cool. | 20:21 |
| *** jamesmcarthur has joined #openstack-infra | 20:25 | |
| *** markvoelker has joined #openstack-infra | 20:26 | |
| rpioso | fungi, jamesmcarthur: Thank you! | 20:26 |
| openstackgerrit | James E. Blair proposed zuul/zuul-jobs master: download-artifacts: correct build selection https://review.opendev.org/664685 | 20:28 |
| *** jamesmcarthur has quit IRC | 20:28 | |
| *** eharney has quit IRC | 20:32 | |
| * rpioso agrees the vendor to driver relationship is m:n in the wild | 20:35 | |
| *** smarcet has quit IRC | 20:36 | |
| *** jamesmcarthur has joined #openstack-infra | 20:53 | |
| *** markvoelker has quit IRC | 20:59 | |
| *** weifan has quit IRC | 20:59 | |
| *** Lucas_Gray has joined #openstack-infra | 20:59 | |
| *** weifan has joined #openstack-infra | 21:00 | |
| *** jamesmcarthur has quit IRC | 21:04 | |
| *** nicolasbock has quit IRC | 21:06 | |
| openstackgerrit | Guilherme Steinmuller Pimentel proposed openstack/project-config master: Retire openstack-ansible unused roles https://review.opendev.org/650422 | 21:08 |
| *** nicolasbock has joined #openstack-infra | 21:08 | |
| openstackgerrit | Merged zuul/zuul-jobs master: download-artifacts: correct build selection https://review.opendev.org/664685 | 21:12 |
| openstackgerrit | Merged opendev/system-config master: Check spamhaus pbl when launching new servers https://review.opendev.org/664682 | 21:12 |
| *** eernst has quit IRC | 21:17 | |
| *** mudpuppy has joined #openstack-infra | 21:18 | |
| *** eernst has joined #openstack-infra | 21:18 | |
| *** jtomasek has quit IRC | 21:22 | |
| *** eernst has quit IRC | 21:23 | |
| *** jtomasek has joined #openstack-infra | 21:24 | |
| clarkb | I'll boot ne gitea06 as soon as ^ is on bridge | 21:24 |
| clarkb | mordred: I've just realized a flaw with our control plane images idea | 21:25 |
| clarkb | mordred: you cannot delete an imgae used on a boot from volume node until the volume is also deleted | 21:25 |
| fungi | so we have to keep those images ~indefinitely? | 21:26 |
| clarkb | ya | 21:26 |
| clarkb | I'm not sure I like that with nodepool | 21:26 |
| clarkb | it will get unhappy | 21:26 |
| clarkb | I need to have a little think about that | 21:27 |
| ianw | hrm, when you "server list" you see recent servers list their image, but then older servers don't, i'd always assumed it was because the base image they booted from disappeared | 21:28 |
| clarkb | ianw: ya it is, this particular problem only affects boot from volume servers which we only do in vexxhost | 21:28 |
| *** ekultails has quit IRC | 21:28 | |
| openstackgerrit | Merged openstack/project-config master: Replace the old Stein cycle signing key with Train https://review.opendev.org/664675 | 21:29 |
| *** igordc has joined #openstack-infra | 21:31 | |
| clarkb | so I guess the concern is that we may end up with as many images as we have servers | 21:32 |
| clarkb | however, these images are much smaller than our test node images | 21:32 |
| fungi | i expect more important is figuring out how to keep nodepool from freaking out over continually trying to delete them all | 21:33 |
| clarkb | they are 3.0GB raw | 21:33 |
| clarkb | fungi: ya and it won't remove them from the builder disk until it deletes the image in the cloud | 21:34 |
| clarkb | I wonder can we "copy" an image | 21:34 |
| fungi | ahh, right, so local disk space too | 21:34 |
| clarkb | so our process could be copy whatever image is newest from nodepool then boot off the copy | 21:35 |
| clarkb | then nodepool can keep managing the image as it already does | 21:35 |
| * clarkb looks at glance api docs | 21:35 | |
| clarkb | no built in functionality for that but we could just upload the image on nb0* with a new name. If we do that we probably don't want nodepool to upload the images (just build them) | 21:36 |
| *** sreejithp has quit IRC | 21:37 | |
| fungi | i suppose that's an option. if it doesn't upload them it doesn't have to worry about being able to delete them | 21:39 |
| fungi | and when we're launching a server we upload whatever the latest is | 21:39 |
| fungi | which is how i've generally been doing it for my personal servers | 21:39 |
| *** nicolasbock has quit IRC | 21:39 | |
| fungi | when it's only a few gb, that doesn't take long | 21:39 |
| clarkb | ceph doesn't cow right? so I wonder if there is a way to convince novaand glance we are ok with the non boot from volume behavior | 21:40 |
| *** diablo_rojo has joined #openstack-infra | 21:40 | |
| clarkb | mnaser: ^ do you know if we can tell nova and/or glance it is ok to delete the image from glance when a running server is using that image? | 21:40 |
| fungi | i am somewhat curious why our server images would be 3gb though... what extra are we installing? the debian openstack images are half a gb | 21:41 |
| mnaser | clarkb: nope, it doesn't do it because the cow leaves a reference | 21:41 |
| clarkb | fungi: 512MB is ext4 journal | 21:41 |
| *** nicolasbock has joined #openstack-infra | 21:41 | |
| fungi | ahh | 21:41 |
| fungi | and that doesn't compress? | 21:42 |
| clarkb | fungi: not with raw images | 21:42 |
| fungi | nm, i was talking about qcow2 anyway | 21:42 |
| ianw | have we turned off all caching? | 21:42 |
| clarkb | ianw: for afs? | 21:42 |
| ianw | sorry i mean when building the images | 21:42 |
| clarkb | mnaser: right but wouldn't the reference be associated with the running instance(s) and no longer glance? | 21:43 |
| fungi | if it's just the cloud provider where images end up hanging around because we're doing manual uploads, then the raw size is mostly only relevant for the providers which require raw (so roughly just rax) | 21:43 |
| clarkb | fungi: and vexxhost | 21:43 |
| fungi | oh, for some reason i thought we uploaded qcow2 there | 21:43 |
| mnaser | clarkb: nope, so glance store a snapshot (i.e. image-foo@snap) and then that snapshot is used to build a volume (disk-uuid) | 21:43 |
| clarkb | fungi: we did until we broke their cloud then switched to raw | 21:44 |
| fungi | ahh | 21:44 |
| mnaser | you cant delete image-foo@snap because disk-uuid uses it | 21:44 |
| mnaser | ^ lols | 21:44 |
| clarkb | mnaser: that seems like poorly implemented cow | 21:44 |
| clarkb | but there is probably some crush algorithm limitation I'm not aware of that leads to that | 21:44 |
| mnaser | yes, its a ceph level thing | 21:45 |
| mnaser | there is a way to .. uh | 21:45 |
| mnaser | 'un-cow-ify' | 21:45 |
| fungi | most cow implementations i'm familiar with have a flatten option where you copy all lower layers into the specified layer and then you can discard them once there are no remaining references to their blocks | 21:45 |
| mnaser | yes! flatten, but that's not really implemented in the openstack layer | 21:45 |
| fungi | got it | 21:45 |
| clarkb | fungi: to store the image in disk on ceph for use by nova you really want to store the raw image (because then you can serve the ceph blocks direclty) | 21:46 |
| clarkb | fungi: so when we were uploading qcow2 images they were convertin to raw behind the scenes | 21:46 |
| fungi | yeah, that makes sense | 21:46 |
| clarkb | and that wasn't cheap | 21:46 |
| *** diablo_rojo has quit IRC | 21:49 | |
| clarkb | Thinking about other options. If SDK/nodepool can detect that the image isn't being deleted because it is associated with an instance we could tell it to try less forcefully to clean that image up | 21:52 |
| clarkb | maybe try deleting it once a day or something | 21:52 |
| clarkb | Of course if glance/ceph/nova were to have a bug and let us delete the image that might also nuke the instance(s) | 21:52 |
| fungi | and we could still allow cleaning up the on-disk copy | 21:53 |
| clarkb | maybe the safest thing is for nodepool to detect that case, remove its local copy and the db record and kick the can down the road (eg manual cleanup of the image later) | 21:53 |
| fungi | if we can detect that the image is associated with an instance we could just avoid deleting it from the provider even if it's "expired" | 21:53 |
| clarkb | ya | 21:54 |
| fungi | also possibly remove from np db | 21:54 |
| fungi | so expired images we don't keep the local copy or the db record but we skip the delete from providers if they have references to that image | 21:55 |
| fungi | bonus points if we can do that just for bfv providers | 21:55 |
| *** markvoelker has joined #openstack-infra | 21:56 | |
| clarkb | nodepool already knows if it is booting from volume so we should be able to scope any special behavior to those cases | 21:56 |
| *** armax has joined #openstack-infra | 22:00 | |
| mnaser | i think dfw mirors are being iffy again? | 22:03 |
| mnaser | E: Failed to fetch http://mirror.dfw.rax.opendev.org/ubuntu/dists/bionic-updates/universe/binary-amd64/Packages.gz File has unexpected size (1298819 != 1299303). Mirror sync in progress? [IP: 2001:4800:7819:105:be76:4eff:fe04:9b8a 80] | 22:03 |
| mnaser | http://logs.openstack.org/90/664690/1/check/openstack-tox-docs/70590cf/job-output.txt.gz | 22:04 |
| *** diablo_rojo has joined #openstack-infra | 22:05 | |
| openstackgerrit | Kevin Carter (cloudnull) proposed zuul/zuul-jobs master: Enhance upstream installation mode https://review.opendev.org/664711 | 22:06 |
| *** kjackal has quit IRC | 22:06 | |
| clarkb | mnaser: I'll rerun the flushes | 22:07 |
| * clarkb makes a script | 22:07 | |
| corvus | ianw: should we look into kafs for the mirror heads? | 22:09 |
| *** rcernin has joined #openstack-infra | 22:10 | |
| ianw | corvus: it may be an option, but i think it will be quite bespoke in terms of packages, etc. i started playing with jobs at one point -> https://review.opendev.org/#/c/623974/ | 22:11 |
| clarkb | /home/clarkb/fs_flush.sh on the mirror node for flushing bionic, xenial, trusty repo control files | 22:11 |
| ianw | IIRC the fedora packages were a bit tangled up and some work was going to be done on getting the client bits (python?) working better ... that's about where i stopped | 22:12 |
| *** rfarr_ has quit IRC | 22:12 | |
| corvus | is it not in debuntu? | 22:12 |
| clarkb | cloudnull: I don't think we should fall back with docker installations | 22:13 |
| clarkb | cloudnull: if you want upstream packaging then the job should fail if you don't get it | 22:13 |
| cloudnull | I was kinda trying to implement https://docs.docker.com/install/linux/docker-ce/ubuntu/#uninstall-old-versions as a fall back plan | 22:14 |
| cloudnull | however I'd be happy to force the role into one path or the other | 22:14 |
| ianw | corvus: i do not believe so | 22:15 |
| corvus | :( | 22:16 |
| cloudnull | clarkb - If you think it best I can squash these three commits and make that process change ? | 22:16 |
| ianw | we do, however, have a pretty great framework for doing a bunch of CI ... | 22:16 |
| clarkb | cloudnull: I think the base change is fine as is, it doens't regress old behavior | 22:16 |
| * prometheanfire needs to look at zuul docs for what backends it supports | 22:17 | |
| corvus | prometheanfire: what meaning of the word "backend" do you have in mind? | 22:17 |
| cloudnull | clarkb ok | 22:17 |
| prometheanfire | where can it spin up VMs, openstack sure, but ganeti? | 22:17 |
| cloudnull | clarkb - I'll update that latest change | 22:17 |
| *** ChosSimbaOne has quit IRC | 22:18 | |
| clarkb | corvus: ianw when not concerned about afs things would be curious about your thoughts on the control plane image thing discussed above. I don't want to boot itea06 if it will make nodepool sad | 22:18 |
| corvus | prometheanfire: ah, that's the drivers section in https://zuul-ci.org/docs/nodepool/ | 22:18 |
| prometheanfire | thanks | 22:19 |
| corvus | clarkb: wow, that's very unpleasant. | 22:21 |
| *** slaweq has joined #openstack-infra | 22:22 | |
| corvus | clarkb: i don't think we should subject our production zuul-nodepool to that. i think it will be very hard to disentangle our control-plane from our data-plane if we do. | 22:24 |
| clarkb | ya | 22:25 |
| corvus | clarkb: i think we should find a way to mitigate that (improve sdk/nodepool; separate nodepool instance; improve openstack) in the long term and in the short term maybe manually manage some images or something. | 22:25 |
| clarkb | we can probably manually upload the latest image that has already been built and that will freeze in time for a bit but that should be fine | 22:25 |
| corvus | yeah, first thing we do is upgrade | 22:26 |
| openstackgerrit | Kevin Carter (cloudnull) proposed zuul/zuul-jobs master: Isolate installation mode https://review.opendev.org/664711 | 22:29 |
| *** markvoelker has quit IRC | 22:30 | |
| clarkb | my opensuse kernel seems to have a kafs.ko | 22:30 |
| cloudnull | clarkb ^ that will make it so the role does one or the other, no more distro fall back | 22:30 |
| *** slaweq has quit IRC | 22:30 | |
| ianw | clarkb: sorry if silly question, but how do we delete testing node images then; are we relying on everything moving to the new image before we come back and remove the old one next day? | 22:31 |
| clarkb | ianw: ya I think nodepool is doing its best then as all the old nodes go away it cleans them up | 22:31 |
| ianw | clarkb: yeah, it's more the tools ontop that don't seem to get a lot of packaging love | 22:32 |
| clarkb | ianw: ah fwiw I don't see kafs in the bionic kernel modules list | 22:32 |
| ianw | hrm, so it sort of works there maybe a bit more by luck than design? | 22:32 |
| clarkb | but maybe we can install a package | 22:32 |
| clarkb | ianw: ya | 22:32 |
| openstackgerrit | Kendall Nelson proposed opendev/storyboard-webclient master: Enabling suggestions on all user fields https://review.opendev.org/648525 | 22:32 |
| clarkb | /lib/modules/5.1.7-1-default/kernel/fs/afs on my opensuse machine fwiw | 22:33 |
| openstackgerrit | Kendall Nelson proposed opendev/storyboard-webclient master: Enabling suggestions on all user fields https://review.opendev.org/648525 | 22:34 |
| ianw | clarkb / corvus: so AFAICS https://copr.fedorainfracloud.org/coprs/jsbillings/kafs/packages/ is still pretty much the home of the client utils; which is what was being tested @ https://review.opendev.org/#/c/623974/ | 22:38 |
| corvus | ianw, clarkb: we shouldn't need any tools for a web head, right? | 22:39 |
| corvus | it's all just anonymous access | 22:39 |
| clarkb | right now we are using the fs flush tools, but otherwise ya I think its just mount and read data (with cache) | 22:39 |
| fungi | i have a /lib/modules/4.19.0-5-amd64/kernel/fs/afs/kafs.ko on my (debian unstable/sid) workstation | 22:40 |
| fungi | so seems like the ubuntu kernels would be picking it up too | 22:40 |
| corvus | i also have that on my bionic workstation | 22:40 |
| corvus | i'm not sure i can easily test it atm, because i'm running openafs | 22:41 |
| openstackgerrit | Kendall Nelson proposed opendev/storyboard-webclient master: Allowing the user to choose what Columns are seen https://review.opendev.org/651270 | 22:41 |
| fungi | corvus: do you maybe have a hwe kernel? | 22:42 |
| fungi | /lib/modules/4.15.0-51-generic/kernel/fs/ on mirror.dfw.rax.opendev.org does not have an afs tree | 22:42 |
| fungi | what kernel version are you on? | 22:42 |
| fungi | other possibility is it's coming from a kernel modules package | 22:43 |
| corvus | fungi: no hwe. dpkg says linux-modules-extra-4.15.0-51-generic: | 22:43 |
| fungi | wacky | 22:43 |
| fungi | but maybe that package | 22:44 |
| fungi | we only have linux-modules-4.15.0-51-generic installed, no extra | 22:44 |
| corvus | might be worth a try :) | 22:45 |
| corvus | actually, it may be easy for me to test | 22:45 |
| ianw | yeah, we at least need like the client etc to get the mounts setup ... something i just found https://gitlab.umich.edu/jsbillin/ansible-kafs-workstation/blob/master/roles/kafs/tasks/main.yml | 22:45 |
| clarkb | re the control plane image thing I think I'll hold off on gitea06 for now and we can sync up with mordred when he is around. I think my suggestion will be to take whatever image is current for rax and vexxhost bionic minimal, reupload that under opendev-ubuntu-bionic-$DATE then remove the config from the existing builders | 22:48 |
| clarkb | want to make sure mordred is on board since he was driving a lot of this | 22:48 |
| fungi | it looks to me like the newer openafs tools rely on libkafs2 to interact with the kafs implementation in kernel | 22:48 |
| fungi | which doesn't seem to have made it to ubuntu as far back as bionic | 22:49 |
| fungi | or at all ever | 22:50 |
| fungi | oh, wait, it's libkopenafs2 | 22:50 |
| fungi | yeah, bionic has it: https://packages.ubuntu.com/bionic-updates/libkopenafs2 | 22:50 |
| fungi | the package description there is scant | 22:51 |
| clarkb | kopenafs is a funny name for it | 22:52 |
| clarkb | I wonder if it is shared between implementations? | 22:52 |
| fungi | debian's clarifies "a subset of the interface provided by the Heimdal libkafs library" | 22:52 |
| fungi | so maybe that's not the same thinh | 22:52 |
| fungi | or maybe heimdal added kafs support earlier and openafs is reconsuming it for that purpose? | 22:52 |
| fungi | related presumably to what's packaged in libkafs0-heimdal | 22:53 |
| fungi | which says "Heimdal Kerberos - KAFS support library" | 22:54 |
| fungi | "This package contains the library for KAFS support." | 22:54 |
| *** rkukura_ has joined #openstack-infra | 22:54 | |
| *** auristor has quit IRC | 22:54 | |
| fungi | so, yeah, i think the idea must be openafs userspace calling kafs implementation in linux kernel via libkopenafs2 library interface | 22:54 |
| *** whoami-rajat has quit IRC | 22:55 | |
| ianw | right, looking back through my notes and chat logs; at the time, the kafs packages in that copr were getting confused between "/afs" and "/kafs" and changing the mount point was on the "next" branch | 22:55 |
| *** rkukura has quit IRC | 22:57 | |
| *** rkukura_ is now known as rkukura | 22:57 | |
| fungi | huh, this has been around for ages | 22:58 |
| *** eernst has joined #openstack-infra | 22:59 | |
| corvus | this works: http://paste.openstack.org/show/752781/ | 22:59 |
| *** gfidente has quit IRC | 22:59 | |
| fungi | openafs source package changelog from debian for 1.5.73.3-1 (2010) indicates addition of a "New libkopenafs library providing a kernel PAG manipulation interface (a subset of the API provided by Heimdal's libkafs)." | 22:59 |
| corvus | kafs is supposed to have dynamic root support, but that didn't work so great on my workstation, it's possible that's too new for bionic | 23:00 |
| *** eernst has quit IRC | 23:00 | |
| *** eernst has joined #openstack-infra | 23:00 | |
| corvus | but if it's more stable, i think we can live with a non-dynamic root | 23:00 |
| clarkb | is that what the stuff after the # is for? | 23:00 |
| corvus | yeah | 23:00 |
| corvus | that's "mount the root.afs volume in the openstack.org cell (previously defined) as the afs root volume, preferring read-only volumes" | 23:01 |
| fungi | i don't see us likely adding other afs roots to our mirror hosts anyway | 23:01 |
| corvus | if the dynamic stuff worked, it'd be "mount -t afs none /afs -o dyn" | 23:01 |
| corvus | documented here: https://www.kernel.org/doc/Documentation/filesystems/afs.txt | 23:01 |
| corvus | but the dyn option got me: [4351958.562340] kAFS: Unknown or invalid mount option: 'dyn' | 23:02 |
| corvus | anyway, those 3 commands are all we should need for a web head | 23:02 |
| * clarkb tries here | 23:03 | |
| clarkb | do I need to specify the rootcell on the modprobe if attempting the dynamic option? | 23:03 |
| corvus | clarkb: i would try without | 23:03 |
| *** tkajinam has joined #openstack-infra | 23:04 | |
| clarkb | seemed to work | 23:04 |
| clarkb | no errors, do get auto mount like behavior under the first level of /afs though | 23:05 |
| fungi | that's with linux 5.1? | 23:05 |
| clarkb | so have to cd into /afs/openstack.org before it'll list that dir | 23:05 |
| clarkb | fungi: ya | 23:05 |
| fungi | vs corvus's 4.15 | 23:05 |
| clarkb | 5.1.2-1-default | 23:05 |
| corvus | if anyone wants to make a kernel commit -- that documentation refers to 3 kernel modules but only shows installing 2... | 23:05 |
| *** eernst has quit IRC | 23:05 | |
| corvus | clarkb: cool, that's how i would expect it to function | 23:05 |
| *** auristor has joined #openstack-infra | 23:06 | |
| *** mriedem has quit IRC | 23:06 | |
| fungi | maybe i'll have time to try with the 4.19 i'm running | 23:06 |
| corvus | so if the cache manager is any better, then we could live with the manually configured form in bionic and switch to the dynamic one next time | 23:06 |
| clarkb | seems like it would be worth a try at least | 23:07 |
| clarkb | ianw: ^ what do you think | 23:07 |
| corvus | i guess to test this, we should spin up another mirror host and swap dns? either that, or pause rax-dfw in nodepool and manually switch out cache managers on that host? | 23:08 |
| clarkb | corvus: we can probably use one of the new iad or ord mirros that isn't being used yet | 23:08 |
| clarkb | then we'll have side by side comparison too | 23:08 |
| corvus | oh, i forgot they were booted but not in prod. ++ | 23:08 |
| *** Lucas_Gray has quit IRC | 23:08 | |
| openstackgerrit | Ian Wienand proposed opendev/system-config master: [DNM] kafs testing https://review.opendev.org/623974 | 23:10 |
| fungi | remember we don't yet know that the cache problem is related to bionic vs just something going wrong with the cinder volume attached to the new dfw mirror | 23:10 |
| clarkb | fungi: ya we can probably do ord on openafs, iad on kafs (or vice versa) then we'll be testing both things | 23:11 |
| *** rlandy|ruck has quit IRC | 23:14 | |
| clarkb | cd'ing into the ubuntu mirror dir with my kafs mount doesn't seem to be happening quickly | 23:14 |
| *** goldyfruit has quit IRC | 23:14 | |
| clarkb | that could be my NAT and wifi though | 23:14 |
| ianw | yeah, i'm just looking at what the caching situation is | 23:14 |
| *** smarcet has joined #openstack-infra | 23:14 | |
| corvus | clarkb: yeah, that's normal for even the openafs client | 23:16 |
| ianw | so we want cachefilesd installed | 23:19 |
| *** smarcet has quit IRC | 23:20 | |
| ianw | how about we put iad in disabled and fiddle on that? tracking on https://etherpad.openstack.org/p/opendev-mirror-afs | 23:22 |
| clarkb | wfm | 23:22 |
| *** factor has joined #openstack-infra | 23:22 | |
| *** smarcet has joined #openstack-infra | 23:23 | |
| *** smarcet has quit IRC | 23:26 | |
| *** markvoelker has joined #openstack-infra | 23:26 | |
| openstackgerrit | Ian Wienand proposed opendev/system-config master: Fix syntax for new mirror hosts https://review.opendev.org/664745 | 23:35 |
| ianw | infra-root: ^ ... :/ | 23:35 |
| ianw | that explains why the new hosts didn't seem to be running ansible against them, anyway | 23:35 |
| fungi | i single-core approved it | 23:37 |
| fungi | as i suspect it was cutting the inventory in ~half and only getting us ansible runs against the hosts before that | 23:38 |
| *** goldyfruit has joined #openstack-infra | 23:40 | |
| ianw | i feel like we can lint a no-op thing and at least validate the syntax of the inventory | 23:40 |
| ianw | i will look into that as penance for breaking it :) | 23:41 |
| ianw | on the plus side, makes it easy to fiddle on iad rax mirror because nothing's happened just yet | 23:41 |
| fungi | heh. at an old job we used to practice what i liked to call "punitive documentation" | 23:44 |
| fungi | if you broke something, it was your job to document how not to break it that way in the future | 23:44 |
| *** ianychoi has quit IRC | 23:48 | |
| *** liuyulong has quit IRC | 23:48 | |
| *** ianychoi has joined #openstack-infra | 23:48 | |
| cloudnull | any chance I could get - https://review.opendev.org/#/q/topic:docker-multi-distro+(status:open) reviewed? - sorry for the pestering, I'm working on trying to get to the point where i can use the new tox-molecule job w/ `tripleo-ansible`, but I need this docker-install role to work on cent / fedora. | 23:50 |
| *** aaronsheffield has quit IRC | 23:50 | |
| *** weifan has quit IRC | 23:51 | |
| ianw | cloudnull: sure, i had that up, thanks for adding docs. that symlink had me confused for a bit too :) | 23:53 |
| *** lseki has quit IRC | 23:53 | |
| *** diablo_rojo has quit IRC | 23:53 | |
| *** smarcet has joined #openstack-infra | 23:54 | |
| *** sthussey has quit IRC | 23:54 | |
| cloudnull | yeah, i kinda wish gerrit represented links like that a little better. | 23:54 |
| *** tdasilva_ has joined #openstack-infra | 23:54 | |
| cloudnull | though maybe I also should have called that out in the comments | 23:55 |
| *** jcoufal has joined #openstack-infra | 23:55 | |
| *** dchen has joined #openstack-infra | 23:56 | |
| *** tdasilva has quit IRC | 23:57 | |
| *** jcoufal has quit IRC | 23:57 | |
| *** hwoarang has quit IRC | 23:58 | |
| *** nicolasbock has quit IRC | 23:58 | |
| *** jamesmcarthur has joined #openstack-infra | 23:58 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!