| *** jamesmcarthur has quit IRC | 00:08 | |
| *** goldyfruit_ has joined #openstack-infra | 00:14 | |
| *** jamesmcarthur has joined #openstack-infra | 00:17 | |
| *** weshay has joined #openstack-infra | 00:24 | |
| *** yamamoto has quit IRC | 00:24 | |
| *** markvoelker has quit IRC | 00:26 | |
| *** gyee has quit IRC | 00:27 | |
| *** yamamoto has joined #openstack-infra | 00:28 | |
| *** smarcet has quit IRC | 00:28 | |
| *** jamesmcarthur has quit IRC | 00:31 | |
| *** jamesmcarthur has joined #openstack-infra | 00:32 | |
| *** smarcet has joined #openstack-infra | 00:33 | |
| *** smarcet has quit IRC | 00:37 | |
| *** yamamoto has quit IRC | 00:43 | |
| *** yamamoto has joined #openstack-infra | 00:44 | |
| *** yamamoto has quit IRC | 00:49 | |
| *** yamamoto has joined #openstack-infra | 00:55 | |
| *** jamesmcarthur has quit IRC | 01:14 | |
| *** jamesmcarthur has joined #openstack-infra | 01:17 | |
| *** ianychoi has quit IRC | 01:17 | |
| *** smarcet has joined #openstack-infra | 01:18 | |
| *** ianychoi has joined #openstack-infra | 01:18 | |
| *** dave-mccowan has joined #openstack-infra | 01:21 | |
| *** jamesmcarthur has quit IRC | 01:22 | |
| *** igordc has quit IRC | 01:26 | |
| *** jamesmcarthur has joined #openstack-infra | 01:40 | |
| *** auristor has quit IRC | 01:41 | |
| *** auristor has joined #openstack-infra | 01:53 | |
| *** hongbin has joined #openstack-infra | 01:55 | |
| *** jamesmcarthur has quit IRC | 02:06 | |
| *** jamesmcarthur has joined #openstack-infra | 02:07 | |
| *** ykarel|away has joined #openstack-infra | 02:12 | |
| *** yamamoto has quit IRC | 02:14 | |
| *** prometheanfire has quit IRC | 02:16 | |
| *** prometheanfire has joined #openstack-infra | 02:16 | |
| *** yamamoto has joined #openstack-infra | 02:17 | |
| *** hongbin has quit IRC | 02:33 | |
| *** roman_g has quit IRC | 02:33 | |
| *** hongbin has joined #openstack-infra | 02:34 | |
| *** hwoarang has quit IRC | 02:38 | |
| *** hwoarang has joined #openstack-infra | 02:48 | |
| *** serim has quit IRC | 02:50 | |
| *** yamamoto has quit IRC | 02:59 | |
| *** dave-mccowan has quit IRC | 03:04 | |
| *** psachin has joined #openstack-infra | 03:12 | |
| *** raukadah is now known as chandankumar | 03:23 | |
| *** spsurya has joined #openstack-infra | 03:29 | |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: yum-minimal: Don't install yum, install libcurl https://review.opendev.org/684461 | 03:30 |
|---|---|---|
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: pip-and-virtualenv : deprecate source for CentOS 8, new variables https://review.opendev.org/684462 | 03:30 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: simple-init: Use wrappers to call pip for glean install https://review.opendev.org/685643 | 03:30 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Fix networking for CentOS 8 https://review.opendev.org/684513 | 03:30 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: CentOS 8 minimal testing and support https://review.opendev.org/684860 | 03:30 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: WIP: CentOS 8 support https://review.opendev.org/684308 | 03:30 |
| *** gmann_afk is now known as gmann | 03:33 | |
| *** markvoelker has joined #openstack-infra | 03:41 | |
| *** markvoelker has quit IRC | 03:42 | |
| *** markvoelker has joined #openstack-infra | 03:43 | |
| *** yamamoto has joined #openstack-infra | 03:44 | |
| *** yamamoto has quit IRC | 03:49 | |
| *** hongbin has quit IRC | 03:56 | |
| *** udesale has joined #openstack-infra | 03:57 | |
| *** igordc has joined #openstack-infra | 03:58 | |
| *** ianychoi has quit IRC | 03:59 | |
| *** ianychoi has joined #openstack-infra | 04:00 | |
| *** whoami-rajat has joined #openstack-infra | 04:04 | |
| *** kjackal has joined #openstack-infra | 04:09 | |
| *** smarcet has quit IRC | 04:11 | |
| *** yamamoto has joined #openstack-infra | 04:15 | |
| *** ricolin has joined #openstack-infra | 04:16 | |
| *** rfolco has quit IRC | 04:17 | |
| *** yamamoto has quit IRC | 04:21 | |
| *** surpatil has joined #openstack-infra | 04:26 | |
| *** ykarel|away has quit IRC | 04:27 | |
| *** yamamoto has joined #openstack-infra | 04:28 | |
| *** odicha has joined #openstack-infra | 04:30 | |
| *** jamesmcarthur has quit IRC | 04:31 | |
| *** jamesmcarthur has joined #openstack-infra | 04:33 | |
| AJaeger | config-core, please review https://review.opendev.org/679806 https://review.opendev.org/684374 and https://review.opendev.org/681270 | 04:34 |
| *** spsurya has quit IRC | 04:37 | |
| *** spsurya has joined #openstack-infra | 04:38 | |
| *** weshay has quit IRC | 04:40 | |
| *** ykarel|away has joined #openstack-infra | 04:48 | |
| *** yamamoto_ has joined #openstack-infra | 04:49 | |
| *** ykarel|away is now known as ykarel | 04:51 | |
| *** yamamoto has quit IRC | 04:51 | |
| *** pcaruana has joined #openstack-infra | 05:01 | |
| *** ianychoi has quit IRC | 05:03 | |
| *** ianychoi has joined #openstack-infra | 05:05 | |
| *** jaosorior has joined #openstack-infra | 05:05 | |
| *** dpawlik has joined #openstack-infra | 05:07 | |
| *** jbadiapa has joined #openstack-infra | 05:13 | |
| *** yamamoto_ has quit IRC | 05:16 | |
| *** yamamoto has joined #openstack-infra | 05:16 | |
| *** jamesmcarthur has quit IRC | 05:17 | |
| *** eernst has joined #openstack-infra | 05:19 | |
| *** xenos76 has joined #openstack-infra | 05:20 | |
| *** ianychoi has quit IRC | 05:27 | |
| *** ianychoi has joined #openstack-infra | 05:29 | |
| *** markvoelker has quit IRC | 05:47 | |
| *** jamesmcarthur has joined #openstack-infra | 05:47 | |
| *** igordc has quit IRC | 05:52 | |
| *** yamamoto has quit IRC | 05:57 | |
| *** ianychoi has quit IRC | 06:00 | |
| *** ianychoi has joined #openstack-infra | 06:01 | |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: yum-minimal : update mirrors for Centos 8 https://review.opendev.org/684439 | 06:02 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: dib-python : handle centos 8 https://review.opendev.org/684441 | 06:02 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Update locales for Centos 8 https://review.opendev.org/684442 | 06:02 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Update redhat-common pkg-map for centos 8 https://review.opendev.org/684449 | 06:02 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Add environment switch for centos8 to use dnf https://review.opendev.org/684459 | 06:03 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Use $YUM instead of direct calls in more places https://review.opendev.org/684460 | 06:03 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: yum-minimal: Don't install yum, install libcurl https://review.opendev.org/684461 | 06:03 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: pip-and-virtualenv : deprecate source for CentOS 8, new variables https://review.opendev.org/684462 | 06:03 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: simple-init: Use wrappers to call pip for glean install https://review.opendev.org/685643 | 06:03 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Fix networking for CentOS 8 https://review.opendev.org/684513 | 06:03 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: CentOS 8 minimal testing and support https://review.opendev.org/684860 | 06:03 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: WIP: CentOS 8 support https://review.opendev.org/684308 | 06:03 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Remove "failovermethod=priority" for Fedora (dnf) https://review.opendev.org/685876 | 06:03 |
| openstackgerrit | Merged openstack/project-config master: Remove charm-neutron-api-genericswitch from infra https://review.opendev.org/681270 | 06:04 |
| rm_work | yeah I think Shade used to do some intelligent guessing about region name that the SDK connection doesn't do >_> | 06:07 |
| rm_work | will be interesting to see if this is really the issue tho, because the connect URL looked correct and I'm not sure why lack of region would cause the certificate validation to fail :/ | 06:09 |
| *** surpatil has quit IRC | 06:12 | |
| *** surpatil has joined #openstack-infra | 06:13 | |
| yoctozepto | fungi, clarkb: thx for handling :-) | 06:16 |
| *** jamesmcarthur has quit IRC | 06:20 | |
| *** jbadiapa has quit IRC | 06:22 | |
| *** pgaxatte has joined #openstack-infra | 06:23 | |
| *** jamesmcarthur has joined #openstack-infra | 06:28 | |
| *** jtomasek has joined #openstack-infra | 06:29 | |
| *** lpetrut has joined #openstack-infra | 06:31 | |
| *** yamamoto has joined #openstack-infra | 06:35 | |
| *** ianychoi has quit IRC | 06:40 | |
| *** ianychoi has joined #openstack-infra | 06:42 | |
| *** defionscode has quit IRC | 06:43 | |
| openstackgerrit | Ian Wienand proposed zuul/nodepool master: dib-functional : allow extra elements to be passed https://review.opendev.org/685884 | 06:44 |
| *** iurygregory has joined #openstack-infra | 06:47 | |
| *** yamamoto has quit IRC | 06:47 | |
| openstackgerrit | Merged opendev/system-config master: logrotate: better rotation options https://review.opendev.org/682786 | 06:49 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: [wip] use mirrors for functional test builds https://review.opendev.org/685885 | 06:55 |
| *** hongbin has joined #openstack-infra | 06:56 | |
| *** slaweq has joined #openstack-infra | 06:57 | |
| ianw | Unknown configuration error ... huh | 06:57 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: [wip] use mirrors for functional test builds https://review.opendev.org/685885 | 07:00 |
| *** hongbin has quit IRC | 07:00 | |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: [wip] use mirrors for functional test builds https://review.opendev.org/685885 | 07:02 |
| *** rpittau|afk is now known as rpittau | 07:04 | |
| *** jamesmcarthur has quit IRC | 07:04 | |
| *** zbr is now known as zbr|ruck | 07:08 | |
| *** xek has joined #openstack-infra | 07:12 | |
| *** gregoryo has joined #openstack-infra | 07:14 | |
| *** tesseract has joined #openstack-infra | 07:16 | |
| *** tosky has joined #openstack-infra | 07:16 | |
| *** apetrich has joined #openstack-infra | 07:17 | |
| *** dtantsur|afk is now known as dtantsur | 07:23 | |
| *** kopecmartin|off is now known as kopecmartin | 07:24 | |
| *** jbadiapa has joined #openstack-infra | 07:27 | |
| *** soniya29 has joined #openstack-infra | 07:30 | |
| *** admcleod has quit IRC | 07:34 | |
| *** jpena|off is now known as jpena | 07:43 | |
| *** ralonsoh has joined #openstack-infra | 07:45 | |
| *** pkopec has joined #openstack-infra | 07:46 | |
| *** admcleod has joined #openstack-infra | 07:47 | |
| *** markvoelker has joined #openstack-infra | 07:47 | |
| *** ykarel is now known as ykarel|lunch | 07:48 | |
| *** markvoelker has quit IRC | 07:51 | |
| *** denaitre has quit IRC | 07:58 | |
| *** Jeffrey4l has quit IRC | 07:59 | |
| *** Jeffrey4l has joined #openstack-infra | 08:00 | |
| *** ociuhandu has joined #openstack-infra | 08:02 | |
| *** apetrich has quit IRC | 08:02 | |
| *** rcernin has quit IRC | 08:02 | |
| *** rcernin has joined #openstack-infra | 08:03 | |
| *** jbadiapa has quit IRC | 08:03 | |
| *** tkajinam has quit IRC | 08:04 | |
| *** jbadiapa has joined #openstack-infra | 08:04 | |
| *** apetrich has joined #openstack-infra | 08:06 | |
| openstackgerrit | Slawek Kaplonski proposed opendev/irc-meetings master: Update chairs for various Neutron meetings https://review.opendev.org/685893 | 08:13 |
| *** surpatil has quit IRC | 08:13 | |
| *** jaosorior has quit IRC | 08:16 | |
| *** dchen has quit IRC | 08:18 | |
| *** ociuhandu has quit IRC | 08:21 | |
| *** ociuhandu has joined #openstack-infra | 08:22 | |
| *** yolanda has joined #openstack-infra | 08:23 | |
| *** yamamoto has joined #openstack-infra | 08:26 | |
| *** e0ne has joined #openstack-infra | 08:29 | |
| mordred | rm_work: it should be identical code | 08:31 |
| mordred | also - region_name processing happens after certificate validation - it's about filtering things returned in teh catalog | 08:32 |
| mordred | (unless you have a region-name templated auth url) | 08:32 |
| *** derekh has joined #openstack-infra | 08:32 | |
| *** xenos76 has quit IRC | 08:33 | |
| mordred | corvus: I think adding gcc and friends to python-builder seems like a fine idea. it *could* mask incomplete bindep files, but I don't think that's it's job | 08:36 |
| *** surpatil has joined #openstack-infra | 08:37 | |
| *** ykarel|lunch is now known as ykarel | 08:54 | |
| AJaeger | config-core, please review https://review.opendev.org/679806 and https://review.opendev.org/684374 | 08:59 |
| *** jamesmcarthur has joined #openstack-infra | 09:01 | |
| *** ociuhandu has quit IRC | 09:02 | |
| *** jamesmcarthur has quit IRC | 09:06 | |
| *** gregoryo has quit IRC | 09:14 | |
| *** gfidente has joined #openstack-infra | 09:16 | |
| *** ociuhandu has joined #openstack-infra | 09:23 | |
| openstackgerrit | Merged openstack/project-config master: Add airshipui project https://review.opendev.org/679806 | 09:26 |
| *** ociuhandu has quit IRC | 09:28 | |
| *** rfolco has joined #openstack-infra | 09:29 | |
| *** jbadiapa has quit IRC | 09:29 | |
| *** jbadiapa has joined #openstack-infra | 09:30 | |
| *** ricolin has quit IRC | 09:44 | |
| *** markvoelker has joined #openstack-infra | 09:48 | |
| *** markvoelker has quit IRC | 09:53 | |
| *** xenos76 has joined #openstack-infra | 09:54 | |
| *** yamamoto has quit IRC | 10:02 | |
| *** ociuhandu has joined #openstack-infra | 10:20 | |
| *** jaosorior has joined #openstack-infra | 10:24 | |
| *** udesale has quit IRC | 10:27 | |
| *** udesale has joined #openstack-infra | 10:28 | |
| *** jovial[m] has joined #openstack-infra | 10:35 | |
| jovial[m] | I'm not sure if this is the right channel, but I can't login to the wiki via openid, I get: ` OpenID error | 10:37 |
| jovial[m] | An error occurred: an invalid token was found. `, any ideas? | 10:37 |
| *** soniya29 has quit IRC | 10:37 | |
| frickler | jovial[m]: what openid did you use? it seems to work fine for me with my ubuntu one id | 10:39 |
| openstackgerrit | Merged zuul/zuul master: Replace tox-py36 by tox-py37 https://review.opendev.org/682158 | 10:47 |
| jovial[m] | frickler: I was also using ubuntu one. I don't currently have a username. I got as far as the "choose a username" page and wwhatever I enter there, I always get that same error. | 10:49 |
| jovial[m] | this is the URL that I finish on: https://wiki.openstack.org/wiki/Special:OpenIDLogin/ChooseName | 10:49 |
| *** jbadiapa has quit IRC | 10:53 | |
| *** yamamoto has joined #openstack-infra | 11:00 | |
| *** ykarel is now known as ykarel|meeting | 11:02 | |
| frickler | jovial[m]: hmm, I have no idea, then. maybe some other infra-root can take a look later, as that server also seems to be so old that I can't access it. | 11:04 |
| *** udesale has quit IRC | 11:05 | |
| *** udesale has joined #openstack-infra | 11:06 | |
| jovial[m] | frickler: OK, thanks for looking into it. | 11:07 |
| *** soniya29 has joined #openstack-infra | 11:11 | |
| *** dave-mccowan has joined #openstack-infra | 11:11 | |
| *** roman_g has joined #openstack-infra | 11:14 | |
| *** udesale has quit IRC | 11:17 | |
| *** ykarel|meeting is now known as ykarel | 11:20 | |
| *** hrw has joined #openstack-infra | 11:26 | |
| hrw | good morning | 11:26 |
| hrw | after some zuul change all links there lead to http://zuul.openstack.org/review.opendev.org/XYZ rather to http://review.opendev.org/XYZ | 11:29 |
| hrw | <a href="review.opendev.org/XYZ">XYZ,A</a> in page code | 11:29 |
| frickler | hrw: that is a known issue, sorry for the trouble. hopefully someone can fix this soon | 11:31 |
| hrw | frickler: I may look just do not know where D: | 11:31 |
| openstackgerrit | Merged opendev/irc-meetings master: Update chairs for various Neutron meetings https://review.opendev.org/685893 | 11:31 |
| *** jpena is now known as jpena|lunch | 11:38 | |
| *** jcoufal_ has quit IRC | 11:40 | |
| *** weshay has joined #openstack-infra | 11:41 | |
| AJaeger | hrw: I think that was discussed in #zuul last Friday, you might want to read logs via eavesdrop.o.o | 11:41 |
| hrw | AJaeger: thanks. | 11:42 |
| *** hrw has left #openstack-infra | 11:47 | |
| AJaeger | mnaser: could you check the comment in https://review.opendev.org/#/c/683963/1/roles/tox/library/test_tox_install_sibling_packages.py, please? | 11:48 |
| *** markvoelker has joined #openstack-infra | 11:49 | |
| *** markvoelker has quit IRC | 11:54 | |
| *** yamamoto has quit IRC | 11:58 | |
| *** ianychoi has quit IRC | 12:10 | |
| *** ianychoi has joined #openstack-infra | 12:13 | |
| *** georgk has quit IRC | 12:21 | |
| *** fdegir has quit IRC | 12:21 | |
| *** fdegir has joined #openstack-infra | 12:22 | |
| *** georgk has joined #openstack-infra | 12:22 | |
| *** lpetrut has quit IRC | 12:24 | |
| *** yamamoto has joined #openstack-infra | 12:25 | |
| fungi | jovial[m]: i've seen that on a handful of accounts, something about specific ubuntu one sso openids doesn't seem to work with the version of the mediawiki openid extension we've got (not sure if it would work in other versions of that extension or not) | 12:31 |
| fungi | jovial[m]: i was able to recreate the problem once myself by creating a new ubuntu one account and trying to authenticate with that, but i couldn't tell what the difference was between that account and two other accounts i already had which were working | 12:32 |
| *** ricolin has joined #openstack-infra | 12:32 | |
| jovial[m] | fungi: is there a workaround? | 12:32 |
| fungi | jovial[m]: unless someone (likely someone with a much better grasp of php than me) finds time to try and dig into the mediawiki openid extension and add some additional debugging, possibly also in collaboration with one of the ubuntu one sso maintainers, the only workaround i know about right now is to ask someone with a working wiki account to make edits for you | 12:33 |
| *** trident has quit IRC | 12:34 | |
| fungi | we're in the process of rebuilding and upgrading wiki.openstack.org, which will have a newer version of that extension, so that might also just make the problem go away, but there's no current estimate for when that will get done either | 12:34 |
| *** trident has joined #openstack-infra | 12:35 | |
| *** yamamoto has quit IRC | 12:37 | |
| *** kjackal has quit IRC | 12:37 | |
| *** jpena|lunch is now known as jpena | 12:38 | |
| *** georgk has quit IRC | 12:45 | |
| *** fdegir has quit IRC | 12:45 | |
| *** georgk has joined #openstack-infra | 12:45 | |
| *** fdegir has joined #openstack-infra | 12:45 | |
| *** smarcet has joined #openstack-infra | 12:45 | |
| *** kjackal has joined #openstack-infra | 12:45 | |
| *** kjackal has quit IRC | 12:46 | |
| *** kjackal has joined #openstack-infra | 12:49 | |
| AJaeger | infra-root, FYI, we have zuul errors regarding the neutron feature/graphql branch that release automation accidently re-created. Change https://review.opendev.org/685955 will avoid recreation - and then I'll ask for removal of the branch again. | 12:50 |
| fungi | thanks AJaeger! | 12:53 |
| *** Goneri has joined #openstack-infra | 12:56 | |
| *** jaosorior has quit IRC | 12:58 | |
| *** rcernin has quit IRC | 12:58 | |
| *** jaosorior has joined #openstack-infra | 13:02 | |
| *** jbadiapa has joined #openstack-infra | 13:06 | |
| *** yamamoto has joined #openstack-infra | 13:10 | |
| *** dpawlik has quit IRC | 13:12 | |
| *** dave-mccowan has quit IRC | 13:13 | |
| *** dave-mccowan has joined #openstack-infra | 13:14 | |
| *** mriedem has joined #openstack-infra | 13:15 | |
| *** jbadiapa has quit IRC | 13:16 | |
| *** yamamoto has quit IRC | 13:17 | |
| *** dave-mccowan has quit IRC | 13:19 | |
| *** trident has quit IRC | 13:22 | |
| *** trident has joined #openstack-infra | 13:23 | |
| *** soniya29 has quit IRC | 13:23 | |
| *** aaronsheffield has joined #openstack-infra | 13:25 | |
| *** dpawlik has joined #openstack-infra | 13:29 | |
| *** jcoufal has joined #openstack-infra | 13:31 | |
| openstackgerrit | Kostyantyn Kalynovskyi proposed openstack/project-config master: Add airship/apis project https://review.opendev.org/684374 | 13:32 |
| AJaeger | infra-root, 685955 is merged, could you delete the neutron branch feature/graphql again, please? | 13:39 |
| *** bdodd has joined #openstack-infra | 13:41 | |
| *** ociuhandu has quit IRC | 13:42 | |
| *** michael-beaver has joined #openstack-infra | 13:42 | |
| *** ociuhandu has joined #openstack-infra | 13:43 | |
| *** sthussey has joined #openstack-infra | 13:46 | |
| *** ociuhandu has quit IRC | 13:48 | |
| *** eernst has quit IRC | 13:49 | |
| *** markvoelker has joined #openstack-infra | 13:50 | |
| *** jaosorior has quit IRC | 13:51 | |
| *** markvoelker has quit IRC | 13:55 | |
| fungi | Code Review - Error: branch openstack/neutron,refs/heads/feature/graphql has open changes | 13:57 |
| *** markvoelker has joined #openstack-infra | 13:57 | |
| fungi | i expect the branch creation triggered a .gitreview patch proposal | 13:57 |
| fungi | searching now | 13:57 |
| fungi | abandoning https://review.opendev.org/685768 and https://review.opendev.org/685767 | 13:58 |
| *** odicha has quit IRC | 13:59 | |
| fungi | #status log deleted feature/graphql branch of openstack/neutron previously at 9ee628dcc0eb61418e86fee355add38a6b09fab9 per https://review.opendev.org/685955 | 13:59 |
| *** SurajPatil has joined #openstack-infra | 13:59 | |
| openstackstatus | fungi: finished logging | 13:59 |
| fungi | AJaeger: ^ thanks! | 14:00 |
| openstackgerrit | Merged openstack/project-config master: Add airship/apis project https://review.opendev.org/684374 | 14:00 |
| *** markvoelker has quit IRC | 14:01 | |
| AJaeger | thanks, fungi . slaweq FYI ^ | 14:01 |
| *** jcoufal_ has joined #openstack-infra | 14:02 | |
| *** odicha has joined #openstack-infra | 14:02 | |
| *** surpatil has quit IRC | 14:02 | |
| *** jcoufal has quit IRC | 14:05 | |
| *** mtreinish has joined #openstack-infra | 14:06 | |
| slaweq | AJaeger: fungi thx | 14:06 |
| *** mattmceuen has left #openstack-infra | 14:06 | |
| *** surpatil has joined #openstack-infra | 14:08 | |
| *** ociuhandu has joined #openstack-infra | 14:10 | |
| *** SurajPatil has quit IRC | 14:11 | |
| *** SurajPatil has joined #openstack-infra | 14:20 | |
| *** markvoelker has joined #openstack-infra | 14:22 | |
| *** surpatil has quit IRC | 14:22 | |
| *** markvoelker has quit IRC | 14:26 | |
| *** surpatil has joined #openstack-infra | 14:26 | |
| *** markvoelker has joined #openstack-infra | 14:27 | |
| *** SurajPatil has quit IRC | 14:29 | |
| *** smarcet has quit IRC | 14:31 | |
| openstackgerrit | James E. Blair proposed zuul/zuul-registry master: Initial implementation https://review.opendev.org/683958 | 14:34 |
| openstackgerrit | James E. Blair proposed zuul/zuul-registry master: Fix container image build https://review.opendev.org/685808 | 14:34 |
| donnyd | fungi: Have you heard any complaints lately about FN? Just wanting to make sure the reduction in test nodes actually worked | 14:39 |
| *** lpetrut has joined #openstack-infra | 14:40 | |
| clarkb | I havent heard any | 14:41 |
| donnyd | clarkb: I got around to setting up some irc notifications and I haven't either. I think 65 is what FN is reliably do without issues. | 14:42 |
| donnyd | Which bums me out a little, I really wanted to hit 100.. maybe more tuning can get me there | 14:42 |
| *** dpawlik has quit IRC | 14:43 | |
| *** lpetrut has quit IRC | 14:47 | |
| mordred | corvus: re: adding gcc/g++ to the python-builder image ... I think the easiest thing would be to just switch python-builder to being based on python and not python:slim. python has gcc/make installed in it already | 14:51 |
| openstackgerrit | Monty Taylor proposed opendev/system-config master: Use python base image for python-builder https://review.opendev.org/685989 | 14:52 |
| mordred | corvus: like that ^^ | 14:52 |
| fungi | donnyd: did you manage to figure out what resource contention you were hitting when pushing above 65? | 14:54 |
| fungi | or is that still unknown? | 14:55 |
| *** jamesmcarthur has joined #openstack-infra | 14:55 | |
| donnyd | fungi: I am thinking it was CPU. I am not oversubscribed on memory, and when I measured IO (with fio) at full load it appeared as though nothing was even running. I feel pretty safe in saying that I cannot oversubscribe CPU's on FN due to their age | 14:57 |
| donnyd | At 65 CPU subscription is around 105% | 14:58 |
| fungi | makes sense, it's hard to cleanly timeslice on x86 architecture too | 14:58 |
| *** jbadiapa has joined #openstack-infra | 14:58 | |
| corvus | mordred: oh neat that's easy | 14:59 |
| donnyd | I am sure there is more tuning I could do, but I don't want to push much further past standard configs because I worry about the risk of jobs then passing on FN that don't pass other places from the huge bump in IO | 15:00 |
| donnyd | I guess I can just be happy with what I can get out of it. | 15:01 |
| *** xenos76 has quit IRC | 15:04 | |
| *** jbadiapa has quit IRC | 15:05 | |
| donnyd | fungi: It would be cool if I could get churn metrics on how many jobs FN does per hour or something like that | 15:05 |
| donnyd | I am curious to know if the IO helps in getting those jobs done faster or if the old CPU's balance out the faster IO speeds | 15:06 |
| fungi | mgagne: i don't know if it's important, but we've gotten a couple of notifications today that "our" credit card is expiring shortly, and to log into the internap portal and update our billing details to avoid any service interruption | 15:06 |
| fungi | (one for the contact address of each of our two tenants there) | 15:07 |
| fungi | donnyd: i'm trying to think if we have anything like that from statsd/graphite | 15:08 |
| openstackgerrit | James E. Blair proposed zuul/zuul-registry master: Initial implementation https://review.opendev.org/683958 | 15:10 |
| openstackgerrit | James E. Blair proposed zuul/zuul-registry master: Fix container image build https://review.opendev.org/685808 | 15:10 |
| openstackgerrit | Fabien Boucher proposed zuul/zuul master: WIP - Gitlab - Basic handling of merge_requests event https://review.opendev.org/685990 | 15:12 |
| *** lpetrut has joined #openstack-infra | 15:13 | |
| *** ociuhandu has quit IRC | 15:17 | |
| *** ociuhandu has joined #openstack-infra | 15:18 | |
| *** smarcet has joined #openstack-infra | 15:19 | |
| *** ianychoi has quit IRC | 15:20 | |
| *** iurygregory has quit IRC | 15:21 | |
| *** ianychoi has joined #openstack-infra | 15:23 | |
| *** ociuhandu has quit IRC | 15:24 | |
| *** prometheanfire has quit IRC | 15:24 | |
| *** ociuhandu has joined #openstack-infra | 15:25 | |
| *** prometheanfire has joined #openstack-infra | 15:25 | |
| *** ykarel is now known as ykarel|afk | 15:26 | |
| *** ociuhandu has quit IRC | 15:30 | |
| *** ociuhandu has joined #openstack-infra | 15:31 | |
| *** mattw4 has joined #openstack-infra | 15:32 | |
| *** tesseract has quit IRC | 15:33 | |
| *** smarcet has quit IRC | 15:33 | |
| *** gyee has joined #openstack-infra | 15:34 | |
| *** lpetrut has quit IRC | 15:35 | |
| *** ociuhandu has quit IRC | 15:36 | |
| corvus | infra-root: i went to sign into gerrit's gerrit using infra-root's account, and google has decided that it wants to send me an sms code before it will let me log in. i'm not willing to associate that account with my personal number. does infra-root have a cell phone we can use for this purpose, or are we stuck? | 15:38 |
| mordred | wow | 15:38 |
| mordred | I feel like it would be nice to have an sms something that could be accessed somehow by infra-root people rather than being associated with someone's phone | 15:39 |
| mordred | are there reasonably free/open solutions for such a thing? | 15:39 |
| clarkb | corvus: I think we can set up a u2f key (or pair of keys instead) | 15:39 |
| clarkb | or totp | 15:39 |
| corvus | clarkb: i'm not sure that's an option | 15:39 |
| clarkb | oh hrm | 15:39 |
| corvus | this isn't 2fa -- this is 'we think you are a bot' | 15:40 |
| clarkb | ah | 15:40 |
| fungi | in fairness, the account is for a bot | 15:40 |
| corvus | indeed | 15:40 |
| clarkb | that might be something luca knows how to handle? | 15:40 |
| fungi | might also be worth asking the gerrit community if this is something they've already worked out? | 15:40 |
| clarkb | since they run a ci system separate of the google hivemind right? | 15:40 |
| corvus | i would bet a nickel someone just put their phone number in | 15:41 |
| fungi | or they manually create ci accounts internal to gerrit rather than put them through google auth? | 15:41 |
| fungi | (like we used to do) | 15:41 |
| mordred | googling for "open source service for receiving automated SMS" gets lots of results for *sending* SMS | 15:41 |
| *** jpena is now known as jpena|brb | 15:42 | |
| donnyd | Why not use google voice and then tie phone numbers to that one google voice account | 15:42 |
| clarkb | donnyd: doesn't that just nest the problem? still need sms for the voice account? | 15:42 |
| *** ociuhandu has joined #openstack-infra | 15:42 | |
| *** rpittau is now known as rpittau|afk | 15:42 | |
| donnyd | voice does sms | 15:42 |
| mordred | yeah - we'd need to be able to log in to a google account to add a voice account | 15:42 |
| clarkb | donnyd: right but to verify the voice acount... | 15:43 |
| donnyd | You will need a real phone | 15:43 |
| clarkb | right | 15:43 |
| clarkb | which is the pickle we are in right now anyway | 15:43 |
| donnyd | LOL | 15:43 |
| *** xek has quit IRC | 15:44 | |
| donnyd | I see, so nobody wants to tie their number to it... Maybe a SIP account with sms support would work then | 15:44 |
| *** rh-jelabarre has joined #openstack-infra | 15:44 | |
| clarkb | can our asterisk server do sms? | 15:44 |
| *** xek has joined #openstack-infra | 15:44 | |
| fungi | hah, the trunk for the pbx? ;) | 15:44 |
| fungi | indeed | 15:45 |
| corvus | https://wiki.voip.ms/article/SMS | 15:45 |
| donnyd | corvus: that is what a couple peoples on reddit said too | 15:45 |
| corvus | that's the service we use for pbx.openstack.org so should be easy to try | 15:46 |
| corvus | there's a good chance that google might know about that and choose not to accept that number | 15:46 |
| corvus | but maybe it's worth a try :) | 15:46 |
| *** ociuhandu has quit IRC | 15:46 | |
| donnyd | well if you can just get direct texts, and given asterisk can support sms you should be able to forward from there no? | 15:47 |
| donnyd | https://wiki.asterisk.org/wiki/display/AST/SMS | 15:47 |
| corvus | apparently voip.ms can forward the sms to email, so no ast setup required | 15:47 |
| corvus | i'll give this a shot :) | 15:48 |
| * mordred expects great things | 15:48 | |
| *** ociuhandu has joined #openstack-infra | 15:49 | |
| donnyd | oh nice, well then that may be problem solved | 15:49 |
| * donnyd gets coffee and waits for result | 15:50 | |
| corvus | fungi, clarkb: the email address for the account is not one that i have access to; do you? | 15:50 |
| donnyd | all of these anti-bot protections make it difficult to be a bot these days | 15:51 |
| corvus | fungi, clarkb: oh, it looks like you can specify an email address for sms, so that shouldn't be an issue | 15:51 |
| corvus | donnyd: tell me about it | 15:51 |
| corvus | (ftr, i did ask the gerrit folks how they would like this account created, and i did that) | 15:51 |
| clarkb | corvus: if its scotts address due to billing we can work something out if necessary I bet. But if you can set it to infra-root@o.o even better | 15:52 |
| corvus | wow you can have sms's trigger http url. could totally add an sms trigger for zuul. | 15:53 |
| mordred | corvus: and a zuul sms reporter too | 15:55 |
| mordred | first python contract I ever did was writing snpp support ... would be an amusing reporter - and very mean to connect someone's phone to | 15:55 |
| mordred | maybe for april fool's we could have zuul sms jbryce every time a patch merges... | 15:56 |
| corvus | even better if we can get one of those premium rate sms numbers and monetize it :) | 15:57 |
| fungi | i remember at an early sysadmin job where we were issued sms-capable cell phones, i built an sms/e-mail interface to perform ping/traceroute and reply with the results | 15:57 |
| mordred | corvus: "you can recheck a zuul job via sms for a small cost" | 15:57 |
| corvus | our "watson i want to see you" moment has arrived: i sent an sms message, "Sup?", to our number and have received an email | 15:59 |
| clarkb | mordred: tie it to promotion and charge even more :) | 15:59 |
| fungi | heh, charge a messaging fee for rechecks ;) | 15:59 |
| corvus | that seemed to be the appropriate first sms to send | 15:59 |
| fungi | the telephony equivalent of "hello world" | 16:00 |
| corvus | "This phone number cannot be used for verification." | 16:01 |
| clarkb | well then | 16:01 |
| fungi | shoot | 16:01 |
| fungi | with as many bots as google slams our webservers, it's amusing they're prejudiced against anyone else's bots | 16:03 |
| corvus | well, i already got the api password, so strictly speaking, i don't think we're blocked now as long as we can use the rest api for everything we need | 16:03 |
| *** surpatil has quit IRC | 16:04 | |
| *** pgaxatte has quit IRC | 16:09 | |
| *** surpatil has joined #openstack-infra | 16:10 | |
| openstackgerrit | Clark Boylan proposed zuul/zuul-jobs master: Revert "Use import_role on persistent-firewall" https://review.opendev.org/685996 | 16:11 |
| *** ociuhandu has quit IRC | 16:11 | |
| *** SurajPatil has joined #openstack-infra | 16:13 | |
| *** surpatil has quit IRC | 16:16 | |
| *** e0ne has quit IRC | 16:18 | |
| *** jpena|brb is now known as jpena | 16:19 | |
| *** lpetrut has joined #openstack-infra | 16:22 | |
| corvus | i approved https://review.opendev.org/682749 which is the next step in talking to gerrit | 16:23 |
| corvus | when that's in and reconfigured, we recheck https://review.opendev.org/682758 | 16:24 |
| donnyd | corvus: the only thing that really worries me is if gerrit will actually renew some car warranty | 16:24 |
| *** ociuhandu has joined #openstack-infra | 16:25 | |
| *** weshay_ has joined #openstack-infra | 16:25 | |
| mordred | donnyd: Yeah, but I'm sayin', that TruCoat, you don't get it and you get oxidization problems. | 16:26 |
| *** weshay has quit IRC | 16:26 | |
| *** SurajPatil has quit IRC | 16:27 | |
| * donnyd hopes gerrit doesn't also need a new medical plan | 16:28 | |
| *** ociuhandu has quit IRC | 16:29 | |
| openstackgerrit | Jimmy McArthur proposed zuul/zuul-website master: CSS fix for ul/li in FAQ https://review.opendev.org/686003 | 16:31 |
| *** ricolin has quit IRC | 16:33 | |
| *** smarcet has joined #openstack-infra | 16:36 | |
| *** ykarel|afk is now known as ykarel|away | 16:36 | |
| *** dtantsur is now known as dtantsur|afk | 16:40 | |
| openstackgerrit | Merged opendev/system-config master: Use the gerrit driver for the googlesource connection https://review.opendev.org/682749 | 16:40 |
| *** ykarel|away has quit IRC | 16:43 | |
| *** weshay_ is now known as weshay | 16:46 | |
| *** imacdonn has quit IRC | 16:48 | |
| *** gfidente is now known as gfidente|afk | 16:55 | |
| *** smarcet has quit IRC | 16:58 | |
| *** derekh has quit IRC | 17:01 | |
| *** armax has quit IRC | 17:06 | |
| tosky | uh, which component does create the zuul user and its directory (/home/zuul)? In the devstack/tempest jobs there is a difference in permissions between ubuntu images (0755) and centos 7 ones (0700), | 17:07 |
| tosky | and the latter breaks the jobs where the run-tempest role tries to access the tempest_blacklist file shipped by a tempest plugin (so somewhere under /home/zuul) | 17:08 |
| tosky | I'd say that 0711 would be a reasonable compromise, but I'm not sure where that value should be changed | 17:08 |
| clarkb | tosky: its part of our image build process with dib | 17:08 |
| clarkb | there is a zuul element /me finds it | 17:08 |
| clarkb | tosky: that implies to me that centos and ubuntu have different modmasks | 17:09 |
| clarkb | tosky: https://opendev.org/openstack/project-config/src/branch/master/nodepool/elements/zuul-worker/install.d/60-zuul-worker | 17:10 |
| tosky | yep | 17:10 |
| tosky | I can see the different default permissions from a quick test on Fedora (which should have the same CentOS settings) and Debian (for Ubuntu, unless they changed) | 17:12 |
| tosky | do you think that setting the value to 0711 would be acceptable (so restricting it a bit on Ubuntu), or should I try to just set it for CentOS/RHEL/Fedora where permissions are more restricted? | 17:14 |
| *** yamamoto has joined #openstack-infra | 17:15 | |
| *** jpena is now known as jpena|off | 17:16 | |
| *** xenos76 has joined #openstack-infra | 17:19 | |
| *** yamamoto has quit IRC | 17:19 | |
| AJaeger | clarkb: ianw flagged https://review.opendev.org/683431 for PTL review if you want to tackle it at some point. it adds a special nested label for VMs. | 17:20 |
| clarkb | tosky: we probably need to set the modmask otherwise your subdirs with the git repos will be restricted too | 17:20 |
| *** andreww has joined #openstack-infra | 17:21 | |
| clarkb | AJaeger: thanks | 17:21 |
| AJaeger | config-core, any opinion on https://review.opendev.org/683028 (add a I'm not a robot voting option)? I'm torn, will +2 tomorrow probably... | 17:21 |
| *** ykarel|away has joined #openstack-infra | 17:22 | |
| tosky | clarkb: from what I've seen from some tests, that should be fine | 17:22 |
| clarkb | tosky: isn't the issue that the tempest user can't read from a git repo under the homedir? that will persist if you don't change the modmask | 17:22 |
| clarkb | tosky: you can open the top level dir but if the git repo isn't navigable it will still fail | 17:23 |
| tosky | clarkb: this is what I see right now: http://paste.openstack.org/show/780566/ | 17:23 |
| clarkb | if we change the modmask then all new dirs will have the correct perms | 17:23 |
| *** xarses_ has quit IRC | 17:23 | |
| clarkb | oh interesting so its the top level dir only that has a problem and modmask is fine otherwise | 17:24 |
| tosky | I understand the concerns, it's just that I'd prefer to touch as many directories as possible; I still remember how much time the patch which restricted the files touched by devstack took :) | 17:24 |
| *** kjackal has quit IRC | 17:25 | |
| tosky | the less likely is that someone starts shouting tomorrow and reverts the patch, the better I feel :) | 17:25 |
| clarkb | tosky: one option if you are wary about that is to have the job update the homedir perm early | 17:25 |
| clarkb | then eg tripleo will be left untouched | 17:26 |
| tosky | actually tripleo jobs shouldn't suffer, as their permissions will increase | 17:26 |
| tosky | I'm more concerned on restricting them on ubuntu | 17:26 |
| clarkb | well tripleo has explicitly complained about too permissive perms on dirs in jobs | 17:27 |
| clarkb | which is why I mentioned them | 17:27 |
| tosky | oh | 17:27 |
| clarkb | and you don't necessarily have to remove perms on ubuntu | 17:27 |
| clarkb | you can use relative perm adds like +x | 17:27 |
| *** ralonsoh has quit IRC | 17:27 | |
| tosky | that too | 17:27 |
| tosky | I just though that this more about a default zuul "thing", so fixing it in zuul would have been better | 17:28 |
| clarkb | ya I'll have to think about it a bit more. My initial impression is that this would be a good default, but I've been wrong about that in the past :) | 17:29 |
| tosky | I vaguely rememeber some of the discussions about the permissions, maybe I can raise them with the people who complained | 17:30 |
| tosky | do you remember who was involved in the those discussions from the tripleo side? | 17:30 |
| clarkb | tosky: zbr|ruck | 17:31 |
| zbr|ruck | hi. i was about to leave. | 17:31 |
| tosky | zbr|ruck: oh, nothing urgent; when you can, please check the backlog | 17:31 |
| *** lpetrut has quit IRC | 17:31 | |
| tosky | the tl;dr question is: in the light of the previous discussions about permissions, would 0711 be acceptable for /home/zuul instead of the current centos default of 0700 ? | 17:32 |
| zbr|ruck | shortly is not a tripleo issue, is ansible default security model: not loading its config from folders which are world-writeable | 17:32 |
| zbr|ruck | something that I find resonable | 17:32 |
| pabelanger | clarkb: tosky: I mean, the default under fedora is 0700 for homedirectory, so changing it across the board would be different in what users have. That said, I also think the idea of a pre-run jobs, is also good, for users that want to relax it | 17:33 |
| tosky | pabelanger: in general, does it mean that any customizations applied to the images used by zuul should not diverge from the default content of the official cloud images? | 17:34 |
| *** e0ne has joined #openstack-infra | 17:35 | |
| pabelanger | tosky: no, but as we diverge things, it makes them more different then what users get out of box | 17:35 |
| pabelanger | if job or app needs specific change, maybe better to also include that in the process of install or documentation over fixing in just CI images | 17:35 |
| *** igordc has joined #openstack-infra | 17:37 | |
| tosky | I guess I can add a task into the devstack.git, playbooks/pre.yaml, pre_tasks: section | 17:38 |
| *** jamesmcarthur has quit IRC | 17:38 | |
| zbr|ruck | i kinda agreee with pabelanger that we should aim to keep systems as close to default/supported status whenever this is possible. | 17:41 |
| tosky | thanks all | 17:42 |
| *** armax has joined #openstack-infra | 17:47 | |
| *** jamesmcarthur has joined #openstack-infra | 17:48 | |
| *** kjackal has joined #openstack-infra | 17:51 | |
| tosky | and I guess I can safely use ansible_user_dir instead of hardcoding /home/zuul | 17:53 |
| corvus | i'm running zuul-scheduler full-reconfigure to pick up the googlesource connection change | 17:58 |
| *** jamesmcarthur has quit IRC | 17:59 | |
| *** jamesmcarthur has joined #openstack-infra | 17:59 | |
| *** Goneri has quit IRC | 17:59 | |
| *** xenos76 has quit IRC | 18:01 | |
| *** whoami-rajat has quit IRC | 18:02 | |
| corvus | that's done | 18:04 |
| *** jamesmcarthur has quit IRC | 18:04 | |
| AJaeger | corvus: is the Zuul Web UI link to changes issue also fixed? | 18:06 |
| corvus | oh, hrm, it looks like full-reconfigure doesn't restart the drivers, so this will need a full restart | 18:07 |
| corvus | AJaeger: i'm not aware of a change to fix that | 18:08 |
| AJaeger | ;( ok | 18:08 |
| corvus | i'll look into doing a full restart after lunch+meeting | 18:09 |
| *** psachin has quit IRC | 18:10 | |
| *** Goneri has joined #openstack-infra | 18:11 | |
| *** psachin has joined #openstack-infra | 18:12 | |
| *** smarcet has joined #openstack-infra | 18:15 | |
| *** xenos76 has joined #openstack-infra | 18:15 | |
| *** e0ne has quit IRC | 18:17 | |
| *** psachin has quit IRC | 18:17 | |
| *** jamesmcarthur has joined #openstack-infra | 18:19 | |
| *** jamesmcarthur has quit IRC | 18:23 | |
| *** harlowja has joined #openstack-infra | 18:32 | |
| *** Goneri has quit IRC | 18:34 | |
| *** ociuhandu has joined #openstack-infra | 18:34 | |
| *** ociuhandu has quit IRC | 18:37 | |
| *** ociuhandu has joined #openstack-infra | 18:39 | |
| openstackgerrit | Merged zuul/zuul-jobs master: Revert "Use import_role on persistent-firewall" https://review.opendev.org/685996 | 18:42 |
| *** gfidente|afk has quit IRC | 18:45 | |
| *** ociuhandu has quit IRC | 18:46 | |
| *** ociuhandu has joined #openstack-infra | 18:46 | |
| *** jamesmcarthur has joined #openstack-infra | 18:47 | |
| *** Goneri has joined #openstack-infra | 18:48 | |
| *** jcoufal_ has quit IRC | 18:54 | |
| openstackgerrit | Merged zuul/zuul-jobs master: Allow upload-logs to toggle compression of console logs https://review.opendev.org/567696 | 18:56 |
| fungi | corvus: i think we may have collided on editing the secrets file. feel free to overwrite and i can readd mine when you're done. sorry! | 18:56 |
| clarkb | meeting time in a couple minutes | 18:58 |
| *** xenos76 has quit IRC | 19:00 | |
| corvus | fungi: oh, i'm only reading it | 19:00 |
| corvus | fungi: i have exited | 19:00 |
| corvus | fungi: maybe double check that your update is there? (i expect it to be) | 19:00 |
| fungi | corvus: yep, it's in there. thanks! | 19:00 |
| *** smarcet has quit IRC | 19:06 | |
| *** ociuhandu has quit IRC | 19:07 | |
| *** smarcet has joined #openstack-infra | 19:08 | |
| *** e0ne has joined #openstack-infra | 19:08 | |
| *** spsurya has quit IRC | 19:09 | |
| AJaeger | mnaser: could you check the comment in https://review.opendev.org/#/c/683963/1/roles/tox/library/test_tox_install_sibling_packages.py, please? | 19:13 |
| *** pcrews has quit IRC | 19:15 | |
| openstackgerrit | Mohammed Naser proposed zuul/zuul-jobs master: Add unit tests for tox_instalL_sibling_packages https://review.opendev.org/683963 | 19:18 |
| mnaser | AJaeger: done :> | 19:18 |
| AJaeger | thanks, mnaser | 19:19 |
| AJaeger | ianw: your comment got addressed ^ | 19:20 |
| *** markvoelker has quit IRC | 19:21 | |
| *** smarcet has quit IRC | 19:24 | |
| *** xenos76 has joined #openstack-infra | 19:39 | |
| openstackgerrit | Merged zuul/zuul-jobs master: Add unit tests for tox_instalL_sibling_packages https://review.opendev.org/683963 | 19:42 |
| *** eernst has joined #openstack-infra | 19:42 | |
| *** eernst has quit IRC | 19:46 | |
| *** smarcet has joined #openstack-infra | 19:46 | |
| rm_work | eugh nm, i'm back to thinking i may need a hold | 19:48 |
| rm_work | could someone put a hold for me on 683285? | 19:48 |
| clarkb | rm_work: for what job? | 19:48 |
| rm_work | or possibly tell me what they think could cause this? | 19:49 |
| rm_work | https://zuul.opendev.org/t/openstack/build/b164ed07603247579293699a1d6e007f | 19:49 |
| rm_work | SSLError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed (_ssl.c:852)') | 19:49 |
| rm_work | (this may belong in the SDK channel but ... this is related to the hold) | 19:50 |
| rm_work | it's a slightly different way of authing the SDK connection, and suddenly the certs don't verify | 19:50 |
| rm_work | which seems odd to me and i can't repro locally | 19:50 |
| clarkb | don't use https against a mirror which only has http? | 19:50 |
| rm_work | so, it was JUST connecting | 19:50 |
| rm_work | if you look at the full log, this is the third run against the cloud | 19:50 |
| rm_work | i didn't change the URL | 19:51 |
| rm_work | at least I don't think I did? | 19:51 |
| rm_work | previously it was coming from the devstack supplied clouds.yaml so i guess possibly i'm using the wrong URL now? but this wasn't something I changed (the code has always been using that) | 19:51 |
| rm_work | and I would think the devstack would use HTTPS? does it not? | 19:52 |
| rm_work | I can try removing the S | 19:52 |
| clarkb | oh what that isn't the mirror for some reason I read it as trying to fetch from the mirror | 19:52 |
| clarkb | its the localhost running openstack services | 19:53 |
| rm_work | yes | 19:53 |
| clarkb | it may not listen on the public address | 19:53 |
| rm_work | but now that you say that, maybe it's possible that devstack didn't spin up for HTTPS? | 19:53 |
| clarkb | it may only listen on localhost or other private ip | 19:53 |
| clarkb | or ya no https | 19:53 |
| rm_work | hmm | 19:53 |
| clarkb | check the apache logs and config | 19:53 |
| rm_work | oh does it store the clouds.yaml | 19:54 |
| *** fdegir has quit IRC | 19:54 | |
| rm_work | that'd be best to see | 19:54 |
| rm_work | yesss | 19:54 |
| rm_work | it does, sweet | 19:54 |
| rm_work | hmmmm | 19:54 |
| rm_work | AH | 19:54 |
| rm_work | the clouds.yaml specifies a cacert | 19:54 |
| *** fdegir has joined #openstack-infra | 19:54 | |
| rm_work | which makes sense because it would be all snakeoil | 19:54 |
| clarkb | its not snakeoil, but it is a local CA | 19:55 |
| rm_work | kk this explains it | 19:55 |
| rm_work | so i need to give that cacert to the SDK | 19:55 |
| rm_work | thanks :D | 19:55 |
| rm_work | <3 | 19:55 |
| rm_work | do you know how that clouds.yaml is built by devstack? is the path to that cacert in an ENV VAR somewhere/ | 19:56 |
| rm_work | I could hardcode it but usually try to avoid that since i assume devstack puts EVERYTHING in an env var | 19:56 |
| clarkb | its in the devstack/tools/ dir as a script iirc | 19:56 |
| rm_work | or i could just do --insecure :D | 19:57 |
| *** slaweq has quit IRC | 19:59 | |
| *** markvoelker has joined #openstack-infra | 20:00 | |
| rm_work | AHA! it's $SSL_BUNDLE_FILE | 20:01 |
| rm_work | ;) | 20:01 |
| AJaeger | corvus: is https://review.opendev.org/#/c/680696 ready now? "Switch to prepare-workspace-git role" | 20:01 |
| rm_work | thanks (again) for the pointer clarkb :) | 20:01 |
| corvus | AJaeger: i have not verified that we have new image builds since 682934 | 20:03 |
| corvus | maybe someone else has? | 20:03 |
| *** eernst has joined #openstack-infra | 20:07 | |
| *** jamesmcarthur has quit IRC | 20:07 | |
| clarkb | AJaeger: ianw left a commetn on https://review.opendev.org/#/c/683431/1 please let me know if that makes sense to you? Then maybe we can get donnyd logan- and mnaser to all +1 it | 20:08 |
| donnyd | its already enabled and I think a couple of jobs are already using it, so happy FN can be of use | 20:10 |
| *** kopecmartin is now known as kopecmartin|off | 20:11 | |
| *** eernst has quit IRC | 20:12 | |
| *** smarcet has quit IRC | 20:13 | |
| ianw | clarkb: yeah, i didn't think we had a hard policy ... are you thinking more this is a "use this to get it stable and then jobs can dynamically switch" or we forever more keep the nodes types separate? | 20:15 |
| donnyd | ianw: I would think some of that is largely dependent on providers | 20:16 |
| *** jamesmcarthur has joined #openstack-infra | 20:16 | |
| clarkb | ianw I hope that eventually most/all would end up enabling the feature if it is shown to be safe and reliable then we can remove the special subset | 20:16 |
| *** ykarel|away has quit IRC | 20:17 | |
| clarkb | as long as we have redundant clouds with the feature and everyone doesnt decide their jobs can only run there it should be fine to be separate for a while | 20:17 |
| clarkb | then we can run targetted jobs on that label | 20:17 |
| ianw | yeah, that was my only concern, that jobs now evolve to only run there | 20:17 |
| ianw | rather than just happen to run faster there | 20:18 |
| donnyd | after its vetted, it would be really slick to have something that could parse if it was enabled or not, and then turn it on for jobs that run on providers that do have it | 20:19 |
| corvus | load is low and decreasing, so i'm going to do a full restart of zuul now | 20:19 |
| *** ykarel|away has joined #openstack-infra | 20:20 | |
| clarkb | ianw ya I think that is the risk and its possible nested virt would stop working in anyor all cloudstoo | 20:20 |
| ianw | donnyd: right, that's what i meant by "dynamically switch". jobs should probe and decide | 20:20 |
| clarkb | so we should push people to not be dependent on it and instead start with targetted jobs | 20:20 |
| ianw | but i understand that while you're trying to validate/test it all, it's a royal pain if you only get a nested capable host x% of the time (x < 100 :) | 20:20 |
| donnyd | ianw: well if you are sitting there waiting for the job to complete I would see how that could be frustrating.. but the jobs run now without it, so it shouldn't be much different. I would also think a random by product in FN's specific case is if the jobs that are already at the edge can move much faster.. I would be willing to bet I could over subscribe FN to do more jobs | 20:24 |
| clarkb | donnyd: ya I think the point is to use a special label to prpve it works with targetted jobs that exercise the functionality | 20:25 |
| clarkb | then ideally we can relax the rules more overall | 20:26 |
| donnyd | yea that makes sense | 20:26 |
| *** e0ne has quit IRC | 20:27 | |
| donnyd | Should ask sean-k-mooney if his NUMA jobs were using it | 20:27 |
| clarkb | and if/when we have trouble with ut we know who to contact at these three clouds for cou details, kernel data, etc to file bugs with linux kernel | 20:29 |
| *** kjackal has quit IRC | 20:29 | |
| fungi | if some jobs run significantly faster with it, then i expect working out when to increase your job timeouts becomes a bit harder | 20:31 |
| corvus | i think there may be a problem with zuul in this configuration | 20:32 |
| *** ykarel|away has quit IRC | 20:33 | |
| *** pcaruana has quit IRC | 20:33 | |
| corvus | i'm going to manually remove the googlesource entry and restart again | 20:33 |
| corvus | or reconstrue it as a git driver | 20:34 |
| donnyd | clarkb: I am still working on a way that doesn't significantly compromise my infra to push all log data public so you can see what is happening under the hood | 20:36 |
| *** yamamoto has joined #openstack-infra | 20:37 | |
| corvus | re-enqueuing now | 20:40 |
| *** xek has quit IRC | 20:43 | |
| corvus | oh i think i see what the problem was and it was me; i think i misnamed the hiera value for the password | 20:45 |
| corvus | i'll try to verify that was the only problem before i proceed | 20:46 |
| corvus | and maybe improve the error handling | 20:46 |
| tosky | uhm, have you noticed that the link to reviews from the zuul dashboard does not bring to the review (review.opendev.org/<nnnn>) but to zuul.openstack.org/review.opendev.org/<nnnn>? | 20:48 |
| tosky | maybe a relative link instead of an absolute one somewhere? | 20:48 |
| *** pkopec has quit IRC | 20:49 | |
| fungi | yes, it's known, though i don't know if anyone has gotten to the bottom of what changed to cause it (could be an update of a dependent lib), nor whether anyone has started work on fixing it | 20:49 |
| tosky | is it on a graphical-full-of-javascript-part-of-code? | 20:50 |
| corvus | tosky: i suspect it's python | 20:51 |
| clarkb | shrews was looking at it when we were at ansiblefest iirc | 20:51 |
| clarkb | but don't think it got tracked down | 20:51 |
| corvus | i also suspect i broke it | 20:51 |
| corvus | however, it's like #4 on the list of things i may have broken and need to fix | 20:52 |
| tosky | sure, I understand; it's just a minor annoyance | 20:53 |
| Shrews | clarkb: corvus: fungi: on my last attempt to hunt it down, i tried to reproduce it locally. but it was not reproducible for me using HEAD of master branch. | 20:57 |
| *** Goneri has quit IRC | 20:57 | |
| *** whoami-rajat has joined #openstack-infra | 20:58 | |
| fungi | well, the scheduler and web service were both restarted a few minutes ago, so presumably using ~head | 20:58 |
| *** smarcet has joined #openstack-infra | 21:00 | |
| clarkb | ok the issue is in the status json the url change.url value doesn't have a https:// prefix. Its just review.opendev.org/$changenumber | 21:00 |
| clarkb | so the browser treats that as a relative path | 21:00 |
| *** ociuhandu has joined #openstack-infra | 21:08 | |
| *** yamamoto has quit IRC | 21:08 | |
| corvus | all right, the good news is that identified what i missed adding to the connection config. the bad news is that in my local testing, when i configure it with our credentials, i get 403 unauthorized, which means that we *are* stuck on providing a phone number to google. | 21:11 |
| *** yamamoto has joined #openstack-infra | 21:11 | |
| corvus | our google friends are in germany, so we may need to wait until tomorrow to see what they say | 21:11 |
| *** ociuhandu has quit IRC | 21:12 | |
| clarkb | I htink it is possible that the url problem originates in https://review.opendev.org/#/c/681936/6/zuul/driver/gerrit/gerritmodel.py | 21:14 |
| clarkb | almost like we parse ssh events a http | 21:15 |
| corvus | private "hiera" is corrected | 21:16 |
| clarkb | since the http version drops the scheme in self.url there after parsing the url provided in data | 21:16 |
| clarkb | corvus: ^ do you know why we don't pass through self.url as whatever data['url'] is in both cases? | 21:16 |
| corvus | clarkb: not offhand but i can look in a few minutes | 21:17 |
| openstackgerrit | James E. Blair proposed opendev/system-config master: Revert "Use the gerrit driver for the googlesource connection" https://review.opendev.org/686048 | 21:19 |
| openstackgerrit | James E. Blair proposed opendev/system-config master: Use the gerrit driver for the googlesource connection https://review.opendev.org/686049 | 21:19 |
| corvus | infra-root: we should merge 686048 soon | 21:19 |
| clarkb | corvus: ya that is what is happening. We create a session object for the review.opendev.org connection because we have a password for it (I'm guessing to report via http) | 21:20 |
| clarkb | because self.session is not none we create http gerrit change objects not ssh gerrit change objects and the http version of the objects remove the scheme from change.url | 21:20 |
| clarkb | I think we may be able to simply set self.url = data['url'] in the change object regardless of using http or ssh | 21:21 |
| paladox | corvus edwin is online | 21:25 |
| corvus | paladox: yeah, i sent him a message, but it must be late so i won't be surprised if he politely ignores it until tomorrow :) | 21:26 |
| paladox | oh | 21:26 |
| *** openstackstatus has quit IRC | 21:32 | |
| *** openstackstatus has joined #openstack-infra | 21:34 | |
| *** ChanServ sets mode: +v openstackstatus | 21:34 | |
| *** odicha has quit IRC | 21:34 | |
| *** odicha has joined #openstack-infra | 21:35 | |
| openstackgerrit | Clark Boylan proposed zuul/zuul master: Always use change url from gerrit api data https://review.opendev.org/686054 | 21:47 |
| clarkb | corvus: ^ I went ahead and pushed a change to have a breadcrumb to follow | 21:48 |
| corvus | clarkb: thanks, i'll take a look at that now | 21:51 |
| corvus | clarkb: commented | 21:56 |
| *** mriedem has quit IRC | 21:56 | |
| clarkb | aha | 21:57 |
| fungi | so was this an outgrowth of the switch to use the rest api instead of ssh api? | 21:57 |
| clarkb | fungi: yes, which actually points to an oddity. I think the http parser is ebing used to parse ssh events | 21:57 |
| fungi | neat! | 21:57 |
| jrosser | something seems a bit brok at http://zuul.openstack.org/status for me | 21:58 |
| clarkb | fixing that likely requires more thought | 21:58 |
| fungi | jrosser: what exactly? | 21:58 |
| jrosser | if i click one of the links in a job which should take me back to the gerrit page it tries to go to somewhere like this http://zuul.openstack.org/review.opendev.org/681002 | 21:58 |
| fungi | jrosser: yeah, that's the fix we were just talking about, though it's been this way for a week or two | 21:59 |
| jrosser | oh, no worries :) | 21:59 |
| fungi | jrosser: clarkb started on a fix with 686054 just a few minutes ago | 21:59 |
| corvus | clarkb: aroo? http parser ssh what? | 21:59 |
| clarkb | corvus: the switch for deciding if the gerrit event should be handed as an ssh event or http event is whether or not we have an http session. Because our review.opendev.org connection config has a password we create a session for it, but only use that to report not get events. But we parse all the ssh events coming in as http events i think | 22:01 |
| clarkb | corvus: the ssh parser shouldn't have this bug with url generation | 22:01 |
| clarkb | only the http parser does and I think that is why we use it (the presence of a session for reporting) | 22:01 |
| clarkb | I also don't know if connection.baseurl will be an ssh:// or https:// url in this case | 22:02 |
| corvus | clarkb: nah -- think of this in terms of triggers, reporters, sources. triggering actions for us use ssh. but reporters and (with the recent change to support http more fully) sources use http when available. when our event arrives over ssh, the source uses http to get information about the change. that's what's happening here. | 22:02 |
| clarkb | looks like its always https based on the connection code | 22:02 |
| corvus | clarkb: baseurl is not set in our config file so it will be https://review.opendev.org | 22:03 |
| clarkb | corvus: doesn't the ssh event have all of this info in it though? | 22:03 |
| clarkb | seems like we are doing an unnecassary round trip | 22:03 |
| corvus | clarkb: nope, it's missing a lot | 22:03 |
| openstackgerrit | Merged opendev/system-config master: Revert "Use the gerrit driver for the googlesource connection" https://review.opendev.org/686048 | 22:03 |
| corvus | clarkb: it has info about the event, including some rudimentory information about the change, but for the full info we've always gone back to gerrit. we used to do that over ssh, but now use http. | 22:04 |
| clarkb | I see | 22:05 |
| corvus | i expect we'll drop ssh source and reporter support in the not-too-distant-future for ease of maintenance. | 22:05 |
| corvus | trigger, of course, we'll keep :) | 22:05 |
| openstackgerrit | Clark Boylan proposed zuul/zuul master: Set url scheme on HTTP Gerrit events https://review.opendev.org/686054 | 22:13 |
| clarkb | that better? | 22:13 |
| *** aaronsheffield has quit IRC | 22:15 | |
| corvus | clarkb: yep, though 'connection.baseurl' would have worked too | 22:15 |
| corvus | clarkb: thanks! | 22:16 |
| *** dchen has joined #openstack-infra | 22:24 | |
| *** Goneri has joined #openstack-infra | 22:28 | |
| *** weshay has quit IRC | 22:29 | |
| *** xenos76 has quit IRC | 22:30 | |
| tosky | oh, thanks! | 22:45 |
| *** dciabrin_ has quit IRC | 22:45 | |
| *** jamesmcarthur has quit IRC | 22:48 | |
| *** Goneri has quit IRC | 22:48 | |
| *** smarcet has quit IRC | 22:49 | |
| *** tkajinam has joined #openstack-infra | 22:50 | |
| *** bdodd has quit IRC | 22:54 | |
| fungi | clarkb: looks like the quickstart job for it failed out on a 404 during "TASK [Fetch log URL]" | 22:54 |
| fungi | https://e1b7c5837d1435fd98ed-957e0323e7657520e3a7352c7d8ac713.ssl.cf5.rackcdn.com/686054/2/check/zuul-quick-start/ed703d6/job-output.txt | 22:54 |
| fungi | https://e1b7c5837d1435fd98ed-957e0323e7657520e3a7352c7d8ac713.ssl.cf5.rackcdn.com/686054/2/check/zuul-quick-start/ed703d6/container_logs/logs.log | 22:55 |
| *** bdodd has joined #openstack-infra | 22:55 | |
| clarkb | hrm does that mean the test job failed? | 22:55 |
| clarkb | no executor log seems to show it succeeding | 22:56 |
| *** yamamoto has quit IRC | 22:57 | |
| fungi | yeah, executor log says the file in question was uploaded 3 seconds earlier if i'm reading it right | 22:57 |
| fungi | this is... weird | 22:57 |
| clarkb | at 22:48:34,579 | 22:57 |
| clarkb | 22:48:37 is when the apache 404 is logged. I agree seems like the file should be there | 22:58 |
| clarkb | maybe an fs syncing issue | 22:58 |
| *** weshay has joined #openstack-infra | 22:58 | |
| clarkb | if these things are bindmounted across different containers? | 22:58 |
| *** smarcet has joined #openstack-infra | 22:59 | |
| fungi | uploaded as /srv/static/logs/2/2/1/check/testjob/062504d/job-output.txt and the request was for .../2/2/1/check/testjob/062504d/job-output.txt.gz | 22:59 |
| clarkb | oh | 22:59 |
| clarkb | this is that change that AJaeger was tlaking about iirc | 22:59 |
| fungi | we merged a change recently to compress those unconditionally, right? | 22:59 |
| fungi | or maybe other way around | 23:00 |
| clarkb | https://review.opendev.org/567696 | 23:00 |
| clarkb | ok I see what the fix is | 23:00 |
| fungi | so the yeah, i guess the quickstart exercise needs patching | 23:00 |
| fungi | i suppose we don't run the quickstart job against zuul-jobs changes | 23:01 |
| *** yamamoto has joined #openstack-infra | 23:01 | |
| fungi | so didn't catch it before merging | 23:02 |
| *** tosky has quit IRC | 23:02 | |
| openstackgerrit | Clark Boylan proposed zuul/zuul master: Set url scheme on HTTP Gerrit events https://review.opendev.org/686054 | 23:02 |
| openstackgerrit | Clark Boylan proposed zuul/zuul master: Handle new default of uncompressed job-output https://review.opendev.org/686072 | 23:02 |
| clarkb | fungi: ^ I think that should do it | 23:03 |
| *** weshay has quit IRC | 23:12 | |
| *** weshay has joined #openstack-infra | 23:15 | |
| *** jamesmcarthur has joined #openstack-infra | 23:32 | |
| *** smarcet has quit IRC | 23:33 | |
| *** rcernin has joined #openstack-infra | 23:33 | |
| *** bdodd has quit IRC | 23:37 | |
| *** markvoelker has quit IRC | 23:38 | |
| *** yamamoto has quit IRC | 23:39 | |
| *** yamamoto has joined #openstack-infra | 23:39 | |
| *** yamamoto has quit IRC | 23:43 | |
| *** markvoelker has joined #openstack-infra | 23:44 | |
| *** sthussey has quit IRC | 23:44 | |
| *** exsdev has quit IRC | 23:48 | |
| *** yamamoto has joined #openstack-infra | 23:48 | |
| *** exsdev has joined #openstack-infra | 23:48 | |
| *** smarcet has joined #openstack-infra | 23:49 | |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: [wip] use mirrors for functional test builds https://review.opendev.org/685885 | 23:51 |
| *** yamamoto has quit IRC | 23:52 | |
| openstackgerrit | Merged zuul/zuul master: Handle new default of uncompressed job-output https://review.opendev.org/686072 | 23:54 |
| *** yamamoto has joined #openstack-infra | 23:55 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!