clarkb | infra-root I do think that https://review.opendev.org/#/c/704085/1 will be necessary after reading gerrit docs | 00:11 |
---|---|---|
clarkb | we can have gerrit do basic auth via a config flag change | 00:11 |
clarkb | but then every script will have to update and that might be easier to swallow with a gerrit upgrade | 00:12 |
clarkb | I think for now we should have zuul do digest explicitly, then zuul can set its default to basic and we will switch to basic when we update to 2.15 or newer | 00:12 |
*** trident has quit IRC | 00:13 | |
*** trident has joined #openstack-infra | 00:14 | |
*** dchen has joined #openstack-infra | 00:22 | |
fungi | makes me think a bunch of other scripts/tools we have doing digest auth to the rest api are going to need fixing | 00:25 |
fungi | oh, wait | 00:25 |
fungi | so gerrit is dropping digest auth in coming releases, or...> | 00:27 |
fungi | okay, yeah | 00:27 |
*** tosky has quit IRC | 00:28 | |
fungi | so we will need to update a bunch of stuff when we upgrade to a gerrit which doesn't support digest auth | 00:28 |
openstackgerrit | Tristan Cacqueray proposed zuul/zuul-operator master: Update sdk to v0.13.0 and install dhall-to-json https://review.opendev.org/702103 | 00:31 |
openstackgerrit | Tristan Cacqueray proposed zuul/zuul-operator master: Setup Prelude and Kubernetes binding https://review.opendev.org/702104 | 00:31 |
openstackgerrit | Tristan Cacqueray proposed zuul/zuul-operator master: Replace existing operator tasks with the new application https://review.opendev.org/702106 | 00:31 |
*** diablo_rojo has joined #openstack-infra | 00:32 | |
openstackgerrit | Merged zuul/nodepool master: Lower min-ready request priority https://review.opendev.org/704058 | 00:34 |
*** goldyfruit_ has quit IRC | 00:34 | |
*** goldyfruit_ has joined #openstack-infra | 00:34 | |
*** dchen has quit IRC | 00:36 | |
*** dchen has joined #openstack-infra | 00:38 | |
clarkb | fungi: yup | 00:56 |
fungi | governance tools, election tools, that release liaisons check job ttx just added... | 01:04 |
*** zxiiro has quit IRC | 01:08 | |
*** yamamoto has joined #openstack-infra | 01:16 | |
*** roman_g has quit IRC | 01:21 | |
*** goldyfruit_ has quit IRC | 01:21 | |
*** goldyfruit has joined #openstack-infra | 01:21 | |
*** andreaf has quit IRC | 01:37 | |
*** andreaf has joined #openstack-infra | 01:38 | |
*** zxiiro has joined #openstack-infra | 01:41 | |
*** rh-jelabarre has joined #openstack-infra | 01:50 | |
*** diablo_rojo has quit IRC | 02:03 | |
*** rf0lc0 has quit IRC | 02:18 | |
*** yamamoto has quit IRC | 02:19 | |
*** yamamoto has joined #openstack-infra | 02:25 | |
*** goldyfruit has quit IRC | 02:25 | |
*** armax has joined #openstack-infra | 02:40 | |
*** dSrinivas has joined #openstack-infra | 03:25 | |
*** stevebaker_ has joined #openstack-infra | 03:35 | |
*** stevebaker has quit IRC | 03:36 | |
*** yamamoto has quit IRC | 03:38 | |
*** psachin has joined #openstack-infra | 03:38 | |
*** goldyfruit has joined #openstack-infra | 03:38 | |
*** goldyfruit has quit IRC | 03:43 | |
*** goldyfruit has joined #openstack-infra | 03:43 | |
*** zxiiro has quit IRC | 03:49 | |
*** factor has quit IRC | 03:55 | |
*** factor has joined #openstack-infra | 03:55 | |
*** rlandy has quit IRC | 04:05 | |
*** goldyfruit has quit IRC | 04:05 | |
*** ykarel|away is now known as ykarel | 04:10 | |
*** goldyfruit has joined #openstack-infra | 04:11 | |
*** rh-jelabarre has quit IRC | 04:14 | |
*** lajoskatona has joined #openstack-infra | 04:15 | |
*** lajoskatona has left #openstack-infra | 04:15 | |
*** ramishra has joined #openstack-infra | 04:19 | |
*** goldyfruit has quit IRC | 04:27 | |
*** goldyfruit has joined #openstack-infra | 04:27 | |
*** kjackal has joined #openstack-infra | 04:32 | |
*** goldyfruit has quit IRC | 04:33 | |
*** goldyfruit has joined #openstack-infra | 04:33 | |
*** yamamoto has joined #openstack-infra | 04:36 | |
*** armax has quit IRC | 04:37 | |
*** goldyfruit has quit IRC | 04:50 | |
*** goldyfruit has joined #openstack-infra | 04:50 | |
openstackgerrit | Tristan Cacqueray proposed zuul/zuul-operator master: Replace existing operator tasks with the new dhall function https://review.opendev.org/702106 | 04:50 |
*** udesale has joined #openstack-infra | 04:55 | |
*** goldyfruit has quit IRC | 04:59 | |
*** raukadah is now known as chkumar|ruck | 05:00 | |
*** chkumar|ruck is now known as chkumar|rover | 05:24 | |
*** evrardjp has quit IRC | 05:34 | |
*** evrardjp has joined #openstack-infra | 05:34 | |
*** surpatil has joined #openstack-infra | 05:40 | |
*** gyee has quit IRC | 05:47 | |
*** gfidente has joined #openstack-infra | 05:51 | |
*** kjackal has quit IRC | 06:04 | |
prometheanfire | offhand, how many containers are we using on rackcdn? I only ask because enabling js on each of them is annoying :P | 06:05 |
*** kjackal has joined #openstack-infra | 06:29 | |
*** kjackal has quit IRC | 06:34 | |
*** lmiccini has joined #openstack-infra | 06:39 | |
*** yamamoto has quit IRC | 06:40 | |
*** yamamoto has joined #openstack-infra | 06:43 | |
*** kjackal has joined #openstack-infra | 06:46 | |
*** kjackal has quit IRC | 06:51 | |
*** kjackal_v2 has joined #openstack-infra | 06:51 | |
*** yamamoto has quit IRC | 06:58 | |
*** yamamoto has joined #openstack-infra | 07:08 | |
*** yamamoto has quit IRC | 07:15 | |
*** yamamoto has joined #openstack-infra | 07:19 | |
*** ykarel is now known as ykarel|lunch | 07:20 | |
*** yamamoto has quit IRC | 07:29 | |
*** pgaxatte has joined #openstack-infra | 07:31 | |
*** kjackal_v2 has quit IRC | 07:34 | |
*** yamamoto has joined #openstack-infra | 07:40 | |
*** yamamoto has quit IRC | 07:41 | |
*** yamamoto has joined #openstack-infra | 07:45 | |
*** dtantsur|afk is now known as dtantsur | 07:48 | |
*** ralonsoh has joined #openstack-infra | 07:56 | |
*** yamamoto has quit IRC | 07:58 | |
*** jpena|off is now known as jpena | 08:00 | |
*** yamamoto has joined #openstack-infra | 08:03 | |
*** elod is now known as elod_off | 08:09 | |
*** yamamoto has quit IRC | 08:09 | |
*** yamamoto has joined #openstack-infra | 08:09 | |
*** yamamoto has quit IRC | 08:12 | |
*** yamamoto has joined #openstack-infra | 08:16 | |
*** tkajinam has quit IRC | 08:20 | |
*** ccamacho has joined #openstack-infra | 08:20 | |
*** ykarel|lunch is now known as ykarel | 08:24 | |
*** deke997 has quit IRC | 08:30 | |
*** tesseract has joined #openstack-infra | 08:34 | |
*** tosky has joined #openstack-infra | 08:36 | |
openstackgerrit | Merged zuul/zuul-jobs master: fetch-tox-output: introduce zuul_use_fetch_output https://review.opendev.org/681864 | 08:36 |
openstackgerrit | Andreas Jaeger proposed zuul/zuul-jobs master: Making opensuse-tumbleweed jobs nv https://review.opendev.org/702693 | 08:39 |
openstackgerrit | Andreas Jaeger proposed zuul/zuul-jobs master: Making opensuse-tumbleweed jobs nv https://review.opendev.org/702693 | 08:41 |
openstackgerrit | Andreas Jaeger proposed openstack/project-config master: Move tap-as-a-service job templates https://review.opendev.org/703752 | 08:43 |
*** rpittau|afk is now known as ironic | 08:51 | |
*** ironic is now known as rpittau | 08:51 | |
*** evrardjp has quit IRC | 08:54 | |
*** xek has joined #openstack-infra | 08:55 | |
*** yamamoto has quit IRC | 08:55 | |
AJaeger | config-core, please review https://review.opendev.org/703752 https://review.opendev.org/702693 and https://review.opendev.org/703917 , https://review.opendev.org/703691, https://review.opendev.org/703081 , https://review.opendev.org/#/c/702574 | 08:56 |
fungi | prometheanfire: for logs? thousands | 08:57 |
*** yamamoto has joined #openstack-infra | 08:57 | |
*** yamamoto has quit IRC | 08:58 | |
AJaeger | fungi: What are you doing here at this time? All ok? | 08:59 |
fungi | AJaeger: woke up, will probably be back asleep soon | 09:00 |
AJaeger | fungi: ok, get some rest ;) | 09:02 |
fungi | soon | 09:03 |
fungi | rsync error: received SIGINT, SIGTERM, or SIGHUP (code 20) at rsync.c(644) [generator=3.1.2] | 09:05 |
fungi | rsync error: received SIGUSR1 (code 19) at main.c(1447) [receiver=3.1.2] | 09:05 |
fungi | that happened while or immediately after transferring noarch/tftpboot-installation-openSUSE-Kubic-x86_64-14.452-1.14.noarch.rpm | 09:05 |
fungi | i suspect that's a sign that the rsync took longer than our configured timeout of 30 minutes | 09:07 |
AJaeger | so, let's hope next run will work... Thanks, fungi ! | 09:07 |
fungi | if we could split the tumbleweed mirror to its own volume we could release updates for it independently of the rest of our opensuse mirroring so that it doesn't block if we hold vos release on update failures | 09:07 |
fungi | but yeah, it seems there was a fairly large batch of packages to update in tumbleweed on the last pulse | 09:09 |
fungi | and 30 minutes was insufficient to transfer them all | 09:09 |
*** lucas has joined #openstack-infra | 09:11 | |
*** pcaruana has joined #openstack-infra | 09:14 | |
*** kjackal has joined #openstack-infra | 09:22 | |
openstackgerrit | Merged openstack/project-config master: Move tap-as-a-service job templates https://review.opendev.org/703752 | 09:25 |
openstackgerrit | Merged openstack/project-config master: Add linaro-us cloud to nodepool https://review.opendev.org/703917 | 09:27 |
openstackgerrit | Merged zuul/zuul-jobs master: Making opensuse-tumbleweed jobs nv https://review.opendev.org/702693 | 09:31 |
ttx | fungi: go back to sleep, stop jinxing me on threads | 09:32 |
*** roman_g has joined #openstack-infra | 09:32 | |
openstackgerrit | Merged openstack/openstack-zuul-jobs master: Update ansible-lint https://review.opendev.org/702574 | 09:34 |
openstackgerrit | Merged openstack/project-config master: Add charm-interface-keystone-notifications project https://review.opendev.org/703691 | 09:34 |
openstackgerrit | Merged openstack/project-config master: Add dependent charm for watcher https://review.opendev.org/703081 | 09:35 |
*** derekh has joined #openstack-infra | 09:39 | |
*** yamamoto has joined #openstack-infra | 09:41 | |
*** yamamoto has quit IRC | 09:45 | |
*** kevko has joined #openstack-infra | 09:49 | |
kevko | hello guys, i'm working on vitrage-dashboard to replace vendorized js script with XStatic versions, so I've already created and uploaded XStatic replacements to PIP .. but now i need to create openstack git repositories ... in this point I'm little bit confused how to deal with it | 09:50 |
*** yamamoto has joined #openstack-infra | 09:55 | |
openstackgerrit | Uzume proposed zuul/zuul master: Change default Gerrit HTTP auth method https://review.opendev.org/704068 | 10:00 |
*** yamamoto has quit IRC | 10:03 | |
AJaeger | kevko: docs.openstack.org/infra/manual/creators.html explains repo setup. You might want to talk with Horizon team on #openstack-horizon about XStatic repos as well since they created quite a few | 10:03 |
openstackgerrit | Merged zuul/zuul-jobs master: Return subunit test report as artifact https://review.opendev.org/703235 | 10:04 |
*** kjackal has quit IRC | 10:05 | |
*** yamamoto has joined #openstack-infra | 10:12 | |
kevko | AJaeger: thanks | 10:20 |
openstackgerrit | Andreas Jaeger proposed openstack/openstack-zuul-jobs master: WIP: Remove legacy-barbican-simple-crypto-dsvm-tempest-nova https://review.opendev.org/704128 | 10:20 |
*** witek has joined #openstack-infra | 10:31 | |
openstackgerrit | Michal Arbet proposed openstack/project-config master: Add xstatic-** projects for vitrage-dashboard https://review.opendev.org/704133 | 10:33 |
*** lmiccini has quit IRC | 10:38 | |
*** lmiccini has joined #openstack-infra | 10:40 | |
*** soniya29 has joined #openstack-infra | 10:42 | |
AJaeger | kevko: re-read the docs - you need a governance change and link to it via Needed-By, otherwise we cannot merge it. | 10:44 |
kevko | AJaeger: Ah, ok , will process , thanks | 10:44 |
AJaeger | kevko: did you discuss with amotoki ? You use the same group as horizon, so better get his buyin | 10:46 |
kevko | AJaeger: e0one was assigned to story and tasks for this in Storyboard, after discussion with him we took this tasks , me and my colleguage .. | 10:48 |
kevko | AJaeger: it is working now , so my colleguage create review for vitrage-dashboard and I add Needed-by to commit message .. correct ? | 10:49 |
AJaeger | kevko: review for governance repo you mean? Yes, do that, and see my comments on review | 10:49 |
AJaeger | kevko: and then we need vitrage and horizon PTLs to +1 due to the setup you do with shared ACLs. | 10:50 |
kevko | AJaeger: ok, thanks, everything is clear :) | 10:51 |
AJaeger | cool | 10:54 |
*** yamamoto has quit IRC | 10:57 | |
*** gshippey has joined #openstack-infra | 10:58 | |
*** yamamoto has joined #openstack-infra | 10:59 | |
*** yamamoto has quit IRC | 11:01 | |
*** yamamoto has joined #openstack-infra | 11:02 | |
*** witek has quit IRC | 11:15 | |
*** Ng has quit IRC | 11:15 | |
*** Ng has joined #openstack-infra | 11:16 | |
*** yamamoto has quit IRC | 11:19 | |
*** witek has joined #openstack-infra | 11:22 | |
*** yamamoto has joined #openstack-infra | 11:24 | |
*** rpittau is now known as rpittau|bbl | 11:28 | |
*** surpatil has quit IRC | 11:32 | |
*** dSrinivas has quit IRC | 11:33 | |
openstackgerrit | Michal Arbet proposed openstack/project-config master: Add xstatic-** projects for vitrage-dashboard https://review.opendev.org/704133 | 11:38 |
*** yamamoto has quit IRC | 11:42 | |
*** yamamoto has joined #openstack-infra | 11:45 | |
kevko | AJaeger: I have one more question , what I can do if vitrage-dashboard needs 2 additional packages from PIP , ant these packages don't have git repo , and I am not owner :( ? | 11:46 |
kevko | AJaeger: I mean 2 additional xstatic packages | 11:46 |
*** iurygregory has joined #openstack-infra | 11:48 | |
*** yamamoto has quit IRC | 11:56 | |
amotoki | kevko: AJaeger: IMHO if the proposed xstatic repos are specific to vitrage dashboard, it would be better to host by the vitrage dashboard team (= vitrage team actually). the number of horizon devs is decreasing, so I don't think it works for the horizon team hosts all xstatic repos including ones not used by horizon itself. | 12:06 |
amotoki | I know it should be discussed in the governance patch so I just express my feeling now. | 12:07 |
kevko | amotoki: ok, understand , one more question > do i need really create openstack git repos ? could I add only requirement for XStatic packages which are already in pip ? | 12:08 |
kevko | amotoki: i've uploaded to pip already and working .. | 12:08 |
*** ykarel is now known as ykarel|afk | 12:08 | |
*** kjackal has joined #openstack-infra | 12:10 | |
amotoki | kevko: it leads to another question. where do you manage the source of the xstatic PyPI package you uploaded. | 12:10 |
amotoki | ? | 12:10 |
kevko | amotoki: my github acc | 12:11 |
amotoki | kevko: if you continue to manage your github repo it would be another option. | 12:11 |
kevko | amotoki: yes I will | 12:11 |
amotoki | kevko: the point is that it is important to provide the source and keep it available thoughout the life of vitrage dashboard at least. it might be longer than the period you work on. | 12:12 |
amotoki | kevko: that's the only merit I see in creating a repo under openstack/opendev infra. | 12:13 |
*** rf0lc0 has joined #openstack-infra | 12:14 | |
kevko | amotoki: ok, understand ... | 12:15 |
amotoki | kevko: e0ne might have a different opinion. he is also a vitrage-dashboard core. | 12:16 |
amotoki | hi infra-root?, could you abandon https://review.opendev.org/#/c/398936/ ? It was proposed against refs/meta/config branch somehow, so horizon-core cannot abandon it. | 12:21 |
frickler | amotoki: done | 12:23 |
amotoki | frickler: thanks! | 12:23 |
*** soniya29 has quit IRC | 12:29 | |
*** jpena is now known as jpena|lunch | 12:29 | |
*** soniya29 has joined #openstack-infra | 12:30 | |
*** yamamoto has joined #openstack-infra | 12:36 | |
*** eharney has joined #openstack-infra | 12:41 | |
*** yamamoto has quit IRC | 12:43 | |
*** udesale_ has joined #openstack-infra | 12:45 | |
*** rh-jelabarre has joined #openstack-infra | 12:47 | |
*** udesale has quit IRC | 12:48 | |
openstackgerrit | Tobias Henkel proposed zuul/zuul master: Handle draft pull requests in canMerge https://review.opendev.org/704150 | 12:55 |
*** jtomasek has joined #openstack-infra | 12:58 | |
*** artom has quit IRC | 13:01 | |
*** witek has quit IRC | 13:02 | |
*** kjackal has quit IRC | 13:03 | |
openstackgerrit | Tobias Henkel proposed zuul/zuul master: Handle draft pull requests in canMerge https://review.opendev.org/704150 | 13:04 |
*** sshnaidm|afk has quit IRC | 13:11 | |
*** iurygregory has quit IRC | 13:15 | |
*** ykarel|afk is now known as ykarel | 13:15 | |
*** hashar has joined #openstack-infra | 13:19 | |
*** ociuhandu has joined #openstack-infra | 13:25 | |
openstackgerrit | Tristan Cacqueray proposed zuul/zuul-operator master: Generate TLS certificats for the gearman service https://review.opendev.org/702716 | 13:25 |
openstackgerrit | Tristan Cacqueray proposed zuul/zuul-operator master: Add OpenShift SCC and functional test https://review.opendev.org/702758 | 13:25 |
openstackgerrit | Tristan Cacqueray proposed zuul/zuul-operator master: Handle service restart when connections are changed https://review.opendev.org/703624 | 13:25 |
openstackgerrit | Tristan Cacqueray proposed zuul/zuul-operator master: Add tenant reconfiguration when main.yaml changed https://review.opendev.org/703631 | 13:25 |
*** ociuhandu has quit IRC | 13:25 | |
*** ociuhandu has joined #openstack-infra | 13:26 | |
*** rlandy has joined #openstack-infra | 13:28 | |
*** rf0lc0 is now known as rfolco|doctor | 13:33 | |
*** ociuhandu has quit IRC | 13:33 | |
*** jpena|lunch is now known as jpena | 13:35 | |
*** rpittau|bbl is now known as rpittau | 13:40 | |
*** jtomasek has quit IRC | 13:44 | |
*** jamesmcarthur has joined #openstack-infra | 13:48 | |
*** petevg has quit IRC | 13:48 | |
*** petevg has joined #openstack-infra | 13:48 | |
*** kjackal has joined #openstack-infra | 13:51 | |
*** ykarel is now known as ykarel|afk | 14:07 | |
*** auristor has quit IRC | 14:07 | |
openstackgerrit | Antoine Musso proposed zuul/zuul master: On CI, use a tmpfs for ZUUL_TEST_ROOT https://review.opendev.org/704160 | 14:10 |
*** kjackal has quit IRC | 14:10 | |
openstackgerrit | sebastian marcet proposed opendev/puppet-openstackid master: Updated Build https://review.opendev.org/703834 | 14:11 |
*** sshnaidm has joined #openstack-infra | 14:13 | |
*** artom has joined #openstack-infra | 14:13 | |
*** piotrowskim has quit IRC | 14:13 | |
*** sshnaidm has quit IRC | 14:17 | |
*** ociuhandu has joined #openstack-infra | 14:23 | |
openstackgerrit | Antoine Musso proposed zuul/zuul master: On CI, use a tmpfs for ZUUL_TEST_ROOT https://review.opendev.org/704160 | 14:23 |
*** sshnaidm has joined #openstack-infra | 14:24 | |
*** zxiiro has joined #openstack-infra | 14:24 | |
*** ociuhandu has quit IRC | 14:28 | |
*** hashar has quit IRC | 14:29 | |
fungi | infra-puppet-core: can we get a second pair of eyes on https://review.opendev.org/703834 ? | 14:29 |
fungi | puppet-openstackid change for an upgrade to the openstackid-dev server | 14:29 |
*** ralonsoh is now known as ralonsoh-lunch | 14:30 | |
*** sshnaidm_ has joined #openstack-infra | 14:31 | |
*** sshnaidm has quit IRC | 14:31 | |
*** andrewbonney has joined #openstack-infra | 14:33 | |
*** ociuhandu has joined #openstack-infra | 14:33 | |
*** witek has joined #openstack-infra | 14:33 | |
*** goldyfruit has joined #openstack-infra | 14:34 | |
frickler | config-core: please review this change to add py38 nv jobs https://review.opendev.org/693401 . AJaeger: I'm hoping your previous concern have been resolved by what the TC did | 14:35 |
*** panda is now known as panda|bbl | 14:45 | |
*** soniya29 has quit IRC | 14:45 | |
*** Tengu has quit IRC | 14:46 | |
*** lucas is now known as lucasagomes | 14:46 | |
frickler | fungi: failed lint, otherwise lgtm | 14:48 |
*** seongsoocho has quit IRC | 14:49 | |
fungi | oh, yep, i missed that there was a new patchset | 14:49 |
*** seongsoocho has joined #openstack-infra | 14:49 | |
fungi | i'll fix that for him real quick | 14:49 |
openstackgerrit | Jeremy Stanley proposed opendev/puppet-openstackid master: Updated Build https://review.opendev.org/703834 | 14:52 |
fungi | frickler: ^{ | 14:52 |
*** psachin has quit IRC | 14:52 | |
fungi | thanks for spotting that | 14:52 |
*** dklyle has quit IRC | 14:54 | |
*** goldyfruit_ has joined #openstack-infra | 14:54 | |
*** goldyfruit has quit IRC | 14:55 | |
*** goldyfruit_ has quit IRC | 14:55 | |
*** goldyfruit_ has joined #openstack-infra | 14:55 | |
*** coreycb has quit IRC | 14:57 | |
*** coreycb has joined #openstack-infra | 14:57 | |
*** hashar has joined #openstack-infra | 15:03 | |
*** dklyle has joined #openstack-infra | 15:04 | |
openstackgerrit | Antoine Musso proposed zuul/zuul master: On CI, use a tmpfs for ZUUL_TEST_ROOT https://review.opendev.org/704160 | 15:04 |
openstackgerrit | Antoine Musso proposed zuul/zuul master: On CI, use a tmpfs for ZUUL_TEST_ROOT https://review.opendev.org/704160 | 15:05 |
*** goldyfruit_ has quit IRC | 15:07 | |
*** goldyfruit_ has joined #openstack-infra | 15:07 | |
*** jamesmcarthur has quit IRC | 15:08 | |
*** yamamoto has joined #openstack-infra | 15:10 | |
*** yamamoto has quit IRC | 15:15 | |
*** goldyfruit_ has quit IRC | 15:16 | |
*** goldyfruit_ has joined #openstack-infra | 15:17 | |
*** chkumar|rover is now known as raukadah | 15:19 | |
*** jtomasek has joined #openstack-infra | 15:20 | |
AJaeger | frickler: thanks - missed that the dependency finally merged | 15:24 |
*** zzzeek has quit IRC | 15:24 | |
*** sshnaidm_ is now known as sshnaidm|off | 15:25 | |
*** ralonsoh-lunch is now known as ralonsoh | 15:26 | |
*** Tengu has joined #openstack-infra | 15:27 | |
*** jtomasek has quit IRC | 15:28 | |
*** dulek has quit IRC | 15:28 | |
*** jamesmcarthur has joined #openstack-infra | 15:28 | |
openstackgerrit | Merged openstack/openstack-zuul-jobs master: Add non-voting tox py38 jobs to Ussuri templates https://review.opendev.org/693401 | 15:28 |
fungi | we've been granted some really nice weather this morning, so i'm going to take advantage of it while i can and go for a long walk. should be back in a couple hours though | 15:29 |
AJaeger | fungi: enjoy! | 15:29 |
*** armax has joined #openstack-infra | 15:30 | |
*** mnasiadka has quit IRC | 15:31 | |
*** mnasiadka has joined #openstack-infra | 15:32 | |
*** zzzeek has joined #openstack-infra | 15:33 | |
*** auristor has joined #openstack-infra | 15:33 | |
openstackgerrit | Merged opendev/puppet-openstackid master: Updated Build https://review.opendev.org/703834 | 15:44 |
*** dulek has joined #openstack-infra | 15:44 | |
*** ociuhandu has quit IRC | 15:49 | |
*** ociuhandu has joined #openstack-infra | 15:50 | |
*** ociuhandu has quit IRC | 15:55 | |
*** panda|bbl is now known as panda | 16:02 | |
openstackgerrit | Merged zuul/zuul master: Fix canceling builds in starting phase https://review.opendev.org/684414 | 16:06 |
*** aedc_ has joined #openstack-infra | 16:14 | |
*** gyee has joined #openstack-infra | 16:14 | |
*** aedc has quit IRC | 16:15 | |
*** tosky has quit IRC | 16:16 | |
*** lmiccini has quit IRC | 16:18 | |
*** udesale_ has quit IRC | 16:19 | |
*** auristor has quit IRC | 16:23 | |
*** artom has quit IRC | 16:26 | |
*** auristor has joined #openstack-infra | 16:26 | |
*** hashar has quit IRC | 16:28 | |
*** yamamoto has joined #openstack-infra | 16:30 | |
*** Lucas_Gray has joined #openstack-infra | 16:32 | |
*** gshippey has quit IRC | 16:36 | |
*** gshippey has joined #openstack-infra | 16:36 | |
openstackgerrit | Paul Belanger proposed zuul/zuul master: Update component diagram for GitHub / Web events https://review.opendev.org/704172 | 16:37 |
openstackgerrit | Paul Belanger proposed zuul/zuul master: Update component diagram for GitHub / Web events https://review.opendev.org/704172 | 16:41 |
*** jackedin has joined #openstack-infra | 16:41 | |
*** ociuhandu has joined #openstack-infra | 16:45 | |
*** rfolco|doctor is now known as rfolco | 16:45 | |
AJaeger | config-core, a small doc update for zuul-jobs for review, please: https://review.opendev.org/704017 | 16:49 |
*** Goneri has joined #openstack-infra | 16:50 | |
*** Lucas_Gray has quit IRC | 16:55 | |
*** Lucas_Gray has joined #openstack-infra | 16:59 | |
*** gfidente is now known as gfidente|afk | 17:00 | |
*** diablo_rojo has joined #openstack-infra | 17:03 | |
*** dtantsur is now known as dtantsur|afk | 17:03 | |
*** hashar has joined #openstack-infra | 17:05 | |
*** hashar has quit IRC | 17:06 | |
*** ociuhandu has quit IRC | 17:07 | |
*** hashar has joined #openstack-infra | 17:07 | |
*** hashar has quit IRC | 17:08 | |
openstackgerrit | Merged zuul/zuul-jobs master: Update roles/prepare-workspace-openshift/README.rst https://review.opendev.org/704017 | 17:08 |
*** hashar has joined #openstack-infra | 17:08 | |
*** ociuhandu has joined #openstack-infra | 17:09 | |
*** lucasagomes has quit IRC | 17:09 | |
*** hashar has quit IRC | 17:09 | |
*** jpena is now known as jpena|off | 17:11 | |
*** ociuhandu has quit IRC | 17:13 | |
*** artom has joined #openstack-infra | 17:13 | |
*** ociuhandu has joined #openstack-infra | 17:14 | |
clarkb | fungi: when you get back from your walk can you review https://review.opendev.org/#/c/704085/ so that we don't get caught by the zuul change to use basic auth against gerrit? | 17:15 |
fungi | oh, yep, already back just catching up quietly. will certainly take a look | 17:16 |
*** pgaxatte has quit IRC | 17:17 | |
fungi | clarkb: also part of the reason not to do basic auth right now is, i think, that they didn't drop digest auth until after they switched to storing web password hashes instead of the plaintext versions | 17:18 |
*** ralonsoh has quit IRC | 17:18 | |
*** goldyfruit_ has quit IRC | 17:18 | |
*** kjackal has joined #openstack-infra | 17:18 | |
fungi | (your long-time security bug report) | 17:18 |
fungi | or, i guess they did it at the same time | 17:19 |
fungi | since digest auth would need the server to have access to the plaintext | 17:19 |
clarkb | ah | 17:20 |
fungi | anyway, we get some limited security of passwords in-flight with digest auth, but it's a reasonable sacrifice to switch to basic auth if it means we get to no longer have a database full of plaintext passwords | 17:22 |
*** tesseract has quit IRC | 17:27 | |
*** ykarel|afk is now known as ykarel|away | 17:30 | |
openstackgerrit | Merged zuul/zuul master: test: prevent ResourceWarning in test_client https://review.opendev.org/703782 | 17:32 |
*** rpittau is now known as rpittau|afk | 17:35 | |
*** ociuhandu has quit IRC | 17:39 | |
openstackgerrit | Merged opendev/system-config master: Set gerrit digest auth in zuul config https://review.opendev.org/704085 | 17:39 |
*** ociuhandu has joined #openstack-infra | 17:40 | |
*** rlandy is now known as rlandy|brb | 17:41 | |
openstackgerrit | Paul Belanger proposed zuul/zuul master: Add estimated time remaining tooltip to UI https://review.opendev.org/703892 | 17:42 |
openstackgerrit | Paul Belanger proposed zuul/zuul master: WIP: debug estimate_time on job start https://review.opendev.org/704179 | 17:42 |
*** ociuhandu has quit IRC | 17:46 | |
openstackgerrit | Merged zuul/zuul master: Whitelist debug threads used by visual studio code https://review.opendev.org/703248 | 17:49 |
*** jamesmcarthur has quit IRC | 17:52 | |
*** yamamoto has quit IRC | 17:56 | |
openstackgerrit | Tobias Henkel proposed zuul/zuul master: Use apt mirror infrastructure during zuul-quick-start https://review.opendev.org/649448 | 17:56 |
*** yamamoto has joined #openstack-infra | 17:57 | |
fungi | and now i'm needing to go run some lunch errands, but will be back as soon as i can | 17:57 |
*** derekh has quit IRC | 18:01 | |
*** elod_off has quit IRC | 18:05 | |
*** elod_off has joined #openstack-infra | 18:06 | |
*** rlandy|brb is now known as rlandy | 18:09 | |
clarkb | re linaro-us the nodepool.yaml config has updated but not the clouds.yaml | 18:18 |
openstackgerrit | Paul Belanger proposed zuul/zuul master: WIP: debug estimate_time on job start https://review.opendev.org/704179 | 18:20 |
zbr | what do you think about these timeouts on zuul: https://zuul.opendev.org/t/zuul/builds?job_name=tox-py35&project=zuul%2Fzuul | 18:20 |
zbr | should we override it from 3600 to 4000 ? | 18:21 |
clarkb | linaro-us template was failing because nodepool_linaro_us_project is used in the templates but nodepool_linaro_us_project_name was the group var. I edited the group var to match the code | 18:22 |
clarkb | I expect it will be fixed on the next pass around | 18:22 |
clarkb | zbr: that is a question for the zuul project in #zuul. I believe there has been work to make the tests run more efficiently as well as splitting them up so they don't take so long | 18:23 |
zbr | yeah, https://review.opendev.org/#/c/702473/ | 18:23 |
zbr | i have mixed feelings about myself | 18:23 |
zbr | i personally do not like sharding, but.... | 18:24 |
clarkb | ya that is why I started with trying to make slow tests run faster. hashar seems to ahve taken some of my investigating and added further improvements | 18:24 |
*** jamesmcarthur has joined #openstack-infra | 18:24 | |
zbr | 10 days latest, the fix did not ship. | 18:24 |
clarkb | we're stilltalking like ~5 minutes but its something | 18:24 |
clarkb | in any case if extending the timeout is a question for zuul, it is project configurable | 18:25 |
*** pkopec has joined #openstack-infra | 18:25 | |
*** witek has quit IRC | 18:30 | |
*** yamamoto has quit IRC | 18:35 | |
openstackgerrit | Tobias Henkel proposed zuul/zuul master: Disable pip cache when managing ansible https://review.opendev.org/704184 | 18:35 |
openstackgerrit | Sorin Sbarnea proposed zuul/zuul master: Increase timeout for tox-py27/36 jobs https://review.opendev.org/704185 | 18:38 |
openstackgerrit | Tobias Henkel proposed zuul/zuul master: DNM: Test multi-threaded ansible setup without cache https://review.opendev.org/704186 | 18:39 |
openstackgerrit | Sorin Sbarnea proposed zuul/zuul master: Increase timeout for tox-py35/37 jobs https://review.opendev.org/704185 | 18:41 |
*** psachin has joined #openstack-infra | 18:47 | |
openstackgerrit | Clark Boylan proposed opendev/system-config master: Update project doc to reflect OpenDev changes https://review.opendev.org/703488 | 18:49 |
clarkb | ttx: ^ thank you for the feedback | 18:49 |
clarkb | I think linaro-us is working now | 18:53 |
clarkb | but hasn't done any work yet | 18:53 |
clarkb | yoctozepto: ^ if you've got any kolla changes that need arm64 testing now is a good time to test out the new cloud :) | 18:53 |
clarkb | we are probably watiing on image uploads right now though | 18:53 |
yoctozepto | clarkb: thanks, I believe we are constantly sending jobs on the aarch64 pipeline | 18:54 |
clarkb | cool I'll just be patient then | 18:54 |
*** ociuhandu has joined #openstack-infra | 18:55 | |
openstackgerrit | Paul Belanger proposed zuul/zuul master: Add estimated time remaining tooltip to UI https://review.opendev.org/703892 | 18:56 |
openstackgerrit | Tristan Cacqueray proposed zuul/zuul-operator master: DNM: test arbritary uid support for zuul image https://review.opendev.org/702980 | 18:57 |
*** ociuhandu has quit IRC | 18:59 | |
openstackgerrit | Merged zuul/zuul master: On CI, use a tmpfs for ZUUL_TEST_ROOT https://review.opendev.org/704160 | 19:01 |
clarkb | kevinz: hrw: we are seeing connections reset when uploading images to linaro-us | 19:02 |
clarkb | I'm trying to sort out where that is happening now | 19:03 |
clarkb | port 5000 appears to be the problem which is keystone I think | 19:04 |
openstackgerrit | Tristan Cacqueray proposed zuul/zuul-operator master: Add zuul-operator-promote-image job https://review.opendev.org/704187 | 19:04 |
clarkb | ok I think it must be a firewall problem | 19:05 |
clarkb | kevinz: hrw: nl03.openstack.org (the nodepool launcher for linaro) can talk to linaro-us but nb03.openstack.org (the image build and uploader for arm images) cannot | 19:05 |
*** pkopec has quit IRC | 19:06 | |
*** pkopec has joined #openstack-infra | 19:08 | |
*** pkopec has quit IRC | 19:09 | |
*** pkopec has joined #openstack-infra | 19:09 | |
*** kjackal has quit IRC | 19:10 | |
openstackgerrit | Merged zuul/zuul master: Don't add implicit role if plugin found https://review.opendev.org/691715 | 19:11 |
*** ociuhandu has joined #openstack-infra | 19:11 | |
*** yamamoto has joined #openstack-infra | 19:13 | |
*** ociuhandu has quit IRC | 19:16 | |
openstackgerrit | Tobias Henkel proposed zuul/zuul master: Increase timeout for tox-py35/37 jobs https://review.opendev.org/704185 | 19:19 |
*** jamesmcarthur has quit IRC | 19:23 | |
*** psachin has quit IRC | 19:23 | |
*** yamamoto has quit IRC | 19:24 | |
*** jackedin has quit IRC | 19:36 | |
*** pkopec has quit IRC | 19:40 | |
*** pkopec has joined #openstack-infra | 19:41 | |
*** Lucas_Gray has quit IRC | 19:45 | |
openstackgerrit | Merged zuul/zuul master: Update component diagram for GitHub / Web events https://review.opendev.org/704172 | 19:48 |
openstackgerrit | Clark Boylan proposed zuul/zuul master: Be more specific with remaining time https://review.opendev.org/704191 | 19:55 |
*** pkopec has quit IRC | 19:55 | |
*** pkopec has joined #openstack-infra | 19:56 | |
openstackgerrit | Tristan Cacqueray proposed zuul/zuul master: Dockerfile: add support for arbritary uid https://review.opendev.org/650246 | 19:56 |
*** pkopec has quit IRC | 19:59 | |
*** pkopec has joined #openstack-infra | 20:01 | |
*** slaweq_ has joined #openstack-infra | 20:01 | |
*** kjackal has joined #openstack-infra | 20:06 | |
fungi | good news: we are no longer copying wheels from pypi into our wheel cache, so anything we delete from the cache which exists on pypi will not be repopulated | 20:14 |
fungi | i've gone digging in the logs from the past couple nights across the three architectures for which we do wheel building | 20:15 |
fungi | seems to be operating as hoped | 20:15 |
openstackgerrit | Merged zuul/zuul master: Increase timeout for tox-py35/37 jobs https://review.opendev.org/704185 | 20:16 |
fungi | we still have two obvious holes though... no py37 wheels for ubuntu-bionic, and no wheels for centos-8 yet | 20:16 |
*** artom has quit IRC | 20:19 | |
openstackgerrit | Tristan Cacqueray proposed zuul/nodepool master: kubernetes: add release note about service account token issue https://review.opendev.org/703869 | 20:20 |
*** goldyfruit_ has joined #openstack-infra | 20:26 | |
*** hashar has joined #openstack-infra | 20:30 | |
clarkb | centos8 is in progress though | 20:41 |
*** hashar has quit IRC | 20:41 | |
clarkb | I sent email to ianw hrw and kevinz re the firewall issue with nb03 uploading images to the new linaro cloud | 20:44 |
clarkb | hopefully won't get missed with the weekend and holdiays this way | 20:44 |
fungi | i also haven't found time yet to perform comprehensive testing for reproducible wheel builds across our full data set | 20:46 |
openstackgerrit | Clark Boylan proposed zuul/zuul master: Be more specific with remaining time https://review.opendev.org/704191 | 20:55 |
*** hashar has joined #openstack-infra | 20:58 | |
openstackgerrit | Slawek Kaplonski proposed opendev/irc-meetings master: Move Neutron CI meeting to Wednesday https://review.opendev.org/704200 | 21:00 |
openstackgerrit | Tristan Cacqueray proposed zuul/zuul-jobs master: fetch-subunit-output: introduce zuul_use_fetch_output https://review.opendev.org/681882 | 21:05 |
*** slaweq_ has quit IRC | 21:06 | |
openstackgerrit | Antoine Musso proposed zuul/zuul master: Add client_id to RPC client https://review.opendev.org/704201 | 21:07 |
openstackgerrit | Tristan Cacqueray proposed zuul/zuul-jobs master: fetch-subunit-output: introduce zuul_use_fetch_output https://review.opendev.org/681882 | 21:08 |
openstackgerrit | Tristan Cacqueray proposed zuul/zuul-jobs master: DNM: test tox-py36 on openshift node https://review.opendev.org/682049 | 21:08 |
openstackgerrit | Tristan Cacqueray proposed zuul/zuul-jobs master: fetch-javascript-tarball: introduce zuul_use_fetch_output https://review.opendev.org/681603 | 21:15 |
*** kjackal has quit IRC | 21:18 | |
openstackgerrit | Clark Boylan proposed zuul/zuul master: Be more specific with remaining time https://review.opendev.org/704191 | 21:18 |
smcginnis | That's some life advice there. ^ | 21:19 |
clarkb | ha | 21:19 |
clarkb | fungi: I think it is my turn to pop out and enjoy the outdoors. Though I wouldn't call it nice out right now. Cool and Damp. Could be worse | 21:20 |
clarkb | smcginnis is probably under a foot of snow | 21:22 |
*** zxiiro has quit IRC | 21:23 | |
fungi | yeah, definitely go be more specific with your remaining time. it's worthwhile | 21:26 |
fungi | i'll keep an eye out for emergencies | 21:26 |
*** ociuhandu has joined #openstack-infra | 21:29 | |
*** ociuhandu has quit IRC | 21:34 | |
*** artom has joined #openstack-infra | 21:35 | |
*** pkopec has quit IRC | 21:41 | |
*** rlandy has quit IRC | 21:44 | |
*** diablo_rojo has quit IRC | 21:48 | |
*** Lucas_Gray has joined #openstack-infra | 21:50 | |
*** rfolco has quit IRC | 22:00 | |
*** pkopec has joined #openstack-infra | 22:17 | |
*** jamesmcarthur has joined #openstack-infra | 22:21 | |
ianw | clarkb: hrm, yeah i'm not sure what would cause nb->cloud issues ... can it ping the mirror? | 22:22 |
ianw | 64 bytes from 139.178.85.143: icmp_seq=1 ttl=40 time=111 ms | 22:23 |
ianw | yes | 22:23 |
*** pkopec has quit IRC | 22:23 | |
ianw | i can telnet us.linaro.cloud 5000 | 22:23 |
ianw | Could not find versioned identity endpoints when attempting to authenticate. | 22:24 |
ianw | i wonder if that is the root cause | 22:24 |
ianw | i think it needs the /v3 on the nodepool config ... | 22:24 |
ianw | yeah, i added that by hand and now it's uploading | 22:27 |
fungi | if you can push the fix i'll review asap | 22:28 |
ianw | hrm, hang on, maybe not | 22:28 |
ianw | still seems to report the old url, i wonder if nb doesn't notice the clouds.yaml update | 22:29 |
fungi | probably needs restarting | 22:30 |
fungi | i don't think any nodepool services deteck conffile updates | 22:30 |
ianw | it's not building anything, i'm going to restart it | 22:30 |
fungi | er, detect | 22:30 |
*** rcernin has quit IRC | 22:34 | |
ianw | hrm, the builder seems to be in a busy loop doing something, but it's not putting any info in the logs | 22:35 |
ianw | cannot create temp file for here-document: No space left on device | 22:36 |
*** xek has quit IRC | 22:38 | |
fungi | yeah, /mnt seems to be entirely full | 22:46 |
fungi | i guess it needs the service disabled, the server rebooted, and the disk cleaned up | 22:47 |
fungi | i can give that a shot if you want, it's your saturday after all | 22:47 |
ianw | fungi: yeah, removing it now and see if we can get it going with the /v3 | 22:48 |
ianw | it's ok, i'm housebound waiting for someone to come connect my internet cable anyway :) yes the saga continues | 22:48 |
fungi | yeesh | 22:49 |
*** hashar has quit IRC | 22:49 | |
*** petevg has quit IRC | 22:49 | |
ianw | i don't know why we have /mnt and /opt | 22:50 |
fungi | something to do with the flavor in that cloud maybe? | 22:51 |
ianw | yeah, it seems to be cloud-init related. i'm commenting it out, as we have the uuid mount below it | 22:51 |
clarkb | ianw: oh, did nl03 have the /v3? | 22:52 |
clarkb | ianw: I was able to curl without the v3 on nl03 but not from nb03 | 22:52 |
fungi | seems /mnt and /opt are the same device? | 22:52 |
clarkb | fungi: ya I think config drive magic causes that | 22:52 |
fungi | fstab has a /opt entry | 22:53 |
fungi | but no /mnt entry | 22:53 |
ianw | fungi: i just commented out the /mnt entry | 22:53 |
fungi | oh | 22:53 |
fungi | now i see it | 22:53 |
ianw | (but it's still mounted from prior boot) | 22:53 |
fungi | yeah, one was by uuid | 22:53 |
fungi | defaults,nofail,x-systemd.requires=cloud-init.service,comment=cloudconfig | 22:54 |
fungi | that does indeed look like something cloud-init might have helpfully done for us | 22:54 |
ianw | clarkb: hrm, no the launcher doesn't have /v3, and neither does the uk | 22:55 |
ianw | but it did spew that error about versioned enpoints | 22:56 |
*** jamesmcarthur has quit IRC | 22:57 | |
clarkb | just double checked `curl https://us.linaro.cloud:5000` works from nl03 but not nb03 | 22:58 |
clarkb | from nb03 it seems the connection never successfully happens | 22:58 |
*** apetrich has quit IRC | 22:58 | |
ianw | yeah, agree, weird. it seems to connect (like the telnet did) but not talking | 23:02 |
ianw | security group for linaro-uk seems ok? http://paste.openstack.org/show/788786/ | 23:05 |
clarkb | ianw: ya I wonder if it is a firewall in front of the linaro-us api server | 23:08 |
clarkb | though I can actually hit it from home so would be a weird set of rules | 23:09 |
fungi | something terminating ssl and doing layer 7 inspection? | 23:10 |
ianw | i jumped on another testing node in uk.linaro.org and it also can't get there | 23:14 |
ianw | so it's not specific to the control plane project | 23:14 |
*** jamesmcarthur has joined #openstack-infra | 23:14 | |
ianw | kevinz: i've put all this into https://storyboard.openstack.org/#!/story/2007195 , task 38463 | 23:16 |
ianw | fungi: are there plans to make it so tasks have individual comments ... or am i using it wrong? | 23:16 |
*** bdodd has quit IRC | 23:17 | |
fungi | ianw: tasks basically have descriptions for now. you can fill those with commentary but there's no history for them | 23:19 |
fungi | not attribution for the prose you add | 23:19 |
fungi | er, nor attribution | 23:20 |
*** jamesmcarthur has quit IRC | 23:23 | |
*** eharney has quit IRC | 23:29 | |
clarkb | the fact that ping works implies routing is fine | 23:29 |
clarkb | which really does make me think a firewall is involved, but our security groups look ok so probably outside our control | 23:30 |
fungi | well, pathologically there could be something else responding to ping on behalf of that address, but i'd rate that fairly unlikely | 23:30 |
fungi | specifically layer 7 firewalling yeah? you said you can get a response to some api queries on that port? | 23:31 |
openstackgerrit | Clark Boylan proposed zuul/zuul master: Be more specific with remaining time https://review.opendev.org/704191 | 23:32 |
clarkb | I am not able to no | 23:33 |
clarkb | ianw indicated that may be the case though | 23:33 |
ianw | no, i don't think i can. we see the connect happen, but no communications | 23:33 |
fungi | ahh, okay, socket is established though? | 23:34 |
ianw | even after cleaning /opt(/mnt) on nb03, it /only/ has ~20g available | 23:34 |
fungi | but yeah, starting to sound more and more like a basic firewall problem | 23:35 |
fungi | or maybe repeated/rapid api call failures tripped some sort of anti-ddos mechanism | 23:36 |
ianw | should we perhaps leave nb03 disabled until we get upstream to look at this? | 23:36 |
fungi | nodepool does have a well-earned reputation for hammering apis | 23:36 |
*** jamesmcarthur has joined #openstack-infra | 23:40 | |
ianw | ok, i'm rebooting nb03 | 23:43 |
ianw | i guess it doesn't hurt for it to be stuck uploading, really | 23:43 |
ianw | but i i think we'll need kevinz and maybe a packet trace on the us.linaro.org side to make further progress | 23:43 |
clarkb | does the graphite composer have no option for "give me the url for this graph"? | 23:47 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!