| fungi | Reverbverbverb: the timing on that can also be relevant. was it slow or a long delay before that error, or was it fairly immediate? also over ipv4 or ipv6? | 00:11 |
|---|---|---|
| fungi | i've tested cloning ironic directly from all 6 backends and haven't gotten any error, which suggests the problem is farther out on the internet | 00:20 |
| JayF | I similarly tested this when Reverbverbverb reported it to me and I couldn't find it on my connection. | 01:10 |
| Clark[m] | I wonder if the phone tether is trying to traffic shape/filter | 01:10 |
| JayF | That's essentially what I was suspecting, but I was hoping y'all knew some magical flag to pass to get which makes it okay with everything 🤣 | 01:11 |
| JayF | *git | 01:11 |
| opendevreview | OpenStack Proposal Bot proposed openstack/project-config master: Normalize projects.yaml https://review.opendev.org/c/openstack/project-config/+/912694 | 02:28 |
| *** jroll05 is now known as jroll0 | 05:22 | |
| opendevreview | Merged openstack/project-config master: Normalize projects.yaml https://review.opendev.org/c/openstack/project-config/+/912694 | 05:49 |
| frickler | seems apache2 just got unattended-upgraded on a lot of our ubuntu hosts. no that I expect any issues, but something to keep in mind in case something pops up | 07:11 |
| noonedeadpunk | fungi: so, let's wait for couple of days just in case? and then.... can you reach OFTC folks to help us? | 08:11 |
| opendevreview | Joel Capitao proposed openstack/project-config master: Implement periodic job to update Packstack constraints https://review.opendev.org/c/openstack/project-config/+/912904 | 08:39 |
| opendevreview | Joel Capitao proposed openstack/project-config master: Implement periodic job to update Packstack constraints https://review.opendev.org/c/openstack/project-config/+/912904 | 08:41 |
| opendevreview | Joel Capitao proposed openstack/project-config master: Implement periodic job to update Packstack constraints https://review.opendev.org/c/openstack/project-config/+/912904 | 08:42 |
| fungi | noonedeadpunk: sounds like a plan. let me know how the evacuation attempt goes | 11:37 |
| fungi | my appointment this morning is running longer than expected, and will still need to grab something to eat after, but i should be around again by 15:00 utc | 13:36 |
| opendevreview | Elod Illes proposed openstack/project-config master: [release-tool] Fix branch creation exceptions https://review.opendev.org/c/openstack/project-config/+/913189 | 14:02 |
| fungi | okay, around again now | 14:47 |
| frickler | fungi: clarkb: please check https://review.opendev.org/c/openstack/project-config/+/913189 when you have a moment, see also the discussion in #-release | 14:55 |
| opendevreview | Merged openstack/project-config master: [release-tool] Fix branch creation exceptions https://review.opendev.org/c/openstack/project-config/+/913189 | 15:05 |
| frickler | thx | 15:07 |
| fungi | of course! | 15:09 |
| Reverbverbverb | @fungi No speed problems, no delay. Just quits with the RPC failure message. | 15:12 |
| fungi | Reverbverbverb: noted. i can try cloning on my phone too, but odds are it'll be very provider-specific behavior | 15:12 |
| Reverbverbverb | I'll have more data today -- they're supposed to install my new internet service, which is the reason I'm using tethering in the first place | 15:15 |
| fungi | makes sense, i'd do the same | 15:16 |
| opendevreview | Takashi Kajinami proposed openstack/project-config master: yaql: Notify gerrit patches in heat channel https://review.opendev.org/c/openstack/project-config/+/913234 | 15:57 |
| clarkb | Reverbverbverb: fungi https://stackoverflow.com/questions/38618885/error-rpc-failed-curl-transfer-closed-with-outstanding-read-data-remaining indicates that this is likely a connectivity issue and people haev had some success doing shallow clones then unshallowing afterwards | 16:07 |
| clarkb | also apparently ssh helps. Which really makes me think that firewalls or traffic manipulation is at play | 16:08 |
| clarkb | bit of a slow start for me this morning. My brother cancelled the fishing trip on me so I'm stuck in limbo deciding how much I actually want to work today :) | 16:11 |
| fungi | yeah, i was about to ask why you're not fishing (or why you're irc'ing from the boat) | 16:12 |
| fungi | also, i was able to successfully git clone https://opendev.org/openstack/ironic over my phone carrier | 16:14 |
| fungi | not that i expected to be able to reproduce the problem, as every carrier's networks are probably implemented a little differently | 16:14 |
| clarkb | fungi: for the centos-7 removals you merged stuff and then abandoned the reverts. Does that mean we're relatively clear for more final removal tomorrow? | 16:18 |
| fungi | clarkb: i believe so, yes | 16:19 |
| fungi | at least for master and stable/2024.1 branches of openstack projects, which were my main concern (the possible impact on the impending coordinated release) | 16:19 |
| clarkb | great! thank you for getting that over the virtual finish line. Honestly, that bit was probably going to be the most difficult part as long as openafs doesn't explode again when we stop mirroring :) | 16:19 |
| fungi | indeed | 16:19 |
| opendevreview | Merged openstack/project-config master: yaql: Notify gerrit patches in heat channel https://review.opendev.org/c/openstack/project-config/+/913234 | 16:21 |
| clarkb | apparently there is some gerrit issue that causes full offline reindexes to clobber the change index https://issues.gerritcodereview.com/issues/322269961 | 16:21 |
| clarkb | 3.8.3 is reported to not have this problem but I'm not sure about 3.8.4 yet. This may affect our project renaming and gerrit 3.9 upgrade plans though neither should need offline reindexes | 16:22 |
| clarkb | according to the included in pop up only stable-3.9 should be affected. Master has had the broken change reverted (I don't think that revert is in stable-3.9 yet) | 16:25 |
| clarkb | I suspect that our 3.8 isntallation will be fine for renaming but before we upgrade to 3.9 we should ensure that this is addressed | 16:25 |
| clarkb | Reverbverbverb: fungi: you could clone from gerrit for now and use ssh there to see if it changes anything. Or try the shallow clone then unshallow | 16:27 |
| fungi | also there is a continuously updated mirror of the ironic repo at https://github.com/openstack/ironic (though cloning it from there may suffer from the same problem) | 16:32 |
| Reverbverbverb | fungi: clarkb: jayf: Just tried it again and this time it worked. Chalking it up to some temporary network issue. Shrug. | 17:38 |
| fungi | internet gonna internet | 17:41 |
| frickler | how does zuul vote both v-1 and v+1 at the same time on https://review.opendev.org/c/opendev/base-jobs/+/912786? and do we want to do the same force-merge test + possible revert on it as earlier? | 18:38 |
| fungi | frickler: good catch. that's coming from two different tenants, looks like | 18:51 |
| fungi | i wonder why the openstack tenant includes a vote when reporting | 18:51 |
| fungi | i don't think we'll have to bypass gating since it should only be gated by the opendev tenant, but maybe there's a bug around that or we have something not quite configured right in zuul | 18:53 |
| frickler | oh, the +1 is from the opendev tenant, right. maybe the V-1 is only due to the config error and wouldn't show up otherwise? | 18:53 |
| fungi | that's my suspicion, since other tenants relying on opendev/base-jobs didn't appear to vote or run any jobs | 19:05 |
| hashar | fungi: seems like you can tag a new version of git-review :-] | 19:26 |
| hashar | though it is never ending, I found out the test suite targets Gerrit 3.4.4 which is kind of eol | 19:27 |
| hashar | well it is eol for sure | 19:27 |
| fungi | yep, we do also test on newer gerrit | 19:31 |
| fungi | we have jobs testing on 3.7.1 | 19:32 |
| fungi | https://zuul.opendev.org/t/opendev/builds?job_name=nox-py311-gerrit-371 | 19:32 |
| fungi | https://opendev.org/opendev/git-review/src/branch/master/.zuul.yaml | 19:33 |
| fungi | hashar: you can override WAR_URL in the calling environment to point to newer versions | 19:34 |
| fungi | but i agree we can likely raise the default version to something newer now | 19:34 |
| hashar | ahh | 19:34 |
| hashar | awesome :) | 19:34 |
| fungi | i think 3.4.x was the oldest i could get it reliably testing on with other updates we had to make to the testsuite to support newer warfiles | 19:35 |
| fungi | also we could probably cut some of the matrix expansion there. i doubt testing python 3.6 and 3.11 with both gerrit 3.4.4 and 3.7.1 is going to turn up any bugs that we wouldn't catch by just doing python 3.6 with gerrit 3.3.4 and python 3.11 with gerrit 3.7.1, or whatever | 19:37 |
| hashar | I doubt as well yeah | 19:38 |
| fungi | post-release i'll refresh some of the versions there | 19:38 |
| hashar | https://www.gerritcodereview.com/support.html#supported-versions has the list of supported version | 19:39 |
| hashar | s | 19:39 |
| fungi | we were also talking about dropping python 3.6 support in the following release, so that will probably be a good time to revisit what versions of stuff we're testing too | 19:39 |
| hashar | does Zuul support axis of parameters to define jobs / different envs? | 19:39 |
| fungi | not really. we just use a config generator script if we need to define lots of similar jobs with slight variations | 19:40 |
| hashar | yeah I got confused with good old jjb :) | 19:40 |
| fungi | the crux of the problem there is that zuul relies on yaml, and there's not really a matrix solution in the yaml language | 19:41 |
| fungi | and zuul doesn't have an internal job definition generator that could operate on a data structure like that either | 19:41 |
| hashar | that is why you need yet another layer of abstraction on top of yaml | 19:42 |
| hashar | the config generator you mentionned | 19:42 |
| fungi | right, basically we have an externalized abstraction layer when we need it (which isn't often). if somebody wanted to work on an internal solution, it might be possible but would require a spec and a lot of discussion/review | 19:43 |
| fungi | and consensus fro the zuul maintainers that it's even somethig we'd want to support | 19:44 |
| hashar | anyway, thanks for the release notes and eventually taking care of the release | 19:46 |
| fungi | hashar: sure, i've been sidetracked by a few other problems of critical urgency or we probably would have done it last week, but now it's probably going to be early next week if we want to avoid friday/weekend releases | 19:47 |
| hashar | +1 | 19:47 |
| hashar | feel free to poke me next week if needed :) | 19:48 |
| hashar | I am more than happy to offer a little bit of help on git-review since we make heavy use of it | 19:48 |
| fungi | hashar: that's good to know, glad it's still proving useful! thanks, i'll take you up on it | 19:49 |
| hashar | awesome thanks! | 19:49 |
| opendevreview | Jeremy Stanley proposed openstack/project-config master: Replace 2024.1/Caracal key with 2024.2/Dalmatian https://review.opendev.org/c/openstack/project-config/+/913274 | 21:59 |
Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!