| *** mhen_ is now known as mhen | 02:30 | |
| *** ykarel_ is now known as ykarel | 09:05 | |
| ykarel__ | frickler, thx for your response on Friday re. test_rebuild_server | 12:43 |
|---|---|---|
| ykarel__ | do you know if there is known issue for that, i couldn't find that | 12:43 |
| ykarel__ | else i can create one to track that | 12:44 |
| *** ykarel__ is now known as ykarel | 12:44 | |
| frickler | ykarel: I tried to find one, but failed. might not be for devstack but some other project. maybe gmaan remembers, but also it wouldn't hurt to create a fresh one | 12:46 |
| ykarel | frickler, i have found https://bugs.launchpad.net/tempest/+bug/2039940 and https://bugs.launchpad.net/tempest/+bug/1888224 but not the one i was looking for | 12:51 |
| ykarel | but looking now that particular kernel panic was seen only on 11th November so may that specific was temporary https://32c2553a5b1b0d58bd31-9e074609c9fda723118db1a634ce1a12.ssl.cf5.rackcdn.com/openstack/6194bd1896c44468a4a8bde11df03df2/testr_results.html | 12:51 |
| ykarel | so will leave it for now as other ones are already tracked in above bugs | 12:52 |
| gmaan | ykarel: yeah, those are old one but still happening | 17:36 |
| gmaan | add comment in one of those, that will be helpful | 17:37 |
| sean-k-mooney | i have seen nova-next fail twice on the inablity to install ectd on debian 12 | 17:47 |
| sean-k-mooney | https://zuul.opendev.org/t/openstack/build/b23d88aa990448d096afd308121ce207/log/job-output.txt#6421-6435 | 17:47 |
| sean-k-mooney | its getting as 503 downloadign ti form github | 17:47 |
| sean-k-mooney | this particalar job does not actuly need ectd3 because i turn of cinder | 17:47 |
| sean-k-mooney | so i could disable this in this job but does anyone know why were are downloadign the tar? | 17:48 |
| clarkb | I think that is the official way of installing it | 17:49 |
| clarkb | they build a binary because its go and you just grab it and run it | 17:49 |
| sean-k-mooney | ok so https://github.com/etcd-io/etcd/releases/tag/v3.5.21 | 17:50 |
| sean-k-mooney | still exists | 17:50 |
| sean-k-mooney | and https://github.com/etcd-io/etcd/releases/download/v3.5.21/etcd-v3.5.21-linux-amd64.tar.gz | 17:50 |
| sean-k-mooney | works for me locally | 17:50 |
| sean-k-mooney | im wondering if we shoudl be perhaps caching this in our base image | 17:51 |
| sean-k-mooney | or in our provider mirros | 17:51 |
| clarkb | we've tried to get away from caching things like that in our base images. | 17:51 |
| sean-k-mooney | ack | 17:52 |
| clarkb | specifically its use case specific and updates versiosn regularly. It is difficult to manage those in the images | 17:52 |
| sean-k-mooney | im wondering if the 503 is realted to ratelemitign or just a transiant blip in gituhb uptime | 17:52 |
| clarkb | github says rate limits respond with 403 or 429 | 17:53 |
| sean-k-mooney | ok os it was likely jsut downtime | 17:53 |
| sean-k-mooney | let me check codesarch for that error | 17:53 |
| sean-k-mooney | *opensearch | 17:54 |
| sean-k-mooney | it hit my patch to nova twice in a row but its failing in devstack super early so i know it not related to the patch | 17:55 |
| sean-k-mooney | btu im wondering how widspread the failure is | 17:55 |
| sean-k-mooney | 88 hits in 30 days | 17:56 |
| sean-k-mooney | so not very common | 17:56 |
| sean-k-mooney | they are also clustered | 17:56 |
| sean-k-mooney | so 32 hits today and anouth batch a few days ago | 17:56 |
| sean-k-mooney | ok ill just recheck for now but if we see that happening more often we might want to figure out a better approch to this | 17:57 |
| clarkb | I wonder if simply retrying after a few seconds would get the vast majority of the failures to succeed | 17:59 |
| sean-k-mooney | ya i could proably add retry logic to get_extra_file quickly that woudl do an expencial backoff and 3-5 retires | 18:00 |
| sean-k-mooney | failing a build set for a transitent issues is expensive | 18:00 |
| sean-k-mooney | if you think something like https://github.com/openstack/nova/blob/master/nova/filesystem.py#L25-L56 | 18:01 |
| sean-k-mooney | but in bash woudl be useful i can do a poc of that | 18:02 |
| sean-k-mooney | clarkb: actully curl and wget apprently have the ablity to do automatic retry with delays | 18:11 |
| sean-k-mooney | so i can skip the generic soltion and jsut delegate to them | 18:13 |
| sean-k-mooney | wget aslo supprot --retry-on-http-error so if we only want to do it on a 503 or 500 instead of a 403/429 we can do that cleanly as well | 18:15 |
| clarkb | that seems like a good idea particularly for github which does rate limit | 18:20 |
| opendevreview | sean mooney proposed openstack/devstack master: allow get_extra_files to retry on common errors https://review.opendev.org/c/openstack/devstack/+/968249 | 19:13 |
| opendevreview | sean mooney proposed openstack/devstack master: allow get_extra_files to retry on common errors https://review.opendev.org/c/openstack/devstack/+/968249 | 19:14 |
| opendevreview | sean mooney proposed openstack/devstack master: allow get_extra_files to retry on common errors https://review.opendev.org/c/openstack/devstack/+/968249 | 19:15 |
| opendevreview | Merged openstack/grenade stable/2024.2: [stable-only] Update grenade FROM branch https://review.opendev.org/c/openstack/grenade/+/963716 | 22:16 |
| opendevreview | Merged openstack/grenade stable/2024.2: [stable-only] Remove grenade-skip-level-always https://review.opendev.org/c/openstack/grenade/+/968106 | 22:16 |
| opendevreview | Ashish Gupta proposed openstack/tempest master: Test create VM with unaddressed port https://review.opendev.org/c/openstack/tempest/+/959187 | 22:37 |
Generated by irclog2html.py 4.0.0 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!