| stephenfin | fungi: clarkb: frickler: When you're about, I'd be interested in knowing if this is a reasonable thing to do https://review.opendev.org/c/openstack/openstack-zuul-jobs/+/966618 | 11:53 |
|---|---|---|
| opendevreview | Stephen Finucane proposed openstack/openstack-zuul-jobs master: Switch to building releasenotes with tox https://review.opendev.org/c/openstack/openstack-zuul-jobs/+/966618 | 11:56 |
| opendevreview | Stephen Finucane proposed openstack/openstack-zuul-jobs master: Switch to building releasenotes with tox https://review.opendev.org/c/openstack/openstack-zuul-jobs/+/966618 | 11:57 |
| *** haleyb|out is now known as haleyb | 12:55 | |
| ralonsoh | hello folks, I had a message when trying to download some logs in zuul | 13:44 |
| ralonsoh | something like "denied for financial reasons" | 13:45 |
| ralonsoh | I never saw that before | 13:45 |
| ralonsoh | and now all CI jobs of one patch doesn't have logs anymore | 13:45 |
| ralonsoh | e.g.: https://zuul.opendev.org/t/openstack/build/9db58210088949cabeb39439ad42fef0 | 13:45 |
| sean-k-mooney | clarkb: fungi ^ so that obviously impacting most project i guess. one of our providers i guess if fully or we have hight quota or something | 14:13 |
| sean-k-mooney | if i recall correctly we only use a subset of provider to upload logs with swift right? | 14:14 |
| sean-k-mooney | storage.bhs.cloud.ovh.net in this case | 14:15 |
| fungi | amorin: ^ looks like the credits didn't take? | 14:19 |
| fungi | dmsimard[m]: ^ | 14:19 |
| sean-k-mooney | Completed at 2025-11-12 13:12:26 | 14:20 |
| sean-k-mooney | could also be a timing thing? | 14:20 |
| amorin | hey | 14:20 |
| sean-k-mooney | i.e. depending on when they were applied | 14:20 |
| amorin | I think we were too late for the voucher | 14:20 |
| amorin | I am taking care of this | 14:20 |
| dmsimard[m] | :( | 14:20 |
| sean-k-mooney | amorin: ++ | 14:22 |
| amorin | I confirm that the project was suspended, sorry for this failure | 14:22 |
| amorin | we are making it up again | 14:22 |
| fungi | thanks amorin! | 14:24 |
| opendevreview | Ron Stone proposed openstack/project-config master: Update StarlingX docs promote job for R11 release https://review.opendev.org/c/openstack/project-config/+/966868 | 14:39 |
| -opendevstatus- NOTICE: Zuul job log URLs for storage.*.cloud.ovh.net are temporarily returning an access denied/payment required error, but the provider has been engaged and is working to correct it | 14:49 | |
| amorin | it's back | 14:54 |
| ralonsoh | thanks | 14:55 |
| fungi | amorin: thanks! how long should it take urls like https://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_750/openstack/750781052ddd4de4a1b0b71e843ffad4/zuul-manifest.json to stop returning a payment required error? | 14:55 |
| amorin | that's a good question, everything is supposed to be back online | 14:59 |
| fungi | amorin: never mind, it's working now as of a few seconds ago, was probably just cached on the server side | 14:59 |
| amorin | perfect | 14:59 |
| amorin | I refreshed here and I confirm I can reach it as well | 15:00 |
| amorin | sorry for this failure.. | 15:00 |
| fungi | thanks for your quick assistance on it! | 15:00 |
| fungi | though i do wonder how to get a longer grace period before things get turned off. this isn't the first time it's taken longer to get vouchers added than the automated suspension process allows | 15:01 |
| amorin | agree, I believe emails are sent like a month before or something like this | 15:14 |
| amorin | do you know if you monitor such emails? | 15:14 |
| dmsimard[m] | We should do better, I'll ask around and see if we can find out a more reliable solution | 15:21 |
| fungi | amorin: i was checking closely, we get messages that say "We confirm the payment of your order." which i've taken to indicate we still have remaining credits. we got one for that account on 2025-11-02, and then the very next day (2025-11-03) received one for the same account that stated "Either there is no payment method registered on your account, or there is an issue with | 15:22 |
| fungi | the default payment method that has been registered." so i informed both of you that same day | 15:22 |
| fungi | looks like the account was suspended 10 days after the billing date, based on that, 9 days from when we got notified that payment failed | 15:23 |
| fungi | so at the moment it seems like we only get notified our credits have run out 9 days before suspension | 15:24 |
| fungi | amorin: and you mentioned the new voucher was added on 2025-11-10, which was 7 days after we were notified the credits ran out, but that was apparently not fast enough to avoid suspension | 15:26 |
| amorin | I must admit that I dont know how this works within the OVH billing part. From my perspective, it looks like a big tower with some wizard protecting it, too risky to get closer. | 15:31 |
| fungi | your bravery is appreciated, sir knight! | 15:35 |
| clarkb | stephenfin: I think that is fine, but would require us to update all projects before changing the job definition (or risk breaking release notes updates for those that don't update) | 15:47 |
| stephenfin | clarkb: my point is that I think all projects are currently providing 'releasenotes' tox environments, though I'm not sure how to prove it. I assume there's no mechanism to "rehearse" a job chance against all affected repos? | 15:48 |
| stephenfin | *job change | 15:48 |
| clarkb | stephenfin: depends on is the main rehearsal feature. Which may work here if we do premerge release notes testing but requires a lot of throw away changes | 15:49 |
| stephenfin | I was thinking you'd say that :( heh | 15:49 |
| clarkb | I think if you spot check that the vast majority are already set up to do this and then change it and a few require cleanup that is probably fine and worst case we revert the job update and regroup with a new plan | 15:50 |
| fungi | there are definitely non-openstack projects that use reno but have nox configs and no tox configs | 15:50 |
| fungi | not sure if they'd be affected though | 15:51 |
| clarkb | I doubt they are using the openstack specific jobs. but the may be | 15:51 |
| stephenfin | fungi: they shouldn't be using/affected by changes to jobs in openstack-zuul-jobs though, right? | 15:51 |
| stephenfin | yeah | 15:51 |
| fungi | right, at least the ones i'm involved in don't | 15:51 |
| stephenfin | okay, I'll cross reference projects with the jobs against those with a releasenotes tox.ini target. It's not perfect (the releasenotes target could be broken) but it'll do, I suspect, especially if coupled with an email to the list | 15:55 |
| clarkb | stephenfin: I think even if only say 80% are expected to work that may be a reasonable baseline to proceed with the intent of fixing others along the way | 15:56 |
| opendevreview | Merged openstack/project-config master: Update StarlingX docs promote job for R11 release https://review.opendev.org/c/openstack/project-config/+/966868 | 16:06 |
| opendevreview | James E. Blair proposed openstack/project-config master: Grafana: add core graphs to rackspace-flex https://review.opendev.org/c/openstack/project-config/+/966981 | 21:49 |
| opendevreview | James E. Blair proposed openstack/project-config master: Grafana: add core graphs to rackspace-flex https://review.opendev.org/c/openstack/project-config/+/966981 | 21:50 |
Generated by irclog2html.py 4.0.0 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!