opendevreview | Merged openstack/ironic master: Revert "Fix IRONIC_IMAGE_NAME=non-existent-image" https://review.opendev.org/c/openstack/ironic/+/886960 | 01:31 |
---|---|---|
opendevreview | Merged openstack/ironic master: Retry SQLite DB write failures due to locks https://review.opendev.org/c/openstack/ironic/+/888500 | 04:13 |
TheJulia | Woot | 04:13 |
opendevreview | Merged openstack/ironic master: Firmware Interface https://review.opendev.org/c/openstack/ironic/+/885276 | 06:00 |
rpittau | good morning ironic! o/ | 06:34 |
arne_wiebalck | Good morning rpittau and Ironic! | 07:28 |
rpittau | hey arne_wiebalck :) | 07:44 |
mohammed__ | TheJulia, I see the sqlite fixes merged :) Can anyone confirm that this fixed the "database is locked" error? | 08:17 |
rpittau | mohammed__: it should fix that :) | 08:58 |
rpittau | just found out the real issue with tinycore 14.x, and it's hilarious: "chroot: failed to run command '/bin/sh': No such file or directory" | 09:23 |
rpittau | (┛ಠ_ಠ)┛彡┻━┻ | 09:24 |
opendevreview | Mahnoor Asghar proposed openstack/ironic master: WIP: Add inspection (processing) hooks https://review.opendev.org/c/openstack/ironic/+/887554 | 09:46 |
mohammed__ | rpittau, Thanks ! I will build the ironic image and push it to Quay | 10:00 |
opendevreview | Lucas Alvares Gomes proposed openstack/ironic master: DNM Enable OVN https://review.opendev.org/c/openstack/ironic/+/885087 | 10:13 |
iurygregory | good morning Ironic | 11:47 |
iurygregory | rpittau, tinycore hate us that much?! O.o | 11:47 |
rpittau | I have not idea what's happening, didn't have the time to investigate more, I'll check again tomorrow | 12:59 |
TheJulia | good morning | 13:15 |
opendevreview | Riccardo Pittau proposed openstack/bifrost master: Use Launchpad for bug reports https://review.opendev.org/c/openstack/bifrost/+/888925 | 13:15 |
rpittau | good morning TheJulia :) | 13:15 |
TheJulia | How is everyone this fine morning? | 13:34 |
iurygregory | doing good | 13:34 |
iurygregory | good morning TheJulia =) | 13:34 |
opendevreview | Julia Kreger proposed openstack/ironic master: Add wait step https://review.opendev.org/c/openstack/ironic/+/879061 | 13:41 |
opendevreview | Julia Kreger proposed openstack/ironic master: WIP/DNM: CI: SNMP job to Ubuntu Jammy https://review.opendev.org/c/openstack/ironic/+/888926 | 13:49 |
TheJulia | got to start ^ process at some point | 13:49 |
JayF | o/ | 13:56 |
JayF | do we have a grenade skip level yet? | 13:56 |
JayF | we need that, too | 13:56 |
JayF | > ironic-grenade-skip-level https://zuul.opendev.org/t/openstack/build/f36b9d1c1ddc49ce8432fb7598c07dd6 : SUCCESS in 56m 30s (non-voting) | 13:57 |
JayF | yes, and it's passing | 13:57 |
JayF | good stuff | 13:57 |
iurygregory | you already answered =) | 13:57 |
iurygregory | I was too slow lol | 13:58 |
JayF | does it make sense if I say, often I'm thinkking out loud with a questionmark on the end lol | 13:58 |
JayF | I don't ever expect someone to curate public info that I can go find that easy | 13:58 |
iurygregory | oh ok | 13:58 |
JayF | not that I woulda complained if you beat me :D | 13:58 |
iurygregory | lol | 13:58 |
TheJulia | Brraaaaiiinnnsss | 14:01 |
rpittau | TheJulia: thanks for the snmp job test, there's also mine open in case you want to check logs, but I couldn't really find anything from CI | 14:04 |
JayF | would be interesting to see it with the older dnsmasq | 14:05 |
JayF | now that we at least have a known issue with that ubu versino | 14:05 |
opendevreview | Julia Kreger proposed openstack/ironic-python-agent master: WIP: preserve/handle config drives on 4k block devices https://review.opendev.org/c/openstack/ironic-python-agent/+/888794 | 14:09 |
TheJulia | rpittau: I didn't realize you had an open change | 14:10 |
TheJulia | stevebaker[m]: reved based on review feedback, thanks! | 14:11 |
rpittau | TheJulia: no worries, I was not doing any real steps forward :/ | 14:16 |
TheJulia | I'll give it a try, maybe dnsmasq will help us shine some more light on it | 14:18 |
arne_wiebalck | Initial assessment after MySQL update from 5.7 to 8.0; the upgrade seems to reduce Ironic API response time by ~15% (for the Ironic DB optimization aficionados ... looking at TheJulia ;-). | 15:00 |
TheJulia | nice! | 15:01 |
* TheJulia notes a release note might be good, just to communicate that to operators. | 15:01 | |
TheJulia | ;) | 15:01 |
arne_wiebalck | 5.7 is out of support soon, so operators will need to move, but this may be an additional carrot :) | 15:04 |
TheJulia | True | 15:05 |
TheJulia | iurygregory: you missed a couple doc-ish items in with firmware interfaces, I'm going to just add them in my service steps patch since I'm adding the items there, if you want to extract that is fine, but I'm kind of focused in trying to get it hammered out as fast as possible (the rest of the way) | 15:08 |
iurygregory | TheJulia, ack | 15:10 |
iurygregory | sorry for that, but I can do a follow-up since is doc items =) | 15:11 |
TheJulia | iurygregory: I didn't see if you did api ref, I'm not going to do that, since there is not a user facing difference in the data with my patch, it is "new enough client to toggle the verb usage" | 15:11 |
TheJulia | also, could be taken as more of an informational increment too | 15:12 |
TheJulia | ... which saves us headaches at times too | 15:12 |
iurygregory | api-ref I added | 15:12 |
arne_wiebalck | bye everyone o/ | 15:19 |
JayF | o/ | 15:20 |
iurygregory | bye arne_wiebalck o/ | 15:20 |
opendevreview | Merged openstack/sushy stable/zed: Retry on ilo state error https://review.opendev.org/c/openstack/sushy/+/882746 | 15:47 |
TheJulia | errr | 16:04 |
TheJulia | hmmm | 16:04 |
TheJulia | why do we have multiple files saying they ahve the same downrev | 16:04 |
TheJulia | okay, my mistake | 16:08 |
* TheJulia lets tests run | 16:08 | |
opendevreview | Jay Faulkner proposed openstack/ironic-python-agent master: Log the number of bytes downloaded https://review.opendev.org/c/openstack/ironic-python-agent/+/887729 | 16:20 |
JayF | trivial spelling fix there, figured I'd save the round trip | 16:21 |
JayF | I still +2'd it if someone else wants to land it | 16:21 |
opendevreview | Julia Kreger proposed openstack/ironic master: WIP: service steps https://review.opendev.org/c/openstack/ironic/+/884783 | 16:26 |
TheJulia | much appreciated | 16:27 |
TheJulia | wow, it is actually kind of boiler plate at this point to add another steps model | 16:32 |
TheJulia | I need to double check the ipa code, but I don't think that change set will grow much more, especially if I split off docs. | 16:35 |
JayF | I'm giving you an early review on that now btw | 16:35 |
TheJulia | err, I need to going to walk the code and check tests | 16:36 |
rpittau | good night! o/ | 16:36 |
TheJulia | thanks, some refactoring to handle the third state is a common thing in there | 16:36 |
TheJulia | I'm mobile at the moment, going to be back at the house shortly, I have a call, and then back to the change set | 16:37 |
JayF | not a big deal, I'm just getting reviews in where they are owed | 16:37 |
TheJulia | hopefully existing clean/service don't explide | 16:37 |
JayF | I'll be going for an early lunch in about 30m | 16:37 |
TheJulia | explode | 16:37 |
TheJulia | cool cool | 16:37 |
TheJulia | I'll likely be heads down on it this evening, should worst comes to worst | 16:37 |
JayF | I'm finishing up fixes to my homelab this afternoon after I'm done reviewing; getting my new VM host setup permanently | 16:38 |
TheJulia | fun! | 16:39 |
JayF | more like annoying :) the fun was building the new computer yesterday evening | 16:41 |
JayF | converting the old one to a VM host involves lots of "do I need this data?" questions which are a pain to answer as a data pakrat lol | 16:42 |
TheJulia | There is a reason I have a NAS now... and a tool ready to roll to do deduping | 16:43 |
JayF | guess what's going to happen with the litany of disks in the new hypervisor :D | 16:43 |
JayF | lol | 16:43 |
TheJulia | "oh, I have 9 copies of this file, sweet! Lets let the filesystem hide the duplication, kthxbai" | 16:44 |
TheJulia | JayF: any thoughts on backporting the bytes downloaded logging change? | 16:46 |
JayF | can't think of a reason why not | 16:46 |
TheJulia | okay, I think it would at least make my life, and the life of operators easier when troubleshooting fun networking issues | 16:46 |
JayF | I always approach backports from a 'why not' standpoint | 16:47 |
JayF | someone wouldn't have put it in master if it wasn't useful | 16:47 |
TheJulia | At least once a year I get a variation of "spanning tree blocks traffic and deployment fails" and it is a PITA to troubleshoot when people don't want to share switch configs and just claim "we swapped the cable" | 16:47 |
TheJulia | which reminds me, I need to go check the internal bug/case for that, to see if they actually, finally did :( | 16:50 |
opendevreview | Verification of a change to openstack/ironic master failed: add default conductor group capability https://review.opendev.org/c/openstack/ironic/+/855705 | 16:58 |
JayF | uh oh, ugly failures down the list on tha tone | 16:59 |
JayF | https://zuul.opendev.org/t/openstack/build/cefaa503719942099d1c9408c20bacec/log/job-output.txt#21893 | 17:00 |
JayF | looks like devstack is busted building a cirros image? | 17:00 |
TheJulia | curl: (60) SSL: no alternative certificate subject name matches target host name 'objects.githubusercontent.com' | 17:00 |
opendevreview | Verification of a change to openstack/bifrost master failed: remove setuptools system packages requirement https://review.opendev.org/c/openstack/bifrost/+/874522 | 17:51 |
opendevreview | Verification of a change to openstack/bifrost master failed: Refactor the use of include_vars https://review.opendev.org/c/openstack/bifrost/+/874523 | 17:52 |
opendevreview | Verification of a change to openstack/ironic master failed: Add job to test with SQLAlchemy master (2.x) https://review.opendev.org/c/openstack/ironic/+/886020 | 18:14 |
TheJulia | so it is not the RC_DIR (no idea where that is coming from), it is purely the download | 18:25 |
TheJulia | and it looks like we get redirected | 18:25 |
TheJulia | I'm sort of wondering if it has resolved already | 18:31 |
TheJulia | rechecked grenade | 18:32 |
TheJulia | err | 18:32 |
TheJulia | the sqlalchemy change | 18:32 |
opendevreview | Verification of a change to openstack/ironic master failed: Add job to test with SQLAlchemy master (2.x) https://review.opendev.org/c/openstack/ironic/+/886020 | 18:40 |
TheJulia | so the issue is basically the cert has no subject alternative name, and is wildcarded to *.github.io | 19:12 |
JayF | this isn't unique to us, is it? | 19:14 |
JayF | if not, we should engage qa/devstack folks? | 19:14 |
TheJulia | it is unique to us | 19:18 |
TheJulia | we download a stock iamge and modify it | 19:18 |
TheJulia | so it will actually local boot properly | 19:18 |
TheJulia | becuase cirros is designed for VMs | 19:18 |
TheJulia | and thus is geared to that specifically | 19:18 |
TheJulia | All we can really do, short of begin an campaign to excise/re-evaluate is to just go "its okay curl, don't error" | 19:19 |
JayF | can we tell curl "Verify but no SAN is OK" | 19:19 |
JayF | probably not : / | 19:19 |
TheJulia | afaik no | 19:19 |
TheJulia | looks like the certs are updating | 19:20 |
TheJulia | but openssl s_client only gives so much data | 19:20 |
JayF | yeah I'd +2 a temporary fix for telling curl to not verify | 19:20 |
JayF | but we should make a note to revisit | 19:20 |
TheJulia | all I can see is there is just no subject alternative name | 19:20 |
JayF | I can setup a reminder to check on Monday | 19:20 |
TheJulia | k | 19:20 |
JayF | yeah, you wanna push it up, I'll +2A | 19:20 |
JayF | and setting a slack reminder now to follow up on monday | 19:20 |
opendevreview | Julia Kreger proposed openstack/ironic master: CI: Handle unhappiness with github cert https://review.opendev.org/c/openstack/ironic/+/888951 | 19:23 |
JayF | OpenStack Caracal :| | 20:05 |
JayF | that's a lot of c's and a's to type for the next several years | 20:06 |
TheJulia | ... indeed | 20:20 |
iurygregory | caracal is the new release name? ouch >.< | 21:09 |
opendevreview | Merged openstack/bifrost master: remove setuptools system packages requirement https://review.opendev.org/c/openstack/bifrost/+/874522 | 21:42 |
JayF | TheJulia: ... would CI fail in grenade because stable/2023.1 needs the curl fix, too? | 22:18 |
JayF | I think so, and they might have to merge in inverse order, or we may have to drop the job and re-enable | 22:18 |
opendevreview | Jay Faulkner proposed openstack/ironic stable/2023.1: CI: Handle unhappiness with github cert https://review.opendev.org/c/openstack/ironic/+/888654 | 22:18 |
JayF | I give it a 50/50 chance of failing because zed will need the same change (lol) | 22:19 |
TheJulia | i'd disable grenade on master, backport the change | 22:25 |
TheJulia | and then re-enable | 22:25 |
TheJulia | each branch will have the same issue, so might as well do it alongside | 22:25 |
TheJulia | JayF: ^ | 22:32 |
JayF | If you edit your change to do that, I can land it again | 23:04 |
JayF | If you need me to make the change, it'll be later this evening | 23:04 |
JayF | QA | 23:05 |
JayF | Whoops, somehow that's the string that came out when I fat finger exiting the mobile app | 23:06 |
JayF | whatever, I walked to a computer, lets see if I can swing this from windows :) | 23:07 |
opendevreview | Jay Faulkner proposed openstack/ironic master: CI: Handle unhappiness with github cert https://review.opendev.org/c/openstack/ironic/+/888951 | 23:19 |
opendevreview | Jay Faulkner proposed openstack/ironic master: CI: Re-enable grenade job as voting https://review.opendev.org/c/openstack/ironic/+/888960 | 23:19 |
JayF | that should do the trick | 23:19 |
* JayF disappears back into the inky shadows | 23:19 | |
TheJulia | Just don’t make deals with them | 23:25 |
TheJulia | :) | 23:25 |
opendevreview | Jay Faulkner proposed openstack/ironic master: CI: Handle unhappiness with github cert https://review.opendev.org/c/openstack/ironic/+/888951 | 23:25 |
opendevreview | Jay Faulkner proposed openstack/ironic master: CI: Re-enable grenade job as voting https://review.opendev.org/c/openstack/ironic/+/888960 | 23:26 |
opendevreview | Jay Faulkner proposed openstack/ironic master: CI: Handle unhappiness with github cert https://review.opendev.org/c/openstack/ironic/+/888951 | 23:28 |
opendevreview | Jay Faulkner proposed openstack/ironic master: CI: Handle unhappiness with github cert https://review.opendev.org/c/openstack/ironic/+/888951 | 23:30 |
opendevreview | Jay Faulkner proposed openstack/ironic master: CI: Re-enable grenade job as voting https://review.opendev.org/c/openstack/ironic/+/888960 | 23:30 |
JayF | and it was today I learned zuul configs really, really hate tabs | 23:31 |
JayF | oh, and I'll note -- on my windows machine; raw.githubusercontent.com is serving up a cert for *.github.io; but listed under "Extensions -> Certificate Subject Alternative Name", it has *.github.com, and *.githubusercontent.com (among others) | 23:54 |
JayF | I'm tending to think this might be a curl bug... | 23:54 |
JayF | or github is serving up a different/wrong cert based on CDN location(?) | 23:55 |
TheJulia | JayF: I wasn't getting a alternative name earlier | 23:58 |
JayF | That is from microsoft edge | 23:58 |
TheJulia | could be they noticed a major mistake | 23:58 |
JayF | so I don't know what that actually means lol | 23:58 |
TheJulia | tabs == great unhappiness | 23:58 |
opendevreview | Julia Kreger proposed openstack/ironic master: WIP: service steps https://review.opendev.org/c/openstack/ironic/+/884783 | 23:59 |
Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!