JayF | admiyo: reservation is internal-ish, basically consider it a DB-side lock that only a conductor can take | 01:11 |
---|---|---|
JayF | admiyo: https://specs.openstack.org/openstack/ironic-specs/specs/15.0/node-lessee.html might help | 01:12 |
JayF | I'm not super familiar with the feature, but hopefully that is at least a point in the right direction. | 01:12 |
JayF | https://docs.openstack.org/ironic/latest/admin/node-multitenancy.html appears to address it as well | 01:13 |
hgy__ | Good morning, ironic! | 01:29 |
TheJulia | admiyo: you may want to chat with tzumainn. I think he was working on scheduling awareness for owner/lessee stuffs but I honestly don't know/remember | 01:30 |
TheJulia | hgy__: good morning! | 01:30 |
opendevreview | Jacob Anders proposed openstack/sushy master: Changing boot device string for vmedia on SuperMicro https://review.opendev.org/c/openstack/sushy/+/817137 | 05:55 |
iurygregory | good morning Ironic o/ | 06:17 |
opendevreview | Riccardo Pittau proposed openstack/ironic-python-agent master: Call execute from ironic-lib in hardware.py https://review.opendev.org/c/openstack/ironic-python-agent/+/816791 | 06:52 |
opendevreview | Riccardo Pittau proposed openstack/ironic-python-agent master: Call execute from ironic-lib in hardware.py https://review.opendev.org/c/openstack/ironic-python-agent/+/816791 | 06:52 |
rpittau | good morning ironic! o/ | 06:55 |
iurygregory | good morning rpittau o/ | 06:56 |
rpittau | hey iurygregory :) | 06:56 |
rpittau | we need to rebuild ipa ramdisk on master to get the new eventlet in | 06:56 |
iurygregory | eventlet causing problems \o/ | 06:58 |
rpittau | we can probably merge either one patch on ipa or ipa-builder to publish a new image | 06:59 |
iurygregory | yeah | 07:00 |
arne_wiebalck | Good morning rpittau iurygregory and Ironic! | 07:09 |
iurygregory | good morning arne_wiebalck o/ | 07:09 |
muellerbe | good morning ironic \o | 07:25 |
iurygregory | good morning muellerbe o/ | 07:27 |
rpittau | hey arne_wiebalck :) | 07:38 |
opendevreview | Merged openstack/sushy master: Add basic support for CertificateService https://review.opendev.org/c/openstack/sushy/+/815479 | 07:45 |
hgy__ | Hi, Could I ask a question? If I want to deploy ironic-api and ironic-conductor in different hosts, which hosts should be installed Nova-compute? | 08:46 |
arne_wiebalck | hgy__: nova-compute can be installed on a different host as well | 08:47 |
hgy__ | arne_wiebalck: Oh, Sorry, I had a wrong understanding. So, I don't need to deply nova-compute on the same host which has been deploied ironic service? | 08:52 |
hgy__ | arne_wiebalck: I can deploy ironic-api, ironic-conductor and nova-compute in defferent hosts | 08:53 |
hgy__ | ? | 08:53 |
hgy__ | arne_wiebalck: love you! | 08:54 |
rpittau | can someone please have a look at https://review.opendev.org/c/openstack/ironic-python-agent-builder/+/815815 ? | 08:56 |
iurygregory | rpittau, just wondering.. but https://review.opendev.org/c/openstack/ironic-python-agent-builder/+/815815/14/releasenotes/notes/debian-arm64-fc3cc4949e3100d9.yaml#2 this wouldn't be a feature? | 09:20 |
arne_wiebalck | hgy__: you can, yes | 09:20 |
arne_wiebalck | hgy__: we have conductor/API on the same node, and nova-compute on a separate one | 09:21 |
arne_wiebalck | hgy__: but this is mostly out of convenience: this way I have only one type of Ironic node, not multiple | 09:22 |
rpittau | iurygregory: I don't know, I think we used other when building new images, we don't have any active CI running with arm64, it's just build and publish | 09:40 |
hgy__ | arne_wiebalck: Thank you very much, I get it. | 09:41 |
iurygregory | rpittau, gotcha! no worries =) | 09:45 |
janders | hey iurygregory rpittau arne_wiebalck muellerbe hgy__ and Ironic o/ | 09:49 |
rpittau | hey janders :) | 09:49 |
hgy__ | hey janders | 09:50 |
arne_wiebalck | hey janders o/ | 09:52 |
muellerbe | hey janders |o | 09:53 |
muellerbe | hey janders \o | 09:54 |
iurygregory | hey janders o/ | 09:58 |
opendevreview | Jacob Anders proposed openstack/sushy master: Changing boot device string for vmedia on SuperMicro https://review.opendev.org/c/openstack/sushy/+/817137 | 09:58 |
hgy__ | Sorry for bother | 10:09 |
hgy__ | Could I ask a question again | 10:10 |
hgy__ | https://docs.openstack.org/ironic/latest/install/configure-pxe.html | 10:10 |
hgy__ | In the third step of "UEFI PXE - Grub setup" | 10:11 |
hgy__ | set default=master | 10:11 |
hgy__ | set timeout=5 | 10:11 |
hgy__ | set hidden_timeout_quiet=false | 10:11 |
hgy__ | menuentry "master" { | 10:11 |
hgy__ | configfile /tftpboot/$net_default_mac.conf | 10:11 |
hgy__ | } | 10:11 |
arne_wiebalck | janders: Re your patch ^^, is this true for all supermicro nodes, or only for some, or we do not know? | 10:11 |
hgy__ | we config grub.cfg like this | 10:12 |
hgy__ | whit is the "$net_default_mac" | 10:12 |
arne_wiebalck | hgy__: please you paste.openstack.org to share code/config snippets (easier to read and keeps irc cleaner) | 10:13 |
arne_wiebalck | hgy__: s/you/use | 10:14 |
hgy__ | arne_wiebalck: oh,sorry very much. | 10:14 |
arne_wiebalck | hgy__: no worries :) | 10:14 |
hgy__ | "$net_default_mac" is the mac of BMC NIC or the mac of other NIC of hosts which will be control by ironic | 10:16 |
hgy__ | I'm confuse | 10:16 |
janders | arne_wiebalck we do not know 100% | 10:17 |
janders | I was considering checking the model as well, but IIRC after a chat with Dmitry we decided not to (so that we don't have to keep adding new models going forward) | 10:18 |
hgy__ | arne_wiebalck: Sorry I didn't know this rule before. I will paste in paste.opendev.org/ in the future | 10:18 |
arne_wiebalck | janders: fair enough, we can start adding models once we run into the first one where this approach does not work :-D | 10:19 |
janders | arne_wiebalck yeah that may be the go. If we see breakage, we can do a negative match against the older models. | 10:20 |
janders | Both more recent ones I had exposure to need UsbCd | 10:20 |
arne_wiebalck | janders: ++ | 10:20 |
iurygregory | I just hope we won't need sushy-supermicro in the near future :D | 10:36 |
janders | iurygregory I hope so, too, but who knows... | 10:36 |
iurygregory | janders, yeah =( | 10:37 |
janders | sushymicro | 10:37 |
janders | at least it looks like backports will be easy, everything auto-merged cleanly into Xena and Wallaby (just tried for a test) | 10:38 |
janders | (provided no major further changes to the master patch) | 10:38 |
iurygregory | \o/ | 10:38 |
opendevreview | Merged openstack/ironic-python-agent-builder master: Build and publish arm64 debian based ipa ramdisk https://review.opendev.org/c/openstack/ironic-python-agent-builder/+/815815 | 10:49 |
opendevreview | Jacob Anders proposed openstack/sushy stable/wallaby: Changing boot device string for vmedia on SuperMicro https://review.opendev.org/c/openstack/sushy/+/818364 | 11:01 |
janders | thank you for the +2 arne_wiebalck | 11:57 |
opendevreview | Jacob Anders proposed openstack/sushy stable/xena: Changing boot device string for vmedia on SuperMicro https://review.opendev.org/c/openstack/sushy/+/818369 | 12:02 |
janders | ^^ while we're at it, let | 12:02 |
janders | let's have all three up | 12:03 |
janders | (jumping the gun a little I know) | 12:03 |
janders | see you tomorrow Ironic o/ | 12:30 |
arne_wiebalck | bye janders o/ | 12:33 |
arne_wiebalck | rpioso: small correction: the power profile did not flag the missing AllowableValues since they are not missing (the issue flagged is due to a missing GracefulRestart which Ironic uses, but the endpoint does not provide) | 12:37 |
dtantsur | hi folks | 12:37 |
* dtantsur is not feeling well, ping explicitly if any help needed | 12:37 | |
arne_wiebalck | rpioso: to not flag the missing AllowableValues is correct since they are there, but not in the resource but referenced via ResetActionInfo | 12:38 |
arne_wiebalck | rpioso: now, since sushy complains it cannot find the allowed values (while they are there and the service validation confirms this is correct), makes me think this is actually a bug in sushy and it needs to be extended | 12:40 |
dtantsur | rpittau: a correction: we need an IPA patch merged, IPA-builder will not do | 12:41 |
arne_wiebalck | hi dtantsur, get better soon and do not read my Redfish/sushy comments here as I am not sure if these help when feeling unwell | 12:41 |
dtantsur | yeah, I tried following the discussion and decided to rather not :) | 12:41 |
arne_wiebalck | heh | 12:41 |
dtantsur | rpittau or anyone: I can offer you to merge https://review.opendev.org/c/openstack/ironic-python-agent/+/806393/ to build the image :) | 12:41 |
dtantsur | ah, merge conflict, damn | 12:41 |
dtantsur | gerrit, y u no notify? | 12:42 |
dtantsur | fg | 12:46 |
dtantsur | and another WTF: why does my window manager keeps redirecting me to the IRC window? | 12:47 |
opendevreview | Dmitry Tantsur proposed openstack/ironic-python-agent master: Use two more functions from disk_utils https://review.opendev.org/c/openstack/ironic-python-agent/+/806393 | 12:50 |
rpittau | dtantsur: right, I +2ed that but we need an approval | 12:58 |
iurygregory | I will take a look in a few =) | 13:03 |
timeu | Hi all, does anybody have used/experience with https://github.com/openstack/ironic-prometheus-exporter ? | 13:04 |
iurygregory | me \o/ | 13:04 |
timeu | nice :-] | 13:04 |
dtantsur | timeu: iurygregory literally wrote it | 13:04 |
iurygregory | yeah =) | 13:04 |
timeu | I am very interesting to give it a spin | 13:05 |
* iurygregory never tested in Lenovo HW so you might find interesting things :D | 13:05 | |
iurygregory | timeu, if you have any questions or problems feel free to ping me here in the irc =) | 13:06 |
timeu | I have one ;-) is this an add on to ironic conductor ? | 13:06 |
timeu | so I can install it in the ironic_conductor container ? | 13:06 |
timeu | or is it its own service | 13:07 |
timeu | looking at the docs it seems to be a flask app so I guess it's own service ? | 13:07 |
iurygregory | yeah it has it own service the app but also has the oslo messaging extension | 13:08 |
iurygregory | because the conductor is configured to collect the sensor data from the nodes | 13:08 |
dtantsur | do we actually have install docs? | 13:08 |
timeu | https://docs.openstack.org/ironic-prometheus-exporter/latest/install.html#pre-requisites | 13:09 |
timeu | is there a minimum requiurements for the ironic version ? | 13:09 |
timeu | I would like to try it with our OSP 16.2 | 13:09 |
dtantsur | mmmm, yeah, this needs a significant expansion | 13:09 |
timeu | setup | 13:09 |
iurygregory | since train we have some support | 13:09 |
timeu | like just to see what metrics/data comes out and how it works. My idea was to simply start it on one of the controller nodes | 13:10 |
iurygregory | oh 16.2 is train I think =) | 13:10 |
timeu | yeah | 13:10 |
dtantsur | ah, so, https://docs.openstack.org/ironic-prometheus-exporter/latest/configuration.html should be partly moved to the installation docs | 13:10 |
dtantsur | the first part, about the required options | 13:10 |
dtantsur | iurygregory: ^^^ | 13:10 |
iurygregory | timeu, want to watch a 25min video? https://www.youtube.com/watch?v=fnDxxHa9nW8 :D | 13:10 |
timeu | but the configuration part is for the conductor right ? | 13:10 |
timeu | iurygregory: thanks will watch it | 13:10 |
dtantsur | and maybe make it very explicit that there has to be a shared directory | 13:10 |
iurygregory | timeu, right | 13:11 |
dtantsur | iurygregory: could you maybe update the installation docs with the whole procedure? I've just realized we have a lot of missing bits. | 13:11 |
iurygregory | dtantsur, I will do that =) | 13:11 |
dtantsur | like https://docs.openstack.org/ironic-prometheus-exporter/latest/run.html should be a part of the install guide as well | 13:11 |
iurygregory | ack | 13:11 |
dtantsur | timeu: the docs actually have everything, it's just not under the installation guide currently | 13:12 |
timeu | ok so basically I enable metrics scraping on the conductor. the conductor will put them in [oslo_messaging_notifications]/location and the exporter service will fetch them from there and expose them as an prom endpoint | 13:12 |
iurygregory | yup | 13:13 |
dtantsur | I think that's the summary | 13:13 |
timeu | and there needs be a shared directory because 3 controllers might scrape data | 13:13 |
dtantsur | which means, IPE can be a separate container, but you need a shared volume | 13:13 |
dtantsur | s/can/should/ ? | 13:13 |
iurygregory | oh the flask app need to be aware of the information in ironic.conf I think... | 13:13 |
iurygregory | dtantsur, correct | 13:13 |
dtantsur | yep, let's cover this topic in the docs too :) | 13:13 |
timeu | so maybe it's the easiest to isntall it for now into the ironic conductor container | 13:14 |
iurygregory | I think in metal3 we have it running as a separate container | 13:14 |
dtantsur | yeah https://github.com/metal3-io/ironic-image/blob/master/scripts/runironic-exporter | 13:14 |
timeu | related to this, how is it with the ironic_conductor. If I have 3 controllers I have 3 conductors that will a manage a subset of the entire baremetal pool right ? | 13:15 |
timeu | or is always only one active and the others are standby ? | 13:16 |
iurygregory | depends if you have conductors group I think | 13:17 |
dtantsur | nope, each manages its share of nodes | 13:17 |
dtantsur | (conductor groups allow additional control over it) | 13:17 |
opendevreview | Merged openstack/ironic-python-agent-builder master: more details where to find the iso-image-create script https://review.opendev.org/c/openstack/ironic-python-agent-builder/+/817430 | 13:17 |
timeu | ok but then I guess I would also need 3 exporter services on the 3 controllers running ? | 13:18 |
timeu | in a production setup | 13:18 |
dtantsur | heh, a good question | 13:18 |
timeu | or have one shared foler across the 3 controllers and 1 exporter service | 13:18 |
dtantsur | if my migraine brain serves me right, both options should work | 13:18 |
dtantsur | in the first case you'll need to give prometheus all 3 exporters | 13:19 |
timeu | yeah right, I have then 3 targets to scrape | 13:20 |
timeu | ok I will watch the video and play around and report back ;-) | 13:20 |
dtantsur | please do | 13:20 |
timeu | it would be pretty handy because we currently do monitoring/metrics and alerting with prometheus everywhere almost | 13:21 |
timeu | getting sensor data would be nice for correlation etc | 13:21 |
dtantsur | ++ | 13:21 |
iurygregory | yeah, I never tested with multiple conductors .-. | 13:25 |
hgy__ | Hello, Could I ask a question. In the third step of https://docs.openstack.org/ironic/latest/install/configure-pxe.html#uefi-pxe-grub-setup | 13:32 |
hgy__ | $net_default_mac in grub.conf refers to which nic on which host? | 13:32 |
Alex-dev | hello, I'am trying inspect nodes and got error in nodes console: "failed to run hardware-detection utility" | 13:35 |
hgy__ | https://paste.opendev.org/show/811163/ | 13:36 |
hgy__ | the configure file section | 13:36 |
Alex-dev | I try differect images(centos-8-victoria, centos8-master), build my own image (ironic-python-agent-builder -v -o my-ipa -e devuser --release 8-stream centos) but got the same error | 13:36 |
Alex-dev | hgy__: Could you give mo info? where I need add this options? | 13:39 |
opendevreview | Bernd Mueller proposed openstack/ironic-python-agent-builder master: add element-deps for element burn-in delete entries https://review.opendev.org/c/openstack/ironic-python-agent-builder/+/817408 | 13:42 |
iurygregory | Alex-dev, in your case did you have the extra-hardware element set when building the images? | 13:42 |
Alex-dev | no, I use default: ironic-python-agent-builder -v -o my-ipa -e devuser --release 8-stream centos | 13:43 |
dtantsur | yep, you're missing extra-hardware | 13:44 |
dtantsur | or you need to disable extra hardware collection in your configuration | 13:44 |
iurygregory | I think you just need to add "-e extra-hardware" | 13:44 |
dtantsur | this ^^ | 13:44 |
iurygregory | yeah =) | 13:45 |
Alex-dev | ok ) I will try! thanks! | 13:46 |
iurygregory | hgy__, if I recall correct it should be the mac of the nic on the node that has pxe enabled | 13:46 |
hgy__ | <Alex-dev>: This——https://paste.opendev.org/show/811163/,in grub.cfg. In the third step of https://docs.openstack.org/ironic/latest/install/configure-pxe.html#uefi-pxe-grub-setup | 13:49 |
hgy__ | Alex-dev: 3.Create master grub.cfg | 13:50 |
hgy__ | iurygregory: Thank you, love you | 13:50 |
iurygregory | I hope it helps if goes wrong let us know | 13:50 |
iurygregory | we will try to help | 13:51 |
dtantsur | hgy__: I think you need to put it there literally like this, not try to substitute anything | 13:51 |
dtantsur | grub will do it for you on boot | 13:51 |
Alex-dev | 2021-11-18 13:53:31.172 | diskimage_builder.element_dependencies.MissingElementException: Element 'extra-hardware' not found | 13:54 |
Alex-dev | Command '['disk-image-create', '-o', 'my-ipa', 'ironic-python-agent-ramdisk', 'centos', 'devuser', 'extra-hardware', '-x']' returned non-zero exit status 1. | 13:54 |
Alex-dev | [root@localhost image]# | 13:54 |
dtantsur | Alex-dev: old ironic-python-agent-builder? | 13:54 |
hgy__ | dtantsur: emm~~~if putting it there literallly like this, because no $net_default_mac in system,$net_default_mac=Null , a .conf will apper | 13:55 |
dtantsur | $net_default_mac is a grub variable. if it's not populated on boot, you have issues with your grub. | 13:55 |
dtantsur | see https://www.gnu.org/software/grub/manual/grub/html_node/Network.html#Network | 13:56 |
hgy__ | dtantsur: oh, thank you very much | 13:58 |
hgy__ | dtantsur: I will learn about it and try it | 13:58 |
Alex-dev | dtantsur: openstack-ironic-python-agent-builder-2.2.0-2.el8.noarch | 13:58 |
dtantsur | our release notes are pretty light, lemme check | 14:04 |
rpittau | Alex-dev: you will need at least version 3.0.0 | 14:06 |
rpittau | no, nvm, sorry version 2.30 | 14:06 |
rpittau | 2.3.0 | 14:06 |
opendevreview | Merged openstack/sushy master: Changing boot device string for vmedia on SuperMicro https://review.opendev.org/c/openstack/sushy/+/817137 | 14:19 |
TheJulia | third moderna dose is brutal | 14:19 |
dtantsur | oh? | 14:20 |
dtantsur | I guess it really depends on $everything | 14:20 |
TheJulia | yeah | 14:20 |
TheJulia | we got our doses yesterday because the clinics all open up to anyone today | 14:21 |
dtantsur | the 2nd (after J&J, so like 3rd) dose of Pfizer didn't have any substantial effect on me | 14:21 |
iurygregory | good morning TheJulia =) | 14:21 |
TheJulia | which means they were going to be slammed and we have pre-existing conditions... so yeah :) | 14:21 |
dtantsur | (got it on Friday, went climbing on Sunday) | 14:21 |
iurygregory | I will get a third dose in Brazil | 14:21 |
dtantsur | TheJulia: very sensible, yep | 14:21 |
* TheJulia wonders who turned up the thermostat of the home office to 5000 degrees | 14:22 | |
dtantsur | iurygregory: will you be able to issue a EU-style certificate for it? | 14:22 |
iurygregory | I will probably not have to worry that much XD | 14:22 |
dtantsur | TheJulia: "warm as on the sun" taken literally? | 14:22 |
iurygregory | because I will probably be remote in 2022... | 14:22 |
TheJulia | Hopefully this will all be over sometime in 2022, at least... the insanity that is | 14:23 |
dtantsur | there are downsides to home offices, but overall I definitely don't regret it | 14:23 |
dtantsur | but yeah, if this pandemic lasts years..... | 14:23 |
rpittau | I'm kind on the pessimistic side, so I'll keep comments to myself :) | 14:23 |
dtantsur | hehe | 14:23 |
TheJulia | I suspect the logical progression is opening an ironic asylumn | 14:23 |
rpittau | lol | 14:24 |
dtantsur | oh awesome | 14:24 |
dtantsur | who will be our Joker? | 14:24 |
* dtantsur suspects himself | 14:24 | |
opendevreview | Merged openstack/ironic stable/xena: Avoid handling a deploy failure twice https://review.opendev.org/c/openstack/ironic/+/817109 | 14:24 |
* iurygregory votes for dtantsur | 14:24 | |
iurygregory | let's open a pool and we will check the results | 14:24 |
dtantsur | you probably meant poll, but I like pool more | 14:25 |
iurygregory | yeah sorry | 14:25 |
TheJulia | a pool would be nice.... | 14:25 |
dtantsur | since I'm supposed to be a bit on a murderous side, do I start with drowning everyone with incompatible redfish implementations? :) | 14:26 |
iurygregory | we can have a pool in the asylum... | 14:26 |
rpittau | dtantsur: that would be not murder but self defense | 14:26 |
dtantsur | RIGHT | 14:26 |
TheJulia | dtantsur: no, those go the reformitory | 14:26 |
dtantsur | hey, it's not chaotic enough for a Joker! | 14:27 |
TheJulia | lol | 14:27 |
iurygregory | LOL | 14:27 |
iurygregory | chaotic-evil :D | 14:27 |
iurygregory | RPG feelings <3 | 14:28 |
TheJulia | rloo: is zer0c00l around these days? | 14:28 |
rloo | TheJulia: should be. Would you like me to be a messenger? :) | 14:28 |
TheJulia | rloo: I would <3 if he could take a look at https://review.opendev.org/c/openstack/nova/+/813897. I added him as a reviewer, so he should see it on a review dashboard if he takes a look | 14:29 |
dtantsur | rloo: in year 2021 you're not a messenger if you're not written on electron | 14:29 |
dtantsur | I'm sorry, I'm not the one defining the rules | 14:29 |
rloo | heh. ok, i'm not a messenger then ;) | 14:30 |
* TheJulia suspects we need to get a special jacket ready for dtantsur ;) | 14:30 | |
rloo | i'll let him know. | 14:30 |
dtantsur | wait, you haven't it already??? | 14:30 |
TheJulia | rloo: thanks! | 14:30 |
dtantsur | you.. shouldn't have told me that ;) | 14:30 |
TheJulia | dtantsur: no, I slacked on it! | 14:30 |
* TheJulia blinks at CI and wonders "wut" | 14:31 | |
TheJulia | so, extreme sadness | 14:33 |
TheJulia | error: unknown option `insecure' | 14:34 |
TheJulia | looks like we could put in place explicit git config | 14:36 |
opendevreview | Julia Kreger proposed openstack/ironic stable/ussuri: Revert "CI: Get tinyipa build working for CI usage" https://review.opendev.org/c/openstack/ironic/+/818324 | 14:39 |
opendevreview | Dmitry Tantsur proposed openstack/sushy master: Migrate System constants to enums https://review.opendev.org/c/openstack/sushy/+/816717 | 14:41 |
* TheJulia wonders if env works in the tinycore shell | 14:44 | |
opendevreview | Julia Kreger proposed openstack/ironic stable/ussuri: CI: Work around tinyipa build issues https://review.opendev.org/c/openstack/ironic/+/818394 | 14:49 |
opendevreview | Julia Kreger proposed openstack/ironic-python-agent stable/ussuri: Output verbose info from efibootmgr https://review.opendev.org/c/openstack/ironic-python-agent/+/817019 | 14:50 |
TheJulia | ^^ with a depends-on so we'll know if this works or not | 14:50 |
opendevreview | Dmitry Tantsur proposed openstack/sushy master: Migrate System Storage constants to enums https://review.opendev.org/c/openstack/sushy/+/818396 | 15:00 |
iurygregory | OpenInfra Keynotes Day 2 \o/ | 15:01 |
* dtantsur has a meeting in 30 minutes | 15:03 | |
iurygregory | if anyone wants the link https://www.youtube.com/watch?v=e-SMtkZu3co | 15:06 |
Alex-dev_ | I have already build image (centos stream based), inspect - ok and then I start deploy (via tripleo) | 15:07 |
Alex-dev_ | and got again error: Command: blkid /dev/sda --match-tag UUID --match-tag PARTUUID Exit code: 2 | 15:07 |
Alex-dev_ | https://paste.opendev.org/raw/811173/ | 15:08 |
Alex-dev_ | Any idea? bugs? know issue with wa? | 15:10 |
TheJulia | rpittau did say yesterday that was a known issue... but on centos7. Did you find the agent log and/or the conductor logs? | 15:12 |
dtantsur | "centos" means 7 by default, you mean need to add --release=8-stream to IPA-builder command Alex-dev_ | 15:13 |
Alex-dev_ | I used centos stream for ipa - ironic-python-agent-builder -v -o my-ipa -e devuser -e extra-hardware --release 8-stream centos | 15:15 |
dtantsur | ah, okay, this is correct | 15:15 |
dtantsur | TheJulia: blkid is terrible when it comes to error messages... | 15:15 |
Alex-dev_ | and I still had this bug with centos-stream | 15:15 |
*** akahat|rover is now known as akahat|dinner | 15:19 | |
Alex-dev_ | And I can't find any another errors in nova, ironic, ironic-inspector, ironic-conductor | 15:21 |
TheJulia | Alex-dev_: /var/log/containers/ironic/deploy | 15:25 |
Alex-dev_ | aha, something new ) ./journal:Nov 18 15:20:06 overcloud-novacompute-0 ironic-python-agent[2754]: 2021-11-18 15:20:06.792 2754 ERROR ironic_lib.disk_utils [-] Failed to fix GPT partition on disk /dev/sda for node None. Error: Unexpected error while running command. | 15:30 |
rpittau | so that's sgdisk failing, still too vague, would be useful to have the entire ramdisk log | 15:36 |
TheJulia | le sigh | 15:38 |
iurygregory | node None is amazing... /facepalm =( | 15:39 |
* TheJulia wonders if this is a partition image attempting to be deployed as a whole disk image | 15:39 | |
TheJulia | or vise-versa | 15:39 |
TheJulia | iurygregory: yeah... :\ | 15:39 |
dtantsur | this is a possibility | 15:39 |
rpittau | mmm could be | 15:39 |
dtantsur | another possibility is a damaged image, we've seen it in metal3 | 15:39 |
TheJulia | ahh yeah | 15:39 |
dtantsur | I think I've replaced blkid with lsblk after that | 15:39 |
dtantsur | because lsblk has *some* diagnostics, while blkid - only status code | 15:39 |
TheJulia | Alex-dev_: what does your glance image show data look like? | 15:40 |
dtantsur | okay, my meeting did not happen because bluejeans doesn't open :) | 15:40 |
TheJulia | \o/ | 15:40 |
dtantsur | I think I'll use it as a sign to go back to resting and trying to recover | 15:40 |
iurygregory | dtantsur, bluejeans on PTO? :D | 15:40 |
dtantsur | I hope so :) | 15:40 |
dtantsur | if somebody approves https://review.opendev.org/c/openstack/ironic-python-agent/+/806393, we'll get a fixed tinyIPA image | 15:41 |
dtantsur | see you tomorrow folks o/ | 15:41 |
rpittau | bye dtantsur, take care | 15:41 |
Alex-dev_ | https://paste.opendev.org/raw/811175/ - overcloud image | 15:41 |
TheJulia | well, looks like a whole disk image :) | 15:42 |
TheJulia | if you download the file, what do you get if you run `file <filename>` | 15:42 |
Alex-dev_ | it's bad idea ? to use whole disk image ? | 15:43 |
TheJulia | no, it is highly perferred | 15:43 |
TheJulia | but, thinking it would be good to at least validate the image is what we think it is | 15:44 |
Alex-dev_ | ok, where I can get valid overcloud-full image ? | 15:44 |
Alex-dev_ | build it? or download? | 15:44 |
TheJulia | Well, instead of just trying something different, lets try and dig a little bit to understand what is going on | 15:45 |
Alex-dev_ | and how I can validate it ?) | 15:45 |
TheJulia | step one, file <filename> :) | 15:45 |
TheJulia | It will read the header/formatting and give us a very quick idea | 15:45 |
Alex-dev_ | overcloud-full.qcow2: QEMU QCOW Image (v3), 5073141760 bytes | 15:46 |
TheJulia | ahh, right | 15:47 |
TheJulia | hmm | 15:47 |
TheJulia | well, it is not a raw image then | 15:48 |
TheJulia | do you have the 50gb of disk space to extract it? | 15:48 |
TheJulia | I guess, that is the problem though, the image is set as a raw image | 15:48 |
TheJulia | disk_format is set to "raw" in the glance metadata | 15:49 |
TheJulia | change that to qcow2 | 15:49 |
opendevreview | Julia Kreger proposed openstack/ironic stable/ussuri: CI: Work around tinyipa build issues https://review.opendev.org/c/openstack/ironic/+/818394 | 15:49 |
Alex-dev_ | TheJulia: ok, I will try. thanks a lot! | 15:52 |
TheJulia | if that turns out to be the issue, we likely ought to put a check in | 15:53 |
* TheJulia awaits on CI | 15:58 | |
* TheJulia needs more coffee | 16:03 | |
opendevreview | Julia Kreger proposed openstack/ironic master: Fix some of the SRBAC tests https://review.opendev.org/c/openstack/ironic/+/818298 | 16:43 |
opendevreview | Julia Kreger proposed openstack/ironic master: project scoped manager support https://review.opendev.org/c/openstack/ironic/+/818299 | 16:43 |
opendevreview | Julia Kreger proposed openstack/ironic stable/ussuri: CI: Work around tinyipa build issues https://review.opendev.org/c/openstack/ironic/+/818394 | 16:47 |
rpittau | good night o/ | 16:48 |
opendevreview | Julia Kreger proposed openstack/ironic master: Add FIPS jobs https://review.opendev.org/c/openstack/ironic/+/797739 | 16:51 |
*** akahat|dinner is now known as akahat|rover | 16:58 | |
TheJulia | yay irccloud issues | 17:04 |
arne_wiebalck | I have only 2 different Redfish nodes so far, but they are behaving completely differently. What will happen when I add a third node? | 17:09 |
arne_wiebalck | One requires Etags, the other one refuses them ... WAT | 17:10 |
* arne_wiebalck goes home now :) | 17:13 | |
arne_wiebalck | bye, see you tomorrow o/ | 17:13 |
TheJulia | wut!? | 17:15 |
opendevreview | Merged openstack/ironic-python-agent master: Use two more functions from disk_utils https://review.opendev.org/c/openstack/ironic-python-agent/+/806393 | 17:19 |
opendevreview | Julia Kreger proposed openstack/ironic stable/ussuri: CI: Work around tinyipa build issues https://review.opendev.org/c/openstack/ironic/+/818394 | 17:37 |
TheJulia | oh, lovely. I think devstack merged a breaking change | 17:50 |
* TheJulia goes and takes a shower before digging into that | 17:50 | |
opendevreview | Julia Kreger proposed openstack/ironic stable/ussuri: CI: Work around tinyipa build issues https://review.opendev.org/c/openstack/ironic/+/818394 | 18:22 |
*** tkajinam is now known as Guest6220 | 18:30 | |
opendevreview | Julia Kreger proposed openstack/ironic master: Test a cross repo fix https://review.opendev.org/c/openstack/ironic/+/813264 | 18:43 |
opendevreview | Julia Kreger proposed openstack/ironic stable/ussuri: CI: Work around tinyipa build issues https://review.opendev.org/c/openstack/ironic/+/818394 | 19:33 |
opendevreview | Julia Kreger proposed openstack/ironic master: CI: Fix devstack plugin with RBAC changes https://review.opendev.org/c/openstack/ironic/+/818458 | 19:54 |
opendevreview | Samuel Zuk proposed openstack/ironic-specs master: Spec proposal for a Redfish proxy for Ironic https://review.opendev.org/c/openstack/ironic-specs/+/808804 | 19:56 |
sam_z | heyo folks, i've been working on implementing the redfish proxy for ironic that i mentioned a little while ago and have updated the corresponding spec to reflect my updated plans for implementation! | 19:59 |
opendevreview | Julia Kreger proposed openstack/ironic master: CI: Fix devstack plugin with RBAC changes https://review.opendev.org/c/openstack/ironic/+/818458 | 20:00 |
TheJulia | sam_z: awesome | 21:34 |
opendevreview | Julia Kreger proposed openstack/ironic stable/ussuri: CI: Work around tinyipa build issues https://review.opendev.org/c/openstack/ironic/+/818394 | 21:42 |
opendevreview | Manuel Schönlaub proposed openstack/sushy master: Add support for NetworkAdapter resources https://review.opendev.org/c/openstack/sushy/+/813839 | 21:43 |
opendevreview | Manuel Schönlaub proposed openstack/sushy master: Add support for NetworkAdapter resources https://review.opendev.org/c/openstack/sushy/+/813839 | 21:45 |
opendevreview | Manuel Schönlaub proposed openstack/sushy master: Add support for additional network resources. https://review.opendev.org/c/openstack/sushy/+/813850 | 21:45 |
opendevreview | Julia Kreger proposed openstack/ironic master: CI: Fix devstack plugin with RBAC changes https://review.opendev.org/c/openstack/ironic/+/818458 | 22:02 |
TheJulia | now to wait() | 22:04 |
opendevreview | Merged openstack/ironic stable/ussuri: Revert "CI: Get tinyipa build working for CI usage" https://review.opendev.org/c/openstack/ironic/+/818324 | 23:14 |
opendevreview | Julia Kreger proposed openstack/ironic stable/ussuri: CI: Work around tinyipa build issues https://review.opendev.org/c/openstack/ironic/+/818394 | 23:46 |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!