*** gyee has quit IRC | 00:01 | |
*** diurnalist has joined #openstack-ironic | 00:17 | |
*** cdearborn has quit IRC | 00:20 | |
*** stevebaker has joined #openstack-ironic | 00:31 | |
*** Goneri has joined #openstack-ironic | 00:54 | |
*** stevebaker has quit IRC | 01:38 | |
*** tzumainn has quit IRC | 01:40 | |
*** Goneri has quit IRC | 01:48 | |
*** ricolin has joined #openstack-ironic | 02:01 | |
*** early has quit IRC | 02:11 | |
*** rloo has quit IRC | 02:11 | |
*** Lucas_Gray has quit IRC | 02:12 | |
*** early has joined #openstack-ironic | 02:30 | |
*** rcernin has quit IRC | 02:49 | |
*** stevebaker has joined #openstack-ironic | 02:51 | |
*** rcernin has joined #openstack-ironic | 02:54 | |
*** mkrai has joined #openstack-ironic | 02:59 | |
*** rcernin has quit IRC | 03:08 | |
*** Qianbiao has joined #openstack-ironic | 03:16 | |
*** rcernin has joined #openstack-ironic | 03:45 | |
*** rcernin has quit IRC | 03:45 | |
*** rcernin has joined #openstack-ironic | 03:50 | |
*** diurnalist has quit IRC | 05:10 | |
*** Qianbiao has quit IRC | 05:19 | |
*** threestrands has joined #openstack-ironic | 05:27 | |
*** threestrands has quit IRC | 05:33 | |
arne_wiebalck | Good morning, ironic! | 05:39 |
---|---|---|
*** Qianbiao has joined #openstack-ironic | 06:08 | |
*** Qianbiao has quit IRC | 06:29 | |
*** Habib-A92 has joined #openstack-ironic | 06:31 | |
openstackgerrit | Kaifeng Wang proposed openstack/ironic-inspector master: Accept IPv6 link local address during interface validation https://review.opendev.org/736110 | 06:34 |
Habib-A92 | TheJuliathe server had been running for 3 hours in that state before i restarted it in debug mode | 06:39 |
Habib-A92 | do you advise me running it again and waiting more ?! | 06:40 |
Habib-A92 | i had ata erase disabled as the server has 2 7200rpm hdd in raid 1 over hpe controller server model proliant g8 | 06:41 |
Habib-A92 | i couldn't build an image with proliant-tools or it worked and booted it wouldn't get an IP keeps trying v6 which i don't have implemented | 06:42 |
Habib-A92 | so instead i went for disable ata cause it fails erasing and hope that shred package would erase the disk successfully | 06:43 |
*** Qianbiao has joined #openstack-ironic | 06:47 | |
Habib-A | TheJulia :D | 06:48 |
Habib-A | im using tinyipa-stable-train | 06:49 |
*** rpittau|afk is now known as rpittau | 06:56 | |
rpittau | good morning ironic! o/ | 06:57 |
Habib-A | Good morning :D | 06:59 |
dtantsur | morning ironic | 07:07 |
*** diurnalist has joined #openstack-ironic | 07:07 | |
*** mkrai has quit IRC | 07:08 | |
dtantsur | Habib-A: shredding large disks can take VERY long, hours is normal | 07:08 |
rpittau | good morning dtantsur :) | 07:10 |
openstackgerrit | Riccardo Pittau proposed openstack/ironic-python-agent-builder master: Disable automatic updates in dnf-based systems https://review.opendev.org/735335 | 07:11 |
iurygregory | good morning arne_wiebalck rpittau dtantsur and Ironic o/ | 07:21 |
rpittau | hey iurygregory :) | 07:21 |
arne_wiebalck | hey iurygregory o/ | 07:21 |
Habib-A | dtantsur its only 1TB disks i will try again and wait | 07:27 |
iurygregory | only 1TB xd | 07:29 |
iurygregory | this can take some time | 07:29 |
dtantsur | by default it means writing 2TiB of random data and 1TiB of zeroes IIRC | 07:29 |
iurygregory | yeah | 07:30 |
iurygregory | so you can go do other things hehe | 07:30 |
rpittau | Habib-A: for 1TB 3 hours is kind of normal, can be even more | 07:30 |
openstackgerrit | Dmitry Tantsur proposed openstack/ironic master: Fix internal server error on deleting nodes with allocations https://review.opendev.org/736118 | 07:30 |
* dtantsur facepalm ^^ | 07:30 | |
iurygregory | I know at the university in Brazil 2TB took 8hrs | 07:31 |
iurygregory | yay now we will have stable/ussuri green again since the devstack change is merged \o/ | 07:32 |
*** dougsz has joined #openstack-ironic | 07:32 | |
rpittau | yeah, I rechecked one patch in ironic-lib, hopefully it will pass | 07:33 |
iurygregory | rpittau, probably only after our fix is merged in stable/ussuri also | 07:33 |
rpittau | iurygregory: in master ? | 07:34 |
iurygregory | ussuri | 07:34 |
iurygregory | I thought you meant ussuri since it was the branch I mentioned =) | 07:35 |
* iurygregory is waking up | 07:35 | |
rpittau | oh no, it was a general thing as devstack fix is merged, the recheck is in master | 07:35 |
* iurygregory needs a second mug of coffee | 07:36 | |
iurygregory | rpittau, gotcha =) | 07:36 |
*** mkrai has joined #openstack-ironic | 07:36 | |
*** diurnalist has quit IRC | 07:40 | |
rpittau | mmm I'm seeing an 'Invalid or missing agent token received.' in a dib job | 07:41 |
openstackgerrit | Dmitry Tantsur proposed openstack/ironic master: Fix internal server error on deleting nodes with allocations https://review.opendev.org/736118 | 07:44 |
dtantsur | rpittau: maybe https://review.opendev.org/735955 ? | 07:47 |
patchbot | patch 735955 - ironic - Fix agent token and URL handling during fast-track... - 1 patch set | 07:47 |
*** rcernin has quit IRC | 07:47 | |
dtantsur | I need to test it locally though | 07:47 |
rpittau | dtantsur: yeah, might be that, the logs are in the ipmitool converted job here in case https://review.opendev.org/734759 | 07:48 |
patchbot | patch 734759 - ironic - Convert ironic-tempest-ipa-wholedisk-bios-agent_ip... - 7 patch sets | 07:48 |
dtantsur | rpittau: try rebasing on top of my patch? | 07:48 |
rpittau | yep | 07:48 |
openstackgerrit | Riccardo Pittau proposed openstack/ironic master: Convert ironic-tempest-ipa-wholedisk-bios-agent_ipmitool to dib https://review.opendev.org/734759 | 07:52 |
*** mcarden has quit IRC | 08:02 | |
openstackgerrit | Riccardo Pittau proposed openstack/metalsmith master: Use is instead of ambiguous pipe https://review.opendev.org/736124 | 08:04 |
*** lucasagomes has joined #openstack-ironic | 08:05 | |
rpittau | ^^ this should fix the error in the metalsmith jobs we're seeing | 08:06 |
rpittau | 'Missing sudo password' error, ok.... | 08:07 |
openstackgerrit | OpenStack Proposal Bot proposed openstack/ironic-inspector master: Imported Translations from Zanata https://review.opendev.org/736126 | 08:07 |
*** Lucas_Gray has joined #openstack-ironic | 08:24 | |
*** k_mouza has joined #openstack-ironic | 08:31 | |
*** Lucas_Gray has quit IRC | 08:35 | |
*** k_mouza has quit IRC | 08:35 | |
rpittau | gerrit seems particularly slow for me today.... | 08:36 |
openstackgerrit | Riccardo Pittau proposed openstack/ironic master: Fix mock callable for Python 3.6 and precedent https://review.opendev.org/736131 | 08:36 |
*** Lucas_Gray has joined #openstack-ironic | 08:36 | |
openstackgerrit | Merged openstack/ironic-inspector master: Remove cimc_address from address field list https://review.opendev.org/736061 | 08:38 |
*** priteau has joined #openstack-ironic | 08:50 | |
*** Habib-A has quit IRC | 08:51 | |
*** ociuhandu has quit IRC | 08:51 | |
iurygregory | rpittau, same here | 08:51 |
iurygregory | yesterday was slow also =( | 08:51 |
dtantsur | and storyboard too | 08:53 |
iurygregory | ouch =( | 08:56 |
*** tkajinam has quit IRC | 08:57 | |
openstackgerrit | Dmitry Tantsur proposed openstack/ironic master: Networking boot fallback for local boot https://review.opendev.org/734490 | 08:57 |
openstackgerrit | Dmitry Tantsur proposed openstack/ironic master: [WIP] Agent power interface https://review.opendev.org/735591 | 08:57 |
arne_wiebalck | iurygregory, rpittau Could one of you have a look at the (trivial doc) change in https://review.opendev.org/#/c/734806, please? | 09:00 |
patchbot | patch 734806 - ironic - [doc] Fix indentation in admin/troubleshooting - 2 patch sets | 09:00 |
*** Habib-A92 has quit IRC | 09:00 | |
iurygregory | arne_wiebalck, doing now | 09:00 |
arne_wiebalck | iurygregory: thanks! | 09:00 |
iurygregory | nova valid host OMG | 09:00 |
arne_wiebalck | :-D | 09:01 |
arne_wiebalck | (non-intentional) | 09:01 |
* rpittau gives coffee to gerrit | 09:02 | |
*** mkrai has quit IRC | 09:08 | |
*** mkrai_ has joined #openstack-ironic | 09:08 | |
*** mkrai_ has quit IRC | 09:09 | |
*** mkrai has joined #openstack-ironic | 09:09 | |
openstackgerrit | Dmitry Tantsur proposed openstack/ironic master: [WIP] Agent power interface https://review.opendev.org/735591 | 09:10 |
Qianbiao | hello ironic. | 09:38 |
*** yaawang_ has quit IRC | 09:40 | |
*** diurnalist has joined #openstack-ironic | 09:40 | |
openstackgerrit | QianBiao Ng proposed openstack/ironic master: Fix: review from dtantsur of 728123 https://review.opendev.org/735276 | 09:45 |
arne_wiebalck | dtantsur: the 'standalone' option in inspector.conf means there is only a single inspector in the deployment? (I am not clear on what "standalone: Whether to run ironic-inspector as a standalone service." means.) | 09:52 |
arne_wiebalck | dtantsur: this is in the context of the leader election patch | 09:52 |
dtantsur | arne_wiebalck: it's not an ideal name, it rather means API+conductor in the same provess | 09:52 |
dtantsur | * process | 09:52 |
arne_wiebalck | dtantsur: ah, ok | 09:52 |
dtantsur | usually, this is standalone since for an HA deployment we kind of expect the split to be used. but it's likely not mandatory, especially in your case. | 09:53 |
arne_wiebalck | dtantsur: this is why I was confused when kaifeng and you asked me about this the other day | 09:53 |
arne_wiebalck | dtantsur: yeah, we have several standalone inspectors | 09:53 |
arne_wiebalck | dtantsur: :-D | 09:53 |
arne_wiebalck | dtantsur: splitting these is still experimental? | 09:54 |
dtantsur | I guess it is, we haven't fully settled down on AMQP-vs-anything-else | 09:55 |
arne_wiebalck | in standalone, there is no need for messaging, I guess? | 09:55 |
dtantsur | correct | 09:56 |
arne_wiebalck | right, so standalone inspector would also allow for easier removal of amqp from a deployment ... but would then block the way to a non-standalone inspector | 09:58 |
* arne_wiebalck is thinking about trying out json rpc | 09:58 | |
openstackgerrit | Iury Gregory Melo Ferreira proposed openstack/ironic master: Add api-ref for indicators API https://review.opendev.org/732149 | 09:59 |
Qianbiao | rpittau thanks for the review. :) | 10:03 |
rpittau | Qianbiao: yw :) | 10:03 |
Qianbiao | dtantsur you got a minute for https://review.opendev.org/#/c/735276 ? | 10:03 |
patchbot | patch 735276 - ironic - Fix: review from dtantsur of 728123 - 2 patch sets | 10:03 |
* arne_wiebalck just realised the non-standalone mode for the inspector came only with Train ... and are nicely documented :) | 10:06 | |
Qianbiao | is there any ironic client that could visit from mobile? | 10:07 |
Qianbiao | simple web-based client or mobile app. | 10:07 |
iurygregory | something happened to devstack and the logs doesn't show tempest.conf D: or /etc =( | 10:07 |
openstackgerrit | Riccardo Pittau proposed openstack/ironic master: Fix mock callable for Python 3.6 and precedent https://review.opendev.org/736131 | 10:09 |
rpittau | iurygregory: is it actually running tempest ? | 10:09 |
dtantsur | Qianbiao: we have ironic-ui which is a horizon panel. not sure how mobile-friendly it is. | 10:09 |
Qianbiao | dtantsur thanks will have a look at it. | 10:10 |
*** diurnalist has quit IRC | 10:10 | |
iurygregory | rpittau, well https://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_024/727480/5/check/ironic-standalone/024304f/testr_results.html =0 | 10:11 |
iurygregory | =) | 10:11 |
iurygregory | https://zuul.opendev.org/t/openstack/build/024304fb457843aca01d2759eb5a6a81/log/job-output.txt#26060 =( | 10:11 |
iurygregory | some jobs have | 10:11 |
iurygregory | but others dont .-. | 10:11 |
iurygregory | I think something changed | 10:11 |
rpittau | iurygregory: https://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_024/727480/5/check/ironic-standalone/024304f/controller/logs/tempest_conf.txt | 10:12 |
rpittau | ? | 10:12 |
iurygregory | https://review.opendev.org/#/c/735955/ | 10:13 |
patchbot | patch 735955 - ironic - Fix agent token and URL handling during fast-track... - 1 patch set | 10:13 |
iurygregory | this one if you look at standalone doesn't has | 10:13 |
rpittau | there's no ironic-bm-logs either, something else wrong there | 10:14 |
iurygregory | yup | 10:14 |
iurygregory | no ironic-bm-logs no etc | 10:14 |
iurygregory | no tempest.conf | 10:14 |
rpittau | no, I mean, something wrong in ironic | 10:15 |
rpittau | and indeed Jun 17 08:02:36.096098 ubuntu-bionic-vexxhost-ca-ymq-1-0017188447 ironic-conductor[25404]: ERROR ironic.conductor.manager [None req-40bb5c66-6647-48e5-8a45-c255a723c255 None None] Invalid agent_token receieved for node d51d098d-db38-4d77-9b67-806d173034a7 | 10:15 |
rpittau | iurygregory: https://83cd06ba4ab6fcb10ece-e95fa72ee90c44566fe24f9777fa290e.ssl.cf1.rackcdn.com/735955/1/check/ironic-standalone/da4a72a/controller/logs/screen-ir-cond.txt | 10:15 |
rpittau | same issue I saw before, dtantsur patch should fix that hopefully | 10:15 |
*** derekh has joined #openstack-ironic | 10:17 | |
*** yaawang_ has joined #openstack-ironic | 10:17 | |
*** rpittau is now known as rpittau|bbl | 10:18 | |
iurygregory | do you think thats why we are not getting the full logs? | 10:18 |
rpittau|bbl | yeah, I think the node doesn't finish even the first run and it just doesn't log anything, it sounds weird but it might be, I saw it happening in other jobs too | 10:20 |
* rpittau|bbl lunch ttyl | 10:20 | |
iurygregory | humm gotcha | 10:20 |
iurygregory | I asked qa if they know something | 10:20 |
openstackgerrit | Riccardo Pittau proposed openstack/ironic master: Enforce autospec in test_rpc_api and test_steps https://review.opendev.org/734132 | 10:20 |
*** k_mouza has joined #openstack-ironic | 10:20 | |
openstackgerrit | Riccardo Pittau proposed openstack/ironic master: Enforce autospec in test_rpc_api and test_steps https://review.opendev.org/734132 | 10:21 |
openstackgerrit | Merged openstack/ironic-lib master: Use unittest.mock instead of mock https://review.opendev.org/734352 | 10:24 |
openstackgerrit | Merged openstack/ironic master: [doc] Fix indentation in admin/troubleshooting https://review.opendev.org/734806 | 10:24 |
iurygregory | well not only our project is affected | 10:25 |
iurygregory | so something changed that is not in our control hehe | 10:26 |
iurygregory | dtantsur, I noticed that metalsmith-integration-glance-localboot-centos7 is failling quite a lot in stable/ussuri with RETRY_LIMIT | 10:30 |
iurygregory | not quite a lot, but it's falling sorry =( | 10:31 |
dtantsur | iurygregory: maybe the same problem that rpittau|bbl fixed recently? | 10:32 |
* iurygregory looks for the patch | 10:32 | |
iurygregory | https://review.opendev.org/#/c/736124/ ? | 10:33 |
patchbot | patch 736124 - metalsmith - Use is instead of ambiguous pipe - 1 patch set | 10:33 |
dtantsur | yeah | 10:35 |
openstackgerrit | Verification of a change to openstack/tenks failed: CI: multiple fixes https://review.opendev.org/735917 | 10:36 |
iurygregory | sad "that seems to be a general issue, possibly related to the ansible upgrade" =( | 10:39 |
iurygregory | no config files or ipa logs in ironic-bm-logs for us | 10:40 |
openstackgerrit | Merged openstack/metalsmith master: Use is instead of ambiguous pipe https://review.opendev.org/736124 | 10:47 |
openstackgerrit | Iury Gregory Melo Ferreira proposed openstack/metalsmith stable/ussuri: Use is instead of ambiguous pipe https://review.opendev.org/736153 | 10:49 |
*** Lucas_Gray has quit IRC | 10:49 | |
iurygregory | dtantsur, I pushed the backport to stable/ussuri | 10:49 |
*** mkrai has quit IRC | 10:51 | |
*** mkrai_ has joined #openstack-ironic | 10:51 | |
*** derekh has quit IRC | 11:00 | |
*** derekh has joined #openstack-ironic | 11:00 | |
*** k_mouza has quit IRC | 11:04 | |
*** k_mouza has joined #openstack-ironic | 11:08 | |
openstackgerrit | Merged openstack/ironic stable/train: agent: do not hard power off if soft power off actually succeeds https://review.opendev.org/731673 | 11:08 |
openstackgerrit | Merged openstack/ironic-inspector master: Imported Translations from Zanata https://review.opendev.org/736126 | 11:08 |
openstackgerrit | Verification of a change to openstack/tenks failed: CI: multiple fixes https://review.opendev.org/735917 | 11:08 |
*** dougsz has quit IRC | 11:09 | |
*** mkrai_ has quit IRC | 11:10 | |
*** ociuhandu has joined #openstack-ironic | 11:12 | |
dtantsur | iurygregory: thanks, let's see how it goes | 11:14 |
*** dougsz has joined #openstack-ironic | 11:24 | |
openstackgerrit | Dmitry Tantsur proposed openstack/ironic master: [WIP] Fix fast-track with the direct deploy interface https://review.opendev.org/736164 | 11:27 |
dtantsur | TheJulia: moar fast-track fixes ^^^ | 11:27 |
openstackgerrit | Dmitry Tantsur proposed openstack/ironic master: Networking boot fallback for local boot https://review.opendev.org/734490 | 11:30 |
openstackgerrit | Dmitry Tantsur proposed openstack/ironic master: [WIP] Agent power interface https://review.opendev.org/735591 | 11:30 |
*** sshnaidm_ has joined #openstack-ironic | 11:32 | |
*** sshnaidm has quit IRC | 11:33 | |
*** dougsz has quit IRC | 11:35 | |
*** sshnaidm_ is now known as sshnaidm | 11:35 | |
*** mkrai_ has joined #openstack-ironic | 11:42 | |
*** Lucas_Gray has joined #openstack-ironic | 12:02 | |
openstackgerrit | Iury Gregory Melo Ferreira proposed openstack/metalsmith stable/train: Use is instead of ambiguous pipe https://review.opendev.org/736170 | 12:04 |
openstackgerrit | Iury Gregory Melo Ferreira proposed openstack/metalsmith stable/stein: Use is instead of ambiguous pipe https://review.opendev.org/736172 | 12:05 |
*** rpittau|bbl is now known as rpittau | 12:06 | |
*** diurnalist has joined #openstack-ironic | 12:07 | |
*** Lucas_Gray has quit IRC | 12:16 | |
*** Lucas_Gray has joined #openstack-ironic | 12:19 | |
rpittau | I was too optimistic for the ironic-bm-logs missing :( | 12:22 |
*** Wryhder has joined #openstack-ironic | 12:23 | |
iurygregory | rpittau, yup =) | 12:24 |
*** Lucas_Gray has quit IRC | 12:24 | |
iurygregory | now we need to use black magic to debug failures \o/ | 12:24 |
*** Wryhder has quit IRC | 12:28 | |
rpittau | dtantsur: even rebasing on top of your patch I'm still seeing 'Invalid or missing agent token received' | 12:30 |
rpittau | and of course not having the ipa ramdisk logs doesn't really help.... | 12:30 |
dtantsur | ugh | 12:31 |
*** mkrai_ has quit IRC | 12:31 | |
iurygregory | =( | 12:31 |
*** Lucas_Gray has joined #openstack-ironic | 12:32 | |
*** dougsz has joined #openstack-ironic | 12:36 | |
openstackgerrit | Dmitry Tantsur proposed openstack/ironic-python-agent master: Make get_partition_uuids work with whole disk images https://review.opendev.org/736191 | 12:40 |
*** diurnalist has quit IRC | 12:40 | |
dtantsur | "Major events are to remain banned until at least the end of October in Germany", so much for the Summit :( | 12:44 |
rpittau | wow | 12:46 |
rpittau | well it's going to be same here as well probably, still don't know if I will be able to go back to Sardegna this summer... | 12:46 |
TheJulia | dtantsur: where did you hear/red that? | 12:46 |
dtantsur | TheJulia: https://www.thelocal.de/20200617/major-events-to-be-banned-in-germany-until-end-of-october | 12:47 |
dtantsur | rpittau: personal travels should be fine soon | 12:48 |
rpittau | dtantsur: as we say 'bucca tua santa' ~bless your words :) | 12:49 |
iurygregory | dtantsur, they can do the summit in CZ | 12:49 |
dtantsur | lol | 12:49 |
iurygregory | here you can already have events with 2500 people | 12:49 |
dtantsur | well, I'd not mind a summit in Prague or Vienna, really | 12:49 |
iurygregory | =( | 12:49 |
rpittau | depends if CZ accepts foreigners | 12:49 |
iurygregory | rpittau, it does already | 12:49 |
dtantsur | well, I'm not sure how long it will take until EU starts accepting people from the USA, Russia or China | 12:49 |
rpittau | ah cool | 12:50 |
dtantsur | iurygregory: inside EU - yes. for outsiders it's much more complicated. | 12:50 |
iurygregory | depending on the country you need to show the negative test | 12:50 |
TheJulia | well, I'm fairly sure nobody will be allowing folks from the US, so the question then becomes how many people does that cut out of an event? | 12:50 |
dtantsur | TheJulia: minus USA, minus China, minus former USSR, a half would be optimistic | 12:51 |
rpittau | or from China, considering recent events..... | 12:51 |
iurygregory | yeah | 12:51 |
iurygregory | my feeling is that CZ is moving to fast allowing such things (but maybe is just me) | 12:51 |
dtantsur | it probably is | 12:51 |
rpittau | btw good morning TheJulia :D | 12:52 |
dtantsur | and yes, good (heh) morning TheJulia | 12:52 |
TheJulia | good morning | 12:52 |
iurygregory | good morning TheJulia =) | 12:52 |
iurygregory | welcome to the CI without useful logs =) | 12:52 |
TheJulia | seriously? | 12:53 |
dtantsur | logs are overrated *drops the mic and walks out* | 12:53 |
rpittau | until yesterday the logs were there, then a black hole happened | 12:53 |
iurygregory | yup no ironic-bm-logs folder , no /etc folder, no tempest.log | 12:53 |
iurygregory | tks zuul \o/ | 12:54 |
dtantsur | example? | 12:54 |
rpittau | everything looks fine here https://549a2824969dd0dbcdfc-714725c6ff301dc1cc967cdae554d0b2.ssl.cf5.rackcdn.com/731159/2/check/ironic-tempest-ipa-wholedisk-bios-agent_ipmitool-tinyipa/5da04c5/job-output.txt | 12:54 |
rpittau | which is actually from the 15 | 12:54 |
iurygregory | I think the reason is the ansible update they did | 12:54 |
dtantsur | mmm, right, no logs in https://zuul.opendev.org/t/openstack/build/45d730d881484a5fbcc8c1f49a07ee4d/logs | 12:54 |
*** rloo has joined #openstack-ironic | 12:54 | |
rpittau | looks like it's selectively not copying some dirs | 12:55 |
iurygregory | yesterday at 4 UTC I think | 12:55 |
dtantsur | can someone please raise it to #openstack-infra? | 12:55 |
iurygregory | dtantsur, frickler now about the issue | 12:55 |
iurygregory | I talked with him on openstack-qa | 12:55 |
iurygregory | they were talking in #opendev | 12:56 |
dtantsur | mmm, ok | 12:56 |
dtantsur | thank you\ | 12:56 |
* dtantsur desperately tries to make fast-track work | 12:56 | |
iurygregory | in the begin I thought it was something on the devstack-tempest job but no =( | 12:57 |
TheJulia | dtantsur: It did work at some point, what is not working for you now? | 12:57 |
dtantsur | TheJulia: https://review.opendev.org/736164 | 12:58 |
patchbot | patch 736164 - ironic - [WIP] Fix fast-track with the direct deploy interface - 1 patch set | 12:58 |
dtantsur | not sure when and how the issue got introduced, but it's pretty badly broken now | 12:58 |
dtantsur | + that agent URL/token problems from yesterday (I'm past them now) | 12:58 |
rpittau | TheJulia: not sure if it's related, but we're seeing some errors related to the token, like 'Invalid or missing agent token received' | 12:58 |
TheJulia | ugh, I put the partitioning call an hour too early on my calendar | 13:03 |
TheJulia | #couldhavesleptin | 13:03 |
dtantsur | ouch | 13:03 |
rpittau | :/ | 13:03 |
TheJulia | rpittau: older agents with newer ironics? | 13:03 |
rpittau | mmmmm | 13:04 |
rpittau | it's in a recent job | 13:04 |
openstackgerrit | Dmitry Tantsur proposed openstack/ironic master: Networking boot fallback for local boot https://review.opendev.org/734490 | 13:04 |
openstackgerrit | Dmitry Tantsur proposed openstack/ironic master: [WIP] Agent power interface https://review.opendev.org/735591 | 13:04 |
TheJulia | rpittau: got a link | 13:07 |
TheJulia | ? | 13:07 |
rpittau | the image seems to be from yesterday | 13:07 |
rpittau | yeah | 13:07 |
rpittau | TheJulia: conductor logs https://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_b61/734759/8/check/ironic-tempest-ipa-wholedisk-bios-agent_ipmitool/b61a274/controller/logs/screen-ir-cond.txt | 13:07 |
rpittau | we don't have ipa ramdisk logs :/ | 13:08 |
TheJulia | looks like we asked the agent for its logs before that | 13:10 |
TheJulia | then it heartbeated again | 13:10 |
TheJulia | Yeah, we can ignore that it looks like. We were not in fast track so we collected the logs before successfully exiting cleaning | 13:14 |
TheJulia | We went to tear down, but it triggered a heartbeat between tear_down_cleaning and token removal | 13:14 |
TheJulia | hmm | 13:14 |
TheJulia | yup, ignorable | 13:15 |
TheJulia | just looks nasty | 13:15 |
rpittau | ok | 13:17 |
rpittau | without other logs hard to say what went wrong | 13:18 |
rpittau | the only difference is in the ramdisk | 13:18 |
openstackgerrit | Julia Kreger proposed openstack/ironic master: Minor agent token log handling https://review.opendev.org/736214 | 13:20 |
TheJulia | rpittau: ^^^ | 13:20 |
TheJulia | that should make the backtrace disappear | 13:20 |
rpittau | thanks :) | 13:20 |
TheJulia | and then the world will be a happier place with less red herrings | 13:20 |
dtantsur | hmm, my bifrost environment decided to stop PXE booting, lovely | 13:20 |
openstackgerrit | Riccardo Pittau proposed openstack/ironic master: Convert ironic-tempest-ipa-wholedisk-bios-agent_ipmitool to dib https://review.opendev.org/734759 | 13:21 |
TheJulia | dtantsur: well, I can tell you bifrost was not written with irish cream | 13:22 |
TheJulia | so it may be demanding an irish whiskey | 13:23 |
dtantsur | ouch, I only have scotch here :( | 13:23 |
dtantsur | c'mon, boot the freaking kernel finally :( | 13:24 |
dtantsur | the strange thing, I don't know what made it stop booting. it worked like an hour ago. and PXE itself works, it just stops right afterwards.. | 13:24 |
TheJulia | dtantsur: I have vague memorys of having to bounce/restart dnsmasq at some point, maybe it is hung or out of reservations? | 13:26 |
TheJulia | s/reservations/possible leases/ | 13:26 |
gudrutis2 | Hi people | 13:27 |
gudrutis2 | Is there a snippet how to create alembic migration script? | 13:27 |
dtantsur | TheJulia: dnsmasq looks happy :( | 13:29 |
TheJulia | dtantsur: networking in general? | 13:29 |
dtantsur | hard to say. I don't know what it's doing even, it has downloaded IPA alright | 13:29 |
TheJulia | gudrutis2: One an do it manually if one knows the style and the head point but generally there is alembic helper utility to create the skeleton | 13:29 |
TheJulia | dtantsur: so the ramdisk is booting? | 13:30 |
TheJulia | gudrutis2: sadly, and I suspect this is the case for all of us long time ironic devs... we change the db model so rarely that we surely have to look it up completely every single time | 13:30 |
dtantsur | TheJulia: maybe? it stopped right after iPXE and stays there for tens of minutes already | 13:30 |
dtantsur | gudrutis2: https://docs.openstack.org/ironic-inspector/latest/contributor/#making-changes-to-the-database | 13:31 |
TheJulia | dtantsur: is console=ttyS0 in the pxe command line? | 13:31 |
TheJulia | \o/ | 13:31 |
dtantsur | TheJulia: I haven't changed anything recently, so should be (will double check) | 13:31 |
TheJulia | irccloud != vim | 13:31 |
dtantsur | yeah, it's there | 13:32 |
* dtantsur tries again | 13:33 | |
*** diurnalist has joined #openstack-ironic | 13:33 | |
TheJulia | corrupt kernel/ramdisk? | 13:38 |
TheJulia | I guess that is a risk if you re-ran a complete install and maybe grabbed an inflight copy on a mirror | 13:38 |
TheJulia | plus side of breaking tests you wrote in the previous retry patch. your tests are easy to fix! | 13:39 |
*** rpittau is now known as rpittau|brb | 13:39 | |
dtantsur | I didn't reinstall, only updated the ironic source... | 13:39 |
dtantsur | oh, which tests are you talking about? :) | 13:39 |
*** priteau has quit IRC | 13:40 | |
*** ricolin has quit IRC | 13:40 | |
TheJulia | dtantsur: well, further enhancing mid stream download failure retries | 13:40 |
TheJulia | so if a major break kills the download, we will completely retry | 13:40 |
dtantsur | ah, right | 13:40 |
dtantsur | yeah, I remember now. sorry, my brain is overloaded with this discovery+fast-track+agent-power thing | 13:41 |
TheJulia | no worries | 13:41 |
TheJulia | no worries, I think this should take care of the downstream retry headaches even though I'm pushing back on lacp it should all help the agent navigate hard breaks that last the period of port hold-downs | 13:42 |
*** tzumainn has joined #openstack-ironic | 13:43 | |
openstackgerrit | Merged openstack/metalsmith stable/ussuri: Use is instead of ambiguous pipe https://review.opendev.org/736153 | 13:45 |
gudrutis2 | TheJulia: yep, I found the utility, and it generated the script and ... It would have been more useful to clone and modify existing script because it just generated an empty body :) | 13:45 |
TheJulia | gudrutis2: the key is the positional data at the top of the migration script though :) | 13:46 |
dtantsur | gudrutis2: there is some gotcha there | 13:46 |
dtantsur | like, you need to do 'upgrade', then apply your change to models, then generate the migration | 13:46 |
dtantsur | if you run upgrade *after* modifying models, you'll get an empty migration | 13:46 |
dtantsur | or something like that | 13:46 |
TheJulia | I think there is yet another caveat, but it has been so long that I simply don't remember anymore | 13:47 |
TheJulia | (shows how often I touch our data models) | 13:48 |
gudrutis2 | well I am following this tutorial https://alembic.sqlalchemy.org/en/latest/tutorial.html | 13:48 |
gudrutis2 | I will mess around and see if I will corupt my testack DB or not :) | 13:49 |
TheJulia | easy enough to recreate if you do | 13:49 |
tzumainn | hi! I have a question about a one-line change in the database layer - https://review.opendev.org/#/c/730366/2 - which allows ports to be seen not only by node owners, but also node lessees | 13:50 |
patchbot | patch 730366 - ironic - Allow node lessee to see node's ports - 2 patch sets | 13:50 |
TheJulia | speaking of databases! | 13:50 |
gudrutis2 | :D | 13:50 |
tzumainn | the change updates a filter called add_port_filter_by_node_owner - so my question would be - should I change the name of the filter function? | 13:50 |
tzumainn | or should I create a new one? | 13:51 |
tzumainn | also the change means that a bunch of functions going up to the API layer is no longer filtering by owner, but filtering by project, which would then match owner or lessee | 13:51 |
tzumainn | can I change the name of the parameter being used in those functions from owner to project, or do I have to add a new parameter alongside owner? | 13:52 |
*** rpittau|brb is now known as rpittau | 13:53 | |
*** priteau has joined #openstack-ironic | 13:56 | |
*** mkrai has joined #openstack-ironic | 13:59 | |
TheJulia | likely new parameter and method, I think | 13:59 |
tzumainn | TheJulia, that makes sense the more I think about it - thanks! | 14:00 |
dtantsur | JayF: hey, joining the partitioning discussion? | 14:01 |
openstackgerrit | Julia Kreger proposed openstack/ironic-python-agent master: Add full download retries https://review.opendev.org/736065 | 14:02 |
openstackgerrit | Merged openstack/ironic-inspector master: Accept IPv6 link local address during interface validation https://review.opendev.org/736110 | 14:08 |
openstackgerrit | Shivanand Tendulker proposed openstack/ironic master: Adds boot mode support to iLO management interface https://review.opendev.org/736232 | 14:15 |
*** rh-jelabarre has joined #openstack-ironic | 14:30 | |
*** jovial[m] has joined #openstack-ironic | 14:34 | |
openstackgerrit | Dmitry Tantsur proposed openstack/ironic-inspector stable/ussuri: Accept IPv6 link local address during interface validation https://review.opendev.org/736244 | 14:45 |
openstackgerrit | Dmitry Tantsur proposed openstack/ironic-inspector stable/train: Accept IPv6 link local address during interface validation https://review.opendev.org/736245 | 14:46 |
openstackgerrit | Mark Goddard proposed openstack/tenks stable/1.0: CI: multiple fixes https://review.opendev.org/735917 | 14:53 |
openstackgerrit | Mark Goddard proposed openstack/tenks master: WIP: test CI https://review.opendev.org/736249 | 14:54 |
*** Goneri has joined #openstack-ironic | 14:57 | |
JayF | dtantsur: Letting zer0c00l lead the way on this one; but I should be active in reviews once specs are up. I know just enough about our downstream use cases and current upstream support to be dangerous :) | 15:11 |
dtantsur | :D | 15:11 |
dtantsur | you can check the etherpad to see where it's going | 15:11 |
JayF | I have been :D | 15:11 |
openstackgerrit | Merged openstack/metalsmith stable/stein: Use is instead of ambiguous pipe https://review.opendev.org/736172 | 15:12 |
JayF | You should know by now I'm getting to professional-levels of lurking :D | 15:12 |
*** Lucas_Gray has quit IRC | 15:12 | |
dtantsur | indeed :) | 15:12 |
dtantsur | rloo: it seems that we can support preseed with more or less the same code, which solves the problem of supporting non-RH systems (at least some of them) | 15:13 |
JayF | That's basically my only concern ^... although I'll note in reality, kickstart is 100x better than any other product for automated OS installs | 15:14 |
JayF | so while it's good to be generic (and I want to advocate for that), admittedly the reality is that may not be actually super useful | 15:14 |
dtantsur | right | 15:14 |
rpittau | I took the liberty to add an Advanced Partitioning entry under Priorities in the Ironic whiteboard | 15:17 |
rpittau | L392 | 15:17 |
TheJulia | rpittau: thanks | 15:17 |
*** sshnaidm is now known as sshnaidm|bbl | 15:17 | |
TheJulia | fwiw, if we ever have a service that does super advanced configs, I believe glitter may be required | 15:18 |
JayF | is that a utility, or are you referring to the infectious crafting material? | 15:19 |
TheJulia | infectious crafting material | 15:19 |
JayF | [nope] | 15:19 |
dtantsur | heh | 15:19 |
rpittau | like...? https://media.giphy.com/media/xTiTnEHBh7qapyuvwQ/giphy.gif | 15:20 |
dtantsur | :D | 15:21 |
rloo | dtantsur: ++ i think supporting kickstart and preseed (and others in the future probably?) with similar interface/mechanism would be good. | 15:21 |
rloo | moar drivers/interfaces! | 15:21 |
dtantsur | well, I haven't done the driver composition reform for nothing ;) | 15:22 |
dtantsur | I still wonder if we should permit the users to change the deploy interface somehow.. | 15:22 |
TheJulia | https://usercontent.irccloud-cdn.com/file/UJaGWALX/glitter.gif | 15:26 |
rpittau | wow | 15:26 |
JayF | dtantsur: I was thinking, maybe more like let glance metadata (or some external method for standalone) help dictate the deploy interface / deploy interface settings | 15:28 |
NobodyCam | I like the glitterBoots | 15:28 |
NobodyCam | nd OOFC Good Morning all | 15:28 |
JayF | dtantsur: booting into an image that's tagged:is_ramdisk? Then use ramdisk driver, same for "kickstart" or "preseed", etc | 15:28 |
* JayF doesn't think glance calls it tags? Maybe metadata? | 15:29 | |
TheJulia | dtantsur: I keep wondering that.... | 15:29 |
TheJulia | metadata I believe | 15:29 |
TheJulia | For non-openstack users I guess they would stsill have to change the drivers, but I suspect that is somewhere in the neighborhood of perfectly okay | 15:29 |
TheJulia | NobodyCam: I wanted it to color it like pixie boots, but the editor didn't listen and... *shrugs* | 15:31 |
TheJulia | for a 30 second amusement, it is not bad :) | 15:31 |
JayF | we may now have a :pixieglitter: in VzM slack | 15:32 |
dtantsur | TheJulia: I'm thinking of including deploy_interface to a post-MVP iteration of the deployment API (re standalone users) | 15:36 |
JayF | only thing that gets awkward about that, is unless you change data model (currentDeployInterface vs defaultDeployInterface) you can make deployments to a node inconsistent based on what was previously used to deploy them | 15:38 |
JayF | e.g. I have a saved script that calls deployment API without deploy interface, run it, it works. Someone else does a deploy, changes the deploy interface. Now my previous tested-working script broke, despite me using the API identically. | 15:39 |
dtantsur | JayF: I was thinking about instance_info/deploy_interface that overrides node.deploy_interface (I've already done a similar thing with root_device) | 15:39 |
dtantsur | (loading drivers will get funny at this point, of course) | 15:39 |
JayF | that makes a lot of sense +1 | 15:40 |
openstackgerrit | Tzu-Mainn Chen proposed openstack/ironic master: Allow node lessee to see node's ports https://review.opendev.org/730366 | 15:48 |
NobodyCam | TheJulia: I like it! | 15:54 |
openstackgerrit | Merged openstack/ironic-inspector master: CI: make grenade voting again https://review.opendev.org/735579 | 15:57 |
*** gyee has joined #openstack-ironic | 15:58 | |
*** lucasagomes has quit IRC | 16:01 | |
openstackgerrit | Julia Kreger proposed openstack/ironic-python-agent master: Add timeout operations to try and prevent hang on read() https://review.opendev.org/734709 | 16:02 |
openstackgerrit | Julia Kreger proposed openstack/ironic-python-agent master: Add full download retries https://review.opendev.org/736065 | 16:04 |
*** dtantsur is now known as dtantsur|afk | 16:12 | |
dtantsur|afk | o/ | 16:12 |
rpittau | bye everyone! o/ | 16:17 |
*** rpittau is now known as rpittau|afk | 16:17 | |
TheJulia | goodnigth | 16:17 |
*** mkrai has quit IRC | 16:18 | |
TheJulia | dtantsur|afk: for tomorrow, those download retry patches are goign to be tried out by our field folks in that environment they are fighting with. | 16:21 |
arne_wiebalck | bye everyone o/ | 16:23 |
*** Qianbiao has quit IRC | 16:32 | |
*** dougsz has quit IRC | 16:34 | |
*** ociuhandu_ has joined #openstack-ironic | 16:38 | |
*** ociuhandu has quit IRC | 16:42 | |
*** ociuhandu_ has quit IRC | 16:43 | |
*** ociuhandu has joined #openstack-ironic | 16:47 | |
iurygregory | finally zuul gave +1 in the backport to fix stable/ussuri \o/ | 16:48 |
TheJulia | woot | 16:50 |
*** ociuhandu has quit IRC | 16:51 | |
*** uzumaki has joined #openstack-ironic | 16:54 | |
*** derekh has quit IRC | 17:01 | |
*** k_mouza has quit IRC | 17:16 | |
*** k_mouza has joined #openstack-ironic | 17:16 | |
*** k_mouza has quit IRC | 17:21 | |
openstackgerrit | Julia Kreger proposed openstack/ironic master: iPXE ISO Ramdisk booting https://review.opendev.org/729464 | 17:33 |
openstackgerrit | Verification of a change to openstack/ironic-inspector failed: Accept IPv6 link local address during interface validation https://review.opendev.org/736244 | 18:00 |
*** naved001 has joined #openstack-ironic | 18:25 | |
TheJulia | neat hostname :) | 18:41 |
*** diurnalist has quit IRC | 19:00 | |
*** sshnaidm|bbl is now known as sshnaidm | 19:09 | |
*** eliaswimmer has quit IRC | 19:09 | |
*** eliaswimmer has joined #openstack-ironic | 19:13 | |
openstackgerrit | Merged openstack/bifrost master: Migrate pip_install.yml to a new role bifrost-pip-install https://review.opendev.org/735461 | 19:28 |
*** diurnalist has joined #openstack-ironic | 19:30 | |
openstackgerrit | Merged openstack/ironic stable/ussuri: devstack: Use uwsgi binary from path; temporary disable grenade https://review.opendev.org/736013 | 19:38 |
iurygregory | \o/ | 19:39 |
*** ociuhandu has joined #openstack-ironic | 19:52 | |
*** pas-ha_ has joined #openstack-ironic | 20:11 | |
*** Lucas_Gray has joined #openstack-ironic | 20:11 | |
*** mbuil_ has joined #openstack-ironic | 20:13 | |
*** gyee has quit IRC | 20:17 | |
*** cp-- has joined #openstack-ironic | 20:18 | |
*** irclogbot_2 has quit IRC | 20:18 | |
*** bfournie has quit IRC | 20:18 | |
*** mbuil has quit IRC | 20:18 | |
*** pas-ha has quit IRC | 20:18 | |
*** buhman has quit IRC | 20:18 | |
*** mgoddard has quit IRC | 20:18 | |
*** dtruong has quit IRC | 20:18 | |
*** cp- has quit IRC | 20:18 | |
*** JayF has quit IRC | 20:18 | |
*** zer0c00l has quit IRC | 20:18 | |
*** pas-ha_ is now known as pas-ha | 20:18 | |
*** dtruong has joined #openstack-ironic | 20:19 | |
*** irclogbot_2 has joined #openstack-ironic | 20:21 | |
*** mgoddard has joined #openstack-ironic | 20:21 | |
*** buhman has joined #openstack-ironic | 20:23 | |
openstackgerrit | Merged openstack/ironic-inspector stable/train: Accept IPv6 link local address during interface validation https://review.opendev.org/736245 | 20:26 |
*** gyee has joined #openstack-ironic | 20:31 | |
*** ildikov has quit IRC | 20:35 | |
*** pas-ha has quit IRC | 20:35 | |
*** rpioso has quit IRC | 20:38 | |
*** tonyb[m] has quit IRC | 20:43 | |
openstackgerrit | Julia Kreger proposed openstack/ironic-tempest-plugin master: Ramdisk iso boot tempest scenario test https://review.opendev.org/736378 | 20:47 |
*** ociuhandu has quit IRC | 20:48 | |
*** PrinzElvis has quit IRC | 20:49 | |
*** priteau has quit IRC | 20:49 | |
*** PrinzElvis has joined #openstack-ironic | 20:52 | |
*** PrinzElvis has quit IRC | 20:57 | |
*** JasonF has joined #openstack-ironic | 21:06 | |
*** JasonF is now known as JayF | 21:06 | |
*** diurnalist has quit IRC | 21:06 | |
*** diurnalist has joined #openstack-ironic | 21:17 | |
*** ociuhandu has joined #openstack-ironic | 21:19 | |
openstackgerrit | Julia Kreger proposed openstack/ironic master: ISO ramdisk virtual media test enablement https://review.opendev.org/736383 | 21:22 |
*** ociuhandu has quit IRC | 21:24 | |
*** rh-jelabarre has quit IRC | 21:24 | |
* TheJulia hopes that was enough but will take a long time to get through initial CI | 21:24 | |
*** ildikov has joined #openstack-ironic | 21:33 | |
*** pas-ha has joined #openstack-ironic | 21:34 | |
*** PrinzElvis has joined #openstack-ironic | 21:35 | |
openstackgerrit | Steve Baker proposed openstack/ironic master: Enable HTTP Basic authentication for JSON-RPC https://review.opendev.org/735757 | 21:36 |
*** rpioso has joined #openstack-ironic | 21:37 | |
*** tonyb[m] has joined #openstack-ironic | 21:38 | |
*** k_mouza has joined #openstack-ironic | 21:45 | |
stevebaker | TheJulia: hey I notice the ironic-standalone devstack job still uses keystone. Should I look at switching that to http_basic, at least for the json-rpc calls? | 21:45 |
TheJulia | stevebaker: I'm afraid that the tempest suite is heavily baked into the ci jobs for that | 21:47 |
stevebaker | TheJulia: yeah but maybe json-rpc is sufficiently internal to not make a difference to tempest | 21:48 |
*** k_mouza has quit IRC | 21:49 | |
TheJulia | oh, for jsonrpc. I guess that is doable | 21:50 |
TheJulia | that would make a lot of sense actually | 21:50 |
TheJulia | I wasn't just thinking json-rpc | 21:50 |
stevebaker | TheJulia: yeah API would be nice, but tempest issues aside, glance would still need keystone. I could take a look at what it would take for tempest to use file:// based images, then we could maybe switch off glance and swift? | 21:53 |
openstackgerrit | Julia Kreger proposed openstack/ironic-python-agent master: Extend retry interval to 30 seconds https://review.opendev.org/736390 | 21:54 |
TheJulia | I was just actually looking at that and I put up a patch to just pass a URL. Lets see if it works! | 21:54 |
TheJulia | #popcorn | 21:54 |
stevebaker | woop woop | 21:54 |
TheJulia | https://zuul.opendev.org/t/openstack/stream/ba4df76c875043e4b11753cf862193e3?logfile=console.log | 21:55 |
openstackgerrit | Vladyslav Drok proposed openstack/ironic master: Stop allocating double space for raw images https://review.opendev.org/736391 | 22:02 |
*** mrda has quit IRC | 22:27 | |
*** mrda has joined #openstack-ironic | 22:30 | |
stevebaker | TheJulia: only one test failed | 22:41 |
*** rcernin has joined #openstack-ironic | 22:42 | |
TheJulia | \o/ | 22:50 |
TheJulia | hmm... the tests skipped :\ | 22:51 |
*** seongsoocho has joined #openstack-ironic | 22:51 | |
*** gyee has quit IRC | 22:52 | |
openstackgerrit | Steve Baker proposed openstack/ironic master: devstack json-rpc, use http basic auth https://review.opendev.org/736398 | 22:53 |
*** tkajinam has joined #openstack-ironic | 22:54 | |
*** Lucas_Gray has quit IRC | 23:07 | |
*** hoonetorg has quit IRC | 23:10 | |
openstackgerrit | Verification of a change to openstack/ironic failed: devstack: Use uwsgi binary from path; temporary disable grenade https://review.opendev.org/736015 | 23:20 |
*** Lucas_Gray has joined #openstack-ironic | 23:22 | |
*** hoonetorg has joined #openstack-ironic | 23:23 | |
*** diurnalist has quit IRC | 23:30 |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!