| janders | TheJulia regarding the kexec question I'm looking at https://docs.openstack.org/ironic/latest/admin/node-deployment.html#node-deployment-deploy-steps | 00:11 |
|---|---|---|
| janders | just conceptually I suppose there could be "deploy.kexec_instance_kernel (priority 25)" which is disabled by default. | 00:12 |
| janders | is that what you're thinking? | 00:12 |
| openstackgerrit | Jacob Anders proposed openstack/bifrost master: Add ansible collections symlink to .gitignore https://review.opendev.org/743125 | 00:19 |
| openstackgerrit | Jacob Anders proposed openstack/bifrost master: Add ansible collections symlink to .gitignore https://review.opendev.org/743125 | 00:22 |
| openstackgerrit | Jacob Anders proposed openstack/bifrost master: Add ansible collections symlink to .gitignore https://review.opendev.org/743125 | 00:23 |
| TheJulia | janders: I started wondering that, but what I ultimately want is dynamic selection if there is heartbeating when we hit deploy.deploy | 00:25 |
| TheJulia | which makes me think why not both | 00:25 |
| TheJulia | And I quickly mentally think we reach https://imgur.com/gallery/IP73r | 00:26 |
| janders | :) | 00:26 |
| janders | dynamic as in determining whether we kexec or not when the provisioning request comes in? | 00:28 |
| janders | (just making sure I'm getting this right) | 00:29 |
| *** Lucas_Gray has joined #openstack-ironic | 00:33 | |
| *** bfournie has joined #openstack-ironic | 00:42 | |
| *** dsneddon has quit IRC | 01:08 | |
| *** yaawang has quit IRC | 01:27 | |
| *** yaawang has joined #openstack-ironic | 01:28 | |
| *** Goneri has quit IRC | 01:49 | |
| *** Goneri has joined #openstack-ironic | 01:50 | |
| *** Goneri has quit IRC | 01:50 | |
| *** Goneri has joined #openstack-ironic | 01:59 | |
| *** Goneri has quit IRC | 01:59 | |
| openstackgerrit | Jacob Anders proposed openstack/bifrost master: Add ansible collections symlink to .gitignore https://review.opendev.org/743125 | 02:00 |
| janders | sorry about the noise :) | 02:01 |
| *** Goneri has joined #openstack-ironic | 02:02 | |
| *** Goneri has quit IRC | 02:02 | |
| *** Goneri has joined #openstack-ironic | 02:04 | |
| *** yaawang has quit IRC | 02:10 | |
| *** yaawang has joined #openstack-ironic | 02:11 | |
| *** yaawang has quit IRC | 02:18 | |
| *** yaawang has joined #openstack-ironic | 02:19 | |
| *** Goneri has quit IRC | 02:20 | |
| *** Goneri has joined #openstack-ironic | 02:23 | |
| *** Lucas_Gray has quit IRC | 02:25 | |
| *** yaawang has quit IRC | 02:27 | |
| *** Goneri has quit IRC | 02:31 | |
| *** rcernin has quit IRC | 02:31 | |
| *** yaawang has joined #openstack-ironic | 02:37 | |
| janders | stevebaker do you know an easy way to recover a node from clean failed state in standalone ironic? | 02:38 |
| *** rcernin has joined #openstack-ironic | 02:40 | |
| *** rcernin has quit IRC | 02:40 | |
| *** rcernin has joined #openstack-ironic | 02:41 | |
| janders | stevebaker got it, disregard :) | 02:42 |
| *** yaawang has quit IRC | 02:57 | |
| *** yaawang has joined #openstack-ironic | 03:02 | |
| *** mkrai has joined #openstack-ironic | 03:14 | |
| *** ricolin has joined #openstack-ironic | 03:41 | |
| *** mkrai has quit IRC | 03:44 | |
| *** fdegir2 has joined #openstack-ironic | 03:48 | |
| *** fdegir has quit IRC | 03:49 | |
| *** mkrai has joined #openstack-ironic | 04:09 | |
| *** mrda has quit IRC | 04:37 | |
| *** mrda has joined #openstack-ironic | 04:38 | |
| *** uzumaki has joined #openstack-ironic | 04:45 | |
| *** Goneri has joined #openstack-ironic | 04:52 | |
| *** Goneri has quit IRC | 05:03 | |
| *** abdysn has joined #openstack-ironic | 05:14 | |
| *** Goneri has joined #openstack-ironic | 05:16 | |
| *** Goneri has quit IRC | 05:22 | |
| *** Goneri has joined #openstack-ironic | 05:23 | |
| *** Goneri has quit IRC | 05:30 | |
| *** Goneri has joined #openstack-ironic | 05:32 | |
| *** Goneri has quit IRC | 05:34 | |
| *** Goneri has joined #openstack-ironic | 05:37 | |
| *** dsneddon has joined #openstack-ironic | 05:41 | |
| openstackgerrit | Merged openstack/ironic master: Enforce autospec in some api tests https://review.opendev.org/741468 | 05:43 |
| *** Goneri has quit IRC | 05:43 | |
| *** yaawang has quit IRC | 05:44 | |
| *** yaawang has joined #openstack-ironic | 05:44 | |
| *** Goneri has joined #openstack-ironic | 05:46 | |
| *** dsneddon has quit IRC | 05:47 | |
| *** rcernin has quit IRC | 05:50 | |
| *** rcernin has joined #openstack-ironic | 05:52 | |
| *** mkrai_ has joined #openstack-ironic | 05:58 | |
| *** mkrai has quit IRC | 06:01 | |
| *** uzumaki has quit IRC | 06:11 | |
| *** uzumaki has joined #openstack-ironic | 06:11 | |
| *** rcernin has quit IRC | 06:21 | |
| *** rcernin has joined #openstack-ironic | 06:22 | |
| *** Goneri has quit IRC | 06:26 | |
| arne_wiebalck | Good morning, ironic! | 06:41 |
| openstackgerrit | vinay kumar muddu proposed openstack/ironic master: Decouple the ISO creation logic from redfish https://review.opendev.org/739174 | 06:44 |
| *** Goneri has joined #openstack-ironic | 06:59 | |
| *** yaawang has quit IRC | 07:10 | |
| *** yaawang has joined #openstack-ironic | 07:12 | |
| *** mkrai_ has quit IRC | 07:12 | |
| openstackgerrit | Merged openstack/ironic-python-agent master: More refactoring of the image module https://review.opendev.org/742110 | 07:15 |
| iurygregory | good morning arne_wiebalck and Ironic! | 07:21 |
| janders | good morning Ironic o/ | 07:26 |
| janders | how was your weekend arne_wiebalck iurygregory ? | 07:26 |
| *** rcernin has quit IRC | 07:28 | |
| *** Goneri has quit IRC | 07:35 | |
| iurygregory | good morning janders o/ | 07:41 |
| iurygregory | it was ok, I was able to get some rest | 07:41 |
| janders | that's great to hear, same here | 07:42 |
| *** ricolin has quit IRC | 07:43 | |
| janders | we went for a bit of a hike on Sunday with my wife which made me realise there is some good mountainbike trails here as well | 07:43 |
| iurygregory | that's awesome | 07:44 |
| janders | fixed up my bike after 6 months of forced inactivity due to bushfires and then covid, if the new tyres hold pressure overnight I can pop out for a quick ride tomorrow | 07:44 |
| iurygregory | good luck =) | 07:45 |
| janders | thanks! :) | 07:45 |
| janders | some hard engineering for a change | 07:45 |
| iurygregory | hehehe | 07:45 |
| janders | now back to software engineering - much easier on my hands :) | 07:45 |
| iurygregory | https://review.opendev.org/#/c/743125/ this is just so avoid having git status to show the files right ? | 07:46 |
| patchbot | patch 743125 - bifrost - Add ansible collections symlink to .gitignore - 4 patch sets | 07:46 |
| janders | correct | 07:46 |
| janders | I forgot about adding the symlink to gitignore | 07:46 |
| iurygregory | no worries | 07:46 |
| janders | I'm now working on https://storyboard.openstack.org/#!/story/1618014 so I put my name on it so that others know | 07:48 |
| iurygregory | cool | 07:48 |
| janders | do I need to switch it to in progress somewhere or is this sufficient? | 07:48 |
| *** ociuhandu has joined #openstack-ironic | 07:49 | |
| iurygregory | you can change to In Progress so people will know you started working | 07:50 |
| janders | "Progress" is Storyboard's term for "In Progress" right? | 07:51 |
| * iurygregory checks | 07:52 | |
| iurygregory | Yeah | 07:52 |
| janders | thank you iurygregory | 07:53 |
| iurygregory | yw | 07:53 |
| janders | I was guessing it is but could be some time tracking thing (thinking Jira) | 07:53 |
| janders | all good now | 07:54 |
| iurygregory | =) | 07:56 |
| *** lucasagomes has joined #openstack-ironic | 07:58 | |
| *** yaawang has quit IRC | 08:00 | |
| *** yaawang has joined #openstack-ironic | 08:01 | |
| *** alexmcleod has joined #openstack-ironic | 08:03 | |
| arne_wiebalck | hey iurygregory janders o/ | 08:04 |
| * arne_wiebalck just left his morning meetings | 08:04 | |
| *** vmud213 has joined #openstack-ironic | 08:04 | |
| iurygregory | arne_wiebalck, o/ | 08:05 |
| *** dtantsur|afk is now known as dtantsur | 08:05 | |
| *** uzumaki has quit IRC | 08:07 | |
| dtantsur | morning ironic | 08:07 |
| dtantsur | I've realized that my attempts to fix HTTP basic auth in Bifrost were probably misguided. Back to the drawing board :( | 08:08 |
| vmud213 | Morning Ironic, dtantsur | 08:09 |
| iurygregory | morning dtantsur | 08:09 |
| dtantsur | iurygregory, morning, if you have a minute this morning: https://review.opendev.org/#/c/742203/ | 08:10 |
| patchbot | patch 742203 - bifrost - Use random passwords by default - 13 patch sets | 08:10 |
| iurygregory | dtantsur, sure! | 08:10 |
| *** uzumaki has joined #openstack-ironic | 08:13 | |
| openstackgerrit | Dmitry Tantsur proposed openstack/bifrost master: [WIP] Support HTTP basic auth and switch bifrost-cli to it https://review.opendev.org/741964 | 08:14 |
| dtantsur | iurygregory: do we have support for source installation of collections? | 08:15 |
| iurygregory | dtantsur, well you can update the requirements.yml | 08:17 |
| iurygregory | https://docs.ansible.com/ansible/latest/user_guide/collections_using.html#install-multiple-collections-with-a-requirements-file | 08:18 |
| dtantsur | iurygregory: what I mean is: if we have a source code of the collection in zuul, use it instead of galaxy | 08:18 |
| janders | good morning dtantsur | 08:18 |
| dtantsur | I can take a look at it, just asking if you have any ideas already | 08:19 |
| dtantsur | good evening janders :) | 08:19 |
| iurygregory | I don't think so .-. | 08:19 |
| dtantsur | okay, `cp -r` it is :) | 08:20 |
| iurygregory | hehehe | 08:21 |
| openstackgerrit | vinay kumar muddu proposed openstack/ironic master: Allow HttpImageService to accept custom certificate https://review.opendev.org/742936 | 08:24 |
| openstackgerrit | vinay kumar muddu proposed openstack/ironic master: Allow HttpImageService to accept custom certificate https://review.opendev.org/742936 | 08:27 |
| *** dougsz has joined #openstack-ironic | 08:28 | |
| *** yaawang has quit IRC | 08:29 | |
| *** yaawang has joined #openstack-ironic | 08:30 | |
| *** rcernin has joined #openstack-ironic | 08:30 | |
| *** rpittau has joined #openstack-ironic | 08:31 | |
| rpittau | good morning ironic! o/ | 08:32 |
| janders | good morning rpittau o/ | 08:34 |
| *** mkrai has joined #openstack-ironic | 08:34 | |
| rpittau | hey janders :) | 08:34 |
| *** rcernin has quit IRC | 08:35 | |
| iurygregory | dtantsur, we broke tripleO | 08:35 |
| iurygregory | good morning rpittau | 08:35 |
| *** yaawang has quit IRC | 08:36 | |
| iurygregory | `got an unexpected keyword argument 'hash_function' (HTTP 500)` | 08:36 |
| janders | does broken tripleO become a tripleX? :) | 08:36 |
| akahat | dtantsur, this is the log: https://06d1312bb3be444c75a6-5c39bede91061630f9efbbd6c20220a5.ssl.cf1.rackcdn.com/723876/14/check/tripleo-ci-centos-8-scenario012-standalone/d602a64/job-output.txt | 08:37 |
| dtantsur | akahat, iurygregory, please update your tooz | 08:38 |
| *** yaawang has joined #openstack-ironic | 08:38 | |
| iurygregory | aha | 08:38 |
| iurygregory | but it should grab tooz from the ironic requirements no? | 08:38 |
| rpittau | hey iurygregory :) | 08:39 |
| rpittau | oh wow it seems I lost the last 2 days logs :/ | 08:40 |
| *** fdegir2 is now known as fdegir | 08:40 | |
| openstackgerrit | Dmitry Tantsur proposed openstack/bifrost master: Support installing the openstack collection from a local location https://review.opendev.org/743167 | 08:45 |
| openstackgerrit | vinay kumar muddu proposed openstack/ironic master: Decouple the ISO creation logic from redfish https://review.opendev.org/739174 | 08:48 |
| *** derekh has joined #openstack-ironic | 08:48 | |
| rpittau | is it me or the ipa tempest jobs are failing a lot in ussuri ? | 09:06 |
| openstackgerrit | Dmitry Tantsur proposed openstack/bifrost master: [WIP] dynamic roles: consolidate auth parameters in one place https://review.opendev.org/743169 | 09:07 |
| gudrutis0 | hi ironic o/ | 09:08 |
| *** Lucas_Gray has joined #openstack-ironic | 09:10 | |
| iurygregory | dtantsur, reviewed =) | 09:13 |
| *** Lucas_Gray has quit IRC | 09:16 | |
| dtantsur | thx! | 09:16 |
| gudrutis0 | Can someone explain what this test does and what is wrong with it? https://zuul.opendev.org/t/openstack/build/9bbaef19f39a417398b0417d1f5b2631 | 09:23 |
| gudrutis0 | also how to debug it | 09:23 |
| gudrutis0 | dtantsur: can you review my patch in general ? https://review.opendev.org/#/c/731794/ | 09:23 |
| patchbot | patch 731794 - ironic-inspector - More flexible definitions of conditions in rules - 7 patch sets | 09:23 |
| *** rcernin has joined #openstack-ironic | 09:25 | |
| *** rcernin has quit IRC | 09:30 | |
| dtantsur | I'll add to my queue | 09:31 |
| dtantsur | gudrutis0: re test: inspection timeout may be a transient problem, it seems like that in your case: https://zuul.opendev.org/t/openstack/build/9bbaef19f39a417398b0417d1f5b2631/log/controller/logs/ironic-bm-logs/node-1_console_2020-07-24-16:27:39_log.txt | 09:33 |
| rpittau | dtantsur: I'm not sure it's just my feeling, but I'm seeing a lot of timeout errors in ironic-inspector and ipa tempest jobs in ussuri | 09:39 |
| dtantsur | it's not just your feeling :( | 09:39 |
| rpittau | wondering if we can backport https://review.opendev.org/#/c/725855/ and https://review.opendev.org/#/c/720394/ ? | 09:39 |
| patchbot | patch 725855 - ironic-inspector - Add variable to set inspection timeout in tempest ... (MERGED) - 1 patch set | 09:39 |
| patchbot | patch 720394 - ironic-inspector - Add variable to set discovery timeout in tempest t... (MERGED) - 2 patch sets | 09:39 |
| dtantsur | we probably should | 09:40 |
| rpittau | ok | 09:40 |
| rpittau | actually only one, mmmm | 09:42 |
| openstackgerrit | Riccardo Pittau proposed openstack/ironic-inspector stable/ussuri: Add variable to set inspection timeout in tempest tests https://review.opendev.org/743179 | 09:43 |
| openstackgerrit | Dmitry Tantsur proposed openstack/bifrost master: [WIP] dynamic roles: consolidate auth parameters in one place https://review.opendev.org/743169 | 09:45 |
| openstackgerrit | Dmitry Tantsur proposed openstack/bifrost master: [WIP] Support HTTP basic auth and switch bifrost-cli to it https://review.opendev.org/741964 | 09:45 |
| *** uzumaki has quit IRC | 09:48 | |
| rpittau | uhmmmm I think we hit a bug in systemd in the dib images | 09:49 |
| *** mkrai has quit IRC | 09:49 | |
| dtantsur | \o/ | 09:52 |
| *** Lucas_Gray has joined #openstack-ironic | 09:52 | |
| rpittau | systemd-login is not starting, it doesn't happen all the time, but when it happens it breaks everything | 09:52 |
| dtantsur | amazing | 09:54 |
| dtantsur | I wonder if we should declare our experiment with DIB a failure :( | 09:54 |
| rpittau | :/ | 09:54 |
| rpittau | there'sa bug report for rhel 7.6, but I'm seeign that happening in centos 8 in some jobs | 09:55 |
| rpittau | "RHEL 7.6 periodically doesn't boot properly because polkit.service and tuned.service fail to start. This happens about 1 in 10 to 20 boots." | 09:55 |
| janders | is this impacting DIB images only, or standard RHEL as well? | 09:57 |
| rpittau | janders: this impacts RHEL | 09:57 |
| janders | ouch | 09:58 |
| rpittau | this is the official BZ https://bugzilla.redhat.com/show_bug.cgi?id=1531486, which goes up to 7.8, but seems exceptionally similar to what happens in 8.x in our dib jobs from time to time | 09:59 |
| openstack | bugzilla.redhat.com bug 1531486 in systemd "Make connection to dbus asynchronous" [Urgent,Assigned] - Assigned to systemd-maint | 09:59 |
| *** mkrai has joined #openstack-ironic | 10:00 | |
| openstackgerrit | Riccardo Pittau proposed openstack/ironic-python-agent-builder master: [DNM] test ci https://review.opendev.org/743183 | 10:03 |
| janders | I suppose https://access.redhat.com/solutions/3900301 wouldn't help? | 10:08 |
| janders | (I see reports the workaround is no longer applicable to 7.8 so I guess el8 looks bleak too...) | 10:09 |
| openstackgerrit | Dmitry Tantsur proposed openstack/bifrost master: [WIP] dynamic roles: consolidate auth parameters in one place https://review.opendev.org/743169 | 10:09 |
| openstackgerrit | Dmitry Tantsur proposed openstack/bifrost master: [WIP] Support HTTP basic auth and switch bifrost-cli to it https://review.opendev.org/741964 | 10:09 |
| rpittau | janders: thanks, I saw that, not sure we can rely on that though | 10:09 |
| rpittau | I'm also seeing more errors related to selinux that make me think that the issue might be different | 10:09 |
| janders | dumb idea but might be worth a try: test with permissive just to narrow it down? | 10:10 |
| *** tkajinam has quit IRC | 10:10 | |
| *** rcernin has joined #openstack-ironic | 10:11 | |
| rpittau | janders: not dumb at all, we can try that if we see it' still failing | 10:14 |
| *** rcernin has quit IRC | 10:15 | |
| janders | with weird intermittent boot issues like the systemd bug above there is one seemingly insane trick I used to use with good success in the old systemd days - setting initdefault to 6 | 10:16 |
| janders | there is almost certainly a systemd way - reboot.target or sth | 10:16 |
| janders | but from the BZ it sounds like the cause is well understood but the fix is non trivial | 10:17 |
| janders | as opposed to difficulty reproducing | 10:17 |
| rpittau | yep, the problem is that this is happening in the ipa-ramdisk, not sure doing that is an option | 10:17 |
| janders | yeah confined environment makes troubleshooting things like this even harder as if it wasnt hard enough on its own :( | 10:19 |
| janders | s/old systemd days/pre systemd days/ | 10:19 |
| janders | my sentence above made no sense sorry | 10:20 |
| openstackgerrit | Riccardo Pittau proposed openstack/bifrost master: Change to ANSBILE_COLLECTIONS where needed https://review.opendev.org/743186 | 10:28 |
| openstackgerrit | Riccardo Pittau proposed openstack/bifrost master: Change to "collections" where needed https://review.opendev.org/743186 | 10:29 |
| dtantsur | rpittau: responded on https://review.opendev.org/#/c/743167/ | 10:31 |
| patchbot | patch 743167 - bifrost - Support installing the openstack collection from a... - 1 patch set | 10:31 |
| *** mkrai has quit IRC | 10:33 | |
| rpittau | oh geez... | 10:34 |
| dtantsur | I'm not sure what the ansible community thinks about it, but for me it sounds like "collections path" is where you can have many collections | 10:35 |
| dtantsur | while "collection path" is a path of some specific (in this case openstack) collection | 10:35 |
| dtantsur | I could do ANSIBLE_OPENSTACK_COLLECTION_SOURCE_PATH, but this is quite long | 10:36 |
| janders | would ANSIBLE_OS_COLLECTION_SRC_PATH be any better? :) | 10:37 |
| dtantsur | I'd paint it purple :) | 10:38 |
| dtantsur | I think I took _SOURCE_PATH from ANSIBLE_SOURCE_PATH | 10:38 |
| dtantsur | adding _OS_ makes some sense, but keep in mind it's a private variable that is only used in the CI | 10:39 |
| *** uzumaki has joined #openstack-ironic | 10:39 | |
| janders | wrapping up for the night | 10:45 |
| janders | have a good day and see you tomorrow | 10:45 |
| janders | o/ | 10:45 |
| dtantsur | see you janders | 10:47 |
| dtantsur | folks, looking for a 2nd +2 on https://review.opendev.org/#/c/742692/ please | 10:48 |
| patchbot | patch 742692 - ironic-python-agent-builder - Add dynamic-login to our published images by default - 2 patch sets | 10:48 |
| openstackgerrit | Dmitry Tantsur proposed openstack/ironic-tempest-plugin master: POC deploy-time RAID https://review.opendev.org/741227 | 10:53 |
| *** iurygregory has quit IRC | 10:59 | |
| openstackgerrit | Merged openstack/ironic-python-agent-builder master: Strip some excess from the centos dib image https://review.opendev.org/741819 | 11:00 |
| *** iurygregory has joined #openstack-ironic | 11:01 | |
| openstackgerrit | Dmitry Tantsur proposed openstack/bifrost master: Dynamic roles: consolidate auth parameters in one place https://review.opendev.org/743169 | 11:03 |
| openstackgerrit | Dmitry Tantsur proposed openstack/bifrost master: [WIP] Support HTTP basic auth and switch bifrost-cli to it https://review.opendev.org/743197 | 11:09 |
| *** rcernin has joined #openstack-ironic | 11:23 | |
| openstackgerrit | Merged openstack/bifrost master: Add ansible collections symlink to .gitignore https://review.opendev.org/743125 | 11:30 |
| openstackgerrit | Merged openstack/bifrost master: Support installing the openstack collection from a local location https://review.opendev.org/743167 | 11:34 |
| openstackgerrit | Dmitry Tantsur proposed openstack/bifrost master: [WIP] Support HTTP basic auth and switch bifrost-cli to it https://review.opendev.org/741964 | 11:34 |
| vmud213 | Can anyone take a look at this patch https://review.opendev.org/#/c/739174/ | 11:38 |
| patchbot | patch 739174 - ironic - Decouple the ISO creation logic from redfish - 7 patch sets | 11:38 |
| vmud213 | The code was merged earlier and reverted for a good reason. It's a rework on it. | 11:39 |
| *** rh-jelabarre has joined #openstack-ironic | 11:59 | |
| *** derekh has quit IRC | 12:25 | |
| openstackgerrit | Merged openstack/ironic-python-agent-builder master: Add dynamic-login to our published images by default https://review.opendev.org/742692 | 12:28 |
| openstackgerrit | Verification of a change to openstack/ironic-inspector failed: Make inspector base CI job use 2 CPUs https://review.opendev.org/740747 | 12:39 |
| openstackgerrit | Riccardo Pittau proposed openstack/bifrost master: Consolidate env-setup https://review.opendev.org/742201 | 12:40 |
| openstackgerrit | Riccardo Pittau proposed openstack/bifrost master: Change to "collections" where needed https://review.opendev.org/743186 | 12:41 |
| openstackgerrit | Riccardo Pittau proposed openstack/bifrost master: Consolidate env-setup https://review.opendev.org/742201 | 12:42 |
| *** dougsz has quit IRC | 12:43 | |
| *** dougsz has joined #openstack-ironic | 12:56 | |
| openstackgerrit | Dmitry Tantsur proposed openstack/ironic-tempest-plugin master: POC deploy-time RAID https://review.opendev.org/741227 | 12:59 |
| *** Lucas_Gray has quit IRC | 13:10 | |
| *** rloo has joined #openstack-ironic | 13:13 | |
| openstackgerrit | Riccardo Pittau proposed openstack/ironic-python-agent master: Update version of hacking https://review.opendev.org/743224 | 13:16 |
| zaneb | quick q: am I correct that ironic_inspector never calls back to ironic (over RPC or REST), and that the only interaction between them consists of ironic calling ironic-inspector's REST API? | 13:21 |
| *** Lucas_Gray has joined #openstack-ironic | 13:21 | |
| dtantsur | zaneb: this is not correct | 13:21 |
| dtantsur | ironic-inspector uses ironic API to provide updates (create ports, change properties) | 13:21 |
| zaneb | aha! | 13:22 |
| dtantsur | and in some cases for managing boot (setting boot device, power on/off) | 13:22 |
| *** derekh has joined #openstack-ironic | 13:22 | |
| *** dtantsur is now known as dtantsur|brb | 13:22 | |
| *** rcernin has quit IRC | 13:29 | |
| TheJulia | good morning | 13:38 |
| *** trandles has joined #openstack-ironic | 13:44 | |
| iurygregory | good morning TheJulia =) | 13:47 |
| arne_wiebalck | zaneb: dtantsur|brb: the inspector also uses the Ironic API to get the list of all nodes to update its node cache | 13:48 |
| zaneb | arne_wiebalck: thanks, I found some code... I wasn't expecting it to use openstacksdk, which I think is why I had trouble finding it | 13:49 |
| *** tzumainn has joined #openstack-ironic | 13:50 | |
| zaneb | currently trying to figure out how openstacksdk reads these options https://github.com/metal3-io/ironic-inspector-image/commit/46405518119dd5b4c38103f29b5b01fc88a0ac3d from iurygregory's patch, even though they are not explicitly defined in the config in ironic_inspector itself | 13:51 |
| arne_wiebalck | zaneb: I only found out some weeks ago when the sync brought down our DB :) | 13:51 |
| zaneb | lol | 13:51 |
| zaneb | always a fun way to learn something new | 13:51 |
| iurygregory | zaneb, since inspector needs to interact with ironic you need the username/password in ironic-inspector.conf in [ironic] | 13:52 |
| zaneb | iurygregory: yeah, that makes sense. just trying to satisfy my own curiousity by figuring out the actual mechanism | 13:52 |
| iurygregory | zaneb, oh =) | 13:53 |
| * TheJulia feels insanely exhausted | 13:53 | |
| zaneb | iurygregory: like, I'd really expect to see them defined right here: https://opendev.org/openstack/ironic-inspector/src/branch/master/ironic_inspector/conf/ironic.py#L24-L33 and they're just not | 13:54 |
| zaneb | so I assume it's some sort of magic in openstacksdk? | 13:54 |
| iurygregory | magic is always the right word =D | 13:55 |
| iurygregory | yeah it would make sense to be in this file o.o | 13:55 |
| *** tzumainn has quit IRC | 13:55 | |
| *** tzumainn has joined #openstack-ironic | 13:56 | |
| zaneb | iurygregory: ah, it's here: https://opendev.org/openstack/ironic-inspector/src/branch/master/ironic_inspector/conf/ironic.py#L42 | 13:57 |
| zaneb | which calls https://opendev.org/openstack/ironic-inspector/src/branch/master/ironic_inspector/common/keystone.py#L48-L72 | 13:59 |
| rpittau | mmmm should we backport this https://review.opendev.org/#/c/740454/ to ussuri? I think the problem that we're seeing in ipa-tempest jobs there is because we didn't backport that | 13:59 |
| patchbot | patch 740454 - ironic-python-agent - Update jobs (MERGED) - 2 patch sets | 13:59 |
| rpittau | since this change https://review.opendev.org/#/c/735960/ | 13:59 |
| patchbot | patch 735960 - ironic-tempest-plugin - Improve test_baremetal_basic_ops (MERGED) - 5 patch sets | 13:59 |
| iurygregory | rpittau, we probably need but also I'm trying to fix the basic_ops, in some cases the tests are falling because of the flavor | 14:01 |
| rpittau | seems like not a clean backport, let' see | 14:01 |
| iurygregory | I gave a try to workaround the issue with https://review.opendev.org/742381 and testing with https://review.opendev.org/741445 https://review.opendev.org/741886 | 14:01 |
| patchbot | patch 742381 - ironic - Create altbaremetal flavor - 1 patch set | 14:01 |
| patchbot | patch 741445 - ironic-tempest-plugin - Update basic_ops - 12 patch sets | 14:01 |
| patchbot | patch 741886 - ironic - Add tempest default_boot_option - 2 patch sets | 14:01 |
| iurygregory | tempest was happy, but seems that the altbaremetal change and the one testing tempest didn't work 100% | 14:02 |
| arne_wiebalck | ipmitool on centos8, ciphers and lanplus ... anyone here who wants to rant with me about it? | 14:03 |
| * rpittau rant mode activated | 14:04 | |
| arne_wiebalck | we have a wrapper around ipmitool to handle all cases, but now the wrapper broke since the new ipmitool on c8 enforces ciphers when -I lanplus is passed | 14:08 |
| * arne_wiebalck will now patch Ironic to not pass anything to the wrapper, and let the wrapper figure it all out ... | 14:10 | |
| openstackgerrit | Julia Kreger proposed openstack/ironic-python-agent master: Add possibility to pass global request ID https://review.opendev.org/728529 | 14:11 |
| TheJulia | dtantsur|brb: any intent on backporting https://review.opendev.org/#/c/739779/ ? | 14:21 |
| patchbot | patch 739779 - ironic - Add an option to choose the hash ring algorithm (MERGED) - 2 patch sets | 14:21 |
| *** rcernin has joined #openstack-ironic | 14:22 | |
| openstackgerrit | Merged openstack/ironic master: Extend base build timeouts https://review.opendev.org/741818 | 14:27 |
| *** ricolin has joined #openstack-ironic | 14:31 | |
| naved001 | Hello Team Ironic! | 14:33 |
| naved001 | I have a standalone containerized deployment. My cinder is backed by ceph. Is it possible to boot a node from cinder volume without using the compute service? I have been trying, but in the generated ipxe file I see `sanboot iscsi:::::::` (the iscsi parameters are missing). | 14:33 |
| naved001 | This is the document that I have been following: https://docs.openstack.org/ironic/latest/admin/boot-from-volume.html | 14:33 |
| *** hoonetorg has quit IRC | 14:35 | |
| openstackgerrit | Vladyslav Drok proposed openstack/ironic-python-agent master: Add possibility to pass global request ID https://review.opendev.org/728529 | 14:37 |
| uzumaki | hello people! o/ | 14:37 |
| *** abdysn has quit IRC | 14:39 | |
| iurygregory | hello uzumaki o/ | 14:42 |
| uzumaki | how you doing iurygregory ? \o/ | 14:42 |
| iurygregory | uzumaki, doing good and you ? | 14:43 |
| uzumaki | I'm fine.. I gues.. It's just the summer's really getting to me.. it's going to be monsoon season here in Pakistan, humidity's going to hit the roof.. | 14:44 |
| *** cdearborn has joined #openstack-ironic | 14:46 | |
| openstackgerrit | Riccardo Pittau proposed openstack/ironic-python-agent stable/ussuri: Update jobs https://review.opendev.org/743248 | 14:46 |
| uzumaki | iurygregory, do you know if ironic allows you to have raid configurations on multiple controllers? Like.. I'd like to have RAID1 for my Dell BOSS card, and RAID1 for my other spinner disks in front bay? | 14:47 |
| iurygregory | uzumaki, I think you can set this on the json you will use for target-raid-config | 14:48 |
| iurygregory | you can specify the physical_disks you want to use | 14:49 |
| *** hoonetorg has joined #openstack-ironic | 14:49 | |
| uzumaki | I see, lemmi look into it a bit more, thanks! iurygregory | 14:49 |
| rpioso | uzumaki: The RAID JSON schema supports it. I haven't tried it myself. | 14:51 |
| uzumaki | rpioso, alright. thanks! | 14:51 |
| rpioso | uzumaki: yw | 14:52 |
| iurygregory | uzumaki, maybe you just need to specify the physical_disks | 14:54 |
| TheJulia | naved001: without using the compute service. Have you been populating a volume target entry? | 14:55 |
| iurygregory | uzumaki, https://docs.openstack.org/ironic/latest/admin/raid.html | 14:55 |
| TheJulia | naved001: this would be the block device data for the attachment with cinder, maybe if you've got your steps written down it might be easier | 14:55 |
| uzumaki | Yeah, I think it might be a different thing trying to get that thing over to metal3. Thanks iurygregory | 14:55 |
| iurygregory | oh =) | 14:56 |
| *** rcernin has quit IRC | 14:56 | |
| *** Lucas_Gray has quit IRC | 14:59 | |
| iurygregory | o/ | 15:00 |
| *** beekneemech is now known as bnemec | 15:00 | |
| * iurygregory removes hands up and waits for TheJulia to start | 15:00 | |
| TheJulia | I feel like casual nick mondays needs to be a thing | 15:00 |
| TheJulia | #startmeeting ironic | 15:00 |
| openstack | Meeting started Mon Jul 27 15:00:55 2020 UTC and is due to finish in 60 minutes. The chair is TheJulia. Information about MeetBot at http://wiki.debian.org/MeetBot. | 15:00 |
| openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 15:00 |
| *** openstack changes topic to " (Meeting topic: ironic)" | 15:00 | |
| TheJulia | Good morning everyone! | 15:00 |
| openstack | The meeting name has been set to 'ironic' | 15:00 |
| iurygregory | o/ | 15:01 |
| rpioso | \o | 15:01 |
| ajya | o/ | 15:01 |
| erbarr | o/ | 15:01 |
| rpittau | o/ | 15:01 |
| cdearborn | o/ | 15:01 |
| bdodd_ | o/ | 15:01 |
| arne_wiebalck | o/ | 15:01 |
| TheJulia | Our agenda this week is quite full, so hopefully we'll get through it quickly! | 15:01 |
| TheJulia | #link https://wiki.openstack.org/wiki/Meetings/Ironic#Agenda_for_next_meeting | 15:01 |
| rloo | o/ | 15:02 |
| TheJulia | #topic Announcements / Reminders | 15:02 |
| *** openstack changes topic to "Announcements / Reminders (Meeting topic: ironic)" | 15:02 | |
| TheJulia | A few different items! | 15:02 |
| mjturek | o/ | 15:03 |
| TheJulia | First off as everyone may have noticed we've been having a lot of issues with CI. Largely these have revolved around seemingly random failures that are race conditions due to substrate clouds or totally random issues. Please remember to log these on the whiteboard so everyone can keep track of them. We all need to remember to do it and update it as fixes merge. | 15:03 |
| TheJulia | #link https://etherpad.opendev.org/p/IronicWhiteBoard | 15:04 |
| TheJulia | Next up! | 15:04 |
| TheJulia | #info Ironic now has a website! (That is if you didn't catch this during OpenDev!) | 15:04 |
| rpioso | \o/ | 15:04 |
| TheJulia | #link https://ironicbaremetal.org/ | 15:04 |
| cdearborn | YAY!!! | 15:05 |
| TheJulia | #info The whitepaper has also been published \o/ | 15:05 |
| TheJulia | #link https://www.openstack.org/bare-metal/how-ironic-delivers-abstraction-and-automation-using-open-source-infrastructure | 15:05 |
| TheJulia | A special thanks to everyone that contributed and helped make that a success! | 15:05 |
| TheJulia | Including OSF staffers who helped review and provide feedback in the very end! | 15:05 |
| *** dtantsur|brb is now known as dtantsur | 15:06 | |
| TheJulia | Next up looks like arne_wiebalck has a call scheduled for the Redfish InterOp profiles work | 15:06 |
| TheJulia | arne_wiebalck: is there a link? | 15:06 |
| arne_wiebalck | Yes, there is a zoom call tomorrow to discuss the Redfish interop profile status, everyone interested is welcome to join at 2pm UTC: https://cern.zoom.us/j/97073886481 | 15:06 |
| TheJulia | #info Call to discuss Redfish Interop Profile status, Tue 28 at 2pm UTC | 15:06 |
| TheJulia | #link https://cern.zoom.us/j/97073886481 | 15:06 |
| TheJulia | Two reminders! | 15:08 |
| TheJulia | Well 3 | 15:08 |
| TheJulia | First! | 15:08 |
| TheJulia | #info The CFP for the Open Infrastucture Summit is presently open through August 4th | 15:08 |
| TheJulia | #link https://cfp.openstack.org/ | 15:09 |
| TheJulia | Second! | 15:09 |
| TheJulia | #info We're quickly coming up on August 10th which is around when we committed to making our next intermediate release. | 15:10 |
| TheJulia | Third! | 15:10 |
| TheJulia | #info In order for us to be able to be able to make that date, it would be extremely helpful for people who are not presently core reviewers to spend a little time and review 1-2 patches a day. It doesn't take long, it would just help us in the long run. | 15:11 |
| TheJulia | Wow, that was a lot | 15:11 |
| TheJulia | Does anyone have anything else? | 15:11 |
| arne_wiebalck | We have not done this during the past summits, but for the summit we may want to get a slot for the bare metal SIG, to promote the new site, the paper and attract/organise people to work on items ... what do you think? | 15:11 |
| TheJulia | arne_wiebalck: I think it is a wonderful idea | 15:12 |
| TheJulia | I would encourage everyone to submit something! | 15:12 |
| iurygregory | arne_wiebalck ++ | 15:12 |
| arne_wiebalck | Increase visibility is the whole point. | 15:12 |
| TheJulia | not just would, I do encourage everyone to submit something! | 15:12 |
| TheJulia | I'm even working on something in the back of my brain! | 15:12 |
| * iurygregory will \o/ | 15:12 | |
| arne_wiebalck | We plan submit sth on scaling Ironic. | 15:12 |
| TheJulia | ++ | 15:13 |
| TheJulia | Also, if anyone has more than than the CFP submission limit, please let me know and we can likely figure something out. | 15:14 |
| TheJulia | Anyway, if nobody else has anything to remind us of, we should move on! | 15:14 |
| *** Lucas_Gray has joined #openstack-ironic | 15:14 | |
| TheJulia | Looks like we have no action items from the last meeting | 15:15 |
| TheJulia | So we will move directly to subteam status reports | 15:15 |
| TheJulia | #topic Review subteam status reports | 15:15 |
| *** openstack changes topic to "Review subteam status reports (Meeting topic: ironic)" | 15:15 | |
| TheJulia | #link https://etherpad.opendev.org/p/IronicWhiteBoard | 15:15 |
| TheJulia | Starting at line 341 | 15:16 |
| *** diurnalist has joined #openstack-ironic | 15:17 | |
| TheJulia | Is there any update on the changes for bugfix branches? | 15:17 |
| iurygregory | I gave a try to override checkout but didn't work | 15:18 |
| iurygregory | not sure if dtantsur found something | 15:18 |
| dtantsur | I haven't done anything around it | 15:18 |
| dtantsur | iurygregory: do you have a patch? | 15:18 |
| iurygregory | dtantsur, I do | 15:19 |
| TheJulia | I feel like part of the idea originally was to try and use bifrost on it since we don't have stable hardcoded into its logic really | 15:19 |
| iurygregory | it was https://review.opendev.org/#/c/741825/ | 15:19 |
| patchbot | patch 741825 - ironic-python-agent (bugfix/6.2) - [DNM] Testing setting IRONIC_PYTHON_AGENT_BRANCH - 2 patch sets | 15:19 |
| vmud213 | TheJulia: Mind taking a look at https://review.opendev.org/#/c/739174/ | 15:19 |
| patchbot | patch 739174 - ironic - Decouple the ISO creation logic from redfish - 7 patch sets | 15:19 |
| vmud213 | I saw you recently made some changes in redfish/boot.py | 15:19 |
| TheJulia | vmud213: we're in our weekly meeting right now, we're not to the section on priorities for the week yet | 15:19 |
| vmud213 | oh.ok | 15:19 |
| vmud213 | sorry | 15:19 |
| TheJulia | vmud213: worth noting, that change is also in that list already | 15:19 |
| TheJulia | no worries | 15:20 |
| TheJulia | iurygregory: still fighting grenade? | 15:20 |
| iurygregory | dtantsur, patch1 I went trying override-checkout: bugfix/6.2 and patch 2 IRONIC_PYTHON_AGENT_BRANCH: bugfix/6.2 | 15:20 |
| patchbot | No data found for patch 2 | 15:20 |
| iurygregory | TheJulia, yeah =( | 15:20 |
| iurygregory | haven't find a clear path on how to move forward | 15:20 |
| TheJulia | :( | 15:21 |
| TheJulia | Would it help to have a small meeting to try and walk through issues and maybe brainstorm ideas? | 15:21 |
| dtantsur | iurygregory: you need override-checkout and you need it per project | 15:21 |
| dtantsur | i.e. don't try to use bugfix/6.2 on ironic, ironic has bugfix/15.1 | 15:21 |
| iurygregory | yeah, I will send and email to openstack-discuss so we can find a time | 15:21 |
| iurygregory | dtantsur, I will give a try overriding the ironic | 15:22 |
| dtantsur | we need bugfix branches for ironic and master for everything else | 15:22 |
| dtantsur | * for ironic and inspector | 15:23 |
| TheJulia | Re scale issues, no update other than patch for OOMs is still in review. Dtantsur did make a note on an issue in our db logic for ports that we should likely take a look at if someone has database spoons handy | 15:23 |
| TheJulia | Looks like stevebaker has been making good progress on cleaning up wsme stuffs \o/ | 15:25 |
| TheJulia | dtantsur: any update on ramdisk tls? | 15:26 |
| TheJulia | iurygregory: Looks like your working through reviews on job changes to simplify jobs? | 15:26 |
| iurygregory | TheJulia, yeah, need to first figure out a few things related to the flavor that we need to use partition test | 15:27 |
| iurygregory | since nova override the capabilites | 15:27 |
| TheJulia | iurygregory: interesting | 15:27 |
| TheJulia | ugh | 15:27 |
| TheJulia | NOVAAAAA!!! | 15:27 |
| iurygregory | so I was testing https://review.opendev.org/742381 as depends on for https://review.opendev.org/741445 | 15:28 |
| patchbot | patch 742381 - ironic - Create altbaremetal flavor - 1 patch set | 15:28 |
| patchbot | patch 741445 - ironic-tempest-plugin - Update basic_ops - 12 patch sets | 15:28 |
| TheJulia | dtantsur: mgoddard: Anything new on in-band deploy steps? | 15:28 |
| iurygregory | and the tempest as depends on for https://review.opendev.org/741886 | 15:28 |
| patchbot | patch 741886 - ironic - Add tempest default_boot_option - 2 patch sets | 15:28 |
| dtantsur | TheJulia: trying to make in-band RAID work in the CI | 15:28 |
| dtantsur | staring at the logs as we speak | 15:28 |
| iurygregory | tempest is happy the the other ironic patches are unhappy so I'm debugging | 15:28 |
| TheJulia | dtantsur: ++ | 15:28 |
| dtantsur | the patch is https://review.opendev.org/741227 | 15:28 |
| patchbot | patch 741227 - ironic-tempest-plugin - POC deploy-time RAID - 5 patch sets | 15:28 |
| TheJulia | Looks like the refish interop profile one has been updated | 15:29 |
| TheJulia | arne_wiebalck: shall we discuss the baremetal program/sig item during the specific window for that topic area? | 15:29 |
| arne_wiebalck | yes | 15:29 |
| TheJulia | Okay then! | 15:30 |
| TheJulia | Is everyone good to proceed forward? | 15:30 |
| iurygregory | ++ | 15:30 |
| arne_wiebalck | +1 | 15:30 |
| rpittau | let's | 15:30 |
| TheJulia | #topic Deciding on priorities for the coming week | 15:30 |
| *** openstack changes topic to "Deciding on priorities for the coming week (Meeting topic: ironic)" | 15:30 | |
| TheJulia | #link https://etherpad.opendev.org/p/IronicWhiteBoard | 15:30 |
| TheJulia | Starting at line 142 | 15:31 |
| TheJulia | First I'll delete the merged items from the list... and almost everything on that list HAS merged | 15:31 |
| TheJulia | Thanks everyone! | 15:31 |
| TheJulia | iurygregory: is there a next step for dhcp-less? | 15:31 |
| iurygregory | TheJulia, so we just need to sync if we want to have the element on diskimage-builder or on ipa-builder I think | 15:32 |
| iurygregory | we won't need to use dhcp-all-interfaces element on the image | 15:33 |
| openstackgerrit | Dmitry Tantsur proposed openstack/ironic-tempest-plugin master: POC deploy-time RAID https://review.opendev.org/741227 | 15:34 |
| iurygregory | https://specs.openstack.org/openstack/ironic-specs/specs/not-implemented/L3-based-deployment.html#ramdisk-impact | 15:34 |
| TheJulia | So as for items to add this week, I went through the projects this mroning and made a list starting at 231. Looks like ?dmitry? proposed some items starting at 224 | 15:34 |
| TheJulia | Any objections to adding them all to the list? | 15:35 |
| * TheJulia takes silence as none | 15:36 | |
| rpittau | nope | 15:36 |
| rpioso | TheJulia: We would appreciate reviews of https://review.opendev.org/#/c/740721/ | 15:38 |
| patchbot | patch 740721 - ironic-specs - [WIP] Operationally efficient & fast-track provisi... - 6 patch sets | 15:38 |
| TheJulia | rpioso: it is already on the list | 15:38 |
| rpioso | TheJulia: +1 :-) | 15:38 |
| TheJulia | Okay, aside from a little clean up, is there anything else to add? | 15:39 |
| dtantsur | looks good, I guess | 15:39 |
| TheJulia | Awesome | 15:40 |
| TheJulia | Then I guess we should proceed? | 15:40 |
| iurygregory | ++ | 15:40 |
| TheJulia | #topic Baremetal SIG | 15:40 |
| *** openstack changes topic to "Baremetal SIG (Meeting topic: ironic)" | 15:40 | |
| TheJulia | arne_wiebalck: do you want to do the typing ? :) | 15:41 |
| arne_wiebalck | Sure :) Given the input from the opendev event, I was considering to introduce regular SIG meetings, to organise/tackle the work for the next item(s) after the white paper. | 15:41 |
| arne_wiebalck | Does that sound sensible or would you rather despise more meetings? | 15:41 |
| arne_wiebalck | I was thinking monthly maybe. | 15:42 |
| arne_wiebalck | Any thoughts? | 15:42 |
| arne_wiebalck | There are various topics that were raised during the event, I listed them on the white board as well. | 15:42 |
| iurygregory | I think monthly should be fine | 15:43 |
| arne_wiebalck | line 424 | 15:43 |
| rpittau | monthly sounds good | 15:43 |
| rpittau | maybe written updates from time to time? in the etherpad | 15:43 |
| arne_wiebalck | Ok, let's see how it goes and if there is some attendance/interest. | 15:43 |
| TheJulia | I think monthly sig meetings woul dbe good | 15:44 |
| arne_wiebalck | the weekly Ironic meeting should still get updates I think | 15:44 |
| rpioso | +1 | 15:44 |
| TheJulia | ++ | 15:44 |
| TheJulia | I think that is reasonable | 15:44 |
| arne_wiebalck | but short, no discussion | 15:44 |
| dtantsur | absolutely | 15:44 |
| arne_wiebalck | preferences for zoom or irc for the monthly meeting? | 15:44 |
| TheJulia | I kind of feel like actual video call might garner a little more engagement | 15:45 |
| arne_wiebalck | yeah, I think so, too | 15:45 |
| TheJulia | as much as many of us might dislike putting on pants | 15:45 |
| arne_wiebalck | :-D | 15:46 |
| rpittau | just keep the camera always pointed to the top body part :) | 15:46 |
| TheJulia | rpittau: ++ | 15:46 |
| arne_wiebalck | Finding a time suitable for everyone will be challenging. | 15:46 |
| TheJulia | Yeah, timing is always hard | 15:46 |
| arne_wiebalck | Maybe the same slots we used for the white paper, like Tue 2pm UTC | 15:47 |
| arne_wiebalck | this seemed to fit most | 15:47 |
| TheJulia | An open doodle for 1-2 weeks might yield a common window especially if the mailing list is reminded | 15:47 |
| TheJulia | That did kind of fit | 15:47 |
| *** gyee has joined #openstack-ironic | 15:47 | |
| arne_wiebalck | Ok, we can also doodle for it, yes. | 15:47 |
| TheJulia | Is there anything else baremetal sig related? | 15:48 |
| arne_wiebalck | I don't think so. | 15:48 |
| TheJulia | Okay then, well then next up is RFE Review | 15:48 |
| TheJulia | #topic RFE Review | 15:48 |
| *** openstack changes topic to "RFE Review (Meeting topic: ironic)" | 15:48 | |
| TheJulia | kaifeng asked for us to quickly revisit the smart consoles RFE | 15:48 |
| TheJulia | #link https://storyboard.openstack.org/#!/story/2007876 | 15:48 |
| TheJulia | it sounds good to me | 15:49 |
| TheJulia | Any comments/questions? | 15:51 |
| TheJulia | If there is none, I'll mark it rfe-approved and we can move on? | 15:51 |
| rpittau | lgtm | 15:51 |
| openstackgerrit | Dmitry Tantsur proposed openstack/ironic master: Make the final deploy step validation actually fail deploy https://review.opendev.org/743266 | 15:52 |
| TheJulia | ohhhh ahhh | 15:52 |
| TheJulia | Okay, time for Open Discussion with 8 minutes left | 15:52 |
| TheJulia | #topic Open Discussion | 15:52 |
| *** openstack changes topic to "Open Discussion (Meeting topic: ironic)" | 15:52 | |
| TheJulia | Does anyone have anything to discuss? Or is everyone busy working on proposals for the Open Infrastructure Summit? | 15:53 |
| naved001 | TheJulia: I did run `openstack baremetal volume target create <args>`. I'll get all steps down and then share it here. Thanks so much for your help! | 15:53 |
| rpittau | just keep an eye on https://review.opendev.org/743248 as it should fix the ipa ussuri CI | 15:54 |
| patchbot | patch 743248 - ironic-python-agent (stable/ussuri) - Update jobs - 1 patch set | 15:54 |
| TheJulia | rpittau: awesome | 15:54 |
| TheJulia | naved001: Hmm... Any chance you could provide us a list of the commands your executing with arguments? redacted of course. Also what openstack baremetal node show indicates when you tell it to deploy. Seems like something is not quite right somewhere... :( | 15:55 |
| openstackgerrit | John Garbutt proposed openstack/networking-generic-switch master: Add support for Cumulus 4.x NCLU driver https://review.opendev.org/743269 | 15:56 |
| iurygregory | email sent to openstack-discuss http://lists.openstack.org/pipermail/openstack-discuss/2020-July/016102.html =) | 15:56 |
| ajya | there is an issue with deploy steps that have higher priority than `deploy` step and that require rebooting. They execute successfully but they reset PXE config and deployment can't proceed. Any comments? | 15:56 |
| TheJulia | iurygregory: awesome | 15:57 |
| ajya | Should PXE/boot config happen closer to `deploy` step? Or make boot settings persistent and remove afterwards when no longer needed? | 15:57 |
| TheJulia | ajya: I was wondering the same thing yesterday because I was wondering how we could wire in a kexec step that is optional but can still be chosen | 15:57 |
| openstackgerrit | Dmitry Tantsur proposed openstack/ironic-python-agent master: Allow erase_devices_metadata to be used as a deploy step https://review.opendev.org/743272 | 15:58 |
| TheJulia | ajya: pxe/boot config is in the preparation step | 15:58 |
| * TheJulia has this feeling many things are going to become steps soon | 15:58 | |
| ajya | TheJulia: yes, at the very beginning of deploying | 15:58 |
| dtantsur | yep, DeployInterface.prepare should probably become a step | 15:58 |
| ajya | but before actual deploy steps are started | 15:58 |
| openstackgerrit | Verification of a change to openstack/ironic failed: Change non-tinyipa jobs to use multiple cores https://review.opendev.org/741577 | 15:58 |
| dtantsur | ajya: what you describe is probably an issue in the reboot_requested flag handling | 15:59 |
| rpioso | dtantsur: Could be. A reboot consumes the PXE boot once. | 16:00 |
| ajya | dtantsur: maybe, but there are things where iDRAC needs rebooting to complete a task | 16:00 |
| dtantsur | oh, so it reboots itself, not via ironic? | 16:00 |
| dtantsur | then it's probably up to the driver to restore the boot configuration | 16:00 |
| *** lucasagomes has quit IRC | 16:00 | |
| rpioso | dtantsur: Via ironic. | 16:00 |
| openstackgerrit | Merged openstack/sushy master: Update version of hacking https://review.opendev.org/742712 | 16:00 |
| dtantsur | okay, then it's probably an issue in reboot_requested | 16:00 |
| rpioso | dtantsur: The idrac driver generates a reboot. | 16:00 |
| ajya | that would be a work around, but that means that every step that needs rebooting need to restore it | 16:01 |
| dtantsur | rpioso: so, not via reboot_requested? | 16:01 |
| rpioso | Not sure off hand. | 16:01 |
| dtantsur | then you're probably still in charge for restoring the boot configuration | 16:01 |
| rpioso | We found our bios apply_configuration deploy step doesn't work. | 16:02 |
| dtantsur | Ironic has no way to understand that we've requested "one-time boot", but "not THIS one time" :) | 16:02 |
| ajya | need to add some more logic if the step is configured to execute after deployment, then don't need to restore anything | 16:02 |
| TheJulia | Well, we're past time and it seems like this discussion is going to run for a little while | 16:02 |
| ajya | so maybe it's more configurable if can control when boot device is configured | 16:03 |
| TheJulia | ajya: I was kind of thinking some sort of "conditional awareness to invoke the step or not" but then again the step could be self aware and in the chain | 16:03 |
| TheJulia | If the effective action is a noop, I suspect that is fine on the default path | 16:03 |
| rpioso | Keep in mind these steps are often clean steps, too. | 16:03 |
| TheJulia | Indeed | 16:03 |
| *** uzumaki has quit IRC | 16:04 | |
| ajya | yes, that means adding more logic to determine if it's deploy/clean step | 16:04 |
| TheJulia | Any objection to ending the meeting? | 16:04 |
| ajya | no | 16:04 |
| rpioso | +1 | 16:04 |
| dtantsur | none | 16:04 |
| TheJulia | Thanks everyone! | 16:05 |
| TheJulia | #endmeeting | 16:05 |
| *** openstack changes topic to "Bare Metal Provisioning | Status: http://bit.ly/ironic-whiteboard | Docs: http://docs.openstack.org/ironic/ | Bugs: https://storyboard.openstack.org/#!/project_group/75 | Contributors are generally present between 6 AM and 12 AM UTC, If we do not answer, please feel free to pose questions to openstack-discuss mailing list." | 16:05 | |
| openstack | Meeting ended Mon Jul 27 16:05:24 2020 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 16:05 |
| openstack | Minutes: http://eavesdrop.openstack.org/meetings/ironic/2020/ironic.2020-07-27-15.00.html | 16:05 |
| openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/ironic/2020/ironic.2020-07-27-15.00.txt | 16:05 |
| openstack | Log: http://eavesdrop.openstack.org/meetings/ironic/2020/ironic.2020-07-27-15.00.log.html | 16:05 |
| dtantsur | Some bad news: I'm hitting a wall trying to make HTTP basic auth work in bifrost | 16:07 |
| rpioso | dtantsur: Here's the BIOS apply_configuration code: https://opendev.org/openstack/ironic/src/branch/master/ironic/drivers/modules/drac/bios.py#L126-L130 | 16:08 |
| rpioso | dtantsur: I expect reboot_needed is True. | 16:08 |
| rpittau | dtantsur: I didn't have time today, but I will test your http basic auth patch tomorrow | 16:08 |
| dtantsur | rpittau: you're welcome to. the problem is reproducible if you run test-bifrost.sh. I have https://review.opendev.org/#/c/743227/ but it doesn't seem enough. | 16:09 |
| patchbot | patch 743227 - keystoneauth - Fix get_endpoint_data for non-keystone plugins - 2 patch sets | 16:09 |
| *** ricolin has quit IRC | 16:16 | |
| ajya | dtantsur: in short-term could add some logic to check if it's clean/deploy step, is it rewriting boot device (at the beginning) or not (if executed at later stage), but should it be long term considered that e.g., boot device config is priority 150 step where everything above don't have to bother about boot device settings? | 16:23 |
| dtantsur | yeah, we should probably move prepare to deploy steps.. | 16:23 |
| ajya | ok, I'll keep this in mind and take a look at effort involved. Currently, thinking that workaround for affected steps is smaller :) | 16:28 |
| *** Goneri has joined #openstack-ironic | 16:38 | |
| arne_wiebalck | bye everyone o/ | 16:48 |
| *** rcernin has joined #openstack-ironic | 16:54 | |
| *** rcernin has quit IRC | 16:58 | |
| *** vmud213 has quit IRC | 16:59 | |
| *** ociuhandu has quit IRC | 16:59 | |
| *** dtantsur is now known as dtantsur|afk | 16:59 | |
| naved001 | TheJulia: The commands I ran were | 16:59 |
| naved001 | openstack baremetal node set --storage-interface cinder dell-3 | 16:59 |
| naved001 | openstack baremetal volume connector create --node $NODE_UUID --type iqn --connector-id iqn.2017-08.org.openstack.$NODE_UUID | 16:59 |
| naved001 | openstack baremetal volume target create --node $NODE_UUID --type iscsi --boot-index 0 --volume 918fc47e-17db-4dd0-a6d4-ad12f13bd1d7 | 16:59 |
| naved001 | openstack baremetal node set --property capabilities=iscsi_boot:True dell-3 | 16:59 |
| naved001 | openstack baremetal node deploy dell-3 | 16:59 |
| naved001 | https://controlc.com/3ef66bd4 has the outputs of various show commands. | 16:59 |
| *** Lucas_Gray has quit IRC | 16:59 | |
| naved001 | At the moment, my deploy seems to be failing due to other reasons (looking into it now). The furthest I reached in this process was when my node booted from an ipxe file which did not have any iscsi endpoint information so it was just stuck retrying. Other odd thing I noticed was that there was no process listening on port 3260 on my controller. I don't know what service is responsible for exposing cinder volume with iscsi. | 16:59 |
| *** derekh has quit IRC | 17:00 | |
| *** dougsz has quit IRC | 17:00 | |
| openstackgerrit | John Garbutt proposed openstack/networking-generic-switch master: WIP: Attempt to batch up cmds https://review.opendev.org/743283 | 17:03 |
| TheJulia | naved001: cinder itself should be expsoing it. The conundrum is... and I just relaized you said ceph earlier... that ceph support in cinder doesn't automatically offer iscsi | 17:03 |
| TheJulia | s/automatically// | 17:04 |
| TheJulia | at all | 17:04 |
| naved001 | I see | 17:04 |
| naved001 | TheJulia: so I would need to use an `external` storage interface if I want to use ceph (and manually configure the volumes and iscsi endpoints in ceph)? | 17:08 |
| *** ociuhandu has joined #openstack-ironic | 17:15 | |
| *** ociuhandu has quit IRC | 17:20 | |
| TheJulia | naved001: likely unless the cinder folks have formal iscsi response/support for managing cinder | 17:23 |
| naved001 | TheJulia: okay. thank you for taking out the time to help me out! | 17:33 |
| *** dsneddon has joined #openstack-ironic | 17:42 | |
| *** ociuhandu has joined #openstack-ironic | 17:50 | |
| openstackgerrit | Merged openstack/ironic-python-agent master: Revert jobs to dib https://review.opendev.org/738442 | 17:55 |
| openstackgerrit | Merged openstack/ironic-prometheus-exporter master: Set min version of tox to 3.2.1 https://review.opendev.org/741200 | 17:55 |
| openstackgerrit | Merged openstack/ironic-tempest-plugin master: Set min version of tox to 3.2.1 https://review.opendev.org/741201 | 17:55 |
| openstackgerrit | Merged openstack/ironic-python-agent master: Update version of hacking https://review.opendev.org/743224 | 17:55 |
| openstackgerrit | Merged openstack/ironic-inspector stable/ussuri: Add variable to set inspection timeout in tempest tests https://review.opendev.org/743179 | 17:55 |
| *** ociuhandu has quit IRC | 17:55 | |
| *** ociuhandu has joined #openstack-ironic | 18:14 | |
| *** ociuhandu has quit IRC | 18:19 | |
| openstackgerrit | Julia Kreger proposed openstack/ironic master: Reset power state upon adoption failure https://review.opendev.org/743321 | 19:28 |
| openstackgerrit | Julia Kreger proposed openstack/ironic master: Prevents power sync with ADOPTFAIL nodes https://review.opendev.org/743322 | 19:28 |
| *** SpamapS has quit IRC | 19:46 | |
| *** SpamapS has joined #openstack-ironic | 19:50 | |
| *** ociuhandu has joined #openstack-ironic | 20:10 | |
| *** Lucas_Gray has joined #openstack-ironic | 20:31 | |
| *** uzumaki has joined #openstack-ironic | 20:31 | |
| *** ociuhandu has quit IRC | 20:33 | |
| zaneb | stevebaker: for http basic_auth, is there any advantage in having one username per consumer, or would you just have one user/password combination for each service? | 21:07 |
| zaneb | in a metal³ context | 21:07 |
| stevebaker | zaneb: I think if they're all system users, a single username would be fine, especially considering the services have no direct exposure to human users. Having said that, if the service configuration interface supported more than one username on the server-side that would make no-downtime password rotation possible, but that could be a future thing | 21:13 |
| zaneb | in a practical sense I don't think we're going to be able to change the password without killing the pod anyway | 21:14 |
| zaneb | just because a lot of the setup happens in the pod's init script | 21:14 |
| stevebaker | exactly | 21:14 |
| zaneb | ok, I'll see if that makes it easier | 21:14 |
| zaneb | I'm trying to find a way to have separate passwords for each service and only provide the hash to the service that has to verify it | 21:15 |
| zaneb | currently we just pass the raw password in an environment variable everywhere | 21:15 |
| stevebaker | zaneb: yeah, although ironic needs client credentials for inspector, and vice-versa | 21:16 |
| zaneb | indeed, but they can be different credentials | 21:16 |
| stevebaker | they can be | 21:17 |
| zaneb | stevebaker: I'm wondering how debug will fit into this... maybe it doesn't matter. users will just grab the secret and use the creds in there to log in | 21:22 |
| stevebaker | zaneb: yeah, I guess they would exec into a container in the pod and find the credentials from the config files, but having a pre-rendered credentials file in the container would be nice | 21:40 |
| *** SpamapS has quit IRC | 21:52 | |
| *** rcernin has joined #openstack-ironic | 21:53 | |
| *** SpamapS has joined #openstack-ironic | 21:57 | |
| *** rcernin has quit IRC | 21:58 | |
| *** rcernin has joined #openstack-ironic | 21:59 | |
| *** trandles_ has joined #openstack-ironic | 22:49 | |
| *** tkajinam has joined #openstack-ironic | 22:52 | |
| *** trandles has quit IRC | 22:52 | |
| *** trandles_ is now known as trandles | 22:52 | |
| janders | good morning Ironic o/ | 22:59 |
| *** dking has joined #openstack-ironic | 23:01 | |
| *** hoonetorg has quit IRC | 23:06 | |
| *** trandles has quit IRC | 23:14 | |
| *** hoonetorg has joined #openstack-ironic | 23:19 | |
| TheJulia | good morning | 23:21 |
| janders | hi TheJulia | 23:29 |
| janders | how are things? | 23:29 |
| *** tzumainn has quit IRC | 23:33 | |
| *** janders has quit IRC | 23:58 | |
| *** janders has joined #openstack-ironic | 23:59 | |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!