*** Lucas_Gray has joined #openstack-ironic | 00:12 | |
*** gyee has quit IRC | 00:20 | |
openstackgerrit | Verification of a change to openstack/ironic failed: Auto extend the timeout for RAX hosts https://review.opendev.org/741853 | 00:46 |
---|---|---|
*** k_mouza has joined #openstack-ironic | 01:12 | |
*** k_mouza has quit IRC | 01:16 | |
* TheJulia sighs | 01:27 | |
openstackgerrit | Julia Kreger proposed openstack/ironic master: Add some tuning documentation https://review.opendev.org/739783 | 01:30 |
openstackgerrit | Verification of a change to openstack/ironic-inspector failed: Make inspector base CI job use 2 CPUs https://review.opendev.org/740747 | 01:39 |
*** yaawang has quit IRC | 01:57 | |
*** yaawang has joined #openstack-ironic | 01:58 | |
*** ricolin has joined #openstack-ironic | 02:01 | |
*** rloo has quit IRC | 02:15 | |
openstackgerrit | Jacob Anders proposed openstack/bifrost master: Auto-set ansible_python_interpreter when in venv https://review.opendev.org/742335 | 03:07 |
janders | stevebaker would you have a couple minutes to discuss this change? I need some guidance on the direction I'm taking hance workflow-1 | 03:08 |
stevebaker | janders: yep but I'm about to do a school run, I'll ping you when I'm online | 03:09 |
janders | ok no worries :) I may take a break soon, if I'm quiet I'll be back later | 03:10 |
stevebaker | janders: but also you could ask mwhahaha and cloudnull in #tripleo because they've dealt with every kind of ansible/python interaction | 03:12 |
janders | cool! thanks stevebaker willlllllllllllllllllllllllllllllllllllllllllllllllllllllllllllllllllllllllllllllllllllllllllllllllllllllllll do | 03:13 |
janders | oopss keyboard going nuts again | 03:13 |
janders | time for a new one :) | 03:13 |
*** stevebaker has quit IRC | 03:16 | |
*** stevebaker has joined #openstack-ironic | 03:50 | |
stevebaker | janders: I'm back | 03:51 |
janders | I was just chatting to mwhahaha, got some pointers | 03:53 |
janders | but very interested in hearing your thoughts as well if you have time. I'm not sure if the playbook I'm tweaking is supported to run outside VENV (I don't have a way of making it run unless I activate a VENV) | 03:54 |
stevebaker | janders: my hunch is that the playbook should be left alone, and the thing calling the playbook should set ansible_python_interpreter if it isn't the default | 03:57 |
stevebaker | janders: or maybe there is a local directory ansible.cfg way of doing it | 03:58 |
stevebaker | janders: ah, like this https://docs.ansible.com/ansible/latest/reference_appendices/interpreter_discovery.html | 03:59 |
janders | nice find stevebaker thank you! | 03:59 |
janders | I did try the ansible.cfg approach but without success hence moving on, but from this doco I see what might have been wrong | 04:00 |
janders | will try this | 04:00 |
janders | do you think it's cool to have scripts/env-setup.sh generate ansible.cfg with the appropriate path matching VENV? | 04:01 |
janders | VENV is being stood up in this step so that would be my first idea on where to put config generation | 04:02 |
janders | taking a break, will be back a bit later | 04:23 |
*** rh-jelabarre has quit IRC | 04:25 | |
*** diurnalist has quit IRC | 04:35 | |
*** Lucas_Gray has quit IRC | 04:36 | |
stevebaker | janders: that could be worth looking into, but I don't know where the ansible.cfg should be written to. The current directory? A known location which is referenced each time ansible-playbook is run? dtantsur|afk may have some thoughts on that | 04:41 |
*** stevebaker has quit IRC | 04:52 | |
openstackgerrit | Merged openstack/ironic master: Iso booting via redfish virtual media https://review.opendev.org/727480 | 04:55 |
*** abdysn has joined #openstack-ironic | 04:58 | |
*** tzumainn has quit IRC | 05:08 | |
*** diurnalist has joined #openstack-ironic | 05:32 | |
*** diurnalist has quit IRC | 05:36 | |
*** iurygregory has joined #openstack-ironic | 06:25 | |
iurygregory | good morning Ironic! | 06:26 |
janders | good morning iurygregory o/ | 06:49 |
janders | how are you going? | 06:49 |
rpittau | good morning ironic! o/ | 06:58 |
janders | g'day rpittau! o/ | 07:00 |
rpittau | hey janders :) | 07:01 |
janders | with a little help from stevebaker I think I'm getting on top of ansible+venv challenges | 07:01 |
rpittau | I was reading the log, yeah | 07:01 |
janders | I think my second patch is irrelevant but I'm curious what are your thoughts on the first one: | 07:02 |
janders | https://review.opendev.org/#/c/742192/ | 07:02 |
patchbot | patch 742192 - bifrost - Replace ANSIBLE_COLLECTIONS_PATHS var with symlink - 1 patch set | 07:02 |
iurygregory | hey janders and rpittau o/ | 07:02 |
iurygregory | doing good =) | 07:02 |
rpittau | hey iurygregory :) | 07:02 |
janders | is this an acceptable approach to configuring things up? If so I will add another snippet which will autogenerate ansible config for the playbooks which will force the right python interpreter and we should be closee to done | 07:03 |
janders | iurygregory good to hear! :) | 07:03 |
rpittau | janders: the base check is ok, it will work | 07:06 |
iurygregory | I'm a bit puzzled by " This change replaces the variable based approach..." you need the variable to use the symb link approach no? | 07:06 |
janders | maybe I need to be more clear on which variaable | 07:06 |
iurygregory | in the commit message, seems like we are getting rid off the variable.. | 07:06 |
janders | VENV is all good | 07:06 |
janders | where things were falling apart for me is ANSIBLE_COLLECTIONS_PATHS | 07:07 |
janders | it almost never gets set and this causes the issue where ansible can't find collections that the playbook relies on | 07:07 |
janders | I should have said "exported" not "set" | 07:07 |
rpittau | you're accounting only for the presence or not of the symlink, but that will fail if you have an actual file called collections already in place | 07:07 |
rpittau | which is a remote possibility | 07:08 |
iurygregory | maybe we should create the ansible.cfg and set collections_paths.... | 07:08 |
janders | iurygregory this is a very timely comment cause I'm just working on auto-generating ansible.cfggggggggggggggggg | 07:09 |
janders | sorry sticky keys | 07:09 |
janders | need new keyboardd | 07:09 |
iurygregory | https://docs.ansible.com/ansible/latest/reference_appendices/config.html#collections-paths | 07:09 |
janders | too many trips in a backpack | 07:09 |
iurygregory | I think ansible won't like to many g's =) | 07:09 |
janders | LOL | 07:10 |
rpittau | only limitation is that ansible.cfg must be generated before running ansible :) | 07:10 |
janders | let me add the other snippet and upload the new revision | 07:10 |
*** ociuhandu has quit IRC | 07:10 | |
janders | and I can rewrite the collections stuff in the same fashion if you like this apporach | 07:10 |
rpittau | it's probably more clean, wondering if it might conflict with any other config already in place by the final user | 07:11 |
janders | good point rpittau | 07:11 |
janders | my "defence" against that is I'm writing ansible.cfg in the "playbooks" subdirectory | 07:11 |
janders | so it should override global and user config | 07:11 |
rpittau | mmm ok so pointing to that specifically | 07:11 |
openstackgerrit | Jacob Anders proposed openstack/bifrost master: Replace ANSIBLE_COLLECTIONS_PATHS var with symlink https://review.opendev.org/742192 | 07:14 |
janders | how do you find this? happy to rewrite the collections bit along the same lines | 07:15 |
janders | the commit message will need total rewrite (or I might abandon and resubmit :) ) but I think this captures what I'm trying to do | 07:16 |
iurygregory | when you do git commit --amend you can rewrite the whole commit message =) | 07:17 |
iurygregory | just keep the Change-Id | 07:17 |
janders | ok! can do :) | 07:18 |
iurygregory | otherwise it will generate a new change on gerrit =) | 07:18 |
rpittau | I'm ok for the symlink approach, although I would not limit the check to just symlinks | 07:20 |
rpittau | the python interpreter proably deserves a separate patch | 07:20 |
rpittau | I'm still not sure bypassing other ansible config files is the right approach | 07:20 |
janders | https://review.opendev.org/#/c/742335/ | 07:21 |
patchbot | patch 742335 - bifrost - Auto-set ansible_python_interpreter when in venv - 1 patch set | 07:21 |
janders | that was my other idea | 07:21 |
janders | or I should say the other working idea | 07:22 |
janders | cause I was hoping to address this by setting a custom fact (or an addition to inventory) but in both of those cases the variable seems to be ignored | 07:22 |
janders | it seems to be one of those weird ansible things where a simple fix is surprisingly difficult to make for some reason | 07:23 |
janders | I don't quite understand why it needs interpreter override in the first place instead of just running off VENV interpreter | 07:24 |
rpittau | it's also not how it's explained in the docs :) | 07:24 |
*** rcernin has quit IRC | 07:32 | |
rpittau | thinking a bit more about it, I'm slightly more inclined to the vars approach, just because it's a temporary override | 07:32 |
janders | do we support (or intend to support) running these playbooks outside bifrost VENV context? | 07:34 |
janders | that was my only concern about the vars bit - if VENV wasn't set it would fail | 07:34 |
janders | but having said that I haven't managed to get this playbook to start doing anything without VENV being active | 07:34 |
janders | so maybe this is not a concern? | 07:35 |
rpittau | we currently support only VENV runs | 07:36 |
*** ociuhandu has joined #openstack-ironic | 07:36 | |
janders | good! :) | 07:37 |
rpittau | slightly fewer headaches :D | 07:37 |
janders | agreed | 07:37 |
janders | so - to move forward - would you be happy with two separate fixes: 1) collections/symlink (provided it checks for existence of files, not just symlinks) and 2) var-override based fix for the interpreter issue? | 07:39 |
rpittau | janders: yeah, to me it looks like the best approach at the moment | 07:39 |
rpittau | I guess dtantsur|afk will have his saying :) | 07:39 |
janders | sounds good! | 07:40 |
janders | in the meantime I will carry on with testing and see if these fixes allow me to actually deploy something | 07:40 |
rpittau | sounds good | 07:41 |
janders | without these I couldn't get my C8 node to get to enrolment step, ansible would err out before that | 07:41 |
janders | cool! thanks for your help rpittau and iurygregory much appreciated! :) | 07:41 |
janders | cheers guys | 07:41 |
rpittau | anytime :) | 07:41 |
iurygregory | np =) | 07:41 |
janders | what's the best way to snoop on the VMs when they sit in wait call-back? virt-manager connecting to the beaker node? | 07:42 |
janders | http://paste.openstack.org/show/796198/ | 07:43 |
janders | virsh console doesn't seem to be doing much | 07:43 |
iurygregory | strange .-. | 07:45 |
iurygregory | maybe you can edit the xml? | 07:47 |
janders | I virt-man'ed in, I see splash screens of tinycorelinux | 07:48 |
janders | but the instances are still in "wait call-back" as far as ironic is concerned | 07:49 |
* janders is reading the playbook to learn what tinycorelinux is used for in bifrost | 07:49 | |
rpittau | janders: we use tinycore 10 | 07:50 |
rpittau | janders: if the node is in 'wait call-back' should mean that it's being deployed | 07:51 |
rpittau | janders: a useful reference -> https://docs.openstack.org/ironic/latest/contributor/api/ironic.common.states.html | 07:52 |
janders | agreed, but in this case it's been in this state for quite long and I see the OS login screen | 07:52 |
rpittau | ah | 07:53 |
janders | I had quite a few failures on the way here due to ansible bugs so I suspect something isn't cool. I might need to clean up a bit and recreate the VMs I suspect | 07:53 |
rpittau | the OS login screen of tinycore ? | 07:53 |
janders | correct | 07:53 |
rpittau | ok that's weird | 07:53 |
janders | but if I see that and the instances are in wait-callback I am leaning to think these were deployed by one of the previous installs | 07:53 |
janders | or install attempts I should say | 07:54 |
janders | I did virsh destroy/undefine prior to re-deploying bifrost but perhaps the qcows were spared or something | 07:54 |
janders | I think I might break for dinner now and when I'm back dtantsur|afk will likely be online. Then maybe we can confirm how we want to go about my fixes and I can clean up the test environment and test new patches. | 07:58 |
rpittau | mmmmm so what you're seeing, the login screen, is normal if you used virt-manager, you should check the console instead | 07:58 |
rpittau | janders: enjoy :) | 07:58 |
janders | bifrost doesn't have "uninstall" playbook right? | 07:59 |
janders | okay... so broken virsh console is likely indicating some problem. Good to know! | 07:59 |
janders | rpittau thanks :) | 07:59 |
rpittau | no "uninstall" playbook :/ | 08:00 |
rpittau | np | 08:00 |
*** lucasagomes has joined #openstack-ironic | 08:07 | |
openstackgerrit | Riccardo Pittau proposed openstack/sushy master: Update system schema to 1.10 https://review.opendev.org/742236 | 08:10 |
*** yaawang has quit IRC | 08:13 | |
*** yaawang has joined #openstack-ironic | 08:13 | |
*** dtantsur|afk is now known as dtantsur | 08:52 | |
dtantsur | morning ironic | 08:52 |
iurygregory | I'm wondering if we need to set something else for the partition tests .-. | 08:52 |
iurygregory | morning dtantsur | 08:53 |
dtantsur | janders: "uninstall" is something we should have eventually | 08:53 |
dtantsur | janders: also bifrost saves log output from nodes to somewhere like /var/log/libvirt/baremetal_nodes | 08:54 |
openstackgerrit | Dmitry Tantsur proposed openstack/bifrost master: Support HTTP basic auth and switch bifrost-cli to it https://review.opendev.org/741964 | 09:03 |
iurygregory | dtantsur, seems like the partition test is trying to install grub2 and it fails O.o | 09:03 |
dtantsur | iurygregory: then boot_option:netboot is not applied | 09:04 |
dtantsur | I wonder if nova overwrites instance_info completely | 09:04 |
iurygregory | bad nova =( | 09:04 |
dtantsur | iurygregory: it overwrites capabilities: https://opendev.org/openstack/nova/src/branch/master/nova/virt/ironic/patcher.py#L115 | 09:06 |
iurygregory | enr .-. | 09:06 |
dtantsur | iurygregory: if we cover local boot tests in the standalone job well enough, we can just use netboot in all "large" jobs | 09:07 |
dtantsur | standalone tests control their nodes, there is no nova to interfere | 09:07 |
iurygregory | yeah | 09:07 |
iurygregory | other approach could also be a new parameter "capabilities" ? | 09:09 |
iurygregory | in the nova code maybe | 09:09 |
janders | dtantsur thanks for your comments. I will take notes as I clean up my beaker node - maybe I can turn these into uninstall playbook one day :) | 09:09 |
*** rcernin has joined #openstack-ironic | 09:10 | |
iurygregory | janders++ | 09:10 |
janders | dtantsur we were chatting about my ansible-venv fixes earlier, it would be great to have your thoughts on the possible approaches. Would you have time to chat about this now? | 09:11 |
dtantsur | iurygregory: capabilities are coming from the flavor, you'd have to modify it | 09:11 |
dtantsur | janders: absolutely; I'd appreciate a tl;dr from the scrollback though :) | 09:11 |
iurygregory | we can create a second flavor I assume? | 09:12 |
* iurygregory wondering what would be better | 09:12 | |
janders | I have some proposed patches to choose from that take different approaches: | 09:12 |
janders | https://review.opendev.org/#/c/742192/2/scripts/env-setup.sh | 09:13 |
patchbot | patch 742192 - bifrost - Replace ANSIBLE_COLLECTIONS_PATHS var with symlink - 2 patch sets | 09:13 |
janders | this handles collections issue by symlinking them to the playbook and the interpreter issue by creating a local ansible.cfg override in the playbook dir | 09:13 |
janders | alternative solution to the interpreter issue is this: | 09:14 |
janders | https://review.opendev.org/#/c/742335/1/playbooks/enroll-dynamic.yaml | 09:14 |
patchbot | patch 742335 - bifrost - Auto-set ansible_python_interpreter when in venv - 1 patch set | 09:14 |
janders | (it's based on a top-level var) | 09:14 |
janders | I tried injecting things into dynamic inventory or setting custom facts but didn't have any luck. The ansible.cfg override and vars based approach both fix the interpreter issue. | 09:15 |
janders | question for you is what do you think of these options and do you have preference for a specific one (especially for the interpreter issue) | 09:15 |
dtantsur | janders: does https://review.opendev.org/#/c/742335/ also solve the collections location problem? | 09:16 |
patchbot | patch 742335 - bifrost - Auto-set ansible_python_interpreter when in venv - 1 patch set | 09:16 |
dtantsur | (just to make sure I understand it right) | 09:17 |
janders | no, this only solves the interpreter problem | 09:17 |
janders | to my best knowledge | 09:17 |
janders | but it is a good question that justifies a quick test | 09:17 |
dtantsur | yes please | 09:17 |
* janders is removing the symlink from the former fix and re-testing | 09:18 | |
iurygregory | dtantsur, wdyt if we add a new flavor in https://github.com/openstack/ironic/blob/d867488e90dfe0ff09c35223a842f2407dad1a75/devstack/lib/ironic and we can add a config in the tempest-plugin that would have the id and we can set the flavor for the test? | 09:19 |
janders | the test failed, dropping the output into pastebin | 09:19 |
janders | http://paste.openstack.org/show/796201/ | 09:20 |
janders | I think this is due to a different mechanism in which the collections work - collections rely on an environment variable (which I am having issues with in the current codebase) or the symlink | 09:21 |
janders | there is no desire to go looking for collections in venv if one of those isn't specified AFAIK | 09:21 |
iurygregory | janders, if you have the path in the ansible.cfg does it works without problems? | 09:21 |
dtantsur | iurygregory: there even some flavor_ref_alt: https://github.com/openstack/ironic/blob/d867488e90dfe0ff09c35223a842f2407dad1a75/devstack/lib/ironic#L2993 (not sure what it does) | 09:22 |
* janders testing this now | 09:22 | |
iurygregory | dtantsur, WUT | 09:22 |
dtantsur | janders: does the symlink approach work without 'cd playbooks' (e.g. if you call them from somewhere else)? | 09:22 |
iurygregory | flavor_alt_ref lol | 09:22 |
iurygregory | according to tempest `flavor_ref_alt is only used in tests where two different-sized servers are required (for example, a resize test).` | 09:23 |
iurygregory | but I do think we can workaround this by setting our new flavor as flavor_ref_alt and change the config | 09:24 |
janders | iurygregory if collections_paths=/opt/stack/bifrost/collections/ is set in local ansible.cfg override it does work without the symlink | 09:26 |
janders | dtantsur testing running from another working dir | 09:26 |
iurygregory | I guess we can say that it's necessary to set on the ansible.cfg, we can probably generate the ansible.cfg with this config in the env setup (I think) | 09:27 |
janders | dtantsur ansible.cfg based approach does not work if CWD isn't playbooks. Combination of symlink + vars tweak DOES WORK. | 09:29 |
dtantsur | janders: I'd go for the latter then (+ documentation for those who build custom venv) | 09:30 |
dtantsur | the only thing about the vars tweak: I think it should go to each role that relies on the collection | 09:30 |
dtantsur | because people can use custom playbooks based on our roles | 09:30 |
janders | ok! I can do that. | 09:31 |
janders | I will just make sure-sure it still works (ansible gave me a lot of grief today silently ignoring interpreter overrides from a lot of places in code) but I think it will | 09:32 |
dtantsur | janders: as a bonus, you'll be able to use our standard defaults (bifrost_venv_dir and so on) | 09:33 |
*** dsneddon has quit IRC | 09:33 | |
janders | nice! :) | 09:33 |
janders | I'm glad all the years of hacking on ansible didn't go to waste :) | 09:33 |
dtantsur | heh, good indeed :) | 09:34 |
janders | looks like 7 roles out of 20 would need changes | 09:35 |
*** rcernin has quit IRC | 09:35 | |
janders | is recursive grepping for openstack.cloud in the roles dir a sufficient check what roles need collections? I suppose so... | 09:36 |
iurygregory | dtantsur, I will go with the flavor_ref_alt approach, to get some results =) | 09:37 |
dtantsur | janders: we haven't fully switched to collections yet, but everything that uses os_* will also need this hack eventually | 09:37 |
dtantsur | if iurygregory does not object, you can pick up the task of switching them ;) | 09:38 |
dtantsur | iurygregory: let's give it a try indeed | 09:38 |
iurygregory | I have no problem, my plan was to do next week =) | 09:39 |
*** hjensas has quit IRC | 09:39 | |
janders | ok! :) I will just check priorities with shadower cause I know he wanted me to look aat deploying OCP/IPI on some nodes. Having said that I'm more than happy to pick this up! :) | 09:44 |
dtantsur | maybe you can split the load? :) I'm not trying to pick on you, but ansible 2.10 will not have the os_* modules and they're deprecated aliases in the collection | 09:45 |
dtantsur | so we're not in a big hurry, but we also cannot delay the switch indefinitely | 09:45 |
iurygregory | yeah | 09:45 |
dtantsur | (mostly setting up context for shadower ^^^) | 09:45 |
shadower | I appreciate it | 09:46 |
iurygregory | shadower is back \o/ | 09:46 |
shadower | o/ | 09:46 |
iurygregory | `openstack flavor set altbaremetal --property "capabilities:boot_option"="netboot"` this is correct right dtantsur ? | 09:48 |
openstackgerrit | Iury Gregory Melo Ferreira proposed openstack/ironic master: Create altbaremetal flavor https://review.opendev.org/742381 | 09:51 |
*** k_mouza has joined #openstack-ironic | 09:53 | |
janders | dtantsur I moved the interpreter to the role vars as you suggested, it works fine (and I like it, it's cleaner). Before I start applying this more widely, can you confirm if this is how you wanted it to be done? | 09:56 |
janders | http://paste.openstack.org/show/796204/ | 09:56 |
openstackgerrit | Iury Gregory Melo Ferreira proposed openstack/ironic-tempest-plugin master: Update basic_ops https://review.opendev.org/741445 | 10:00 |
* iurygregory fingers crossed | 10:00 | |
iurygregory | we will probably need to backport the alt flavor to stable branches otherwise CI will *BOOM* | 10:02 |
dtantsur | iurygregory: 1. I think so, 2. Let's somehow skip the partition test if the flavor is not provided and default_boot_option is local? | 10:03 |
iurygregory | makes sense | 10:04 |
iurygregory | I was thinking in removing the "default_boot_option", but maybe will be useful for other cases in the future so I will re add that, and add the skip | 10:05 |
dtantsur | janders: I think to account for all variables we need to do something like http://paste.openstack.org/show/796205/ | 10:06 |
janders | ACK! thank you dtantsur | 10:07 |
janders | I will aim to progress further on the fixes tomorrow - wrapping up for tonight as I'm aiming to have a go at our 5am (my time) meeting | 10:09 |
janders | thank you for your help and guidance today dtantsur rpittau iurygregory - invaluable! | 10:10 |
janders | have a good one and we'll speak tomorrow | 10:10 |
iurygregory | janders, good night! you are welcome =) | 10:10 |
*** yaawang has quit IRC | 10:11 | |
dtantsur | g'night! | 10:13 |
*** yaawang has joined #openstack-ironic | 10:13 | |
janders | apologies if I am slightly late tomorrow :) | 10:13 |
dtantsur | no worries :) | 10:13 |
*** yaawang has quit IRC | 10:20 | |
*** yaawang has joined #openstack-ironic | 10:21 | |
openstackgerrit | Dmitry Tantsur proposed openstack/bifrost master: Use random passwords by default https://review.opendev.org/742203 | 10:31 |
*** priteau has joined #openstack-ironic | 10:33 | |
*** Lucas_Gray has joined #openstack-ironic | 10:41 | |
openstackgerrit | Verification of a change to openstack/ironic-lib failed: Support more bcrypt prefixes https://review.opendev.org/738718 | 10:42 |
*** ricolin has quit IRC | 10:48 | |
*** tkajinam has quit IRC | 10:59 | |
*** sshnaidm is now known as sshnaidm|afk | 11:14 | |
openstackgerrit | Dmitry Tantsur proposed openstack/bifrost master: Use random passwords by default https://review.opendev.org/742203 | 11:14 |
*** uzumaki has joined #openstack-ironic | 11:31 | |
*** rcernin has joined #openstack-ironic | 11:49 | |
*** rh-jelabarre has joined #openstack-ironic | 12:00 | |
*** ociuhandu has quit IRC | 12:03 | |
*** ociuhandu_ has joined #openstack-ironic | 12:03 | |
openstackgerrit | Iury Gregory Melo Ferreira proposed openstack/ironic-tempest-plugin master: Update basic_ops https://review.opendev.org/741445 | 12:08 |
*** Goneri has joined #openstack-ironic | 12:25 | |
*** rloo has joined #openstack-ironic | 12:28 | |
*** m1p_ has joined #openstack-ironic | 12:31 | |
iurygregory | seems like test_baremetal_vm_multitenancy didn't like my approach, maybe we can just use flavor_ref in the multitenancy test, thoughts? | 12:32 |
openstackgerrit | Iury Gregory Melo Ferreira proposed openstack/ironic-tempest-plugin master: Update basic_ops https://review.opendev.org/741445 | 12:34 |
*** m1p has quit IRC | 12:38 | |
*** seba has quit IRC | 12:38 | |
*** m1p_ is now known as m1p | 12:38 | |
*** mkowalski has quit IRC | 12:40 | |
*** seba has joined #openstack-ironic | 12:42 | |
*** mkowalski has joined #openstack-ironic | 12:49 | |
openstackgerrit | Dmitry Tantsur proposed openstack/bifrost master: Use random passwords by default https://review.opendev.org/742203 | 12:50 |
dtantsur | iurygregory: not familiar with this test | 12:50 |
iurygregory | dtantsur, I gave a try, since the VM that is create was using flavor_ref_alt (and before it was the same as flavor_ref) | 12:50 |
iurygregory | so let's see =) | 12:51 |
dtantsur | makes sense | 12:51 |
TheJulia | good morning | 12:51 |
dtantsur | morning TheJulia | 12:51 |
iurygregory | good morning TheJulia =) | 12:51 |
dtantsur | iurygregory: you can ask dradez or mchapman (e.g. downstream on #rhos-netansible) why the test was written this way | 12:51 |
iurygregory | dtantsur, gotcha will ask | 12:52 |
iurygregory | maybe in their setup the flavor_alt_ref is different... | 12:52 |
iurygregory | but in our CI we were using the same.. | 12:53 |
* iurygregory doesn't want to break things | 12:53 | |
openstackgerrit | Verification of a change to openstack/ironic failed: Extend base build timeouts https://review.opendev.org/741818 | 12:56 |
*** tzumainn has joined #openstack-ironic | 12:57 | |
dtantsur | oh, nice music on opendev today :) | 12:58 |
*** sshnaidm|afk is now known as sshnaidm | 13:29 | |
*** bnemec has joined #openstack-ironic | 13:30 | |
*** rcernin has quit IRC | 13:32 | |
*** bfournie has joined #openstack-ironic | 13:34 | |
openstackgerrit | Riccardo Pittau proposed openstack/ironic-python-agent master: Fix versions in release notes https://review.opendev.org/742431 | 13:42 |
*** ricolin has joined #openstack-ironic | 13:43 | |
openstackgerrit | Dmitry Tantsur proposed openstack/bifrost master: Use random passwords by default https://review.opendev.org/742203 | 13:46 |
openstackgerrit | Dmitry Tantsur proposed openstack/bifrost master: Use random passwords by default https://review.opendev.org/742203 | 13:50 |
openstackgerrit | Dmitry Tantsur proposed openstack/bifrost master: [WIP] Support HTTP basic auth and switch bifrost-cli to it https://review.opendev.org/741964 | 13:59 |
*** uzumaki has quit IRC | 14:09 | |
*** yolanda has quit IRC | 14:10 | |
openstackgerrit | Dmitry Tantsur proposed openstack/bifrost master: Use random passwords by default https://review.opendev.org/742203 | 14:11 |
*** abdysn has quit IRC | 14:11 | |
*** yolanda has joined #openstack-ironic | 14:12 | |
*** dsneddon has joined #openstack-ironic | 14:19 | |
*** dsneddon has quit IRC | 14:26 | |
openstackgerrit | Dmitry Tantsur proposed openstack/bifrost master: Use random passwords by default https://review.opendev.org/742203 | 14:32 |
dtantsur | keystone is going to drive me nuts | 14:34 |
iurygregory | what happen? | 14:37 |
iurygregory | happened* | 14:38 |
iurygregory | interesting, the flavor_ref_alt is set but tempest didn't use O.o | 14:39 |
*** bfournie has quit IRC | 14:45 | |
*** bfournie has joined #openstack-ironic | 14:48 | |
dtantsur | iurygregory: keystone has a "feature" that locks you out of your account after N login attempts | 14:48 |
dtantsur | sounds okay, until you realize it's a service supposed to be used on public clouds | 14:49 |
iurygregory | you can't override the N? | 14:49 |
dtantsur | you can, but what's the point? | 14:49 |
dtantsur | as long as this feature is enabled, anybody on the network can lock out anyone by their user name + domain ID | 14:49 |
dtantsur | which is exactly what I've just done to myself :) | 14:50 |
openstackgerrit | Iury Gregory Melo Ferreira proposed openstack/ironic-tempest-plugin master: Update basic_ops https://review.opendev.org/741445 | 14:52 |
iurygregory | dtantsur, ouch! | 14:52 |
iurygregory | =X | 14:52 |
dtantsur | okay, it's not forever by default, it's half an hour (which is eternity for a public cloud) | 14:53 |
openstackgerrit | Dmitry Tantsur proposed openstack/bifrost master: Disable keystone account locking by default https://review.opendev.org/742456 | 14:55 |
dtantsur | iurygregory: ^^^ | 14:57 |
*** diurnalist has joined #openstack-ironic | 14:58 | |
openstackgerrit | Dmitry Tantsur proposed openstack/bifrost master: Use random passwords by default https://review.opendev.org/742203 | 14:58 |
iurygregory | looking | 14:58 |
openstackgerrit | Dmitry Tantsur proposed openstack/bifrost master: Support configuring credential-less deploy https://review.opendev.org/741894 | 14:59 |
*** k_mouza has quit IRC | 15:00 | |
*** k_mouza has joined #openstack-ironic | 15:01 | |
openstackgerrit | Dmitry Tantsur proposed openstack/bifrost master: [WIP] Support HTTP basic auth and switch bifrost-cli to it https://review.opendev.org/741964 | 15:01 |
*** rcernin has joined #openstack-ironic | 15:25 | |
openstackgerrit | Dmitry Tantsur proposed openstack/bifrost master: [WIP] Support HTTP basic auth and switch bifrost-cli to it https://review.opendev.org/741964 | 15:25 |
*** rcernin has quit IRC | 15:29 | |
*** k_mouza has quit IRC | 15:41 | |
openstackgerrit | Merged openstack/ironic stable/train: Stop running test_schedule_to_all_nodes in the multinode job https://review.opendev.org/742215 | 15:43 |
*** k_mouza has joined #openstack-ironic | 15:44 | |
*** gyee has joined #openstack-ironic | 15:48 | |
iurygregory | dtantsur, https://docs.openstack.org/ironic/latest/configuration/config.html#json-rpc .-. | 15:54 |
rpioso | pas-ha: Can https://review.opendev.org/#/c/732158/ be abandoned? | 15:54 |
patchbot | patch 732158 - ironic (stable/train) - Revert "redfish: handle hardware that is unable to... - 2 patch sets | 15:54 |
iurygregory | http_basic_username and http_basic_password .-. | 15:54 |
dtantsur | iurygregory: yeah, dunno how we missed that | 15:54 |
dtantsur | I'm fixing it now (with deprecation, SIGH) | 15:54 |
rpioso | pas-ha: I believe the fix merged on stable/train: https://review.opendev.org/#/c/736941/ | 15:54 |
patchbot | patch 736941 - ironic (stable/train) - Fix Redfish handle no continuous override boot src (MERGED) - 1 patch set | 15:54 |
iurygregory | oh we need to deprecated because we have a release right? | 15:55 |
pas-ha | rpioso: seems like can be abandoned indeed | 15:55 |
*** k_mouza has quit IRC | 15:55 | |
dtantsur | iurygregory: yeaaah :( | 15:56 |
rpioso | pas-ha: Cool! Thank you. | 15:56 |
* iurygregory cries =( | 15:56 | |
*** lucasagomes has quit IRC | 15:57 | |
rpioso | pas-ha: Also, it seems like https://review.opendev.org/#/c/732122/ should be all set now. Please consider removing the Workflow-1. | 15:58 |
patchbot | patch 732122 - ironic (stable/train) - Remove iDRAC Redfish boot device known issue - 1 patch set | 15:58 |
openstackgerrit | Merged openstack/ironic master: Use native oslo.concurrency execution timeout in ipmitool https://review.opendev.org/738591 | 15:58 |
rpioso | pas-ha: Errr Code-Review-1 | 15:58 |
pas-ha | yep, done too | 15:59 |
rpioso | pas-ha: :-) | 15:59 |
openstackgerrit | Verification of a change to openstack/ironic failed: Stop running test_schedule_to_all_nodes in the multinode job https://review.opendev.org/742214 | 15:59 |
openstackgerrit | Dmitry Tantsur proposed openstack/bifrost master: [WIP] Support HTTP basic auth and switch bifrost-cli to it https://review.opendev.org/741964 | 16:06 |
openstackgerrit | Merged openstack/bifrost master: Disable keystone account locking by default https://review.opendev.org/742456 | 16:08 |
openstackgerrit | Dmitry Tantsur proposed openstack/ironic master: Deprecate http_basic_username and http_basic_password in [json_rpc] https://review.opendev.org/742474 | 16:10 |
dtantsur | iurygregory: ^^ | 16:13 |
dtantsur | I got hit by it in my bifrost patch | 16:13 |
iurygregory | dtantsur, ack | 16:14 |
iurygregory | at least on the bright side we have username/password for inspector =) | 16:17 |
TheJulia | yay opendev is over! | 16:18 |
*** ricolin has quit IRC | 16:19 | |
*** bfournie has quit IRC | 16:20 | |
dtantsur | :) | 16:20 |
TheJulia | Would it help folks if I were to update the review list on the etherpad because we have a few fixes that could use some review traffic | 16:21 |
dtantsur | TheJulia: once you get enough rest, I'd be curious to hear your opinion on https://review.opendev.org/742203 | 16:21 |
patchbot | patch 742203 - bifrost - Use random passwords by default - 11 patch sets | 16:21 |
dtantsur | TheJulia++ | 16:21 |
* TheJulia goes and makes a fresh pot of coffee before updating the etherpad | 16:21 | |
iurygregory | I'm still doing something wrong since partition test are still failing even with using the other flavor .-. | 16:23 |
*** Lucas_Gray has quit IRC | 16:24 | |
*** jadonn has joined #openstack-ironic | 16:24 | |
openstackgerrit | Dmitry Tantsur proposed openstack/ironic master: Add an option to choose the hash ring algorithm https://review.opendev.org/739779 | 16:28 |
dtantsur | fixes ironic in FIPS mode, reviews appreciated ^^^ | 16:28 |
dtantsur | well, it doesn't fix automatically, but makes it possible to fix | 16:28 |
iurygregory | I thought the fix was on tooz only | 16:30 |
dtantsur | unfortunately, no | 16:30 |
dtantsur | we cannot just switch tooz to sha256, it would be breaking for rolling upgrades | 16:31 |
*** Lucas_Gray has joined #openstack-ironic | 16:31 | |
*** dtantsur is now known as dtantsur|afk | 16:35 | |
dtantsur|afk | o/ | 16:35 |
TheJulia | :( | 16:35 |
TheJulia | Yeah, I was suspecting that would be the case | 16:35 |
openstackgerrit | Zygimantas Matonis proposed openstack/ironic-inspector master: WIP: adding condition_join to rules. https://review.opendev.org/731794 | 16:38 |
TheJulia | crazy question: What if on rax hosts, we change a default on jobs where we don't build IPA to use tinycore? | 16:53 |
TheJulia | https://8fedc9098215014c7687-39f5f8dab729bdab706fbbfdb548a0f1.ssl.cf1.rackcdn.com/741818/5/gate/ironic-tempest-ipa-wholedisk-bios-agent_ipmitool-indirect/695d93c/controller/logs/ironic-bm-logs/ <-- because the dib images running in RAX just seem like we're never going to balance things if we don't | 16:58 |
*** sshnaidm is now known as sshnaidm|afk | 17:09 | |
*** ociuhandu has joined #openstack-ironic | 17:11 | |
*** ociuhandu_ has quit IRC | 17:14 | |
*** ociuhandu has quit IRC | 17:16 | |
*** dsneddon has joined #openstack-ironic | 17:16 | |
openstackgerrit | Julia Kreger proposed openstack/ironic-inspector master: Respond so Apache HTTPd doesn't think the request failed https://review.opendev.org/740344 | 17:18 |
*** ociuhandu has joined #openstack-ironic | 17:22 | |
*** Nisha_Agarwal has joined #openstack-ironic | 17:22 | |
*** Lucas_Gray has quit IRC | 17:23 | |
*** sshnaidm|afk has quit IRC | 17:23 | |
*** ociuhandu has quit IRC | 17:26 | |
*** sshnaidm has joined #openstack-ironic | 17:27 | |
*** sshnaidm is now known as sshnaidm|afk | 17:27 | |
openstackgerrit | Julia Kreger proposed openstack/ironic master: Extend PXE boot retry timeout for RAX hosts https://review.opendev.org/742501 | 17:38 |
openstackgerrit | Julia Kreger proposed openstack/ironic master: Extend PXE boot retry timeout for RAX hosts https://review.opendev.org/742501 | 17:41 |
*** paraplan has joined #openstack-ironic | 17:43 | |
openstackgerrit | Julia Kreger proposed openstack/ironic master: Force RAX hosts to run tinyipa https://review.opendev.org/742502 | 17:50 |
*** k_mouza has joined #openstack-ironic | 17:55 | |
*** k_mouza has quit IRC | 17:59 | |
TheJulia | On the list of review priorities there are 6 changes which should address most of our current sporatic CI failures or major issues that are problematic | 17:59 |
gudrutis0 | very knew this kind of status code existed https://httpstatuses.com/418 | 18:10 |
gudrutis0 | newer* | 18:10 |
TheJulia | please let me guess without looking... it is a teapot? | 18:10 |
TheJulia | Anyone know if Doug Szumski frequents irc? | 18:11 |
TheJulia | lol, it is a teapot | 18:12 |
TheJulia | Ironic should respond with that at some point | 18:12 |
TheJulia | Maybe out of memory + auth failed | 18:12 |
openstackgerrit | Julia Kreger proposed openstack/ironic-python-agent master: Fix bootloader install issue with MDRAID https://review.opendev.org/740331 | 18:17 |
openstackgerrit | Merged openstack/ironic-lib master: Support more bcrypt prefixes https://review.opendev.org/738718 | 18:19 |
TheJulia | Anyone remember what james denton's irc nick is? | 18:24 |
*** jj123 has joined #openstack-ironic | 18:54 | |
openstackgerrit | Julia Kreger proposed openstack/ironic stable/stein: Pin the python-ibmcclient upper bounds due to six usage https://review.opendev.org/742512 | 19:01 |
*** bnemec has quit IRC | 19:03 | |
*** stevebaker has joined #openstack-ironic | 19:05 | |
*** Nisha_Agarwal has quit IRC | 19:27 | |
janders | g'day Ironic! o/ | 19:28 |
stevebaker | janders: you're up early | 19:28 |
janders | haha just a little | 19:28 |
janders | I'm more of a morning person so this is not too bad | 19:29 |
janders | just need a doubleshot flat white and she'll be right | 19:30 |
janders | :) | 19:30 |
stevebaker | lol | 19:30 |
*** ociuhandu has joined #openstack-ironic | 19:31 | |
janders | that's something I love about visiting Wellington -being able to get a nice takeaway cofee any time of the day | 19:31 |
janders | (or night) | 19:31 |
*** ociuhandu_ has joined #openstack-ironic | 19:34 | |
*** ociuhand_ has joined #openstack-ironic | 19:35 | |
*** paraplan has quit IRC | 19:35 | |
*** ociuhandu has quit IRC | 19:36 | |
*** ociuhandu_ has quit IRC | 19:38 | |
*** diurnalist has quit IRC | 19:38 | |
* TheJulia could use a flat white at the moment | 19:43 | |
*** adrianc_ has joined #openstack-ironic | 19:44 | |
*** ociuhand_ has quit IRC | 19:45 | |
*** adrianc has quit IRC | 19:47 | |
*** jj123 has quit IRC | 19:50 | |
openstackgerrit | Jacob Anders proposed openstack/bifrost master: Create symlink to ansible collections on install https://review.opendev.org/742192 | 19:53 |
openstackgerrit | Merged openstack/ironic-python-agent master: Adds poll mode deployment support https://review.opendev.org/694461 | 19:53 |
*** jj123 has joined #openstack-ironic | 19:53 | |
janders | Regarding https://review.opendev.org/742192 - do we need to update the doco here: https://docs.openstack.org/bifrost/latest/install/index.html#dependencies and mention the creation of the symlink? | 19:57 |
patchbot | patch 742192 - bifrost - Create symlink to ansible collections on install - 3 patch sets | 19:57 |
janders | if so, should the doco update be a part of the same change proposal, or would that be separate? | 19:57 |
*** yolanda has quit IRC | 20:05 | |
*** yolanda has joined #openstack-ironic | 20:08 | |
*** diurnalist has joined #openstack-ironic | 20:13 | |
*** tzumainn has quit IRC | 20:22 | |
openstackgerrit | Verification of a change to openstack/ironic failed: Stop running test_schedule_to_all_nodes in the multinode job https://review.opendev.org/742214 | 20:44 |
*** priteau has quit IRC | 20:47 | |
* arne_wiebalck realises it is probably time to call it a day when he sees janders leave and come back :) | 20:48 | |
arne_wiebalck | bye everyone, cu tmrw o/ | 20:48 |
janders | have a good one arne_wiebalck | 20:53 |
*** bnemec has joined #openstack-ironic | 21:04 | |
jj123 | I could use some guidance on identifying a known-good recipe for the example DevStack ironic build at https://docs.openstack.org/ironic/latest/contributor/dev-quickstart.html. After following the recipe on an Ubuntu 18.04.4 VirtualBox VM, My node is available in `openstack baremetal node list`, but is shown as 'ERROR None NOSTATE' in `openstack | 21:05 |
jj123 | server list --long`. From a fresh unstack.sh/clean.sh/stack.sh, tempest ironic tests fail: test_baremetal_server_ops_partition_image, test_baremetal_server_ops_wholedisk_image. I've made no changes from the example, except to checkout the devstack:stable/ussuri branch and a few minor workarounds to complete the stash.sh build. | 21:05 |
jj123 | I want to achieve a functional starting point that allows me to create and access baremetal instances. Is there a reference environment + script and/or CI recipe that is known to work? I'd prefer a local VM, but am flexible to use a different hypervisor, a cloud instance or physical server. | 21:06 |
*** bnemec has quit IRC | 21:11 | |
janders | jj123 do you need full devstack, or would ironic-standalone suffice for your needs? | 21:11 |
jj123 | I want the whole devstack (or similar set of capabilities) to exercise all of the ironic / device features as they would work in an OpenStack deployment. | 21:13 |
janders | I'm focusing specifically on ironic, so bifrost works pretty well https://docs.openstack.org/bifrost/latest/ I don't have recent experience with devstack but perhaps others will be able to help | 21:14 |
jj123 | The scope of my development will likely be creating a redfish-compatible BMC for an in-house server appliance, a custom hardware type in ironic so I can manage it, and an application that wraps access to an OpenStack deployment that includes the devices, but also uses other OpenStack services. | 21:18 |
*** bnemec has joined #openstack-ironic | 21:18 | |
openstackgerrit | Jacob Anders proposed openstack/bifrost master: Auto-set ansible_python_interpreter when in venv https://review.opendev.org/742335 | 21:24 |
*** cdearborn has joined #openstack-ironic | 21:25 | |
jj123 | I've got devstack (without ironic) working ok, and ironic standalone working ok. Perhaps it makes sense to try to get a non-ironic devstack to talk to a standalone ironic... | 21:28 |
openstackgerrit | Julia Kreger proposed openstack/ironic master: Force RAX hosts to run tinyipa https://review.opendev.org/742502 | 21:40 |
openstackgerrit | Merged openstack/ironic stable/stein: Pin the python-ibmcclient upper bounds due to six usage https://review.opendev.org/742512 | 21:42 |
TheJulia | jj123: our published devstack configs are typically reliable... although thtey typically don't trigger tempest | 21:43 |
TheJulia | also openstack baremetal node list might be more insightful as to the state of youre test machine | 21:43 |
TheJulia | only a little bit gets surfaced to nova. | 21:43 |
*** ociuhandu has joined #openstack-ironic | 21:46 | |
iurygregory | jj123, if you want standalone you can try http://paste.openstack.org/show/796224/ | 21:47 |
*** rh-jlabarre has joined #openstack-ironic | 21:47 | |
iurygregory | what I normaly do is get the local.conf from the jobs set ERROR_ON_CLONE to false, and remove HOST_IP and SERVICE_HOST | 21:48 |
*** ociuhandu has quit IRC | 21:50 | |
*** rh-jelabarre has quit IRC | 21:51 | |
openstackgerrit | Merged openstack/ironic-python-agent master: Fix bootloader install issue with MDRAID https://review.opendev.org/740331 | 22:13 |
openstackgerrit | Zygimantas Matonis proposed openstack/ironic-inspector master: WIP: adding condition_join to rules. https://review.opendev.org/731794 | 22:28 |
*** Lucas_Gray has joined #openstack-ironic | 22:32 | |
openstackgerrit | Julia Kreger proposed openstack/ironic stable/stein: Allow retrying PXE boot if it takes too long https://review.opendev.org/742313 | 22:34 |
*** jj123 has quit IRC | 22:50 | |
*** rcernin has joined #openstack-ironic | 22:52 | |
openstackgerrit | Steve Baker proposed openstack/ironic-inspector master: Add public api support to basic auth https://review.opendev.org/742306 | 22:53 |
*** rcernin has quit IRC | 22:58 | |
*** rcernin has joined #openstack-ironic | 23:01 | |
*** rcernin has quit IRC | 23:04 | |
*** rcernin has joined #openstack-ironic | 23:05 | |
*** Lucas_Gray has quit IRC | 23:09 | |
janders | with the patches fixing up ansible-collection and python interpreter paths I was able to deploy Bifrost on C8 seamlessly, zero errors on the way | 23:12 |
janders | i did notice a couple things that seemed unexpected though | 23:13 |
janders | after deploying instances | 23:13 |
janders | are the "baremetal" nodes expected to have the IP addresses listed in the json inventory? | 23:14 |
janders | (mine came up with some random ones) | 23:14 |
janders | and second question: are we using tinycore linux as IPA image? | 23:15 |
*** jj123 has joined #openstack-ironic | 23:16 | |
TheJulia | Depends on settings but yes, tinycore does get used as one of the two ipa images we test with | 23:17 |
janders | thank you TheJulia | 23:17 |
TheJulia | I think ip addresses in the inventory are optional because that is also driven fromtest case, if it is dhcp only or not | 23:17 |
janders | noted! | 23:18 |
janders | with standalone, is there a way of figuring out what IPs got allocated without consoling into the VMs? | 23:18 |
janders | it feels like libvirt allocates random IPs and ironic has done it's job by the time it comes to that so my guess is no... | 23:19 |
jj123 | TheJulia Thanks. I added and ran tempest myself following the DevStack Quickstart (https://docs.openstack.org/ironic/latest/contributor/dev-quickstart.html), to troubleshoot. For the emulated baremetal node, `openstack baremetal node list` looked fine. For some reason the corresponding nova entry didn't match the tutorial... nova Status was ERROR, | 23:20 |
jj123 | Power State was NOSTATE, and no network listed. | 23:20 |
jj123 | iurygregory Thanks. I'll try that config. | 23:20 |
*** yolanda has quit IRC | 23:23 | |
*** yolanda has joined #openstack-ironic | 23:24 | |
*** diurnalist has quit IRC | 23:26 | |
openstackgerrit | Merged openstack/ironic stable/ussuri: Fix the error message when reached max number of traits https://review.opendev.org/739477 | 23:43 |
*** ociuhandu has joined #openstack-ironic | 23:47 | |
*** ociuhandu has quit IRC | 23:52 |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!