| *** crushil has joined #openstack-ironic | 00:05 | |
| VisBits | I have my provisioning_network set in ironic.conf but when I deploy an instance to it, the dhcp configuration is written for the instance network instead of provision. Ideas? | 00:13 |
|---|---|---|
| *** sasha2 has quit IRC | 00:20 | |
| *** milan has joined #openstack-ironic | 00:23 | |
| *** bfournie has joined #openstack-ironic | 00:25 | |
| *** yangyapeng has quit IRC | 00:27 | |
| *** fragatina has joined #openstack-ironic | 00:31 | |
| *** fragatina has quit IRC | 00:37 | |
| *** fragatina has joined #openstack-ironic | 00:40 | |
| *** milan has quit IRC | 00:43 | |
| *** sasha2 has joined #openstack-ironic | 00:51 | |
| *** fragatina has quit IRC | 00:52 | |
| *** tzumainn has quit IRC | 00:52 | |
| *** rloo has quit IRC | 00:56 | |
| *** yangyapeng has joined #openstack-ironic | 01:00 | |
| *** racedo_ has joined #openstack-ironic | 01:01 | |
| *** phuongnh has joined #openstack-ironic | 01:03 | |
| *** liuzz has joined #openstack-ironic | 01:03 | |
| *** racedo has quit IRC | 01:03 | |
| *** yangyapeng has quit IRC | 01:04 | |
| *** yangyapeng has joined #openstack-ironic | 01:14 | |
| *** VisBits has quit IRC | 01:20 | |
| openstackgerrit | Yusef Shaban proposed openstack/sushy master: Implement Redfish Sessions https://review.openstack.org/471942 | 01:23 |
| *** pmannidi has joined #openstack-ironic | 01:30 | |
| *** VisBits has joined #openstack-ironic | 01:31 | |
| *** zhangfei has joined #openstack-ironic | 01:39 | |
| *** sapd__ has joined #openstack-ironic | 01:43 | |
| *** sapd_ has quit IRC | 01:43 | |
| *** jlabarre has quit IRC | 01:48 | |
| *** crushil_ has joined #openstack-ironic | 01:53 | |
| *** crushil has quit IRC | 01:57 | |
| *** masber has joined #openstack-ironic | 02:00 | |
| *** crushil_ has quit IRC | 02:00 | |
| *** threestrands_ has joined #openstack-ironic | 02:02 | |
| *** masuberu has quit IRC | 02:02 | |
| *** zhangfei has quit IRC | 02:04 | |
| *** zhangfei has joined #openstack-ironic | 02:04 | |
| *** jappleii__ has quit IRC | 02:04 | |
| openstackgerrit | Yusef Shaban proposed openstack/sushy master: Implement Redfish Sessions https://review.openstack.org/471942 | 02:44 |
| *** phuongnh has quit IRC | 02:45 | |
| *** phuongnh has joined #openstack-ironic | 02:45 | |
| *** hshiina has joined #openstack-ironic | 02:49 | |
| *** phuongnh has quit IRC | 02:50 | |
| *** phuongnh has joined #openstack-ironic | 02:51 | |
| *** kiseok7 has quit IRC | 03:08 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/bifrost master: Updated from global requirements https://review.openstack.org/533856 | 03:17 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/ironic master: Updated from global requirements https://review.openstack.org/533875 | 03:24 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/ironic-inspector master: Updated from global requirements https://review.openstack.org/533876 | 03:24 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/ironic-lib master: Updated from global requirements https://review.openstack.org/533877 | 03:24 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/ironic-tempest-plugin master: Updated from global requirements https://review.openstack.org/532954 | 03:24 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/ironic-python-agent master: Updated from global requirements https://review.openstack.org/529949 | 03:24 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/networking-baremetal master: Updated from global requirements https://review.openstack.org/533901 | 03:31 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/networking-generic-switch master: Updated from global requirements https://review.openstack.org/533903 | 03:31 |
| *** rbudden has quit IRC | 03:42 | |
| *** penick has joined #openstack-ironic | 03:47 | |
| *** jaianshu has joined #openstack-ironic | 03:47 | |
| *** namnh has joined #openstack-ironic | 03:52 | |
| *** Nisha_Agarwal has joined #openstack-ironic | 03:59 | |
| *** Nisha_Agarwal has quit IRC | 04:00 | |
| *** penick has quit IRC | 04:05 | |
| *** links has joined #openstack-ironic | 04:06 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/ironic master: Updated from global requirements https://review.openstack.org/533875 | 04:08 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/ironic-inspector master: Updated from global requirements https://review.openstack.org/533876 | 04:08 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/ironic-lib master: Updated from global requirements https://review.openstack.org/533877 | 04:08 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/ironic-python-agent master: Updated from global requirements https://review.openstack.org/529949 | 04:08 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/ironic-ui master: Updated from global requirements https://review.openstack.org/533963 | 04:09 |
| *** zhangfei has quit IRC | 04:09 | |
| *** cjloader has joined #openstack-ironic | 04:12 | |
| *** etingof has quit IRC | 04:14 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/networking-baremetal master: Updated from global requirements https://review.openstack.org/533901 | 04:14 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/networking-baremetal master: Updated from global requirements https://review.openstack.org/533901 | 04:14 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/networking-generic-switch master: Updated from global requirements https://review.openstack.org/533903 | 04:15 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/networking-baremetal master: Updated from global requirements https://review.openstack.org/533901 | 04:15 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/networking-generic-switch master: Updated from global requirements https://review.openstack.org/533903 | 04:16 |
| *** cjloader has quit IRC | 04:17 | |
| *** zhangfei has joined #openstack-ironic | 04:20 | |
| *** etingof has joined #openstack-ironic | 04:28 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/python-ironicclient master: Updated from global requirements https://review.openstack.org/534023 | 04:30 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/python-ironicclient master: Updated from global requirements https://review.openstack.org/534024 | 04:30 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/sushy master: Updated from global requirements https://review.openstack.org/534055 | 04:35 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/sushy master: Updated from global requirements https://review.openstack.org/534056 | 04:35 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/sushy master: Updated from global requirements https://review.openstack.org/534057 | 04:35 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/sushy-tools master: Updated from global requirements https://review.openstack.org/534058 | 04:35 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/sushy-tools master: Updated from global requirements https://review.openstack.org/534059 | 04:35 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/sushy-tools master: Updated from global requirements https://review.openstack.org/534060 | 04:35 |
| *** karthiks has joined #openstack-ironic | 04:36 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/virtualbmc master: Updated from global requirements https://review.openstack.org/534072 | 04:37 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/virtualbmc master: Updated from global requirements https://review.openstack.org/534073 | 04:37 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/virtualbmc master: Updated from global requirements https://review.openstack.org/534074 | 04:37 |
| *** penick has joined #openstack-ironic | 04:38 | |
| *** zshi has quit IRC | 04:43 | |
| *** zshi has joined #openstack-ironic | 04:53 | |
| *** penick has quit IRC | 04:53 | |
| openstackgerrit | Debayan Ray proposed openstack/sushy master: Update documentation related to 'refresh()' https://review.openstack.org/531341 | 05:03 |
| *** sasha2 has quit IRC | 05:04 | |
| *** cjloader has joined #openstack-ironic | 05:08 | |
| *** cjloader has quit IRC | 05:12 | |
| *** cjloader has joined #openstack-ironic | 05:13 | |
| *** dpawar has joined #openstack-ironic | 05:21 | |
| *** namnh_ has joined #openstack-ironic | 05:22 | |
| *** namnh_ has quit IRC | 05:22 | |
| *** namnh has quit IRC | 05:25 | |
| *** cjloader has quit IRC | 05:37 | |
| *** stendulker has joined #openstack-ironic | 05:38 | |
| *** hieulq has quit IRC | 05:50 | |
| *** absubram has joined #openstack-ironic | 05:53 | |
| *** marios has joined #openstack-ironic | 05:55 | |
| jlvillal | Wow! That is a lot of proposal bot action! | 05:59 |
| *** jaganathan has quit IRC | 06:02 | |
| *** ccollett has joined #openstack-ironic | 06:02 | |
| *** charcol has quit IRC | 06:05 | |
| openstackgerrit | Ankit Kumar proposed openstack/ironic master: DNM Patch : Testing the HPEProliant CI https://review.openstack.org/534109 | 06:18 |
| *** mgoddard has quit IRC | 06:36 | |
| *** zhangfei has quit IRC | 06:37 | |
| *** mgoddard has joined #openstack-ironic | 06:42 | |
| *** absubram has quit IRC | 06:43 | |
| openstackgerrit | Ankit Kumar proposed openstack/ironic master: DNM Patch : Testing the HPEProliant CI https://review.openstack.org/534127 | 06:43 |
| Tengu | how does that bot work in fact? | 06:46 |
| openstackgerrit | Merged openstack/ironic master: Make the Python 3 job voting https://review.openstack.org/531398 | 06:48 |
| *** zhangfei has joined #openstack-ironic | 06:50 | |
| *** ccollett has quit IRC | 07:01 | |
| *** links has quit IRC | 07:06 | |
| openstackgerrit | Ankit Kumar proposed openstack/ironic master: DNM Patch : Testing the HPEProliant CI https://review.openstack.org/534134 | 07:12 |
| *** dsneddon has quit IRC | 07:13 | |
| *** rcernin has quit IRC | 07:14 | |
| openstackgerrit | Ankit Kumar proposed openstack/ironic master: DNM Patch : Testing the HPEProliant CI https://review.openstack.org/534137 | 07:15 |
| *** threestrands_ has quit IRC | 07:18 | |
| *** etingof has quit IRC | 07:21 | |
| *** links has joined #openstack-ironic | 07:23 | |
| *** makowals has joined #openstack-ironic | 07:24 | |
| *** etingof has joined #openstack-ironic | 07:35 | |
| openstackgerrit | Ankit Kumar proposed openstack/ironic master: DNM Patch : Testing the HPEProliant CI https://review.openstack.org/534147 | 07:38 |
| *** links has quit IRC | 07:39 | |
| *** etingof has quit IRC | 07:42 | |
| *** etingof has joined #openstack-ironic | 07:56 | |
| *** tesseract has joined #openstack-ironic | 08:05 | |
| *** jaganathan has joined #openstack-ironic | 08:09 | |
| *** zhangfei has quit IRC | 08:09 | |
| *** AlexeyAbashkin has joined #openstack-ironic | 08:15 | |
| *** links has joined #openstack-ironic | 08:15 | |
| *** milan has joined #openstack-ironic | 08:21 | |
| *** rbartal has joined #openstack-ironic | 08:24 | |
| *** zhangfei has joined #openstack-ironic | 08:26 | |
| *** tuanla____ has joined #openstack-ironic | 08:38 | |
| *** zhangfei has quit IRC | 08:40 | |
| openstackgerrit | vinay kumar muddu proposed openstack/ironic master: Fixes issue with UEFI bootable ISO creation https://review.openstack.org/531700 | 08:42 |
| *** e0ne has joined #openstack-ironic | 08:48 | |
| *** zhangfei has joined #openstack-ironic | 08:52 | |
| *** amarao has joined #openstack-ironic | 08:53 | |
| *** stendulker_ has joined #openstack-ironic | 08:56 | |
| *** stendulker has quit IRC | 08:59 | |
| *** priteau has joined #openstack-ironic | 08:59 | |
| *** stendulker_ has quit IRC | 09:01 | |
| *** hshiina has quit IRC | 09:04 | |
| *** hieulq has joined #openstack-ironic | 09:08 | |
| openstackgerrit | Vasyl Saienko proposed openstack/networking-generic-switch master: Add initial release note https://review.openstack.org/534201 | 09:12 |
| openstackgerrit | Anshul Jain proposed openstack/ironic-specs master: Update OOB RAID for iLO5 based HPE Proliant Servers https://review.openstack.org/530838 | 09:13 |
| openstackgerrit | Vasyl Saienko proposed openstack/networking-generic-switch master: Add initial release note https://review.openstack.org/534201 | 09:15 |
| openstackgerrit | Vasyl Saienko proposed openstack/networking-generic-switch master: Exclude tempest tests for release note changes https://review.openstack.org/534203 | 09:15 |
| *** stendulker has joined #openstack-ironic | 09:26 | |
| *** lucas-afk is now known as lucasagomes | 09:36 | |
| *** derekh has joined #openstack-ironic | 09:44 | |
| openstackgerrit | Anup Navare proposed openstack/ironic-specs master: VNC Graphical console https://review.openstack.org/306074 | 09:55 |
| *** yangyapeng has quit IRC | 10:04 | |
| *** yangyapeng has joined #openstack-ironic | 10:04 | |
| *** stendulker has quit IRC | 10:06 | |
| *** absubram has joined #openstack-ironic | 10:10 | |
| *** stendulker has joined #openstack-ironic | 10:11 | |
| *** priteau has quit IRC | 10:12 | |
| *** jaganathan has quit IRC | 10:21 | |
| *** AlexeyAbashkin has quit IRC | 10:23 | |
| *** AlexeyAbashkin has joined #openstack-ironic | 10:26 | |
| *** liuzz has quit IRC | 10:29 | |
| *** gcb has joined #openstack-ironic | 10:46 | |
| openstackgerrit | Debayan Ray proposed openstack/sushy master: Implement Redfish Sessions https://review.openstack.org/471942 | 10:56 |
| *** athomas has joined #openstack-ironic | 10:59 | |
| *** dtantsur|afk is now known as dtantsur | 11:00 | |
| dtantsur | morning ironic | 11:00 |
| *** etingof has quit IRC | 11:03 | |
| *** zhangfei has quit IRC | 11:03 | |
| *** ameeda has joined #openstack-ironic | 11:06 | |
| ameeda | Hi, when I try to inspect nodes I got this errors "http://paste.openstack.org/show/645699/" | 11:07 |
| dtantsur | TheJulia: hi, is today good time to release bifrost or should we wait till end of the cycle? | 11:08 |
| dtantsur | ameeda: hard to tell, may be PXE or DHCP problems, for example | 11:09 |
| ameeda | when I fill instackenv.json file, which port should I use? its iLO port ? | 11:10 |
| *** stendulker has quit IRC | 11:13 | |
| ameeda | dtantsur: to let you know what I did, First I install undercloud on VM at baremetal using tripleO quick start. then I try as I mentioned before. I am messing if I should configure undercloud.conf correctly, or everything is okay with undercloud.conf. | 11:13 |
| dtantsur | ameeda: do you have connectivity set up correctly between the undercloud VM and bare metals? Some hypervisors do not allow VMs to provide DHCP by default. | 11:14 |
| ameeda | I didn't anything else, how can I configure the connection ? | 11:15 |
| dtantsur | ameeda: I don't know, sorry. Using undercloud on a VM is something I don't do and don't recommend. Try looking at your nodes' virtual consoles (via iLO), check if they actually fail on DHCP. If so, check tcpdump on the undercloud if it sees the DHCP requests coming on br-ctlplane. | 11:16 |
| ameeda | can you please check this log for me ? "http://paste.openstack.org/show/645702/" | 11:17 |
| dtantsur | ameeda: DHCP looks okay. check ironic-inspector logs if they contain the specific error then | 11:18 |
| dtantsur | also do check virtual consoles of nodes, maybe it fails on iPXE stage | 11:19 |
| ameeda | let me paste ironic-inspector log for you, thanks for your time | 11:19 |
| ameeda | ... DEBUG ironic_inspector.firewall [-] Not updating iptables - no changes in MAC list set([]) update_filters /usr/lib/pyth... | 11:20 |
| ameeda | this log appears continuously, its okay ? | 11:20 |
| dtantsur | yep (it's DEBUG) | 11:26 |
| *** gmonteiro|home has joined #openstack-ironic | 11:26 | |
| gmonteiro|home | Good Morning Ironic :) | 11:27 |
| ameeda | dtantsur: now I watch the remote console, when baremetal start, it keeps try to boot (DHCP .... ) | 11:27 |
| ameeda | gmonteiro|home: good morning :) | 11:28 |
| gmonteiro|home | o/ ameeda | 11:28 |
| openstackgerrit | Dmitry Tantsur proposed openstack/ironic-python-agent master: Clean up release notes before a release https://review.openstack.org/534243 | 11:30 |
| *** mgoddard_ has joined #openstack-ironic | 11:34 | |
| ameeda | dtantsur: what do you think ? | 11:35 |
| dtantsur | ameeda: about what, sorry? | 11:35 |
| ameeda | dtantsur: when baremetal start, it keeps trying to boot from network, I saw (DHCP.....) | 11:36 |
| dtantsur | ameeda: okay, so does it fail on DHCP? then please see what I wrote above about DHCP problems | 11:36 |
| ameeda | ok, Thanks | 11:36 |
| *** stendulker has joined #openstack-ironic | 11:39 | |
| *** etingof has joined #openstack-ironic | 11:44 | |
| openstackgerrit | Merged openstack/sushy master: Updated from global requirements https://review.openstack.org/534055 | 11:47 |
| openstackgerrit | Merged openstack/virtualbmc master: Updated from global requirements https://review.openstack.org/534074 | 11:47 |
| openstackgerrit | Merged openstack/sushy-tools master: Updated from global requirements https://review.openstack.org/534060 | 11:47 |
| *** oanson has quit IRC | 11:48 | |
| *** racedo has joined #openstack-ironic | 11:50 | |
| *** oanson has joined #openstack-ironic | 11:50 | |
| *** racedo_ has quit IRC | 11:52 | |
| *** racedo has quit IRC | 11:55 | |
| ameeda | dtantsur: when I execute this command "ovs-ofctl dump-flows br-ctlplane" , I see this "cookie=0xabf4fc40d7d3dc0, duration=8894.119s, table=0, n_packets=5, n_bytes=438, idle_age=65534, priority=2,in_port=2 actions=drop" | 11:55 |
| *** phuongnh has quit IRC | 11:56 | |
| dtantsur | sorry, I have no idea what it means :( I don't have a good experience with ovs. try asking on #tripleo | 11:56 |
| openstackgerrit | Dmitry Tantsur proposed openstack/ironic stable/pike: Do not validate root partition size for whole disk images in iscsi deploy https://review.openstack.org/534251 | 11:58 |
| *** gmonteiro|home has quit IRC | 11:59 | |
| *** gmonteiro|home has joined #openstack-ironic | 12:00 | |
| dtantsur | pas-ha: hey! should we add the new option from https://review.openstack.org/#/c/494136/ to our docs? | 12:01 |
| patchbot | patch 494136 - nova - Allow shuffling hosts with the same best weight (MERGED) | 12:01 |
| *** sambetts|afk is now known as sambetts | 12:06 | |
| sambetts | Morning all | 12:06 |
| *** mgoddard_ has quit IRC | 12:09 | |
| *** pmannidi has quit IRC | 12:09 | |
| mrtenio | Morning sambetts! | 12:10 |
| *** skazi has quit IRC | 12:10 | |
| *** oanson has quit IRC | 12:10 | |
| *** skazi has joined #openstack-ironic | 12:10 | |
| *** tuanla____ has quit IRC | 12:12 | |
| *** oanson has joined #openstack-ironic | 12:12 | |
| gmonteiro|home | Morning mrtenio, sambetts o/ | 12:13 |
| dtantsur | morning sambetts, mrtenio, gmonteiro|home | 12:13 |
| openstackgerrit | Dmitry Tantsur proposed openstack/ironic master: Do not send sensors data for nodes in maintenance mode https://review.openstack.org/415173 | 12:16 |
| dtantsur | sambetts: any news re https://bugs.launchpad.net/ironic/+bug/1668909 ? | 12:24 |
| openstack | Launchpad bug 1668909 in Ironic "UcsSDK is deprecated and not py3 compatible" [High,Triaged] | 12:24 |
| *** bfournie has quit IRC | 12:24 | |
| *** bfournie has joined #openstack-ironic | 12:24 | |
| dtantsur | also, folks, this spec was +2ed 4 months ago, anyone wants to take a look? https://review.openstack.org/#/c/438859/ | 12:25 |
| patchbot | patch 438859 - ironic-specs - OOB inspection support for `redfish` hardware type | 12:25 |
| dtantsur | TheJulia: ^^^ | 12:25 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/ironic master: Updated from global requirements https://review.openstack.org/533875 | 12:29 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/ironic-inspector master: Updated from global requirements https://review.openstack.org/533876 | 12:29 |
| *** bfournie has quit IRC | 12:29 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/ironic-lib master: Updated from global requirements https://review.openstack.org/533877 | 12:29 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/ironic-lib master: Updated from global requirements https://review.openstack.org/533877 | 12:29 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/ironic-python-agent master: Updated from global requirements https://review.openstack.org/529949 | 12:30 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/ironic-python-agent master: Updated from global requirements https://review.openstack.org/529949 | 12:30 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/networking-baremetal master: Updated from global requirements https://review.openstack.org/533901 | 12:30 |
| dtantsur | omg bot STAAAHHHPP :D | 12:30 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/networking-generic-switch master: Updated from global requirements https://review.openstack.org/533903 | 12:30 |
| *** pmannidi has joined #openstack-ironic | 12:32 | |
| *** lucasagomes is now known as lucas-hungry | 12:32 | |
| *** pcaruana has joined #openstack-ironic | 12:33 | |
| absubram | hi all.. had a quick question with regards to deploy images and the user images.. I understand that the user image is the actual OS that gets installed on my baremetal server.. | 12:41 |
| absubram | what is the deploy image? does the deploy image have to be of the same flavor/type as my user image? i.e. do I need to use ubuntu deploy images only if my user image is ubuntu? | 12:42 |
| absubram | can I use say centos deploy images and then have ubuntu user image installed? will it affect anything? | 12:42 |
| absubram | anyone know? | 12:42 |
| absubram | sambetts: ^^.. hi! :) | 12:45 |
| sambetts | dtantsur: we'll got some patches downstream to replace it with the new version of the SDK, but it's been a singificant amount of work because of the way the orignal driver was written and the differences between the old and new SDKs | 12:46 |
| sambetts | absubram: the deploy image is a small ramdisk that we temporarly boot onto the server to enable ironic to write the user image to that server's disks, and perform other tasks like cleaning the server after the instance is deleted etc | 12:48 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/python-ironic-inspector-client master: Updated from global requirements https://review.openstack.org/534284 | 12:49 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/python-ironic-inspector-client master: Updated from global requirements https://review.openstack.org/534285 | 12:49 |
| sambetts | absubram: the ramdisk has little to no knowledge of the user image runs, and just runs https://docs.openstack.org/ironic-python-agent/latest/ to allow communication between it and ironic | 12:49 |
| sambetts | absubram: we have a couple of prebuilt ramdisks, a coreos one and a tinycorelinux one, but you can build a fedora/ubuntu/etc ramdisk image using DIB too | 12:50 |
| sambetts | absubram: the OS of the ramdisk has no baring on the type of images you can deploy, IPA running on a linux ramdisk can deploy a windows user image if you wanted it too | 12:51 |
| openstackgerrit | Michael Turek proposed openstack/ironic-python-agent master: Use lshw in place of dmidecode for the default hardware manager https://review.openstack.org/501799 | 12:51 |
| *** jlabarre has joined #openstack-ironic | 12:53 | |
| dtantsur | sambetts: I see, okay | 12:55 |
| *** yangyapeng has quit IRC | 12:56 | |
| *** strigazi has quit IRC | 12:56 | |
| *** jaganathan has joined #openstack-ironic | 12:58 | |
| *** weshay_PTO is now known as weshay | 13:01 | |
| *** strigazi has joined #openstack-ironic | 13:04 | |
| *** bfournie has joined #openstack-ironic | 13:04 | |
| *** pmannidi has quit IRC | 13:05 | |
| *** mgoddard_ has joined #openstack-ironic | 13:08 | |
| *** dprince has joined #openstack-ironic | 13:09 | |
| *** jcoufal has joined #openstack-ironic | 13:10 | |
| hjensas | sambetts: I think I found an issue with the baremetal agent, but I want to blame neutron ... https://etherpad.openstack.org/p/neutron-new-agents-rapidly-reporting-issue | 13:10 |
| sambetts | hjensas: I'm a little confused, whats the issue? | 13:15 |
| hjensas | sambetts: If I add multiple agents via report_state rpc quickly, I get the StaleDataError in neutron logs. And the agent_db segment host mapping is not created for all host agents. | 13:16 |
| *** dtantsur is now known as dtantsur|brb | 13:17 | |
| hjensas | sambetts: If I add the same 3 agents with some delay between each report_state it works. | 13:17 |
| hjensas | sambetts: so it seems neutron side cannot handle multiple agents rapidly reporting state with the start_flag: True. (This should work, so I will open a bug with neutron.) | 13:19 |
| *** trown|outtypewww is now known as trown | 13:20 | |
| *** lucas-hungry is now known as lucasagomes | 13:20 | |
| *** MattMan_1 has quit IRC | 13:20 | |
| sambetts | ah ok, yeah thats a weird behaviour, I wonder if that effects starting several nova compute host agents all at the same time | 13:21 |
| *** MattMan_1 has joined #openstack-ironic | 13:21 | |
| hjensas | sambetts: I bet if you have 10+ nova computes and start the ovs agent simultanously we would see the same. | 13:21 |
| *** yangyapeng has joined #openstack-ironic | 13:22 | |
| *** makowals has quit IRC | 13:22 | |
| hjensas | sambetts: but I think this is in the segments plugin space, not many people use that yet I guess. | 13:22 |
| sambetts | hjensas: yeah, very likely, thanks for finding this! | 13:23 |
| hjensas | sambetts: yeah, it was after adding https://review.openstack.org/#/c/533707/ I realized it. :( | 13:24 |
| patchbot | patch 533707 - networking-baremetal - start_flag = True, only first time, or conf change | 13:24 |
| *** makowals has joined #openstack-ironic | 13:25 | |
| hjensas | sambetts: I was hoping you's support an ffe for this work, I started writing something here. https://etherpad.openstack.org/p/ffe-networking-baremetal-scratchpad (But this issue needs fixing first ...) | 13:25 |
| sambetts | hjensas: I had the start_flag logic in there at one point, but then took it out trying to avoid storing to much data, but I guess it is required, at least for the first time | 13:26 |
| *** tzumainn has joined #openstack-ironic | 13:27 | |
| hjensas | sambetts: yes, first time and when mappings change. It seems neutron expect that agenst stop and start to re-read bridge_mappings from config file. | 13:27 |
| hjensas | sambetts: but it makes sense to not always set the flag, since setting it makes neutron do the rest calls to Placement and Nova. | 13:28 |
| *** xnox has quit IRC | 13:28 | |
| sambetts | hjensas: ah yeah! it makes sense to se it false to avoid constantly changing nova/placement | 13:29 |
| sambetts | I thought neutron would have its own logic in there to handle if there had been no changes | 13:29 |
| sambetts | alas I assumed wrong | 13:29 |
| sambetts | ;-P | 13:29 |
| sambetts | hjensas: so the FFE is for networking-baremetal specifically? or for neutron? | 13:30 |
| hjensas | sambetts: for networking-baremetal. | 13:30 |
| hjensas | sambetts: https://github.com/openstack/neutron/blob/master/neutron/services/segments/db.py#L248-L258 <- Here, they just look at the start_flag if the host was previously reported. | 13:31 |
| sambetts | hjensas: I'd support that FFE I think, because networking-baremetal isn't that wildly used and is still really being developed into something usable so for the sake of not slowing down development I think it makes sense | 13:33 |
| *** makowals has quit IRC | 13:33 | |
| absubram | sambetts - thanks for clearing that up for me! :) | 13:35 |
| sambetts | absubram: no problem :) | 13:35 |
| *** makowals has joined #openstack-ironic | 13:35 | |
| *** gmonteiro|home has quit IRC | 13:36 | |
| hjensas | sambetts: thanks. I'll go open a bug against neutron and try to chase someone ... | 13:36 |
| *** jaianshu_ has joined #openstack-ironic | 13:46 | |
| *** VisBits has quit IRC | 13:46 | |
| *** gmonteiro|home has joined #openstack-ironic | 13:49 | |
| *** jaianshu has quit IRC | 13:49 | |
| *** jaianshu_ has quit IRC | 13:50 | |
| *** rloo has joined #openstack-ironic | 13:50 | |
| *** hw_wutianwei has joined #openstack-ironic | 13:54 | |
| openstackgerrit | Ilya Etingof proposed openstack/sushy-tools master: Abstract away the virtualization management interface https://review.openstack.org/523321 | 13:55 |
| *** rbudden has joined #openstack-ironic | 13:55 | |
| *** sasha2 has joined #openstack-ironic | 13:58 | |
| *** rloo has quit IRC | 14:00 | |
| *** rloo has joined #openstack-ironic | 14:00 | |
| *** xnox has joined #openstack-ironic | 14:01 | |
| *** xnox has quit IRC | 14:01 | |
| *** xnox has joined #openstack-ironic | 14:01 | |
| *** fragatina has joined #openstack-ironic | 14:02 | |
| *** fragatina has quit IRC | 14:02 | |
| *** fragatina has joined #openstack-ironic | 14:03 | |
| rloo | good morning ironic'ers | 14:04 |
| *** Bico_Fino has quit IRC | 14:04 | |
| rloo | TheJulia: if you have a minute, could you check this bug? It is tagged 'rfe' but I don't think it is? https://bugs.launchpad.net/ironic/+bug/1735474 | 14:04 |
| openstack | Launchpad bug 1735474 in Ironic "Ensure BFV model allows for multiattach" [Wishlist,Fix released] - Assigned to Julia Kreger (juliaashleykreger) | 14:04 |
| *** links has quit IRC | 14:05 | |
| *** homegrown_ has quit IRC | 14:08 | |
| *** homegrown has joined #openstack-ironic | 14:13 | |
| rloo | dtantsur|brb: let me know when we've released ironic (or maybe it is enough to do the patch for it), so I can remove my -2 on the rescue work | 14:16 |
| *** gmonteiro|home has quit IRC | 14:18 | |
| TheJulia | good morning | 14:18 |
| *** dtantsur|brb is now known as dtantsur | 14:18 | |
| dtantsur | morning rloo, TheJulia | 14:18 |
| *** zhangfei has joined #openstack-ironic | 14:19 | |
| TheJulia | rloo: it is not, just a doc update | 14:19 |
| rloo | morning TheJulia, dtantsur :) | 14:19 |
| dtantsur | rloo: will do. still pending. | 14:19 |
| rloo | TheJulia: ok, i'll remove the tag then. thx. | 14:19 |
| *** gmonteiro|home has joined #openstack-ironic | 14:19 | |
| TheJulia | i just removed it | 14:19 |
| *** absubram has quit IRC | 14:19 | |
| dtantsur | hjensas: note that under "Risks" I mostly mean "What can we break by landing it?" | 14:19 |
| *** xnox has quit IRC | 14:20 | |
| *** stendulker has quit IRC | 14:22 | |
| *** sapd has joined #openstack-ironic | 14:22 | |
| sapd | hi guys, i'm stucking in deploying node | 14:22 |
| sapd | cleaning node is ok, node can get IP from DHCP server | 14:22 |
| TheJulia | dtantsur: re bifrost, end of cycle | 14:23 |
| sapd | but after node became available and start deploying, node can not get IP from DHCP server again | 14:23 |
| dtantsur | TheJulia: ack | 14:23 |
| sapd | can you help me debug this issue? | 14:23 |
| sapd | flat network, simple topo, supermicro server with IPMI driver | 14:23 |
| * TheJulia sips coffee | 14:23 | |
| TheJulia | sapd: That kind of sounds like a dhcp issue :( | 14:24 |
| sapd | yes, but the strange thing here is: node can get DHCP offer while cleaning :( | 14:24 |
| sapd | but not while deploying | 14:25 |
| TheJulia | so perhaps whatever network your telling it to deploy to is not actually avialable? | 14:25 |
| TheJulia | I bet there are errors in the neutron-dhcp-agent logs | 14:26 |
| *** gmonteiro|home has quit IRC | 14:28 | |
| sambetts | sapd: which network are you selecting in the "openstack server create" command for the server? it needs to be the same network as the one configured in the ironic.confg | 14:28 |
| sapd | sambetts: yeah, same network | 14:28 |
| sapd | TheJulia: unfortunately, no error log | 14:28 |
| sapd | only syslog show DHCP log: no address available while deploying | 14:29 |
| rloo | TheJulia, dtantsur, sambetts (good morning), and anyone else. What do you think about using the tenant network for rescuing? https://review.openstack.org/#/c/509342/26//COMMIT_MSG | 14:29 |
| patchbot | patch 509342 - ironic - Add rescue related methods to network interface | 14:29 |
| rloo | TheJulia, dtantsur, sambetts: any security issues? Is it OK not to give admin a choice in that? | 14:29 |
| *** stendulker has joined #openstack-ironic | 14:30 | |
| *** mjturek has joined #openstack-ironic | 14:30 | |
| rloo | vs using a rescue network | 14:30 |
| openstackgerrit | Merged openstack/python-ironicclient master: Updated from global requirements https://review.openstack.org/534024 | 14:30 |
| sambetts | rloo: I thought we already flipped into the tenant network when using the driver that supports it | 14:31 |
| dtantsur | rloo: how does nova implement that? I think the expectation is to stay on tenant networks, but I'd double-check with them | 14:31 |
| *** gmonteiro|home has joined #openstack-ironic | 14:31 | |
| rloo | sambetts: to do rescue, there is an instance on that node and it is in tenant network already. | 14:31 |
| stendulker | Good morning Ironi, rloo, sambetts, dtantsur TheJulia | 14:32 |
| rloo | dtantsur: good point, i'll take a look... for standalone, we'd be ok doing the same? | 14:32 |
| rloo | stendulker: hi, i thought you weren't on irc. oh, you just joined :) | 14:32 |
| sambetts | right, but then we unplug the tenant network, flip it to rescue boot the ramdisk, and the flip it back into the tenant network | 14:32 |
| rloo | stendulker: ^^ | 14:32 |
| sambetts | rloo: ^ | 14:32 |
| stendulker | rloo: Wanted to discuss with you on rescue network :) | 14:32 |
| rloo | sambetts: well, this code/patch isn't doing the unplugging etc. just using tenant network for everything (booting the ramdisk etc) | 14:33 |
| rloo | sambetts: hence my question :) | 14:33 |
| *** xnox has joined #openstack-ironic | 14:33 | |
| *** xnox has quit IRC | 14:33 | |
| *** xnox has joined #openstack-ironic | 14:33 | |
| stendulker | rloo: Just joined... | 14:33 |
| sambetts | rloo: we can't boot the ramdisk in the tenant network, there is no access from the tenant network to the TFTPservers | 14:33 |
| rloo | stendulker: good timing, that's what i just asked the others cuz you weren't on irc when i looked. so welcome to the party :) | 14:33 |
| sambetts | rloo: or to ironic | 14:33 |
| sambetts | hence we flip out and then flip back | 14:33 |
| sambetts | or we should be anyway | 14:33 |
| stendulker | rloo: :) | 14:34 |
| sambetts | I'm sure that is the original design because thats why it was blocked on my change that fixed the unplugging logic to not delete the tenant port | 14:34 |
| sambetts | when we unplugged it | 14:34 |
| *** crushil has joined #openstack-ironic | 14:34 | |
| sambetts | so we could replug it after the ramdisk was booted | 14:35 |
| rloo | sambetts: how do we do provisioning using a flat network? | 14:35 |
| sambetts | its the same network, pluging the provisioning network is a "pass" | 14:35 |
| rloo | sambetts: so why can't we do the same for rescuing, use the same networking. | 14:36 |
| sambetts | for flat we should be, but for the neutron driver we shouldn't be | 14:36 |
| rloo | sambetts: yeah, my question was for flat :) | 14:36 |
| rloo | sambetts: we agree, for neutron driver we need a diff rescue network from tenant network | 14:36 |
| sambetts | although for the flat network, we do technically support separate cleaning network from provisioning | 14:37 |
| rloo | sambetts: ugh, sorry, i looked at my original question. i forgot to mention 'flat' | 14:37 |
| sambetts | but it doesn't flip it just uses different DHCP servers on the same flat network | 14:37 |
| openstackgerrit | Merged openstack/bifrost master: Updated from global requirements https://review.openstack.org/533856 | 14:37 |
| rloo | sambetts: yeah, so i am concerned about the inconsistency too, of a cleaning network for flat, but no rescue network for flat. | 14:38 |
| dtantsur | folks, the 2nd +2 is needed on https://review.openstack.org/#/c/534243/ to proceed with the IPA release | 14:38 |
| patchbot | patch 534243 - ironic-python-agent - Clean up release notes before a release | 14:38 |
| sambetts | rloo: at the point we do cleaning there isn't a port already connected to any network, so we need to create one and attaching it | 14:38 |
| sambetts | at the point we do resuce there is already a port we can use connected | 14:39 |
| sambetts | because of the tenant port | 14:39 |
| stendulker | sambetts: yes, thats difference between cleaning and rescue. | 14:39 |
| rloo | sambetts: right, I know we're good if we use the tenant network, just wanted to know if we're good if we always use the tenant network. | 14:39 |
| stendulker | sambetts: we do not flip n/ws in cleaning. | 14:39 |
| rloo | sambetts, stendulker: if there are no security issues, then i think we can use tenant network for 'flat'. if someone wants a different (non-tenant) rescue network, I think we can add that later w/o microversioning. | 14:41 |
| sambetts | rloo: I think in the flat case I would say we are, because we're already doing provisioing etc on that network so rescue shouldn't be an issue | 14:41 |
| rloo | sambetts: yup. that makes sense. thx. | 14:41 |
| sambetts | rloo: we don't need microversions for it, its all internal no API | 14:41 |
| TheJulia | rloo: If it is not settled yet, there was supposed to be a flip to the tenant network, support fo rsuch has been added into IPA, at least for coreos, tinyipa is still outstanding if I remember correctly | 14:42 |
| * TheJulia reads along | 14:42 | |
| sambetts | TheJulia: thats for non-flat cases and thats how it works | 14:42 |
| rloo | sambetts: exactly; it just means using the rescue-network config option. i hate dealing with microversions so if that is involved, i'd rather address it up front than have to add it later :) | 14:42 |
| sambetts | rloo: +1000 | 14:43 |
| TheJulia | sambetts: well, realistically even in flat, the dhcp server can hand out different addresses based on calling mac address | 14:43 |
| TheJulia | but yeah | 14:43 |
| rloo | sambetts: so since no microversion is involved, i'm good with not dealing/adding later if need be | 14:43 |
| sambetts | TheJulia: yeah, theoryetically we could add a check to see if the network the tenant port is attached to matches the one in the config file, if its not the same then unplug the tenant port, plugin to the network from the config file, then unplug and then replug the tenant port | 14:44 |
| sambetts | but we'd have to make sure we checked the networks aren't the same, otherwise you end up with a duplicate mac address entry error when we try to add a new port | 14:45 |
| rloo | sambetts: yes, which is why I don't see it a problem adding that code/check in. but if we don't need to i am also fine punting it to later. | 14:45 |
| *** zhangfei has quit IRC | 14:45 | |
| rloo | sambetts, TheJulia: so you're all good with using the tenant network for rescuing, if 'flat' interface? | 14:46 |
| TheJulia | sambetts: I think we should just let neutron handle it and not try to do anything too fancy when there doesn't really seem to be a solid need to go down that path. | 14:46 |
| sambetts | +1 | 14:46 |
| TheJulia | rloo: yes, because it kind of already has to work. I think for enough of the deployments that I've seen or helped people with that use flat, it should be perfectly fine. | 14:46 |
| rloo | TheJulia, sambetts: thx for your input! | 14:47 |
| rloo | stendulker: ^^ Please update the commit msg to reflect/summarize that :) I'll continue reviewing that patch. | 14:47 |
| stendulker | rloo: Thank you all. To summarize, we will use the tenant network in case of 'flat' network. | 14:48 |
| rloo | stendulker: yup | 14:48 |
| stendulker | rloo: Will update the commit message and post the patch. | 14:49 |
| rloo | stendulker: i commented in the patch | 14:50 |
| stendulker | rloo: ok. Thank you. | 14:50 |
| rloo | stendulker: if you're going to do another revision soon, i'll wait to review | 14:50 |
| stendulker | rloo: yes, i will post another revision. | 14:50 |
| rloo | stendulker: thx | 14:51 |
| *** gmonteiro|home has quit IRC | 14:53 | |
| rloo | TheJulia: after you address john's comments, I'll review https://review.openstack.org/529325 | 14:54 |
| patchbot | patch 529325 - ironic-lib - Add wait_for_disk to destroy_disk_metadata function | 14:54 |
| TheJulia | rloo: I have a meeting for the next hour, but realistically his comments are comments. I'll try to get them done here in a little bit | 14:57 |
| rloo | TheJulia: no worries. we have time. Hopefully we can get it approved today. | 14:58 |
| *** cjloader has joined #openstack-ironic | 15:01 | |
| hjensas | sambetts: The neutron bug opened - https://bugs.launchpad.net/neutron/+bug/1743579 | 15:02 |
| openstack | Launchpad bug 1743579 in neutron "Concurrent report_state from multiple agents: segment_host_mapping fails - StaleDataError" [Undecided,New] | 15:02 |
| openstackgerrit | Merged openstack/ironic-python-agent master: Clean up release notes before a release https://review.openstack.org/534243 | 15:04 |
| sambetts | hjensas: awesome! /me subscribes to the bug report | 15:06 |
| *** sapd has quit IRC | 15:09 | |
| pas-ha | dtantsur: re new nova options - we might add some hint for that (with all caveats) | 15:14 |
| openstackgerrit | Shivanand Tendulker proposed openstack/ironic master: Adds RPC calls for rescue interface https://review.openstack.org/509336 | 15:14 |
| openstackgerrit | Shivanand Tendulker proposed openstack/ironic master: Add rescue related methods to network interface https://review.openstack.org/509342 | 15:14 |
| dtantsur | pas-ha: wanna to that? you have more context, I've just noticed your patch :) | 15:15 |
| dtantsur | s/to/do/ | 15:15 |
| dtantsur | rloo: https://tarballs.openstack.org/ironic/ironic-10.0.0.tar.gz :) | 15:15 |
| rloo | dtantsur: yay! | 15:15 |
| pas-ha | dtantsur: will do | 15:17 |
| dtantsur | thanks! | 15:17 |
| rpioso | Good morning | 15:19 |
| dtantsur | morning rpioso | 15:19 |
| rpioso | dtantsur: :) | 15:20 |
| *** dpawar has quit IRC | 15:27 | |
| *** rbartal has quit IRC | 15:27 | |
| *** links has joined #openstack-ironic | 15:29 | |
| *** jcoufal has quit IRC | 15:35 | |
| *** jaganathan has quit IRC | 15:36 | |
| openstackgerrit | Julia Kreger proposed openstack/ironic-lib master: Add wait_for_disk to destroy_disk_metadata function https://review.openstack.org/529325 | 15:37 |
| openstackgerrit | Merged openstack/ironic-lib master: Updated from global requirements https://review.openstack.org/533877 | 15:38 |
| *** mjturek has quit IRC | 15:42 | |
| *** fragatina has quit IRC | 15:43 | |
| TheJulia | rloo: ^^^ | 15:44 |
| rloo | TheJulia: thx! | 15:44 |
| *** fragatina has joined #openstack-ironic | 15:44 | |
| *** baha has joined #openstack-ironic | 15:47 | |
| *** fragatina has quit IRC | 15:51 | |
| *** links has quit IRC | 15:51 | |
| *** fragatina has joined #openstack-ironic | 15:51 | |
| openstackgerrit | Shivanand Tendulker proposed openstack/ironic master: Add rescuewait timeout periodic task https://review.openstack.org/353156 | 16:01 |
| openstackgerrit | Shivanand Tendulker proposed openstack/ironic master: Agent rescue implementation https://review.openstack.org/400437 | 16:01 |
| *** cjloader has quit IRC | 16:01 | |
| openstackgerrit | Shivanand Tendulker proposed openstack/ironic master: Add API methods for [un]rescue https://review.openstack.org/350831 | 16:01 |
| openstackgerrit | Shivanand Tendulker proposed openstack/ironic master: Add rescue interface field to node-related notifications https://review.openstack.org/502889 | 16:01 |
| openstackgerrit | Shivanand Tendulker proposed openstack/ironic master: Update description for config params of 'rescue' interface https://review.openstack.org/517919 | 16:01 |
| openstackgerrit | Shivanand Tendulker proposed openstack/ironic master: Add documentation for rescue interface https://review.openstack.org/419606 | 16:01 |
| *** stendulker has quit IRC | 16:02 | |
| *** cjloader has joined #openstack-ironic | 16:02 | |
| *** marios has quit IRC | 16:03 | |
| *** makowals has quit IRC | 16:05 | |
| NobodyCam | Good Morning Ironic'ers | 16:06 |
| *** crushil has quit IRC | 16:09 | |
| *** marios has joined #openstack-ironic | 16:09 | |
| *** mjturek has joined #openstack-ironic | 16:14 | |
| *** e0ne has quit IRC | 16:18 | |
| openstackgerrit | Yusef Shaban proposed openstack/sushy master: Implement Redfish Sessions https://review.openstack.org/471942 | 16:23 |
| openstackgerrit | Yusef Shaban proposed openstack/sushy master: Implement Redfish Sessions https://review.openstack.org/471942 | 16:24 |
| *** links has joined #openstack-ironic | 16:25 | |
| *** absubram has joined #openstack-ironic | 16:26 | |
| openstackgerrit | Dmitry Tantsur proposed openstack/ironic master: [WIP] Automatically migrate nodes to hardware types https://review.openstack.org/534373 | 16:29 |
| dtantsur | rloo: dunno how I feel about this code ^^^ :( | 16:29 |
| dtantsur | ideas are appreciated | 16:29 |
| dtantsur | morning NobodyCam | 16:29 |
| NobodyCam | Hey Hey Good Morning dtantsur :) | 16:29 |
| rloo | dtantsur: ok, i'll let you know (later today) | 16:30 |
| dtantsur | thnx | 16:30 |
| rloo | good morning NobodyCam | 16:32 |
| NobodyCam | Good Morning rloo :) | 16:32 |
| *** krtaylor has quit IRC | 16:36 | |
| *** crushil_ has joined #openstack-ironic | 16:39 | |
| openstackgerrit | Merged openstack/ironic master: Join nodes with traits https://review.openstack.org/530723 | 16:44 |
| openstackgerrit | Merged openstack/networking-generic-switch master: Exclude tempest tests for release note changes https://review.openstack.org/534203 | 16:45 |
| openstackgerrit | Julia Kreger proposed openstack/bifrost master: Fedora 25-27 support https://review.openstack.org/471750 | 16:45 |
| TheJulia | NobodyCam: ^^^ if you have some time, pleae take a look | 16:46 |
| *** rama_y has joined #openstack-ironic | 16:49 | |
| *** links has quit IRC | 16:54 | |
| *** jaganathan has joined #openstack-ironic | 17:08 | |
| *** AlexeyAbashkin has quit IRC | 17:11 | |
| *** serlex has joined #openstack-ironic | 17:12 | |
| *** cjloader has quit IRC | 17:12 | |
| *** cjloader has joined #openstack-ironic | 17:13 | |
| *** mjturek has quit IRC | 17:16 | |
| *** lucasagomes is now known as lucas-pto | 17:17 | |
| *** tesseract has quit IRC | 17:21 | |
| *** marios has quit IRC | 17:30 | |
| *** dsneddon has joined #openstack-ironic | 17:33 | |
| *** zigo has quit IRC | 17:33 | |
| *** openstackgerrit has quit IRC | 17:33 | |
| *** trown is now known as trown|lunch | 17:35 | |
| *** zigo has joined #openstack-ironic | 17:37 | |
| *** gmonteiro|home has joined #openstack-ironic | 17:43 | |
| *** fragatina has quit IRC | 17:49 | |
| *** openstackgerrit has joined #openstack-ironic | 17:53 | |
| openstackgerrit | Merged openstack/ironic-tempest-plugin master: Updated from global requirements https://review.openstack.org/532954 | 17:53 |
| openstackgerrit | Merged openstack/ironic master: Introduce hpOneView and ilorest to OneView https://review.openstack.org/523943 | 17:53 |
| *** penick has joined #openstack-ironic | 17:53 | |
| *** derekh has quit IRC | 17:55 | |
| jroll | (late) morning everyone | 17:57 |
| gmonteiro|home | o/ jroll | 17:58 |
| * milan is away: bbl | 18:00 | |
| openstackgerrit | Pavlo Shchelokovskyy proposed openstack/ironic master: [docs] mention new nova scheduler option https://review.openstack.org/534401 | 18:02 |
| *** deadnull has joined #openstack-ironic | 18:03 | |
| *** dtantsur is now known as dtantsur|afk | 18:05 | |
| dtantsur|afk | o/ | 18:05 |
| openstackgerrit | Pavlo Shchelokovskyy proposed openstack/ironic-inspector master: Add keystoneauth adapters https://review.openstack.org/515787 | 18:06 |
| *** amarao has quit IRC | 18:07 | |
| *** gmonteiro|home has quit IRC | 18:07 | |
| *** mgoddard_ has quit IRC | 18:09 | |
| *** mjturek has joined #openstack-ironic | 18:10 | |
| *** mjturek has quit IRC | 18:12 | |
| *** links has joined #openstack-ironic | 18:17 | |
| TheJulia | Is there any reason we are not deleting user vif attachments when nodes go through cleaning? | 18:20 |
| TheJulia | It seems problematic to entirely expect nova to achieve cleaning that up if a node is locked for a long period of time. | 18:21 |
| jroll | I'm surprised we're not, but now that you say that I feel like nova gets unhappy during delete if you do that | 18:22 |
| sambetts | TheJulia: it was done on purpose because ironic shouldn't be touching a config like that a user (in this case nova is the user) added | 18:22 |
| jroll | mmmm, yeah that. | 18:22 |
| sambetts | if in standalone you called vif attach on a node to add a vif, and then you cleaned the node and that configuration went away you'd be (at least I would be) sad, same rule applies to nova | 18:23 |
| jroll | easiest case to think about is nova boot --nic port:foo | 18:24 |
| TheJulia | sambetts: yeah, well I found (likely two) bugs where it gets orphaned | 18:24 |
| TheJulia | tl;dr nova tries for 5 minutes to delete it looks like and ultimately fails | 18:25 |
| TheJulia | because the node was still locked due to cleanup from a failed deploy | 18:25 |
| sambetts | probably related to this thing I was trying to fix at one point: https://review.openstack.org/#/c/422678/ | 18:25 |
| patchbot | patch 422678 - nova - Change order of _cleanup_deploy and _unprovision i... (ABANDONED) | 18:25 |
| sambetts | tbh the way we handle things in nova is really dumb today | 18:26 |
| sambetts | because when the node moves to clean wait it gets locked, and then nova calls unplug vifs | 18:27 |
| TheJulia | well, in this case, that wouldn't have prevented this | 18:27 |
| TheJulia | That likely would have failed as well, since we automatically failed the deploy due to a timeout | 18:27 |
| openstackgerrit | Hugo Nicodemos proposed openstack/ironic master: Migrate oneview hardware type to use python-hpOneView https://review.openstack.org/524310 | 18:27 |
| *** absubram has quit IRC | 18:27 | |
| sambetts | on deploy failure nova calls unplug vifs so it should remove it | 18:27 |
| sambetts | or is locked because of clean wait at that point? | 18:28 |
| sambetts | /cleaning | 18:28 |
| TheJulia | sambetts: it can't remove it if the node is locked in the mean time | 18:28 |
| TheJulia | because of cleaning | 18:28 |
| TheJulia | something is afoot there, I need to dig a little more | 18:29 |
| TheJulia | first, lunch | 18:29 |
| sambetts | yeah... our nova driver is kinda dumb when it comes to the states and doesn't take into account the node getting locked by the cleaning state, so just keeps trying and trying eventually timing out the request on the nova side | 18:32 |
| TheJulia | well, part of the retrying is our client library masking the failure at time sas well | 18:32 |
| TheJulia | times as well | 18:33 |
| * TheJulia takes a break | 18:33 | |
| rloo | we don't lock the node the entire time we do cleaning, do we? | 18:33 |
| sambetts | rloo: it unlocks during clean wait | 18:34 |
| *** links has quit IRC | 18:34 | |
| rloo | sambetts: which is what takes the longest i think, so most of the time? node locking shouldn't be an issue? | 18:34 |
| sambetts | rloo: but the "cleaning" state is locked, and during cleaning it moves between both states, so when the node is quick to boot into the ramdisk it might start a cleaning task which puts it back into cleaning I guess | 18:35 |
| rloo | sambetts: guess that's where timings would be useful like that thing we hooked into ironic that i've forgotten the name of. the profiler stuff. | 18:35 |
| * TheJulia also wonders if we should just detect a nova driven instance and wax the vif attaachments upon cleanup anyway... | 18:36 | |
| TheJulia | anyway, break/lunch | 18:36 |
| rloo | no hacks cuz of nova! :) | 18:36 |
| *** links has joined #openstack-ironic | 18:36 | |
| sambetts | I think part of the issue is that we decided at some point that a nova instance won't wait for cleaning, so that the nova instance is deleted as fast a possible freeing up quotas, however there are now post-deploy tasks nova has to perform on the node which causes issues when nova doesn't wait for those things to happen | 18:37 |
| *** penick has quit IRC | 18:37 | |
| sambetts | s/post-deploy/post-delete* | 18:37 |
| sambetts | personally I don't like how we blow away instance_info on cleaning/delete either, I think that should happen from nova, and I feel like the reason it does that in ironic today is a hack around this issue | 18:38 |
| *** trown|lunch is now known as trown | 18:39 | |
| *** penick has joined #openstack-ironic | 18:41 | |
| openstackgerrit | Hugo Nicodemos proposed openstack/ironic master: Migrate python-oneviewclient validations to oneview hardware type https://review.openstack.org/524599 | 18:42 |
| openstackgerrit | Hugo Nicodemos proposed openstack/ironic master: Remove python-oneviewclient from oneview hardware type. https://review.openstack.org/524729 | 18:42 |
| *** AlexeyAbashkin has joined #openstack-ironic | 18:43 | |
| rloo | sambetts: a discussion we ought to have with nova, but not high on any projects' list of priorities... | 18:44 |
| TheJulia | sambetts: but we've also set that expectation from early on with nova being the first consumer/user of our api | 18:45 |
| sambetts | rloo: not sure if it really affect the nova team that much, I'm pretty sure its all in nova driver, although I'm sure they'll probably have opinions ;) | 18:46 |
| *** lbragstad_ has joined #openstack-ironic | 18:47 | |
| *** AlexeyAbashkin has quit IRC | 18:48 | |
| rloo | sambetts: yup, it is those sought-after opinions that I was referring to :) | 18:48 |
| *** lbragstad has quit IRC | 18:49 | |
| *** lbragstad_ is now known as lbragstad | 18:50 | |
| sambetts | TheJulia, rloo: I feel a PTG topic coming on | 18:51 |
| rloo | sambetts: ignore it, just a mosquito buzzing around you | 18:51 |
| TheJulia | lol | 18:51 |
| sambetts | rloo: ;) | 18:52 |
| sambetts | its getting late my end, but in all seriousness I think that this would be a good PTG topic, as more user inputs are added to ironic we need to come up with a final decision about who's responsible for them at each point in the node's life cycle | 18:54 |
| sambetts | personal opinion is that if a user added it the user should remove it, however we have mixed behaviours in ironic at the momment between instance_info, and vifs etc | 18:57 |
| * sambetts --> home | 18:57 | |
| *** sambetts is now known as sambetts|afk | 18:58 | |
| sambetts|afk | night all | 18:58 |
| TheJulia | I'm unsure we can make a "final" decision because it was already committed to. | 19:03 |
| *** mgoddard_ has joined #openstack-ironic | 19:05 | |
| *** links has quit IRC | 19:07 | |
| *** athomas has quit IRC | 19:07 | |
| *** fragatina has joined #openstack-ironic | 19:15 | |
| rloo | sambetts|afk: bye. you have a good point. there was something i recently reviewed, that added info to node.instance_info. which we probably should not do but we've done in the past. | 19:16 |
| *** amarao has joined #openstack-ironic | 19:27 | |
| openstackgerrit | Merged openstack/networking-generic-switch master: Updated from global requirements https://review.openstack.org/533903 | 19:44 |
| *** harlowja has joined #openstack-ironic | 19:44 | |
| *** pcaruana has quit IRC | 19:50 | |
| *** dprince has quit IRC | 19:52 | |
| *** serlex has quit IRC | 20:10 | |
| TheJulia | so the bug I've been hunting today, looks like the only way it could have actually occured is if the bmc went on vacation for like 20 minutes | 20:10 |
| *** penick has quit IRC | 20:16 | |
| *** e0ne has joined #openstack-ironic | 20:17 | |
| TheJulia | So, yeah. old version of the ilo firmware | 20:28 |
| TheJulia | and it hung | 20:28 |
| TheJulia | so that was the locking issue basically :\ | 20:29 |
| TheJulia | meanwhile nova gave up trying to delete it... hmmmm | 20:29 |
| *** penick has joined #openstack-ironic | 20:30 | |
| rloo | TheJulia: 20 min vaca for bmc; that doesn't seem normal... | 20:30 |
| *** hw_wutianwei has quit IRC | 20:31 | |
| *** dprince has joined #openstack-ironic | 20:31 | |
| TheJulia | no, I logged into the BMC and went "Oh, i know that version, yeah, nope... backing away!" | 20:32 |
| *** hw_wutianwei has joined #openstack-ironic | 20:32 | |
| rloo | TheJulia: can we just document that we dont support that version of firmware. or if there is a way to detect programmatically, log WARNING WARNING beep beep... :) | 20:33 |
| *** e0ne has quit IRC | 20:33 | |
| TheJulia | eh... in this case it is ipmi against an ilo | 20:35 |
| TheJulia | and.... it really just needs to be updated because of CVE-2017-12542 | 20:36 |
| TheJulia | but agree in principal that if we could re-enact a star trek episode with beeping to try and warn the operator... it could be amusing. | 20:37 |
| *** amarao has quit IRC | 20:40 | |
| TheJulia | back to the vif thing, it feels like we should permit the record to be deleted without hitting a lock if the node is not in a deployment/active/rebuild | 20:41 |
| rloo | TheJulia: in theory yes. if we can do it in code, w/o getting into a mess, then fine :) | 20:44 |
| TheJulia | we would have to move where we pull the lock | 20:44 |
| * TheJulia looks closer again | 20:45 | |
| *** makowals has joined #openstack-ironic | 20:45 | |
| TheJulia | I think I'm going to give up on the ironic-lib patch | 21:07 |
| *** etingof has quit IRC | 21:08 | |
| rloo | TheJulia: :-(. Question for you. Did the original code work? or 'work' to some extent? | 21:09 |
| rloo | TheJulia: we seem stuck on the fuser part and honestly, i haven't looked into it; just reviewed based on assuming the original code worked. | 21:10 |
| TheJulia | it would have kind of worked, just not revealed anything where the locking is hiding under the kernel vfs layer | 21:10 |
| TheJulia | basically it was only looking at filesystem level io locks | 21:10 |
| rloo | TheJulia: so it is better than nothing, and better than the original, right? it == your patch. | 21:10 |
| TheJulia | yes | 21:11 |
| rloo | TheJulia: I mean, the patch was meant to do the same 'wait' in another area. If the 'wait' itself is suboptimal, that seems to me a bug/different issue. | 21:11 |
| rloo | TheJulia: so why can't we just make the change to have the wait as in the original, and someone can fix that bug... | 21:12 |
| TheJulia | Well, we have to wait before the lock is freed. If we think it is freed when it really is not, then the next operation might fail depending on the operation and the state | 21:12 |
| TheJulia | I've nevera actually see the lock code log anything in all of hte conductor logs I've looked at, so maybe it is for naught | 21:12 |
| rloo | oh. hmm. in that case, then we need to fix the bug first. | 21:13 |
| TheJulia | wheeeee... :671: DeprecationWarning: 'async' and 'await' will become reserved keywords in Python 3.7 when running a fresh tox -epep8 run | 21:13 |
| rloo | who uses python 3.7? :) | 21:14 |
| *** sasha2 has quit IRC | 21:15 | |
| *** threestrands_ has joined #openstack-ironic | 21:18 | |
| openstackgerrit | Julia Kreger proposed openstack/ironic master: WIP: Don't try to lock upfront for vif removal https://review.openstack.org/534441 | 21:19 |
| *** sasha2 has joined #openstack-ironic | 21:20 | |
| TheJulia | re vif, conceptually ^^^ Looks like a couple of the unit tests are broken, but I've also got unrelated failures appearing for pxe template handling :( | 21:20 |
| TheJulia | rloo: well, w/r/t ironic-lib, ultimately we're just moving the code, so there is no real rush, and I only noticed the fact that we're not getting all of the possible info when I poked my lvm volume and went "wait a second... this is definitely in-use...." | 21:22 |
| *** deadnull has quit IRC | 21:23 | |
| rloo | TheJulia: well, not just moving the code, using it in another place too. but if that code doesn't work, then doesn't matter about using it elsewhere; not worth it. | 21:23 |
| TheJulia | if I have something open with fdisk, like a block file, and I try to query it, it will show as an fs lock, but if that filesystem is mounted by the kernel vfs layer then it will show as free | 21:25 |
| *** mgoddard_ has quit IRC | 21:25 | |
| openstackgerrit | Ian Pilcher proposed openstack/ironic-lib master: Use dd conv=sparse when writing images to nodes https://review.openstack.org/534442 | 21:28 |
| TheJulia | heh, I had no idea dd even had that capability and I've been using dd for... far longer than I ever want to think about | 21:31 |
| *** ElCoyote_ has joined #openstack-ironic | 21:43 | |
| *** rama_y has quit IRC | 21:44 | |
| *** dprince has quit IRC | 21:44 | |
| *** etingof has joined #openstack-ironic | 21:54 | |
| TheJulia | rloo: I've posted a few questions back to you on the ironic-lib patch. My aspie brain has requested cider and a pizza, so I'll be back a little later | 21:56 |
| *** makowals has quit IRC | 21:57 | |
| rloo | TheJulia: oh, so you want answers from me today? i'm in rescue-review bowels.. oh geez, just remembered i said i'd review one of dmitry's patches too. ok, will see what i can do. | 21:58 |
| TheJulia | rloo: tomorrow morning is fine | 21:59 |
| *** trown is now known as trown|outtypewww | 22:00 | |
| *** crushil_ has quit IRC | 22:19 | |
| *** crushil_ has joined #openstack-ironic | 22:30 | |
| *** rcernin has joined #openstack-ironic | 22:31 | |
| *** cjloader has quit IRC | 22:51 | |
| *** bfournie has quit IRC | 22:51 | |
| *** jroll has quit IRC | 22:53 | |
| *** baha has quit IRC | 22:55 | |
| *** jroll has joined #openstack-ironic | 22:58 | |
| *** ElCoyote_ has quit IRC | 22:59 | |
| *** rbudden has quit IRC | 23:00 | |
| *** rbudden has joined #openstack-ironic | 23:07 | |
| *** crushil_ has quit IRC | 23:08 | |
| *** pmannidi has joined #openstack-ironic | 23:17 | |
| openstackgerrit | Harald Jensås proposed openstack/networking-baremetal master: Docs - Add multi-tenant devstack - n-g-s vlans https://review.openstack.org/534459 | 23:21 |
| openstackgerrit | Harald Jensås proposed openstack/ironic master: Devstack - use neutron segments (routed provider networks) https://review.openstack.org/531275 | 23:22 |
| openstackgerrit | Harald Jensås proposed openstack/ironic master: Wait for ironic-neutron-agent to report state https://review.openstack.org/531637 | 23:22 |
| openstackgerrit | Harald Jensås proposed openstack/networking-baremetal master: Add baremetal neutron agent https://review.openstack.org/456235 | 23:22 |
| openstackgerrit | Harald Jensås proposed openstack/networking-baremetal master: start_flag = True, only first time, or conf change https://review.openstack.org/533707 | 23:26 |
| openstackgerrit | Harald Jensås proposed openstack/networking-baremetal master: Switch from MechanismDriver to SimpleAgentMechanismDriverBase https://review.openstack.org/521838 | 23:26 |
| openstackgerrit | Harald Jensås proposed openstack/networking-baremetal master: Devstack - Add ironic-neutron-agent https://review.openstack.org/530117 | 23:26 |
| openstackgerrit | Harald Jensås proposed openstack/networking-baremetal master: Add support to bind type vlan networks https://review.openstack.org/532349 | 23:26 |
| openstackgerrit | Harald Jensås proposed openstack/networking-baremetal master: Add dsvm job https://review.openstack.org/530409 | 23:26 |
| openstackgerrit | Harald Jensås proposed openstack/networking-baremetal master: Docs - Add multi-tenant devstack - n-g-s vlans https://review.openstack.org/534459 | 23:26 |
| *** etingof has quit IRC | 23:29 | |
| NobodyCam | \o/ Woo Hoo for docs! | 23:30 |
| *** charcol has joined #openstack-ironic | 23:35 | |
| *** penick has quit IRC | 23:40 | |
| *** etingof has joined #openstack-ironic | 23:50 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!