Friday, 2021-04-23

*** pmannidi has quit IRC00:02
*** pmannidi has joined #openstack-ironic00:03
*** gyee has quit IRC00:05
*** pmannidi has quit IRC00:07
*** pmannidi has joined #openstack-ironic00:09
*** pmannidi has quit IRC00:14
*** pmannidi has joined #openstack-ironic00:20
*** pmannidi has quit IRC00:25
*** pmannidi has joined #openstack-ironic00:26
*** pmannidi has quit IRC00:31
*** k_mouza has joined #openstack-ironic00:32
*** k_mouza has quit IRC00:32
*** pmannidi has joined #openstack-ironic00:32
*** k_mouza has joined #openstack-ironic00:33
*** pmannidi has quit IRC00:36
*** k_mouza has quit IRC00:41
*** pmannidi has joined #openstack-ironic00:44
*** pmannidi has quit IRC00:48
*** pmannidi has joined #openstack-ironic00:49
*** pmannidi has quit IRC00:54
*** paras333 has joined #openstack-ironic00:59
*** pmannidi has joined #openstack-ironic01:01
*** paras333 has quit IRC01:03
*** pmannidi has quit IRC01:05
*** pmannidi has joined #openstack-ironic01:13
*** pmannidi has quit IRC01:17
*** pmannidi has joined #openstack-ironic01:18
*** pmannidi has quit IRC01:23
*** paras333 has joined #openstack-ironic01:32
*** pmannidi has joined #openstack-ironic01:36
*** paras333 has quit IRC01:36
*** k_mouza has joined #openstack-ironic01:39
*** k_mouza has quit IRC01:39
*** k_mouza has joined #openstack-ironic01:40
*** pmannidi has quit IRC01:40
*** k_mouza_ has joined #openstack-ironic01:43
*** k_mouza has quit IRC01:47
*** k_mouza_ has quit IRC01:47
*** pmannidi has joined #openstack-ironic01:47
*** pmannidi has quit IRC01:52
*** pmannidi has joined #openstack-ironic01:53
*** k_mouza has joined #openstack-ironic01:57
*** k_mouza has quit IRC02:01
*** k_mouza has joined #openstack-ironic02:15
*** k_mouza has quit IRC02:19
*** tzumainn has quit IRC03:25
*** mkrai has joined #openstack-ironic03:36
*** zzzeek has quit IRC03:37
*** zzzeek has joined #openstack-ironic03:38
*** k_mouza has joined #openstack-ironic04:16
*** k_mouza has quit IRC04:21
*** buhman has joined #openstack-ironic05:01
openstackgerritVerification of a change to openstack/ironic failed: Fix fast track with redfish-virtual-media  https://review.opendev.org/c/openstack/ironic/+/78540705:04
*** priteau has joined #openstack-ironic05:29
*** paras333 has joined #openstack-ironic05:33
*** paras333 has quit IRC05:38
*** k_mouza has joined #openstack-ironic06:17
*** k_mouza has quit IRC06:21
openstackgerritRadosław Piliszek proposed openstack/bifrost stable/wallaby: [CI] Make Kolla job running again  https://review.opendev.org/c/openstack/bifrost/+/78760506:55
arne_wiebalckGood morning, ironic!07:04
*** frigo has joined #openstack-ironic07:09
frigogood morning Ironic!07:09
*** mkrai has quit IRC07:10
*** rpittau|afk is now known as rpittau07:12
rpittaugood morning ironic! Happy Friday! o/07:12
frigohappy Friday rpittau !07:19
*** rcernin has quit IRC07:25
*** buhman has quit IRC07:30
rpittauhey frigo :)07:32
frigoI'm investigating why the virtual media boot is slow and fails some times... in fact Grub/the iLO, choose to do HTTP GET request by range of 131072 or 262144 bytes. So it needs something like 2000 queries to complete, and there is no retry logic07:41
*** dougsz has joined #openstack-ironic07:51
*** rcernin has joined #openstack-ironic07:52
*** tosky has joined #openstack-ironic07:53
*** rcernin has quit IRC07:57
*** derekh has joined #openstack-ironic08:07
*** rcernin has joined #openstack-ironic08:09
*** mgoddard has joined #openstack-ironic08:12
*** rcernin has quit IRC08:14
*** dtantsur|afk is now known as dtantsur08:17
*** k_mouza has joined #openstack-ironic08:19
dtantsurmorning ironic08:19
dtantsurfrigo: wow08:19
frigo(Im think Im going to add a retry logic but this is some grub efi thing, the environment might not be straigtforward to set up. I think our object store (so... S3) is throttling us a bit)08:20
dtantsureandersson: try removing .stestr directory08:20
*** k_mouza has quit IRC08:23
*** mkrai has joined #openstack-ironic08:27
openstackgerritVerification of a change to openstack/ironic failed: Fix fast track with redfish-virtual-media  https://review.opendev.org/c/openstack/ironic/+/78540708:32
openstackgerritRiccardo Pittau proposed openstack/ironic-python-agent master: [trivial] Add versions to wallaby release notes  https://review.opendev.org/c/openstack/ironic-python-agent/+/78768808:32
openstackgerritVerification of a change to openstack/ironic failed: Fix fast track with redfish-virtual-media  https://review.opendev.org/c/openstack/ironic/+/78540708:52
*** rcernin has joined #openstack-ironic09:00
*** k_mouza has joined #openstack-ironic09:02
ajyaHi, http://ptg.openstack.org/ptg.html says that 3rd party CI will start at 13UTC, but the room is booked starting from 15UTC. Which is it? I think it should be 15UTC in Coming up next section.09:16
*** rcernin has quit IRC09:18
*** rcernin has joined #openstack-ironic09:21
dtantsurajya: yeah, it's 15UTC. probably a typo09:30
*** dtantsur is now known as dtantsur|bbl09:30
ajyathx09:37
*** k_mouza has quit IRC09:40
*** k_mouza has joined #openstack-ironic09:42
*** k_mouza has quit IRC09:43
*** k_mouza has joined #openstack-ironic09:45
openstackgerritDhuldev Valekar proposed openstack/ironic master: Follow up to add iDRAC management via Redfish  https://review.opendev.org/c/openstack/ironic/+/78477509:48
*** k_mouza_ has joined #openstack-ironic09:50
*** k_mouza has quit IRC09:53
*** vdrok has quit IRC10:04
*** vdrok has joined #openstack-ironic10:04
*** k_mouza_ has quit IRC10:07
openstackgerritMerged openstack/ironic-python-agent stable/wallaby: Do not fail network interface collection on unsupported interface  https://review.opendev.org/c/openstack/ironic-python-agent/+/78759710:09
openstackgerritMerged openstack/ironic-python-agent stable/victoria: Do not fail network interface collection on unsupported interface  https://review.opendev.org/c/openstack/ironic-python-agent/+/78759810:09
*** k_mouza has joined #openstack-ironic10:19
openstackgerritVerification of a change to openstack/ironic failed: Wipe agent tokens on inspection start and abort  https://review.opendev.org/c/openstack/ironic/+/78737610:33
*** rcernin has quit IRC10:43
*** viks____ has joined #openstack-ironic11:02
*** mkrai has quit IRC11:04
*** lucasagomes has joined #openstack-ironic11:10
*** rcernin has joined #openstack-ironic11:15
viks____Hi, baremetal installation guide contains setting up the network using openvswitch mechanism driver.. Does it work with linuxbridge as well ? or not? If yes, is there any documentation on how to set up using linuxbridge? can someone plz help?11:18
*** paras333 has joined #openstack-ironic11:36
*** paras333 has quit IRC11:41
*** mgoddard has quit IRC11:43
*** rcernin has quit IRC11:49
openstackgerritMerged openstack/ironic master: Fix fast track with redfish-virtual-media  https://review.opendev.org/c/openstack/ironic/+/78540712:08
*** rh-jelabarre has joined #openstack-ironic12:11
*** dtantsur|bbl is now known as dtantsur12:29
dtantsurviks____: it probably should, you just need to make sure the bare metal machines can access the DHCP agent12:30
TheJuliagood morning12:32
rpittaudtantsur, TheJulia: if you have a minute, this should be the last grenade removal -> https://review.opendev.org/c/openstack/ironic-inspector/+/78750612:33
rpittauTheJulia: good morning! :)12:33
TheJuliaapproved12:33
rpittauthanks12:34
*** k_mouza has quit IRC12:40
*** k_mouza has joined #openstack-ironic12:41
viks____dtantsur: Ok thanks..  Do we have some setup documentation with linuxbridge somewhere?12:44
*** mgoddard has joined #openstack-ironic12:44
dtantsurI don't think so, you should probably check Neutron docs12:45
viks____dtantsur: ok.. thanks12:48
*** priteau has quit IRC12:48
*** priteau has joined #openstack-ironic12:54
*** rloo has joined #openstack-ironic13:02
TheJuliaviks____: if your operating with linuxbridge, I'd also make that known to Neutron because they may not be cognizent of all of it's use13:04
*** k_mouza_ has joined #openstack-ironic13:10
viks____TheJulia: ok... can you plz elaborate a bit.. also is openvswitch  the preferred choice?13:13
*** k_mouza has quit IRC13:13
viks____and is there any issues if linuxbridge used with ironic? or it should work just normal?13:15
TheJuliaviks____: ovn, which is superceeding openvswitch, is superceeding. Linuxbridge is considered "the old thing" from before openvswitch13:18
TheJuliaviks____: I think it should just work, but obviously not in a test matrix13:18
*** dhellmann has quit IRC13:19
viks____TheJulia: ok... thanks13:20
*** dhellmann has joined #openstack-ironic13:25
*** tzumainn has joined #openstack-ironic13:40
*** priteau has quit IRC13:43
openstackgerritMerged openstack/ironic-inspector stable/rocky: Remove grenade jobs from old stable branches  https://review.opendev.org/c/openstack/ironic-inspector/+/78750613:43
*** priteau has joined #openstack-ironic13:46
openstackgerritDmitry Tantsur proposed openstack/ironic stable/wallaby: Fix fast track with redfish-virtual-media  https://review.opendev.org/c/openstack/ironic/+/78761314:06
rpittaubye everyone, have a great weekend! o/14:15
*** rpittau is now known as rpittau|afk14:15
openstackgerritVerification of a change to openstack/ironic failed: Remove temporary cleaning information on starting cleaning  https://review.opendev.org/c/openstack/ironic/+/78753614:23
*** k_mouza_ has quit IRC14:36
*** k_mouza has joined #openstack-ironic14:36
*** lbragstad_ has joined #openstack-ironic14:38
*** lbragstad has quit IRC14:42
openstackgerritVerification of a change to openstack/ironic failed: Remove temporary cleaning information on starting cleaning  https://review.opendev.org/c/openstack/ironic/+/78753614:56
*** paras333_ has joined #openstack-ironic15:01
*** k_mouza_ has joined #openstack-ironic15:12
*** k_mouza has quit IRC15:16
*** k_mouza has joined #openstack-ironic15:20
*** k_mouza_ has quit IRC15:23
openstackgerritMark Goddard proposed openstack/bifrost master: Install squashfs-tools for Ubuntu image builds  https://review.opendev.org/c/openstack/bifrost/+/78750515:32
frigofyi I sent https://lists.gnu.org/archive/html/grub-devel/2021-04/msg00098.html   - grub/iLO with virtual media is hammering the object store with thousands HTTP requests, and sometimes one fails. I added a retry in grub and it seems to work.. (not sure grub community will be as nice as the Ironic one, but I try nevertheless:))15:41
dtantsurinteresting!15:42
TheJuliaouch15:43
frigoin fact the BMC is not that slow:)  but of course retrieving a 350MB file through 200kB chunks, one at a time, does not help15:43
TheJuliathat actually explains some behavior I've observed, I just never really looked at the logs15:43
frigomaybe it was visible on swift as well15:43
frigoa *real* fix would be to increase the chunk size, but I leave that to someone else...15:44
frigo(or to somehow, be able to have the initramdisk downloaded by the kernel and not by grub... some magic you are adding to CoreOS?)15:46
TheJuliaYeah, the entire interaction chain is just.. not great with connect when the IO ops are super small15:47
TheJuliaI think one of my machines does like 32k blocks on http and then closes the connection...15:47
frigoouch. Also the object store and the BMC usually are in different networks, you pay a long "ping" for each packet15:48
TheJuliaindeed15:48
TheJuliaphotons or electrons in mediums are also not the speed of light15:49
dtantsurfrigo: this is where having a 2-stage IPA ramdisk may come handy15:49
frigoyes! does that exist ?15:49
dtantsurno, but it shouldn't be hard to make15:49
frigolol15:50
* JayF offers generic warnings about two-stage ramdisks being more susceptable to firmware issues in network cards15:50
dtantsurI've done something similar with CoreOS (you don't want to try it)15:50
dtantsurJayF: this is a very fair point. On the other hand, retrying logic is simpler once you're in normal user space15:50
frigoit's fine as long as we build our own IPA that works with our hardware15:51
JayFI'm just offering vague warnings :D IPA being a 1-stage ramdisk is explicitly a feature IMO, but obviosuly that grub issue is horrendous so we should try to fix it :)15:51
dtantsuryet, I'm not sure how much space we'd win by splitting away the IPA venv15:52
frigoIf I can build my IPA at the size of the TinyIPA that would be an improvement already...15:52
dtantsurthe IPA venv is just 43 MiB..15:53
dtantsurfrigo: you may win a lot by playing with this parameter https://opendev.org/openstack/ironic-python-agent-builder/src/branch/master/dib/ironic-python-agent-ramdisk/environment.d/10-defaults.bash#L115:55
dtantsurpretty much remove everything not needed by your hardware15:55
frigocool! indeed firmware takes 1/3 I think15:56
dtantsurcorrect15:56
frigoI confirm emacs is not installed too16:02
frigoaaaand good evening!16:03
*** frigo has quit IRC16:06
*** diurnalist has joined #openstack-ironic16:15
*** k_mouza has quit IRC16:16
*** lucasagomes has quit IRC16:38
*** dougsz has quit IRC16:51
*** derekh has quit IRC17:01
arne_wiebalckbye everyone o/17:18
*** diurnalist has quit IRC17:21
*** dtantsur is now known as dtantsur|afk17:22
*** lbragstad_ is now known as lbragstad17:23
dtantsur|afkhave a great weekend folks17:25
*** diurnalist has joined #openstack-ironic17:31
*** diurnalist has quit IRC17:46
*** gyee has joined #openstack-ironic18:05
*** diurnalist has joined #openstack-ironic18:12
openstackgerritMerged openstack/ironic stable/victoria: Wipe agent tokens on inspection start and abort  https://review.opendev.org/c/openstack/ironic/+/78737618:26
-openstackstatus- NOTICE: The Gerrit service on review.openstack.org is being restarted to pick up some updates, and should be available again momentarily19:02
*** stevebaker has quit IRC19:55
*** diurnalist has quit IRC20:11
*** rloo has quit IRC20:11
*** rloo has joined #openstack-ironic20:12
*** rloo has quit IRC20:15
*** rloo has joined #openstack-ironic20:16
*** rloo has quit IRC20:20
*** rloo has joined #openstack-ironic20:21
*** diurnalist has joined #openstack-ironic20:37
*** paras333_ has quit IRC20:50
*** diurnalist has quit IRC21:10
openstackgerritMerged openstack/ironic master: Remove temporary cleaning information on starting cleaning  https://review.opendev.org/c/openstack/ironic/+/78753621:23
*** diurnalist has joined #openstack-ironic21:28
*** ociuhandu has joined #openstack-ironic21:45
*** ociuhandu has quit IRC21:49
*** rloo has quit IRC21:57
*** buhman has joined #openstack-ironic22:18
*** tzumainn has quit IRC23:03
*** diurnalist has quit IRC23:19
*** diurnalist has joined #openstack-ironic23:39
*** bfournie has quit IRC23:41
*** diurnalist has quit IRC23:54
*** tosky has quit IRC23:58

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!