Tuesday, 2020-03-17

*** erbarr has quit IRC00:08
*** TxGirlGeek has quit IRC00:22
*** ociuhandu has joined #openstack-ironic00:44
*** ociuhandu has quit IRC00:49
*** cdearborn has quit IRC01:10
*** Goneri has quit IRC01:12
*** rh-jelabarre has quit IRC02:35
*** tzumainn has quit IRC02:45
*** diurnalist has joined #openstack-ironic02:46
*** diurnalist has quit IRC02:51
*** diurnalist has joined #openstack-ironic02:55
*** mkrai has joined #openstack-ironic03:09
*** ricolin has joined #openstack-ironic03:41
*** diurnalist has quit IRC03:48
*** diurnalist has joined #openstack-ironic04:13
*** diurnalist has quit IRC04:22
*** ricolin has quit IRC04:48
*** mkrai has quit IRC05:08
*** mkrai_ has joined #openstack-ironic05:08
*** ricolin has joined #openstack-ironic05:45
arne_wiebalckGood morning, ironic!05:56
*** jdandrea has quit IRC06:00
arne_wiebalckThanks TheJulia dtantsur|afk rpittau|afk iurygregory for the taking the time to compile this very comprehensive mid cycle summary!06:07
*** k_mouza has joined #openstack-ironic06:15
*** ociuhandu has joined #openstack-ironic06:17
*** k_mouza has quit IRC06:19
*** ociuhandu has quit IRC06:28
*** ociuhandu has joined #openstack-ironic06:28
*** ociuhandu has quit IRC06:33
openstackgerritRachit Kapadia proposed openstack/ironic master: DRAC: Fix a failure to create virtual disk bug  https://review.opendev.org/71085206:38
openstackgerritRiccardo Pittau proposed openstack/bifrost master: Switch to stestr  https://review.opendev.org/71234406:49
openstackgerritRiccardo Pittau proposed openstack/bifrost master: Fix dhcp job  https://review.opendev.org/71230407:06
iurygregorygood morning Ironic07:07
iurygregoryarne_wiebalck, np o/07:07
*** ociuhandu has joined #openstack-ironic07:49
openstackgerritMerged openstack/bifrost master: Switch to stestr  https://review.opendev.org/71234408:03
*** uzumaki has joined #openstack-ironic08:06
openstackgerritMerged openstack/ironic master: Send our token back to the agent  https://review.opendev.org/69758508:10
*** uzumaki has quit IRC08:14
*** tkajinam has quit IRC08:15
*** tesseract has joined #openstack-ironic08:17
*** dtantsur|afk is now known as dtantsur08:24
dtantsurmorning ironic08:25
iurygregorymorning dtantsur08:30
*** amoralej|off is now known as amoralej08:31
*** mkrai_ has quit IRC08:35
*** ociuhandu has quit IRC08:39
*** ociuhandu has joined #openstack-ironic08:39
*** jtomasek has joined #openstack-ironic08:43
*** ociuhandu has quit IRC08:54
*** priteau has joined #openstack-ironic09:01
*** mkrai_ has joined #openstack-ironic09:05
*** ociuhandu has joined #openstack-ironic09:17
*** ociuhandu has quit IRC09:22
openstackgerritKaifeng Wang proposed openstack/ironic-inspector master: Add text for mutiarch configuration  https://review.opendev.org/71338509:24
*** yaawang has quit IRC09:24
*** yaawang has joined #openstack-ironic09:27
dtantsurrpittau|afk, mgoddard, hey, what's the status of bifrost CI? should we disable the centos8 job for now?09:29
*** priteau has quit IRC09:31
rpittau|afkdtantsur: the job is fixed09:38
*** rpittau|afk is now known as rpittau09:38
rpittaugood morning ironic! o/09:38
openstackgerritMahendra Kamble proposed openstack/ironic master: DRAC : idrac-redfish inspect updates pxe port  https://review.opendev.org/69332809:39
iurygregorymorning rpittau09:49
rpittauhey iurygregory :)09:49
openstackgerritRiccardo Pittau proposed openstack/bifrost master: Fix dhcp job  https://review.opendev.org/71230409:52
openstackgerritRiccardo Pittau proposed openstack/bifrost master: Fix dhcp job  https://review.opendev.org/71230409:53
*** threestrands has quit IRC09:56
dtantsurthanks rpittau. so, recheck all the things, right?09:58
rpittaudtantsur: yeah :)09:58
rpittauI think we have only 2 patches open at the moment09:58
*** khansa has joined #openstack-ironic10:02
iurygregoryplease insert the meme recheck all things here10:04
*** ociuhandu has joined #openstack-ironic10:05
*** ociuhandu has quit IRC10:12
*** ociuhandu has joined #openstack-ironic10:12
*** khansa has quit IRC10:12
*** yaawang has quit IRC10:23
*** yaawang has joined #openstack-ironic10:23
*** khansa has joined #openstack-ironic10:25
openstackgerritKaifeng Wang proposed openstack/ironic-inspector master: Add words for mutiarch configuration  https://review.opendev.org/71338510:30
*** Lucas_Gray has joined #openstack-ironic10:46
rpittauiurygregory: https://i.imgflip.com/3swya6.jpg10:46
*** ociuhandu has quit IRC10:46
iurygregoryrpittau, ++10:46
dtantsurheh10:51
*** ociuhandu has joined #openstack-ironic10:54
*** k_mouza has joined #openstack-ironic10:55
*** mkrai_ has quit IRC10:57
*** ociuhandu has quit IRC10:59
openstackgerritVerification of a change to openstack/ironic-python-agent failed: Rescan after restarting the md device  https://review.opendev.org/70663211:01
*** Lucas_Gray has quit IRC11:02
*** Lucas_Gray has joined #openstack-ironic11:02
*** ociuhandu has joined #openstack-ironic11:07
*** Lucas_Gray has quit IRC11:10
*** Lucas_Gray has joined #openstack-ironic11:12
openstackgerritDmitry Tantsur proposed openstack/ironic master: Documentation clarifications for software RAID  https://review.opendev.org/71340411:16
dtantsurarne_wiebalck: could you double-check me on ^^^ please?11:16
arne_wiebalckdtantsur: will do!11:18
dtantsurto be clear: this is before the hints support, I intend to backport it when merged11:18
dtantsurthanks11:18
*** ociuhandu has quit IRC11:18
arne_wiebalckdtantsur: done11:20
dtantsurthat was quick :)11:20
openstackgerritDmitry Tantsur proposed openstack/ironic-python-agent master: [WIP] Allow specifying target devices for software RAID  https://review.opendev.org/71320911:22
dtantsurone small fix ^^ will look into tests soon11:23
openstackgerritMerged openstack/bifrost master: Ensure DIB is installed from source  https://review.opendev.org/71212011:24
*** ociuhandu has joined #openstack-ironic11:29
*** mkrai_ has joined #openstack-ironic11:33
openstackgerritArne Wiebalck proposed openstack/ironic master: [doc] Add documentation for retirement support  https://review.opendev.org/71341011:34
*** rpittau is now known as rpittau|afk11:34
*** rpittau|afk is now known as rpittau|bbl11:34
*** ociuhandu has quit IRC11:34
arne_wiebalckrpittau|bbl: dtantsur: the addition to the admin doc as discussed yesterday ^11:35
dtantsurnice!11:35
dtantsura couple quick comments, will review in depth later11:36
*** tkajinam has joined #openstack-ironic11:37
*** tkajinam has quit IRC11:39
*** tkajinam has joined #openstack-ironic11:40
*** tkajinam has quit IRC11:41
*** tkajinam has joined #openstack-ironic11:41
*** tkajinam has quit IRC11:42
*** dougsz has joined #openstack-ironic11:49
*** tkajinam has joined #openstack-ironic11:53
openstackgerritIlya Etingof proposed openstack/sushy-cli master: Add system BIOS management command  https://review.opendev.org/71154111:56
openstackgerritIlya Etingof proposed openstack/sushy-cli master: Add `--show-traffic` feature to aid Redfish diagnostics  https://review.opendev.org/71341812:03
openstackgerritDmitry Tantsur proposed openstack/ironic-python-agent master: Allow specifying target devices for software RAID  https://review.opendev.org/71320912:04
*** rh-jelabarre has joined #openstack-ironic12:05
*** k_mouza has quit IRC12:06
*** ociuhandu has joined #openstack-ironic12:08
etingoffun fact: it takes 6MB of JSON messaging with iDRAC to change a single bios option12:10
dtantsurO___o12:12
iurygregory=O12:12
dtantsurthe future is bright, let us put on sunglasses12:12
etingofactually, even simplest get system info involves the same 6MB. it's message registries to blame12:12
iurygregorywoa12:12
dtantsuretingof: please tell me we don't download them on each call..12:13
etingofsorry dtantsur12:13
dtantsurugh12:13
dtantsuractually, we shouldn't download them until we need them (e.g. to display an error)12:13
iurygregoryI'm wondering if all the 6MB of information is necessary .-.12:13
iurygregorydtantsur ++12:14
dtantsurI'm wondering if it includes jquery, bootstrap.js etc :D12:14
etingofwell, we try to cache these beasts so when cache works we should not probably re-download them (I need to check if it really works that way)12:14
iurygregoryhehehe12:14
etingofthat cache lives within Sushy object12:15
etingofso every time it's re-created I am pretty sure we re-download the whole thing12:15
* dtantsur suppresses the urge to throw the monitor in the window12:15
etingofno code, pure json12:15
dtantsurwe can probably cache it globally for the process..12:16
*** khansa has quit IRC12:16
etingofwell, they are BMC-specific anyway12:16
etingofeach node should have its own copy12:17
etingofperhaps it would be best to postpone downloading until we need to resolve error12:17
dtantsur++12:17
*** ociuhandu has quit IRC12:18
etingofI will look into that... with the latest sushy-cli --show-traffic it's evident what's lurking under water12:18
*** khansa has joined #openstack-ironic12:20
*** k_mouza has joined #openstack-ironic12:22
*** rcernin has quit IRC12:26
openstackgerritDmitry Tantsur proposed openstack/ironic master: Allow specifying target devices for software RAID  https://review.opendev.org/71342312:30
*** ociuhandu has joined #openstack-ironic12:33
*** khansa has quit IRC12:40
*** rpittau|bbl is now known as rpittau12:51
openstackgerritMerged openstack/ironic master: Drop rootwrap.d/ironic-lib.filters file  https://review.opendev.org/68427012:59
openstackgerritMerged openstack/ironic master: Add separate policies for updating node instance_info and extra  https://review.opendev.org/70771912:59
openstackgerritMerged openstack/ironic-tempest-plugin master: Test cases for iLO driver in standalone ironic  https://review.opendev.org/70837912:59
openstackgerritMerged openstack/ironic-inspector master: Add words for mutiarch configuration  https://review.opendev.org/71338512:59
*** mkrai_ has quit IRC13:02
*** mbeierl has joined #openstack-ironic13:04
TheJuliagood morning13:06
dtantsurmorning TheJulia13:06
*** ociuhandu has quit IRC13:07
openstackgerritJulia Kreger proposed openstack/ironic master: Hash the rescue_password  https://review.opendev.org/69141313:08
TheJuliadtantsur: kaifeng ^^13:08
dtantsurTheJulia: I'm still in the meh group for a breaking change13:09
TheJuliawe can't fix it and not break it13:09
dtantsurwe can do the same thing as with agent token13:09
TheJuliano, we really can't13:09
dtantsurallow fallback by default, provide an option to disallow fallback13:09
dtantsurI'm still unable to see why13:10
openstackgerritArne Wiebalck proposed openstack/ironic master: [doc] Add documentation for retirement support  https://review.opendev.org/71341013:10
TheJuliaan attacker could still pretend to be an older agent, and cause the password to be revealed to themselves if they carefully crafted an attack13:10
TheJuliathe idea of the patch was prevent that from being able to happen13:11
TheJuliaSo this is a case where breaking compatibility is the best choice for enhanced security13:11
dtantsurTheJulia: active MitM, which is something agent token is vulnerable to as well13:11
TheJuliawell, before agent token, it didn't have to be active MitM13:11
dtantsurright, and this is what I'm talking about: we could prevent passive MitM *now* and provide a knob to close all gaps13:12
openstackgerritArne Wiebalck proposed openstack/ironic master: [doc] Add documentation for retirement support  https://review.opendev.org/71341013:12
dtantsurthen we could backport the resulting changes as far as we want13:12
dtantsurwhile now we'll be stuck with Ussuri (and probably piss off some users)13:12
TheJuliahow many operators would actually use the knob?13:12
dtantsurthat's a philosophical question13:13
dtantsurhow many operators give a damn about features and fixes we add?13:13
TheJuliayour raising this point because you want to try and do a graceful backport right?13:13
dtantsuryep, I'd be curious to backport that13:13
dtantsurand I think the only blocker is its breaking nature13:13
*** amoralej is now known as amoralej|lunch13:13
TheJuliaI had thought we agreed just to break people and backport it13:13
dtantsurI'm definitely -2 to backporting a breaking changes13:14
TheJuliaokay, -1 it. I'll try to pick it up again later today and... find a way to navigate it13:14
dtantsurI'm not blocking the patch, since I see your point as well13:14
dtantsurTheJulia: mmm, one thing though13:14
dtantsurno, never mind, being stupid13:15
TheJuliaI'm kind of at that "I'm out of spoons and I've been trying to get this in since october point"13:15
dtantsurI hear ya13:15
TheJuliai know13:15
TheJuliapreaching to the choir13:15
dtantsurTheJulia: time to find a volunteer to finish this work?13:16
* dtantsur looks around in search of an innocent victim13:16
TheJuliaeh, I can do it as long as my meeting in like3-4 hours doesn't derail my day13:16
dtantsur> meeting > doesn't derail my day13:16
*** rloo has joined #openstack-ironic13:17
* TheJulia suddenly wonders, how many meetings she actually has today and pulls up the other calendar13:18
TheJuliaoh yay, just two13:18
dtantsurnot bad13:19
*** rloo has quit IRC13:19
dtantsur(actually, pretty bad IMO)13:19
TheJuliawelll, today was also going to have a board meeting13:19
TheJulialuckilly, it got pushed back13:19
*** rloo has joined #openstack-ironic13:19
TheJuliahow do people feel about our code using port['extra'] ?13:27
*** Goneri has joined #openstack-ironic13:27
dtantsuruneasy. why?13:30
openstackgerritMark Goddard proposed openstack/bifrost stable/train: Ensure DIB is installed from source  https://review.opendev.org/71344313:31
iurygregorymorning TheJulia13:32
TheJuliadtantsur: add https://review.opendev.org/#/c/700002 to your review queue for that topic13:33
patchbotpatch 700002 - ironic - Additional IP addresses to IPv6 stateful ports - 8 patch sets13:33
TheJuliadtantsur: but I feel the same, fyi13:33
* dtantsur looking13:33
* TheJulia wonders if we begin bribing reviewers with coffee13:34
dtantsurbribing reviewers is a good idea to discuss13:37
TheJuliaI was thinking for reviewing13:38
TheJuliabut I'm a HORRIBLE person13:38
TheJuliaand I have no idea why you people like me :)13:38
dtantsureh, good old times when the potential of becoming a core was a huge motivation for newcomers..13:38
* dtantsur unrolls a huge scroll with reasons why he likes TheJulia13:38
TheJuliaoh noes13:38
TheJulia:)13:38
* dtantsur rolls it back and stashes for a better moment13:39
TheJulia:)13:39
rpittaubecause you offer free coffee in exchange of reviews? :)13:39
dtantsurthat's a future reason :)13:39
TheJuliaWell, we need that teleporter project first... and then I would send hawaiian coffee13:39
TheJulia(at which point, I just store the pattern in a "pattern buffer" and keep resending13:39
* rpittau worried for the personal coffee reserve13:40
dtantsurTheJulia: I got another use case for a human cloner as well13:40
dtantsur(Hugh asked me about the deployment API today)13:40
TheJuliaI have ~3.5 bags of whole  beans, so I think I'm relatively good13:40
TheJuliadtantsur: *sigh*13:40
dtantsuryeaaah13:40
* dtantsur hasn't had coffee in weeks13:40
TheJuliawut?!?13:41
dtantsurtrying to keep the levels of anxiety in check13:41
dtantsurunfortunately, doesn't help with my irritability (for which I apologize)13:41
*** ociuhandu has joined #openstack-ironic13:43
TheJuliaUnderstood, I have major anxiety issues, although I'm medicated13:44
TheJuliawith one of the worst medications to be on long term, but hey, I'm functional!13:44
TheJuliaand stable!13:44
TheJuliaQueue commentary on how horrible society is13:45
dtantsursigh13:45
dtantsurWe patch up ourselves to be able to keep going..13:46
rpittau:/13:46
*** tzumainn has joined #openstack-ironic13:51
*** jdandrea has joined #openstack-ironic13:52
arne_wiebalckmajor tempest test going on at the moment13:54
*** ociuhandu has quit IRC13:54
rpittaudefine "major" :)13:55
*** ociuhandu has joined #openstack-ironic13:55
arne_wiebalckwell, maximal then :)13:57
*** ociuhandu has quit IRC13:58
*** ociuhandu has joined #openstack-ironic13:58
*** mkrai has joined #openstack-ironic14:00
openstackgerritNoor Muhammad Malik proposed openstack/ironic master: WIP: [RFE] Implement the bios-interface for idrac-wsman driver  https://review.opendev.org/71345014:02
*** Lucas_Gray has quit IRC14:02
openstackgerritNoor Muhammad Malik proposed openstack/ironic master: WIP: [RFE] Implement the bios-interface for idrac-wsman driver  https://review.opendev.org/71345014:05
*** Lucas_Gray has joined #openstack-ironic14:05
*** Lucas_Gray has quit IRC14:07
TheJuliahttps://review.opendev.org/#/c/706864/ should be fairly quick to review14:07
patchbotpatch 706864 - ironic - Add node lessee field - 3 patch sets14:07
TheJuliaarne_wiebalck: maximal with pretty graphs to follow?14:07
arne_wiebalckI was referring to the current global situation :)14:08
TheJuliaoh... this is true14:08
rpittauoh!14:08
dtantsurlet's hope it doesn't turn into a grenade test :D14:09
*** Lucas_Gray has joined #openstack-ironic14:09
TheJuliaugh14:09
TheJuliano more openstack test jokes about current global situation14:09
arne_wiebalcksorry14:09
TheJuliakaifeng: You may wnat to look at dtantsur's comments on https://review.opendev.org/#/c/702215/14:09
patchbotpatch 702215 - ironic-inspector - Added scope to introspection rules. - 14 patch sets14:09
TheJuliaarne_wiebalck: no worries, basically all of my extended family is at high risk right now, so thinking about it is... not fun14:10
openstackgerritJulia Kreger proposed openstack/ironic master: Signal agent token is required  https://review.opendev.org/69930414:11
* dtantsur ditto14:11
*** jtomasek has quit IRC14:12
*** jtomasek has joined #openstack-ironic14:13
openstackgerritJulia Kreger proposed openstack/ironic master: Add indicators REST API endpoints  https://review.opendev.org/65178514:13
*** spotz has joined #openstack-ironic14:14
*** jtomasek has quit IRC14:15
TheJuliao/ spotz14:15
TheJuliakaifeng: you may want to also rebase https://review.opendev.org/#/c/694461/14:15
patchbotpatch 694461 - ironic-python-agent - Adds poll mode deployment support - 1 patch set14:15
TheJuliawith the agent token stuff having merged, you may need to do some more work and put some more thought into that change14:15
*** amoralej|lunch is now known as amoralej14:15
openstackgerritJulia Kreger proposed openstack/ironic master: Burn configdrive into virtual media boot ISO  https://review.opendev.org/68725014:16
*** uzumaki has joined #openstack-ironic14:18
*** Lucas_Gray has quit IRC14:18
TheJuliadtantsur: quick note on https://review.opendev.org/#/c/708697, no revision required, just spotted the helper moved and have this strong and strange feeling there is a similar thing elsewhere14:19
patchbotpatch 708697 - ironic - Refactoring: move iSCSI deploy code to iscsi_deplo... - 2 patch sets14:19
openstackgerritDmitry Tantsur proposed openstack/ironic master: Allow specifying target devices for software RAID  https://review.opendev.org/71342314:19
openstackgerritRiccardo Pittau proposed openstack/bifrost master: Fix dhcp job  https://review.opendev.org/71230414:21
dtantsurTheJulia++14:21
*** Lucas_Gray has joined #openstack-ironic14:21
TheJuliadtantsur: quick comment in-line https://review.opendev.org/#/c/711918/314:23
patchbotpatch 711918 - ironic - Remove compatibility with pre-deploy steps drivers - 3 patch sets14:23
TheJuliafor your thoughts14:23
dtantsurwill check after I finish with wrap_ipv614:24
TheJulia<314:24
openstackgerritTzu-Mainn Chen proposed openstack/ironic master: Add node lessee field  https://review.opendev.org/70686414:26
dtantsurTheJulia: sort of: if not node.driver_internal_info['deploy_steps']: blow-up?14:27
TheJuliakind of14:27
TheJulia"Your driver doesn't use deploy steps, support has been removed."14:27
TheJuliafriendly error message kind of thing14:28
TheJuliathen again that may be in the code elsewhere already14:28
dtantsurTheJulia: maybe? I can follow-up with this one as well.14:29
TheJuliaworks for me14:29
dtantsurokay, the wrap_ipv6 follow-up will be posted once the iSCSI refactoring merges, otherwise it has merge conflicts14:31
TheJuliak14:32
dtantsur(I have it prepared locally, just cannot git review)14:32
openstackgerritDmitry Tantsur proposed openstack/ironic master: Refactoring: split out wrap_ipv6  https://review.opendev.org/71345714:32
dtantsurokay, I did it without rebase, so it's probably insta-red14:32
arne_wiebalckTheJulia: I'm trying to get tempest going for the RAID patch ... do you think these are just random failures?14:35
arne_wiebalckTheJulia: (as you sent it into a recheck)14:35
TheJuliawhich ones specifically?14:35
TheJuliaoh, the rescue ones!14:35
TheJuliayeah, the port plugging can cause rescue testing to fail14:35
arne_wiebalckhttps://review.opendev.org/69615614:35
patchbotpatch 696156 - ironic-python-agent - Software RAID: Add UEFI support - 8 patch sets14:35
arne_wiebalckyes14:35
TheJuliaso it is a known thing14:36
arne_wiebalckoh, yeah?14:36
* arne_wiebalck is working on reproducing this on a local tempest14:36
* arne_wiebalck well, was trying14:37
TheJuliayeah, that one is near impossible because it is a race between neutron and ironci14:40
arne_wiebalckoh, ok14:43
* arne_wiebalck learnt some tempest stuff at least ;)14:43
TheJulia:)14:43
TheJulia\o/14:44
arne_wiebalckthe other half of the patch also fails in tempest, will have a look at that one then instead14:44
openstackgerritTzu-Mainn Chen proposed openstack/ironic master: Clean up nits from adding additional node update policies  https://review.opendev.org/71346214:45
* TheJulia wonders if with the thigns going on, if CI will remain stable for the rest of the cycle14:45
* TheJulia immediately knocks on the table14:46
dtantsurclose to the release? no way14:46
dtantsurwe cannot do without the traditional multinode grenade brea... ah, wait, it's already broken?14:46
TheJulia*sigh*14:46
*** ricolin_ has joined #openstack-ironic14:47
*** gmann is now known as gmann_afk14:48
*** tkajinam has quit IRC14:48
openstackgerritMerged openstack/bifrost master: Fix Ubuntu keystone deployment  https://review.opendev.org/71211214:51
*** ociuhandu has quit IRC14:56
openstackgerritNoor Muhammad Malik proposed openstack/ironic master: WIP: [RFE] Implement the bios-interface for idrac-wsman driver  https://review.opendev.org/71345014:56
*** diurnalist has joined #openstack-ironic14:58
*** khansa has joined #openstack-ironic14:58
*** dtantsur is now known as dtantsur|brb15:00
*** ociuhandu has joined #openstack-ironic15:01
openstackgerritRiccardo Pittau proposed openstack/ironic-inspector master: Convert ironic-inspector-non-standalone-tempest to dib  https://review.opendev.org/71251615:02
arne_wiebalckTheJulia: the same test failed again ... so I just recheck until it works?15:07
TheJuliaarne_wiebalck: got a link handy?15:08
arne_wiebalckhttps://zuul.opendev.org/t/openstack/build/42cfb78507d243f998244153761007b815:08
openstackgerritTzu-Mainn Chen proposed openstack/ironic master: Clean up nits from adding additional node update policies  https://review.opendev.org/71346215:12
rpittauarne_wiebalck, TheJulia, had a quick look and saw this: https://0b19ff5ea4687c54bbc8-78c6b016591aee5bdb634ced0dc80e36.ssl.cf5.rackcdn.com/696169/4/check/ironic-standalone/42cfb78/controller/logs/ironic-bm-logs/node-4_no_ansi_2020-03-04-16%3A37%3A00_log.txt15:18
*** ricolin_ has quit IRC15:18
rpittau2020-03-04 16:36:42.152 504 ERROR root TypeError: install_bootloader() got an unexpected keyword argument 'target_boot_mode'15:19
TheJuliahmm15:20
*** khansa has quit IRC15:22
TheJuliait is the patch15:22
TheJuliahttps://review.opendev.org/#/c/696169/415:22
patchbotpatch 696169 - ironic - Software RAID: Pass the boot mode to the IPA - 4 patch sets15:22
TheJuliaadds new keywords without having a fallback15:23
rpittaulooks like it15:23
TheJuliano fallback,then things fail15:23
rpittauwould probably help adding a unit test for that15:24
TheJuliait would need to be on every single command15:24
rpittauheh15:25
TheJuliaand the test got updated15:25
TheJuliato include the field15:25
TheJuliaso... *boom*15:25
TheJuliait happens though15:25
iurygregorydtantsur|brb, something like this sounds good https://gist.github.com/iurygregory/9eca22c011539fef8d010eb7355bf1b6 ?15:26
iurygregoryat least is a small boom15:27
TheJulianot an earth shattering kaboom?15:27
* rpittau hates when can't reproduce failures locally15:28
* arne_wiebalck is somewhat lost15:30
arne_wiebalckI may have provided the wrong link.15:30
TheJuliaarne_wiebalck: fret not! we are as well15:30
arne_wiebalcklol15:30
rpittauwelcome to the club! :)15:31
arne_wiebalckThere are 2 patches.15:31
arne_wiebalckLOL15:31
arne_wiebalckthe IPA one and the ironic one15:31
arne_wiebalckthe IPA one is the one I was looking at for now15:31
arne_wiebalckthis is the one we discussed Monday15:31
arne_wiebalckand it is the one that is failing in the rescue test15:31
rpittauarne_wiebalck: the link goes to the ironic one15:32
arne_wiebalckrpittau: aha!15:32
rpittau:)15:32
arne_wiebalcksanity restored!15:32
rpittaulucky you :)15:32
arne_wiebalckwell, don't trust me15:33
rpittaueheh15:33
arne_wiebalckhow did you find this log? did you go through all?15:33
*** priteau has joined #openstack-ironic15:33
arne_wiebalckas mentioned, I haven't looked at this one yet, so this might be obvious15:33
rpittauarne_wiebalck: not through all, just had a quick view at what looked off15:34
arne_wiebalckok15:34
arne_wiebalckwhat about the IPA one, retrying is the course of action?15:34
arne_wiebalckdue to the race TheJulia mentioned?15:34
arne_wiebalcktries to provide the correct link15:35
arne_wiebalckhttps://zuul.opendev.org/t/openstack/build/813605b238d741b79534426c01dac13515:35
rpittaummmm https://ef1bd6032c64c1864435-d6fd3b06d50c034d0364bbf684ea1b1c.ssl.cf5.rackcdn.com/696156/8/check/ironic-standalone-ipa-src/813605b/controller/logs/ironic-bm-logs/node-4_no_ansi_2020-03-13-17%3A17%3A29_log.txt15:37
*** erbarr has joined #openstack-ironic15:37
arne_wiebalckalso, for the first one: why does it break if it depends on the change in the IPA?15:37
*** gyee has joined #openstack-ironic15:38
arne_wiebalckrpittau: hmm indeed15:39
arne_wiebalckrpittau: it tries to mount md0p1 , but fails ... initially p1 was hardcoded, then superseded by using the rootfs uuid15:42
arne_wiebalckrpittau: I think it is now the default when the uuid is not passed or the device not found15:43
arne_wiebalckrpittau: could equally be that the md device is not there15:43
arne_wiebalckrpittau: the md device is there it seems15:44
arne_wiebalckrpittau: even md0p1 seems to be there15:46
rpittauarne_wiebalck:  sorry, I'm checking the build logs, I spot a couple of things that I don't like in the ipa build process, like we're using python 2 in at least one place15:46
iurygregoryrpittau, what?!15:47
iurygregorypython2?!15:47
rpittauyeah15:47
iurygregoryholy moly15:48
rpittauarne_wiebalck: the md device looks there indeed15:48
*** TxGirlGeek has joined #openstack-ironic15:49
arne_wiebalckrpittau: and it seems the partition it tries to mount as well15:49
openstackgerritIury Gregory Melo Ferreira proposed openstack/ironic master: Add info on how to enable ironic-tempest-plugin  https://review.opendev.org/71290115:50
*** Lucas_Gray has quit IRC15:50
* TheJulia blinks15:55
rpittauwell ok the patch seems to be there, so that's correct at least15:56
*** ociuhandu has quit IRC15:58
rpittauoh TheJulia one thing about the hwclock command, we might want to add something for the drifting -> http://paste.openstack.org/show/790803/15:58
rpittauarne_wiebalck: 2020-03-13 17:16:04.471 505 ERROR ironic_python_agent.extensions.iscsi [-] Error when cleaning up iscsi binds.: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.16:00
*** diurnalist has quit IRC16:02
*** rloo has quit IRC16:03
*** rloo has joined #openstack-ironic16:04
arne_wiebalckrpittau: this is the failed mount command?16:06
rpittauarne_wiebalck: this is tgtadm failing16:06
*** diurnalist has joined #openstack-ironic16:09
arne_wiebalckTheJulia: I'd need some ELI5 on https://review.opendev.org/#/c/696169 ... sorry :)16:11
patchbotpatch 696169 - ironic - Software RAID: Pass the boot mode to the IPA - 4 patch sets16:11
openstackgerritRiccardo Pittau proposed openstack/ironic-python-agent-builder master: [WIP] Use python3 binary for all operations  https://review.opendev.org/71347716:11
arne_wiebalckrpittau: how do you see the patch is there?16:13
openstackgerritVerification of a change to openstack/ironic failed: Refactoring: move iSCSI deploy code to iscsi_deploy.py  https://review.opendev.org/70869716:18
rpittauarne_wiebalck: nvm I was looking at the wrong logs :/16:20
* rpittau has too many open tabs16:20
arne_wiebalckrpittau: wdyt is a good way forward to get these 2 patches through the ci testing?16:23
arne_wiebalckfor the ironic patch I am not clear on the issue (you and the TheJulia seemed to have seen it right away), for the IPA patch I am not clear on whether this is just a race we have to accept or if there is sth more fundamental to be fixed16:25
rpittauarne_wiebalck: for the IPA patch it might be just a race, or even an error in the node, let's see how the next recheck goes16:28
rpittauwe'll need eventually to address the issue with the md device, I 'm also confused by that as it seems to be there, although the error with tgt seems related16:28
*** uzumaki has quit IRC16:29
rpittauthe ironic patch will need to have an updated tinyipa image with the ipa patch, that means a job with IRONIC_INSPECTOR_BUILD_RAMDISK set to TRUE16:31
rpittauor wait for the first patch to land :)16:31
*** ociuhandu has joined #openstack-ironic16:31
rpittauarne_wiebalck: the depends-on is not enough16:34
arne_wiebalckrpittau: thanks for the explanation16:37
arne_wiebalckrpittau: I did not realise that the depends on will not make sure that this is in the IPA for the CI16:38
arne_wiebalckrpittau: for the IPA patch, I have similar when writing the code16:39
arne_wiebalckrpittau: that's why I have some md restart and rescan snippets in the code16:40
*** dtantsur|brb is now known as dtantsur16:40
arne_wiebalckrpittau: the kernel does not always realize the structure of the devices16:41
rpittauarne_wiebalck: no worries, and sorry, the correct configuration variable is IRONIC_BUILD_DEPLOY_RAMDISK16:41
arne_wiebalckrpittau: we can do these patches one after the other I guess ... we will need to figure out the issue with IPA one anyway16:42
rpittauarne_wiebalck: oh yeah, but we maybe can find a different way to deal with those errors16:42
rpittaufor tgt I mean16:42
*** ociuhandu has quit IRC16:45
openstackgerritDmitry Tantsur proposed openstack/ironic master: Refactoring: move iSCSI deploy code to iscsi_deploy.py  https://review.opendev.org/70869716:46
*** ociuhandu has joined #openstack-ironic16:47
openstackgerritDmitry Tantsur proposed openstack/ironic master: Refactoring: split out wrap_ipv6  https://review.opendev.org/71345716:48
TheJuliarpittau: re drift, wow...17:00
TheJuliaarne_wiebalck: ELI5?17:00
arne_wiebalckgoogle it :)17:00
arne_wiebalckrpittau did that already :)17:01
arne_wiebalckI mean explain.17:01
iurygregoryELI5 LOL17:02
TheJuliaokay, sorry meetings17:02
rpittaunot sure a 5 years old could understand that, need to try with my nephew :P17:02
iurygregoryarne_wiebalck, ++17:02
iurygregoryrpittau, agree, maybe 10 XD17:02
rpittau:)17:02
arne_wiebalckrpittau: it sounded obvious when you and TheJulia discussed this, but I still didn't get it :-S17:04
arne_wiebalcknow I do \o/17:04
rpittauglad to see that :)17:04
rpittaubye everyone, good night, stay safe! o/17:10
*** rpittau is now known as rpittau|afk17:10
openstackgerritkhansa proposed openstack/sushy-cli master: Add manager vmedia command  https://review.opendev.org/70889017:12
*** priteau has quit IRC17:12
*** Lucas_Gray has joined #openstack-ironic17:12
*** Lucas_Gray has quit IRC17:15
*** Lucas_Gray has joined #openstack-ironic17:17
*** mkrai has quit IRC17:20
*** ricolin_ has joined #openstack-ironic17:29
*** Lucas_Gray has quit IRC17:33
*** dougsz has quit IRC17:34
*** tesseract has quit IRC17:37
*** ricolin_ has quit IRC17:43
*** dtantsur is now known as dtantsur|afk17:59
dtantsur|afkg'night!17:59
TheJuliaWell, today should be a flood of annoucements18:07
openstackgerritVerification of a change to openstack/ironic failed: Revamp grenade jobs  https://review.opendev.org/71317618:07
openstackgerritMark Goddard proposed openstack/bifrost master: Remove --ignore-installed from CentOS 8 pip 19 install  https://review.opendev.org/71350418:14
openstackgerritRadosław Piliszek proposed openstack/ironic master: DNM test with cirros 0.5.1  https://review.opendev.org/71272818:17
openstackgerritMark Goddard proposed openstack/bifrost stable/train: WIP: CentOS 8 support (Train)  https://review.opendev.org/71350818:23
openstackgerritMark Goddard proposed openstack/bifrost stable/train: WIP: CentOS 8 support (Train)  https://review.opendev.org/71350818:31
openstackgerritMerged openstack/ironic master: Remove compatibility with pre-deploy steps drivers  https://review.opendev.org/71191818:33
*** ociuhandu has quit IRC18:37
openstackgerritRadosław Piliszek proposed openstack/ironic master: DNM test with cirros 0.5.1  https://review.opendev.org/71272818:38
openstackgerritHarald Jensås proposed openstack/ironic master: Additional IP addresses to IPv6 stateful ports  https://review.opendev.org/70000218:42
openstackgerritIlya Etingof proposed openstack/sushy master: Lazily load message registries  https://review.opendev.org/71351218:48
*** ijw_ has joined #openstack-ironic18:50
*** k_mouza has quit IRC18:50
etingofdtantsur|afk, without message registries ^, sushy is 3 times faster and generates 150 times less traffic18:51
openstackgerritMark Goddard proposed openstack/bifrost stable/train: WIP: CentOS 8 support (Train)  https://review.opendev.org/71350818:51
*** ijw has quit IRC18:53
openstackgerritHarald Jensås proposed openstack/ironic master: Additional IP addresses to IPv6 stateful ports  https://review.opendev.org/70000218:55
*** diurnalist has quit IRC18:58
*** rh-jlabarre has joined #openstack-ironic19:00
*** rh-jelabarre has quit IRC19:02
openstackgerritHarald Jensås proposed openstack/ironic master: Additional IP addresses to IPv6 stateful ports  https://review.opendev.org/70000219:02
TheJuliaetingof: I always had a feeling message registries were a mistake19:02
*** amoralej is now known as amoralej|off19:02
etingofthis is not the first time when they kill the fish19:03
TheJuliahrh19:07
*** SpamapS has quit IRC19:12
*** rh-jlabarre has quit IRC19:15
*** ijw has joined #openstack-ironic19:17
*** ijw_ has quit IRC19:20
*** rh-jelabarre has joined #openstack-ironic19:21
*** dsneddon has quit IRC19:22
*** dsneddon has joined #openstack-ironic19:22
*** SpamapS has joined #openstack-ironic19:24
*** gmann_afk is now known as gmann19:25
openstackgerritMark Goddard proposed openstack/bifrost stable/train: WIP: CentOS 8 support (Train)  https://review.opendev.org/71350819:27
openstackgerritJulia Kreger proposed openstack/ironic master: Change [deploy]/default_boot_option to local  https://review.opendev.org/49211419:31
*** openstackgerrit has quit IRC19:33
*** diurnalist has joined #openstack-ironic19:34
*** ociuhandu has joined #openstack-ironic20:21
*** etingof has quit IRC20:22
*** diurnalist has quit IRC20:30
*** diurnalist has joined #openstack-ironic20:49
*** dougsz has joined #openstack-ironic20:56
*** ociuhandu has quit IRC20:57
*** dougsz has quit IRC21:06
* TheJulia sighs at the rescue code21:14
*** ociuhandu has joined #openstack-ironic21:14
*** openstackgerrit has joined #openstack-ironic21:18
openstackgerritHarald Jensås proposed openstack/ironic master: Additional IP addresses to IPv6 stateful ports  https://review.opendev.org/70000221:18
openstackgerritJulia Kreger proposed openstack/ironic master: Hash the rescue_password  https://review.opendev.org/69141321:20
* TheJulia takes a break21:20
*** rcernin has joined #openstack-ironic21:30
*** rcernin has quit IRC21:37
*** rcernin has joined #openstack-ironic21:38
*** ociuhandu has quit IRC21:46
*** etingof has joined #openstack-ironic21:59
*** ociuhandu has joined #openstack-ironic22:01
*** ociuhandu has quit IRC22:06
*** jdandrea has quit IRC22:10
openstackgerritHarald Jensås proposed openstack/ironic master: Additional IP addresses to IPv6 stateful ports  https://review.opendev.org/70000222:16
openstackgerritMerged openstack/ironic master: Refactoring: move iSCSI deploy code to iscsi_deploy.py  https://review.opendev.org/70869722:25
*** Goneri has quit IRC22:50
*** tkajinam has joined #openstack-ironic22:58
*** bfournie has quit IRC23:04
*** rloo has quit IRC23:36
*** diurnalist has quit IRC23:52
*** ijw has quit IRC23:55

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!