Friday, 2020-06-26

« Thursday, 2020-06-25 Index Saturday, 2020-06-27 »
*** mrda has joined #openstack-ironic00:00
*** Lucas_Gray has quit IRC00:09
*** Lucas_Gray has joined #openstack-ironic00:12
*** jawad_axd has joined #openstack-ironic00:15
*** ricolin has joined #openstack-ironic00:37
*** ricolin has quit IRC00:42
*** jamesden_ has joined #openstack-ironic00:43
*** jamesdenton has quit IRC00:43
*** jawad_axd has quit IRC00:50
*** ociuhandu has joined #openstack-ironic00:56
*** ociuhandu has quit IRC00:59
*** ociuhandu has joined #openstack-ironic00:59
*** diurnalist has quit IRC01:02
*** ociuhandu has quit IRC01:03
*** tzumainn has quit IRC01:16
*** diurnalist has joined #openstack-ironic01:34
*** ricolin has joined #openstack-ironic01:46
openstackgerritSteve Baker proposed openstack/metalsmith master: WIP metalsmith_deployment role switch to metalsmith_instances  https://review.opendev.org/73788801:49
openstackgerritSteve Baker proposed openstack/metalsmith master: WIP Document metalsmith_instances  https://review.opendev.org/73813101:49
*** Lucas_Gray has quit IRC02:04
*** jawad_axd has joined #openstack-ironic02:06
*** chenhaw has quit IRC02:37
*** jawad_axd has quit IRC02:41
*** ricolin has quit IRC03:02
*** yolanda has quit IRC03:02
*** yolanda has joined #openstack-ironic03:03
*** diurnalist has quit IRC03:05
*** Qianbiao has joined #openstack-ironic03:13
openstackgerritSteve Baker proposed openstack/metalsmith master: WIP metalsmith_deployment role switch to metalsmith_instances  https://review.opendev.org/73788803:18
openstackgerritSteve Baker proposed openstack/metalsmith master: Document metalsmith_instances  https://review.opendev.org/73813103:18
*** Qianbiao has quit IRC03:43
*** jawad_axd has joined #openstack-ironic03:58
*** diurnalist has joined #openstack-ironic04:22
*** jawad_axd has quit IRC04:31
*** jtomasek has joined #openstack-ironic04:58
*** diurnalist has quit IRC05:13
*** rh-jelabarre has quit IRC05:27
*** dsneddon has joined #openstack-ironic05:28
*** Qianbiao has joined #openstack-ironic05:43
iurygregorygood morning Ironic o/ happy Friday!06:08
*** jawad_axd has joined #openstack-ironic06:09
*** rachit7 has joined #openstack-ironic06:10
*** jawad_axd has quit IRC06:14
*** rpittau|afk is now known as rpittau06:29
rpittaugood morning ironic! o/06:29
iurygregorygood morning rpittau o/06:29
rpittauhey iurygregory :)06:29
iurygregoryrpittau, as I promissed I reviewd the ubuntu focal patch =)06:39
rpittauoh cool, thanks :)06:39
iurygregoryI only added some nits that you can do in a follow-up =)06:40
openstackgerritMerged openstack/bifrost master: Consolidate the default IP address handling  https://review.opendev.org/73723206:41
iurygregorybad auto-generated patch file XD06:43
*** Qianbiao has quit IRC06:44
arne_wiebalckGood morning iurygregory rpittau and ironic!06:48
rpittauhey arne_wiebalck :)06:48
iurygregorymorning arne_wiebalck o/06:49
openstackgerritMerged openstack/bifrost master: Get rid of venv_python_path  https://review.opendev.org/73727106:57
rpittaummmm cirros don't recognize sata disks?!?06:59
*** riuzen has joined #openstack-ironic06:59
iurygregorywhat?106:59
iurygregory!*06:59
openstackiurygregory: Error: "*" is not a valid command.06:59
iurygregoryok openstack07:00
*** jawad_axd has joined #openstack-ironic07:00
*** riuzen has quit IRC07:01
*** jawad_axd has quit IRC07:22
*** jawad_axd has joined #openstack-ironic07:22
*** jtomasek has quit IRC07:32
*** dtantsur|afk is now known as dtantsur07:33
*** jtomasek has joined #openstack-ironic07:35
*** rachit7 has quit IRC07:35
*** ociuhandu has joined #openstack-ironic07:37
*** dougsz has joined #openstack-ironic07:41
dtantsurmorning ironic07:46
openstackgerritDmitry Tantsur proposed openstack/ironic-python-agent master: DNM trying really slow prepare_image  https://review.opendev.org/73815607:54
dtantsurTheJulia: trying a small simulation ^^07:55
openstackgerritVerification of a change to openstack/ironic-python-agent failed: Add debug message to node lookup  https://review.opendev.org/73755507:56
*** Qianbiao has joined #openstack-ironic08:05
*** Qianbiao has quit IRC08:07
*** lucasagomes has joined #openstack-ironic08:07
*** Qianbiao has joined #openstack-ironic08:07
openstackgerritDmitry Tantsur proposed openstack/bifrost master: Use firewalld to open ports on Red Hat systems  https://review.opendev.org/73804208:08
*** jtomasek has quit IRC08:10
openstackgerritMerged openstack/bifrost stable/ussuri: install-deps: install setuptools early for Debian  https://review.opendev.org/73811208:11
rpittauproblems with package conflicts in ipa-builder ' cannot install both libnghttp2-1.41.0-1.module_el8+9071+b2b61c14.x86_64 and libnghttp2-1.33.0-1.el8_0.1.x86_64'08:12
*** jtomasek has joined #openstack-ironic08:14
rpittauseems like an issue with the package in epel repo08:18
openstackgerritVerification of a change to openstack/ironic-python-agent-builder failed: Build tinyipa on focal  https://review.opendev.org/72579908:20
rpittauyep centos8 is broken at the moment \o/08:22
*** derekh has joined #openstack-ironic08:43
*** hjensas|afk is now known as hjensas08:48
*** stendulker_ has joined #openstack-ironic08:55
stendulker_rpittau: Good morning08:55
rpittauhey stendulker_ :)08:55
stendulker_rpittau: Do you have a min?08:55
rpittaustendulker_: sure08:56
stendulker_Reagarding https://review.opendev.org/#/c/738151/08:56
patchbotpatch 738151 - x/proliantutils - Adds py3 to tox environment - 5 patch sets08:56
stendulker_It is still testing for py2708:56
stendulker_Am I missing anything?08:56
rpittaummm is it tied to the project config maybe ? Sometimes there are default jobs there too08:56
stendulker_Shouldn't it be this https://github.com/openstack/openstack-zuul-jobs/blob/master/zuul.d/project-templates.yaml#L460-L46908:56
stendulker_Any suggestion where I can check for other project config?08:57
rpittaustendulker_: https://github.com/openstack/project-config/blob/master/zuul.d/projects.yaml#L786508:59
rpittaustendulker_: you'll have to modify that and remove the unwanted jobs ^09:02
stendulker_Thank you rpittau. Will raise a patch for this09:02
rpittaunp09:03
stendulker_rpittau: We can remove this altogether now?09:03
stendulker_Or would we need it?09:03
rpittaustendulker_: I believe you still need it09:03
stendulker_as most of the things get covered in zuul template09:04
stendulker_ok, will just remove py27 and py35 jobs09:04
rpittauyeah, I think you need at least the project entry, I suggest to leave at least publish-to-pypi09:04
rpittauthe rest can be controlled directly in the project itself09:05
*** kaiokmo has joined #openstack-ironic09:06
stendulker_Have raised patch in project-config https://review.opendev.org/#/c/738168/09:09
patchbotpatch 738168 - project-config - Removes py35 and py27 jobs for proliantutils - 1 patch set09:09
rpittaustendulker_: I think you can safely remove the 'check' and 'gate' parts and leave that to the project, openstack-python3-victoria-jobs includes openstack-tox-pep809:12
stendulker_I thought so.., but left it09:12
stendulker_Will remove it09:13
openstackgerritDmitry Tantsur proposed openstack/bifrost master: Use firewalld to open ports on Red Hat systems  https://review.opendev.org/73804209:19
openstackgerritDmitry Tantsur proposed openstack/bifrost master: Use firewalld to open ports on Red Hat systems  https://review.opendev.org/73804209:21
openstackgerritDmitry Tantsur proposed openstack/ironic-python-agent master: DNM trying really slow prepare_image  https://review.opendev.org/73815609:28
openstackgerritRiccardo Pittau proposed openstack/metalsmith master: [WIP] Use Centos 8  https://review.opendev.org/73727809:28
gudrutisHi Ironic o/09:29
iurygregoryhi gudrutis o/09:31
*** Lucas_Gray has joined #openstack-ironic09:41
*** priteau has joined #openstack-ironic10:03
*** rpittau is now known as rpittau|bbl10:04
openstackgerritArne Wiebalck proposed openstack/ironic-inspector master: Add leader election for periodic sync with ironic  https://review.opendev.org/73552710:10
arne_wiebalckdtantsur: I updated the leader election patch ^^, I have tested this with two inspectors coming and going and the leadership seems to be taken over successfully by the running inspector10:13
dtantsurmany thanks!10:13
openstackgerritDmitry Tantsur proposed openstack/bifrost master: Use firewalld to open ports on Red Hat systems  https://review.opendev.org/73804210:14
*** hjensas_ has joined #openstack-ironic10:14
*** hjensas has quit IRC10:17
*** hjensas_ is now known as hjensas|lunch10:56
*** hjensas_ has joined #openstack-ironic11:01
*** hjensas|lunch has quit IRC11:04
*** k_mouza has joined #openstack-ironic11:10
*** Lucas_Gray has quit IRC11:14
*** Lucas_Gray has joined #openstack-ironic11:26
*** dougsz has quit IRC11:35
*** hjensas_ is now known as hjensas11:45
*** k_mouza has quit IRC11:47
*** k_mouza has joined #openstack-ironic11:48
*** rh-jelabarre has joined #openstack-ironic12:02
*** rpittau|bbl is now known as rpittau12:12
*** ociuhandu has quit IRC12:14
dtantsurTheJulia: I've simulated super-slow prepare_image and I cannot reproduce what you see, at least on master: https://zuul.opendev.org/t/openstack/build/5102767e43de4efdbf89cb3e7436ce0e/log/controller/logs/ironic-bm-logs/node-0_no_ansi_2020-06-26-10:44:19_log.txt12:22
dtantsurI'd prefer to get to the bottom of it before we jump to conclusions12:22
* dtantsur tries the same on stable/train now12:22
openstackgerritDmitry Tantsur proposed openstack/ironic-python-agent stable/train: DNM trying really slow prepare_image  https://review.opendev.org/73819312:23
openstackgerritDmitry Tantsur proposed openstack/bifrost master: Use firewalld to open ports on Red Hat systems  https://review.opendev.org/73804212:28
*** derekh has quit IRC12:32
*** ociuhandu has joined #openstack-ironic12:34
openstackgerritRiccardo Pittau proposed openstack/metalsmith master: [WIP] Use Centos 8  https://review.opendev.org/73727812:53
openstackgerritRiccardo Pittau proposed openstack/metalsmith master: Remove ussuri jobs in favor of victoria  https://review.opendev.org/73819812:54
openstackgerritArne Wiebalck proposed openstack/ironic-inspector master: Add leader election for periodic sync with ironic  https://review.opendev.org/73552712:54
openstackgerritDmitry Tantsur proposed openstack/ironic master: [WIP] Agent power interface  https://review.opendev.org/73559112:57
*** jamesden_ is now known as jamesdenton12:59
rpittaudtantsur: sorry to be bringer of bad news on a friday afternoon, but I think the centos8 job ipa-builder ci is broken because of a bad package in epel13:00
dtantsur\o/13:01
dtantsurwhich means, the whole DIB is broken?13:01
dtantsuror just our stuff?13:01
rpittauI noticed this morning and after some tests I see the same issue13:01
rpittauI think dib is broken as well13:01
rpittauit's in one of the dib elements13:01
dtantsurrpittau: raise it to #openstack-dib maybe?13:02
rpittauyep, just wanted to inform you first13:02
dtantsurthanks, gotcha13:02
dtantsurI'm about to leave though - I have a half-day PTO today13:02
*** derekh has joined #openstack-ironic13:04
rpittaudtantsur: enjoy :)13:05
TheJuliadtantsur: so on stable/train we don't complete the command so maybe it needs to be on stable/train and just stable/train? Your test does basically immediately return completed command state which... Interesting your ramdisk on master also gets concurrently running prepare_image commands, I guess that is the result of one of the recent changes?13:05
dtantsurTheJulia: there is some confusion logging there IMO. We log "Command completed with result None" for asynchronous commands13:06
dtantsurwhile we mean that the control has been returned to the caller13:06
TheJuliaThat may be on stable/train13:06
dtantsurmaybe13:06
dtantsurI've created https://review.opendev.org/738193 to test it13:07
patchbotpatch 738193 - ironic-python-agent (stable/train) - DNM trying really slow prepare_image - 1 patch set13:07
TheJuliayour logs return full command completed data immediately though13:07
dtantsuralso good morning :)13:07
TheJuliaand yes, good morning!13:07
dtantsurmmm, no, I think it's still confusing logging13:07
dtantsurthis https://zuul.opendev.org/t/openstack/build/5102767e43de4efdbf89cb3e7436ce0e/log/controller/logs/ironic-bm-logs/node-0_no_ansi_2020-06-26-10:44:19_log.txt#1710 is not the actual command finish13:08
dtantsurIt says "command completed", but it means "asynchronous command scheduled"13:08
iurygregorygood morning TheJulia =)13:08
dtantsurat this point (at least in master) the command is recorded in RUNNING state13:08
TheJuliahttps://zuul.opendev.org/t/openstack/build/5102767e43de4efdbf89cb3e7436ce0e/log/controller/logs/ironic-bm-logs/node-0_no_ansi_2020-06-26-10:44:19_log.txt#130613:08
dtantsurugh, pasting wrong links, bear with me13:08
TheJuliaYeah, that is the same log you linked to me13:09
dtantsurTheJulia: yep, this is NOT the end of the command.13:09
rpittaugood morning TheJulia :)13:09
TheJuliawe don't even get that if memory serves on stable/train13:09
TheJuliabut I'd have to dig up the full log files that I was able to obtain13:09
dtantsurthis is the actual end of the command https://zuul.opendev.org/t/openstack/build/5102767e43de4efdbf89cb3e7436ce0e/log/controller/logs/ironic-bm-logs/node-0_no_ansi_2020-06-26-10:44:19_log.txt#170313:09
dtantsurI'd be really surprised if it works differently on train, but who knows..13:10
*** rloo has joined #openstack-ironic13:10
TheJuliasmall minor changes here and there can have huge impacts13:10
TheJuliaI did focus on the train code path and went back and validated that the same behavior existed in the conductor side of the universe13:11
openstackgerritTzu-Mainn Chen proposed openstack/python-ironicclient master: Add port-uuid parameter to node vif attach  https://review.opendev.org/73758513:11
openstackgerritRiccardo Pittau proposed openstack/ironic master: [WIP] Test virtio with uefi  https://review.opendev.org/73820013:11
openstackgerritDmitry Tantsur proposed openstack/ironic-python-agent master: Fix confusing logging when running asynchronous commands  https://review.opendev.org/73820313:19
dtantsurTheJulia: logging fix ^^13:19
TheJulia++13:20
*** dtantsur is now known as dtantsur|afk13:21
dtantsur|afkhave a great weekend, everyone13:21
dtantsur|afkTheJulia: stable/train seems to work similarly: https://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_d2a/738193/1/check/ipa-tempest-partition-bios-ipmi-direct-tinyipa-src/d2a65c4/controller/logs/ironic-bm-logs/node-0_no_ansi_2020-06-26-13%3A10%3A20_log.txt13:22
* dtantsur|afk leaves for real now13:22
TheJuliadtantsur|afk: willing to look at the logs next week?13:23
TheJuliaAnyone up for reviewing https://review.opendev.org/#/c/736390/ ?13:25
patchbotpatch 736390 - ironic-python-agent - Extend retries to 9, 10 seconds apart. - 3 patch sets13:25
jamesdentonGood morning. Anyone interested in giving https://review.opendev.org/#/c/557051/ a look?13:32
patchbotpatch 557051 - networking-generic-switch - Support multiple links in link_local_information d... - 11 patch sets13:32
*** rachit7 has joined #openstack-ironic13:34
rpittauTheJulia: I tried with sata and uefi, but cirros didn't like it :(13:34
rpittauhttps://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_b50/738055/1/check/ironic-tempest-ipa-partition-uefi-pxe-grub2/b50fe4f/controller/logs/ironic-bm-logs/node-0_console_2020-06-25-17%3A41%3A53_log.txt13:34
rpittauI'm trying with virtio13:36
TheJuliavirtio is good I guess13:37
TheJuliaif the kernel groks it13:37
rpittauI saw a note (an old note) saying that virtio doesn't work with uefi13:37
rpittauand that's why using ide13:37
iurygregoryouch =(13:37
TheJulia:(13:45
rpittauyeah, I don't know, I could try the an ahci bus configuration, but I think that's what missing in cirros13:46
*** elemaill has joined #openstack-ironic13:50
TheJuliaclarkb: out of curiosity, do you have any familiarity with cirros support and uefi vms? I ask because out of everyone in channel, I suspect you may13:54
TheJuliahave useful knowledge in this case :)13:54
rpittaumainly curious why it doesn't recognize sata disks :/13:55
elemaillHello ironic ! :) my baremetal deployment is stuck : on ironic nodes are on state "wait call-back" and on the nodes ipa logs loop on hearbeat sucessfull ; sleeping before next hearbeat14:01
elemaillAny idea what could be wrong ?14:01
iurygregorywhen we were testing uefi for cirros 0.5.1 https://review.opendev.org/#/c/712728/14:15
patchbotpatch 712728 - ironic - DNM test with cirros 0.5.1 (ABANDONED) - 7 patch sets14:15
iurygregorymarcin seems to have a bit of knowledge on that14:16
iurygregorynot sure his irc nick14:16
arne_wiebalckelemaill: This what you would see on cleaning if the node moves to maitenance after Ironic starts waiting for the callback, but before the IPA started cleaning. Not sure if this could happen on deployment as well ... you node has maintenance=False I guess?14:16
rpittauI think we're past that now14:16
iurygregoryrpittau, yeah but maybe he would have some ideas on the problems we are having now14:17
elemaillarne_wiebalck: yes they are on maintenance False . I just launch bifrost playbook deploy-dynamic.yaml14:19
elemaillon the node console the last log before heartbeat loop was "writing image with command [...] write_image.sh14:22
arne_wiebalckelemaill: one other potential explanation is some long running job on the IPA: the heartbeat is sent from a thread, so you see heartbeats while the IPA is actually doing sth ... what is the last thing the IPA logged before heart beating?14:22
arne_wiebalckelemaill: :-D14:22
elemaill:D14:22
arne_wiebalckelemaill: is the node still working on this? top may tell you what the IPA is doing14:23
elemaillok i will try to figure if IPA is doing anything14:24
elemaillwill need to find the password :D14:25
arne_wiebalckelemaill: oh, thought you had access since you see the logs?14:26
arne_wiebalckelemaill: the next step may be to enable debugging in the IPA14:26
elemaillthe logs are printed on the console :D14:26
elemailleven if no session are opened14:27
elemailli use debian dib image i guess there is a default pass14:27
rpittauso mock doesn't alert if the parameter passed to the patch function is misspelled, and I just found a thousand 'autpspec'14:30
arne_wiebalckelemaill: this I don't know, we build our own IPA images and include our keys14:30
clarkbTheJulia: I don't. Frickler may though14:34
*** diurnalist has joined #openstack-ironic14:38
elemaillarne_wiebalck: ok thank you ! i did not even know i can ssh the ramdisk :) it will have to figure how bifrost created itbecause the key used for the deployment seems not working ! thanks for your help :)14:39
arne_wiebalckelemaill: np, good luck!14:39
*** priteau has quit IRC14:44
*** stendulker_ has quit IRC15:12
openstackgerritVerification of a change to openstack/ironic-python-agent failed: Extend retries to 9, 10 seconds apart.  https://review.opendev.org/73639015:17
jlvillalIs Ironic now Python 3.6 or higher? No more Python 2.7, correct? :)15:25
*** priteau has joined #openstack-ironic15:26
iurygregoryjlvillal, correct from Ussuri +15:27
*** priteau has quit IRC15:30
*** priteau has joined #openstack-ironic15:30
rpittauMy laptop crashed again \o/15:32
jlvillaliurygregory, Awesome :)15:33
*** jawad_axd has quit IRC15:36
*** jtomasek has quit IRC15:37
*** Qianbiao has quit IRC15:39
*** ricolin has joined #openstack-ironic15:39
*** k_mouza has quit IRC15:49
*** k_mouza has joined #openstack-ironic15:52
openstackgerritMerged openstack/ironic-inspector master: Document [ironic] auth options for inspector  https://review.opendev.org/73740415:54
rpittaubye! have a great weekend! o/15:59
*** rpittau is now known as rpittau|afk15:59
*** lucasagomes has quit IRC16:06
*** rachit7 has quit IRC16:08
*** ricolin has quit IRC16:13
*** k_mouza has quit IRC16:14
*** k_mouza has joined #openstack-ironic16:19
*** k_mouza has quit IRC16:22
*** k_mouza has joined #openstack-ironic16:22
*** elemaill has left #openstack-ironic16:23
*** Lucas_Gray has quit IRC16:28
*** gyee has joined #openstack-ironic16:35
*** ociuhandu_ has joined #openstack-ironic16:36
*** ociuhandu has quit IRC16:38
*** k_mouza has quit IRC16:39
*** ociuhandu_ has quit IRC16:40
TheJuliazuuullll1!!!!!16:40
*** priteau has quit IRC16:48
*** derekh has quit IRC17:00
*** ociuhandu has joined #openstack-ironic17:11
*** kaiokmo has quit IRC17:17
*** ociuhandu has quit IRC17:18
* arne_wiebalck goes and gets the cookies again ...17:52
*** dsneddon has quit IRC17:55
*** michchap has quit IRC18:13
TheJuliaHeh18:55
TheJuliaLots of cookies18:55
TheJuliaLooks like that build failed due to rpm package issues, looks like a new version got pushed out and things broke. At least index wise so unknown when we'll see that fixed19:13
*** dking has quit IRC21:34
*** dsneddon has joined #openstack-ironic21:36
openstackgerritIury Gregory Melo Ferreira proposed openstack/ironic master: Native zuulv3 grenade multinode multitenant  https://review.opendev.org/70503021:49
*** hjensas_ has joined #openstack-ironic22:02
*** hjensas has quit IRC22:05
*** rloo has quit IRC22:18
*** rh-jelabarre has quit IRC23:23
« Thursday, 2020-06-25 Index Saturday, 2020-06-27 »

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!