Thursday, 2021-06-03

*** paras333 has quit IRC00:29
*** rloo has quit IRC00:45
*** rloo has joined #openstack-ironic00:46
*** rloo has quit IRC00:55
opendevreviewSteve Baker proposed openstack/ironic-python-agent master: Ignore efi grub2-install failure  https://review.opendev.org/c/openstack/ironic-python-agent/+/79436301:52
*** paras333 has joined #openstack-ironic01:53
opendevreviewSteve Baker proposed openstack/ironic-python-agent master: Ignore efi grub2-install failure  https://review.opendev.org/c/openstack/ironic-python-agent/+/79436301:58
*** paras333 has quit IRC02:23
*** paras333 has joined #openstack-ironic02:35
*** paras333 has quit IRC02:40
*** paras333 has joined #openstack-ironic02:40
*** tzumainn has quit IRC02:47
*** sdanni_ has joined #openstack-ironic02:48
*** paras333 has quit IRC02:48
*** sdanni has quit IRC02:55
opendevreviewSimon Li proposed openstack/ironic master: Update detach to use V3 Cinder API  https://review.opendev.org/c/openstack/ironic/+/79436803:01
TheJuliastevebaker: I guess we need a reno on that change, besides that it lgtm04:22
*** stendulker has joined #openstack-ironic04:25
*** zaneb has quit IRC04:34
*** zaneb has joined #openstack-ironic04:34
arne_wiebalckGood morning, ironic!06:41
iurygregorygood morning arne_wiebalck and Ironic o/06:55
arne_wiebalckhey iurygregory o/06:55
*** Guest504 has quit IRC06:57
*** tosky has joined #openstack-ironic07:20
*** lucasagomes has joined #openstack-ironic07:26
*** rpittau|afk is now known as rpittau07:34
rpittaugood morning ironic! o/07:34
iurygregorymorning rpittau o/ feeling better?07:34
rpittauhey iurygregory :)07:34
rpittauI'm ok, better than yesterday, I'm going to take it easy today :)07:35
iurygregorynice! I will need your reviews in the release patches today hehe07:35
rpittauiurygregory: I'll try to make sense :P07:36
iurygregoryhehehe07:36
*** lucasagomes has quit IRC07:38
iurygregoryrpittau, do you think we should cut a bugfix branch for ipa-b?07:41
rpittauiurygregory: I was thinkint about that, but I don't think that's necessary07:41
iurygregoryack =)07:42
*** Qianbiao has joined #openstack-ironic08:00
*** lucasagomes has joined #openstack-ironic08:04
*** derekh has joined #openstack-ironic08:11
jandersgood morning arne_wiebalck rpittau iurygregory and Ironic o/08:16
rpittauhey janders :)08:16
arne_wiebalckhey janders o/08:16
iurygregory"morning" janders o/08:16
jandersiurygregory time is relative :)08:16
* arne_wiebalck thinks rpittau may not be fully back, but still blazingly fast08:16
iurygregoryjanders, yeah =D08:16
rpittauI could make a joke about the "enhanced connectivity", but I won't :)08:18
* arne_wiebalck is only half-connected so far, but will get to full speed in 10 days08:20
rpittau:)08:20
arne_wiebalckoh, so the service disruption from yesterday was due to the full duplex?08:21
rpittauonly half for me08:21
rpittaustill a great improvement!08:21
arne_wiebalckyeah!08:21
*** lourot has quit IRC08:32
*** lourot has joined #openstack-ironic08:32
janderseverything is better than smoke signals and carrier pigeons!08:35
rpittaummm not sure, pigeons can be quite fast :)08:38
iurygregorythey can if you have food for them08:41
opendevreviewlikui proposed openstack/ironic-python-agent master: Changed minversion in tox to 3.18.0  https://review.opendev.org/c/openstack/ironic-python-agent/+/79446708:51
*** Luzi has joined #openstack-ironic08:52
opendevreviewlikui proposed openstack/ironic-inspector master: Changed minversion in tox to 3.18.0  https://review.opendev.org/c/openstack/ironic-inspector/+/79446808:54
opendevreviewlikui proposed openstack/ironic-specs master: Changed minversion in tox to 3.18.0  https://review.opendev.org/c/openstack/ironic-specs/+/79446908:56
opendevreviewlikui proposed openstack/ironic-inspector-specs master: Changed minversion in tox to 3.18.0  https://review.opendev.org/c/openstack/ironic-inspector-specs/+/79447008:57
iurygregoryfyi in a few minutes the bot will spam the channel09:38
iurygregory:D09:38
opendevreviewOpenStack Release Bot proposed openstack/ironic-python-agent bugfix/8.0: Update .gitreview for bugfix/8.0  https://review.opendev.org/c/openstack/ironic-python-agent/+/79454609:51
opendevreviewOpenStack Release Bot proposed openstack/ironic bugfix/18.0: Update .gitreview for bugfix/18.0  https://review.opendev.org/c/openstack/ironic/+/79454709:51
opendevreviewOpenStack Release Bot proposed openstack/bifrost bugfix/11.0: Update .gitreview for bugfix/11.0  https://review.opendev.org/c/openstack/bifrost/+/79455209:59
*** osmanlic- has joined #openstack-ironic10:14
*** osmanlicilegi has quit IRC10:17
opendevreviewMerged openstack/ironic-inspector stable/wallaby: Trivial: better guard against malformed data in extra_hardware  https://review.opendev.org/c/openstack/ironic-inspector/+/79418311:07
opendevreviewMerged openstack/ironic bugfix/18.0: Update .gitreview for bugfix/18.0  https://review.opendev.org/c/openstack/ironic/+/79454711:19
*** osmanlic- has quit IRC11:20
*** osmanlicilegi has joined #openstack-ironic11:20
*** akahat has joined #openstack-ironic11:48
*** stendulker has quit IRC12:01
*** nfedorov has joined #openstack-ironic12:12
opendevreviewMerged openstack/ironic stable/ussuri: Delete unavailable py2 package  https://review.opendev.org/c/openstack/ironic/+/79288612:13
opendevreviewMerged openstack/ironic-python-agent bugfix/8.0: Update .gitreview for bugfix/8.0  https://review.opendev.org/c/openstack/ironic-python-agent/+/79454612:13
nfedorovHi! I have a question about Bifrost, can someone help me?12:14
arne_wiebalcknfedorov: I think the best is to ask the question to see if someone is able to help.12:16
nfedorovI tried several branches on different OS.12:18
*** tzumainn has joined #openstack-ironic12:18
nfedorov./bifrost-cli testenv ; ./bifrost-cli install --testenv12:19
nfedorovas result I have ironic and 2VMs12:19
nfedorovWhen I run scripts/test-bifrost.sh,  I see12:25
opendevreviewRiccardo Pittau proposed openstack/bifrost master: [DNM] Test CI  https://review.opendev.org/c/openstack/bifrost/+/79457612:25
nfedorovFound existing installation: ironic 17.0.3.dev11\n    Uninstalling ironic-17.0.3.dev11:\n      Successfully uninstalled ironic-112:26
nfedorov7.0.3.dev11\nSuccessfully installed ironic-18.0.0\n",                        12:26
*** lmcgann has joined #openstack-ironic12:26
nfedorovI don't understand why installed version of Ironic was changed by test script12:27
*** Luzi has quit IRC12:32
nfedorovAnother one. Is it expected vvv12:33
nfedorovfatal: [127.0.0.1]: FAILED! => {"changed": true, "cmd": ["ip", "link", "del", "virbr0"], "delta": "0:00:00.009699", "end": "2021-06-03 11:33:23.725844", "msg": "non-zero return code", "rc": 1, "start": "2021-06-03 11:33:23.716145", "stderr": "Cannot find device \"virbr0\"", "stderr_lines": ["Cannot find device \"virbr0\""], "stdout": "", "stdout_lines": []}12:33
rpittaunfedorov: bifrost clones the ironic repo from git and does an installation from there, if there is a new version available and you do the installation again, it will update it12:37
iurygregoryre virbr0 seems like you don't have kvm installed12:38
iurygregoryprobably missing packages in the OS12:38
nfedorovUbunto 20.04 cloud image12:44
nfedorov(bifrost) ubuntu@rare-ewe:~/bifrost$ sudo virsh list --all12:44
nfedorov Id   Name      State12:44
nfedorov--------------------------12:44
nfedorov 3    testvm1   running12:44
nfedorov -    testvm2   shut off12:44
rpittaunfedorov: please don't paste logs here in the channel, use a paste service, like http://paste.openstack.org/12:45
nfedorovok thanks12:47
nfedorovI used Maas for Deploy Ubuntu 20.0412:48
nfedorovand walked through documentation steps, there are no previous versions of Ironic12:50
nfedorovI have full log from the beginning12:51
iurygregorywe just did a release of Ironic 18.0.0 a few hours ago =)12:55
nfedorov:)12:55
iurygregoryhttps://opendev.org/openstack/ironic/src/tag/18.0.012:55
*** rloo has joined #openstack-ironic12:56
opendevreviewMerged openstack/bifrost bugfix/11.0: Update .gitreview for bugfix/11.0  https://review.opendev.org/c/openstack/bifrost/+/79455212:56
nfedorovwhat should I do to deploy a VM?12:56
nfedorovI don't see inspection step12:57
*** rloo has quit IRC12:59
*** rloo has joined #openstack-ironic12:59
iurygregorynfedorov, https://docs.openstack.org/bifrost/latest/user/howto.html this will probably give the steps you can follow to have a VM13:02
nfedorovAftre installation, I have 2 files  baremetal-inventory.json and baremetal-nodes.json13:05
nfedorovTo enroll, I  use ./bifrost-cli enroll baremetal-nodes.json  from ~/bifrost13:07
nfedorovAnd got an error13:07
*** paras333 has joined #openstack-ironic13:08
nfedorovWhich is the right sequence?13:11
TheJuliagood morning everyone13:20
rpittaunfedorov: if you ran bifrost-cli testenv you should have already the VMs running, but in any case, since you're using testenv please have a look at https://docs.openstack.org/bifrost/latest/contributor/testenv.html13:22
nfedorovI don't now what should I have after installation steps13:24
nfedorovTASK [bifrost-create-vm-nodes - create VM , but not start them13:31
iurygregoryto create a new vm you can just create new JSON file and you can run ./bifrost-cli enroll /<path>/<file>.json13:33
iurygregoryor using the enroll-dynamic https://docs.openstack.org/bifrost/latest/user/howto.html#how-this-works13:34
iurygregoryafter the enroll you can go to the deploy part13:34
nfedorovI don't want new VM. I want to see how works your test env desribed in the docs13:35
iurygregorybefore you asked "what should I do to deploy a VM?" =)13:36
*** zbitter has joined #openstack-ironic13:36
iurygregoryI was trying to answer that hehe13:36
nfedorovyes, but why not use existing VM after installation with test env flag13:37
opendevreviewRiccardo Pittau proposed openstack/bifrost master: Fix upper-constraints branch reference  https://review.opendev.org/c/openstack/bifrost/+/79458813:37
rpittaummm wrong branch13:37
rpittau:/13:37
nfedorovi have installed bifrost with test env flag, have 2 baremetal files, 2 vms, bridge, network, ips -  ./bifrost-cli enroll  ~/bifrost/baremetal-nodes.json13:40
opendevreviewRiccardo Pittau proposed openstack/bifrost stable/wallaby: Fix upper-constraints reference  https://review.opendev.org/c/openstack/bifrost/+/79459013:41
rpittau^ now in the correct branch13:41
*** zaneb has quit IRC13:42
*** zbitter is now known as zaneb13:42
rpittaunfedorov: as written in https://docs.openstack.org/bifrost/latest/contributor/testenv.html mentioned before, the correct way to use the nodes.json file is to use the baremetal command, as in baremetal create baremetal-nodes.json13:42
nfedorovI did it13:49
opendevreviewRiccardo Pittau proposed openstack/bifrost stable/victoria: Recognize TOX_CONSTRAINTS_FILE as a valid constraints variable  https://review.opendev.org/c/openstack/bifrost/+/79459413:56
*** kkillsfirst has joined #openstack-ironic13:58
*** krkillsfirst has joined #openstack-ironic13:59
TheJuliaarne_wiebalck: does your environment use traits?14:00
arne_wiebalckTheJulia: no14:00
TheJuliaok14:00
*** krkillsfirst has quit IRC14:03
*** kkillsfirst has quit IRC14:06
iurygregorypython is drunk O.o 0.1 + 0.2 == 0.3 False14:08
TheJuliaI beleive that is documented14:08
iurygregoryI just discovered this14:08
iurygregoryI'm like "WHAT?!"14:09
*** krkillsfirst has joined #openstack-ironic14:14
*** krkillsfirst has left #openstack-ironic14:15
*** kkillsfirst has joined #openstack-ironic14:15
*** paras333 has quit IRC14:19
*** paras333 has joined #openstack-ironic14:19
*** sdanni_ has quit IRC14:36
*** sdanni has joined #openstack-ironic14:36
*** Qianbiao has quit IRC14:37
nfedorovMy testvm1 stuck in clean, after it have wait callback and console "ERROR ironic_python_agent.agent [-] error sending heartbeat t"14:50
TheJuliathe fact we require traits to be in a TraitsList object to be on a node is going to drive me crazy14:51
TheJulianfedorov: does it actually say why it failed to send the heartbeat?14:51
TheJulianfedorov: and have you consulted the ironic-api log?14:52
nfedorovgive me a second14:52
nfedorovmy fault, it was another env, but there is Error heartbeating to agent API: Error 404: Node 4e41df61-84b1-5856-bfb6-6b5f2cd3dd11 could not be found14:59
TheJuliawhat does the ironic api log say? are the mac addresses of the machine known to ironic? are there multiple ironic deployments on the same network?15:00
nfedorovi think was reached timout and the script removed node from ironic15:02
TheJuliaso it has just been sitting in that state for a long time and the node is no longer in ironic at all?15:03
*** stendulker has joined #openstack-ironic15:05
nfedorovyes,  I'v got the same few second ago15:06
nfedorov15:00:25.530 717 INFO root [-] Asynchronous command execute_clean_step completed:15:11
nfedorov15:04:00.050 717 ERROR ironic_python_agent.agent [-] error sending heartbeat15:12
nfedorovscripts/test-bifrost.sh is finished15:14
nfedorovWhat is it means? "fatal  An unhandled exception occurred while running the lookup plugin ...ignoring15:19
nfedorovfatal-ignoring15:20
TheJulianfedorov: we need more logging data or more details into the errors surrounding. So a few lines up of the log most likely reveal exactly what happened.15:37
TheJulianfedorov: two possibilities. something external did something, or you've got a bad state in the database. If you have removed the nodes from ironic, state is reset andd you should be able to re-run test-bifrost as long as those vms have also been unregistered...  I believe (since it re-creates them)15:39
opendevreviewMerged openstack/ironic-lib master: utils.execute: log stdout and stderr even on failure  https://review.opendev.org/c/openstack/ironic-lib/+/79417115:42
nfedorovI moved qcows to RAM because clean step  2x10G on hard disk is slow15:43
TheJuliaif your just testing, disable cleaning15:53
TheJuliaor set it to metadata erase instead15:53
nfedorovI just try to see how can be deployed a VM via Bifrost15:56
*** stendulker has quit IRC16:04
TheJuliaCould you elaborate on that a little bit. I'm not sure I understand16:08
nfedorov2021-06-03 16:06:25.796 596 ERROR ironic_python_agent.utils [-] Failed to get the output of the command "['iptables', '-L']". Error: [Errno 2] No such file or directory: 'iptables': 'iptables': FileNotFoundError: [Errno 2] No such file or directory: 'iptables': 'iptables'ESC[00m16:09
nfedorovis it normal&16:09
nfedorov?16:09
nfedorovI'm choosing a tool for Openstack deployment.16:11
TheJulianfedorov: eh... could be okay, that *shouldn't* be fatal though, at least afaik16:11
nfedorovI worked with Metal3 and Airship16:12
rpittaubye everyone! o/16:12
*** rpittau is now known as rpittau|afk16:12
TheJulianfedorov: that is non-fatal, it is doing log collection. Either it is done, or there has been a critical failure and likely the agent has been asked to provide it's logs16:14
nfedorovI have  provisioning steps : available,inspecting,  inspect wait , cleaning , clean wait , cleaning , available, deploying, active, deleting, cleaning, clean wait16:20
nfedorovnow TASK [bifrost-unprovision-node-dynamic : Unprovision node16:22
nfedorovwhy do we need to do this? how can I see that node was provisioned and I can log in to check16:24
*** lucasagomes has quit IRC16:25
TheJuliaso that task deletes the node16:25
TheJuliaIt is a test playbook, deletes the node on purpose because are trying to setup the environment so you can rinse/repeat16:26
nfedorovwe have cleanup16:28
nfedorovin the beggining16:28
*** sshnaidm is now known as sshnaidm|afk16:32
*** derekh has quit IRC17:06
opendevreviewVerification of a change to openstack/ironic-python-agent failed: Check the target root device with smartctl  https://review.opendev.org/c/openstack/ironic-python-agent/+/79395317:24
JayFI just -1'd ^ that, please do not re-land it until my concerns are addressed17:27
JayFrpittau|afk: Please remove the +A form the above patch ^^^17:27
trandlesTheJulia: would you like me to start a storyboard (in ironic-specs or ironic-inspector-specs?) for the ability to send inspection data to something like RabbitMQ or Kafka?17:29
opendevreviewMerged openstack/ironic-python-agent master: Changed minversion in tox to 3.18.0  https://review.opendev.org/c/openstack/ironic-python-agent/+/79446717:30
opendevreviewMerged openstack/ironic-inspector master: Changed minversion in tox to 3.18.0  https://review.opendev.org/c/openstack/ironic-inspector/+/79446817:36
opendevreviewMerged openstack/ironic-specs master: Changed minversion in tox to 3.18.0  https://review.opendev.org/c/openstack/ironic-specs/+/79446917:36
opendevreviewMerged openstack/ironic master: Trivial: fix an outdated link  https://review.opendev.org/c/openstack/ironic/+/79394717:45
opendevreviewMerged openstack/python-ironicclient master: Update project conundrum related docs  https://review.opendev.org/c/openstack/python-ironicclient/+/79374217:45
TheJuliatrandles: if it looks non-invasive, I'd almost be willing to say just post a pach. The specs process is heavy weight and for minimally invasive things it sometimes just doesn't make sense18:00
TheJuliaJayF: oh my, I've WF-1'ed it and -1'ed it as well18:00
TheJuliaJayF: and posted concerns, and I guess I would like to see a specific test added for exit code 218:01
opendevreviewVerification of a change to openstack/ironic failed: Secure RBAC - Efficent node santiziation  https://review.opendev.org/c/openstack/ironic/+/79392918:03
TheJulia*sigh*18:03
trandlesTheJulia: thanks. I'll dig into it.18:04
*** kkillsfirst has quit IRC18:14
*** mjturek has joined #openstack-ironic18:44
*** kkillsfirst has joined #openstack-ironic18:48
stevebakermorning20:54
jandersgood morning Ironic o/21:26
iurygregorymorning stevebaker janders o/21:54
jandershey iurygregory o/21:54
opendevreviewSteve Baker proposed openstack/ironic-python-agent master: Ignore efi grub2-install failure  https://review.opendev.org/c/openstack/ironic-python-agent/+/79436322:00
stevebakeriurygregory, janders: hi!22:00
TheJuliastevebaker: no reno?22:01
*** paras333 has quit IRC22:01
*** lmcgann has quit IRC22:02
stevebakerdammit, didn't add it to the commit22:03
TheJuliaDo'oh.22:03
opendevreviewSteve Baker proposed openstack/ironic-python-agent master: Ignore efi grub2-install failure  https://review.opendev.org/c/openstack/ironic-python-agent/+/79436322:04
*** paras333 has joined #openstack-ironic22:06
*** paras333 has quit IRC22:14
*** rloo has quit IRC22:28
opendevreviewJulia Kreger proposed openstack/ironic master: Only return the requested fields  https://review.opendev.org/c/openstack/ironic/+/79227422:49
opendevreviewJulia Kreger proposed openstack/ironic master: Set stage for objects to handle selected field lists.  https://review.opendev.org/c/openstack/ironic/+/79227522:49
opendevreviewJulia Kreger proposed openstack/ironic master: WIP: API to pass fields to node object list  https://review.opendev.org/c/openstack/ironic/+/79229622:49
TheJuliastevebaker: py3 tests all passed (well, except the two complaining I only have 990MB of memory free ;)22:50
TheJulia_22:50
stevebakernice22:52
TheJuliano idea if it will make it *much* faster, but it will reduce the sqlalchemy overhead by a ton and does fundimentally change standard column view to the faster calls anyway22:53
TheJuliaso it *should* kind of speed up generalized read and hopefully be super kind to the database22:53
stevebakerthat sounds good22:54
TheJulia(by also not hitting it with follow-up queries on "oh, the user didn't ask for this field, I should go get it now" logic, where as now it will just get everything asked for and only the bare minimum more22:54
TheJuliaif the bifrost benchmark comes back at 600+ nodes a second, we'll know it is an improvement22:55
*** tosky has quit IRC23:00
TheJuliamental note to self: turn off the extra work on the bifrost-ironic-benchmark job23:05
*** kkillsfirst has quit IRC23:34

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!