Wednesday, 2019-08-28

*** hwoarang has quit IRC00:12
*** ijw_ has joined #openstack-ironic00:13
*** hwoarang has joined #openstack-ironic00:14
TheJuliadhellmann: tl;dr == if priority == 0 then manual00:14
*** ijw has quit IRC00:17
*** ijw_ has quit IRC00:18
*** rloo has quit IRC00:34
*** gyee has quit IRC00:43
*** bdodd_ has joined #openstack-ironic01:05
*** bdodd has quit IRC01:05
*** mkrai has joined #openstack-ironic01:07
*** ricolin has joined #openstack-ironic02:25
*** rloo has joined #openstack-ironic02:26
openstackgerritNguyen Van Trung proposed openstack/ironic master: Support firmware upgrade for irmc driver  https://review.opendev.org/59999202:28
*** rloo has quit IRC02:28
openstackgerritMerged openstack/networking-baremetal master: Fix networking-baremetal CI  https://review.opendev.org/67570102:58
*** rh-jelabarre has quit IRC02:59
*** rh-jelabarre has joined #openstack-ironic03:03
*** rh-jelabarre has quit IRC03:15
*** ianychoi has quit IRC03:29
*** ianychoi has joined #openstack-ironic03:30
*** gkadam has joined #openstack-ironic03:36
*** gkadam has quit IRC03:36
*** dsneddon has quit IRC03:51
openstackgerritShivanand Tendulker proposed openstack/ironic master: Add deploy steps for iLO BIOS interface  https://review.opendev.org/67427003:55
*** dsneddon has joined #openstack-ironic04:24
*** rachit7 has joined #openstack-ironic04:58
*** stendulker has joined #openstack-ironic05:15
*** jhesketh has quit IRC05:34
rachit7Hi stendulker05:38
rachit7Good Morning05:38
stendulkerHi rachit705:39
rachit7Can you please add this patch https://review.opendev.org/#/c/674021/ on your priority list ?05:39
patchbotpatch 674021 - ironic - DRAC : clear_job_queue clean step to fix pending b... - 8 patch sets05:39
*** yaawang has quit IRC05:39
stendulkerok05:40
*** yaawang has joined #openstack-ironic05:40
stendulkerrachit7: I did not get how the exception is getting handled for client.delete_jobs(job_ids=[_CLEAR_JOB_IDS])05:41
stendulkerAre you expecting it to get handled at conductor level?05:42
*** jhesketh has joined #openstack-ironic05:42
rachit7I don't think it needs any exception to handled. I mean if there is any job pending or scheduled or ongoing job it will clear it after this call and other exception for this call(client.delete_jobs) is handled by iDRAC lib(python-dracclient)05:46
openstackgerritShivanand Tendulker proposed openstack/ironic master: Add iLO RAID deploy steps  https://review.opendev.org/67427105:47
openstackgerritShivanand Tendulker proposed openstack/ironic master: WIP: Add iDRAC RAID deploy steps  https://review.opendev.org/64173105:48
stendulkerrachit7: python-dracclient exception is not handled in Ironic05:56
stendulkerProbably you need to handle and translate it to DracOperationError https://github.com/openstack/ironic/blob/master/ironic/common/exception.py#L49805:58
rachit7stendulker : Ohhh okay.. got it..05:59
openstackgerritAnkit Kumar proposed openstack/ironic master: Add iso less virtual media deploy  https://review.opendev.org/67799606:00
rachit7Thank you stendulker06:00
stendulkernp06:00
*** dsneddon has quit IRC06:14
openstackgerritShivanand Tendulker proposed openstack/ironic master: Follow-up for deploy steps for Redfish BIOS interface  https://review.opendev.org/67769506:20
*** jtomasek has joined #openstack-ironic06:27
*** pradip_k has joined #openstack-ironic06:28
*** yaawang has quit IRC06:31
*** yaawang has joined #openstack-ironic06:33
*** kaifeng has quit IRC06:34
*** kaifeng has joined #openstack-ironic06:35
arne_wiebalckGood morning, ironic!06:36
*** dsneddon has joined #openstack-ironic06:42
*** dsneddon has quit IRC06:47
*** dsneddon has joined #openstack-ironic06:48
*** dsneddon has quit IRC06:54
*** dsneddon has joined #openstack-ironic06:54
*** stendulker has quit IRC06:59
*** dsneddon has quit IRC07:00
*** dsneddon has joined #openstack-ironic07:00
*** dsneddon has quit IRC07:06
*** dsneddon has joined #openstack-ironic07:07
*** trident has quit IRC07:08
*** pradip_k has quit IRC07:08
*** rcernin has quit IRC07:12
rachit7Hey arne_wiebalck I have a ironic upstream patch with conflicts. can you help me to resolve it ?07:14
*** trident has joined #openstack-ironic07:17
arne_wiebalckrachit7: Could you provide the link (also for others to have a look)?07:29
rachit7arne_wiebalck https://review.opendev.org/#/c/671038/07:29
patchbotpatch 671038 - ironic - DRAC: Drives conversion from raid to jbod - 13 patch sets07:29
yoctozeptooff-topic: how can we invite patchbot to another channel (e.g. kolla) as well? so far only seen it here and it could come in handy in discussion (no need to copy the subject)07:32
*** mrda has joined #openstack-ironic07:33
mrdaHey ironic, just a question on extra-hardware collection with ipa... There's no privilege escalation here: https://opendev.org/openstack/ironic-python-agent/src/branch/master/ironic_python_agent/inspector.py#L264-L268  But `hardware-detect` really should be run as root or else it doesn't collect very much.  Would we prefer ipa to escalate privileges, or expect hardware-detect to be setuid'd or07:36
mrdasimilar?  Thoughts anyone?07:36
mrdaOr have I missed the point?07:37
mrda:-)07:37
rachit7arne_wiebalck Let me brief you what i did when i recieved conflicts. 1. I tried to push the changes in upstream topic branch but said it has conflicts. 2. Then i tried to fetch remote(master and gerrit) and did rebase gerrit/master. 3. solved conflicts and able to see my topic branch updated and my patch set commit was on top the latest commit. 4.07:39
rachit7But my master branch was not updated compare to latest commit on ironic branch . 5.updated new patch set(unfortunately i missed to run tox and it was having syntax error) . 6. Then i updated master branch by following command `git fetch gerrit` and it updated. 7 But after when i run tox command it gives this error : `  File "/home/devel/git/ironic/07:39
rachit7ironic/tests/unit/common/test_nova.py", line 14, in <module>07:39
rachit7arne_wiebalck I tried to run tox on master branch after rebasing it but it shows me same error.07:46
rachit7arne_wiebalck I tried to run tox on master branch after rebasing it but it shows me same above error.07:47
arne_wiebalckrachit7: I'm in a meeting now. Will try to have a look later.07:47
rachit7arne_wiebalck sure no prob07:47
kaifengmrda: probably we need to pass a run_as_root=True there, the execution uses rootwrap, so we also need proper configuration for that during ramdisk building.07:57
*** lucasagomes has joined #openstack-ironic08:04
*** dougsz has joined #openstack-ironic08:08
*** alexmcleod has joined #openstack-ironic08:22
*** rachit7 has quit IRC08:22
mrdakaifeng: So I'll look atthis some more tomorrow.  But we probably want privsep rather than rootwrap, right?08:23
* mrda notices that privsep hasn't got here yet, so rootwrap it is08:29
*** rachit7 has joined #openstack-ironic08:29
*** yolanda__ is now known as yolanda08:30
openstackgerritraphael.glon proposed openstack/ironic-python-agent master: image extension, install_bootloader improvements  https://review.opendev.org/67487908:34
*** dsneddon has quit IRC08:38
openstackgerritDmitry Tantsur proposed openstack/ironic-python-agent-builder master: [WIP] Import ansible version of the image building job  https://review.opendev.org/67888408:41
*** derekh has joined #openstack-ironic08:43
kaifengmrda: hmm, is privsep broadly adopted in other projects? maybe we need a story for tracking that.08:48
kaifengmrda: hmm, is privsep broadly adopted in other projects? maybe we need a story for tracking that.08:48
mrdakaifeng: privsep is the future openstack thing to replace rootwrap.  But we haven't moved here in Ironic yet.  That's ok.  We can do that in the future with a story and planning etc.  For this, I'll just continue with rootwrap as that's what is in play right now.08:55
mrdaI'll get a patch up for i-p-a-builder tomorrow08:55
kaifengmrda: thanks! note that the ipa needs a patch too, otherwise it's not able to run as root.08:57
openstackgerritMerged openstack/ironic-python-agent master: Run a standalone job in the gate  https://review.opendev.org/67593708:59
arne_wiebalckrachit7: I had a first look and left a comment on the review as to why tox is complaining.09:00
openstackgerritMerged openstack/bifrost master: Install mariadb instead of mysql on deb distros  https://review.opendev.org/66590209:01
openstackgerritRachit Kapadia proposed openstack/ironic master: DRAC: Drives conversion from raid to jbod  https://review.opendev.org/67103809:04
rachit7Hi arne_wiebalck Thanks for the review i have already resolved that syntax error in local branch and just updated patchset too but still problem remains same09:05
arne_wiebalckrachit7: One test failing you mean?09:07
rachit7arne_wiebalck : yess trying to run tox but giving this error `=========================09:08
rachit7", line 456, in _find_test_path09:08
*** dsneddon has joined #openstack-ironic09:12
arne_wiebalckrachit7: for me, test_validate_configuration_custom_schema is the failing test09:15
*** dsneddon has quit IRC09:17
rachit7arne_wiebalck okay09:20
arne_wiebalckrachit7: without that test, tox passes py2709:24
rachit7arne_wiebalck Ohhh.. do you know any solution for that?09:32
arne_wiebalckrachit7: can you reproduce the failing test in your local tests?09:32
rachit7arne_wiebalck Is it possible to go two patchset behind and rebase branch again?09:33
*** dougsz has quit IRC09:35
arne_wiebalckrachit7: what is the problem you're trying to solve?09:35
arne_wiebalckrachit7: you think your local repo is in a bad state?09:36
rachit7arne_wiebalck  yes i think09:36
arne_wiebalckrachit7: ok09:36
arne_wiebalckrachit7: in case you didn't know, there is a download link on the top right corner in the gerrit dashboard09:37
*** hjensas has joined #openstack-ironic09:37
rachit7arne_wiebalck i tried to run tox without my changes by checkout master branch and it gives me same error09:37
arne_wiebalckrachit7: from there you can checkout the branch with your patch09:37
rachit7arne_wiebalck okay09:37
arne_wiebalckrachit7: what I usually do in this case is sth like picking a commit ID, do a hard reset, followed by a pull :)09:38
arne_wiebalckrachit7: try the checkout from gerrit, this should leave you on sth that is clean09:39
erolgmorning Ironic o/, Is there anyone available for review #677181.09:44
rachit7arne_wiebalck okay i will do that09:45
arne_wiebalckrachit7: good luck :)09:46
rachit7Thanks for the help arne_wiebalck :)09:46
arne_wiebalckrachit7: yw09:47
*** dougsz has joined #openstack-ironic09:51
* mrda wonders whether anyone has used 'extra-hardware' in ipa in anger before....10:06
*** dsneddon has joined #openstack-ironic10:18
*** ricolin has quit IRC10:25
openstackgerritRachit Kapadia proposed openstack/ironic master: DRAC: Drives conversion from raid to jbod  https://review.opendev.org/67103810:29
openstackgerritM V P Nitesh proposed openstack/ironic master: UEFI PXE Provisioning for wholedisk images  https://review.opendev.org/66486410:58
rachit7Hey arne_wiebalck it worked. i did copy git pull url of last patch set from gerrit dasboard and git checkout with last patch set and run tox and it passed11:03
openstackgerritVladyslav Drok proposed openstack/ironic stable/stein: Do not wait for console being started on timeout  https://review.opendev.org/67902511:07
arne_wiebalckrachit7: nice11:10
*** tesseract has joined #openstack-ironic11:12
*** dtantsur|afk is now known as dtantsur11:26
dtantsurhi ironic11:26
TheJuliaGood Morning!11:29
dtantsurmorning TheJulia11:31
arne_wiebalckdtantsur: TheJulia: o/11:32
*** Lucas_Gray has joined #openstack-ironic11:33
openstackgerritDmitry Tantsur proposed openstack/ironic-python-agent-builder master: Correct the relative path calculation  https://review.opendev.org/67903311:33
*** dsneddon has quit IRC11:36
*** dsneddon has joined #openstack-ironic11:45
openstackgerritDmitry Tantsur proposed openstack/ironic-python-agent-builder master: Import ansible version of the image building job  https://review.opendev.org/67888411:45
* TheJulia pokes gerrit11:46
etingofrpioso, o/ I am refactoring sushy along the lines of your suggestions -- https://review.opendev.org/67057911:56
patchbotpatch 670579 - sushy - Make message registries available to all resources (MERGED) - 3 patch sets11:56
etingofrpioso, it seems this change is overwhelming11:56
openstackgerritDmitry Tantsur proposed openstack/ironic-python-agent-builder master: [WIP] Import ansible version of the image building job  https://review.opendev.org/67888411:58
openstackgerritJulia Kreger proposed openstack/bifrost stable/stein: Remove openSUSE Leap 42.3  jobs  https://review.opendev.org/67718112:00
*** rh-jelabarre has joined #openstack-ironic12:01
TheJuliadtantsur: Looking at https://zuul.opendev.org/t/openstack/build/f92849f0dfd744ba8b6c0dd7a38f1b42 I'm wondering if we're hitting a race in neutron12:03
dtantsursigh12:08
TheJuliaActually looks like order of operations :\12:09
TheJuliayeah, race... except its in network booting https://a98906b115e1af31900d-686811860e75a35eabcecb5697905253.ssl.cf1.rackcdn.com/678729/1/gate/ironic-tempest-ipa-partition-redfish-tinyipa/f92849f/controller/logs/ironic-bm-logs/node-0_no_ansi_2019-08-28-10:43:22_log.txt.gz *sigh*12:16
TheJuliaIs there a reason to really run rescue testing so prolithicly in our CI?12:16
openstackgerritRachit Kapadia proposed openstack/ironic master: DRAC: Drives conversion from raid to jbod  https://review.opendev.org/67103812:19
openstackgerritJulia Kreger proposed openstack/ironic-tempest-plugin master: Enable boot_option to be specified  https://review.opendev.org/67863312:22
rpiosoetingof: If memory serves, that change addresses a non-blocking bug. If you agree with my comments, it could be reverted and fixed anew later.12:23
etingofrpioso, I think your concern was that we release a new API (registries) which we will have to pull back in the next release, no?12:24
TheJuliaarne_wiebalck: crazy off the wall question, but software raid implies localboot right?12:24
rachit7Good Morning rpioso :)12:25
rpiosoetingof: Correct. That would be an API change.12:25
rpiosorachit7: Good morning :-)12:26
etingofrpioso, that's why I am trying to change it just once, before the upcoming release... this patch will be huge :(12:26
arne_wiebalckTheJulia: erm ... by implies you mean "wouldn't work without" ?12:26
arne_wiebalckTheJulia: IIRC, the RAID code does not change anything related to how the instance is going to boot12:27
arne_wiebalckTheJulia: if that is your question?12:28
rpiosoetingof: The alternative is revert and fix anew after the next release. And that could be back ported, because it’s a bug fix.12:28
openstackgerritDmitry Tantsur proposed openstack/ironic-python-agent-builder master: [WIP] Import ansible version of the image building job  https://review.opendev.org/67888412:29
etingofrpioso, would reverting this patch undermine our Dell server relationship...?12:30
TheJuliaarne_wiebalck: what do you guys run with your default_boot_option?12:31
arne_wiebalckTheJulia: local12:32
TheJuliaokay... hmm12:32
rpiosoetingof: I don’t believe so, but I’m not certain. The Dell EMC 3d Party CI would be a quick smoke test.12:32
TheJuliaarne_wiebalck: I'm trying to change the default to actually be local boot, and I noticed the raid CI jobs failed when local was explicitly set. I'm wondering if there is an edge case where the code gets confused with raid if it is set via capabilities12:33
arne_wiebalckTheJulia: how are the jobs failing?12:35
TheJuliahttps://dbe05845bd36655c0e9a-218375fc8749de6a1ac263f444b96da4.ssl.cf5.rackcdn.com/678633/4/check/ironic-standalone/899dbe5/testr_results.html.gz12:36
openstackgerritDmitry Tantsur proposed openstack/ironic-python-agent-builder master: [WIP] Import ansible version of the image building job  https://review.opendev.org/67888412:36
TheJuliaarne_wiebalck: "Failed to install a bootloader when deploying node 38350e1e-66b0-498a-8bba-606bec1f05b9. Error: {u'message': u\"Command execution failed: Installing GRUB2 boot loader to device /dev/md0 failed with Unexpected error while running command.\\nCommand: mount /dev/md0p1 /tmp/tmp4k691suz\\nExit code: 32\\nStdout: ''\\nStderr: 'mount: special device /dev/md0p1 does not exist\\\\n'.\"12:37
* TheJulia checks the job time because it may hav ebeen an old ipa12:37
TheJuliaLooks like we have an even newer IPA build12:38
TheJuliaIt might have run with an older build, so that may be it12:39
* TheJulia engages wait()12:39
etingofrpioso, let me go through that patch... on the other hand, the API change introduced by that patch is really negligible...12:41
*** rachit7 has quit IRC12:43
*** rloo has joined #openstack-ironic12:45
rpiosoetingof: The API change is most, if not all, objects now have a 'registries' property, right?12:46
arne_wiebalckTheJulia: I'll need to have a look at the code, but the bootloader should not go onto the md device or its partition ... but maybe that's just a confusing error message?12:46
rpiosoetingof: s/objects/classes/12:46
*** sthussey has joined #openstack-ironic12:47
TheJuliaarne_wiebalck: possibly, I'm re-running my change of the default option patch as well which should give us an idea of if there is a bigger bug someplace under the hood12:47
etingofrpioso, yes, but this is internal to sushy. these objects are not exposed through the package API12:48
TheJuliaarne_wiebalck: but always the possibility that the device patch didn't actually make it in to the prior IPA iamges because the builds were failing for a few days.12:48
dtantsurTheJulia: last time this message was a sign of missing mdadm12:48
dtantsuralthough we shouldn't have regressed in this aspect12:48
TheJuliaAgreed, time will tell12:48
rpiosoetingof: Isn't that property public, without an underscore prefix?12:49
etingofrpioso, it is, but I doubt anyone would use it...12:49
etingofrpioso, ...and we could preserve it going forward for backward compatibility if needed12:50
*** ricolin has joined #openstack-ironic12:50
rpiosoetingof: Given that it's public, I believe it's considered part of the API.12:51
etingofrpioso, formally, yes. but in reality, I doubt it's important. still, there should be no issue keeping it exposed12:52
etingofrpioso, last minute reverting feels unsafe a bit, so I'd propose to release sushy as-is for now12:53
rpiosoetingof: Sure, it could be deprecated or preserved for backwards compatibility, but that seems like extra work, confusing, and untidy. If it's truly not essential, revert and revisit. I'm pretty certain it's not essential.12:54
rpiosoetingof: Do you agree it's a bug fix?12:55
rpiosoetingof: If so, revert, revisit, and back port is an alternative to leaving it as-is.12:56
openstackgerritMerged openstack/ironic master: Out-of-band `erase_devices` clean step for Proliant Servers  https://review.opendev.org/64158212:56
etingofrpioso, it feels like something in-between a bug fix and a new feature12:58
* TheJulia is happy thigns actually pass CI now13:02
openstackgerritDmitry Tantsur proposed openstack/ironic-python-agent-builder master: Import ansible version of the image building job  https://review.opendev.org/67888413:03
dtantsurTheJulia: ^^13:03
TheJuliadtantsur: ack13:04
TheJuliaI already had it on my list for later today13:04
dtantsurI think I've finally finished cleaning it up :)13:04
TheJulia:)13:05
etingofrpioso, there seems to be a dependent patch related to message registries caching13:05
etingofrpioso, we will have to revert it as well -- https://review.opendev.org/#/c/671091/3/sushy/main.py13:07
patchbotpatch 671091 - sushy - Cache message registries (MERGED) - 3 patch sets13:07
TheJuliaHmmm... we don't mention software raid in the release notes13:09
*** jcoufal has joined #openstack-ironic13:17
*** dsneddon has quit IRC13:20
dtantsursudo: ovs-vsctl: command not found13:27
dtantsura silly error in the V6 job, I wonder what installs it usually13:27
*** dsneddon has joined #openstack-ironic13:28
TheJuliahmmm13:29
TheJuliathat is needed really early on for multinode job13:29
TheJuliajobs13:29
TheJuliabecause of the vxlan tunnel13:29
*** rachit7 has joined #openstack-ironic13:31
openstackgerritDmitry Tantsur proposed openstack/ironic master: WIP ipv6 jobs  https://review.opendev.org/61316913:32
dtantsurthat's not a multinode job though13:32
dtantsurtrying setting Q_* stuff explicitly ^^13:32
*** dsneddon has quit IRC13:33
TheJuliaq_* _should_ only be for the legacy devstack plugin...13:34
dtantsurTheJulia: yep, and I had to switch to it because the new one seemingly defaults neutron-api to 0.0.0.013:37
TheJuliaGAH13:42
* TheJulia hands dtantsur nikka coffey grain13:42
*** Goneri has joined #openstack-ironic13:42
openstackgerritIlya Etingof proposed openstack/sushy master: Change OEM extensions architecture  https://review.opendev.org/67688913:45
openstackgerritIlya Etingof proposed openstack/sushy master: Add conditional field matching  https://review.opendev.org/67507313:45
openstackgerritDmitry Tantsur proposed openstack/bifrost master: Stop using deprecated OS_URL  https://review.opendev.org/67905813:47
dtantsurTheJulia: also FYI ^^13:47
TheJuliadtantsur: thanks13:47
dtantsuralso Nikka Coffey Grain sounds amazing :)13:49
*** jtwill98 has joined #openstack-ironic13:49
dtantsurTheJulia: are we ready to remove coreos jobs from IPA?13:53
TheJulia*sigh*13:53
TheJuliaI think so13:53
dtantsurwell, a replacement is coming together pretty quickly :)13:53
TheJuliadib based?13:53
dtantsuryeah13:54
dtantsurall the stuff I've been doing the last couple of weeks13:54
TheJuliayeah, CoreOS was a good alternative and I suspect we may revisit it, but the best thing for us to do at this point is to kill it with fire13:54
TheJuliabecause for newer coreos stream we're going to have to start largely from scratch13:54
TheJuliastreams13:54
*** priteau has joined #openstack-ironic13:54
rpiosoetingof: Agree14:04
*** dsneddon has joined #openstack-ironic14:07
openstackgerritDmitry Tantsur proposed openstack/ironic-python-agent master: Remove support for CoreOS images  https://review.opendev.org/67906414:08
dtantsurhere we go14:08
TheJuliahttps://review.opendev.org/679065 as well :)14:18
patchbotpatch 679065 - election - Add Julia Kreger for Ironic U cycle PTL - 1 patch set14:18
*** openstackgerrit has quit IRC14:22
etingofrpioso, do you think we should revert both patches or none?14:23
*** amotoki_ has quit IRC14:34
*** amotoki has joined #openstack-ironic14:35
dtantsurrevert the heck out of everything!14:42
* dtantsur has no idea, just kidding14:43
*** hjensas has quit IRC14:44
*** openstackgerrit has joined #openstack-ironic14:45
openstackgerritJulia Kreger proposed openstack/ironic master: Add software raid release note to ironic  https://review.opendev.org/67907514:45
dtantsurhmm, suse jobs are actually broken, aren't they?14:45
TheJulianot entirely sure, the bifrost change has a naming discrepency14:46
TheJuliaI've not cycled back to that yet this morning14:46
dtantsurhttps://review.opendev.org/#/c/679058/14:47
patchbotpatch 679058 - bifrost - Stop using deprecated OS_URL - 1 patch set14:47
TheJulia*gasp* https://review.opendev.org/#/c/678633/ passed14:47
patchbotpatch 678633 - ironic-tempest-plugin - Enable boot_option to be specified - 5 patch sets14:47
TheJuliaship it!14:47
TheJuliaAnd I feel like we might have a bug https://storage.gra1.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/logs_14/492114/18/check/ironic-standalone/d6aac91/testr_results.html.gz14:49
*** hjensas has joined #openstack-ironic14:51
*** Lucas_Gray has quit IRC14:51
dtantsursorry, I'm banging my head on the stupid tempest timeout14:53
* dtantsur wonders why we even use tempest14:54
TheJuliadtantsur: which one?14:54
dtantsurhttps://c5b5c576705ed78be235-fc6b0fdbb44c8a933c3daf9bbf32644a.ssl.cf2.rackcdn.com/676239/7/check/ipa-tempest-wholedisk-bios-ipmi-direct-dib-src/c82cf60/job-output.txt14:55
TheJulialol, it timed out during cleaning14:56
dtantsuryeah, the success was so close14:56
dtantsurnow I wonder why it timed out after 5 minutes if unprovision_timeout is 900 seconds14:57
TheJuliaI had to disable automated cleaning on the networking-baremetal job because the extra time just takes it a little bit longer and hits the failure point14:57
TheJuliaI did post a change to extend the base timeouts a little more14:57
TheJuliabecause CI performance is always a variable14:57
*** igordc has joined #openstack-ironic14:57
TheJuliaoh, hmmm14:58
TheJuliathe outer job timeout I would guess....14:58
TheJuliahmm14:58
TheJuliain the actual wait14:58
*** mkrai_ has joined #openstack-ironic14:59
dtantsurand why do we poke it every second if interval=3014:59
*** mkrai has quit IRC15:01
TheJuliaso we don't flood the logs15:03
TheJuliayeah, 900 seconds... hmm15:03
openstackgerritDmitry Tantsur proposed openstack/ironic master: WIP ipv6 jobs  https://review.opendev.org/61316915:07
dtantsurTheJulia: I suspect it may be OS_TEST_TIMEOUT which we do raise for coreos jobs15:07
dtantsurasked nishagb to try it15:07
TheJuliayeah, I think that gets read in the code internally and not logged as config, it could be the only real way15:08
openstackgerritDmitry Tantsur proposed openstack/ironic-python-agent-builder master: Install IPA from source in the CI  https://review.opendev.org/67908615:18
*** donnyd has quit IRC15:19
*** donnyd has joined #openstack-ironic15:20
*** donnyd has quit IRC15:20
*** donnyd has joined #openstack-ironic15:21
rpiosoetingof: Both15:22
etingofrpioso, the second patch feels important - without it ironic log turns into message registries dump ;)15:23
*** gyee has joined #openstack-ironic15:26
openstackgerritDmitry Tantsur proposed openstack/ironic-python-agent-builder master: DIB: install IPA from source checked out by Zuul  https://review.opendev.org/67908615:26
*** dsneddon has quit IRC15:27
*** ash2307 has joined #openstack-ironic15:28
TheJuliaetingof: yeah, please don't let it dump registries into ironic's logs...15:28
*** ash2307 has left #openstack-ironic15:28
rpiosoetingof: Was that undesirable situation introduced by https://review.opendev.org/670579 ?15:28
patchbotpatch 670579 - sushy - Make message registries available to all resources (MERGED) - 3 patch sets15:28
rpiosoetingof: In other words, did the dependent change fix a bug in that one ^^^?15:30
*** mkrai_ has quit IRC15:32
NobodyCamGood Morning Ironic folks15:32
openstackgerritDmitry Tantsur proposed openstack/ironic-python-agent master: Switch to image building jobs from ironic-python-agent-builder  https://review.opendev.org/67908715:33
etingofrpioso, the first patch allowed caching once downloaded message registries - that's what the second (dependent) patch does15:34
*** trandles has joined #openstack-ironic15:35
etingofrpioso, second patch (caching registries) seems more like a feature, excessive registries download and logging has been introduced by some older patch perhaps implementing message registries15:35
dtantsurfolks, looking for reviews on https://review.opendev.org/#/c/679033/ please15:36
patchbotpatch 679033 - ironic-python-agent-builder - Correct the relative path calculation - 1 patch set15:36
etingofrpioso, so we can only revert both patches at once (some more dependencies can potentially come up along the way)15:36
etingofrpioso, I am not yet convinced we should revert the patches because (in my mind) one exposed public API property does not justify (1) disabling registries cache and (2) risking regressions15:38
*** niceplace_ has joined #openstack-ironic15:39
*** dsneddon has joined #openstack-ironic15:44
*** bdodd has joined #openstack-ironic15:53
*** bdodd_ has quit IRC15:54
*** lucasagomes has quit IRC16:00
openstackgerritRachit Kapadia proposed openstack/ironic master: DRAC: Drives conversion from JBOD to RAID  https://review.opendev.org/67909316:01
*** whoami-rajat has joined #openstack-ironic16:01
openstackgerritRachit Kapadia proposed openstack/ironic master: [WIP]DRAC: Drives conversion from JBOD to RAID  https://review.opendev.org/67909316:03
*** ricolin has quit IRC16:04
*** ricolin has joined #openstack-ironic16:04
*** tesseract has quit IRC16:08
*** ricolin has quit IRC16:12
*** alexmcleod has quit IRC16:14
openstackgerritMerged openstack/networking-baremetal master: Update api-ref location  https://review.opendev.org/67359816:15
*** rachit7 has quit IRC16:16
openstackgerritMerged openstack/networking-baremetal master: Update Python 3 test runtimes for Train  https://review.opendev.org/66507316:17
trandlesQuestion/comment about ironic console and ipmitool-socat. I'm using ironic installed from CentOS 7 stein RPMs. It's standalone (nothing but ironic-api and ironic-conductor). I can't get serial console because the ironic services are running as user ironic, but it's trying to bind socat to a privileged port (623) and gets permission denied. Am I missing something in the config? I would have expected socat to bind a local unprivileged port.16:19
trandles| last_error             | Error enabling the console on node 2f9fd223-839c-4bf8-ae22-fc8d7394c786. Reason: Console subprocess failed to start. Command: socat -T600 -L/tmp/2f9fd223-839c-4bf8-ae22-fc8d7394c786.pid TCP4-LISTEN:623,bind=192.168.100.254,reuseaddr,fork,max-children=1 EXEC:"ipmitool -I lanplus -H 192.168.100.253 -L ADMINISTRATOR -U NULL -f /tmp/2f9fd223-839c-4bf8-ae22-fc8d7394c786.pw sol activate",pty,stderr. |16:20
trandles|                        | Exit code: 1.                                                                                                                                                                                                                                                                                                                                                                                                |16:20
trandles|                        | Stderr: '2019/08/28 10:16:12 socat[99114] E bind(15, {AF=2 192.168.100.254:623}, 16): Permission denied\n'16:20
openstackgerritNisha Brahmankar proposed openstack/ironic-python-agent master: Adds CI job that uses DIB build images  https://review.opendev.org/67623916:20
priteautrandles: Did you set the ipmi_terminal_port on each node to a unique, unprivileged port?16:30
trandlesOk, answering my own question. ipmi_terminal_port is the LOCAL port, not the remote port. Maybee documentation ambiguity.16:30
trandlespriteau: yes, that fixed it...16:31
trandlesOne of those days16:31
trandlesI read the ipmi_port note on https://docs.openstack.org/ironic/stein/install/enrollment.html and didn't distinguish local vs. remote16:33
*** derekh has quit IRC16:57
*** dougsz has quit IRC17:01
* TheJulia reads17:03
TheJuliao/ trandles17:03
TheJulia\o/17:04
*** dtantsur is now known as dtantsur|afk17:08
dtantsur|afkg'night17:08
*** ijw has joined #openstack-ironic17:14
*** ijw has quit IRC17:16
*** ijw has joined #openstack-ironic17:16
*** ijw has quit IRC17:17
*** ijw has joined #openstack-ironic17:18
trandlesHi TheJulia17:39
trandlesSorry, poorly timed message earlier. I had to run to a meeting for the past hour.17:40
openstackgerritDmitry Tantsur proposed openstack/ironic-python-agent master: Remove support for CoreOS images  https://review.opendev.org/67906417:46
openstackgerritDmitry Tantsur proposed openstack/ironic-python-agent master: Switch to image building jobs from ironic-python-agent-builder  https://review.opendev.org/67908717:47
openstackgerritDmitry Tantsur proposed openstack/ironic-python-agent master: DNM testing the new CI jobs  https://review.opendev.org/67910617:48
*** mmethot has quit IRC17:58
*** zbitter has joined #openstack-ironic17:58
*** mmethot has joined #openstack-ironic17:58
*** zaneb has quit IRC17:58
*** priteau has quit IRC18:12
*** ociuhandu has joined #openstack-ironic18:12
*** igordc has quit IRC18:23
*** trandles has quit IRC18:57
*** cdearborn has joined #openstack-ironic19:12
*** ociuhandu has quit IRC19:14
*** jcoufal_ has joined #openstack-ironic19:57
openstackgerritJulia Kreger proposed openstack/ironic master: Change [deploy]/default_boot_option to local  https://review.opendev.org/49211419:57
openstackgerritJulia Kreger proposed openstack/ironic master: Fix get_boot_option logic  https://review.opendev.org/67913219:57
*** jcoufal has quit IRC19:59
TheJuliadtantsur|afk: ^^^ okay, that _should_ fix software raid local boot when we change the boot option in the following patch. I'll edit the commit message of the tempest test fix.20:01
openstackgerritJulia Kreger proposed openstack/ironic-tempest-plugin master: Enable boot_option to be specified  https://review.opendev.org/67863320:02
jtwill98Does anyone have experience using the Virtual Redfish Emulator who I could talk with?20:02
*** gyee has quit IRC20:05
TheJuliajtwill98: well, we use it in our CI, so maybe ask your questions and someone might know. If all else fails etingof may be a good person to chat with20:06
jtwill98Well, I am trying to use the sushy-emulator and can see the Systems, however all efforts to see Managers and Chassis are failing.  If I use static with mockups I see them fine.20:09
jtwill98In fact the only data items under my ServiceRoot is "Systems"/20:13
TheJuliaI suspect that is because it is not implemted in the dynamic emulator since that is used in our CI for testing and I think has very exclusive paths for manager urls.20:14
jtwill98I suspect that may be the case.  How does one follow the instructions in the "virtual media boot" section found at URL: https://docs.openstack.org/sushy-tools/latest/user/dynamic-emulator.html.20:19
jtwill98It looks like you need Managers to map images to virtual media.20:20
TheJuliaare you installing a release or are you installing directly from the master branch of git?20:20
jtwill98I installed a release but would be willing to use the master branch, if required.20:21
TheJuliajtwill98: well, that would be why your having issues20:21
TheJulialatest documentation is from master branch20:21
jtwill98sushy-tools .60 if I recall correctly.20:21
TheJuliaWhat your searching for merged on August 6th, thus hasn't been released yet20:22
jtwill98using pip install.20:22
*** gyee has joined #openstack-ironic20:23
TheJuliahttps://review.opendev.org/#/c/656792 and https://review.opendev.org/#/c/65693820:23
patchbotpatch 656792 - sushy-tools - Add Virtual Media support (MERGED) - 26 patch sets20:23
patchbotpatch 656938 - sushy-tools - Add `get/set_boot_image` to libvirt driver (MERGED) - 28 patch sets20:23
jtwill98OK, at least I now something new to try.20:24
TheJuliajtwill98: enjoy!20:24
jtwill98Is there an easy way to apply the patches?20:24
TheJuliajtwill98: what patches are you trying to apply?20:29
TheJuliajtwill98: the ones I specified? There are more to just those, you'll need to just pull master down and install it20:30
jtwill98I'm good.20:34
jtwill98thanks Julie20:34
jtwill98Thanks Julia!20:35
*** trandles has joined #openstack-ironic20:41
openstackgerritMerged openstack/ironic master: Follow-up for deploy steps for Redfish BIOS interface  https://review.opendev.org/67769520:42
*** jcoufal_ has quit IRC20:44
*** jcoufal has joined #openstack-ironic20:45
*** jcoufal has quit IRC20:50
*** bdodd has quit IRC20:51
*** trandles has quit IRC20:56
*** belmoreira has joined #openstack-ironic20:59
*** patchbot has quit IRC20:59
*** patchbot has joined #openstack-ironic21:00
*** Goneri has quit IRC21:15
*** belmoreira has quit IRC21:16
etingofjtwill98, sorry for being late to the party... with latest master both Managers and Chassis are indeed supported21:22
*** belmoreira has joined #openstack-ironic21:25
*** jtwill98 has quit IRC21:37
openstackgerritIlya Etingof proposed openstack/sushy-tools master: Do not reuse sqlite connection  https://review.opendev.org/67879722:02
*** belmoreira has quit IRC22:11
*** patchbot has quit IRC22:38
*** patchbot has joined #openstack-ironic22:48
*** rcernin has joined #openstack-ironic23:21
*** rh-jelabarre has quit IRC23:42
*** sthussey has quit IRC23:47

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!