Wednesday, 2023-01-25

arozmanHi Ironic !06:38
arne_wiebalckGood morning arozman and Ironic!07:21
rpittaugood morning ironic! o/09:25
samuelkunkel[m]Good morning10:13
samuelkunkel[m]TheJulia: I did some investigation into the iDRAC 6.10 stuff with the suggested adjustments (adding 400 into the "allowed" response status to continue). The issue seems that, despite all the handling, we never see an etag provided as argument from the patch function to the _etag_handler. Therefore there is an initial patch called and within the exception handling we always fail here10:15
samuelkunkel[m]https://opendev.org/openstack/sushy/src/branch/master/sushy/connector.py#L325 as etag is always None from what I see.10:15
samuelkunkel[m] * TheJulia: I did some investigation into the iDRAC 6.10 stuff with the suggested adjustments (adding 400 into the "allowed" response status to continue). The issue seems that, despite all the handling, we never see an etag provided as argument from the patch function to the \_etag\_handler. Therefore there is an initial patch called and within the exception handling we always fail here10:17
samuelkunkel[m]https://opendev.org/openstack/sushy/src/branch/master/sushy/connector.py#L325 as etag is never declared(None) from what I see.10:17
samuelkunkel[m]Any further idea?10:17
dtantsuranyone is seeing some absurd behavior by tox?12:25
dtantsurin my case, `tox -epy39` completely ignores the 'py39' part and just runs everything12:25
dtantsurit also uses sdist now, which is something we wanted to avoid?12:26
dtantsurWorks with tox 4.0. I guess we just broke tox 3. FYI rpittau, JayF 12:28
opendevreviewDmitry Tantsur proposed openstack/ironic-python-agent master: [WIP] Make logs collection a hardware manager call  https://review.opendev.org/c/openstack/ironic-python-agent/+/87170812:34
iurygregorydtantsur, by "runs everything" you mean it runs the all tests under the default python version in your system?12:44
kubajjdtantsur: in https://review.opendev.org/c/openstack/ironic/+/871394 should I include something else for the exception or is the logging enough?12:50
dtantsuriurygregory: it didn't reach tests for me, fails on reno12:50
dtantsurkubajj: I'll check a bit later12:50
iurygregorydtantsur, ok, let me try to run here, you were running the tests for ironic or other project?12:51
iurygregory(ipa, inspector etc)12:51
kubajjdtantsur: thanks12:51
dtantsuriurygregory: IPA12:52
iurygregoryok o/12:52
iurygregoryjesus12:53
iurygregorythis doesn't look good '-'12:53
iurygregoryhttps://paste.opendev.org/show/bgVQYOMbnhDQPpb6lP37/12:54
iurygregorydtantsur, so I was checking the ironic tox.ini vs ipa tox.ini the only diff that caught my eye was that in ironic we still have usedevelop = True in [testenv] but in IPA we don't have 13:15
iurygregoryhttps://opendev.org/openstack/ironic-python-agent/commit/3ded705e5601da8f8447281cd0a1bae5b3c5b592 maybe we should only have removed skipsdist ...13:16
rpittauusedevelop is supported, skipsdist is not since a while13:30
rpittaualso they are (were) mutually exclusive13:30
iurygregoryyeah, I'm trying to understand why adding to ipa helps...13:30
rpittauiurygregory: adding what ?13:30
iurygregorybecause I just removed from ironic and it also worked13:31
iurygregoryusedevelop = True back to tox.ini in IPA13:31
rpittauiurygregory: usedevelop=True install the current package in development mode with “setup.py develop” instead of installing from the sdist package. 13:33
rpittauso adding usedevelop remove sdist usage13:33
rpittau I haven't even noticed it was removed to be honest13:34
rpittauit should be readded13:34
rpittauIWas planning to cut bugfix today but I'll wait for that to be readded13:37
dtantsuriurygregory: I see the same thing (as in your paste)13:38
opendevreviewRiccardo Pittau proposed openstack/ironic-python-agent master: Readd usedevelop true to tox.ini  https://review.opendev.org/c/openstack/ironic-python-agent/+/87172813:41
rpittaudtantsur, iurygregory, this ^ should fix things13:42
dtantsurrpittau: do we plan to use the new branch downstream? I'd like to get https://review.opendev.org/c/openstack/ironic-python-agent/+/871708 in if possible13:42
rpittauwe should check the other repos13:43
dtantsur(just waiting for CI results to check the approach)13:43
iurygregoryok, good o/ 13:43
rpittaudtantsur: we'll probably use the new bugfix branch downstream13:43
rpittauwe can wait for early next week I guess13:43
dtantsurI'll try to finish this one today13:45
opendevreviewMerged openstack/ironic bugfix/20.2: Use cinder from stable/zed for CI jobs  https://review.opendev.org/c/openstack/ironic/+/87160414:12
opendevreviewDmitry Tantsur proposed openstack/ironic-python-agent master: Make logs collection a hardware manager call  https://review.opendev.org/c/openstack/ironic-python-agent/+/87170814:17
dtantsurrpittau: ready for review ^^14:17
rpittauack, I'll check ASAP14:18
iurygregoryreleasenote failed .-. ValueError: Unknown reference 'stable/8.4'14:22
dtantsurwe could have screwed up EOL'ing branches..14:24
TheJuliao/14:28
iurygregorydtantsur, yeah, I have this feeling 14:32
iurygregorymorning TheJulia, I hope you are feeling better today o/14:32
TheJuliasomewhat, not 100%. Trying to figure out at the moment if it is the cold meds that make me feel awful this morning, or if it is still the cold14:43
TheJuliaLaying in bed, I felt great14:43
TheJuliaGetting up and moving around... ugh14:44
TheJuliainteresting, a job failed and it looks like libvirt compeltely failed to actually start the VMs, no logs. :\15:14
dtantsurwow15:43
dtantsurkubajj: a new review incoming15:43
kubajjdtantsur: thanks, on it15:45
dtantsurTheJulia: was it you who added TLS 1.3 topic to the B PTG?15:46
dtantsurwould be curious to hear details. I seem to vaguely recall seeing TLS 1.3...15:47
JayFit was me15:48
JayFAdam from Metal3 mentioned it15:49
JayFwe absolutely do not support TLSv3 on IPA's wsgi server15:49
JayFwith the TLS support stuff I put in and you hooked up with automation thru ironic15:49
TheJuliame? I'm still a brainless zombie15:49
TheJuliabraaaaainnnss15:49
JayFI do not know about clients/servers from the ironic or inspector side15:49
dtantsursorry TheJulia 15:49
JayFre: tls1.315:49
TheJuliac'est la vie15:49
JayFdtantsur stunned to learn I do more than edit etherpads and run meetings? ;) 15:49
dtantsurno way!15:50
JayFJust joking :P 15:50
dtantsurright, I don't think I use built-in TLS anywhere except for IPA in deployments I care about (bifrost and metal3)15:50
JayFI am talking in #openstack-oslo15:50
JayFthey have nobody working on oslo.service at all anymore15:50
dtantsurouch15:50
JayFso I'm going to look and see if we're the only folks using that code15:50
JayFif not, maybe we keep using oslo.service and enhance it15:50
JayFif so... then maybe we migrate to something else, or adopt the code directly into IPA15:51
TheJuliaI think we're one of many15:51
TheJuliahonestly15:51
dtantsurI have a nagging feeling that updating oslo.service is somewhat easier15:51
TheJulia++15:51
JayFgood, maybe we can talk someone !ironic into helping us with that lol15:51
TheJulia++15:51
dtantsurrunning IPA behind a normal server could be beneficial, but requires some rework of the auto-TLS effort15:52
TheJuliaand increased memory footprint15:52
dtantsuralso true :(15:52
TheJuliawhich is not an issue in reality outside of CI15:52
JayFI don't think "run an extra service in the ramdisk" is ever going to be the answer15:52
JayFbecause of the amount of pain it adds to customers15:52
dtantsuryeah15:52
JayFand there's no need to do it at IPA scale15:52
TheJulia++15:53
JayFwe just gotta make the support work :) 15:53
dtantsurespecially those of us dealing with containers :)15:53
TheJuliaIt just needs to "work"15:53
JayFI should probably hit the list with this tbh15:53
TheJuliaand we hide a lot of complexity to just make sure it "just works"15:53
JayFI'm going to email the list and basically assume for now someone (me if nobody else) is picking this up for bobcat15:53
TheJuliaIt seems like a really valid ptg-wide topic, tbh15:54
dtantsurI think the problem with PROTOCOL_TLSv1_* is that these variables are deprecated15:54
JayFyep15:54
JayFI spent two hours digging this yesterday15:54
JayFif that wasn't the case; I would've JFDI'd a patch15:55
JayFbeccause I thought it would be that easy lol15:55
dtantsurhmmmm wait15:55
dtantsurhttps://opendev.org/openstack/oslo.service/src/branch/master/oslo_service/sslutils.py#L9115:55
dtantsurdoes it mean that we can simply unset this option?15:55
dtantsur(if we ever set it)15:56
* dtantsur is confused again15:57
TheJuliaconfusion is a valid state of being15:57
dtantsurNew, TLSv1.3, Cipher is TLS_AES_256_GCM_SHA38415:59
dtantsurjust tested local Ironic with a self-signed cert15:59
dtantsurCLOSED WORKSFORME?15:59
JayFdtantsur: I did hit the list about this, if you are going to dig harder might wanna put your findings there15:59
JayFnope, because you can't configure TLS v1.3 only, right?16:00
JayF"You can make TLS 1.3 work by turning off all config about ciphers and versions" is a workaround, not a fix16:00
dtantsurwas it the request?16:00
dtantsurAdam was asking about "TLS 1.3 support". The support is there.16:00
JayFI don't know what Adam's exact request was; but I know I've had similar requirements to that in the past16:00
dtantsurI'm not sure how easy it is, to disable TLS 1.2-16:00
JayF(where you have to be able to limit it to only latest ciphers/only approved cipher/etc)16:01
dtantsur(quite easy with nginx/httpd)16:01
JayFWell yeah, but IPA doesn't have those bits and we all just agreed they shouldn't16:01
dtantsurDeprecated since version 3.6: OpenSSL has deprecated all version specific protocols.16:01
JayFso perhaps it really is just a "remove the config" and "fix the docs"16:01
JayFdtantsur: you going to correct my post to the list or should I self-reply16:01
* JayF afk/distracted, TC meeting16:02
dtantsurI will, but need to run today16:02
dtantsurnoticing though that https://docs.python.org/3/library/ssl.html#ssl.TLSVersion is not deprecated, maybe we can use that if the request is to limit version16:02
JayFack 16:02
JayFdid you know some of this beforehand?16:03
JayFif not, how the hell did you figure it out so quick?16:03
JayFyou have some kind of magically good docs somewhere? lol16:03
dtantsurhaha, I did have some exposure to Python's TLS support after I implemented auto-TLS16:03
JayFmy knowledge was all dated to before they deprecated the TLS_VERSION stuff16:04
JayFso wheen I went digging and there was no ssl.PROTOCOL_TLS_V13 or whatever16:04
JayFI started up with the WTFs16:05
kubajjdtantsur: for the test where swiftclient raises exception, should I mock an exception?16:11
JayFWhat exactly aree you trying to determine?16:19
JayFIf the method you called raises? 16:19
kubajjdtantsur: any clue what I'm doing wrong if I get this error when trying to test the destroy_node? https://paste.opendev.org/show/beLJJ1xQjsIe7BSwQuJU/16:30
kubajjJayF: sorry, didn't see this. I have a function that tries to delete a swift object, which might not exist which raises ClientException16:31
JayFassertRaises is what you're looking for16:32
JayFself.assertRaises(method_call(x,y), MyException)16:32
JayFI may have that call order outta whack, or it might be the wrong test library16:32
JayFbut you get the idea :D 16:32
kubajjJayF: but I'm mocking the call that would raise the exception, if you know what I mean.16:46
JayFso you can do like16:47
JayFmock_thing.side_effect = MyException() 16:47
JayFi think?16:47
kubajjJayF: thanks16:47
JayFgoogle/search repo for side_effect and you should get good syntax16:47
rpittaugood night! o/17:12
JayFSo FYI; we're working this in #openstack-releases17:18
JayFCI is busted on release notes17:18
JayFand has been apparently since bugfix branch retirement17:18
JayFfor $reno_reasons17:18
JayFI'm going to be working on this now, trying to fix it :( 17:18
* JayF put it in whiteboard17:19
JayFI think our bugfix branch chickens are coming home to roost17:47
JayFin the form of reno likely needing major changes17:47
opendevreviewMerged openstack/ironic bugfix/20.2: Prevent pxe retry when agent token exists  https://review.opendev.org/c/openstack/ironic/+/86802618:00
stevebaker[m]good morning20:03
TheJuliao/ stevebaker[m] 20:03
JayFthis reno algo is exactly the sort of thing I'm bad at20:18
JayFbut I think I'm figuring it out20:18
JayFI was hoping for a quick fix but no dice20:18
JayFtl;dr: reno parses out numbers from any branch ending in -eol, and expects for there to be an equivalent `stable/x.y`20:19
JayFso our new `bugfix-x.y-eol` tags are breaking reno builds20:19
JayFjust excluding bugfix tags seems to have a negative impact on the build because it's unable to track some of the release notes20:19
JayFso I'm trying to grok the algorithm that the tracker in reno is using20:20
TheJuliaHmm I would think it would be okay to just exclude them20:52
JayFyeah, see -release20:53
JayFthe bad logs I was getting appear in the last good run before I retired the branches20:53
JayFso I think the updated-config for the regexps of eol tags to care about is the fix20:53
JayFgoing to push that shortly20:53
JayFTheJulia: it's accurate to say the releasenotes job should only run on master; yeah?20:58
TheJuliaJayF: for what is published, afaik, it runs from master20:58
JayFack; so the "backport" will be to kill the job on younger branches20:59
TheJuliaso20:59
TheJuliathe conundrum is you still need it there if you want to validate you made branch specific changes on the change20:59
TheJuliabecause once merged, the job on master will pick it up20:59
TheJuliabut not beforehand20:59
JayFah, so we still have to backport the conf fix20:59
JayFgot it20:59
TheJuliayeah20:59
JayFdamn, I think we still need a reno change21:02
JayFbecause it doesn't look like config is hooke dup21:02
JayF*hooked up21:02
opendevreviewJay Faulkner proposed openstack/ironic-python-agent master: Make reno ignore bugfix eol tags  https://review.opendev.org/c/openstack/ironic-python-agent/+/87178621:20
opendevreviewJay Faulkner proposed openstack/ironic master: Make reno ignore bugfix eol tags  https://review.opendev.org/c/openstack/ironic/+/87178721:21
opendevreviewJay Faulkner proposed openstack/ironic-inspector master: Make reno ignore bugfix eol tags  https://review.opendev.org/c/openstack/ironic-inspector/+/87178821:22
JayFjust kidding I read some docs21:27
JayFbeautiful \o/21:27
JayFthat ironic change needs revision, I probably won't get to it until after my next meeting21:52
JayFapparently we already had a reno.yaml for ironic21:52
opendevreviewJay Faulkner proposed openstack/ironic master: Make reno ignore bugfix eol tags  https://review.opendev.org/c/openstack/ironic/+/87178721:56
TheJuliaahh, yeah, kilo is why this is ringing a bell in myead23:08
TheJuliamy head23:08
vanougood morning ironic23:54

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!