Wednesday, 2022-12-07

*** swalladge is now known as Guest118803:12
*** yadnesh|away is now known as yadnesh04:43
*** akekane is now known as abhishekk04:48
dpawlikfungi: hey, I did not receive any email and in AWS console I don't see such option so probably I don't have permissions07:06
dpawlikfungi: I will check once again today, but I don't believe that I have such permissions07:06
*** yadnesh is now known as yadnesh|afk07:46
*** jpena|off is now known as jpena08:41
*** yadnesh|afk is now known as yadnesh08:49
opendevreviewJiri Podivin proposed openstack/project-config master: Releasing tripleo-ansible as PyPi deliverable  https://review.opendev.org/c/openstack/project-config/+/86683909:48
*** dviroel|biab is now known as dviroel11:14
*** rlandy|out is now known as rlandy|rover11:14
*** yadnesh is now known as yadnesh|afk11:50
*** d34dh0r5| is now known as d34dh0r5312:05
*** yadnesh|afk is now known as yadnesh12:34
*** frenzy_friday is now known as frenzy_friday|food13:09
*** akekane is now known as abhishekk13:56
*** dasm|off is now known as dasm14:43
*** frenzy_friday|food is now known as frenzy_friday15:34
clarkbdpawlik: fungi: I think the issue is you need to validate the email verification and that necessarily goes to an address under the domain?15:57
fungiyeah, ttx and i are working to figure it out15:57
dpawlikack15:58
*** dviroel is now known as dviroel|lunch16:15
*** yadnesh is now known as yadnesh|away17:14
*** dviroel|lunch is now known as dviroel17:16
ade_leefungi, clarkb -- got a couple of wip patches up -- does this look about right?  https://review.opendev.org/c/zuul/zuul-jobs/+/866881 and https://review.opendev.org/c/openstack/tempest/+/866882 ?17:17
ade_leeah, I guess not :/17:18
ade_leefungi, so I have to define the base fips job in project_config?17:19
fungiade_lee: the playbook which uses that secret will need to be in the same repository as the secret, yes17:21
ade_leefungi, gotcha - so I just need a playbook in project-config that I invoke elsewhere 17:22
fungiade_lee: well, a job definition in project-config will use a playbook in project-config for one of its phases (presumably pre-run in this case)17:23
fungibut then you can inherit from that job in other projects17:23
fungiand add the remaining logic outside project-config that way17:23
fungie.g. in openstack-zuul-jobs17:24
ade_leeack17:24
*** jpena is now known as jpena|off17:31
fungiade_lee: you presumably need just enough logic in the playbook to feed the token into the registration tool in ubuntu and clean up anywhere you may have temporarily written it in doing so17:33
fungiafter that, the inheriting job can likely take over, updating package lists and installing packages, et cetera17:33
fungihowever, you're not going to be able to rely on depends-on to try out the additions to project-config, that's going to have to be merged before zuul will allow it to be used by other jobs17:34
fungifor safety reasons17:35
ade_leefungi, gotcha 17:36
ade_leefungi, I was just thinking of having the playbook invoke the enable-fips role with the changes I specified above - but I can just have it add the token, and then call the enable_fips role later sans token17:40
ade_leeas long as we're sure the token will be added first17:40
fungiade_lee: yes, zuul playbook ordering for inheritance is onion layered, so if z inherits from y inherits from x then it will execute x:pre-run y:pre-run z:pre-reun z:run z:post-run y:post-run x:post-run in that order17:42
fungii.e. the grandparent of your job will have its pre-run playbooks executed before the parent's pre-run playbooks which in turn come before the child's pre-run playbooks17:43
ade_leefungi, ack ok17:43
fungior nesting doll order if you like17:44
fungiand yeah, if you can avoid calling enable-fips in the project-config job then you'll have more flexibility with depends-on testing of the fips parts17:45
fungibasically try to do as little in config projects as possible, in order to maximize your ability to leverage speculative execution when trying out changes to the rest of the job17:46
ade_leefungi, ok makes sense.  I'm looking now for an appropriate job in project-config to modify/clone17:48
ade_leefungi, I guess there isn't one really - we just need something super simple17:51
fungiade_lee: maybe propose-translation-updates though it's a more complex example, it does i think use the secret in pre-run (most of the others are used in run or post-run)17:52
fungier, update (singular) sorrt17:53
ade_leefungi, ack17:53
fungino, i guess it uses it in run too17:54
fungidpawlik: clarkb: so the process seems to be that the root account owner is notified of the upcoming cert expiration, then they click a button to send a renewal approval request to one of the role addresses for the domain (i.e. the hostmaster address for openstack.org), and then someone with access to that inbox needs to click a link in the message which takes them to a webpage where17:58
fungithey can click an approval button17:58
fungiso the main thing we're looking into is how to widen the set of people who get notified about the impending expiration17:58
fungiand also possibly to be able to trigger issuing the approval request17:59
clarkbI see and that would be smething in the amazon account settings?18:00
fungipresumably, but they're designed as a sort of behavioral psych experiment to see who's smart enough to navigate the maze before their certs expire18:01
zulhey guys have you seen this error before? starlingx seems to be hammered by this now https://zuul.opendev.org/t/openstack/build/7f0bb87e68df44a2b905870daee4809418:32
clarkbzul we updated our default nodeset to ubuntu jammy semi recently and python3.10's configparser is more particular about that aiui18:36
clarkboh though that is in ansible itself via a zuul module. That is interesting18:36
clarkboh but that module is simply parsing your tox config so its a side effect of the project too18:37
clarkbI think we need to identify the broken tox.ini file and fix it.18:39
zuli think starlingx is mostly busted right now18:39
clarkbwhat that module does is run `tox --showconfig` to get your configuration and then it parses that to find where the siblings are. Let me see what that looks like against starlingx/metal18:42
clarkbzul: https://pypi.org/project/tox/#history tox released 2 hours ago. Any chance this started within that time frame?18:43
zulpossibly i was made aware of it like 5 minutes ago18:44
clarkblooks like others are broken too, not just starlingx which is why I'm beginning to suspect that18:44
zulwe have our minversion set to 2.318:45
zulin starlingx/metal at least18:45
funginote that's minversion not a maximum18:46
fungimakes sure users have a new enough tox to parse the config (and gives them a useful error if they don't)18:46
zulbarbican seems to be hitting this as well18:47
clarkbzul: yes its widespread I think there is an issue between that ansible module which the tox jobs all use and the latest tox18:48
clarkbchecking old tox and new tox output locally for starlingx/metal the output is different and testenv:docs isn't even present in the new config18:49
clarkbeven though it is right there in the actual tox.ini file18:49
fungihttps://codesearch.opendev.org/?q=whitelist_externals18:49
fungisupport for that is removed in 4.0.0 according to the tox changelog, and seems to be heavily used by starlingx and others18:50
fungihttps://tox.wiki/en/latest/changelog.html18:50
clarkbfungi: I don't think that is it18:51
clarkbit seems to comment unused values effectively ignoring them in the --showconfig output. Removing whitelist_externals did not fix the docs env18:52
fungimaybe not, but it's also going to need to be cleaned up18:52
clarkbbut that does make me wonder if there is something we are doing in there that makes the testenv:docs env invalid so it doesn't show up18:52
zulits not just the testenv:docs thats failing apparently https://zuul.openstack.org/status#metal19:01
clarkbzul: ya my hunch is this has to do with coloring of output by default breaking parsing19:02
clarkbI'm working on a patch to test that19:02
clarkbzul: I think https://review.opendev.org/c/zuul/zuul-jobs/+/866926 will be self testing to see if that fixes at least some of this19:12
fricklerseems allowlist_externals also became stricter, see e.g. https://review.opendev.org/c/openstack/neutron-dynamic-routing/+/86692719:18
clarkbzul: ok the color thing doesn't seem to help. I've pushed https://review.opendev.org/c/zuul/zuul-jobs/+/866928 to try and pin tox and stem the bleeding then we'll need to followup and figure out how to make tox v4 work19:19
clarkbor maybe we should all just switch to nox (that would make siblings very difficult I think)19:19
zulack19:21
zuli guess we will need to recheck our jobs when this get merged?19:24
fungiyes19:25
fungiat least any that failed in the past two hours with that sort of error19:25
clarkbthe other issue is ensure-tox in zuul-jobs looks for locally installed tox before installing the pinned version I just set. It appears that it doesn't find a locally installed tox on our test nodes, but if it does my pin will be undone and we may need to update images too19:25
zulok cool19:26
*** dviroel is now known as dviroel|brb20:14
clarkbzul: I think things should be good now the pin has landed20:20
zulYep I just did a recheck and it passed20:22
fungiawesome, thanks for confirming!20:22
*** dviroel|brb is now known as dviroel|afk20:47
*** blarnath is now known as d34dh0r5321:23
opendevreviewJay Faulkner proposed openstack/project-config master: ironic-release group for releasing+maint of bugfix  https://review.opendev.org/c/openstack/project-config/+/86693721:29
fungiJayF: are the people in ironic-release also in ironic-stable-maint? because you're going to need to possibly be able to abandon open changes on branches before gerrit will allow you to delete them21:36
JayFfungi: I think ironic-stable-maint == ironic-core at this point21:37
fungigood enough21:37
JayFhttps://review.opendev.org/admin/groups/0c53b8f80897aa9e7cee7347e4710bd9b8bdfbd2,members21:37
JayFwe probably need to edit that to delete the individual members21:38
JayFI'm fairly sure, for instance, that jroll should not have core on that anymore21:38
fungii miss jroll21:40
JayFWe all do :( 21:40
JayFHe's downstream at Stripe nowadays AIUI21:41
opendevreviewJay Faulkner proposed openstack/project-config master: ironic-release group for releasing+maint of bugfix  https://review.opendev.org/c/openstack/project-config/+/86693722:09
*** dasm is now known as dasm|off22:11
*** rlandy|rover is now known as rlandy|out22:29

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!