Thursday, 2024-06-13

opendevreviewIan Wienand proposed opendev/glean master: testing: remove centos7 and 8  https://review.opendev.org/c/opendev/glean/+/92191106:29
opendevreviewIan Wienand proposed openstack/diskimage-builder master: Disabling CentOS Stream 8 jobs  https://review.opendev.org/c/openstack/diskimage-builder/+/92182306:42
opendevreviewArtem Goncharov proposed openstack/project-config master: Add publish openapi specs job  https://review.opendev.org/c/openstack/project-config/+/92193410:17
fricklerinfra-root: seems that gerrit is no longer setting the "attention-needed" flag on voting, which is kind of breaking my workflow12:26
*** tosky_ is now known as tosky12:28
fungifrickler: any idea when that changed? i guess between 3.8 and 3.9?12:36
fricklermust be pretty recent I think, might be related to the weird attention set UI look update that corvus mentioned yesterday. I can try to go through some changes in order to get some better bounds12:59
fungiokay, so it could be a bug in the 3.9 branch which came in with a more recent rebuild too13:00
fricklerhmm, actually I find that I'm not so sure anymore, might be 3.8 or even older. at least this is documented https://gerrit-review.googlesource.com/Documentation/user-attention-set.html#bots and the corresponding change I've found is from 2020, so it may have been a bug somehow. one thing I'm not sure about for example is how zuul gets identified as bot (or does it even?)13:27
fricklerah, it is classified as "members of the "Service Users" group", which zuul indirectly is13:31
fungioh, is your observation that zuul's votes don't set attention-needed?13:31
rpittaummm the dib-functests job is failing with a 404 in the fedora section but it looks like the image is there, is it a known issue?13:38
fungirpittau: i don't see a recent mention of anything in #openstack-dib at least, but i'll take a look at a failure and see if anything jumps out at me13:40
rpittauthanks fungi :)13:40
fungihttps://zuul.opendev.org/t/openstack/build/53f75080df214f559b5b9f5d4177f5d7/log/logs/fedora_build-succeeds.FAIL.log#30013:42
fungithere's an example13:42
fungiit's attempting to download https://download.fedoraproject.org/pub/fedora/linux/releases/37/Cloud/x86_64/images/Fedora-Cloud-Base-37-.x86_64.qcow213:42
fungihttps://na.edge.kernel.org/fedora/releases/37/README says "The contents of this directory have been moved to our archives"13:43
rpittauyay13:44
fungilooks like 39 is the oldest release still served13:44
fungiso probably dib needs to increase the minimum fedora version it's testing with13:44
rpittauremove F37 alongside CS8 then ?13:44
fungiyeah, that's what i'd do anyway13:44
rpittauok, I'll update my patch13:45
rpittauthanks again :)13:45
fungiyw13:45
fricklerfungi: (re: attention set) yes. I was pretty sure this did still happen some months ago at least, now I'm not so sure anymore13:45
fricklerlike my workflow was to trigger a recheck and then wait for the patch to show up again in the "needs attention" section once zuul has returned with fresh results13:46
fungigot it. i have finely-tuned mail filters for that purpose, so had never tried the gerrit feature13:46
fricklerwhen the attention-set feature came up, I was first annoyed by it, too. but finally I switched completely to using that and stopping getting any emails from gerrit13:47
fricklerbut now it seems gerrit maintainers have once again decided that this is not what they want me to do13:48
opendevreviewRiccardo Pittau proposed openstack/diskimage-builder master: Disabling CentOS Stream 8 and Fedora 37 jobs  https://review.opendev.org/c/openstack/diskimage-builder/+/92182313:50
fricklero.k., weird, now for https://review.opendev.org/c/openstack/requirements/+/921656 I was just added to the attention-set again, and the only update was from zuul14:34
fricklerand horizon just dropped py3.8 support, breaking reqs testing :-/14:38
fungiprobably a discussion for #openstack-tc but i thought previous experiences had indicated that decoupling the removal of testing and the introduction of requires_python bumps was necessary to avoid undue impact to integration testing14:53
fungiand to hold changes for requires_python until closer to the end of the release cycle14:54
* JayF would bet all of the money that whoever made that change was completely unaware of that conversation re: removing requires_python ever happening14:55
hasharfrickler: Zuul voted with a negative score and in this case the owner of the change (or the uploader if different than owner) is added back to the attention set. I guess cause CI failing requires your attention ;)14:58
hasharfrickler: ref with code: https://phabricator.wikimedia.org/T337648#888862714:58
hasharthat task was about Gerrit adding everyone to the attention set (back in Gerrit 3.7 maybe??)14:59
hasharunrelated, I have a patch to enable git to colorize the message banner emitted by Gerrit when one sends a patch for review.15:06
hasharhttps://review.opendev.org/c/opendev/git-review/+/914000 :)15:07
hasharhttps://phabricator.wikimedia.org/T359981 has a screenshot of the current state (no color)  and a comment below with a screenshot showing `SUCCESS` being colorized by the git client15:07
fricklerhashar: oh, so this really changed with our update to 3.9 and I was not misremembering, thx for the pointer. now we can start discussing whether we might want to revert that "fix" or make if configurable for our deployment15:13
clarkbI don't think we should carry local patches (I stuck to that with the local docs build stuff too which is why it didn't happen for us). THe ideal would be to upstream somethign to make it configurable or maybe even configurable by user?15:15
hasharfrickler: and potentially open a discussion with upstream. Though myabe that has changed again with 3.10 or a later version. It seems they keep iterating based on the feedback of their internal teams15:15
fungia user-specific option would probably be the best outcome15:15
fungiand yes, gerrit upstream seems to feel that they're developing a necessarily opinionated workflow tool rather than a bunch of workflow options for users to implement custom workflows on top of15:16
hasharpretty much yes15:19
hasharI can not blame them for enforcing a single workflow, that makes things easier in the long run15:20
fungiyeah, i'm not saying it's a good or bad thing, it's simply their choice as the maintainers of the software15:24
opendevreviewTony Breeds proposed opendev/zone-opendev.org master: Add new openmetal mirror  https://review.opendev.org/c/opendev/zone-opendev.org/+/92189515:54
opendevreviewMerged opendev/zone-opendev.org master: Add new openmetal mirror  https://review.opendev.org/c/opendev/zone-opendev.org/+/92189516:02
opendevreviewTony Breeds proposed opendev/system-config master: DNM: Initial dump or mediawiki role and config  https://review.opendev.org/c/opendev/system-config/+/92132217:38
tonybI'm not going to be able to verify 921896: Add openmetal mirror node to the inventory | https://review.opendev.org/c/opendev/system-config/+/921896 after the deploy/prod runs17:44
fungii can check it17:45
opendevreviewMerged opendev/system-config master: Add openmetal mirror node to the inventory  https://review.opendev.org/c/opendev/system-config/+/92189617:49
corvushi git-review people; in looking at the test results for https://6465d641e8d90881111c-e9283d1668aa96fc6a81b85ada542fce.ssl.cf5.rackcdn.com/921879/1/check/nox-py311-gerrit-default/f492a5f/testr_results.html which is from https://review.opendev.org/921879 i see that we have a test that verifies that the workflow "make a patch on master; download it; make a backport to stable; download it" is executed and the two download locations go to different18:15
corvuslocal branches that don't conflict18:15
corvusthe thing about that test is that the branch collision is avoided because by default the backport patch would get a different topic, and the topic is included in the local branch name for the download18:16
fungiyeah, i can see where that's problematic logic18:16
corvusit strikes me that is encoding a lot of workflow particulars in those local branch names.  and of course, it doesn't work if you have "notopic" set (and that change is attempting to make that the standard behavior)18:17
fungibut also maybe the underlying intent of that test was to make sure git-review is creating branches named after the topics18:17
corvuslet me get the local branch names real quick...18:17
corvusthe first download goes to review/administrator/I28fe02a53b773bcad5c6937a41182fc4e9544ab1 because it's the master branch and we don't set the topic on master branch changes; the second one goes to review/administrator/mybackport because the topic was mybackport.18:18
clarkbI dunno how much of that is workflow vs trying to avoid us needing to explain the reflog to people and relying on all the info present to create uniquish entries that also make sense in a git branch -a situation18:18
Guest8493I do think that was the underlying intent - even though that may not longer be a super helpful intent. I'd also argue the the non-topic behavior of just making a branch named after the change should be a fine behavior to do all the time - rather than sometimes change/XXX and sometimes topic18:19
clarkbgiven that statement maybe we should just put the 7digit sha prefix in there18:19
Guest8493wait - it's creating "I28fe02a53b773bcad5c6937a41182fc4e9544ab1" ?18:19
corvusfungi: it could be -- i sort of interpreted as wanting to ensure that a user could download both the master and backport branches of a change without having to delete local branches18:19
Guest8493when I do git review -d I get review/monty_taylor/92160518:19
Guest8493which totally makes sense18:20
JayFMonty you know your nick is Guest8493, right? :D 18:20
fungimight depend on the gerrit version18:20
clarkbGuest8493: oh ya that may be better than the changeid or sha prefix18:20
clarkbsince it is unique per change and ties back to something easily found18:20
fungii think gerrit recently changed how it reports back change identifiers?18:20
Guest8493JayF: I am, in fact, curious where that monty_taylor is coming from 18:20
corvusmordred: you're hitting the same code path; this test uses the gerrit change-id18:20
corvusmordred: so if you did `git-review -d I7112c8c58b3de204eb251cccb74642442ae053ee` you'd get what the test gets18:21
clarkbanyway my suggestion to address this would be to always use the change number for git review -d branch creation since we know those are unique ish (if you ahve two gerrit upstreams you may collide but otherwise it should be safe)18:21
corvus(i also assume this test was written when everyone thought the numbers would go away)18:21
Guest8493fascinating. I have literally never imagined using the Change-Id in git review -d :) 18:21
Guest8493ah - yes. that makes sense18:21
fungianyway, all this has got me thinking that the autotopic from branch name functionality sort of went hand-in-hand with the functionality to name local branches after the topics of retrieved changes18:21
corvusmordred: yeah, and if you do use the gerrit change id, you have to give the extra branch argument; so the second time this test runs the command it's `git-review -d I7112c8c58b3de204eb251cccb74642442ae053ee testbranch`18:22
fungiand that if we're turning off one we should probably turn off both18:22
Guest8493corvus: that seems harder. but - hey, TIL18:23
corvusso review/921605/01 ?  review/monty_taylor/921605/01 ?18:23
Guest8493I never get a local branch with a /01 - just 92160518:23
corvusyeah sorry, lemme splain18:23
fungiincluding the revision number in branch names is likely to cause confusion if those branches continue to get reused18:24
corvusthe current behavior will do review/author/something for the current patchset; and review/author/something-patch1 if you do git-review -d 921605,118:24
corvusso i was also jumping ahead to try to make that consistent18:25
corvusbut we can just leave the current behavior the way it is18:25
fungia common workflow for me is to git review -d some change, commit some edits, then git review the result. or even -d a base change and then -x to cherry-pick multiple other changes to stack on top of it (so at that point even the current topic-less behavior of using the change number gets muddled... guess i'm out of good ideas)18:25
corvusokay, so always including the patch number would be weird; we should just leave that the way it is for now18:27
fungii'm noticing that we also lack a feature to tell git-review -d what branch name we want it to create18:27
fungiso if you want to start a new topic branch from a change in gerrit, i guess the solution is to -d the change and then branch -m (or -M) it to your desired topic branch name18:28
fungii suppose that's straightforward enough that it doesn't need to be wrapped as a convenience in git-review18:29
Guest8493nod. gotit - I forgot about -d 921605,118:30
Guest8493I agree - I think keeping that behavior when the person explicitly is doing a revision seems sane18:30
Guest8493but I'm all about scrapping auto-topic - and branchname-from-topic18:30
Guest8493also - I am now no longer sure why author is in the branch name - fwiw18:30
Guest8493which I'm mostly noting is weird because I really don't know why monty_taylor is my author slug :)18:31
corvusyeah that wouldn't have been my guess :)18:31
Guest8493I vote for review/921605/01 in the new world order18:32
Guest8493and review/92160518:32
corvusi like that too, i'll propose that18:33
fungiagreed, i think if -d is given an explicit revision number then including it in the branch name is fine18:34
fungiif it's given an unqualified change number only, then including the revision number could be weird18:34
corvusreal bikeshed here: /01 or /1 ? :)18:35
corvusfor the patchset18:35
fungi /1 because there's no effective limit on the number of revisions in a change18:35
corvusprobably /1 i would think18:35
corvusyeah18:35
corvusfatal: cannot lock ref 'refs/heads/review/1/2': 'refs/heads/review/1' exists; cannot create 'refs/heads/review/1/2'18:36
fungiotherwise you have /01,..,/09,/10,...,/99,/100,...18:36
tonybyes please '/1'18:36
corvusi was not expecting that error18:37
corvusi guess that's why it was '-patch1' before18:37
fungiand now we know why we included the author?18:37
corvusno i think it was using '-patch1' for other patches that did that18:37
fungiohhh18:37
corvusi guess we should still do that18:37
fungiyeah never mind, "review" is not the name of a remote18:38
fungii was confused18:38
corvusyeah.... git-review is a little loose with the change/review terminology18:38
fungii have a feeling gerrit was too back when we made it18:39
corvusthese tests make my computer warm!18:43
corvushttps://imgur.com/screenshot-1rDvs9r18:43
corvusthat is really doing a good job maxing all the cores18:44
opendevreviewJames E. Blair proposed opendev/git-review master: Stop setting a default topic on new changes  https://review.opendev.org/c/opendev/git-review/+/92187918:45
corvusthat passes tests locally ^18:45
fungiyes, i was not a fan of the approach of "unit" testing git-review by spinning up a bunch of gerrits on your machine, but since i didn't have time to write the test harness for it, we got what was contributed by someone who did18:58
fungiwhich is still an improvement over the manual exercising we used to do with it, at least18:58
corvusi kinda dig it. :)19:14
AlbinVass[m]1I thought git review set the topic deliberately so you could easily merge a branch with submitwholetopic. Now I've never wanted it to do that so I use -Ta lot19:43
fungiAlbinVass[m]1: git-review's autotopic behavior pre-dates gerrit's submitwholetopic feature by about a decade19:45
fungitonyb: 921896 deployed successfully about 15 minutes ago19:46
fungiand http://mirror.iad3.openmetal.opendev.org/ has the expected content19:47
fungihttps is working fine too19:47
fungi[and there was much rejoicing]19:48
fungido we have a nodepool launcher config addition change up yet?19:49
funginot immediately spotting any19:49
tonybno we don't but feel free to create one19:50
tonybfungi: thanks for checking 19:51
fungiwill work on that in a sec19:51
tonybcool beans19:52
clarkbfungi: we need images first but ya not sure if we've got any changes for that yet19:55
fungioh, right need to add them to builder configs too for upload20:09
fungiis there any reason to split that into more than one config?20:09
clarkbfungi: I think you can do change 1 with both buildres and launchers and set max-servers to 0. Then maybe followup changes to actually put the provider into use20:09
clarkbthat way we can spot check things by manually booting images first and ensure glean works in that cloud20:10
fungifor launchers, should i associate it with nl02 like was done for the old "inmotion" environment?20:11
fungilooks like nl02 is currently providerless20:11
clarkbfungi: yes that launcher has no providers in it so we should add it there20:11
fungicool20:12
opendevreviewJeremy Stanley proposed openstack/project-config master: Add OnMetal to Nodepool and Grafana  https://review.opendev.org/c/openstack/project-config/+/92198720:29
fungii think that's ^ got it20:29
funginope, wrong cloud name20:30
* fungi sighs20:31
opendevreviewJeremy Stanley proposed openstack/project-config master: Add OpenMetal to Nodepool and Grafana  https://review.opendev.org/c/openstack/project-config/+/92198720:34
fungithat should be better20:34
clarkbthat looks good to me. One thing we should check while testing node boots is that we can direct attach the nodes to the external network as described in the clouds.yaml. I think this may happen automatically if we test node boots from a nodepool node and use the clouds.yaml there20:37
fungiyeah, i think the sdk is supposed to just figure that out from the config20:52
clarkbyup, but if we have the names wrong or if the cloud network stack has shifted and doesn't support it it will fail so we should check it before trying to launch nodes. Unless we just want nodepool to go for it and debug from there20:53
clarkbfungi: do we want to go aehad and land 921987 or wait for another review? My ability to keep an eye on stuff is quickly fading though21:33
Guest8493ohwow - I was just looking through other git-review patches and learned about git-worktree21:51
Guest8493and by wow - I mean - wow, git now supports the bzr workflow!21:51
corvusthat could be really handy for, say, someone who does a lot of running of unit tests on development branches and master :)22:01
fungiclarkb: i can self-approve and check in on it after it deploys to make sure images upload, though may not test booting a node tonight22:14
clarkbfungi: ya I think image uploads may be slow too as we do them serially now iirc22:15
fungiso just as well then22:15
clarkbcorvus: I've skimmed the zin stack really quickly and one thing that occurs to me (which may or may not be covered by the spec I can't recall) is wondering if cleaning out old nodepool images/labels will be more difficult with zuul's config checks22:26
clarkbtoday we can remoev stuff from nodepool and then let jobs fail when the ndoe doesn't exist. Are we going to not be able to do that without a force merge if jobs still rely on labels?22:27
corvusclarkb: i have 2 thoughts on that (and i think there's flexibility here):22:29
corvus1) i'm pretty sure the most strict path we could take would still let you define a label object but not use it in any provider.  so we can still remove labels from providers, but keep `label` entries until zero jobs reference it.  but if those jobs try to run, then they get a node error22:30
corvus2) a more lenient path would be not to syntax check that job labels exist in the system; that would be current behavior22:31
corvusi think neither one of those approaches removes our ability to remove images from providers22:31
clarkbok that makes sense and I agree that continues to enable us to clean up the important bits that consume many cpu cycles and gigabytes of disk22:32
corvusoption 1 sounds like more work, but it would pretty much make "label" objects behave like "nodeset" objects, which sort of makes sense.22:32
corvus(since that's how we use labels and nodesets in opendev; pretty much 1:1)22:32
clarkbya22:32
opendevreviewMerged openstack/project-config master: Add OpenMetal to Nodepool and Grafana  https://review.opendev.org/c/openstack/project-config/+/92198722:33
clarkbmostly I'm happy if we can somewhat decouple the lack of maintenance in projects from the maintenance of the CI system22:34
corvus++22:34
clarkbfungi: region iad3 is not valid needs to be IAD323:06
fungid'oh! so it did change...23:06
clarkbsorry I shoukld've cauight that as frickler pointed it out on earlier changes for clouds.yaml23:06
* fungi sighs23:06
clarkbyou can see the exceptions in the builder log if you are curiouis23:06
clarkband I really can't type this afternoon23:06
fungino worries, and thanks for spotting it!23:06
opendevreviewJeremy Stanley proposed openstack/project-config master: Correct OpenMetal region from iad3 to IAD3  https://review.opendev.org/c/openstack/project-config/+/92199123:09
fungiclarkb: tonyb: ^23:09
fungiif you have time23:09
clarkbdone23:10
fungithanks!23:10
opendevreviewMerged openstack/project-config master: Correct OpenMetal region from iad3 to IAD3  https://review.opendev.org/c/openstack/project-config/+/92199123:55

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!