Wednesday, 2022-02-09

opendevreviewMerged openstack/openstack-zuul-jobs master: prepare-zanata-client: upgrade pip in venv  https://review.opendev.org/c/openstack/openstack-zuul-jobs/+/82821900:10
opendevreviewNeil Hanlon proposed openstack/project-config master: Add rockylinux-8 to nodepool configuration  https://review.opendev.org/c/openstack/project-config/+/82843500:32
*** dviroel|ruck|afk is now known as dviroel|ruck00:48
*** rlandy|ruck|bbl is now known as rlandy|ruck00:57
*** dviroel|ruck is now known as dviroel|ruck|out00:57
*** dviroel|ruck|out is now known as dviroel|out00:57
*** rlandy|ruck is now known as rlandy|out04:06
*** amoralej|off is now known as amoralej08:11
*** jpena|off is now known as jpena08:31
*** sshnaidm|afk is now known as sshnaidm08:54
*** ysandeep|out is now known as ysandeep09:01
*** mnasiadka_ is now known as mnasiadka09:18
*** akekane__ is now known as abhishekk09:26
*** rlandy|out is now known as rlandy|ruck11:06
*** dviroel|out is now known as dviroel|ruck11:10
*** jcapitao is now known as jcapitao_lunch11:50
*** ysandeep is now known as ysandeep|break12:41
*** amoralej is now known as amoralej|lunch13:07
*** ysandeep|break is now known as ysandeep13:13
*** dasm|off is now known as dasm13:17
*** jcapitao_lunch is now known as jcapitao13:31
*** amoralej|lunch is now known as amoralej13:59
*** akahat|rover is now known as akahat|PTO14:11
sean-k-mooneyclarkb: frickler  fungi  was there a zuul restart about 4 days ago14:53
sean-k-mooneyhttps://review.opendev.org/c/openstack/nova/+/79236214:53
sean-k-mooneythat has a +2 from zuul but it was never merged when its child merged 14:53
sean-k-mooney*parent14:53
sean-k-mooney+w didnt seam to be enough i can recheck it but just said i would ask if it was infra related or not before i did14:55
sean-k-mooneyhum either ye retriggered it or the second +w did but zuul is runnign the gate job again in anycase15:22
fungisean-k-mooney: doesn't look like it would be a zuul restart, zuul voted verified +2 at 22:56z on friday15:32
fungiit just didn't manage to tell gerrit to submit the change15:33
fungithe last gerrit restart was over a week ago, so probably not that either15:33
fungithe git parent of 792362,8 is 792356,7 but 792356,8 is what merged, so i don't think gerrit will let 792362 merge without a rebase15:39
fungihowever, i'm surprised zuul isn't pointing that out. i wonder if there's been a recent regression in zuul or gerrit, or if i'm just misremembering how zuul behaved in such cases15:40
fungiclarkb: ^ please check my memory there when you have a moment15:40
*** ysandeep is now known as ysandeep|out15:43
sean-k-mooneyfungi: well it shoudl create a merge commit right15:55
sean-k-mooneyassumign it can still apply15:55
sean-k-mooneylookign at the status page it passed all gate jobs agin15:55
sean-k-mooneyso its just waiting for the cinder jobs to finish that it was co gating with15:55
fricklergerrit used to give an indication about rebase needed, but maybe it no longer does with the mergeability check disabled15:56
sean-k-mooneyyes gerrit will indicate if a merge confict exists15:56
sean-k-mooneybut there isnt one in this case15:56
sean-k-mooneyfrickler: everything is green https://zuul.openstack.org/status#79236215:57
fungisean-k-mooney: it can't create a merge commit if the parent isn't in the tree15:57
sean-k-mooneyso zuul was clearly able to merge it with the tip of master15:57
fungithink about how git works15:57
fungigerrit can't, i mean15:58
fricklerzuul rebases automatically iiuc, gerrit doesn't15:58
sean-k-mooneythats a good point15:58
sean-k-mooneyya zuul was able to make it work bug i have not looked in the job to see what it did15:58
frickleryou might not even see it in the job, if the zuul-merger does it. the only indication would possibly be a different sha for your commit16:00
sean-k-mooneywhat gerrit/zuul effectivly are doign currently is ignoring the parent sicne the gerrit change is now merged in master and testing this patch as a patch againt master16:00
sean-k-mooneyhttps://zuul.opendev.org/t/openstack/build/018fde7499d446b9b2ba18c8e311e567/log/job-output.txt#316-32716:01
sean-k-mooneyHEAD is now at 283eea6919 Merge commit 'refs/changes/62/792362/8' of ssh://review.opendev.org:29418/openstack/nova into HEAD16:01
fungiif you `git review -d 792362` and then git log, you'll see the commit id for the parent is not in the master branch, so gerrit's going to refuse to merge it when asked16:02
frickleryeah, let's wait what happens when the cinder patches merge and zuul tries to submit this one16:02
sean-k-mooneyi think it will work but sure16:03
sean-k-mooneyill just rebase the patch if it fails or ping stephen to do the same16:03
fricklerseems zuul received an error from gerrit last time already https://paste.opendev.org/show/b6f1WE2hmpc3fNC65gHJ/16:10
fricklerbut that only shows up in the debug log. maybe zuul should note a comment about this in the change16:11
clarkbfungi: I think zuul never cared about that situation.16:16
clarkbfungi: all zuul checked was that you could merge into the target branch before running test and that you are theoretically mergable16:16
clarkbthen it checks actual ability to submit and if that fails it doesn't merge16:16
clarkbits possible zuul coudl do a better job reporting that16:16
fungiclarkb: i wonder why it considers that change "mergeable" when its parent isn't in the target branch. is it merging using the change refs from outside the branch instead?16:27
clarkbfungi: it merges change ref into target branch. If git can resolve that then its ok16:28
clarkbThen separately there is a "is this submittable" check but I believe that only happens after verified +2 is applied16:29
clarkb(I could be wrong about when that is submittable check happens but that should be what would catch it16:29
fungiyeah, i'm wondering how git "resolves" that, unless it uses the out-of-branch parents from the change refs16:30
clarkbThe you can only merge if your parent patchset is valid check is a gerrit thing. Zuul either needs to emulate that or rely on the is submittable check to tell it16:30
clarkbfungi: git yes it uses the out of branch parents from the chagne refs16:30
clarkbits just doing merge change xyz into master16:31
fungiokay, thanks16:31
clarkband that will merge everything under change xyz too16:31
clarkbIf there is a conflict it will fail16:31
clarkbwhich is probably more likely in the case of a parent patchset respin then in many other cases but not necessarily the case16:31
fungiso zuul can gate changes with parents which have alternative commits in the target branch already, as long as they don't merge-conflict with what did merge instead, but gerrit explicitly refuses to create such a merge commit itself16:32
clarkbcorrect16:32
clarkbbecause Gerrit is aware that it doesn't make sense in the context of its code review workflow16:33
fungiand if we had zuul pushing its merge commits instead of relying on gerrit to perform the merge, then that's what we'd get in the resulting repository branch state as well16:33
clarkbyes I think that is correct16:34
*** ralonsoh_ is now known as ralonsoh16:40
clarkbhrm even if zuul did the right things (whcih it may I'm not yet sure) there is a race here depending on when the parent change updates16:41
clarkbif zuul checks the is submittable check prior to starting gate jobs that may be true beacuse the parent is still valid. Then while the gate is running (whcih can take many hours) the parent can be updated making that check fail when zuul finishes gating16:41
clarkbI think that means even if we do everything possible to guard against the situation sean-k-mooney found it is still possible16:42
*** ykarel is now known as ykarel|away16:48
fungiyeah, however zuul could probably report an error in a separate review comment on the change after the submit call to gerrit fails16:51
clarkbyup16:52
fungidoesn't save it from wasting time sitting in the pipeline and running jobs, but at least there's a hint to the reviewers/author afterward16:52
*** jpena is now known as jpena|off17:27
clarkbdpawlik3: gmann: hey I'm trying to catch up on the ELK and health stuff. I'd like to start working to remove what I can now if we are ready to start on that.17:28
clarkbdpawlik3: gmann: I guess first major question is: can openstack use the opensearch based system now and the old ELK system can be turned off? or is there still work to be done? then for the health side I think my plan was to stop services and let them sit for a few days ebfore deleting the hosts and database entirely. Then work on retiring the infra side management17:29
clarkb(I'm flexible here, but I think we can make some progress on the opendev side now so want to make sure that doesn't get forgotten)17:29
fricklersean-k-mooney: seems you could rebase now17:44
frickler2022-02-09 16:52:02,455 DEBUG zuul.Pipeline.openstack.gate: [e: c7e9dfd1cfdd48319fc8f52e506061c7] <QueueItem db0f98a403b74131be6a1d7e14c521a5 for <Change 0x7f8b067b6280 openstack/nov17:44
fricklera 792362,8> in gate> is a failing item because ['it did not merge']17:44
gmannclarkb: thanks. about health dashbaord, I do not think we got any volunteer but let me check on qa channel  again. 17:46
sean-k-mooneyfrickler: huh ok i will zuul did +2 again17:58
sean-k-mooneyso we likely need to fix that and eitehr have zuul try to auto rebase the patch and merge again or set it in merge conflcit17:59
fungizuul reporting a comment on the change when it gets an error trying to submit to gerrit is probably the best option there18:02
sean-k-mooneyfungi: ya that would work18:02
fungii'd feel a bit weird about having zuul try to hit gerrit's rebase api method, and it's only a click away if that's how the author wants to solve things18:03
sean-k-mooneyya there is also the machine written "code" issues18:03
fungii definitely wouldn't want zuul to tell gerrit to rebase and then immediately merge the result, i've seen my share of horked-up rebases because git guesses wrong for where things should go18:03
sean-k-mooneytechnically zuul would have author the commit 18:03
sean-k-mooneyif we could have a comment when the submit failed that would be enough18:04
*** amoralej is now known as amoralej|off18:17
gmannclarkb: checked and we do not have any maintainer to fix code so ok to stop the service now and later we will retire the repo.18:42
gmannclarkb: for ELK status, I am not much following up on this, dpawlik3 can tell latest updates and plan.18:43
clarkbgmann: thanks for the followup18:46
*** timburke__ is now known as timburke20:54
opendevreviewJames E. Blair proposed openstack/project-config master: Add zuul-web stats to zuul-status page  https://review.opendev.org/c/openstack/project-config/+/82860921:02
opendevreviewJames E. Blair proposed openstack/project-config master: Add zuul-web stats to zuul-status page  https://review.opendev.org/c/openstack/project-config/+/82860921:03
*** dviroel|ruck is now known as dviroel|out22:33
opendevreviewMerged openstack/project-config master: Add zuul-web stats to zuul-status page  https://review.opendev.org/c/openstack/project-config/+/82860922:38
*** rlandy|ruck is now known as rlandy|out23:23

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!