Friday, 2022-05-06

opendevreviewIan Wienand proposed opendev/infra-openafs-deb master: [wip] make jammy packages  https://review.opendev.org/c/opendev/infra-openafs-deb/+/84078900:05
opendevreviewIan Wienand proposed opendev/infra-openafs-deb jammy: Build jammy packages  https://review.opendev.org/c/opendev/infra-openafs-deb/+/84079000:10
ianwfungi: just confirming that https://review.opendev.org/c/openstack/openstack-zuul-jobs/+/840788/3/roles/openafs-deb-package-build/tasks/main.yaml looks approximately like what you'd think00:21
ianwbasically each branch in infra-openafs-deb will build a suitable .orig file, and then openafs-deb-package-build will build and upload that package to the ppa00:23
ianwmake-orig.sh is the help that each branch will define in infra-openafs-deb; e.g. https://review.opendev.org/c/opendev/infra-openafs-deb/+/840790/1/make-orig.sh00:25
ianwi know that the debian/rules has a makefile target to pull the upstream source and repackage;  we can choose to use it if we're on a version not in the primary archive, i guess.  but the make-orig.sh script could sort that out00:26
ianwall the generic job cares is that there is a source to build from00:26
ianwhttps://zuul.opendev.org/t/openstack/build/51b8d18f382c4990bed676376b8d7a1d/logs is a jammy build using this00:27
opendevreviewIan Wienand proposed opendev/infra-openafs-deb master: Build for Xenial  https://review.opendev.org/c/opendev/infra-openafs-deb/+/84079101:14
opendevreviewIan Wienand proposed opendev/infra-openafs-deb xenial: Build for Xenial  https://review.opendev.org/c/opendev/infra-openafs-deb/+/84079201:15
opendevreviewIan Wienand proposed opendev/infra-openafs-deb xenial: Build for Xenial  https://review.opendev.org/c/opendev/infra-openafs-deb/+/84079201:19
*** rlandy|bbl is now known as rlandy|out01:23
opendevreviewIan Wienand proposed opendev/infra-openafs-deb bionic: Build for Bionic  https://review.opendev.org/c/opendev/infra-openafs-deb/+/84079401:35
opendevreviewIan Wienand proposed opendev/infra-openafs-deb focal: Build for Focal  https://review.opendev.org/c/opendev/infra-openafs-deb/+/84079501:37
opendevreviewIan Wienand proposed opendev/infra-openafs-deb jammy: Build jammy packages  https://review.opendev.org/c/opendev/infra-openafs-deb/+/84079001:40
opendevreviewBalendu Mouli Burla proposed openstack/project-config master: Add SRIOV FEC Operator app to StarlingX  https://review.opendev.org/c/openstack/project-config/+/84026302:26
opendevreviewOpenStack Proposal Bot proposed openstack/project-config master: Normalize projects.yaml  https://review.opendev.org/c/openstack/project-config/+/84079802:29
opendevreviewBalendu Mouli Burla proposed openstack/project-config master: Add SRIOV FEC Operator app to StarlingX  https://review.opendev.org/c/openstack/project-config/+/84026302:32
*** soniya29 is now known as soniya29|ruck02:50
opendevreviewIan Wienand proposed opendev/infra-openafs-deb jammy: Build jammy packages  https://review.opendev.org/c/opendev/infra-openafs-deb/+/84079002:53
opendevreviewMerged opendev/infra-openafs-deb jammy: Build jammy packages  https://review.opendev.org/c/opendev/infra-openafs-deb/+/84079003:13
ianwohhhh, i guess because the promote uses a secret, we need to use a config project to do the promote job03:31
opendevreviewIan Wienand proposed openstack/project-config master: opendev/infra-openafs-deb : add promote job  https://review.opendev.org/c/openstack/project-config/+/84080603:35
opendevreviewIan Wienand proposed opendev/infra-openafs-deb jammy: Run promote job from project-config  https://review.opendev.org/c/opendev/infra-openafs-deb/+/84080703:37
opendevreviewIan Wienand proposed openstack/project-config master: opendev/infra-openafs-deb : add promote job  https://review.opendev.org/c/openstack/project-config/+/84080603:45
opendevreviewMerged openstack/project-config master: opendev/infra-openafs-deb : add promote job  https://review.opendev.org/c/openstack/project-config/+/84080604:05
opendevreviewIan Wienand proposed opendev/infra-openafs-deb jammy: Run promote job from project-config  https://review.opendev.org/c/opendev/infra-openafs-deb/+/84080704:07
opendevreviewIan Wienand proposed opendev/infra-openafs-deb jammy: Run promote job from project-config  https://review.opendev.org/c/opendev/infra-openafs-deb/+/84080704:18
opendevreviewIan Wienand proposed opendev/infra-openafs-deb jammy: Run promote job from project-config  https://review.opendev.org/c/opendev/infra-openafs-deb/+/84080704:20
opendevreviewIan Wienand proposed opendev/infra-openafs-deb jammy: Run promote job from project-config  https://review.opendev.org/c/opendev/infra-openafs-deb/+/84080704:29
*** ysandeep|out is now known as ysandeep04:43
*** ysandeep is now known as ysandeep|rover04:43
*** elodilles is now known as elodilles_pto04:59
opendevreviewIan Wienand proposed openstack/project-config master: infra-openafs-deb: run jobs on !master branch  https://review.opendev.org/c/openstack/project-config/+/84081505:58
opendevreviewMerged openstack/project-config master: infra-openafs-deb: run jobs on !master branch  https://review.opendev.org/c/openstack/project-config/+/84081506:21
opendevreviewIan Wienand proposed opendev/infra-openafs-deb master: Add readme to master branch  https://review.opendev.org/c/opendev/infra-openafs-deb/+/84081706:27
opendevreviewIan Wienand proposed opendev/infra-openafs-deb jammy: Run promote job from project-config  https://review.opendev.org/c/opendev/infra-openafs-deb/+/84080706:29
opendevreviewIan Wienand proposed openstack/project-config master: infra-openafs-deb: run noop on master branch  https://review.opendev.org/c/openstack/project-config/+/84081806:40
opendevreviewIan Wienand proposed opendev/infra-openafs-deb master: Testing  https://review.opendev.org/c/opendev/infra-openafs-deb/+/84081906:43
opendevreviewIan Wienand proposed opendev/infra-openafs-deb trusty: Testing  https://review.opendev.org/c/opendev/infra-openafs-deb/+/84082006:44
opendevreviewIan Wienand proposed opendev/infra-openafs-deb jammy: try debug  https://review.opendev.org/c/opendev/infra-openafs-deb/+/84082106:49
opendevreviewMerged openstack/project-config master: infra-openafs-deb: run noop on master branch  https://review.opendev.org/c/openstack/project-config/+/84081806:56
opendevreviewMerged opendev/infra-openafs-deb master: Add readme to master branch  https://review.opendev.org/c/opendev/infra-openafs-deb/+/84081707:00
*** jpena|off is now known as jpena07:01
opendevreviewIan Wienand proposed openstack/project-config master: Revert "Temporarly disable linaro-us"  https://review.opendev.org/c/openstack/project-config/+/84082407:03
opendevreviewCedric Jeanneret proposed openstack/diskimage-builder master: Ensure cloud-init is configured to generated host keys  https://review.opendev.org/c/openstack/diskimage-builder/+/84082507:23
opendevreviewMerged opendev/infra-openafs-deb jammy: Run promote job from project-config  https://review.opendev.org/c/opendev/infra-openafs-deb/+/84080707:40
opendevreviewIan Wienand proposed opendev/infra-openafs-deb bionic: Build for Bionic  https://review.opendev.org/c/opendev/infra-openafs-deb/+/84079407:52
opendevreviewIan Wienand proposed opendev/infra-openafs-deb focal: Build for Focal  https://review.opendev.org/c/opendev/infra-openafs-deb/+/84079507:53
opendevreviewIan Wienand proposed opendev/infra-openafs-deb xenial: Build for Xenial  https://review.opendev.org/c/opendev/infra-openafs-deb/+/84079207:54
opendevreviewIan Wienand proposed opendev/infra-openafs-deb trusty: Build for Trusty  https://review.opendev.org/c/opendev/infra-openafs-deb/+/84082708:02
opendevreviewMerged opendev/infra-openafs-deb bionic: Build for Bionic  https://review.opendev.org/c/opendev/infra-openafs-deb/+/84079408:03
opendevreviewMerged opendev/infra-openafs-deb xenial: Build for Xenial  https://review.opendev.org/c/opendev/infra-openafs-deb/+/84079208:06
opendevreviewMerged opendev/infra-openafs-deb focal: Build for Focal  https://review.opendev.org/c/opendev/infra-openafs-deb/+/84079508:12
opendevreviewMerged opendev/infra-openafs-deb trusty: Build for Trusty  https://review.opendev.org/c/opendev/infra-openafs-deb/+/84082708:15
*** ysandeep|rover is now known as ysandeep|rover|lunch08:20
*** soniya29|ruck is now known as soniya29|ruck|lunch08:36
opendevreviewMerged openstack/project-config master: Revert "Temporarly disable linaro-us"  https://review.opendev.org/c/openstack/project-config/+/84082408:39
fricklerkevinz: if you are around, according to grafana we still have 45 nodes in "deleting" state, can you please check? I can get more details from the log if needed08:46
*** ysandeep|rover|lunch is now known as ysandeep|rover08:59
*** soniya29|ruck|lunch is now known as soniya29|ruck09:09
opendevreviewCedric Jeanneret proposed openstack/diskimage-builder master: Ensure cloud-init is configured to generated host keys  https://review.opendev.org/c/openstack/diskimage-builder/+/84082509:11
fricklerhmm, nl03 config seems broken since yesterday. KeyError: 'ubuntu-jammy-arm64'09:14
fricklermissed to add it to diskimages here https://review.opendev.org/c/openstack/project-config/+/840394/1/nodepool/nl03.opendev.org.yaml09:15
opendevreviewDr. Jens Harbott proposed openstack/project-config master: Fix config error for nl03  https://review.opendev.org/c/openstack/project-config/+/84084909:17
tweiningHello. I saw there is no openstack-tox-functional-py310 job defined yet in https://docs.openstack.org/infra/openstack-zuul-jobs/jobs.html#job-openstack-tox-functional-py39. I'd like to propose to add it there.09:17
*** artom__ is now known as artom09:17
tweiningah, I think I found the Git repo for it.09:18
tweining... and of course it has been proposed already in https://review.opendev.org/c/openstack/openstack-zuul-jobs/+/840785. sorry for the noise.09:21
opendevreviewMerged openstack/project-config master: Fix config error for nl03  https://review.opendev.org/c/openstack/project-config/+/84084909:35
fricklerthe servers in linaro-us are all in status "BUILD" and if I try to show details for one of them, there's a 404 response, likely some cell database cleanup needed09:59
*** rlandy|out is now known as rlandy10:21
opendevreviewIan Wienand proposed opendev/infra-openafs-deb trusty: Trusty updates  https://review.opendev.org/c/opendev/infra-openafs-deb/+/84086010:45
ianwfrickler: ahh, i thought i saw it empty :/  have they come back and not started to build?10:46
ianwi've replied to kevinz10:50
fricklerianw: just out of curiosity, where are you talking to kevinz?10:57
ianwfrickler: via email, infra-root cc'd10:57
opendevreviewMerged opendev/infra-openafs-deb trusty: Trusty updates  https://review.opendev.org/c/opendev/infra-openafs-deb/+/84086011:01
opendevreviewIan Wienand proposed opendev/infra-openafs-deb trusty: Use 1.8.5 for Trusty  https://review.opendev.org/c/opendev/infra-openafs-deb/+/84086111:15
*** dviroel|out is now known as dviroel11:35
opendevreviewIan Wienand proposed opendev/infra-openafs-deb trusty: Retrigger trusty upload  https://review.opendev.org/c/opendev/infra-openafs-deb/+/84086611:40
opendevreviewIan Wienand proposed opendev/infra-openafs-deb trusty: Drop libroken patch  https://review.opendev.org/c/opendev/infra-openafs-deb/+/84086611:47
*** soniya29|ruck is now known as soniya29|ruck|afk11:49
*** ysandeep|rover is now known as ysandeep|afk11:56
*** soniya is now known as soniya|ruck|afk11:57
*** pojadhav is now known as pojadhav|break11:58
opendevreviewIan Wienand proposed opendev/infra-openafs-deb trusty: Drop libroken patch  https://review.opendev.org/c/opendev/infra-openafs-deb/+/84086612:03
opendevreviewMerged opendev/infra-openafs-deb trusty: Drop libroken patch  https://review.opendev.org/c/opendev/infra-openafs-deb/+/84086612:22
fungitweining: and 840785 has merged now, so you can proceed to call openstack-tox-functional-py310 where needed12:22
tweiningthanks12:22
*** pojadhav|break is now known as pojadhav12:29
*** ysandeep|afk is now known as ysandeep|rover12:42
*** soniya|ruck|afk is now known as soniya|ruck13:43
*** pojadhav is now known as pojadhav|afk13:57
opendevreviewsean mooney proposed openstack/project-config master: update Review-Priority lable for nova related projects  https://review.opendev.org/c/openstack/project-config/+/83759513:59
opendevreviewsean mooney proposed openstack/project-config master: update Review-Priority label for nova related projects  https://review.opendev.org/c/openstack/project-config/+/83759514:00
opendevreviewMerged opendev/irc-meetings master: Schedule Blazar meeting one hour earlier  https://review.opendev.org/c/opendev/irc-meetings/+/84070814:32
*** ysandeep|rover is now known as ysandeep|out14:58
*** ysandeep|out is now known as ysandeep14:58
clarkbfrickler: thank you for debugging that arm64 image problem. That was my fault15:15
*** ysandeep is now known as ysandeep|out15:18
*** dviroel is now known as dviroel|lunch15:40
opendevreviewClark Boylan proposed opendev/system-config master: Update etherpad to 1.8.18  https://review.opendev.org/c/opendev/system-config/+/84095516:10
clarkbthey actually published new 1.8.18 images quickyl this time. But I'd like to see that be consistent before we drop the copied Dockerfile in system-config again16:10
clarkbTheJulia: nodes are being reclaimed now. Thanks!16:11
clarkbI'm going to do irc client maintenance again. I'll likely pop out for a bit while that is running16:13
*** jpena is now known as jpena|off16:29
*** dviroel|lunch is now known as dviroel16:42
TheJuliaClark[m]: thanks17:19
TheJuliaerr, clarkb17:20
TheJuliaout of curiosity, does anyone know where the zuul ansible roles used by openstack projects can be located17:20
TheJulia?17:20
TheJuliaThey don't seem to come up in codesearch.opendev.org17:20
TheJuliaspecifically hunting for setup-stack-user17:22
fungiTheJulia: that's because codesearch indexes file content, and you're looking for a directory name17:22
fungii'm seeing if there's a way to coerce codesearch into returning that17:24
fungithough i may have crashed it instead :/17:24
TheJuliayeah... I was kind of hoping maybe it was noted in a in-repo documentation file or something someplace17:25
TheJuliabut no dice17:25
TheJuliafungi: \o/17:25
fungiTheJulia: anyway, i happen to recognize that particular one is at https://opendev.org/openstack/devstack/src/branch/master/roles/setup-stack-user17:26
TheJuliadoh, I looked for a roles folder, just not in the right place17:27
TheJuliahmm... then the question is... what does ssh key management17:27
* TheJulia may be in the process of loosing her mind due to grenade17:28
fungiTheJulia: if you have an example build result, you can check the console view to get an idea from the task names17:29
TheJuliaDidn't see the filename logged, but worth trying again17:29
fungiTheJulia: you're asking specifically about the add-build-sshkey role called from opendev.org/opendev/base-jobs/playbooks/base/pre.yaml or something else?17:31
clarkbTheJulia: I think it depends on what ssh keys you ar etalking about17:31
clarkbtempest and devstack will manage the stack user's key(s) and zuul has keys it uses to ru nthe job17:32
TheJuliazuul-build-sshkey is the comment on the key... hmm17:32
TheJuliaalthough, that may explain why with grenade things just go utterly sideways17:33
clarkbthat will be the key that zuul uses to ssh into the node I think17:33
clarkbthough if this is a multinode job there is another set of zuul keys to ssh between the nodes and it could be that (i don't recall specifically how each are commented)17:34
fungiTheJulia: if you're looking at a build result, there's a "view job documentation" link in the top-right of the screen which will take you to some job metadata which includes a list of the repos where it used roles from, so that at least allows you to narrow your search through git ls-files at least17:34
fungithough you'll probably want to look at the same field for the parent jobs linked from it as well17:35
TheJuliayeah, already dug down through all of that...17:35
TheJuliaI'm basically at a loss why the file doesn't exist when we expect it in one case17:35
fungianyway, i think you're referring to the ssh key created by https://opendev.org/zuul/zuul-jobs/src/branch/master/roles/add-build-sshkey17:36
TheJuliayup, looking at it17:36
fungiat least a codesearch for the key comment does turn up that role17:39
*** soniya|ruck is now known as soniya|out17:39
clarkboh looks like the thing that configures keys for zuul itself also configures ssh between all the nodes. I thought they were distinct keys17:40
TheJulianope, its the same key... but what I'm finding absolutely bizzar is in one job I can find /opt/stack/.ssh/id_rsa, another just slightly different chain with grenade can't find it17:41
TheJuliawhich may, or may not, be why I'm loosing  my mind17:41
clarkbanything in /opt/stack is probably configured by devstack and/or grenade17:41
TheJuliathats what I would have thought17:41
* TheJulia wonders if devstack just copies ~zuul to ~stack17:42
clarkbya devstack runs copy-build-sshkey to do that looks like17:43
TheJuliagah17:43
clarkbin devstack/roles/orchestrate-devstack/tasks/main.yaml17:43
* TheJulia goes and checks the lunch pizza dough beforegoing down the next rabbithole17:44
clarkbTheJulia: grenade runs orchestrate-devstack which should do the copy. Is it possible you're on a very old branch and using devstack-gate or something like that?17:52
TheJuliayoga, so... not very old17:55
TheJuliabut I don't see the second step running17:55
fungiyoga shouldn't be using d-g at least17:56
TheJuliano, it appears to run the role17:56
opendevreviewClark Boylan proposed opendev/system-config master: DNM force etherpad failure to hold node  https://review.opendev.org/c/opendev/system-config/+/84097217:56
TheJulia"Setup devstack on sub-nodes" appears not to trigger.. or even get logged...17:57
* TheJulia pulls down the entire log to grep just to be sure17:57
TheJuliahmm, block is not logged, but it looks like the subtask is run17:58
clarkbinfra-root I've put a hold in place for 840972 so that we can check the etherpad upgrade before upgrading it17:59
TheJuliaoh! thats why our job doesn't work18:02
TheJuliawell, the original code18:02
TheJuliabecause the ssh key is not copied *unless* it is a multinode job18:03
TheJuliaand it is copied after devstack runs18:03
TheJuliawhich is why I cna login, find it on a node, but when devstack runs, nothing is found18:03
clarkbah its the subnode in groups check I think since controller is always in th ehosts18:04
TheJuliaand the controller is always first, and that is what checks/needs the key in our case18:06
TheJuliaI guess we could special case to extract the zuul key for our nefarious testing purposes18:07
fungiit wouldn't allow anythign especially nefarious, as it's generated specifically for that build and then discarded18:12
fungiso really, feel free to do anything you like with the key within the scope of the build (it will be entirely useless outside that build)18:12
clarkbin our jobs that need keys we tend to generate new ones. But one reason for that is thing slike gerrit not liking rsa18:13
TheJuliain this case, we have a job which needs to be able to ssh to the subnodes to tweak ovs settings for simulation testing18:14
TheJuliaas if your re-plugging physical ports on a switch18:14
clarkband I gues ansible has handed over control by then?18:17
clarkbfedora was apparently talking aout removing bios support in 37. They have decided not to do that. I wonder when we won't be able to fedora anymore simply due tothat18:26
fungiwe've been able to boot via uefi for some images already, right?18:29
clarkbonly arm6418:29
clarkbit requires the cloud to support it and I'm sure those are in the minority today18:30
fungithough we did it there because it was required18:30
clarkbyes18:30
*** dviroel is now known as dviroel|afk20:11
ianwfungi/clarkb: one thing about a 30+ year old code base is that with a few tweaks it builds from trusty->jammy :) https://launchpad.net/~openstack-ci-core/+archive/ubuntu/openafs-deb-test/+packages20:40
ianwtry that with your node.js or go thing :)20:41
clarkbha20:42
clarkb173.231.255.168 as etherpad.opendev.org is the held node. clarkb-test2 is my test pad21:01
clarkbit seems to be working if we can get testers for that maybe we upgrade monday21:02
clarkbyou have to use /etc/hosts to override due to the built in redirect. Also, firefox doesn't seem to be able to view the self signed cert there. Chrome can. Not the first time FF's cert viewer breaks due to something it is overly strict about21:02
fungiseems to be working for me21:18
*** dviroel|afk is now known as dviroel23:53
*** dviroel is now known as dviroel|out23:56

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!