Tuesday, 2021-08-31

ianwfungi: ahh, ok, sorry yeah it made a bit more sense when i kept reading on :)00:00
ianwyeah that next change error is weird00:00
ianw No section: 'testenv:linters'00:01
fungiright, i tink it's getting a tox_extra_args which is being set in the previous playbook. maybe it's possible to clear it or scope it to that playbook?00:02
ianwit would probably help to debug dump the entire arguments passed, i don't think we can get that any other way00:05
fungioh, good point00:08
mordredmnaser: yikes. Travelling is hard!00:13
mordredmnaser: Tldr buster to bullseye upgrade ... And also an update to fix arm00:14
mnasermordred: I thought wearing a mask for a whole day is hard. Wearing one in a flight for 6 hours gives me a whole another level of respect for folks who have to do that (and grateful for us who don’t need to)00:14
mordredThere's buster and bullseye tags now to facilitate upgrade00:14
mordredmnaser: ++ yah00:14
mnasermordred: oh cool, I haven’t dabbled much in building images, I will dig into it a little bit later and see how that works00:14
mordredI've done one flight. It's bonkers00:14
mnaserHope you’re staying safe too btw :)00:14
mnaserYeah, 6 hours here (I’m in sfo)00:15
mordredHeck yes ... Evacuated to Panama City Beach Florida :)00:15
* mordred returns to walking on the beach with a drink00:16
corvusfungi, ianw: fungi asked for help in #zuul and i responded.... did you see that response?00:27
fungicorvus: not yet, i'm at a different computer at the moment but i'll check the one i've got matrix on in a few, thanks!00:34
opendevreviewIan Wienand proposed openstack/diskimage-builder master: [dnm] testing ubuntu builds  https://review.opendev.org/c/openstack/diskimage-builder/+/80666001:56
opendevreviewIan Wienand proposed openstack/diskimage-builder master: [dnm] testing ubuntu builds  https://review.opendev.org/c/openstack/diskimage-builder/+/80666003:16
opendevreviewIan Wienand proposed openstack/diskimage-builder master: [dnm] testing ubuntu builds  https://review.opendev.org/c/openstack/diskimage-builder/+/80666006:04
opendevreviewMerged zuul/zuul-jobs master: ensure-podman: enable testing of centos-8-stream  https://review.opendev.org/c/zuul/zuul-jobs/+/80543306:05
opendevreviewMerged zuul/zuul-jobs master: ensure-docker: enable centos-8-stream testing  https://review.opendev.org/c/zuul/zuul-jobs/+/80543206:05
*** ysandeep|away is now known as ysandeep06:12
*** jpena|off is now known as jpena07:51
*** ysandeep is now known as ysandeep|lunch08:10
*** ysandeep|lunch is now known as ysandeep09:03
*** bhagyashris_ is now known as bhagyashris10:07
*** ysandeep is now known as ysandeep|afk11:01
*** jpena is now known as jpena|lunch11:38
*** ysandeep|afk is now known as ysandeep11:58
opendevreviewMerged openstack/project-config master: Add os-vif-core to stable maintainers  https://review.opendev.org/c/openstack/project-config/+/79807112:10
mazzyfungi, mordred: so guys i was able to make an element with flatcar but not yet in fully. with root.d i've designed a script to fetch flatcar sdk. the thing is that from what I've understood dib create an image from the content of chroot. however in my case the image that has to be created is just in a folder inside the chroot but it is not the12:40
mazzyentire chroot. take a look at here https://kinvolk.io/docs/flatcar-container-linux/latest/reference/developer-guides/sdk-modifying-flatcar/#create-the-flatcar-container-linux-os-image12:40
*** jpena|lunch is now known as jpena12:41
opendevreviewArx Cruz proposed opendev/elastic-recheck rdo: Updates for docker and frontpage of elastic-recheck  https://review.opendev.org/c/opendev/elastic-recheck/+/80673912:57
*** ysandeep is now known as ysandeep|afk14:31
clarkbfungi: do you know if my test kata list server got delete? if that hasn't been done I can do that this morning14:47
fungii don't think it's been deleted yet, i didn't want to clean it up until i could confirm with you14:47
clarkbfungi: I think the upgrade went well from what I have seen and have no other reason to keep the test server around unless you can think of something to check for lists.o.o there14:48
fungiyeah, all clear in my opinion14:49
clarkbok I've put that on my todo list for this morning after meetings and getting the opendev team meeting agenda out14:49
clarkbinfra-root it looks like the zuul changes to update how zk secrets are managed have landed. https://review.opendev.org/c/opendev/system-config/+/803992 is our change to accomodate that in opendev. I suspect zuul hasn't been restarted with those changes yet which means we probably don't want to land that chagne yet but reviews would be good15:42
corvusclarkb: i think we're safe to land it now; presumably the new image has deployed and the commands are available.  nothing in ZK changes, we just stop reading stuff in from disk (and that will take effect when we do restart).15:44
*** jpena is now known as jpena|off16:02
*** ysandeep|afk is now known as ysandeep16:05
clarkbcorvus: I think because I'm using docker exec things will fail until we update the running images, but that is probably ok as well16:13
clarkbagreed that we should be able to land that now and it will start functioning when the zuul installation is updated16:14
corvusclarkb: oh right sorry.  agreed.16:15
opendevreviewJeremy Stanley proposed zuul/zuul-jobs master: Add tox_config_file rolevar to tox  https://review.opendev.org/c/zuul/zuul-jobs/+/80661316:15
opendevreviewJeremy Stanley proposed zuul/zuul-jobs master: Support verbose showconfig in tox siblings  https://review.opendev.org/c/zuul/zuul-jobs/+/80662116:15
opendevreviewJeremy Stanley proposed zuul/zuul-jobs master: Include tox_extra_args in tox siblings tasks  https://review.opendev.org/c/zuul/zuul-jobs/+/80661216:15
clarkbfungi: if you get a chance can you confirm clarkb-test-lists.kc.io b36e34f3-8c8c-4808-8320-c58ddd4ccd80 is the instance to delete?16:19
fungib36e34f3-8c8c-4808-8320-c58ddd4ccd80 is what i see for clarkb-test-lists.kc.io16:21
clarkbalright deleting it now16:21
fungisome autoheld nodes for lists upgrade testing16:22
fungiyou've also got, i mean16:22
fungia 3-node group for 79403616:22
clarkbfungi: if you don't think there is anymore testing we can/should do with those then we can delete them as well (the autohold removal will do that for us)16:23
clarkbfungi: I can do that if you confirm there isn't any other testing/checking you want to do with them16:23
fungii don't know of anything else we were going to try there, but i was mainly just making sure you knew they were still held16:23
clarkbyup I'm aware. I think I have a gitea held as well taht can be cleaned up as waiting for 1.15.1 seems like a good idea (the mysql fix did appear to land)16:24
clarkbfungi: I'll remove those two autoholds now16:25
clarkbmnaser: I'll also remove your autohold for loci keystone as it never hit anything16:26
clarkbI assume that means it got sorted out separtely. If not we can add a new hold16:26
mnaserclarkb: yes, nothing merged since then but it works now.. who knows16:51
mnaseri will Ask for another one if I am troubleshooting this later16:51
clarkbmnaser: sounds good16:51
*** dviroel|out is now known as dviroel|ruck16:54
opendevreviewJeremy Stanley proposed zuul/zuul-jobs master: Support verbose showconfig in tox siblings  https://review.opendev.org/c/zuul/zuul-jobs/+/80662117:15
opendevreviewJeremy Stanley proposed zuul/zuul-jobs master: Include tox_extra_args in tox siblings tasks  https://review.opendev.org/c/zuul/zuul-jobs/+/80661217:15
*** ysandeep is now known as ysandeep|away17:54
clarkbinfra-root service-nodepool failed in the hourly deploy jobs because nb03 is unreachable. I suspect we need to force restart it or similar, but before I dig in would it be better to fix up the nodepool image stuff or are we happy with that situation now?18:23
clarkbconnection reset by peer is the error I get trying to ssh18:24
funginb03 is the arm64 builder?18:25
clarkb INFO: task jbd2/dm-3-8:480 blocked for more than 120 seconds. <- seems like it has sad disks?18:25
clarkbfungi: yes18:25
clarkbthe console log also shows dracut is sad18:25
fungiyeah, that does look like it may have lost contact with the storage somehow18:25
fungiif it's iscsi then could be a network blip18:25
fungihard to know since we don't have insight into how the storage is attached18:26
clarkbI'm not sure what backs it18:26
fungithough it could also be cpu, the jbd2 kernel threads wake up a lot and would be more likely to show up as blocked when there's cpu starvation on the host18:27
fungiif it's really lost contact with storage, you'll usually also see scsi timeouts or similar logged for the corresponding block devices18:28
fungiand messages about switching the filesystems on them to read-only18:28
opendevreviewMathieu Gagné proposed openstack/project-config master: INAP mtl01 region is now owned by iWeb  https://review.opendev.org/c/openstack/project-config/+/80678818:30
clarkbShould I go ahead and ask openstack to reboot it? or wait on nodepool images or perhaps bring it up with kevinz ?18:30
fungipresmably kevinz has logs on the host side anyway. if you reboot it, we can check syslog to see roughly when it seems to have gotten stuck18:31
fungiwhat nodepool images are you talking about waiting on?18:32
clarkbmgagne: left a note on ^ about how I think we need to add the new name in, then wind down the old name.18:34
clarkbotherwise we might have a mess to cleanup with orphaned resources in nodepool. Let us know if you'd like one of us to push newer patchests or if you'd prefer to do it18:34
mgagneI agree with your comments, I'll look into it.18:35
fungiyeah, ignore my review comment, it's basically the same thing clarkb said18:35
clarkbfungi: the docker images which have given us trouble recently18:35
fungiclarkb: oh, wait on new nodepool software containers to be published to dockerhub so we can deploy and boot onto those?18:36
fungis/boot/docker-compose up/18:36
fungiwe'd need to reboot the server anyway before we can deploy a new container image onto it, right?18:37
clarkbfungi: ya as I'm not sure if this may have been caused by sad docker images. I don't know if we've updated them since we half reverted18:37
clarkbfungi: we do but that will start the docker container back up again aiui18:37
fungiright but that's going to happen either way, right? unless we delete the server entirely and build a new one, or rescue boot it so we can disable services on the filesystem18:38
clarkbya thats true I guess. We'd have to rescue boot it and stop the container from starting on boot18:38
clarkbif that was the issue18:38
clarkbI'll reboot it now18:38
fungisounds as good as anything18:41
fungii'll hop on and look at logs once it's up18:41
clarkbits up. Looks like the nodepool-builder image is older and should be fine18:42
clarkbI guess we probably didn't succeed in testing with the sad images? I didn't know if that was the case but seems to be18:42
fungithere's a gap in the syslog from Aug 29 17:33:20 to Aug 31 03:42:2418:43
mgagneclarkb: should I take care of the system-config update or will one of you do it?18:43
opendevreviewMathieu Gagné proposed openstack/project-config master: INAP mtl01 region is now owned by iWeb  https://review.opendev.org/c/openstack/project-config/+/80679118:44
opendevreviewMathieu Gagné proposed openstack/project-config master: INAP mtl01 region is now owned by iWeb  https://review.opendev.org/c/openstack/project-config/+/80678818:44
clarkbmgagne: I can do it if you prefer18:45
fungimost reccent log entry prior to the reboot messages was at Aug 31 15:31:0818:45
mgagneI can do it, I was wondering if it requires informations/details I didn't have access to.18:45
clarkbmgagne: it shouldn't all of the secret bits are templated there. If we want new variables you can use the new names in system-config and one of the infra-root will update the secrets properly before landing the change18:46
mgagneguess that could also be done in 2 steps, introduce the new one with existing names and later remove the old one and rename?18:47
fungiright, it's mostly about being able to rely on the nodepool launchers and builders to wind down and clean up any remaining server instances and images18:48
fungibecause we can't easily reassociate them to a different provider name18:48
mazzydoes anyone has any clue about this issue https://pastebin.com/quAtmkfp?18:54
fungiclarkb: how should we handle the mirror server? will just adding records in dns be enough to get servers booting in the "new" provider talking to it? i expect not, we'll need to add the new name to the acme config for a new https cert too at a minimum, and i'll need to check the apache config to see if the vhost cares what name you request18:54
clarkbfungi: oh good point, yes I think we need to update DNS and then have acme rissue the cert18:56
fungimazzy: that looks like diskimage_builder hasn't been installed into python's import path18:56
clarkbfungi: I don't think that apache cares about the name as I can hit https://mirror01.dfw.rax.opendev.org without trouble18:56
fungiclarkb: yeah, so dns and acme18:57
fungiwhich will let us transition without having to replace the mirror server immediately18:57
mazzyfungi: but that is done installing dib via virtualenv18:58
mazzyand i have done that.18:58
clarkbare you executing diskimage-builder from the same virtualenv? It seems to be looking at a source path and not an install path18:59
fungimazzy: i agree installing it in a venv/virtualenv should be enough as long as the env is activated or you're invoking an entrypoint within it rather than, say, whatever python is on your default system path18:59
mazzyfungi: the env is activated19:02
mazzy(env) ubuntu@ubuntu:~/dib/diskimage-builder$ which python319:02
mazzy(env) ubuntu@ubuntu:~/dib/diskimage-builder$ which disk-image-create19:02
fungiit shouldn't be failing to import from diskimage_builder in that case19:03
opendevreviewMathieu Gagné proposed opendev/system-config master: Introduce iweb cloud configs  https://review.opendev.org/c/opendev/system-config/+/80679519:04
fungimazzy: i see a few lines before the exception it also complains "/usr/bin/env: 'python3': No such file or directory"19:04
fungithat may be a clue19:04
mazzyyeah this is what i really do not understand - why it's failing on that19:05
opendevreviewMathieu Gagné proposed openstack/project-config master: INAP mtl01 region is now owned by iWeb  https://review.opendev.org/c/openstack/project-config/+/80678819:23
fungimazzy: so anyway, it looks like pre-install.d/10-package-installs gets started, tries to run some script which has a shebang like "#!/usr/bin/env python3" (could even be the 10-package-installs executable itself?), and finds no python3 it its executable path. the traceback later for the ModuleNotFoundError looks like it was raised during error handling/cleanup so may not be directly related to19:34
fungithe underlying issue19:34
ianwfungi: yeah sorry we went on a bit of a parallel track in #openstack-dib.  python3 is required *in* the chroot, it's basically an assumption it is there19:41
fungigood to know19:41
mazzyfungi, ianw: alos another thing is there a way to disable package-installs to run? i would add a distro that does not has a package manager so there is no sense to run package-installs19:49
ianwmazzy: there is not currently.  i guess the package-installs element could have a flag that you define in an environment.d file to not run.  19:50
ianwmazzy: perhaps let's discuss in #openstack-dib19:52
mazzyyeah it makes sense. 19:52
opendevreviewJeremy Stanley proposed opendev/system-config master: Stop managing OpenStackID servers  https://review.opendev.org/c/opendev/system-config/+/80679819:54
opendevreviewIan Wienand proposed opendev/system-config master: Add assets and a related docker image/bundle  https://review.opendev.org/c/opendev/system-config/+/80593220:17
opendevreviewIan Wienand proposed opendev/system-config master: gitea: use assets bundle  https://review.opendev.org/c/opendev/system-config/+/80593320:17
opendevreviewClark Boylan proposed openstack/project-config master: INAP mtl01 region is now owned by iWeb  https://review.opendev.org/c/openstack/project-config/+/80678820:30
clarkbmgagne: ^ that just sets a depends on for the system-config change.20:30
fungiclarkb: should i go ahead and push the dns record additions too?20:34
fungior are you already writing it?20:34
clarkbfungi: I hadn't started if you want to do it. but I can as well20:35
fungino worries, on it now20:35
clarkbI'm just getting through the set of changes I said I would review this afternoon :)20:35
clarkbfungi: ianw https://review.opendev.org/c/opendev/system-config/+/803992 would be good to review. Note that docker exec will fail until we update our zuul installation but corvus  and I are both ok with that20:35
clarkbfungi: I suppose we also need a system-config update to add the name to the cert name list20:37
clarkbfungi: we can put that on top of https://review.opendev.org/c/opendev/system-config/+/806795 or squash it in.20:37
fungiyeah, i thought you were including it when you said system-config change20:38
fungibut could be separate too20:38
mgagneclarkb: thanks20:38
clarkbfungi: oh no the system-config change already existed and is safe to alnd as is, but the project-config one isn't until we land the existing system-config change and update the cert and dns20:40
clarkbI'll update system-config20:40
opendevreviewJeremy Stanley proposed opendev/zone-opendev.org master: Add iweb mtl01 mirror records  https://review.opendev.org/c/opendev/zone-opendev.org/+/80680520:41
fungialso i guess when we clean up the old dns records we'll also need to update the hostname in the inventory?20:42
opendevreviewClark Boylan proposed opendev/system-config master: Introduce iweb cloud configs  https://review.opendev.org/c/opendev/system-config/+/80679520:43
clarkbfungi: we shouldn't update the old dns records as long as the hostname is the old hostname imo20:43
fungiyeah, i didn't touch the old records just added a complete new copy for the new subdomain and bumped the serial20:43
clarkbwe can drop the CNAME for the old name but the fqdn for server isn't changing20:43
clarkbI think https://review.opendev.org/c/opendev/system-config/+/806795 should be mergable as soon as that dns update lands. I'll review dns now20:44
fungigot it, so we wouldn't alter the hostname in the inventory unless we actually rebuilt/replaced the server instance20:44
clarkbfungi: yes, that way everything lines up with nova20:44
ianwclarkb: lgtm, that file should match backups20:45
clarkbfungi: I've approved the dns update20:46
clarkbfungi: and i think my system-config update matches the names you added acme challenge records for20:46
fungiyep, just checked and it matches20:50
clarkbLooks like we may need to publish the assets image afterall? https://zuul.opendev.org/t/openstack/build/3e448801258f40f29a688162ef89930920:51
clarkbI'm ok with that and have +2'd the assets image change20:51
clarkbhrm maybe not reviewing the change I think possibly there is a small thing to change20:52
clarkbianw: ^ left a note on that change with what I think should make it happier?20:53
opendevreviewIan Wienand proposed opendev/system-config master: gitea: use assets bundle  https://review.opendev.org/c/opendev/system-config/+/80593320:54
ianwclarkb: sorry, yeah just looking :) i left the "requires" off the image build job20:54
clarkbianw: and you don't need the new requires on the system-config-run-gitea job20:54
ianwah, yeah20:55
clarkbianw: one sec one more thing20:55
clarkbcomment posted20:55
opendevreviewIan Wienand proposed opendev/system-config master: gitea: use assets bundle  https://review.opendev.org/c/opendev/system-config/+/80593320:55
clarkbI was too slow :) one more small thing on ps4 to address20:56
ianwclarkb: hrm, i feel like we've had this discussion before.  if it should pull that image from the registry or use released images20:57
clarkbianw: right I think if you only use released images then gating won't use the speculative state20:58
clarkbwith the requires on the upload you cna have an update to both the assets and gitea images enter the gate and the end result is coherent20:58
opendevreviewIan Wienand proposed opendev/system-config master: gitea: use assets bundle  https://review.opendev.org/c/opendev/system-config/+/80593320:59
ianwok that adds it20:59
clarkbI've +2'd that as I expect it should work now :)21:00
ianwif that works, i think we can also add the asset to the gerrit container and serve the image file directly from review too21:00
clarkbianw: yup, though I'm not sure how that works for gerrit? I Guess we serve other assets directly like the theme file?21:01
opendevreviewMerged opendev/zone-opendev.org master: Add iweb mtl01 mirror records  https://review.opendev.org/c/opendev/zone-opendev.org/+/80680521:03
ianwclarkb: doesn't it serve up things under "/static"?21:05
ianwi was thinking put the image in there, then update the --header-icon variable in css21:06
clarkbya looks like if you put things in review_site/static it serves them at /gerrit/static ?21:07
clarkbianw: currently we bind mount that and populate it via ansible on the host21:08
clarkbbut we could move all that content into the docker image and then add in the image?21:08
clarkbor we can write the file to the static dir with ansible and not use the "package" docker image in this instance21:09
fungizuul seems to think 806798 is safe to go in now, i expect we're going to have some cert refresh job failures until it merges21:10
ianwyes that works too; ansible doesn't have the context issues the gitea container21:10
clarkbfungi: 806798 lgtm but might be good to have ianw check it for any missing bits21:13
ianwlgtm, handlers all gone21:15
clarkbfungi: ^ do you want to approve that change or should I?21:31
ianwclarkb: https://zuul.opendev.org/t/openstack/build/00870d67f01c4605a4ea0bd2cb148365/log/job-output.txt#835 is not the error i was expecting from the gitea build21:33
ianw#8 ERROR: failed commit on ref "config-sha256:c250addbd759142b5feb692703a422348faecf3ddfa2cc8191ab43d265c7bc07": unexpected commit digest sha256:e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855, expected sha256:c250addbd759142b5feb692703a422348faecf3ddfa2cc8191ab43d265c7bc07: failed precondition21:33
clarkbI'll approve https://review.opendev.org/c/opendev/system-config/+/803992 tomorrow when I can double check the results of that cron entry21:34
clarkbI'll be afk at that time today so not a good option today21:34
clarkbianw: hrm I wonder if that is due to various rechecks? Is it possible we're seeing an old sha from the registry or old sha in the zuul db?21:35
clarkbianw: sha256:e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 is the hash for an empty string21:35
ianwclarkb: heh, i'm going to assume you don't just have that committed to memory :)22:08
ianwHead blob _local opendevorg/assets sha256:c250addbd759142b5feb692703a422348faecf3ddfa2cc8191ab43d265c7bc0722:13
clarkbianw: I don't, but I remember the registry serving empty blobs before so cheked it. I thought that was before zuul got its own registry though22:20
ianwlooks like the job ran on
ianw"docker logs --since 2h  b5f0acdcb0d5 2>&1 | grep --color" doesn't have any hits22:22
ianwis it possible it got ...7bc07 via zuul artifacts, but then didn't actually hit the intermediate registry?22:24
clarkbianw: oh that would be interesting, and docker hub served an empty blob?22:29
ianwfirst it says22:34
ianw#13 [auth] opendevorg/assets:pull token for zuul-jobs.buildset-registry:500022:34
ianw#13 sha256:28d5d2508429d320ed30c9b68d3a33016c268a91ab51841f606dab1fc692834d22:34
ianwmordred's change @ https://opendev.org/zuul/zuul-jobs/commit/70db82198c4bd0a6a0dd78221c2fae4bc7e9682f to write the buildkitd.toml feels *maybe* related22:54
clarkbmaybe we aren't instructing buildkit to find the right image?22:55
ianwyeah, but it does seem the registry is seeing queries  https://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_f53/805933/6/check/opendev-buildset-registry/f5336df/docker/buildset_registry.txt22:56
ianwif i put a hold on system-config-build-image-gitea , that's not going to hold the parent registry as well, is it?22:58
clarkbianw: I don't think so22:59
clarkbianw: you would need to hold both jobs22:59
ianwthis is a bit annoying because zuul-jobs can't depend-on from system-config23:00
fungior make a dnm change to cause the job in question to busywait/pause while you investigate on the node23:01
fungirather than using an autohold23:01
ianwthat only gives me 90 minutes :)  23:01
ianwi feel like this is configured correctly and we may be seeing something odd with buildkit pulling from the buildset registry23:02
ianweither part of that statement may be wrong23:02
opendevreviewIan Wienand proposed opendev/base-jobs master: buildset-registry: add flag to make job fail  https://review.opendev.org/c/opendev/base-jobs/+/80681823:14
opendevreviewShnaidman Sagi (Sergey) proposed openstack/diskimage-builder master: Correct path for CentOS 9 stream base image  https://review.opendev.org/c/openstack/diskimage-builder/+/80681923:24
opendevreviewIan Wienand proposed opendev/system-config master: gitea: use assets bundle  https://review.opendev.org/c/opendev/system-config/+/80593323:26
sshnaidmianw, please review  https://review.opendev.org/c/openstack/diskimage-builder/+/80681923:27
ianwsshnaidm: what is still using this element?23:28
sshnaidmianw, for example: https://99957bd7ffedb79bb17e-02cf1f4ef0de29ab49209009be295d1d.ssl.cf2.rackcdn.com/806812/2/check/ironic-python-agent-check-image-dib-centos9/4fbd3bf/job-output.txt23:29
ianwis there a reason this can't use centos-minimal builds?23:32
Clark[m]Would it work if users set the version as 9-stream instead? Seems weird to alias 9 to 9-stream23:32
sshnaidmianw, idk, but it looks for cloud image in the wrong path..23:32
*** sshnaidm is now known as sshnaidm|afk23:34
ianwi'm open to suggestions on how to test 80681823:37
opendevreviewMerged opendev/system-config master: Stop managing OpenStackID servers  https://review.opendev.org/c/opendev/system-config/+/80679823:38
opendevreviewMerged opendev/system-config master: Introduce iweb cloud configs  https://review.opendev.org/c/opendev/system-config/+/80679523:38

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!