Wednesday, 2020-11-11

*** zenkuro has quit IRC00:09
*** zenkuro has joined #zuul00:10
pabelangerI am looking for a job that uses the buildset registry (eg: pushes an image to it) and a child job uses it.00:17
pabelangerI am kind of getting confused where some jobs have the intermediate registry too00:18
clarkbpabelanger: opendev/system-config has a number of jobs like that for our various dockerized services00:19
clarkbpabelanger: the intermediate registry exists to store results between changes. The buildset registry stores results within a change (and may fetch from the intermediate registry)00:19
clarkbbasically intermediate enables depends-on and buildest enables you to build an image for gitea and gerrit in separate jobs then combine them in a single integration job00:20
pabelangerokay, thanks. I feel I should be looking into docker-build-image role to better understand how the image is push to the buildset registry00:23
pabelangerand how the child job picks that info up00:23
clarkbhvae you seen the zuul-jobs document on the subject /me goes looking for it00:26
pabelangeryup, I've read thought it. I _think_ I understand the workflow, was looking to see example00:26
clarkbhttps://zuul-ci.org/docs/zuul-jobs/docker-image.html for anyone else looking for it00:27
fungiwe also published this about our container job workflow in opendev: https://docs.opendev.org/opendev/base-jobs/latest/docker-image.html00:28
clarkbpabelanger: https://opendev.org/opendev/base-jobs/src/branch/master/zuul.d/jobs.yaml#L144-L233 that is our base jobs00:28
clarkbhttps://opendev.org/opendev/system-config/src/branch/master/zuul.d/docker-images/base.yaml#L18-L46 is one place we consume them (and the other files in that dir do image specific jobs00:28
pabelanger++ thanks00:28
pabelangerI can't use the jobs directly, as I need to fit in ansible-builder (ansible new tool for creating containers)00:29
pabelangermuch like buildx00:29
pabelangerso, hoping to reuses a lot of the registry bits00:29
pabelangerand push commands00:29
pabelangerI think I'll be able to reuse all execpt yoursite-build-docker-image00:39
pabelangerfor that, I'll have to create something specific to ansible-builder00:39
*** zenkuro has quit IRC00:47
*** cloudnull has quit IRC00:57
*** cloudnull has joined #zuul01:01
*** Goneri has quit IRC01:09
*** rf0lc0 has quit IRC01:23
*** cloudnull has quit IRC02:10
*** cloudnull has joined #zuul02:14
*** hamalq has quit IRC02:39
*** bhavikdbavishi has joined #zuul03:09
*** bhavikdbavishi1 has joined #zuul03:14
*** bhavikdbavishi has quit IRC03:16
*** bhavikdbavishi1 is now known as bhavikdbavishi03:16
*** bhavikdbavishi has quit IRC04:27
*** bhavikdbavishi has joined #zuul04:27
*** polls45 has quit IRC05:28
*** evrardjp has quit IRC05:33
*** evrardjp has joined #zuul05:33
*** wuchunyang has joined #zuul05:57
*** wuchunyang has quit IRC06:11
*** bhagyashris is now known as bhagyashris|off06:17
*** bhavikdbavishi has quit IRC07:03
*** zenkuro has joined #zuul07:05
*** sduthil has quit IRC07:20
*** zenkuro has quit IRC07:21
*** zenkuro has joined #zuul07:22
*** tosky has joined #zuul07:23
*** sduthil has joined #zuul07:28
*** bhavikdbavishi has joined #zuul07:47
*** bhavikdbavishi1 has joined #zuul07:52
*** bhavikdbavishi has quit IRC07:54
*** bhavikdbavishi1 is now known as bhavikdbavishi07:54
*** cloudnull has quit IRC08:00
*** cloudnull has joined #zuul08:00
*** armstrongs has joined #zuul08:10
*** armstrongs has quit IRC08:20
*** jpena|off is now known as jpena08:25
*** yoctozepto has quit IRC08:29
*** yoctozepto has joined #zuul08:30
openstackgerritAlbin Vass proposed zuul/nodepool master: Reorganize drivers into separate documents  https://review.opendev.org/76220808:49
*** bhavikdbavishi has quit IRC08:58
*** bhavikdbavishi has joined #zuul08:58
*** yolanda__ has joined #zuul09:03
*** yolanda__ has quit IRC09:29
*** yolanda__ has joined #zuul09:30
*** ianychoi has quit IRC09:38
*** mgoddard has quit IRC09:39
*** nils has joined #zuul09:57
*** iurygregory has quit IRC10:19
*** iurygregory has joined #zuul10:36
*** bhavikdbavishi has quit IRC10:36
*** zenkuro has quit IRC11:06
*** zenkuro has joined #zuul11:06
*** iurygregory has quit IRC11:11
*** iurygregory_ has joined #zuul11:35
*** bhavikdbavishi has joined #zuul11:35
*** iurygregory_ is now known as iurygregory11:35
*** rf0lc0 has joined #zuul11:55
*** wuchunyang has joined #zuul12:02
*** wuchunyang has quit IRC12:02
*** wuchunyang has joined #zuul12:09
*** wuchunyang has quit IRC12:09
*** rlandy has joined #zuul12:28
pabelangerwhen trying to use the buildset-(container-)registry, I assume you need to use docker login?12:28
pabelangerI'm getting an auth error by trying to pull images from it12:28
pabelangerJust starting to debug now12:29
avasspabelanger: I think there's a role use-buildset-registry or something to set that up for you12:35
pabelangeryah, I thought that was it too12:36
avasspabelanger: https://zuul-ci.org/docs/zuul-jobs/container-roles.html#role-use-buildset-registry12:36
*** jpena is now known as jpena|lunch12:36
pabelangersomething isn't working properly then12:36
pabelangerholding a job to debug it now12:37
*** zenkuro has quit IRC12:48
*** zenkuro has joined #zuul12:49
pabelangerokay, I can see config.json being setu12:55
pabelangersetup*12:55
pabelangersomething else must be going on12:55
*** jpena|lunch is now known as jpena13:41
*** bhavikdbavishi has quit IRC14:05
pabelangerokay, I think I got it working14:07
pabelangerneed to collect docker debug log to confirm14:08
*** bhavikdbavishi has joined #zuul14:28
*** Goneri has joined #zuul14:48
openstackgerritzbr proposed zuul/zuul-jobs master: DNM: trigger ensure-docker  https://review.opendev.org/76235215:03
pabelangerdo we have any jobs that are publishing to quay.io?15:04
zbrmnaser: are you aware of ERROR Project github.com/vexxhost/zuul-base-jobs does not have the default branch master in 3s issues?15:08
zbri seen failures reported by VEXXHOST CI for a good number of days.15:09
mnaserzbr: yes.  i've been trying to get to the bottom of it but no luck.  that repo's default branch is `main`.  it's configured inside zuul main.yaml to use `main`15:09
zbrhaha, main strikes :D15:09
mnaserhttps://www.irccloud.com/pastebin/3cYIlcQ7/15:10
mnaseri think it's a zuul bug but it hasn't really been easy to track it down :\15:10
*** zenkuro has quit IRC15:11
*** zenkuro has joined #zuul15:11
zbrso basically zuul insists around using a master branch15:11
mnaseryeah.15:11
corvusno there's an option to use an alternate branch15:12
corvusmnaser is using that option15:12
corvusthere's a bug15:12
corvusthat's different than "zuul insists on using"15:12
zbrcaching, did this repo ever had a master branch or it was with main from start?15:12
mnasermain from the start15:12
mnaseri don't see the issue when testing a project using 'main' already, so it sounds like it's ignoring that option in specific cases -- or perhaps in cross-connection cases15:13
*** Goneri has quit IRC15:13
mnaserfwiw the option works, just not .. everywhere from what i see :\15:15
*** bhavikdbavishi has quit IRC15:16
mnasermy search lead me here: https://opendev.org/zuul/zuul/src/branch/master/zuul/configloader.py#L185515:17
openstackgerritPaul Belanger proposed zuul/zuul-jobs master: Include docker_registry when tagging docker-image  https://review.opendev.org/76235315:17
pabelangerI'll need to better understand tests so I can update ^15:18
mnaseroh hold on15:18
mnaserhttps://opendev.org/zuul/zuul/src/branch/master/zuul/configloader.py#L2267-L226815:18
mnasershould that be `[tpc.load_branch if tpc.load_branch else 'master']` instead?15:20
*** zenkuro has quit IRC15:24
openstackgerritMohammed Naser proposed zuul/zuul master: Use load-branch with trusted repository  https://review.opendev.org/76235415:28
mnaseri'm not sure how to test this as there was already tests that were passing :\15:28
*** bhavikdbavishi has joined #zuul15:37
tobiashmnaser: the tests probably didn't test the dynamic path?15:37
mnasertobiash: right, that would make sense.  i would probably need a little help in figuring out where to build those tests out, configloader is a bit of a far leap for me :)15:38
mnaseroops i added whitespace15:38
mnaseror rather looks like i removed extra whitespace15:38
tobiashmost editors can be configured to strip those on save ;)15:39
openstackgerritMohammed Naser proposed zuul/zuul master: Use load-branch with trusted repository  https://review.opendev.org/76235415:39
mnaserits too early to look at code15:39
tobiashmnaser: you mean that test_tenant_config_load_branch was successfull in the past right?15:40
openstackgerritMohammed Naser proposed zuul/zuul master: Use load-branch with trusted repository  https://review.opendev.org/76235415:40
mnasertobiash: yes -- and it actually seems to work in an env where i am using 'main' as my branch15:41
tobiashprobably except changes to that trusted repo?15:41
mnasernot even .. because if you look at the vexxhost ci failures, that is third-party-ci15:41
mnaserso changes to zuul-jobs fail15:41
mnaser(which in this case is not a trusted repo)15:42
tobiashoh yes, on changes on a different repo since that's the dynamic part15:42
tobiashthe speculative layout uses the non-existing config on master branch15:42
mnaserbut i wonder why it isn't an issue for my other projects that are using main15:42
mnaseri have github projects that don't have this issue, but they're all using 'main' too15:43
tobiashso that test case could be extended by 1. break config on master 2. add a change that modifies zuul config to an untrusted repo that relies on a correct config on the stable branch15:43
tobiashmnaser: that looks to me that it only breaks for changes touching zuul config15:44
*** zenkuro has joined #zuul15:44
mnaserthen maybe the issue is elsewhere.  the only thing i am thinking is the fact that they are using different connections tobiash15:44
mnaserso both gerrithub and opendev are reporting this 'complaint', but again, i havent tested a github project using 'master'15:45
tobiashthe bugfix you're suggesting is connection agnostic15:45
tobiash(and really fixing a bug)15:45
mnaserhm15:46
mnaserhttps://opendev.org/zuul/zuul/src/branch/master/zuul/configloader.py#L1606-L161215:46
mnaserthis is another hard-coded master15:46
tobiashthis is resorting the branches so that master is the first if existing15:47
tobiashthat's needed so that config on master takes precedence over config on other branches15:47
mnaserideally i think we should use the default-branch option instead of master there, but that's probably unrelated and we have a few other cases to cover there15:48
tobiash(but is unrelated to load-branch because that's for untrusted repos)15:48
mnaseroh boy15:49
mnaseri really hope this isn't it15:49
mnaser`exclude-unprotected-branches: true`15:49
mnaseri wonder if it's not loading it because maybe it doesn't have protection15:49
mnaserbut the error reports 'master' instead of 'main'15:49
*** zenkuro has quit IRC15:50
mnaserhttps://opendev.org/zuul/zuul/src/branch/master/zuul/executor/server.py#L1109-L111715:52
mnaseror https://opendev.org/zuul/zuul/src/branch/master/zuul/executor/server.py#L1843-L185115:53
mnaseri don't see the "Checking out" log message, so that tells me its the first iteration that is failing15:55
mnaserso `default-branch` is `master` by default, so it's trying to check that out?15:58
*** rfolco has joined #zuul15:59
*** rf0lc0 has quit IRC16:01
tobiashmnaser: I'd have a test case to your change, shall I update it?16:14
mnasertobiash: go for it :)16:14
tobiash(although it won't solve your problem actually)16:14
openstackgerritPaul Belanger proposed zuul/zuul-jobs master: Include docker_registry when tagging docker-image  https://review.opendev.org/76235316:15
fungizbr: i'm testing out the latest version of your ansi color rendering feature for the webui, do you happen to know a job which runs frequently in opendev which spits out colorized text? if not, i can push up a dnm change somewhere to temporarily create one16:15
openstackgerritTobias Henkel proposed zuul/zuul master: Use load-branch with trusted repository  https://review.opendev.org/76235416:16
tobiashmnaser: ^16:16
tobiashtesting showed that this is a bug but only affects validation of zuul config to the trusted repo16:17
*** Goneri has joined #zuul16:18
*** jhesketh has quit IRC16:26
pabelangerhow are people dealing with this error from paramiko when trying to load an RSA key for gerrit16:28
pabelangerhttp://paste.openstack.org/show/799928/16:28
pabelangerthat is using 2.7.1 of paramiko16:28
openstackgerritJeremy Stanley proposed zuul/zuul master: DNM: ANSI Color Test  https://review.opendev.org/76236316:32
fungipabelanger: if memory serves, the problem has to do with your local key file being in the wrong format16:33
funginewer openssh generates and expects a new format, not the old pem format16:33
fungii don't recall what paramiko supports though16:33
pabelangerI've confirmed it is PEM16:33
pabelangerbut, paramiko is trying to load ed25519key16:34
pabelangerbut, cannot use ed25519 as gerrit doesn't support16:34
pabelangernot sure what is happening here16:34
openstackgerritJeremy Stanley proposed zuul/zuul master: DNM: ANSI Color Test  https://review.opendev.org/76236316:38
avasshttps://review.opendev.org/#/c/762208/ is ready (split drivers into their own documents)16:40
avasspabelanger: that error is misleading16:40
avasspabelanger: I believe it usually means that you don't have access16:41
avassI've seen paramiko throw that when you'd usually get a 'permission denied'16:42
avasspabelanger: https://github.com/paramiko/paramiko/issues/161216:42
pabelangerOh16:45
pabelangerI think you are right16:45
pabelangerI left the port off in my zuul.conf16:46
pabelangerhow did that happen16:46
pabelangerhmm16:47
pabelangerokay, I need to take a break16:47
avass:)16:48
zbrfungi: there is one. ANSI DNM job I used at https://review.opendev.org/#/c/761175/ -- use that16:50
zbrfungi: sadly testing ANSI output is very inconvenient, maybe we can alter own zuul build jobs to have a task that produces ansi specially for testing purposes16:51
zbrif quite hard to reach the one particular job that creates the output desired for testing the UI. if we add some tasks for this purpose we may be able to make faster progress.16:52
clarkbshouldn't be difficult if you have a build uuid, that will take you straigt to the build page16:59
fungiyeah, i was able to get that displayed in the draft view17:00
zbrthat buildid expires over time, you need to reget an unexperied id, and paste it to the search, after picking the right dropdown item. If you count total number of actions is they are not very few.17:21
zbralso these involve knowing some far from obvious zuul ui-changes tricks (and limitations), not very handy for new users that may want to help with feedback.17:22
zbrif we can improve it, we would all benefit from it, that applies to any UI changes not only that particular ANSI one.17:22
zbrmaybe if we can post a UI testing link directly to the build, it would make it easier. i bet most people have no idea about how site preview works, or the reload limitation and that sharing links does not work.17:26
clarkbwe do post a UI testing link directly to the build17:28
zbrpabelanger: i remember fixing something similar in elastic-recheck for paramiko.17:29
zbrclarkb: i am not sure where is direct link because I only see the 3 dashboard job where I need 3 click to reach the site preview.17:31
clarkbzbr: maybe I don't understand what you mean then but each of those site previews is a UI testing link17:32
clarkband is directly provided on each build17:32
zbrno1 click job link no2. click artifacts tab no3. click site preview.17:32
zbr3 clicks != directly imho17:32
clarkbI mean there is a lot of data we can link to directly in the gerrit comments but doing so would make the gerrit comments useless17:33
zbrdirectly to me it would be a link named site-preview posted to gerrit.17:33
clarkbI think what we do hits a decent balance between overwhelming the user and giving them what they need to debug jobs17:33
clarkbfor some builds that is going to be the ansible console, for some the console stream, others the site preview, and so on17:33
clarkbwe make each of those accessible pretty easily17:34
clarkband yes if you have a human prefilter for you then we can probably provide better links initially, but I'm not sure how we'd do that with a set of machine rules17:35
zbrhow many times does a user need something else than site preview when clicking a dashboard job? i would say 99% will want to see sitepreview and nothing else.17:35
zbri know that is not something easy to address17:35
clarkbI often look at the console stream because js is foreign to me and you get warnings and stuff there17:35
zbrmainly comes to answering the question: what is the main "product" of a succesfull build17:36
clarkbyes, and I think what we've got now strikes a good balance beacuse that differs based on contenxt and the individual behind the keyboard17:36
zbrfor unitests I would say is the unittest report, for dashboard or docs is site preview17:36
clarkbwe give you an overview with links to the likely candidates17:37
clarkbI never look at the unittest report fwiw (and I wrote the code for it)17:37
clarkbI appreciate people find it to be valuable but I don't, and I think its ok to have those differences17:37
corvuszbr: in opendev's zuul, we're only going to report one link per build back to gerrit, and it has to be the link to the build page because if we report anything else, the user can't navigate back to the build page.17:37
zbrcorvus: i know. the only alternative would if we change builds to allow reporting custom data in addition to link to build.17:38
corvus(zuul supports supplying a different url, but we've elected not to use it for the zuul project and generally in opendev)17:38
fungiwhich would seem to be redundant to the build result page since it already provides those too17:39
zbrmaybe if we assure artifacts are visible on the summary page we cut at least one step.17:39
pabelangerzbr: do you remember the issue? I've downgraded paramiko to test again17:39
zbrpabelanger: looking....17:39
corvuszbr: i think that's worth looking into.  that's where i put the artifacts when i added them, but they were moved in the pf4 update.17:40
fungiwe did once upon a time link successful docs build results to the docs preview and failures to the build logs (back before we had a build status page) and that while convenient much of the time, became a hindrance if you wanted to view the logs of a successful run17:40
zbri know that pf4 didn't bring only benefits, but we should be able to address downsides one by one.17:40
*** nils has quit IRC17:42
zbri am considering finding a way to squeeze artifacts somewhere on the header. maybe as last column, env combining first two columns into a single one.17:42
zbrthe first column contains a lot of boilerplate which is useless most of the time.17:43
*** jpena is now known as jpena|off17:43
zbrproject/branch/pipeline could be compressed as a single line maybe?17:43
zbri would have found the change title (in addition to number,patch) as far more useful than these17:44
zbri personally do not find number being very friendly17:45
zbralso UUID and EvenID have almost no visual value, they are useful only if you want to copy them to clipboard, but not as in being displayed.17:46
zbri would hide them and expose them as tooltips and only provide a button to copy them to clipboard.17:47
zbrpipeline name could be displayed as a label with rounded corners before the one that express the SUCCESS/FAILURE>17:49
avasszbr: as long as they're easily accessible I wouldn't complain. but they're invaluabe for searching logs17:49
zbravass: yep, that is why i mentioned ability to copy them easily.17:50
zbri know that all information in the UI is there because someone found it useful, the trick is to adapt the UI in such way that we improve the experience for most use cases.17:51
zbri need them too :D17:51
zbranother change that could improve UI is to hide/collapse skipped tasks by default and allow user to unhide them.17:53
*** zenkuro has joined #zuul18:02
*** hamalq has joined #zuul18:09
*** hamalq has quit IRC18:09
*** hamalq has joined #zuul18:10
openstackgerritMerged zuul/zuul-jobs master: More E208 (final)  https://review.opendev.org/76129718:24
*** bhavikdbavishi has quit IRC18:50
*** EmilienM has joined #zuul18:57
*** bhavikdbavishi has joined #zuul19:01
openstackgerritAlbin Vass proposed zuul/nodepool master: WIP: Digitalocean driver  https://review.opendev.org/75955919:08
*** yolanda__ is now known as yolanda19:08
openstackgerritAlbin Vass proposed zuul/nodepool master: Remove unused labels in gce tests  https://review.opendev.org/76239219:18
avasscorvus: i believe you missed removing those ^ :)19:19
corvusavass: yup thx19:19
*** bhavikdbavishi has quit IRC19:20
avass:)19:32
openstackgerritAlbin Vass proposed zuul/nodepool master: Fix loggername for Gce test driver  https://review.opendev.org/76239919:32
corvusi think i should just single-core approve these19:33
avassprobably, they shouldn't be affecting any functionality19:34
avassif you got (or an other core) time over the doc update to split drivers into separate documents is ready: https://review.opendev.org/#/c/762208/19:36
*** armstrongs has joined #zuul19:58
*** armstrongs has quit IRC20:07
openstackgerritMerged zuul/nodepool master: Remove unused labels in gce tests  https://review.opendev.org/76239220:54
openstackgerritMerged zuul/nodepool master: Fix loggername for Gce test driver  https://review.opendev.org/76239920:54
corvusavass: +3 with comment; also i happened to note the formatting is messed up with azure (not the fault of your patch); in case you feel like doing another fix.  my guess is wrong indentation but i haven't looked.21:27
*** rfolco has quit IRC21:29
pabelangerokay, I am struggling a little bit with buildset-registry, how do namespaces work?  I am building an ansible/ansible-runner container image, that works fine. But from the other job, if I pull ansible/ansible-runner, it will come from the buildset registry. If I use quay.io/ansible/ansible-runner, it comes from quay.io. Is there a way to have th buildset registry include the quay.io namespace?21:34
*** holser has quit IRC21:37
*** smyers has quit IRC21:37
*** sshnaidm|off has quit IRC21:37
*** bhagyashris|off has quit IRC21:37
*** timburke has quit IRC21:37
*** lyr has quit IRC21:37
*** pleia2 has quit IRC21:37
*** holser has joined #zuul21:37
*** smyers has joined #zuul21:37
*** sshnaidm|off has joined #zuul21:37
*** bhagyashris|off has joined #zuul21:37
*** timburke has joined #zuul21:37
*** lyr has joined #zuul21:37
*** pleia2 has joined #zuul21:37
*** tosky has quit IRC21:40
*** amotoki has quit IRC21:40
*** pots has quit IRC21:40
*** freefood has quit IRC21:40
*** ianw has quit IRC21:40
*** mordred has quit IRC21:40
*** persia has quit IRC21:40
*** yolanda has quit IRC21:40
*** gundalow has quit IRC21:40
*** ericsysmin has quit IRC21:40
*** shanemcd has quit IRC21:40
*** reiterative has quit IRC21:40
*** zer0c00l has quit IRC21:40
*** sean-k-mooney has quit IRC21:40
*** SpamapS has quit IRC21:40
*** systemd has quit IRC21:40
*** mordred has joined #zuul21:41
*** persia has joined #zuul21:41
*** yolanda has joined #zuul21:41
*** gundalow has joined #zuul21:41
*** ericsysmin has joined #zuul21:41
*** shanemcd has joined #zuul21:41
*** reiterative has joined #zuul21:41
*** zer0c00l has joined #zuul21:41
*** sean-k-mooney has joined #zuul21:41
*** SpamapS has joined #zuul21:41
*** systemd has joined #zuul21:41
*** gouthamr_ has quit IRC21:41
*** fbo has quit IRC21:41
*** tosky has joined #zuul21:41
*** amotoki has joined #zuul21:41
*** pots has joined #zuul21:41
*** freefood has joined #zuul21:41
*** ianw has joined #zuul21:41
*** Goneri has quit IRC21:41
*** nhicher has quit IRC21:41
*** mhu has quit IRC21:41
*** Pilou has quit IRC21:41
*** Goneri has joined #zuul21:42
*** nhicher has joined #zuul21:42
*** mhu has joined #zuul21:42
*** fbo has joined #zuul21:42
*** gouthamr_ has joined #zuul21:42
*** Pilou has joined #zuul21:42
*** ericsysmin has quit IRC21:43
corvuspabelanger: i think first you need to build a quay.io/ansible/ansible-runner image21:43
*** gundalow has quit IRC21:44
*** masterpe has quit IRC21:44
*** ericsysmin has joined #zuul21:44
corvuspabelanger: you'll need the https://zuul-ci.org/docs/zuul-jobs/container-roles.html#role-build-container-image role for that (not build-docker-image)21:45
*** mordred has quit IRC21:45
corvuspabelanger: note that the upload-container-image and promote-container-image (versus -docker-image) roles have not been written yet21:45
*** aluria has quit IRC21:45
pabelangerah, I am using build-docker-image to create quay.io/ansible/ansible-runner21:46
pabelangerlet me switch that out21:46
*** iurygregory has quit IRC21:46
*** yoctozepto has quit IRC21:46
*** cloudnull has quit IRC21:46
*** dmsimard has quit IRC21:46
*** bschanzel has quit IRC21:46
*** ttx has quit IRC21:46
*** pabelanger has quit IRC21:46
*** etp has quit IRC21:46
*** tobberydberg_ has quit IRC21:46
*** Miouge has quit IRC21:46
*** frickler has quit IRC21:46
*** arxcruz has quit IRC21:46
*** guillaumec has quit IRC21:46
*** weshay|ruck has quit IRC21:46
*** mmedvede has quit IRC21:46
*** johanssone has quit IRC21:46
*** felixedel has quit IRC21:46
*** spotz has quit IRC21:46
*** iurygregory has joined #zuul21:47
*** yoctozepto has joined #zuul21:47
*** cloudnull has joined #zuul21:47
*** dmsimard has joined #zuul21:47
*** pabelanger has joined #zuul21:47
*** bschanzel has joined #zuul21:47
*** ttx has joined #zuul21:47
*** etp has joined #zuul21:47
*** tobberydberg_ has joined #zuul21:47
*** Miouge has joined #zuul21:47
*** frickler has joined #zuul21:47
*** Eighth_Doctor has quit IRC21:47
corvuspabelanger: essentially "-docker" is docker-specific and "-container" is agnostic.  but we don't have upload or promote for -container yet21:47
*** aluria has joined #zuul21:48
pabelangerthat is okay for now21:48
corvuspabelanger: it's possible docker_registry could be used with build-docker-image21:48
*** evrardjp has quit IRC21:48
*** johnsom has quit IRC21:48
*** donnyd has quit IRC21:48
*** samccann has quit IRC21:48
*** ChrisShort has quit IRC21:48
*** stevthedev has quit IRC21:48
*** iamweswilson has quit IRC21:48
*** mgagne has quit IRC21:48
*** fdegir has quit IRC21:48
*** fungi has quit IRC21:48
pabelangercan maybe help write them21:48
corvuspabelanger: haven't tried it https://zuul-ci.org/docs/zuul-jobs/container-roles.html#rolevar-build-docker-image.docker_registry21:48
pabelangercorvus: yah, this lead me to create https://review.opendev.org/762353/ but it doesn't look like docker pull will use the registry21:49
corvuspabelanger: i think the other thing to know is that the docker commands basically don't support ... yeah that21:50
pabelangerit does tag the quay.io/ansible/ansible-runner image properly now, I think21:50
pabelangerk, so flipping to podman might be the next step21:50
corvuspabelanger: because of the way docker is implemented, there just isn't the possibility to have a speculative container registry other than dockerhub21:50
*** gundalow has joined #zuul21:50
pabelangerkk21:50
corvuspabelanger: but the podman tooling supports anything21:50
pabelangerthat is likely it21:50
*** arxcruz has joined #zuul21:50
*** guillaumec has joined #zuul21:50
*** weshay|ruck has joined #zuul21:50
*** mmedvede has joined #zuul21:50
*** johanssone has joined #zuul21:50
*** felixedel has joined #zuul21:50
*** spotz has joined #zuul21:50
*** evrardjp has joined #zuul21:51
*** johnsom has joined #zuul21:51
*** donnyd has joined #zuul21:51
*** samccann has joined #zuul21:51
*** ChrisShort has joined #zuul21:51
*** stevthedev has joined #zuul21:51
*** iamweswilson has joined #zuul21:51
*** mgagne has joined #zuul21:51
*** fdegir has joined #zuul21:51
*** fungi has joined #zuul21:51
*** SotK has quit IRC21:51
*** tristanC has quit IRC21:51
*** noonedeadpunk has quit IRC21:51
*** avass has quit IRC21:51
*** odyssey4me has quit IRC21:51
*** danpawlik has quit IRC21:51
*** clarkb has quit IRC21:51
*** EmilienM has quit IRC21:51
*** decimuscorvinus has quit IRC21:51
*** jpena|off has quit IRC21:51
*** jkt has quit IRC21:51
corvuspabelanger: so i'm pretty sure that 'build-container-image' followed by 'podman run quay.io/...' would work; it's possible that 'build-docker-image' followed by 'podman run quay.io' might work but i'm less sure.21:51
corvuspabelanger: and i'm pretty sure that build-*-image followed by 'docker run quay.io' will not work21:52
*** EmilienM has joined #zuul21:53
*** decimuscorvinus has joined #zuul21:53
*** jpena|off has joined #zuul21:53
*** jkt has joined #zuul21:53
*** SotK has joined #zuul21:53
*** tristanC has joined #zuul21:53
*** noonedeadpunk has joined #zuul21:53
*** avass has joined #zuul21:53
*** odyssey4me has joined #zuul21:53
*** danpawlik has joined #zuul21:53
*** clarkb has joined #zuul21:53
pabelangerso much choice21:53
pabelanger:)21:53
*** dcastellani has quit IRC21:53
*** dcastellani has joined #zuul21:53
*** dcastellani has quit IRC21:53
*** SotK has quit IRC21:53
*** tristanC has quit IRC21:53
*** noonedeadpunk has quit IRC21:53
*** avass has quit IRC21:53
*** odyssey4me has quit IRC21:53
*** danpawlik has quit IRC21:53
*** clarkb has quit IRC21:53
*** EmilienM has quit IRC21:53
*** decimuscorvinus has quit IRC21:53
*** jpena|off has quit IRC21:53
*** jkt has quit IRC21:53
*** arxcruz has quit IRC21:53
*** guillaumec has quit IRC21:53
*** weshay|ruck has quit IRC21:53
*** mmedvede has quit IRC21:53
*** johanssone has quit IRC21:53
*** felixedel has quit IRC21:53
*** spotz has quit IRC21:53
*** evrardjp has quit IRC21:53
*** johnsom has quit IRC21:53
*** donnyd has quit IRC21:53
*** samccann has quit IRC21:53
*** ChrisShort has quit IRC21:53
*** stevthedev has quit IRC21:53
*** iamweswilson has quit IRC21:53
*** mgagne has quit IRC21:53
*** fdegir has quit IRC21:53
*** fungi has quit IRC21:53
*** iurygregory has quit IRC21:53
*** yoctozepto has quit IRC21:53
*** cloudnull has quit IRC21:53
*** dmsimard has quit IRC21:53
*** bschanzel has quit IRC21:53
*** ttx has quit IRC21:53
*** pabelanger has quit IRC21:53
*** etp has quit IRC21:53
*** tobberydberg_ has quit IRC21:53
*** Miouge has quit IRC21:53
*** frickler has quit IRC21:53
*** Pilou has quit IRC21:53
*** Goneri has quit IRC21:53
*** nhicher has quit IRC21:53
*** mhu has quit IRC21:53
*** gouthamr_ has quit IRC21:53
*** fbo has quit IRC21:53
*** yolanda has quit IRC21:53
*** shanemcd has quit IRC21:53
*** reiterative has quit IRC21:53
*** zer0c00l has quit IRC21:53
*** sean-k-mooney has quit IRC21:53
*** SpamapS has quit IRC21:53
*** systemd has quit IRC21:53
*** persia has quit IRC21:53
*** tosky has quit IRC21:53
*** amotoki has quit IRC21:53
*** pots has quit IRC21:53
*** freefood has quit IRC21:53
*** ianw has quit IRC21:53
*** holser has quit IRC21:53
*** smyers has quit IRC21:53
*** sshnaidm|off has quit IRC21:53
*** bhagyashris|off has quit IRC21:53
*** timburke has quit IRC21:53
*** lyr has quit IRC21:53
*** pleia2 has quit IRC21:53
*** ChanServ has quit IRC21:53
*** ericsysmin has quit IRC21:53
*** rpittau|afk has quit IRC21:53
*** mnaser has quit IRC21:53
*** irclogbot_1 has quit IRC21:53
*** tflink has quit IRC21:53
*** maxamillion has quit IRC21:53
*** mwhahaha has quit IRC21:53
*** gmann has quit IRC21:53
*** ironfoot has quit IRC21:53
*** zbr has quit IRC21:53
*** aluria has quit IRC21:53
*** openstackgerrit has quit IRC21:53
*** gundalow has quit IRC21:53
*** hamalq has quit IRC21:53
*** guilhermesp has quit IRC21:53
*** gouthamr has quit IRC21:53
*** mugsie has quit IRC21:53
*** rlandy has quit IRC21:53
*** paladox has quit IRC21:53
*** mnasiadka has quit IRC21:53
*** aprice has quit IRC21:53
*** erbarr has quit IRC21:53
*** PrinzElvis has quit IRC21:53
*** Open10K8S has quit IRC21:53
*** jbryce has quit IRC21:53
*** webknjaz has quit IRC21:53
*** logan- has quit IRC21:53
*** leoluk has quit IRC21:53
*** zenkuro has quit IRC21:53
*** sduthil has quit IRC21:53
*** sugaar has quit IRC21:53
*** tobiash has quit IRC21:53
*** Tahvok has quit IRC21:53
*** corvus has quit IRC21:53
*** dcastellani has joined #zuul21:54
*** clarkb has joined #zuul21:54
*** danpawlik has joined #zuul21:54
*** odyssey4me has joined #zuul21:54
*** avass has joined #zuul21:54
*** noonedeadpunk has joined #zuul21:54
*** tristanC has joined #zuul21:54
*** SotK has joined #zuul21:54
*** jkt has joined #zuul21:54
*** jpena|off has joined #zuul21:54
*** decimuscorvinus has joined #zuul21:54
*** EmilienM has joined #zuul21:54
*** fungi has joined #zuul21:54
*** fdegir has joined #zuul21:54
*** mgagne has joined #zuul21:54
*** iamweswilson has joined #zuul21:54
*** stevthedev has joined #zuul21:54
*** ChrisShort has joined #zuul21:54
*** samccann has joined #zuul21:54
*** donnyd has joined #zuul21:54
*** johnsom has joined #zuul21:54
*** evrardjp has joined #zuul21:54
*** spotz has joined #zuul21:54
*** felixedel has joined #zuul21:54
*** johanssone has joined #zuul21:54
*** mmedvede has joined #zuul21:54
*** weshay|ruck has joined #zuul21:54
*** guillaumec has joined #zuul21:54
*** arxcruz has joined #zuul21:54
*** gundalow has joined #zuul21:54
*** aluria has joined #zuul21:54
*** frickler has joined #zuul21:54
*** Miouge has joined #zuul21:54
*** tobberydberg_ has joined #zuul21:54
*** etp has joined #zuul21:54
*** ttx has joined #zuul21:54
*** bschanzel has joined #zuul21:54
*** pabelanger has joined #zuul21:54
*** dmsimard has joined #zuul21:54
*** cloudnull has joined #zuul21:54
*** yoctozepto has joined #zuul21:54
*** iurygregory has joined #zuul21:54
*** ericsysmin has joined #zuul21:54
*** Pilou has joined #zuul21:54
*** gouthamr_ has joined #zuul21:54
*** fbo has joined #zuul21:54
*** mhu has joined #zuul21:54
*** nhicher has joined #zuul21:54
*** Goneri has joined #zuul21:54
*** ianw has joined #zuul21:54
*** freefood has joined #zuul21:54
*** pots has joined #zuul21:54
*** amotoki has joined #zuul21:54
*** tosky has joined #zuul21:54
*** systemd has joined #zuul21:54
*** SpamapS has joined #zuul21:54
*** sean-k-mooney has joined #zuul21:54
*** zer0c00l has joined #zuul21:54
*** reiterative has joined #zuul21:54
*** shanemcd has joined #zuul21:54
*** yolanda has joined #zuul21:54
*** persia has joined #zuul21:54
*** pleia2 has joined #zuul21:54
*** lyr has joined #zuul21:54
*** timburke has joined #zuul21:54
*** bhagyashris|off has joined #zuul21:54
*** sshnaidm|off has joined #zuul21:54
*** smyers has joined #zuul21:54
*** holser has joined #zuul21:54
*** hamalq has joined #zuul21:54
*** zenkuro has joined #zuul21:54
*** rlandy has joined #zuul21:54
*** sduthil has joined #zuul21:54
*** paladox has joined #zuul21:54
*** rpittau|afk has joined #zuul21:54
*** tflink has joined #zuul21:54
*** mnaser has joined #zuul21:54
*** guilhermesp has joined #zuul21:54
*** gouthamr has joined #zuul21:54
*** mnasiadka has joined #zuul21:54
*** aprice has joined #zuul21:54
*** erbarr has joined #zuul21:54
*** PrinzElvis has joined #zuul21:54
*** Open10K8S has joined #zuul21:54
*** jbryce has joined #zuul21:54
*** maxamillion has joined #zuul21:54
*** mwhahaha has joined #zuul21:54
*** gmann has joined #zuul21:54
*** webknjaz has joined #zuul21:54
*** sugaar has joined #zuul21:54
*** mugsie has joined #zuul21:54
*** ironfoot has joined #zuul21:54
*** ChanServ has joined #zuul21:54
*** irclogbot_1 has joined #zuul21:54
*** zbr has joined #zuul21:54
*** logan- has joined #zuul21:54
*** openstackgerrit has joined #zuul21:54
*** tobiash has joined #zuul21:54
*** Tahvok has joined #zuul21:54
*** corvus has joined #zuul21:54
*** leoluk has joined #zuul21:54
*** tepper.freenode.net sets mode: +o ChanServ21:54
*** kgz has quit IRC21:54
*** rlandy has quit IRC21:54
*** paladox has quit IRC21:54
*** mnasiadka has quit IRC21:54
*** aprice has quit IRC21:54
*** erbarr has quit IRC21:54
*** PrinzElvis has quit IRC21:54
*** Open10K8S has quit IRC21:54
*** jbryce has quit IRC21:54
*** webknjaz has quit IRC21:54
*** logan- has quit IRC21:54
*** leoluk has quit IRC21:54
*** zenkuro has quit IRC21:54
*** sduthil has quit IRC21:54
*** sugaar has quit IRC21:54
*** tobiash has quit IRC21:54
*** Tahvok has quit IRC21:54
*** corvus has quit IRC21:54
*** rlandy has joined #zuul21:54
*** paladox has joined #zuul21:54
*** mnasiadka has joined #zuul21:54
*** aprice has joined #zuul21:54
*** erbarr has joined #zuul21:54
*** PrinzElvis has joined #zuul21:54
*** Open10K8S has joined #zuul21:54
*** jbryce has joined #zuul21:54
*** webknjaz has joined #zuul21:54
*** logan- has joined #zuul21:54
*** leoluk has joined #zuul21:54
*** logan- has quit IRC21:54
*** zenkuro has joined #zuul21:55
*** sduthil has joined #zuul21:55
*** sugaar has joined #zuul21:55
*** tobiash has joined #zuul21:55
*** Tahvok has joined #zuul21:55
*** corvus has joined #zuul21:55
*** dcastellani has quit IRC21:56
*** mnasiadka has quit IRC21:57
*** PrinzElvis has quit IRC21:57
*** mnasiadka has joined #zuul21:58
*** erbarr has quit IRC21:58
*** PrinzElvis has joined #zuul21:58
*** kgz has joined #zuul21:58
*** logan- has joined #zuul21:59
*** erbarr has joined #zuul21:59
*** dcastellani has joined #zuul22:00
fungiso much netsplit it all over my screen22:12
*** Eighth_Doctor has joined #zuul22:15
openstackgerritIan Wienand proposed zuul/nodepool master: Install podman in container for container-based builds  https://review.opendev.org/75664322:17
*** mordred has joined #zuul22:25
openstackgerritMerged zuul/nodepool master: Reorganize drivers into separate documents  https://review.opendev.org/76220822:38
pabelanger2020-11-11 22:55:42.628757 | ubuntu-bionic | Error: Error copying image to the remote destination: Error trying to reuse blob sha256:88557d3f8a58a7ca4c8b429593aede5a9b6b963905c32aae55057503893d9e28 at destination: pinging docker registry returned: Get https://zuul-jobs.buildset-registry:5000/v2/: EOF22:56
pabelangercorvus: have you see that before?^22:56
pabelangerthat is using the build-container-image22:56
pabelangerrole*22:56
pabelangerso, backend is podman22:57
mwhahahamight be an oci vs docker format thing22:58
mwhahahawe ended up forcing dockerv2 format because oci got weird when we had to handle container storage issues22:59
pabelangerforce it where?23:01
*** tosky has quit IRC23:08
pabelanger`http://paste.openstack.org/show/799935/23:16
pabelangerhttp://paste.openstack.org/show/799935/23:16
pabelangerthat is the debug log from podman23:16
clarkbpabelanger: have you tried fetching that url manually? maybe the name isn't in dns?23:17
clarkbmaybe the port is different etc23:17
clarkbmy hunch is dns though given the fqdn there23:17
pabelangerdns looks right23:20
clarkbwhat does wget or curl say?23:20
clarkbthey may have better debug output23:20
pabelangerHmm, getting openssl error23:22
clarkbhrm I think the job sets up certs for the clients. May need to ignore ssl verification in wget/curl to debug further23:23
clarkbbut maybe the certs aren't set properly for podman?23:23
pabelangerdo we know if we have a job using build-container-images role?23:24
clarkbI don't know of anyone using the podman stuff. We tried for a short period of time but it turns out podman != docker and it was easier to just keep dockering23:24
clarkb(specifically had issues with bind mounts)23:24
pabelangerhttp://paste.openstack.org/show/799936/23:25
pabelangerthat is error I see23:25
clarkbif you do curl --insecure does it change?23:27
clarkbif not then maybe its ssl setup on the registry side23:27
pabelangerno23:27
clarkbok then ya I would check the registry side's ssl setup23:27
pabelangeryah, that is what I am checking now23:27
clarkbiirc there is config for that, maybe double check the files exist and perms are such that the files can be read23:27
corvuspabelanger: to answer your earlier question: there should be a test job in zuul-jobs which exercises the build-container-image role23:28
corvuspabelanger: zuul-jobs-test-registry-podman i think23:30
pabelangercorvus: ack, thanks23:30
pabelangerhttp://paste.openstack.org/show/799937/23:30
openstackgerritMerged zuul/nodepool master: Ignore unparsable/empty image build ZNode data  https://review.opendev.org/74634923:30
pabelangerthat is all I see from zuul-registry23:30
corvus(careful grepping there; it's actually the same playbook used for both roles)23:30
pabelangerit looks like tls certs are mounted into the container23:31
*** zenkuro has quit IRC23:33
pabelangerI think it might be related to ipv623:36
pabelangeryah, a ipv4 only node seem to work properly23:37
clarkbthe ssl error implies it is talking though which would imply to me that ipv6 is carrying the traffic23:40
pabelangermaybe registry isn't loading certs properly when ipv623:41
pabelangerhttp://paste.openstack.org/show/799938/23:43
pabelangerthat is diff on not working / working with openssl s_client23:44
clarkbweird, I would still look at it from the bottom up and check the ssl configs and the files and so on23:44
pabelangerlet me see if I can get into the container23:44
pabelangerthe good news, is podman pull worked properly23:59

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!