| *** dsneddon has joined #oooq | 00:05 | |
| *** d0ugal has quit IRC | 00:06 | |
| *** dsneddon has quit IRC | 00:10 | |
| *** d0ugal has joined #oooq | 00:22 | |
| *** dsneddon has joined #oooq | 00:44 | |
| *** dsneddon has quit IRC | 00:48 | |
| *** ccamacho has quit IRC | 01:09 | |
| *** dsneddon has joined #oooq | 01:22 | |
| *** dsneddon has quit IRC | 01:27 | |
| *** dsneddon has joined #oooq | 01:57 | |
| *** dsneddon has quit IRC | 02:02 | |
| *** dsneddon has joined #oooq | 02:30 | |
| *** dsneddon has quit IRC | 02:34 | |
| *** d0ugal has quit IRC | 02:39 | |
| *** ykarel|away has joined #oooq | 02:45 | |
| *** d0ugal has joined #oooq | 02:53 | |
| *** dsneddon has joined #oooq | 03:01 | |
| *** dsneddon has quit IRC | 03:06 | |
| *** dsneddon has joined #oooq | 03:42 | |
| *** aakarsh|2 has quit IRC | 03:42 | |
| *** gkadam has joined #oooq | 03:46 | |
| *** dsneddon has quit IRC | 03:46 | |
| *** gkadam has quit IRC | 03:47 | |
| *** surpatil has joined #oooq | 04:07 | |
| *** udesale has joined #oooq | 04:11 | |
| *** surpatil has quit IRC | 04:12 | |
| *** dsneddon has joined #oooq | 04:14 | |
| *** dsneddon has quit IRC | 04:19 | |
| *** ykarel|away has quit IRC | 04:35 | |
| *** soniya29 has joined #oooq | 04:42 | |
| *** dsneddon has joined #oooq | 04:51 | |
| *** dsneddon has quit IRC | 04:56 | |
| *** ykarel has joined #oooq | 04:56 | |
| *** dsneddon has joined #oooq | 05:27 | |
| *** surpatil has joined #oooq | 05:28 | |
| *** dsneddon has quit IRC | 05:31 | |
| *** ksambor has joined #oooq | 05:42 | |
| *** ksambor has quit IRC | 05:42 | |
| *** ksambor has joined #oooq | 05:42 | |
| *** ksambor has quit IRC | 05:43 | |
| *** ksambor has joined #oooq | 05:43 | |
| *** ratailor has joined #oooq | 05:44 | |
| *** ksambor has quit IRC | 05:44 | |
| *** ksambor has joined #oooq | 05:45 | |
| *** marios has joined #oooq | 05:57 | |
| *** dsneddon has joined #oooq | 05:57 | |
| *** dsneddon has quit IRC | 06:02 | |
| *** jfrancoa has joined #oooq | 06:02 | |
| *** kopecmartin|off is now known as kopecmartin | 06:16 | |
| *** dsneddon has joined #oooq | 06:30 | |
| *** dsneddon has quit IRC | 06:35 | |
| *** sshnaidm_ is now known as sshnaidm|rover | 06:37 | |
| *** holser has joined #oooq | 07:06 | |
| *** dsneddon has joined #oooq | 07:06 | |
| *** tosky has joined #oooq | 07:08 | |
| *** dsneddon has quit IRC | 07:11 | |
| *** bogdando has joined #oooq | 07:21 | |
| *** akahat has joined #oooq | 07:26 | |
| holser | Morning | 07:27 |
|---|---|---|
| holser | https://lists.centos.org/pipermail/centos-devel/2019-September/017694.html :( | 07:27 |
| *** ykarel is now known as ykarel|lunch | 07:28 | |
| *** amoralej has joined #oooq | 07:32 | |
| *** jpena|off is now known as jpena | 07:34 | |
| *** gchamoul has joined #oooq | 07:37 | |
| *** sshnaidm|rover is now known as sshnaidm|afk | 07:39 | |
| *** apetrich has joined #oooq | 07:44 | |
| *** dsneddon has joined #oooq | 07:46 | |
| *** dsneddon has quit IRC | 07:51 | |
| marios | sshnaidm|afk: fyi merged that to config but shouldn't break anything job is non voting https://review.rdoproject.org/r/#/c/22259/ | 07:54 |
| marios | sshnaidm|afk: (you are ruck? or is it panda now?) | 07:54 |
| *** soniya29 has quit IRC | 07:54 | |
| *** chem has joined #oooq | 07:54 | |
| *** panda has quit IRC | 07:56 | |
| *** panda has joined #oooq | 07:58 | |
| *** matbu has joined #oooq | 08:06 | |
| *** soniya29 has joined #oooq | 08:09 | |
| *** dsneddon has joined #oooq | 08:24 | |
| *** dsneddon has quit IRC | 08:28 | |
| *** saneax has joined #oooq | 08:30 | |
| chandankumar | panda: hello | 08:34 |
| chandankumar | panda: where this var is defined registry_login_enabled ? | 08:35 |
| *** derekh has joined #oooq | 08:38 | |
| *** sshnaidm|afk is now known as sshnaidm|rover | 08:43 | |
| sshnaidm|rover | marios, ack | 08:46 |
| sshnaidm|rover | panda, are you ruck today? | 08:47 |
| chandankumar | boom I have some logs now on container login | 08:47 |
| *** ykarel|lunch is now known as ykarel | 08:49 | |
| *** skramaja has joined #oooq | 08:50 | |
| kopecmartin | chandankumar: here's the task for interns, could you assign it to one of them? https://tree.taiga.io/project/tripleo-ci-board/task/1281 | 08:50 |
| sshnaidm|rover | do we have interns? | 08:53 |
| chandankumar | sshnaidm|rover: yes, two interns | 08:57 |
| *** dsneddon has joined #oooq | 08:57 | |
| chandankumar | kopecmartin: sure | 08:57 |
| kopecmartin | chandankumar: thanks :) | 08:58 |
| *** panda is now known as panda|ruck | 08:59 | |
| *** soniya29 has quit IRC | 09:00 | |
| *** dsneddon has quit IRC | 09:02 | |
| zbr | morning! anything I can help with? | 09:15 |
| marios | zbr: review that? https://review.rdoproject.org/r/#/c/22002/ | 09:18 |
| zbr | marios: afaik pushing a manifest requires you to push images from it before pushing it, was i wrong? | 09:19 |
| marios | zbr: yes you must have the containers tagged in the registry first as described in commit message | 09:27 |
| *** dsneddon has joined #oooq | 09:31 | |
| surpatil | hello surpatil here im a intern | 09:31 |
| surpatil | suraj patil | 09:32 |
| *** soniya29 has joined #oooq | 09:32 | |
| *** dtantsur|afk is now known as dtantsur | 09:32 | |
| soniya29 | kopecmartin, sshnaidm|rover, hello | 09:33 |
| sshnaidm|rover | surpatil, soniya29 hey folks | 09:33 |
| surpatil | hello sshnaidm|rover :) | 09:33 |
| chandankumar | jpena: sshnaidm|rover zbr https://review.rdoproject.org/r/#/c/22299/ | 09:34 |
| sshnaidm|rover | chandankumar, but still worth to print status code | 09:36 |
| *** dsneddon has quit IRC | 09:36 | |
| chandankumar | sshnaidm|rover: you mean exit status? | 09:38 |
| sshnaidm|rover | chandankumar, yeah | 09:38 |
| chandankumar | ok | 09:38 |
| chandankumar | updating it | 09:38 |
| zbr | chandankumar: can registry_login_podman expose secrets? do you have an example to show me (in private) | 09:40 |
| zbr | chandankumar: "unknown reason" is very bad anti-pattern. i want to see if we can avoid exposure without crippling user interface | 09:40 |
| chandankumar | zbr: fixed | 09:43 |
| chandankumar | with exit status | 09:43 |
| *** jaosorior has joined #oooq | 09:45 | |
| zbr | sshnaidm|rover: chandankumar please read my comment on https://review.rdoproject.org/r/c/22299 | 09:50 |
| zbr | the login needs to be secured on https://opendev.org/openstack/tripleo-ansible/src/branch/master/tripleo_ansible/roles/tripleo-podman/tasks/tripleo_podman_login.yml#L21-L22 | 09:50 |
| zbr | avoid giving credentials via CLI | 09:50 |
| sshnaidm|rover | zbr, via cli with env is more secure actually | 09:51 |
| *** dsneddon has joined #oooq | 10:05 | |
| zbr | sshnaidm|rover: chandankumar: see https://review.opendev.org/#/c/682329/2/tripleo_ansible/roles/tripleo-podman/tasks/tripleo_podman_login.yml | 10:06 |
| *** dsneddon has quit IRC | 10:10 | |
| sshnaidm|rover | zbr, commented, it's even worse than was before | 10:18 |
| sshnaidm|rover | zbr, the problem was in leaking "items" | 10:19 |
| sshnaidm|rover | zbr, and now it's leaked also in "cmd" | 10:20 |
| zbr | sshnaidm|rover: have you tried it? the only secret is the password, and is not leaked. see https://gist.github.com/ssbarnea/fc6bb10cf2b14b3765897f722e0e447f | 10:23 |
| sshnaidm|rover | zbr, you'd better test such things | 10:23 |
| sshnaidm|rover | zbr, see my comments | 10:23 |
| zbr | sshnaidm|rover: you are talking about debug mode, something that was exposing the secret even before. | 10:24 |
| zbr | is normal and -v mode, nothing is visible | 10:24 |
| sshnaidm|rover | zbr, no any debug mode | 10:25 |
| sshnaidm|rover | zbr, just take this task and run, it's not difficult | 10:25 |
| zbr | https://seashells.io/v/fjxeJu3F -- i do not see any "secret" there | 10:26 |
| sshnaidm|rover | zbr, when failing, not when passed | 10:27 |
| sshnaidm|rover | zbr, when it's passed no any problem, we struggle with leaking when task failed | 10:27 |
| sshnaidm|rover | zbr, don't run your md5 task, run please a real task from your patch | 10:28 |
| sshnaidm|rover | zbr, it's not testing what you do | 10:28 |
| *** udesale has quit IRC | 10:28 | |
| zbr | sshnaidm|rover: i see what you say, in fact is not my patch exposes them, is the looping. | 10:35 |
| zbr | when using a loop+register you expose the looped content, in our case containing credentials. still, this is not something introduced by my patch. | 10:36 |
| *** dsneddon has joined #oooq | 10:38 | |
| *** dsneddon has quit IRC | 10:43 | |
| *** tesseract has joined #oooq | 10:51 | |
| zbr | sshnaidm|rover: i guess that the answer to the security question is.... | 10:57 |
| zbr | there is no security | 10:57 |
| zbr | clearly that stdin use improves the situation, but the final outcome is relative. | 11:00 |
| sshnaidm|rover | zbr, stdin clearly makes situation much worse, see my comments to patch | 11:05 |
| sshnaidm|rover | zbr, the real solution will be ignore_errors: true, capturint rc code and "fail" task if rc code is not 0 | 11:05 |
| sshnaidm|rover | zbr, then only "fail" task fails and no info is leaked | 11:06 |
| *** marios has quit IRC | 11:09 | |
| *** tesseract has quit IRC | 11:09 | |
| zbr | stdin is moving the secret from .cmd & invocation.module_args._raw_params to invocation.module_ars.stdin -- not really increasing the exposure. | 11:09 |
| zbr | advantage would be that allows us to also log the command line executed. | 11:10 |
| *** dsneddon has joined #oooq | 11:11 | |
| zbr | but this does not fix the other issues, for those your approach will work (log only safe fields from registered result) | 11:11 |
| chandankumar | zbr: sshnaidm|rover In ordet to put final patch for enablig container login will I keep https://github.com/rdo-infra/review.rdoproject.org-config/blob/master/playbooks/tripleo-rdo-base/container-login.yaml#L6 default to false or true? | 11:16 |
| chandankumar | as in jobs these playbooks will be explicitly called | 11:16 |
| *** dsneddon has quit IRC | 11:16 | |
| sshnaidm|rover | chandankumar, default of what? | 11:17 |
| sshnaidm|rover | chandankumar, registry_login_enabled ? | 11:17 |
| chandankumar | sshnaidm|rover: registry_login_enabled | 11:17 |
| chandankumar | yes | 11:17 |
| zbr | chandankumar: good question, mainly adding no_log at that level makes the output barely usable, but at the same time i do not know how to secure it in a different way. | 11:18 |
| chandankumar | if we donot have default value it will leads to retry limit error in the logs | 11:18 |
| sshnaidm|rover | chandankumar, I think we can start with false firstly to see if it breaks nothing, (and add |bool) | 11:18 |
| zbr | chandankumar: how about this: replace conditon by looking if container_registry_logins is empty or not | 11:18 |
| chandankumar | sshnaidm|rover: zbr yes I can do that | 11:18 |
| zbr | you avoid using a boolean by checking if the dictionary with logings is empty | 11:18 |
| zbr | is more pythonic | 11:18 |
| sshnaidm|rover | zbr, it's boolean flag afaiu | 11:19 |
| sshnaidm|rover | and I'd prefer to have it in order to switch on/off easily | 11:20 |
| zbr | yeah i know, but i was trying to say: "do login if there is anything to login into", or am i missing somethign? do we have an execution path where we have credentials but we dont want to login? | 11:20 |
| sshnaidm|rover | zbr, yes, it could be such option | 11:21 |
| zbr | ok. lets keep it like this | 11:22 |
| *** dtantsur is now known as dtantsur|bbl | 11:26 | |
| *** jpena is now known as jpena|lunch | 11:30 | |
| bogdando | o/ PTAL https://review.opendev.org/#/c/682092/4 | 11:30 |
| bogdando | do you know perchance where to dig to figure out the node indexes assigned? | 11:30 |
| bogdando | ykarel: ^^ | 11:31 |
| bogdando | so I have | 11:31 |
| bogdando | [overcloud] | 11:31 |
| bogdando | subnode-2 | 11:31 |
| bogdando | instead of subnode-1 | 11:31 |
| bogdando | https://opendev.org/openstack/tripleo-quickstart/src/branch/master/roles/tripleo-inventory/tasks/inventory.yml#L50 looks the cause... | 11:32 |
| bogdando | not sure where to adjust the things nicely | 11:33 |
| ykarel | bogdando, /me don't know that, but yes ^^ looks the right place where the inventory is populated | 11:33 |
| bogdando | ykarel: it parses /etc/nodepool/sub_nodes_private, but there is only a single IP... | 11:34 |
| bogdando | hm, why do we add +2 and not +1 | 11:35 |
| bogdando | sshnaidm|rover: around? | 11:35 |
| * ykarel don't know +2 reasoning | 11:35 | |
| sshnaidm|rover | bogdando, yep | 11:35 |
| bogdando | so for a 1ctrlr node file and a multinode job, I have a valid distribution of primary/secondary in zuul and nodepool, even works for a single public IP and no private IP (with https://review.opendev.org/#/c/682092/)... The undercloud is matched as primary, and subnode-1 as secondary. But that +2 ruins the further deploynment | 11:38 |
| bogdando | as I have no subnode-2 | 11:38 |
| *** ccamacho has joined #oooq | 11:39 | |
| bogdando | I wonder how much of the things fall into cracks if I set +1 https://opendev.org/openstack/tripleo-quickstart/src/branch/master/roles/tripleo-inventory/tasks/inventory.yml#L50 | 11:39 |
| * bogdando away adjusting his fork | 11:39 | |
| sshnaidm|rover | chandankumar, commented on https://review.rdoproject.org/r/#/c/22299/ | 11:41 |
| sshnaidm|rover | bogdando, in some point it was subnode-1, subnode-2 | 11:44 |
| sshnaidm|rover | bogdando, as I see now it's "primary" and "secondary" | 11:44 |
| *** udesale has joined #oooq | 11:45 | |
| *** soniya29 has quit IRC | 11:47 | |
| sshnaidm|rover | bogdando, hmm.. still see it subnode-2 here: https://e6d7ddba3e6c9e0ac442-b854b998feabd4bf6926393c8ea9e138.ssl.cf5.rackcdn.com/682206/1/check/tripleo-ci-centos-7-containers-multinode/f7e7991/logs/ | 11:47 |
| *** dsneddon has joined #oooq | 11:48 | |
| bogdando | sshnaidm|rover: git story point me to https://review.opendev.org/#/c/450351/ | 11:48 |
| sshnaidm|rover | bogdando, yes, I remember why I did this :) | 11:49 |
| bogdando | let's try +1 back and see how the world collapses?.. | 11:49 |
| sshnaidm|rover | bogdando, or maybe just "secondary" | 11:51 |
| *** dsneddon has quit IRC | 11:52 | |
| *** weshay has joined #oooq | 11:53 | |
| *** amoralej is now known as amoralej|lunch | 11:54 | |
| bogdando | sshnaidm|rover: indeed | 11:57 |
| bogdando | I'll try that | 11:57 |
| bogdando | btw, I was reading about a new devops squad... Shall we merge quickstart with infrared? :) | 12:00 |
| bogdando | weshay: hi ^^ | 12:01 |
| bogdando | got some fancy secrets about that? | 12:01 |
| weshay | bogdando, secrets.. that would be a terrible way to proceed | 12:01 |
| weshay | lol | 12:01 |
| bogdando | :D | 12:01 |
| weshay | bogdando, so there has been some open discussion about it | 12:02 |
| sshnaidm|rover | bogdando, we can merge with infrared... in way like killer whale merges with tuna | 12:03 |
| bogdando | hahah | 12:04 |
| *** marios has joined #oooq | 12:06 | |
| *** soniya29 has joined #oooq | 12:09 | |
| weshay | sshnaidm|rover, panda|ruck fyi.. the box that created cix's got pulled from infra.. /me setting it back up in tripleo-infra | 12:11 |
| sshnaidm|rover | weshay, you can add it in our playbooks, in some jumphost box for example | 12:12 |
| weshay | is the jumpbox still up? | 12:12 |
| sshnaidm|rover | weshay, no.. but there is hubbot | 12:14 |
| weshay | sshnaidm|rover, k.. that works | 12:14 |
| sshnaidm|rover | weshay, I think we had a task to create a general toolbox? Now everybody create a separate instance for each script | 12:14 |
| sshnaidm|rover | iirc we even choose the name for this toolbox | 12:15 |
| sshnaidm|rover | like half job is done | 12:15 |
| weshay | hrm.. can you raise that in ideas_for_improvement | 12:17 |
| *** sanjayu_ has joined #oooq | 12:17 | |
| *** saneax has quit IRC | 12:18 | |
| *** rfolco has joined #oooq | 12:23 | |
| *** dsneddon has joined #oooq | 12:24 | |
| *** rlandy has joined #oooq | 12:25 | |
| weshay | panda|ruck, the stein ci.centos job is reporting failure to dlrn when the job passed | 12:28 |
| weshay | panda|ruck, can you get that fixed please https://ci.centos.org/job/tripleo-quickstart-promote-stein-current-tripleo-delorean-minimal/197/console | 12:29 |
| weshay | and make sure we promote stein rdo | 12:29 |
| *** dsneddon has quit IRC | 12:30 | |
| sshnaidm|rover | weshay, I had to increase deploy_timeout to make stein rdo job passing.. | 12:30 |
| sshnaidm|rover | weshay, seems like we have a problem there, something is slowing down the deploy | 12:30 |
| panda|ruck | and causing the reporting to fail | 12:32 |
| *** jpena|lunch is now known as jpena | 12:33 | |
| *** ratailor has quit IRC | 12:34 | |
| weshay | panda|ruck, fyi.. need repro https://trello.com/c/DvgaBFim/1104-cixlp1843259tripleociproa-periodic-rocky-fs020-job-fails-tempest-tests-tempestscenariotestsecuritygroupsbasicopstestsecuritygrou | 12:39 |
| rfolco | marios, panda|ruck rlandy weshay would you please review ? this seems to be ready https://review.rdoproject.org/r/#/c/21872/ | 12:41 |
| marios | rfolco: ack will check in bit noting | 12:42 |
| rlandy | rfolco: you're promoting to docker.io? | 12:42 |
| rlandy | and reading rdo reg | 12:42 |
| rlandy | no internal regs? | 12:42 |
| rlandy | ^^ discuss this at meeting | 12:42 |
| rfolco | rlandy, why you asking ? checking my patch again... | 12:43 |
| * weshay notes infra also ate my bouncer | 12:49 | |
| *** amoralej|lunch is now known as amoralej | 12:57 | |
| *** dsneddon has joined #oooq | 12:57 | |
| weshay | sshnaidm|rover, k.. the last job passed, but ya.. took a long time | 12:59 |
| weshay | perf regressions | 13:00 |
| weshay | we need ara in the overcloud back | 13:00 |
| rfolco | ping scrum | 13:00 |
| rfolco | ping scrum | 13:00 |
| sshnaidm|rover | weshay, we should have ara on overcloud, we don't have on undercloud | 13:00 |
| rfolco | marios, rlandy panda|ruck zbr arxcruz | 13:00 |
| weshay | sshnaidm|rover, oh really? that's something everyone should see /me looks | 13:00 |
| sshnaidm|rover | weshay, always had | 13:01 |
| marios | rfolco: sory joining | 13:01 |
| sshnaidm|rover | weshay, https://logs.rdoproject.org/63/22163/4/check/tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-master-vexxhost/0ecdaac/logs/ara_oooq_overcloud/ara-report/ | 13:01 |
| *** dsneddon has quit IRC | 13:02 | |
| rfolco | zbr, rlandy | 13:02 |
| *** bogdando has quit IRC | 13:06 | |
| *** bogdando has joined #oooq | 13:09 | |
| *** Goneri has joined #oooq | 13:11 | |
| weshay | zbr, :) thanks for joining | 13:11 |
| *** matbu has quit IRC | 13:11 | |
| *** bogdando has quit IRC | 13:11 | |
| *** matbu has joined #oooq | 13:12 | |
| weshay | can we supress the logging on TASK [promoter : clone promoter dir from local dir if present] ***************** | 13:17 |
| *** aakarsh|2 has joined #oooq | 13:18 | |
| *** aakarsh|3 has joined #oooq | 13:21 | |
| zbr | chandankumar: ok if I update 22299 to fix the looping? | 13:23 |
| chandankumar | zbr: yes | 13:23 |
| *** aakarsh|2 has quit IRC | 13:23 | |
| chandankumar | panda|ruck: Do we need to enable container login for standalone jobs also na? | 13:24 |
| panda|ruck | chandankumar: for everything. | 13:24 |
| -openstackstatus- NOTICE: The Gerrit service on review.opendev.org will be offline briefly starting at 14:00 UTC (that's roughly 30 minutes from now) for maintenance: http://lists.openstack.org/pipermail/openstack-discuss/2019-September/009064.html | 13:27 | |
| *** skramaja has quit IRC | 13:27 | |
| *** bogdando has joined #oooq | 13:27 | |
| sshnaidm|rover | chandankumar, for periodic ones, right? | 13:34 |
| *** dsneddon has joined #oooq | 13:35 | |
| weshay | sshnaidm|rover, thanks for pointing out ara.. | 13:35 |
| weshay | sshnaidm|rover, looks like the upstream jobs are not rendering the ara page https://storage.gra1.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_879/682055/1/check/tripleo-ci-centos-7-containers-multinode/879e1c1/logs/ara_oooq_overcloud/ | 13:36 |
| weshay | https://8729da22a49c2d7a78d7-1b102124c6fd0b6d71635117190cffc0.ssl.cf5.rackcdn.com/672969/3/check/tripleo-ci-centos-7-containers-multinode/a21975e/logs/ara_oooq_overcloud/ara-report/ | 13:36 |
| weshay | is that something infra blocked us on? | 13:36 |
| sshnaidm|rover | weshay, yes, it's after infra changed their logs handling | 13:36 |
| weshay | fun | 13:36 |
| chandankumar | zbr: since we get rid of assert, we can do that same for docker part also | 13:38 |
| zbr | yeah, already done that but I am also collapsing them into a single task | 13:39 |
| *** dsneddon has quit IRC | 13:40 | |
| chandankumar | panda|ruck: sshnaidm|rover: I started testing with standalone one, so we need to enable login for all the base which is defined here https://github.com/rdo-infra/review.rdoproject.org-config/blob/master/zuul.d/tripleo-rdo-base.yaml except container build jobs as they have different playbook? | 13:41 |
| weshay | zbr, https://github.com/rdo-infra/ci-config/blob/master/ci-scripts/dlrnapi_promoter/config/RedHat-8/master.ini | 13:43 |
| panda|ruck | chandankumar: why selecting the jobs to login ? why not just enable it for everything ? | 13:43 |
| sshnaidm|rover | panda|ruck, you don't auth with docker.io in regular jobs | 13:44 |
| weshay | https://meet.google.com/oei-zqpp-mia | 13:45 |
| panda|ruck | auth was not meant for docker.io | 13:45 |
| panda|ruck | auth was tied to the fact we wanted to close down rdo-registry | 13:45 |
| weshay | panda|ruck, sshnaidm|rover do you guys have any idea if zoltan got the image server clean up script done? https://tree.taiga.io/project/morucci-software-factory/issue/2961 | 13:47 |
| sshnaidm|rover | weshay, no, but I can ask him | 13:48 |
| *** chem` has joined #oooq | 13:48 | |
| *** chem has quit IRC | 13:49 | |
| zbr | weshay: sshnaidm|rover : is this what we needed https://review.rdoproject.org/r/c/22306/ ? | 13:49 |
| weshay | zbr, please also add fs001 | 13:50 |
| weshay | zbr, then sshnaidm|rover and panda|ruck can review | 13:50 |
| *** holser has quit IRC | 13:50 | |
| *** surpatil has quit IRC | 13:51 | |
| zbr | weshay: done, updated and also sorted list. | 13:52 |
| weshay | zbr, rock on.. thanks! | 13:53 |
| weshay | zbr, this closes out that user story :) | 13:53 |
| *** soniya29 has quit IRC | 13:54 | |
| weshay | well done folks https://tree.taiga.io/project/tripleo-ci-board/epic/940 | 13:55 |
| weshay | chandankumar, last one is auth :) | 13:55 |
| weshay | panda|ruck, sshnaidm|rover wow.. 92% pass rate in upstream :)) | 13:57 |
| weshay | that's as high as I've see that in the cockpit | 13:57 |
| *** gchamoul has quit IRC | 13:58 | |
| weshay | zbr, sorry.. one more thing | 14:00 |
| weshay | zbr, http://cistatus.tripleo.org/promotion/ | 14:00 |
| weshay | scen001/002 need to be added to that config | 14:00 |
| weshay | zbr, pull request to sshnaidm's sova repo | 14:00 |
| -openstackstatus- NOTICE: The Gerrit service on review.opendev.org is offline briefly for maintenance: http://lists.openstack.org/pipermail/openstack-discuss/2019-September/009064.html | 14:01 | |
| *** ChanServ changes topic to "The Gerrit service on review.opendev.org is offline briefly for maintenance: http://lists.openstack.org/pipermail/openstack-discuss/2019-September/009064.html" | 14:01 | |
| zbr | marios: where? | 14:02 |
| *** ykarel is now known as ykarel|afk | 14:03 | |
| weshay | zbr https://meet.google.com/oei-zqpp-mia | 14:03 |
| *** holser has joined #oooq | 14:07 | |
| *** dsneddon has joined #oooq | 14:07 | |
| weshay | zbr, did you understand my sova comment? | 14:08 |
| zbr | zbr: did not see it, where? | 14:09 |
| weshay | <weshay> zbr, sorry.. one more thing | 14:10 |
| weshay | <weshay> zbr, http://cistatus.tripleo.org/promotion/ | 14:10 |
| weshay | <weshay> scen001/002 need to be added to that config | 14:10 |
| weshay | <weshay> zbr, pull request to sshnaidm's sova repo | 14:10 |
| *** gchamoul has joined #oooq | 14:10 | |
| zbr | weshay: ahh... so that is not using our config. | 14:11 |
| weshay | zbr, sova does not use the promotion ini files.. no | 14:11 |
| *** dsneddon has quit IRC | 14:11 | |
| weshay | sshnaidm|rover, is this correct for the promotion jobs? https://github.com/sshnaidm/sova/tree/promotion | 14:12 |
| weshay | zbr, https://github.com/sshnaidm/sova/blob/promotion/tripleoci/config.py#L143-L147 | 14:12 |
| sshnaidm|rover | weshay, yes | 14:13 |
| weshay | cool.. thanks | 14:13 |
| zbr | weshay: doing it. can't we just move sova to rdo? using github is a PITA | 14:13 |
| weshay | zbr, yes that's an option, but I don't really care too much | 14:14 |
| sshnaidm|rover | zbr, firstly need to review this patch https://review.opendev.org/678630 | 14:14 |
| sshnaidm|rover | weshay, ^ | 14:14 |
| weshay | zbr, retro idea for improvement | 14:14 |
| sshnaidm|rover | oh, gerrit is down | 14:14 |
| zbr | yeah. once case where gh sucks less, it is up. | 14:16 |
| zbr | anyway, gerrit uptime was really good, cannot complain. | 14:16 |
| zbr | you should have seen how often jenkins was going down downstream.... | 14:17 |
| zbr | sshnaidm|rover: a hint on how to add the missing periodics in sova? | 14:17 |
| sshnaidm|rover | zbr, just add names to this list: https://github.com/sshnaidm/sova/blob/promotion/tripleoci/config.py#L143-L147 | 14:18 |
| sshnaidm|rover | zbr, in pull request | 14:18 |
| zbr | thanks | 14:18 |
| zbr | sshnaidm|rover: OMG, not on master branch... :( :( :( | 14:19 |
| zbr | that is why i was clueless | 14:19 |
| sshnaidm|rover | zbr, yeah, on "promotion" branch | 14:19 |
| chandankumar | zbr: now we have two reviews https://review.rdoproject.org/r/22299 and https://review.rdoproject.org/r/22305 can we merge in a single one? | 14:22 |
| zbr | i created is separated as i was not ready yet and was too different. obbiosuly that we will merge only one of them | 14:23 |
| zbr | https://github.com/sshnaidm/sova/pull/78 | 14:24 |
| *** akahat has quit IRC | 14:26 | |
| chandankumar | sshnaidm|rover: let's merge zbr patch then https://review.rdoproject.org/r/#/c/22305/ | 14:26 |
| chandankumar | I will abandon mine | 14:26 |
| zbr | chandankumar: wait few more minutes to consolidate it, i want to make it a single task | 14:26 |
| zbr | only the var name is different | 14:26 |
| chandankumar | ok | 14:26 |
| *** ykarel_ has joined #oooq | 14:26 | |
| zbr | less code/tasks = less bugs | 14:27 |
| *** ykarel_ has quit IRC | 14:27 | |
| sshnaidm|rover | zbr, I think you need registry_login_docker.results, not registry_login_docker | 14:29 |
| zbr | yeah, thanks | 14:29 |
| zbr | trying to figure out how to combine, i guess with ternary | 14:29 |
| weshay | chandankumar, rfolco planning.. | 14:30 |
| *** ykarel|afk has quit IRC | 14:30 | |
| weshay | chandankumar, rfolco https://bluejeans.com/5878458097 | 14:30 |
| weshay | chandankumar, you there? | 14:31 |
| chandankumar | weshay: joined | 14:31 |
| sshnaidm|rover | zbr, see my comment to previous patch sets | 14:31 |
| sshnaidm|rover | zbr, with map(attribute), list and join | 14:31 |
| *** sanjayu_ has quit IRC | 14:32 | |
| *** sanjayu_ has joined #oooq | 14:32 | |
| sshnaidm|rover | zbr, actually if you loop over results, you don't need to combine | 14:33 |
| *** ChanServ changes topic to "Docs: https://docs.openstack.org/tripleo-quickstart/latest/" | 14:33 | |
| -openstackstatus- NOTICE: The Gerrit outage portion of the current maintenance is complete and the service is back on line, however reindexing for renamed repositories is still underway and some Zuul job fixes are in the process of being applied | 14:33 | |
| *** dsneddon has joined #oooq | 14:41 | |
| *** dsneddon has quit IRC | 14:46 | |
| marios | arxcruz: sync tomorrow morning OK for you? | 14:46 |
| marios | arxcruz: we can have a quick call i think its the easiest? are you busy in the morning | 14:47 |
| arxcruz | marios: sure | 14:47 |
| marios | arxcruz: i'll send an invite so we can make it official :D | 14:47 |
| arxcruz | marios: 5 minutes before right? :D | 14:47 |
| marios | arxcruz: taiga/review please? | 14:47 |
| marios | arxcruz: now doing | 14:48 |
| marios | but 17:47 < marios> arxcruz: taiga/review please? | 14:48 |
| arxcruz | marios: https://tree.taiga.io/project/tripleo-ci-board/task/1204?kanban-status=1447275 | 14:48 |
| arxcruz | marios: brb | 14:48 |
| marios | arxcruz: thanks check email in like 5 mins :D | 14:49 |
| marios | weshay: cool, calendar seems to be integrated with meet :D | 14:50 |
| marios | weshay: when you schedule stuffs | 14:50 |
| marios | arxcruz: sent let me know if you want to move the time | 14:53 |
| marios | arxcruz: anything works for me either side of that | 14:53 |
| zbr | sshnaidm|rover: let me know if this version looks ok https://review.rdoproject.org/r/c/22305/ | 14:54 |
| *** sanjayu_ has quit IRC | 14:54 | |
| sshnaidm|rover | zbr, looking | 14:55 |
| sshnaidm|rover | chandankumar, arxcruz did you see this error? http://logs.rdoproject.org/35/681635/1/openstack-check/tripleo-ci-rhel-8-standalone-rdo/b3c9c4f/logs/undercloud/home/zuul/tempest.log.txt.gz | 14:56 |
| sshnaidm|rover | chandankumar, arxcruz it's from patch: https://review.opendev.org/#/c/681635/1 | 14:56 |
| zbr | i do assume that podman/docker return code can be trusted | 14:56 |
| bogdando | rlandy: hi | 15:01 |
| sshnaidm|rover | zbr, I'd prefer to have 2 tasks as it was, you change the logic here and bring complexity | 15:01 |
| rlandy | bogdando" hello | 15:01 |
| bogdando | rlandy, sshnaidm|rover: with https://review.opendev.org/#/c/682346/ and https://review.opendev.org/#/c/682092/ I have now a multi-node jobs deploying with CI repro | 15:01 |
| sshnaidm|rover | zbr, in original patch there was nothing about registry_login_docker defined or not | 15:01 |
| zbr | i can replace that with the distro check | 15:02 |
| bogdando | there is also a few https://review.rdoproject.org/r/#/q/topic:ci-repro+(status:open) | 15:02 |
| zbr | sshnaidm|rover: are these two tasks mutually exclusive or not? | 15:03 |
| sshnaidm|rover | zbr, they depend on distro as I can see | 15:03 |
| sshnaidm|rover | weshay, ready? | 15:03 |
| rlandy | bogdando: k - will take a look when all the ci completes | 15:04 |
| bogdando | thanks | 15:04 |
| sshnaidm|rover | bogdando, rlandy consider also legacy pre playbooks in rdo | 15:07 |
| *** pierrepr1netti is now known as pierreprinetti | 15:10 | |
| rlandy | marios: rfolco: http://pastebin.test.redhat.com/797530 - query command for v2 repos | 15:10 |
| *** ykarel has joined #oooq | 15:12 | |
| marios | rlandy: thank you checking & saving | 15:13 |
| *** dsneddon has joined #oooq | 15:13 | |
| weshay | sshnaidm|rover, I'm in | 15:13 |
| chandankumar | sshnaidm|rover: https://review.opendev.org/681352 might fix it | 15:15 |
| chandankumar | a lot of patches coming soon related to nova less deploy | 15:16 |
| *** dsneddon has quit IRC | 15:18 | |
| *** dtantsur|bbl is now known as dtantsur | 15:23 | |
| rlandy | panda|ruck: hi - have a few minutes to discuss fixtures for promoter staging set up? http://pastebin.test.redhat.com/797545 - I'm adding the loval registry and the namespace | 15:39 |
| rlandy | local | 15:39 |
| panda|ruck | rlandy: the error is related to an existing sqllite db file, means that the cleanup was not done correctly | 15:42 |
| rlandy | panda|ruck: can I manually clean up? | 15:43 |
| *** amoralej is now known as amoralej|off | 15:44 | |
| panda|ruck | rlandy: yes, the database and the tree are in /tmp/ for the pytest part | 15:47 |
| weshay | rfolco, we need to have a chat w/ Mike from IBM re: | 15:50 |
| weshay | http://lists.openstack.org/pipermail/openstack-discuss/2019-September/009374.html | 15:50 |
| weshay | rfolco, can you please get in touch w/ him asap | 15:50 |
| *** dsneddon has joined #oooq | 15:52 | |
| rfolco | mjturek, ^^ | 15:52 |
| *** ccamacho has quit IRC | 15:52 | |
| rfolco | mjturek, need to answer that thread ^ | 15:53 |
| rfolco | baha, fyi ^ | 15:54 |
| mjturek | will do! | 15:54 |
| *** dsneddon has quit IRC | 15:57 | |
| *** ccamacho has joined #oooq | 15:58 | |
| mjturek | The rabbitmq issue confuses me as that's not preventing the builds... | 15:58 |
| mjturek | should we be concerned there? | 15:58 |
| *** dsneddon has joined #oooq | 16:00 | |
| rfolco | weshay, mjturek baha wanna chat about it ? what about now ? | 16:01 |
| mjturek | rfolco sure, doing some investigation now | 16:02 |
| rfolco | mjturek, ok, let me know if you need to chat. I'll be around. | 16:02 |
| *** holser has quit IRC | 16:04 | |
| marios | ttyl folks | 16:10 |
| *** marios is now known as marios|out | 16:10 | |
| *** bogdando has quit IRC | 16:10 | |
| weshay | zbr, ping me when you have 5min | 16:13 |
| weshay | re: centos8 | 16:13 |
| mjturek | rfolco, baha, weshay: Maybe we should have a chat as rfolco suggested to get us all on the same page | 16:15 |
| mjturek | I'm available whenever | 16:15 |
| weshay | me too | 16:15 |
| weshay | rfolco, you avail? | 16:15 |
| rfolco | weshay, ok | 16:15 |
| rfolco | weshay, your blue? https://bluejeans.com/5878458097 | 16:16 |
| *** marios|out has quit IRC | 16:16 | |
| rfolco | mjturek, baha ^ | 16:17 |
| zbr | weshay: yeah | 16:18 |
| *** kopecmartin is now known as kopecmartin|off | 16:18 | |
| *** ykarel is now known as ykarel|away | 16:24 | |
| *** ccamacho has quit IRC | 16:27 | |
| *** udesale has quit IRC | 16:32 | |
| *** ykarel|away has quit IRC | 16:34 | |
| *** rlandy is now known as rlandy|brb | 16:44 | |
| weshay | zbr, now a good time? | 16:46 |
| zbr | yeah. bj? | 16:46 |
| weshay | zbr https://meet.google.com/fmo-dgtm-std | 16:47 |
| mjturek | weshay rfolco baha: responded here http://lists.openstack.org/pipermail/openstack-discuss/2019-September/009383.html | 16:47 |
| rfolco | mjturek, thx | 16:47 |
| *** sshnaidm|rover is now known as sshnaidm|afk | 16:49 | |
| weshay | zbr, https://tree.taiga.io/project/tripleo-ci-board/epic/1082 | 16:56 |
| *** jpena is now known as jpena|off | 16:58 | |
| *** derekh has quit IRC | 17:00 | |
| *** jfrancoa has quit IRC | 17:13 | |
| *** dtantsur is now known as dtantsur|afk | 17:14 | |
| *** Goneri has quit IRC | 17:21 | |
| *** aakarsh|3 has quit IRC | 17:25 | |
| *** weshay has quit IRC | 17:25 | |
| *** jfrancoa has joined #oooq | 17:28 | |
| *** ykarel|away has joined #oooq | 17:29 | |
| *** rlandy|brb is now known as rlandy | 17:29 | |
| rfolco | rlandy, can we chat? | 17:48 |
| rlandy | yes | 17:52 |
| *** weshay has joined #oooq | 17:52 | |
| *** ccamacho has joined #oooq | 17:53 | |
| rfolco | rlandy, https://meet.google.com/agw-dprx-qxe | 17:54 |
| chandankumar | zbr: rfolco rlandy weshay centos8 is coming https://twitter.com/CentOSProject/status/1173652996305170432 | 17:59 |
| chandankumar | will there be centos8 ubi images also | 18:00 |
| chandankumar | ? | 18:00 |
| weshay | chandankumar, meh.. don't know | 18:00 |
| weshay | chandankumar, zbr is going to go after the nodepool image for us | 18:00 |
| chandankumar | weshay: cool, looking forward :-) | 18:00 |
| chandankumar | weshay: I think we can unblock the centos 8 epic, as it is no longer myth | 18:01 |
| chandankumar | weshay: zbr do we have cr repo for centos8? | 18:02 |
| *** Goneri has joined #oooq | 18:02 | |
| weshay | chandankumar, nope.. I just got off the phone w/ zbr about it.. | 18:02 |
| weshay | chandankumar, he'll be driving it | 18:03 |
| chandankumar | zbr: :-) | 18:03 |
| chandankumar | I hope all our python3 issues gets resolved | 18:03 |
| chandankumar | zbr: if you need any help nodepool image side for rdo, let me know I can help. | 18:07 |
| zbr | chandankumar: don't hyperventilate! that tweet does not mention centos 8, it could 7.7 on 24th. | 18:21 |
| chandankumar | zbr: yes, correct | 18:24 |
| *** aakarsh has joined #oooq | 18:44 | |
| rfolco | rlandy, whaaat... https://review.rdoproject.org/r/#/c/22256/ gate job failed? | 18:45 |
| *** ykarel|away has quit IRC | 18:46 | |
| *** fmount has quit IRC | 18:52 | |
| *** aakarsh has quit IRC | 18:56 | |
| rlandy | rfolco: sorry = my sister just dropped by .. back in a bit | 18:58 |
| *** rlandy is now known as rlandy|biab | 18:59 | |
| rfolco | np | 18:59 |
| *** dsneddon has quit IRC | 19:05 | |
| *** holser has joined #oooq | 19:07 | |
| *** holser has quit IRC | 19:11 | |
| *** aakarsh has joined #oooq | 19:17 | |
| *** aakarsh|2 has joined #oooq | 19:21 | |
| *** aakarsh has quit IRC | 19:23 | |
| *** chem` has quit IRC | 19:28 | |
| *** ccamacho has quit IRC | 19:31 | |
| *** jtomasek has quit IRC | 19:34 | |
| *** holser has joined #oooq | 19:35 | |
| *** holser has quit IRC | 19:39 | |
| *** dsneddon has joined #oooq | 19:41 | |
| *** holser has joined #oooq | 19:51 | |
| *** dsneddon has quit IRC | 19:56 | |
| *** rlandy|biab is now known as rlandy | 19:57 | |
| rlandy | rfolco: sorry - back | 19:57 |
| rlandy | looking at gate failure | 19:57 |
| rlandy | rerunning that | 19:57 |
| rfolco | rlandy, I am combining my 2 patches into a single one, and will rebase on top of yours when you fix local registry var | 19:58 |
| rlandy | rfolco: shoot - it merged | 19:58 |
| rlandy | non-voting | 19:58 |
| rlandy | ugh | 19:58 |
| rfolco | rlandy, I don't know what happened there | 19:59 |
| rfolco | rlandy, rebase probably messed it up | 20:00 |
| rlandy | no idea - no log | 20:00 |
| rlandy | will recheck my patch | 20:00 |
| *** pierreprinetti has quit IRC | 20:10 | |
| rlandy | rfolco: test running now | 20:19 |
| rlandy | with variables | 20:19 |
| rfolco | nice | 20:20 |
| rlandy | watching the molecule test to see what fails | 20:20 |
| rfolco | I integrated the containers list patch in to the dlrn invokation patch | 20:20 |
| rfolco | and also, when we rebase we can move cleanup part to separate file - https://review.rdoproject.org/r/#/c/21872/17/ci-scripts/infra-setup/roles/promoter/tasks/teardown.yml | 20:21 |
| rlandy | rfolco" sorry for earlier delay ... my sister and all her kids dropped by unexpectedly | 20:21 |
| rfolco | rlandy, I need the cleanup separated from the setup | 20:21 |
| rfolco | rlandy, stop apologizing :) | 20:21 |
| *** jfrancoa has quit IRC | 20:21 | |
| rfolco | its all good timing, wan't blocked at all | 20:22 |
| rfolco | wasn't* | 20:22 |
| rlandy | rfolco: http://pastebin.test.redhat.com/797657 - molecule failure | 20:22 |
| *** dsneddon has joined #oooq | 20:24 | |
| rlandy | 2019-09-16 20:21:41.488133 | rdo-fedora-stable | __import__(name) | 20:25 |
| rlandy | 2019-09-16 20:21:41.488282 | rdo-fedora-stable | File "/home/zuul/src/review.rdoproject.org/rdo-infra/ci-config/.tox/molecule/lib/python2.7/site-packages/pytest_molecule/__init__.py", line 11, in <module> | 20:25 |
| rlandy | 2019-09-16 20:21:41.488326 | rdo-fedora-stable | from molecule.config import molecule_drivers | 20:25 |
| rlandy | 2019-09-16 20:21:41.488370 | rdo-fedora-stable | ImportError: cannot import name molecule_drivers | 20:25 |
| rlandy | zbr: ^^? | 20:25 |
| rlandy | that is a new error | 20:25 |
| *** dsneddon has quit IRC | 20:29 | |
| rlandy | https://github.com/rdo-infra/ci-config/commits/master | 20:36 |
| rlandy | don;t see any changes there | 20:36 |
| rlandy | http://logs.rdoproject.org/55/22255/7/check/rdo-tox-molecule/8bd9cdd/tox/reports.html - hmmm - canb't see what versions were installed | 20:38 |
| rlandy | rfolco: ^^ idk - question for zbr | 20:41 |
| rlandy | idk what changed | 20:41 |
| *** aakarsh|2 has quit IRC | 20:46 | |
| rlandy | rfolco: ha - it's zbr's doing https://github.com/ansible/molecule/commit/745b370aff3edb99b3de9e7545b147e5eec58c7d | 20:48 |
| rlandy | zbr: ping, ping | 20:49 |
| *** dsneddon has joined #oooq | 21:01 | |
| *** dsneddon has quit IRC | 21:06 | |
| *** panda|ruck has quit IRC | 21:10 | |
| rlandy | do we lock our molecule version? | 21:15 |
| *** aakarsh|2 has joined #oooq | 21:15 | |
| *** panda has joined #oooq | 21:16 | |
| *** dsneddon has joined #oooq | 21:23 | |
| rlandy | rfolco: https://github.com/pycontribs/pytest-molecule/pull/40/files | 21:24 |
| rlandy | abr's fix ^^ | 21:24 |
| rlandy | zbr's fix | 21:24 |
| rlandy | not merged yet | 21:24 |
| rfolco | rlandy, thx, will rebase on your patch later | 21:36 |
| rlandy | rfolco: the tests won;t run :( | 21:37 |
| rlandy | sent email | 21:37 |
| rlandy | to ask zbr to push the fix | 21:37 |
| *** holser has quit IRC | 21:54 | |
| *** holser has joined #oooq | 22:34 | |
| *** tosky has quit IRC | 22:35 | |
| *** Tengu has quit IRC | 23:11 | |
| *** holser has quit IRC | 23:35 | |
| *** rlandy has quit IRC | 23:43 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!