| openstackgerrit | RedHat RDO CI proposed openstack/tripleo-quickstart-extras master: GATE CHECK for quickstart-extras https://review.openstack.org/560445 | 00:00 |
|---|---|---|
| *** mjturek has quit IRC | 00:02 | |
| *** ooolpbot has joined #tripleo | 00:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 00:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1786764 | 00:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1787910 | 00:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1789416 | 00:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1789437 | 00:10 |
| openstack | Launchpad bug 1786764 in tripleo "tripleo-ci-centos-7-scenario000-multinode-oooq-container-updates times out on prepare" [Critical,Triaged] - Assigned to Sorin Sbarnea (ssbarnea) | 00:10 |
| *** ooolpbot has quit IRC | 00:10 | |
| openstack | Launchpad bug 1787910 in tripleo "OVB overcloud deploy fails on nova placement errors" [Critical,Triaged] - Assigned to Marios Andreou (marios-b) | 00:10 |
| openstack | Launchpad bug 1789416 in tripleo "stable/queens: No image with the name 'bm-deploy-kernel' found - make sure you have uploaded boot images."" [Critical,In progress] - Assigned to wes hayutin (weshayutin) | 00:10 |
| openstack | Launchpad bug 1789437 in tripleo "missing rpm deps in rocky builds causing dlrn build errors" [Critical,Triaged] | 00:10 |
| *** sri_ has quit IRC | 00:11 | |
| *** sri_ has joined #tripleo | 00:13 | |
| *** ansmith has quit IRC | 00:16 | |
| *** ansmith has joined #tripleo | 00:19 | |
| *** lblanchard has quit IRC | 00:25 | |
| *** sri_ has quit IRC | 00:30 | |
| *** sri_ has joined #tripleo | 00:30 | |
| *** sri_ has quit IRC | 00:32 | |
| *** rlandy is now known as rlandy|bbl | 00:33 | |
| *** sri_ has joined #tripleo | 00:33 | |
| *** rh-jelabarre has quit IRC | 00:38 | |
| *** sri_ has quit IRC | 00:40 | |
| *** sri_ has joined #tripleo | 00:41 | |
| *** sri_ has quit IRC | 00:42 | |
| *** sri_ has joined #tripleo | 00:43 | |
| openstackgerrit | Jill Rouleau proposed openstack/ansible-role-tripleo-aodh master: Add required role repo contents https://review.openstack.org/597334 | 00:53 |
| openstackgerrit | Jill Rouleau proposed openstack/ansible-role-tripleo-barbican master: Add required role repo contents https://review.openstack.org/597335 | 00:53 |
| openstackgerrit | Jill Rouleau proposed openstack/ansible-role-tripleo-ceilometer master: Add required role repo contents https://review.openstack.org/597336 | 00:53 |
| openstackgerrit | Jill Rouleau proposed openstack/ansible-role-tripleo-cinder master: Add required role repo contents https://review.openstack.org/597337 | 00:53 |
| openstackgerrit | Jill Rouleau proposed openstack/ansible-role-tripleo-congress master: Add required role repo contents https://review.openstack.org/597338 | 00:53 |
| *** rpioso is now known as rpioso|afk | 00:57 | |
| *** jcoufal has quit IRC | 01:02 | |
| *** sri_ has quit IRC | 01:04 | |
| *** sri_ has joined #tripleo | 01:05 | |
| *** dmacpher has joined #tripleo | 01:08 | |
| *** itlinux is now known as itlinux-away | 01:09 | |
| *** ooolpbot has joined #tripleo | 01:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 01:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1786764 | 01:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1787910 | 01:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1789416 | 01:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1789437 | 01:10 |
| openstack | Launchpad bug 1786764 in tripleo "tripleo-ci-centos-7-scenario000-multinode-oooq-container-updates times out on prepare" [Critical,Triaged] - Assigned to Sorin Sbarnea (ssbarnea) | 01:10 |
| *** ooolpbot has quit IRC | 01:10 | |
| openstack | Launchpad bug 1787910 in tripleo "OVB overcloud deploy fails on nova placement errors" [Critical,Triaged] - Assigned to Marios Andreou (marios-b) | 01:10 |
| openstack | Launchpad bug 1789416 in tripleo "stable/queens: No image with the name 'bm-deploy-kernel' found - make sure you have uploaded boot images."" [Critical,In progress] - Assigned to wes hayutin (weshayutin) | 01:10 |
| openstack | Launchpad bug 1789437 in tripleo "missing rpm deps in rocky builds causing dlrn build errors" [Critical,Triaged] | 01:10 |
| *** fungi has quit IRC | 01:18 | |
| *** kambiz has quit IRC | 01:19 | |
| *** odyssey4me has quit IRC | 01:19 | |
| *** mcarden has quit IRC | 01:19 | |
| *** beagles has quit IRC | 01:19 | |
| *** sdoran has quit IRC | 01:19 | |
| *** dtantsur|afk has quit IRC | 01:19 | |
| *** fungi has joined #tripleo | 01:19 | |
| *** beagles has joined #tripleo | 01:19 | |
| *** odyssey4me has joined #tripleo | 01:20 | |
| *** kambiz has joined #tripleo | 01:21 | |
| *** itlinux-away is now known as itlinux | 01:21 | |
| *** dtantsur has joined #tripleo | 01:22 | |
| *** itlinux is now known as itlinux-away | 01:22 | |
| *** gbarros has joined #tripleo | 01:22 | |
| *** sri_ has quit IRC | 01:22 | |
| stevebaker | jillr: hey are you about? | 01:23 |
| *** itlinux-away is now known as itlinux | 01:24 | |
| *** itlinux is now known as itlinux-away | 01:24 | |
| *** sri_ has joined #tripleo | 01:25 | |
| *** itlinux-away is now known as itlinux | 01:27 | |
| *** itlinux is now known as itlinux-away | 01:27 | |
| *** sri_ has quit IRC | 01:28 | |
| *** itlinux-away is now known as itlinux | 01:28 | |
| *** itlinux is now known as itlinux-away | 01:29 | |
| *** sri_ has joined #tripleo | 01:29 | |
| openstackgerrit | Merged openstack/ansible-role-tripleo-barbican master: Add required role repo contents https://review.openstack.org/597335 | 01:32 |
| openstackgerrit | Merged openstack/ansible-role-tripleo-aodh master: Add required role repo contents https://review.openstack.org/597334 | 01:34 |
| openstackgerrit | Merged openstack/ansible-role-tripleo-ceilometer master: Add required role repo contents https://review.openstack.org/597336 | 01:34 |
| openstackgerrit | Merged openstack/ansible-role-tripleo-congress master: Add required role repo contents https://review.openstack.org/597338 | 01:35 |
| openstackgerrit | Steve Baker proposed openstack/tripleo-common master: Refactor non-docker upload functions into base class https://review.openstack.org/590084 | 01:37 |
| openstackgerrit | Steve Baker proposed openstack/tripleo-common master: Skopeo based uploader https://review.openstack.org/590086 | 01:37 |
| openstackgerrit | Steve Baker proposed openstack/tripleo-common master: WIP Make skopeo the default uploader https://review.openstack.org/590087 | 01:37 |
| openstackgerrit | Steve Baker proposed openstack/tripleo-common master: WIP cross repo mount for skopeo registry->registry https://review.openstack.org/596016 | 01:37 |
| openstackgerrit | Steve Baker proposed openstack/tripleo-common master: WIP POC export image data to crane format https://review.openstack.org/596017 | 01:37 |
| openstackgerrit | Steve Baker proposed openstack/tripleo-common master: Simplify tenacity sleep mocking https://review.openstack.org/597349 | 01:37 |
| *** lblanchard has joined #tripleo | 01:38 | |
| *** lblanchard has quit IRC | 01:38 | |
| stevebaker | mwhahaha: let me know what you think of this alternative tenacity mocking https://review.openstack.org/#/c/597349 | 01:43 |
| *** ianw has quit IRC | 01:49 | |
| *** spsurya has quit IRC | 01:49 | |
| *** itlinux-away is now known as itlinux | 01:51 | |
| *** itlinux is now known as itlinux-away | 01:51 | |
| *** ianw has joined #tripleo | 01:53 | |
| *** thrash is now known as thrash|g0ne | 01:59 | |
| *** itlinux-away is now known as itlinux | 02:01 | |
| *** ianw has quit IRC | 02:03 | |
| *** ianw has joined #tripleo | 02:04 | |
| *** sri_ has quit IRC | 02:11 | |
| *** sri_ has joined #tripleo | 02:11 | |
| *** itlinux is now known as itlinux-away | 02:11 | |
| *** rlandy|bbl is now known as rlandy | 02:13 | |
| *** psachin has joined #tripleo | 02:16 | |
| *** hamzy has quit IRC | 02:17 | |
| *** hamzy has joined #tripleo | 02:18 | |
| *** sri_ has quit IRC | 02:18 | |
| *** sri_ has joined #tripleo | 02:18 | |
| *** sri_ has quit IRC | 02:19 | |
| *** sri_ has joined #tripleo | 02:20 | |
| *** sri_ has quit IRC | 02:24 | |
| *** sri_ has joined #tripleo | 02:25 | |
| *** itlinux-away is now known as itlinux | 02:29 | |
| *** itlinux is now known as itlinux-away | 02:29 | |
| *** openstack has joined #tripleo | 02:51 | |
| *** zzzeek has joined #tripleo | 02:52 | |
| *** ChanServ sets mode: +o openstack | 02:52 | |
| *** itlinux-away is now known as itlinux | 02:53 | |
| *** itlinux is now known as itlinux-away | 02:53 | |
| *** itlinux-away is now known as itlinux | 02:54 | |
| *** PhilSliderS has joined #tripleo | 02:56 | |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart-extras master: WIP: Stop relying on old legacy sub_nodes_private https://review.openstack.org/596906 | 02:59 |
| *** sri_ has quit IRC | 03:02 | |
| *** openstackstatus has joined #tripleo | 03:02 | |
| *** ChanServ sets mode: +v openstackstatus | 03:02 | |
| *** sri_ has joined #tripleo | 03:03 | |
| *** sri_ has quit IRC | 03:05 | |
| *** sri_ has joined #tripleo | 03:07 | |
| stevebaker | mwhahaha: sure | 03:11 |
| *** psachin has quit IRC | 03:13 | |
| *** psachin has joined #tripleo | 03:14 | |
| *** sri_ has quit IRC | 03:18 | |
| *** srini_ has joined #tripleo | 03:18 | |
| openstackgerrit | Steve Baker proposed openstack/tripleo-docs master: Add container prepare step to Standalone https://review.openstack.org/595908 | 03:23 |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart-extras master: WIP: Stop relying on old legacy sub_nodes_private https://review.openstack.org/596906 | 03:28 |
| *** srini_ has quit IRC | 03:28 | |
| *** srini_ has joined #tripleo | 03:29 | |
| *** rlandy has quit IRC | 03:30 | |
| *** ramishra has joined #tripleo | 03:37 | |
| openstackgerrit | Merged openstack/tripleo-docs master: Add container prepare step to Standalone https://review.openstack.org/595908 | 03:37 |
| *** gkadam has joined #tripleo | 03:39 | |
| *** Petersingh has joined #tripleo | 03:40 | |
| *** skramaja has joined #tripleo | 03:41 | |
| *** skramaja has quit IRC | 03:46 | |
| *** skramaja has joined #tripleo | 03:46 | |
| *** Petersingh is now known as Petersingh|afk | 03:48 | |
| *** spsurya has joined #tripleo | 03:54 | |
| *** udesale has joined #tripleo | 03:59 | |
| *** tzumainn has quit IRC | 04:01 | |
| *** saneax has joined #tripleo | 04:16 | |
| *** radeks has joined #tripleo | 04:17 | |
| jaosorior | Good morning folks! | 04:23 |
| *** myoung is now known as myoung|pto | 04:25 | |
| *** Petersingh|afk is now known as Petersingh | 04:28 | |
| *** srini_ has quit IRC | 04:30 | |
| *** sri_ has joined #tripleo | 04:32 | |
| openstackgerrit | Merged openstack/tripleo-specs master: Add new Edge focused squad https://review.openstack.org/594161 | 04:38 |
| *** paramite has joined #tripleo | 04:54 | |
| *** janki has joined #tripleo | 05:09 | |
| Tengu | hello there | 05:13 |
| Tengu | EmilienM: great :). Now do the same with selinux :D. Oh. wait. That's my part -.-' | 05:13 |
| *** sri_ has quit IRC | 05:25 | |
| *** aufi has joined #tripleo | 05:25 | |
| *** ykarel has joined #tripleo | 05:28 | |
| *** itlinux has quit IRC | 05:31 | |
| *** radeks has quit IRC | 05:35 | |
| *** ratailor has joined #tripleo | 05:35 | |
| *** radeks has joined #tripleo | 05:41 | |
| *** ykarel has quit IRC | 05:42 | |
| *** ksambor has joined #tripleo | 05:47 | |
| *** links has joined #tripleo | 05:48 | |
| *** Petersingh is now known as Petersingh|afk | 05:49 | |
| *** ykarel has joined #tripleo | 05:52 | |
| Tengu | jaosorior: heya! what do you think about this approach for the selinux thingy with podman? https://review.openstack.org/#/c/597130/ | 05:53 |
| jaosorior | Tengu: didn't you have an issue before with container_var_lib_t ? | 05:54 |
| Tengu | jaosorior: well, the patch is actually working - I'm able to deploy redis and mysql containers up to step 5 - after that, there are some needs of other services for some kind of post-deploy steps. | 05:54 |
| Tengu | jaosorior: apparently the issue was corrected adding the :z to the mount. | 05:55 |
| jaosorior | Tengu: I think the issue is that docker-puppet.py generates the directory with a certain context. And then when we start the other container, that context is different (cause it's another container), so it has no access to it. | 05:56 |
| jaosorior | That's fine for /var/lib/kolla/config_files | 05:56 |
| Tengu | jaosorior: that's not the docker-puppet.py - it's plain ansible in t-h-t :) | 05:56 |
| jaosorior | Tengu: does /var/lib/mysql work with the Z option instead of the z option? | 05:57 |
| Tengu | hmmm Z makes it private right? | 05:57 |
| jaosorior | Tengu: correct. | 05:57 |
| Tengu | can give it a try | 05:57 |
| jaosorior | Tengu: just to test it out | 05:57 |
| jaosorior | I don't think we can change to that yet. | 05:57 |
| jaosorior | but I like where this is going | 05:58 |
| Tengu | gimme 5 minutes in order to re-up the vagrant box :). | 05:58 |
| jaosorior | Tengu: to get this to work, we would need for both pacemaker and paunch to remember which namespace was used, and re-use them when recreating the container. | 05:58 |
| jaosorior | (which would sure be a nice feature) | 05:59 |
| Tengu | hmm ok. | 05:59 |
| Tengu | ah, it works on the last sXX part of the labels right? | 05:59 |
| jaosorior | Tengu: so, lets check if it works with an initial deployment | 05:59 |
| jaosorior | Tengu: yes, the MCS part, or something of the sort (need to revisit Dan Walsh's blog) | 05:59 |
| Tengu | ok :). getting a bit more used to SELinux on my part, that's better as well. | 06:00 |
| jaosorior | Tengu: here's the article I was thinking about https://opensource.com/article/18/2/understanding-selinux-labels-container-runtimes | 06:00 |
| *** ccamacho has joined #tripleo | 06:03 | |
| Tengu | ah, that's the origin of the svirt references I saw in the openstack-selinux. | 06:03 |
| jaosorior | Tengu: actually... it might just work. Even if the container is destroyed and re-created. the Z option should relabel | 06:03 |
| jaosorior | so, there wouldn't be a need to store the MCS label at all | 06:03 |
| Tengu | let's see that - vagrant box still deploying its base. | 06:04 |
| Tengu | once it's done, I'll run the openstack undercloud install | 06:04 |
| jaosorior | Tengu: so, "z" should be fine for logs and such, but /var/lib/mysql, and /run/redis (or whaterver it was) could use "Z" | 06:04 |
| Tengu | fine for me. | 06:04 |
| Tengu | now we have to keep in mind docker will still be involved, so we might need to be more subtle. | 06:04 |
| Tengu | the proposed change is podman-centric, and will crash docker. | 06:05 |
| *** shyamb has joined #tripleo | 06:05 | |
| jaosorior | Tengu: why will it crash docker? | 06:05 |
| Tengu | jaosorior: because of different selinux context | 06:05 |
| jaosorior | ah | 06:06 |
| jaosorior | right | 06:06 |
| Tengu | docker isn't able to talk to container_* - at least I'm pretty sure of that. | 06:06 |
| jaosorior | Tengu: so does docker user different types than container_* ? | 06:06 |
| Tengu | I didn't test, but.... | 06:06 |
| jaosorior | crap | 06:06 |
| Tengu | there are some svirt_* mentions | 06:06 |
| jaosorior | those were supposed to be standard (at least that's what they tried) | 06:06 |
| jaosorior | Tengu: can we parameterize those? | 06:06 |
| Tengu | well, I can apply my patch against a clean master and see how it goes. | 06:06 |
| jaosorior | if docker, use X if podman use Z | 06:06 |
| *** udesale has quit IRC | 06:07 | |
| Tengu | jaosorior: well, that would be the goal. I have in mind a hash in a global variable file. | 06:07 |
| jaosorior | badass | 06:07 |
| Tengu | selabel[provider][....] | 06:07 |
| jaosorior | +1 | 06:07 |
| Tengu | that would be the best, as this will allow support for a third, fourth techno | 06:07 |
| Tengu | so my proposal will avoid most of the pain that were raised when I talked about volumes - although volumes are still a "good way", they don't correct all the selinux issues. | 06:08 |
| Tengu | (and it's a shame) | 06:08 |
| jaosorior | it is :/ | 06:08 |
| jaosorior | and, fact of the matter is, podman has no support for named volumes yet, so it's no use even. | 06:09 |
| Tengu | yep | 06:09 |
| Tengu | it "only" supports plain bind mounts. | 06:09 |
| Tengu | that's what I understood by the reading of both docs and code. | 06:09 |
| jaosorior | ack | 06:10 |
| Tengu | the location in /var/lib/containers/storage/mounts is nice, but not really useful. | 06:10 |
| Tengu | so no real advantage to use that location - for now at least. Guess we'll need a few podman releases before that becomes usable. | 06:10 |
| *** agurenko has joined #tripleo | 06:13 | |
| Tengu | ok, step 1 engaged. | 06:13 |
| Tengu | let's ee. | 06:13 |
| Tengu | *see | 06:13 |
| Tengu | jaosorior: ah, for the rsync - have to figure out the issue, but I get a "permission denied", and it's apparently NOT selinux-related. At least, nothing shows up in the audit.log. | 06:14 |
| jaosorior | whaa | 06:14 |
| jaosorior | OK | 06:14 |
| Tengu | jaosorior: have to check the kind of content present in that location, wondering if it's not broken symlink | 06:14 |
| jaosorior | Tengu: wait, where do we run rsync again? | 06:14 |
| Tengu | jaosorior: from within the container, with the docker-puppet.sh generated file, run as root. | 06:15 |
| jaosorior | ok | 06:15 |
| *** jfrancoa has joined #tripleo | 06:15 | |
| Tengu | erf, crashed... forget I tried to run the haproxy container -.-. | 06:16 |
| *** hamdyk has joined #tripleo | 06:16 | |
| Tengu | jaosorior: ah, also, a """feature""" of docker volumes was used, and it's not working with podman anymore. | 06:17 |
| jaosorior | which one? | 06:17 |
| Tengu | jaosorior: if you bind-mount into docker, and the host location doesn't exist, docker will actually create it, and mount it in docker as an empty file/directory. | 06:17 |
| Tengu | jaosorior: podman will crash, saying "no such file or directory" - IMHO podman does the right thing. | 06:17 |
| jaosorior | Tengu: haha shit, that's correct, we do use that. | 06:18 |
| *** kopecmartin has joined #tripleo | 06:18 | |
| jaosorior | That's also a fault on my side, I've used that in a couple of places. | 06:18 |
| Tengu | and this creates an issue with haproxy, it wants its certificate, but it doesn't exist - at least in my ultra-minimal thing | 06:18 |
| Tengu | jaosorior: EmilienM stumbled on a couple of them :). But apparently he could deploy the full undercloud with podman last night. | 06:19 |
| jaosorior | nice!! | 06:19 |
| Tengu | he's just lacking the selinux support - but at least, it deploys. | 06:19 |
| jaosorior | well, that's already quite awesome | 06:20 |
| Tengu | yep! | 06:20 |
| shyamb | Hi | 06:20 |
| jaosorior | Tengu: let me know if you and him have some patches that need reviews. | 06:20 |
| jaosorior | marios, jistr: around? | 06:22 |
| *** ykarel has quit IRC | 06:23 | |
| shyamb | To get memcached servers list I am using http://paste.openstack.org/show/729023/ | 06:26 |
| shyamb | Value I am getting from this code is list if memcached servers | 06:26 |
| shyamb | I want to use this in my conf file | 06:27 |
| shyamb | through puppet | 06:27 |
| *** yprokule has joined #tripleo | 06:29 | |
| *** Petersingh|afk is now known as Petersingh | 06:29 | |
| jaosorior | shyamb: well, it all depends if the value you intend to put that in takes arrays. It probably does though. Don't know the specifics of your manfiests. | 06:29 |
| shyamb | it uses nova conf format | 06:30 |
| jaosorior | then it should be fine. | 06:31 |
| shyamb | jaosorior: I belive nova needs comma separated values of memcached servers | 06:31 |
| jaosorior | if you use the nova_conf puppet resource. | 06:31 |
| jaosorior | shyamb: you could use puppet's join function from stdlib | 06:32 |
| shyamb | ok | 06:34 |
| shyamb | jaosorior: thanks | 06:34 |
| Tengu | jaosorior: :Z not OK for /var/lib/mysql - chown: changing ownership of '/var/lib/mysql': Permission denied rm: cannot remove '/var/lib/mysql/mariadb.pid': Permission denied | 06:34 |
| jaosorior | Tengu: yeah, I'm guessing some extra steps are needed. The change of ownership would now need to be done as root from within the container. | 06:36 |
| Tengu | hmm I think it's done from within it | 06:36 |
| jaosorior | is it? | 06:37 |
| Tengu | apparently yes. | 06:37 |
| jaosorior | where? | 06:37 |
| Tengu | wait, firing up tmate | 06:37 |
| openstackgerrit | Kamil Sambor proposed openstack/tripleo-heat-templates master: Remove unused config file when start ovs agent https://review.openstack.org/597387 | 06:41 |
| *** waleedm has joined #tripleo | 06:45 | |
| *** pcaruana has joined #tripleo | 06:50 | |
| *** rdopiera has joined #tripleo | 06:51 | |
| *** shyamb has quit IRC | 06:52 | |
| *** shyamb has joined #tripleo | 06:53 | |
| *** udesale has joined #tripleo | 06:55 | |
| *** ykarel has joined #tripleo | 06:55 | |
| *** radeks has quit IRC | 06:56 | |
| *** radeks has joined #tripleo | 06:57 | |
| *** aevoo has joined #tripleo | 06:58 | |
| *** rcernin has quit IRC | 07:00 | |
| *** palkar has joined #tripleo | 07:02 | |
| palkar | Hi | 07:02 |
| *** apetrich has joined #tripleo | 07:02 | |
| *** aevoo has quit IRC | 07:04 | |
| palkar | nova compute container has rootwrap file in /etc/nova directory | 07:04 |
| *** Damjanek has joined #tripleo | 07:04 | |
| palkar | Any idea on how this file is getting created? | 07:04 |
| *** ykarel has quit IRC | 07:05 | |
| palkar | I don't see this file on host at /var/lib/config-data/puppet-generated/nova_libvirt/etc/nova | 07:05 |
| *** shardy has joined #tripleo | 07:07 | |
| *** ykarel has joined #tripleo | 07:10 | |
| *** ykarel has quit IRC | 07:10 | |
| *** ykarel has joined #tripleo | 07:10 | |
| *** ykarel has quit IRC | 07:11 | |
| palkar | jaosorior: Tengu: Any idea? | 07:12 |
| *** ykarel has joined #tripleo | 07:12 | |
| Tengu | palkar: hmm nope. | 07:12 |
| *** jtomasek has joined #tripleo | 07:12 | |
| *** ykarel has quit IRC | 07:13 | |
| jaosorior | palkar: AFAIK it comes directly from the nova source code. | 07:13 |
| jaosorior | palkar: that eventually gets installed by the rpm package | 07:13 |
| jaosorior | so, puppet doesn't touch it at all at this moment. | 07:13 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/tripleo-ui stable/queens: Imported Translations from Zanata https://review.openstack.org/597004 | 07:14 |
| jaosorior | palkar: I actually wrote up a blog post to aide folks trying to find where configuration files come from in TripleO http://jaormx.github.io/2018/configuration-files-in-tripleo/ | 07:14 |
| openstackgerrit | Juan Badia Payno proposed openstack/tripleo-heat-templates master: Enable fluentd on multinode-containers scenario https://review.openstack.org/597403 | 07:15 |
| palkar | jaosorior: Thanks | 07:15 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/tripleo-ui master: Imported Translations from Zanata https://review.openstack.org/597404 | 07:16 |
| *** dolly has quit IRC | 07:16 | |
| *** takamatsu has quit IRC | 07:16 | |
| *** ratailor_ has joined #tripleo | 07:19 | |
| *** shyamb has quit IRC | 07:19 | |
| openstackgerrit | Juan Badia Payno proposed openstack/tripleo-heat-templates master: Added all keystone log files to fluentd https://review.openstack.org/563009 | 07:20 |
| *** shyamb has joined #tripleo | 07:20 | |
| *** ratailor has quit IRC | 07:20 | |
| *** moshele has joined #tripleo | 07:20 | |
| ssbarnea | any core around now to help with https://review.openstack.org/#/c/597141/ ? already passed CI and it solves a critical CI bug on queens. | 07:23 |
| *** shyamb has quit IRC | 07:25 | |
| shardy | ssbarnea: lgtm | 07:25 |
| ssbarnea | shardy: yep, without it the gate job would fail to find the images, found it yesterday while trying to merge other fixes. | 07:27 |
| *** udesale has quit IRC | 07:31 | |
| jaosorior | ssbarnea: thanks for the patch. | 07:35 |
| *** f1 has joined #tripleo | 07:35 | |
| *** f1 is now known as florianf | 07:35 | |
| *** jpich has joined #tripleo | 07:37 | |
| *** shyamb has joined #tripleo | 07:37 | |
| jistr | jaosorior: hi, now i'm around :) did you need something? | 07:38 |
| *** sri_ has joined #tripleo | 07:38 | |
| *** tosky has joined #tripleo | 07:38 | |
| ssbarnea | jaosorior: not mine, but thanks! this should clearly help. | 07:39 |
| jaosorior | jistr: not anymore, thanks though | 07:40 |
| *** shyamb has quit IRC | 07:44 | |
| *** ykarel has joined #tripleo | 07:49 | |
| *** threestrands has quit IRC | 07:50 | |
| *** jpena|off is now known as jpena | 07:51 | |
| *** Petersingh is now known as Petersingh|lunch | 07:52 | |
| d0ugal | jtomasek: did you manage to solve the tripleo.plan.list issue? | 07:56 |
| jtomasek | d0ugal: not yet | 07:56 |
| *** dmacpher has quit IRC | 07:57 | |
| d0ugal | jtomasek: it means that the action took longer than the maximum RPC call time :) | 07:58 |
| d0ugal | jtomasek: this is one of the limitations of direct action calls | 07:58 |
| d0ugal | jtomasek: do you have a large number of plans? | 07:58 |
| jtomasek | d0ugal: no, it is a fresh install with only one plan | 07:59 |
| jtomasek | d0ugal: listing of executions (which usually takes much longer) executes just fine | 07:59 |
| d0ugal | jtomasek: Interesting. No errors in the executor log? | 07:59 |
| d0ugal | Maybe there is something wrong with swift? | 08:00 |
| jtomasek | d0ugal: I am going to check executor and swift logs, listing containers via swift CLI works fine | 08:01 |
| openstackgerrit | Jiri Stransky proposed openstack/tripleo-heat-templates stable/rocky: Ceph update and upgrade in config-download era https://review.openstack.org/597419 | 08:01 |
| *** sri_ has quit IRC | 08:02 | |
| d0ugal | jtomasek: it is such a simple action I'm struggling to understand why it could be so slow | 08:02 |
| d0ugal | https://github.com/openstack/tripleo-common/blob/master/tripleo_common/actions/plan.py#L81-L91 | 08:02 |
| d0ugal | It doesn't even have any retrying or error handling if the swift calls fail :) | 08:03 |
| *** sri_ has joined #tripleo | 08:03 | |
| jtomasek | d0ugal: yeah, there must be something which just gets it stuck | 08:03 |
| *** owalsh_ is now known as owalsh | 08:10 | |
| *** ccamacho has quit IRC | 08:13 | |
| *** ccamacho has joined #tripleo | 08:14 | |
| jtomasek | d0ugal: If I am looking correctly at executor log, it logs the response from swift immediately but the action never returns a response and timeouts after some time | 08:15 |
| jtomasek | d0ugal: so I don't think the problem is at swift side | 08:16 |
| d0ugal | jtomasek: hmm, interesting. | 08:25 |
| jtomasek | d0ugal: so I tried to run the workflow tripleo.plan_management.v1.list_plans and it executes just fine, except the command itself timeouts, but when I look at the executions list and execution output, it is SUCCESS with correct output of plans list | 08:26 |
| *** ykarel is now known as ykarel|away | 08:27 | |
| Tengu | jaosorior: I'm adding more and more containers to the undercloud - apparently the change I propose is consistent and works for all the current ones - taking the list in the same order, I'm at OS::TripleO::Services::CertmongerUser :) | 08:28 |
| jtomasek | d0ugal: http://paste.openstack.org/show/729030/ | 08:28 |
| *** ykarel|away has quit IRC | 08:29 | |
| *** akrivoka has joined #tripleo | 08:29 | |
| *** shyamb has joined #tripleo | 08:30 | |
| d0ugal | jtomasek: how curious. | 08:31 |
| d0ugal | apetrich: ^ | 08:31 |
| d0ugal | jtomasek: it almost feels like there could be a problem with the communication between the API and the engine - but I've not seen that before | 08:32 |
| d0ugal | jtomasek: Any errors logs in the API for that? | 08:32 |
| apetrich | jtomasek, d0ugal huh. I think I saw that once | 08:33 |
| apetrich | d0ugal, but I'm pretty sure it was when I was debuging something and had not restarted all the jobs correctly | 08:34 |
| jtomasek | d0ugal: api log has the same error as I pasted yesterday | 08:34 |
| jaosorior | Tengu: yeah... certmonger is not containerized :( | 08:34 |
| Tengu | jaosorior: yep, saw that, but not a big deal - I'm adding same resources as in the original roles_data_undercloud. | 08:35 |
| Tengu | in the same order | 08:35 |
| jtomasek | d0ugal, apetrich: maybe it can be containers communication issue? | 08:36 |
| d0ugal | jtomasek: oh, that is a good idea. | 08:36 |
| d0ugal | jtomasek: but I have no idea how you debug that | 08:36 |
| jtomasek | me neither | 08:36 |
| Tengu | jaosorior: still, I think some services should not be in containers - certmonger and ntp/chrony are part of them | 08:36 |
| shardy | what kind of containers communication issue? | 08:37 |
| shardy | we use net=host so mostly the dependencies are on mounts to the host filesystem | 08:37 |
| jtomasek | d0ugal: I am going to try another action(s) | 08:38 |
| * shardy can perhaps help debug | 08:38 | |
| jtomasek | shardy: http://paste.openstack.org/show/729030/ | 08:38 |
| jtomasek | shardy: the mistral workflow executes fine but the command which initiated it timeouts | 08:38 |
| shardy | jtomasek: yup I'm just not clear why containers could be related | 08:39 |
| jtomasek | shardy: same for running mistral action | 08:39 |
| d0ugal | shardy: we are just guessing :) | 08:39 |
| shardy | is haproxy running OK? | 08:39 |
| jtomasek | shardy: do you want access to the environment? | 08:40 |
| shardy | jtomasek: I can take a look if you like, can't promise to resolve it but happy to try | 08:41 |
| jtomasek | shardy: thanks, just give me your public key please | 08:41 |
| shardy | jtomasek: ack I'll pm you | 08:41 |
| dtantsur | shardy: morning! thanks for the comments, I'll start walking through them now. | 08:43 |
| *** jaganathan has joined #tripleo | 08:44 | |
| dtantsur | shardy: re package dependency: I don't think we've had a promotion since then, have we? | 08:45 |
| shardy | dtantsur: Hmm, sec let me check | 08:46 |
| shardy | dtantsur: and 'morning! | 08:46 |
| shardy | dtantsur: happy to chat, mostly the comments are just thoughts not blockers, it works quite well for me locally already :) | 08:47 |
| shardy | Yeah the tripleo master pin is 15 days old | 08:47 |
| openstackgerrit | Merged openstack/tripleo-quickstart-extras master: Add openshift etcd image to image prepare params https://review.openstack.org/576837 | 08:49 |
| openstackgerrit | Merged openstack/python-tripleoclient master: Make openstack undercloud upgrade --dry-run actually dry https://review.openstack.org/593958 | 08:49 |
| openstackgerrit | Merged openstack/tripleo-common master: Enable Ansible error handling per role https://review.openstack.org/576686 | 08:49 |
| openstackgerrit | Merged openstack-infra/tripleo-ci master: Collect cfg files in home dir https://review.openstack.org/597303 | 08:49 |
| *** Petersingh|lunch is now known as Petersingh | 08:53 | |
| dtantsur | shardy: responded. seems like good feature requests :) | 08:53 |
| *** ccamacho has quit IRC | 08:55 | |
| dtantsur | shardy: filed https://storyboard.openstack.org/#!/story/2003584 and https://storyboard.openstack.org/#!/story/2003585 | 08:55 |
| *** ccamacho has joined #tripleo | 08:56 | |
| *** ykarel has joined #tripleo | 08:56 | |
| shardy | dtantsur: ack thanks, it was mostly the interface I was concerned about, seems like it'd be good to avoid substantially changing that after merge if possible | 08:57 |
| shardy | d0ugal: it seems to be an RPC timeout in mistral-api ref http://paste.openstack.org/show/729031/ | 08:57 |
| shardy | the "No calling threads" looks suspicious | 08:57 |
| * shardy checks the mistral config | 08:58 | |
| dtantsur | shardy: we'll try to. but I don't know what to replace the opaque dict with.. | 08:58 |
| *** sshnaidm|afk is now known as sshnaidm | 08:59 | |
| *** noama has joined #tripleo | 09:00 | |
| openstackgerrit | Merged openstack/tripleo-common master: Add override_ansible_cfg https://review.openstack.org/584087 | 09:00 |
| openstackgerrit | Merged openstack/tripleo-common master: Simplify tenacity sleep mocking https://review.openstack.org/597349 | 09:00 |
| d0ugal | shardy: oh, interesting. I had missed that INFO message. | 09:10 |
| *** moshele has quit IRC | 09:12 | |
| shardy | d0ugal: perhaps you can take a look - it seems that the gateway timeout is from haproxy, but the underlying issue is that INFO happens right after requesting the workflow execution, then eventually haproxy times out, and the RPC timeout happens arount/after that | 09:13 |
| openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-quickstart-extras master: WIP: Track ansible overcloud deployment with ARA https://review.openstack.org/597222 | 09:14 |
| *** moshele has joined #tripleo | 09:15 | |
| jtomasek | d0ugal: let me know if you want to access the environment | 09:17 |
| numans | shardy, Hi. I was debugging the scenario007 issue locally on my setup. The stack failed with the message - 'Property DockerCinderConfigImage not assigned'. Is there a way for me to know the list of enabled services on that failed stack ? | 09:20 |
| openstackgerrit | Raoul Scarazzini proposed openstack/tripleo-quickstart-extras master: Remove deprecated ironic command from prep images https://review.openstack.org/597432 | 09:21 |
| jtomasek | d0ugal: I can confirm that other action executions behave the same | 09:22 |
| d0ugal | jtomasek: Sure, first one here should work: https://github.com/d0ugal.keys | 09:25 |
| openstackgerrit | Raoul Scarazzini proposed openstack/tripleo-quickstart-extras master: Remove deprecated ironic command from prep images https://review.openstack.org/597432 | 09:25 |
| openstackgerrit | Martin André proposed openstack/tripleo-heat-templates master: Move to openshift-ansible 3.10 https://review.openstack.org/582495 | 09:26 |
| shyamb | Hi | 09:26 |
| shyamb | I want to add my service to openstack haproxy through redhat director | 09:27 |
| shyamb | Like this http://paste.openstack.org/show/729035/ | 09:27 |
| shyamb | Who is creating this content? and how? | 09:27 |
| shyamb | Like internal ip, virtual ip and controller node list | 09:27 |
| *** moshele has quit IRC | 09:28 | |
| shyamb | jaosorior: Any thoughts? | 09:29 |
| *** holser_ has joined #tripleo | 09:30 | |
| *** gfidente has joined #tripleo | 09:31 | |
| dtantsur | shardy: so, wdyt about the current state of the patch? would you like something changed right here? | 09:32 |
| janki | Hi, Can I please get some reviews for https://review.openstack.org/#/c/585159/ | 09:33 |
| KingJ | When deploying the undercloud, which network should the undercloud_admin_host and undercloud_public_host be in? The documentation seems to suggest they should be in the PXE/provisioning network, but as that's non-routable it then makes the tripleo UI inaccessible. | 09:34 |
| shardy | dtantsur: the main thing is the request blob thing, I don't have a specific alternative atm but will spend some time later trying to figure it out | 09:34 |
| *** shyamb has quit IRC | 09:34 | |
| shardy | dtantsur: that said, if neither of us can define a better alternative I'm not opposed to landing it then iterating | 09:34 |
| dtantsur | cool | 09:34 |
| shardy | the placement by name thing would be really nice too, but that can be a follow-up | 09:34 |
| *** ykarel is now known as ykarel|away | 09:36 | |
| *** ykarel|away has quit IRC | 09:43 | |
| *** leanderthal has joined #tripleo | 09:44 | |
| *** Petersingh is now known as Petersingh|afk | 09:49 | |
| *** udesale has joined #tripleo | 09:52 | |
| *** ykarel has joined #tripleo | 09:57 | |
| openstackgerrit | Raoul Scarazzini proposed openstack/tripleo-quickstart-extras master: Remove deprecated ironic command from prep images https://review.openstack.org/597432 | 10:01 |
| dtantsur | shardy: listing command and API: https://review.openstack.org/#/c/597436/ | 10:10 |
| *** shyamb has joined #tripleo | 10:11 | |
| jaosorior | jbadiapa: are you the person to ask if I have some questions regarding sensu integration? | 10:12 |
| jaosorior | jbadiapa: also, logging group isn't used any more, is it? | 10:16 |
| sri_ | KingJ, undercloud_public_host and undercloud_admin_host I've put my rouble ip address also you need "generate_service_certificate = true" to your undercloud.conf to make tripleo-ui listen on routable ip | 10:19 |
| sri_ | KingJ, my undercloud config http://paste.openstack.org/show/729038/ | 10:22 |
| openstackgerrit | Jose Luis Franco proposed openstack/tripleo-quickstart master: Update repo_cmd for upgrades release files. https://review.openstack.org/597441 | 10:22 |
| *** ratailor_ has quit IRC | 10:23 | |
| openstackgerrit | Jose Luis Franco proposed openstack/tripleo-upgrade stable/queens: DNM: Test pike->queens upgrades. https://review.openstack.org/563616 | 10:25 |
| jbadiapa | jaosorior, about the logging_group, not it's not been used | 10:26 |
| jaosorior | jbadiapa: is logging_source unused as well? | 10:26 |
| jbadiapa | jaosorior, yes, logging_source and logging_group are not used. | 10:27 |
| jaosorior | jbadiapa: cool, I'll remove them then | 10:27 |
| jaosorior | jbadiapa: Do you happen to know what's up with the sensu integration? was looking at the monitoring_subscription section in the templates. | 10:27 |
| jbadiapa | jaosorior, about the sensu, you can ask mmagr | 10:28 |
| jbadiapa | but maybe I can answer the question | 10:28 |
| jaosorior | jbadiapa: thanks for the pointer | 10:28 |
| *** psachin has quit IRC | 10:28 | |
| jaosorior | jbadiapa: well, it's just a very basic question on how the monitoring_subscription output gets used. | 10:28 |
| jbadiapa | what's the thing about the monitoring_subscription | 10:28 |
| jaosorior | I don't see it being used and am a bit confused about it. | 10:29 |
| *** saneax has quit IRC | 10:33 | |
| *** thrash|g0ne is now known as thrash | 10:33 | |
| fultonj | cschwede: can i get some feedback on https://review.openstack.org/#/c/597221 ? | 10:36 |
| *** jaganathan has quit IRC | 10:37 | |
| cschwede | fultonj: sure, will have a look within the next hour | 10:37 |
| fultonj | cschwede: thanks | 10:37 |
| fultonj | also https://review.openstack.org/#/c/597233/ | 10:38 |
| *** moshele has joined #tripleo | 10:38 | |
| fultonj | i ran into 2 problems in ^ that i have ideas on how to solve, but wanted to get your feedback | 10:38 |
| fultonj | cschwede: do you know off of the top of your head if i need the token to upload to a temp URL? | 10:39 |
| cschwede | fultonj: no, you only need the temporary url itself (including the computed signature), no token or anything else | 10:39 |
| jaosorior | jbadiapa: also, any idea since when did we stop using logging_group? | 10:39 |
| fultonj | gfidente: ^ | 10:39 |
| gfidente | cschwede so a PUT overwrites the existing object? | 10:40 |
| cschwede | gfidente: yes | 10:40 |
| openstackgerrit | Merged openstack/tripleo-quickstart master: set the correct config download settings for queens https://review.openstack.org/597141 | 10:41 |
| cschwede | as long as there is no object versioning enabled | 10:41 |
| jbadiapa | jaosorior, https://review.openstack.org/#/c/543871/ <-- to give you an idea, needs to be updated | 10:41 |
| gfidente | cschwede ok yeah I see, so in that case the remaining issue would be that the filename used to have a timestamp which is not "meaningful" anymore? | 10:41 |
| jaosorior | jbadiapa: damn, 6 months ago? | 10:42 |
| gfidente | fultonj ^ | 10:42 |
| cschwede | gfidente: hmm, which timestamp? | 10:43 |
| fultonj | https://review.openstack.org/#/c/597233/2/workbooks/deployment.yaml | 10:43 |
| gfidente | cschwede the filename we upload into the container, for which the tempurl is created | 10:43 |
| fultonj | temporary_dir-20180827-214352.tar.gz | 10:44 |
| fultonj | because the GetUrl needs to be like http://.../overcloud-swift-rings/temporary_dir.tar.gz | 10:44 |
| cschwede | ah, ok. so that timestamp is there (for the swift rings) to ensure we don't loose any history | 10:44 |
| cschwede | and yes, if object versioning is enabled, we wouldn't need it | 10:44 |
| fultonj | cschwede: sure, that's a nice feature... | 10:44 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Remove references to logging_group https://review.openstack.org/597445 | 10:44 |
| jaosorior | jbadiapa: well, gave it a go ^^ | 10:44 |
| jaosorior | if that goes well, I'll upload another for logging_source | 10:44 |
| cschwede | it's just that i wanted to be sure nothing gets lost if there is an operator error | 10:44 |
| fultonj | cschwede: that's great | 10:44 |
| fultonj | cschwede: my problem is that i was thinking the same thing... | 10:45 |
| cschwede | so you can always recover the original ring if one accidentally deleted sth | 10:45 |
| fultonj | and introduced my own timestamps | 10:45 |
| fultonj | https://github.com/openstack/tripleo-common/blob/fa22231bc7311184f9667558b7bff068755c5b37/tripleo_common/actions/files.py#L111-L112 | 10:45 |
| fultonj | because the GetUrl needs to be like http://.../overcloud-swift-rings/temporary_dir.tar.gz | 10:45 |
| fultonj | not http://.../overcloud-swift-rings/temporary_dir-20180827-214352.tar.gz | 10:46 |
| cschwede | in that case it would make a lot of sense to enable versioning on the container | 10:46 |
| *** moshele has quit IRC | 10:46 | |
| fultonj | cschwede: that's fine, but i need to be backwards compatible | 10:46 |
| cschwede | right | 10:46 |
| fultonj | anyone running queens will already have $container/$foo-$timestamp.tar.gz | 10:46 |
| cschwede | well, there is another trick you could use: create an object that points to the latest "timestamped" object | 10:46 |
| fultonj | cschwede: that sounds handy | 10:47 |
| openstackgerrit | Sorin Sbarnea proposed openstack/tripleo-quickstart master: Enable Ansible ANSI colored output on CI builds https://review.openstack.org/590748 | 10:48 |
| fultonj | cschwede: sounds likea swift symlink | 10:48 |
| cschwede | fultonj: right | 10:48 |
| fultonj | is there a doc on that? | 10:48 |
| cschwede | fultonj: X-Symlink-Target in https://developer.openstack.org/api-ref/object-store/ | 10:48 |
| fultonj | cschwede: thank you | 10:50 |
| fultonj | cschwede: so....... | 10:50 |
| *** radeks has quit IRC | 10:51 | |
| fultonj | cschwede: i was thinking in plan-management.yaml that i'd create the symlink | 10:51 |
| fultonj | add an extra check | 10:51 |
| fultonj | is that the right place? | 10:51 |
| fultonj | https://github.com/openstack/tripleo-common/commit/bfabb3f5755628f707be58b1ead41b2f799ca099 | 10:52 |
| cschwede | fultonj: from the top of my head - yes | 10:52 |
| fultonj | as per ^ | 10:52 |
| jaosorior | owalsh: around? | 10:52 |
| fultonj | cschwede: because deploy only runs on deploy | 10:52 |
| fultonj | initial deployment | 10:52 |
| fultonj | though won't i need to create the swift symlink during deployment when i make its temp url? | 10:54 |
| shyamb | Hi | 10:54 |
| *** colonwq has joined #tripleo | 10:54 | |
| shyamb | jaosorior: I am looking at this puppet module: https://github.com/openstack/puppet-tripleo/blob/master/manifests/haproxy.pp | 10:55 |
| cschwede | fultonj: right - you can create the tempurl even without creating the symlink before | 10:55 |
| shyamb | Do you know which parameter tells this module to enable ssl on external network(haproxy frontend)? | 10:55 |
| shyamb | Or by default it enabled ssl on external network? | 10:56 |
| jbadiapa | jaosorior, have you realized that the patch with the note release was not merged? | 10:56 |
| fultonj | https://docs.openstack.org/tripleo-docs/latest/install/advanced_deployment/ssl.html#overcloud-ssl | 10:56 |
| jaosorior | shyamb: that's all set up from tripleo-heat-templates. So it could be several parameters. | 10:57 |
| jaosorior | jbadiapa: I see. | 10:57 |
| fultonj | thank you cschwede ! i will update the patch. | 10:57 |
| cschwede | fultonj: you're welcome, I'll have a look later then and will run a deployment for testing | 10:57 |
| shyamb | fultonj: this article talks mostly about internal tls | 10:58 |
| jaosorior | shyamb: if you reat up in the article, it actually does mention public TLS | 10:58 |
| fultonj | under "Certificate and Public VIP Configuration" | 10:58 |
| jaosorior | shyamb: http://tripleo.org/install/developer/tht_walkthrough/tls_for_services.html#public-tls | 10:58 |
| jaosorior | ah, that other article :D | 10:59 |
| jaosorior | thanks fultonj :D | 10:59 |
| fultonj | jaosorior: np | 10:59 |
| shyamb | jaosorior: ok | 10:59 |
| shyamb | thanks | 10:59 |
| *** sri_ has quit IRC | 11:00 | |
| *** sri_ has joined #tripleo | 11:00 | |
| KingJ | sri_: Thanks, that's helpful - so just to double check - eno2 is your provisioning interface which sits in 10.1.24.0/24, and 10.1.6.11 is your admin/management interface and you've bound public/admin to that. And that's all OK? i.e. hosts from the provisioning network don't need to access the public/admin interfaces? (see you're also enabled masq on the provisioning network - i'm not doing that right now) | 11:01 |
| owalsh | jaosorior: hey | 11:01 |
| jaosorior | owalsh: nevermind :D was gonna ask about the cellv2_discovery flag in the templates, but it's all good now. | 11:01 |
| *** mburned has quit IRC | 11:02 | |
| *** d0ugal has quit IRC | 11:03 | |
| *** Petersingh|afk is now known as Petersingh | 11:03 | |
| dtantsur | folks, what to do with MessagingTimeout: Timed out waiting for a reply to message ID eea80a3a747e4184925fd480069705fe right after the deployment starts? | 11:04 |
| *** udesale has quit IRC | 11:04 | |
| * dtantsur wonders if anybody actually tries deploying tripleo master outside of the CI nowadays :-/ | 11:05 | |
| fultonj | i do | 11:05 |
| fultonj | tripleo-master-ci | 11:05 |
| fultonj | restart zaqar? | 11:05 |
| fultonj | havent' seen that one though (sorry) | 11:06 |
| *** rpioso|afk is now known as rpioso | 11:07 | |
| openstackgerrit | Brad P. Crochet proposed openstack/tripleo-common master: Use swift bulk-delete when deleting a plan https://review.openstack.org/553616 | 11:07 |
| sri_ | KingJ, yes your right | 11:08 |
| KingJ | sri_: Great, thanks :) | 11:08 |
| *** rpioso is now known as rpioso|afk | 11:09 | |
| sri_ | KingJ, np | 11:09 |
| *** mburned has joined #tripleo | 11:10 | |
| openstackgerrit | Brad P. Crochet proposed openstack/tripleo-common master: Use swift bulk-delete when deleting a plan https://review.openstack.org/553616 | 11:10 |
| numans | mwhahaha, Hi, can you please take a look at this patch when you get some time - https://review.openstack.org/#/c/597143/ | 11:12 |
| *** shyamb has quit IRC | 11:16 | |
| *** shyamb has joined #tripleo | 11:16 | |
| *** bfournie has quit IRC | 11:17 | |
| *** d0ugal has joined #tripleo | 11:18 | |
| dtantsur | fultonj: trying. the only unusual thing about my environment is uptime of 46 hours before the first deploy | 11:18 |
| dtantsur | I wonder if zaqar dies during this time.. | 11:18 |
| fultonj | i do keep underclouds alive for about 2 weeks | 11:19 |
| fultonj | that shouldn't be a problem | 11:19 |
| dtantsur | fultonj: did not help. nothing suspicious in logs of mistral or zaqar Oo | 11:20 |
| fultonj | maybe rabbitmq? | 11:21 |
| openstackgerrit | Numan Siddique proposed openstack/tripleo-heat-templates master: Fix the scenario007 CI job failure https://review.openstack.org/596594 | 11:21 |
| *** sri_ has quit IRC | 11:22 | |
| dtantsur | okay, restarting it | 11:22 |
| dtantsur | btw folks, is it expected that all logs are readable by the stack user? it's handy for debugging, but I remember previously they used to be root-only.. | 11:22 |
| openstackgerrit | Numan Siddique proposed openstack/tripleo-heat-templates master: DNM: FOR TESTING ONLY https://review.openstack.org/597043 | 11:22 |
| *** sri_ has joined #tripleo | 11:23 | |
| dtantsur | fultonj: did not help either :( tripleo just hates me today | 11:23 |
| *** jcoufal has joined #tripleo | 11:24 | |
| fultonj | dtantsur: 'opentack overcloud deploy ... --debug' | 11:25 |
| fultonj | while tailing mistral executor log? | 11:25 |
| dtantsur | fultonj: executor looks okay: http://paste.openstack.org/show/729043/ | 11:27 |
| dtantsur | but the response to list_plans never arrives back | 11:28 |
| openstackgerrit | Jose Luis Franco proposed openstack/tripleo-quickstart master: Update repo_cmd for upgrades release files. https://review.openstack.org/597441 | 11:28 |
| openstackgerrit | Jose Luis Franco proposed openstack/tripleo-quickstart master: Set the correct config download settings for queens. https://review.openstack.org/597450 | 11:28 |
| dtantsur | oh, something I missed in mistral-api initially: ERROR oslo.messaging._drivers.impl_rabbit [req-6399e1f7-19b8-4a8d-af99-bc431ae91366 66fbd53f21484b49b76674b8b020a313 fdaa0a59b31e4119ab7c80f1096b02cd - default default] [4166ca76-f412-4789-a948-bfea12b4538f] AMQP server on undercloud.internalapi.localdomain:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: error: [Errno | 11:29 |
| dtantsur | 104] Connection reset by peer | 11:29 |
| dtantsur | but the RPC does arrive to the executor, WUT?? | 11:29 |
| dtantsur | fultonj: ^^ | 11:29 |
| fultonj | dtantsur: ohn, i reproduced it | 11:29 |
| dtantsur | how? | 11:30 |
| fultonj | http://paste.openstack.org/show/729044/ | 11:30 |
| fultonj | dtantsur: can you run that? | 11:30 |
| fultonj | and get same error? | 11:30 |
| openstackgerrit | Jose Luis Franco proposed openstack/tripleo-heat-templates stable/queens: DNM, testing config-download for queens https://review.openstack.org/597142 | 11:30 |
| fultonj | uptime 48 hours | 11:31 |
| dtantsur | fultonj: it hangs. I suspect the same result indeed. | 11:31 |
| dtantsur | we forgot to feed our rabbit and it died after 40+ hours? | 11:31 |
| fultonj | so on a 7-day old queens undercloud (pre containerization) it works fine | 11:32 |
| fultonj | dtantsur: did you reboot the entire undercloud? | 11:32 |
| dtantsur | fultonj: I don't think so.. I think I just built it and switched to something else. | 11:33 |
| dtantsur | yeah, same result with echo | 11:33 |
| fultonj | thrash: dtantsur and i are both seeing this http://paste.openstack.org/show/729044 , where would you look next? | 11:34 |
| fultonj | d0ugal: ^ ? | 11:34 |
| *** abishop has quit IRC | 11:36 | |
| openstackgerrit | Martin Mágr proposed openstack/tripleo-heat-templates master: Enable ceilometer-agent-compute health check https://review.openstack.org/552501 | 11:37 |
| *** moshele has joined #tripleo | 11:37 | |
| *** jpena is now known as jpena|lunch | 11:37 | |
| shyamb | jaosorior: Any idea about this parameter: DeployedSSLCertificatePath | 11:38 |
| shyamb | in enable tls? | 11:38 |
| fultonj | dtantsur: how did you restart zaqr? did you just 'docker restart ...' | 11:39 |
| dtantsur | yep | 11:39 |
| jaosorior | shyamb: that's the path to the certificate (that's only used if public TLS is enabled) | 11:39 |
| jaosorior | shyamb: there is a parameter called EnablePublicTLS which is true if public TLS is enabled. | 11:40 |
| d0ugal | fultonj: jtomasek also hit that issue. I'm trying to figure it out, but no luck yet | 11:41 |
| fultonj | dtantsur: ^ | 11:42 |
| dtantsur | k, thansk d0ugal | 11:42 |
| fultonj | d0ugal: thanks, is there a bug I could report in on ? | 11:42 |
| fultonj | or workaround? | 11:42 |
| *** morazi has joined #tripleo | 11:43 | |
| *** shyamb has quit IRC | 11:44 | |
| jtomasek | fultonj, dtantsur: <shardy>it seems that mistral tries to create the execution then that "no threads" RPC INFO happens, then eventually the RPC times out | 11:46 |
| *** tiwu has joined #tripleo | 11:46 | |
| jtomasek | fultonj, dtantsur: my observation - happens with any mistral action or workflow, workflow itself actually executes without problem but the response never arrives back and the command which initiated it timeouts | 11:47 |
| tiwu | Hi, I have a question about openstack container service .e.g nova_libvirt. If i want to modify the /etc/nova/nova.conf for nova_libvirt docker, what is the proper way to do it? everytime I do docker restart nova_libvirt, the config is got overwriten | 11:48 |
| fultonj | tiwu: https://docs.openstack.org/tripleo-docs/latest/install/containers_deployment/tips_tricks.html#testing-a-code-fix-in-a-container | 11:48 |
| thrash | jtomasek: fultonj dtantsur are you seeing it at all in ci? | 11:49 |
| fultonj | you might also find this useful for restarting the container https://docs.openstack.org/tripleo-docs/latest/install/containers_deployment/tips_tricks.html#debugging-with-paunch | 11:49 |
| fultonj | tiwu: ^ | 11:49 |
| jtomasek | tiwu: change /var/lib/config-data/puppet-generated/nova_placement/etc/nova/nova.conf and restart the container | 11:49 |
| *** raildo has joined #tripleo | 11:50 | |
| fultonj | jtomasek: how old is your undercloud? | 11:50 |
| *** bfournie has joined #tripleo | 11:50 | |
| fultonj | uptime | 11:50 |
| fultonj | jtomasek: thanks for sharing that insight, about it happening but not reporting to us | 11:50 |
| jtomasek | fultonj: 5 days | 11:51 |
| * fultonj reboots undercloud... | 11:51 | |
| tiwu | :jtomasek hi, i have /var/lib/config-data/nova_libvirt/etc/nova/nova.conf. is it the file ? | 11:52 |
| fultonj | jtomasek: did you open a LP bug | 11:52 |
| fultonj | ? | 11:52 |
| jtomasek | fultonj: not yet, sorry | 11:52 |
| fultonj | np | 11:52 |
| jtomasek | tiwu: I don't think so | 11:53 |
| tiwu | :fultonj thank. I will check the links. for me , the docker is already uprunning, i just want to modify the config+restart the service, without rebuild the docker image | 11:54 |
| fultonj | tiwu: you can't just 'docker restart' to make a config change land. you have to docker stop and docker start | 11:54 |
| *** ssbarnea|ruck has joined #tripleo | 11:54 | |
| fultonj | but the docker start needs to be started correctly and paunch will get you the exact command | 11:54 |
| fultonj | as per the second link | 11:55 |
| fultonj | there are many arguments passed | 11:55 |
| fultonj | you want pauch to figure it out for you | 11:55 |
| fultonj | paunch* | 11:55 |
| *** lblanchard has joined #tripleo | 11:56 | |
| fultonj | dtantsur: i rebooted my undercloud and now `mistral run-action std.echo '{"output": "Hello Workflow!"}'` works | 11:57 |
| *** paramite has quit IRC | 11:57 | |
| openstackgerrit | Dmitry Tantsur proposed openstack/tripleo-docs master: Document location-aware deploy of ironic in the overcloud https://review.openstack.org/597454 | 11:57 |
| fultonj | dtantsur: you might want to do that as a workaround and subscribe to the bug | 11:57 |
| *** rbrady has joined #tripleo | 11:57 | |
| *** paramite has joined #tripleo | 11:57 | |
| dtantsur | lemme try | 11:57 |
| d0ugal | fultonj: interesting. That is a good find! | 11:57 |
| d0ugal | I don't think we have a bug for this, yet | 11:58 |
| fultonj | oh good | 11:58 |
| jtomasek | fultonj: cool! | 11:58 |
| fultonj | there's probably a better workaround, restart container foo and then you can zoom in on the issue | 11:58 |
| *** dprince has joined #tripleo | 11:58 | |
| fultonj | i'll open a bug in LP | 11:59 |
| d0ugal | Thanks | 11:59 |
| jtomasek | d0ugal: do you want me to keep the environment as it is or can I restart? | 11:59 |
| d0ugal | jtomasek: go ahead and restart | 11:59 |
| jtomasek | d0ugal: ok | 11:59 |
| openstackgerrit | Dmitry Tantsur proposed openstack/tripleo-docs master: Document location-aware deploy of ironic in the overcloud https://review.openstack.org/597454 | 12:00 |
| openstackgerrit | Dmitry Tantsur proposed openstack/tripleo-heat-templates stable/rocky: Stop hardcoding baremetal API version in stackrc https://review.openstack.org/597457 | 12:02 |
| *** ssbarnea|ruck has quit IRC | 12:03 | |
| *** rh-jelabarre has joined #tripleo | 12:03 | |
| dtantsur | fultonj: yep, reboot helped. thanks! | 12:05 |
| fultonj | ok, cool. we workaround for now | 12:05 |
| d0ugal | Any idea why a reboot would help? | 12:05 |
| * fultonj will open bug in a little bit | 12:05 | |
| d0ugal | It makes me think it's a docker setup issue rather than a Mistral one? | 12:05 |
| *** janki has quit IRC | 12:06 | |
| *** abishop has joined #tripleo | 12:07 | |
| *** ccamacho has quit IRC | 12:07 | |
| *** ccamacho has joined #tripleo | 12:09 | |
| dtantsur | next question :) has anyone seen something like this when deploying with custom roles? http://paste.openstack.org/show/729048/ | 12:12 |
| *** beagles has quit IRC | 12:12 | |
| *** beagles has joined #tripleo | 12:13 | |
| *** udesale has joined #tripleo | 12:14 | |
| openstackgerrit | Merged openstack/tripleo-quickstart-extras master: Show cfg,j2,py files in browser https://review.openstack.org/597041 | 12:15 |
| *** udesale has quit IRC | 12:16 | |
| openstackgerrit | Juan Badia Payno proposed openstack/tripleo-heat-templates master: Pacemaker-cinder-volume log path fix https://review.openstack.org/597462 | 12:16 |
| *** shyamb has joined #tripleo | 12:16 | |
| jistr | sshnaidm, ssbarnea: the patch to pull latest content from dlrn-current into containers most likely doesn't work as expected, there's still something broken, the error is still the same | 12:16 |
| jistr | https://bugs.launchpad.net/tripleo/+bug/1786764 | 12:17 |
| openstack | Launchpad bug 1786764 in tripleo "tripleo-ci-centos-7-scenario000-multinode-oooq-container-updates times out on prepare" [Critical,Triaged] - Assigned to Sorin Sbarnea (ssbarnea) | 12:17 |
| jistr | i also increasingly think it might be the reason why we can't get sshnaidm's patch working (the one for ARA reporting) | 12:17 |
| *** sri_ has quit IRC | 12:17 | |
| openstackgerrit | Juan Badia Payno proposed openstack/tripleo-heat-templates stable/rocky: Pacemaker-cinder-volume log path fix https://review.openstack.org/597464 | 12:19 |
| *** udesale has joined #tripleo | 12:19 | |
| *** udesale has quit IRC | 12:19 | |
| sshnaidm | jistr, well, this patch also causes this: https://bugs.launchpad.net/tripleo/+bug/1756936 very problematic patch.. | 12:20 |
| openstack | Launchpad bug 1756936 in tripleo "rdo jobs ignore depends-on tripleo-common" [Critical,Triaged] | 12:20 |
| *** ykarel_ has joined #tripleo | 12:20 | |
| jistr | sshnaidm: are we sure that the patch caused it though? i'm thinking it might have been like it all the time... The broken content versions (surfacing in update job, but it could affect any job) have definitely been present even before that patch. | 12:21 |
| sshnaidm | jistr, I'd revert it and trying to investigate more.. | 12:21 |
| sshnaidm | jistr, yeah, but not for testing your dependency it must be on the top | 12:22 |
| *** shyamb has quit IRC | 12:22 | |
| sshnaidm | jistr, not just rebase once a week.. | 12:22 |
| *** ykarel has quit IRC | 12:22 | |
| jistr | sshnaidm: yea but what i mean is the modify-image role (or how we run it) is completely broken it looks... So reverting the patch might not help i think. | 12:22 |
| jistr | it was broken before that patch too :) | 12:23 |
| *** shyamb has joined #tripleo | 12:24 | |
| *** morazi has quit IRC | 12:24 | |
| openstackgerrit | Jiri Stransky proposed openstack/tripleo-common master: DNM: get more output from undercloud modify-image https://review.openstack.org/597466 | 12:24 |
| jistr | sshnaidm: let's see if this can uncover something ^^ | 12:25 |
| *** trown|outtypewww is now known as trown | 12:25 | |
| sshnaidm | jistr, yeah, I fail to find its logs usually.. | 12:26 |
| *** morazi has joined #tripleo | 12:26 | |
| jistr | sshnaidm: it's here but it has no useful info: http://logs.openstack.org/21/583321/9/check/tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades/8581a26/logs/undercloud/home/zuul/install-undercloud.log.txt.gz | 12:26 |
| jistr | hopefully the incresed loglevel will help | 12:27 |
| shardy | dtantsur: those errors re *Image happen when you don't pass the custom roles to the container image prepare command, e.g for quickstart overcloud-prep-containers.sh runs and outputs containers-default-parameters.yaml | 12:27 |
| sshnaidm | jistr, yeah, otherwise need to add there prints and use a separate file for it | 12:28 |
| shardy | dtantsur: if containers-default-parameters.yaml is missing any of the images for the services you have enabled, those errors can happen on deploy | 12:28 |
| *** udesale has joined #tripleo | 12:28 | |
| sshnaidm | jistr, that what happens when nobody from ci team is involved in ci roles.. :) | 12:28 |
| *** udesale has quit IRC | 12:28 | |
| *** sshnaidm is now known as sshnaidm|afk | 12:28 | |
| *** rlandy has joined #tripleo | 12:29 | |
| jistr | sshnaidm: yea. I'd like to come up with something that we can actually merge for long term (e.g. --debug flag for the command). The above patch is just a quick way to see if it's the right direction to explore. | 12:29 |
| dtantsur | shardy: aaaahh, ok. so easy :( | 12:30 |
| dtantsur | thanks for the hint | 12:30 |
| dtantsur | I guess the custom roles documentation needs an update | 12:30 |
| *** janki has joined #tripleo | 12:30 | |
| shardy | dtantsur: possibly, it pre-dates the switch to containers, but there should be docs on running container image prepare? | 12:31 |
| * shardy checks docs | 12:31 | |
| dtantsur | shardy: I think so, just not where I need them :) | 12:31 |
| *** udesale has joined #tripleo | 12:31 | |
| shardy | dtantsur: yeah, we should document it between the roles generate and overcloud deploy steps | 12:32 |
| shardy | https://docs.openstack.org/tripleo-docs/latest/install/advanced_deployment/container_image_prepare.html | 12:32 |
| shardy | dtantsur: those are the docs, and it's invoked by quickstart here: | 12:33 |
| honza | jtomasek: do you have the docker restart notes handy? | 12:33 |
| shardy | https://github.com/openstack/tripleo-quickstart-extras/blob/master/roles/overcloud-prep-containers/templates/overcloud-prep-containers.sh.j2#L34 | 12:34 |
| honza | florianf: do we have a bug somewhere for the missing validations in containerized undercloud? | 12:34 |
| dtantsur | shardy: I don't actually see any references to roles_data in that page | 12:34 |
| shardy | dtantsur: yeah that should probably be mentioned explicitly - you can pass -r and -e like the deploy CLI | 12:35 |
| shardy | then it tries to figure out what services are enabled | 12:35 |
| shardy | I think you can also pass a default/empty argument then it gets everything defined in tripleo-common | 12:36 |
| trown | mandre: for https://review.openstack.org/#/c/582495/ are you saying you think we need 2 "overcloud" nodes now to make that work? | 12:36 |
| *** ykarel_ is now known as ykarel | 12:36 | |
| *** jpich has quit IRC | 12:36 | |
| mandre | trown: i think we need one more node to assign the new OS::TripleO::Services::OpenShift::Infra role | 12:39 |
| dtantsur | shardy: okay, thanks! I'll try to figure out and update the docs. | 12:40 |
| mandre | trown: because I do not reproduce this issue locally where I'm deploying with more nodes | 12:40 |
| *** gkadam has quit IRC | 12:41 | |
| trown | mandre: hmm... that is a pretty big change. We cant do it all in one like we did before? Before we had master and worker on the same node. | 12:42 |
| openstackgerrit | Sorin Sbarnea proposed openstack/tripleo-upgrade master: Limit duration of setup HEAT outputs via update prepare task https://review.openstack.org/596381 | 12:43 |
| *** Petersingh has quit IRC | 12:43 | |
| slagle | sshnaidm|afk: i guess the override-ansiblecfg patch didn't work | 12:43 |
| trown | mandre: the reason why it is a big change is that we only have support for our 2node type jobs in the reproducer code... so if we switch the openshift job to need 3 nodes, we break the ability to easily reproduce it | 12:44 |
| mandre | flaper87: is it possible to run the infra pods on the worker node as previously with 3.10? | 12:44 |
| shardy | dtantsur: I have a question re metalsmith - would such an interface be a valid candidate for an Ironic API extension? | 12:44 |
| shardy | dtantsur: I'm thinking beyond TripleO where there is interest in deploying via Ironic with a minimal number of additional dependencies | 12:45 |
| mandre | trown: yeah I understand how it makes testing a lot more difficult | 12:45 |
| dtantsur | shardy: I'm not sure what you mean by Ironic API extension. Move its functionality into Ironic? There has been plans for years, but nobody so far came up even with a full spec.. | 12:45 |
| * dtantsur -> lunch | 12:45 | |
| shardy | dtantsur: yeah I mean what if the Ironic API could do this to avoid the Mistral->metalsmith layers | 12:45 |
| mandre | flaper87: I guess my question was, is splitting the worker and infra role a requirement for 3.10 or is it just best practice? | 12:46 |
| *** jpena|lunch is now known as jpena | 12:46 | |
| shardy | in the OpenShift community there's some interest in some sort of appliance like that, and requiring Mistral, Ironic, Neutron, Glance, Keystone, Mysql, Rabbit is a pretty heavy stack | 12:46 |
| shardy | just wondering how we could do a "lite" version | 12:46 |
| mandre | flaper87: adding a new node for testing https://review.openstack.org/#/c/582495/ will be difficult I think | 12:47 |
| trown | ssbarnea: are you aware of any issues with vexxhost? seeing a timeout on a patch that was run on that cloud, and it just seems to be general slowness and not related to my patch | 12:47 |
| trown | ssbarnea: http://logs.openstack.org/21/593621/1/check/tripleo-ci-centos-7-scenario003-multinode-oooq-container/dee3e06/ ... also seemed to timeout and not collect logs other than console/inventory | 12:47 |
| ssbarnea | trown: not aware and I am inclined to believe it may happen with any cloud based on http://dashboard-ci.tripleo.org/d/cEEjGFFmz/cockpit?orgId=1 | 12:49 |
| trown | ssbarnea: oh shiny... hadnt looked at that dashboard. it is very nice! | 12:50 |
| openstackgerrit | Raoul Scarazzini proposed openstack/tripleo-quickstart-extras master: Remove deprecated ironic command from prep images https://review.openstack.org/597432 | 12:50 |
| trown | ssbarnea: seems for gate jobs at least vexxhost is more failure prone... 4/7 of the timeouts in the last 24hrs | 12:52 |
| trown | ssbarnea: not that that information helps us in any way | 12:52 |
| ssbarnea | trown: i am looking at your log and I see ~30min gap at 2018-08-29 09:52:22.130966 - inside collect-logs,... which I think is too long, especially without any output. | 12:53 |
| *** radeks has joined #tripleo | 12:54 | |
| dtantsur | shardy: metalsmith itself is tiny, I don't see it as a problem. and I don't think ironic will handle things like creating ports in neutron.. | 12:55 |
| ssbarnea | it does a bit, timeout for collect is 40min, so it does not make much sense to blade collect if it is killed only after 30min by zuul. | 12:55 |
| shardy | dtantsur: yeah, I was thinking about a more bifrost style minimal setup | 12:56 |
| shardy | imagine you deploy a small OpenShift, then add Ironic, and use that to scale out the cluster | 12:56 |
| dtantsur | shardy: that sounds like bifrost itself :) | 12:56 |
| shardy | well, yeah | 12:56 |
| dtantsur | metalsmith is not exactly about it, it's just simplifed access to the required APIs | 12:57 |
| trown | ssbarnea: ya time out was before collect logs though http://logs.openstack.org/21/593621/1/check/tripleo-ci-centos-7-scenario003-multinode-oooq-container/dee3e06/job-output.txt.gz#_2018-08-29_09_52_13_679023 | 12:57 |
| dtantsur | you can do it yourself with ironic and neutron, it just requires some knowledge that is not quite common | 12:57 |
| trown | ssbarnea: not sure why collect logs also failed... because that is in post | 12:57 |
| shardy | dtantsur: ack - the context is currently there's work going into OpenShift to enable deploying on Vms via Nova | 12:58 |
| *** ccamacho has quit IRC | 12:58 | |
| shardy | dtantsur: I'm trying to figure out what the baremetal story will look like if we remove Nova - I guess we'll have a driver that speaks to the Mistral API, but in that case it's just a shim to Ironic/Neutron | 12:58 |
| *** paramite has quit IRC | 12:58 | |
| *** paramite|clone has joined #tripleo | 12:58 | |
| ssbarnea | i think that post has a timeout too, not sure but let me look at original timeout. | 12:58 |
| *** ccamacho has joined #tripleo | 12:59 | |
| dtantsur | shardy: I'm not sure why Mistral is a part here. We have Mistral even with Nova. It's not a key component, we just happened to use it. | 12:59 |
| dtantsur | shardy: for openshift it makes more sense to me to use bifrost and/or metalsmith through ansible | 12:59 |
| shardy | dtantsur: yeah it's not ansible, theyre is work going into a different tool that relies on APIs vs CLI calls etc | 13:00 |
| shardy | so if we remove Mistral there's no API to run metalsmith | 13:00 |
| *** agurenko has quit IRC | 13:00 | |
| shardy | hence my question about adding it to the Ironic API :) | 13:01 |
| shardy | dtantsur: https://github.com/openshift/installer/pull/144/ FYI | 13:01 |
| dtantsur | okay, I see now | 13:01 |
| shardy | dtantsur: it's not exactly related to the work you've started, but I wanted to figure out the options | 13:01 |
| shardy | e.g in the case where you want an API but no longer care about backwards compatibility etc the way we do for TripleO | 13:02 |
| dtantsur | shardy: well, using Nova may nto be the best option anyway | 13:02 |
| sshnaidm|afk | slagle, yeah, it didn't | 13:02 |
| *** sshnaidm|afk is now known as sshnaidm | 13:02 | |
| shardy | dtantsur: yeah I think that will be the first step, but it would be unfortunate if we then remove it from TripleO by default and OpenShift requires it | 13:02 |
| openstackgerrit | Gabriele Cerami proposed openstack-infra/tripleo-ci master: Remove inclusion of legacy playbook in tripleo-ci-base https://review.openstack.org/596422 | 13:02 |
| dtantsur | well, I'll be very sorry for them :) | 13:03 |
| shardy | and there's all the scheduling issues we're trying to solve by removing it | 13:03 |
| dtantsur | exactly | 13:03 |
| ssbarnea | trown: what I see here is http://logs.openstack.org/21/593621/1/check/tripleo-ci-centos-7-scenario003-multinode-oooq-container/dee3e06/job-output.txt.gz#_2018-08-29_08_23_51_371737 -- which is a FATAL error, not sure why the outcome is marked as "multinode-undercloud.yml passed successfully". | 13:03 |
| sshnaidm | slagle, my patch with ara that should do the same also didn't work, maybe same reason.. | 13:03 |
| dtantsur | shardy: pulling in mistral may not be the worst idea then. esp. if we'll try to reproduce our enrolling logic, introspection logic, etc | 13:03 |
| * dtantsur has to run, sorry. back in an hour or two | 13:03 | |
| shardy | dtantsur: Ah yeah, I guess we get to reuse that | 13:04 |
| shardy | np ttyl | 13:04 |
| *** dtantsur is now known as dtantsur|bbl | 13:04 | |
| *** pcaruana has quit IRC | 13:04 | |
| openstackgerrit | Gabriele Cerami proposed openstack-infra/tripleo-ci master: Remove inclusion of legacy playbook in tripleo-ci-base https://review.openstack.org/596422 | 13:05 |
| trown | ssbarnea: there is a rescue for that code: https://github.com/openstack/tripleo-quickstart-extras/blob/master/roles/set-libvirt-type/tasks/main.yml#L25 so it is not actually a FATAL error... but could explain the slowness... | 13:06 |
| openstackgerrit | Raoul Scarazzini proposed openstack/tripleo-quickstart-extras master: Remove deprecated ironic command from prep images https://review.openstack.org/597432 | 13:07 |
| *** shyamb has quit IRC | 13:07 | |
| trown | ssbarnea: because on ovh for instance it looks like KVM is working http://logs.openstack.org/21/593621/1/check/tripleo-ci-centos-7-scenario004-multinode-oooq-container/13e70a2/job-output.txt.gz#_2018-08-29_07_56_07_997957 | 13:08 |
| ssbarnea | yep, just seen it. maybe i should try to change that code to avoid confusing output, the fatal that is not really fatal. | 13:08 |
| trown | ssbarnea: yep and checking another vexxhost timeout, I see the same thing http://logs.openstack.org/21/593621/1/gate/tripleo-ci-centos-7-scenario004-multinode-oooq-container/a3c5cc9/job-output.txt.gz#_2018-08-29_03_39_45_999103 | 13:09 |
| trown | ssbarnea: so our KVM enabling code is not working there... which would make things slower | 13:09 |
| trown | ssbarnea: not sure if KVM is just not usable on that cloud, or if we need a tweek to how we are enabling it | 13:10 |
| slagle | sshnaidm: where do we see what version of tripleo-common is in the mistral container on the undercloud? | 13:13 |
| sshnaidm | slagle, great question | 13:14 |
| *** tzumainn has joined #tripleo | 13:14 | |
| sshnaidm | slagle, tried without luck, wanna see now what can be done with that ansible-modify role, it's completely black box | 13:14 |
| slagle | e.g., we need to record what the CI job actually tetsed | 13:14 |
| sshnaidm | slagle, of course | 13:14 |
| sshnaidm | slagle, but tripleo-common patch was merged, so I *assume* it's included | 13:15 |
| sshnaidm | slagle, shouldn't it fail if wasn't included because of unknown parameter? | 13:15 |
| slagle | sshnaidm: not sure | 13:16 |
| sshnaidm | slagle, actually you have defaults there.. | 13:16 |
| slagle | sshnaidm: just b/c the patch merged, does that mean container images are immediately updated to include it? or does the CI job do that | 13:16 |
| sshnaidm | slagle, before this new role it was updated in CI job with delorean-current repo, but with ansible-modify-image no idea what happens there | 13:17 |
| sshnaidm | slagle, and delorean-current contained all newest tripleo pckgs | 13:18 |
| sshnaidm | slagle, just now jistr submitted a patch that may help to understand this https://review.openstack.org/#/c/597466 | 13:18 |
| *** saneax has joined #tripleo | 13:18 | |
| slagle | sshnaidm: ok, i guess we may need to wait for that to get useful output | 13:20 |
| slagle | sshnaidm: the workflow got updated to include my change, but the workflow is created via the Mistral API during the undercloud install | 13:20 |
| *** aufi has quit IRC | 13:20 | |
| slagle | sshnaidm: it's the action (python code) that I'm not sure was updated. as it takes a kwargs argument, it wouldn't have failed with an unknown parameter error | 13:21 |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart-extras master: Stop relying on old legacy sub_nodes_private https://review.openstack.org/596906 | 13:21 |
| sshnaidm | slagle, I see.. | 13:21 |
| florianf | honza: https://bugs.launchpad.net/tripleo/+bug/1786772 | 13:22 |
| openstack | Launchpad bug 1786772 in tripleo "Validations not exposed any more in containerized undercloud" [High,Fix released] - Assigned to Bogdan Dobrelya (bogdando) | 13:22 |
| florianf | honza: patch fixes it. but running validations is not working, which is what I'm debugging atm | 13:22 |
| *** sanjayu_ has joined #tripleo | 13:24 | |
| jistr | slagle: what issue/patches is this about? It sounds exactly like the problem we hit in update CI. Likely a difference in tripleo-common version between containers. The workflow was created with a stale content (included parameter which no longer exists in latest master code) and then called with up-to-date code (erroring that the parameter wasn't provided). | 13:25 |
| jistr | slagle: https://bugs.launchpad.net/tripleo/+bug/1786764/comments/33 | 13:25 |
| openstack | Launchpad bug 1786764 in tripleo "tripleo-ci-centos-7-scenario000-multinode-oooq-container-updates times out on prepare" [Critical,Triaged] - Assigned to Sorin Sbarnea (ssbarnea) | 13:25 |
| slagle | jistr: it's this patch: https://review.openstack.org/#/c/597222/ | 13:25 |
| slagle | jistr: we're trying to figure out if when it ran, it had https://review.openstack.org/#/c/584087/ | 13:26 |
| slagle | jistr: there seems to be no record of what version of tripleo-common is in the mistral container on the undercloud in any CI logs | 13:26 |
| *** saneax has quit IRC | 13:26 | |
| slagle | jistr: the workflow change is there, as those are not created by packaging. but i can't tell if the change to the action was there or not | 13:27 |
| jistr | slagle: yea that sounds exactly like what we hit in update CI. Workflow respecting new code but action doesn't. And yes re logging, aside from more output from the modify-image step, maybe we could also add CI-specific code to capture `rpm -qa` in each container, same as we do for the host machine. | 13:29 |
| jistr | sshnaidm: ^ wdyt? | 13:29 |
| sshnaidm | jistr, yeah, we definitely need to return to previous logging - what is installed before, what is updated and what is status after update | 13:31 |
| sshnaidm | jistr, for every container | 13:31 |
| jtomasek | honza: sorry, I am back now | 13:32 |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart master: Stop relying on old legacy sub_nodes_private https://review.openstack.org/596887 | 13:34 |
| mandre | trown: my current failure with the openshift 3.10 patch is caused by a dep issue with python-docker-py | 13:35 |
| mandre | trown: if you have ideas... http://paste.openstack.org/show/729049/ | 13:35 |
| *** skramaja has quit IRC | 13:36 | |
| *** ade_lee has joined #tripleo | 13:36 | |
| bfournie | hi EmilienM, when you have a chance can you approve this backport - https://review.openstack.org/#/c/591766/? thank you | 13:37 |
| EmilienM | bfournie: sure | 13:38 |
| trown | mandre: yuck... seems like that python2-docker package is probably missing a provides for python-docker-py ... looking into it | 13:39 |
| trown | mandre: yep... if I `yum downgrade python2-docker; yum install atomic` ... it works... so just a bug in latest python2-docker package. I will raise it with RDO folks | 13:41 |
| mandre | trown: aha! thank a bunch! let's move it to #rdo | 13:41 |
| openstackgerrit | Sorin Sbarnea proposed openstack/tripleo-quickstart-extras master: Avoid fatal task execution when falling back to QEMU https://review.openstack.org/597523 | 13:42 |
| openstackgerrit | Jiri Stransky proposed openstack/tripleo-quickstart-extras master: Log collection: sorted rpm -qa for containers https://review.openstack.org/597525 | 13:43 |
| jistr | sshnaidm, slagle: here's rpm -qa ^ | 13:43 |
| openstackgerrit | David Moreau Simard proposed openstack/tripleo-quickstart master: Do not merge: Test ARA 0.16 https://review.openstack.org/597526 | 13:44 |
| *** mjturek has joined #tripleo | 13:44 | |
| sshnaidm | jistr++ | 13:45 |
| openstackgerrit | David Moreau Simard proposed openstack/tripleo-quickstart-extras master: Do not merge: Test ARA 0.16 https://review.openstack.org/597528 | 13:45 |
| openstackgerrit | Sorin Sbarnea proposed openstack/tripleo-quickstart-extras master: Avoid fatal task execution when falling back to QEMU https://review.openstack.org/597523 | 13:48 |
| openstackgerrit | Gabriele Cerami proposed openstack-infra/tripleo-ci master: Remove inclusion of legacy playbook in tripleo-ci-base https://review.openstack.org/596422 | 13:48 |
| slagle | jistr: excellent | 13:49 |
| sshnaidm | jistr, do you know where is ansible-role-tripleo-modify-image executed from? | 13:50 |
| openstackgerrit | Juan Badia Payno proposed openstack/tripleo-heat-templates master: Added all keystone log files to fluentd https://review.openstack.org/563009 | 13:51 |
| jistr | sshnaidm: the root point is from undercloud deploy via external_deploy_tasks here https://github.com/openstack/tripleo-heat-templates/blob/master/puppet/services/container-image-prepare.j2.yaml#L101 | 13:52 |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart master: Stop relying on old legacy sub_nodes_private https://review.openstack.org/596887 | 13:57 |
| openstackgerrit | Merged openstack/tripleo-common master: Add support for custom validations https://review.openstack.org/569513 | 13:57 |
| openstackgerrit | Merged openstack/tripleo-quickstart master: bump ansible from 2.5.5 to 2.5.8 https://review.openstack.org/587371 | 13:57 |
| shardy | mandre: how are you testing the ocp 3.10 patch, via quickstart of are you still using the tripleo-openshift scripts? | 13:58 |
| *** dtantsur|bbl is now known as dtantsur | 13:58 | |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart-extras master: Stop relying on old legacy sub_nodes_private https://review.openstack.org/596906 | 13:59 |
| dtantsur | shardy: back. to clarify on my comments: if you guys are building tooling to install openshift on a general openstack cloud (bm or not), using nova is the right thing to do | 13:59 |
| dtantsur | shardy: but if you're building a lightweight undercloud-style installer, we better not repeat our past mistakes :) | 13:59 |
| mandre | shardy: i'm still using the tripleo-openshift scripts, i'll push my changes if you want to look at how I did | 13:59 |
| dtantsur | shardy: (I'd also prefer our team to be involved in the latter to avoid coming up with something we're not going to support) | 14:00 |
| *** raildo_ has joined #tripleo | 14:00 | |
| shardy | dtantsur: yeah, the plan is to do both hence wanting to discuss the lightweight part of it | 14:00 |
| openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-quickstart-extras master: WIP: Track ansible overcloud deployment with ARA https://review.openstack.org/597222 | 14:00 |
| shardy | dtantsur: agree that for VMs and baremetal to tenant nova makes sense | 14:00 |
| sshnaidm | jistr, let's check on live job: https://review.openstack.org/#/c/597222/ | 14:00 |
| *** raildo has quit IRC | 14:01 | |
| shardy | dtantsur: yeah agreed, it's at the initial stages (basically just me taking a look into what is possible), but my aim is to ensure the team is involved, since it's a more general feature, e.g undercloud appliance for generic provisioning | 14:01 |
| dtantsur | shardy: I think in the current situation bringing in mistral and metalsmith is lighter than nova, heat and glance | 14:01 |
| trown | shardy: mandre fwiw I have been testing using reproducer script in quickstart and it works great to get the same result on libvirt as CI | 14:01 |
| dtantsur | shardy: well, I've been also thinking about the same thing. so we may be duplicating our thought work :) | 14:02 |
| shardy | trown: ack I can do that - was initially looking to deploy on my existing quickstart deployed env | 14:02 |
| shardy | dtantsur: heh yeah I figured as much, hence all the questions :D | 14:02 |
| mandre | shardy: https://github.com/mandre/tripleo-openshift/commit/d1f5e469120462d0539b6f2d7c5473bfc6137df9 | 14:02 |
| *** rmascena__ has joined #tripleo | 14:03 | |
| dtantsur | shardy: I feel like we need to build a working group here with individuals who're interested in this topic | 14:03 |
| dtantsur | even if it's only you and me (but I doubt it) | 14:03 |
| shardy | dtantsur: yeah I hope to find time to discuss it at the PTG | 14:03 |
| dtantsur | shardy: well, I'm not going there.. | 14:03 |
| shardy | I'll add it as a topic, although it can probably be combined with the novaless deploy discussion | 14:03 |
| shardy | dtantsur: Oh, sorry to hear that | 14:03 |
| shardy | hopefully we can get some other folks interested anyway and discuss it remotely and/or on the ML | 14:04 |
| dtantsur | :( | 14:05 |
| dtantsur | suddenly when I'm not going everyone needs me | 14:05 |
| *** raildo_ has quit IRC | 14:05 | |
| dtantsur | shardy: on the other hand, I don't find PTGs a good place for early design discussions | 14:05 |
| dtantsur | probably in a corner of a bar in the evening :) | 14:06 |
| shardy | dtantsur: beer-track++ :) | 14:06 |
| slagle | someone say beer | 14:06 |
| dtantsur | shardy: do you know if you plan to be in berlin? | 14:06 |
| honza | beer | 14:06 |
| shardy | dtantsur: Not sure yet | 14:06 |
| dtantsur | lol slagle do you have notification on beer? | 14:06 |
| slagle | i'm interested. what are we talking about | 14:06 |
| honza | i do :) | 14:06 |
| dtantsur | LOL | 14:07 |
| shardy | slagle: the novaless deploy patch, and a possible future option of a lightweight deployment appliance vs the full TripleO stack | 14:07 |
| slagle | dtantsur: shardy : right :). i will help and would like to be involved. | 14:07 |
| shardy | everyone is interested now I said beer ;D | 14:07 |
| dtantsur | well, if we remove nova, glance and swift, and make ironic-inspector optional, undercloud will be a lightweight appliance | 14:07 |
| dtantsur | right :) | 14:08 |
| dtantsur | on the other hand, if I want to the PTG, I would spend most of my time in the Ironic track.. so I really thing we should have something outside of it. | 14:08 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: Create missing directories before mounting them https://review.openstack.org/595831 | 14:08 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: Initial support for Podman in docker-puppet https://review.openstack.org/588655 | 14:09 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: docker-puppet: don't force FACTER_hostname https://review.openstack.org/595274 | 14:09 |
| shardy | dtantsur: sure, but that was the reason for my question re the Ironic API earlier - it's cool to solve this for TripleO, but it does seem like a more general requirement | 14:09 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: DNM - test podman https://review.openstack.org/590587 | 14:09 |
| shardy | I guess regardless of this TripleO is a good place to incubate it | 14:09 |
| dtantsur | shardy: there are plans to solve parts of it in ironic. we should don't know when and how much. | 14:09 |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Remove unused config file when start ovs agent https://review.openstack.org/597387 | 14:09 |
| dtantsur | I can imagine something like mistral-ironic-workbook which is not tripleo-dependent | 14:09 |
| dtantsur | and just uses metalsmith and pure API | 14:10 |
| slagle | i think we will need to solve for the API outside of Ironic | 14:10 |
| slagle | unless Ironic is considering expanding a lot of scope | 14:11 |
| *** ykarel is now known as ykarel|afk | 14:11 | |
| dtantsur | what I'm saying is that we'd maybe better use mistral than have a lot of logic written in go | 14:11 |
| dtantsur | slagle: we do consider some expansion, but no promises made (incl. time scale) | 14:11 |
| slagle | yes, i did a similar thing with ansible. you need some higher level deployment abstractions that go beyond just what Ironic does | 14:12 |
| shardy | Yeah for now using mistral as the API seems fine, I just wondered about the Ironic API scope encompassing some of this in future | 14:12 |
| dtantsur | and one of the reason I suggested a working group to have a place to capture the current discussion :) | 14:12 |
| dtantsur | * is to have.. | 14:12 |
| slagle | wg would be fine. could also operate within the edge squad, although that is a tripleo specific thing | 14:14 |
| *** ykarel|afk has quit IRC | 14:15 | |
| *** rmascena__ has quit IRC | 14:16 | |
| *** raildo has joined #tripleo | 14:17 | |
| dtantsur | shardy, slagle, do we have any plans to ever get rid of heat? | 14:18 |
| shardy | dtantsur: as I mentioned in your review we could consider it at some future point, e.g deploy nodes then configure them with ansible | 14:19 |
| dtantsur | I guess the biggest problem is migrating existing stacks | 14:19 |
| *** raildo has quit IRC | 14:19 | |
| shardy | the heat stack could still be used for backwards compatibility, e.g in ephemeral mode like we do for the undercloud, but there are probably other options for new applications | 14:19 |
| dtantsur | shardy: my head is boiling, did we agree on something re "requests"? | 14:19 |
| *** raildo has joined #tripleo | 14:20 | |
| shardy | dtantsur: the undeploy workflow just says "instances" - can we use that instead perhaps? | 14:20 |
| shardy | at least for the user-visible inputs? | 14:20 |
| dtantsur | shardy: then it will have two meanings.. won't it be confusing? | 14:20 |
| shardy | not a big deal, maybe we just need more docstrings | 14:21 |
| shardy | dtantsur: well in each case it's a list of instances - at some point the undeploy workflow could even accept the same list format and look up the nodes? | 14:21 |
| slagle | dtantsur: there aren't any specific plans to get rid of Heat that I know of. we're addressing it in a different way, by looking at what adds user facing value | 14:21 |
| dtantsur | shardy: it does not make sense for it to accept e.g. {capabilities: {profile:compute}} | 14:21 |
| slagle | dtantsur: eventually, we may end up in a spot where it makes sense to look at a migration off heat | 14:22 |
| * dtantsur thinks again | 14:22 | |
| shardy | if you wanted to undeploy all compute nodes it would :) | 14:22 |
| shardy | but sure, it can be two different list formats | 14:22 |
| dtantsur | well, it won't work this way for now :) | 14:22 |
| shardy | dtantsur: yeah I know :) | 14:22 |
| dtantsur | I mean, it's fine, I can do "instances" for both. I had it in one of the revisions. | 14:22 |
| shardy | dtantsur: Ok shall we go with that? | 14:23 |
| shardy | I don't want to bikeshed but "requests" had me confused for a while when testing | 14:23 |
| dtantsur | okay, lemme update it | 14:23 |
| slagle | dtantsur: i think with the novaless deployment, we have an opportunity to define a new interface around baremetal deployment for tripleo (or whatever). | 14:23 |
| openstackgerrit | Alex Schultz proposed openstack/tripleo-docs master: Add usage examples for standalone https://review.openstack.org/595869 | 14:24 |
| openstackgerrit | Alex Schultz proposed openstack/tripleo-docs master: Add networking diagrams https://review.openstack.org/595888 | 14:24 |
| slagle | dtantsur: and then use that interface to provision, and then suck that into Heat via deployed-server | 14:24 |
| dtantsur | shardy: the only problem is that now I have hard times to test it, because containers.. | 14:24 |
| shardy | slagle: agreed - my speculation above was just to say, perhaps we don't couple this to heat and stick with deployed-server and config-download | 14:24 |
| slagle | dtantsur: so kind of flipping what you have initially done with the ptch | 14:24 |
| shardy | then we have options in future | 14:24 |
| slagle | *patch | 14:24 |
| dtantsur | slagle: I like it, my only problem is with deriving parameters from heat templates | 14:25 |
| dtantsur | things like OvercloudComputeFlavor, other optional things | 14:25 |
| openstackgerrit | Martin Mágr proposed openstack/tripleo-heat-templates master: Enable neutron-sriov-agent health check https://review.openstack.org/555283 | 14:25 |
| slagle | right, backwards compatibility :) | 14:25 |
| dtantsur | yeaaah | 14:25 |
| openstackgerrit | Martin Mágr proposed openstack/tripleo-heat-templates master: Add reflection of RpcPort to health checks https://review.openstack.org/583629 | 14:25 |
| slagle | we could start by defining what a new interface might look like in a perfect world. and then see how we could make it backwards compatible | 14:26 |
| shardy | I was more approaching it thinking "what if" for the OpenShift case, where we don't have many backwards compat constraints | 14:26 |
| shardy | yeah | 14:27 |
| slagle | we kind of did that for the undercloud install | 14:27 |
| slagle | shardy: yep, that's one of the reasons why i like not constraining ourselves to what we already have | 14:27 |
| *** moshele has quit IRC | 14:29 | |
| dtantsur | okay, so this affects the next patch I'm writing, not the current one, right? | 14:30 |
| dtantsur | this one only needs cosmetic changes | 14:30 |
| dtantsur | shardy: did you have any success with a script to update containers on a live undercloud? | 14:32 |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart-extras master: Stop relying on old legacy sub_nodes_private https://review.openstack.org/596906 | 14:33 |
| *** waleedm has quit IRC | 14:33 | |
| *** ksambor has quit IRC | 14:34 | |
| *** dtrainor_ has quit IRC | 14:35 | |
| *** dtrainor has joined #tripleo | 14:35 | |
| openstackgerrit | Sorin Sbarnea proposed openstack/tripleo-quickstart master: Remove duplicate dictionary keys and avoid future regression https://review.openstack.org/597547 | 14:36 |
| *** hamdyk has quit IRC | 14:38 | |
| ssbarnea | arxcruz: ^ | 14:39 |
| shardy | dtantsur: I've not yet written a script, but the steps in https://etherpad.openstack.org/p/tripleo-rpm-container-image-notes are working fine for me | 14:39 |
| dtantsur | okie, I'll try it | 14:40 |
| *** sri_ has joined #tripleo | 14:40 | |
| shardy | dtantsur: if you need a script I can look at creating one, basically I manually rebuilt the mistral executor, api and engine containers, pushed them, then hacked the paunch config for step4 and step5 | 14:40 |
| shardy | step5 is needed to populate the actions | 14:40 |
| shardy | dtantsur: I also had to manually load the new workbook via the mistral CLI | 14:41 |
| shardy | dtantsur: note the "from source" option is much, much faster | 14:41 |
| dtantsur | I can imagine :) | 14:42 |
| dtantsur | I'll probably update tripleo-common tomorrow, my brain does not want to work today | 14:42 |
| shardy | dtantsur: ack np | 14:44 |
| dtantsur | thanks for review! | 14:45 |
| shardy | dtantsur: np - as noted in https://bugs.launchpad.net/tripleo/+bug/1788414 the prepare command can actually modify images before upload, I've not yet tried that but it may be better than a script | 14:46 |
| openstack | Launchpad bug 1788414 in tripleo "No easy way for local debugging on the containerized undercloud" [High,Triaged] | 14:46 |
| EmilienM | mwhahaha: is stable/rocky still broken? | 14:47 |
| *** zaneb has quit IRC | 14:47 | |
| mwhahaha | EmilienM: no idea | 14:47 |
| mwhahaha | shouldn't be | 14:47 |
| EmilienM | k | 14:47 |
| mwhahaha | i thought we merged the fix last night | 14:47 |
| mwhahaha | will need to recheck | 14:47 |
| *** pcaruana has joined #tripleo | 14:50 | |
| d0ugal | Workflow squad meeting in 10 mins. https://etherpad.openstack.org/p/tripleo-workflows-squad-status /cc rbrady,apetrich,thrash,toure,jtomasek | 14:50 |
| dtantsur | slagle: is there an edge squad meeting btw? | 14:51 |
| *** zaneb has joined #tripleo | 14:52 | |
| slagle | dtantsur: not yet | 14:52 |
| dtantsur | k | 14:52 |
| slagle | what times work for you? :) | 14:53 |
| openstackgerrit | weizj proposed openstack/tripleo-validations master: fix bug link in readme https://review.openstack.org/597557 | 14:54 |
| *** dtrainor has quit IRC | 14:54 | |
| *** dtrainor has joined #tripleo | 14:54 | |
| *** dtrainor has quit IRC | 14:56 | |
| *** vinaykns has joined #tripleo | 14:56 | |
| *** dtrainor has joined #tripleo | 14:57 | |
| *** ykarel has joined #tripleo | 14:57 | |
| mwhahaha | EmilienM: It looks like rocky seems to be ok now | 14:59 |
| mwhahaha | i'm rechecking steve's patch | 14:59 |
| EmilienM | good | 15:00 |
| dtantsur | slagle: CEST-friendly :) maybe create a doodle? I have assorted meetings here and there.. | 15:02 |
| slagle | dtantsur: will do | 15:03 |
| dtantsur | thnx | 15:03 |
| *** janki has quit IRC | 15:04 | |
| openstackgerrit | Ana Krivokapic proposed openstack/tripleo-docs master: Document the custom validations feature https://review.openstack.org/569966 | 15:05 |
| jaosorior | slagle, mwhahaha, EmilienM: Any place in the docs where you think it's the most relevant to add the list of squads? Should I add it in the index? | 15:08 |
| mwhahaha | jaosorior: it's already in the docs | 15:08 |
| jaosorior | is it? | 15:08 |
| jaosorior | thought it was only in the specs repo | 15:08 |
| mwhahaha | oh yea | 15:09 |
| mwhahaha | so yea probably under the contributor guide | 15:09 |
| *** raildo_ has joined #tripleo | 15:14 | |
| openstackgerrit | Merged openstack/tripleo-docs master: Add usage examples for standalone https://review.openstack.org/595869 | 15:15 |
| openstackgerrit | Merged openstack/tripleo-docs master: Add networking diagrams https://review.openstack.org/595888 | 15:15 |
| *** raildo has quit IRC | 15:17 | |
| openstackgerrit | yatin proposed openstack/tripleo-quickstart master: [FS021] Switch to containerized undercloud net config https://review.openstack.org/594111 | 15:19 |
| ykarel | sshnaidm, EmilienM can u look at ^^ | 15:19 |
| openstackgerrit | Alex Schultz proposed openstack/tripleo-common master: Add image building config file for Fedora and py3 https://review.openstack.org/597234 | 15:21 |
| EmilienM | ykarel: will do asap | 15:21 |
| ykarel | EmilienM, Thanks | 15:21 |
| openstackgerrit | Alex Schultz proposed openstack/tripleo-common master: Add image building config file for Fedora and py3 https://review.openstack.org/597234 | 15:22 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-docs master: Add squads to the docs https://review.openstack.org/597565 | 15:24 |
| jaosorior | slagle, mwhahaha, EmilienM ^^ | 15:24 |
| *** ykarel has quit IRC | 15:25 | |
| EmilienM | we already have it http://specs.openstack.org/openstack/tripleo-specs/specs/policy/squads.html | 15:25 |
| EmilienM | I commented | 15:26 |
| *** chem has quit IRC | 15:26 | |
| openstackgerrit | Ronelle Landy proposed openstack-infra/tripleo-ci master: Remove inclusion of legacy playbook in tripleo-ci-base https://review.openstack.org/596422 | 15:26 |
| *** ykarel has joined #tripleo | 15:27 | |
| jaosorior | EmilienM: we do, and I don't think it's the appropriate place to keep that. | 15:28 |
| jaosorior | It was good for the proposal, but not to keep that info. | 15:28 |
| EmilienM | ok | 15:28 |
| EmilienM | i'm fine movingi t | 15:28 |
| jaosorior | I think | 15:28 |
| jaosorior | slagle: ^^ | 15:28 |
| slagle | jaosorior: i commented, but it doesnt address what we talked about yesterday | 15:28 |
| slagle | which is where do you update the copy/paste boilerplate used during the tripleo meeting | 15:29 |
| *** jtomasek has quit IRC | 15:29 | |
| slagle | without having to hack the ptl's laptop | 15:29 |
| slagle | that's all I wanted to know :) | 15:29 |
| jaosorior | OK. So... what do you suggest? | 15:29 |
| slagle | i suggested the wiki | 15:29 |
| jaosorior | slagle: I updated the wiki already | 15:29 |
| slagle | ok great. not sure why we need this docs change then | 15:30 |
| slagle | unless the aim is to move from policy to docs | 15:30 |
| slagle | fine with me | 15:31 |
| jaosorior | slagle: cause it's probably good for a new-coming contributor to see what squads are there. The docs are where the folks go. Not the specs | 15:31 |
| openstackgerrit | Jose Luis Franco proposed openstack/tripleo-quickstart master: Set the correct config download settings for queens. https://review.openstack.org/597450 | 15:31 |
| jaosorior | I think the policy file in the specs repo should point to the docs to list the current squads. | 15:31 |
| jaosorior | unless folks don't think it's a good idea. Then we can just leave things as they are. | 15:33 |
| * mwhahaha thinks we should stop arguing over something like this and solve real problems | 15:33 | |
| mwhahaha | docs are the entry point for external folks, the list of squads should be in a single spot that's likely to be consumed externally | 15:33 |
| *** aufi has joined #tripleo | 15:33 | |
| mwhahaha | move it out of specs into docs and move on with life | 15:34 |
| jaosorior | I thought it would be a 2 min conversation/review. | 15:34 |
| * mwhahaha blames EmilienM | 15:34 | |
| jaosorior | Anybody still seeing errors such as: resources.ServiceChain: Property error: resources[2].properties: Property DockerCinderConfigImage not assigned ? | 15:36 |
| EmilienM | mwhahaha: why? | 15:36 |
| mwhahaha | jaosorior: stevebaker was working on that, not sure if it's been fully resolved | 15:36 |
| EmilienM | mwhahaha: I've +2'ed his proposal fwiw | 15:37 |
| *** dxiri has joined #tripleo | 15:38 | |
| *** dxiri has quit IRC | 15:38 | |
| *** dxiri has joined #tripleo | 15:39 | |
| *** ykarel_ has joined #tripleo | 15:39 | |
| *** yprokule has quit IRC | 15:40 | |
| *** kopecmartin has quit IRC | 15:40 | |
| *** ykarel has quit IRC | 15:42 | |
| openstackgerrit | Alex Schultz proposed openstack/tripleo-common master: Add image building config file for Fedora and py3 https://review.openstack.org/597234 | 15:43 |
| fultonj | dtantsur d0ugal thrash fyi, filed a bug on that MessagingTimeout we were talking about earlier https://bugs.launchpad.net/tripleo/+bug/1789680 | 15:44 |
| openstack | Launchpad bug 1789680 in tripleo "mistral MessagingTimeout correlates with containerized undercloud uptime" [Critical,Triaged] | 15:44 |
| fultonj | EmilienM: fyi ^ | 15:45 |
| fultonj | EmilienM: d0ugal was looking into it as jtomasek reported it earlier | 15:45 |
| *** shyamb has joined #tripleo | 15:46 | |
| *** jfrancoa has quit IRC | 15:46 | |
| EmilienM | fultonj: nice | 15:46 |
| *** rpioso|afk is now known as rpioso | 15:48 | |
| sri_ | fultonj, hi if you have min can you please look at this, overcloud failing with NotFound: Software config with http://paste.openstack.org/show/729060/ | 15:56 |
| sri_ | fultonj, in my setup ceph,controller,compute all have Storage network and only ceph nodes have StorageMgmt network | 15:57 |
| sri_ | fultonj, I think validation expects to all nodes to ping on every network in controller | 15:58 |
| *** jpich has joined #tripleo | 15:59 | |
| openstackgerrit | RedHat RDO CI proposed openstack/tripleo-quickstart-extras master: GATE CHECK for quickstart-extras https://review.openstack.org/560445 | 16:00 |
| sri_ | fultonj, to disable the validation i am passing this in my environment resource_registry: OS::TripleO::AllNodes::Validation: OS::Heat::None | 16:00 |
| *** leanderthal has quit IRC | 16:01 | |
| *** shyamb has quit IRC | 16:03 | |
| *** raildo_ has quit IRC | 16:04 | |
| *** raildo has joined #tripleo | 16:05 | |
| sri_ | fultonj, here is my complete config http://paste.openstack.org/show/729061/ | 16:06 |
| sri_ | mwhahaha, ^^ | 16:07 |
| *** rdopiera has quit IRC | 16:08 | |
| openstackgerrit | Sorin Sbarnea proposed openstack/tripleo-quickstart master: Remove duplicate dictionary keys https://review.openstack.org/597547 | 16:08 |
| *** slaweq has quit IRC | 16:11 | |
| *** links has quit IRC | 16:14 | |
| *** ramishra has quit IRC | 16:15 | |
| *** ykarel_ is now known as ykarel|away | 16:16 | |
| *** slaweq has joined #tripleo | 16:16 | |
| *** udesale has quit IRC | 16:16 | |
| *** trozet has joined #tripleo | 16:16 | |
| openstackgerrit | Marius Cornea proposed openstack/tripleo-heat-templates master: Move to openshift-ansible 3.10 https://review.openstack.org/582495 | 16:17 |
| *** dsneddon has quit IRC | 16:18 | |
| *** slaweq has quit IRC | 16:21 | |
| openstackgerrit | Alex Schultz proposed openstack/tripleo-puppet-elements master: Add python3 heat agent for Fedora https://review.openstack.org/596498 | 16:21 |
| openstackgerrit | Sorin Sbarnea proposed openstack/tripleo-quickstart master: Enable yamllint to avoid future key duplications https://review.openstack.org/597581 | 16:23 |
| *** dsneddon has joined #tripleo | 16:23 | |
| openstackgerrit | Merged openstack/tripleo-common stable/pike: ensure unique ironic node ID with UCS driver https://review.openstack.org/591766 | 16:25 |
| sshnaidm | jistr, it's weird, but no output... http://logs.openstack.org/25/597525/1/check/tripleo-ci-centos-7-containers-multinode/de8a8af/logs/undercloud/var/log/extra/docker/containers/ironic_conductor/docker_info.log.txt.gz | 16:26 |
| *** dsneddon has quit IRC | 16:27 | |
| *** aufi has quit IRC | 16:28 | |
| sshnaidm | jaosorior, I think it's here: https://bugs.launchpad.net/tripleo/+bug/1783653 | 16:28 |
| openstack | Launchpad bug 1783653 in tripleo "scenario007 failing with resources.ServiceChain: resources.BlockStorageServiceChain.Property error: resources[2].properties: Property DockerCinderConfigImage not assigned" [Critical,Triaged] - Assigned to Steve Baker (steve-stevebaker) | 16:28 |
| *** jpena is now known as jpena|off | 16:31 | |
| *** jpich has quit IRC | 16:32 | |
| *** trown is now known as trown|lunch | 16:33 | |
| *** khyr0n has quit IRC | 16:34 | |
| *** slaweq has joined #tripleo | 16:35 | |
| *** psachin has joined #tripleo | 16:40 | |
| *** morazi has quit IRC | 16:41 | |
| jrist | the feature itself has merged, can we get the doc update merged? https://review.openstack.org/#/c/569966/ | 16:42 |
| jrist | thanks | 16:42 |
| *** ykarel|away has quit IRC | 16:46 | |
| *** slaweq has quit IRC | 16:49 | |
| *** shardy has quit IRC | 16:52 | |
| *** dtantsur is now known as dtantsur|afk | 16:54 | |
| *** ccamacho has quit IRC | 16:54 | |
| *** khyr0n has joined #tripleo | 16:56 | |
| *** psachin has quit IRC | 16:56 | |
| openstackgerrit | Merged openstack/tripleo-docs master: Document the custom validations feature https://review.openstack.org/569966 | 16:58 |
| fultonj | sri_: i think something else is going on | 17:00 |
| fultonj | sri_: you can `openstack overcloud deploy ... --disable-validations` | 17:01 |
| fultonj | sri_: only ceph storage nodes need the storage mgmt network (or hci computes, basically any server which runs the ceph osd service) | 17:02 |
| fultonj | as you correctly state | 17:02 |
| fultonj | sri_: however, you should be able to deploy without the storage_mgmt network needing to be on the controllers | 17:02 |
| fultonj | i used to do that | 17:02 |
| *** akrivoka has quit IRC | 17:02 | |
| fultonj | sri_: if you really believe it's that the controllers insist on being able to ping IPs in the storage_mgmt, then the easiest workaround (and way to test your theory that that's causing your problem) is to put the controllers on that network | 17:03 |
| openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-quickstart-extras master: Log collection: sorted rpm -qa for containers https://review.openstack.org/597525 | 17:04 |
| sri_ | fultonj, https://github.com/openstack/tripleo-heat-templates/blob/master/overcloud.j2.yaml#L860 | 17:04 |
| openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-quickstart-extras master: Log collection: list installed rpms and their source repos https://review.openstack.org/597525 | 17:05 |
| sshnaidm | jistr, changed a little bit ^^ | 17:05 |
| *** florianf has quit IRC | 17:05 | |
| sri_ | fultonj, I will try --disable-validations, trying to deconstruct peace by peace, this time trying to deploy without ceph to see if everything working, | 17:05 |
| *** zul has quit IRC | 17:06 | |
| sri_ | fultonj, about adding storage_mgmt to controller I don't have access the network, that request take 2 to 3 days to finsh | 17:08 |
| fultonj | sri_: it's on in your trunk? | 17:08 |
| fultonj | nic4 and nic6 are physically distrinct then i take it? | 17:08 |
| fultonj | distrinct* | 17:08 |
| fultonj | i see | 17:09 |
| sri_ | fultonj, I think compute and controller in a trunk, storage node not in trunk, bond's with ip's, I am not sure tho | 17:10 |
| fultonj | sri_: ack | 17:10 |
| fultonj | somtimes if it's in the trunk anyway that's an easy way to check | 17:10 |
| fultonj | but if it's not and you need to talk to the network team.... yeah | 17:11 |
| sri_ | fultonj, the error message not clear http://paste.openstack.org/show/729062/ | 17:11 |
| fultonj | yeah | 17:12 |
| sri_ | fultonj, I must be missing soemting very basic thing, :) | 17:13 |
| fultonj | https://github.com/openstack/tripleo-heat-templates/blob/1ad6b2bd893bc3ca15c395528fe76f46c1254a23/ci/common/all-nodes-validation-disabled.yaml | 17:13 |
| fultonj | hmmm | 17:13 |
| *** gkadam has joined #tripleo | 17:14 | |
| fultonj | sri_: is that error from when you tried to disalb ethe validations? | 17:14 |
| fultonj | sri_: this is not my strong area, i've been able to get it to do what i need, but I don't hack on this directly | 17:15 |
| *** gkadam has quit IRC | 17:15 | |
| sri_ | fultonj, I think so, I've just re-deploy the stack without disabling validations | 17:15 |
| *** gkadam has joined #tripleo | 17:15 | |
| sri_ | fultonj, understand | 17:15 |
| sri_ | fultonj, thanks for looking into it, I will do more testing and let you know | 17:18 |
| *** vinaykns has quit IRC | 17:21 | |
| *** rpioso is now known as rpioso|eat | 17:21 | |
| openstackgerrit | David Rabel proposed openstack/tripleo-docs master: Fix indentation in tempest.rst https://review.openstack.org/597610 | 17:25 |
| *** gbarros has quit IRC | 17:25 | |
| *** gbarros has joined #tripleo | 17:27 | |
| *** dsneddon has joined #tripleo | 17:31 | |
| openstackgerrit | Merged openstack/instack-undercloud master: Replace assertRaisesRegexp with assertRaisesRegex https://review.openstack.org/596772 | 17:41 |
| openstackgerrit | Merged openstack/instack-undercloud master: import zuul job settings from project-config https://review.openstack.org/596028 | 17:43 |
| openstackgerrit | Merged openstack/instack-undercloud master: switch documentation job to new PTI https://review.openstack.org/596029 | 17:43 |
| openstackgerrit | Merged openstack/instack-undercloud master: add python 3.6 unit test job https://review.openstack.org/596030 | 17:43 |
| *** jtomasek has joined #tripleo | 17:45 | |
| *** trown|lunch is now known as trown|brb | 17:50 | |
| *** trown|brb is now known as trown | 17:50 | |
| *** noama has quit IRC | 17:52 | |
| *** slaweq has joined #tripleo | 17:54 | |
| sri_ | fultonj, I think I am getting that error if pass OS::TripleO::AllNodes::Validation: OS::Heat::None to env | 17:57 |
| openstackgerrit | Alex Schultz proposed openstack/python-tripleoclient master: Remove instack-undercloud and --use-heat https://review.openstack.org/588606 | 17:57 |
| *** sanjayu_ has quit IRC | 18:00 | |
| jaosorior | mwhahaha: wooo! :D | 18:02 |
| *** slaweq has quit IRC | 18:03 | |
| openstackgerrit | Sorin Sbarnea proposed openstack-infra/tripleo-ci master: replace pep8 check with generic linters https://review.openstack.org/588588 | 18:03 |
| mwhahaha | rlandy, sshnaidm, panda: https://review.openstack.org/#/c/589540/ if you have a second | 18:05 |
| sshnaidm | mwhahaha, why do we need libselinux? | 18:06 |
| mwhahaha | sshnaidm: it was required for some task, I'd have to try and reproduce the error | 18:09 |
| mwhahaha | I was using it as a standalone and got that error if you have enforcing on | 18:09 |
| sshnaidm | mwhahaha, ok | 18:10 |
| sshnaidm | mwhahaha, worth to get reviews from #rdo infra folks too.. | 18:13 |
| openstackgerrit | Rafael Folco proposed openstack-infra/tripleo-ci master: Move toci BASH variables to ansible https://review.openstack.org/589448 | 18:14 |
| openstackgerrit | Rafael Folco proposed openstack-infra/tripleo-ci master: Move toci BASH variables to ansible https://review.openstack.org/589448 | 18:14 |
| mwhahaha | Why it's just parameterizing what we have | 18:14 |
| bnemec | Did we lose ooolpbot? | 18:15 |
| bnemec | It looks like there are some alert bugs open but I don't see any alerts today. | 18:15 |
| *** zul has joined #tripleo | 18:20 | |
| *** rh-jelabarre has quit IRC | 18:22 | |
| *** slaweq has joined #tripleo | 18:22 | |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: Create missing directories before mounting them https://review.openstack.org/595831 | 18:29 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: Create missing directories before mounting them https://review.openstack.org/595831 | 18:29 |
| *** rh-jelabarre has joined #tripleo | 18:29 | |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: Create missing directories before mounting them https://review.openstack.org/595831 | 18:29 |
| *** slaweq has quit IRC | 18:31 | |
| *** wolverineav has joined #tripleo | 18:32 | |
| *** vinaykns has joined #tripleo | 18:34 | |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-quickstart master: Enable virt7-container-common-candidate repo starting in Stein https://review.openstack.org/592079 | 18:51 |
| EmilienM | mwhahaha: FYI https://review.openstack.org/#/c/592695/ just landed. | 18:53 |
| mwhahaha | k | 18:53 |
| openstackgerrit | Rafael Folco proposed openstack-infra/tripleo-ci master: DNM: Add another level of parent jobs for zuul v3 https://review.openstack.org/593063 | 18:55 |
| *** gkadam has quit IRC | 18:56 | |
| *** rpioso|eat is now known as rpioso | 19:04 | |
| *** toure is now known as toure|biab | 19:08 | |
| *** pcaruana has quit IRC | 19:09 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Define keepalived service in environments/docker.yaml https://review.openstack.org/593621 | 19:12 |
| *** tiwu has quit IRC | 19:23 | |
| openstackgerrit | Alex Schultz proposed openstack/tripleo-common master: import zuul job settings from project-config https://review.openstack.org/596053 | 19:28 |
| openstackgerrit | Alex Schultz proposed openstack/tripleo-common master: switch documentation job to new PTI https://review.openstack.org/596054 | 19:28 |
| openstackgerrit | Alex Schultz proposed openstack/tripleo-common master: add python 3.6 unit test job https://review.openstack.org/596055 | 19:28 |
| dpeacock | mwhahaha: I'm trying to coordinate with doug on the upstream dev mailing list and I think you're into this already - do you want to take over that or is there anything I can take off your plate? | 19:30 |
| mwhahaha | dpeacock: i started looking, you may want to take a look at the failing ci ones | 19:31 |
| mwhahaha | dpeacock: recheck and such as necessary. it looks like their THT patch is bad against mater | 19:31 |
| mwhahaha | https://review.openstack.org/#/c/596061/ | 19:31 |
| mwhahaha | needs to be manually fixed as their script didn't work right | 19:31 |
| dpeacock | ok | 19:32 |
| openstackgerrit | Rafael Folco proposed openstack-infra/tripleo-ci master: Move toci BASH variables to ansible https://review.openstack.org/589448 | 19:33 |
| *** gbarros has quit IRC | 19:36 | |
| openstackgerrit | Alex Schultz proposed openstack/tripleo-image-elements master: add python 3.6 unit test job https://review.openstack.org/596064 | 19:37 |
| *** gbarros has joined #tripleo | 19:39 | |
| openstackgerrit | Merged openstack/tripleo-docs master: import zuul job settings from project-config https://review.openstack.org/596058 | 19:39 |
| *** morazi has joined #tripleo | 19:42 | |
| openstackgerrit | Dan Prince proposed openstack/ansible-role-tripleo-modify-image master: Fix the roles_path to actually work in a venv https://review.openstack.org/597645 | 19:47 |
| openstackgerrit | Merged openstack/tripleo-ipsec stable/queens: import zuul job settings from project-config https://review.openstack.org/596133 | 19:51 |
| *** gbarros has quit IRC | 19:51 | |
| mwhahaha | dpeacock: you may want to look into why tripleo-puppet-elements stable branches fail with the pep8/tox jobs | 19:56 |
| dpeacock | mwhahaha: sure - tox is fubar until the upstream requirements is sorted out - I'm waiting on some peeps I'm collabing with for that. | 19:57 |
| mwhahaha | k | 19:57 |
| dpeacock | thanks | 19:58 |
| dpeacock | going afk a while - back later | 19:58 |
| *** radeks_ has joined #tripleo | 19:59 | |
| *** dprince has quit IRC | 20:01 | |
| *** slaweq has joined #tripleo | 20:01 | |
| *** radeks has quit IRC | 20:02 | |
| openstackgerrit | Rafael Folco proposed openstack-infra/tripleo-ci master: Move toci BASH variables to ansible https://review.openstack.org/589448 | 20:13 |
| *** rh-jelabarre has quit IRC | 20:20 | |
| *** mgagne has joined #tripleo | 20:20 | |
| *** gbarros has joined #tripleo | 20:26 | |
| *** rh-jelabarre has joined #tripleo | 20:26 | |
| *** dhill_ has quit IRC | 20:27 | |
| openstackgerrit | Ronelle Landy proposed openstack-infra/tripleo-ci master: Remove inclusion of legacy playbook in tripleo-ci-base https://review.openstack.org/596422 | 20:27 |
| *** gbarros has quit IRC | 20:33 | |
| *** gbarros has joined #tripleo | 20:36 | |
| *** jcoufal has quit IRC | 20:38 | |
| *** raildo has quit IRC | 20:41 | |
| stevebaker | morning | 20:51 |
| openstackgerrit | Merged openstack/tripleo-repos master: fix tox python3 overrides https://review.openstack.org/591925 | 20:51 |
| openstackgerrit | Merged openstack/instack master: import zuul job settings from project-config https://review.openstack.org/596025 | 20:53 |
| openstackgerrit | Merged openstack/instack master: add python 3.6 unit test job https://review.openstack.org/596026 | 20:53 |
| openstackgerrit | Merged openstack/instack master: add python 3.6 unit test job https://review.openstack.org/596027 | 20:56 |
| openstackgerrit | Merged openstack/instack stable/ocata: import zuul job settings from project-config https://review.openstack.org/596085 | 20:56 |
| openstackgerrit | Merged openstack/instack stable/rocky: import zuul job settings from project-config https://review.openstack.org/596138 | 20:56 |
| openstackgerrit | Merged openstack/instack stable/queens: import zuul job settings from project-config https://review.openstack.org/596121 | 20:56 |
| openstackgerrit | Merged openstack/instack stable/pike: import zuul job settings from project-config https://review.openstack.org/596105 | 20:56 |
| *** waleedm has joined #tripleo | 20:58 | |
| openstackgerrit | Oliver Walsh proposed openstack/tripleo-heat-templates stable/pike: DNM: test compute extraconfig https://review.openstack.org/597705 | 21:00 |
| *** trown is now known as trown|outtypewww | 21:05 | |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart-extras master: Testing adding properties to flavors https://review.openstack.org/579406 | 21:13 |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart-extras master: Increase nova db_sync time if defined. https://review.openstack.org/593077 | 21:14 |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Enable neutron-sriov-agent health check https://review.openstack.org/555283 | 21:14 |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart master: [DNM] Test job for OVB ci-rhos https://review.openstack.org/577230 | 21:14 |
| *** wolverineav has quit IRC | 21:20 | |
| *** abishop has quit IRC | 21:23 | |
| *** radeks_ has quit IRC | 21:25 | |
| *** bfournie has quit IRC | 21:34 | |
| *** mcarden has joined #tripleo | 21:37 | |
| openstackgerrit | Merged openstack/tripleo-validations stable/queens: import zuul job settings from project-config https://review.openstack.org/596137 | 21:44 |
| *** sri_ has quit IRC | 21:45 | |
| *** sri_ has joined #tripleo | 21:46 | |
| openstackgerrit | Merged openstack/tripleo-validations stable/pike: import zuul job settings from project-config https://review.openstack.org/596120 | 21:46 |
| *** rcernin has joined #tripleo | 21:49 | |
| *** gbarros has quit IRC | 21:51 | |
| *** fultonj has quit IRC | 21:58 | |
| *** vinaykns has quit IRC | 22:08 | |
| *** slaweq has quit IRC | 22:17 | |
| *** threestrands has joined #tripleo | 22:19 | |
| *** threestrands has quit IRC | 22:19 | |
| *** threestrands has joined #tripleo | 22:22 | |
| *** waleedm has quit IRC | 22:25 | |
| openstackgerrit | Sergii Golovatiuk proposed openstack/tripleo-heat-templates master: Always lowercase role name https://review.openstack.org/597722 | 22:25 |
| openstackgerrit | Pablo Iranzo Gómez proposed openstack/tripleo-common master: Fix formatting options https://review.openstack.org/597723 | 22:28 |
| *** sri_ has quit IRC | 22:45 | |
| *** sri_ has joined #tripleo | 22:46 | |
| openstackgerrit | Alex Schultz proposed openstack/python-tripleoclient master: import zuul job settings from project-config https://review.openstack.org/596048 | 22:51 |
| openstackgerrit | Alex Schultz proposed openstack/python-tripleoclient master: switch documentation job to new PTI https://review.openstack.org/596049 | 22:51 |
| openstackgerrit | Alex Schultz proposed openstack/python-tripleoclient master: add python 3.6 unit test job https://review.openstack.org/596050 | 22:51 |
| *** gfidente has quit IRC | 22:55 | |
| *** rlandy is now known as rlandy|bbl | 22:57 | |
| *** zaneb has quit IRC | 22:57 | |
| openstackgerrit | Steve Baker proposed openstack/tripleo-common master: Handle sparse resource registry in build_service_filter https://review.openstack.org/597726 | 22:58 |
| stevebaker | mwhahaha: ^^ this could be one for rc2 | 23:01 |
| *** zaneb has joined #tripleo | 23:02 | |
| mwhahaha | stevebaker: is that the cinder image stuff? | 23:08 |
| *** lblanchard has quit IRC | 23:08 | |
| *** slaweq has joined #tripleo | 23:11 | |
| *** tosky has quit IRC | 23:13 | |
| *** slaweq has quit IRC | 23:15 | |
| *** thrash is now known as thrash|g0ne | 23:21 | |
| stevebaker | mwhahaha: it *could* be, unless that is lingering because of the lack of a promotion | 23:21 |
| mwhahaha | stevebaker: we're still trying to land your docker container service in rocky, so it's a race to get them both landed :D | 23:22 |
| stevebaker | oh well I'll backport it, if it makes it it makes it | 23:23 |
| *** toure|biab is now known as toure|gone | 23:23 | |
| *** toure|gone is now known as toure|pto | 23:23 | |
| stevebaker | mwhahaha: maybe I should exclude rocky from this change so it can land on master, then add rocky https://review.openstack.org/#/c/573476/ | 23:23 |
| mwhahaha | stevebaker: yea if it's already landed in master, drop the depends-on | 23:24 |
| mwhahaha | stevebaker: or change it to the depends-on: <gerrit url> syntax instead | 23:25 |
| *** holser_ has quit IRC | 23:29 | |
| openstackgerrit | Steve Baker proposed openstack/tripleo-quickstart-extras master: Switch to workflow driven image prepare https://review.openstack.org/573476 | 23:33 |
| openstackgerrit | Steve Baker proposed openstack/tripleo-quickstart-extras master: Rocky: Switch to workflow driven image prepare https://review.openstack.org/597732 | 23:33 |
| openstackgerrit | Steve Baker proposed openstack/tripleo-common master: Handle sparse resource registry in build_service_filter https://review.openstack.org/597726 | 23:40 |
| stevebaker | mwhahaha: I fixed the derp | 23:41 |
| *** khyr0n has quit IRC | 23:41 | |
| *** khyr0n has joined #tripleo | 23:42 | |
| *** bfournie has joined #tripleo | 23:43 | |
| *** sri_ has quit IRC | 23:50 | |
| *** sri_ has joined #tripleo | 23:50 | |
| *** mjturek has quit IRC | 23:55 | |
| openstackgerrit | Doug Hellmann proposed openstack/instack master: import zuul job settings from project-config https://review.openstack.org/597750 | 23:55 |
| openstackgerrit | Doug Hellmann proposed openstack/instack master: add python 3.5 unit test job https://review.openstack.org/597751 | 23:55 |
| openstackgerrit | Doug Hellmann proposed openstack/instack master: add python 3.6 unit test job https://review.openstack.org/597752 | 23:55 |
| openstackgerrit | Doug Hellmann proposed openstack/instack-undercloud master: import zuul job settings from project-config https://review.openstack.org/597753 | 23:55 |
| openstackgerrit | Doug Hellmann proposed openstack/instack-undercloud master: switch documentation job to new PTI https://review.openstack.org/597754 | 23:56 |
| openstackgerrit | Doug Hellmann proposed openstack/instack-undercloud master: add python 3.6 unit test job https://review.openstack.org/597755 | 23:56 |
| openstackgerrit | Doug Hellmann proposed openstack/os-net-config master: import zuul job settings from project-config https://review.openstack.org/597756 | 23:56 |
| openstackgerrit | Doug Hellmann proposed openstack/os-net-config master: switch documentation job to new PTI https://review.openstack.org/597757 | 23:56 |
| openstackgerrit | Doug Hellmann proposed openstack/paunch master: import zuul job settings from project-config https://review.openstack.org/597758 | 23:56 |
| openstackgerrit | Doug Hellmann proposed openstack/paunch master: switch documentation job to new PTI https://review.openstack.org/597759 | 23:56 |
| openstackgerrit | Doug Hellmann proposed openstack/paunch master: add python 3.6 unit test job https://review.openstack.org/597760 | 23:56 |
| openstackgerrit | Doug Hellmann proposed openstack/puppet-pacemaker master: import zuul job settings from project-config https://review.openstack.org/597761 | 23:56 |
| openstackgerrit | Doug Hellmann proposed openstack/puppet-pacemaker master: switch documentation job to new PTI https://review.openstack.org/597762 | 23:56 |
| openstackgerrit | Doug Hellmann proposed openstack/puppet-tripleo master: import zuul job settings from project-config https://review.openstack.org/597763 | 23:56 |
| openstackgerrit | Doug Hellmann proposed openstack/puppet-tripleo master: switch documentation job to new PTI https://review.openstack.org/597764 | 23:56 |
| openstackgerrit | Doug Hellmann proposed openstack/python-tripleoclient master: import zuul job settings from project-config https://review.openstack.org/597765 | 23:56 |
| openstackgerrit | Doug Hellmann proposed openstack/python-tripleoclient master: switch documentation job to new PTI https://review.openstack.org/597766 | 23:56 |
| openstackgerrit | Doug Hellmann proposed openstack/python-tripleoclient master: add python 3.6 unit test job https://review.openstack.org/597767 | 23:56 |
| openstackgerrit | Doug Hellmann proposed openstack/tempest-tripleo-ui master: import zuul job settings from project-config https://review.openstack.org/597768 | 23:56 |
| openstackgerrit | Doug Hellmann proposed openstack/tempest-tripleo-ui master: switch documentation job to new PTI https://review.openstack.org/597769 | 23:56 |
| openstackgerrit | Doug Hellmann proposed openstack/tripleo-common master: import zuul job settings from project-config https://review.openstack.org/597770 | 23:56 |
| openstackgerrit | Doug Hellmann proposed openstack/tripleo-common master: switch documentation job to new PTI https://review.openstack.org/597771 | 23:56 |
| openstackgerrit | Doug Hellmann proposed openstack/tripleo-common master: add python 3.6 unit test job https://review.openstack.org/597772 | 23:56 |
| openstackgerrit | Doug Hellmann proposed openstack/tripleo-docs master: import zuul job settings from project-config https://review.openstack.org/597773 | 23:56 |
| openstackgerrit | Doug Hellmann proposed openstack/tripleo-docs master: switch documentation job to new PTI https://review.openstack.org/597774 | 23:56 |
| openstackgerrit | Doug Hellmann proposed openstack/tripleo-heat-templates master: import zuul job settings from project-config https://review.openstack.org/597775 | 23:56 |
| openstackgerrit | Doug Hellmann proposed openstack/tripleo-image-elements master: import zuul job settings from project-config https://review.openstack.org/597776 | 23:56 |
| openstackgerrit | Doug Hellmann proposed openstack/tripleo-image-elements master: switch documentation job to new PTI https://review.openstack.org/597777 | 23:56 |
| openstackgerrit | Doug Hellmann proposed openstack/tripleo-image-elements master: add python 3.5 unit test job https://review.openstack.org/597778 | 23:56 |
| openstackgerrit | Doug Hellmann proposed openstack/tripleo-image-elements master: add python 3.6 unit test job https://review.openstack.org/597779 | 23:56 |
| openstackgerrit | Doug Hellmann proposed openstack/tripleo-puppet-elements master: import zuul job settings from project-config https://review.openstack.org/597780 | 23:57 |
| openstackgerrit | Doug Hellmann proposed openstack/tripleo-puppet-elements master: switch documentation job to new PTI https://review.openstack.org/597781 | 23:57 |
| openstackgerrit | Doug Hellmann proposed openstack/tripleo-quickstart master: import zuul job settings from project-config https://review.openstack.org/597782 | 23:57 |
| openstackgerrit | Doug Hellmann proposed openstack/tripleo-quickstart master: switch documentation job to new PTI https://review.openstack.org/597783 | 23:57 |
| openstackgerrit | Doug Hellmann proposed openstack/tripleo-quickstart-extras master: import zuul job settings from project-config https://review.openstack.org/597784 | 23:57 |
| openstackgerrit | Doug Hellmann proposed openstack/tripleo-quickstart-extras master: switch documentation job to new PTI https://review.openstack.org/597785 | 23:57 |
| openstackgerrit | Doug Hellmann proposed openstack/tripleo-specs master: import zuul job settings from project-config https://review.openstack.org/597786 | 23:57 |
| openstackgerrit | Doug Hellmann proposed openstack/tripleo-ui master: import zuul job settings from project-config https://review.openstack.org/597787 | 23:57 |
| openstackgerrit | Doug Hellmann proposed openstack/tripleo-ui master: switch documentation job to new PTI https://review.openstack.org/597788 | 23:57 |
| openstackgerrit | Doug Hellmann proposed openstack/tripleo-upgrade master: import zuul job settings from project-config https://review.openstack.org/597789 | 23:57 |
| openstackgerrit | Doug Hellmann proposed openstack/tripleo-upgrade master: switch documentation job to new PTI https://review.openstack.org/597790 | 23:57 |
| openstackgerrit | Doug Hellmann proposed openstack/tripleo-validations master: import zuul job settings from project-config https://review.openstack.org/597791 | 23:57 |
| openstackgerrit | Doug Hellmann proposed openstack/tripleo-validations master: switch documentation job to new PTI https://review.openstack.org/597792 | 23:57 |
| openstackgerrit | Doug Hellmann proposed openstack/tripleo-validations master: add python 3.6 unit test job https://review.openstack.org/597793 | 23:57 |
| openstackgerrit | Doug Hellmann proposed openstack/instack stable/ocata: import zuul job settings from project-config https://review.openstack.org/597794 | 23:57 |
| *** sri_ has quit IRC | 23:57 | |
| openstackgerrit | Doug Hellmann proposed openstack/instack-undercloud stable/ocata: import zuul job settings from project-config https://review.openstack.org/597795 | 23:57 |
| openstackgerrit | Doug Hellmann proposed openstack/os-apply-config stable/ocata: import zuul job settings from project-config https://review.openstack.org/597796 | 23:57 |
| openstackgerrit | Doug Hellmann proposed openstack/os-collect-config stable/ocata: import zuul job settings from project-config https://review.openstack.org/597797 | 23:57 |
| openstackgerrit | Doug Hellmann proposed openstack/os-net-config stable/ocata: import zuul job settings from project-config https://review.openstack.org/597798 | 23:57 |
| openstackgerrit | Doug Hellmann proposed openstack/os-refresh-config stable/ocata: import zuul job settings from project-config https://review.openstack.org/597799 | 23:57 |
| *** srini_ has joined #tripleo | 23:57 | |
| openstackgerrit | Doug Hellmann proposed openstack/puppet-tripleo stable/ocata: import zuul job settings from project-config https://review.openstack.org/597800 | 23:57 |
| openstackgerrit | Doug Hellmann proposed openstack/python-tripleoclient stable/ocata: import zuul job settings from project-config https://review.openstack.org/597801 | 23:58 |
| openstackgerrit | Doug Hellmann proposed openstack/tripleo-common stable/ocata: import zuul job settings from project-config https://review.openstack.org/597802 | 23:58 |
| openstackgerrit | Doug Hellmann proposed openstack/tripleo-heat-templates stable/ocata: import zuul job settings from project-config https://review.openstack.org/597803 | 23:58 |
| openstackgerrit | Doug Hellmann proposed openstack/tripleo-image-elements stable/ocata: import zuul job settings from project-config https://review.openstack.org/597804 | 23:58 |
| openstackgerrit | Doug Hellmann proposed openstack/tripleo-puppet-elements stable/ocata: import zuul job settings from project-config https://review.openstack.org/597805 | 23:58 |
| openstackgerrit | Doug Hellmann proposed openstack/tripleo-ui stable/ocata: import zuul job settings from project-config https://review.openstack.org/597806 | 23:58 |
| openstackgerrit | Doug Hellmann proposed openstack/tripleo-validations stable/ocata: import zuul job settings from project-config https://review.openstack.org/597807 | 23:58 |
| openstackgerrit | Doug Hellmann proposed openstack/instack stable/pike: import zuul job settings from project-config https://review.openstack.org/597808 | 23:58 |
| openstackgerrit | Doug Hellmann proposed openstack/instack-undercloud stable/pike: import zuul job settings from project-config https://review.openstack.org/597809 | 23:58 |
| openstackgerrit | Doug Hellmann proposed openstack/os-apply-config stable/pike: import zuul job settings from project-config https://review.openstack.org/597810 | 23:58 |
| openstackgerrit | Doug Hellmann proposed openstack/os-collect-config stable/pike: import zuul job settings from project-config https://review.openstack.org/597811 | 23:58 |
| openstackgerrit | Doug Hellmann proposed openstack/os-net-config stable/pike: import zuul job settings from project-config https://review.openstack.org/597812 | 23:58 |
| openstackgerrit | Doug Hellmann proposed openstack/os-refresh-config stable/pike: import zuul job settings from project-config https://review.openstack.org/597813 | 23:58 |
| openstackgerrit | Doug Hellmann proposed openstack/paunch stable/pike: import zuul job settings from project-config https://review.openstack.org/597814 | 23:58 |
| openstackgerrit | Doug Hellmann proposed openstack/puppet-tripleo stable/pike: import zuul job settings from project-config https://review.openstack.org/597815 | 23:58 |
| openstackgerrit | Doug Hellmann proposed openstack/python-tripleoclient stable/pike: import zuul job settings from project-config https://review.openstack.org/597816 | 23:58 |
| openstackgerrit | Doug Hellmann proposed openstack/tripleo-common stable/pike: import zuul job settings from project-config https://review.openstack.org/597817 | 23:58 |
| openstackgerrit | Doug Hellmann proposed openstack/tripleo-heat-templates stable/pike: import zuul job settings from project-config https://review.openstack.org/597818 | 23:59 |
| openstackgerrit | Doug Hellmann proposed openstack/tripleo-image-elements stable/pike: import zuul job settings from project-config https://review.openstack.org/597819 | 23:59 |
| openstackgerrit | Doug Hellmann proposed openstack/tripleo-puppet-elements stable/pike: import zuul job settings from project-config https://review.openstack.org/597820 | 23:59 |
| openstackgerrit | Doug Hellmann proposed openstack/tripleo-ui stable/pike: import zuul job settings from project-config https://review.openstack.org/597821 | 23:59 |
| openstackgerrit | Doug Hellmann proposed openstack/tripleo-upgrade stable/pike: import zuul job settings from project-config https://review.openstack.org/597823 | 23:59 |
| openstackgerrit | Doug Hellmann proposed openstack/tripleo-validations stable/pike: import zuul job settings from project-config https://review.openstack.org/597824 | 23:59 |
| openstackgerrit | Doug Hellmann proposed openstack/instack stable/queens: import zuul job settings from project-config https://review.openstack.org/597825 | 23:59 |
| openstackgerrit | Doug Hellmann proposed openstack/instack-undercloud stable/queens: import zuul job settings from project-config https://review.openstack.org/597826 | 23:59 |
| openstackgerrit | Doug Hellmann proposed openstack/os-apply-config stable/queens: import zuul job settings from project-config https://review.openstack.org/597827 | 23:59 |
| openstackgerrit | Doug Hellmann proposed openstack/os-collect-config stable/queens: import zuul job settings from project-config https://review.openstack.org/597828 | 23:59 |
| openstackgerrit | Doug Hellmann proposed openstack/os-net-config stable/queens: import zuul job settings from project-config https://review.openstack.org/597829 | 23:59 |
| *** srini_ has quit IRC | 23:59 | |
| openstackgerrit | Doug Hellmann proposed openstack/os-refresh-config stable/queens: import zuul job settings from project-config https://review.openstack.org/597830 | 23:59 |
| openstackgerrit | Doug Hellmann proposed openstack/paunch stable/queens: import zuul job settings from project-config https://review.openstack.org/597831 | 23:59 |
| openstackgerrit | Doug Hellmann proposed openstack/puppet-tripleo stable/queens: import zuul job settings from project-config https://review.openstack.org/597832 | 23:59 |
| openstackgerrit | Doug Hellmann proposed openstack/python-tripleoclient stable/queens: import zuul job settings from project-config https://review.openstack.org/597833 | 23:59 |
| openstackgerrit | Doug Hellmann proposed openstack/tripleo-common stable/queens: import zuul job settings from project-config https://review.openstack.org/597834 | 23:59 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!