| openstackgerrit | RedHat RDO CI proposed openstack/tripleo-heat-templates stable/queens: GATE CHECK for TripleO https://review.openstack.org/567224 | 00:00 |
|---|---|---|
| openstackgerrit | RedHat RDO CI proposed openstack/tripleo-quickstart-extras master: GATE CHECK for quickstart-extras https://review.openstack.org/560445 | 00:00 |
| openstackgerrit | RedHat RDO CI proposed openstack/tripleo-heat-templates master: GATE CHECK for TripleO https://review.openstack.org/604298 | 00:00 |
| openstackgerrit | RedHat RDO CI proposed openstack/tripleo-heat-templates stable/rocky: GATE CHECK for TripleO https://review.openstack.org/604293 | 00:00 |
| *** wolverineav has joined #tripleo | 00:04 | |
| *** rascasoft has joined #tripleo | 00:06 | |
| openstackgerrit | Jon Schlueter proposed openstack/tripleo-common master: drop msgpack now that kolla has dropped it as well https://review.openstack.org/638529 | 00:08 |
| *** sdake_ has quit IRC | 00:08 | |
| *** wolverineav has quit IRC | 00:10 | |
| *** slaweq has joined #tripleo | 00:11 | |
| *** wolverineav has joined #tripleo | 00:12 | |
| *** agopi has joined #tripleo | 00:15 | |
| *** slaweq has quit IRC | 00:16 | |
| *** rascasoft has quit IRC | 00:16 | |
| *** wolverineav has quit IRC | 00:17 | |
| openstackgerrit | Nagasai Vinaykumar Kapalavai proposed openstack/tripleo-heat-templates master: metrics_qdr: Add TLS support https://review.openstack.org/630736 | 00:18 |
| openstackgerrit | Nagasai Vinaykumar Kapalavai proposed openstack/tripleo-heat-templates master: metrics_qdr: Add TLS support https://review.openstack.org/630736 | 00:20 |
| *** sdake has joined #tripleo | 00:25 | |
| *** vinaykns has quit IRC | 00:25 | |
| *** rlandy is now known as rlandy|afk | 00:49 | |
| *** wolverineav has joined #tripleo | 00:50 | |
| *** mcornea has quit IRC | 01:13 | |
| *** dprince has quit IRC | 01:13 | |
| *** rascasoft has joined #tripleo | 01:23 | |
| *** khyr0n has quit IRC | 01:27 | |
| *** khyr0n has joined #tripleo | 01:29 | |
| *** rascasoft has quit IRC | 01:33 | |
| *** mjturek has quit IRC | 01:40 | |
| *** cfontain has joined #tripleo | 01:41 | |
| *** sdake has quit IRC | 01:44 | |
| *** sdake has joined #tripleo | 01:45 | |
| *** wolverineav has quit IRC | 02:01 | |
| *** _fragatina has quit IRC | 02:11 | |
| *** slaweq has joined #tripleo | 02:11 | |
| *** hamzy has joined #tripleo | 02:15 | |
| *** slaweq has quit IRC | 02:15 | |
| *** cfontain has quit IRC | 02:16 | |
| *** mschuppert has quit IRC | 02:21 | |
| *** wolverineav has joined #tripleo | 02:25 | |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci master: Add fedora-28 support to container-build job on fedora-28 with Buildah https://review.openstack.org/635991 | 02:28 |
| *** wolverineav has quit IRC | 02:29 | |
| *** rfolco|rover has quit IRC | 02:30 | |
| *** wolverineav has joined #tripleo | 02:31 | |
| *** sdake has quit IRC | 02:32 | |
| *** wolverineav has quit IRC | 02:33 | |
| *** sdake has joined #tripleo | 02:33 | |
| *** cfontain has joined #tripleo | 02:35 | |
| *** sdake has quit IRC | 02:38 | |
| *** sdake_ has joined #tripleo | 02:39 | |
| *** ccamacho has quit IRC | 02:48 | |
| *** rascasoft has joined #tripleo | 02:56 | |
| *** sdake_ has quit IRC | 03:03 | |
| *** skramaja has joined #tripleo | 03:04 | |
| *** psachin has joined #tripleo | 03:05 | |
| *** rascasoft has quit IRC | 03:05 | |
| *** sdake has joined #tripleo | 03:10 | |
| openstackgerrit | Merged openstack/tripleo-common master: Improve retry behaviour of _copy_layer_registry_to_registry https://review.openstack.org/638266 | 03:12 |
| *** apetrich has quit IRC | 03:16 | |
| *** janki has joined #tripleo | 03:20 | |
| *** skramaja has quit IRC | 03:25 | |
| openstackgerrit | Steve Baker proposed openstack/tripleo-common master: Allow tripleo-admin user to have a keypair https://review.openstack.org/638316 | 03:28 |
| openstackgerrit | Steve Baker proposed openstack/tripleo-common master: Set the private key for undercloud tripleo-admin https://review.openstack.org/638323 | 03:28 |
| *** sdake has quit IRC | 03:33 | |
| *** dxiri has joined #tripleo | 03:33 | |
| *** dxiri has quit IRC | 03:38 | |
| *** _fragatina has joined #tripleo | 03:40 | |
| *** cfontain has quit IRC | 03:49 | |
| openstackgerrit | Steve Baker proposed openstack/tripleo-common master: Set the private key for undercloud tripleo-admin https://review.openstack.org/638323 | 03:50 |
| openstackgerrit | Steve Baker proposed openstack/tripleo-heat-templates master: Copy tripleo-admin key to mistral home directory https://review.openstack.org/638322 | 03:51 |
| openstackgerrit | Steve Baker proposed openstack/tripleo-heat-templates master: Run mistral_executor unprivileged https://review.openstack.org/636813 | 03:51 |
| *** skramaja has joined #tripleo | 03:52 | |
| *** udesale has joined #tripleo | 03:53 | |
| openstackgerrit | Merged openstack/python-tripleoclient master: Check proxy env vars https://review.openstack.org/636772 | 03:53 |
| *** rascasoft has joined #tripleo | 03:55 | |
| *** _fragatina has quit IRC | 03:57 | |
| *** _fragatina has joined #tripleo | 03:57 | |
| *** rascasoft has quit IRC | 04:00 | |
| *** tzumainn has quit IRC | 04:01 | |
| *** slaweq has joined #tripleo | 04:11 | |
| *** slaweq has quit IRC | 04:16 | |
| *** wolverineav has joined #tripleo | 04:20 | |
| openstackgerrit | John Fulton proposed openstack/tripleo-quickstart-extras master: WIP/DNM: Add split-controlplane-standalone.yml playbook https://review.openstack.org/617368 | 04:20 |
| openstackgerrit | John Fulton proposed openstack/tripleo-quickstart master: WIP/DNM: Add featureset 59 for split controlplane https://review.openstack.org/615987 | 04:21 |
| openstackgerrit | John Fulton proposed openstack-infra/tripleo-ci master: WIP/DNM: Add split-controlplane standalone non-voting job definition https://review.openstack.org/615988 | 04:21 |
| *** rlandy|afk is now known as rlandy | 04:21 | |
| *** wolverineav has quit IRC | 04:24 | |
| openstackgerrit | John Fulton proposed openstack/tripleo-quickstart-extras master: WIP/DNM: Add split-controlplane-standalone.yml playbook https://review.openstack.org/617368 | 04:25 |
| openstackgerrit | Merged openstack/python-tripleoclient master: Allow 'container image prepare' to support drivers https://review.openstack.org/637989 | 04:39 |
| *** ramishra has joined #tripleo | 04:48 | |
| *** _fragatina has quit IRC | 05:05 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Podman support in haproxy-public-tls-inject https://review.openstack.org/638246 | 05:08 |
| *** rascasoft has joined #tripleo | 05:09 | |
| *** slaweq has joined #tripleo | 05:11 | |
| *** slaweq has quit IRC | 05:15 | |
| *** rascasoft has quit IRC | 05:18 | |
| *** skramaja_ has joined #tripleo | 05:19 | |
| *** skramaja has quit IRC | 05:20 | |
| *** ratailor has joined #tripleo | 05:21 | |
| *** thrash is now known as thrash|g0ne | 05:28 | |
| Tengu | hello there :) | 05:33 |
| *** galaxyyahoo has quit IRC | 05:47 | |
| *** galaxyyahoo has joined #tripleo | 05:47 | |
| *** shyamb has joined #tripleo | 05:59 | |
| shyamb | Hi | 06:02 |
| shyamb | introspection dnsmasq container is restarting continously | 06:02 |
| shyamb | logs show address already in use | 06:02 |
| shyamb | I think neutron's dnsmasq container is using the port | 06:03 |
| *** saneax has joined #tripleo | 06:06 | |
| *** _fragatina has joined #tripleo | 06:07 | |
| *** _fragatina has quit IRC | 06:24 | |
| *** shyamb has quit IRC | 06:26 | |
| *** shyamb has joined #tripleo | 06:27 | |
| *** jfrancoa has joined #tripleo | 06:33 | |
| *** ykarel|pto has joined #tripleo | 06:38 | |
| *** ykarel|pto is now known as ykarel | 06:40 | |
| *** yprokule has joined #tripleo | 06:47 | |
| *** paramite has quit IRC | 06:50 | |
| *** ratailor has quit IRC | 06:53 | |
| *** ratailor has joined #tripleo | 06:53 | |
| *** quiquell|off is now known as quiquell | 06:59 | |
| *** sdake has joined #tripleo | 07:00 | |
| *** cfontain has joined #tripleo | 07:03 | |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: [wip] fix opensuse pip-and-virtualenv https://review.openstack.org/638594 | 07:05 |
| *** shyamb has quit IRC | 07:09 | |
| *** shyamb has joined #tripleo | 07:09 | |
| *** slaweq has joined #tripleo | 07:11 | |
| *** rascasoft has joined #tripleo | 07:11 | |
| *** slaweq has quit IRC | 07:15 | |
| Tengu | folks, would it be possible to get some reviews on https://review.openstack.org/#/c/637729/ ? Would be really, really cool to get a proper failure in case a service or a container isn't starting as expected :). | 07:18 |
| *** jtomasek has joined #tripleo | 07:27 | |
| quiquell | Tengu: into it | 07:28 |
| quiquell | marios: Tengu's cool feature for tq -> https://review.openstack.org/#/c/637729 | 07:28 |
| quiquell | sshnaidm: ^ | 07:28 |
| *** aufi has joined #tripleo | 07:33 | |
| *** sdake has quit IRC | 07:33 | |
| Tengu | :) | 07:35 |
| *** mrunge has quit IRC | 07:37 | |
| marios | quiquell: i voted there already :D | 07:39 |
| Tengu | marios: thanks for your comments - I pushed answer | 07:40 |
| Tengu | marios: fun part: I already thouht about both of them before pushing my proposal :D | 07:40 |
| marios | Tengu: thanks will cycle back in a sec (yah sure you did man just minor thoughts otherwise lgtm) | 07:40 |
| Tengu | marios: ;) | 07:41 |
| *** shyamb has quit IRC | 07:41 | |
| marios | panda|ruck|off: o/ so we doing this today ? :) https://review.openstack.org/#/c/638363/ | 07:41 |
| marios | panda|ruck|off: looks like it, fultonj has lined it up in https://review.openstack.org/#/c/637196/6 and not heard any other suggestions | 07:42 |
| *** mschuppert has joined #tripleo | 07:42 | |
| *** mrunge has joined #tripleo | 07:43 | |
| *** ykarel is now known as ykarel|lunch | 07:46 | |
| Tengu | ah, folks, also: https://review.openstack.org/#/c/638168/ a pretty easy/quick/nice thing for convenience :). | 07:53 |
| Tengu | far easier to review than the previous :). | 07:53 |
| *** galaxyyahoo has quit IRC | 07:56 | |
| *** galaxyyahoo has joined #tripleo | 07:56 | |
| *** ratailor has quit IRC | 07:57 | |
| *** ratailor has joined #tripleo | 07:58 | |
| sshnaidm | ykarel|lunch, replied in https://review.openstack.org/#/c/638438 | 07:58 |
| marios | Tengu: revoted - didn't +A let me know if you want me to | 07:59 |
| *** kopecmartin|off is now known as kopecmartin | 08:00 | |
| Tengu | marios: maybe someone else from CI might have a look as well? Just to be sure - else you can +A. On our (DF) side, I guess we don't have that many view in there :). | 08:00 |
| *** hberaud|gone is now known as hberaud | 08:00 | |
| openstackgerrit | RedHat RDO CI proposed openstack/tripleo-heat-templates master: GATE CHECK for TripleO https://review.openstack.org/604298 | 08:00 |
| marios | Tengu: ack yeah is still early that's why i left it ping me if it doesn't merge later and you want me to | 08:00 |
| Tengu | marios: ack :) | 08:01 |
| marios | Tengu: re https://review.openstack.org/#/c/638168/ see https://review.openstack.org/#/q/topic:remove_gitignore_editors | 08:01 |
| marios | Tengu: i wanted to add some but ended up removing all :/ ^ | 08:02 |
| Tengu | wtf ?! | 08:02 |
| marios | Tengu: https://review.openstack.org/#/c/592520/ here is the source | 08:03 |
| marios | # git config --global core.excludesfile '~/.gitignore' | 08:03 |
| Tengu | marios: hmm ok... would be nice to put that in the .gitignore as a comment for "new guys coming in that world". | 08:04 |
| *** florianf has joined #tripleo | 08:04 | |
| * marios shrug i mean yeah do that | 08:04 | |
| marios | Tengu: like thats what we did in the others guess not tqe | 08:05 |
| marios | Tengu: so just add that to your commit | 08:05 |
| Tengu | yep, lemme correct its content :). | 08:05 |
| openstackgerrit | Cédric Jeanneret proposed openstack/tripleo-quickstart-extras master: Tell people how to ignore their personnal editor temporary files https://review.openstack.org/638168 | 08:08 |
| *** slaweq has joined #tripleo | 08:08 | |
| Tengu | marios: -^^ | 08:08 |
| marios | Tengu: ack to sour files | 08:09 |
| *** ykarel|lunch is now known as ykarel | 08:10 | |
| ykarel | sshnaidm, looking | 08:10 |
| ykarel | sshnaidm, re. what are "scenario(ovb jobs that weren't able to run collect logs, so collect_logs for ovb can be skipped if "run" phase times out or fails before collecting logs | 08:11 |
| ykarel | so for such case, logs can be collected in "post" | 08:11 |
| ykarel | makes sense? | 08:11 |
| sshnaidm | ykarel, oh, timeout, yeah | 08:12 |
| Tengu | marios: hu, didn't see the typo, but I feel it's a neat one. OK with it? :D | 08:12 |
| Tengu | let's put some fun in those boring listing files ;) | 08:12 |
| *** tkajinam has quit IRC | 08:13 | |
| sshnaidm | ykarel, it won't help with ovb, ovb instances will be destroyed in this stage | 08:15 |
| ykarel | sshnaidm, only overcloud nodes are destroyed, no? | 08:15 |
| sshnaidm | ykarel, yeah | 08:15 |
| sshnaidm | ykarel, ideally we need to collect ovb logs in post-ovb | 08:16 |
| *** sdake has joined #tripleo | 08:17 | |
| *** shyamb has joined #tripleo | 08:17 | |
| ykarel | sshnaidm, ack not aware of that | 08:18 |
| ykarel | if there is an ideal way good to go | 08:18 |
| *** pbandark has quit IRC | 08:20 | |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci master: Remove redundant logs collection for non-ovb https://review.openstack.org/638438 | 08:20 |
| sshnaidm | ykarel, ^^ | 08:21 |
| ykarel | sshnaidm, ack | 08:21 |
| marios | Tengu: sure sour files why not | 08:25 |
| Tengu | :] | 08:25 |
| *** apetrich has joined #tripleo | 08:26 | |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci master: Remove redundant logs collection for non-ovb https://review.openstack.org/638438 | 08:33 |
| *** cfontain has quit IRC | 08:43 | |
| openstackgerrit | Grzegorz Grasza proposed openstack/tripleo-heat-templates stable/rocky: certmonger: Don't restart haproxy on cert renewal https://review.openstack.org/638604 | 08:46 |
| openstackgerrit | Christian Schwede proposed openstack/tripleo-heat-templates master: Do not ignore Swift ring changes to trigger container restart https://review.openstack.org/616116 | 08:48 |
| openstackgerrit | Sylvain Afchain proposed openstack/tripleo-heat-templates master: Use dedicated container tag per skydive service https://review.openstack.org/638606 | 08:48 |
| *** suuuper has joined #tripleo | 08:49 | |
| *** jpich has joined #tripleo | 08:51 | |
| *** jpich has quit IRC | 08:52 | |
| openstackgerrit | Grzegorz Grasza proposed openstack/tripleo-heat-templates stable/queens: certmonger: Don't restart haproxy on cert renewal https://review.openstack.org/638607 | 08:52 |
| *** jpich has joined #tripleo | 08:52 | |
| jaosorior | dtantsur|afk, d0ugal: are you aware of this work https://review.openstack.org/#/c/498936/5 ? any idea if it'll be continued? | 08:53 |
| jaosorior | sshnaidm: can we merge this https://review.openstack.org/#/c/638378/ ? | 08:53 |
| d0ugal | jaosorior: Good question. I am roughly aware of it, but I don't know of any plans to continue it | 08:54 |
| d0ugal | seems very unlikely | 08:54 |
| jaosorior | :( | 08:54 |
| sshnaidm | jaosorior, done | 08:55 |
| jaosorior | sshnaidm: thanks | 08:55 |
| *** pbandark has joined #tripleo | 08:55 | |
| *** sshnaidm is now known as sshnaidm|off | 08:56 | |
| *** dtantsur|afk is now known as dtantsur | 08:58 | |
| dtantsur | jaosorior: I've seen it. I think it was for UI, so we should ask UI folks (akrivoka has left RH) | 08:59 |
| *** ykarel is now known as ykarel|lunch | 08:59 | |
| *** sai_p_ has quit IRC | 09:01 | |
| *** jpena|off is now known as jpena | 09:02 | |
| openstackgerrit | Sylvain Afchain proposed openstack/tripleo-common master: remove skydive-ansible from mistral container https://review.openstack.org/637144 | 09:03 |
| *** holser_ has joined #tripleo | 09:11 | |
| dtantsur | jaosorior, slagle, morning. with my deploy_roles patch I could get well into ansible yesterday \o/ now, a weird thing: there is no networking within a controller node, even though it's reachable via SSH O__o | 09:20 |
| dtantsur | I wonder if os-net-config did something weird | 09:20 |
| dtantsur | well, correction: there is networking, but there is no DNS, and the DNS servers from the subnet are not pingable | 09:21 |
| *** bogdando has joined #tripleo | 09:21 | |
| jaosorior | sshnaidm|off: still getting "Failed to connect to the host via ssh: ssh: Could not resolve hostname supplemental: No address associated with hostname" | 09:22 |
| jaosorior | dtantsur: that's weird | 09:22 |
| dtantsur | hmm, even nodes not touched by tripleo are limited to 192.168.24.0 | 09:22 |
| jaosorior | sounds like something weird did happen to os-net-config | 09:23 |
| dtantsur | yeah. and neutron is probably not doing something right about the default routes. shouldn't undercloud be the router? | 09:23 |
| jaosorior | it should | 09:24 |
| *** panda|ruck|off is now known as panda|ruck | 09:24 | |
| dtantsur | jaosorior: so, on a node that was deployed but NOT touched by TripleO traceroute dies out after the undercloud. On a node that TripleO was deploying it fails immediately with "network unreachable". | 09:26 |
| *** sdake has quit IRC | 09:26 | |
| jaosorior | dtantsur: did neutron attach the ports related to the nodes? | 09:27 |
| jaosorior | or was that removed? | 09:27 |
| *** shyamb has quit IRC | 09:27 | |
| panda|ruck | marios: does DF agree on this move ? | 09:28 |
| dtantsur | jaosorior: the ports look okay (they are created by metalsmith), the IP address is correct, SSH works. | 09:28 |
| jaosorior | oh yeah, metalsmith should handle that | 09:28 |
| dtantsur | jaosorior: maybe this is the problem? http://paste.openstack.org/show/745684/ | 09:29 |
| dtantsur | I don't get what it is trying to do though | 09:29 |
| marios | panda|ruck: you mean scen1 tempdisable? i don't know good point maybe we should get fultonj to talk to them too | 09:31 |
| dtantsur | hjensas: morning! do you know how to debug os-net-config if I suspect it's doing something wrong? | 09:31 |
| jaosorior | dtantsur: that doesn't look good. But I really don't know how to debug that. | 09:33 |
| *** florianf has quit IRC | 09:33 | |
| jaosorior | brb | 09:33 |
| *** jaosorior has quit IRC | 09:33 | |
| *** florianf has joined #tripleo | 09:34 | |
| *** jaosorior has joined #tripleo | 09:35 | |
| panda|ruck | marios: always remember who our customers are (insert dramatic music here) | 09:35 |
| dtantsur | slagle: is http://tripleo.org/install/advanced_deployment/deployed_server.html#configuring-deployed-servers-to-poll-heat still required with config-download? | 09:39 |
| openstackgerrit | Natal Ngétal proposed openstack/python-tripleoclient master: Add support of extra variables. https://review.openstack.org/637530 | 09:39 |
| *** ykarel|lunch is now known as ykarel | 09:41 | |
| marios | panda|ruck: ack i mean we discussed a bit with jaosorior last night but i'll ask fultonj to socialise a bit more and maybe he can do it during the US day today | 09:46 |
| marios | jaosorior: ( panda|ruck expressing concern about the https://review.openstack.org/638363 and we should talk to DF first) | 09:47 |
| jaosorior | marios: well, the only choice is that they all merge together. What are the concerns? | 09:47 |
| *** shyamb has joined #tripleo | 09:54 | |
| *** galaxyyahoo has quit IRC | 09:57 | |
| *** galaxyyahoo has joined #tripleo | 09:57 | |
| *** pbandark has quit IRC | 09:58 | |
| openstackgerrit | Adriano Petrich proposed openstack/tripleo-common master: Stop sending execution object via Zaqar message https://review.openstack.org/630291 | 10:00 |
| *** dtantsur is now known as dtantsur|brb | 10:01 | |
| *** gfidente has joined #tripleo | 10:03 | |
| openstackgerrit | Michele Baldessari proposed openstack/tripleo-heat-templates master: Do not bind mount the ovn_db folder for the ovn pcmk restart bundle https://review.openstack.org/638518 | 10:04 |
| sshnaidm|off | jaosorior, show me your ssh.config.ansible | 10:06 |
| sshnaidm|off | jaosorior, in ~/.quickstart | 10:06 |
| *** shyam89 has joined #tripleo | 10:10 | |
| *** shyamb has quit IRC | 10:12 | |
| openstackgerrit | Michele Baldessari proposed openstack/tripleo-heat-templates master: Delete the stale and incorrect ovn environment files https://review.openstack.org/592299 | 10:18 |
| jaosorior | sshnaidm|off: the suplemental node is missing | 10:18 |
| *** suuuper has quit IRC | 10:18 | |
| jaosorior | sshnaidm|off: pulled the latest quickstart now (just in case) and running it again | 10:19 |
| shyam89 | on overcloud deployment wth ssl | 10:20 |
| shyam89 | krb-service-principals.yaml | 10:20 |
| shyam89 | this file is missing | 10:20 |
| shyam89 | and hence deployment is failing | 10:21 |
| shyam89 | I see a similar issue logged https://bugzilla.redhat.com/show_bug.cgi?id=1510419 | 10:21 |
| openstack | bugzilla.redhat.com bug 1510419 in python-tripleoclient "[osp12] cannot use enable-internal-tls.yaml due to /usr/share/openstack-tripleo-heat-templates/extraconfig/nova_metadata/krb-service-principals.yaml doesn't exist" [High,Closed: errata] - Assigned to maandre | 10:21 |
| shyam89 | but its closed now | 10:21 |
| sshnaidm|off | jaosorior, try to remove .quickstart, pull the latest quickstart and run again | 10:22 |
| *** gfidente has quit IRC | 10:22 | |
| shyam89 | jaosorior: Any ideas? | 10:22 |
| *** gfidente has joined #tripleo | 10:26 | |
| Tengu | florianf: heya :). Care to have a look at https://review.openstack.org/#/c/636283/ ? maybe gchamoul as well ? :) thanks! | 10:30 |
| *** rcernin has quit IRC | 10:31 | |
| *** shyam89 has quit IRC | 10:32 | |
| gchamoul | Tengu: done from my side a few days ago, just added my +1 (not sure if I can use my core power on other than tripleo-validations) | 10:33 |
| florianf | Tengu: looking | 10:33 |
| Tengu | gchamoul: oh, right, sorry. no idea for the core thingy - not yet facing that situation ;). | 10:33 |
| Tengu | gchamoul: but since it does affect validations.. well, anyway, it has your support :). | 10:34 |
| *** dciabrin__ has joined #tripleo | 10:34 | |
| *** dciabrin_ has quit IRC | 10:34 | |
| openstackgerrit | Merged openstack/tripleo-ui master: Imported Translations from Zanata https://review.openstack.org/625159 | 10:34 |
| openstackgerrit | Merged openstack/tripleo-ui stable/rocky: Imported Translations from Zanata https://review.openstack.org/625158 | 10:34 |
| *** bogdando has quit IRC | 10:37 | |
| *** gfidente has quit IRC | 10:37 | |
| florianf | Tengu, gchamoul: Added some idea about different kinds of roles | 10:39 |
| Tengu | florianf: lemme check that :) | 10:40 |
| Tengu | florianf: hmmm so that's more or less the group (or tags). does it have to be put in the spec, or shall we consider that "common sense for implementation"? | 10:41 |
| Tengu | florianf: I'd rather avoid being to precise regarding implementation, in order to let some freedom (and avoid having to amend the spec again ;)) | 10:43 |
| florianf | Tengu, good point. I added a +1 (no 2+ powers on specs) to make it clear I approve with or without adding the idea to the spec itself | 10:45 |
| Tengu | florianf: thanks! | 10:45 |
| openstackgerrit | Gael Chamoulaud proposed openstack/tripleo-validations stable/rocky: Ignore new ansible-lint pipefail rule https://review.openstack.org/638624 | 10:46 |
| Tengu | guess we might make it merge then... ? I'll ping EmilienM on that, since ccamacho seems absent | 10:46 |
| Tengu | unless gchamoul has +A ? :) | 10:46 |
| *** shyamb has joined #tripleo | 10:47 | |
| *** moshele has joined #tripleo | 10:47 | |
| gchamoul | Tengu: we have it ... but just want to be on the right side of the TripleO law! | 10:48 |
| Tengu | gchamoul: guess if you do have core on a repo, you're allowed to use your powers :). | 10:48 |
| Tengu | (and no, I won't yell "I am the Law!") | 10:49 |
| gchamoul | Tengu: done, I am running away right now!!!! | 10:50 |
| Tengu | have a nice weekend then, gchamoul :) | 10:50 |
| gchamoul | :) | 10:50 |
| *** ccamacho has joined #tripleo | 10:54 | |
| *** ccamacho has quit IRC | 10:54 | |
| *** shardy has joined #tripleo | 10:54 | |
| shyamb | shardy: Hi | 10:57 |
| shyamb | jaosorior: Hi | 10:57 |
| shyamb | I am facing this issue again | 10:57 |
| shyamb | https://bugzilla.redhat.com/show_bug.cgi?id=1510419 | 10:57 |
| openstack | bugzilla.redhat.com bug 1510419 in python-tripleoclient "[osp12] cannot use enable-internal-tls.yaml due to /usr/share/openstack-tripleo-heat-templates/extraconfig/nova_metadata/krb-service-principals.yaml doesn't exist" [High,Closed: errata] - Assigned to maandre | 10:57 |
| jaosorior | shyamb: that file is missing because it gets rendered from the j2 jinja file | 10:58 |
| shyamb | jaosorior: At which stage? | 10:58 |
| shyamb | during overcloud deployment? | 10:58 |
| shyamb | or early | 10:58 |
| jaosorior | it gets rendered during the deployment | 10:58 |
| jaosorior | at what stage is it failing for you?\ | 10:58 |
| *** udesale has quit IRC | 10:59 | |
| shyamb | Overcloud deployment is failing at very early stage | 10:59 |
| jaosorior | shyamb: what version? | 10:59 |
| jaosorior | shyamb: is it OSP or upstream? | 10:59 |
| shyamb | osp14 | 10:59 |
| shyamb | Have a look at this http://paste.openstack.org/show/745700/ | 11:00 |
| shyamb | deployment o/p | 11:00 |
| shyamb | before even starting heat execution | 11:00 |
| shyamb | it is failing | 11:00 |
| jaosorior | shyamb: are those all the options you're including? | 11:00 |
| openstackgerrit | Merged openstack/tripleo-specs master: Amend Validation Framework Spec https://review.openstack.org/636283 | 11:00 |
| jaosorior | I don't see any other environment files there | 11:00 |
| jaosorior | sshnaidm|off: removing .quickstart did the trick | 11:01 |
| shyamb | jaosorior: http://paste.openstack.org/show/745701/ | 11:01 |
| shyamb | these are all env files I included using --enviornment-directory option | 11:02 |
| jaosorior | shyamb: ah! | 11:02 |
| jaosorior | shyamb: check the paths from those files | 11:03 |
| jaosorior | shyamb: I think you have relative paths in those environment files | 11:03 |
| jaosorior | make them absolute | 11:03 |
| openstackgerrit | Lukas Bezdicka proposed openstack/tripleo-heat-templates stable/queens: Upgrades: Ensure idempotency of pacemaker services https://review.openstack.org/638628 | 11:03 |
| shyamb | yes | 11:03 |
| shyamb | they are relative paths | 11:04 |
| shyamb | jaosorior: OS::TripleO::ServiceServerMetadataHook: ../../extraconfig/nova_metadata/krb-service-principals.yaml | 11:04 |
| shyamb | what absolute path should I user here? | 11:04 |
| jaosorior | shyamb: you're using the default (because you don't specify a path for --templates) | 11:04 |
| jaosorior | the default is /usr/share/openstack-tripleo-heat-templates/ | 11:04 |
| jaosorior | sdo replace ../../ with that | 11:05 |
| shyamb | ok | 11:05 |
| shyamb | ok | 11:05 |
| shyamb | let me try | 11:05 |
| ramishra | Hi guys, do we test neutron on the overcloud in any job. I'm getting an error after we migrated to ovn "Refusing to bind port xxx due to no OVN chassis for host" and can't spawn instances. I can see the host in ovn db though. Any idea? | 11:06 |
| ramishra | http://paste.openstack.org/show/745702/ | 11:06 |
| *** shardy has quit IRC | 11:06 | |
| *** bogdando has joined #tripleo | 11:09 | |
| ramishra | lucasagomes: Hi! ^^^ Any idea what's wrong? | 11:09 |
| openstackgerrit | Lukas Bezdicka proposed openstack/tripleo-heat-templates stable/queens: minor update: move VIP before stopping pacemaker on a node https://review.openstack.org/638630 | 11:09 |
| *** sdake has joined #tripleo | 11:11 | |
| *** tosky has joined #tripleo | 11:12 | |
| lucasagomes | ramishra, hmmm is ovn-controller running there ? If so, can u check its logs to see if there's any pointers there please ? | 11:12 |
| ramishra | lucasagomes: yep | 11:13 |
| ramishra | lucasagomes: let me check | 11:14 |
| lucasagomes | ramishra, apparently the hostname doesn't match with the one in the Chassis table | 11:14 |
| lucasagomes | no OVN chassis for host: reprosubnode-1.localdomain | 11:15 |
| lucasagomes | hostname : "reprosubnode-1.rdocloud" | 11:15 |
| openstackgerrit | Martin André proposed openstack/tripleo-quickstart-extras master: Remove duplicate enable_tempest from undercloud.conf https://review.openstack.org/638631 | 11:15 |
| ramishra | lucasagomes: aha | 11:18 |
| jaosorior | sshnaidm|off: are you off today or just off for now? | 11:20 |
| shyamb | jaosorior: I provided templates directly using -e option | 11:20 |
| ramishra | lucasagomes: where is getting reprosubnode-1.localdomain? from some configuration? | 11:20 |
| shyamb | now it's working | 11:20 |
| shyamb | thanks a lo | 11:20 |
| shyamb | lot* | 11:20 |
| jaosorior | shyamb: np | 11:20 |
| sshnaidm|off | jaosorior, I'm off in Fridays | 11:20 |
| jaosorior | sshnaidm|off: oh! didn't know | 11:20 |
| jaosorior | sshnaidm|off: OK, I'll poke you on monday then. Enjoy your time off :D | 11:20 |
| openstackgerrit | Gael Chamoulaud proposed openstack/tripleo-validations master: Migrating Undercloud playbooks to their own Ansible Role https://review.openstack.org/636958 | 11:21 |
| sshnaidm|off | jaosorior, it's usual for IL :) let's talk in monday, yeah | 11:21 |
| jaosorior | IL? | 11:22 |
| sshnaidm|off | jaosorior, Israel | 11:22 |
| sshnaidm|off | not Illinois :D | 11:22 |
| ramishra | lucasagomes: It seems to be in neutron.conf, let me change and try | 11:22 |
| lucasagomes | ramishra, ack, yeah lemme look at how it grabs that config btw | 11:23 |
| *** holser_ is now known as holser|lunch | 11:24 | |
| jaosorior | sshnaidm|off: haha yeah, I was thinking you relocated and was working in weird schedules now | 11:26 |
| *** thrash|g0ne is now known as thrash | 11:31 | |
| *** shyamb has quit IRC | 11:31 | |
| lucasagomes | ramishra, so apparently two ways | 11:32 |
| lucasagomes | ramishra, 1. from the config in the open vswitch db, you can check for a "hostname" key by running | 11:33 |
| lucasagomes | $ sudo ovs-vsctl get Open_vSwitch . external_ids | 11:33 |
| lucasagomes | if it's there it will use it | 11:33 |
| lucasagomes | if it's not, it will grab the hostname in the system | 11:33 |
| lucasagomes | ramishra, can u check it ^ please ? | 11:33 |
| ramishra | lucasagomes: yeah both are reprosubnode-1.rdocloud | 11:34 |
| ramishra | and changin neutron.conf did not help either | 11:34 |
| lucasagomes | ramishra, the one in sudo ovs-vsctl get Open_vSwitch . external_ids ? is .rdocloud ? | 11:35 |
| ramishra | lucasagomes: http://paste.openstack.org/show/745718/ | 11:35 |
| lucasagomes | hmm | 11:35 |
| lucasagomes | and after u restart the ovn-controller it stills uses the .localdomain one ? | 11:35 |
| ramishra | lucasagomes: yep, I restarted ovn-controller and neutron-server | 11:36 |
| lucasagomes | numans, dalvarez ^ any idea why ovn-controller is not using that configuration ? | 11:37 |
| lucasagomes | ramishra, and the hostname from the system is .rdocloud ? | 11:37 |
| ramishra | lucasagomes: yes | 11:37 |
| * dalvarez reads | 11:38 | |
| ramishra | lucasagomes: I can add your ssh key if you want to take a look urself | 11:38 |
| openstackgerrit | Jose Luis Franco proposed openstack/tripleo-upgrade master: Option to specify python version and use package instead of yum. https://review.openstack.org/638636 | 11:40 |
| lucasagomes | ramishra, yeah let's see | 11:40 |
| lucasagomes | ramishra, after u changed it in neutron u did restart the neutron services right ? | 11:40 |
| lucasagomes | cause that .localdomain seems to be coming from the PortContext | 11:41 |
| * lucasagomes gotta look at the neutron code to see how the context.host is set, 1 sec | 11:41 | |
| ramishra | I restarted neutron_api container | 11:41 |
| ramishra | That should be enough I assume | 11:41 |
| dalvarez | lucasagomes: ramishra openstack port show for the port ID shows localdomain or rdocloud? | 11:42 |
| dalvarez | lucasagomes: ramishra i suspect nova is setting .localdomain and OVN can't find that chassis | 11:43 |
| dalvarez | ramishra: check nova conf as well pls | 11:44 |
| ramishra | dalvarez: http://paste.openstack.org/show/745720/ | 11:46 |
| ramishra | dalvarez: I don't see hostname for that port yet as it's not bound to any host | 11:46 |
| dalvarez | ramishra: this is weird... that's network:dhcp host, we don't expect to bind that anywhere | 11:47 |
| dalvarez | s/host/owner | 11:47 |
| dalvarez | it's used for metadata service in ovn | 11:47 |
| dalvarez | ramishra: right, hostname won't be there... i guess it's nova trying to bind it to that hostname | 11:47 |
| dalvarez | and doesnt match the system hostname | 11:47 |
| *** florianf has quit IRC | 11:49 | |
| panda|ruck | anyone from opendaylight ? | 11:55 |
| panda|ruck | https://nexus.opendaylight.org/ seems to be down and containers build are failing | 11:56 |
| panda|ruck | also, is opendaylight still relevant for master ? | 11:57 |
| panda|ruck | janki: do you know ? ^ | 11:57 |
| *** shyamb has joined #tripleo | 11:57 | |
| *** moshele has quit IRC | 11:59 | |
| janki | panda|ruck, not that I am aware of | 12:01 |
| *** janki has quit IRC | 12:01 | |
| *** sdake has quit IRC | 12:03 | |
| *** _fragatina has joined #tripleo | 12:03 | |
| *** sdake_ has joined #tripleo | 12:05 | |
| *** rfolco|rover has joined #tripleo | 12:06 | |
| *** dprince has joined #tripleo | 12:07 | |
| Tengu | anyone for a last glance on https://review.openstack.org/#/c/637729/ ? would love seeing it merge sooner than later in order to catch early failures with services/containers :) | 12:07 |
| Tengu | panda|ruck: -^^ maybe? as it's CI-related | 12:07 |
| quiquell | Tengu: going to +áº+w it | 12:09 |
| Tengu | quiquell: ah, just wanted to ensure no one would come back later saying "nope" :). | 12:09 |
| panda|ruck | Tengu: I can say "nope" if you want | 12:09 |
| Tengu | panda|ruck: don't force yourself ;) | 12:10 |
| *** raildo has joined #tripleo | 12:11 | |
| panda|ruck | mmmh ... ignore_errors: true ... | 12:11 |
| ykarel | Tengu, quiquell iirc test_ping is used only for older releases | 12:11 |
| ykarel | now rely mostly on tempest | 12:11 |
| ykarel | so good to not use same var for this validation | 12:11 |
| quiquell | ykarel: new one better ? | 12:12 |
| Tengu | panda|ruck: yes. grep will return non-0 if it can't grep string | 12:12 |
| quiquell | ykarel: so we activate little by little ? | 12:12 |
| panda|ruck | ignore_errors: true it's like try: 100 lines of code except Exception: pass | 12:12 |
| Tengu | panda|ruck: not in this case. really not. | 12:12 |
| Tengu | I want the rc, but I don't want to make non-0 crash in that precise case. | 12:12 |
| ykarel | quiquell, don't get it, which new one? | 12:13 |
| panda|ruck | Tengu: block is a better way to handle failures | 12:13 |
| Tengu | ykarel: anything better for the "when" value? no issue for me, it was one of marios concers anyway | 12:13 |
| quiquell | ykarel: I mean test_services <- create new one and add it to fs | 12:13 |
| panda|ruck | Tengu: also you're trying both podman and docker ? | 12:13 |
| Tengu | yes. see my comment | 12:14 |
| panda|ruck | Tengu: why not just try one of them ? | 12:14 |
| ykarel | quiquell, Tengu yup something else but not test_ping, there are multiple sorts of validation currently, so good to align with them | 12:14 |
| ykarel | i didn't checked complete review thought | 12:15 |
| ykarel | just saw marios comment and jumped on it | 12:15 |
| Tengu | ykarel: I'd like to get the most common, widely used thing - this check should be really done for each and every job | 12:15 |
| quiquell | ykarel: we can activate it a fs052 (standalone) | 12:15 |
| *** udesale has joined #tripleo | 12:16 | |
| Tengu | panda|ruck: I can add readme in the new role for some doc/explanation | 12:17 |
| Tengu | no big deal for me :) | 12:17 |
| *** Tengu has quit IRC | 12:17 | |
| *** Tengu has joined #tripleo | 12:17 | |
| panda|ruck | Tengu: what readme ? | 12:18 |
| Tengu | grumpf. | 12:18 |
| panda|ruck | readme.grumpf ? | 12:18 |
| Tengu | panda|ruck: I can add a new one in the role (got a huge lag, sorry) | 12:18 |
| panda|ruck | Tengu: new what ? | 12:19 |
| Tengu | panda|ruck: a new README in order to explain the role usage and why both podman /docker are checked and the like. | 12:19 |
| ramishra | lucasagomes: dalvarez reported https://bugs.launchpad.net/tripleo/+bug/1817315 | 12:19 |
| openstack | Launchpad bug 1817315 in tripleo "networking-ovn: Spawning instances on rdocloud overcloud fails" [High,New] | 12:19 |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/rocky: Add CertmongerUser role to OVB defaults https://review.openstack.org/638378 | 12:20 |
| *** gfidente has joined #tripleo | 12:20 | |
| panda|ruck | I understand why we need to do both, I don't necessarily agree we need to do them both at the same time relying on the ignore_errors: module | 12:21 |
| *** shyamb has quit IRC | 12:22 | |
| panda|ruck | Tengu: because ignore_errors make the module pass whatever the error is, even when it's a legit error. | 12:22 |
| Tengu | panda|ruck: as said: if "foo | grep bar" doesn't have a match, it will return a non-0, hence crash. we don't want that, right? | 12:22 |
| Tengu | that said... does "shell" crash on non-0? have a small doubt now. | 12:22 |
| panda|ruck | Tengu: not crash, fails. | 12:23 |
| panda|ruck | Tengu: what happens if neither podman nor docker are installed ? | 12:23 |
| Tengu | anyway. I don't want it to stop on non-0. | 12:23 |
| Tengu | panda|ruck: is it a thing that can really happen? | 12:23 |
| Tengu | like, in the real world where python-tripleoclient has a hard dependency on docker and podman? | 12:24 |
| Tengu | and where the whole deploy actually depends on the presence of either podman or docker? | 12:24 |
| *** holser|lunch is now known as holser_ | 12:25 | |
| *** EmilienM is now known as EvilienM | 12:27 | |
| openstackgerrit | Emilien Macchi proposed openstack/python-tripleoclient master: container image build: introduce --use-buildah https://review.openstack.org/634322 | 12:33 |
| *** shyamb has joined #tripleo | 12:33 | |
| panda|ruck | Tengu: ok, let's start from scratch, I wanna help merge this, but I have concerns. Have time to chat ? | 12:34 |
| Tengu | panda|ruck: of course :) | 12:34 |
| *** dtantsur|brb is now known as dtantsur | 12:35 | |
| Tengu | panda|ruck: BJ, or IRC.. ? | 12:35 |
| *** jpena is now known as jpena|lunch | 12:35 | |
| panda|ruck | your bj | 12:37 |
| Tengu | 1s | 12:37 |
| *** gfidente has quit IRC | 12:38 | |
| openstackgerrit | Marios Andreou proposed openstack/tripleo-repos master: WIP: Add tripleo-ci-testing to tripleo-repos for use in periodics https://review.openstack.org/638651 | 12:38 |
| openstackgerrit | Marios Andreou proposed openstack-infra/tripleo-ci master: WIP: Add override repos into tripleo-ci tripleo-repos role https://review.openstack.org/638652 | 12:38 |
| *** ccamacho has joined #tripleo | 12:39 | |
| *** gfidente has joined #tripleo | 12:40 | |
| openstackgerrit | Rafael Folco proposed openstack/tripleo-quickstart-extras master: Include container build error log for logstash indexing https://review.openstack.org/638655 | 12:42 |
| *** ratailor has quit IRC | 12:45 | |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci master: Add fedora-28 support to container-build job on fedora-28 with Buildah https://review.openstack.org/635991 | 12:51 |
| *** shyamb has quit IRC | 12:56 | |
| *** jcoufal has joined #tripleo | 13:01 | |
| Tengu | panda|ruck: for instance: podman ps -a --filter "status=restarting" --filter "status=exited" --filter "status=dead" «invalid filter: dead is not a valid status» | 13:03 |
| Tengu | yay | 13:03 |
| Tengu | that's the "podman effect" ;) | 13:03 |
| *** trown|outtypewww is now known as trown | 13:03 | |
| panda|ruck | Tengu: damn | 13:04 |
| panda|ruck | Tengu: is ther a replacemente for dead ? | 13:04 |
| Tengu | not sure..... have to read what "dead" means, maybe it's related to the healthchecks. | 13:05 |
| dalvarez | ramishra: but that job is passing right? http://logs.openstack.org/18/638518/1/check/tripleo-ci-centos-7-containers-multinode/dfd4ada/ | 13:05 |
| Tengu | panda|ruck: and as podman doesn't have healtchecks, "dead" doesn't mean anything, if it's the case :). lemme read a bit | 13:05 |
| dalvarez | ramishra: lucasagomes http://logs.openstack.org/18/638518/1/check/tripleo-ci-centos-7-containers-multinode/dfd4ada/logs/subnode-2/var/log/containers/nova/nova-compute.log.txt.gz#_2019-02-22_00_58_08_437 in this job it's using centos-7-rax-iad-0002880178.localdomain | 13:06 |
| dalvarez | is it only in rdocloud ramishra lucasagomes ? | 13:07 |
| dalvarez | ramishra: lucasagomes in RDO Third party CI jobs it's using overcloud-novacompute-0.ooo.test | 13:07 |
| dalvarez | https://logs.rdoproject.org/18/638518/2/openstack-check/tripleo-ci-centos-7-ovb-3ctlr_1comp_1supp-featureset039/0d9152e/logs/overcloud-novacompute-0/var/log/containers/nova/nova-compute.log.txt.gz#_2019-02-22_12_24_22_059 | 13:08 |
| dalvarez | and passing as well | 13:08 |
| Tengu | panda|ruck: damn... we can't run «podman ps -a --filter "status=restarting" --filter "status=exited"» - it will match only the "restarting". No "or", it's a plain "and", and apparently there is no way to get multiple status value. | 13:08 |
| Tengu | so probably my |grep was the """right yet ugly""" way. | 13:08 |
| *** panda|ruck is now known as panda|lunch | 13:10 | |
| ramishra | dalvarez: I don't think the job runs any tempest tests that spawns instances, just the basic_ops test http://logs.openstack.org/40/638440/1/check/tripleo-ci-centos-7-containers-multinode/68770f0/logs/undercloud/home/zuul/tempest.log.txt.gz#_2019-02-21_20_01_07 | 13:11 |
| dalvarez | ramishra: according to nova compute they do | 13:11 |
| dalvarez | let me check | 13:11 |
| dalvarez | ramishra: there's no job which boots BM? | 13:12 |
| dalvarez | VM* | 13:12 |
| *** vinaykns has joined #tripleo | 13:12 | |
| panda|lunch | Tengu: and prone to fals positive, but ok c'est la vie | 13:12 |
| dalvarez | ramishra: lucasagomes i see this: https://logs.rdoproject.org/18/638518/2/openstack-check/tripleo-ci-centos-7-ovb-3ctlr_1comp_1supp-featureset039/0d9152e/logs/overcloud-novacompute-0/var/log/containers/openvswitch/ovn-controller.log.txt.gz | 13:12 |
| Tengu | panda|lunch: or we can ignore the restarting containers.... | 13:12 |
| dalvarez | 2019-02-22T12:33:43.194Z|00025|binding|INFO|Claiming lport 9e1cc843-1314-4d3c-a92a-74ec6a6b4664 for this chassis. | 13:12 |
| dalvarez | 2019-02-22T12:33:43.194Z|00026|binding|INFO|9e1cc843-1314-4d3c-a92a-74ec6a6b4664: Claiming fa:16:3e:fa:61:b0 10.100.0.13 | 13:12 |
| dalvarez | ramishra: ^ this is a VM booting on novacompute-0 | 13:12 |
| dalvarez | ramishra: and you can check instances here in libvirt logs: https://logs.rdoproject.org/18/638518/2/openstack-check/tripleo-ci-centos-7-ovb-3ctlr_1comp_1supp-featureset039/0d9152e/logs/overcloud-novacompute-0/var/log/libvirt/qemu/ | 13:13 |
| Tengu | panda|lunch: so yeah, "podman ps -a --filter 'status=exited' --format '{{.Names}} {{.Status}}'" is a pretty neat thing we can use, and easily "match" in it with a "fail: when: ..." lemme give it a try. | 13:15 |
| panda|lunch | Tengu: perfect, thanks! | 13:15 |
| ramishra | dalvarez: I see this in nova service list http://paste.openstack.org/show/745724/, compute is registered with localdomain | 13:16 |
| dalvarez | ramishra: yeah this is my point | 13:16 |
| dalvarez | that's incorrect IMHO | 13:16 |
| ramishra | dalvarez: but that's just the reproducer | 13:16 |
| ramishra | nothing that I'm doing | 13:16 |
| dalvarez | ramishra: yeah that could be that the reproducer is wrong | 13:17 |
| dalvarez | but i dont think it's a networking-ovn bug :) | 13:17 |
| ramishra | dalvarez: well, the standard deployment with that job reproducer does not work which used to work before:) | 13:18 |
| ramishra | I'm not saying it's a netowkring-ovn bug | 13:18 |
| dalvarez | ramishra: then maybe networking-ovn uncovered a bug :P | 13:18 |
| dalvarez | ack | 13:18 |
| dalvarez | ramishra++ | 13:18 |
| *** florianf has joined #tripleo | 13:19 | |
| dalvarez | ramishra: can you show me the reproducer you're using pls? let's try to figure out how those names are worked out | 13:19 |
| openstackgerrit | Merged openstack/python-tripleoclient master: Remove execution from workflow message send https://review.openstack.org/630970 | 13:20 |
| *** quiquell is now known as quiquell|off | 13:22 | |
| ramishra | dalvarez: http://paste.openstack.org/show/745726/ | 13:22 |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart-extras master: [WIP] Reuse the validate-tempest skip list in os_tempest https://review.openstack.org/634380 | 13:23 |
| openstackgerrit | Sorin Sbarnea proposed openstack-infra/tripleo-ci master: [DNM] test tripleo-repos role with molecule https://review.openstack.org/636923 | 13:23 |
| openstackgerrit | Sorin Sbarnea proposed openstack-infra/tripleo-ci master: [DNM] test tripleo-repos role with molecule https://review.openstack.org/636923 | 13:24 |
| dalvarez | ramishra: http://git.openstack.org/cgit/openstack/tripleo-quickstart/tree/config/general_config/featureset001.yml#n53 by default featuresets are using 'localdomain' | 13:24 |
| *** udesale has quit IRC | 13:25 | |
| dalvarez | ramishra: could be that when you're sourcing your creds for rdocloud, it's specifying some 'rdocloud' thing somewhere? | 13:26 |
| lucasagomes | dalvarez, ah yeah looks like a mismatch between nova/neutron+ovn config... Lemme try to find where nova does grab that hostname from | 13:26 |
| lucasagomes | I saw thta the portbindingports table from neutron does have the host name set there, and that's what's used to build the portcontext which is then passed to networking-ovn | 13:27 |
| dalvarez | lucasagomes: the localdomain thing i think it comes by default in ooo, not sure who's writing 'rdocloud' on the actual hostname | 13:30 |
| ramishra | dalvarez: I'm not sure that's the case, nothing in the rc file like that. | 13:30 |
| dalvarez | ramishra: ack thanks for checking, not sure who's setting .rdocloud hostname, maybe rdocloud itself for certain tenants? cause doesnt seem to be the case for the RDO Third Party CI | 13:30 |
| openstackgerrit | Gael Chamoulaud proposed openstack/tripleo-validations master: Add dhcp-validations role https://review.openstack.org/638661 | 13:31 |
| openstackgerrit | Sorin Sbarnea proposed openstack-infra/tripleo-ci master: DNM: Add py3/f28 support to tripleo-container-build-base https://review.openstack.org/636160 | 13:31 |
| *** moshele has joined #tripleo | 13:33 | |
| hjensas | dtantsur: sorry for the late reply, I was up working very late and ended ut sleeping all day. | 13:34 |
| *** rlandy has joined #tripleo | 13:34 | |
| hjensas | dtantsur: troubleshooing os-net-config, you can get /etc/os-net-config/config.json and do re-run's manually? With added debug flags/noop flags. | 13:35 |
| *** psachin has quit IRC | 13:35 | |
| *** hamzy has quit IRC | 13:35 | |
| openstackgerrit | Cédric Jeanneret proposed openstack/tripleo-quickstart-extras master: Raise an error if a service or container is failed https://review.openstack.org/637729 | 13:37 |
| Tengu | panda|lunch: you'll be happy with that new version I think :) -^^ | 13:37 |
| Tengu | (at least I'm happy with it - cleaner imho) | 13:37 |
| dtantsur | hjensas: config.json contains empty dns_servers, why is this? | 13:37 |
| lucasagomes | dalvarez, right... yeah strange. Looking at the service list paste I can see that both the scheduler and conductor services that are .localdomain are marked as down | 13:39 |
| dtantsur | or rather: why does dns_servers come from? | 13:39 |
| hjensas | dtantsur: are you loosing the dns_server set on the ctlplane subnet along the way? | 13:39 |
| hjensas | dtantsur: I guess this is metalsmith? | 13:39 |
| dtantsur | hjensas: the ctlplane subnet has DNS servers set | 13:39 |
| dtantsur | yep | 13:39 |
| lucasagomes | dalvarez, the compute still up even tho there's a mismatch in the hostname, would that be the case of doing a "openstack service delete" on the .localdomain and recreate the compute with .rdocloud ? | 13:39 |
| lucasagomes | ramishra, ^ | 13:39 |
| hjensas | dtantsur: so you build the DeployedServerPortMap somewhere? | 13:40 |
| dtantsur | hjensas: oh, and there's no default route (next_hop is empty). | 13:40 |
| dtantsur | hjensas: I do, yes | 13:40 |
| dalvarez | lucasagomes: that would make sense.. not sure if somebody has done that tho | 13:40 |
| *** hamzy has joined #tripleo | 13:40 | |
| lucasagomes | dunno as well, it seems that the hostname of all nodes were updated and some of the services recreated | 13:41 |
| lucasagomes | but compute was missing there | 13:41 |
| lucasagomes | now who did this, I've no idea | 13:41 |
| *** moshele has quit IRC | 13:41 | |
| *** udesale has joined #tripleo | 13:41 | |
| hjensas | dtantsur: so the DeployedServerPortMap would have to look very similar to what a heat resource does. So that dnsservers and routers can be picked up using get_attr. | 13:41 |
| hjensas | dtantsur: | 13:42 |
| hjensas | https://github.com/openstack/tripleo-heat-templates/blob/master/puppet/role.role.j2.yaml#L531 | 13:42 |
| hjensas | dtantsur: https://github.com/openstack/tripleo-heat-templates/blob/master/puppet/role.role.j2.yaml#L509 | 13:42 |
| *** moguimar has joined #tripleo | 13:42 | |
| dtantsur | god | 13:42 |
| dtantsur | thanks hjensas, will give it a try | 13:42 |
| *** artom is now known as temka | 13:43 | |
| *** moshele has joined #tripleo | 13:43 | |
| *** agopi has quit IRC | 13:44 | |
| openstackgerrit | Ronelle Landy proposed openstack-infra/tripleo-ci master: Add base job for TripleO CI baremetal jobs https://review.openstack.org/636763 | 13:45 |
| *** moshele has quit IRC | 13:45 | |
| hjensas | dtantsur: heat's port objects and server addresses objects is extended to include attributes of the subnet and network as well as the port attributes. | 13:45 |
| dtantsur | hjensas: oh :) do I need to pass through host_routes? something from network? | 13:46 |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/rocky: Upgrades: Ensure idempotency of pacemaker services https://review.openstack.org/638384 | 13:46 |
| * dtantsur is pondering just serializing the whole subnet as JSON :D | 13:46 | |
| hjensas | dtantsur: yes! | 13:46 |
| dtantsur | hjensas: do you know what I need from network? | 13:47 |
| *** ccamacho has quit IRC | 13:50 | |
| hjensas | dtantsur: you need mtu from network as well. So serialize them both and put them in DeployedServerPortMap, I think "- network: [...]" should be added to deployed-server/deployed-server.yaml's output section as well. | 13:50 |
| openstackgerrit | Cédric Jeanneret proposed openstack/tripleo-quickstart-extras master: Raise an error if a service or container is failed https://review.openstack.org/637729 | 13:50 |
| *** ccamacho has joined #tripleo | 13:51 | |
| *** saneax has quit IRC | 13:51 | |
| Tengu | damn.... | 13:51 |
| *** sdake_ has quit IRC | 13:51 | |
| openstackgerrit | Cédric Jeanneret proposed openstack/tripleo-quickstart-extras master: Raise an error if a service or container is failed https://review.openstack.org/637729 | 13:51 |
| * Tengu should drink a coffee | 13:51 | |
| *** florianf_ has joined #tripleo | 13:54 | |
| *** agopi has joined #tripleo | 13:54 | |
| dtantsur | hjensas: out of curiosity: do you know what network["tags"] is? looks like subnet CIDR | 13:55 |
| hjensas | dtantsur: yes, that is a hack. | 13:56 |
| dtantsur | a hack? in openstack?? unbelievable.. | 13:56 |
| dtantsur | :D | 13:56 |
| Tengu | unbelievable | 13:56 |
| * Tengu is astonished :] | 13:56 | |
| hjensas | dtantsur: We need to make firewall rules and some ceph stuff aware of multiple CIDR's in routed deployments. Since the heat stack does not create the ctlplane network/subnets. (it's created by undercloud). | 13:56 |
| *** florianf has quit IRC | 13:57 | |
| hjensas | dtantsur: I had to store the CIDR's on peer-subnets on the ctlplane somewhere. | 13:57 |
| dtantsur | holy stack updates.. | 13:57 |
| dtantsur | okay, you convinced me: I'll just serialize the whole records :) | 13:57 |
| *** agopi_ has joined #tripleo | 13:58 | |
| hjensas | dtantsur: https://github.com/openstack/tripleo-heat-templates/blob/master/overcloud.j2.yaml#L352-L358 | 13:59 |
| *** agopi has quit IRC | 14:00 | |
| *** holser_ has quit IRC | 14:01 | |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-common master: DNM - add --debug to buildah https://review.openstack.org/638433 | 14:05 |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci master: Add fedora-28 support to container-build job on fedora-28 with Buildah https://review.openstack.org/635991 | 14:05 |
| *** ekultails has joined #tripleo | 14:06 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/queens: certmonger: Don't restart haproxy on cert renewal https://review.openstack.org/638607 | 14:09 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-common master: buildah/builder: use net=host https://review.openstack.org/638667 | 14:10 |
| *** jpena|lunch is now known as jpena | 14:13 | |
| *** panda|lunch is now known as panda | 14:13 | |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-common master: DNM - add --debug to buildah https://review.openstack.org/638433 | 14:13 |
| openstackgerrit | Rafael Folco proposed openstack/tripleo-common master: Remove opendaylight container image build from Stein https://review.openstack.org/638668 | 14:13 |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci master: Add fedora-28 support to container-build job on fedora-28 with Buildah https://review.openstack.org/635991 | 14:14 |
| openstackgerrit | Carlos Camacho proposed openstack/python-tripleoclient master: Add new CLI option openstack tripleo validate list https://review.openstack.org/636581 | 14:14 |
| openstackgerrit | Carlos Camacho proposed openstack/python-tripleoclient master: Add new CLI option openstack tripleo validate run https://review.openstack.org/636930 | 14:14 |
| openstackgerrit | Carlos Camacho proposed openstack/python-tripleoclient master: Add unit tests for running and listing validations from the CLI https://review.openstack.org/638426 | 14:14 |
| EvilienM | weshay, rfolco|rover : not sure we want https://review.openstack.org/#/c/638668/ in Stein | 14:17 |
| EvilienM | I think we need to properly deprecate the service | 14:17 |
| EvilienM | and remove in the next release | 14:17 |
| *** sdake has joined #tripleo | 14:17 | |
| dalvarez | lucasagomes: ramishra http://logs.openstack.org/94/582294/18/check/tripleo-ci-centos-7-scenario012-multinode-oooq-container/8f3223c/logs/undercloud/home/zuul/cloud-names.yaml.txt.gz could this be the cloud-names.yaml ? | 14:18 |
| *** boazel has joined #tripleo | 14:18 | |
| rfolco|rover | EvilienM, got it. I'll -2 with your comments | 14:18 |
| *** tzumainn has joined #tripleo | 14:19 | |
| *** dprince has quit IRC | 14:20 | |
| openstackgerrit | Dan Prince proposed openstack/tripleo-heat-templates master: flatten the gnocchi service configurations https://review.openstack.org/634703 | 14:20 |
| openstackgerrit | Jon Schlueter proposed openstack/tripleo-common master: cinder block - dead code cleanup https://review.openstack.org/638670 | 14:20 |
| *** panda is now known as panda|rcuk | 14:21 | |
| *** panda|rcuk is now known as panda|ruck | 14:21 | |
| jschlueter | mwhahaha: ^^ cleanup of dead code patch proposed | 14:21 |
| *** dprince has joined #tripleo | 14:22 | |
| marios | fultonj: panda|ruck o/ added comment in https://review.openstack.org/#/c/638363/3//COMMIT_MSG cc mwhahaha jaosorior | 14:30 |
| *** dxiri has joined #tripleo | 14:30 | |
| openstackgerrit | Jakub Libosvar proposed openstack/tripleo-heat-templates master: ml2-ansible: Switch to default Neutron backend https://review.openstack.org/638416 | 14:36 |
| *** mcornea has joined #tripleo | 14:37 | |
| openstackgerrit | Jakub Libosvar proposed openstack/tripleo-heat-templates master: ml2-ansible: Switch to default Neutron backend https://review.openstack.org/638416 | 14:39 |
| *** bnemec is now known as beekneemech | 14:39 | |
| *** rbrady has joined #tripleo | 14:41 | |
| *** sdake has quit IRC | 14:43 | |
| *** sdake has joined #tripleo | 14:45 | |
| *** suuuper has joined #tripleo | 14:46 | |
| openstackgerrit | Jose Luis Franco proposed openstack/python-tripleoclient master: Remove redundancy in _launch_ansible* methods. https://review.openstack.org/636920 | 14:47 |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci master: Add fedora-28 support to container-build job on fedora-28 with Buildah https://review.openstack.org/635991 | 14:51 |
| *** mjturek has joined #tripleo | 14:54 | |
| openstackgerrit | Jose Luis Franco proposed openstack/python-tripleoclient master: Remove redundancy in _launch_ansible* methods. https://review.openstack.org/636920 | 14:54 |
| dtantsur | hjensas: okay, now config.json looks correct (thanks!). however, no packages go beyond undercloud. do you know what can cause that? | 14:55 |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/rocky: certmonger: Don't restart haproxy on cert renewal https://review.openstack.org/638604 | 14:57 |
| openstackgerrit | Natal Ngétal proposed openstack/python-tripleoclient master: Move the code to create the ansible symlink. https://review.openstack.org/638399 | 14:57 |
| *** ccamacho has quit IRC | 15:01 | |
| dtantsur | slagle: same question ^^. shouldn't tripleo configure something for the undercloud to serve as a gateway? | 15:10 |
| *** ykarel is now known as ykarel|away | 15:10 | |
| fultonj | marios: ack | 15:11 |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci master: Add fedora-28 support to container-build job on fedora-28 with Buildah https://review.openstack.org/635991 | 15:11 |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci master: Add fedora-28 support to container-build job on fedora-28 with Buildah https://review.openstack.org/635991 | 15:13 |
| openstackgerrit | Dmitry Tantsur proposed openstack/python-tripleoclient master: nova-less-deploy: command for deploying nodes with ironic https://review.openstack.org/638685 | 15:13 |
| *** mjturek has quit IRC | 15:13 | |
| *** beagles is now known as beagles|pto | 15:14 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Don't look for primary_role ips in AllNodesValidationConfig https://review.openstack.org/638440 | 15:14 |
| *** rh-jelabarre has joined #tripleo | 15:17 | |
| *** udesale has quit IRC | 15:18 | |
| fultonj | mwhahaha: i replied to your comment in https://review.openstack.org/#/c/638363 . care to talk about this now while marios is still here? | 15:18 |
| fultonj | gfidente: ^ fyi | 15:18 |
| *** dprince has quit IRC | 15:18 | |
| mwhahaha | meh | 15:19 |
| mwhahaha | why can't the lvm patch be landed first? | 15:19 |
| mwhahaha | doe sit break everything? | 15:19 |
| fultonj | it breaks 001 and 004 | 15:19 |
| marios | o/ folks | 15:20 |
| marios | mwhahaha: either one breaks looks like | 15:20 |
| marios | mwhahaha: the tht sets bluestore as th backend but that will fail unless the tripleo-ci side sets it up | 15:20 |
| mwhahaha | why dont' we make the lvm thing configiruable | 15:20 |
| mwhahaha | rather than just assume we want it | 15:21 |
| mwhahaha | it seems that we're being lazy here | 15:21 |
| marios | mwhahaha: well that's a different story i mean chosing rather than switching to | 15:21 |
| marios | but i guess there may be reasons from ceph for that like its the new default from now on or something | 15:21 |
| marios | fultonj: gfidente ^ | 15:21 |
| mwhahaha | so i think we need to make https://review.openstack.org/#/c/638363/ configurable rather than relyign on ci branch | 15:21 |
| *** sdake has quit IRC | 15:21 | |
| mwhahaha | and https://review.openstack.org/#/c/547682/ would enable lvm | 15:21 |
| mwhahaha | then no non-voting is required | 15:21 |
| mwhahaha | and it's a better configuration because we can swithc bluestore on and off | 15:22 |
| mwhahaha | and is only stein+ | 15:22 |
| *** sdake has joined #tripleo | 15:22 | |
| mwhahaha | as the ci/environment files are branchs pecifric | 15:22 |
| mwhahaha | IMHO that's the better solution | 15:22 |
| fultonj | scope creep | 15:23 |
| mwhahaha | relying on ci_branch for functionality is dangerous | 15:23 |
| mwhahaha | so no, it's not scope creep | 15:23 |
| mwhahaha | it's making the patch less fragile | 15:23 |
| fultonj | so now you want tripleo to set up the LVM volumes in advance | 15:24 |
| mwhahaha | ... | 15:24 |
| fultonj | i'd prefer ceph-ansible set up the lvm volumes in advance | 15:24 |
| mwhahaha | that's what your tripleo-ci patch does | 15:24 |
| fultonj | yes, that's what the tripleo-ci patch does | 15:24 |
| fultonj | we need both at the same time | 15:24 |
| mwhahaha | so i'm just saying make it a CI var? | 15:25 |
| mwhahaha | i know | 15:25 |
| mwhahaha | just make it configuable so that we disable it in the scenario file | 15:25 |
| fultonj | sure we make it a CI var, and then... | 15:25 |
| mwhahaha | and then it lands with out having to switch anything to non-voting? | 15:25 |
| mwhahaha | and it doesn't matter that we have to land the patches right away? | 15:25 |
| fultonj | i think you're skipping over a few details | 15:25 |
| mwhahaha | not really | 15:26 |
| fultonj | the triplco-ci job runs first | 15:26 |
| mwhahaha | anyway i've got to go i'll deal with it later and think about it more | 15:26 |
| mwhahaha | i don't like the disk prep we have anyway | 15:26 |
| *** mjturek has joined #tripleo | 15:27 | |
| *** florianf_ has quit IRC | 15:27 | |
| fultonj | i don't see how how what you're asking for is possible | 15:27 |
| fultonj | but i'm trying to understand how i could make it the way you're asking | 15:27 |
| mwhahaha | you need to recheck the patch anyway | 15:28 |
| mwhahaha | let me dig deeper later | 15:28 |
| * mwhahaha wanders off for a bit | 15:28 | |
| *** jobewan has joined #tripleo | 15:30 | |
| *** khyr0n has quit IRC | 15:30 | |
| fultonj | hmmmmm | 15:30 |
| *** dxiri has quit IRC | 15:30 | |
| *** khyr0n has joined #tripleo | 15:31 | |
| *** mjturek has quit IRC | 15:35 | |
| openstackgerrit | Dmitry Tantsur proposed openstack/python-tripleoclient master: nova-less-deploy: command for deploying nodes with ironic https://review.openstack.org/638685 | 15:35 |
| *** mjturek has joined #tripleo | 15:36 | |
| *** Vorrtex has joined #tripleo | 15:37 | |
| openstackgerrit | Dmitry Tantsur proposed openstack/python-tripleoclient master: nova-less-deploy: command for deploying nodes with ironic https://review.openstack.org/638685 | 15:45 |
| *** jfrancoa has quit IRC | 15:49 | |
| weshay | easy review on openshift-ansible https://review.openstack.org/#/c/637727/1 | 15:50 |
| openstackgerrit | Rabi Mishra proposed openstack/tripleo-heat-templates stable/rocky: Don't look for primary_role ips in AllNodesValidationConfig https://review.openstack.org/638693 | 15:54 |
| *** ykarel|away has quit IRC | 15:55 | |
| openstackgerrit | Rabi Mishra proposed openstack/tripleo-heat-templates stable/queens: Don't look for primary_role ips in AllNodesValidationConfig https://review.openstack.org/638695 | 15:56 |
| *** mjturek has quit IRC | 15:57 | |
| openstackgerrit | RedHat RDO CI proposed openstack/tripleo-heat-templates stable/queens: GATE CHECK for TripleO https://review.openstack.org/567224 | 16:00 |
| *** mjturek has joined #tripleo | 16:00 | |
| openstackgerrit | RedHat RDO CI proposed openstack/tripleo-heat-templates master: GATE CHECK for TripleO https://review.openstack.org/604298 | 16:00 |
| openstackgerrit | RedHat RDO CI proposed openstack/tripleo-heat-templates stable/rocky: GATE CHECK for TripleO https://review.openstack.org/604293 | 16:00 |
| *** kopecmartin is now known as kopecmartin|off | 16:06 | |
| openstackgerrit | Dmitry Tantsur proposed openstack/python-tripleoclient master: nova-less-deploy: command for deploying nodes with ironic https://review.openstack.org/638685 | 16:08 |
| *** vinaykns has quit IRC | 16:09 | |
| *** yprokule has quit IRC | 16:11 | |
| slagle | dtantsur: undercloud usually is the gateway if the gateway ip on the ctlplane subnet is the undercloud's "local_ip" | 16:12 |
| slagle | should be the default route on the overcloud nodes | 16:12 |
| slagle | if all that looks ok, then you may be missing the masquerade rule in undercloud's nat iptables | 16:12 |
| dtantsur | yeah, looks okay. I'm redeploying to make sure I don't have anything from my previous attempts. | 16:13 |
| slagle | dtantsur: we used to masquerade by default, but now we don't | 16:13 |
| dtantsur | slagle: what do we use now, at least on virt environments? | 16:13 |
| slagle | as it's really a developer setup option tbh | 16:13 |
| slagle | we still use the masquerade rule, you just have to enable it undercloud.conf | 16:13 |
| dtantsur | I would expect quickstart to do something about it :) | 16:13 |
| slagle | <no comment> | 16:14 |
| dtantsur | masquerade=False | 16:14 |
| dtantsur | hmmmm | 16:14 |
| *** ykarel|away has joined #tripleo | 16:14 | |
| mwhahaha | yea it changed in 14 | 16:14 |
| mwhahaha | er rocky | 16:15 |
| mwhahaha | we used to add the masq options even if it was set to false (yay bugs) | 16:15 |
| mwhahaha | we "fixed" that | 16:15 |
| mwhahaha | so you have to enable it under ctlplane-subnet now | 16:15 |
| slagle | we just went ahead and fixed the glitch | 16:16 |
| dtantsur | mwhahaha: do you happen to know why quickstart doesn't do it? it looks like a deployment cannot succeed without it in the virtual environment with one NIC | 16:16 |
| slagle | it will just work itself out naturally | 16:16 |
| mwhahaha | i think it's an option in quickstart | 16:16 |
| * mwhahaha googles | 16:16 | |
| mwhahaha | ctlplane_masquerade | 16:17 |
| mwhahaha | is false by default | 16:17 |
| dtantsur | oook. I was sure I had successful deployment in rocky.. but maybe it was metalsmith-only, so I did not need DNS working. | 16:17 |
| dtantsur | anyway, thanks slagle and mwhahaha. I think I know what I need now. | 16:18 |
| openstackgerrit | Dmitry Tantsur proposed openstack/tripleo-common master: nova-less-deploy: implement deploy_roles workflow https://review.openstack.org/637191 | 16:19 |
| dtantsur | this madness seems to work ^^^, modulo masquerading | 16:19 |
| *** gfidente has quit IRC | 16:19 | |
| mwhahaha | fultonj: ok so i'm going to look at the change. I still don't think we should be relying on ci_branch and we could use job vars instead but gimme a few minutes to look further | 16:20 |
| fultonj | mwhahaha: i think i can do what you're asking, but i'm trying to figure out the flow | 16:20 |
| mwhahaha | fultonj: so my issue with ci_branch is that it's really ci specific and so you end up not being able to reuse the roles | 16:21 |
| fultonj | i think you're saying tripleo-ci could pass a param to the ceph-loop-device role to turn on LVM or not | 16:21 |
| mwhahaha | well we could configure a var in the job definition | 16:21 |
| mwhahaha | it might be more work than it's worth tho so | 16:22 |
| mwhahaha | gimme a minute | 16:22 |
| mwhahaha | i just really don't like relying on ci_branch | 16:22 |
| *** aufi has quit IRC | 16:23 | |
| openstackgerrit | Rafael Folco proposed openstack/tripleo-heat-templates master: Deprecate opendaylight service https://review.openstack.org/638701 | 16:26 |
| mwhahaha | fultonj: upon further review let's just merge it as it. Because we'd still have to time a tripleo-ci/tht change anyway due to scenario001/004 being on other repos. i don't like it but i don't think there's a better option | 16:27 |
| *** agopi_ is now known as agopi | 16:29 | |
| fultonj | mwhahaha: as is --> meaning stacked on the temporary disable and then we'd renable w/ revert when both land? | 16:29 |
| mwhahaha | fultonj: yea | 16:29 |
| fultonj | mwhahaha: ok, thanks | 16:29 |
| mwhahaha | i'll +2 and keep an eye on the rechecks today | 16:29 |
| fultonj | thanks mwhahaha | 16:30 |
| dtantsur | mwhahaha, slagle, do you guys know if this masquerade setting can be changed on a live system? | 16:32 |
| *** gfidente has joined #tripleo | 16:32 | |
| mwhahaha | dtantsur: you'd have to change it in the conf and rerun install to apply | 16:32 |
| mwhahaha | dtantsur: but yea it should be something you can adjust | 16:32 |
| mwhahaha | or just manually add the rules :D | 16:32 |
| dtantsur | nice, I'll try (on Monday) | 16:32 |
| dtantsur | heh | 16:32 |
| *** vinaykns has joined #tripleo | 16:34 | |
| slagle | dtantsur: a quick hack is "iptables -t nat -A POSTROUTING ! -s 127.0.0.0/8 -j MASQUERADE" | 16:34 |
| slagle | to try it | 16:34 |
| dtantsur | slagle: I ran this command, now you're responsible for what will happen to my undercloud! | 16:35 |
| dtantsur | :D | 16:35 |
| dtantsur | thanks slagle | 16:35 |
| openstackgerrit | Alex Schultz proposed openstack/python-tripleoclient stable/rocky: Check proxy env vars https://review.openstack.org/638710 | 16:36 |
| *** hberaud is now known as hberaud|school-r | 16:41 | |
| *** hberaud|school-r is now known as hberaud | 16:46 | |
| fultonj | bogdando: do you prefer we merge https://review.openstack.org/#/c/631489 as is and then address other issues in a subsequent patch? | 16:46 |
| fultonj | https://review.openstack.org/#/c/631489/2..3/doc/source/install/advanced_deployment/distributed_compute_node.rst | 16:46 |
| bogdando | fultonj: yes please | 16:47 |
| bogdando | thanks! gtg now. Have a nice weekends | 16:47 |
| fultonj | bogdando: ok | 16:47 |
| *** itlinux has joined #tripleo | 16:47 | |
| *** bogdando has quit IRC | 16:52 | |
| dtantsur | slagle, "Overcloud deployed" \o/ | 16:54 |
| * dtantsur is dancing | 16:54 | |
| *** agopi is now known as agopi|lunch|trav | 16:54 | |
| *** agopi|lunch|trav has quit IRC | 16:55 | |
| *** boazel has quit IRC | 16:55 | |
| *** evrardjp is now known as gatersaregonnaga | 16:58 | |
| *** gatersaregonnaga is now known as evrardjp | 17:00 | |
| *** suuuper has quit IRC | 17:00 | |
| *** dciabrin__ has quit IRC | 17:00 | |
| dtantsur | jaosorior: FYI some good progress ^^^ | 17:01 |
| *** dciabrin__ has joined #tripleo | 17:01 | |
| openstackgerrit | Ronelle Landy proposed openstack-infra/tripleo-ci master: DNM - Temp change periodic switch to rely on zuul.job https://review.openstack.org/625271 | 17:01 |
| *** dprince has joined #tripleo | 17:04 | |
| openstackgerrit | Merged openstack/tripleo-common stable/rocky: Add missing queue_name input parameter for listing validations https://review.openstack.org/637485 | 17:05 |
| slagle | dtantsur: make it the default! | 17:06 |
| dtantsur | worked once - time for production! | 17:06 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-common master: [DOWNSTREAM ONLY] Remove rsyslog container image https://review.openstack.org/638720 | 17:07 |
| *** ykarel_ has joined #tripleo | 17:08 | |
| *** dtantsur is now known as dtantsur|afk | 17:08 | |
| *** ykarel|away has quit IRC | 17:10 | |
| *** trown is now known as trown|lunch | 17:18 | |
| *** dciabrin_ has joined #tripleo | 17:25 | |
| *** dciabrin__ has quit IRC | 17:25 | |
| *** tosky has quit IRC | 17:28 | |
| *** jpich has quit IRC | 17:36 | |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-common master: image-serve: add httpd_sys_content_t type to v2/index.json https://review.openstack.org/638729 | 17:41 |
| *** _fragatina has quit IRC | 17:42 | |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci master: Add fedora-28 support to container-build job on fedora-28 with Buildah https://review.openstack.org/635991 | 17:48 |
| openstackgerrit | Emilien Macchi proposed openstack/python-tripleoclient master: container image build: introduce --use-buildah https://review.openstack.org/634322 | 17:51 |
| openstackgerrit | Emilien Macchi proposed openstack/python-tripleoclient master: container image build: introduce --use-buildah https://review.openstack.org/634322 | 17:51 |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Do not ignore Swift ring changes to trigger container restart https://review.openstack.org/616116 | 17:52 |
| openstackgerrit | Merged openstack/tripleo-common stable/rocky: Append qemu-img to Mistral executor package list https://review.openstack.org/638446 | 17:52 |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/queens: minor update: move VIP before stopping pacemaker on a node https://review.openstack.org/638630 | 17:52 |
| *** hberaud is now known as hberaud|afk | 17:52 | |
| *** sdake has quit IRC | 17:54 | |
| *** sdake has joined #tripleo | 17:55 | |
| *** betherly has joined #tripleo | 17:56 | |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci master: Add fedora-28 support to container-build job on fedora-28 with Buildah https://review.openstack.org/635991 | 17:56 |
| openstackgerrit | Athlan-Guyot sofer proposed openstack/tripleo-heat-templates master: Setup cluster definition based on the ansible limit option. https://review.openstack.org/631483 | 17:58 |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci master: Create a new container build job with Buildah on centos7 https://review.openstack.org/635991 | 17:58 |
| *** boazel has joined #tripleo | 17:59 | |
| *** betherly has quit IRC | 18:01 | |
| openstackgerrit | Alex Schultz proposed openstack/tripleo-common master: Use the default ContainerImagePrepare if not provided https://review.openstack.org/638286 | 18:01 |
| *** wolverineav has joined #tripleo | 18:01 | |
| *** jpena is now known as jpena|off | 18:07 | |
| *** moguimar has quit IRC | 18:08 | |
| *** ekultails has quit IRC | 18:12 | |
| *** ekultails has joined #tripleo | 18:13 | |
| openstackgerrit | Alex Schultz proposed openstack/tripleo-common master: Use the default ContainerImagePrepare if not provided https://review.openstack.org/638286 | 18:15 |
| openstackgerrit | Arx Cruz proposed openstack/tripleo-quickstart-extras master: Send return of tempest init to /dev/null https://review.openstack.org/638740 | 18:26 |
| *** rlandy is now known as rlandy|brb | 18:28 | |
| *** wolverineav has quit IRC | 18:28 | |
| *** wolverineav has joined #tripleo | 18:31 | |
| *** wolverineav has quit IRC | 18:32 | |
| *** wolverineav has joined #tripleo | 18:32 | |
| *** _fragatina has joined #tripleo | 18:32 | |
| *** gfidente has quit IRC | 18:34 | |
| *** betherly has joined #tripleo | 18:35 | |
| *** ramishra has quit IRC | 18:40 | |
| *** trown|lunch is now known as trown | 18:40 | |
| *** betherly has quit IRC | 18:40 | |
| *** holser_ has joined #tripleo | 18:43 | |
| *** chandankumar is now known as raukadah | 18:45 | |
| *** agopi has joined #tripleo | 18:45 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Make openshift-ansible working dir owned by tripleo-admin https://review.openstack.org/637727 | 18:48 |
| *** rlandy|brb is now known as rlandy | 18:54 | |
| sshnaidm|off | jaosorior, vinaykns tried ipa setup with quickstart.sh and it passed, so should be everything ok | 19:08 |
| *** dciabrin_ has quit IRC | 19:18 | |
| *** dciabrin_ has joined #tripleo | 19:18 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Change vxlan to geneve for network environment files https://review.openstack.org/638253 | 19:22 |
| openstackgerrit | Ronelle Landy proposed openstack-infra/tripleo-ci master: DNM - To test periodic https://review.openstack.org/638756 | 19:23 |
| *** mjturek has quit IRC | 19:25 | |
| *** ykarel_ is now known as ykarel | 19:28 | |
| *** sdake has quit IRC | 19:31 | |
| *** ykarel is now known as ykarel|away | 19:32 | |
| *** _fragatina has quit IRC | 19:41 | |
| *** Vorrtex has quit IRC | 19:41 | |
| *** mjturek has joined #tripleo | 19:41 | |
| *** itlinux has quit IRC | 19:41 | |
| *** Vorrtex has joined #tripleo | 19:42 | |
| *** Vorrtex has quit IRC | 19:42 | |
| *** Vorrtex has joined #tripleo | 19:43 | |
| *** ykarel|away has quit IRC | 19:46 | |
| jidar | fultonj: still looks like it's hanging up on workflow step2 after ceph-ansible successfully kicks off and finishes it's update, I also don't see any sort of HTTPS failures or heat claiming it can't talk to an endpoint, in fact I just see no error at all that claims the process failed. I see triplo-admin getting called by ansible a few times and then nothing | 19:53 |
| jidar | I have no idea why a successful deploy followed up by another deploy would always result in an error | 19:54 |
| fultonj | jidar: are you using spine/leaf networking? | 19:57 |
| jidar | I do not | 19:57 |
| jidar | the last thing I see in the mistral-exec log is: CMD "ansible-playbook -vvv /usr/share/ceph-ansible/site-docker.yml.sample --user tripleo-admin --become --become-user root --extra-vars {"ireallymeanit": "yes"} --inventory-file /tmp/ansible-mistral-actionIH_JA7/inventory.yaml --private-key /tmp/ansible-mistral-actionIH_JA7/ssh_private_key --skip*** package-install,with_pkg" returned: 0 in 337.191s execute | 19:58 |
| jidar | /usr/lib/python2.7/site-packages/oslo_concurrency/processutils.py:409 | 19:58 |
| *** wolverineav has quit IRC | 19:59 | |
| *** wolverineav has joined #tripleo | 19:59 | |
| *** wolverineav has quit IRC | 20:04 | |
| *** wolverineav has joined #tripleo | 20:04 | |
| *** jcoufal has quit IRC | 20:05 | |
| *** wolverineav has quit IRC | 20:09 | |
| openstackgerrit | Dan Prince proposed openstack/tripleo-heat-templates master: flatten the octavia service configurations https://review.openstack.org/638762 | 20:18 |
| *** itlinux has joined #tripleo | 20:25 | |
| *** ekultails has quit IRC | 20:25 | |
| openstackgerrit | wes hayutin proposed openstack-infra/tripleo-ci master: execute tripleo-ci collect-logs https://review.openstack.org/638763 | 20:34 |
| fultonj | jidar: try interacting with the mistral CLI to see what tasks it go through | 20:35 |
| fultonj | source stackrc; mistral execution-list --limit=-1 | 20:35 |
| openstackgerrit | wes hayutin proposed openstack-infra/tripleo-ci master: execute tripleo-ci collect-logs https://review.openstack.org/638763 | 20:35 |
| fultonj | if you can find the most recent run of the ceph-install workflow by its UUID, then you can identify its list of tasks and see which task failed | 20:36 |
| fultonj | i use this script to do that | 20:36 |
| fultonj | https://github.com/fultonj/tripleo-ceph-ansible/blob/master/see-last-task.sh | 20:36 |
| openstackgerrit | Francesco Pantano proposed openstack/tripleo-heat-templates master: Added tar option to preserve metadata of existing fetch_dir https://review.openstack.org/637537 | 20:36 |
| fultonj | it's more about the commands thatn the script though | 20:36 |
| fultonj | you should be able to relate the executed tasks to the mistral workbook https://github.com/openstack/tripleo-common/blob/stable/queens/workbooks/ceph-ansible.yaml#L152 | 20:37 |
| fultonj | does mistral believe the ceph_install task is complete ? | 20:37 |
| fultonj | if so, are you stuck on the task after that? | 20:37 |
| fultonj | jidar: ^ | 20:38 |
| fultonj | you need to isolate if the problem is in the mistral workflow or if the workflow finished and couldn't communicate back to heat that it was done | 20:38 |
| fultonj | the heat resource in question is https://github.com/openstack/heat/blob/master/heat/engine/resources/openstack/mistral/external_resource.py | 20:39 |
| fultonj | jidar: but i think it better to make sure mistral finished first | 20:39 |
| *** ekultails has joined #tripleo | 20:43 | |
| *** wolverineav has joined #tripleo | 20:45 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/queens: Handle upper and lower case system uuids https://review.openstack.org/638494 | 20:47 |
| *** dprince has quit IRC | 20:47 | |
| *** wolverineav has quit IRC | 20:50 | |
| *** itlinux has quit IRC | 20:51 | |
| *** wolverineav has joined #tripleo | 20:56 | |
| *** itlinux has joined #tripleo | 21:00 | |
| *** itlinux has quit IRC | 21:02 | |
| openstackgerrit | Alex Schultz proposed openstack-infra/tripleo-ci master: Create a new container build job with Buildah on centos7 https://review.openstack.org/635991 | 21:03 |
| weshay | mwhahaha https://review.openstack.org/#/c/628498 shall we? | 21:08 |
| mwhahaha | maybe | 21:08 |
| mwhahaha | seems to be a bunch of stuff that needs to be merged first | 21:09 |
| * mwhahaha reviews | 21:09 | |
| weshay | the other two reviews merged | 21:09 |
| mwhahaha | not the ones it's based on top of | 21:09 |
| weshay | ah crud | 21:09 |
| *** tosky has joined #tripleo | 21:11 | |
| *** toure is now known as toure|gone | 21:12 | |
| mwhahaha | do we already have a bug of the image build failures in ovb? | 21:12 |
| mwhahaha | https://logs.rdoproject.org/86/638286/3/openstack-check/tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001/a7e1c2f/logs/undercloud/home/zuul/overcloud_image_build.log.txt.gz#_2019-02-22_19_16_55 | 21:12 |
| * weshay looks | 21:13 | |
| *** itlinux has joined #tripleo | 21:13 | |
| weshay | rfolco|rover fyi ^ | 21:14 |
| * weshay checks if it happens more than once | 21:14 | |
| mwhahaha | happened on the fs35 version too and my patch was for container builds so it's unlikely to be the cause | 21:14 |
| weshay | ya.. I'll open it now.. don't see it and it's running like shit.. 52% | 21:15 |
| weshay | rdo has been bumpy the last two days | 21:15 |
| weshay | infra | 21:15 |
| *** raildo has quit IRC | 21:15 | |
| mwhahaha | yea wasn't sure if related to the cloud | 21:15 |
| weshay | will find out | 21:16 |
| weshay | heh ansible-playbook-3 symlink missing on RHEL8 | 21:17 |
| mwhahaha | for all the fedora28 has given us, it's also made us do some silly workarounds | 21:18 |
| mwhahaha | like ansible-playbook-3 | 21:18 |
| *** hberaud|afk is now known as hberaud | 21:20 | |
| *** jobewan has quit IRC | 21:20 | |
| *** itlinux has quit IRC | 21:20 | |
| *** holser_ has quit IRC | 21:22 | |
| *** morazi has quit IRC | 21:23 | |
| *** Vorrtex has quit IRC | 21:24 | |
| *** jcoufal has joined #tripleo | 21:24 | |
| openstackgerrit | wes hayutin proposed openstack-infra/tripleo-ci master: DNM: execute tripleo-ci collect-logs https://review.openstack.org/638763 | 21:24 |
| *** jcoufal has quit IRC | 21:25 | |
| *** wolverineav has quit IRC | 21:26 | |
| openstackgerrit | wes hayutin proposed openstack-infra/tripleo-ci master: DNM, Wes Create a new container build job with Buildah on centos7 https://review.openstack.org/638768 | 21:26 |
| weshay | mwhahaha roger on the logs.. /me sees if I can get something else going | 21:26 |
| *** wolverineav has joined #tripleo | 21:27 | |
| *** itlinux has joined #tripleo | 21:27 | |
| *** itlinux has quit IRC | 21:27 | |
| *** betherly has joined #tripleo | 21:32 | |
| mwhahaha | weshay: we generally don't need additional logs because most of it is not supposed to be using the system stuff. i think EvilienM is just running into problems with his assumptions around docker/podman/buildah | 21:33 |
| weshay | k k.. np.. I wanted to see if I can get our wizbang reproducer to run the containers build job.. | 21:34 |
| mwhahaha | unlikely because we don't use quickstart of any of it | 21:35 |
| mwhahaha | which was the point | 21:35 |
| weshay | it doesn't need it | 21:35 |
| weshay | should work for any zuul based job | 21:36 |
| *** wolverineav has quit IRC | 21:37 | |
| *** holser_ has joined #tripleo | 21:37 | |
| *** betherly has quit IRC | 21:37 | |
| *** itlinux has joined #tripleo | 21:40 | |
| *** temka has quit IRC | 21:40 | |
| *** artom has joined #tripleo | 21:40 | |
| openstackgerrit | John Fulton proposed openstack/tripleo-quickstart-extras master: WIP/DNM: Add split-controlplane-standalone.yml playbook https://review.openstack.org/617368 | 21:47 |
| openstackgerrit | John Fulton proposed openstack/tripleo-quickstart master: WIP/DNM: Add featureset 59 for split controlplane https://review.openstack.org/615987 | 21:47 |
| openstackgerrit | John Fulton proposed openstack-infra/tripleo-ci master: WIP/DNM: Add split-controlplane standalone non-voting job definition https://review.openstack.org/615988 | 21:47 |
| openstackgerrit | Tom Barron proposed openstack/puppet-tripleo master: Support cephfs_volume_mode parameter https://review.openstack.org/638773 | 21:52 |
| *** boazel has quit IRC | 21:53 | |
| *** mjturek has quit IRC | 21:59 | |
| *** jtomasek has quit IRC | 21:59 | |
| *** rh-jelabarre has quit IRC | 22:03 | |
| *** cfontain has joined #tripleo | 22:06 | |
| *** cfontain has quit IRC | 22:11 | |
| openstackgerrit | Nagasai Vinaykumar Kapalavai proposed openstack/puppet-tripleo master: metrics_qdr: TLS support. https://review.openstack.org/631297 | 22:11 |
| openstackgerrit | Nagasai Vinaykumar Kapalavai proposed openstack/tripleo-heat-templates master: metrics_qdr: Add TLS support https://review.openstack.org/630736 | 22:12 |
| openstackgerrit | Tom Barron proposed openstack/tripleo-heat-templates master: Support cephfs_volume_mode parameter https://review.openstack.org/638775 | 22:13 |
| *** rlandy has quit IRC | 22:15 | |
| *** _fragatina has joined #tripleo | 22:21 | |
| jidar | fultonj: https://gist.github.com/2c477f6ff94aa8d4ae6b3b2d8a5b1d68 the workflow claims to be still running (hours later) | 22:24 |
| fultonj | mistral task-list $UUID | 22:25 |
| fultonj | jidar: i wonder if you set the task to complete if things will just continue as they should | 22:26 |
| jidar | I'd like to try that | 22:26 |
| jidar | > 61fab958-0a90-4d77-b2af-564249a84b42 ceph_base_ansible_workflow tripleo.overcloud.workflow_tasks.step2 f44c6f48-a39b-4a2f-a955-6552e3374cd9 RUNNING None 2019-02-22 19:36:03 <none> | 22:27 |
| fultonj | mistral execution-update -s <STATE> <ID> | 22:34 |
| jidar | yea, following along now it kicked that process over | 22:34 |
| jidar | 2019-02-22 19:36:01Z [overcloud-AllNodesDeploySteps-mlcwsflsuptv.WorkflowTasks_Step2_Execution]: CREATE_IN_PROGRESS state changed | 22:34 |
| jidar | 2019-02-22 22:31:21Z [overcloud-AllNodesDeploySteps-mlcwsflsuptv.WorkflowTasks_Step2_Execution]: CREATE_COMPLETE state changed | 22:34 |
| jidar | (check timestamps) | 22:34 |
| fultonj | so when you told mistral it was done, it was able to tell heat it was done and that reseources was marked as created and it moved on | 22:35 |
| jidar | seems that way | 22:35 |
| *** sdake has joined #tripleo | 22:37 | |
| jidar | I'll note, the workflow doesn't appear done | 22:37 |
| jidar | my earlier gist is still true | 22:37 |
| fultonj | you set the execution to finished? | 22:38 |
| jidar | > mistral execution-update -s SUCCESS f44c6f48-a39b-4a2f-a955-6552e3374cd9 | 22:38 |
| fultonj | but the tasks connected to it, e.g. the ceph_base_ansible_workflow task is still running | 22:39 |
| fultonj | workflow = set of tasks | 22:39 |
| fultonj | an execution is an instance of the workflow and its tasks | 22:39 |
| jidar | yea, so when I filter using your script for WORKFLOW='tripleo.overcloud.workflow_tasks.step2' | 22:39 |
| fultonj | you get a workflow containing tasks | 22:40 |
| fultonj | the overall workflow has a status | 22:40 |
| fultonj | but you didnt' chagne the status of the individual tasks | 22:40 |
| fultonj | so that's why the task is still running | 22:40 |
| jidar | yea, that's what I figured | 22:40 |
| jidar | update complete, and successful | 22:41 |
| * jidar groans | 22:41 | |
| jidar | obviously f44c6f48-a39b-4a2f-a955-6552e3374cd9 has no output to review | 22:42 |
| *** dciabrin_ has quit IRC | 22:42 | |
| *** dciabrin_ has joined #tripleo | 22:43 | |
| fultonj | can you share `mistral task-list $UUID` | 22:43 |
| fultonj | it should output a table of how the tasks did | 22:43 |
| jidar | 61fab958-0a90-4d77-b2af-564249a84b42 ceph_base_ansible_workflow tripleo.overcloud.workflow_tasks.step2 f44c6f48-a39b-4a2f-a955-6552e3374cd9 RUNNING None 2019-02-22 19:36:03 <none> | 22:44 |
| jidar | I used -f value ^ | 22:44 |
| *** cfontain has joined #tripleo | 22:44 | |
| fultonj | can i see the bale without the awk and loop? | 22:44 |
| fultonj | s/bale/table/ | 22:44 |
| fultonj | mistral task-list $UUID | 22:44 |
| jidar | https://gist.github.com/574405f81ad1a4b0e9e194ab0302edf2 | 22:45 |
| *** chem has quit IRC | 22:45 | |
| fultonj | https://github.com/openstack/tripleo-common/blob/stable/queens/workbooks/ceph-ansible.yaml#L29 | 22:46 |
| fultonj | list of tasks ^ | 22:46 |
| fultonj | set_swift_container --> should have a status | 22:47 |
| fultonj | collect_puppet_hieradata --> should have a status | 22:47 |
| fultonj | i want to be sure that the ceph_install task is the one that hung and not a subsequent task | 22:47 |
| *** holser_ has quit IRC | 22:47 | |
| fultonj | if you uncomment that #mistral task-get-result $TASK_ID | 22:49 |
| jidar | it looks like ceph_install tripleo.storage.v1.ceph_install is still running | 22:49 |
| jidar | from 02-08 | 22:49 |
| jidar | but everything else in that list looks good | 22:50 |
| *** mcornea has quit IRC | 22:50 | |
| jidar | let me do that real quick | 22:50 |
| fultonj | i need to go | 22:51 |
| jidar | gotcha, thanks for all the help again fultonj | 22:52 |
| fultonj | so save_fetch_directory didn't run yet right? | 22:52 |
| fultonj | it didn't get to it | 22:52 |
| jidar | https://gist.github.com/09da4cc01c360beb3b7f9f54f059045b | 22:52 |
| jidar | checking | 22:52 |
| jidar | it did not | 22:53 |
| fultonj | so your update is missing that | 22:53 |
| fultonj | that the result of that task | 22:53 |
| jidar | mistral task-list | grep save_fetch_directory is blank | 22:53 |
| fultonj | but if it's an idempotent update it shouldnt' matter | 22:54 |
| fultonj | anyway | 22:54 |
| fultonj | these are all the symptoms of that ssl bug | 22:54 |
| fultonj | but if it's not ssl, then something else is preventing it from ack'ing | 22:54 |
| fultonj | it ack's via the path referred to in that bug | 22:54 |
| jidar | there's no error (that I found) incapacitating that it's not able to hit heat | 22:55 |
| jidar | s/incapacitating/indicating | 22:55 |
| jidar | but I agree it looks _just_ like that ssl bug | 22:55 |
| fultonj | a network issue on the internal api network? | 22:55 |
| jidar | that's a closed off network only on two switches... | 22:56 |
| fultonj | given the IP/port it should be able to ack to (to say "i'm done move on") | 22:56 |
| jidar | like, L2 even, my ssh sessions stay up for weeks | 22:56 |
| fultonj | gotta go now | 22:57 |
| jidar | I guess I'll spend some time looking at heat during the deployment | 22:57 |
| jidar | thanks again fultonj | 22:57 |
| fultonj | something about the process communciation | 22:57 |
| fultonj | it's not necesarily heat | 22:57 |
| fultonj | it's pre heat | 22:57 |
| fultonj | heat handed off | 22:57 |
| fultonj | mistral and it's actions are having trouble ack'ing | 22:57 |
| jidar | in the same spot, everytime? | 22:57 |
| jidar | thats just so weird | 22:58 |
| fultonj | yeah, something in that | 22:58 |
| fultonj | that's where to look | 22:58 |
| fultonj | ttyl | 22:58 |
| openstackgerrit | Nagasai Vinaykumar Kapalavai proposed openstack/tripleo-heat-templates master: Update to the ceilometer publisher list https://review.openstack.org/600843 | 22:58 |
| jidar | groovy | 22:58 |
| *** vinaykns has quit IRC | 23:09 | |
| *** rascasoft has quit IRC | 23:13 | |
| *** cfontain has quit IRC | 23:17 | |
| *** slaweq has quit IRC | 23:23 | |
| *** ekultails has quit IRC | 23:31 | |
| *** itlinux has quit IRC | 23:35 | |
| *** wolverineav has joined #tripleo | 23:38 | |
| *** wolverineav has quit IRC | 23:42 | |
| *** holser_ has joined #tripleo | 23:53 | |
| *** itlinux has joined #tripleo | 23:57 | |
| *** rascasoft has joined #tripleo | 23:58 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!