| openstackgerrit | RedHat RDO CI proposed openstack/tripleo-heat-templates stable/queens: GATE CHECK for TripleO https://review.openstack.org/567224 | 00:00 |
|---|---|---|
| openstackgerrit | RedHat RDO CI proposed openstack/tripleo-quickstart-extras master: GATE CHECK for quickstart-extras https://review.openstack.org/560445 | 00:00 |
| *** sri_ has quit IRC | 00:10 | |
| *** sri_ has joined #tripleo | 00:11 | |
| *** morazi has quit IRC | 00:13 | |
| *** dxiri has quit IRC | 00:16 | |
| *** dmacpher has quit IRC | 00:21 | |
| *** morazi has joined #tripleo | 00:28 | |
| *** lblanchard has quit IRC | 00:53 | |
| *** morazi has quit IRC | 01:00 | |
| *** sri_ has quit IRC | 01:02 | |
| *** morazi has joined #tripleo | 01:02 | |
| *** sri_ has joined #tripleo | 01:02 | |
| *** dmacpher has joined #tripleo | 01:30 | |
| *** rlandy has quit IRC | 01:34 | |
| *** bdodd has quit IRC | 01:34 | |
| *** ykarel|away has joined #tripleo | 01:35 | |
| *** bdodd has joined #tripleo | 01:37 | |
| *** ramishra has quit IRC | 01:54 | |
| *** sri_ has quit IRC | 02:05 | |
| *** sri_ has joined #tripleo | 02:06 | |
| *** lblanchard has joined #tripleo | 02:13 | |
| *** apetrich has quit IRC | 02:14 | |
| *** lblanchard has quit IRC | 02:19 | |
| *** ramishra has joined #tripleo | 02:28 | |
| *** sri_ has quit IRC | 02:51 | |
| *** sri_ has joined #tripleo | 02:52 | |
| *** psachin has joined #tripleo | 02:56 | |
| *** moshele has joined #tripleo | 03:11 | |
| *** ramishra has quit IRC | 03:29 | |
| *** skramaja has joined #tripleo | 03:32 | |
| *** udesale has joined #tripleo | 03:59 | |
| *** khyr0n has joined #tripleo | 03:59 | |
| *** khyr0n has quit IRC | 03:59 | |
| *** sri_ has quit IRC | 04:02 | |
| *** Petersingh has joined #tripleo | 04:02 | |
| *** Petersingh is now known as Petersingh|afk | 04:04 | |
| *** ramishra has joined #tripleo | 04:06 | |
| *** hamzy has joined #tripleo | 04:15 | |
| *** links has joined #tripleo | 04:29 | |
| *** Petersingh|afk is now known as Petersingh | 04:36 | |
| *** morazi has quit IRC | 04:46 | |
| *** jchhatbar has joined #tripleo | 04:49 | |
| *** slong has joined #tripleo | 04:58 | |
| *** jchhatbar has quit IRC | 05:03 | |
| *** gkadam has joined #tripleo | 05:04 | |
| Tengu | hello there | 05:06 |
| Tengu | jaosorior: heya! do you know why the whole host /etc/pki isn't mounted as-is in the containers? I'm having issues acceding the certificates when SELinux is enabled, although selinux doesn't complain -.-. I'm wondering if the way the files are shared isn't an issue. | 05:07 |
| *** janki has joined #tripleo | 05:09 | |
| *** shyamb has joined #tripleo | 05:12 | |
| *** ramishra has quit IRC | 05:20 | |
| *** janki has quit IRC | 05:23 | |
| *** Petersingh is now known as Petersingh|afk | 05:28 | |
| *** paramite|clone has joined #tripleo | 05:29 | |
| *** ykarel_ has joined #tripleo | 05:29 | |
| *** Petersingh|afk is now known as Petersingh | 05:30 | |
| *** Petersingh is now known as Petersingh|afk | 05:31 | |
| *** ykarel|away has quit IRC | 05:32 | |
| *** sanjayu__ has joined #tripleo | 05:32 | |
| *** ramishra has joined #tripleo | 05:37 | |
| openstackgerrit | Martin André proposed openstack/tripleo-heat-templates master: Move to openshift-ansible 3.10 https://review.openstack.org/582495 | 05:40 |
| *** ykarel_ is now known as ykarel | 05:53 | |
| *** ykarel_ has joined #tripleo | 05:55 | |
| *** ykarel_ is now known as ykarel|afk | 05:56 | |
| *** ykarel has quit IRC | 05:58 | |
| *** ksambor has joined #tripleo | 06:00 | |
| *** psachin has quit IRC | 06:00 | |
| *** ykarel|afk has quit IRC | 06:01 | |
| *** jbadiapa has joined #tripleo | 06:01 | |
| *** shyamb has quit IRC | 06:03 | |
| *** yprokule has joined #tripleo | 06:04 | |
| *** shyamb has joined #tripleo | 06:04 | |
| *** Petersingh|afk is now known as Petersingh | 06:05 | |
| *** rdopiera has joined #tripleo | 06:11 | |
| *** sri_ has joined #tripleo | 06:14 | |
| *** paramite|clone has quit IRC | 06:16 | |
| *** sri_ has quit IRC | 06:18 | |
| *** sri_ has joined #tripleo | 06:18 | |
| *** holser_ has joined #tripleo | 06:20 | |
| *** apetrich has joined #tripleo | 06:24 | |
| *** shyamb has quit IRC | 06:27 | |
| *** shyamb has joined #tripleo | 06:27 | |
| *** janki has joined #tripleo | 06:27 | |
| *** holser_ has quit IRC | 06:29 | |
| *** shyamb has quit IRC | 06:36 | |
| *** akrivoka has joined #tripleo | 06:41 | |
| *** shyamb has joined #tripleo | 06:41 | |
| *** ccamacho has joined #tripleo | 06:43 | |
| *** ccamacho has quit IRC | 06:44 | |
| openstackgerrit | Jose Luis Franco proposed openstack/tripleo-heat-templates stable/queens: DNM: Test Gnocchi Upgrades P->Q. https://review.openstack.org/565231 | 06:51 |
| openstackgerrit | Jose Luis Franco proposed openstack/tripleo-upgrade stable/queens: DNM: Test pike->queens upgrades. https://review.openstack.org/563616 | 06:51 |
| *** ccamacho has joined #tripleo | 06:52 | |
| *** aufi has joined #tripleo | 06:54 | |
| *** dxiri has joined #tripleo | 06:56 | |
| *** ccamacho has quit IRC | 06:57 | |
| *** ccamacho has joined #tripleo | 06:58 | |
| *** sanjayu__ is now known as saneax | 06:59 | |
| *** rcernin has quit IRC | 07:00 | |
| *** jfrancoa has joined #tripleo | 07:12 | |
| *** shyamb has quit IRC | 07:12 | |
| *** shardy has joined #tripleo | 07:16 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/tripleo-ui master: Imported Translations from Zanata https://review.openstack.org/597404 | 07:17 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/tripleo-ui stable/rocky: Imported Translations from Zanata https://review.openstack.org/598471 | 07:17 |
| *** shyamb has joined #tripleo | 07:19 | |
| *** pcaruana has joined #tripleo | 07:19 | |
| *** dmacpher has quit IRC | 07:19 | |
| *** janki has quit IRC | 07:25 | |
| shyamb | Hi | 07:26 |
| shyamb | I want to define network for my service | 07:26 |
| *** holser_ has joined #tripleo | 07:29 | |
| *** holser_ has quit IRC | 07:30 | |
| *** holser_ has joined #tripleo | 07:30 | |
| *** jpena|off is now known as jpena | 07:31 | |
| *** shardy_ has joined #tripleo | 07:31 | |
| *** janki has joined #tripleo | 07:32 | |
| shyamb | Can I do it in my heat env file | 07:32 |
| shyamb | or I need to use NetMapDefaults? | 07:32 |
| Tengu | jaosorior: I think I have the root cause of my issues : broken symlink due to the way we share the pki content in the containers. I'm still trying things, but I'm pretty sure this is the root cause. | 07:33 |
| *** shardy has quit IRC | 07:34 | |
| Tengu | shyamb: I think you can do that in your custom env file, there are some examples in the doc for that. | 07:34 |
| shyamb | Tengu: Ok | 07:37 |
| shyamb | I have 'ServiceNetMap' this variable in my end file | 07:37 |
| shyamb | This take dictionary as input | 07:38 |
| shyamb | So do I need to mention networks for all services here? | 07:38 |
| shyamb | Tengu: Because it mentions that this is going to override NetMapDefaults | 07:38 |
| Tengu | yup | 07:39 |
| shardy_ | shyamb: no you only need to pass the values that differ from the ServiceNetMapDefaults | 07:39 |
| shardy_ | unless it's a pretty old release | 07:39 |
| *** shardy_ is now known as shardy | 07:39 | |
| Tengu | shyamb: ah, it's a merge? | 07:39 |
| Tengu | shardy: -^ (sorry) | 07:40 |
| shardy | Tengu: yes, sec let me find a link | 07:40 |
| shyamb | shardy: Tengu: That's good | 07:40 |
| Tengu | there's also https://docs.openstack.org/tripleo-docs/latest/install/advanced_deployment/network_isolation.html#create-network-environment-file maybe? | 07:40 |
| *** sri_ has quit IRC | 07:41 | |
| shyamb | What if I just use nova_api network for my service? | 07:41 |
| *** srini_ has joined #tripleo | 07:41 | |
| shardy | https://github.com/openstack/tripleo-heat-templates/blob/master/network/service_net_map.j2.yaml#L130 | 07:41 |
| shardy | shyamb: if you're adding a new service you should create a new ServiceNetMap entry for it | 07:41 |
| shyamb | hmm ok | 07:41 |
| *** jpich has joined #tripleo | 07:41 | |
| shardy | https://github.com/openstack/tripleo-heat-templates/blob/master/network/service_net_map.j2.yaml#L22 | 07:42 |
| shardy | the defaults are defined there | 07:42 |
| shardy | and you can add or override values via ServiceNetMap | 07:42 |
| shardy | Tengu: I think you mean https://docs.openstack.org/tripleo-docs/latest/install/advanced_deployment/network_isolation.html#assigning-openstack-services-to-isolated-networks ? | 07:44 |
| shardy | that needs an update, I'll push a patch | 07:44 |
| openstackgerrit | Olivier Bourdon proposed openstack/diskimage-builder master: Fix CentOS image build failure when dib runs on debian based system https://review.openstack.org/559485 | 07:45 |
| shyamb | shardy: thanks a lot | 07:45 |
| shyamb | shardy: Tengu: Added entry in my custom env file | 07:46 |
| shyamb | http://paste.openstack.org/show/729213/ | 07:46 |
| shyamb | pls have a look | 07:46 |
| Tengu | jaosorior: I think I get the root cause now: http://paste.openstack.org/show/729214/ | 07:47 |
| Tengu | files don't have correct permissions. Like, nothing. Directories are OK though. | 07:48 |
| shardy | shyamb: that's Ok, or if the patch will merge to t-h-t you can add it to ServiceNetMapDefaults | 07:48 |
| shardy | shyamb: what is the service_name in the service template? | 07:48 |
| shardy | we convert e.g TrilioDatamoverApiNetwork to trilio_datamover_api_network internally, so the name should match, e.g trilio_datamover_api | 07:49 |
| *** Petersingh is now known as Petersingh|lunch | 07:49 | |
| shyamb | shardy: It's "trilio_datamover_api" | 07:49 |
| shardy | shyamb: ack should work fine then I think | 07:49 |
| Tengu | shardy: ah, thanks for the correct link :). and coming patch :). | 07:50 |
| shardy | Hmm rdocloud is back but vbmc is failing to start during a quickstart run | 07:54 |
| *** jchhatbar has joined #tripleo | 07:55 | |
| *** shyamb has quit IRC | 07:55 | |
| *** janki has quit IRC | 07:57 | |
| *** florianf has joined #tripleo | 07:58 | |
| *** dbecker has quit IRC | 08:04 | |
| *** dbecker has joined #tripleo | 08:05 | |
| *** paramite|clone has joined #tripleo | 08:06 | |
| cgoncalves | shardy, I also started getting into that vbmc issue yesterday but on my local machine | 08:10 |
| cgoncalves | so I wonder if it is rdo or something else | 08:11 |
| cgoncalves | shardy, http://paste.openstack.org/show/729215/ | 08:11 |
| jaosorior | Tengu: the entire /etc/pki wasn't mounted as-is, cause we don't want the contianers to have access to all the certs, only their own (and the trusted chain, so they trust the same certs) | 08:13 |
| jaosorior | Tengu: might be a broken link issue yeah :O | 08:13 |
| jaosorior | Tengu: if my responses are delayed is cause I've been sleeping most of the day, had a fever yesterday and today I'm not feeling too good either :/ | 08:13 |
| openstackgerrit | Tobias Urdin proposed openstack/puppet-tripleo master: Move zuul config to repo https://review.openstack.org/598494 | 08:16 |
| Tengu | jaosorior: ah, no problem | 08:18 |
| Tengu | jaosorior: fact is, mounting the /etc/pki altogether doesn't correct anything. | 08:18 |
| Tengu | it's really weird. | 08:18 |
| jaosorior | Tengu: you can keep pinging me and i'll check it out, but I might be a bit slow. | 08:18 |
| Tengu | jaosorior: no problem - still digging into that. | 08:18 |
| jaosorior | Tengu: that's why I wanted to bind-mount only the directories that are needed. | 08:18 |
| Tengu | jaosorior: fair enough. but still.... mounted things aren't properly usable. Have to find out what's happening. | 08:19 |
| Tengu | but seeing this might provide some help: Aug 31 08:19:54 undercloud75 kernel: SELinux: mount invalid. Same superblock, different security settings for (dev mqueue, type mqueue) | 08:20 |
| Tengu | maybe we lack a "shared" flag. | 08:20 |
| jaosorior | Tengu: which, "z" ? | 08:20 |
| jaosorior | ah wait | 08:20 |
| jaosorior | litereally "shared" | 08:20 |
| Tengu | yep | 08:20 |
| jaosorior | let me read up on what that does | 08:20 |
| Tengu | as /etc can't be re-labelled | 08:20 |
| *** srini_ has quit IRC | 08:20 | |
| jaosorior | abd shouldn't | 08:20 |
| jaosorior | we would break other applications | 08:21 |
| Tengu | it should allow mounting volume in multiple containers | 08:21 |
| *** srini_ has joined #tripleo | 08:21 | |
| Tengu | damn. still not good. | 08:21 |
| jaosorior | Tengu: got docs for the shared flag? | 08:21 |
| jaosorior | aaaah you tried it and it didn't work? | 08:21 |
| Tengu | yeah. still looping on my vagrant box ;) | 08:21 |
| Tengu | I basically tried this: '--volume', '/etc/pki:/etc/pki:ro,shared' | 08:22 |
| Tengu | but nope. | 08:22 |
| jaosorior | Tengu: what about rshared? | 08:22 |
| Tengu | hu? | 08:22 |
| jaosorior | Tengu: https://docs.docker.com/storage/bind-mounts/#configure-bind-propagation | 08:22 |
| Tengu | hmm. | 08:23 |
| Tengu | or maybe slave/rslave. | 08:23 |
| Tengu | IF it is supported by podman | 08:23 |
| Tengu | let's try rshared. | 08:23 |
| jaosorior | I don't think these are the options we're looking for | 08:24 |
| jaosorior | Tengu: "Bind propagation refers to whether or not mounts created within a given bind-mount or named volume can be propagated to replicas of that mount' | 08:24 |
| Tengu | hmm. | 08:26 |
| Tengu | jaosorior: did you see the paste I showed earlier? | 08:26 |
| Tengu | the permissions are broken on the files, I get "???" for both perms and selinux.. | 08:26 |
| Tengu | jaosorior: I'm wondering if we shouldn't copy the pki thing in a volume, chcon, and mount that volume. | 08:31 |
| Tengu | that would make a bit more work, but at least we can do whatever we want. | 08:31 |
| Tengu | jaosorior: aha! https://danwalsh.livejournal.com/78940.html | 08:34 |
| Tengu | some reading by SELinux Master | 08:34 |
| Tengu | jaosorior: so probably missing --security-opt label:disable for the init. | 08:35 |
| Tengu | will give it a try. | 08:35 |
| openstackgerrit | Tobias Urdin proposed openstack/puppet-pacemaker master: Move zuul config to repo https://review.openstack.org/598540 | 08:35 |
| jaosorior | Tengu: security-opt disables disables docker/podman enforcing selinux rules for that container | 08:36 |
| Tengu | I know. | 08:36 |
| Tengu | I want to check what's going on first. | 08:37 |
| jaosorior | Tengu: I like your idea better of copying the files instead | 08:37 |
| Tengu | apparently there might be some missing things. | 08:37 |
| jaosorior | ok | 08:37 |
| jaosorior | to check maybe this would be a better idea, yeah | 08:37 |
| Tengu | step after step. I want to understand. | 08:37 |
| Tengu | that's apparently the ONLY location with that issue. | 08:37 |
| *** chem has joined #tripleo | 08:41 | |
| *** ykarel has joined #tripleo | 08:43 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Always lowercase role name https://review.openstack.org/597722 | 08:43 |
| openstackgerrit | Tobias Urdin proposed openstack/puppet-tripleo master: Move zuul config to repo https://review.openstack.org/598559 | 08:45 |
| *** Petersingh|lunch is now known as Petersingh | 08:47 | |
| openstackgerrit | Pranali Deore proposed openstack/tripleo-heat-templates master: Pass image import conf file to command which runs glance server https://review.openstack.org/598560 | 08:50 |
| *** shyamb has joined #tripleo | 08:51 | |
| *** dtantsur|afk is now known as dtantsur | 09:07 | |
| openstackgerrit | Pranali Deore proposed openstack/tripleo-heat-templates master: Pass image import conf file to command which runs glance server https://review.openstack.org/598560 | 09:07 |
| *** ramishra has quit IRC | 09:13 | |
| *** dbecker has quit IRC | 09:14 | |
| openstackgerrit | Harald Jensås proposed openstack/tripleo-heat-templates master: L3 routed networks - data + env (1/4) https://review.openstack.org/582180 | 09:16 |
| shyamb | Hi | 09:17 |
| shyamb | I want to add my service to haproxy | 09:17 |
| shyamb | during deployment | 09:17 |
| *** dbecker has joined #tripleo | 09:17 | |
| shyamb | For that I need to call this puppet class: http://paste.openstack.org/show/729216/ | 09:17 |
| shyamb | At what stage this is supposed to be called? | 09:17 |
| shyamb | step* | 09:18 |
| shyamb | can I call it directly from heat service template? | 09:18 |
| shyamb | under puppet_config's step_config section? | 09:19 |
| jaosorior | shyamb: so that one's tricky, because you ideally need to add that to the haproxy manfiest, or make sure that that runs on the same container that generates the haproxy configuration. An alternative is to use this interface https://github.com/openstack/puppet-tripleo/blob/master/manifests/haproxy.pp#L885 | 09:22 |
| jaosorior | which calls this https://github.com/openstack/puppet-tripleo/blob/master/manifests/haproxy/service_endpoints.pp | 09:23 |
| jaosorior | so, it allows you to specify hieradata for your service | 09:23 |
| jaosorior | so, you would add it in hieradata with the following key | 09:23 |
| jaosorior | tripleo.<service name>.haproxy_endpoints | 09:24 |
| shyamb | jaosorior: yeah, I want avoid haproxy.pp changes | 09:24 |
| jaosorior | shyamb: right, what I'm suggesting doesn't require to do haproxy.pp changes | 09:24 |
| jaosorior | it's all via hieradata | 09:24 |
| Tengu | jaosorior: well.... "2018-08-31 09:23:41,348 ERROR: 11597 -- Invalid --security-opt 1: \"label:disable\"", | 09:24 |
| shyamb | ok | 09:24 |
| * Tengu headbanging his desk | 09:25 | |
| shyamb | jaosorior: Thanks, let me check this | 09:25 |
| jaosorior | Tengu: you had used this resource at some point, right? https://github.com/openstack/puppet-tripleo/blob/master/manifests/haproxy/service_endpoints.pp | 09:25 |
| Tengu | jaosorior: it's probably included yep | 09:25 |
| Tengu | but that doesn't really explain the issue I have with the whole pki directory :( | 09:26 |
| jaosorior | Tengu: it is included, was just wondernig if you had some points on how to use that, for shyamb | 09:26 |
| Tengu | jaosorior: ah, nope, sorry. best thing to do is to check what the tripleo::haproxy::userlist and ::endpoint do | 09:26 |
| jaosorior | shyamb: ^^ | 09:27 |
| Tengu | hmm. the userlist might be me in fact XD. In order to provide authentication. | 09:27 |
| *** moshele has joined #tripleo | 09:27 | |
| jaosorior | Tengu: it was you :D | 09:27 |
| shyamb | ok | 09:27 |
| jaosorior | Tengu: anyway... back to your issue | 09:27 |
| jaosorior | it should have been --security-opt label:disable .... at least that works in docker | 09:27 |
| shyamb | userlist is something I am seeing new | 09:27 |
| jaosorior | might be some issue in podman then :( | 09:28 |
| shyamb | why we need that class here? | 09:28 |
| openstackgerrit | Martin André proposed openstack/tripleo-quickstart master: Switch featuresets to workflow driven image prepare https://review.openstack.org/598574 | 09:28 |
| shyamb | I am following this article http://tripleo.org/install/developer/tht_walkthrough/tls_for_services.html | 09:28 |
| shyamb | jaosorior: So , to use this endpoints class, can I call this from heat template? | 09:29 |
| Tengu | shyamb: userlist allows to create authenticated services - I added that because there were some usecases, like exposing a prometheus exporter behind haproxy in order to take profit of the TLS endpoint, and it's better to put some authentication on that service. | 09:29 |
| shyamb | ok | 09:30 |
| jaosorior | shyamb: you might not need it, but it's something good to know in case you do | 09:30 |
| jaosorior | but no, you wouldn't call the class, you would just add it to your service's hieradata | 09:30 |
| openstackgerrit | Martin André proposed openstack/tripleo-quickstart master: Switch featuresets to workflow driven image prepare https://review.openstack.org/598574 | 09:31 |
| openstackgerrit | Martin André proposed openstack/tripleo-quickstart master: WIP: Testing atomic package from virt-sig https://review.openstack.org/598190 | 09:31 |
| openstackgerrit | Martin André proposed openstack/tripleo-quickstart master: Revert "Revert "Move to openshift-ansible 3.10"" https://review.openstack.org/589469 | 09:31 |
| shyamb | jaosorior: ok, I need to first get a working stable code for ha+ssl | 09:31 |
| shyamb | :D | 09:31 |
| shyamb | thanks jaosorior and Tengu | 09:32 |
| shyamb | I will try to call this endpoints class from my step_config | 09:32 |
| shyamb | I am not sure at which step it will get called during deployment | 09:32 |
| Tengu | https://github.com/containers/libpod/blob/462c503a4762a0f20023d937a5fb05a55d4183a3/cmd/podman/parse.go#L528 so. "label:disable" doesn't appear to be a supported option.. or am I misreading? | 09:33 |
| *** ykarel is now known as ykarel|lunch | 09:33 | |
| *** hamzy_ has joined #tripleo | 09:37 | |
| *** hamzy has quit IRC | 09:37 | |
| *** shyamb has quit IRC | 09:37 | |
| *** two_oes has joined #tripleo | 09:38 | |
| openstackgerrit | Sergii Golovatiuk proposed openstack/tripleo-heat-templates stable/rocky: Always lowercase role name https://review.openstack.org/598578 | 09:38 |
| *** aufi has quit IRC | 09:38 | |
| Tengu | raaahhh | 09:39 |
| Tengu | jaosorior: podman $PODMANBASE run --security-opt label=disable alpine so great, not compatible with docker syntaxe apparently. | 09:39 |
| *** Petersingh is now known as Petersingh|afk | 09:43 | |
| *** ramishra has joined #tripleo | 09:48 | |
| *** Petersingh|afk is now known as Petersingh | 09:52 | |
| *** Petersingh is now known as Petersingh|afk | 09:54 | |
| *** ykarel|lunch is now known as ykarel | 09:58 | |
| -openstackstatus- NOTICE: Jobs using devstack-gate (legacy devstack jobs) have been failing due to an ara update. We use now a newer ansible version, it's safe to recheck if you see "ImportError: No module named manager" in the logs. | 09:58 | |
| openstackgerrit | Sergii Golovatiuk proposed openstack/tripleo-heat-templates stable/queens: Always lowercase role name https://review.openstack.org/598587 | 10:05 |
| *** shyamb has joined #tripleo | 10:05 | |
| shyamb | Hi | 10:06 |
| openstackgerrit | Sergii Golovatiuk proposed openstack/tripleo-heat-templates stable/pike: Always lowercase role name https://review.openstack.org/598588 | 10:07 |
| openstackgerrit | Sergii Golovatiuk proposed openstack/tripleo-heat-templates stable/ocata: Always lowercase role name https://review.openstack.org/598589 | 10:08 |
| *** moshele has quit IRC | 10:09 | |
| *** Petersingh|afk has quit IRC | 10:09 | |
| Tengu | jaosorior: so, disabling labels make access to /etc/pki work. But other things fails. so not the right solution. | 10:10 |
| Tengu | jaosorior: guess copying all certificates and creating new ones in a volume (being docker or podman) is the right thing to do, but will take longer. | 10:11 |
| shyamb | Tengu: What is the format for "tripleo::${underscore_name}::haproxy_endpoints" | 10:14 |
| shyamb | hiera | 10:14 |
| Tengu | shyamb: I'd say a hash with the same keys/info than this definition: https://github.com/openstack/puppet-tripleo/blob/master/manifests/haproxy/endpoint.pp | 10:15 |
| shyamb | ok | 10:15 |
| *** skramaja has quit IRC | 10:18 | |
| shyamb | Tengu: Hi | 10:21 |
| shyamb | Do you have any example? | 10:21 |
| shyamb | of any third party module that used this approach? | 10:21 |
| *** shyamb has quit IRC | 10:23 | |
| *** shyamb has joined #tripleo | 10:23 | |
| Tengu | shyamb: not anymore - I did investigate that in order to provide the userlist patch, but that was "some times ago", and I don't remember. | 10:25 |
| shyamb | ok | 10:25 |
| shyamb | I see we are call service endpoints from haproxy.pp | 10:26 |
| shyamb | https://github.com/openstack/puppet-tripleo/blob/master/manifests/haproxy.pp#L885 | 10:26 |
| shyamb | and then we are calling endpoint again | 10:26 |
| shyamb | why we need to call two times? | 10:26 |
| *** ramishra has quit IRC | 10:27 | |
| shyamb | service endpoints eventually calling endpoint class | 10:27 |
| *** ramishra has joined #tripleo | 10:28 | |
| Tengu | there are wrappers. the service_endpoints calls the endpoint itself | 10:28 |
| Tengu | because a service endpoint can actually have multiple endpoints. | 10:29 |
| Tengu | i.e. non-TLS + TLS | 10:29 |
| Tengu | that's two endpoints :). | 10:29 |
| Tengu | but it's grouped under one service_endpoint | 10:29 |
| shyamb | ok | 10:32 |
| shyamb | we are using both approaches from haproxy.pp | 10:34 |
| shyamb | https://github.com/openstack/puppet-tripleo/blob/master/manifests/haproxy.pp#L905 | 10:34 |
| Tengu | probably because of specific options, and probably because "we" don't want to see them overridden wildly. | 10:36 |
| *** lvdombrkr has joined #tripleo | 10:36 | |
| *** Petersingh|afk has joined #tripleo | 10:38 | |
| Tengu | shyamb: https://github.com/openstack/puppet-tripleo/commit/9d438cd1426ba8de92d5bb04402b7cbbc450cb7a#diff-2dacdcedc9f99ac2eb594e8ab7b03b77 | 10:39 |
| Tengu | you have an example here. | 10:39 |
| Tengu | I did it in order to make the unit tests for the userlist. | 10:39 |
| shyamb | ok | 10:40 |
| Tengu | so you have the right way to use that ressource in hiera. | 10:40 |
| *** dsneddon has quit IRC | 10:41 | |
| shyamb | great | 10:42 |
| *** Petersingh_ has joined #tripleo | 10:42 | |
| shyamb | Tengu: Thanks | 10:42 |
| shyamb | I belive I should be able to skip userlist | 10:42 |
| Tengu | shyamb: as said, that one is only for authentified custom services. | 10:44 |
| Tengu | so yeah, you can drop that - but basically you have a way to create your own custom endpoint. | 10:44 |
| *** Petersingh|afk has quit IRC | 10:44 | |
| shyamb | thanks Tengu | 10:44 |
| Tengu | X( sometimes I just hate ansible.... FAILED! => {"changed": false, "msg": "Remote copy does not support recursive copy of directory: /etc/pki"} | 10:45 |
| *** Petersingh_ is now known as Petersingh|afk | 10:46 | |
| shyamb | Tengu: If I want to define "public_virtual_ip" in my heat service template Can I use hiera there? | 10:47 |
| shyamb | public_virtual_ip | 10:47 |
| shyamb | Under step config? | 10:48 |
| *** cgoncalves has quit IRC | 10:48 | |
| shyamb | Or any other place we should define this hash? | 10:48 |
| *** two_oes has quit IRC | 10:50 | |
| *** cgoncalves has joined #tripleo | 10:50 | |
| *** leanderthal has joined #tripleo | 10:51 | |
| *** ykarel_ has joined #tripleo | 10:52 | |
| *** ykarel has quit IRC | 10:53 | |
| *** shyamb has quit IRC | 10:57 | |
| *** aufi has joined #tripleo | 11:03 | |
| openstackgerrit | Harry Kominos proposed openstack/diskimage-builder master: Fix bootloader packages for aarch64 https://review.openstack.org/598595 | 11:06 |
| *** boazel has joined #tripleo | 11:11 | |
| *** udesale has quit IRC | 11:12 | |
| *** gfidente has joined #tripleo | 11:12 | |
| *** ykarel_ is now known as ykarel|afk | 11:12 | |
| *** ykarel|afk has quit IRC | 11:17 | |
| *** morazi has joined #tripleo | 11:22 | |
| openstackgerrit | Michael Chapman proposed openstack/tripleo-heat-templates master: Add scenario 012 - overlcoud baremetal+ansible-ml2 https://review.openstack.org/579603 | 11:27 |
| *** jpena is now known as jpena|lunch | 11:28 | |
| *** Petersingh|afk is now known as Petersingh | 11:33 | |
| *** shyamb has joined #tripleo | 11:33 | |
| *** fultonj has joined #tripleo | 11:33 | |
| shyamb | owalsh: You there? | 11:33 |
| owalsh | shyamb: yea | 11:33 |
| shyamb | owalsh: Can we have a short meeting to discuss haproxy progress? | 11:37 |
| *** dbecker has quit IRC | 11:38 | |
| owalsh | shyamb: just scrolling back... not sure if I'll be any help here | 11:38 |
| shyamb | ok | 11:39 |
| *** ykarel has joined #tripleo | 11:40 | |
| owalsh | shyamb: ok, hiera goes in config_settings | 11:41 |
| shyamb | yeah, but I am not able to connect all the pieces | 11:42 |
| *** saneax has quit IRC | 11:42 | |
| owalsh | shyamb: step_config is a puppet, usually just includes other puppet manifest | 11:42 |
| owalsh | is a puppet manifest | 11:42 |
| shyamb | then how an we call service endpoints with service name? | 11:43 |
| shyamb | I think include does not support arguments | 11:43 |
| shyamb | tripleo::haproxy::service_endpoints { $service_names: } | 11:43 |
| shyamb | tripleo::haproxy::service_endpoints { trilio_datamover_api: } | 11:44 |
| Tengu | shyamb: you just need to add hiera entries in config_settings, puppet will take care of the rest | 11:45 |
| owalsh | shyamb: expect you could have ::tripleo::haproxy::endpoint { 'service_name': ... in step_config | 11:45 |
| Tengu | the endpoint will be created as long as it's properly named so that the create_resource() can kick in | 11:45 |
| owalsh | or that ^^^ | 11:45 |
| Tengu | (and I'd rather go with the hiera thingy) | 11:46 |
| shyamb | ok | 11:49 |
| shyamb | let me show you what I have | 11:50 |
| shyamb | http://paste.openstack.org/show/729227/ | 11:52 |
| shyamb | This is hiera I prepared | 11:52 |
| shyamb | Other than port information, I don't know how to get other settings | 11:52 |
| shyamb | like public ip, internale ip | 11:52 |
| shyamb | Can you help me with it? | 11:52 |
| shyamb | owalsh: | 11:52 |
| Tengu | shyamb: indentation is broken - but have a look at the example I gave you from the unit tests. | 11:52 |
| shyamb | sure, I will take care of indetation | 11:53 |
| shyamb | Let me know how to get values of parameters | 11:53 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: Initial support for Podman in docker-puppet https://review.openstack.org/588655 | 11:55 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: docker-puppet: don't force FACTER_hostname https://review.openstack.org/595274 | 11:55 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: rabbit: do not mount /etc/rabbitmq in RO https://review.openstack.org/598327 | 11:55 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: DNM - test podman https://review.openstack.org/590587 | 11:56 |
| openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-quickstart-extras master: WIP: Track ansible overcloud deployment with ARA https://review.openstack.org/597222 | 11:58 |
| *** ramishra has quit IRC | 11:58 | |
| *** dprince has joined #tripleo | 11:59 | |
| *** gkadam has quit IRC | 12:00 | |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-quickstart master: Enable virt7-container-common-candidate repo starting in Stein https://review.openstack.org/592079 | 12:01 |
| *** tonyb has quit IRC | 12:02 | |
| shyamb | owalsh: Tengu: Any ideas? | 12:03 |
| shyamb | Can I use hiera here to get public ip? | 12:03 |
| shyamb | or any other way? | 12:03 |
| *** moguimar has joined #tripleo | 12:04 | |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: DNM - test podman https://review.openstack.org/590587 | 12:04 |
| *** dsneddon has joined #tripleo | 12:06 | |
| *** raildo has joined #tripleo | 12:06 | |
| *** lblanchard has joined #tripleo | 12:07 | |
| *** trown|outtypewww is now known as trown | 12:07 | |
| *** shyamb has quit IRC | 12:08 | |
| Tengu | shardy: not sure you have to pass the public IP. | 12:08 |
| *** shyamb has joined #tripleo | 12:08 | |
| *** rh-jelabarre has quit IRC | 12:08 | |
| trown | mandre: I was able to get my 3.10 to deploy by retagging the images as latest, so your latest patchset seems like it could get us all the way there | 12:08 |
| trown | mandre: going to try it out | 12:08 |
| Tengu | shyamb: not sure you have to pass the public IP. (sorry shardy - wrong HL -.-') | 12:09 |
| shardy | shyamb, Tengu: The EndpointMap gives you all the endpoints for every service | 12:09 |
| shardy | shyamb: do you need the IP to access the service, or the per-node bind IP? | 12:09 |
| trown | mandre: iiuc the issue was that we were stripping the tag with that yaql expression, so then it defaults to looking for :latest | 12:10 |
| mandre | trown: yeah they've changed the meaning of osm_image and osn_image in openshift-ansible, previously it would inherit the tag from openshift_image_tag, now you need to explicitly pass the tag in the image name | 12:11 |
| shyamb | I need haproxy frontend ip and backend ip for my service | 12:11 |
| shyamb | shardy: | 12:11 |
| shardy | shyamb: Ok EndpointMap gives you the frontend IP (e.g the VIP, there's one for each network) | 12:12 |
| shardy | and ServiceNetMap is used to give you the bind IP, e.g the per-node backend IP | 12:12 |
| * shardy finds examples | 12:12 | |
| shardy | https://github.com/openstack/tripleo-heat-templates/blob/master/puppet/services/nova-api.yaml#L161 | 12:13 |
| trown | mandre: ah makes sense... I did have an older version of 3.10 working ... I guess redefining what a key variable means doesnt constitute a major version bump :p | 12:13 |
| shardy | example of nova referencing the keystone endpoint | 12:13 |
| shardy | shyamb: https://github.com/openstack/tripleo-heat-templates/blob/master/puppet/services/nova-api.yaml#L181..L186 | 12:13 |
| shardy | example of the backend bind IP | 12:13 |
| shardy | that is accessible via hiera, but you need to select the network for the service via ServiceNetMap | 12:14 |
| shardy | so we str_replace before writing the hiera key | 12:14 |
| *** ansmith has joined #tripleo | 12:15 | |
| shyamb | shardy: let me check | 12:15 |
| shyamb | shardy: Do you have a clear example of how to construct hiera for tripleo::haproxy::service_endpoints { $service_names: } | 12:17 |
| trown | mandre: the job that failed... it skipped running the prep containers. no idea why yet though | 12:18 |
| mandre | trown: this is because we've switched to the workflow driven image prepare, see https://review.openstack.org/#/c/598574/ | 12:19 |
| shyamb | shardy: This class is created for composable roles | 12:19 |
| *** tonyb has joined #tripleo | 12:19 | |
| shyamb | and I don't get why we don't have some good examples | 12:19 |
| shyamb | I am struggling to get this simple information | 12:19 |
| mandre | trown: scenario009 successful on ^^ | 12:19 |
| shyamb | Most of third party plugins/services are going to use this class to register endpoint in haproxy | 12:20 |
| shyamb | we should have some article or readme about it | 12:20 |
| mandre | trown: actually, we also got the scenario009 green with 3.10 in https://review.openstack.org/#/c/582495/ :) | 12:21 |
| trown | mandre: nice! | 12:21 |
| shardy | shyamb: the docs can probably be improved, but there are many examples of existing templates | 12:21 |
| shardy | the pattern in mostly the same in all of them | 12:21 |
| trown | mandre: oh ya that is what I thought you were talking about. I saw it green on the main patch. | 12:22 |
| trown | mandre: I guess we need to figure out this atomic package thing, and we are good to go | 12:22 |
| shyamb | shardy: I got the pattern, look at my code here : https://github.com/trilioData/triliovault-cfg-scripts/blob/master/redhat-director-scripts/docker/services/trilio-dmapi.yaml | 12:22 |
| *** jpena|lunch is now known as jpena | 12:23 | |
| shyamb | But for this particular case, I am not able to fetch the correct information | 12:23 |
| mandre | trown: pep8 is not happy with how I changed the default for OpenShiftWorkerInfra in the infra service, I'll need to change that | 12:23 |
| shardy | shyamb: which information are you missing? | 12:23 |
| shyamb | shardy: I need this information: http://paste.openstack.org/show/729227/ | 12:24 |
| shardy | shyamb: are you aiming to add this to t-h-t btw? | 12:24 |
| mandre | trown: I'm thinking we should split the 3.10 and infra role patches, there's more work needed on the infra role patch to do things correctly | 12:24 |
| shardy | shyamb: I just showed how to get the virtual IP and the internal IP, and there are per-network list for the ip lists and names | 12:25 |
| shardy | already in hieradata | 12:25 |
| * shardy finds another link | 12:25 | |
| trown | mandre: I thought we needed the infra stuff to make 3.10 work? | 12:26 |
| shardy | shyamb: try e.g "%{hiera('tvault_datamover_api_ips')}, but note you should use _ not - in the service_name, and also tvault may not work unless you use the same abbreviation in ServiceNetMap | 12:27 |
| shyamb | yeah, I changed it in my latest code | 12:29 |
| shardy | https://github.com/openstack/tripleo-heat-templates/blob/master/overcloud.j2.yaml#L705..L737 | 12:29 |
| shyamb | this will give me public virtual ip? https://github.com/openstack/tripleo-heat-templates/blob/master/puppet/services/nova-api.yaml#L181..L186 | 12:29 |
| shardy | shyamb: ack, if you look at a deployment you'll see the hiera output from that, it basically generates service_name_ips for every service | 12:29 |
| shardy | and similar lists for the names and bootstrap node | 12:29 |
| shardy | shyamb: No, the EndpointMap will give you the VIP, you can get the public endpoint for whatever the service is | 12:30 |
| trown | mandre: asking about what to do about that unmirrored cbs repo on #rdo, but I guess worst case we can just add it only to the openshift featureset | 12:30 |
| shardy | shyamb: we also generate service_name_vip based on the ServiceNetMap entry | 12:31 |
| shardy | https://github.com/openstack/tripleo-heat-templates/blob/master/puppet/all-nodes-config.j2.yaml#L182 | 12:31 |
| shyamb | shardy: from code, I am not getting clear idea, on how this is retriving | 12:31 |
| shyamb | VIP | 12:31 |
| shardy | shyamb: so most of the data you need is auto-generated and already in the hieradata | 12:31 |
| shardy | shyamb: Ok, do you have an existing deployment? | 12:31 |
| openstackgerrit | Harald Jensås proposed openstack/tripleo-heat-templates master: L3 routed networks - network.j2 (2/4) https://review.openstack.org/582181 | 12:32 |
| shardy | sometimes looking at the hieradata is easier | 12:32 |
| shyamb | yeah, I have it | 12:32 |
| shyamb | I like this way http://tripleo.org/install/developer/tht_walkthrough/tls_for_services.html | 12:32 |
| shyamb | but this will need change in haproxy.pp | 12:32 |
| shyamb | this article has clearly mentioned everything | 12:32 |
| shardy | shyamb: ack, it may be worth checking with jaosorior as IIRC the haproxy endpoints are composable now, so you may be able to avoid a change to puppet-tripleo | 12:34 |
| shardy | there's a lot of good info in that tht_walkthrough but some of it is probably due an update | 12:34 |
| shyamb | yeah | 12:34 |
| openstackgerrit | Chuck Short proposed openstack/tripleo-common master: add python 3.6 unit test job https://review.openstack.org/597772 | 12:34 |
| shyamb | if jaosorior: can help me here, it will be great | 12:35 |
| shyamb | It's EOD for me | 12:35 |
| palkar | Hi | 12:35 |
| shardy | shyamb: in the meantime try checking /etc/puppet/hieradata and grep for your service name | 12:35 |
| shyamb | ok | 12:35 |
| shardy | you'll hopefully see what I mean about the auto-generated hieradata | 12:35 |
| *** shardy has quit IRC | 12:35 | |
| shyamb | sure shardy | 12:36 |
| shyamb | thanks a lot | 12:36 |
| shyamb | jaosorior: If you have some free time, let me know | 12:36 |
| shyamb | we can have a quick talk | 12:36 |
| *** rlandy has joined #tripleo | 12:40 | |
| *** shyamb has quit IRC | 12:41 | |
| mandre | trown: we should be able to uncouple the 3.10 and infra role changes, i'm testing locally | 12:47 |
| openstackgerrit | John Trowbridge proposed openstack/tripleo-quickstart master: Use atomic package from virt-sig for openshift job https://review.openstack.org/598190 | 12:49 |
| openstackgerrit | John Trowbridge proposed openstack/tripleo-quickstart master: Revert "Revert "Move to openshift-ansible 3.10"" https://review.openstack.org/589469 | 12:50 |
| *** Petersingh has quit IRC | 12:51 | |
| trown | mandre: cool, I reworked the fix for the atomic package to only affect our job ^, I think we can go with that safely while waiting on a different better solution | 12:51 |
| *** thrash|g0ne is now known as thrash | 12:52 | |
| *** EmilienM is now known as EvilienM | 12:57 | |
| honza | jistr: thank you for your helpful email <3 | 13:00 |
| jistr | honza: sure thing, i'm glad it was helpful :) | 13:00 |
| *** ansmith has quit IRC | 13:01 | |
| *** elmaciej has joined #tripleo | 13:01 | |
| *** elmaciej has quit IRC | 13:01 | |
| *** tosky has joined #tripleo | 13:02 | |
| *** jcoufal has joined #tripleo | 13:02 | |
| *** Hazelesque has quit IRC | 13:03 | |
| *** ansmith has joined #tripleo | 13:06 | |
| *** Hazelesque has joined #tripleo | 13:10 | |
| *** mjturek has joined #tripleo | 13:19 | |
| *** salmankhan has joined #tripleo | 13:23 | |
| *** salmankhan has quit IRC | 13:27 | |
| *** dtrainor has quit IRC | 13:28 | |
| lyarwood | owalsh: https://bugs.launchpad.net/tripleo/+bug/1789392/comments/4 - this came up during triage downstream right? | 13:29 |
| openstack | Launchpad bug 1789392 in tripleo "Stop hardcoding OS_BAREMETAL_API_VERSION in stackrc" [Medium,Fix released] - Assigned to Dmitry Tantsur (divius) | 13:29 |
| lyarwood | owalsh: http://codesearch.openstack.org/?q=COMPUTE_API_VERSION&i=nope&files=&repos= - it's not being used right now anyway so yeah we can remove it | 13:29 |
| lyarwood | owalsh: OS_COMPUTE_API_VERSION is the correct thing to use | 13:29 |
| *** bnemec is now known as beekneemech | 13:31 | |
| owalsh | lyarwood: also sets NOVA_VERSION=1.1, any idea why? | 13:32 |
| lyarwood | owalsh: nope | 13:32 |
| lyarwood | owalsh: legacy python-novaclient reasons? | 13:33 |
| owalsh | probably | 13:33 |
| openstackgerrit | Rafael Folco proposed openstack-infra/tripleo-ci master: Move toci BASH variables to ansible https://review.openstack.org/589448 | 13:34 |
| *** colonwq has quit IRC | 13:35 | |
| *** colonwq has joined #tripleo | 13:35 | |
| *** rascasoft is now known as raoh | 13:36 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/rocky: Remove unused config file when start ovs agent https://review.openstack.org/598158 | 13:40 |
| openstackgerrit | Merged openstack/python-tripleoclient master: Updating python-tripleoclient requires to upgrade the containers images repo https://review.openstack.org/596678 | 13:40 |
| rlandy | EvilienM: hi - panda|rover and I are working on removing references to /etc/nodepool/* files to be more zuulv3 native. (see https://review.openstack.org/#/c/596422) . https://github.com/openstack/tripleo-heat-templates/blob/master/ci/common/net-config-multinode-os-net-config.yaml#L136 still refers to those /etc/nodepool files. Is it possible to get this template to use the newer ansible variables? | 13:40 |
| openstackgerrit | Florian Fuchs proposed openstack/tripleo-common master: Fix validation runs in a containerized environment https://review.openstack.org/598958 | 13:44 |
| EvilienM | rlandy: maybe we could read from the ENV directly | 13:45 |
| mwhahaha | rlandy, EvilienM: we'll probably need to do is rewrite the network config and pass that information in elsewhere | 13:45 |
| rlandy | EvilienM: mwhahaha: ok - whatever we can do here would be helpful. The reliance on /etc/nodepool is blocking rdocloud jobs transition away from legacy | 13:48 |
| rlandy | pls let us know what you think is best | 13:48 |
| rlandy | also, the ci templates moved to ttps://github.com/openstack-infra/tripleo-ci/blob/master/heat-templates at one point | 13:49 |
| rlandy | we should pick a consistent location | 13:49 |
| rlandy | panda|rover: ^^ | 13:49 |
| mwhahaha | i think THT was where we wanted to move them to | 13:49 |
| mwhahaha | rather that continuing tripleo-ci | 13:50 |
| EvilienM | +1 for THT, so we can also version it | 13:51 |
| *** raoh is now known as rascasoft | 13:52 | |
| rlandy | fine by me, as long as we have one place to check | 13:52 |
| panda|rover | EvilienM: that value is now provided with a zuul variable. We have that variable, we just have to pass it to you in some way, we can decide its format | 13:54 |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/rocky: Ceph update and upgrade in config-download era https://review.openstack.org/597419 | 13:54 |
| openstackgerrit | Merged openstack/tripleo-ui master: Imported Translations from Zanata https://review.openstack.org/597404 | 13:54 |
| openstackgerrit | Merged openstack/tripleo-ui stable/rocky: Imported Translations from Zanata https://review.openstack.org/598471 | 13:54 |
| rlandy | or if we removed that script and passed the output directly to deploy command | 13:56 |
| *** rh-jelabarre has joined #tripleo | 14:01 | |
| *** gbarros has joined #tripleo | 14:03 | |
| *** myoung has joined #tripleo | 14:06 | |
| rlandy | 2018-08-31 00:38:30 | Error: The following files were not found: /home/zuul/containers-default-parameters.yaml | 14:09 |
| rlandy | ^^ that is not a patch issue - I assume | 14:09 |
| openstackgerrit | David Peacock proposed openstack/tripleo-heat-templates master: python3ification of docker-puppet.py https://review.openstack.org/598234 | 14:09 |
| rlandy | woohoo rdocloud jobs are on the move and working so far :) | 14:10 |
| *** waleedm has joined #tripleo | 14:18 | |
| *** saneax has joined #tripleo | 14:20 | |
| *** rh-jelabarre has quit IRC | 14:22 | |
| *** colonwq has quit IRC | 14:23 | |
| *** sanjayu_ has joined #tripleo | 14:23 | |
| *** links has quit IRC | 14:24 | |
| hamzy_ | hey y'all, my ethernet connections in instances installed via TripleO doesn't work. I seem to see all the bridges and connections setup, but some final qemu hardware connection is broken or missing http://paste.openstack.org/show/729241/ | 14:25 |
| *** hamzy_ is now known as hamzy | 14:26 | |
| *** ykarel is now known as ykarel|away | 14:26 | |
| *** saneax has quit IRC | 14:26 | |
| *** ade_lee has quit IRC | 14:29 | |
| *** rh-jelabarre has joined #tripleo | 14:31 | |
| panda|rover | rlandy: \o/ | 14:32 |
| *** colonwq has joined #tripleo | 14:32 | |
| *** zzzeek has quit IRC | 14:33 | |
| *** zzzeek has joined #tripleo | 14:34 | |
| *** ade_lee has joined #tripleo | 14:36 | |
| *** ksambor has quit IRC | 14:36 | |
| *** sanjayu_ has quit IRC | 14:36 | |
| openstackgerrit | Brent Eagles proposed openstack/tripleo-heat-templates master: DNM: OVN test https://review.openstack.org/593056 | 14:36 |
| *** mjturek has quit IRC | 14:36 | |
| *** dtrainor has joined #tripleo | 14:37 | |
| *** dtrainor has quit IRC | 14:37 | |
| *** moshele has joined #tripleo | 14:38 | |
| *** dtrainor has joined #tripleo | 14:38 | |
| *** dsneddon has quit IRC | 14:39 | |
| *** zzzeek has quit IRC | 14:40 | |
| *** zzzeek has joined #tripleo | 14:42 | |
| *** waleedm has quit IRC | 14:42 | |
| *** jpena is now known as jpena|off | 14:42 | |
| *** jpena|off is now known as jpena | 14:43 | |
| *** jaosorior has quit IRC | 14:43 | |
| openstackgerrit | Jose Luis Franco proposed openstack/tripleo-quickstart master: Set the correct config download settings for queens. https://review.openstack.org/597450 | 14:43 |
| *** mjturek has joined #tripleo | 14:43 | |
| openstackgerrit | Nicolas Hicher proposed openstack/tripleo-quickstart-extras master: DNM: add timeout to debug network issue https://review.openstack.org/598989 | 14:46 |
| *** mjturek has quit IRC | 14:46 | |
| *** zzzeek has quit IRC | 14:46 | |
| *** zzzeek has joined #tripleo | 14:47 | |
| *** mjturek has joined #tripleo | 14:47 | |
| *** dsneddon has joined #tripleo | 14:49 | |
| jistr | sshnaidm|off: looking at http://logs.openstack.org/66/597466/1/check/tripleo-ci-centos-7-containers-multinode/47d358f/logs/undercloud/home/zuul/install-undercloud.log.txt.gz | 14:51 |
| *** hkominos_ has left #tripleo | 14:51 | |
| jistr | sshnaidm|off: your patch worked nice! | 14:51 |
| *** paramite|clone has quit IRC | 14:55 | |
| *** morazi has quit IRC | 14:56 | |
| openstackgerrit | Dmitry Tantsur proposed openstack/tripleo-common master: Workflow for provisioning bare metals without Nova https://review.openstack.org/576856 | 14:58 |
| *** rpioso|afk is now known as rpioso | 14:59 | |
| openstackgerrit | Harry Kominos proposed openstack/diskimage-builder master: Fix bootloader packages for aarch64 https://review.openstack.org/598595 | 15:02 |
| *** boazel has quit IRC | 15:03 | |
| *** myoung is now known as myoung_ | 15:04 | |
| *** yprokule has quit IRC | 15:04 | |
| *** mjturek has quit IRC | 15:05 | |
| dtantsur | Failed to handle action completion [error=Can not evaluate YAQL expression [expression=task().result, error=Task execution not found [id=6ebbe89e-455f-4594-89f6-7cf640917bb7], data={}], wf | 15:05 |
| dtantsur | =tripleo.baremetal_deploy.v1.deploy_instances, task=get_pubkey, action=tripleo.validations.get_pubkey] | 15:05 |
| dtantsur | d0ugal, thrash, any ideas ^^^? | 15:06 |
| dtantsur | it hanged for a few minutes on that action (my patch does not change it), then failed with this | 15:06 |
| *** leanderthal has quit IRC | 15:07 | |
| Tengu | EvilienM: guess what.... Apparently I have something working more or less for an undercloud running on podman with selinux :D | 15:07 |
| *** ykarel|away has quit IRC | 15:08 | |
| Tengu | EvilienM: at least I'm at step 2 with the full stack. | 15:08 |
| EvilienM | nice! | 15:08 |
| EvilienM | I have to but selinux is permissive :P | 15:08 |
| * EvilienM hides | 15:08 | |
| Tengu | tsts | 15:08 |
| Tengu | call me Master ;) | 15:08 |
| Tengu | EvilienM: starting containers for step 3. Suspens! | 15:10 |
| EvilienM | Tengu: I can't wait | 15:10 |
| *** myoung_ has quit IRC | 15:10 | |
| *** ccamacho has quit IRC | 15:12 | |
| *** dxiri has quit IRC | 15:12 | |
| d0ugal | dtantsur: Interesting! I don't think I've seen that one before. | 15:13 |
| Tengu | EvilienM: "failed". but that's weird. "stderr: container create failed: container_linux.go:336: starting container process caused \"setup user: no such file or directory\"", | 15:14 |
| Tengu | thought I had the last build.... ? | 15:14 |
| Tengu | EvilienM: will give a new try next week. Now: weekend. But I'm closer :). | 15:15 |
| EvilienM | Tengu: see ya | 15:15 |
| Tengu | there's also stderr: /usr/lib/python2.7/site-packages/pymysql/cursors.py:166: Warning: (1831, u'Duplicate index `block_device_mapping_instance_uuid_virtual_name_device_name_idx`. This is deprecated and will be disallowed in a future release.') | 15:15 |
| Tengu | anyway. I'm off. | 15:15 |
| fultonj | dtantsur: you might be running into the issues discussed in this review https://review.openstack.org/#/c/588216 | 15:20 |
| d0ugal | dtantsur: I'd be interested to see the logs for that. | 15:20 |
| dtantsur | d0ugal: absolutely nothing interesting in the logs... | 15:21 |
| d0ugal | hm | 15:21 |
| dtantsur | d0ugal: my only suspect is that the executor is slightly newer than other mistral components. could it break things? | 15:23 |
| dr_gogeta86 | good evening | 15:23 |
| dr_gogeta86 | i'm going to stack update in interactive way | 15:23 |
| *** moshele has quit IRC | 15:24 | |
| dr_gogeta86 | is normar it doesn't update the whole machine but just puppet and openstack-nova | 15:24 |
| dr_gogeta86 | Is a compute machine | 15:24 |
| *** mjturek has joined #tripleo | 15:25 | |
| d0ugal | dtantsur: there hasn't been much activity in master yet, assuming that is what you are using. | 15:26 |
| dtantsur | yeah.. then I have no idea | 15:26 |
| *** pcaruana has quit IRC | 15:26 | |
| *** jchhatbar has quit IRC | 15:27 | |
| d0ugal | dtantsur: How much older? | 15:27 |
| openstackgerrit | Ilya Etingof proposed openstack/tripleo-quickstart master: Run VirtualBMC 1.4.0+ as user `stack` https://review.openstack.org/599004 | 15:27 |
| d0ugal | dtantsur: there was a bit change that merged on August 20th | 15:28 |
| d0ugal | One that we wanted in early in the cycle, so it can get a good test and time to flesh out | 15:28 |
| d0ugal | dtantsur: does "mistral task-get 6ebbe89e-455f-4594-89f6-7cf640917bb7" return something? | 15:30 |
| d0ugal | I wonder if somehow the YAQL was executed before the task was commited to the database | 15:30 |
| d0ugal | ... but I'm kinda guessing | 15:30 |
| openstackgerrit | Ilya Etingof proposed openstack/tripleo-quickstart master: Run VirtualBMC 1.4.0+ as user `stack` https://review.openstack.org/599004 | 15:32 |
| openstackgerrit | Merged openstack/tripleo-quickstart-extras master: nodepool-setup: add NODEPOOL_CBS_CENTOS_PROXY https://review.openstack.org/598255 | 15:35 |
| *** moguimar has quit IRC | 15:36 | |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart-extras master: Increase nova db_sync time if defined. https://review.openstack.org/593077 | 15:37 |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart-extras master: Testing adding properties to flavors https://review.openstack.org/579406 | 15:37 |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart-extras master: Increase nova db_sync time if defined. https://review.openstack.org/593077 | 15:38 |
| dtantsur | d0ugal: task-get shows this error | 15:42 |
| dtantsur | (the one I posted above) | 15:42 |
| openstackgerrit | Martin André proposed openstack/tripleo-heat-templates master: Move to openshift-ansible 3.10 https://review.openstack.org/582495 | 15:43 |
| openstackgerrit | Ilya Etingof proposed openstack/tripleo-quickstart master: Run VirtualBMC 1.4.0+ as user `stack` https://review.openstack.org/599004 | 15:44 |
| *** moguimar has joined #tripleo | 15:44 | |
| *** jfrancoa has quit IRC | 15:45 | |
| mandre | trown: if https://review.openstack.org/#/c/582495/ passes CI I think we can merge it -- I'm still working on the templates to make them better suited for composable roles but that will have to go in subsequent commits | 15:46 |
| dr_gogeta86 | anybody | 15:47 |
| dr_gogeta86 | how to do yum update on nodes ? | 15:47 |
| *** aufi has quit IRC | 15:51 | |
| rlandy | mwhahaha: running on internal cloud (which is very slow) we had to increase nova::db::sync::db_sync_timeout. Now we have keystone-manage db_sync timeouts. Is there a similar parameter for keystone? keystone::db::sync::db_sync_timeout? | 15:52 |
| rlandy | https://thirdparty.logs.rdoproject.org/jenkins-tq-gate-rhos-13-ci-rhos-ovb-featureset001-157/undercloud/home/stack/undercloud_install.log.txt.gz#_2018-08-30_15_36_43 | 15:52 |
| mwhahaha | unlikely | 15:52 |
| mwhahaha | we've never had keystone db sync timeout | 15:53 |
| mwhahaha | that cloud seems really terrible | 15:53 |
| rlandy | welcome to downstream | 15:53 |
| rlandy | nobody else will touch it | 15:54 |
| * mwhahaha sighs | 15:54 | |
| rlandy | but we have the resource and weshay|pto wants rhos-* running again | 15:54 |
| rlandy | anything I can do here? | 15:54 |
| mwhahaha | raise the issue with the keystone folks to ask why db sync takes longer than 5 minutes to run | 15:55 |
| mwhahaha | it's a perf problem in keystone | 15:55 |
| mwhahaha | https://thirdparty.logs.rdoproject.org/jenkins-tq-gate-rhos-13-ci-rhos-ovb-featureset001-157/undercloud/var/log/keystone/keystone.log.txt.gz#_2018-08-30_15_31_50_521 | 15:56 |
| mwhahaha | we restarted it cause it fails, there are retries | 15:56 |
| mwhahaha | but it's taking more than 5 mins to run keystone db sync | 15:56 |
| rlandy | probably because that cloud is dying of old age | 15:56 |
| mwhahaha | if it's over capacity that'll do it | 15:57 |
| mwhahaha | but yea whatever cloud that is jsut can't handle it | 15:57 |
| mwhahaha | any deployment workarounds are just delaying failures elsewhere for the same reason | 15:57 |
| rlandy | yeah - that may be the final word on this - the cloud is too old to handle these type of installations | 15:58 |
| rlandy | we are early adopters on upshift | 15:58 |
| rlandy | best we get there asap | 15:58 |
| rlandy | mwhahaha: thanks | 15:58 |
| mwhahaha | the cpu seems fine | 15:58 |
| mwhahaha | so it seems like a disk problem | 15:58 |
| *** gbarros has quit IRC | 15:58 | |
| rlandy | it should be - I hiked it | 15:58 |
| rlandy | and the volume | 15:58 |
| rlandy | and everything else I could find to adjust | 15:58 |
| mwhahaha | i don't know what the underlying disks are | 15:58 |
| mwhahaha | but 8 Intel(R) Xeon(R) CPU E5-2690 v3 @ 2.60GHz should be plenty of processing. and it's got 16G ram | 15:59 |
| *** jpich has quit IRC | 15:59 | |
| *** rdopiera has quit IRC | 15:59 | |
| rlandy | cloud is osp-10 based though | 15:59 |
| openstackgerrit | RedHat RDO CI proposed openstack/tripleo-quickstart-extras master: GATE CHECK for quickstart-extras https://review.openstack.org/560445 | 16:00 |
| mwhahaha | shoudln't matter | 16:00 |
| * mwhahaha shrugs | 16:00 | |
| *** lvdombrkr has quit IRC | 16:00 | |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart-extras master: Increase nova db_sync time if defined. https://review.openstack.org/593077 | 16:01 |
| *** eggmaster has joined #tripleo | 16:02 | |
| *** jpena is now known as jpena|off | 16:03 | |
| *** dsneddon has quit IRC | 16:03 | |
| *** dsneddon has joined #tripleo | 16:04 | |
| *** boazel has joined #tripleo | 16:05 | |
| *** openstackgerrit has quit IRC | 16:06 | |
| *** holser_ has quit IRC | 16:07 | |
| *** mjturek has quit IRC | 16:09 | |
| *** mjturek has joined #tripleo | 16:10 | |
| *** openstackgerrit has joined #tripleo | 16:13 | |
| openstackgerrit | Carlos Goncalves proposed openstack/tripleo-common master: Download CentOS-based amphora image if not present https://review.openstack.org/591997 | 16:13 |
| *** gbarros has joined #tripleo | 16:21 | |
| *** abishop has quit IRC | 16:21 | |
| *** abishop has joined #tripleo | 16:22 | |
| *** dxiri has joined #tripleo | 16:24 | |
| *** moguimar has quit IRC | 16:29 | |
| *** lblanchard has quit IRC | 16:29 | |
| *** trown is now known as trown|lunch | 16:34 | |
| *** ssbarnea|ruck has joined #tripleo | 16:36 | |
| *** gbarros has quit IRC | 16:47 | |
| openstackgerrit | Merged openstack/puppet-pacemaker master: import zuul job settings from project-config https://review.openstack.org/597761 | 16:49 |
| openstackgerrit | Merged openstack/puppet-pacemaker master: switch documentation job to new PTI https://review.openstack.org/597762 | 16:49 |
| openstackgerrit | Sorin Sbarnea proposed openstack/tripleo-quickstart master: Remove duplicate dictionary keys https://review.openstack.org/597547 | 16:51 |
| openstackgerrit | Ilya Etingof proposed openstack/tripleo-quickstart master: Handle VirtualBMC 1.4.0+ setup https://review.openstack.org/598095 | 16:55 |
| openstackgerrit | Alex Schultz proposed openstack/tripleo-heat-templates master: switch documentation job to new PTI https://review.openstack.org/596061 | 16:57 |
| flaper87 | mwhahaha: hey, have 2 sec to help me debug a network issue with a standalone tripleo deployment? | 16:58 |
| flaper87 | I can ssh into the VM | 16:58 |
| mwhahaha | flaper87: sup | 16:58 |
| flaper87 | but I can't reach the internet from it | 16:58 |
| mwhahaha | flaper87: did you create a router | 16:58 |
| flaper87 | I did | 16:58 |
| * flaper87 doble checks | 16:58 | |
| mwhahaha | did you set the external gateway on said router? | 16:58 |
| flaper87 | mwhahaha: yep | 16:59 |
| mwhahaha | k i'm out of ideas :D | 16:59 |
| mwhahaha | that's what i ran into it when i did it | 17:00 |
| mwhahaha | tmate? | 17:00 |
| flaper87 | oh :( | 17:02 |
| flaper87 | mmh, can't install tmate in this env | 17:02 |
| flaper87 | ok | 17:02 |
| * flaper87 keeps debugging | 17:02 | |
| mwhahaha | flaper87: you're likely running into actual neutron issues. so if the main host can reach the internet it's how you've defined your networks | 17:03 |
| mwhahaha | flaper87: What i have in the docs is what i've used successfully | 17:04 |
| mwhahaha | flaper87: https://docs.openstack.org/tripleo-docs/latest/install/containers_deployment/standalone.html#example-1-nic-using-compute-with-tenant-and-provider-networks | 17:04 |
| flaper87 | mwhahaha: mmh, ok. I followed your doc but I try again from scratch. Mind sharing the link again | 17:04 |
| flaper87 | oh you did | 17:04 |
| mwhahaha | i ran through these scenarios after shardy's questions around this | 17:05 |
| mwhahaha | so they worked for me | 17:05 |
| *** raildo has quit IRC | 17:07 | |
| *** rpioso is now known as rpioso|eat | 17:07 | |
| *** raildo has joined #tripleo | 17:08 | |
| *** srini_ has quit IRC | 17:09 | |
| openstackgerrit | Carlos Goncalves proposed openstack/tripleo-heat-templates master: Add scenario010 to check job list https://review.openstack.org/599035 | 17:14 |
| *** morazi has joined #tripleo | 17:15 | |
| openstackgerrit | Doug Hellmann proposed openstack/tripleo-docs master: switch documentation job to new PTI https://review.openstack.org/597774 | 17:18 |
| openstackgerrit | Doug Hellmann proposed openstack/tripleo-validations master: switch documentation job to new PTI https://review.openstack.org/597792 | 17:20 |
| openstackgerrit | Doug Hellmann proposed openstack/tripleo-validations master: add python 3.6 unit test job https://review.openstack.org/597793 | 17:20 |
| *** jcoufal has quit IRC | 17:24 | |
| *** mjturek has quit IRC | 17:27 | |
| *** mjturek has joined #tripleo | 17:28 | |
| flaper87 | mwhahaha: totally my fault, I used the wrong gw ip | 17:30 |
| flaper87 | thanks | 17:30 |
| mwhahaha | flaper87: :D np | 17:30 |
| openstackgerrit | Alex Schultz proposed openstack/tripleo-image-elements master: add python 3.5 unit test job https://review.openstack.org/597778 | 17:33 |
| *** trown|lunch is now known as trown | 17:34 | |
| *** jcoufal has joined #tripleo | 17:36 | |
| *** mjturek has quit IRC | 17:37 | |
| *** sshnaidm|off has quit IRC | 17:37 | |
| *** mjturek has joined #tripleo | 17:38 | |
| hamzy | hey y'all, my ethernet connections in instances installed via TripleO doesn't work. I seem to see all the bridges and connections setup, but some final qemu hardware connection is broken or missing http://paste.openstack.org/show/729241/ | 17:38 |
| *** sshnaidm|off has joined #tripleo | 17:38 | |
| mwhahaha | hamzy: that sounds more like a nova/neutron issue than tripleo. in tripleo we're testing this via tempest so it's unlikely to be tripleo specific | 17:40 |
| mwhahaha | maybe metadata service problems? | 17:40 |
| * mwhahaha shrugs | 17:40 | |
| *** sshnaidm|off has quit IRC | 17:41 | |
| *** sshnaidm|off has joined #tripleo | 17:41 | |
| hamzy | mwhahaha, thanks... I'll ask in -nova | 17:42 |
| mwhahaha | hamzy: it could be a net config issue as deployed via tripleo if you're not connecting things correctly but it' snot specific to something we do | 17:43 |
| *** mjturek has quit IRC | 17:45 | |
| *** mjturek has joined #tripleo | 17:46 | |
| hamzy | mwhahaha, I think the compute nodes themselves work... they can install all packages and provision instances... but inside of the instance, I can't connect | 17:47 |
| hamzy | It probably is some obscure configuration setup I am doing wrong :) | 17:47 |
| *** dsneddon has quit IRC | 17:58 | |
| *** dtantsur is now known as dtantsur|afk | 17:59 | |
| *** dsneddon has joined #tripleo | 18:00 | |
| *** morazi has quit IRC | 18:03 | |
| *** hjensas has quit IRC | 18:03 | |
| *** hjensas has joined #tripleo | 18:05 | |
| *** rpioso|eat is now known as rpioso | 18:15 | |
| *** moshele has joined #tripleo | 18:16 | |
| *** raildo has quit IRC | 18:23 | |
| *** mjturek has quit IRC | 18:33 | |
| *** dsneddon has quit IRC | 18:35 | |
| *** dsneddon has joined #tripleo | 18:38 | |
| EvilienM | ssbarnea: hey | 18:42 |
| EvilienM | is https://bugs.launchpad.net/tripleo/+bug/1790144 consistent in the gate? | 18:42 |
| openstack | Launchpad bug 1790144 in tripleo "queens: overcloud-deploy.sh fail with mistra timed out waiting for ping module test success: SSH Error: data could not be sent to remote host " [Critical,Triaged] | 18:42 |
| *** dsneddon has quit IRC | 18:43 | |
| *** gfidente has quit IRC | 18:43 | |
| EvilienM | http://zuul.openstack.org/builds.html?job_name=tripleo-ci-centos-7-scenario001-multinode-oooq-container | 18:45 |
| *** mcornea has joined #tripleo | 18:50 | |
| EvilienM | slagle: it sounds like this backport broke scenario001 on stable/queens, but I could be wrong https://review.openstack.org/#/c/597053/ | 18:50 |
| EvilienM | http://logs.openstack.org/57/595357/1/check/tripleo-ci-centos-7-scenario001-multinode-oooq-container/a3f7856/logs/undercloud/var/log/mistral/executor.log.txt.gz#_2018-08-30_00_40_15_950 | 18:50 |
| openstackgerrit | Carlos Goncalves proposed openstack/tripleo-quickstart master: Add scenario010 to the check queue https://review.openstack.org/599052 | 18:51 |
| *** tosky has quit IRC | 18:52 | |
| openstackgerrit | James Slagle proposed openstack/tripleo-docs master: config-download User's Guide https://review.openstack.org/599053 | 18:54 |
| *** dsneddon has joined #tripleo | 18:54 | |
| slagle | EvilienM: well you're linking me a mistral log, and that code does not run under mistral :) | 18:55 |
| EvilienM | yeah I just figured that | 18:56 |
| EvilienM | I'm digging... | 18:56 |
| slagle | EvilienM: the line that is changed is executed directly by tripleoclient to remove the temporary ssh key | 18:56 |
| EvilienM | indeed. Sorry for noise | 18:57 |
| EvilienM | I'm looking at recent changes in tripleo common | 18:57 |
| *** openstackstatus has quit IRC | 18:58 | |
| openstackgerrit | Jill Rouleau proposed openstack/tripleo-common master: Add ansible_group_vars to config download https://review.openstack.org/596429 | 18:59 |
| openstackgerrit | Jill Rouleau proposed openstack/tripleo-heat-templates master: Add stack output ansible_group_vars https://review.openstack.org/596427 | 18:59 |
| EvilienM | slagle: maybe https://review.openstack.org/#/c/589150/ | 19:03 |
| *** raildo has joined #tripleo | 19:05 | |
| *** rh-jelabarre has quit IRC | 19:15 | |
| *** rbrady has quit IRC | 19:19 | |
| mwhahaha | fultonj: https://bugs.launchpad.net/tripleo/+bug/1790144 are you aware of anything like this for rocky/queens that maybe we didn't backport that is causing ssh timeout issues with the ceph-ansible bits? | 19:24 |
| openstack | Launchpad bug 1790144 in tripleo "queens: overcloud-deploy.sh fail with mistra timed out waiting for ping module test success: SSH Error: data could not be sent to remote host " [Critical,Triaged] | 19:24 |
| fultonj | mwhahaha: looking | 19:28 |
| fultonj | rocky doesn't execute ceph-ansible during step2 | 19:28 |
| fultonj | this must be queens only | 19:28 |
| mwhahaha | fultonj: so it seems like it's trying to talk to the undercloud on a bad ip | 19:29 |
| fultonj | does this job inject a trust anchor? | 19:29 |
| mwhahaha | fultonj: 192.168.24.3 is in the undercloud.conf but isn't in use on the host | 19:29 |
| mwhahaha | http://logs.openstack.org/57/595357/1/check/tripleo-ci-centos-7-scenario001-multinode-oooq-container/a3f7856/logs/undercloud/var/log/extra/network.txt.gz | 19:29 |
| mwhahaha | undercloud_admin_host = 192.168.24.3 from | 19:29 |
| mwhahaha | http://logs.openstack.org/57/595357/1/check/tripleo-ci-centos-7-scenario001-multinode-oooq-container/a3f7856/logs/undercloud/home/zuul/undercloud.conf.txt.gz | 19:30 |
| fultonj | https://review.openstack.org/#/c/588216/ | 19:30 |
| fultonj | mwhahaha: ^ | 19:31 |
| mwhahaha | but this is the ssh tho | 19:31 |
| fultonj | ceph-ansible triggers the access.yaml workbook which wants to connect back to the public end point of the undercloud | 19:31 |
| mwhahaha | "msg": "timed out waiting for ping module test success: SSH Error: data could not be sent to remote host \\"192.168.24.3\\". Make sure this host can be reached over ssh | 19:32 |
| mwhahaha | different issue i think | 19:32 |
| fultonj | yeah, ok | 19:32 |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/queens: Use fqdn for live_migration_inbound_addr https://review.openstack.org/590362 | 19:33 |
| mwhahaha | ok so it's not the undercloud | 19:34 |
| mwhahaha | we're doign some stupid stuff in the .conf it seems but not necessarily related | 19:34 |
| mwhahaha | http://logs.openstack.org/57/595357/1/check/tripleo-ci-centos-7-scenario001-multinode-oooq-container/a3f7856/logs/subnode-2/var/log/extra/network.txt.gz | 19:34 |
| mwhahaha | 192.168.24.3 is subnode-2 | 19:34 |
| fultonj | https://github.com/openstack/tripleo-common/blob/stable/queens/workbooks/ceph-ansible.yaml#L89 | 19:36 |
| fultonj | i think it might be this playbook timing out to reach subnode2 | 19:37 |
| mwhahaha | no | 19:37 |
| mwhahaha | http://logs.openstack.org/57/595357/1/check/tripleo-ci-centos-7-scenario001-multinode-oooq-container/a3f7856/logs/undercloud/tmp/ansible-mistral-actionm9Bj3V/ | 19:37 |
| mwhahaha | it is timing out trying to reach subnode2 | 19:37 |
| mwhahaha | but not that playbook | 19:38 |
| mwhahaha | or it might be that one, it's timing out int he fact collection | 19:38 |
| mwhahaha | i guess i should just spin up a reproducer | 19:38 |
| * mwhahaha wonders if rdo cloud is happy today | 19:39 | |
| *** openstackstatus has joined #tripleo | 19:39 | |
| *** ChanServ sets mode: +v openstackstatus | 19:39 | |
| *** dprince has quit IRC | 19:40 | |
| fultonj | mwhahaha: is this the first time we've seen it | 19:41 |
| mwhahaha | evidently it's been happening for like 2 weeks | 19:41 |
| mwhahaha | in queens | 19:41 |
| mwhahaha | so not exactly super helpful | 19:41 |
| mwhahaha | only in queens tho | 19:41 |
| fultonj | mwhahaha: i have seen this in the past and people have addressed it by updating ansible.cfg's timeout=X retries=Y | 19:46 |
| mwhahaha | yea i don't think that's the solution here cause it looks like it's already retrying and times out after like 5 mins | 19:46 |
| mwhahaha | something else is wrong | 19:47 |
| mwhahaha | i'll try and run a reproducer | 19:47 |
| mwhahaha | it seems more environmental than code related maybe | 19:47 |
| fultonj | ok | 19:51 |
| *** ansmith has quit IRC | 19:52 | |
| *** openstackstatus has quit IRC | 19:55 | |
| mwhahaha | and of course teh reproducer fails gloriously even before that | 19:55 |
| * mwhahaha sighs | 19:55 | |
| *** openstackstatus has joined #tripleo | 19:59 | |
| *** ChanServ sets mode: +v openstackstatus | 19:59 | |
| *** edmondsw has left #tripleo | 19:59 | |
| *** jcoufal has quit IRC | 20:02 | |
| *** itlinux has joined #tripleo | 20:04 | |
| rlandy | EvilienM: to get back to https://github.com/openstack/tripleo-heat-templates/blob/master/ci/common/net-config-multinode-os-net-config.yaml#L136, can I just remove this function and execute it in an overcloud prepare step? | 20:07 |
| rlandy | or is it not that simple? | 20:07 |
| rlandy | I could so the sed's of /etc/os-net-config/config.json before deploy | 20:07 |
| *** openstackstatus has quit IRC | 20:11 | |
| openstackgerrit | Merged openstack/tripleo-quickstart-extras master: Include minimal Browbeat playbook in baremetal playbook https://review.openstack.org/581488 | 20:13 |
| openstackgerrit | Merged openstack/puppet-tripleo stable/rocky: import zuul job settings from project-config https://review.openstack.org/597849 | 20:13 |
| openstackgerrit | Merged openstack/puppet-tripleo stable/queens: import zuul job settings from project-config https://review.openstack.org/597832 | 20:13 |
| openstackgerrit | Merged openstack/puppet-tripleo stable/pike: import zuul job settings from project-config https://review.openstack.org/597815 | 20:13 |
| openstackgerrit | Merged openstack/python-tripleoclient master: import zuul job settings from project-config https://review.openstack.org/597765 | 20:13 |
| *** openstackstatus has joined #tripleo | 20:13 | |
| *** ChanServ sets mode: +v openstackstatus | 20:13 | |
| openstackgerrit | Merged openstack/python-tripleoclient master: switch documentation job to new PTI https://review.openstack.org/597766 | 20:13 |
| openstackgerrit | Merged openstack/python-tripleoclient master: add python 3.6 unit test job https://review.openstack.org/597767 | 20:13 |
| openstackgerrit | Merged openstack/python-tripleoclient stable/rocky: import zuul job settings from project-config https://review.openstack.org/597850 | 20:13 |
| openstackgerrit | Merged openstack/python-tripleoclient stable/queens: import zuul job settings from project-config https://review.openstack.org/597833 | 20:13 |
| openstackgerrit | Merged openstack/python-tripleoclient stable/pike: import zuul job settings from project-config https://review.openstack.org/597816 | 20:13 |
| openstackgerrit | Jill Rouleau proposed openstack/tripleo-common master: Add ansible_group_vars to config download https://review.openstack.org/596429 | 20:13 |
| *** itlinux has quit IRC | 20:16 | |
| *** fultonj has quit IRC | 20:22 | |
| EvilienM | sdoran: https://review.rdoproject.org/r/16101 was merged! it was the fix FYI | 20:23 |
| *** holser_ has joined #tripleo | 20:23 | |
| sdoran | You're fast! Thanks! | 20:24 |
| sdoran | We can close out the relate bug in launchpad. | 20:25 |
| openstackgerrit | Florian Fuchs proposed openstack/tripleo-common master: Fix validation runs in a containerized environment https://review.openstack.org/598958 | 20:25 |
| *** dxiri has quit IRC | 20:26 | |
| openstackgerrit | Merged openstack/tripleo-common stable/rocky: import zuul job settings from project-config https://review.openstack.org/597851 | 20:27 |
| openstackgerrit | Merged openstack/tripleo-common stable/queens: import zuul job settings from project-config https://review.openstack.org/597834 | 20:27 |
| openstackgerrit | Merged openstack/tripleo-common stable/pike: import zuul job settings from project-config https://review.openstack.org/597817 | 20:27 |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/rocky: import zuul job settings from project-config https://review.openstack.org/597852 | 20:27 |
| *** itlinux has joined #tripleo | 20:28 | |
| openstackgerrit | John Trowbridge proposed openstack/tripleo-quickstart master: Revert "Revert "Move to openshift-ansible 3.10"" https://review.openstack.org/589469 | 20:32 |
| *** med_ has joined #tripleo | 20:33 | |
| ssbarnea|ruck | EvilienM : aparently is consistent, see http://logs.openstack.org/24/567224/96/check/tripleo-ci-centos-7-scenario001-multinode-oooq-container/93a2b31/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz | 20:34 |
| *** trown is now known as trown|outtypewww | 20:36 | |
| *** openstackstatus has quit IRC | 20:36 | |
| openstackgerrit | Merged openstack/ansible-role-tripleo-modify-image master: Install yum priorities to containers before update https://review.openstack.org/598322 | 20:36 |
| openstackgerrit | Merged openstack/tripleo-validations stable/rocky: import zuul job settings from project-config https://review.openstack.org/597856 | 20:36 |
| *** raildo has quit IRC | 20:37 | |
| *** openstackstatus has joined #tripleo | 20:39 | |
| *** ChanServ sets mode: +v openstackstatus | 20:39 | |
| openstackgerrit | Merged openstack/tripleo-puppet-elements stable/rocky: import zuul job settings from project-config https://review.openstack.org/597854 | 20:39 |
| openstackgerrit | Merged openstack/tripleo-image-elements stable/rocky: import zuul job settings from project-config https://review.openstack.org/597853 | 20:39 |
| openstackgerrit | James Slagle proposed openstack/tripleo-heat-templates stable/queens: Add BlacklistedHostnames stack output https://review.openstack.org/599067 | 20:43 |
| openstackgerrit | James Slagle proposed openstack/tripleo-heat-templates stable/queens: Add BlacklistedIpAddresses stack output https://review.openstack.org/599068 | 20:43 |
| *** itlinux has quit IRC | 20:44 | |
| openstackgerrit | James Slagle proposed openstack/tripleo-common stable/queens: Support deployment blacklist with --limit https://review.openstack.org/599069 | 20:46 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-quickstart master: Enable virt7-container-common-candidate repo starting in Stein https://review.openstack.org/592079 | 20:57 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-quickstart master: Enable virt7-container-common-candidate repo starting in Stein https://review.openstack.org/592079 | 20:58 |
| *** cmurphy|vacation is now known as cmurphy | 20:58 | |
| *** holser_ has quit IRC | 20:58 | |
| openstackgerrit | James Slagle proposed openstack/tripleo-heat-templates master: Tag step plays https://review.openstack.org/599072 | 20:59 |
| mwhahaha | slagle: so our failure collection stuff needs to be updated for config download cause it's still checking stack statues | 21:00 |
| mwhahaha | slagle: https://github.com/openstack/tripleo-quickstart-extras/blob/master/roles/overcloud-deploy/templates/overcloud-deploy.sh.j2#L48-L75 | 21:01 |
| slagle | mwhahaha: don't think so. EvilienM already added that? | 21:02 |
| slagle | mwhahaha: yea it's there, line 53 | 21:02 |
| EvilienM | https://github.com/openstack/tripleo-quickstart-extras/commit/51bf780176c60575db333d90a5ce979ab6464957#diff-12610415db2e2b4b5bc651b174dee70c | 21:03 |
| mwhahaha | slagle: maybe i'mr eading it wrong but that won't run if the stack create is ok but the ansible bits aren't | 21:03 |
| mwhahaha | don't we need to use the openstack overcloud status now as a 3rd elif | 21:03 |
| EvilienM | rlandy: which step exactly? | 21:03 |
| slagle | mwhahaha: oh right, so EvilienM's patch was useless | 21:03 |
| slagle | gee whiz! | 21:04 |
| EvilienM | you're welcome | 21:04 |
| EvilienM | I take it personally | 21:04 |
| mwhahaha | good | 21:04 |
| rlandy | EvilienM: overcloud-prep-network? | 21:04 |
| EvilienM | rlandy: oh, yeah in that role. Yes if that works. | 21:04 |
| rlandy | really anywhere I can pass ansible vars from the inventory | 21:04 |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart-extras master: DNM - Example code to move network_config_hook https://review.openstack.org/599076 | 21:07 |
| rlandy | EvilienM: ^^ something like | 21:07 |
| rlandy | unsure what https://github.com/openstack/tripleo-heat-templates/blob/master/ci/common/net-config-multinode-os-net-config.yaml#L145 would return | 21:08 |
| mwhahaha | slagle: so also i don't think 'openstack overcloud status' works correctly if you deploy, delete the stack & plan and then deploy again. | 21:09 |
| rlandy | etc/nodepool/sub_nodes_private does not resolve | 21:09 |
| EvilienM | rlandy: http://my1.fr/files/emilien-right-now.jpg | 21:09 |
| EvilienM | do you feel this way? | 21:09 |
| * mwhahaha is currently running a deploy and it says it's already successful | 21:10 | |
| rlandy | EvilienM: totally | 21:10 |
| EvilienM | good | 21:10 |
| * rlandy just started off wanting to add a browbeat job | 21:10 | |
| openstackgerrit | James Slagle proposed openstack/tripleo-quickstart-extras master: Use overcloud status for failure checking https://review.openstack.org/599077 | 21:10 |
| rlandy | and landed up in the middle of the zuulv3 transition | 21:10 |
| slagle | mwhahaha: see ^ | 21:11 |
| slagle | mwhahaha: i guess we'd have to update the "if" release checker when stein branches. how does one say release >= rocky, without having to say "release not in <every stable branch since Bexar>" | 21:12 |
| *** raildo has joined #tripleo | 21:12 | |
| mwhahaha | yea would be nice if we branched oooq-extras so we didn't :D but here we are | 21:12 |
| *** raildo has quit IRC | 21:13 | |
| EvilienM | Bexar | 21:14 |
| slagle | were you born when that was released? | 21:14 |
| EvilienM | I was really young | 21:15 |
| *** akrivoka has quit IRC | 21:16 | |
| EvilienM | I actually was wearing an uniform ;-) | 21:16 |
| openstackgerrit | John Fulton proposed openstack/tripleo-heat-templates master: WIP/DNM: Persist ceph-ansible fetch_directory using config-download https://review.openstack.org/582811 | 21:24 |
| openstackgerrit | John Fulton proposed openstack/tripleo-heat-templates master: WIP/DNM: Persist ceph-ansible fetch_directory using config-download https://review.openstack.org/582811 | 21:25 |
| *** med_ has quit IRC | 21:36 | |
| *** moshele has quit IRC | 21:37 | |
| openstackgerrit | Carlos Goncalves proposed openstack/tripleo-common master: Fix skip of octavia-undercloud Ansible role https://review.openstack.org/591413 | 21:41 |
| openstackgerrit | Carlos Goncalves proposed openstack/tripleo-common master: Download CentOS-based amphora image if not present https://review.openstack.org/591997 | 21:42 |
| mwhahaha | EvilienM: slagle: so looks like we're not creating tripleo-admin anymore in scenario001 on queens which is why it's failing | 21:42 |
| mwhahaha | https://bugs.launchpad.net/tripleo/+bug/1790144 | 21:42 |
| openstack | Launchpad bug 1790144 in tripleo "queens: overcloud-deploy.sh fail with mistra timed out waiting for ping module test success: SSH Error: data could not be sent to remote host " [Critical,Triaged] | 21:42 |
| mwhahaha | my reproducer doesn't have a tripleo-admin user on the overcloud node | 21:42 |
| *** med_ has joined #tripleo | 21:43 | |
| EvilienM | mwhahaha: give me one sec, brb | 21:45 |
| slagle | mwhahaha: does this job even use config-download? | 21:46 |
| EvilienM | it's queens, so no | 21:46 |
| mwhahaha | no, this is failing in the ceph-ansible stuff | 21:46 |
| slagle | right, ok. | 21:46 |
| slagle | i dont know too much about their worfklow | 21:47 |
| *** florianf has quit IRC | 21:48 | |
| mwhahaha | so it's just failing on the external ansible call which i don't think is related to their workflow | 21:48 |
| mwhahaha | was the tripleo-admin stuff a workflow thing or a THT thing | 21:49 |
| slagle | workflow | 21:49 |
| slagle | the heat task that is failing is in WorkflowTasks | 21:49 |
| slagle | WorkflowTasks_Step2_Execution | 21:49 |
| slagle | that's why you see the error in the mistral log | 21:49 |
| mwhahaha | well good to see that tripleo.access.v1.enable_ssh_admin failed, that's probably why ansible hangs | 21:50 |
| mwhahaha | HEH | 21:50 |
| slagle | i was inspired to work on config-download partly by this design | 21:52 |
| slagle | ya know, removing layers of complexity so you can actually see how things fail, instead of adding them | 21:53 |
| mwhahaha | pffft | 21:53 |
| mwhahaha | well this is still failing in the initial user creation which is a problem for either | 21:53 |
| mwhahaha | i'll poke at mistral but i think this is the task to actually enable it | 21:53 |
| slagle | mwhahaha: where do you see that enable_ssh_admin failed? | 21:54 |
| mwhahaha | in the mistral execution list | 21:54 |
| slagle | which is captured where? | 21:55 |
| mwhahaha | in mistral | 21:55 |
| mwhahaha | i've got a reproducer up | 21:55 |
| mwhahaha | so i'm quiering it | 21:55 |
| *** thrash is now known as thrash|g0ne | 21:57 | |
| openstackgerrit | Carlos Goncalves proposed openstack/puppet-tripleo master: Add scenario010 to the check queue https://review.openstack.org/599083 | 21:59 |
| *** dtrainor has quit IRC | 22:01 | |
| *** dtrainor has joined #tripleo | 22:02 | |
| *** EvilienM is now known as EmilienM | 22:04 | |
| *** mcornea has quit IRC | 22:07 | |
| *** tosky has joined #tripleo | 22:09 | |
| *** itlinux has joined #tripleo | 22:11 | |
| *** rlandy has quit IRC | 22:16 | |
| openstackgerrit | Alex Schultz proposed openstack/tripleo-quickstart master: Fix queens fs016 fs019 https://review.openstack.org/599088 | 22:24 |
| *** itlinux has quit IRC | 22:34 | |
| openstackgerrit | John Fulton proposed openstack/tripleo-common master: Generalize swift_rings_backup workflow https://review.openstack.org/597221 | 22:39 |
| *** boazel has quit IRC | 22:41 | |
| openstackgerrit | Jill Rouleau proposed openstack/tripleo-heat-templates master: Add stack output ansible_group_vars https://review.openstack.org/596427 | 22:43 |
| mwhahaha | so good news, launched a vm on a f28 overcloud running centos7 containers. | 22:45 |
| * mwhahaha gives up | 22:45 | |
| *** zaneb has quit IRC | 22:48 | |
| *** zaneb has joined #tripleo | 22:48 | |
| openstackgerrit | Ilya Etingof proposed openstack/tripleo-quickstart master: Handle VirtualBMC 1.4.0+ setup https://review.openstack.org/598095 | 22:55 |
| *** jrist has quit IRC | 22:58 | |
| *** almondjoy has quit IRC | 23:03 | |
| *** tosky has quit IRC | 23:14 | |
| openstackgerrit | Merged openstack/tripleo-quickstart-extras master: import zuul job settings from project-config https://review.openstack.org/597784 | 23:39 |
| openstackgerrit | Merged openstack/tripleo-quickstart-extras master: switch documentation job to new PTI https://review.openstack.org/597785 | 23:39 |
| openstackgerrit | Merged openstack/tripleo-quickstart master: import zuul job settings from project-config https://review.openstack.org/597782 | 23:39 |
| openstackgerrit | Merged openstack/os-net-config stable/rocky: import zuul job settings from project-config https://review.openstack.org/597846 | 23:39 |
| openstackgerrit | Merged openstack/os-net-config stable/queens: import zuul job settings from project-config https://review.openstack.org/597829 | 23:39 |
| openstackgerrit | Merged openstack/os-net-config stable/pike: import zuul job settings from project-config https://review.openstack.org/597812 | 23:39 |
| openstackgerrit | Merged openstack/os-apply-config stable/rocky: import zuul job settings from project-config https://review.openstack.org/597844 | 23:39 |
| openstackgerrit | Merged openstack/os-apply-config stable/queens: import zuul job settings from project-config https://review.openstack.org/597827 | 23:39 |
| openstackgerrit | Merged openstack/os-apply-config stable/pike: import zuul job settings from project-config https://review.openstack.org/597810 | 23:39 |
| openstackgerrit | Merged openstack/python-tripleoclient master: Add --override-ansible-cfg https://review.openstack.org/584121 | 23:51 |
| *** rpioso is now known as rpioso|afk | 23:51 | |
| openstackgerrit | Jill Rouleau proposed openstack/tripleo-heat-templates master: Create a Timesync service declaration https://review.openstack.org/586679 | 23:58 |
| openstackgerrit | Jill Rouleau proposed openstack/tripleo-heat-templates master: WIP: Add chrony time service https://review.openstack.org/588111 | 23:58 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!
