*** owalsh has quit IRC | 00:01 | |
*** Wasaac has joined #openstack-kolla | 00:15 | |
*** Wasaac has quit IRC | 00:19 | |
*** trungnv has quit IRC | 00:48 | |
*** igordc has quit IRC | 01:00 | |
*** spsurya has joined #openstack-kolla | 01:17 | |
*** kevinz has joined #openstack-kolla | 01:24 | |
*** altlogbot_0 has quit IRC | 01:37 | |
*** altlogbot_1 has joined #openstack-kolla | 01:38 | |
*** kevinz has quit IRC | 01:53 | |
*** weshay_dentist is now known as weshay | 02:13 | |
*** gregoryo has joined #openstack-kolla | 02:25 | |
*** BjoernT has joined #openstack-kolla | 02:41 | |
*** kevinz has joined #openstack-kolla | 02:46 | |
*** hongbin has joined #openstack-kolla | 02:49 | |
*** kevinz has quit IRC | 02:55 | |
*** BjoernT_ has joined #openstack-kolla | 02:58 | |
*** BjoernT has quit IRC | 02:59 | |
*** whoami-rajat has joined #openstack-kolla | 03:07 | |
*** erijpkema has quit IRC | 03:08 | |
*** hongbin has quit IRC | 04:11 | |
*** BjoernT_ has quit IRC | 04:12 | |
*** skramaja has joined #openstack-kolla | 04:28 | |
*** janki has joined #openstack-kolla | 05:04 | |
*** Luzi has joined #openstack-kolla | 05:05 | |
Tengu | hello there | 05:10 |
---|---|---|
*** jchhatbar has joined #openstack-kolla | 05:38 | |
*** jchhatbar has quit IRC | 05:41 | |
*** janki has quit IRC | 05:41 | |
*** jchhatbar has joined #openstack-kolla | 05:42 | |
*** jchhatbar has quit IRC | 05:43 | |
*** gkadam_ has joined #openstack-kolla | 05:54 | |
*** gkadam_ has quit IRC | 05:54 | |
*** gkadam has quit IRC | 05:56 | |
*** cah_link has joined #openstack-kolla | 06:12 | |
yoctozepto | morning | 06:19 |
openstackgerrit | jacky06 proposed openstack/kolla-cli master: Add reno for release notes management https://review.opendev.org/674732 | 06:21 |
*** kevinz has joined #openstack-kolla | 06:30 | |
openstackgerrit | jacky06 proposed openstack/kolla-cli master: Add reno for release notes management https://review.opendev.org/674732 | 06:33 |
openstackgerrit | jacky06 proposed openstack/kolla-cli master: Add reno for release notes management https://review.opendev.org/674732 | 06:35 |
mnasiadka | morning | 07:08 |
*** jbadiapa has joined #openstack-kolla | 07:18 | |
*** jbadiapa has quit IRC | 07:27 | |
openstackgerrit | jacky06 proposed openstack/kolla-cli master: Add reno for release notes management https://review.opendev.org/674732 | 07:40 |
openstackgerrit | jacky06 proposed openstack/kolla-cli master: Add reno for release notes management https://review.opendev.org/674732 | 07:42 |
openstackgerrit | jacky06 proposed openstack/kolla-cli master: Add reno for release notes management https://review.opendev.org/674732 | 07:44 |
*** rpittau|afk is now known as rpittau | 07:46 | |
*** gregoryo has quit IRC | 07:50 | |
*** dougsz has joined #openstack-kolla | 07:52 | |
*** kevinz has quit IRC | 07:52 | |
*** kevinz has joined #openstack-kolla | 07:52 | |
*** JangwonLee has joined #openstack-kolla | 08:23 | |
hrw | morning | 08:24 |
openstackgerrit | Merged openstack/kolla-cli master: Add reno for release notes management https://review.opendev.org/674732 | 08:32 |
openstackgerrit | caoyuan proposed openstack/kolla-cli master: Update kolla command to kolla-cli action command https://review.opendev.org/672406 | 08:45 |
*** rgogunskiy has joined #openstack-kolla | 08:52 | |
*** Wasaac has joined #openstack-kolla | 08:57 | |
*** gfidente has joined #openstack-kolla | 09:08 | |
openstackgerrit | Michal Nasiadka proposed openstack/kolla master: WIP: Allow simple building of stable tarballs based source images https://review.opendev.org/674608 | 09:08 |
stingrayza | o/ | 09:08 |
openstackgerrit | Michal Nasiadka proposed openstack/kolla master: WIP: Allow simple building of stable tarballs based source images https://review.opendev.org/674608 | 09:09 |
*** owalsh_ is now known as owalsh | 09:10 | |
*** dr_feelgood has joined #openstack-kolla | 09:11 | |
*** shyamb has joined #openstack-kolla | 09:22 | |
hrw | mnasiadka: 'point'? | 09:56 |
mnasiadka | hrw: in stable branches we use point releases, 7.0.0, 7.0.1, etc | 09:57 |
hrw | mnasiadka: ok | 09:57 |
hrw | mnasiadka: calling 'master' stable sounds tricky ;D | 09:57 |
mnasiadka | hrw: I’ll run a name contest after fixing tests :) | 09:58 |
hrw | ;D | 09:59 |
hrw | mnasiadka: and there was a tool to generate sources list for stable branches. | 10:00 |
mnasiadka | hrw: yeah, I’ll look into that as well, just wanted to have openstack_release var for downloading upper-constraints.txt, but now I have some more ideas :) | 10:02 |
hrw | sure | 10:02 |
hrw | mnasiadka: I just wanted to get rid of /somewhere/systemd/something/kolla.conf and now I have to learn 'to_nice_json' ;D | 10:02 |
*** mgoddard has quit IRC | 10:03 | |
hrw | mnasiadka: commented | 10:04 |
yoctozepto | hrw, mnasiadka: I just wanted to integrate ldap with keystone and now I'm fixing keystone | 10:04 |
*** mgoddard has joined #openstack-kolla | 10:07 | |
*** dr_feelgood has quit IRC | 10:07 | |
hrw | ~curse bigdata 'devs; | 10:09 |
*** dr_feelgood has joined #openstack-kolla | 10:09 | |
yoctozepto | bigdata? whoa, whoa, you shouldn't have rebuilt containers thousand times | 10:11 |
hrw | yoctozepto: I am build engineer. kolla is one of my tasks | 10:11 |
*** shyamb has quit IRC | 10:19 | |
*** dr_feelgood has quit IRC | 10:21 | |
*** dr_feelgood has joined #openstack-kolla | 10:21 | |
*** dr_feelgood has quit IRC | 10:25 | |
hrw | uf. my playbook is now able to inject registry into existing docker.json | 10:39 |
*** rgogunskiy has quit IRC | 10:45 | |
*** dr_feelgood has joined #openstack-kolla | 10:49 | |
*** shyamb has joined #openstack-kolla | 10:51 | |
*** kevinz has quit IRC | 10:54 | |
openstackgerrit | Isaac Prior proposed openstack/kolla-ansible master: Moves monasca-thresh java.io.tmpdir to existing docker volume https://review.opendev.org/674775 | 10:57 |
*** kevinz has joined #openstack-kolla | 11:08 | |
hrw | mnasiadka: does https://paste.fedoraproject.org/paste/90C0uivUEktN-1jDZoA9hA have sense? | 11:09 |
openstackgerrit | Isaac Prior proposed openstack/kolla master: Ensures monasca-thresh data dir exists and is empty on start up https://review.opendev.org/674779 | 11:12 |
*** shyamb has quit IRC | 11:12 | |
*** shyam89 has joined #openstack-kolla | 11:12 | |
*** dr_feelgood has quit IRC | 11:13 | |
*** dr_feelgood has joined #openstack-kolla | 11:13 | |
hrw | let CI check ;d | 11:13 |
openstackgerrit | Marcin Juszkiewicz proposed openstack/kolla-ansible master: Configure docker without guessing how it starts https://review.opendev.org/672700 | 11:13 |
*** dr_feelgood has quit IRC | 11:14 | |
*** dr_feelgood has joined #openstack-kolla | 11:15 | |
openstackgerrit | Mark Goddard proposed openstack/kolla-ansible master: WIP: CI: Profile performance and task execution time https://review.opendev.org/674664 | 11:16 |
*** shyamb has joined #openstack-kolla | 11:17 | |
*** shyam89 has quit IRC | 11:17 | |
*** kplant has joined #openstack-kolla | 11:19 | |
*** ivve has joined #openstack-kolla | 11:22 | |
mnasiadka | hrw: yeah, it's nice - question is what happens with MountFlags != shared :) | 11:31 |
hrw | mnasiadka: read docker 18.09 release notes please. and https://review.opendev.org/674587 | 11:31 |
mnasiadka | hrw: I know the release notes, just haven't experienced them on myself :) | 11:32 |
hrw | mnasiadka: my latest deployment has empty mountflags | 11:32 |
mnasiadka | hrw: and neutron-openvswitch-agent works? | 11:32 |
hrw | mnasiadka: not present | 11:32 |
mnasiadka | hrw: I think neutron-ovs-agent had a problem without mountflags=shared, so we would need to test that | 11:33 |
hrw | mnasiadka: I would say that this is a problem with those agents | 11:33 |
mnasiadka | hrw: that's a bold statement that is equally true and nobody will give a shit about it :) | 11:34 |
hrw | ~curse yaml | 11:34 |
mnasiadka | I hate json more :) | 11:36 |
hrw | json ignores indents. yaml is not | 11:37 |
hrw | - name: get configured insecure registries | 11:37 |
hrw | vars: | 11:37 |
hrw | registries: [{{docker_registry}}] | 11:37 |
hrw | pep8 shouts at 3rd line | 11:38 |
kplant | languages that don't ignore whitespace are annoying... cough python | 11:38 |
mnasiadka | hrw: my json love comes from integration efforts with one ITSM tool, it vomitted huge json, from which I needed at most 5 variables :) | 11:39 |
hrw | mnasiadka: ;D | 11:39 |
hrw | mnasiadka: I did some JSON API hacking in past with some game. | 11:40 |
hrw | mnasiadka: can you take a look at https://review.opendev.org/672700 and tell me how to fix post-install.yml syntax so our pep8 check with shut? | 11:41 |
*** Wasaac has quit IRC | 11:42 | |
openstackgerrit | Marcin Juszkiewicz proposed openstack/kolla master: Add Debian/source CI job https://review.opendev.org/674240 | 11:43 |
*** Wasaac has joined #openstack-kolla | 11:43 | |
mgoddard | hrw: registries: ["{{docker_registry}}"] | 11:50 |
hrw | mgoddard: thx | 11:50 |
mgoddard | hrw: Jinja confuses YAML, you often need quots | 11:50 |
openstackgerrit | Marcin Juszkiewicz proposed openstack/kolla-ansible master: Configure docker without guessing how it starts https://review.opendev.org/672700 | 11:51 |
mnasiadka | seems mgoddard has a nice parser in his eyes :) | 11:52 |
mgoddard | too many hours spent staring at ansible syntax erros | 11:52 |
yoctozepto | mgoddard: hi, https://review.opendev.org/673165 waiting for you :-) | 11:53 |
yoctozepto | with mnasiadka decided to wait for you | 11:53 |
mgoddard | yoctozepto: yeah, will do it shortly | 11:53 |
mgoddard | thanks for waiting | 11:53 |
yoctozepto | sure, I value quality, not quantity | 11:54 |
*** dr_feelgood has quit IRC | 12:01 | |
*** zbr is now known as zbr|lunch | 12:01 | |
hrw | mgoddard: thanks for docker.io patch comments | 12:01 |
mgoddard | hrw: do they make sense? | 12:02 |
*** dr_feelgood has joined #openstack-kolla | 12:02 | |
hrw | mgoddard: replied there - docker.io from debian/ubuntu gives us kind of 'docker lts' as we do not have to worry about any changes for a while | 12:02 |
mnasiadka | damn, my change will get bigger... | 12:03 |
mnasiadka | mgoddard: thanks for comments, integrating that with version-check.py makes sense | 12:03 |
mgoddard | mnasiadka: yeah, I think that's a key use case | 12:04 |
mgoddard | hrw: I see. Have we seen problems with docker CE being unstable? | 12:04 |
hrw | mgoddard: for most of time I avoid updating it. | 12:05 |
hrw | mgoddard: https://review.opendev.org/674587 is fun | 12:05 |
hrw | mgoddard: and related bug | 12:05 |
*** dr_feelgood has quit IRC | 12:07 | |
*** shyamb has quit IRC | 12:10 | |
*** henriqueof has joined #openstack-kolla | 12:10 | |
*** shyamb has joined #openstack-kolla | 12:11 | |
mgoddard | heading out for a bit. yoctozepto I will look at your review when I'm back | 12:12 |
*** dr_feelgood has joined #openstack-kolla | 12:15 | |
*** Wasaac has quit IRC | 12:16 | |
*** Wasaac has joined #openstack-kolla | 12:17 | |
openstackgerrit | Marcin Juszkiewicz proposed openstack/kolla-ansible master: Configure docker without guessing how it starts https://review.opendev.org/672700 | 12:24 |
hrw | fixed another error | 12:25 |
hrw | "msg": "'dict object' has no attribute 'insecure-registries'" | 12:26 |
*** shyamb has quit IRC | 12:27 | |
mgoddard | hrw: why don't we see that mountflags issue on centos? | 12:32 |
mgoddard | do we see it on ubuntu when using docker CE (rather than docker.io)? | 12:32 |
hrw | mgoddard: no idea. | 12:33 |
mgoddard | latest docker CE is 19.03 | 12:33 |
mgoddard | when did you see the issue? | 12:33 |
hrw | mgoddard: https://bugs.launchpad.net/kolla-ansible/+bug/1833835 | 12:33 |
openstack | Launchpad bug 1833835 in kolla-ansible "[debian] MountFlags=shared fail for docker 18.09" [Undecided,In progress] - Assigned to Marcin Juszkiewicz (hrw) | 12:33 |
hrw | mgoddard: all my machines were on Debian stretch with 18.06 before I got that bug | 12:33 |
mgoddard | using docker CE or docker.io? | 12:34 |
hrw | CE | 12:34 |
hrw | stretch did not had docker at all | 12:34 |
*** hongbin has joined #openstack-kolla | 12:34 | |
openstackgerrit | Merged openstack/kolla-ansible stable/stein: CI: fix checks for upgrade and multinode jobs https://review.opendev.org/673989 | 12:36 |
hrw | and most of my machines are not supported in buster so upgrading them was tricky | 12:36 |
*** zbr|lunch is now known as zbr | 12:38 | |
mgoddard | yoctozepto: thanks for updating, approved the ceph patch | 12:49 |
openstackgerrit | Marcin Juszkiewicz proposed openstack/kolla-ansible master: Configure docker without guessing how it starts https://review.opendev.org/672700 | 12:54 |
hrw | and another error ;D | 12:55 |
*** kevinz has quit IRC | 12:56 | |
openstackgerrit | Rafael Weingärtner proposed openstack/kolla-ansible master: Standardize the configuration of "oslo_messaging" section https://review.opendev.org/670626 | 12:56 |
openstackgerrit | gugug proposed openstack/kolla-cli master: Update kolla command to kolla-cli action command https://review.opendev.org/674806 | 13:01 |
openstackgerrit | Marcin Juszkiewicz proposed openstack/kolla master: Add Debian/source CI job https://review.opendev.org/674240 | 13:01 |
hrw | making pep8 test happier | 13:02 |
openstackgerrit | gugug proposed openstack/kolla-cli master: Update kolla command to kolla-cli action command https://review.opendev.org/674806 | 13:02 |
openstackgerrit | gugug proposed openstack/kolla-cli master: Update kolla command to kolla-cli action command https://review.opendev.org/674806 | 13:05 |
openstackgerrit | gugug proposed openstack/kolla-cli master: Update kolla command to kolla-cli action command https://review.opendev.org/674806 | 13:09 |
*** dr_feelgood has quit IRC | 13:09 | |
*** dr_feelgood has joined #openstack-kolla | 13:09 | |
openstackgerrit | gugug proposed openstack/kolla-cli master: Update kolla command to kolla-cli action command https://review.opendev.org/674806 | 13:10 |
hrw | kolla-cli became Chinese project | 13:11 |
openstackgerrit | gugug proposed openstack/kolla-cli master: Update kolla command to kolla-cli action command https://review.opendev.org/674806 | 13:11 |
openstackgerrit | Isaac Prior proposed openstack/kolla master: Ensures monasca-thresh data and worker dirs exist and are empty on start up https://review.opendev.org/674779 | 13:12 |
openstackgerrit | Pierre Riteau proposed x/kayobe master: Remove storage management network from controllers https://review.opendev.org/672482 | 13:13 |
goldyfruit_ | hrw, more a 99cloud.net project | 13:13 |
*** Wasaac has quit IRC | 13:15 | |
openstackgerrit | Isaac Prior proposed openstack/kolla-ansible master: Moves monasca-thresh java.io.tmpdir to existing docker volume https://review.opendev.org/674775 | 13:15 |
*** Wasaac_ has joined #openstack-kolla | 13:15 | |
openstackgerrit | Marcin Juszkiewicz proposed openstack/kolla-ansible master: Configure docker without guessing how it starts https://review.opendev.org/672700 | 13:18 |
hrw | shit. need to rebase | 13:19 |
openstackgerrit | gugug proposed openstack/kolla-cli master: Update kolla command to kolla-cli action command https://review.opendev.org/674806 | 13:21 |
openstackgerrit | gugug proposed openstack/kolla-cli master: Update kolla command to kolla-cli action command https://review.opendev.org/674806 | 13:22 |
*** hongbin has quit IRC | 13:24 | |
openstackgerrit | Marcin Juszkiewicz proposed openstack/kolla-ansible master: Configure docker without guessing how it starts https://review.opendev.org/672700 | 13:24 |
hrw | now it sits on top of mountflags one | 13:25 |
hrw | so you guys probably will ignore it ;D | 13:25 |
*** dr_feelgood has quit IRC | 13:39 | |
*** dr_feelgood has joined #openstack-kolla | 13:40 | |
*** BjoernT has joined #openstack-kolla | 13:40 | |
*** mflynn has joined #openstack-kolla | 13:42 | |
*** dr_feelgood has quit IRC | 13:42 | |
*** dr_feelgood has joined #openstack-kolla | 13:43 | |
*** BjoernT has quit IRC | 13:44 | |
mflynn | What combination of options are recommended for infrastructure monitoring? telegraf, prometheus, grafana? | 13:46 |
hrw | GFW#$@#$@%^@#$^@$(^@$&^(@#$&%@ | 13:46 |
openstackgerrit | Isaac Prior proposed openstack/kolla master: Ensures monasca-thresh data and worker dirs exist and are empty on start up https://review.opendev.org/674779 | 13:47 |
openstackgerrit | Marcin Juszkiewicz proposed openstack/kolla-ansible master: Configure docker without guessing how it starts https://review.opendev.org/672700 | 13:47 |
*** lemko has joined #openstack-kolla | 13:48 | |
openstackgerrit | Isaac Prior proposed openstack/kolla-ansible master: Moves monasca-thresh java.io.tmpdir to existing docker volume https://review.opendev.org/674775 | 13:48 |
*** BjoernT has joined #openstack-kolla | 13:48 | |
hrw | mflynn: prometheus+grafana or monasca? but I never deployed any of them | 13:48 |
goldyfruit_ | mosnasca will be more to monitor instances, no ? | 13:50 |
kplant | ^ was just typing that | 13:50 |
*** dr_feelgood has quit IRC | 13:51 | |
hrw | I only know that our previous admin was prometheus+grafana fan | 13:51 |
goldyfruit_ | hrw, I'm! | 13:52 |
mflynn | I was hoping someone might have a grafana dashboard already built with all kinds of pretty graphs. | 13:53 |
goldyfruit_ | mflynn, https://grafana.com/grafana/dashboards | 13:54 |
mflynn | goldyfruit_, been looking at those. Found some nice ones. thanks | 13:56 |
*** Luzi has quit IRC | 13:56 | |
openstackgerrit | Merged openstack/kolla-ansible master: ceph: fixes to deployment and upgrade https://review.opendev.org/673165 | 13:59 |
openstackgerrit | Merged openstack/kolla-ansible master: Support mon and osd to be named with hostname https://review.opendev.org/654417 | 13:59 |
*** kevinz has joined #openstack-kolla | 14:00 | |
openstackgerrit | Isaac Prior proposed openstack/kolla-ansible master: Moves monasca-thresh java.io.tmpdir to existing docker volume https://review.opendev.org/674775 | 14:06 |
openstackgerrit | gugug proposed openstack/kolla-cli master: Update kolla command to kolla-cli action command https://review.opendev.org/674806 | 14:07 |
openstackgerrit | Isaac Prior proposed openstack/kolla master: Ensures monasca-thresh data and worker dirs exist and are empty on start up https://review.opendev.org/674779 | 14:07 |
*** JangwonLee has quit IRC | 14:08 | |
mnasiadka | yoctozepto: the monster merged :) | 14:09 |
*** dpawlik has quit IRC | 14:10 | |
*** altlogbot_1 has quit IRC | 14:12 | |
henriqueof | I added a new service on globals.yml, should I use reconfigure or deploy option to enable it? | 14:13 |
*** altlogbot_3 has joined #openstack-kolla | 14:14 | |
*** cah_link has quit IRC | 14:16 | |
goldyfruit_ | henriqueof, deploy, you will have trouble to reconfigure something that doesn't exist :) | 14:16 |
henriqueof | goldyfruit_: hahah, thanks, will stop and use deploy. | 14:17 |
openstackgerrit | Doug Szumski proposed openstack/kolla-ansible master: Moves monasca-thresh java.io.tmpdir to existing docker volume https://review.opendev.org/674775 | 14:18 |
henriqueof | goldyfruit_: So deploy won't cause problems to my runnning services, right? | 14:19 |
goldyfruit_ | Nop, except if you change configuration manually | 14:20 |
goldyfruit_ | if that is the case then kolla, will override the changes and then the container(s) will be restarted | 14:20 |
henriqueof | I changed some configs on Octavia, since kolla-ansible won't configure it (create networks and stuff), how can I override the kolla scripts so I don't need to add it manually again later? | 14:21 |
goldyfruit_ | Override the config into /etc/kolla/config/* | 14:23 |
goldyfruit_ | but you could use tag to deploy | 14:23 |
goldyfruit_ | kolla-ansible deploy -t barbican | 14:23 |
goldyfruit_ | which will just touch barbican | 14:23 |
henriqueof | Ah man, I used deploy just to add barbican, if I knew the tag feature before. hahaha | 14:24 |
henriqueof | Is there any risks if I stop the deploy script now? | 14:24 |
goldyfruit_ | yeah, I would wait just in case | 14:24 |
*** kevinz has quit IRC | 14:26 | |
yoctozepto | mgoddard, mnasiadka: thanks, now onto stein | 14:27 |
openstackgerrit | Radosław Piliszek proposed openstack/kolla-ansible stable/stein: ceph: fixes to deployment and upgrade https://review.opendev.org/674443 | 14:28 |
*** cah_link has joined #openstack-kolla | 14:28 | |
yoctozepto | ^ this | 14:28 |
yoctozepto | and will need more of me for rocky so be done later | 14:28 |
*** KeithMnemonic has joined #openstack-kolla | 14:36 | |
*** BjoernT has quit IRC | 14:42 | |
openstackgerrit | Merged openstack/kolla-cli master: Update kolla command to kolla-cli action command https://review.opendev.org/674806 | 14:43 |
hrw | looks like docker.io change goes nicely on CI | 14:53 |
hrw | yoctozepto: so ceph jobs are good now and upgrade-ceph ones need stein change? | 15:07 |
*** BjoernT has joined #openstack-kolla | 15:10 | |
mgoddard | yoctozepto: WDYT about this notifications patch? Do we really want to configure notifications for all services, even if we don't know that they produce them? | 15:13 |
*** skramaja has quit IRC | 15:14 | |
*** BjoernT has quit IRC | 15:23 | |
*** BjoernT has joined #openstack-kolla | 15:33 | |
yoctozepto | hrw: yep | 15:45 |
yoctozepto | upgrades left without fancy rebootstrapping, it is saner I think | 15:46 |
*** ivve has quit IRC | 15:46 | |
yoctozepto | mgoddard: mhm, that's the painful point of it, would be better to know, still this is something that can be orchestrated nicely because it is popular part of oslo | 15:46 |
yoctozepto | and Rafael seems to have only changed the ones that we already "tried" to configure | 15:47 |
mgoddard | yoctozepto: I found the list of services ceilometer listens to | 15:47 |
mgoddard | we can restrict it to that for anything using enable_ceilometer | 15:47 |
yoctozepto | mgoddard: sounds reasonable | 15:47 |
*** igordc has joined #openstack-kolla | 15:48 | |
yoctozepto | have you linked it? | 15:48 |
yoctozepto | k, refreshed, I see | 15:48 |
yoctozepto | maybe we should only orchestrate those ceilometer-relevant | 15:59 |
yoctozepto | otherwise it could be confusing yeah | 15:59 |
yoctozepto | though the list is maybe not the best reference | 16:01 |
yoctozepto | https://blueprints.launchpad.net/blazar/+spec/notifications | 16:01 |
yoctozepto | reads as if blazar has integrated the notifications | 16:01 |
yoctozepto | though definitely not all | 16:02 |
yoctozepto | argh, decisions, decisions :-) | 16:02 |
kdean | yoctozepto: Btw just wanted to say thanks for your help | 16:03 |
kdean | yoctozepto: I'm now up and running | 16:04 |
yoctozepto | kdean: you are welcome, that's so nice to hear! :-) | 16:06 |
yoctozepto | (or read in fact) | 16:06 |
yoctozepto | mgoddard: what if we orchestrated notification_control_exchanges too? | 16:07 |
yoctozepto | seems logic to do this from kolla, huh? | 16:07 |
yoctozepto | (I mean k-a ofc) | 16:07 |
mgoddard | yoctozepto: so blazar is a good example of where a separate flag would be useful. ceilometer is clearly not interested, but users might be | 16:08 |
yoctozepto | well, ceilometer can be configure to listen | 16:09 |
yoctozepto | whatever that would mean though | 16:09 |
yoctozepto | but yeah, plainly configuring everything by enable_ceilometer without configuring ceilometer is actually pointless and confusing | 16:09 |
kdean | yoctozepto: :-) | 16:09 |
kdean | Do you know if there is anyway to get designate to use the internal URL for reverse lookup zones this is the only bit I have left to get configured, should I just turn the setting off in the neutron.conf as its currently causing this error. | 16:10 |
kdean | Its due to HAproxy speaking HTTP on the internal address and neutron trys to connect to it using https | 16:10 |
mgoddard | Oh, I see notification_control_exchanges is the default, not allowed values | 16:10 |
kdean | No details.: SSLError: SSL exception connecting to https://example.com:9001/zones?name=0.21.10.in-addr.arpa.: HTTPSConnectionPool(host='example.com', port=9001): | 16:10 |
kdean | Max retries exceeded with url: /zones?name=0.21.10.in-addr.arpa. (Caused by SSLError(SSLError("bad handshake: Error([('SSL routines', 'ssl3_get_record', 'wrong version number')],)",),)) | 16:10 |
yoctozepto | yes, what I meant exactyl :-) | 16:10 |
yoctozepto | I love my typos | 16:10 |
yoctozepto | sounds like a name for an e-dinosaur | 16:10 |
mgoddard | ok. Well either way, I think we need to know which services actually produce notifications rather than just randomly adding variables | 16:11 |
yoctozepto | kdean: I have little knowledge of designate | 16:11 |
kdean | no worries. thanks anyway | 16:12 |
*** igordc has quit IRC | 16:12 | |
*** dougsz has quit IRC | 16:12 | |
yoctozepto | mgoddard: k, left note with our thoughts on change | 16:14 |
*** owalsh_ has joined #openstack-kolla | 16:17 | |
*** owalsh has quit IRC | 16:22 | |
*** hongbin has joined #openstack-kolla | 16:24 | |
*** dougsz has joined #openstack-kolla | 16:25 | |
*** hongbin has quit IRC | 16:29 | |
*** owalsh_ has quit IRC | 16:31 | |
*** owalsh has joined #openstack-kolla | 16:31 | |
openstackgerrit | Rafael Weingärtner proposed openstack/kolla-ansible master: Standardize the configuration of "oslo_messaging" section https://review.opendev.org/670626 | 16:33 |
openstackgerrit | Pierre Riteau proposed openstack/kolla-ansible master: Run task only if heat-engine is enabled on this host https://review.opendev.org/674867 | 16:37 |
*** gfidente has quit IRC | 16:38 | |
*** rpittau is now known as rpittau|afk | 16:41 | |
yoctozepto | mgoddard: argh, Rafael must be very confused as we agree only partially ;D | 16:44 |
mgoddard | yoctozepto: we as in you + me? | 16:45 |
yoctozepto | yeah | 16:45 |
yoctozepto | see my response | 16:45 |
yoctozepto | did not see yours before posting | 16:45 |
mgoddard | I'm trying to reduce the scope of the change. It's already too large | 16:46 |
mgoddard | factor out the less well understood parts into another patch | 16:46 |
mgoddard | make sense? | 16:46 |
*** BjoernT has quit IRC | 16:48 | |
yoctozepto | makes | 16:50 |
yoctozepto | but better put it | 16:51 |
yoctozepto | "what to do" | 16:51 |
yoctozepto | in this particular change | 16:51 |
yoctozepto | rather that what not to ;p | 16:51 |
openstackgerrit | Merged openstack/kolla-ansible master: Add mon address to ceph release version check https://review.opendev.org/669269 | 17:04 |
mgoddard | yoctozepto: except I want some of the current change to be removed | 17:08 |
*** BjoernT has joined #openstack-kolla | 17:08 | |
yoctozepto | mgoddard: yes, yes, but it is more understandable when you say what you want the scope of the current change to be rather what not | 17:09 |
yoctozepto | rather than* | 17:09 |
openstackgerrit | Doug Szumski proposed openstack/kolla-ansible master: Add support for using custom Logstash patterns https://review.opendev.org/674884 | 17:18 |
openstackgerrit | Mark Goddard proposed openstack/kolla-ansible master: WIP: CI: Profile performance and task execution time https://review.opendev.org/674664 | 17:27 |
openstackgerrit | Mark Goddard proposed openstack/kolla-ansible master: Remove support for Docker legacy packages https://review.opendev.org/674886 | 17:34 |
*** dcapone2004 has joined #openstack-kolla | 17:41 | |
dcapone2004 | Is it possible to do an AIO install for evaluation purposes using kolla ansible and a virtual environment? I am getting some errors and I am not finding much help online | 17:42 |
kplant | dcapone2004: absolutely | 17:42 |
kplant | what errors are you getting and at what stage? | 17:43 |
dcapone2004 | prechecks it is complaining about importerror no module named docker found | 17:43 |
dcapone2004 | I googled that and came across this... | 17:43 |
kplant | right, okay | 17:44 |
kplant | so before you can run prechecks, you need a prepared environment | 17:44 |
dcapone2004 | https://ask.openstack.org/en/question/101298/docker-module-importerror-with-kolla-ansible/ but it seemed to imply that using a virtual environment wasn't recommended which is contrary to the kolla ansible quickstart which does recommend it | 17:44 |
kplant | if you run: kolla-ansible -i all-in-one bootstrap-servers | 17:44 |
kplant | that will pop docker on there for you | 17:44 |
dcapone2004 | that runs perfect no error | 17:44 |
dcapone2004 | run prechecks it fails | 17:45 |
*** dougsz has quit IRC | 17:45 | |
kplant | you're using the provided 'all-in-one' ? | 17:45 |
yoctozepto | sounds like virtualenv is not picked up | 17:45 |
yoctozepto | what release of kolla-ansible is this? | 17:45 |
dcapone2004 | yep, I don't think I made any changes whatsoever to the all-in-one file....I customized globals.yml though | 17:45 |
yoctozepto | probably worth reporting as bug | 17:46 |
dcapone2004 | for stein...I am running kolla-ansible from within the virtual environment is that correct? | 17:46 |
kplant | pip or git? | 17:46 |
dcapone2004 | pip | 17:46 |
dcapone2004 | end of bootstrap output: | 17:47 |
dcapone2004 | PLAY RECAP ************************************************************************************************************************************************************************************** | 17:47 |
dcapone2004 | localhost : ok=37 changed=1 unreachable=0 failed=0 skipped=24 rescued=0 ignored=0 | 17:47 |
kplant | right so, regarding venvs, it gets a little hairy | 17:47 |
kplant | you can use venvs on the deploying host and/or on the target hosts | 17:47 |
kplant | but you're using aio.... heh | 17:47 |
dcapone2004 | and the docker tasks seem to run successfully | 17:47 |
dcapone2004 | TASK [baremetal : Add kolla user to docker group] *********************************************************************************************************************************************** | 17:47 |
dcapone2004 | ok: [localhost] | 17:47 |
dcapone2004 | TASK [baremetal : Start docker] ***************************************************************************************************************************************************************** | 17:47 |
dcapone2004 | ok: [localhost] | 17:47 |
dcapone2004 | TASK [baremetal : Restart docker] *************************************************************************************************************************************************************** | 17:47 |
dcapone2004 | skipping: [localhost] | 17:47 |
dcapone2004 | TASK [baremetal : Enable docker] **************************************************************************************************************************************************************** | 17:47 |
dcapone2004 | ok: [localhost] | 17:47 |
kplant | if you run `docker ps` do you get output? | 17:47 |
dcapone2004 | kplant: yeah I thought the virtualenv issue would be on multimode deployments not aio | 17:48 |
dcapone2004 | from within the virtualenv or outside of it? | 17:48 |
kplant | outside | 17:48 |
kplant | that's where ansible is going to run, unless specified otherwise in inventory or globals.yml | 17:48 |
dcapone2004 | get output from both actually | 17:49 |
dcapone2004 | (virtualaio) [root@dev-lx-os-stein-aio bin]# docker ps | 17:49 |
dcapone2004 | CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES | 17:49 |
dcapone2004 | (virtualaio) [root@dev-lx-os-stein-aio bin]# deactivate | 17:49 |
dcapone2004 | [root@dev-lx-os-stein-aio bin]# docker ps | 17:49 |
dcapone2004 | CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES | 17:49 |
dcapone2004 | [root@dev-lx-os-stein-aio bin]# | 17:49 |
dcapone2004 | oh crap, should I not be running this as root and running as the user kolla instead? | 17:49 |
kplant | root is fine | 17:50 |
kplant | for a poc aio anyway :-) | 17:50 |
dcapone2004 | lol | 17:50 |
kplant | what distro is this | 17:50 |
dcapone2004 | in what config file does the kolla user get set? CentOS 7 | 17:51 |
dcapone2004 | using centos for the container distro | 17:51 |
openstackgerrit | Radosław Piliszek proposed openstack/kolla-ansible stable/rocky: ceph: fixes to deployment and upgrade https://review.opendev.org/674889 | 17:51 |
kplant | and you're running `kolla-ansible -i all-in-one prechecks` ? | 17:52 |
dcapone2004 | correct | 17:52 |
openstackgerrit | Radosław Piliszek proposed openstack/kolla-ansible stable/stein: Add mon address to ceph release version check https://review.opendev.org/674891 | 17:52 |
*** spsurya has quit IRC | 17:52 | |
dcapone2004 | from within the virtual environment....is that correct? | 17:52 |
kplant | if you're using venv on the deploying host yes, otherwise kolla-ansible won't exist | 17:53 |
dcapone2004 | very true | 17:53 |
dcapone2004 | :-) | 17:53 |
kplant | can you try without a venv? | 17:53 |
kplant | this is just a vm right? you don't care about it? | 17:53 |
dcapone2004 | it is bare metal but I don't care about it as it is a complete dev machine so I can whack and reload easily | 17:54 |
openstackgerrit | Radosław Piliszek proposed openstack/kolla-ansible stable/rocky: Add ceph-mds/rgw/nfs to gate https://review.opendev.org/674479 | 17:54 |
openstackgerrit | Radosław Piliszek proposed openstack/kolla-ansible stable/rocky: Add ceph-mds/rgw/nfs to gate https://review.opendev.org/674479 | 17:54 |
kplant | if there's nothing else on here i would try it without a venv | 17:55 |
dcapone2004 | that was my planned next step | 17:55 |
kplant | something sounds... screwy | 17:55 |
openstackgerrit | Radosław Piliszek proposed openstack/kolla-ansible stable/stein: Add ceph-mds/rgw/nfs to gate https://review.opendev.org/673302 | 17:55 |
kplant | i use venvs in production (on both build and target hosts) without trouble | 17:55 |
openstackgerrit | Radosław Piliszek proposed openstack/kolla-ansible stable/stein: Add ceph-mds/rgw/nfs to gate https://review.opendev.org/673302 | 17:55 |
dcapone2004 | centos or ubuntu? Also, I configured it to use binary vs source but I don't think that would make any difference at this stage of the game | 17:56 |
kplant | centos from source | 17:57 |
openstackgerrit | Mark Goddard proposed openstack/kolla-ansible master: CI: Sanity check that nodepool.private_ipv4 is assigned https://review.opendev.org/674898 | 18:04 |
*** igordc has joined #openstack-kolla | 18:08 | |
dcapone2004 | so from a documentation standpoint when not using a virtual environment.....you need to install kolla-ansible using pip BEFORE installing ansible as yum installs PyYAML with ansible and it creates a dependency issue when using pip | 18:18 |
dcapone2004 | that is probably not an issue for multimode though | 18:18 |
kplant | you can just pip install ansible --ignore-installed | 18:19 |
dcapone2004 | pip install kolla-ansible is where the error is generated if ansible is already installed with yum | 18:19 |
kplant | sorry | 18:21 |
kplant | meant pip install kolla-ansible --ignore-installed | 18:21 |
kplant | but the documentation calls out installing ansible from pypi iirc | 18:22 |
kplant | so it doesn't expect that | 18:22 |
dcapone2004 | docs say use yum to install ansible and then pip for kolla-ansible | 18:23 |
kplant | aah it does, for venv it gets it right | 18:23 |
kplant | but without venv it says to use yum | 18:24 |
dcapone2004 | correct | 18:24 |
dcapone2004 | that is why I was just mentioning it from a documentation standpoint here | 18:24 |
kplant | yeah that should probably be a pip install ansible OR pip install kolla-ansible --ignore-installed | 18:24 |
kplant | the former would probably be better | 18:24 |
*** igordc has quit IRC | 18:25 | |
*** henriqueof has quit IRC | 18:38 | |
*** igordc has joined #openstack-kolla | 18:46 | |
*** jbadiapa has joined #openstack-kolla | 18:47 | |
*** Wasaac_ has quit IRC | 18:55 | |
dcapone2004 | alrightly, so install completed but neutron did not appear to come up....I'm coming from an RDO/packstack world and I would usually be checking neutron processes using systemctl and config files for neutron, but since kolla uses docker containers I'm guessing I would need to enter the correct container and make these similar checks? | 18:57 |
dcapone2004 | looking at docker, it appears like the neutron-server:stein container just keeps restarting on its own | 18:59 |
*** jbadiapa has quit IRC | 19:03 | |
dcapone2004 | trying to redeploy from source and see what happens | 19:06 |
kplant | `docker logs [containername]` | 19:14 |
kplant | that will give you a nice output of what's going on | 19:14 |
*** jbadiapa has joined #openstack-kolla | 19:16 | |
*** shaan9 has joined #openstack-kolla | 19:25 | |
*** jbadiapa has quit IRC | 19:31 | |
*** ivve has joined #openstack-kolla | 19:32 | |
openstackgerrit | Rafael Weingärtner proposed openstack/kolla-ansible master: Standardize the configuration of "oslo_messaging" section https://review.opendev.org/670626 | 19:35 |
*** atmark has joined #openstack-kolla | 19:41 | |
*** henriqueof has joined #openstack-kolla | 19:42 | |
*** Wasaac has joined #openstack-kolla | 19:45 | |
*** Wasaac has quit IRC | 19:49 | |
dcapone2004 | well, the source didn't help and nor did the logs really give much info | 19:50 |
dcapone2004 | and I can't get into the container fast enough to look into much more detail before it restarts itself | 19:50 |
dcapone2004 | ok, hitting enter just at the right time to get me the neutron-server.log file has shed some light....the issue is with Fwaas....it cannot find the plugin inside of the container....is Fwaas not supported via Kolla Ansible? | 19:59 |
dcapone2004 | this is what is getting put in the neutron-server container.... | 20:02 |
dcapone2004 | 2019-08-06 15:56:09.234 6 INFO neutron.manager [req-ca8c9369-22bb-48b0-bbcf-1680810e735b - - - - -] Loading Plugin: firewall | 20:02 |
dcapone2004 | 2019-08-06 15:56:09.236 6 ERROR neutron_lib.utils.runtime [req-ca8c9369-22bb-48b0-bbcf-1680810e735b - - - - -] Error loading class by alias: NoMatches: No 'neutron.service_plugins' driver found, looking for 'firewall' | 20:02 |
dcapone2004 | 2019-08-06 15:56:09.236 6 ERROR neutron_lib.utils.runtime Traceback (most recent call last): | 20:02 |
dcapone2004 | 2019-08-06 15:56:09.236 6 ERROR neutron_lib.utils.runtime File "/var/lib/kolla/venv/lib/python2.7/site-packages/neutron_lib/utils/runtime.py", line 114, in load_class_by_alias_or_classname | 20:02 |
dcapone2004 | 2019-08-06 15:56:09.236 6 ERROR neutron_lib.utils.runtime namespace, name, warn_on_missing_entrypoint=False) | 20:02 |
dcapone2004 | 2019-08-06 15:56:09.236 6 ERROR neutron_lib.utils.runtime File "/var/lib/kolla/venv/lib/python2.7/site-packages/stevedore/driver.py", line 61, in __init__ | 20:02 |
dcapone2004 | 2019-08-06 15:56:09.236 6 ERROR neutron_lib.utils.runtime warn_on_missing_entrypoint=warn_on_missing_entrypoint | 20:02 |
dcapone2004 | 2019-08-06 15:56:09.236 6 ERROR neutron_lib.utils.runtime File "/var/lib/kolla/venv/lib/python2.7/site-packages/stevedore/named.py", line 89, in __init__ | 20:02 |
dcapone2004 | 2019-08-06 15:56:09.236 6 ERROR neutron_lib.utils.runtime self._init_plugins(extensions) | 20:02 |
dcapone2004 | 2019-08-06 15:56:09.236 6 ERROR neutron_lib.utils.runtime File "/var/lib/kolla/venv/lib/python2.7/site-packages/stevedore/driver.py", line 113, in _init_plugins | 20:02 |
dcapone2004 | 2019-08-06 15:56:09.236 6 ERROR neutron_lib.utils.runtime (self.namespace, name)) | 20:02 |
dcapone2004 | 2019-08-06 15:56:09.236 6 ERROR neutron_lib.utils.runtime NoMatches: No 'neutron.service_plugins' driver found, looking for 'firewall' | 20:02 |
dcapone2004 | 2019-08-06 15:56:09.236 6 ERROR neutron_lib.utils.runtime | 20:02 |
dcapone2004 | 2019-08-06 15:56:09.237 6 ERROR neutron_lib.utils.runtime [req-ca8c9369-22bb-48b0-bbcf-1680810e735b - - - - -] Error loading class by class name: ValueError: Empty module name | 20:02 |
dcapone2004 | 2019-08-06 15:56:09.237 6 ERROR neutron_lib.utils.runtime Traceback (most recent call last): | 20:02 |
dcapone2004 | 2019-08-06 15:56:09.237 6 ERROR neutron_lib.utils.runtime File "/var/lib/kolla/venv/lib/python2.7/site-packages/neutron_lib/utils/runtime.py", line 120, in load_class_by_alias_or_classname | 20:02 |
dcapone2004 | 2019-08-06 15:56:09.237 6 ERROR neutron_lib.utils.runtime class_to_load = importutils.import_class(name) | 20:02 |
dcapone2004 | 2019-08-06 15:56:09.237 6 ERROR neutron_lib.utils.runtime File "/var/lib/kolla/venv/lib/python2.7/site-packages/oslo_utils/importutils.py", line 30, in import_class | 20:02 |
openstackgerrit | Merged openstack/kolla-ansible stable/stein: ceph: fixes to deployment and upgrade https://review.opendev.org/674443 | 20:11 |
kplant | i would recommend sharing large output like that with something like paste.openstack.org :-) | 20:13 |
kplant | looks like you enabled neutron fwaas? | 20:14 |
kplant | oh, you said that. i only read your output and not messages earlier | 20:14 |
kplant | i have not personally tried fwaas | 20:15 |
dcapone2004 | redeploying without it now | 20:17 |
dcapone2004 | is there a way to have kolla-ansible only redeploy what changed? using deploy again appears to be rerunning and rebuilding everything which is different than ceph-ansible | 20:18 |
dcapone2004 | nevermind, looks like it only redeployed the neutron containers | 20:22 |
*** factor has joined #openstack-kolla | 20:22 | |
*** Wasaac has joined #openstack-kolla | 20:25 | |
*** lemko has quit IRC | 20:27 | |
*** Wasaac has quit IRC | 20:29 | |
*** priteau has joined #openstack-kolla | 20:51 | |
*** mflynn has quit IRC | 20:55 | |
*** whoami-rajat has quit IRC | 20:56 | |
*** strigazi has joined #openstack-kolla | 21:01 | |
*** kplant has quit IRC | 21:02 | |
*** Wasaac has joined #openstack-kolla | 21:03 | |
dcapone2004 | in which container is br-ex defined? | 21:04 |
*** Wasaac has quit IRC | 21:07 | |
*** igordc has quit IRC | 21:12 | |
dcapone2004 | I am having issues with the horizon interface....a lot of things are not working quite right....when creating a network, I am unable to select anything in any downdrops, clicking them closes the dropdown but does not change the value, I have tried edge and chrome, about to try firefox | 21:17 |
dcapone2004 | has anyone else seen anything like this? | 21:17 |
dcapone2004 | "tabs" also do not appear to function properly, if I create networks and subnets via the command line, I can see the networks in horizon, but if I select a network and then click "subnets", I am left with a blank screen | 21:18 |
*** igordc has joined #openstack-kolla | 21:31 | |
*** henriqueof has quit IRC | 21:45 | |
*** Wasaac has joined #openstack-kolla | 21:50 | |
*** Wasaac has quit IRC | 21:55 | |
dcapone2004 | enabled debugging in the horizon config and there appears to be some permissions issues....where does this project maintain bug reports? | 22:07 |
priteau | dcapone2004: https://bugs.launchpad.net/kolla-ansible | 22:11 |
priteau | I've never seen the issues you're mentioning though | 22:11 |
dcapone2004 | with offline compression enabled (default from the kolla install) inside the container | 22:12 |
dcapone2004 | I get this | 22:12 |
dcapone2004 | OfflineGenerationError at /project/ | 22:12 |
dcapone2004 | You have offline compression enabled but key "3dcdc14a426856978c36be7fea160fa32caa3b3167f519795a0c3e31bbe119f8" is missing from offline manifest. You may need to run "python manage.py compress". Here is the original content: | 22:12 |
dcapone2004 | disable offline compression, I am getting: | 22:13 |
dcapone2004 | OSError at /project/server_groups/ | 22:13 |
dcapone2004 | [Errno 13] Permission denied: '/var/lib/kolla/venv/lib/python2.7/site-packages/static/dashboard/js/1ba732d085e1.js' | 22:13 |
dcapone2004 | Request Method:GET | 22:13 |
dcapone2004 | this existed as an issue at some point in the past as well in horizon https://bugs.launchpad.net/horizon/+bug/1155765 | 22:19 |
openstack | Launchpad bug 1155765 in OpenStack Dashboard (Horizon) "Offline compression enabled but key is missing from offline manifest" [Medium,Fix released] - Assigned to Yves-Gwenael Bourhis (yves-gwenael-bourhis) | 22:19 |
priteau | I've seen this kind of issue with static assets a while ago but never with kolla. You could try deleting the horizon container and redeploying. | 22:21 |
priteau | Sorry I don't have a better answer. If you can, try asking during European daytime, there will be more people in this channel. | 22:21 |
*** priteau has quit IRC | 22:21 | |
*** dcapone2004 has quit IRC | 22:23 | |
*** cah_link has quit IRC | 22:35 | |
*** shaan9 has quit IRC | 22:42 | |
*** henriqueof has joined #openstack-kolla | 22:43 | |
*** igordc has quit IRC | 22:56 | |
*** igordc has joined #openstack-kolla | 23:20 | |
henriqueof | I enabled neutron_vpnaas but there is no neutron_vpnaas_agent container and all the vpn services keeps on pending create, is this right? | 23:59 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!