| *** dxiri has quit IRC | 00:01 | |
| *** chyka has joined #openstack-ansible | 00:01 | |
| *** tux_ has joined #openstack-ansible | 00:04 | |
| *** chyka has quit IRC | 00:06 | |
| *** tux_ has quit IRC | 00:07 | |
| *** flaviosr_ has joined #openstack-ansible | 00:07 | |
| *** tux_ has joined #openstack-ansible | 00:10 | |
| *** tux_ has quit IRC | 00:14 | |
| *** masuberu has joined #openstack-ansible | 00:15 | |
| *** masber has quit IRC | 00:19 | |
| *** jra_ has quit IRC | 00:32 | |
| *** jra has joined #openstack-ansible | 00:32 | |
| openstackgerrit | Logan V proposed openstack/openstack-ansible-plugins master: Update physical host mapping for ansible 2.4+ https://review.openstack.org/572229 | 00:36 |
|---|---|---|
| *** jeferobles has joined #openstack-ansible | 01:17 | |
| *** tux_ has joined #openstack-ansible | 01:18 | |
| *** chhagarw has joined #openstack-ansible | 01:53 | |
| *** chhagarw has quit IRC | 01:57 | |
| *** armaan_ has joined #openstack-ansible | 02:05 | |
| *** Rhvs has quit IRC | 02:06 | |
| *** armaan has quit IRC | 02:06 | |
| *** Rhvs has joined #openstack-ansible | 02:13 | |
| *** cjloader has joined #openstack-ansible | 02:19 | |
| *** cjloader has quit IRC | 02:25 | |
| *** lihi has quit IRC | 02:36 | |
| *** lihi has joined #openstack-ansible | 02:37 | |
| *** nurdie has joined #openstack-ansible | 02:42 | |
| *** klamath has joined #openstack-ansible | 02:44 | |
| *** rodolof has quit IRC | 02:46 | |
| cloudnull | evenings | 02:47 |
| cloudnull | throwsb1 there are other auth backends for kibana though I've not used them at this point | 02:48 |
| cloudnull | logan- https://review.openstack.org/#/c/572229 looks fine however it looks like the tests are unhappy for something unrelated? | 02:51 |
| *** dave-mccowan has quit IRC | 02:54 | |
| *** klamath has quit IRC | 02:54 | |
| *** klamath has joined #openstack-ansible | 02:56 | |
| *** dxiri has joined #openstack-ansible | 03:04 | |
| *** klamath has quit IRC | 03:05 | |
| *** klamath has joined #openstack-ansible | 03:07 | |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-rabbitmq_server master: Update the version of erlang to support rabbitmq https://review.openstack.org/572196 | 03:19 |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-rabbitmq_server master: Update rabbitmq to the latest stable release https://review.openstack.org/572207 | 03:23 |
| *** klamath has quit IRC | 03:30 | |
| *** klamath has joined #openstack-ansible | 03:31 | |
| cloudnull | it looks like rally needs to build outside of global requirements http://logs.openstack.org/49/550749/11/check/openstack-ansible-deploy-aio_metal-ubuntu-xenial/c8a1b04/job-output.txt.gz#_2018-06-04_16_13_56_357463 | 03:32 |
| *** jeferobles has quit IRC | 03:35 | |
| cloudnull | odyssey4me looks like we need to revert https://review.openstack.org/#/c/570906 or at a minimum give rally the ability to install outside of constraints | 03:36 |
| *** esbergl__ has quit IRC | 03:38 | |
| *** udesale has joined #openstack-ansible | 03:44 | |
| *** jeferobles has joined #openstack-ansible | 03:49 | |
| cloudnull | it also looks like we're running into issues with the basic test app install http://logs.openstack.org/07/572207/2/check/openstack-ansible-functional-ubuntu-xenial/386e5af/job-output.txt.gz#_2018-06-05_03_27_57_156381 | 03:53 |
| *** tux_ has quit IRC | 03:58 | |
| *** dxiri has quit IRC | 04:00 | |
| *** klamath has quit IRC | 04:04 | |
| *** poopcat has quit IRC | 04:05 | |
| openstackgerrit | Merged openstack/openstack-ansible-os_keystone master: Add rabbit driver ssl config option https://review.openstack.org/572169 | 04:21 |
| *** chhagarw has joined #openstack-ansible | 04:50 | |
| *** gyee has quit IRC | 05:00 | |
| openstackgerrit | Merged openstack/openstack-ansible-tests stable/ocata: Backport to refactor hardcoded branch references https://review.openstack.org/566718 | 05:09 |
| openstackgerrit | Merged openstack/openstack-ansible-tests master: Move database creation into role (heat) https://review.openstack.org/571750 | 05:09 |
| openstackgerrit | Merged openstack/openstack-ansible-tests master: Move database creation into role (ironic) https://review.openstack.org/571760 | 05:09 |
| openstackgerrit | Merged openstack/openstack-ansible-tests master: Move database creation into role (neutron) https://review.openstack.org/571782 | 05:09 |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-ops master: Add documentation on running os-profiler with ELK https://review.openstack.org/572256 | 05:16 |
| *** nurdie has quit IRC | 05:35 | |
| *** nurdie has joined #openstack-ansible | 05:36 | |
| *** sar has joined #openstack-ansible | 05:39 | |
| *** nurdie has quit IRC | 05:40 | |
| openstackgerrit | Merged openstack/openstack-ansible-tests master: Move database creation into role (cinder) https://review.openstack.org/571731 | 05:42 |
| openstackgerrit | Merged openstack/openstack-ansible-tests master: Move database creation into role (sahara) https://review.openstack.org/571796 | 05:42 |
| *** yolanda_ is now known as yolanda | 05:48 | |
| openstackgerrit | Merged openstack/openstack-ansible-tests master: Move database creation into role (horizon) https://review.openstack.org/571756 | 05:48 |
| *** jeferobles has quit IRC | 05:58 | |
| *** mma has joined #openstack-ansible | 05:59 | |
| *** mma has quit IRC | 05:59 | |
| *** mma has joined #openstack-ansible | 05:59 | |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-ops master: Add options to improve beat to log stash performance https://review.openstack.org/572259 | 06:02 |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-ops master: Add documentation on running os-profiler with ELK https://review.openstack.org/572256 | 06:02 |
| cloudnull | jrosser ^ | 06:03 |
| cloudnull | thats what we've found to be +/- working. | 06:03 |
| cloudnull | if you try it all out I'd greatly appreciate your feed back there. | 06:03 |
| *** DanyC has joined #openstack-ansible | 06:16 | |
| *** cjloader has joined #openstack-ansible | 06:20 | |
| *** cshen has joined #openstack-ansible | 06:22 | |
| *** DanyC has quit IRC | 06:24 | |
| *** DanyC has joined #openstack-ansible | 06:25 | |
| *** cjloader has quit IRC | 06:25 | |
| jrosser | cloudnull: sure i will take a look today | 06:27 |
| *** DanyC has quit IRC | 06:29 | |
| *** DanyC has joined #openstack-ansible | 06:30 | |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-ops master: Add documentation on running os-profiler with ELK https://review.openstack.org/572256 | 06:32 |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-ops master: Add documentation on running os-profiler with ELK https://review.openstack.org/572256 | 06:37 |
| *** nurdie has joined #openstack-ansible | 06:37 | |
| openstackgerrit | Niraj Singh proposed openstack/openstack-ansible-os_masakari master: Add doc for installing masakari role https://review.openstack.org/572264 | 06:41 |
| *** DanyC has quit IRC | 06:42 | |
| *** DanyC has joined #openstack-ansible | 06:42 | |
| *** epalper has joined #openstack-ansible | 06:43 | |
| *** armaan_ has quit IRC | 06:44 | |
| *** armaan has joined #openstack-ansible | 06:44 | |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-ops master: Add documentation on running os-profiler with ELK https://review.openstack.org/572256 | 06:47 |
| *** DanyC has quit IRC | 06:47 | |
| *** pcaruana has joined #openstack-ansible | 06:54 | |
| *** jbadiapa has joined #openstack-ansible | 07:01 | |
| *** gkadam has quit IRC | 07:02 | |
| *** pcaruana is now known as pcaruana|worksho | 07:03 | |
| *** lvdombrkr has joined #openstack-ansible | 07:06 | |
| *** sar has quit IRC | 07:11 | |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-ops master: Add documentation on running os-profiler with ELK https://review.openstack.org/572256 | 07:11 |
| jrosser | cloudnull: looks like there is an osprofiler consumer in horizon too plus some panels | 07:20 |
| openstackgerrit | Markos Chandras (hwoarang) proposed openstack/openstack-ansible-tests master: zuul.d: Add new openSUSE Leap 15 jobs https://review.openstack.org/572109 | 07:27 |
| *** jbadiapa has quit IRC | 07:32 | |
| *** jbadiapa has joined #openstack-ansible | 07:33 | |
| cloudnull | jrosser looks like we need something like http://paste.openstack.org/show/722694/ to make it work | 07:34 |
| cloudnull | in horizon | 07:34 |
| cloudnull | and on that note, im off to bed. | 07:34 |
| cloudnull | bbl | 07:34 |
| *** Taseer has quit IRC | 07:36 | |
| *** Taseer has joined #openstack-ansible | 07:39 | |
| *** DanyC has joined #openstack-ansible | 07:44 | |
| *** pcaruana|worksho is now known as pcaruana | 07:50 | |
| *** blinkiz has joined #openstack-ansible | 07:50 | |
| *** shardy has joined #openstack-ansible | 07:58 | |
| *** epalper has quit IRC | 07:58 | |
| *** epalper has joined #openstack-ansible | 07:59 | |
| hwoarang | hmm looks like centos is having issues | 08:07 |
| * hwoarang rechecks | 08:07 | |
| openstackgerrit | Markos Chandras (hwoarang) proposed openstack/openstack-ansible-pip_install master: SUSE: Add support for openSUSE Leap 15 https://review.openstack.org/572292 | 08:10 |
| *** chigang__ has quit IRC | 08:12 | |
| openstackgerrit | Markos Chandras (hwoarang) proposed openstack/openstack-ansible-openstack_hosts master: SUSE: Add support for openSUSE Leap 15 https://review.openstack.org/572293 | 08:13 |
| *** radek__ has joined #openstack-ansible | 08:14 | |
| *** tosky has joined #openstack-ansible | 08:15 | |
| *** pvradu has joined #openstack-ansible | 08:19 | |
| *** gkadam has joined #openstack-ansible | 08:21 | |
| *** jmnk has quit IRC | 08:33 | |
| *** epalper has quit IRC | 08:38 | |
| *** gregoryo has joined #openstack-ansible | 08:39 | |
| evrardjp | ok, where are we today? | 08:39 |
| *** jmnk has joined #openstack-ansible | 08:40 | |
| evrardjp | master is still borked I see. | 08:41 |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible master: Set metadata for test volumes to single https://review.openstack.org/572307 | 08:41 |
| *** tototi has joined #openstack-ansible | 08:45 | |
| *** tototi has quit IRC | 08:46 | |
| Tahvok | cloudnull: hey! Can you tell me what's the problem with this one? https://review.openstack.org/#/c/549291/ | 08:53 |
| *** epalper has joined #openstack-ansible | 08:58 | |
| *** electrofelix has joined #openstack-ansible | 09:03 | |
| *** gregoryo has quit IRC | 09:14 | |
| *** sar has joined #openstack-ansible | 09:20 | |
| *** sar has quit IRC | 09:28 | |
| niraj_singh | evrardjp: https://review.openstack.org/#/c/568811/ please have a look. | 09:44 |
| *** jiteka has quit IRC | 09:48 | |
| *** jiteka- has quit IRC | 09:48 | |
| *** epalper has quit IRC | 09:57 | |
| *** lvdombrkr has quit IRC | 09:58 | |
| *** sar has joined #openstack-ansible | 10:00 | |
| *** sar has quit IRC | 10:05 | |
| evrardjp[m] | niraj_singh: check your inventory | 10:14 |
| evrardjp[m] | I can help later. | 10:20 |
| niraj_singh | ok thank you :) | 10:22 |
| *** cjloader has joined #openstack-ansible | 10:23 | |
| evrardjp[m] | in fact, I can't really help today... Can you check with someone else? Comparing inventories from other roles should help. Check the host vars and group vars too. | 10:25 |
| *** cjloader has quit IRC | 10:28 | |
| ebbex_ | Ok, so yesterday I ran into a strange problem where I had issues using https_proxy with haproxy_server role, so I ended up commenting it out. Now doing a fresh install, pip_install fails because I have *not* specified the https_proxy, and commenting it in seems to work. | 10:36 |
| *** Bhujay has joined #openstack-ansible | 10:38 | |
| *** flaviosr_ has quit IRC | 10:44 | |
| *** flaviosr_ has joined #openstack-ansible | 10:45 | |
| *** epalper has joined #openstack-ansible | 10:50 | |
| *** lhinds has quit IRC | 10:50 | |
| *** tosky__ has joined #openstack-ansible | 10:51 | |
| *** lhinds has joined #openstack-ansible | 10:51 | |
| *** lvdombrkr has joined #openstack-ansible | 10:51 | |
| *** tosky has quit IRC | 10:52 | |
| *** lvdombrkr89 has joined #openstack-ansible | 10:54 | |
| *** hassenius has joined #openstack-ansible | 10:55 | |
| *** hasseniu_ has joined #openstack-ansible | 10:55 | |
| *** lvdombrkr has quit IRC | 10:56 | |
| *** lhinds has quit IRC | 10:57 | |
| *** lhinds has joined #openstack-ansible | 10:59 | |
| *** hassenius has quit IRC | 10:59 | |
| *** ianw has quit IRC | 11:13 | |
| *** gkadam has quit IRC | 11:17 | |
| *** gkadam has joined #openstack-ansible | 11:17 | |
| *** udesale has quit IRC | 11:17 | |
| *** udesale has joined #openstack-ansible | 11:17 | |
| *** udesale has quit IRC | 11:23 | |
| *** ianw has joined #openstack-ansible | 11:32 | |
| evrardjp | hwoarang: do you want me to update the previous week highlights for today's meeting, by adding SLE15? | 11:33 |
| *** nurdie_ has joined #openstack-ansible | 11:34 | |
| *** nurdie has quit IRC | 11:35 | |
| evrardjp | I did it, if you're not happy you can change it :) | 11:36 |
| openstackgerrit | Niraj Singh proposed openstack/openstack-ansible-os_masakari master: Fix functional test https://review.openstack.org/568811 | 11:40 |
| *** epalper has quit IRC | 11:44 | |
| *** ansmith has quit IRC | 11:50 | |
| openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-ops master: Bypass pip constraints when installing Elastic Curator https://review.openstack.org/572355 | 12:00 |
| openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-ops master: Point metricbeat haproxy collector to existing stats endpoint https://review.openstack.org/572356 | 12:00 |
| openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-ops master: Point metricbeat rabbitmq collector to existing rabbitmq endpoint https://review.openstack.org/572357 | 12:00 |
| openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-ops master: Enable apache2 status and collect with metricbeat https://review.openstack.org/572358 | 12:00 |
| openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-ops master: Increase accuracy of detecting apache install https://review.openstack.org/572359 | 12:00 |
| openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-ops master: Enable nginx metric collection with metricbeat https://review.openstack.org/572360 | 12:00 |
| openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-ops master: Point metricbeat to the correct address for memcached stats https://review.openstack.org/572361 | 12:00 |
| *** czunker has joined #openstack-ansible | 12:00 | |
| *** czunker has left #openstack-ansible | 12:08 | |
| openstackgerrit | Jean-Philippe Evrard proposed openstack/openstack-ansible-galera_server master: Bump minor version of mariadb https://review.openstack.org/572365 | 12:12 |
| openstackgerrit | Jean-Philippe Evrard proposed openstack/openstack-ansible-galera_client master: Bump minor version of mariadb https://review.openstack.org/572366 | 12:14 |
| *** jiteka has joined #openstack-ansible | 12:19 | |
| *** jitek4 has joined #openstack-ansible | 12:20 | |
| openstackgerrit | Merged openstack/openstack-ansible-tests master: zuul.d: Add new openSUSE Leap 15 jobs https://review.openstack.org/572109 | 12:21 |
| *** tosky__ is now known as tosky | 12:23 | |
| evrardjp | so FYI, the rabbitmq version we are using is now EOL | 12:28 |
| evrardjp | it would be nice to have someone working on it | 12:28 |
| *** armaan has quit IRC | 12:32 | |
| mgariepy | evrardjp, osa leadership meeting are you waiting for other votes ? | 12:34 |
| evrardjp | mgariepy: yes. | 12:34 |
| evrardjp | But I think it will happen next week. | 12:35 |
| mgariepy | evrardjp, do you mind sending an invite ? | 12:36 |
| mgariepy | or at least an email with the scheduled date and time ? :D | 12:36 |
| evrardjp | I will wait for the others to vote first. | 12:36 |
| evrardjp | if you don't mind | 12:36 |
| mgariepy | nah i don't mind at all, just wanted to make sure you send the detail after :D | 12:38 |
| mnaser | if master is borked i will dig in a bit | 12:38 |
| hwoarang | evrardjp: sle15? that's too ambitious | 12:39 |
| evrardjp | opensuse15 | 12:39 |
| evrardjp | sorry | 12:39 |
| evrardjp | mnaser: you've done your fair share recently, let's have more ppl fixing things! | 12:40 |
| evrardjp | mnaser: if I could choose, I'd prefer you try the distro packages for CentOS :) | 12:40 |
| *** dxiri has joined #openstack-ansible | 12:44 | |
| openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-ops master: Optionally collect uwsgi stats from unix domain sockets https://review.openstack.org/572374 | 12:49 |
| *** dxiri has quit IRC | 12:52 | |
| cloudnull | evrardjp re rabbit and erlang https://review.openstack.org/#/c/572196/ | 12:53 |
| cloudnull | I could use a hand to understand what the issue is with the upgrade job. | 12:54 |
| cloudnull | The first pr we need to backport to Queens. | 12:54 |
| cloudnull | The second updates rabbit and erlang. | 12:54 |
| *** dave-mccowan has joined #openstack-ansible | 12:54 | |
| openstackgerrit | Merged openstack/openstack-ansible-ops master: Add options to improve beat to log stash performance https://review.openstack.org/572259 | 12:57 |
| jrosser | cloudnull: i'm just about to start looking at the osprofiler stuff | 12:58 |
| jrosser | sort of got distracted with metricsbeat stuff but thats now vastly more working than it was before | 13:00 |
| cloudnull | Nice! | 13:00 |
| evrardjp | cloudnull: oh cool | 13:01 |
| evrardjp | I put your name on the etherpad. | 13:01 |
| mnaser | evrardjp: cool, i'm still mulling over the uwsgi problem :( | 13:02 |
| lvdombrkr89 | hello folks | 13:02 |
| evrardjp | mnaser: that's good too | 13:03 |
| evrardjp | I don't know which one you're talking about, but that's good mnaser :) | 13:03 |
| lvdombrkr89 | can anyone point me to latest openstack-ansible installation guide> | 13:03 |
| evrardjp | (we have many sadly) | 13:03 |
| evrardjp | docs.openstack.org | 13:03 |
| evrardjp | lvdombrkr89: ^ | 13:03 |
| mnaser | evrardjp: we install uwsgi from epel-release, epel-release has conflicts with packages in the rdo repo | 13:03 |
| evrardjp | lvdombrkr89: latest stable, right? | 13:03 |
| lvdombrkr89 | evrardjp: sure | 13:03 |
| evrardjp | lvdombrkr89: yup on docs.openstack.org you arrive on queens by default | 13:04 |
| evrardjp | take deployment guide, and follow the openstack-ansible one :) | 13:04 |
| evrardjp | you should be good :) | 13:04 |
| openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-ops master: Add config override docs for gathering uwsgi stats https://review.openstack.org/572377 | 13:05 |
| *** throwsb1 has joined #openstack-ansible | 13:06 | |
| evrardjp | jrosser: is on a row! | 13:07 |
| lvdombrkr89 | evrardjp: when i last time deploy openstack-ansible it was more suitable for ubuntu than centos. something has changed? ) | 13:07 |
| evrardjp | ubuntu has more users lvdombrkr89 | 13:07 |
| *** ansmith has joined #openstack-ansible | 13:07 | |
| evrardjp | hello ansmith | 13:07 |
| evrardjp | thanks for the patches! | 13:08 |
| lvdombrkr89 | evrardjp: its tested on both? | 13:08 |
| evrardjp | lvdombrkr89: I would still recommend ubuntu for newcomers. | 13:08 |
| *** sar has joined #openstack-ansible | 13:08 | |
| evrardjp | lvdombrkr89: it's tested on 3 platforms, but some don't pass testing :p | 13:08 |
| ansmith | evrardjp: your welcome, although I still see ssl issue in the integrate-deploy-aio | 13:08 |
| evrardjp | temporarily | 13:08 |
| evrardjp | ansmith: not everything has merged I think | 13:09 |
| openstackgerrit | Markos Chandras (hwoarang) proposed openstack/openstack-ansible-openstack_hosts master: tasks: openstack_hosts_configure_dns: Fix dnf->yum symlink https://review.openstack.org/572381 | 13:09 |
| hwoarang | cores: a somewhat urgent fix for centos?^ | 13:09 |
| hwoarang | thanks | 13:09 |
| ansmith | evrardjp: will keep an eye on it | 13:09 |
| jrosser | evrardjp: o/ keeping busy :) | 13:10 |
| openstackgerrit | Markos Chandras (hwoarang) proposed openstack/openstack-ansible-tests master: Vagrantfile: Add workaround for Virtualbox bug on guest audio config https://review.openstack.org/572384 | 13:10 |
| openstackgerrit | Markos Chandras (hwoarang) proposed openstack/openstack-ansible-openstack_hosts master: tasks: openstack_hosts_configure_dns: Fix dnf->yum symlink https://review.openstack.org/572381 | 13:13 |
| lvdombrkr89 | evrardjp: thanks for information. any known issues on centos right know?\+ | 13:13 |
| mnaser | hey i'm not sure if anyone have seen this before but it's a cool project | 13:14 |
| mnaser | https://github.com/jonashaag/bjoern | 13:14 |
| mnaser | https://github.com/kubeup/python-wsgi-benchmark | 13:15 |
| mnaser | seems pretty fast | 13:15 |
| mgariepy | nice :: Single-threaded and without coroutines or other crap | 13:16 |
| *** nurdie_ has quit IRC | 13:17 | |
| evrardjp | that's cool, but simple | 13:18 |
| evrardjp | or should I say and simple | 13:18 |
| evrardjp | I am not sure it fits the spec we have for wiring things automatically to the host | 13:19 |
| mnaser | oh it was just "this is a cool thing i ran into so just fyi" | 13:19 |
| mnaser | so we have this -- https://bugzilla.redhat.com/show_bug.cgi?id=1586080 | 13:19 |
| openstack | bugzilla.redhat.com bug 1586080 in distribution "UWSGI packages missing from RDO" [Unspecified,New] - Assigned to amoralej | 13:19 |
| mnaser | and hopefully the RDO team will help rebuild uwsgi into rdo | 13:19 |
| lvdombrkr89 | evrardjp: is still openstack-ansible use linux-bridges not ovs-bridge? | 13:20 |
| mnaser | lvdombrkr89: you can do both | 13:20 |
| *** sar has quit IRC | 13:20 | |
| *** armaan has joined #openstack-ansible | 13:21 | |
| evrardjp | lvdombrkr89: you will learn that I am a very conservative person: When it works, why trying something else :) | 13:23 |
| *** esberglu has joined #openstack-ansible | 13:26 | |
| openstackgerrit | Niraj Singh proposed openstack/openstack-ansible-os_masakari master: Fix functional test https://review.openstack.org/568811 | 13:27 |
| lvdombrkr89 | evrardjp: +1 )) | 13:29 |
| *** jbadiapa has quit IRC | 13:29 | |
| lvdombrkr89 | evrardjp: you mentioned three platforms, centos ubuntu and ? | 13:30 |
| openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-ops master: Use hostname rather than ip when collecting mysql stats https://review.openstack.org/572392 | 13:32 |
| mgariepy | lvdombrkr89, openSUSE 42.X 64-bit | 13:32 |
| lvdombrkr89 | mgariepy: mhmm.. interesting | 13:33 |
| lvdombrkr89 | mnaser: thanks | 13:33 |
| *** cjloader has joined #openstack-ansible | 13:34 | |
| mgariepy | mnaser, did you test deploying ovs on centos ? | 13:34 |
| lvdombrkr89 | mgariepy mnaser : i tried some time ago and had issues, its why i asked now | 13:37 |
| mnaser | mgariepy: we have a few ovs+centos deployments with no issues | 13:37 |
| lvdombrkr89 | and its why i came back after some time to investigate what new )) | 13:37 |
| lvdombrkr89 | im centos person | 13:37 |
| lvdombrkr89 | )) | 13:37 |
| mnaser | lvdombrkr89: works for me, but warning.. it's not the straight forward way | 13:37 |
| mnaser | so you will find some difficulties | 13:37 |
| mnaser | i suggest you become comfortable with OSA before exploring those paths | 13:38 |
| mgariepy | i run with linuxbridge because it's simple and my previous experience with ovs 3 years ago wasn't great :) | 13:38 |
| mgariepy | jra, ^^ | 13:38 |
| lvdombrkr89 | mgariepy: you run on centos> | 13:38 |
| lvdombrkr89 | > | 13:38 |
| lvdombrkr89 | ? | 13:38 |
| mgariepy | not right now i'm on ubuntu | 13:38 |
| mgariepy | i might switch to centos on the next upgrade tho. not quite sure yet. | 13:39 |
| mnaser | openstack ansible cores (odyssey4me, cloudnull, evrardjp, hwoarang): please chime in here https://bugzilla.redhat.com/show_bug.cgi?id=1586080 | 13:39 |
| openstack | bugzilla.redhat.com bug 1586080 in distribution "Add UWSGI packages to RDO Rocky" [Unspecified,New] - Assigned to amoralej | 13:39 |
| lvdombrkr89 | is there anyone around who use centos on production? | 13:39 |
| mgariepy | next OS upgrade. | 13:39 |
| *** fyx has joined #openstack-ansible | 13:39 | |
| mnaser | lvdombrkr89: i do | 13:40 |
| mgariepy | jra is. | 13:40 |
| mgariepy | OS as in operating system. | 13:40 |
| mgariepy | dans it's not clear haha | 13:40 |
| *** jwitko_ has joined #openstack-ansible | 13:40 | |
| hwoarang | mnaser: my impression is that things were moving away from httpd/mod_wsgi to uwsgi | 13:41 |
| *** jbadiapa has joined #openstack-ansible | 13:41 | |
| hwoarang | i least those which use uwsgi were migrated from httpd/mod_wsgi | 13:41 |
| hwoarang | but dont quote me on that | 13:41 |
| lvdombrkr89 | mgariepy : why u choose deploy on centos not ubuntu? | 13:41 |
| mgariepy | i would choose centos so i can keep my system longer, ubuntu need to be upgraded every ~~ 2 years | 13:42 |
| openstackgerrit | Logan V proposed openstack/openstack-ansible-rabbitmq_server master: Variable node address https://review.openstack.org/572397 | 13:42 |
| openstackgerrit | Markos Chandras (hwoarang) proposed openstack/openstack-ansible-openstack_hosts master: SUSE: Add support for openSUSE Leap 15 https://review.openstack.org/572293 | 13:42 |
| mnaser | hwoarang: if you can recall where you saw that, it would be helpful to put that down | 13:43 |
| mgariepy | lvdombrkr89, also uca is not really open atm | 13:44 |
| *** kstev has joined #openstack-ansible | 13:44 | |
| hwoarang | mnaser: just git history :) | 13:44 |
| mgariepy | not that i currently have any issue with ubuntu | 13:44 |
| mnaser | hwoarang: oh are we talking about OSA favoring uwsgi or openstack in general | 13:45 |
| hwoarang | just osa | 13:45 |
| *** jeferobles has joined #openstack-ansible | 13:45 | |
| mgariepy | but deploying from source saved me a couple of time when i needed some patches from upstream project. | 13:46 |
| *** kstev1 has joined #openstack-ansible | 13:46 | |
| *** kstev has quit IRC | 13:48 | |
| *** radeks has joined #openstack-ansible | 13:49 | |
| lvdombrkr89 | mgariepy: thanks. any issues in/after deployment? i mean issues which related only to centos | 13:49 |
| mgariepy | lvdombrkr89, i'm running on ubuntu atm | 13:52 |
| mgariepy | lvdombrkr89, mnaser, would be able to answer you i guess. | 13:53 |
| mnaser | it runs fine | 13:53 |
| mnaser | but you're walking a lonely path though :( | 13:53 |
| *** jwitko_ has quit IRC | 13:54 | |
| *** jwitko_ has joined #openstack-ansible | 13:54 | |
| cloudnull | mnaser how much work or variance is there using gunicorn or httpd/mod_wsgi when compared to the uwsgi things we already have? | 13:57 |
| cloudnull | is it radically different to setup ? | 13:57 |
| cloudnull | mgariepy ++ source has saved us at RAX, frequently. | 13:59 |
| lvdombrkr89 | mgariepy: sorry )) | 13:59 |
| Adri2000 | no one noticed an issue with the spice-html5 git repo yet? | 13:59 |
| cloudnull | Adri2000 whats the issue your seeing ? | 14:00 |
| mnaser | cloudnull: a lot, and i prefer uwsgi in terms of performance. i think the rdo team wants to hear a "hey, we've actually looked into it.. and this is why we think uwsgi is better" | 14:00 |
| mnaser | i think it would be productive to have people with more experience in the history of this chime in :) | 14:00 |
| Adri2000 | cloudnull: they're not on github anymore :) | 14:00 |
| cloudnull | Adri2000 oh, that's a bummer | 14:00 |
| Adri2000 | https://github.com/SPICE/spice-html5 ... https://gitlab.freedesktop.org/spice/spice-html5 | 14:00 |
| mnaser | sigh really | 14:00 |
| Adri2000 | pushing patch now | 14:00 |
| mnaser | Adri2000: ++ thank you | 14:00 |
| openstackgerrit | Adrien Cunin proposed openstack/openstack-ansible master: Updated spice-html5 git repository URL https://review.openstack.org/572405 | 14:01 |
| lvdombrkr89 | mnaser: yes i understood , thats why im asking | 14:01 |
| lvdombrkr89 | and why im here | 14:01 |
| *** armaan has quit IRC | 14:02 | |
| *** armaan has joined #openstack-ansible | 14:03 | |
| cloudnull | https://vignette.wikia.nocookie.net/epicrapbattlesofhistory/images/7/7a/This_is_why_we_can%27t_have_nice_things_Obama_meme.jpg/revision/latest?cb=20140513191023 | 14:05 |
| *** kstev1 has quit IRC | 14:06 | |
| *** rodolof has joined #openstack-ansible | 14:08 | |
| *** pvradu has quit IRC | 14:10 | |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible stable/queens: Updated spice-html5 git repository URL https://review.openstack.org/572408 | 14:10 |
| mnaser | i dig the topic | 14:11 |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible stable/pike: Updated spice-html5 git repository URL https://review.openstack.org/572409 | 14:12 |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible stable/ocata: Updated spice-html5 git repository URL https://review.openstack.org/572410 | 14:13 |
| openstackgerrit | Maksim Malchuk proposed openstack/openstack-ansible-repo_build master: Create distutils cfg before install and build https://review.openstack.org/572411 | 14:13 |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-os_nova master: Updated spice-html5 git repository URL https://review.openstack.org/572413 | 14:15 |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-os_nova stable/ocata: Updated spice-html5 git repository URL https://review.openstack.org/572414 | 14:15 |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-os_nova stable/pike: Updated spice-html5 git repository URL https://review.openstack.org/572415 | 14:15 |
| blinkiz | Am having problem with one container.. I can not understand why this is failing. lxc attaching to this container and I can wget the url without problem. https://paste.ubuntu.com/p/QPpt4pnqCb/ | 14:16 |
| *** hasseniu_ has quit IRC | 14:16 | |
| blinkiz | get modern pip failure | 14:17 |
| *** hassenius has joined #openstack-ansible | 14:17 | |
| *** hassenius has quit IRC | 14:17 | |
| *** hassenius has joined #openstack-ansible | 14:17 | |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-os_nova stable/queens: Updated spice-html5 git repository URL https://review.openstack.org/572417 | 14:18 |
| blinkiz | Did not have this problem a week ago so I do not know what has changed. Still using Queens 17.0.4. | 14:18 |
| *** hasseniu_ has joined #openstack-ansible | 14:18 | |
| cloudnull | https://review.openstack.org/#/q/topic:lost-console+(status:open+OR+status:merged) | 14:19 |
| cloudnull | if folks can help make this go it'd be appreicated | 14:20 |
| cloudnull | thanks Adri2000 for finding this | 14:20 |
| cloudnull | blinkiz what is it failing on ? | 14:20 |
| cloudnull | do you have an example of the error output you could share? | 14:21 |
| blinkiz | cloudnull, thank you for taking your time to look at my problem. It is in my paste, https://paste.ubuntu.com/p/QPpt4pnqCb/ | 14:21 |
| *** hassenius has quit IRC | 14:22 | |
| blinkiz | apparently I can not wget the failing url. Works from other containers but not this one. | 14:22 |
| *** pvradu has joined #openstack-ansible | 14:22 | |
| blinkiz | pinging 172.29.236.9 works | 14:22 |
| cloudnull | mnaser I don't any experience using gunicorn to contribute to that thread. | 14:22 |
| cloudnull | I our experience using mod_wsgi from yester-year but we only ever did that with keystone, in openstack | 14:23 |
| openstackgerrit | Maksim Malchuk proposed openstack/openstack-ansible-repo_build master: Use override pip_upstream_url for get-pip https://review.openstack.org/572422 | 14:23 |
| cloudnull | so its only failing on one container? | 14:24 |
| blinkiz | Hmmm.. I did change container_mtu: 9000 this run.. that can be a reason. The log1 machine is not a real host.. Hmmm.. | 14:25 |
| *** nurdie has joined #openstack-ansible | 14:25 | |
| *** pvradu_ has joined #openstack-ansible | 14:26 | |
| *** pvradu has quit IRC | 14:27 | |
| *** pvradu_ is now known as pvradu | 14:27 | |
| blinkiz | cloudnull, it sure was an MTU problem. Reason why ping (small package size) worked but not wget. | 14:27 |
| *** hachi has quit IRC | 14:28 | |
| *** pvradu_ has joined #openstack-ansible | 14:28 | |
| *** root__ has joined #openstack-ansible | 14:30 | |
| blinkiz | cloudnull, Is is possible to specify a different network configuration for one container (rsyslog-container) in openstack_user_config.yml? | 14:31 |
| *** pvradu has quit IRC | 14:31 | |
| *** pvradu_ is now known as pvradu | 14:31 | |
| *** lvdombrkr89 has quit IRC | 14:33 | |
| openstackgerrit | wangqi proposed openstack/openstack-ansible-repo_build master: Updated spice-html5 git repository URL https://review.openstack.org/572430 | 14:35 |
| evrardjp | hwoarang: you are right | 14:36 |
| hwoarang | about what | 14:36 |
| evrardjp | bout the migrating away from http mod wsgi | 14:36 |
| hwoarang | ok | 14:38 |
| openstackgerrit | Merged openstack/openstack-ansible-openstack_hosts master: tasks: openstack_hosts_configure_dns: Fix dnf->yum symlink https://review.openstack.org/572381 | 14:41 |
| root__ | d | 14:42 |
| *** jiteka has quit IRC | 14:44 | |
| openstackgerrit | Gaudenz Steinlin proposed openstack/openstack-ansible master: Fix loop variable name for nested loop https://review.openstack.org/572433 | 14:44 |
| *** jiteka has joined #openstack-ansible | 14:44 | |
| *** jitek4 has quit IRC | 14:45 | |
| *** ivve has joined #openstack-ansible | 14:46 | |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-repo_build master: Updated spice-html5 git repository URL https://review.openstack.org/572430 | 14:46 |
| *** sar has joined #openstack-ansible | 14:47 | |
| cloudnull | wangqi thanks for that, there was an extra whitespace on that commit, I just updated to clean that up. | 14:47 |
| cloudnull | blinkiz was this a container mtu issue ? | 14:47 |
| cloudnull | like it was running at 1450 ? | 14:48 |
| cloudnull | oh... I didint read above ... | 14:48 |
| cloudnull | so the container mtu was 9000, was this across the board? | 14:48 |
| *** jiteka- has joined #openstack-ansible | 14:49 | |
| *** hasseniu_ has quit IRC | 14:50 | |
| *** rodolof has quit IRC | 14:50 | |
| *** hassenius has joined #openstack-ansible | 14:50 | |
| blinkiz | cloudnull, I have a single virtual machine acting as log1 server according to recommended setup. This virtual machine and virtualization cluster does not have bigger MTU. I forgot that. All other machines, compute och infra servers can communicate with bigger MTU. | 14:51 |
| *** hasseniu_ has joined #openstack-ansible | 14:51 | |
| blinkiz | It's a lab environment. Not a real openstack cluster yet :) | 14:51 |
| cloudnull | ah. I dont think there's a built in way to redirect that traffic over a different network | 14:52 |
| cloudnull | but we could see about making one ? | 14:52 |
| blinkiz | Na, that is no need. I have direct access. It was just an MTU issue | 14:52 |
| *** sar has quit IRC | 14:52 | |
| cloudnull | ok. | 14:52 |
| xdfil | getting coffee | 14:54 |
| blinkiz | cloudnull, In ceph when you specify a bigger MTU, ceph is verifying MTU size on going to verify that it really is possible to use bigger MTU. Maybe that is good idea for openstack-ansible. | 14:54 |
| evrardjp | mnaser: I know a few people that would be happy to have a wsgi server named bjoern at RAX. | 14:55 |
| *** hassenius has quit IRC | 14:55 | |
| evrardjp | (sorry for the private joke, but I had to!) | 14:55 |
| *** cjloader has quit IRC | 14:56 | |
| blinkiz | cloudnull, here is the commit done by ceph devs when they got tired of helping people specifying bigger MTU but not having networks that can handle it. https://tracker.ceph.com/issues/20087 | 14:56 |
| *** rodolof has joined #openstack-ansible | 14:58 | |
| xdfil | evrardjp: many people in the inner-city would also like a cloud infrastructure platform called "UrbanStack" | 14:58 |
| *** cshen has quit IRC | 14:59 | |
| *** cjloader_ has joined #openstack-ansible | 15:00 | |
| openstackgerrit | Gaudenz Steinlin proposed openstack/openstack-ansible-os_nova stable/queens: Fix nova_console_novnc_ssl.yml include path https://review.openstack.org/572434 | 15:01 |
| evrardjp | xdfil: lol | 15:02 |
| openstackgerrit | Gaudenz Steinlin proposed openstack/openstack-ansible-os_nova stable/pike: Fix nova_console_novnc_ssl.yml include path https://review.openstack.org/572435 | 15:02 |
| openstackgerrit | Gaudenz Steinlin proposed openstack/openstack-ansible-os_nova stable/ocata: Fix nova_console_novnc_ssl.yml include path https://review.openstack.org/572437 | 15:02 |
| openstackgerrit | Jean-Philippe Evrard proposed openstack/openstack-ansible-galera_server master: Bump minor version of mariadb https://review.openstack.org/572365 | 15:04 |
| *** pcaruana has quit IRC | 15:05 | |
| *** tux_ has joined #openstack-ansible | 15:07 | |
| openstackgerrit | Jean-Philippe Evrard proposed openstack/openstack-ansible-repo_build master: Updated spice-html5 git repository URL https://review.openstack.org/572430 | 15:08 |
| evrardjp | folks we have meeting in 45 minutes | 15:14 |
| evrardjp | Dear cloudnull, DimGR, andymccr, d34dh0r53, hughsaunders, b3rnard0, palendae,odyssey4me, serverascode, rromans, erikmwilson, mancdaz, _shaps_, BjoernT,claco, echiu, dstanek, jwagner, ayoung, prometheanfire, evrardjp, arbrandes,mhayden, scarlisle, luckyinva, ntt, javeriak, spotz, vdo, jmccrory,alextricity25, jasondotstar, admin0, michaelgugino, ametts, bgmccollum,darrenc, JRobinson__, asettle, | 15:15 |
| evrardjp | colinmcnamara, thorst, adreznec, eil397,qwang,nishpatwa_, cathrichardson, drifterza, hwoarang, cshen, ullbeking, Tahvok meeting in 45 minutes! | 15:15 |
| evrardjp | so it's done. | 15:15 |
| * hughsaunders waves at evrardjp | 15:15 | |
| andymccr | \o/ | 15:15 |
| spotz | o? | 15:15 |
| evrardjp | hughsaunders: ! | 15:16 |
| evrardjp | wow! | 15:16 |
| evrardjp | how are things? | 15:16 |
| prometheanfire | o/ | 15:17 |
| hughsaunders | evrardjp: good thanks evrardjp | 15:17 |
| hughsaunders | evrardjp: hows the chapeau rouge? | 15:18 |
| *** dxiri has joined #openstack-ansible | 15:20 | |
| *** udesale has joined #openstack-ansible | 15:24 | |
| *** radeks has quit IRC | 15:25 | |
| *** radek__ has quit IRC | 15:25 | |
| evrardjp | I don't have one? | 15:26 |
| *** Bhujay has quit IRC | 15:26 | |
| evrardjp | hughsaunders: ^ | 15:26 |
| hughsaunders | aww sad times | 15:26 |
| evrardjp | I have only an interesting green animal | 15:26 |
| *** udesale has quit IRC | 15:26 | |
| hughsaunders | oooh | 15:27 |
| evrardjp | :) | 15:27 |
| *** udesale has joined #openstack-ansible | 15:27 | |
| *** udesale has quit IRC | 15:28 | |
| *** udesale has joined #openstack-ansible | 15:29 | |
| *** jbadiapa has quit IRC | 15:30 | |
| *** udesale has quit IRC | 15:30 | |
| tux_ | Folks I am planning to build Ceph block storage for my openstack environment and this is what i have in my inventory... Someone can advice me how should i use these inventory to build my first storage ? | 15:32 |
| -tux_- 5 Server DL380 G8 (32 core / 32GB Mem /10G NIC) | 15:32 | |
| -tux_- 16 500GB SSD | 15:32 | |
| -tux_- 16 1TB HDD ( 7500k RPMS) | 15:32 | |
| *** cjloader_ has quit IRC | 15:33 | |
| *** pvradu has quit IRC | 15:33 | |
| *** udesale has joined #openstack-ansible | 15:33 | |
| *** cjloader has joined #openstack-ansible | 15:33 | |
| *** udesale has quit IRC | 15:34 | |
| *** jeferobles has quit IRC | 15:34 | |
| hwoarang | has anyone noted that openstack-hosts role does not seem to test anything? | 15:34 |
| hwoarang | https://review.openstack.org/#/c/572293/ | 15:34 |
| hwoarang | :) | 15:34 |
| hwoarang | the tests that are executed are pretty useless | 15:34 |
| *** Leo_m has joined #openstack-ansible | 15:34 | |
| *** jeferobles has joined #openstack-ansible | 15:35 | |
| *** jeferobles has quit IRC | 15:35 | |
| hwoarang | what i mean is that tests/test.yml is never executed | 15:35 |
| hwoarang | veeeery strange | 15:38 |
| evrardjp | wait what? | 15:40 |
| hwoarang | same thing on https://review.openstack.org/#/c/572292/ | 15:41 |
| hwoarang | i am guessing that opensuse-150 (which times out really) messes things up | 15:41 |
| evrardjp | OMG | 15:41 |
| hwoarang | on zuul | 15:41 |
| hwoarang | let me check on something older | 15:41 |
| hwoarang | yeah could be that. | 15:42 |
| evrardjp | pip install is fast though | 15:42 |
| evrardjp | wait | 15:42 |
| hwoarang | older jobs seems fine | 15:42 |
| hwoarang | yeah but if you check the logs nothing really was executed | 15:42 |
| hwoarang | opensuse-150 is broken it needs some glean changes which i am testing right now. so there are no nodes on zuul. and it should really just timeout instead of giving +1 on everything | 15:43 |
| hwoarang | bug bug bug | 15:43 |
| evrardjp | yes I see | 15:43 |
| evrardjp | I am super scared | 15:43 |
| evrardjp | yeah | 15:43 |
| evrardjp | OMG | 15:43 |
| evrardjp | time to merge patches | 15:43 |
| evrardjp | trololol | 15:43 |
| hwoarang | what a strange bug | 15:44 |
| evrardjp | hwoarang: can we quickly revert the inclusion? | 15:44 |
| evrardjp | yeah that's silent | 15:44 |
| hwoarang | it was not included | 15:44 |
| evrardjp | I check the gating times, so I thought this was about normal, just a little fast. | 15:44 |
| *** dxiri has quit IRC | 15:44 | |
| hwoarang | i dont even know how to explain this bug to zuul people ;p | 15:45 |
| *** tux__ has joined #openstack-ansible | 15:45 | |
| evrardjp | changed my voete | 15:45 |
| evrardjp | just do an empty patch on pip install | 15:45 |
| evrardjp | and show https://review.openstack.org/#/c/572292/1 | 15:45 |
| *** dxiri has joined #openstack-ansible | 15:46 | |
| *** jmnk has quit IRC | 15:46 | |
| evrardjp | omg | 15:46 |
| spotz | Poor zuul | 15:46 |
| *** jmnk has joined #openstack-ansible | 15:46 | |
| hwoarang | it's funny that it goes all the way to run_tests_common and it never actually executes the tox command | 15:47 |
| hwoarang | why is it so picky about the tox command? | 15:47 |
| hwoarang | maybe there is an AI in zuul | 15:47 |
| hwoarang | making decisions for us | 15:47 |
| spotz | I'd say chat with Monty is in order? | 15:47 |
| evrardjp | haha | 15:47 |
| evrardjp | chat in infra at least | 15:47 |
| hwoarang | yeah pinged him on infra | 15:48 |
| evrardjp | hwoarang: Maybe worth checking if the inheritance of jobs work fine | 15:48 |
| *** tux_ has quit IRC | 15:48 | |
| hwoarang | dont know | 15:49 |
| openstackgerrit | Shannon Mitchell proposed openstack/openstack-ansible-ops master: Fix vcpu override var issue for logging hostvar. https://review.openstack.org/572456 | 15:49 |
| *** yolanda has quit IRC | 15:50 | |
| *** root__ has quit IRC | 15:51 | |
| openstackgerrit | Markos Chandras (hwoarang) proposed openstack/openstack-ansible-pip_install master: [DNM] - Testing openSUSE pip role https://review.openstack.org/496199 | 15:53 |
| evrardjp | lol | 15:53 |
| evrardjp | I thought you didn't do it | 15:53 |
| evrardjp | so I did one | 15:53 |
| evrardjp | ok cancelling | 15:53 |
| hwoarang | i alreayd had one | 15:54 |
| evrardjp | haha | 15:54 |
| evrardjp | it was an old one that you resurected then | 15:54 |
| evrardjp | :) | 15:54 |
| evrardjp | I see | 15:54 |
| evrardjp | Let's see how it goes. | 15:54 |
| *** chyka has joined #openstack-ansible | 15:56 | |
| hwoarang | hmm | 15:56 |
| evrardjp | ? | 15:57 |
| hwoarang | projects moving away from github and things break everywhere | 15:58 |
| hwoarang | :( | 15:58 |
| *** jra has quit IRC | 15:59 | |
| evrardjp | yeah, that's silly | 15:59 |
| evrardjp | which one are you talking about rn? | 15:59 |
| *** jra has joined #openstack-ansible | 15:59 | |
| hwoarang | https://github.com/SPICE/spice-html5 | 16:00 |
| evrardjp | oh there are patches already | 16:00 |
| hwoarang | iirc you fixed that except opnfv is lagging and everything is red | 16:00 |
| evrardjp | oh ok | 16:00 |
| hwoarang | meeting time? | 16:00 |
| evrardjp | it is! | 16:00 |
| evrardjp | I am available | 16:00 |
| evrardjp | I can run it | 16:00 |
| *** gyee has joined #openstack-ansible | 16:00 | |
| evrardjp | hello gyee | 16:01 |
| hwoarang | o/ | 16:01 |
| gyee | evrardjp, hey how are ya :-) | 16:01 |
| evrardjp | sorry for the delay I didn't intend to run it today :p | 16:01 |
| mnaser | evrardjp: where is that highlight list from? | 16:02 |
| evrardjp | Dear cloudnull, DimGR, andymccr, d34dh0r53, hughsaunders, b3rnard0, palendae,odyssey4me, serverascode, rromans, erikmwilson, mancdaz, _shaps_, BjoernT,claco, echiu, dstanek, jwagner, ayoung, prometheanfire, evrardjp, arbrandes,mhayden, scarlisle, luckyinva, ntt, javeriak, spotz, vdo, jmccrory,alextricity25, jasondotstar, admin0, michaelgugino, ametts, bgmccollum,darrenc, JRobinson__, asettle, | 16:02 |
| evrardjp | colinmcnamara, thorst, adreznec, eil397,qwang,nishpatwa_, cathrichardson, drifterza, hwoarang, cshen, ullbeking, Tahvok | 16:02 |
| mnaser | i put myself down in the wiki and i guess it's not from there | 16:02 |
| *** KeithMnemonic has joined #openstack-ansible | 16:02 | |
| evrardjp | it's from an old copy of the wiki | 16:02 |
| evrardjp | my bad | 16:02 |
| evrardjp | Here is our agenda for today: https://wiki.openstack.org/wiki/Meetings/openstack-ansible | 16:02 |
| evrardjp | #startmeeting openstack_ansible_meeting | 16:02 |
| openstack | Meeting started Tue Jun 5 16:02:37 2018 UTC and is due to finish in 60 minutes. The chair is evrardjp. Information about MeetBot at http://wiki.debian.org/MeetBot. | 16:02 |
| openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 16:02 |
| spotz | bad evrardjp!!!! | 16:02 |
| *** openstack changes topic to " (Meeting topic: openstack_ansible_meeting)" | 16:02 | |
| openstack | The meeting name has been set to 'openstack_ansible_meeting' | 16:02 |
| mnaser | o/ | 16:02 |
| hwoarang | o/ | 16:02 |
| evrardjp | #topic Rollcall and last week highlights | 16:03 |
| *** openstack changes topic to "Rollcall and last week highlights (Meeting topic: openstack_ansible_meeting)" | 16:03 | |
| prometheanfire | o/ | 16:03 |
| evrardjp | welcome everyone | 16:03 |
| andymccr | o/ | 16:03 |
| evrardjp | in the meantime ppl join, please have a look at what happened last week | 16:03 |
| evrardjp | evrardjp has pointed that master is broken, and help is welcomed to fix things. Zuul status should be monitored by more than one person. | 16:03 |
| evrardjp | evrardjp has posted on the ML a change about the way we do releases | 16:03 |
| evrardjp | cloudnull and ansmith asked for the inclusion of roles os_zun and qdrouterd into the OSA umbrella. | 16:03 |
| evrardjp | hwoarang is still working on distro packages, but is also working on opensuse15 support: https://review.openstack.org/#/q/topic:osa-add-leap-150+(status:open+OR+status:merged) | 16:04 |
| evrardjp | evrardjp reminded that this week is M2, and we are lagging behind the schedule: https://docs.openstack.org/openstack-ansible/latest/contributor/periodic-work.html#development-cycle-checklist . | 16:04 |
| evrardjp | andymccr is working on the bump of the ceph-ansible | 16:04 |
| evrardjp | evrardjp mentioned the rabbitmq version we are using is now EOL | 16:04 |
| evrardjp | odyssey4me has been working on https://review.openstack.org/#/q/topic:move-db-setup-into-roles+(status:open+OR+status:merged) | 16:04 |
| andymccr | it should work fine but i think the gate is broken on master atm? | 16:04 |
| evrardjp | yup, see first point. | 16:04 |
| mnaser | do we want to make some action items out of those? | 16:04 |
| evrardjp | mnaser: good question | 16:05 |
| *** yolanda has joined #openstack-ansible | 16:05 | |
| evrardjp | so, there is also something new that wasn't listed there | 16:05 |
| evrardjp | mnaser: suggested to have a list of OSA etherpads | 16:05 |
| evrardjp | which I did on the wiki | 16:05 |
| evrardjp | https://wiki.openstack.org/wiki/OpenStackAnsible | 16:05 |
| evrardjp | there is nothing interesting on the wiki except that list. :p | 16:06 |
| mnaser | sweet. i like that | 16:06 |
| * mnaser bookmarks | 16:06 | |
| evrardjp | as you can see, https://etherpad.openstack.org/p/osa-rocky-m2-deprecations | 16:06 |
| evrardjp | if you want to help, just pick a thing you want to do | 16:06 |
| *** alexr has joined #openstack-ansible | 16:06 | |
| cloudnull | o/ | 16:07 |
| mnaser | evrardjp: i think more critically we need to unbreak master for any of this stuff to go through, is anyone currently working on that? | 16:07 |
| evrardjp | for the rest of today's items, it's all about reviews. Help odyssey4me 's on the topic above, help hwoarang , and fix gates :) | 16:07 |
| ansmith | o/ | 16:07 |
| mnaser | if not, i can volunteer to speed up the unbreakage | 16:07 |
| evrardjp | I think the gate breakage came from ansmith :) | 16:07 |
| evrardjp | A few patches went in | 16:07 |
| evrardjp | I didn't get the chance to look at current state. I will do so today. | 16:08 |
| mnaser | #action mnaser investigate gate and push up fixes | 16:08 |
| mnaser | oh i'm not a chair i guess | 16:08 |
| evrardjp | #action mnaser investigate gate :p | 16:08 |
| evrardjp | Not sure it changes anything, it's recorded whether you are chair or not. | 16:08 |
| evrardjp | anyway | 16:09 |
| evrardjp | cloudnull: did you generate the bug list for today? | 16:09 |
| cloudnull | I did not. | 16:09 |
| cloudnull | I was just going to go off of the open issues | 16:09 |
| *** cjloader has quit IRC | 16:09 | |
| mnaser | would it be okay if i added a few action items to be reviewed next week? | 16:09 |
| evrardjp | hahah | 16:10 |
| cloudnull | evrardjp can you make mnaser a chair ? | 16:10 |
| evrardjp | ok | 16:10 |
| mnaser | #action andymccr bump ceph role variable defaults | 16:10 |
| evrardjp | how does that work? | 16:10 |
| mnaser | i should be okay without chair according to the meetbot docs :p | 16:10 |
| evrardjp | yeah | 16:10 |
| mnaser | #action evrardjp bump galera versions | 16:10 |
| mnaser | #action cloudnull bump rabbitmq versions | 16:10 |
| mnaser | (that way we can follow up on action items from last meeting) | 16:10 |
| evrardjp | and action anyone to do the role/upstream deprecation? | 16:11 |
| evrardjp | that's not gonna work :p | 16:11 |
| mnaser | do we have anyone that can volunteer for the other 3 items? | 16:11 |
| *** cjloader has joined #openstack-ansible | 16:11 | |
| mnaser | upstream deprecations.. i think we're doing okay with that, i saw a few patches pushed up but i'm not sure there is much to do there | 16:12 |
| hwoarang | what other 3 times? i lost track | 16:12 |
| mattt | same :) | 16:12 |
| evrardjp | see https://etherpad.openstack.org/p/osa-rocky-m2-deprecations | 16:12 |
| mnaser | ^ | 16:12 |
| mnaser | tasks #1, #2 and #3 | 16:12 |
| hwoarang | impossible for me | 16:12 |
| evrardjp | yeah it's massive work. | 16:13 |
| d34dh0r53 | I'll take one | 16:13 |
| evrardjp | cool | 16:13 |
| mnaser | d34dh0r53: which one will you be picking up, so we can have an action item? :) | 16:13 |
| d34dh0r53 | I'll take #2 | 16:13 |
| mattt | d34dh0r53: want to tag team on something? i don't think i can commit to something on my own | 16:13 |
| d34dh0r53 | mattt: sure | 16:14 |
| evrardjp | cool | 16:14 |
| mnaser | mattt: if you want, upstream deprecation isn't that difficult, you can get away with deploying an aio | 16:14 |
| evrardjp | look at us, teaming and all. | 16:14 |
| mnaser | and grep the logs for 'deprecation' | 16:14 |
| mattt | mnaser: yeah ok, i can give it a shot | 16:14 |
| evrardjp | yup | 16:14 |
| evrardjp | then read the release notes, just in case :) | 16:14 |
| mattt | which is a pile of work :( | 16:15 |
| mnaser | i guess for OSA deprecation that's a bunch of grep TODO across the source code, but yeah, it's a good exercise | 16:15 |
| mattt | hehe | 16:15 |
| mnaser | #action d34dh0r53 finish up OSA deprecations | 16:15 |
| mnaser | #action mattt work on cleaning up upstream deprecations | 16:15 |
| mnaser | (don't feel like you will be held accountable, this is just to keep track of things, if things come up, let us know and we can work together) | 16:15 |
| mnaser | can someone help me understand what is 'refresh static elements' :X | 16:16 |
| d34dh0r53 | awesome | 16:16 |
| evrardjp | mnaser: yeah, so in the roles we have static versions | 16:16 |
| evrardjp | outside all of those things | 16:17 |
| evrardjp | just bump the defaults | 16:17 |
| evrardjp | to latest standards | 16:17 |
| mattt | yeah i don't think i can read release notes for dozens of projects, but i can certainly go through the reported deprecations | 16:17 |
| evrardjp | mattt: That was a joke, I did that in the past it's insanely long. | 16:17 |
| mnaser | evrardjp: i'm still not following.. what roles for example that have static versions, maybe things like etcd and so? | 16:17 |
| mattt | evrardjp: well tbh it needs to be done! | 16:18 |
| openstackgerrit | Merged openstack/openstack-ansible-pip_install stable/queens: Ensure that pip.conf templates variables properly https://review.openstack.org/563597 | 16:18 |
| evrardjp | mnaser: just taking rally as an example: https://github.com/openstack/openstack-ansible-os_rally/blob/master/defaults/main.yml#L61-L67 | 16:19 |
| evrardjp | this is staticly set, it's not a dynamically generated list of versions | 16:19 |
| evrardjp | we do not bump it on a regular basis | 16:19 |
| evrardjp | it needs to be manually bumped. | 16:19 |
| mnaser | oh i see | 16:19 |
| evrardjp | all the roles have things like that. | 16:20 |
| evrardjp | we just need to go through all the roles, see what's going on | 16:20 |
| openstackgerrit | Merged openstack/openstack-ansible-os_nova stable/ocata: Updated spice-html5 git repository URL https://review.openstack.org/572414 | 16:20 |
| evrardjp | let me rephrase | 16:20 |
| evrardjp | all the role COULD have that | 16:20 |
| evrardjp | roles* | 16:20 |
| evrardjp | so we need to make sure we are up to date. | 16:20 |
| mnaser | okay well, if there's no one volunteering, i can pick it up, i can use codesearch and search for *_pip_packages | 16:20 |
| evrardjp | it's not only that, but yeah it's a good start. | 16:21 |
| evrardjp | I read the keystone role, everything seems fine. I did the first! woot | 16:21 |
| evrardjp | :p | 16:22 |
| mnaser | #action mnaser bump static versions in roles | 16:22 |
| evrardjp | anyway | 16:22 |
| evrardjp | let's move to bug triage | 16:22 |
| mnaser | one more topic before if that's okay? | 16:22 |
| mnaser | unless we'll have open discussion after | 16:22 |
| evrardjp | we have open discussion after | 16:22 |
| mnaser | ++ ack | 16:22 |
| evrardjp | the first section is just to remember what's going usually :p | 16:22 |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-rabbitmq_server master: Update the version of erlang to support rabbitmq https://review.openstack.org/572196 | 16:23 |
| evrardjp | but I won't prevent the enthusiasm on fixing things, that's great! | 16:23 |
| evrardjp | anyway | 16:23 |
| evrardjp | #topic bugtriage | 16:23 |
| *** openstack changes topic to "bugtriage (Meeting topic: openstack_ansible_meeting)" | 16:23 | |
| evrardjp | #link https://bugs.launchpad.net/openstack-ansible/+bug/1771489 | 16:23 |
| openstack | Launchpad bug 1771489 in openstack-ansible "lxd.service starts before lxc-dnsmasq DHCP process is available" [Undecided,New] | 16:23 |
| evrardjp | I am not sure lxd.service is the right title name | 16:24 |
| mnaser | it looks like the user already pushed up a patch for the fix | 16:24 |
| evrardjp | yeah | 16:24 |
| mnaser | and it does make sense that we start up lxc-dnsmasq before lxc | 16:24 |
| evrardjp | it sounds like a low-hanging-fruit and valid | 16:24 |
| andymccr | that said, taht seems like an ubuntu bug then | 16:25 |
| mnaser | andymccr: we override the lxc-dnsmasq service afaik | 16:25 |
| mnaser | https://github.com/openstack/openstack-ansible-lxc_hosts/blob/master/templates/lxc-dnsmasq-systemd-init.j2 | 16:25 |
| andymccr | hmm | 16:25 |
| evrardjp | andymccr: we are generating ours | 16:26 |
| evrardjp | yeah | 16:26 |
| evrardjp | thanks mnaser :) | 16:26 |
| evrardjp | maybe we should stop doing so | 16:26 |
| mnaser | it'd be nice to move towards overrides | 16:26 |
| mnaser | anyways, valid and confirmed and i'll take it and push up a patch | 16:27 |
| andymccr | what has changed though - i mean that would be a pretty critical bug so between some release and now this has caused an issue | 16:27 |
| evrardjp | anyone new should step in there, IMO | 16:28 |
| andymccr | majors comment in the linked task seems to suggest there is a reason for it | 16:28 |
| evrardjp | it's an easy to fix issue | 16:28 |
| mnaser | andymccr: i'm going to guess non deterministic behaviour | 16:28 |
| andymccr | so out of the loads of deploys that have happened on 16.04 only this bug has run into this? | 16:28 |
| andymccr | i guess im saying it seems like somebody went out of their way to disable the service, that isnt something you would do randomly | 16:29 |
| andymccr | im not saying its necessarily correct or incorrect | 16:29 |
| mnaser | andymccr: maybe on a reboot? | 16:29 |
| evrardjp | We are disabling lxc-net and implementing things. | 16:29 |
| evrardjp | mnaser: yes I believe so, when I read the bug | 16:29 |
| mnaser | we probably don't reboot our deploys much | 16:30 |
| evrardjp | (s)he tries to stop and restart containers, see how it goes | 16:30 |
| mnaser | i see no harm in us adding 'Before=lxc.service' .. because it makes sense that it should be the case | 16:30 |
| mnaser | let me see what dependencies lxc-net has | 16:30 |
| mnaser | (or if someone can look into the unit file) | 16:30 |
| * mnaser doesnt have access to an ubuntu deploy, anyone? | 16:31 | |
| mnaser | https://github.com/lxc/lxc/blob/master/config/init/systemd/lxc-net.service.in | 16:31 |
| mnaser | After=network-online.target\nBefore=lxc.service | 16:31 |
| mnaser | so we're doing our own thing and not necessarily doing it The Right Way(tm) | 16:31 |
| evrardjp | Agreed. | 16:32 |
| evrardjp | next? | 16:33 |
| mnaser | sure | 16:33 |
| evrardjp | marking confirmed high | 16:33 |
| evrardjp | and low-hanging-fruit | 16:33 |
| evrardjp | #link https://bugs.launchpad.net/openstack-ansible/+bug/1771760 | 16:34 |
| openstack | Launchpad bug 1771760 in openstack-ansible "Ensure log rotation with rsyslog is properly done in the integrated repo automatically" [Undecided,New] | 16:34 |
| *** tux__ has quit IRC | 16:34 | |
| evrardjp | ok this is to add tests. | 16:34 |
| evrardjp | confirmed low? it cannot be wishlist, as we are basically not proving anything | 16:35 |
| mnaser | yes | 16:35 |
| mnaser | i agree | 16:35 |
| andymccr | sure | 16:35 |
| evrardjp | ok next | 16:36 |
| evrardjp | #link https://bugs.launchpad.net/openstack-ansible/+bug/1771987 | 16:36 |
| openstack | Launchpad bug 1771987 in Pike "lvm is reporting problems, not sending heartbeat. Service will appear "down"" [Undecided,New] | 16:36 |
| openstackgerrit | Mohammed Naser proposed openstack/openstack-ansible-lxc_hosts master: Switch lxc-dnsmasq to start before lxc https://review.openstack.org/572459 | 16:37 |
| mnaser | hmm | 16:37 |
| mnaser | needs more info | 16:37 |
| openstackgerrit | Logan V proposed openstack/openstack-ansible-rabbitmq_server master: Variable node address https://review.openstack.org/572397 | 16:37 |
| mnaser | we need cinder-volume logs | 16:37 |
| evrardjp | that looks like a configuration issue | 16:37 |
| evrardjp | but yeah | 16:38 |
| evrardjp | could you ask for more details in the bug mnaser? | 16:38 |
| evrardjp | I mark it as incomplete | 16:38 |
| mnaser | ++ | 16:38 |
| mnaser | done | 16:38 |
| evrardjp | #link https://bugs.launchpad.net/openstack-ansible/+bug/1772690 | 16:39 |
| openstack | Launchpad bug 1772690 in openstack-ansible "Failed to find required executable rabbitmqctl" [Undecided,New] | 16:39 |
| evrardjp | that's a long name for a host | 16:39 |
| mnaser | hmm | 16:40 |
| evrardjp | ok so | 16:40 |
| evrardjp | mysql failed | 16:40 |
| openstackgerrit | Merged openstack/openstack-ansible-repo_build master: Updated spice-html5 git repository URL https://review.openstack.org/572430 | 16:40 |
| evrardjp | and then (s)he ran the next play, without fixing the first one | 16:40 |
| evrardjp | I will post a message asking for more logs | 16:41 |
| evrardjp | next | 16:41 |
| mnaser | also um | 16:41 |
| evrardjp | #link https://bugs.launchpad.net/openstack-ansible/+bug/1772690 | 16:41 |
| openstack | Launchpad bug 1772690 in openstack-ansible "Failed to find required executable rabbitmqctl" [Undecided,New] | 16:41 |
| mnaser | i suggest setenforce 0 (hide from mhayden) | 16:41 |
| evrardjp | haha | 16:41 |
| evrardjp | we just need more details | 16:41 |
| mnaser | evrardjp: if you'll post a message, ask for 'getenforce' output | 16:41 |
| mnaser | because the selinux stuff in centos isn't so well done (another reason for packaging, yay) | 16:41 |
| *** cjloader has quit IRC | 16:42 | |
| evrardjp | I see | 16:44 |
| evrardjp | I asked | 16:44 |
| evrardjp | I didn't suggest setenforce 0. | 16:44 |
| evrardjp | I am respectful of mhayden legacy :p | 16:44 |
| mnaser | :p | 16:44 |
| *** cjloader has joined #openstack-ansible | 16:44 | |
| mhayden | OH BURN | 16:44 |
| evrardjp | ok next | 16:44 |
| evrardjp | mhayden: haha. | 16:44 |
| mhayden | had to drop out of a meeting to defend SELinux ;) | 16:45 |
| evrardjp | mhayden: go back to your hiding! | 16:45 |
| mhayden | oops | 16:45 |
| evrardjp | DOUBLE BURN. | 16:45 |
| mhayden | :) | 16:45 |
| odyssey4me | o/ folks | 16:45 |
| mhayden | oh crap i messed up an OSA meeting unintentionally | 16:45 |
| * mhayden is a winner :/ | 16:45 | |
| evrardjp | hahah | 16:45 |
| * mhayden departs | 16:45 | |
| evrardjp | ok next | 16:45 |
| evrardjp | #link https://bugs.launchpad.net/openstack-ansible/+bug/1772772 | 16:45 |
| openstack | Launchpad bug 1772772 in openstack-ansible "When using federation sso_callback_template.html is missing" [Undecided,New] | 16:45 |
| *** alexr has quit IRC | 16:46 | |
| *** jbadiapa has joined #openstack-ansible | 16:46 | |
| * mnaser has no idea about keystone federated auth | 16:46 | |
| evrardjp | odyssey4me: you arrive right on time | 16:46 |
| odyssey4me | ah yes, that looks valid | 16:46 |
| odyssey4me | I'll fix that | 16:46 |
| evrardjp | yup I thought so too | 16:46 |
| evrardjp | looks like confirmed low | 16:46 |
| evrardjp | ok for everyone | 16:47 |
| evrardjp | ? | 16:47 |
| odyssey4me | I'd say high actually | 16:47 |
| * mnaser doesn't know enough about this to make a call so will defer | 16:47 | |
| odyssey4me | it's broken, and there's no workaround | 16:47 |
| evrardjp | https://docs.openstack.org/openstack-ansible/latest/user/source-overrides/index.html#overriding-other-upstream-projects-source-code | 16:49 |
| odyssey4me | I've also assigned the related bug mentioned to myself | 16:49 |
| evrardjp | it's not broken | 16:49 |
| evrardjp | it's not properly overriden | 16:49 |
| evrardjp | expectations are broken, that's true | 16:49 |
| evrardjp | but the code itself works, | 16:49 |
| odyssey4me | erm, are we talking about the same thing? | 16:49 |
| evrardjp | oh wait | 16:49 |
| evrardjp | I moved to the next bug | 16:49 |
| mnaser | :D | 16:49 |
| odyssey4me | the conditional is using the idp settings as a conditional, instead of the sp config - it's broken | 16:49 |
| evrardjp | my bad! | 16:50 |
| evrardjp | yeah that's broken | 16:50 |
| evrardjp | I thought it was a done deal | 16:50 |
| evrardjp | next | 16:50 |
| evrardjp | #link https://bugs.launchpad.net/openstack-ansible/+bug/1773124 | 16:50 |
| openstack | Launchpad bug 1773124 in openstack-ansible "plugin py_pkgs.py does not adhere to normal ansible variable precedence rules" [Undecided,New] | 16:50 |
| odyssey4me | lol, ok | 16:50 |
| odyssey4me | erm, haha | 16:51 |
| odyssey4me | the order precedence comes from a var, lemme get that | 16:51 |
| evrardjp | it's not a problem of var precedence | 16:51 |
| odyssey4me | https://github.com/openstack/openstack-ansible/blob/master/inventory/group_vars/repo_all.yml#L71-L74 | 16:51 |
| evrardjp | it's a problem that the var was overriden with just the git branch | 16:51 |
| odyssey4me | yep | 16:52 |
| evrardjp | so precedence was completely ignored | 16:52 |
| odyssey4me | I can answer it if you like | 16:52 |
| evrardjp | you can answer, I already posted something | 16:52 |
| evrardjp | a more english and less spartian answer would be great. | 16:52 |
| evrardjp | anyway | 16:52 |
| odyssey4me | ok, can do | 16:52 |
| evrardjp | next | 16:52 |
| evrardjp | #link https://bugs.launchpad.net/openstack-ansible/+bug/1774658 | 16:53 |
| openstack | Launchpad bug 1774658 in openstack-ansible "Hash sum mismatch when fetching percona-xtrabackup_2.3.10-1.xenial_amd64.deb" [Undecided,New] | 16:53 |
| guilhermesp | that's mine! heheh | 16:53 |
| mnaser | could be transient, are you still running into it guilhermesp ? | 16:53 |
| evrardjp | woot | 16:53 |
| guilhermesp | yep | 16:53 |
| mnaser | ..yay | 16:53 |
| guilhermesp | this morning the same thing | 16:53 |
| evrardjp | I can try deploying a 17.0.4 | 16:53 |
| mnaser | guilhermesp: you don't use a proxy, right? | 16:54 |
| mnaser | looks like 2.3.10 was released a few days ago on the day of the breakage | 16:54 |
| guilhermesp | well, i assume it's by deafult in an all in one, right? | 16:54 |
| mnaser | maybe we should pin xtrabackup version? | 16:54 |
| guilhermesp | I opened a bug in percona community, not sure if was the right place https://www.percona.com/forums/questions-discussions/percona-xtrabackup/51614-hash-sum-mismatch-percona-xtrabackup-percona-xtrabackup_2-3-10-1-xenial_amd64-deb | 16:55 |
| mnaser | guilhermesp: nice! | 16:55 |
| evrardjp | cool | 16:55 |
| guilhermesp | and if the description was that clear, but any answers till now | 16:55 |
| *** chhagarw has quit IRC | 16:55 | |
| evrardjp | typo openstacak-ansible :D | 16:55 |
| guilhermesp | hahahaha sorry for that | 16:55 |
| evrardjp | haha no worries, I am just toying with you :D | 16:56 |
| mnaser | guilhermesp: hmm, can you try apt-get clean | 16:56 |
| guilhermesp | I have a nervous typing sometimes | 16:56 |
| evrardjp | that's cool you did that thing | 16:56 |
| mnaser | apt-get update and then try running it again? | 16:56 |
| guilhermesp | mnaser: I did | 16:56 |
| mnaser | apparently these messed up things could be cached | 16:56 |
| evrardjp | in the meantime I am deploying 17.0.4 | 16:56 |
| mnaser | oh excellent | 16:56 |
| mnaser | we can yell at them then :D | 16:56 |
| evrardjp | so I can tell I have the same issue | 16:56 |
| guilhermesp | same thing. I can clean my vm and try to deploy again, but will the the 3º time | 16:56 |
| evrardjp | in the meantime, we should bump the source maybe | 16:56 |
| evrardjp | to a new version | 16:56 |
| mnaser | evrardjp: cool, maybe you can set to confirmed? also, why wouldn't this be breaking in our gate then? | 16:57 |
| mnaser | 2.3.10 is the latest release published by percona | 16:57 |
| evrardjp | I will assign that to me, I will mark it as confirmed when I see the bug appearing, fine for everyone? | 16:57 |
| *** rpittau has quit IRC | 16:57 | |
| mnaser | fine by me, but i'm just curious why our gate is not hitting the same bug | 16:57 |
| guilhermesp | ok! So, going to my office, I was just wainting the bug to be discussed and to give you a heads up | 16:57 |
| evrardjp | that's why I am confirming/infirming manually :) | 16:58 |
| mnaser | maybe guilhermesp you have a transparent proxy mucking things up? | 16:58 |
| evrardjp | guilhermesp: that's very cool | 16:58 |
| evrardjp | please do so anytime :) | 16:58 |
| evrardjp | we love reporters that show up :) | 16:58 |
| * mnaser sees edu.br so it could be a possibility, we'll let you know and work to fix it for ya (hopefully) | 16:58 | |
| *** kaiokmo has quit IRC | 16:58 | |
| odyssey4me | yeah, I was thinking it might be best for us to pin those packages too | 16:59 |
| guilhermesp | mnaser: thank you! I will right back in 5 or 10 minutes | 16:59 |
| evrardjp | ok we are running out of time | 16:59 |
| evrardjp | odyssey4me: I think it's a good idea to pin them indeed. | 16:59 |
| odyssey4me | we pin mariadb, so we should also pin everything relating to it | 16:59 |
| evrardjp | yup. | 16:59 |
| mnaser | ++ | 16:59 |
| *** kaiokmo has joined #openstack-ansible | 16:59 | |
| evrardjp | now that mariadb is better, I thought of unpinning it though. | 16:59 |
| evrardjp | but that's a longer story. | 16:59 |
| odyssey4me | I think the pins are best to leave in place, and update from time to time | 17:00 |
| evrardjp | yeah | 17:00 |
| * mnaser is in favour of keeping things pinned so tagged releases don't ever break for users | 17:00 | |
| evrardjp | at the end I think it's the most reliable | 17:00 |
| evrardjp | mnaser: that's not true | 17:00 |
| guilhermesp | mnaser: about the proxy, my instance runs a apt-cacher proxy, could be that? | 17:00 |
| evrardjp | because the upstream source can disappear. | 17:00 |
| *** tux_ has joined #openstack-ansible | 17:00 | |
| evrardjp | it's more likely with an old file, than a complete source | 17:00 |
| mnaser | right, but that's less likely to happen than a new release that breaks stuff | 17:00 |
| evrardjp | but it's still better. | 17:00 |
| evrardjp | yeah | 17:00 |
| evrardjp | agreed. | 17:00 |
| mnaser | guilhermesp: it could be possible that your apt cache is stale or has problems, maybe good to try and reset it! | 17:01 |
| mnaser | anyways, next bug? | 17:01 |
| evrardjp | I think we are out of time | 17:01 |
| evrardjp | #topic next meeting chair | 17:01 |
| *** openstack changes topic to "next meeting chair (Meeting topic: openstack_ansible_meeting)" | 17:01 | |
| evrardjp | anyone wants to run the meeting? | 17:01 |
| hwoarang | i can do that | 17:02 |
| * hwoarang checks calendar | 17:02 | |
| *** masuberu has quit IRC | 17:02 | |
| evrardjp | ok | 17:02 |
| *** masuberu has joined #openstack-ansible | 17:02 | |
| hwoarang | yep i can do that | 17:02 |
| evrardjp | else it was mgariepy that was picked by my script. | 17:02 |
| evrardjp | cool, thanks hwoarang ! | 17:02 |
| evrardjp | thank you everyone | 17:03 |
| evrardjp | #endmeeting | 17:03 |
| *** openstack changes topic to "Launchpad: https://launchpad.net/openstack-ansible || Weekly Meetings: https://wiki.openstack.org/wiki/Meetings/openstack-ansible || Review Dashboard: https://goo.gl/tTmdgs" | 17:03 | |
| openstack | Meeting ended Tue Jun 5 17:03:04 2018 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 17:03 |
| openstack | Minutes: http://eavesdrop.openstack.org/meetings/openstack_ansible_meeting/2018/openstack_ansible_meeting.2018-06-05-16.02.html | 17:03 |
| openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/openstack_ansible_meeting/2018/openstack_ansible_meeting.2018-06-05-16.02.txt | 17:03 |
| openstack | Log: http://eavesdrop.openstack.org/meetings/openstack_ansible_meeting/2018/openstack_ansible_meeting.2018-06-05-16.02.log.html | 17:03 |
| mnaser | ok, time to unbreak the gates | 17:03 |
| hwoarang | evrardjp: the pip thing works fine. the stream of logs is broken. check the ara log. so we should be able to restore W+1 | 17:03 |
| evrardjp | oh cool | 17:04 |
| evrardjp | so it's the PYTHON_UNBUFFERED or something? | 17:04 |
| evrardjp | that's why the time is right :) | 17:04 |
| odyssey4me | mnaser FYI, I replied in https://bugzilla.redhat.com/show_bug.cgi?id=1586080 | 17:04 |
| openstack | bugzilla.redhat.com bug 1586080 in distribution "Add UWSGI packages to RDO Rocky" [Unspecified,New] - Assigned to amoralej | 17:04 |
| *** radeks has joined #openstack-ansible | 17:04 | |
| mnaser | odyssey4me: yes, i saw that, thank you so much | 17:04 |
| *** tosky__ has joined #openstack-ansible | 17:05 | |
| *** tosky has quit IRC | 17:05 | |
| *** tosky__ is now known as tosky | 17:05 | |
| jrosser | if anyone has a moment to look this is my last piece of tech-debt for now https://review.openstack.org/#/c/568276/ | 17:05 |
| mnaser | jrosser: left a small comment | 17:07 |
| mnaser | ok so i take it your erlang changes are related to unbreaking the gate, cloudnull ? | 17:08 |
| openstackgerrit | Merged openstack/openstack-ansible stable/ocata: Updated spice-html5 git repository URL https://review.openstack.org/572410 | 17:10 |
| cloudnull | mnaser kinda. | 17:11 |
| mnaser | cloudnull: for your bug | 17:11 |
| mnaser | cloudnull: https://github.com/openstack/openstack-ansible-rabbitmq_server/blob/master/tests/ansible-role-requirements.yml for the upgrade | 17:12 |
| mnaser | previous_rabbitmq_server should be stable/queens ? | 17:12 |
| cloudnull | i think that's a side effect of wanting to have better performance in rabbit, which is why I was looking at this | 17:12 |
| mnaser | yeah it's one of the reason which seem to be breaking the gate, neutron cant auth to rabbit | 17:13 |
| mnaser | which someone was talking about tls stuff yesterday | 17:13 |
| evrardjp | the rabbitmq is something | 17:13 |
| evrardjp | else | 17:13 |
| evrardjp | yes | 17:13 |
| evrardjp | I am working with ansmith on that | 17:13 |
| cloudnull | ok. let me push an update to that pr | 17:13 |
| evrardjp | he introduced patches. | 17:13 |
| evrardjp | I have to check what's up. | 17:13 |
| ansmith | with ssl enabled, the auth to rabbit fails with my patches, have gone through it multiple times, not much visibility in the logs | 17:14 |
| cloudnull | the auth issues I believe are due to a tls bug in erlang 19.3.1 | 17:14 |
| cloudnull | fixed in 19.3.6-1 | 17:15 |
| cloudnull | 20.1 is recommended | 17:15 |
| *** radeks has quit IRC | 17:15 | |
| *** armaan has quit IRC | 17:15 | |
| *** armaan has joined #openstack-ansible | 17:15 | |
| evrardjp | the only thing we changed is oslo and some wiring. | 17:16 |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-rabbitmq_server master: Update the version of erlang to support rabbitmq https://review.openstack.org/572196 | 17:17 |
| evrardjp | it should work. I think we did wiring bad in the past, and we didn't use SSL, and now that we are using it, it fails. | 17:17 |
| evrardjp | but I can be wrong, so... | 17:17 |
| mnaser | oh | 17:17 |
| cloudnull | ssl is working, or it had been | 17:17 |
| evrardjp | I will check the patches you have. | 17:17 |
| mnaser | i | 17:17 |
| mnaser | think i know what's going on | 17:17 |
| odyssey4me | evrardjp I still don't see how you think that the wiring was bad. | 17:17 |
| mnaser | https://review.openstack.org/#/c/558620/18/defaults/main.yml | 17:17 |
| mnaser | we changed the variables | 17:17 |
| mnaser | without any way of deprecating the old ones | 17:17 |
| mnaser | or a change in openstack-ansible integrated | 17:18 |
| evrardjp | cloudnull: odyssey4me I deployed queens, and I saw no ssl whatsoever by default. | 17:18 |
| mnaser | so openstack-ansible creates the rabbitmq user with $some_password | 17:18 |
| mnaser | and the the role configures with the default password | 17:18 |
| cloudnull | I have a pike cloud running , ssl is working like a champ | 17:18 |
| mnaser | because the integrated repo doesnt rely on the role to create mq, but on it's own playbook | 17:18 |
| evrardjp | I guess I will double check when doing the 17.0.4 testing :) | 17:18 |
| cloudnull | oh, 5672 needs to be 5671 w/out ssl. | 17:18 |
| cloudnull | I believe | 17:19 |
| *** DanyC has quit IRC | 17:19 | |
| odyssey4me | cloudnull ansmith yep, the port changes if you're using ssl vs not | 17:19 |
| evrardjp | I am still curious about how this works. | 17:19 |
| *** DanyC has joined #openstack-ansible | 17:19 | |
| evrardjp | that's what I see indeed with rabbitmqctl | 17:19 |
| evrardjp | that one is for ssl, the other is not | 17:19 |
| odyssey4me | ansmith FYI, when we first implemented the transport url usage, we tried using the ssl parameter, but it didn't work | 17:20 |
| odyssey4me | that's why we used the ssl = .conf entry instead | 17:20 |
| mnaser | we're breaking so much things without deprecation | 17:20 |
| mnaser | https://github.com/openstack/openstack-ansible/blob/7e4b5f614520b6136daf08cf6fbe215eea4680eb/playbooks/os-nova-install.yml#L25-L34 | 17:20 |
| mnaser | this is how we create the vhost. | 17:20 |
| openstackgerrit | Merged openstack/openstack-ansible-ops master: Add documentation on running os-profiler with ELK https://review.openstack.org/572256 | 17:21 |
| ansmith | odyssey4me: I tried an experiment and removed the ssl query param, but same auth failure | 17:21 |
| mnaser | yet we are configuring with `nova_oslomsg_rpc_password`. | 17:21 |
| mnaser | https://review.openstack.org/#/c/558620/18/templates/nova.conf.j2 | 17:21 |
| odyssey4me | ansmith yep, I tried the same | 17:22 |
| ansmith | rabbitmq* should be getting pass through to nova_oslomsg_rpc* | 17:22 |
| mnaser | where | 17:22 |
| mnaser | because i don't see that happening anywhere | 17:22 |
| cloudnull | https://www.rabbitmq.com/which-erlang.html - For the best TLS support, the latest version of Erlang/OTP 20.1.x is recommended - I think we've not been using SSL most of this cycle, which is why we've not run into this | 17:23 |
| mnaser | https://github.com/openstack/openstack-ansible/search?utf8=%E2%9C%93&q=nova_rabbitmq_password&type= | 17:23 |
| openstackgerrit | Merged openstack/openstack-ansible stable/queens: Updated spice-html5 git repository URL https://review.openstack.org/572408 | 17:23 |
| *** DanyC has quit IRC | 17:24 | |
| evrardjp | we just need to fix the wiring in master | 17:24 |
| evrardjp | follow it through | 17:24 |
| odyssey4me | hang on - it was neutron broken, is nova now an issue? | 17:24 |
| evrardjp | making sure upgrades are fine | 17:24 |
| ansmith | mnaser: https://github.com/openstack/openstack-ansible/blob/master/inventory/group_vars/neutron_all.yml#L21 | 17:24 |
| mnaser | odyssey4me: i think all of them are broken | 17:24 |
| mnaser | neutron is just the first hit | 17:24 |
| mnaser | nova-conductor shows auth issues | 17:24 |
| mnaser | ansmith: no wiring for password there | 17:24 |
| odyssey4me | the passwords all come from the secrets | 17:25 |
| odyssey4me | never in a variable | 17:25 |
| mnaser | yes, and we're using <foo>_rabbitmq_password secret to create the rabbitmq user | 17:25 |
| mnaser | yet in the role, we're using <foo>_oslo_rpc_blah_password | 17:25 |
| *** ivve has quit IRC | 17:25 | |
| cloudnull | oh, that'd be a problem | 17:26 |
| odyssey4me | heh, ok | 17:26 |
| mnaser | so just to re-iterate | 17:26 |
| mnaser | https://github.com/openstack/openstack-ansible/blob/master/playbooks/os-nova-install.yml#L25-L34 | 17:26 |
| mnaser | https://github.com/openstack/openstack-ansible-os_nova/blob/master/templates/nova.conf.j2#L44 | 17:26 |
| mnaser | not usage of `nova_oslomsg_rpc_password` | 17:27 |
| mnaser | but there is no wiring of `nova_rabbitmq_password: "{{ nova_oslomsg_rpc_password }}"` or vice versa | 17:27 |
| ansmith | mnaser: https://github.com/openstack/openstack-ansible-tests/blob/master/test-vars.yml | 17:27 |
| *** electrofelix has quit IRC | 17:27 | |
| mnaser | nova_oslomsg_rpc_password: "{{ oslomsg_rpc_password }}" | 17:27 |
| mnaser | nova_rabbitmq_password: "{{ rabbitmq_password }}" | 17:27 |
| odyssey4me | ansmith yeah, that's why it works for the role test | 17:27 |
| odyssey4me | but the integrated build doesn't use that | 17:28 |
| ansmith | light bulb goes off | 17:28 |
| mnaser | we've also effectively broken all upgrades because now my secrets file doesnt work anymore | 17:28 |
| odyssey4me | yeah, we're going to have to do a shim to transition between the old names and new | 17:28 |
| odyssey4me | the major upgrade scripting has something for that, so for upgrades that's not too much of an issue | 17:29 |
| mnaser | right, we either add a shim or we fix the integrated repo | 17:29 |
| ansmith | so to wire it in, I should update the group_vars/all for each service? | 17:29 |
| evrardjp | we fix the integrated repo | 17:29 |
| odyssey4me | but to make things work now, we'll need to get rid of the use of the old vars in the intgrated repo | 17:29 |
| mnaser | ++ | 17:29 |
| mnaser | i agree | 17:29 |
| evrardjp | yeah but that's better anyway | 17:30 |
| odyssey4me | all those tasks that use the old vars must go, along with the old vars | 17:30 |
| evrardjp | so we move to the new vars, we wire things up, with default wiring with an old variable name | 17:30 |
| evrardjp | so we have proper deprecation | 17:30 |
| evrardjp | and we remove the old variable next cycle as default, moving towards a real proper default | 17:30 |
| odyssey4me | what's the point of doing a cycle's deprecation for these vars? | 17:30 |
| evrardjp | ease of upgrade, but we can handle that in the tooling indeed. | 17:31 |
| odyssey4me | yes, we have upgrade tooling for this already | 17:31 |
| evrardjp | I don't mind. | 17:31 |
| mnaser | ++ | 17:31 |
| odyssey4me | happy to implement a deprecation, but only if we have a valid reason - and that's not one | 17:31 |
| evrardjp | I thought it was more respectful for users to have a deprecation. | 17:31 |
| evrardjp | tell me what's the line in the sand then. | 17:32 |
| mnaser | we've previously had users update secrets as part of upgrade | 17:32 |
| mnaser | at least into queens | 17:32 |
| evrardjp | it's not written anywhere. | 17:32 |
| mnaser | so going by the status quo | 17:32 |
| mnaser | https://docs.openstack.org/openstack-ansible/queens/admin/upgrades/major-upgrades.html#update-user-secrets-file | 17:32 |
| odyssey4me | Deprecation cycles cause a lot of complexity, so while it's nice to give people time to transition things - if we can automate that transition then we don't need to carry the complexity. | 17:32 |
| evrardjp | well, we don't have any deprecation anymore then, because we can ALWAYS automate it. | 17:33 |
| odyssey4me | then life is awesome | 17:33 |
| evrardjp | : ) | 17:33 |
| mnaser | woo | 17:33 |
| evrardjp | it's just about awareness | 17:33 |
| odyssey4me | deprecation is a high cost thing to implement | 17:33 |
| evrardjp | do ppl need to be aware of this? | 17:33 |
| odyssey4me | so yeah, we have releasenotes for awareness | 17:33 |
| evrardjp | for me they do | 17:33 |
| evrardjp | because we can assume the wiring for many things, but not for group vars | 17:34 |
| mnaser | okay so ansmith will push up a patch to clean and wire this up, release note in the integrated repo, and update the user-secrets-adjustment.yml file? | 17:34 |
| odyssey4me | so we can add a reno to the patch which adds those auto-migrations to the upgrade tooling to also note that it's available | 17:34 |
| evrardjp | we don't know if someone updated the group vars | 17:34 |
| evrardjp | we can update the secrets | 17:34 |
| evrardjp | not the group vars | 17:34 |
| evrardjp | but I am fine with that anyway. | 17:34 |
| odyssey4me | sure, and release notes can help them be aware | 17:35 |
| mnaser | tbh: i operate with the assumption that if you've mucked around enough to be overriding message queue things | 17:35 |
| mnaser | you should be reading release notes when upgrading | 17:35 |
| odyssey4me | agreed | 17:35 |
| evrardjp | agreed | 17:35 |
| evrardjp | that's why I am not opposed to your conversation | 17:35 |
| evrardjp | I am just stating the fact that deprecation could have been nice there. | 17:35 |
| odyssey4me | we automate the secrets migration primarily because we want our upgrade test to work | 17:35 |
| mnaser | cool: so release note to wire things up, drop the old vars, update user-secrets-adjustment.yml -- sound good for everyone, ansmith sounds good to you to work on? | 17:35 |
| ansmith | apologize for the agida, missed an important part of the "wiring" | 17:36 |
| evrardjp | tell that to the reviewers of your patch :p | 17:36 |
| evrardjp | ahahahah | 17:36 |
| evrardjp | anyway | 17:36 |
| ansmith | again, just to clarify, I will wire passwords into inventory/group_vars/ services | 17:36 |
| odyssey4me | not sure what 'release note to wire things up' means - there are already releasenotes | 17:36 |
| odyssey4me | I don't think passwords should be 'wired up' at all | 17:37 |
| mnaser | oh sorry | 17:37 |
| mnaser | there is a comma there somewhere | 17:37 |
| *** DanyC has joined #openstack-ansible | 17:37 | |
| mnaser | release note, rewire things up properly (aka, stop using neutron_rabbit_password in integrated repo, use the new ones) | 17:37 |
| odyssey4me | 1. remove the tasks using the old variables, and remove any presence of the old variables in the integrated repo | 17:37 |
| odyssey4me | ^ make sense as step 1? | 17:38 |
| odyssey4me | 2. update user-secrets-adjustment.yml to migrate the old variables to the new ones | 17:38 |
| * mnaser will absolutely not +W #1 before #2 is up for review so we don't miss it | 17:39 | |
| odyssey4me | perhaps do it all in one patch | 17:39 |
| evrardjp | ok I let you all run though this, as I leave for today. | 17:40 |
| mnaser | evrardjp: later | 17:40 |
| mnaser | odyssey4me: i agree | 17:40 |
| odyssey4me | I'm going to fast follow that patch with moving all these tasks into the roles. | 17:40 |
| odyssey4me | evrardjp have a great eve! | 17:40 |
| *** jra has quit IRC | 17:40 | |
| ansmith | evrardjp: good night! | 17:40 |
| odyssey4me | ansmith is it a bit clearer now what needs to be done? | 17:41 |
| *** jra has joined #openstack-ansible | 17:41 | |
| ansmith | odyssey4me: I understand #2, not sure I know where update to #1 takes place | 17:41 |
| ansmith | still learning where things are... | 17:41 |
| odyssey4me | ansmith these tasks must get removed: https://github.com/openstack/openstack-ansible/blob/master/playbooks/os-nova-install.yml#L25-L34 | 17:42 |
| *** DanyC has quit IRC | 17:42 | |
| odyssey4me | and the same for the other playbooks in the integrated repo | 17:42 |
| odyssey4me | these will be used instead: https://github.com/openstack/openstack-ansible/blob/master/playbooks/os-nova-install.yml#L50-L69 | 17:42 |
| odyssey4me | the issue right now is that the first set of tasks and their related variables are being used to create the nova/neutron/etc user, but the vars being used in the role aren't matching | 17:43 |
| ansmith | I guess what I am missing is what is the "integrated repo" | 17:44 |
| mnaser | ansmith: openstack/openstack-ansible | 17:44 |
| odyssey4me | https://github.com/openstack/openstack-ansible/blob/master/playbooks/os-nova-install.yml#L50-L69 is the integrated repo | 17:44 |
| odyssey4me | the one that is used for an integrated deployment | 17:44 |
| odyssey4me | sorry, it's become a term we use which I guess is not obvious | 17:44 |
| ansmith | gotcha, I thought it might be a separate git | 17:45 |
| ansmith | ok, so let me take a stab at a patch with both fixes | 17:46 |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_keystone master: Use correct variable for sso_callback_template deployment https://review.openstack.org/572502 | 17:47 |
| odyssey4me | thanks ansmith | 17:47 |
| ansmith | thanks for the help | 17:47 |
| ansmith | looking forward to next step which is to bring qdrouterd role into the picture | 17:47 |
| odyssey4me | oh yeah, that should be great | 17:47 |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_keystone master: Use correct variable for sso_callback_template deployment https://review.openstack.org/572502 | 17:50 |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_keystone master: Use correct variable for sso_callback_template deployment https://review.openstack.org/572502 | 17:50 |
| evrardjp | ansmith: yes I will request this today | 17:51 |
| ansmith | evrardjp: perfect, thanks | 17:51 |
| evrardjp | could you link to your repo with the qdrouterd ? | 17:52 |
| evrardjp | so I have it for the requests | 17:52 |
| evrardjp | ty | 17:52 |
| ansmith | evrardjp: https://github.com/ajssmith/ansible-qdrouterd | 17:52 |
| *** gkadam has quit IRC | 17:52 | |
| ansmith | its getting close | 17:52 |
| *** armaan has quit IRC | 17:53 | |
| *** armaan has joined #openstack-ansible | 17:53 | |
| *** armaan has quit IRC | 17:58 | |
| *** poopcat has joined #openstack-ansible | 18:08 | |
| *** hasseniu_ has quit IRC | 18:16 | |
| *** jra has quit IRC | 18:17 | |
| *** jra has joined #openstack-ansible | 18:17 | |
| *** dxiri has quit IRC | 18:18 | |
| *** Adri2000 has quit IRC | 18:22 | |
| *** hassenius has joined #openstack-ansible | 18:23 | |
| *** hasseniu_ has joined #openstack-ansible | 18:23 | |
| *** shardy has quit IRC | 18:23 | |
| *** Adri2000 has joined #openstack-ansible | 18:24 | |
| *** shardy has joined #openstack-ansible | 18:24 | |
| *** hasseniu_ has quit IRC | 18:27 | |
| *** hassenius has quit IRC | 18:27 | |
| *** hasseniu_ has joined #openstack-ansible | 18:29 | |
| guilhermesp | mnaser: yep, seemd that my apt-cacher was generating the "bug" | 18:29 |
| *** hasseniu_ has quit IRC | 18:30 | |
| guilhermesp | I did a rebuild in my instance and disabled the apt-cacher in it | 18:30 |
| *** hasseniu_ has joined #openstack-ansible | 18:30 | |
| guilhermesp | galera_server was installed successfully | 18:31 |
| guilhermesp | so, the bug is invalid | 18:31 |
| guilhermesp | just to be sure, I will rebuild again and keep the apt-cacher to see what is going to happen | 18:31 |
| *** DanyC has joined #openstack-ansible | 18:36 | |
| jrosser | guilhermesp: ive had similar experience with apt-cacher-ng in the past. i keep local mirrors with debmirror now | 18:36 |
| *** hasseniu_ has quit IRC | 18:36 | |
| *** hassenius has joined #openstack-ansible | 18:37 | |
| *** radeks has joined #openstack-ansible | 18:38 | |
| guilhermesp | jrosser: huuum, good to know. Here is apt-cacher-ng. Maybe this is time to move to debmirror too :) | 18:40 |
| *** hassenius has quit IRC | 18:41 | |
| guilhermesp | but anyway, I'm deploying here once again with apt-cacher-ng enabled inside the instance just to confirm | 18:41 |
| *** EmilienM is now known as EmilienM|PTO | 18:43 | |
| *** hassenius has joined #openstack-ansible | 18:44 | |
| *** hasseniu_ has joined #openstack-ansible | 18:44 | |
| *** hassenius has quit IRC | 18:48 | |
| *** yolanda has quit IRC | 18:49 | |
| openstackgerrit | Merged openstack/openstack-ansible stable/pike: Updated spice-html5 git repository URL https://review.openstack.org/572409 | 18:54 |
| *** hasseniu_ has quit IRC | 18:59 | |
| logan- | anyone have a moment to review https://review.openstack.org/#/c/572397/? | 19:01 |
| mgariepy | hey logan- how are you ? | 19:02 |
| *** dxiri has joined #openstack-ansible | 19:02 | |
| *** dxiri has quit IRC | 19:02 | |
| logan- | o/ mgariepy | 19:02 |
| logan- | doing great, how have you been? | 19:03 |
| mgariepy | doing great also :) | 19:03 |
| mgariepy | did you saw the issue i had the other month with ceph ? | 19:03 |
| *** dxiri has joined #openstack-ansible | 19:03 | |
| logan- | no I didn't | 19:03 |
| logan- | what happeend? | 19:03 |
| mgariepy | power failure, all instance booted / using volumes not bootable anymore. | 19:04 |
| mgariepy | all the volumes were locked in ceph | 19:04 |
| mgariepy | http://paste.openstack.org/show/NoSriMEROeDVJtBsEZf9/ | 19:06 |
| mgariepy | something along those lines. | 19:07 |
| *** jbadiapa has quit IRC | 19:10 | |
| logan- | hmmm | 19:11 |
| *** radeks has quit IRC | 19:11 | |
| logan- | so the instances themselves were having the journal replay issue with the ext4/xfs filesystems? | 19:11 |
| mgariepy | it was fun :) | 19:11 |
| mgariepy | the ceph backed vol we ro. | 19:12 |
| logan- | pretty sure ive seen that before | 19:12 |
| logan- | thanks for sharing, i never knew what the problem/solution was | 19:13 |
| mgariepy | the power failure turned off all the ceph and openstack at once. | 19:13 |
| mgariepy | shouldn't happen since we run on generator backed UPS haha | 19:14 |
| mgariepy | unless someone turn off the ups .. | 19:14 |
| logan- | so is that capability meant to be temporary? ie once you get everything booted back up are you supposed to remove the cap? | 19:14 |
| mgariepy | we didn't removed it | 19:14 |
| logan- | yeah interesting http://lists.ceph.com/pipermail/ceph-users-ceph.com/2017-September/020722.html | 19:16 |
| logan- | i usually have seen that with unclean hv shutdowns like if a hv crashes or something, the rbds on it sometimes lock up and won't allow the journal replay to occur so the vms wont boot back up. i bet thats why | 19:17 |
| mgariepy | in ceph-mons log it pretty clear when this issue arise. | 19:17 |
| *** radeks has joined #openstack-ansible | 19:19 | |
| *** mma has quit IRC | 19:20 | |
| mgariepy | anyway we now deploy with this caps on the clouds we manages. less potentials problem on power failure. | 19:21 |
| logan- | yeah thats great info. i think ill be looking at using 'profile rbd' as my mon caps are just 'allow r' currently | 19:23 |
| *** radeks has quit IRC | 19:25 | |
| *** armaan has joined #openstack-ansible | 19:26 | |
| *** armaan has quit IRC | 19:26 | |
| *** armaan has joined #openstack-ansible | 19:27 | |
| *** yolanda has joined #openstack-ansible | 19:29 | |
| openstackgerrit | Andy Smith proposed openstack/openstack-ansible master: [WIP] Remove rabbitmq setup tasks replaced by oslo.messaging https://review.openstack.org/572531 | 19:30 |
| *** rodolof has quit IRC | 19:30 | |
| *** rodolof has joined #openstack-ansible | 19:31 | |
| tux_ | Does br-mgmt use DHCP to provide ip to container ? | 19:43 |
| tux_ | in short how does container get IPs? | 19:44 |
| openstackgerrit | Merged openstack/openstack-ansible-rabbitmq_server master: Variable node address https://review.openstack.org/572397 | 19:44 |
| tux_ | openstackgerrit: ^^ | 19:45 |
| openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible master: Allow integration of externally deployed RadosGW https://review.openstack.org/568276 | 19:46 |
| *** jra has quit IRC | 19:47 | |
| *** jra has joined #openstack-ansible | 19:47 | |
| spotz | cloudnull: not sure if you might want to pull the workflow off of https://review.openstack.org/#/c/568197/ or if you need it to go through to pass | 19:57 |
| openstackgerrit | Merged openstack/openstack-ansible-ops master: Fix vcpu override var issue for logging hostvar. https://review.openstack.org/572456 | 19:58 |
| *** cjloader_ has joined #openstack-ansible | 19:59 | |
| *** cjloader has quit IRC | 19:59 | |
| *** sar has joined #openstack-ansible | 20:00 | |
| evrardjp | ansmith: could you temporarily remove the zuul.d folder in https://github.com/ajssmith/ansible-qdrouterd ? | 20:06 |
| evrardjp | else inclusion will fail | 20:07 |
| ansmith | evrardjp: will do | 20:07 |
| evrardjp | cloudnull: same thing | 20:07 |
| evrardjp | for os_zun | 20:07 |
| *** tux_ has quit IRC | 20:08 | |
| ansmith | evrardjp: removed | 20:13 |
| guilhermesp | evrardjp: I think I saved you a bit of time checking the percona bug :) I checked twice here and with apt-cacher-ng disabled in the same instance that I was using, galera_server role is installed successfully, enabling it, same hash sum mismatch error | 20:13 |
| guilhermesp | just google it about apt-cacher-ng and hash sum mismatch and one particular comment in ubuntu community was: | 20:14 |
| guilhermesp | "APT-cacher-ng has proven to be very buggy in my experience and tons of bug reports are outstanding." | 20:14 |
| evrardjp | guilhermesp: I have tried on my machine and it worked | 20:21 |
| evrardjp | sorry I didn't report on the bug | 20:22 |
| evrardjp | yet | 20:22 |
| evrardjp | I am just very exhausted | 20:22 |
| evrardjp | and still patching :p | 20:22 |
| guilhermesp | I didn't save your time =( hahaha | 20:22 |
| evrardjp | oh it didn't cost me more than 2 minutes | 20:22 |
| *** chyka_ has joined #openstack-ansible | 20:22 | |
| evrardjp | don't worry | 20:22 |
| guilhermesp | awesome. So, next time I will pay attention in my environment. | 20:23 |
| guilhermesp | thank you in advance | 20:23 |
| openstackgerrit | Merged openstack/openstack-ansible-lxc_hosts master: Switch lxc-dnsmasq to start before lxc https://review.openstack.org/572459 | 20:25 |
| *** chyka has quit IRC | 20:26 | |
| openstackgerrit | Maksim Malchuk proposed openstack/openstack-ansible-repo_build stable/queens: Create distutils cfg before install and build https://review.openstack.org/572554 | 20:27 |
| openstackgerrit | Maksim Malchuk proposed openstack/openstack-ansible-repo_build stable/pike: Create distutils cfg before install and build https://review.openstack.org/572555 | 20:28 |
| openstackgerrit | Maksim Malchuk proposed openstack/openstack-ansible-repo_build stable/ocata: Create distutils cfg before install and build https://review.openstack.org/572557 | 20:29 |
| *** throwsb1 has quit IRC | 20:35 | |
| evrardjp | cloudnull: it's quite urgent to remove that zuul.d folder, else both won't get imported. | 20:35 |
| cloudnull | for zun ? | 20:36 |
| evrardjp | yes | 20:36 |
| *** tux_ has joined #openstack-ansible | 20:36 | |
| cloudnull | done. | 20:36 |
| evrardjp | cool thanks | 20:36 |
| evrardjp | why didn't you do another patch on top? | 20:37 |
| evrardjp | that could be easily reverted | 20:37 |
| evrardjp | meh | 20:37 |
| evrardjp | it's fine | 20:37 |
| evrardjp | we'll just rewrite :) | 20:37 |
| evrardjp | thanks | 20:38 |
| cloudnull | oh does the amend mess you up | 20:39 |
| cloudnull | sorry , if so | 20:39 |
| openstackgerrit | Merged openstack/openstack-ansible-repo_build master: Create distutils cfg before install and build https://review.openstack.org/572411 | 20:41 |
| openstackgerrit | Merged openstack/openstack-ansible-repo_build master: Use override pip_upstream_url for get-pip https://review.openstack.org/572422 | 20:42 |
| *** ansmith has quit IRC | 20:43 | |
| *** ansmith has joined #openstack-ansible | 20:44 | |
| *** tux_ has quit IRC | 20:45 | |
| *** joe_w has joined #openstack-ansible | 20:45 | |
| DimGR | hiiiiii | 20:45 |
| cloudnull | o/ | 20:46 |
| *** ansmith has quit IRC | 20:48 | |
| spotz | hey | 20:53 |
| *** hassenius has joined #openstack-ansible | 20:54 | |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-rabbitmq_server master: Update the version of erlang to support rabbitmq https://review.openstack.org/572196 | 20:56 |
| *** hassenius has quit IRC | 20:59 | |
| mnaser | guilhermesp: you can mark your bug as invalid too now :) | 21:00 |
| mnaser | poor cloudnull started off with bumping a release and ened up being dragged down to a zillion things in the same commit :-) | 21:01 |
| guilhermesp | mnaser: done! | 21:02 |
| guilhermesp | I also commented in percona community that was invalid, just to document | 21:02 |
| mnaser | ++ | 21:03 |
| jrosser | hmm all the jabs failed here in a wierd way http://logs.openstack.org/76/568276/8/check/openstack-ansible-deploy-aio_lxc-ubuntu-xenial/93da101/job-output.txt.gz | 21:11 |
| *** DanyC has quit IRC | 21:12 | |
| *** cjloader_ has quit IRC | 21:14 | |
| *** esberglu has quit IRC | 21:16 | |
| *** dave-mccowan has quit IRC | 21:16 | |
| mnaser | ok | 21:18 |
| mnaser | we're in a pickle | 21:18 |
| mnaser | so - spice decided it didnt want to be githubs friend so it moved off | 21:19 |
| mnaser | which is cool, so we pushed up a change to move it | 21:19 |
| mnaser | however, the changes with messaging broke the gate indirectly | 21:19 |
| *** rodolof has quit IRC | 21:19 | |
| mnaser | which means the gate unbreaking fix cant land because the gate is broken from something else | 21:20 |
| *** hasseniu_ has joined #openstack-ansible | 21:23 | |
| logan- | time for a frankenpatch | 21:24 |
| *** hasseniu_ has quit IRC | 21:32 | |
| *** jwitko__ has joined #openstack-ansible | 21:32 | |
| *** Brew has joined #openstack-ansible | 21:36 | |
| *** jwitko_ has quit IRC | 21:36 | |
| openstackgerrit | Mohammed Naser proposed openstack/openstack-ansible-tests master: Add galera_address to list of variables https://review.openstack.org/572565 | 21:36 |
| mnaser | number 1 | 21:36 |
| *** jwitko__ has quit IRC | 21:37 | |
| spotz | mnaser should that pass or it needs to get merged for things to pass? | 21:41 |
| spotz | Or is there more then one convo going on:) | 21:41 |
| *** ansmith has joined #openstack-ansible | 21:43 | |
| *** nurdie has quit IRC | 21:44 | |
| *** nurdie has joined #openstack-ansible | 21:44 | |
| *** hassenius has joined #openstack-ansible | 21:48 | |
| *** nurdie has quit IRC | 21:49 | |
| mnaser | spotz: i hope that passes but i'm not sure if it will yet | 21:49 |
| mnaser | cause there seems to be a bunch of things all cumulated together | 21:49 |
| mnaser | so i think i'll spend the evening just ironing this stuff out | 21:49 |
| spotz | mnaser: Ok well I'll be back in a few hours, if you need eyes/votes just ping or text | 21:49 |
| mnaser | spotz: merci beaucoup you da best! | 21:49 |
| spotz | mnaser I try! | 21:50 |
| spotz | And I was going to reply in French but I only know you're welcome in Spanish:) | 21:50 |
| spotz | And German... I'm set for Berlin! | 21:50 |
| mnaser | "de rien" is the usual goto | 21:51 |
| mnaser | which isn't you're welcome but translates to... "it's nothing" | 21:51 |
| *** hassenius has quit IRC | 21:52 | |
| spotz | de nada! | 21:52 |
| spotz | Which really makes no sense but it is your welcome:) | 21:53 |
| mnaser | it's the same concept! | 21:53 |
| mnaser | i assume nada is nothing | 21:53 |
| xgerman_ | “Macht nichts” | 21:53 |
| spotz | mnaser: yep | 21:57 |
| *** jwitko_ has joined #openstack-ansible | 22:04 | |
| *** DanyC has joined #openstack-ansible | 22:08 | |
| cloudnull | if cores could review the following https://review.openstack.org/#/c/572196/ it'd be greatly appreciated. This first patch is fixing our versions of erlang with the existing version of rabbitmq | 22:09 |
| cloudnull | with that rabbitmq should have the TLS issues resolved and now run the recommended version of erlang | 22:10 |
| *** shardy has quit IRC | 22:10 | |
| cloudnull | the follow on to this will be to update rabbitmq 3.7 | 22:10 |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-rabbitmq_server master: Update rabbitmq to the latest stable release https://review.openstack.org/572207 | 22:11 |
| cloudnull | ^ that one | 22:11 |
| cloudnull | :) | 22:11 |
| *** jwitko_ has quit IRC | 22:11 | |
| cloudnull | so with those two we should be +/- in the clear with updating rabbitmq | 22:12 |
| mnaser | cloudnull: rebasing things midst checking | 22:12 |
| mnaser | got me so confused | 22:12 |
| cloudnull | they're two different PRs | 22:13 |
| mnaser | yeah i was looking at the upgrade one :p | 22:13 |
| cloudnull | ha , sorry | 22:13 |
| mnaser | the first one lgtm so thats a +2 | 22:13 |
| cloudnull | tyvm | 22:13 |
| mnaser | i did have one thing | 22:13 |
| mnaser | added comments cloudnull | 22:14 |
| mnaser | and i think the ubuntu one failed for incorrect shas | 22:14 |
| mnaser | cloudnull: added two follow up comments to hopefully fix the gate issue for that | 22:15 |
| cloudnull | ++ | 22:15 |
| * cloudnull updating | 22:15 | |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-rabbitmq_server master: Update rabbitmq to the latest stable release https://review.openstack.org/572207 | 22:16 |
| cloudnull | done. | 22:17 |
| *** cjloader has joined #openstack-ansible | 22:21 | |
| mnaser | cloudnull: wonderful. can I ask for you to have a look at https://review.openstack.org/#/c/572565/ ? that'll fix gating for roles and it's passed opensuse and ubuntu, just pending centos | 22:22 |
| cloudnull | sure thing | 22:23 |
| cloudnull | +2 +a from me :) | 22:24 |
| cloudnull | thanks spotz for looking at that too | 22:24 |
| mnaser | cloudnull: https://review.openstack.org/#/c/572366 one last one to help land the server change above it | 22:24 |
| mnaser | and bring bionic support (yay) | 22:24 |
| *** nurdie has joined #openstack-ansible | 22:25 | |
| mnaser | dependency for https://review.openstack.org/#/c/572365/ (i +w thinking it was stuck in a zuul reboot or something) | 22:25 |
| *** cjloader has quit IRC | 22:25 | |
| *** nurdie has quit IRC | 22:30 | |
| *** Leo_m has quit IRC | 22:32 | |
| cloudnull | both LGTM | 22:34 |
| cloudnull | also im quite impressed that our bionic roll out is running as smooth as it is :) | 22:35 |
| cloudnull | I hope opensuse 15 will be the same | 22:35 |
| * cloudnull has faith in hwoarang | 22:36 | |
| mnaser | cloudnull: yes! absolutely | 22:36 |
| mnaser | for now, https://review.openstack.org/#/q/topic:osa-gate-fix is my working playground. the tests change is in gate, so once that lands, all role repos will (hopefully) work, so os_nova change will be able to go in | 22:37 |
| mnaser | i'll parent the os_nova change to the integrated repo change to fix the problem regarding rabbitmq stuff | 22:37 |
| mnaser | i'll pick up ansmith work if that's okay because we're blocked in the gate right now | 22:38 |
| *** tux_ has joined #openstack-ansible | 22:42 | |
| openstackgerrit | Mohammed Naser proposed openstack/openstack-ansible master: [WIP] Remove rabbitmq setup tasks replaced by oslo.messaging https://review.openstack.org/572531 | 22:43 |
| openstackgerrit | Mohammed Naser proposed openstack/openstack-ansible master: [WIP] Remove rabbitmq setup tasks replaced by oslo.messaging https://review.openstack.org/572531 | 22:50 |
| openstackgerrit | Merged openstack/openstack-ansible-galera_client master: Bump minor version of mariadb https://review.openstack.org/572366 | 22:51 |
| mnaser | ok | 22:58 |
| mnaser | this is mildly infurirating | 22:58 |
| *** hamza21 has joined #openstack-ansible | 22:58 | |
| mnaser | http://logs.openstack.org/17/572417/1/check/openstack-ansible-functional-centos-7/43a95d8/logs/ara-report/result/f6d81b06-e9a2-46f0-8eb5-5d6ef32c0733/ | 22:58 |
| mnaser | why is it occasionally getting 404s | 22:58 |
| *** DanyC has quit IRC | 23:06 | |
| *** jra has quit IRC | 23:06 | |
| *** DanyC has joined #openstack-ansible | 23:06 | |
| *** jra has joined #openstack-ansible | 23:06 | |
| *** threestrands has joined #openstack-ansible | 23:08 | |
| *** threestrands has quit IRC | 23:08 | |
| *** threestrands has joined #openstack-ansible | 23:08 | |
| mnaser | correction - always getting 404s. | 23:09 |
| *** DanyC has quit IRC | 23:10 | |
| *** tux_ has quit IRC | 23:14 | |
| openstackgerrit | Merged openstack/openstack-ansible-tests master: Add galera_address to list of variables https://review.openstack.org/572565 | 23:25 |
| *** chyka_ has quit IRC | 23:29 | |
| *** tosky has quit IRC | 23:30 | |
| *** hamza21 has quit IRC | 23:34 | |
| *** jra has quit IRC | 23:34 | |
| *** jra has joined #openstack-ansible | 23:35 | |
| *** jra has quit IRC | 23:40 | |
| *** jra has joined #openstack-ansible | 23:40 | |
| *** nurdie has joined #openstack-ansible | 23:44 | |
| *** Brew has quit IRC | 23:50 | |
| *** jra has quit IRC | 23:52 | |
| *** jra has joined #openstack-ansible | 23:52 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!
