| *** toan has joined #openstack-ansible | 00:00 | |
| *** xar- has joined #openstack-ansible | 00:02 | |
| *** MeltedLux has joined #openstack-ansible | 00:02 | |
| *** chyka has quit IRC | 00:06 | |
| openstackgerrit | Merged openstack/openstack-ansible master: Fix roles variable name https://review.openstack.org/527201 | 00:07 |
|---|---|---|
| *** fdegir has joined #openstack-ansible | 00:10 | |
| openstackgerrit | Merged openstack/openstack-ansible-os_tempest stable/ocata: Fix tempest plugins installation https://review.openstack.org/527069 | 00:13 |
| *** yifei has joined #openstack-ansible | 00:16 | |
| *** mubix has quit IRC | 00:20 | |
| *** mubix has joined #openstack-ansible | 00:20 | |
| *** vnogin has quit IRC | 00:29 | |
| *** portdirect has joined #openstack-ansible | 00:29 | |
| *** pedja has quit IRC | 00:45 | |
| *** chyka has joined #openstack-ansible | 01:01 | |
| *** chyka has quit IRC | 01:05 | |
| *** hw_wutianwei has joined #openstack-ansible | 01:13 | |
| *** vnogin has joined #openstack-ansible | 01:30 | |
| *** vnogin has quit IRC | 01:35 | |
| *** MeltedLux has quit IRC | 01:37 | |
| *** MeltedLux has joined #openstack-ansible | 01:37 | |
| *** smatzek has joined #openstack-ansible | 01:46 | |
| *** smatzek has quit IRC | 01:50 | |
| *** gouthamr has joined #openstack-ansible | 01:53 | |
| *** jhesketh has quit IRC | 01:59 | |
| cloudnull | if any cores are around to give this a review it'd be appreciated https://review.openstack.org/#/c/526930/ | 02:13 |
| cloudnull | fixes Glance + NFS | 02:13 |
| cloudnull | and adds a test for it | 02:13 |
| prometheanfire | nice | 02:16 |
| *** chyka has joined #openstack-ansible | 02:48 | |
| odyssey4me | cloudnull a question and suggestion in review for that one | 02:51 |
| *** chyka has quit IRC | 02:53 | |
| *** armaan has quit IRC | 03:02 | |
| cloudnull | odyssey4me: looking now | 03:02 |
| *** armaan has joined #openstack-ansible | 03:02 | |
| *** ianychoi has joined #openstack-ansible | 03:08 | |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-os_glance master: Update glance NFS for systemd https://review.openstack.org/526930 | 03:13 |
| cloudnull | anyone around that might want to give https://review.openstack.org/#/c/454450/ a review? | 03:30 |
| *** nshetty has joined #openstack-ansible | 03:39 | |
| odyssey4me | cloudnull took a look, some questions in there | 03:40 |
| cloudnull | sweet, thanks ! | 03:48 |
| cloudnull | adjusting now | 03:48 |
| odyssey4me | alright, I'm gonna try and sleep again | 03:49 |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible master: Converge neutron agents onto Baremetal https://review.openstack.org/454450 | 03:50 |
| odyssey4me | I have the feeling that stable/pike will fail until https://review.openstack.org/527099 merges :/ | 03:51 |
| odyssey4me | cloudnull perhaps that comment should stay - see review | 03:52 |
| cloudnull | which one? | 03:52 |
| odyssey4me | the one saying that agents are installed there | 03:52 |
| odyssey4me | https://review.openstack.org/#/c/454450/24/etc/openstack_deploy/openstack_user_config.yml.prod.example | 03:52 |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible master: Converge neutron agents onto Baremetal https://review.openstack.org/454450 | 03:53 |
| cloudnull | done | 03:53 |
| odyssey4me | some nits on the reno, not serious though | 03:54 |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible master: Converge neutron agents onto Baremetal https://review.openstack.org/454450 | 03:55 |
| odyssey4me | LGTM, thanks | 03:55 |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible master: Add nspawn container driver https://review.openstack.org/477017 | 03:56 |
| odyssey4me | also, for https://review.openstack.org/#/c/526930/8/tasks/glance_pre_install.yml the q wasn't answered | 03:56 |
| *** v1k0d3n has quit IRC | 03:56 | |
| *** v1k0d3n has joined #openstack-ansible | 03:57 | |
| cloudnull | yea, i failed to click pist | 03:58 |
| cloudnull | **post | 03:58 |
| odyssey4me | hmm, do you think maybe we should perhaps allow the data structure to define the user/group, then have that task set them if they're set? | 04:00 |
| *** udesale has joined #openstack-ansible | 04:00 | |
| odyssey4me | or perhaps have the task set the uid/gid if those are set? | 04:00 |
| odyssey4me | that way we get the idempotent task, but we don't muck with history unless someone deliberately makes it | 04:01 |
| gloksinia | Excuse me, Could i ask a question here ? | 04:02 |
| odyssey4me | gloksinia questions are always welcome - hopefully someone will be available who can answer :) | 04:03 |
| odyssey4me | alright, time for me to try to sleep again - night night | 04:04 |
| Prateek | Hi i have made changes in all.yml and user_variable.yml "openstack_service_publicuri_proto: http" and "openstack_external_ssl: false" still my identity endpoint is coming as https can anyone please help? | 04:09 |
| gloksinia | Okay thank you :) | 04:09 |
| *** markvoelker_ has joined #openstack-ansible | 04:12 | |
| *** markvoelker has quit IRC | 04:12 | |
| gloksinia | So I have got a problem with OVS on openstack ansible after i restarted network host( Actually is the same infra host ) kernel didn't load openvswitch properly i need to use command modprobe to make kernel reload openvswitch. | 04:13 |
| gloksinia | Please help. | 04:15 |
| cloudnull | odyssey4me: have a good night | 04:18 |
| cloudnull | is the module in /etc/modules | 04:18 |
| gloksinia | No have. | 04:20 |
| gloksinia | cloudnull No have | 04:20 |
| cloudnull | check the file /etc/modules | 04:21 |
| cloudnull | if the module you need is not there, add it | 04:21 |
| gloksinia | I need to add it into /etc/modules manually ? | 04:21 |
| gloksinia | Actually i thought that it were added by override config in user_variables.yml right ? | 04:24 |
| *** m|y|k has joined #openstack-ansible | 04:31 | |
| cloudnull | gloksinia: It should have been added during the deployment. | 04:36 |
| cloudnull | but if its not there add it and we can figure out what, if anything, has gone wrong. | 04:36 |
| *** chhavi has joined #openstack-ansible | 04:48 | |
| openstackgerrit | Taseer Ahmed proposed openstack/openstack-ansible-os_congress master: Introduce os_congress role in gerrit https://review.openstack.org/522491 | 04:52 |
| *** gouthamr has quit IRC | 04:53 | |
| gloksinia | Okay for more information i try doing the same things with compute. After reboot, it can working fine although /etc/module also don't have any openvswitch. | 04:59 |
| gloksinia | I added openvswitch into /etc/modules then reboot the network host it all working fine. | 05:00 |
| *** woodard has quit IRC | 05:01 | |
| *** woodard has joined #openstack-ansible | 05:02 | |
| *** pradiprwt has joined #openstack-ansible | 05:04 | |
| cloudnull | ok. | 05:04 |
| cloudnull | can you describe the inital setup? what release is this ? | 05:05 |
| pradiprwt | Hi Everyone, if I want to install openstack service on host instead of containers, what are the changes I need to do ? | 05:05 |
| cloudnull | pradiprwt: all of the services can be set to run on metal by simply changing the environment files | 05:09 |
| cloudnull | evrardjp: has a patch that is doing this for the gate | 05:09 |
| cloudnull | https://review.openstack.org/#/c/504224 | 05:09 |
| cloudnull | you can see the environmental change here https://review.openstack.org/#/c/504224/30/etc/openstack_deploy/env.d/all_metal.yml.example | 05:09 |
| cloudnull | gloksinia: in master I can see the modules should have been added via this setting | 05:11 |
| cloudnull | https://github.com/openstack/openstack-ansible-os_neutron/blob/5763ec83c727774ea72544ccf2ba4b53096dc405/doc/source/app-openvswitch.rst#openstack-ansible-user-variables | 05:11 |
| cloudnull | is that something you have in your deployment ? | 05:11 |
| cloudnull | specifically the "openstack_host_specific_kernel_modules" part | 05:11 |
| *** poopcat has quit IRC | 05:12 | |
| pradiprwt | cloudnull : I am little confuse, what should be good for production environment ? | 05:12 |
| pradiprwt | containerized services or bare metal ? | 05:13 |
| cloudnull | The most tested solution is to use the native LXC driver. | 05:13 |
| cloudnull | but that's really all up to you | 05:13 |
| cloudnull | what's the size of the deployment? | 05:14 |
| pradiprwt | 10 node | 05:14 |
| cloudnull | personally I'd use the stock deployment with lxc containers. | 05:15 |
| cloudnull | i know it scales, and holds up to serious torment. | 05:16 |
| gloksinia | I'am using stable/pike branch and No have special configure actually i use all standard config follow by document https://docs.openstack.org/openstack-ansible-os_neutron/pike/app-openvswitch.html | 05:16 |
| cloudnull | having run the old OSIC cloud on it for a year or so. | 05:16 |
| pradiprwt | cloudnull : I have experience by deploying using LXC container but I don't know about bare metal | 05:16 |
| cloudnull | gloksinia: the end of that doc covers the user_variables you need | 05:17 |
| cloudnull | https://docs.openstack.org/openstack-ansible-os_neutron/pike/app-openvswitch.html#openstack-ansible-user-variables | 05:17 |
| pradiprwt | cloudnull : So, as your experience I should go with LXC ? | 05:17 |
| gloksinia | Added it already. | 05:17 |
| cloudnull | gloksinia: you have that in the user_variables.yml file ? | 05:18 |
| gloksinia | Yes. | 05:18 |
| cloudnull | was that added later in the deployment | 05:19 |
| gloksinia | Actually need to modify pattern form ' pattern: "CONFIG_OPENVSWITCH=" ' to ' pattern: "CONFIG_OPENVSWITCH" ' | 05:19 |
| cloudnull | if the option was there it should have been picked up here https://github.com/openstack/openstack-ansible-openstack_hosts/blob/ef7eeaae77fc80c95316869fa07560aefac84e15/tasks/configure_metal_hosts.yml#L48-L74 | 05:19 |
| cloudnull | ah ok. | 05:19 |
| cloudnull | so maybe we need to update the docs | 05:20 |
| cloudnull | ha, looks like we did https://docs.openstack.org/openstack-ansible-os_neutron/latest/app-openvswitch.html#openstack-ansible-user-variables | 05:20 |
| cloudnull | just need to backport that into the pike docs | 05:20 |
| cloudnull | pradiprwt: for now yes. | 05:20 |
| cloudnull | you can change things to run on metal | 05:21 |
| cloudnull | as needed | 05:21 |
| cloudnull | or as you like | 05:21 |
| cloudnull | but if you're going for prod, and trying to use the most stable/tested solution, that'd be lxc | 05:21 |
| pradiprwt | cloudnull : I want the environment should run longer without any problem | 05:22 |
| gloksinia | For that config on user_variables i push it for the first time deployment. | 05:22 |
| cloudnull | gloksinia: so it's likely just a matter of that pattern match | 05:23 |
| pradiprwt | cloudnull : what about the managing or updating the cloud environment, is it flexible with ansible-openstack ? | 05:23 |
| cloudnull | you can change that in the user_variables and rerun the openstack-host-setup playbook | 05:23 |
| cloudnull | pradiprwt: yes. | 05:23 |
| cloudnull | we've had upgrades for some time | 05:23 |
| cloudnull | both major and intra-series | 05:24 |
| pradiprwt | cloudnull : Awesome, Thanks I will go for deployment with LXC :) | 05:25 |
| cloudnull | ++ | 05:26 |
| gloksinia | cloudnull: I re run playbook again for ensure after finished i will told the result to you. | 05:30 |
| cloudnull | sounds good | 05:30 |
| gloksinia | pradiprwt: Good questions maybe u and me are in the same situation after ansible-openstack on lxc I also need to compare with bare_metal too. LOL | 05:32 |
| pradiprwt | gloksinia : Are you installing it on bare metal now ? | 05:33 |
| gloksinia | cloudnull: A bit more question | 05:33 |
| cloudnull | evrardjp: http://paste.openstack.org/show/628674/ - looks like our vars plugin w/ ansible 2.4 is broken and causing a really bad time w/ master on a multi-node baremetal environment | 05:33 |
| cloudnull | gloksinia: sure | 05:34 |
| gloksinia | In your opinion should i use ceph integration on OSA or dedicated deploy ? | 05:36 |
| gloksinia | I'm going for prod. | 05:36 |
| gloksinia | pradiprwt: Not yet just prepare the information. It will be next step for right now I'm testing networking linuxbridge or OVS. | 05:39 |
| *** robcresswell has quit IRC | 05:39 | |
| pradiprwt | gloksinia : Yeah we are on same page.. I have to make Ceph cluster as separate deployment and latter integration with openstack | 05:41 |
| pradiprwt | gloksinia : For networking which one you feel good OVS or linuxbridge ? | 05:43 |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible master: Add pip config to lxc_hosts https://review.openstack.org/527308 | 05:47 |
| cloudnull | gloksinia: I know quite a few folks that have been running ceph w/ osa | 05:47 |
| cloudnull | they seem to like it a lot | 05:47 |
| cloudnull | I've no personal experience with it so I can't give you my opinion on the matter but from what I hear it works well. | 05:48 |
| gloksinia | pradiprwt: Actually, I feel good with linuxbridge it so strong but for necessary feature is not provided. | 05:48 |
| cloudnull | My one recommendation would be to make sure your network is sized appropriately to handle the traffic you expect from your compute hosts and you should be good to go. | 05:48 |
| *** kanokg has joined #openstack-ansible | 05:49 | |
| cloudnull | pradiprwt: I personally perfer linuxbridge but gloksinia is right, feature wise ovs has more. | 05:49 |
| *** kanokg has quit IRC | 05:49 | |
| cloudnull | evrardjp: in order to get a full deployment to go with http://paste.openstack.org/show/628675/ | 05:51 |
| cloudnull | ansible 2.4.2 | 05:51 |
| cloudnull | i had to sync the group_vars to /etc/openstack_deploy | 05:52 |
| cloudnull | it works afterwords | 05:52 |
| cloudnull | but the vars plugin is still broken | 05:52 |
| gloksinia | cloudnull: Okay i test ceph on OSA :D | 05:56 |
| gloksinia | sorry for my bad english T_T | 05:57 |
| *** bubble_ has joined #openstack-ansible | 06:02 | |
| *** hybridpollo has quit IRC | 06:02 | |
| *** nshetty_ has joined #openstack-ansible | 06:07 | |
| *** nshetty has quit IRC | 06:09 | |
| *** nshetty__ has joined #openstack-ansible | 06:11 | |
| *** nshetty__ is now known as nshetty | 06:12 | |
| *** nshetty_ has quit IRC | 06:13 | |
| cloudnull | gloksinia: your english is fine :) | 06:19 |
| cloudnull | feel free to ask whatever questions you have | 06:19 |
| *** nshetty is now known as nshetty|mtg | 06:24 | |
| gloksinia | cloudnull: thank you so much :) | 06:26 |
| gloksinia | Let started LOL. | 06:26 |
| *** indistylo has joined #openstack-ansible | 06:28 | |
| gloksinia | How you monitoring service in LXC my team trying to deploy monassca but still not success. | 06:28 |
| *** indistylo has quit IRC | 06:28 | |
| ThomasS | good morning | 06:40 |
| ThomasS | is it still possible in pike horizon to use pngs instead of svgs? | 06:40 |
| ThomasS | the OSA docs say only svgs | 06:41 |
| *** nshetty|mtg is now known as nshetty | 06:41 | |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-pip_install master: Set pip to use the pypi-server when locked down https://review.openstack.org/526889 | 06:43 |
| cloudnull | ThomasS: only svgs sadly . | 06:43 |
| cloudnull | horizon is now ignoring png files | 06:44 |
| cloudnull | gloksinia: monassca is a little frustrating. | 06:44 |
| cloudnull | we have a role for it, but i've not used it | 06:44 |
| cloudnull | gloksinia: I work for Rackspace and we use https://github.com/rcbops/rpc-maas | 06:45 |
| cloudnull | depending on what you need or want, you might be able to pull out plugin parts and add them to your monitoring system | 06:45 |
| cloudnull | when i was running the osic i used https://github.com/openstack/openstack-ansible-ops/tree/master/cluster_metrics | 06:46 |
| cloudnull | which was great for getting performance metrics and cluster usage | 06:46 |
| gloksinia | cloudnull: Still not work after ensure that OVS in user_variables is completed configure. After reboot network node( it on infra host ) command ' lsmod | grep openvswitch ' show nothing | 06:47 |
| cloudnull | after rerunning the playbooks it should have added the kernel module to /etc/modules. | 06:49 |
| cloudnull | did you not see that ? | 06:49 |
| gloksinia | Don't have. any module name openvswitch | 06:50 |
| *** chyka has joined #openstack-ansible | 06:51 | |
| cloudnull | that's not good. what about /etc/modules-load.d/modules.conf ? | 06:51 |
| gloksinia | Don't have too | 06:52 |
| gloksinia | I use stable/pike branch pulling on friday I'm not sure with the release version. | 06:53 |
| cloudnull | that should be fine. | 06:54 |
| cloudnull | can you paste-bin the user_variables file ? | 06:55 |
| cloudnull | or at least the kernel ops variable | 06:55 |
| cloudnull | I can give what you have a go to see if i can replicate it | 06:55 |
| *** chyka has quit IRC | 06:55 | |
| cloudnull | it might be tomorrow though | 06:55 |
| cloudnull | because I'm going to bed :D | 06:56 |
| *** DanyC_ has quit IRC | 06:56 | |
| *** DanyC has joined #openstack-ansible | 06:57 | |
| gloksinia | what the ways you prefer for me to send you a config i'm quite new for community. | 06:57 |
| gloksinia | cloudnull: Have a nice dream. | 07:01 |
| cloudnull | we use http://paste.openstack.org for non-sensitive things | 07:01 |
| cloudnull | take care gloksinia | 07:01 |
| cloudnull | have a good night/day yourself | 07:01 |
| *** DanyC has quit IRC | 07:01 | |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-pip_install master: Set pip to use the pypi-server when locked down https://review.openstack.org/526889 | 07:03 |
| *** udesale__ has joined #openstack-ansible | 07:03 | |
| openstackgerrit | Taseer Ahmed proposed openstack/openstack-ansible-os_congress master: Introduce os_congress role in gerrit https://review.openstack.org/522491 | 07:04 |
| *** udesale__ has quit IRC | 07:04 | |
| *** udesale__ has joined #openstack-ansible | 07:04 | |
| *** udesale has quit IRC | 07:04 | |
| gloksinia | cloudnull: this is my user_variables.yml https://pastebin.com/vM42CTKB | 07:11 |
| *** epalper has joined #openstack-ansible | 07:12 | |
| *** nshetty is now known as nshetty|lunch | 07:15 | |
| *** chhavi__ has joined #openstack-ansible | 07:20 | |
| *** chhavi has quit IRC | 07:22 | |
| *** ppetit has joined #openstack-ansible | 07:33 | |
| *** armaan has quit IRC | 07:33 | |
| *** armaan has joined #openstack-ansible | 07:34 | |
| *** robcresswell has joined #openstack-ansible | 07:39 | |
| jafeha | good morning | 07:41 |
| openstackgerrit | Periyasamy Palanisamy proposed openstack/openstack-ansible-specs master: blueprint spec for opendaylight bgpvpn support https://review.openstack.org/523171 | 07:45 |
| *** hamza21 has joined #openstack-ansible | 07:49 | |
| evrardjp | cloudnull: I haven't read everything you said, I don't have enough scrollback, but it works for me, and it worked in gates, including variables overrides, at least that's what the test says. | 07:50 |
| evrardjp | Yeah the vars plugin is broken, on purpose: we don't need it in 2.4. | 07:50 |
| evrardjp | So when it tries to load for 2.4, we basically don't load anything, and it throws a warning. That was a quick hack. | 07:51 |
| evrardjp | then the variables are loaded as normally as it should for ansible. | 07:51 |
| evrardjp | Check your env vars maybe you have an override there. | 07:51 |
| evrardjp | jafeha: good morning | 07:51 |
| jafeha | good morning evrardjp | 07:52 |
| evrardjp | how are you today? | 07:52 |
| openstackgerrit | Jean-Philippe Evrard proposed openstack/openstack-ansible master: [DNM] Build everything on metal https://review.openstack.org/504224 | 07:57 |
| *** mbuil has joined #openstack-ansible | 08:00 | |
| openstackgerrit | Manuel Buil proposed openstack/openstack-ansible master: Add networking-sfc repo to repo_packages https://review.openstack.org/525264 | 08:01 |
| Mr_Smurf | I'm trying to do a minor upgrade but I am running in to problems. | 08:01 |
| Mr_Smurf | I want to upgrade one of the mgmt nodes first to make sure that things are working. | 08:01 |
| Mr_Smurf | So far i have done "openstack-ansible setup-hosts.yml --limit u-mn-o26", "openstack-ansible lxc-containers-create.yml --limit lxc_hosts,repo_all", "openstack-ansible repo-install.yml --limit lxc_hosts,repo_all" and "openstack-ansible -e rabbitmq_upgrade=true setup-infrastructure.yml --limit u-mn-o26" | 08:02 |
| Mr_Smurf | But when I run "openstack-ansible setup-infrastructure.yml --limit lxc_hosts,u-mn-o26_galera_container-7561ce0c" to upgrade my galera i run in to the error | 08:02 |
| Mr_Smurf | TASK [galera_server : Drop mariadb config(s)] ********************************** | 08:02 |
| Mr_Smurf | fatal: [u-mn-o26_galera_container-7561ce0c]: FAILED! => {"failed": true, "msg": "'dict object' has no attribute 'ansible_processor_vcpus'"} | 08:02 |
| jafeha | evrardjp, i'm good. bughunting in my network stack but thats just fine. | 08:02 |
| jafeha | how are u today? | 08:02 |
| Mr_Smurf | ansible_processor_vcpus i set in /etc/openstack_deploy/ansible_facts/u-mn-o26_galera_container-7561ce0c | 08:03 |
| Mr_Smurf | Any suggestions on what I am doing wrong? | 08:03 |
| *** armaan has quit IRC | 08:03 | |
| openstackgerrit | Jean-Philippe Evrard proposed openstack/openstack-ansible master: Workaround ansible lint failure https://review.openstack.org/527333 | 08:04 |
| *** jvidal has joined #openstack-ansible | 08:04 | |
| openstackgerrit | Periyasamy Palanisamy proposed openstack/openstack-ansible master: correct ha proxy configuration for opendaylight https://review.openstack.org/526055 | 08:05 |
| *** gkadam has joined #openstack-ansible | 08:07 | |
| *** nshetty has joined #openstack-ansible | 08:14 | |
| *** nshetty|lunch has quit IRC | 08:14 | |
| Mr_Smurf | Could it be this very old bug that is still there in some cases? https://bugs.launchpad.net/openstack-ansible/+bug/1400444 | 08:22 |
| openstack | Launchpad bug 1400444 in openstack-ansible "galera fails with "One or more undefined variables: 'dict object' has no attribute 'ansible_processor_vcpus"" [Undecided,Expired] | 08:22 |
| *** hw_wutianwei has quit IRC | 08:23 | |
| *** armaan has joined #openstack-ansible | 08:23 | |
| *** hw_wutianwei has joined #openstack-ansible | 08:26 | |
| Mr_Smurf | tasker seemed to have the same issue 2017-09-06, and a reset of the facts seemd to solve the issue for him.. will look in the IRC logs and see if I can do whatvever he did | 08:26 |
| *** cshen_ has joined #openstack-ansible | 08:27 | |
| *** armaan has quit IRC | 08:32 | |
| *** armaan has joined #openstack-ansible | 08:32 | |
| Mr_Smurf | well, removing the facts file and regenerating it did not solve the issue for me, but it did for tasker.. | 08:32 |
| evrardjp | what folder did you remove Mr_Smurf ? | 08:34 |
| Mr_Smurf | evrardjp: I just moved my facts file away /etc/openstack_deploy/ansible_facts/u-mn-o26_galera_container-7561ce0c | 08:37 |
| *** cshen_ has quit IRC | 08:38 | |
| Mr_Smurf | evrardjp: but looking at the logs from eavesdrop.openstack.org/irclogs/%23openstack-ansible/%23openstack-ansible.log.html it looks like the issue is the --limit part | 08:38 |
| Mr_Smurf | for some reason it does not get all the facts when the playbook is run wit --limit | 08:38 |
| *** santosh has joined #openstack-ansible | 08:38 | |
| *** cshen_ has joined #openstack-ansible | 08:39 | |
| *** santosh is now known as Guest7416 | 08:39 | |
| Mr_Smurf | So how can I limit to only run one galera container and nothing else without using limit? | 08:39 |
| Mr_Smurf | I could just run openstack-ansible -e rabbitmq_upgrade=true setup-infrastructure.yml | 08:40 |
| Mr_Smurf | but how much will then exload in a live cloud with multiple running instances? | 08:40 |
| Mr_Smurf | s/exload/expload" | 08:41 |
| openstackgerrit | Jean-Philippe Evrard proposed openstack/openstack-ansible-os_congress master: Introduce os_congress role in gerrit https://review.openstack.org/522491 | 08:43 |
| evrardjp | Mr_Smurf: first, you can only target the playbook you want instead of the whole infrastructure | 08:44 |
| *** rodolof has joined #openstack-ansible | 08:44 | |
| evrardjp | if you want to touch only galera , it's galera-install.yml | 08:44 |
| evrardjp | then you can add to your limit localhost | 08:45 |
| evrardjp | if you need | 08:45 |
| -openstackstatus- NOTICE: Our CI system Zuul is currently not accessible. Wait with approving changes and rechecks until it's back online. Currently waiting for an admin to investigate. | 08:47 | |
| armaan | evrardjp: Hello! A quick question. I want to include the fix for this bug https://bugs.launchpad.net/neutron/+bug/1732543 in my current deployment. AFAIK i have to change the SHA for neutron here https://github.com/openstack/openstack-ansible/blob/stable/pike/playbooks/defaults/repo_packages/openstack_services.yml#L125 | 08:50 |
| openstack | Launchpad bug 1732543 in neutron "HA network tenant network fails upon router delete" [High,Fix released] - Assigned to Brian Haley (brian-haley) | 08:50 |
| armaan | bootstrap again and run the neutron playbook? or i also need to build the repo again? | 08:50 |
| *** gigo has joined #openstack-ansible | 08:53 | |
| evrardjp | hey armaan | 08:53 |
| evrardjp | yes you'd need to apply the patch to a different source | 08:54 |
| armaan | evrardjp: how are you? I have a good news. We are going to provide you a new developer. | 08:54 |
| evrardjp | then run all what you said: | 08:54 |
| armaan | evrardjp: different source? | 08:54 |
| evrardjp | repo to build a new neutron (check that it was well build, if not, destroy the content of the repo and start again after a backup) | 08:55 |
| evrardjp | armaan: I mean on your own repo I guess, if you are alone carrying that patch | 08:55 |
| evrardjp | armaan: you are waiting for this to merge https://review.openstack.org/#/c/526102/, right? | 08:55 |
| evrardjp | so you'd have to apply it to your own repo until it's merged? | 08:56 |
| *** dun has quit IRC | 08:56 | |
| armaan | evrardjp: Yep. Waiting for it to get merged. | 08:56 |
| evrardjp | anyway, yes, repo build (check it's well rebuilt for neutron), then the neutron playbook | 08:56 |
| *** gigo has quit IRC | 08:56 | |
| evrardjp | you don't need to modify the roles or anything, so don't need to bootstrap ansible. However if you do it, it doesn't hurt so ... why not :) | 08:57 |
| evrardjp | armaan: good news :) | 08:58 |
| evrardjp | what's your focus right now? something with ovs apparently? | 08:59 |
| evrardjp | oh no my bad | 08:59 |
| armaan | evrardjp: Yep! She will join you guys in PTG as well. I will make the introductions very soon. | 08:59 |
| evrardjp | oh that's awesome | 09:00 |
| armaan | evrardjp: Yes, company wanted to start contributing upstream and I said hey! let's start with OSA | 09:01 |
| *** cshen_ has quit IRC | 09:02 | |
| gloksinia | Pardon me which playbook should i run if changed is_metal from true to false | 09:03 |
| evrardjp | armaan: that's great :) | 09:06 |
| evrardjp | gloksinia: depends on which component | 09:06 |
| Mr_Smurf | evrardjp: without limits there is no error.. very strange | 09:06 |
| evrardjp | if you changed cinder from true to false, reapply on cinder | 09:07 |
| evrardjp | Mr_Smurf: :) | 09:07 |
| evrardjp | so it works! | 09:07 |
| evrardjp | :D | 09:07 |
| evrardjp | probably the localhost as mentioned | 09:07 |
| -openstackstatus- NOTICE: Zuul is back online, looks like a temporary network problem. | 09:07 | |
| Mr_Smurf | there is a bug somewhere... but well it works.. But it should also work with limit | 09:07 |
| evrardjp | Mr_Smurf: so you used --limit localhost,galera_all ? | 09:09 |
| Mr_Smurf | I did not run with any --limit | 09:09 |
| evrardjp | no I mean when it failed with limit | 09:10 |
| evrardjp | so without limit it works | 09:10 |
| evrardjp | and with --limit x it fails where? | 09:10 |
| evrardjp | and what was x ? | 09:10 |
| *** jappleii__ has quit IRC | 09:10 | |
| evrardjp | Let's dig deeper in this bug :) | 09:10 |
| Mr_Smurf | with limit i used the host name of the controller and the name of the container | 09:10 |
| evrardjp | if any | 09:10 |
| evrardjp | and no localhost? | 09:10 |
| evrardjp | and you wanted to do what exactly ? | 09:11 |
| evrardjp | destroy, rebuild container for galera? | 09:11 |
| Mr_Smurf | yes.. like this openstack-ansible setup-infrastructure.yml --limit u-mn-o26,u-mn-o26_galera_container-7561ce0c | 09:11 |
| Mr_Smurf | no rebuild of the container | 09:11 |
| Mr_Smurf | upgrade from 14.0.7 | 09:11 |
| evrardjp | ok, what was it for? | 09:11 |
| evrardjp | mmm | 09:11 |
| evrardjp | why don't you use the playbook directly? | 09:12 |
| *** nshetty is now known as nshetty|BMGR | 09:12 | |
| *** shardy has joined #openstack-ansible | 09:12 | |
| Mr_Smurf | well, I could but I was just lazy I guess | 09:12 |
| evrardjp | https://github.com/openstack/openstack-ansible/blob/master/playbooks/galera-install.yml#L19 is serial | 09:12 |
| Mr_Smurf | I will run it again with the same limits and see if it still fails | 09:13 |
| gloksinia | evrarjp: I'm changing on cinder after made of that change os-cinder-install still made change on bare metal not on LXC | 09:14 |
| *** lhinds|out is now known as lhinds | 09:14 | |
| Mr_Smurf | now the old command runs even with limits | 09:15 |
| evrardjp | gloksinia: maybe you hit a bug. Is that a production deploy or a test deploy? | 09:17 |
| evrardjp | if it's a prod deploy, you will have to remove this old mention of your inventory and your facts | 09:18 |
| evrardjp | of your generated inventory* | 09:18 |
| evrardjp | if it's a test deploy, you can probably start from scratch, to avoid the surgical changes. | 09:18 |
| evrardjp | in a test deploy, you can destroy your host containers then delete the ansible facts on your deploy node, then delete the inventory on your deploy node. Then re-run all the playbooks and it will be clean | 09:19 |
| *** vnogin has joined #openstack-ansible | 09:21 | |
| gloksinia | evrardjp: Okay thank you much :) | 09:22 |
| evrardjp | gloksinia: when it's not a prod deploy, use the bazooka approach. It works fine. | 09:23 |
| *** armaan has quit IRC | 09:24 | |
| *** armaan has joined #openstack-ansible | 09:25 | |
| gloksinia | evrardjp: Sorry what is bazooka. This is only test deploy. | 09:25 |
| *** DanyC has joined #openstack-ansible | 09:26 | |
| Mr_Smurf | gloksinia: https://en.wikipedia.org/wiki/Bazooka | 09:27 |
| Mr_Smurf | gloksinia: "bazooka approach" = "destroy and restart" | 09:28 |
| gloksinia | Mr_Smurf: Okay got it man LOL. | 09:29 |
| evrardjp | :) | 09:30 |
| *** vnogin has quit IRC | 09:32 | |
| *** dun has joined #openstack-ansible | 09:32 | |
| gloksinia | previously cloudnull recommend me two of this thing https://github.com/rcbops/rpc-maas | 09:34 |
| gloksinia | and https://github.com/openstack/openstack-ansible-ops/tree/master/cluster_metrics | 09:35 |
| gloksinia | for monitoring do you guys have another too just kept it for comparing | 09:35 |
| *** vnogin has joined #openstack-ansible | 09:37 | |
| *** nshetty|BMGR is now known as nshetty|call | 09:37 | |
| evrardjp | I am working for the same company as cloudnull, and my previous company was doing something similar with zabbix | 09:39 |
| evrardjp | now I know that there are other ppl interested by improve monitorstack | 09:40 |
| evrardjp | or by changing things in monitoring all together like ppetit | 09:40 |
| *** cshen_ has joined #openstack-ansible | 09:42 | |
| *** nshetty|call is now known as nshetty | 09:43 | |
| *** nshetty is now known as nshetty|mtg | 09:44 | |
| *** pbandark has joined #openstack-ansible | 09:45 | |
| *** cshen_ has quit IRC | 09:59 | |
| *** jhesketh has joined #openstack-ansible | 10:04 | |
| openstackgerrit | Jean-Philippe Evrard proposed openstack/openstack-ansible-os_congress master: Introduce os_congress role in gerrit https://review.openstack.org/522491 | 10:05 |
| pradiprwt | any one have sample network interface file configuration for centOS 7, official documentation have only ubuntu | 10:06 |
| evrardjp | probably google, or I'd check the bootstrap hosts role | 10:07 |
| *** ppetit has left #openstack-ansible | 10:07 | |
| *** hamza21 has quit IRC | 10:11 | |
| *** alefra has joined #openstack-ansible | 10:13 | |
| *** m|y|k has quit IRC | 10:19 | |
| *** m|y|k has joined #openstack-ansible | 10:21 | |
| *** loudgefly has joined #openstack-ansible | 10:22 | |
| evrardjp | ok found out the issue in gates! | 10:24 |
| evrardjp | WOOOOOT | 10:24 |
| evrardjp | name of the host + name of the container + veth pair > 63 chars. | 10:25 |
| evrardjp | odyssey4me: are you there? | 10:25 |
| loudgefly | Hi everyone, did someone know nay good source of doc/info/how to for installing Monasca & Barbican using openstack-ansible? | 10:26 |
| loudgefly | I didn't manage to find some useful... | 10:26 |
| *** rpittau has joined #openstack-ansible | 10:26 | |
| evrardjp | loudgefly: os_barbican documentation | 10:26 |
| evrardjp | I mean openstack-ansible-os_barbican | 10:26 |
| Mr_Smurf | well, now the os-keystone-install.yml playbook is complaining in the "Gather software version list" task.. "atal: [u-mn-o25_keystone_container-aac4153f]: FAILED! => {"failed": true, "msg": "Unexpected failure during module execution.", "stdout": ""}" | 10:26 |
| evrardjp | for monasca, it's failing | 10:26 |
| Mr_Smurf | there is a long stacktrace but in the end it says KeyError: 'keystone' | 10:26 |
| evrardjp | I mean we have a role but not much people working on it | 10:27 |
| odyssey4me | evrardjp yep | 10:27 |
| evrardjp | odyssey4me: ok let me pick your brain for a sec | 10:27 |
| evrardjp | for all on metal | 10:27 |
| evrardjp | I need to still generate the inventory, because I don't want to change everything | 10:27 |
| evrardjp | the generation of the inventory generates container names, even if doesn't care | 10:27 |
| evrardjp | so it generates ame of the host + name of the container + veth pair | 10:28 |
| evrardjp | "name of the host + name of the container + veth pair" | 10:28 |
| evrardjp | well | 10:28 |
| evrardjp | it generates name of the host + name of the container | 10:28 |
| evrardjp | and checks its length | 10:28 |
| evrardjp | in my case, on gates, I have long hostnames | 10:28 |
| loudgefly | evrardjp: ok, thanks I will go for a try on barbican | 10:28 |
| evrardjp | and for rabbitmq running on baremetal I need to have a proper hostname management | 10:29 |
| evrardjp | So, question, what should I do in gates? | 10:29 |
| odyssey4me | evrardjp oh, of course - I've seen how you do things... you have a hostname like 'use-this-until-you-figure-out-what-is-wrong-with-my-config' don't you? ;) | 10:29 |
| evrardjp | 1) Do not use the long hostname in gates, use aio1 and cleanup the hostname live | 10:29 |
| *** armaan has quit IRC | 10:29 | |
| Prateek | Hi i have made following changes in all.yml and user_variable.yml "openstack_service_publicuri_proto: http" and "openstack_external_ssl: false" still my identity endpoint is coming as https can anyone please help? | 10:29 |
| evrardjp | odyssey4me: what do you mean? | 10:30 |
| *** armaan has joined #openstack-ansible | 10:30 | |
| evrardjp | there is nothing wrong in the AIO build | 10:30 |
| odyssey4me | reality is that production may have long hostnames - so we need to cater to whatever is allowed by the DNS spec for a hostname length | 10:30 |
| evrardjp | in full metal | 10:30 |
| evrardjp | well | 10:30 |
| odyssey4me | Prateek was that done before the first install, or was it done later? | 10:30 |
| evrardjp | there is a simple way to fix it: don't use that inventory | 10:31 |
| evrardjp | the other way would be, like I have on my machine, reset the hostname to aio1 | 10:31 |
| evrardjp | for me it makes 100% sense to use the given hostname | 10:31 |
| evrardjp | so the sed -i "s/aio1/$(hostname)" in our config files make sense | 10:32 |
| evrardjp | but then the generation fails, and I don't want to change that in the same commit | 10:32 |
| evrardjp | that's insane | 10:32 |
| evrardjp | so what would you do? | 10:32 |
| Prateek | @odyssey4me, it was done later | 10:34 |
| Prateek | @odyssey4me, i created setup first time with ssl enabled later on i wanted not to use ssl. | 10:34 |
| *** loudgefly_ has joined #openstack-ansible | 10:37 | |
| odyssey4me | Prateek ok, then you may have to use the openstack client and the admin endpoint of keystone to modify them | 10:37 |
| odyssey4me | I'm not sure whether we've adjusted all the service registrations to replace the endpoints if it changes on an existing install | 10:37 |
| odyssey4me | evrardjp as I mentioned earlier, we should cater to whatever hostname length is given as long as it fits within the DNS spec | 10:38 |
| odyssey4me | so sure, if you want to split concerns, then either fix that in a patch beforehand - or just use aio1 for now | 10:38 |
| Mr_Smurf | removing my --limit solved that error.. strange.. | 10:39 |
| openstackgerrit | Jean-Philippe Evrard proposed openstack/openstack-ansible master: [DNM] Build everything on metal https://review.openstack.org/504224 | 10:40 |
| odyssey4me | Mr_Smurf using --limit with serialise playbooks can cause some trouble | 10:40 |
| *** loudgefly has quit IRC | 10:40 | |
| odyssey4me | you may want to be a bit more surgical - for example, create the container using openstack-ansible lxc-containers-create.yml -- limit lxc_hosts,<container name or group> | 10:40 |
| *** nshetty|mtg is now known as nshetty | 10:41 | |
| Mr_Smurf | odyssey4me: yes, is there some other way to stop after the first controller is updated? So I can verify that stuff is working | 10:41 |
| *** Neptu has quit IRC | 10:41 | |
| odyssey4me | then run the playbook for the service (ie galera-install) without the limit, because the whole cluster needs to work together | 10:41 |
| openstackgerrit | Jean-Philippe Evrard proposed openstack/openstack-ansible master: [DNM] Build everything on metal https://review.openstack.org/504224 | 10:41 |
| Mr_Smurf | ok, so it's fire and then fix.. | 10:41 |
| odyssey4me | Mr_Smurf as far as I know, yes - if you can figure out a way to do it then our docs would benefit from that... if it can't be done with our current code, but you can figure out what to change to make it work, then our code will benefit from that ;) | 10:42 |
| Mr_Smurf | odyssey4me: ok, then I'm just doing it wrong :) | 10:43 |
| Mr_Smurf | well I've managed to update the scary parts (rebbit, galera and keystone) and things are working so far :) | 10:45 |
| Prateek | @odyssey4me, other services configure to http successfully only identity service is not getting configured to http it is still stuck on https... are you talking about modifying endpoint using openstack endpoint create --region RegionOne identity public http://controller:5000/v3 | 10:46 |
| odyssey4me | cores - note that it looks like somethng's gone belly up in infra so don't bother rechecking: you'll see errors like this in the logs: http://logs.openstack.org/99/527099/2/check/openstack-ansible-linters/99828a9/job-output.txt.gz#_2017-12-12_10_28_51_738150 | 10:46 |
| odyssey4me | Prateek yes, except I think it's "update" not create... but you can also create a new one and delete the old one | 10:47 |
| openstackgerrit | Jean-Philippe Evrard proposed openstack/openstack-ansible-os_congress master: Introduce os_congress role in gerrit https://review.openstack.org/522491 | 10:48 |
| odyssey4me | cores - never mind, the issue was around an hour ago, so go ahead and recheck now if you see a job timeout | 10:49 |
| Prateek | @odyssey4me, No command to update the endpoint let me try with creating and deleting the old one | 10:50 |
| *** cshen_ has joined #openstack-ansible | 10:52 | |
| *** Taseer has quit IRC | 11:03 | |
| *** pedja has joined #openstack-ansible | 11:03 | |
| *** cshen_ has joined #openstack-ansible | 11:04 | |
| *** rodolof has quit IRC | 11:04 | |
| *** MasterofJOKers has quit IRC | 11:08 | |
| *** MasterofJOKers has joined #openstack-ansible | 11:11 | |
| *** wspthr has quit IRC | 11:22 | |
| *** wspthr has joined #openstack-ansible | 11:23 | |
| *** stuartgr has joined #openstack-ansible | 11:30 | |
| *** Taseer has joined #openstack-ansible | 11:40 | |
| *** mwynne has quit IRC | 11:42 | |
| *** m|y|k has quit IRC | 11:44 | |
| *** m|y|k has joined #openstack-ansible | 11:44 | |
| *** smatzek has joined #openstack-ansible | 11:45 | |
| *** loudgefly_ has quit IRC | 11:49 | |
| *** loudgefly has joined #openstack-ansible | 11:50 | |
| evrardjp | odyssey4me: in gates, is repo_build_git_cache: /opt/git/openstack empty , or is it populated ? | 11:50 |
| evrardjp | I do not mean the variable itself, I mean the folder contents | 11:50 |
| *** cshen_ has quit IRC | 11:50 | |
| evrardjp | or asked differently: has /opt/git/openstack content in our gates | 11:51 |
| evrardjp | I suppose the folder exists, else we woulnd't get this variable populated, but I wonder with what content | 11:52 |
| odyssey4me | evrardjp it's now empty - that was the place where zuul v2 put the git caches - zuul v3 puts them in a different place now, and we don't cache any repositories now... and trying to use the cache would break things anyway with the current tooling | 11:53 |
| odyssey4me | that's why I have the patches to remove that functionality, with the intent to replace it with something that works with zuul v3 | 11:54 |
| odyssey4me | but I want to get https://review.openstack.org/516448 merged first | 11:55 |
| evrardjp | are you talking about removing https://github.com/openstack/openstack-ansible/blob/6bff605c627112018788993f7f7e193ea5834145/playbooks/repo-build.yml#L64-L122 ? | 11:56 |
| odyssey4me | evrardjp https://review.openstack.org/521750 and https://review.openstack.org/521749 | 11:56 |
| odyssey4me | it was a terrible system, implemented purely to actually provide for zuul | 11:57 |
| odyssey4me | symlink, then bind mount, then symlink | 11:57 |
| odyssey4me | ugh | 11:57 |
| odyssey4me | the ability to pre-cache is still there, but it now forces the remove method - no symlinks | 11:57 |
| odyssey4me | *remote | 11:57 |
| evrardjp | we are loosing 8 minutes in gates for the full metal on that | 11:58 |
| odyssey4me | ie the cache is synchronized to the repo container, instead of using bind mounts and symlinks | 11:58 |
| odyssey4me | for what exactly? | 11:58 |
| evrardjp | because it synchronize files from a folder to a different one, without actually doing anything I guess | 11:58 |
| evrardjp | we should maybe remove this from bootstrap host | 11:58 |
| odyssey4me | yes, that would be a good idea | 11:58 |
| odyssey4me | at least until I can implement something more suitable for zuul v3 | 11:59 |
| evrardjp | https://github.com/openstack/openstack-ansible/blob/c93bfc5991aff693eaf908fe543f8d3d670e09c9/tests/roles/bootstrap-host/tasks/prepare_aio_config.yml#L127-L131 | 11:59 |
| odyssey4me | lemme find where that is and remove it in the integrated build patch | 11:59 |
| evrardjp | I meant that | 11:59 |
| evrardjp | https://github.com/openstack/openstack-ansible/blob/c93bfc5991aff693eaf908fe543f8d3d670e09c9/tests/roles/bootstrap-host/tasks/prepare_aio_config.yml#L122-L131 | 11:59 |
| evrardjp | I can remove it | 11:59 |
| evrardjp | just a sec | 11:59 |
| odyssey4me | I'll add that removal to https://review.openstack.org/521749 | 12:00 |
| evrardjp | done | 12:01 |
| openstackgerrit | Jean-Philippe Evrard proposed openstack/openstack-ansible master: Remove repo build git cache https://review.openstack.org/527382 | 12:01 |
| *** vnogin has quit IRC | 12:01 | |
| evrardjp | odyssey4me: we can do it in two times too. | 12:01 |
| evrardjp | up to you | 12:01 |
| evrardjp | just add my name | 12:01 |
| evrardjp | if you merge the two | 12:01 |
| evrardjp | and abandon my patch then | 12:02 |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible master: Remove sylinked git cache functionality https://review.openstack.org/521749 | 12:03 |
| *** chyka has joined #openstack-ansible | 12:03 | |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible master: Remove sylinked git cache functionality https://review.openstack.org/521749 | 12:03 |
| odyssey4me | if I add your name, you can't really vote | 12:03 |
| odyssey4me | but I can add it if you feel it necessary | 12:04 |
| evrardjp | yes | 12:04 |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible master: Remove sylinked git cache functionality https://review.openstack.org/521749 | 12:04 |
| evrardjp | thanks | 12:05 |
| odyssey4me | I suppose you can vote. Meh - up to you. | 12:06 |
| evrardjp | I don't need to vote | 12:06 |
| evrardjp | we'll see how it goes | 12:06 |
| *** chyka has quit IRC | 12:07 | |
| *** cshen_ has joined #openstack-ansible | 12:09 | |
| openstackgerrit | Jean-Philippe Evrard proposed openstack/openstack-ansible-os_congress master: Introduce os_congress role in gerrit https://review.openstack.org/522491 | 12:11 |
| evrardjp | zuul v3 dashboard dead again | 12:14 |
| openstackgerrit | Jean-Philippe Evrard proposed openstack/openstack-ansible-os_tempest stable/pike: Define cache_timeout by default https://review.openstack.org/527384 | 12:16 |
| *** cshen_ has quit IRC | 12:28 | |
| openstackgerrit | Jean-Philippe Evrard proposed openstack/openstack-ansible-os_nova master: Handle Pike changes for Nova https://review.openstack.org/525515 | 12:31 |
| *** hamza21 has joined #openstack-ansible | 12:35 | |
| *** vnogin has joined #openstack-ansible | 12:35 | |
| *** chhavi__ has quit IRC | 12:43 | |
| *** pradiprwt has quit IRC | 12:44 | |
| jafeha | while deploying, another question about traffic flow within an ovs scenario: we're currently afraid to have a bottleneck in our networking nodes / neutron-containers. can anyone explain me outbound traffic and tennant network flows? | 12:44 |
| *** rodolof has joined #openstack-ansible | 12:44 | |
| *** chhavi__ has joined #openstack-ansible | 12:44 | |
| jafeha | is all outbound traffic routed on the qrouters within the neutron-agent containers? and: is overlay tennant traffic also always flowing through those containers or only if we're routing from one tennant network into another? | 12:44 |
| *** hw_wutianwei has quit IRC | 12:46 | |
| *** nshetty has quit IRC | 12:51 | |
| *** yifei has quit IRC | 12:51 | |
| odyssey4me | jafeha I', not sure if the l3 agent just sets the flows, if if traffic actually routes through it | 12:53 |
| odyssey4me | you'd have to check with the neutron crew | 12:53 |
| odyssey4me | the bottleneck is less of an issue if the nodes are dedicated | 12:53 |
| odyssey4me | another option, of course, is to use a different L3 agent (cisco, juniper, etc) | 12:54 |
| jafeha | ok, i'll keep digging then. i'll probably know for sure after my deployment finishes | 12:57 |
| *** armaan has quit IRC | 12:59 | |
| *** vnogin has quit IRC | 13:11 | |
| *** armaan has joined #openstack-ansible | 13:15 | |
| *** vnogin has joined #openstack-ansible | 13:17 | |
| *** vnogin has quit IRC | 13:35 | |
| *** yifei has joined #openstack-ansible | 13:42 | |
| *** dave-mccowan has joined #openstack-ansible | 13:45 | |
| *** vnogin has joined #openstack-ansible | 13:45 | |
| *** vnogin has quit IRC | 13:45 | |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible master: Fix automatic log copying in Zuul runs https://review.openstack.org/516448 | 13:47 |
| *** loudgefly has quit IRC | 13:47 | |
| *** vnogin has joined #openstack-ansible | 13:47 | |
| *** dave-mccowan has quit IRC | 13:48 | |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible stable/pike: Only build ARA report when test fails https://review.openstack.org/512217 | 13:49 |
| ThomasS | hi | 13:49 |
| ThomasS | does anyone know if i can just use pngs instead of svgs as horizon logos? osa docs only refer to svgs | 13:49 |
| odyssey4me | ThomasS check horizon docs | 13:50 |
| mgariepy | ThomasS, https://docs.openstack.org/horizon/latest/configuration/themes.html#customizing-the-logo | 13:53 |
| robcresswell | No, just SVGs. PNGs should never be used on the web. | 13:54 |
| *** dave-mccowan has joined #openstack-ansible | 13:55 | |
| *** dave-mccowan has quit IRC | 14:00 | |
| ThomasS | thanks! so this looks really like no pngs... | 14:06 |
| ThomasS | damn | 14:06 |
| openstackgerrit | Adrien Cunin proposed openstack/openstack-ansible-ops master: Added ability to cleanup venv tgz https://review.openstack.org/523827 | 14:08 |
| ThomasS | svgs are not so EASY RO EDIT | 14:09 |
| ThomasS | sorry for caps | 14:09 |
| mgariepy | ThomasS, https://inkscape.org/en/ | 14:15 |
| evrardjp | Adri2000: have you tested the ops patch? | 14:16 |
| hwoarang | logan-: ping? can you help me regenerate all the ansible-ceph-* roles? i asked on the ceph-ansible channel but it was complete silence | 14:16 |
| hwoarang | logan-: would you also tell me why we are using all these roles instead of the ceph-ansible one? | 14:16 |
| hwoarang | seems like upstream do not pay attention to these roles anymore :/ | 14:16 |
| evrardjp | Adri2000: I could be worried of my own code and stuff :p | 14:16 |
| *** smatzek has quit IRC | 14:17 | |
| Adri2000 | evrardjp: yes, I tested on a few containers and it didn't rm -rf everything :) | 14:17 |
| evrardjp | That's good I guess? | 14:17 |
| Adri2000 | only the older venvs and tgz :) | 14:17 |
| evrardjp | :p | 14:17 |
| Adri2000 | yes | 14:17 |
| Adri2000 | I think... | 14:17 |
| evrardjp | ahah ok | 14:17 |
| evrardjp | is it my browser or zuulv3 dashboard is dead again? | 14:28 |
| *** rodolof has quit IRC | 14:32 | |
| evrardjp | dear cloudnull, DimGR, andymccr, d34dh0r53, hughsaunders, b3rnard0, palendae, odyssey4me, serverascode, rromans, erikmwilson, mancdaz, _shaps_, BjoernT, claco, echiu, dstanek, jwagner, ayoung, prometheanfire, evrardjp, arbrandes, mhayden, scarlisle, luckyinva, ntt, javeriak, spotz, vdo, jmccrory, alextricity25, jasondotstar, admin0, michaelgugino, ametts, v1k0d3n, severion, bgmccollum, darrenc, | 14:32 |
| evrardjp | JRobinson__, asettle, colinmcnamara, thorst, adreznec, eil397, qwang,nishpatwa_, cathrichardson, drifterza, hwoarang, cshen, ullbeking: | 14:32 |
| evrardjp | the osa bug triage will start in 1h30’. Please have a look at the bug list before starting: https://etherpad.openstack.org/p/osa-bugtriage | 14:32 |
| *** rodolof has joined #openstack-ansible | 14:32 | |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-plugins master: Remove the vars plugin as it's no longer used https://review.openstack.org/527415 | 14:36 |
| -openstackstatus- NOTICE: We're currently seeing an elevated rate of timeouts in jobs and the zuulv3.openstack.org dashboard is intermittently unresponsive, please stand by while we troubleshoot the issues. | 14:38 | |
| *** jwitko has joined #openstack-ansible | 14:42 | |
| *** Neptu has joined #openstack-ansible | 14:44 | |
| *** marst has joined #openstack-ansible | 14:50 | |
| *** Neptu has quit IRC | 14:55 | |
| cloudnull | mornings | 14:56 |
| evrardjp | there is something weird in gates | 14:56 |
| evrardjp | a pip install of ansible took 50 minutes. | 14:57 |
| cloudnull | infra noted that there's an ongoing timeout issue | 14:57 |
| evrardjp | a pip install of keystone packages about 50 minutes. | 14:57 |
| evrardjp | yeah I have seen | 14:57 |
| *** aludwar has quit IRC | 14:58 | |
| cloudnull | integrated repo? | 14:58 |
| evrardjp | but I thought it was only zuulv3 and gating itself, not the pip install bits inside. | 14:58 |
| evrardjp | anything | 14:58 |
| evrardjp | here I was in a role test | 14:58 |
| cloudnull | maybe a routing issue ? | 14:58 |
| mgariepy | good morning | 14:58 |
| cloudnull | o/ mgariepy | 14:58 |
| mgariepy | leaping my prod from kilo to newton now :D | 14:59 |
| bndzor | try turning it off and on | 14:59 |
| cloudnull | mgariepy: nice! | 14:59 |
| evrardjp | mgariepy: good luck! | 14:59 |
| mgariepy | haha | 14:59 |
| evrardjp | cloudnull: I haven't asked yet. | 14:59 |
| bndzor | why not just go for pike | 14:59 |
| *** gouthamr has joined #openstack-ansible | 14:59 | |
| cloudnull | mgariepy: if you need anything let me know | 14:59 |
| mgariepy | it should work, it was working last week.. lol | 14:59 |
| cloudnull | i should +/- be around today. | 14:59 |
| evrardjp | bndzor: that's not possible from K :p | 14:59 |
| bndzor | oh ok | 14:59 |
| bndzor | im really happy with pike, runs very smooth | 15:00 |
| evrardjp | but I guess he will follow from N to O to P ? | 15:00 |
| cloudnull | bndzor: the leap only works from j,K,L > N. | 15:00 |
| mgariepy | bndzor, the os is 14.04, need newton to upgrade to 16.04 | 15:00 |
| mgariepy | yep, newton Ocata pike | 15:00 |
| evrardjp | mgariepy: fun times ahead | 15:00 |
| cloudnull | then there's that | 15:00 |
| mgariepy | it's getting easier :) | 15:00 |
| bndzor | rip sleep i guess :p | 15:00 |
| *** armaan has quit IRC | 15:01 | |
| mgariepy | bndzor, lol | 15:02 |
| mgariepy | nah, | 15:02 |
| evrardjp | the K to N is working :p | 15:02 |
| evrardjp | the N trusty to N xenial is challenging so I heard, ask mhayden :p | 15:03 |
| mgariepy | the leap will be done soonish.. | 15:03 |
| mgariepy | i've done it already | 15:03 |
| *** armaan has joined #openstack-ansible | 15:03 | |
| mgariepy | trusty to xenial is easy ;p haha | 15:03 |
| mgariepy | easier** lol | 15:03 |
| evrardjp | so you fixed the federation stuff mgariepy ? | 15:03 |
| evrardjp | or ldap? | 15:03 |
| mgariepy | switched to ldap. | 15:04 |
| mgariepy | federation needs fixing but i need to focus on the upgrades first. | 15:04 |
| mgariepy | there is a few things i would like to have but i don't have enough time .. haha | 15:05 |
| *** dave-mccowan has joined #openstack-ansible | 15:08 | |
| *** jwitko_ has quit IRC | 15:09 | |
| *** armaan_ has joined #openstack-ansible | 15:10 | |
| *** armaan has quit IRC | 15:10 | |
| mhayden | yeah, i had sad times taking a newton 14.04 box to 16.04 | 15:10 |
| mhayden | there are some serious shenanigans if you have UEFI and legacy BIOS enabled on your system :/ | 15:10 |
| *** rodolof has quit IRC | 15:11 | |
| mhayden | the grub install scripts explode and leave you with no bootloader :/ | 15:11 |
| mhayden | at least it was that way in 16.04.2 | 15:11 |
| *** rodolof has joined #openstack-ansible | 15:11 | |
| mgariepy | bootloader missing is easy to fix at least :) haha | 15:13 |
| *** smatzek has joined #openstack-ansible | 15:13 | |
| mgariepy | repo install :) | 15:14 |
| *** ThomasS has quit IRC | 15:14 | |
| evrardjp | Adri2000: could you update https://review.openstack.org/#/c/526423/ ? | 15:14 |
| openstackgerrit | Jean-Philippe Evrard proposed openstack/openstack-ansible-os_nova master: Updated from OpenStack Ansible Tests https://review.openstack.org/525821 | 15:15 |
| *** m|y|k has quit IRC | 15:24 | |
| evrardjp | mhayden: want to update your vote with my new comment in mind: https://review.openstack.org/#/c/527256/ ? | 15:25 |
| *** hamza21 has quit IRC | 15:26 | |
| mbuil | guys, does it make sense that depending on the OS, we get different packages in the ROLE_VENV_REQUIREMENTS= list (e.g. in venv-build-options-os_keystone.txt) | 15:29 |
| mbuil | ? | 15:29 |
| *** chhavi__ has quit IRC | 15:34 | |
| openstackgerrit | Merged openstack/openstack-ansible-rsyslog_server master: Updated from OpenStack Ansible Tests https://review.openstack.org/525837 | 15:38 |
| odyssey4me | mbuil not normally, given that that's built from the pip package lists which are homogenous across distro's as far as I know | 15:39 |
| *** sxc731 has joined #openstack-ansible | 15:40 | |
| *** m|y|k has joined #openstack-ansible | 15:45 | |
| sxc731 | Hi team! I have a q about ceph_client: it doesn't seem possible to have nova and cinder use different Ceph credentials, right? That is if nova_ceph_client is defined to smth different from cinder_ceph_client, nova can't access (eg: attach) volumes. Or did I miss smth? | 15:47 |
| openstackgerrit | Jimmy McCrory proposed openstack/openstack-ansible master: Move inventory files to folder in root of repo https://review.openstack.org/516032 | 15:55 |
| mbuil | odyssey4me: so I have two deployments, one runs and the other fail. Both use Ubuntu 16.04.03. The one that fails, is failing because it gets a requirement problem when installing python-ldap as part of the keystone venv creation. If I check the ROLE_VENV_REQUIREMENTS, the one failing has python-ldap but the one working has pyldap instead. I am confused because I don't understand why they get different requirements :(. Any idea? | 15:58 |
| odyssey4me | mbuil ah, your first install is using an older tag release, that's why | 15:59 |
| odyssey4me | the latest release solves that issue | 15:59 |
| mbuil | odyssey4me, with tag release you mean SHA for keystone? | 15:59 |
| odyssey4me | if it's master, then https://github.com/openstack/openstack-ansible-os_keystone/commit/ac51441e33f2ffffde36dae7c0760886c521f4cd in particular fixed it | 15:59 |
| odyssey4me | if pike, then https://github.com/openstack/openstack-ansible-os_keystone/commit/ffc9c9b5e681748ff3e54e43f22c921e83342a51 fixed it | 15:59 |
| odyssey4me | no, it's the SHA for our role - not keystone itself | 16:00 |
| evrardjp | Bug triage cloudnull, DimGR, andymccr, d34dh0r53, hughsaunders, b3rnard0, palendae, odyssey4me, serverascode, rromans, erikmwilson, mancdaz, _shaps_, BjoernT, claco, echiu, dstanek, jwagner, ayoung, prometheanfire, evrardjp, arbrandes, mhayden, scarlisle, luckyinva, ntt, javeriak, spotz, vdo, jmccrory, alextricity25, jasondotstar, admin0, michaelgugino, ametts, v1k0d3n, severion, bgmccollum, | 16:00 |
| evrardjp | darrenc, JRobinson__, asettle, colinmcnamara, thorst, adreznec, eil397, qwang,nishpatwa_, cathrichardson, drifterza, hwoarang, cshen | 16:00 |
| evrardjp | Here is our bug list for today https://etherpad.openstack.org/p/osa-bugtriage | 16:00 |
| evrardjp | #startmeeting openstack_ansible_meeting | 16:00 |
| openstack | Meeting started Tue Dec 12 16:00:27 2017 UTC and is due to finish in 60 minutes. The chair is evrardjp. Information about MeetBot at http://wiki.debian.org/MeetBot. | 16:00 |
| openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 16:00 |
| *** openstack changes topic to " (Meeting topic: openstack_ansible_meeting)" | 16:00 | |
| openstack | The meeting name has been set to 'openstack_ansible_meeting' | 16:00 |
| evrardjp | #topic bugs with new status | 16:01 |
| *** openstack changes topic to "bugs with new status (Meeting topic: openstack_ansible_meeting)" | 16:01 | |
| evrardjp | is there anyone ready for bug triage? | 16:01 |
| hwoarang | im here | 16:01 |
| odyssey4me | o/ here, although between some things | 16:01 |
| evrardjp | let's start | 16:02 |
| evrardjp | #link https://bugs.launchpad.net/openstack-ansible/+bug/1737013 | 16:02 |
| openstack | Launchpad bug 1737013 in openstack-ansible "Using non-default Ceph user for Cinder Backup service" [Undecided,New] | 16:02 |
| *** dave-mccowan has quit IRC | 16:02 | |
| evrardjp | confirmed medium? | 16:02 |
| evrardjp | What about the solution? | 16:02 |
| hwoarang | looks sensible to me | 16:03 |
| spotz | hey | 16:03 |
| evrardjp | ok | 16:03 |
| odyssey4me | hmm, we should set a group var to make sure that ceph_client and cinder agree on what's right | 16:04 |
| evrardjp | odyssey4me: see my comment | 16:04 |
| evrardjp | we may want to skip the group var if we can just pass it over | 16:04 |
| odyssey4me | yeah, medium as it's fairly serious | 16:05 |
| odyssey4me | I can't confirm without looking at the code itself, but it sounds plausible. | 16:05 |
| evrardjp | ok | 16:05 |
| evrardjp | I have checked the code it's real. | 16:05 |
| evrardjp | :D | 16:05 |
| evrardjp | now it's about how to do things | 16:05 |
| evrardjp | we can discuss in the bug | 16:05 |
| evrardjp | we have too many bugs to sort today | 16:06 |
| evrardjp | next | 16:06 |
| evrardjp | #link https://bugs.launchpad.net/openstack-ansible/+bug/1736989 | 16:06 |
| openstack | Launchpad bug 1736989 in openstack-ansible "[Docs] Issue when using --limit to add compute with DVR" [Undecided,New] | 16:06 |
| *** DanyC has quit IRC | 16:06 | |
| evrardjp | I've seen more than one ppl having failures with limit, maybe we should document this better. | 16:06 |
| evrardjp | This is a sub-case, probably from our operations guide | 16:07 |
| *** sxc731 has quit IRC | 16:07 | |
| spotz | evrardjp: pop a note in what you want and then assign to me | 16:07 |
| evrardjp | For me it's confirmed and low | 16:07 |
| odyssey4me | we either need to test limits so that we fix issues that arise from using it, or we should recommend not using it on specific playbooks | 16:08 |
| odyssey4me | the ops guide has a lot of dated info, unfortunately | 16:08 |
| odyssey4me | agreed for confirmed, low | 16:08 |
| evrardjp | spotz: could you have a look where we have --limit in our docs, and update to add localhost, when needed? | 16:08 |
| spotz | evrardjp: grep is my friend:) | 16:09 |
| evrardjp | yup :) | 16:09 |
| evrardjp | ok cool | 16:09 |
| evrardjp | next | 16:09 |
| evrardjp | #link https://bugs.launchpad.net/openstack-ansible/+bug/1736731 | 16:09 |
| openstack | Launchpad bug 1736731 in openstack-ansible "os_nova might create a duplicate cell1" [Undecided,New] | 16:09 |
| spotz | evrardjp: travelling with the dog this weekend but if I dont get to it before I leave I'll get it next week | 16:09 |
| odyssey4me | also, any reference to lxc-containers-create.yml and --limit should always include lxc_hosts in the limit | 16:09 |
| evrardjp | ^ +1 this | 16:10 |
| evrardjp | so | 16:10 |
| evrardjp | next bug | 16:10 |
| evrardjp | Adri2000: was the owner of this bug | 16:10 |
| evrardjp | well. is owner :) | 16:10 |
| evrardjp | for me it's a question of what we do | 16:10 |
| evrardjp | it's all a question of expectations | 16:11 |
| Adri2000 | I expect that adding a rabbitmq node works :) | 16:11 |
| evrardjp | if something changed, like in this case adding a rabbitmq node, should we EDIT the cell by being smart ourselves, or should we fully rely on nova | 16:11 |
| evrardjp | well it technically worked: you now had a new cell with your new config :p | 16:12 |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible master: Remove symlinked git cache functionality https://review.openstack.org/521749 | 16:12 |
| *** armaan_ has quit IRC | 16:12 | |
| evrardjp | the problem is that you had two cells with the same name | 16:12 |
| evrardjp | am I correct? | 16:12 |
| Adri2000 | yes | 16:12 |
| evrardjp | Or the problem went even further? | 16:12 |
| Adri2000 | that has some odd consequences | 16:12 |
| Miouge | I’m running into problems around the physical_interface_mappings in linuxbridge_agent.ini with this my openstack_user_config http://paste.openstack.org/show/628740/ br-public shows up in both compute and neutron hosts :( I was expecting the group_binds to apply it only on neutron nodes? | 16:13 |
| odyssey4me | hmm, I wonder if there's a create-or-update command | 16:13 |
| Adri2000 | like nova compute service list listing every service twice | 16:13 |
| Adri2000 | openstack compute service list* | 16:13 |
| evrardjp | so because nova is creating cells based on rabbitmq and galera nodes, we should check the existence of the cell name only ? | 16:13 |
| evrardjp | odyssey4me: I am not aware of it | 16:13 |
| Adri2000 | as long as OSA supports deploying only one cell, I think checking whether "cell1" already exists and then update it should be fine | 16:14 |
| *** sxc731 has joined #openstack-ansible | 16:14 | |
| Adri2000 | it looks like tripleo fixed a similar issue in a similar way (I linked their bug report in our bug report) | 16:14 |
| odyssey4me | looks like this is where it's done: https://github.com/openstack/openstack-ansible-os_nova/blob/65c12961b4d764ae541e49ec9b582fec086dadc8/tasks/nova_db_setup.yml#L31-L35 | 16:14 |
| evrardjp | usage: nova-manage cell [-h] {create,delete,list} ... | 16:15 |
| odyssey4me | which means that nova itself has to get fixed to prevent duplication | 16:15 |
| odyssey4me | and they'll argue that your db should be in sync | 16:15 |
| evrardjp | odyssey4me: yeah that's exactly the thing | 16:15 |
| odyssey4me | oh cell1... hang on | 16:15 |
| evrardjp | it's a nova bug, well no it's not a nova bug, it's your deploy... etc. | 16:15 |
| Adri2000 | odyssey4me: next task I think | 16:16 |
| Adri2000 | command: "{{ nova_bin }}/nova-manage cell_v2 create_cell --name {{ nova_cell1_name }} [...] | 16:16 |
| evrardjp | usage: nova-manage cell_v2 [-h] | 16:16 |
| evrardjp | {create_cell,delete_cell,discover_hosts,list_cells,map_cell0,map_cell_and_hosts,map_instances,simple_cell_setup,update_cell,verify_instance} | 16:16 |
| odyssey4me | oh, perhaps we should check for an existing one, then create if it doesn't exist | 16:16 |
| odyssey4me | there we go, update_cell | 16:17 |
| evrardjp | yup | 16:17 |
| evrardjp | so I think we should list_cells | 16:17 |
| odyssey4me | so basically change that command task into a shell task which does a check and does the right thing, then reports back whether it changed or not | 16:17 |
| evrardjp | see if there is one with maching name | 16:17 |
| evrardjp | then update if that's the case | 16:17 |
| evrardjp | else, create | 16:17 |
| evrardjp | ok sounds like a solved problem! | 16:18 |
| odyssey4me | yes, it should definitely do something like that - good find that one! | 16:18 |
| evrardjp | yeah thanks Adri2000 | 16:18 |
| odyssey4me | that'll need backporting to wherever cells started - ocata or pike, can't recall | 16:18 |
| evrardjp | confirmed high? | 16:18 |
| odyssey4me | yeah | 16:18 |
| evrardjp | cell v2 is end of O | 16:18 |
| evrardjp | iirc | 16:18 |
| odyssey4me | it's in O, yes: https://github.com/openstack/openstack-ansible-os_nova/blob/stable/ocata/tasks/nova_db_setup.yml#L37-L43 | 16:19 |
| evrardjp | Adri2000: can you submit the patch? | 16:19 |
| evrardjp | I propose confirmed and high? | 16:19 |
| odyssey4me | yes, agreed | 16:19 |
| *** sxc731 has quit IRC | 16:19 | |
| Adri2000 | evrardjp: I can try to submit something this week | 16:19 |
| evrardjp | else I just do it quick and you test it :p | 16:20 |
| evrardjp | ok let's sync later | 16:20 |
| evrardjp | next | 16:20 |
| Adri2000 | yep :) | 16:20 |
| evrardjp | #link https://bugs.launchpad.net/openstack-ansible/+bug/1736726 | 16:20 |
| openstack | Launchpad bug 1736726 in openstack-ansible "Pike update causes parallel restart of Galera containers" [Undecided,New] | 16:20 |
| * Adri2000 again o/ | 16:20 | |
| *** sep has quit IRC | 16:20 | |
| evrardjp | big deal IMO | 16:20 |
| evrardjp | so we have a patch in master to prevent restarts | 16:21 |
| evrardjp | we already discussed this on the channel too. | 16:21 |
| Adri2000 | yes it was discussed in the chan one or two days before I filed the report | 16:21 |
| evrardjp | my concern is that: | 16:21 |
| odyssey4me | yeah, but I'd rather have a fix figured out | 16:21 |
| evrardjp | 1) we don't have a test to catch that . 2) we need to fix it soon. | 16:22 |
| odyssey4me | for now we can do a reno though to inform people of the known issue - the trouble is that we need to figure out where the change was introduced so that we can say - any versions from x are affected | 16:22 |
| evrardjp | 16.0.3 and 16.0.4 are affected | 16:22 |
| evrardjp | so anyone from earlier than that will suffer. | 16:22 |
| odyssey4me | when I was digging into this, I thin kall the way back to newton might be affected | 16:22 |
| evrardjp | why? | 16:22 |
| evrardjp | it's coming from a backport, was that backported to N? | 16:23 |
| odyssey4me | but I didn't get to a point of confirming, because we don't have enough information about what the change was to the container config that caused it | 16:23 |
| odyssey4me | yes, I think a patch was made to master, and ported back | 16:23 |
| evrardjp | 16.0.3 is fine I think | 16:23 |
| jmccrory | this has happened before https://review.openstack.org/#/c/426337/ | 16:23 |
| odyssey4me | the patch was fine for master (because in a major upgrade we handle this issue), but not for backports (because we can't handle it for minors) | 16:23 |
| evrardjp | odyssey4me: I agree there. | 16:24 |
| odyssey4me | yep, good find there jmccrory | 16:24 |
| evrardjp | jmccrory: there was no documentation | 16:25 |
| odyssey4me | we should probably serialise te container config changes in all the playbooks anyway for exactly this reason | 16:25 |
| evrardjp | we just fixed the issue by introducing the serialization | 16:25 |
| evrardjp | here it's on lxc hosts/lxc container create | 16:25 |
| odyssey4me | if we do, this whole issue of when we can and can't restart becomes moot | 16:25 |
| odyssey4me | yes, well - if it's in lxc-containers-create then we have a big problem | 16:25 |
| *** sxc731 has joined #openstack-ansible | 16:25 | |
| Adri2000 | https://git.openstack.org/cgit/openstack/openstack-ansible-lxc_container_create/tree/handlers/main.yml#n19 this handler is the issue | 16:25 |
| Adri2000 | if that handler is called for all the galera containers: you loose | 16:26 |
| jmccrory | yeah more impact if it's happening through an lxc host/create play | 16:26 |
| evrardjp | odyssey4me: for me, we should BY DEFAULT for a stable branch NOT reboot. | 16:26 |
| odyssey4me | Adri2000 that's just doing what it's told - some config changed, and that config change is the real root cause | 16:26 |
| Adri2000 | odyssey4me: shouldn't we be able to change the lxc containers config without worrying that restart of the containers will break everything? | 16:26 |
| odyssey4me | evrardjp we should never allow changes to container config to be ported back, unless we also handle the effects or add a BIG release note | 16:27 |
| evrardjp | odyssey4me: I agree. I was on holiday at that time, under the sun :D | 16:27 |
| odyssey4me | Adri2000 not really - container config changes do not take effect until a container is stopped, then started again | 16:27 |
| evrardjp | I should have eyes everywhere, I know. | 16:27 |
| odyssey4me | evrardjp I feel you. | 16:27 |
| odyssey4me | do we have any record of what exactly changed in the container config? | 16:28 |
| evrardjp | Adri2000: you told me it all happened on the same backport right? | 16:28 |
| evrardjp | you had no issues before that | 16:28 |
| *** sxc731 has quit IRC | 16:28 | |
| evrardjp | ? | 16:28 |
| Adri2000 | yes | 16:29 |
| Adri2000 | never had a similar issue before | 16:29 |
| *** gkadam has quit IRC | 16:29 | |
| odyssey4me | if we ran lxc-containers-create in the service playbooks, then we could serialise this sensibly | 16:29 |
| odyssey4me | but that doesn't help stable branches | 16:29 |
| Adri2000 | that happened while doing a regular git pull of stable/pike, bootstrap-ansible && playbooks run | 16:29 |
| evrardjp | please also note that there was a change in stable/pike | 16:29 |
| evrardjp | https://github.com/openstack/openstack-ansible-lxc_container_create/commit/c41d3b20da6be07d9bf5db7f7e6a1384c7cfb5eb | 16:29 |
| evrardjp | on top of the mega backport https://github.com/openstack/openstack-ansible-lxc_container_create/commit/05b84528d100ab73b91e119dd379a8ed0726db7d | 16:30 |
| odyssey4me | evrardjp ok, so if we do not reboot the containers by default - how do we handle making sure the containers are properly configured when initially built? | 16:31 |
| evrardjp | odyssey4me: that's not possible :p | 16:31 |
| odyssey4me | perhaps do something like drop a local fact, then handle the reboot in serial in the service play? | 16:31 |
| evrardjp | that's why I think we are in a pickle | 16:31 |
| evrardjp | well yes or something like that | 16:31 |
| odyssey4me | that's something we can do, and is back portable | 16:31 |
| odyssey4me | it'll also survive a failed playbook, which is nice | 16:32 |
| evrardjp | odyssey4me: yeah and we are closer to JIT. | 16:33 |
| evrardjp | because that's what ppl want | 16:33 |
| evrardjp | so good for me. | 16:33 |
| evrardjp | I have no cycles for that. | 16:33 |
| evrardjp | confirmed high? Maybe it will break some upgrades gates, then I will need to spend cycles on that, but right now I can't say. | 16:35 |
| evrardjp | upgrade tests* | 16:35 |
| evrardjp | ok for the classification anyone? | 16:35 |
| Adri2000 | I'd say at least high :) | 16:35 |
| Adri2000 | anyone with more than 1 galera node is likely to be impacted | 16:35 |
| odyssey4me | high, confirmed - assign it to me | 16:35 |
| evrardjp | yeah for now i'd say high and move to critical if broken jobs | 16:35 |
| odyssey4me | unless someone else wants to take it? | 16:35 |
| evrardjp | anyone? | 16:36 |
| evrardjp | pretty please? | 16:36 |
| evrardjp | :p | 16:36 |
| evrardjp | ok that's for odyssey4me then! | 16:36 |
| odyssey4me | Adri2000 can you please add the tag version you upgraded from and to, so that I can add a reno | 16:36 |
| evrardjp | it should be cloudnull tbh. | 16:36 |
| odyssey4me | that'll really help me narrow down where the issue is | 16:36 |
| evrardjp | odyssey4me: it's in the bug | 16:36 |
| Adri2000 | odyssey4me: the bug report contains the commit ids already, because I was not using tags | 16:36 |
| Adri2000 | was on stable/pike head | 16:36 |
| evrardjp | my mom says "You break it, you fix it". | 16:37 |
| *** armaan has joined #openstack-ansible | 16:37 | |
| spotz | heheh | 16:37 |
| odyssey4me | ah, perfect thanks | 16:37 |
| evrardjp | ok next | 16:37 |
| evrardjp | #link https://bugs.launchpad.net/openstack-ansible/+bug/1736719 | 16:37 |
| openstack | Launchpad bug 1736719 in openstack-ansible "Appendix A: Example test environment configuration in OpenStack-Ansible" [Undecided,New] | 16:37 |
| evrardjp | I guess spotz will have a look at it? :) | 16:38 |
| odyssey4me | ah yeah, maybe mhayden and/or hwoarang could pick that up? | 16:38 |
| evrardjp | hwoarang: mhayden could you help? | 16:38 |
| evrardjp | AHAHAH | 16:38 |
| evrardjp | yeah. | 16:38 |
| evrardjp | mgariepy: too maybe :p | 16:38 |
| evrardjp | confirmed and wishlist ok ? | 16:38 |
| spotz | Poor appendix A, no body loves it | 16:39 |
| evrardjp | spotz: we'll make it better. | 16:39 |
| evrardjp | :) | 16:39 |
| mhayden | odyssey4me / evrardjp: what's up? | 16:40 |
| evrardjp | I assigned that to you spotz , please ask those suse/redhat guys :) | 16:40 |
| evrardjp | we need help on sample network config | 16:40 |
| evrardjp | mhayden: ^ | 16:40 |
| spotz | mhayden go fix appendix a:) | 16:40 |
| mhayden | ORLY | 16:40 |
| evrardjp | for appendix a | 16:40 |
| odyssey4me | mhayden well, evrardjp's beating you in the break-everything-dept | 16:40 |
| evrardjp | just copy pasta and we are good | 16:40 |
| mhayden | hot dang | 16:40 |
| mhayden | evrardjp: i will not let you beat me in gate breakage | 16:40 |
| odyssey4me | not just appendix A - ALL OF THEM! | 16:40 |
| mhayden | this aggression will not stand | 16:40 |
| evrardjp | odyssey4me: you need to bring patches to break stuff :p | 16:40 |
| odyssey4me | bwahaha | 16:40 |
| * mhayden starts writing a new linter | 16:41 | |
| evrardjp | well, there are ppl that do it magically | 16:41 |
| spotz | mhayden: I wonder if we're bad it'll snow again?:) | 16:41 |
| mhayden | that make snow sense | 16:41 |
| odyssey4me | yes, let's make it snow more - the world is too warm | 16:41 |
| evrardjp | mhayden: or new backend for containers. | 16:41 |
| evrardjp | odyssey4me: we are losing the debate folks. | 16:41 |
| odyssey4me | anyway, that's 10 mins of our lives which bug triage will never get back | 16:41 |
| mhayden | let's make a new container frontend | 16:41 |
| spotz | hehe | 16:42 |
| evrardjp | I think right now, we need a good breakage. | 16:42 |
| evrardjp | :p | 16:42 |
| mhayden | i'm about to take down my pike env to re-do the networking and add bonding | 16:42 |
| mhayden | so i might be able to put some of that in | 16:42 |
| evrardjp | I am glad I managed to break it twice in my lifetime, I think I am far from all the others :D | 16:42 |
| hwoarang | i will havea look too | 16:42 |
| evrardjp | I will get better. | 16:42 |
| mhayden | i don't have vxlan offloading, so i need another route for that :/ | 16:42 |
| evrardjp | well as long as you give a first draft, that would be good I guess | 16:43 |
| evrardjp | can we move on? | 16:43 |
| *** hamzy has quit IRC | 16:43 | |
| evrardjp | talking about mhayden breakages: | 16:43 |
| mhayden | hooray | 16:43 |
| evrardjp | #link https://bugs.launchpad.net/openstack-ansible/+bug/1736702 | 16:43 |
| openstack | Launchpad bug 1736702 in openstack-ansible "TMOUT declared two times after upgrade in /etc/profile" [Undecided,New] | 16:43 |
| mhayden | sounds like evrardjp wants me to move on and work on something else | 16:43 |
| mhayden | :) | 16:43 |
| mhayden | ugh yes | 16:43 |
| mhayden | does ansible have a capacity to remove an entire block? | 16:44 |
| evrardjp | thanks bro. | 16:44 |
| mhayden | i'll take that one and do some experimentation | 16:44 |
| evrardjp | yes, blockinfile state absent? | 16:44 |
| mhayden | i'll do some testing/tinkering there | 16:44 |
| evrardjp | you just use the same task, copy pasta, replace state present with absent, and change the marker. BOOM | 16:44 |
| evrardjp | mhayden: thanks! | 16:44 |
| * mhayden gets out markers and crayons | 16:44 | |
| evrardjp | confirmed med | 16:44 |
| odyssey4me | mhayden evrardjp there was a patch that cloudnull did which converts all the networking to networkd | 16:45 |
| evrardjp | where is the love for paint! | 16:45 |
| evrardjp | ? | 16:45 |
| mhayden | MS Paint is deprecated | 16:45 |
| * mhayden stops ruining evrardjp's meeting ;) | 16:45 | |
| evrardjp | odyssey4me: that's a good potential breakage too, but that was yesteryear's conversation! | 16:45 |
| evrardjp | mhayden: everything is fine | 16:45 |
| evrardjp | (fire) (fire) | 16:46 |
| evrardjp | we are almost at a third of the bugs | 16:46 |
| evrardjp | great | 16:46 |
| evrardjp | #link https://bugs.launchpad.net/openstack-ansible/+bug/1735709 | 16:46 |
| openstack | Launchpad bug 1735709 in openstack-ansible "Grub authentication is not applied on Fedora 26 and Ubuntu 16.04 (at least)" [Undecided,New] - Assigned to Major Hayden (rackerhacker) | 16:46 |
| cloudnull | odyssey4me: https://review.openstack.org/#/c/523218/ | 16:46 |
| evrardjp | OH WAIT, guess what? | 16:46 |
| evrardjp | :p | 16:46 |
| cloudnull | sadly i have to circle back on that for suse | 16:46 |
| evrardjp | odyssey4me: don't feed the troll. | 16:46 |
| *** sxc731 has joined #openstack-ansible | 16:46 | |
| evrardjp | :p | 16:46 |
| evrardjp | mhayden: status there? | 16:47 |
| evrardjp | should we care? | 16:47 |
| mhayden | nothing yet | 16:47 |
| mhayden | but this isn't critical | 16:47 |
| mhayden | most people i know are horrified about grub auth on boot | 16:48 |
| mhayden | but it would be nice to fix it | 16:48 |
| evrardjp | confirmed low? | 16:48 |
| evrardjp | or still not confirmed? | 16:48 |
| *** dave-mccowan has joined #openstack-ansible | 16:49 | |
| odyssey4me | or just take it out and say, do it if you wanna | 16:49 |
| odyssey4me | :p | 16:49 |
| *** chyka has joined #openstack-ansible | 16:50 | |
| evrardjp | leaving it as is then :p | 16:50 |
| evrardjp | next | 16:50 |
| evrardjp | #link https://bugs.launchpad.net/openstack-ansible/+bug/1731186 | 16:50 |
| openstack | Launchpad bug 1731186 in openstack-ansible "vpnaas_agent.ini wrong config" [Undecided,New] | 16:50 |
| *** yifei has quit IRC | 16:51 | |
| evrardjp | should I mark this as incomplete? | 16:52 |
| evrardjp | I am not sure I understood this one | 16:52 |
| cloudnull | evrardjp: Adri2000: I missed the message before, what is it i need to do ? | 16:52 |
| * cloudnull can wait for after the meetin g | 16:53 | |
| cloudnull | wasn't vpnaas removed ? | 16:53 |
| evrardjp | cloudnull: fixing the backport that forces restarts of all containers even on minor updates. odyssey4me is assignee for now, but you should work with him :D | 16:53 |
| cloudnull | ok | 16:53 |
| *** jvidal has quit IRC | 16:53 | |
| evrardjp | not so sure but now that you remind me that | 16:53 |
| evrardjp | I think bgpvpn aaS was talked about, etc. | 16:54 |
| evrardjp | so maybe it's worth saying incomplete, and maybe won't fix? | 16:54 |
| cloudnull | evrardjp: odyssey4me: doesn't https://review.openstack.org/#/c/527256 fix that? | 16:54 |
| evrardjp | we can talk about the approach after the meeting | 16:55 |
| cloudnull | ok | 16:55 |
| evrardjp | ok let's wrap it up then | 16:55 |
| evrardjp | I am marking this vpnaas as incomplete | 16:55 |
| evrardjp | next | 16:55 |
| evrardjp | #link https://bugs.launchpad.net/openstack-ansible/+bug/1729525 | 16:55 |
| openstack | Launchpad bug 1729525 in openstack-ansible "Can't run bootstrap_ansible with encrypted user_secrets.yml (prompting for password) " [Undecided,New] | 16:55 |
| evrardjp | ok I think it's fixed | 16:56 |
| evrardjp | we should mark it as invalid on the next bug triage | 16:57 |
| evrardjp | so | 16:57 |
| evrardjp | new topic! | 16:57 |
| evrardjp | #topic next week bug triage | 16:57 |
| *** openstack changes topic to "next week bug triage (Meeting topic: openstack_ansible_meeting)" | 16:57 | |
| evrardjp | can someone handle the bug triage for the next week? | 16:57 |
| evrardjp | I am not available | 16:58 |
| cloudnull | I will be out as well | 16:58 |
| evrardjp | Starting from tomorrow I won't be available at all until next year. | 16:58 |
| cloudnull | ++ | 16:58 |
| evrardjp | ok | 16:58 |
| *** mwynne has joined #openstack-ansible | 16:58 | |
| evrardjp | anyone else to run the meeting? | 16:58 |
| evrardjp | if nobody can run it, we can cancel it, and I post a mail on the ML | 16:59 |
| evrardjp | ok for everyone? | 16:59 |
| cloudnull | sounds good | 16:59 |
| evrardjp | ok thanks everyone then! | 16:59 |
| evrardjp | #endmeeting | 16:59 |
| *** openstack changes topic to "Launchpad: https://launchpad.net/openstack-ansible || Weekly Meetings: https://wiki.openstack.org/wiki/Meetings/openstack-ansible || Review Dashboard: https://goo.gl/tTmdgs" | 16:59 | |
| openstack | Meeting ended Tue Dec 12 16:59:47 2017 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 16:59 |
| openstack | Minutes: http://eavesdrop.openstack.org/meetings/openstack_ansible_meeting/2017/openstack_ansible_meeting.2017-12-12-16.00.html | 16:59 |
| openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/openstack_ansible_meeting/2017/openstack_ansible_meeting.2017-12-12-16.00.txt | 16:59 |
| openstack | Log: http://eavesdrop.openstack.org/meetings/openstack_ansible_meeting/2017/openstack_ansible_meeting.2017-12-12-16.00.log.html | 16:59 |
| evrardjp | cloudnull: the patch you pasted won't do | 17:00 |
| evrardjp | because by default deployers won't have that variable set | 17:00 |
| evrardjp | it will probably also break upgrades | 17:01 |
| evrardjp | except if we pass that in the upgrade process. | 17:01 |
| *** woodard has quit IRC | 17:01 | |
| evrardjp | so yes, we should merge this, but probably with a release note to say we have a known issue? | 17:02 |
| *** woodard has joined #openstack-ansible | 17:02 | |
| evrardjp | then we work on fixing things properly? | 17:02 |
| *** m|y|k has quit IRC | 17:03 | |
| odyssey4me | cloudnull https://review.openstack.org/#/c/527256 fixes nothing, it just gives a tool to prevent restarts - the issue is that a backport introduced a container config change, and we shouldn't be doing that | 17:03 |
| odyssey4me | although it would be better if we could make this all more resiliant | 17:03 |
| odyssey4me | so basically config changes can happen, but if they do the restarts are done serially | 17:04 |
| evrardjp | yeah and probably tested | 17:04 |
| *** cshen has quit IRC | 17:04 | |
| odyssey4me | anyway, that's what we kinda greed to do to resolve https://bugs.launchpad.net/openstack-ansible/+bug/1736726 | 17:05 |
| openstack | Launchpad bug 1736726 in openstack-ansible "Pike update causes parallel restart of Galera containers" [High,Confirmed] - Assigned to Jesse Pretorius (jesse-pretorius) | 17:05 |
| openstackgerrit | Major Hayden proposed openstack/ansible-hardening master: Remove old /etc/profile config block https://review.openstack.org/527463 | 17:05 |
| mhayden | evrardjp: ^^ bam | 17:05 |
| evrardjp | mhayden: did you break gerrit too? :p | 17:05 |
| *** dave-mccowan has quit IRC | 17:05 | |
| mhayden | ? | 17:05 |
| evrardjp | can't load your patch | 17:05 |
| evrardjp | :p | 17:05 |
| evrardjp | No I am kidding. | 17:05 |
| evrardjp | maybe you didn't find that funny. | 17:06 |
| evrardjp | I still have to work on my american sense of humor | 17:06 |
| evrardjp | I know "stella is a good beer, so is bud" is a good topic | 17:06 |
| openstackgerrit | Major Hayden proposed openstack/openstack-ansible-lxc_hosts master: Create and use a local LXC RPM repo https://review.openstack.org/526739 | 17:06 |
| mhayden | LAWL | 17:06 |
| cloudnull | odyssey4me: do you know off hand what the container change is ? | 17:07 |
| mhayden | it cannot be contained in a single patch | 17:08 |
| evrardjp | mhayden: I imagine you with your hands doing the "it cannot be contained in" | 17:09 |
| evrardjp | you did it in your mind, right? | 17:09 |
| cloudnull | Adri2000: ^ | 17:09 |
| evrardjp | I leave you the keys of the kingdom folks. | 17:12 |
| *** hamzy has joined #openstack-ansible | 17:14 | |
| *** epalper has quit IRC | 17:14 | |
| openstackgerrit | Major Hayden proposed openstack/openstack-ansible-lxc_hosts master: Create and use a local LXC RPM repo https://review.openstack.org/526739 | 17:14 |
| Adri2000 | cloudnull: https://git.openstack.org/cgit/openstack/openstack-ansible-lxc_container_create/commit/?h=stable/pike&id=05b84528d100ab73b91e119dd379a8ed0726db7d tasks "Write default container config" and "Add bind mount configuration to container" | 17:15 |
| odyssey4me | JP, that patch does not relate to the bug - it was added to provide consistency and has nothing to do with the bug | 17:15 |
| Adri2000 | cloudnull: those are the two tasks that have been changed *and* that have a notify: Lxc container restart | 17:15 |
| odyssey4me | the bug can be worked around without that patch - that patch is useful for other issues | 17:15 |
| *** taseer1 has joined #openstack-ansible | 17:20 | |
| gloksinia | cloudnull: I had post my user_variables.yml on https://pastebin.com/vM42CTKB For the question about OVS kernel after reboot network host not reload properly. | 17:21 |
| *** Taseer has quit IRC | 17:23 | |
| *** taseer1 is now known as Taseer | 17:23 | |
| jafeha | gloksinia, cloudnull we're experiencing same issue deploying ovs. the module is loaded perfectly on compute nodes, but not on the networking nodes. we've added the module manually to /etc/modules. as far as i digged into it, the module should be added by osa, but i guess this needs some further investigation. | 17:24 |
| *** mbuil has quit IRC | 17:27 | |
| openstackgerrit | Manuel Buil proposed openstack/openstack-ansible-os_neutron master: Provide support for SFC deployments https://review.openstack.org/510909 | 17:28 |
| *** woodard has quit IRC | 17:30 | |
| *** woodard has joined #openstack-ansible | 17:31 | |
| *** DanyC has joined #openstack-ansible | 17:32 | |
| gloksinia | jafeha: that it !!! compute nodes loaded fine but not for network nodes. Although compute don't have openvswitch in /etc/modules at the same. | 17:33 |
| *** DanyC_ has joined #openstack-ansible | 17:34 | |
| *** DanyC has quit IRC | 17:37 | |
| jafeha | gloksinia, as far as i see it, in our env the module gets loaded on compute nodes because the ovs is actually installed on the physical machine. for the networking nodes, ovs is not installed on the physical host but within the container. so the physical host of our networking node has no idea it should load the module | 17:38 |
| *** dave-mccowan has joined #openstack-ansible | 17:38 | |
| gloksinia | jafeha: agreed with you !! | 17:43 |
| jafeha | gloksinia, could you just file a bug about this, i'm happy to add my comments on this issue, mbe we can even come up with a patch together. | 17:45 |
| openstackgerrit | tonytan4ever proposed openstack/openstack-ansible-tests master: Force gzip compression when file has a lot of links https://review.openstack.org/527478 | 17:45 |
| *** vnogin has quit IRC | 17:45 | |
| *** vnogin has joined #openstack-ansible | 17:46 | |
| *** woodard has quit IRC | 17:48 | |
| *** vnogin has quit IRC | 17:56 | |
| gloksinia | jafeha: awesome !!! Good time to start. but how do i start could you suggest me i'm so newbie don't actually know about the flow they are working. | 17:56 |
| jafeha | for starters, here is the bugtracker: https://bugs.launchpad.net/openstack-ansible | 17:58 |
| jafeha | afair you need an account, but when you filed the bug we'll see further, i'm still learning the hole contribution process on my own ;) | 17:58 |
| *** shardy has quit IRC | 18:01 | |
| *** alefra has quit IRC | 18:01 | |
| *** hamzy has quit IRC | 18:07 | |
| gloksinia | jafeha: Okay, So let me take time on that things first :3 | 18:10 |
| *** udesale__ has quit IRC | 18:17 | |
| *** electrofelix has quit IRC | 18:20 | |
| *** woodard has joined #openstack-ansible | 18:24 | |
| *** jafeha__ has joined #openstack-ansible | 18:26 | |
| *** jafeha has quit IRC | 18:30 | |
| *** sxc731 has quit IRC | 18:34 | |
| *** chyka_ has joined #openstack-ansible | 18:34 | |
| *** DanyC_ has quit IRC | 18:37 | |
| *** chyka has quit IRC | 18:38 | |
| *** DanyC has joined #openstack-ansible | 18:38 | |
| *** DanyC has quit IRC | 18:40 | |
| *** jafeha__ has quit IRC | 18:40 | |
| *** DanyC has joined #openstack-ansible | 18:40 | |
| *** hamza21 has joined #openstack-ansible | 18:51 | |
| *** dun has quit IRC | 18:53 | |
| *** sxc731 has joined #openstack-ansible | 18:53 | |
| openstackgerrit | Major Hayden proposed openstack/openstack-ansible-tests master: Force gzip compression when file has a lot of links https://review.openstack.org/527478 | 18:56 |
| *** armaan has quit IRC | 18:59 | |
| *** armaan has joined #openstack-ansible | 19:00 | |
| *** cshen has joined #openstack-ansible | 19:00 | |
| *** armaan has quit IRC | 19:03 | |
| *** armaan has joined #openstack-ansible | 19:04 | |
| *** pramodrj07 has joined #openstack-ansible | 19:06 | |
| *** vnogin has joined #openstack-ansible | 19:07 | |
| *** dun has joined #openstack-ansible | 19:07 | |
| *** cshen has quit IRC | 19:10 | |
| *** cshen has joined #openstack-ansible | 19:12 | |
| *** poopcat has joined #openstack-ansible | 19:16 | |
| *** vnogin has quit IRC | 19:17 | |
| *** aludwar has joined #openstack-ansible | 19:19 | |
| mgariepy | is there a better way to re-create the endpoint beside mysql update ? | 19:21 |
| mgariepy | ie: keystone-manage bootstrap --bootstrap-internal-url <url> ? | 19:22 |
| *** jafeha has joined #openstack-ansible | 19:22 | |
| mgariepy | cloudnull, ^^? | 19:22 |
| *** rodolof has quit IRC | 19:22 | |
| cloudnull | i just edit the db typically | 19:23 |
| cloudnull | but that's just because im a bad person | 19:23 |
| *** rodolof has joined #openstack-ansible | 19:23 | |
| mgariepy | haha lol ok | 19:23 |
| SamYaple | cloudnull: shame on you! | 19:24 |
| SamYaple | mgariepy: the keytone-manage bootstrap was there so we could get ridof admin_token, so that is definetely the way to do it | 19:25 |
| SamYaple | before you wouldhave had to admin_token into keystone to fix it | 19:25 |
| *** hamzy has joined #openstack-ansible | 19:30 | |
| *** cshen has quit IRC | 19:34 | |
| mgariepy | mysql is was.. lol | 19:34 |
| jafeha | mgariepy: https://docs.openstack.org/python-openstackclient/pike/cli/command-objects/endpoint.html | 19:37 |
| *** stuartgr has quit IRC | 19:38 | |
| cloudnull | evrardjp: looks like the current master set of pins is going to need updating, we need libvirt_python-3.9.0 else we hit this bug https://bugs.launchpad.net/openstack-devel/+bug/1682692 | 19:39 |
| openstack | Launchpad bug 1682692 in OpenStack Development Infrastructure "nova fails with error: 'module' object has no attribute 'VIR_MIGRATE_POSTCOPY' after using libvirt 2.5.0 from UCA" [Undecided,New] | 19:39 |
| *** cshen has joined #openstack-ansible | 19:40 | |
| mgariepy | jafeha, yes but my endpoint internal url for identity wasn't good.. | 19:41 |
| mgariepy | so I couldn't update it with openstack client :) | 19:41 |
| jafeha | oh. ic, i guess thats a viable option to hit mysql then | 19:42 |
| * jafeha goes back into his corner | 19:42 | |
| mgariepy | was the simpler option IMO | 19:47 |
| *** masuberu has joined #openstack-ansible | 19:48 | |
| *** esberglu has quit IRC | 19:49 | |
| *** esberglu has joined #openstack-ansible | 19:50 | |
| *** masber has quit IRC | 19:51 | |
| *** dave-mccowan has quit IRC | 19:56 | |
| *** germs has joined #openstack-ansible | 20:00 | |
| *** germs has quit IRC | 20:00 | |
| sxc731 | Hi team! ceph_client: it doesn't seem possible to have nova and cinder use different Ceph credentials, right? That is if nova_ceph_client is defined to smth different from cinder_ceph_client, nova can't access (eg: attach) volumes. Or did I miss smth? | 20:03 |
| openstackgerrit | Merged openstack/openstack-ansible-lxc_hosts stable/ocata: Remove LXC yum repo from containers https://review.openstack.org/527196 | 20:06 |
| mgariepy | cloudnull, seems to work correcly ;) | 20:09 |
| cloudnull | which one? | 20:09 |
| mgariepy | had the small issue with the internal url. and had to mysql edit the cinder volumes hosts but that's all ;) | 20:09 |
| cloudnull | nice! | 20:10 |
| cloudnull | all leap upgraded ? | 20:10 |
| openstackgerrit | Merged openstack/openstack-ansible-openstack_openrc master: Add defaults for keystone insecure variables https://review.openstack.org/527194 | 20:10 |
| mgariepy | from Kilo to newton. | 20:10 |
| cloudnull | awesome! | 20:10 |
| mgariepy | 14.0.8 + some patches | 20:10 |
| cloudnull | sweeT! | 20:10 |
| cloudnull | now to upgrade the distro :) | 20:10 |
| cloudnull | no rest for the wicked ! | 20:11 |
| cloudnull | :P | 20:11 |
| mgariepy | well i'll give that a few days before I do the OS :) | 20:11 |
| mgariepy | haha | 20:11 |
| mgariepy | the distro one i've done it last summer so i just need to dig my notes up a bit. | 20:12 |
| *** hybridpollo has joined #openstack-ansible | 20:12 | |
| -openstackstatus- NOTICE: The zuul scheduler has been restarted after lengthy troubleshooting for a memory consumption issue; earlier changes have been reenqueued but if you notice jobs not running for a new or approved change you may want to leave a recheck comment or a new approval vote | 20:14 | |
| odyssey4me | mgariepy I thought we had an etherpad somewhere, but your notes would be lovely to share :) | 20:14 |
| *** hybridpollo has quit IRC | 20:19 | |
| mgariepy | yeah they are in the etherpad. | 20:20 |
| mgariepy | https://etherpad.openstack.org/p/osa-newton-xenial-upgrade | 20:20 |
| mgariepy | my notes are only for my specific config. | 20:20 |
| *** hybridpollo has joined #openstack-ansible | 20:21 | |
| openstackgerrit | Merged openstack/openstack-ansible-repo_server master: Set pypi-server to cache and use known built wheels https://review.openstack.org/526886 | 20:23 |
| *** fxpester has joined #openstack-ansible | 20:33 | |
| *** savvas has joined #openstack-ansible | 20:33 | |
| *** openstackgerrit has quit IRC | 20:34 | |
| *** jwitko_ has joined #openstack-ansible | 20:34 | |
| *** wspthr has quit IRC | 20:34 | |
| *** armaan has quit IRC | 20:35 | |
| *** ashak has quit IRC | 20:35 | |
| *** coolj has quit IRC | 20:35 | |
| *** coolj has joined #openstack-ansible | 20:35 | |
| *** jmccrory has quit IRC | 20:35 | |
| *** ashak has joined #openstack-ansible | 20:35 | |
| *** armaan has joined #openstack-ansible | 20:35 | |
| *** hamza21 has quit IRC | 20:35 | |
| *** brad[] has quit IRC | 20:35 | |
| *** savvas_ has quit IRC | 20:35 | |
| *** pester has quit IRC | 20:35 | |
| *** mgariepy has quit IRC | 20:35 | |
| *** mcarden has quit IRC | 20:35 | |
| *** csmart has quit IRC | 20:36 | |
| *** mcarden has joined #openstack-ansible | 20:36 | |
| *** DanyC has quit IRC | 20:37 | |
| *** lihi has quit IRC | 20:37 | |
| *** hamza21 has joined #openstack-ansible | 20:37 | |
| *** pramodrj07 has quit IRC | 20:38 | |
| *** hamza21 has quit IRC | 20:38 | |
| *** wspthr has joined #openstack-ansible | 20:39 | |
| xdfil | anyone ever experience modifications to the default security group disappearing? | 20:39 |
| *** lihi has joined #openstack-ansible | 20:40 | |
| *** jmccrory has joined #openstack-ansible | 20:40 | |
| *** mgariepy has joined #openstack-ansible | 20:40 | |
| *** csmart has joined #openstack-ansible | 20:41 | |
| *** Mr_Smurf has quit IRC | 20:45 | |
| *** andymccr has quit IRC | 20:45 | |
| *** mancdaz has quit IRC | 20:45 | |
| *** Oku_OS-away has quit IRC | 20:45 | |
| *** mancdaz has joined #openstack-ansible | 20:45 | |
| *** Mr_Smurf has joined #openstack-ansible | 20:45 | |
| *** Oku_OS-away has joined #openstack-ansible | 20:45 | |
| *** openstackgerrit has joined #openstack-ansible | 20:45 | |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-ceph_client stable/newton: Provide the option to set the the client version https://review.openstack.org/527513 | 20:45 |
| *** andymccr has joined #openstack-ansible | 20:45 | |
| cloudnull | xdfil: as in it's missing when you run the neutron security-group-list | 20:46 |
| cloudnull | or in horizon | 20:47 |
| cloudnull | or as in they have no effect? | 20:47 |
| xdfil | cloudnull: a user claims that they added a rules for 22 and 8443 and it was working about a month agi | 20:48 |
| xdfil | ago | 20:48 |
| xdfil | but today they could not access the instances and I told them they had no security group rules | 20:48 |
| cloudnull | nope, never seen them just disapear | 20:48 |
| xdfil | and they are insisting they had already made the changes | 20:49 |
| xdfil | and I am inclined to beleive them | 20:49 |
| cloudnull | I've seen them break or not take effect | 20:49 |
| xdfil | yeah I've seen that too :( but this is pretty new | 20:49 |
| cloudnull | but never just go away | 20:49 |
| cloudnull | I once had a client run a heat stack w/ sec group changes in it that impacted the rules in adverse ways | 20:50 |
| cloudnull | maybe there some automation running on the client side that adjusted the rules? | 20:51 |
| cloudnull | or wiped them out | 20:51 |
| cloudnull | you should be able to go back through the logs and see there was an update to sec rules | 20:51 |
| *** vnogin has joined #openstack-ansible | 20:52 | |
| openstackgerrit | Merged openstack/openstack-ansible-tests master: Allow additional parameters for ansible-lint https://review.openstack.org/527195 | 20:53 |
| *** jose-phillips has quit IRC | 20:53 | |
| openstackgerrit | Merged openstack/openstack-ansible-os_designate master: Handle Pike deprecations for designate https://review.openstack.org/525488 | 20:53 |
| *** jose-phillips has joined #openstack-ansible | 20:54 | |
| *** dave-mccowan has joined #openstack-ansible | 20:55 | |
| *** dave-mccowan has quit IRC | 20:59 | |
| *** dave-mcc_ has joined #openstack-ansible | 20:59 | |
| *** rodolof has quit IRC | 20:59 | |
| *** rodolof has joined #openstack-ansible | 20:59 | |
| *** sep has joined #openstack-ansible | 21:00 | |
| *** vnogin has quit IRC | 21:00 | |
| *** cshen has quit IRC | 21:03 | |
| *** brad[] has joined #openstack-ansible | 21:06 | |
| *** cshen has joined #openstack-ansible | 21:08 | |
| openstackgerrit | Merged openstack/openstack-ansible-tests stable/pike: Skip failures when collecting nic setups https://review.openstack.org/526775 | 21:11 |
| *** cshen has quit IRC | 21:15 | |
| *** CloudToko has joined #openstack-ansible | 21:22 | |
| *** jappleii__ has joined #openstack-ansible | 21:23 | |
| *** jappleii__ has quit IRC | 21:24 | |
| *** sxc731 has quit IRC | 21:25 | |
| *** jappleii__ has joined #openstack-ansible | 21:25 | |
| *** jappleii__ has quit IRC | 21:26 | |
| *** jappleii__ has joined #openstack-ansible | 21:27 | |
| *** jappleii__ has quit IRC | 21:27 | |
| *** jappleii__ has joined #openstack-ansible | 21:28 | |
| *** smatzek has quit IRC | 21:29 | |
| *** chhavi__ has joined #openstack-ansible | 21:30 | |
| *** chhavi__ has quit IRC | 21:34 | |
| *** savvas_ has joined #openstack-ansible | 21:36 | |
| *** jafeha has quit IRC | 21:36 | |
| *** jafeha has joined #openstack-ansible | 21:37 | |
| *** savvas_ has quit IRC | 21:41 | |
| *** savvas_ has joined #openstack-ansible | 21:41 | |
| *** hamzy has quit IRC | 21:46 | |
| *** savvas_ has quit IRC | 21:47 | |
| *** vnogin has joined #openstack-ansible | 21:50 | |
| *** jwitko__ has joined #openstack-ansible | 21:59 | |
| *** jwitko has quit IRC | 22:03 | |
| *** jwitko__ has quit IRC | 22:05 | |
| openstackgerrit | Merged openstack/openstack-ansible stable/pike: Avoid using 'roles' reserved variable https://review.openstack.org/527166 | 22:16 |
| openstackgerrit | Merged openstack/openstack-ansible stable/ocata: Fix crontab errors on CentOS/SUSE https://review.openstack.org/525652 | 22:16 |
| openstackgerrit | Merged openstack/openstack-ansible master: Reduce console output in gate jobs https://review.openstack.org/524721 | 22:16 |
| openstackgerrit | Merged openstack/openstack-ansible master: Remove is_metal from playbooks https://review.openstack.org/527081 | 22:16 |
| openstackgerrit | Merged openstack/openstack-ansible master: Skip ansible-lint test against roles https://review.openstack.org/527198 | 22:16 |
| *** gouthamr has quit IRC | 22:18 | |
| *** taseer1 has joined #openstack-ansible | 22:34 | |
| *** jwitko has joined #openstack-ansible | 22:34 | |
| *** hybridpollo has quit IRC | 22:36 | |
| *** vnogin has quit IRC | 22:38 | |
| *** Taseer has quit IRC | 22:38 | |
| *** jwitko has quit IRC | 22:38 | |
| *** vnogin has joined #openstack-ansible | 22:40 | |
| *** vnogin has quit IRC | 22:45 | |
| *** esberglu has quit IRC | 22:58 | |
| *** esberglu has joined #openstack-ansible | 22:59 | |
| *** armaan has quit IRC | 23:03 | |
| *** esberglu has quit IRC | 23:03 | |
| *** armaan has joined #openstack-ansible | 23:04 | |
| *** marst has quit IRC | 23:08 | |
| *** esberglu has joined #openstack-ansible | 23:13 | |
| *** esberglu has quit IRC | 23:15 | |
| *** pedja has quit IRC | 23:23 | |
| *** pedja has joined #openstack-ansible | 23:23 | |
| *** CloudToko has quit IRC | 23:24 | |
| *** CloudToko has joined #openstack-ansible | 23:25 | |
| *** Yvan has joined #openstack-ansible | 23:28 | |
| cloudnull | anyone around able to give this a review https://review.openstack.org/#/c/454450/ | 23:28 |
| cloudnull | ^ mhayden | 23:28 |
| *** pmannidi has joined #openstack-ansible | 23:36 | |
| *** woodard_ has joined #openstack-ansible | 23:39 | |
| *** woodard has quit IRC | 23:39 | |
| *** woodard has joined #openstack-ansible | 23:40 | |
| *** woodard_ has quit IRC | 23:40 | |
| *** vnogin has joined #openstack-ansible | 23:41 | |
| *** woodard has quit IRC | 23:41 | |
| *** woodard has joined #openstack-ansible | 23:41 | |
| *** woodard_ has joined #openstack-ansible | 23:42 | |
| *** woodard has quit IRC | 23:42 | |
| *** woodard_ has quit IRC | 23:44 | |
| *** vnogin has quit IRC | 23:45 | |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-os_glance master: Update glance NFS for systemd https://review.openstack.org/526930 | 23:50 |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-tests master: Remove the serialization in tests https://review.openstack.org/521598 | 23:53 |
| cloudnull | another good one for master is https://review.openstack.org/#/c/524086/ | 23:54 |
| cloudnull | if folks have a moment | 23:54 |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible stable/pike: Change the galera health check for better cluster health https://review.openstack.org/527099 | 23:55 |
| openstackgerrit | Merged openstack/openstack-ansible-tests stable/pike: test-log-collect.sh: Collect all environment variables https://review.openstack.org/527155 | 23:57 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!