| *** gyee has quit IRC | 00:07 | |
| *** nurdie has quit IRC | 00:40 | |
| *** strobelight has joined #openstack-ansible | 00:45 | |
| *** strobelight_ has joined #openstack-ansible | 00:52 | |
| *** strobelight is now known as Guest32149 | 00:52 | |
| *** strobelight_ is now known as strobelight | 00:53 | |
| *** Guest32149 has quit IRC | 00:56 | |
| *** TxGirlGeek has joined #openstack-ansible | 00:58 | |
| *** TxGirlGeek has quit IRC | 01:32 | |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/ansible-config_template master: Enhance the config_template comment parser https://review.opendev.org/672170 | 01:32 |
|---|---|---|
| *** TxGirlGeek has joined #openstack-ansible | 01:50 | |
| *** TxGirlGeek has quit IRC | 01:54 | |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/ansible-config_template master: Enhance the config_template comment parser https://review.opendev.org/672170 | 02:18 |
| *** BjoernT has joined #openstack-ansible | 02:32 | |
| *** BjoernT has quit IRC | 02:36 | |
| *** nurdie has joined #openstack-ansible | 02:40 | |
| *** BjoernT has joined #openstack-ansible | 02:41 | |
| *** nurdie has quit IRC | 02:45 | |
| *** BjoernT has quit IRC | 02:58 | |
| *** BjoernT_ has joined #openstack-ansible | 02:58 | |
| *** nurdie has joined #openstack-ansible | 03:04 | |
| *** BjoernT_ has quit IRC | 03:07 | |
| *** gkadam has joined #openstack-ansible | 03:49 | |
| *** gkadam has quit IRC | 03:50 | |
| *** udesale has joined #openstack-ansible | 04:01 | |
| *** cshen has joined #openstack-ansible | 04:18 | |
| *** ChipOManiac has joined #openstack-ansible | 04:30 | |
| *** pcaruana has joined #openstack-ansible | 04:43 | |
| *** raukadah is now known as chandankumar | 04:44 | |
| *** nurdie has quit IRC | 05:16 | |
| *** TxGirlGeek has joined #openstack-ansible | 05:16 | |
| *** TxGirlGeek has quit IRC | 05:43 | |
| cshen | good morning. | 05:44 |
| cshen | I just learned when I run 'openstack-ansible setup-openstack-yml --limit foobar', I have to explicitly add 'localhost' in the limit, so like this 'openstack-ansible setup-openstack.yml --limit localhost,foobar'. | 05:45 |
| cshen | was it because dynamic inventory doesn't include localhost? | 05:46 |
| jrosser | cshen: when you use --limit all other targets are excluded, thats just how ansible works | 05:51 |
| jrosser | and the results can sometimes be unexepected | 05:51 |
| *** miloa has joined #openstack-ansible | 05:52 | |
| *** jhesketh has quit IRC | 06:11 | |
| *** jhesketh has joined #openstack-ansible | 06:11 | |
| miloa | Morning | 06:34 |
| cshen | jrosser: if I run https://opendev.org/openstack/openstack-ansible/src/branch/master/playbooks/os-neutron-install.yml with --limit, I found the first play "Configure Neutron dynamic host groupings" would be skipped, because no host was matched. | 06:40 |
| cshen | So I need to do "openstack-ansible os-neutron-install.yml --limit localhost,HOST_NAME" to make sure that play will be played. | 06:40 |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/ansible-config_template master: Enhance the config_template comment parser https://review.opendev.org/672170 | 06:46 |
| jrosser | cshen: yes, if there are tasks targeting localhost and you exclude localhost with a —limit they will be skipped. | 06:53 |
| cshen | jrosser: thanks. | 06:53 |
| *** Blinkiz has joined #openstack-ansible | 06:55 | |
| Blinkiz | Hello. I have been stuck for a day now without finding a solution. TASK [python_venv_build : Upgrade pip/setuptools/wheel to the versions we want] | 06:56 |
| Blinkiz | Two infrastructure works alright but the third always fails with a "[Errno 111] Connection refused" against http://192.168.38.9:8181. Doing a nmap from within the infra3_utility_container-24784d93 works against that address. | 06:58 |
| Blinkiz | https://paste.ubuntu.com/p/KQZ5mnBnnr/ | 06:58 |
| Blinkiz | What is happening here? Why is it failing? | 07:01 |
| ChipOManiac | Blinkiz: Is 38.9 your load-balanced address? | 07:05 |
| Blinkiz | ChipOManiac, yes, the ipv4 address is used in user_variables.yml,haproxy_keepalived_internal_vip_cidr. | 07:06 |
| *** rpittau|afk is now known as rpittau | 07:09 | |
| *** vnogin has joined #openstack-ansible | 07:13 | |
| noonedeadpunk | mornings | 07:14 |
| *** vnogin has quit IRC | 07:16 | |
| *** nurdie has joined #openstack-ansible | 07:17 | |
| *** irclogbot_1 has quit IRC | 07:20 | |
| *** openstackstatus has quit IRC | 07:20 | |
| *** zbr_ has joined #openstack-ansible | 07:20 | |
| *** irclogbot_2 has joined #openstack-ansible | 07:21 | |
| *** nurdie has quit IRC | 07:22 | |
| *** zbr has quit IRC | 07:23 | |
| *** mrda has quit IRC | 07:23 | |
| *** mrda has joined #openstack-ansible | 07:23 | |
| *** Anticimex has quit IRC | 07:24 | |
| *** tosky has joined #openstack-ansible | 07:28 | |
| openstackgerrit | Dmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-tests master: Update ansible to 2.8.2 https://review.opendev.org/659658 | 07:28 |
| *** Anticimex has joined #openstack-ansible | 07:29 | |
| *** ChipOManiac has quit IRC | 07:40 | |
| jrosser | Blinkiz: if you wget the url from the utility container does it work? and also check that it works more than 3 times one after the other | 07:42 |
| Blinkiz | jrosser, thank you for the suggestion. I deleted the container and is now running setup-hosts.yml and soon setup-infrastructure.yml. I try wget if it fails again. | 07:43 |
| openstackgerrit | Jimmy McCrory proposed openstack/openstack-ansible master: Change haproxy http-check expect for nova_console https://review.opendev.org/672215 | 07:47 |
| openstackgerrit | Merged openstack/openstack-ansible-lxc_container_create master: Do not add container /etc/hosts entry for 127.0.1.1 https://review.opendev.org/670705 | 08:01 |
| Blinkiz | jrosser, When using wget from inside infra3_utility_container-24784d93 I get "Connecting to 192.168.38.9:8181... failed: Connection refused". Doing the same from infra2-utility-container-497e4f58 and it works. Why? :) | 08:06 |
| jrosser | Blinkiz: well i dont know :) but the next thing you can do is to try wget from the utility container to the backend repo servers directly rather than the vip | 08:09 |
| jrosser | then you'll be able to decide if it is a problem with the vip/loadbalancer, or theres a more general networking problem with your infra3 host / containers | 08:10 |
| Blinkiz | jrosser, okay. sure. :) | 08:15 |
| jrosser | Blinkiz: thing is, utility container is the first thing like that which gets made very early in the build, so instinctively i'd say this is a networking issue specific to infra3 | 08:16 |
| Blinkiz | jrosser, So, wget from infra3-utility-container-24784d93 to infra1-repo-container-8e14f718, infra2-repo-container-b4e807fb and infra3-repo-container-0b388e14 works. | 08:17 |
| jrosser | but it fails to the vip? | 08:18 |
| Blinkiz | jrosser, yes.' | 08:18 |
| jrosser | right - so i think that gives you a route to chase down whats wrong, you've definitely got the vip in used_ips? | 08:19 |
| openstackgerrit | Merged openstack/openstack-ansible-lxc_hosts stable/rocky: Fix copying apt keys from host to containers https://review.opendev.org/670127 | 08:19 |
| Blinkiz | jrosser, I do not have the vip ipv4 in used_ips | 08:20 |
| *** ivve has joined #openstack-ansible | 08:22 | |
| jrosser | Blinkiz: here you see for an AIO the VIP is specifically marked as used https://github.com/openstack/openstack-ansible/blob/master/etc/openstack_deploy/openstack_user_config.yml.aio#L11 | 08:22 |
| *** ChipOManiac has joined #openstack-ansible | 08:22 | |
| Blinkiz | jrosser, alright, and? :) | 08:23 |
| Blinkiz | jrosser, in openstack_user_config.yml.example it says used_ips is optional. | 08:24 |
| jrosser | you define a range of IP addresses for the mgmt network in your config, and OSA selects random addresses out of that range for the container eth1 interfaces | 08:24 |
| jrosser | so if you have routers, gateways, or whatever else in the mgmt network you need to list those ips so that a container doesnt get put on an already used ip | 08:26 |
| jrosser | you can check how things have been assigned with ./scripts/invetory_manage.py | 08:27 |
| chandankumar | jrosser: Hello | 08:27 |
| chandankumar | jrosser: what is the ansible version we are using in OSA? | 08:27 |
| Blinkiz | jrosser, yeah. No problem there I think. I have listed in "used_ips" all bare metal services in all subnets. ./scripts/invetory_manage.py, let me check! | 08:27 |
| chandankumar | jrosser: with ansible-2.8 testing http://logs.openstack.org/19/667219/5/check/tripleo-ci-centos-7-standalone/a34fc53/job-output.txt.gz#_2019-07-22_10_35_04_992828 | 08:27 |
| jrosser | chandankumar: it depends | 08:27 |
| chandankumar | this error is still poping up | 08:27 |
| chandankumar | in master branches? | 08:27 |
| jrosser | chandankumar: we pin to the version of ansible that is current during each release | 08:28 |
| jrosser | so we're just about to land a patch moving to 2.8.x | 08:28 |
| jrosser | and that will become the version for stable/train forever | 08:28 |
| openstackgerrit | Arx Cruz proposed openstack/openstack-ansible-os_tempest master: Update stestr_executable variable for RHEL-8 https://review.opendev.org/672225 | 08:30 |
| jrosser | chandankumar: now i'm sure i've seen that error | 08:30 |
| Blinkiz | jrosser, My ./scripts/invetory_manage.py seems okay. https://paste.ubuntu.com/p/NzC9w4pnmZ/ | 08:31 |
| Blinkiz | jrosser, How do I troubleshoot haproxy and the vip address? | 08:32 |
| chandankumar | jrosser: yes, last time noonedeadpunk fixed in openstack-ansible-tests side | 08:32 |
| jrosser | Blinkiz: infra3_horizon_container-07e7f66f | None | horizon | infra3 | None | 192.168.38.9 | 08:33 |
| jrosser | ^ looks like trouble? | 08:33 |
| Blinkiz | jrosser, I do not know, does it? :) | 08:33 |
| jrosser | well, from earlier in IRC "ChipOManiac> Blinkiz: Is 38.9 your load-balanced address?" | 08:34 |
| jrosser | you can't have the loadbalancer VIP and one of the horizon containers both have the same IP | 08:35 |
| Blinkiz | So what you are saying is that 192.168.38.9 should be listed in the variable "used_ips"? | 08:35 |
| jrosser | thats what i told you earlier, yes, anything that can't be assinged to a container needs to listed in used_ips | 08:35 |
| jrosser | and i believe that this is why things on infra3 are failing because there is something local on infra3 replying to arp for your vip, but it's actually a horizon container | 08:36 |
| ChipOManiac | Blinkiz: Port 8181 is for the repo container IIRC. That comes through the load-balancer. | 08:37 |
| jrosser | and due to some race condition / arp battle things are working out better for your other hosts, but thats just down to luck imho | 08:37 |
| ChipOManiac | Since 38.9 is assigned to the infra3_horizon_container, there's going to be a conflict. | 08:37 |
| Blinkiz | The problem here is that before deployment 192.168.38.9 is not a used ip. It makes no sense for me to specify it under used_ips. If openstack-ansible creates a IP am assuming openstack-ansible keeps track of it | 08:37 |
| ChipOManiac | Blinkiz: That's true. But since you selected 38.9 it won't be included. | 08:38 |
| Blinkiz | In openstack_user_config.yml.example "used_ips" is explained. It says nothing about the need to specify things openstack-ansible will create. | 08:39 |
| jrosser | openstack-ansible does not select the internal VIP | 08:39 |
| jrosser | it's user defined, becasue it might be haproxy, or F5 hardware LB or whatever else you want | 08:39 |
| ChipOManiac | ^ You specified it in the variables. | 08:39 |
| noonedeadpunk | saw lots ofhttp://logs.openstack.org/26/670126/1/check/openstack-ansible-linters/e94fd11/job-output.txt.gz#_2019-07-23_08_18_02_804948 today | 08:40 |
| Blinkiz | My I suggest that you add in user_variables.yml.prod.example that used IPs here needs to be specified in openstack_user_config.yml under "used_ips" because openstack-ansible do not keep track of this | 08:44 |
| Blinkiz | But I must thank you guys for nice support here. Thank you :) | 08:46 |
| chandankumar | jrosser: https://review.opendev.org/#/c/665244/ fixes the issue last tome | 08:47 |
| chandankumar | *time | 08:47 |
| *** nurdie has joined #openstack-ansible | 08:56 | |
| *** nurdie has quit IRC | 09:00 | |
| openstackgerrit | Merged openstack/openstack-ansible-os_keystone master: Remove nginx default conf https://review.opendev.org/672040 | 09:00 |
| *** namrata has joined #openstack-ansible | 09:01 | |
| openstackgerrit | Chandan Kumar (raukadah) proposed openstack/openstack-ansible-os_tempest master: [WIP]Set fact tempest_install_method var for meta handler https://review.opendev.org/672231 | 09:02 |
| jrosser | chandankumar: noonedeadpunk: really i dont understand why we have this hander at all https://github.com/openstack/ansible-role-python_venv_build/blob/master/handlers/main.yml#L16-L18 | 09:06 |
| chandankumar | jrosser: I have also no idea | 09:06 |
| jrosser | "noop (added in Ansible 2.0) This literally does 'nothing'. It is mainly used internally and not recommended for general use." | 09:06 |
| chandankumar | jrosser: will remove the handler part from venv_build? | 09:07 |
| chandankumar | and check what other things are breaking | 09:07 |
| noonedeadpunk | jrosser: can't it restart service somehow? | 09:07 |
| noonedeadpunk | not itself but in complex | 09:08 |
| noonedeadpunk | Since other handlers listen to it https://github.com/openstack/openstack-ansible-os_aodh/blob/master/handlers/main.yml#L16 | 09:10 |
| noonedeadpunk | so it kinda triggers real handers outside of this role | 09:10 |
| jrosser | yes just found the same sort of thing https://opendev.org/openstack/openstack-ansible/src/branch/master/playbooks/utility-install.yml#L35 | 09:11 |
| openstackgerrit | Merged openstack/openstack-ansible-openstack_hosts master: Do not add /etc/hosts entry for 127.0.1.1 https://review.opendev.org/670706 | 09:11 |
| noonedeadpunk | chandankumar: maybe I'm not correct (sorry if I am) but I think that we really need ether default or tempest_install_method being defined before checking it's existance | 09:14 |
| chandankumar | noonedeadpunk: let' see I am testing it here https://review.opendev.org/#/c/667219/ | 09:15 |
| chandankumar | in tripleo side tempest_install_method is always distro | 09:15 |
| noonedeadpunk | the point was about variables scope iirc | 09:16 |
| *** vnogin has joined #openstack-ansible | 09:16 | |
| chandankumar | noonedeadpunk: ah, got it, once this job finishes, let me check it's existence | 09:17 |
| jrosser | chandankumar: the proper answer i think is that you need to define tempest_install_method in tripleo in a group_vars or whatever that is in scope for the place that handler is run | 09:17 |
| noonedeadpunk | so during role include vars were included form the role which was doing tempest include (and don't have tempest_install_method) | 09:18 |
| noonedeadpunk | but it's might be related only to OSA, since we're using with_first_found | 09:18 |
| chandankumar | jrosser: noonedeadpunk https://github.com/openstack/tripleo-quickstart-extras/blob/master/playbooks/tempest.yml | 09:19 |
| chandankumar | is the playbook used | 09:19 |
| chandankumar | and is called https://github.com/openstack/tripleo-quickstart-extras/blob/master/playbooks/multinode-standalone.yml#L49 | 09:19 |
| namrata | jonher the workaround you suggested for WSREP SST method upgrade from xtrabackup-v2 to mariabackup worked for me. Thanks | 09:20 |
| *** vnogin has quit IRC | 09:21 | |
| jonher | namrata nice, i should not take credit for that though, i don't remember who posted it here | 09:21 |
| jonher | i saerch the irclog here and jrosser sent it to you once already :p i just resent what he already sent to you. anyways, glad it works :) | 09:22 |
| namrata | oh great! | 09:23 |
| namrata | jonher I would like to make the contribution for the same in the code. if somebody can help me how to proceed will be very helpful. | 09:23 |
| namrata | In that case jrosser thanks a lot for sharing the same | 09:24 |
| jonher | if you have not contributed before you have to setup a few things to be able to suggest a change in gerrit: https://docs.openstack.org/infra/manual/developers.html | 09:25 |
| jonher | if you have contributed before, create a review with the changes :) | 09:25 |
| namrata | I have contributed earlier but not in ansible so I dont need to setup the same | 09:26 |
| *** vnogin has joined #openstack-ansible | 09:27 | |
| openstackgerrit | Merged openstack/openstack-ansible-os_octavia stable/stein: Use the admin endpoint to upload glance images https://review.opendev.org/668374 | 09:30 |
| openstackgerrit | Merged openstack/openstack-ansible-os_octavia stable/rocky: Use the admin endpoint to upload glance images https://review.opendev.org/668375 | 09:30 |
| jrosser | namrata: great that its worked :) | 09:30 |
| openstackgerrit | Merged openstack/openstack-ansible-os_octavia stable/rocky: Ensure that admin endpoint is used to configure octavia quota https://review.opendev.org/668373 | 09:30 |
| namrata | so it will be same in the code like running `galera-install.yml -e galera_wsrep_sst_method=rsync -e galera_upgrade=true ` before stup-infrastructure playbook | 09:31 |
| openstackgerrit | Merged openstack/openstack-ansible-os_octavia master: Save iptables rules for all Debian derivative operating systems https://review.opendev.org/668394 | 09:37 |
| jrosser | namrata: ideally we update the docs here and the upgrade scripts to handle this all automatically https://docs.openstack.org/openstack-ansible/latest/admin/upgrades/major-upgrades.html | 09:38 |
| namrata | okay so should I add this particular step `galera-install.yml -e galera_wsrep_sst_method=rsync -e galera_upgrade=true` in the upgrade script and document both | 09:42 |
| jrosser | namrata: well i guess this is targetting an R->S upgrade? the code in master will become the T release, and if we are already on T we can assume that the replication type is correct | 09:45 |
| ChipOManiac | Anyone know if Zun can be deployed via openstack-ansible? I can certainly see an os_zun repo but no os-zun-install.yml, so I guess running a setup-openstack.yml won't do much. | 09:47 |
| jrosser | namrata: perhaps it's something to ask at the OSA meeting later today what the right way to do this is? | 09:48 |
| namrata | okay thanks jrosser. i will attend the meeting . | 09:49 |
| noonedeadpunk | ChipOManiac: hm, yep, seems that you're right and we're missing zun installation playbook... | 09:50 |
| noonedeadpunk | you can probably use https://github.com/openstack/openstack-ansible-os_zun/blob/master/tests/test-install-zun.yml as a sample... | 09:50 |
| noonedeadpunk | and it's smth that you either may offer for upstream, or we can do it ourselves if you don't have opportinity | 09:52 |
| ChipOManiac | noonedeadpunk: Wouldn't have a problem with that. :) | 10:01 |
| ChipOManiac | We're trying to set it up at our shop. | 10:02 |
| ChipOManiac | Just don't know where to start. | 10:02 |
| jrosser | ChipOManiac: take one of the existing playbooks for another sevice as a starting point, the code is really quite modular these days so the changes needed should be fairly minimal | 10:03 |
| jrosser | and spin up an all-in-one to bash at it a bit | 10:03 |
| openstackgerrit | Dmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-os_zun master: Fix docs linking and naming https://review.opendev.org/672246 | 10:04 |
| *** nurdie has joined #openstack-ansible | 10:07 | |
| *** kopecmartin|off is now known as kopecmartin | 10:12 | |
| *** nurdie has quit IRC | 10:12 | |
| ChipOManiac | jrosser: I see. But the playbook for nova seemed a little daunting, and threw me off actually. | 10:17 |
| ChipOManiac | BTW thanks noonedeadpunk and jrosser. | 10:17 |
| noonedeadpunk | You may probably look at masakari (since it is also devided for compute and api) | 10:19 |
| ChipOManiac | I'll take a look then. Thanks :) | 10:20 |
| jrosser | noonedeadpunk: i just saw that the placement playbook doesnt do any management of haproxy like some of the others do - does that look wrong? | 10:23 |
| *** ansmith has joined #openstack-ansible | 10:26 | |
| noonedeadpunk | jrosser: it's ok if we don't mind service outage... But for placement I'd say it's better to do it serial | 10:26 |
| noonedeadpunk | btw, masakari s missing serial:( | 10:26 |
| noonedeadpunk | seems, like we need some cleanup and unification for playbooks as well... | 10:27 |
| jrosser | yes, QA time everwhere :) | 10:27 |
| jrosser | but thats good | 10:27 |
| openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-tests master: Update ansible to 2.8.2 https://review.opendev.org/659658 | 10:32 |
| noonedeadpunk | jrosser mnaser do you know where/how journalctl logs get colected and compressed in our CI? | 10:46 |
| *** luksky11 has joined #openstack-ansible | 10:47 | |
| jrosser | noonedeadpunk: https://github.com/openstack/openstack-ansible/blob/master/scripts/log-collect.sh#L113-L137 | 10:48 |
| *** luksky123 has joined #openstack-ansible | 10:48 | |
| *** nurdie has joined #openstack-ansible | 10:48 | |
| noonedeadpunk | thanks! | 10:49 |
| *** luksky11 has quit IRC | 10:52 | |
| *** nurdie has quit IRC | 10:53 | |
| *** namrata has quit IRC | 10:55 | |
| openstackgerrit | Dmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-galera_server master: Use systemd-journald instead of log files https://review.opendev.org/672059 | 11:02 |
| evrardjp | hello | 11:02 |
| noonedeadpunk | hi there:) how are you doing?:) | 11:03 |
| *** nurdie has joined #openstack-ansible | 11:09 | |
| *** nurdie has quit IRC | 11:14 | |
| *** kplant has joined #openstack-ansible | 11:16 | |
| *** spatel has joined #openstack-ansible | 11:20 | |
| *** spatel has quit IRC | 11:25 | |
| openstackgerrit | Dmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible master: [WIP] Drop creation of log directories https://review.opendev.org/671783 | 11:27 |
| *** ChipOManiac has quit IRC | 11:28 | |
| *** nurdie has joined #openstack-ansible | 11:30 | |
| *** nurdie has quit IRC | 11:35 | |
| *** vnogin has quit IRC | 11:38 | |
| *** ansmith has quit IRC | 11:41 | |
| *** nurdie has joined #openstack-ansible | 11:51 | |
| *** nurdie has quit IRC | 11:56 | |
| *** markvoelker has quit IRC | 11:58 | |
| *** namrata has joined #openstack-ansible | 11:59 | |
| *** udesale has quit IRC | 12:04 | |
| *** strobelight has quit IRC | 12:04 | |
| *** udesale has joined #openstack-ansible | 12:04 | |
| *** nurdie has joined #openstack-ansible | 12:11 | |
| Blinkiz | openstack-ansible setup-openstack.yml fails at [os_keystone : Add service project] with "keystoneauth1.exceptions.http.Unauthorized: The request you have made requires authentication. (HTTP 401)". https://paste.ubuntu.com/p/VJD2kN8c5w/ | 12:14 |
| Blinkiz | How can I troubleshoot this? | 12:14 |
| *** markvoelker has joined #openstack-ansible | 12:16 | |
| *** nurdie has quit IRC | 12:16 | |
| *** namrata has quit IRC | 12:24 | |
| *** goldyfruit has quit IRC | 12:26 | |
| *** nurdie has joined #openstack-ansible | 12:32 | |
| *** electrofelix has joined #openstack-ansible | 12:36 | |
| *** nurdie has quit IRC | 12:37 | |
| *** ansmith has joined #openstack-ansible | 12:37 | |
| *** namrata has joined #openstack-ansible | 12:38 | |
| *** luksky123 has quit IRC | 12:39 | |
| *** siqbal has joined #openstack-ansible | 12:48 | |
| *** nurdie has joined #openstack-ansible | 12:53 | |
| *** nurdie has quit IRC | 12:57 | |
| *** strattao has joined #openstack-ansible | 12:58 | |
| *** strobelight has joined #openstack-ansible | 13:06 | |
| *** nurdie has joined #openstack-ansible | 13:13 | |
| *** nurdie has quit IRC | 13:18 | |
| *** strattao has quit IRC | 13:20 | |
| *** openstackstatus has joined #openstack-ansible | 13:20 | |
| *** ChanServ sets mode: +v openstackstatus | 13:20 | |
| *** cshen has quit IRC | 13:22 | |
| *** nurdie has joined #openstack-ansible | 13:25 | |
| *** goldyfruit has joined #openstack-ansible | 13:35 | |
| *** tosky_ has joined #openstack-ansible | 13:40 | |
| *** tosky has quit IRC | 13:42 | |
| *** BlackDex has joined #openstack-ansible | 13:53 | |
| BlackDex | hello there. With the openstack dynamic inventory, is there a way to force a specific IP address as the accessIP(v4) ??? | 13:54 |
| BlackDex | now it seems to just pick the first one in the line (seems to be sorted by network id) | 13:55 |
| *** rpittau is now known as rpittau|afk | 14:03 | |
| *** tosky_ is now known as tosky | 14:08 | |
| *** nurdie_ has joined #openstack-ansible | 14:14 | |
| *** nurdie has quit IRC | 14:16 | |
| *** nurdie_ has quit IRC | 14:19 | |
| mnaser | BlackDex: you might wanna look/ask in #openstack-sdks | 14:20 |
| BlackDex | mnaser: oke, i will try it over there :) Thx for the pointer | 14:22 |
| *** gyee has joined #openstack-ansible | 14:23 | |
| *** vnogin has joined #openstack-ansible | 14:28 | |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/ansible-config_template master: Enhance the config_template comment parser https://review.opendev.org/672170 | 14:33 |
| *** TxGirlGeek has joined #openstack-ansible | 14:52 | |
| *** nurdie has joined #openstack-ansible | 14:58 | |
| *** miloa has quit IRC | 14:58 | |
| *** nurdie has quit IRC | 15:05 | |
| *** nurdie has joined #openstack-ansible | 15:06 | |
| *** vnogin has quit IRC | 15:10 | |
| *** trident has quit IRC | 15:18 | |
| *** namrata has quit IRC | 15:19 | |
| *** namrata has joined #openstack-ansible | 15:20 | |
| *** trident has joined #openstack-ansible | 15:20 | |
| *** vnogin has joined #openstack-ansible | 15:38 | |
| *** strattao has joined #openstack-ansible | 15:38 | |
| *** trident has quit IRC | 15:52 | |
| openstackgerrit | Merged openstack/openstack-ansible-lxc_hosts stable/stein: Fix copying apt keys from host to containers https://review.opendev.org/670126 | 15:55 |
| *** trident has joined #openstack-ansible | 15:55 | |
| mnaser | #startmeeting openstack_ansible_meeting | 16:01 |
| openstack | Meeting started Tue Jul 23 16:01:46 2019 UTC and is due to finish in 60 minutes. The chair is mnaser. Information about MeetBot at http://wiki.debian.org/MeetBot. | 16:01 |
| openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 16:01 |
| *** openstack changes topic to " (Meeting topic: openstack_ansible_meeting)" | 16:01 | |
| openstack | The meeting name has been set to 'openstack_ansible_meeting' | 16:01 |
| mnaser | #topic rollcall | 16:01 |
| *** openstack changes topic to "rollcall (Meeting topic: openstack_ansible_meeting)" | 16:01 | |
| mnaser | o/ | 16:01 |
| noonedeadpunk | o/ | 16:01 |
| namrata | o/ | 16:01 |
| guilhermesp | o/ | 16:02 |
| mnaser | hows everyone?! | 16:02 |
| jrosser | o/ | 16:02 |
| * guilhermesp fixes deployments | 16:02 | |
| mnaser | fun :) | 16:02 |
| mnaser | #topic office hours | 16:03 |
| *** openstack changes topic to "office hours (Meeting topic: openstack_ansible_meeting)" | 16:03 | |
| mnaser | personally | 16:03 |
| mnaser | https://review.opendev.org/#/c/671783/ | 16:03 |
| mnaser | i love the -392 part :D | 16:04 |
| guilhermesp | it is lot :P | 16:04 |
| noonedeadpunk | So I was thinking about dropping os-log-dir-setup.yml and rsyslog client in terms of this | 16:04 |
| guilhermesp | seems that we started the work of cleaning up things | 16:04 |
| mnaser | yeah i think at this point rsyslog_client wont really do much if we never run it | 16:05 |
| mnaser | i would even retire rsyslog_server unless omeone wants to maintain it | 16:05 |
| noonedeadpunk | but since it's still used by ceph, unbound and things like tempest, rally and utility container... | 16:05 |
| mnaser | utility needs rsyslog? o_O | 16:05 |
| *** Blinkiz has quit IRC | 16:05 | |
| noonedeadpunk | not rsyslog but os-log-dir-setup.yml | 16:06 |
| mnaser | ahhh ok | 16:06 |
| mnaser | this is the thing that does bind mounts right? | 16:06 |
| noonedeadpunk | I mixed up things a bit:( | 16:06 |
| noonedeadpunk | yep | 16:06 |
| mnaser | i was always wondering why we just didn't log things inside the container and kills all those complicated bind mounts | 16:06 |
| jrosser | it probably historical so you can just collect up whatever is in /openstack/logs/* and not worry about which containers you have | 16:08 |
| noonedeadpunk | probably for compressing without entering container | 16:08 |
| spotz | I thought it was so we could find everything in one place? | 16:08 |
| noonedeadpunk | but since integrated test, which are actually metal ones, everything is already in one place | 16:09 |
| evrardjp | o/ | 16:10 |
| spotz | evrardjp!!!! | 16:10 |
| evrardjp | spotz: ! :) | 16:10 |
| evrardjp | mnaser: love the - in -392 | 16:11 |
| *** vnogin has quit IRC | 16:11 | |
| cjloader | o/ | 16:12 |
| evrardjp | mnaser: yes, historical. I would prefer removing all the complex bind mounts too, as this was a pain to deal with. Cleaning this up would also simplify the code further | 16:12 |
| *** Pilou has quit IRC | 16:13 | |
| jrosser | there is something that collects container journals on the host anyway isnt there? | 16:13 |
| noonedeadpunk | so, the thing is that we don't need that almost anywhere, ecept 3 playbooks | 16:13 |
| jrosser | so moving to all journals this is now of little point to keep the bind mounts | 16:14 |
| mnaser | yeah i agree with all of this so maybe it would be a good clean up | 16:14 |
| mnaser | btw also knock on wood our CI has been relatively stable recently | 16:14 |
| mnaser | im pretty happy on where it is | 16:14 |
| mnaser | the upgrade jobs need work unfortunately | 16:15 |
| evrardjp | yeah. | 16:15 |
| evrardjp | we've decreased coverage though :( | 16:15 |
| evrardjp | if ppl want to help on increasing coverage, I have plenty of ideas, so little time. | 16:16 |
| jrosser | evrardjp: ^ can you define what you mean by that, as there several different things | 16:16 |
| *** vnogin has joined #openstack-ansible | 16:17 | |
| evrardjp | well I think the first thing to do is to match what we removed -- so define new "specific" jobs having a pre-run play configuring the o_u_c or user_variables, to get feature parity back | 16:18 |
| evrardjp | then I guess the idea would be to implement multi-node jobs in periodics | 16:18 |
| noonedeadpunk | Yeah, since we might be missing system packages in roles | 16:20 |
| noonedeadpunk | we won't catch this if they are already installed by previous role | 16:20 |
| mnaser | would we get coverage again if we run both container and metal on every change? | 16:21 |
| mnaser | i mean im not opposed to it but we need to figure out why centos takes stupid long with lxc | 16:21 |
| mnaser | its like 2h20 to run aio | 16:21 |
| jrosser | i would like to see haproxy back in some form | 16:21 |
| mnaser | yes with the bind-to-mgmt stuff you're doing | 16:22 |
| mnaser | it'll be running fine | 16:22 |
| jrosser | the curent metal jobs are fast but they are not sufficiently real life | 16:22 |
| jrosser | i'm a bit stuck on the galera stuff there | 16:22 |
| mnaser | jrosser: its odd that it just works for us, i can try to help with looking that the fails | 16:25 |
| mnaser | did you end up doig the my.cnf adjustments? | 16:25 |
| jrosser | i did, and it's inconsistent | 16:25 |
| jrosser | heres the change for the client my.cnf https://review.opendev.org/#/c/672101/ | 16:26 |
| mnaser | jrosser: lol | 16:26 |
| mnaser | you're gonna hhate me | 16:26 |
| mnaser | jrosser: check the review :p | 16:26 |
| jrosser | i figured i may have messed it up | 16:26 |
| noonedeadpunk | yeah | 16:27 |
| jrosser | aaaaaahhhhhh crap :) | 16:27 |
| jrosser | thankyou :) | 16:27 |
| * jrosser fixes | 16:27 | |
| openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-galera_client master: Default to connecting clients via ip rather than local socket https://review.opendev.org/672101 | 16:28 |
| mnaser | so that should hopefully help | 16:28 |
| evrardjp | mnaser: it won't be enough, and I didn't intent to run centos+lxc :) | 16:28 |
| mnaser | evrardjp: well i figured we'd run all the oeprating systems we cover | 16:29 |
| evrardjp | I just wanted to have like mariadb cluster testing + keystone and stop there | 16:29 |
| mnaser | that probably can be wired up in logic | 16:30 |
| evrardjp | we already have all we need | 16:30 |
| mnaser | ye sbut writing the 'dependency' system | 16:30 |
| evrardjp | just change affinity | 16:30 |
| evrardjp | what do you mean? | 16:30 |
| mnaser | when testing os_keystone then grab what services need os_keystone (i.e. galera memcache etc) | 16:31 |
| evrardjp | the idea to not run centos+lxc was just to have scenarios (ubuntu +lxc is the most frequent one) | 16:31 |
| mnaser | when testing os_nova then grab its dependnecies which are os_neutron,os_keystone,os_glance | 16:31 |
| mnaser | whos dependencies are.. etc | 16:31 |
| mnaser | to reduce our run times | 16:31 |
| evrardjp | that's kinda what's done in tests/role/bootstrap | 16:31 |
| evrardjp | but I understand it would be smarter if we do it that way | 16:32 |
| evrardjp | I thought this could be done using a CLI :) | 16:32 |
| mnaser | mhmm | 16:32 |
| mnaser | i think we should have full coverage, if we do aio_lxc, we do it for all supproted systems | 16:32 |
| evrardjp | just encapsulate the logic there, instead of relying on so many conditionals in ansible | 16:32 |
| mnaser | imho we either do it or drop it | 16:32 |
| mnaser | or otherwise we'll get a change that breaks ar ole for centos that wont be caught there | 16:32 |
| mnaser | and then itll be broken in integrated | 16:33 |
| evrardjp | I meant to keep centos for baremetal, so it would still be tested. Just keeping the most common use cases | 16:33 |
| *** vnogin has quit IRC | 16:33 | |
| evrardjp | but I understand your point | 16:33 |
| *** vnogin has joined #openstack-ansible | 16:34 | |
| mnaser | i feel like with a little bit more efort we'd understand the fundamnetal reason of why centos is sooooo slow | 16:34 |
| mnaser | i think we've regressed something | 16:34 |
| mnaser | it never took this long before | 16:34 |
| jrosser | the data is all there in the ARA reports / db | 16:35 |
| jrosser | to decide if its specific things that are slow, or it's just across the board | 16:35 |
| mnaser | across the board | 16:35 |
| mnaser | every operation is slower | 16:35 |
| *** vnogin has quit IRC | 16:35 | |
| mnaser | like 3-4x slower | 16:35 |
| mnaser | even simple things | 16:35 |
| jrosser | does that still stand outside CI? | 16:36 |
| noonedeadpunk | Our connection module affects? | 16:36 |
| *** jamesdenton has quit IRC | 16:36 | |
| mnaser | i havent tried outside CI, i thougth about our connection moduel but figured it would regress in both OSes? | 16:36 |
| *** jamesdenton has joined #openstack-ansible | 16:36 | |
| jamesdenton | o/ | 16:36 |
| mnaser | bonjour | 16:36 |
| jamesdenton | i've been talking on IRC for like, at least a week, and just realized nothing was going thru | 16:37 |
| mnaser | lolol | 16:37 |
| jamesdenton | my feelings were hurt for a bit | 16:37 |
| jamesdenton | lol | 16:37 |
| mnaser | yeah i dont know | 16:38 |
| mnaser | for the centos stuff | 16:38 |
| mnaser | it deffo needs some profiling | 16:38 |
| mnaser | it'd be nice to get to nspawn and not have to deal with that but | 16:39 |
| jrosser | we bit too much off there in one go | 16:39 |
| mnaser | yea macvlan+nspawn together is a lot | 16:39 |
| jrosser | nspawn + macvlan is too much | 16:39 |
| jrosser | yes | 16:39 |
| mnaser | bridge+nspawn is easier to cosnume but i dunno if i have the current cycles to help with it | 16:40 |
| *** vnogin has joined #openstack-ansible | 16:40 | |
| jrosser | i think there may be (was?) a limitation with nspawn and the number of interfaces you could create | 16:40 |
| jrosser | evrardjp: did you do some work on ansible profiling? | 16:41 |
| evrardjp | long ago | 16:41 |
| evrardjp | dw is better :D | 16:41 |
| jrosser | i was just looking for dw but he's not in #mitogen | 16:41 |
| jrosser | don't want to waste a bunch of time learning 10 wrong tools when someon can just say "do this" | 16:42 |
| evrardjp | that reminds me I need to connect on that channel since I reconfigured my bouncer | 16:42 |
| evrardjp | jrosser: totally | 16:42 |
| evrardjp | just wait for him, last time he was super helpful to me | 16:42 |
| evrardjp | maybe ping him on twitter? | 16:42 |
| jrosser | done | 16:45 |
| chandankumar | cloudnull: jrosser needs +w on this https://review.opendev.org/#/c/672225/ | 16:46 |
| mnaser | so we'll keep improving and cleaning up things, journald seems to be cleaning up well | 16:46 |
| cloudnull | chandankumar done | 16:47 |
| chandankumar | cloudnull: thanks :-) | 16:47 |
| mnaser | OH | 16:47 |
| mnaser | also | 16:48 |
| mnaser | did y'all see my email to the ML | 16:48 |
| mnaser | about openstack-ansible-collab | 16:48 |
| guilhermesp | hectic days, just saw an email around, but I will take a look | 16:48 |
| jamesdenton | Just a heads up, but the unicast flood issue that was brought up last week is related to change in os-vif introduced in Stein. See: https://bugs.launchpad.net/os-vif/+bug/1837252. | 16:50 |
| openstack | Launchpad bug 1837252 in neutron "IFLA_BR_AGEING_TIME of 0 causes flooding across bridges" [Undecided,Incomplete] | 16:50 |
| jrosser | chandankumar: did you find a solution with your tempest undefined var? | 16:50 |
| mnaser | jamesdenton: affecting lxb only? | 16:51 |
| chandankumar | jrosser: above changes worked https://review.opendev.org/#/c/672231/ here, But I need to come up with a better solution | 16:51 |
| jamesdenton | it affects the qbr bridges, too, with OVS. Just not sure what the overall effect is there | 16:51 |
| chandankumar | it might happening due to mixing of venv and distro stuff | 16:51 |
| chandankumar | jrosser: sorry wrong review | 16:52 |
| chandankumar | jrosser: https://review.opendev.org/#/c/667219/ | 16:52 |
| jrosser | evrardjp: word according to dw "'perf record -g ansible-playbook ...' of the ansible run /and/ separately on the host using simply 'perf record' followed by 'perf report' might show something obvious" | 16:57 |
| *** vnogin has quit IRC | 16:57 | |
| *** siqbal90 has joined #openstack-ansible | 16:57 | |
| jrosser | namrata: did you want to ask about upgrades? | 16:57 |
| namrata | yeah I was waiting for open discussion | 16:58 |
| evrardjp | jrosser: oh yeah that rings me a bell :) | 16:58 |
| namrata | Hi would like to contribute to openstack ansible and I can start with the issue which I faced while upgrading R->S i.e upgrading WSREP SST method from xtrabackup-v2 to mariabackup. | 16:58 |
| jrosser | namrata: just ask :) | 16:58 |
| *** siqbal has quit IRC | 16:58 | |
| evrardjp | jrosser: could it be the fact we just added all those plays, and maybe there is cruft in the inventory? | 16:59 |
| evrardjp | I haven't checked tbh | 16:59 |
| namrata | jrosser suggested to take this up in the meeting so we can discuss how to handle it | 16:59 |
| jrosser | mnaser: ^ so for fixing up the R-S upgrade for galera, do we make patches to master? i wasnt totally clear where we do that | 16:59 |
| jrosser | evrardjp: ^ maybe you can advise too | 16:59 |
| evrardjp | well, is S-master broken too? | 17:00 |
| jrosser | if you start on S you are already on the new replication method | 17:00 |
| evrardjp | ok | 17:00 |
| evrardjp | so it's S upgrade only, so it's only implementable in stein | 17:00 |
| evrardjp | you got your answer ? :p | 17:01 |
| jrosser | i guess it's made more complicated by not having a working R-S upgrade CI job :/ | 17:01 |
| jrosser | well, unless we do, of course | 17:01 |
| *** siqbal90 has quit IRC | 17:02 | |
| mnaser | yeah stable only patch | 17:02 |
| namrata | okay so I should push to stable/stein then | 17:02 |
| jrosser | namrata: ok so that sounds like your answer, write something that goes onto stable/stein | 17:02 |
| namrata | jrosser thanks | 17:03 |
| jrosser | and thanks for taking the time to fix it up :) | 17:03 |
| namrata | :] | 17:03 |
| *** udesale has quit IRC | 17:03 | |
| *** trident has quit IRC | 17:07 | |
| *** chandankumar is now known as raukadah | 17:08 | |
| *** trident has joined #openstack-ansible | 17:10 | |
| *** cshen has joined #openstack-ansible | 17:12 | |
| mnaser | #endmeeting | 17:15 |
| *** openstack changes topic to "Launchpad: https://launchpad.net/openstack-ansible || Weekly Meetings: https://wiki.openstack.org/wiki/Meetings/openstack-ansible || Review Dashboard: http://bit.ly/2xA1eZC" | 17:15 | |
| openstack | Meeting ended Tue Jul 23 17:15:41 2019 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 17:15 |
| openstack | Minutes: http://eavesdrop.openstack.org/meetings/openstack_ansible_meeting/2019/openstack_ansible_meeting.2019-07-23-16.01.html | 17:15 |
| openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/openstack_ansible_meeting/2019/openstack_ansible_meeting.2019-07-23-16.01.txt | 17:15 |
| openstack | Log: http://eavesdrop.openstack.org/meetings/openstack_ansible_meeting/2019/openstack_ansible_meeting.2019-07-23-16.01.log.html | 17:15 |
| strattao | Hope all is well with you guys! | 17:16 |
| *** cshen has quit IRC | 17:16 | |
| strattao | We’re having some issues with one of our deployment regions. Rabbit seems to be handling the nova queues just fine, but is stumbling over the neutron queues and we’re getting network timeouts, etc. | 17:17 |
| openstackgerrit | Sorin Sbarnea proposed openstack/openstack-ansible-os_tempest master: POC: running openstack-tox-molecule https://review.opendev.org/672333 | 17:19 |
| openstackgerrit | Sorin Sbarnea proposed openstack/openstack-ansible-os_tempest master: POC: running openstack-tox-molecule https://review.opendev.org/672333 | 17:19 |
| strattao | I was wondering if anyone has a writeup with some best practices for large-scale deployments, worker tunings, etc.? We are looking at adding additional neutron nodes to handle the load. Any recommendations or experiences to share? maybe jrosser or jamesdenton got some insights? | 17:20 |
| jrosser | strattao: one of my team went to this https://indico.cern.ch/event/776411/timetable/#20190527 | 17:23 |
| jrosser | and said that some of the talks were about larger scales and what you need to do to achieve that | 17:24 |
| jrosser | the pdf are all there to look through | 17:29 |
| strattao | yeah, some guy named mnasser even has a walkthrough with examples - I wish all talks had that level of detail! | 17:30 |
| strattao | mnaser* | 17:30 |
| strattao | so, our general approach of just more api workers & more network nodes until the workload is handled, is that the process when you start working at scale? | 17:32 |
| jrosser | well scale means different things in different contexts, i don't have particularly many nodes but have lots of throughput network wise | 17:34 |
| strattao | do you have standalone network nodes? what about standalone rabbit? | 17:36 |
| jrosser | so I split the network nodes out from day 1 | 17:36 |
| strattao | Our infrastructure looks just like this right now: https://docs.openstack.org/project-deploy-guide/openstack-ansible/pike/app-config-prod.html | 17:36 |
| jrosser | the one i build next will have 4 on day one rather than 2, and 20 cores in each | 17:36 |
| strattao | but we are using ovs+dvr | 17:37 |
| strattao | how many api workers? rabbit pool connections? | 17:38 |
| jrosser | just the OSA defaults, like i say i expect we are running into different limits first | 17:38 |
| mnaser | i have a walkthrough? :p | 17:38 |
| strattao | yeah, look at this beautiful presentation! https://indico.cern.ch/event/776411/contributions/3345183/attachments/1851624/3039917/02_-_vGPUs_with_OpenStack_-_Accelerating_Science.pdf | 17:39 |
| strattao | vGPUs are in our future and this is super helpful! | 17:39 |
| mnaser | :D | 17:40 |
| jrosser | strattao: in very general terms if you have a lot of CPU load from "network stuff" it makes sense to run the neutron agents on dedicated hardware at some point so your users don't DOS your control plane | 17:40 |
| jrosser | and similarly rabbit sits at the other end of the scale, Sanger Institute recommended dedicated hardware for that as its so critical/potentially fragile | 17:41 |
| jrosser | so you have to take a judgment based on how stuff is working out under your workload | 17:42 |
| jrosser | mnaser: you need licences for nvidia vgpu? | 17:46 |
| mnaser | yep | 17:46 |
| mnaser | nvidia grid | 17:46 |
| jrosser | hmm bummer | 17:47 |
| jrosser | they make it expensive | 17:47 |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/ansible-config_template master: Enhance the config_template comment parser https://review.opendev.org/672170 | 17:49 |
| *** namrata has quit IRC | 17:51 | |
| *** nurdie has quit IRC | 18:03 | |
| openstackgerrit | Merged openstack/openstack-ansible-os_octavia stable/stein: Ensure that admin endpoint is used to configure octavia quota https://review.opendev.org/668369 | 18:04 |
| *** nurdie has joined #openstack-ansible | 18:05 | |
| *** poopcat has joined #openstack-ansible | 18:08 | |
| *** vnogin has joined #openstack-ansible | 18:16 | |
| *** nurdie has quit IRC | 18:18 | |
| cloudnull | ^ if folks have a minute to give https://review.opendev.org/672170 a review I'd greatly appreciate it -cc jrosser | 18:21 |
| *** strattao has quit IRC | 18:26 | |
| *** strattao has joined #openstack-ansible | 18:46 | |
| *** strattao has quit IRC | 18:47 | |
| grabes | jamesdenton: Thanks for your work on this: https://bugs.launchpad.net/os-vif/+bug/1837252 | 18:56 |
| openstack | Launchpad bug 1837252 in os-vif "IFLA_BR_AGEING_TIME of 0 causes flooding across bridges" [High,Confirmed] - Assigned to sean mooney (sean-k-mooney) | 18:56 |
| *** strattao has joined #openstack-ansible | 18:57 | |
| jamesdenton | happy to help | 19:01 |
| *** goldyfruit has quit IRC | 19:02 | |
| *** goldyfruit has joined #openstack-ansible | 19:06 | |
| openstackgerrit | Vadim Kuznetsov proposed openstack/openstack-ansible-os_octavia master: Updated certificate distribution task https://review.opendev.org/657662 | 19:06 |
| *** kopecmartin is now known as kopecmartin|off | 19:16 | |
| *** vnogin has quit IRC | 19:18 | |
| *** cshen has joined #openstack-ansible | 19:21 | |
| *** vnogin has joined #openstack-ansible | 19:26 | |
| *** cshen has quit IRC | 19:33 | |
| openstackgerrit | Vadim Kuznetsov proposed openstack/openstack-ansible-os_octavia master: Fixed octavia-health-manager group name https://review.opendev.org/672347 | 19:42 |
| *** tosky has quit IRC | 19:47 | |
| *** kplant has quit IRC | 19:54 | |
| *** allanb has joined #openstack-ansible | 19:54 | |
| *** jsquare has quit IRC | 20:03 | |
| *** jsquare has joined #openstack-ansible | 20:05 | |
| *** vnogin has quit IRC | 20:11 | |
| *** ansmith has quit IRC | 20:42 | |
| *** pcaruana has quit IRC | 20:50 | |
| *** vnogin has joined #openstack-ansible | 21:16 | |
| *** irclogbot_2 has quit IRC | 21:32 | |
| *** altlogbot_0 has quit IRC | 21:33 | |
| *** altlogbot_1 has joined #openstack-ansible | 21:33 | |
| *** irclogbot_2 has joined #openstack-ansible | 21:33 | |
| *** vnogin has quit IRC | 21:39 | |
| *** strattao has quit IRC | 21:45 | |
| *** strobelight has quit IRC | 21:47 | |
| *** irclogbot_2 has quit IRC | 21:59 | |
| *** altlogbot_1 has quit IRC | 22:01 | |
| openstackgerrit | Vadim Kuznetsov proposed openstack/openstack-ansible-os_octavia master: Updated certificate distribution task https://review.opendev.org/657662 | 22:04 |
| *** ansmith has joined #openstack-ansible | 22:18 | |
| *** altlogbot_1 has joined #openstack-ansible | 22:21 | |
| *** gyee has quit IRC | 22:23 | |
| *** TxGirlGeek has quit IRC | 22:25 | |
| *** altlogbot_1 has quit IRC | 22:27 | |
| *** goldyfruit has quit IRC | 22:30 | |
| *** goldyfruit has joined #openstack-ansible | 22:30 | |
| *** goldyfruit has quit IRC | 22:38 | |
| *** gyee has joined #openstack-ansible | 23:10 | |
| *** altlogbot_0 has joined #openstack-ansible | 23:13 | |
| *** altlogbot_0 has quit IRC | 23:19 | |
| *** altlogbot_0 has joined #openstack-ansible | 23:27 | |
| *** irclogbot_3 has joined #openstack-ansible | 23:31 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!