*** spatel_ has joined #openstack-ansible | 00:57 | |
*** spatel_ is now known as spatel | 00:57 | |
*** spatel has quit IRC | 02:02 | |
*** evrardjp has quit IRC | 02:33 | |
*** evrardjp has joined #openstack-ansible | 02:33 | |
*** ChipOManiac has joined #openstack-ansible | 03:56 | |
ChipOManiac | @noon | 04:11 |
---|---|---|
ChipOManiac | Oh for crissakes... | 04:11 |
ChipOManiac | noonedeadpunk So I using the specific Git branch when deploying Masakari with OpenStack-Ansible. Good news is that it finally does get the nodes from "compute service list", bad news is that it now attempts to used the resolved IP address of the hostname *as a hostname* and errors out. -_- | 04:13 |
ChipOManiac | At least that's what it looks like. | 04:13 |
*** shyamb has joined #openstack-ansible | 06:16 | |
noonedeadpunk | um.... | 06:43 |
noonedeadpunk | so in compute service list you have ip addresses now??? | 06:44 |
*** shyamb has quit IRC | 06:56 | |
*** shyamb has joined #openstack-ansible | 07:08 | |
*** rpittau|afk is now known as rpittau | 07:19 | |
*** tosky has joined #openstack-ansible | 07:50 | |
*** shyamb has quit IRC | 07:56 | |
*** ChipOManiac has quit IRC | 07:58 | |
*** sshnaidm|off is now known as sshnaidm | 08:12 | |
*** ChipOManiac has joined #openstack-ansible | 08:27 | |
ChipOManiac | noonedeadpunk no, but somehow the error from masakari tells me that its trying to resolve an IP address instead of a hostname. | 08:28 |
noonedeadpunk | can you paste it with tstack trace? | 08:29 |
*** shyamb has joined #openstack-ansible | 08:31 | |
ChipOManiac | noonedeadpunk Yes. The scenario was I made the segments and added the hosts, the did a pkill -KILL of the qemu-system process to simulate a down. The other one was doing a link down of the network interfaces for management and storage (on a VPN so can't disconnect physically). | 08:46 |
noonedeadpunk | Well eventually masakari monitors have 3 parts - instance monitor, process monitor and host monitor. Killing process might trigger only process monitor in case it's configured to check for existance of the specific process | 08:49 |
noonedeadpunk | which is not smth set by default by osa | 08:49 |
*** shyamb has quit IRC | 08:49 | |
*** shyamb has joined #openstack-ansible | 08:49 | |
ChipOManiac | Of course, in this case the instancemonitor understood that the process was down. Putting the stack trace and stuff into a paste bin now. | 08:50 |
noonedeadpunk | bringing link down should actually cause node failover, since then hostmonitor is triggered. as that's when pacemaker marks node as down and masakari hostmnitor listen on the interface for actions that happen | 08:50 |
noonedeadpunk | So eventually you need to check if your pacemaker cluster is healthy (ie with `crm_mon -1`) and what's going on the masakari monitors journald | 08:51 |
noonedeadpunk | As I don't really understand what happens there workflow wise and where it fails with what issue | 08:52 |
ChipOManiac | Nothing wrong with the Pacemaker/Corosync cluster, I had to set on up anyway to get LINSTOR to HA. :) The journald output for instancemonitor is the one with said error. | 08:53 |
noonedeadpunk | so, instancemonitor check up for instance ha specifically. so when it detects instance is down, it tries to evacuate it or reboot. Eventually, I haven't tried this one too much, as was more interested in whole nodes failures rather than in single instance | 08:56 |
noonedeadpunk | But would be aesome to see stack trace with error | 08:56 |
ChipOManiac | Still trying to get you that stack trace. :) | 09:00 |
*** gokhani has joined #openstack-ansible | 09:03 | |
gokhani | Hi folks, when I install cinder service on OSA 22.1.0 I am getting 'AnsibleUnicode' object has no attribute 'items' error. May be this bug resolved in new tags. http://paste.openstack.org/show/804916/ | 09:05 |
gokhani | I defined 2 cinder backends > http://paste.openstack.org/show/804917/ | 09:07 |
ChipOManiac | noonedeadpunk http://paste.openstack.org/show/804918/ there's the paste. | 09:09 |
noonedeadpunk | um, and what's crm_mon -1 ? | 09:11 |
noonedeadpunk | gokhani: and how you've used cinder_backends ? | 09:14 |
gokhani | noonedeadpunk, http://paste.openstack.org/show/804917/ | 09:15 |
noonedeadpunk | gokhani: well, I mean cinder_backends are supposed to be as a part of the `container_vars` https://opendev.org/openstack/openstack-ansible/src/branch/master/etc/openstack_deploy/openstack_user_config.yml.pod.example#L467-L506 | 09:16 |
*** luksky has joined #openstack-ansible | 09:16 | |
gokhani | noonedeadpunk, ok got it :) I have defined cinder_backends in user_variables.yml file. | 09:18 |
noonedeadpunk | what I did to repeat code less: http://paste.openstack.org/show/804919/ | 09:19 |
noonedeadpunk | ChipOManiac: I kind of suspect, that in pacemaker/corosync nodes are added by IP? | 09:20 |
ChipOManiac | Yes they are. Is that the problem? <facepalm> | 09:20 |
noonedeadpunk | as node names must match in corosync and compute service lsit | 09:21 |
gokhani | thanks a lot noonedeadpunk :) | 09:21 |
noonedeadpunk | as hostmonitor listens to corosync, finds that node is down, and the only identifier it has is node name from pacemaker custer | 09:21 |
noonedeadpunk | and it assumes that it's the name that should be in nova as well | 09:21 |
ChipOManiac | noonedeadpunk Aigoo. Well, I'll change that and get back to you ASAP. Thanks for the help so far, you've been very helpful. :) | 09:22 |
noonedeadpunk | so as ring0_addr in corosync.conf you should have an IP of interface (ie mgmt) and name match hostname and what's in compute servce list | 09:23 |
admin0 | morning .. checking if anyone has done stein in focal .. so that xenial -> focal upgrade bypassing bionic | 09:23 |
noonedeadpunk | (that's the default role behaviour for me for some reason) | 09:23 |
noonedeadpunk | stein on focal is not working | 09:24 |
noonedeadpunk | we added focal in U iirc | 09:24 |
admin0 | ok .. at what point/tag is bionic -> focal upgrade recommended | 09:24 |
noonedeadpunk | bionic still supported. We drop it in Xena only | 09:24 |
admin0 | aah .. long life :) | 09:24 |
noonedeadpunk | yeah :) don't want to upgrade haha | 09:25 |
*** jbadiapa has joined #openstack-ansible | 09:25 | |
ChipOManiac | noonedeadpunk Okay, that is the way it is actually, I thought you needed to use the hostname instead of the ip address. | 09:25 |
noonedeadpunk | But probably V is most suitable for upgrade... | 09:25 |
ChipOManiac | The names are the same as what shows up on compute service list | 09:26 |
noonedeadpunk | ChipOManiac: oh, no.... | 09:26 |
ChipOManiac | noonedeadpunk Its basically | 09:28 |
ChipOManiac | node { | 09:28 |
ChipOManiac | ring0_addr: 192.168.51.10 | 09:28 |
ChipOManiac | name: kalmyk1 | 09:28 |
ChipOManiac | nodeid: 10 | 09:28 |
ChipOManiac | } | 09:28 |
ChipOManiac | for each node. | 09:28 |
noonedeadpunk | yeah, looks correct | 09:28 |
noonedeadpunk | I wonder if it's jsut instancemonitor that's broken somehow.... | 09:29 |
ChipOManiac | I thought you meant to make it to ring0_addr: hn-1.openstack.local. | 09:29 |
noonedeadpunk | no-no, ring0_addr is correct for you | 09:29 |
noonedeadpunk | have you checked hostmonitor as well? | 09:29 |
ChipOManiac | Yes. Says everything is normal, shows the other two nodes as well as up. | 09:30 |
noonedeadpunk | and shows them by name? | 09:30 |
ChipOManiac | Initially wasn't working because I used the wrong network interface. | 09:31 |
ChipOManiac | Yes shows by name. | 09:31 |
ChipOManiac | kalmyk1 is 'online' (current: 'online') etc. | 09:31 |
noonedeadpunk | hm... this looks like instancemonitor specific issue to me... | 09:32 |
ChipOManiac | Python issue? | 09:32 |
noonedeadpunk | oh https://opendev.org/openstack/masakari-monitors/commit/85dda1b0ebab75a8f9997a616cf1a759cad79558 | 09:32 |
ChipOManiac | Host is set in the config as the IP address. | 09:34 |
ChipOManiac | As OSA did. | 09:34 |
ChipOManiac | Should that be changed to the hostname? | 09:34 |
noonedeadpunk | oh, yeah, that might be the issue! | 09:34 |
ChipOManiac | Let's see. | 09:34 |
noonedeadpunk | can you try replacing `ansible_host` with smth like `inventory_hostname`? | 09:34 |
noonedeadpunk | or better `ansible_facts['hostname']`? | 09:35 |
noonedeadpunk | here https://opendev.org/openstack/openstack-ansible-os_masakari/src/branch/master/templates/masakarimonitors.conf.j2#L2 | 09:35 |
*** shyam89 has joined #openstack-ansible | 09:35 | |
noonedeadpunk | or probably better to add another option there... | 09:36 |
noonedeadpunk | which will be `hostname = {{ ansible_facts['hostname'] }}` | 09:36 |
ChipOManiac | Sure. I just edited it manually now to see if it works. | 09:37 |
ChipOManiac | And restarted the service. | 09:37 |
ChipOManiac | But I'll go ahead and do it ansible-wise. | 09:37 |
*** shyamb has quit IRC | 09:38 | |
*** luksky has quit IRC | 09:47 | |
openstackgerrit | Merged openstack/openstack-ansible-os_horizon stable/victoria: Install adjutant-ui when the adjutant service is deployed https://review.opendev.org/c/openstack/openstack-ansible-os_horizon/+/788611 | 09:52 |
noonedeadpunk | ChipOManiac: yeah would be awesome to patch that | 09:58 |
*** shyam89 has quit IRC | 10:01 | |
*** shyam89 has joined #openstack-ansible | 10:02 | |
noonedeadpunk | anyway dunno why it picks up IP as `hostname = CONF.hostname or socket.gethostname()` - so should default to hostname anyway... | 10:04 |
ChipOManiac | noonedeadpunk I guess I'll post an issue on Github. I've also noticed that the libvirt development packages, and the python development packages aren't installed by openstack-ansible-masakari. Should I add those too? | 10:05 |
ChipOManiac | I think that's because the entry was host: instead of host: and hostname: | 10:05 |
ChipOManiac | I saw an OSLO warning complaining about host being deprecated. | 10:05 |
noonedeadpunk | I think they are? https://opendev.org/openstack/openstack-ansible-os_masakari/src/branch/master/vars/debian.yml#L23 | 10:06 |
ChipOManiac | Either way I added both host: and hostname: to the ansible masakari.conf template. | 10:06 |
ChipOManiac | Odd, I had to manually install those. | 10:07 |
noonedeadpunk | oh, so you had to install them on computes? | 10:07 |
ChipOManiac | Yes. | 10:07 |
noonedeadpunk | hm, I actually thought it's required only to build package, but not to operate | 10:09 |
noonedeadpunk | it's playbook failed with some error or there was issue in log of the monitors? | 10:09 |
ChipOManiac | Well the issue happens at 'building wheels" or something. | 10:10 |
noonedeadpunk | huh, that's weird indeed. as it's not supposed to run against compute hosts at all | 10:10 |
noonedeadpunk | it's supposed to be delegated to repo container | 10:11 |
ChipOManiac | Yes. | 10:11 |
ChipOManiac | Any idea of where I can get a list of properties that can be applied to instances (eg. making them HA). | 10:11 |
ChipOManiac | ? | 10:11 |
gokhani | noonedeadpunk, I am getting rbd incomplete errors with glance + ceph like this bug definition. https://bugs.launchpad.net/glance/+bug/1916482 . Do we need to do anything on haproxy side ? | 10:14 |
openstack | Launchpad bug 1916482 in Glance "rbd.IncompleteWriteError: RBD incomplete write (Wrote only 8388608 out of 8394566 bytes) since Victoria Upgrade, ceph v nautilus" [Undecided,New] | 10:14 |
noonedeadpunk | ChipOManiac: I think it's not documented | 10:15 |
ChipOManiac | Ahwell. Too bad. | 10:15 |
ChipOManiac | The entry to make an instance HA for Masakari is HA_Enabled is correct however? | 10:16 |
noonedeadpunk | iirc if you want to explicitly enable/didable that there was some tag required in the metadata of the instance ie ha_enabled or smth like that... | 10:16 |
ChipOManiac | Does case matter here? | 10:17 |
noonedeadpunk | I don't think it's exact tag... | 10:17 |
ChipOManiac | Because I just did an interface down, and it didn't move the instance. | 10:17 |
ChipOManiac | It does however get the node right. So thanks for that. :) | 10:17 |
noonedeadpunk | so you set it to the hostname? | 10:18 |
ChipOManiac | I set both. The host and the hostname. | 10:18 |
ChipOManiac | So: | 10:18 |
ChipOManiac | host: 192.168.50.X | 10:18 |
ChipOManiac | hostname: kalmykX | 10:19 |
ChipOManiac | The OSLO complaint has disappeared. | 10:19 |
noonedeadpunk | yeah, I think host is not needed nowadays indeed | 10:20 |
ChipOManiac | I just left it as is. Anyway, thank you for helping me fix that. :) | 10:21 |
*** shyam89 has quit IRC | 10:40 | |
openstackgerrit | Dmitriy Rabotyagov proposed openstack/openstack-ansible-os_masakari master: Allow to configure corosync ports https://review.opendev.org/c/openstack/openstack-ansible-os_masakari/+/789241 | 10:42 |
noonedeadpunk | gokhani: hm, that's interesting read... | 10:43 |
noonedeadpunk | not sure atm | 10:43 |
noonedeadpunk | I'm wondering if just disabling uwsgi for glance and using native service will work better for you | 10:45 |
noonedeadpunk | ie setting `glance_use_uwsgi: false` | 10:45 |
gokhani | noonedeadpunk, you are awesome, thanks:) It could be good for disabling uwsgi when use gilance with ceph | 10:47 |
noonedeadpunk | setting mode to tcp for http backed client, dunno | 10:47 |
noonedeadpunk | sounds like pretty nasty workaround as well | 10:48 |
noonedeadpunk | I'm not sure if disabling uwsgi will actually help - worth checking though | 10:48 |
gokhani | noonedeadpunk, yes I changed mode to tcp | 10:48 |
gokhani | I think we are getting these errors when upload large images | 10:48 |
*** dave-mccowan has joined #openstack-ansible | 10:55 | |
*** jbadiapa has quit IRC | 10:57 | |
gokhani | noonedeadpunk, after changing mode from http to tcp, it worked. Now ı can upload images to ceph. | 10:57 |
gokhani | In glance docs, it says uWSGI Server HTTP Mode has never worked properly > https://docs.openstack.org/glance/victoria/admin/apache-httpd.html | 11:05 |
openstackgerrit | Dmitriy Rabotyagov proposed openstack/openstack-ansible-os_masakari master: Replace deprecated host param for monitors https://review.opendev.org/c/openstack/openstack-ansible-os_masakari/+/789243 | 11:07 |
*** shyam89 has joined #openstack-ansible | 11:10 | |
*** shyam89 has quit IRC | 11:10 | |
*** shyamb has joined #openstack-ansible | 11:10 | |
openstackgerrit | Dmitriy Rabotyagov proposed openstack/openstack-ansible-os_masakari master: Add masakari-introspectiveinstancemonitor support https://review.opendev.org/c/openstack/openstack-ansible-os_masakari/+/789244 | 11:12 |
*** mgariepy has quit IRC | 11:42 | |
jonher | AIO question with cloudkitty dashboard, OPENSTACK_ENDPOINT_TYPE in horizon config is set to "internalURL" by default. Does that not mean it should try the internalURL for cloudkitty(rating service) ? It's trying to use the public one but gets a ssl error since the self-signed cert on HAproxy is not trusted | 11:48 |
jonher | "OPENSTACK_ENDPOINT_TYPE specifies the endpoint type to use for the endpoints in the Keystone service catalog." | 11:49 |
noonedeadpunk | I think it actually should | 11:59 |
noonedeadpunk | But no idea if cloudkitty respects that actuall | 11:59 |
jonher | yeah that's what i'm suspecting, just wanted to make sure | 11:59 |
*** ThiagoCMC has quit IRC | 12:04 | |
*** ChipOManiac has quit IRC | 12:08 | |
*** shyamb has quit IRC | 12:13 | |
*** shyamb has joined #openstack-ansible | 12:14 | |
*** shyamb has quit IRC | 12:17 | |
*** shyamb has joined #openstack-ansible | 12:17 | |
noonedeadpunk | I actually catched several services on that, but never looked into cloudkitty though | 12:17 |
jonher | yeah i found octavia setting the interface based on OPENSTACK_ENDPOINT_TYPE designate not for example (i think) | 12:18 |
openstackgerrit | Dmitriy Rabotyagov proposed openstack/openstack-ansible master: Enable senlin tempest plugin when senlin is deployed https://review.opendev.org/c/openstack/openstack-ansible/+/754105 | 12:20 |
*** dave-mccowan has quit IRC | 12:24 | |
*** shyamb has quit IRC | 12:26 | |
*** dave-mccowan has joined #openstack-ansible | 12:26 | |
openstackgerrit | Dmitriy Rabotyagov proposed openstack/openstack-ansible master: Add centos-8 stream jobs https://review.opendev.org/c/openstack/openstack-ansible/+/776226 | 12:26 |
openstackgerrit | Dmitriy Rabotyagov proposed openstack/openstack-ansible master: Add centos-8 stream jobs https://review.opendev.org/c/openstack/openstack-ansible/+/776226 | 12:26 |
openstackgerrit | Dmitriy Rabotyagov proposed openstack/openstack-ansible master: Add centos-8 stream jobs https://review.opendev.org/c/openstack/openstack-ansible/+/776226 | 12:28 |
*** mgariepy has joined #openstack-ansible | 12:28 | |
*** spatel_ has joined #openstack-ansible | 12:52 | |
*** spatel_ is now known as spatel | 12:52 | |
openstackgerrit | Jonathan Herlin proposed openstack/openstack-ansible-os_cloudkitty stable/victoria: Fix wsgi_venv path for cloudkitty-api https://review.opendev.org/c/openstack/openstack-ansible-os_cloudkitty/+/789267 | 13:03 |
jonher | rebase 780874 ? that would change to using integrated build instead of ansible-functional | 13:08 |
*** ThiagoCMC has joined #openstack-ansible | 13:23 | |
ThiagoCMC | Morning guys! Long time no see... =P | 13:24 |
ThiagoCMC | My OpenStack+Ceph Cloud that I deployment in my basement is running for about 6 months already! However, there is one, very annoying, problem. There are a LOT of random "Error 500", which forces me to try again and again until it works. I already replaced the hardware and even a re-deploy but, same problem. Is it just me? | 13:26 |
*** d34dh0r53 has joined #openstack-ansible | 13:30 | |
*** gokhani has quit IRC | 14:43 | |
*** zbr has quit IRC | 14:51 | |
*** zbr has joined #openstack-ansible | 14:52 | |
*** macz_ has joined #openstack-ansible | 15:26 | |
openstackgerrit | Dmitriy Rabotyagov proposed openstack/openstack-ansible master: [doc] Add OS compatability matrix https://review.opendev.org/c/openstack/openstack-ansible/+/789376 | 15:36 |
noonedeadpunk | jonher: oh, yes:) | 15:36 |
openstackgerrit | Dmitriy Rabotyagov proposed openstack/openstack-ansible-os_cloudkitty master: [goal] Deprecate the JSON formatted policy file https://review.opendev.org/c/openstack/openstack-ansible-os_cloudkitty/+/780874 | 15:36 |
noonedeadpunk | ThiagoCMC: Error 500 where? That shouldn't happen actually | 15:37 |
noonedeadpunk | 500 produce stack traces somewhere in logs. Depending on what produce the error | 15:37 |
*** macz_ has quit IRC | 15:38 | |
noonedeadpunk | cores, any reviews for https://review.opendev.org/c/openstack/openstack-ansible-os_adjutant/+/777607 ? holds adjutant a bit | 15:40 |
ThiagoCMC | noonedeadpunk, they're really random, sometimes Horizon can't display the Glance images, sometimes the Ceph volumes, sometimes the Neutron networks... Via CLI, `openstack stack create ...` is particularly bad, I have to run it many times, until the stack is actually created successfully... Sometimes the stack is created but it fails on Nova, while trying to create the instances. :-( | 15:42 |
noonedeadpunk | sounds smth like rabbit or keystone issue... | 15:42 |
ThiagoCMC | Hmmm | 15:43 |
noonedeadpunk | or, well DB... | 15:43 |
ThiagoCMC | Damn lol | 15:43 |
ThiagoCMC | Well, I'm glad to hear that you don't see them! I'll make a new deployment then, based on Wallaby, and compare both... | 15:43 |
*** mgariepy has quit IRC | 15:43 | |
ThiagoCMC | I'll also keep an eye on those 3 pieces, Rabbit, Keystone and SQL | 15:44 |
noonedeadpunk | if they're often - you should be able to easily reproduce them then? | 15:44 |
noonedeadpunk | and check logs for stack trace once you see it? | 15:44 |
openstackgerrit | Dmitriy Rabotyagov proposed openstack/openstack-ansible master: Enable senlin tempest plugin when senlin is deployed https://review.opendev.org/c/openstack/openstack-ansible/+/754105 | 15:45 |
ThiagoCMC | It's hard to replicate them consistently (it's kinda random, here and there), but good call. I might take most problematic one, the stack create, and monitor for a while. | 15:46 |
noonedeadpunk | for stack create - heat usualy capable of showing error for resource creation | 15:46 |
ThiagoCMC | It shows as 500 | 15:47 |
noonedeadpunk | or at least you can see what resource failed and go there for logs | 15:47 |
ThiagoCMC | got it | 15:47 |
noonedeadpunk | if it's failing at create request - the go for heat logs | 15:47 |
noonedeadpunk | 500 is kind of super general thing - means some service fails with python stack trace in logs | 15:48 |
*** macz_ has joined #openstack-ansible | 15:48 | |
ThiagoCMC | I see, makes sense... I started to think that this was kinda normal lol - But good to know that it isn't suppose to happen, at all! =P | 15:49 |
noonedeadpunk | yeah, it not, otherwise nobody would use that in production :) | 15:49 |
ThiagoCMC | Very true! LOL | 15:49 |
*** shyamb has joined #openstack-ansible | 15:54 | |
*** shyamb has quit IRC | 16:08 | |
*** mgariepy has joined #openstack-ansible | 16:10 | |
*** rpittau is now known as rpittau|afk | 16:32 | |
*** gyee has joined #openstack-ansible | 16:46 | |
*** cp- has joined #openstack-ansible | 17:40 | |
mgariepy | noonedeadpunk, jrosser have you ever seen galera mysql config lost on an upgrade? | 17:51 |
mgariepy | somehow galera pkg update overwrote the my.cnf file in my container.. | 17:52 |
*** spatel has quit IRC | 18:34 | |
*** spatel_ has joined #openstack-ansible | 18:35 | |
*** spatel_ is now known as spatel | 18:35 | |
*** ThiagoCMC has quit IRC | 19:32 | |
*** oleksandry has joined #openstack-ansible | 19:35 | |
*** ThiagoCMC has joined #openstack-ansible | 19:47 | |
*** oleksandry has quit IRC | 19:53 | |
*** cp- has quit IRC | 19:53 | |
*** gyee has quit IRC | 19:53 | |
*** poopcat has quit IRC | 19:53 | |
*** owalsh has quit IRC | 19:53 | |
*** priteau has quit IRC | 19:54 | |
*** akahat|ruck has quit IRC | 19:54 | |
*** bradm has quit IRC | 19:54 | |
*** lemko has quit IRC | 19:54 | |
*** oleksandry has joined #openstack-ansible | 19:55 | |
*** cp- has joined #openstack-ansible | 19:55 | |
*** gyee has joined #openstack-ansible | 19:55 | |
*** poopcat has joined #openstack-ansible | 19:55 | |
*** owalsh has joined #openstack-ansible | 19:55 | |
*** priteau has joined #openstack-ansible | 19:55 | |
*** akahat|ruck has joined #openstack-ansible | 19:55 | |
*** bradm has joined #openstack-ansible | 19:55 | |
*** lemko has joined #openstack-ansible | 19:55 | |
*** cp- has quit IRC | 19:55 | |
*** cp- has joined #openstack-ansible | 19:56 | |
*** jbadiapa has joined #openstack-ansible | 20:31 | |
spatel | jamesdenton around ? | 20:38 |
*** jbadiapa has quit IRC | 20:41 | |
*** spatel has quit IRC | 20:58 | |
*** snapdeal has joined #openstack-ansible | 22:14 | |
*** snapdeal has quit IRC | 22:27 | |
*** tosky has quit IRC | 22:50 | |
*** ThiagoCMC has quit IRC | 22:50 | |
*** ThiagoCMC has joined #openstack-ansible | 23:05 | |
*** macz_ has quit IRC | 23:24 |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!