*** TxGirlGeek has quit IRC | 00:00 | |
*** LiYuenan has quit IRC | 00:02 | |
*** javeriak has quit IRC | 00:04 | |
*** toddnni has quit IRC | 00:06 | |
*** toddnni has joined #openstack-ansible | 00:06 | |
*** thorst has quit IRC | 00:07 | |
*** hughmFLE_ has quit IRC | 00:09 | |
*** javeriak has joined #openstack-ansible | 00:10 | |
*** javeriak has quit IRC | 00:11 | |
*** weezS has quit IRC | 00:21 | |
openstackgerrit | Kyle L. Henderson proposed openstack/openstack-ansible-os_nova: Update NovaLink apt_key url https://review.openstack.org/391319 | 00:21 |
---|---|---|
*** hj-hpe has quit IRC | 00:24 | |
*** chris_hultin|AWA is now known as chris_hultin | 00:46 | |
*** chris_hultin is now known as chris_hultin|AWA | 00:47 | |
openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible: Updated envd configs for mixed virt and baremetal (ironic) https://review.openstack.org/391038 | 00:50 |
openstackgerrit | Merged openstack/openstack-ansible-os_trove: Fix trove deployment errors https://review.openstack.org/391009 | 00:58 |
*** thorst has joined #openstack-ansible | 01:05 | |
*** schwicht has joined #openstack-ansible | 01:08 | |
openstackgerrit | Merged openstack/openstack-ansible-os_nova: Fix permissions for the Nova lock directory in systemd https://review.openstack.org/391295 | 01:12 |
*** thorst has quit IRC | 01:13 | |
*** cathrich_ has joined #openstack-ansible | 01:16 | |
*** cathrichardson has quit IRC | 01:16 | |
*** fandi has joined #openstack-ansible | 01:24 | |
*** LiYuenan has joined #openstack-ansible | 01:28 | |
*** schwicht has quit IRC | 01:41 | |
*** schwicht has joined #openstack-ansible | 01:41 | |
*** maeker has quit IRC | 01:59 | |
*** thorst has joined #openstack-ansible | 02:09 | |
*** c-mart has quit IRC | 02:11 | |
openstackgerrit | Merged openstack/openstack-ansible: Remove ansible_ssh_host variable from inventory https://review.openstack.org/390672 | 02:12 |
*** hybridpollo has quit IRC | 02:14 | |
*** thorst has quit IRC | 02:18 | |
*** npawelek has quit IRC | 02:31 | |
*** npawelek has joined #openstack-ansible | 02:31 | |
*** hybridpollo has joined #openstack-ansible | 02:31 | |
*** schwicht has quit IRC | 02:35 | |
*** weezS has joined #openstack-ansible | 02:37 | |
*** fandi has quit IRC | 02:42 | |
*** thorst has joined #openstack-ansible | 03:00 | |
openstackgerrit | Steve Lewis (stevelle) proposed openstack/openstack-ansible: WIP Refactoring dynamic inventory https://review.openstack.org/391323 | 03:03 |
*** thorst has quit IRC | 03:08 | |
*** derekjhyang has quit IRC | 03:30 | |
*** hybridpollo has left #openstack-ansible | 04:05 | |
*** Mudpuppy has quit IRC | 04:05 | |
*** thorst has joined #openstack-ansible | 04:05 | |
*** Mudpuppy has joined #openstack-ansible | 04:05 | |
*** Mudpuppy has quit IRC | 04:10 | |
*** thorst has quit IRC | 04:12 | |
*** hughmFLEXin has joined #openstack-ansible | 04:24 | |
*** BjoernT has joined #openstack-ansible | 04:31 | |
*** Mudpuppy has joined #openstack-ansible | 04:38 | |
*** BjoernT has quit IRC | 04:38 | |
*** Mudpuppy has quit IRC | 04:43 | |
openstackgerrit | Steve Lewis (stevelle) proposed openstack/openstack-ansible: WIP Refactoring dynamic inventory https://review.openstack.org/391323 | 04:47 |
*** BjoernT has joined #openstack-ansible | 04:47 | |
*** shausy has joined #openstack-ansible | 04:50 | |
*** dxiri has quit IRC | 05:05 | |
*** thorst has joined #openstack-ansible | 05:10 | |
*** weezS has quit IRC | 05:11 | |
*** thorst has quit IRC | 05:18 | |
*** alij has joined #openstack-ansible | 05:31 | |
*** BjoernT has quit IRC | 05:39 | |
*** gouthamr has joined #openstack-ansible | 05:42 | |
*** woodard has joined #openstack-ansible | 05:46 | |
*** woodard has quit IRC | 05:53 | |
*** alij has quit IRC | 05:53 | |
*** woodard has joined #openstack-ansible | 05:59 | |
*** javeriak has joined #openstack-ansible | 06:01 | |
*** h5t4 has joined #openstack-ansible | 06:01 | |
*** woodard has quit IRC | 06:18 | |
*** thorst has joined #openstack-ansible | 06:20 | |
*** javeriak has quit IRC | 06:23 | |
*** thorst has quit IRC | 06:25 | |
*** javeriak has joined #openstack-ansible | 06:28 | |
openstackgerrit | Steve Lewis (stevelle) proposed openstack/openstack-ansible: WIP Refactoring dynamic inventory https://review.openstack.org/391323 | 06:31 |
*** m4rx has joined #openstack-ansible | 06:32 | |
*** rgogunskiy has joined #openstack-ansible | 06:37 | |
*** fandi has joined #openstack-ansible | 06:43 | |
*** thorst has joined #openstack-ansible | 06:45 | |
*** berendt has joined #openstack-ansible | 06:46 | |
*** thorst_ has joined #openstack-ansible | 06:48 | |
*** thorst has quit IRC | 06:50 | |
neith | cloudnull: yes I have, but I noticed the br-storage interface has no IP, I'm checcking why | 06:50 |
*** spotz_zzz is now known as spotz | 06:55 | |
*** fxpester has joined #openstack-ansible | 06:56 | |
*** pester has joined #openstack-ansible | 06:59 | |
*** adrian_otto has joined #openstack-ansible | 06:59 | |
*** adrian_otto has quit IRC | 07:00 | |
*** fxpester has quit IRC | 07:02 | |
*** adrian_otto has joined #openstack-ansible | 07:03 | |
openstackgerrit | Steve Lewis (stevelle) proposed openstack/openstack-ansible: Clean up warnings for BaseException.message https://review.openstack.org/391347 | 07:04 |
*** berendt has quit IRC | 07:04 | |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_nova: Fix permissions for the Nova lock directory in systemd https://review.openstack.org/391350 | 07:13 |
*** Jeffrey4l has joined #openstack-ansible | 07:17 | |
neith | cloudnull: I fixed the IP issue thks for the hint | 07:20 |
*** javeriak has quit IRC | 07:21 | |
*** javeriak has joined #openstack-ansible | 07:39 | |
spotz | you're up late stevelle | 07:39 |
*** drifterza has joined #openstack-ansible | 07:41 | |
stevelle | yeah, I am | 07:41 |
stevelle | even later for you | 07:41 |
*** thorst_ has quit IRC | 07:42 | |
*** thorst has joined #openstack-ansible | 07:43 | |
*** javeriak has quit IRC | 07:44 | |
*** javeriak has joined #openstack-ansible | 07:46 | |
*** thorst has quit IRC | 07:48 | |
*** thorst has joined #openstack-ansible | 07:49 | |
*** thorst has quit IRC | 07:49 | |
*** thorst has joined #openstack-ansible | 07:49 | |
openstackgerrit | Hugh Saunders proposed openstack/openstack-ansible: [Do Not Merge] Testing shell quoting https://review.openstack.org/391241 | 07:51 |
drifterza | ehlo all | 07:51 |
*** hughmFLEXin has quit IRC | 07:51 | |
spotz | morning drifterza | 07:52 |
drifterza | how goes spotz ? | 07:53 |
drifterza | I mean spotz | 07:53 |
*** askb has quit IRC | 07:55 | |
*** hughmFLEXin has joined #openstack-ansible | 07:56 | |
*** javeriak has quit IRC | 07:56 | |
*** adrian_otto has quit IRC | 07:58 | |
*** hughmFLEXin has quit IRC | 08:00 | |
*** admin0 has quit IRC | 08:00 | |
*** flg has joined #openstack-ansible | 08:02 | |
spotz | drifterza: It goes good, we're in th second design session of the day | 08:03 |
drifterza | oh nice.! | 08:04 |
drifterza | is this for OSA or other projects? | 08:04 |
*** adrian_otto has joined #openstack-ansible | 08:04 | |
*** javeriak has joined #openstack-ansible | 08:05 | |
spotz | OSA | 08:06 |
drifterza | Ah, is Trove and Monasca on the agenda at all ? | 08:06 |
*** winggundamth_ has joined #openstack-ansible | 08:06 | |
spotz | pretty sure most everyone is on their firstor second for the day depending | 08:06 |
spotz | We discussed Monasca a little yesterday, can't remember if we did more then mention trove though | 08:07 |
*** gouthamr has quit IRC | 08:07 | |
*** gouthamr has joined #openstack-ansible | 08:08 | |
drifterza | thats a pitty | 08:08 |
*** javeriak has quit IRC | 08:08 | |
*** javeriak has joined #openstack-ansible | 08:09 | |
spotz | drifterza: the problem is this is a shorter then normal cycle. If someone wants to work on the trove role of course their open to | 08:09 |
*** adrian_otto has quit IRC | 08:10 | |
drifterza | I was more hoping for help on the trove role with more exposure. | 08:10 |
drifterza | But I guess its early days so | 08:10 |
spotz | drifterza: I'm sure we could pop in the trove channel and ask:) | 08:10 |
*** javeriak has quit IRC | 08:11 | |
drifterza | No I meant help maintaining the current os-trove role that I'm core on. | 08:11 |
*** adrian_otto has joined #openstack-ansible | 08:12 | |
*** gouthamr has quit IRC | 08:12 | |
*** javeriak has joined #openstack-ansible | 08:13 | |
ioni | on fresh ubuntu 16.04 compute node, services are not started automatically | 08:13 |
ioni | neither on nova, neutron, ceilometer | 08:13 |
*** winggundamth_ has quit IRC | 08:14 | |
*** javeriak has quit IRC | 08:14 | |
spotz | ioni any errors in the install or logs? | 08:16 |
neith | cloudnull: even after fixing the IP of the br-storage bridge I still have the issue I previously mentionned | 08:17 |
ioni | spotz, no, the playbooks finished without errors | 08:18 |
ioni | i do see the services in systemctl list-units | 08:18 |
ioni | http://docs.openstack.org/developer/openstack-ansible/mitaka/install-guide/ops-addcomputehost.html | 08:18 |
spotz | ioni what happens if you manually try to start one? | 08:18 |
ioni | i'm running now full setup-openstack | 08:18 |
spotz | k | 08:19 |
ioni | Oct 28 11:18:13 cloudbox7 ceilometer-polling[10177]: AttributeError: 'module' object has no attribute 'openssl_md_meth_names' | 08:19 |
ioni | all services failed with that error | 08:19 |
ioni | hmm | 08:19 |
*** ggillies_ is now known as ggillies | 08:20 | |
spotz | ioni Well we have a place to look now:) | 08:20 |
ioni | right | 08:21 |
ioni | the venvs are made for ubuntu 14 | 08:21 |
ioni | not sure if that's the cause | 08:21 |
ioni | i'll pull the latest changes for stable/newton | 08:22 |
spotz | ioni most likely is, I was testing some different code installs on something else and ran into something silimilar as the venv was made on wheezy and I was testing the code on 14.04 | 08:23 |
ioni | it's the first compute node with ubuntu 16.04 | 08:23 |
ioni | i had the impression that on newton, we are supporting both cases | 08:23 |
spotz | ioni and what version where you trying? newton should support both yes | 08:24 |
ioni | newton | 08:24 |
ioni | controller is on ubuntu 14 so all the containers are ubuntu 14 based | 08:24 |
ioni | i did install python on ubuntu 16, it's on python 2.7.12 vs 2.7.6 on ubuntu 14 | 08:25 |
ioni | what i found is python 2 incompatibility | 08:25 |
spotz | ioni mhayden posted something I glanced at the other day on those 2 versions, I thought it was just a speed differnece but might be something deeper | 08:26 |
ioni | https://github.com/Homebrew/legacy-homebrew/issues/36346 | 08:26 |
*** winggundamth_ has joined #openstack-ansible | 08:27 | |
spotz | ioni Can you open s bug for us? | 08:27 |
ioni | https://groups.google.com/forum/#!topic/openedx-ops/8OxDEpBLKxM | 08:27 |
ioni | something related | 08:27 |
mhayden | spotz: yeah, i still haven't gotten to the bottom of the problem in speed | 08:28 |
*** gouthamr has joined #openstack-ansible | 08:28 | |
*** shausy has quit IRC | 08:28 | |
ioni | spotz, yeah but first let me check if is not something that is already fixed | 08:28 |
mhayden | i'm wondering if it's some kind of kernel tunable | 08:28 |
mhayden | because it's not the kernel, the python version, or how python was compiled | 08:28 |
evrardjp | thanks for checking that mhayden | 08:28 |
*** hughmFLEXin has joined #openstack-ansible | 08:28 | |
spotz | hey mhayden, yeah I remembered https://gist.github.com/major/20d7d11442685355c30d0abf0c07be98 | 08:28 |
spotz | ioni not sure it is, while I've been helping you the design session I'm in mentioned this python at about the same time and testing | 08:30 |
ioni | are you guys at barcelona now? :) | 08:30 |
spotz | yeah, that's why mhayden and I are awake-ish:) | 08:31 |
mhayden | at least we know that the xenial issues aren't ansible/OSA related ;) | 08:34 |
spotz | heheh | 08:34 |
*** haad1 has joined #openstack-ansible | 08:34 | |
*** thorst has quit IRC | 08:34 | |
mhayden | i wonder if folks on other projects are noticing the slowdown as well... it must be impacting tests for nova/glance/etc | 08:35 |
spotz | mhayden I don't think I've heard of anything from barbican | 08:36 |
*** thorst has joined #openstack-ansible | 08:37 | |
*** hughmFLEXin has quit IRC | 08:38 | |
openstackgerrit | Donovan Francesco proposed openstack/openstack-ansible-os_monasca: Refactoring Monasca role to align more with OSA. https://review.openstack.org/375655 | 08:38 |
*** thorst has quit IRC | 08:41 | |
ioni | mhayden, is it slower on ubuntu 16 or in ubuntu 14? | 08:42 |
*** hughmFLEXin has joined #openstack-ansible | 08:42 | |
*** thorst has joined #openstack-ansible | 08:43 | |
mhayden | 16 | 08:44 |
mhayden | by a fairly wide margin at times | 08:44 |
ioni | ok, i wonder if i should reinstall it :D | 08:45 |
*** thorst has quit IRC | 08:47 | |
logan- | the kernel idea is interesting. what if you run the test on trusty with linux-generic-lts-xenial kernel | 08:48 |
logan- | nevermind just got to that reply | 08:49 |
mhayden | logan-: i just emailed about that on openstack-dev | 08:49 |
mhayden | trusty with xenial's kernel is 3-5% faster than trusty with trusty's normal kernel | 08:49 |
ioni | https://git.openstack.org/cgit/openstack/openstack-ansible/commit/?h=stable/newton&id=f867d39feb4dd2bea5919e714b368ace45fc49fd | 08:50 |
ioni | this bites me up | 08:50 |
ioni | https://paste.xinu.at/t0yX/ | 08:51 |
ioni | HTTPError: 404 Client Error: Not found for url: http://git.openstack.org/cgit/openstack/requirements/plain/upper-constraints.txt?id= | 08:51 |
ioni | + /opt/ansible-runtime/bin/pip install --isolated --upgrade --constraint 'http://git.openstack.org/cgit/openstack/requirements/plain/upper-constraints.txt?id=' -r requirements.txt ansible==2.1.1.0 | 08:51 |
ioni | any hint on how to fix it? | 08:51 |
mhayden | also, running the full suite of nova tests takes 375 seconds (trusty) and 531 seconds (xenial) | 08:51 |
ioni | stable/newton | 08:51 |
logan- | wow | 08:52 |
openstackgerrit | Jimmy McCrory proposed openstack/openstack-ansible-os_barbican: Remove duplicate variable definition https://review.openstack.org/391378 | 08:52 |
ioni | so somebody forgot to add the id for upper-constraints.txt? | 08:52 |
ioni | https://git.openstack.org/cgit/openstack/openstack-ansible/commit/?id=8740250ba24a46397a60ca8b94d69259911fb7ba | 08:53 |
ioni | maybe i need that to stable/newton | 08:53 |
*** thorst has joined #openstack-ansible | 08:53 | |
ioni | checking | 08:53 |
*** admin0 has joined #openstack-ansible | 08:54 | |
ioni | hmm that commit is in newton | 08:55 |
mhayden | i'm thinking this slowdown has to do with thread performance... sysbench shows everything in line between trusty/xenial except for thread performance | 08:55 |
*** michaelg_bcn has joined #openstack-ansible | 08:56 | |
*** hughmFLEXin has quit IRC | 08:56 | |
*** hughmFLEXin has joined #openstack-ansible | 08:56 | |
ioni | anyone has a hint on why boostrap is failing? | 08:57 |
ioni | i can replicate on two environments | 08:57 |
openstackgerrit | Hugh Saunders proposed openstack/openstack-ansible: [Do Not Merge] Testing shell quoting https://review.openstack.org/391241 | 08:59 |
openstackgerrit | Steve Lewis (stevelle) proposed openstack/openstack-ansible: Clean up warnings for BaseException.message https://review.openstack.org/391347 | 08:59 |
openstackgerrit | Wang Qing wu proposed openstack/openstack-ansible-os_nova: Change protocol of novalink url. https://review.openstack.org/391148 | 09:00 |
*** hughmFLEXin has quit IRC | 09:01 | |
ioni | odyssey4me, ping | 09:03 |
*** janki has joined #openstack-ansible | 09:04 | |
*** asettle has joined #openstack-ansible | 09:05 | |
*** hughmFLEXin has joined #openstack-ansible | 09:06 | |
spotz | ioni he's leading the current session | 09:09 |
neith | API's are not responding at each call | 09:09 |
ioni | cool | 09:09 |
neith | I have a 2/3 failure rate | 09:10 |
ioni | spotz, found the problem | 09:10 |
*** maeker has joined #openstack-ansible | 09:10 | |
neith | haproxy seems ok, what can be wrong | 09:10 |
ioni | spotz, i have to run the boostrapt from opentack-ansible directory, not from script | 09:10 |
spotz | ioni - another bug or an environment issue you think? | 09:11 |
ioni | spotz, from what i see, odyssey4me made it like that | 09:11 |
spotz | neith - You have TLS on? I know the checksum issue was fixed if you've got a recent version | 09:11 |
neith | spotz: how do I check? | 09:11 |
ioni | spotz, https://git.openstack.org/cgit/openstack/openstack-ansible/tree/scripts/bootstrap-ansible.sh?h=stable/newton#n30 | 09:12 |
ioni | awk '/requirements_git_install_branch:/ {print $2}' playbooks/defaults/re.... | 09:12 |
spotz | ioni - ok just tag his name with a comment so he can get pinged and look later | 09:12 |
ioni | see the last part, playbooks... | 09:12 |
openstackgerrit | Hugh Saunders proposed openstack/openstack-ansible: [Do Not Merge] Testing shell quoting https://review.openstack.org/391241 | 09:12 |
ioni | so running from scripts directory, i do not have in that directory and playbooks directory | 09:13 |
spotz | neith It would be in the config but not sure where off the top of my head, was helping someone the the other day that was the fix | 09:13 |
spotz | ioni - any chance the docs say run from here? I haven't run into this but haven't built in a while | 09:14 |
ioni | spotz, if i recall, it says like scripts/boostrap-ansible.sh | 09:14 |
ioni | spotz, so it's my fault | 09:15 |
neith | spotz: was it keystone_external_ssl ? | 09:16 |
spotz | :) | 09:16 |
spotz | neith might have been, I wasn't the one typing:( | 09:16 |
neith | spotz: ok then do you remember what fix was applied then? | 09:17 |
spotz | neith He just turned off TLS he said. He's in magnum sessions so not in room with me and may not be on IRC currently to verify | 09:18 |
neith | spotz: no problem | 09:18 |
*** hughmFLEXin has quit IRC | 09:19 | |
spotz | neith I remember a lot of things in passing but if not hands on may not remember the exact details:( | 09:19 |
ioni | spotz, is there a bug that i can follow related to ubuntu 16 slowliness? | 09:21 |
spotz | mhayden ^ ? | 09:21 |
*** hughmFLEXin has joined #openstack-ansible | 09:24 | |
neith | spotz: SSL is disabled | 09:27 |
neith | spotz: so its not related :( | 09:28 |
*** fandi has quit IRC | 09:29 | |
spotz | neith - can you double check in the neutron container that checksum is all ports in the iptables? That;s the 2 places I know to lokk | 09:30 |
*** fandi has joined #openstack-ansible | 09:31 | |
*** berendt has joined #openstack-ansible | 09:33 | |
*** berendt has quit IRC | 09:37 | |
*** hughmFLEXin has quit IRC | 09:38 | |
*** thorst has quit IRC | 09:45 | |
openstackgerrit | Hugh Saunders proposed openstack/openstack-ansible: [Do Not Merge] Testing shell quoting https://review.openstack.org/391241 | 09:46 |
*** michaelg_bcn has quit IRC | 09:47 | |
*** v1k0d3n has joined #openstack-ansible | 09:51 | |
*** thorst has joined #openstack-ansible | 09:51 | |
*** electrofelix has joined #openstack-ansible | 09:55 | |
openstackgerrit | git-harry proposed openstack/openstack-ansible: Stop all but one RabbitMQ node prior to upgrade https://review.openstack.org/391398 | 09:55 |
*** thorst has quit IRC | 09:56 | |
openstackgerrit | git-harry proposed openstack/openstack-ansible: Stop all but one RabbitMQ node prior to upgrade https://review.openstack.org/391401 | 10:05 |
drifterza | Hi haad1 | 10:07 |
*** fandi has quit IRC | 10:12 | |
*** adrian_otto has quit IRC | 10:15 | |
*** chhavi has joined #openstack-ansible | 10:21 | |
neith | spotz: can you precise? | 10:27 |
spotz | neith ? | 10:27 |
neith | spotz: sorry, can you explain what should i check | 10:28 |
spotz | oh so use the lxc command to connect to the neutron container and then iptables -L -N and look at the checksum line | 10:28 |
*** winggundamth_ has quit IRC | 10:29 | |
*** janki has quit IRC | 10:30 | |
neith | spotz are u sure of the -N param? | 10:31 |
neith | seems like something related to chains | 10:31 |
spotz | neith not 100% 4 hours sleep:) | 10:32 |
spotz | -L for sure | 10:32 |
neith | spotz: http://pastebin.com/JFc3TJ6c not sure it displays what we are looking for | 10:33 |
*** asettle has quit IRC | 10:33 | |
*** thorst has joined #openstack-ansible | 10:34 | |
*** spotz is now known as spotz_zzz | 10:35 | |
neith | I think its more related to the proxy | 10:38 |
*** thorst has quit IRC | 10:39 | |
*** Mudpuppy has joined #openstack-ansible | 10:40 | |
*** v1k0d3n has quit IRC | 10:41 | |
*** Jeffrey4l has quit IRC | 10:42 | |
*** gouthamr has quit IRC | 10:43 | |
neith | getting this ressource from outside the repo container fails randomly http://x.x.x.x:8181/venvs/14.0.1/ubuntu/keystone-14.0.1-x86_64.checksum | 10:43 |
neith | thus makes the ansible play to fail | 10:44 |
neith | should I add retries in the playbook? | 10:44 |
*** Mudpuppy has quit IRC | 10:45 | |
neith | spotz_zzz: | 10:47 |
*** flg has quit IRC | 10:48 | |
*** pmannidi has quit IRC | 10:49 | |
*** spotz_zzz is now known as spotz | 11:28 | |
*** gouthamr has joined #openstack-ansible | 11:28 | |
spotz | Neith ahh so repo failure and if you rerun the playbook same thing? | 11:29 |
spotz | And can you ping the repo? | 11:29 |
*** schwicht has joined #openstack-ansible | 11:30 | |
*** spotz is now known as spotz_zzz | 11:33 | |
*** gouthamr has quit IRC | 11:33 | |
ioni | spotz, the problem that i'm seeing with AttributeError: 'module' object has no attribute 'openssl_md_meth_names' is becaue venvs have a copy of python binary in bin that is copied from host where virtualenv was ran | 11:33 |
ioni | that's how virtualenv works | 11:34 |
ioni | if i ln -s /usr/bin/python into venvs bin/python, it works | 11:34 |
neith | spotz yes I can | 11:34 |
ioni | have somebody tested ubuntu 14 as controller and ubuntu 16 as compute hosts? | 11:34 |
neith | as I said 2/3 wget on the ressources gives "no data receivefd" | 11:35 |
*** v1k0d3n has joined #openstack-ansible | 11:38 | |
neith | i'm trying a fix | 11:38 |
*** hughmFLEXin has joined #openstack-ansible | 11:39 | |
openstackgerrit | Logan V proposed openstack/openstack-ansible-pip_install: Fix same-host offline install race https://review.openstack.org/391427 | 11:42 |
*** v1k0d3n has quit IRC | 11:42 | |
*** flg has joined #openstack-ansible | 11:43 | |
*** spotz_zzz is now known as spotz | 11:44 | |
*** thorst has joined #openstack-ansible | 11:45 | |
*** maeker has quit IRC | 11:46 | |
openstackgerrit | Logan V proposed openstack/openstack-ansible: [TEST] Bump ansible-lint version https://review.openstack.org/391429 | 11:47 |
*** thorst has quit IRC | 11:49 | |
*** gouthamr has joined #openstack-ansible | 11:50 | |
*** thorst has joined #openstack-ansible | 11:51 | |
*** hughmFLEXin has quit IRC | 11:52 | |
*** adrian_otto has joined #openstack-ansible | 11:53 | |
*** hughmFLEXin has joined #openstack-ansible | 11:53 | |
*** thorst_ has joined #openstack-ansible | 11:54 | |
*** thorst has quit IRC | 11:55 | |
*** retreved has joined #openstack-ansible | 11:56 | |
*** asettle has joined #openstack-ansible | 11:56 | |
*** maeker has joined #openstack-ansible | 11:57 | |
*** hughmFLEXin has quit IRC | 12:01 | |
*** winggundamth_ has joined #openstack-ansible | 12:02 | |
*** hughmFLEXin has joined #openstack-ansible | 12:02 | |
*** michaelg_bcn has joined #openstack-ansible | 12:04 | |
openstackgerrit | Jean-Philippe Evrard proposed openstack/openstack-ansible-plugins: [WIP] Introduce content argument https://review.openstack.org/382109 | 12:05 |
*** winggundamth_ has quit IRC | 12:07 | |
*** winggundamth_ has joined #openstack-ansible | 12:08 | |
*** McMurlock1 has joined #openstack-ansible | 12:10 | |
*** hughmFLEXin has quit IRC | 12:15 | |
*** johnmilton has joined #openstack-ansible | 12:15 | |
*** asettle has quit IRC | 12:19 | |
*** asettle has joined #openstack-ansible | 12:20 | |
*** hughmFLEXin has joined #openstack-ansible | 12:20 | |
*** maeker has quit IRC | 12:20 | |
*** lunarlamp has quit IRC | 12:20 | |
*** mpjetta has quit IRC | 12:20 | |
*** mattt has quit IRC | 12:20 | |
*** lunarlamp has joined #openstack-ansible | 12:21 | |
mhayden | ioni / spotz: i'm not sure if there's a bug open for Ubuntu 16.04 slowness | 12:23 |
mhayden | but i can open one if needed ;) | 12:23 |
ioni | mhayden, ok | 12:23 |
* mhayden goes to launchpad :) | 12:24 | |
ioni | for now I cannot even run openstack services when controller is on ubuntu 14 | 12:24 |
*** maeker has joined #openstack-ansible | 12:24 | |
ioni | vevns from ubuntu 14 are not compatible with ubuntu 16 | 12:24 |
ioni | not sure if anyone tested that | 12:24 |
ioni | mixed version | 12:24 |
*** admin0 has quit IRC | 12:25 | |
*** mheremans has joined #openstack-ansible | 12:29 | |
*** McMurlock1 has quit IRC | 12:29 | |
*** hughmFLEXin has quit IRC | 12:29 | |
*** mheremans has quit IRC | 12:30 | |
*** schwicht has quit IRC | 12:31 | |
neith | Now I am blocked http://pastebin.com/QMKZdTsA | 12:33 |
*** hughmFLEXin has joined #openstack-ansible | 12:34 | |
neith | I understand that the ipv4 attribute of this fact is missing but Don't understand why | 12:34 |
*** chhavi has quit IRC | 12:35 | |
*** mattt has joined #openstack-ansible | 12:36 | |
*** mpjetta has joined #openstack-ansible | 12:36 | |
*** janki has joined #openstack-ansible | 12:36 | |
*** smatzek has joined #openstack-ansible | 12:36 | |
*** retreved has quit IRC | 12:39 | |
*** mattt has quit IRC | 12:41 | |
*** mattt has joined #openstack-ansible | 12:41 | |
*** Mudpuppy has joined #openstack-ansible | 12:44 | |
spotz | ioni - the concensus in the room was... good question | 12:46 |
ioni | spotz, yeah, it doesn't work :D | 12:46 |
ioni | so somehow we need to create venvs for ubuntu 16 | 12:47 |
openstackgerrit | Jean-Philippe Evrard proposed openstack/openstack-ansible-plugins: [WIP] Introduce content argument https://review.openstack.org/382109 | 12:47 |
*** hughmFLEXin has quit IRC | 12:47 | |
openstackgerrit | Logan V proposed openstack/openstack-ansible-lxc_hosts: Implement LXC cache timeout https://review.openstack.org/391459 | 12:49 |
*** hughmFLEXin has joined #openstack-ansible | 12:52 | |
spotz | ioni Can you put a bug up for us with which servers were on which version and how you were doing this so we can replicate | 12:53 |
ioni | spotz, sure thing | 12:53 |
spotz | ioni thanks | 12:53 |
ioni | spotz, i'll do it later today, now i have to do something asap | 12:54 |
*** chhavi has joined #openstack-ansible | 12:54 | |
*** flg has quit IRC | 12:54 | |
spotz | ioni no prob, it'll definitely be something we'll need to look at when we work on the OS upgrade testing we discussed yesterday | 12:54 |
ioni | spotz, i think i missed the discussion | 12:55 |
spotz | ioni at summit I can get yo the etherpad link if you'd like | 12:55 |
ioni | spotz, sure | 12:56 |
*** schwicht has joined #openstack-ansible | 12:56 | |
*** asettle has quit IRC | 12:56 | |
ioni | i do have couples of servers in production with ubuntu 14 and I do want to migrate them to ubuntu 16 | 12:56 |
ioni | mhayden, have you submitted the bug? | 12:56 |
*** retreved has joined #openstack-ansible | 12:56 | |
* ioni wants to subscribe to it | 12:56 | |
spotz | ioni https://etherpad.openstack.org/p/ocata-osa-summit-upgrades and https://etherpad.openstack.org/p/ocata-osa-summit-testing | 12:56 |
ioni | thanks | 12:57 |
spotz | NP | 12:57 |
neith | I fixed, IP was missing on the interface | 12:57 |
spotz | neith great:) | 12:57 |
openstackgerrit | Donovan Francesco proposed openstack/openstack-ansible-os_monasca: Refactoring Monasca role to align more with OSA. https://review.openstack.org/375655 | 12:59 |
mhayden | ioni: oops -- doing it now | 13:01 |
*** hughmFLEXin has quit IRC | 13:01 | |
*** asettle has joined #openstack-ansible | 13:02 | |
jmccrory | evrardjp https://github.com/ansible/ansible-modules-core/issues/5328 | 13:03 |
mhayden | https://bugs.launchpad.net/openstack-ansible/+bug/1637494 | 13:03 |
openstack | Launchpad bug 1637494 in openstack-ansible "Very slow Xenial gate jobs" [Critical,Confirmed] - Assigned to Major Hayden (rackerhacker) | 13:03 |
mhayden | ioni: ^^ | 13:03 |
ioni | mhayden, thanks | 13:03 |
*** drifterza has quit IRC | 13:04 | |
*** Mudpuppy has quit IRC | 13:04 | |
*** Jeffrey4l has joined #openstack-ansible | 13:05 | |
*** flg has joined #openstack-ansible | 13:05 | |
*** hughmFLEXin has joined #openstack-ansible | 13:06 | |
mhayden | ioni: that bug might not be related to what you're talking about -- spotz just reminded me of that | 13:09 |
mhayden | you may need to open a more specific one | 13:09 |
*** cathrich_ is now known as cathrichardson | 13:10 | |
ioni | mhayden, i don't really seen any slowliness since I couldn't use ubuntu 16 for now due to incompatible venvs | 13:10 |
*** janki has quit IRC | 13:11 | |
*** cathrich_ has joined #openstack-ansible | 13:14 | |
*** cathrich_ is now known as cathrichardson_ | 13:14 | |
*** cathrichardson has quit IRC | 13:15 | |
*** cathrichardson_ has quit IRC | 13:15 | |
*** hughmFLEXin has quit IRC | 13:15 | |
*** cathrichardson has joined #openstack-ansible | 13:16 | |
evrardjp | could someone have a look at this too? https://review.openstack.org/#/c/389795 | 13:18 |
*** smatzek has quit IRC | 13:19 | |
openstackgerrit | Logan V proposed openstack/openstack-ansible: [TEST] Bump ansible-lint version https://review.openstack.org/391429 | 13:19 |
*** hughmFLEXin has joined #openstack-ansible | 13:20 | |
*** jheroux has joined #openstack-ansible | 13:21 | |
openstackgerrit | Hugh Saunders proposed openstack/openstack-ansible: [Do Not Merge] Testing shell quoting https://review.openstack.org/391241 | 13:21 |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_nova: Fix permissions for the Nova lock directory in systemd https://review.openstack.org/391350 | 13:22 |
*** hughmFLEXin has quit IRC | 13:24 | |
spotz | ioni you need to write a bug for the pyenv and the different OS environments and server types | 13:26 |
ioni | spotz, yeah, i'll do it | 13:26 |
ioni | like i promised | 13:26 |
ioni | just cannot do it now | 13:26 |
mgariepy | good morning everyone | 13:26 |
spotz | ioni cool:) Just clarifying mhayden | 13:26 |
spotz | hey mgariepy | 13:27 |
odyssey4me | ioni the issue is most likely a difference between the libvirt version in the repo container and the libvirt version on the compute host | 13:27 |
ioni | odyssey4me, related to what? | 13:28 |
odyssey4me | ioni if you can register a bug then I'll immediately put the options in a comment to ensure we have the record of it | 13:28 |
evrardjp | spotz: https://review.openstack.org/#/c/389795/ | 13:28 |
odyssey4me | ioni I'm guessing that you're getting a libvirt-python error of some sort from the nova-compute service, right? | 13:29 |
ioni | odyssey4me, no | 13:29 |
*** hughmFLEXin has joined #openstack-ansible | 13:29 | |
odyssey4me | ioni oh, interesting | 13:30 |
odyssey4me | well then, I look forward to the bug :) | 13:30 |
evrardjp | mhayden: you should stop saying kubernetes. It still sounds like "squirrel" to me. | 13:33 |
*** dxiri has joined #openstack-ansible | 13:34 | |
*** hughmFLEXin has quit IRC | 13:34 | |
ioni | odyssey4me, https://bugs.launchpad.net/openstack-ansible/+bug/1637509 | 13:34 |
openstack | Launchpad bug 1637509 in openstack-ansible "Ubuntu 14 vevns are not compatible for compute hosts with ubuntu 16" [Undecided,New] | 13:34 |
ioni | spotz, https://bugs.launchpad.net/openstack-ansible/+bug/1637509 | 13:34 |
evrardjp | winggundamth: http://docs.openstack.org/developer/openstack-ansible/install-guide/app-advanced-role-docs.html | 13:34 |
spotz | ioni thanks | 13:35 |
*** schwicht has quit IRC | 13:36 | |
*** ableto has joined #openstack-ansible | 13:36 | |
*** hughmFLEXin has joined #openstack-ansible | 13:38 | |
*** smatzek has joined #openstack-ansible | 13:40 | |
openstackgerrit | Merged openstack/openstack-ansible: Update role SHAs 2016-10-27 https://review.openstack.org/391236 | 13:43 |
*** hughmFLEXin has quit IRC | 13:48 | |
odyssey4me | smatzek http://lists.openstack.org/pipermail/openstack-dev/2015-October/076030.html | 13:49 |
openstackgerrit | Marc GariƩpy proposed openstack/openstack-ansible-os_neutron: Fix perms issue for dnsmasq on CentOS. https://review.openstack.org/391300 | 13:51 |
*** thorst_ has quit IRC | 13:51 | |
*** schwicht has joined #openstack-ansible | 13:52 | |
*** hughmFLEXin has joined #openstack-ansible | 13:52 | |
*** thorst_ has joined #openstack-ansible | 13:56 | |
mgariepy | odyssey4me, how does the log collection on gate check works ? | 13:56 |
odyssey4me | logan- https://github.com/openstack/openstack-ansible-os_keystone/blob/master/tasks/keystone_install.yml#L136 | 13:57 |
openstackgerrit | Samuel Matzek proposed openstack/openstack-ansible-os_swift: Swift proxy performance fixes https://review.openstack.org/391484 | 13:59 |
odyssey4me | logan- https://github.com/openstack/openstack-ansible-os_keystone/blob/master/defaults/main.yml#L39 | 13:59 |
odyssey4me | https://github.com/openstack/openstack-ansible/blob/master/playbooks/os-keystone-install.yml#L79 | 14:00 |
openstackgerrit | Alexandra Settle proposed openstack/openstack-ansible: [DOCS] Adds a cookie cutter deploy guide for d.o.o https://review.openstack.org/391486 | 14:01 |
*** thorst_ has quit IRC | 14:01 | |
*** hughmFLEXin has quit IRC | 14:02 | |
*** thorst_ has joined #openstack-ansible | 14:04 | |
openstackgerrit | Donovan Francesco proposed openstack/openstack-ansible-os_monasca: Refactoring Monasca role to align more with OSA. https://review.openstack.org/375655 | 14:05 |
odyssey4me | ioni added comment for options - I think that option 3 is likely the most sensible | 14:05 |
odyssey4me | it's an easy workaround for now via an override, and we could do something sensible to make it automatic. | 14:06 |
ioni | odyssey4me, i'm not sure why Amy pasted my paste in that bug, is not related | 14:06 |
ioni | can you delete it? | 14:06 |
*** hughmFLEXin has joined #openstack-ansible | 14:06 | |
ioni | i just deleted my paste url, since it doesn't have any relation with my bug | 14:07 |
odyssey4me | ioni I can't - but I see that you've deleted the place it goes to | 14:07 |
ioni | k | 14:08 |
ioni | odyssey4me, i'm not sure what's the right approach here | 14:08 |
*** Jeffrey4l has quit IRC | 14:09 | |
*** chris_hultin|AWA is now known as chris_hultin | 14:10 | |
*** ableto has quit IRC | 14:11 | |
spotz | ioni I thought that was the link you posted to show it | 14:11 |
ioni | odyssey4me, whatever you decide i take it :) | 14:11 |
openstackgerrit | Jean-Philippe Evrard proposed openstack/openstack-ansible: Disable hatool before the upgrade https://review.openstack.org/391495 | 14:14 |
*** hughmFLEXin has quit IRC | 14:15 | |
*** drifterza has joined #openstack-ansible | 14:16 | |
drifterza | cloudnull, you around ? | 14:16 |
*** michaelg_bcn has quit IRC | 14:17 | |
odyssey4me | asettle FYI I've asked if we can get https://review.openstack.org/389232 voted through - it will make https://review.openstack.org/391486 not require a full functional build (and thus pass much more quickly) | 14:17 |
drifterza | ah odyssey4me I have a question | 14:18 |
drifterza | So currently the way I understand it, you use the meta/main.yml to include external galaxy roles right | 14:18 |
odyssey4me | drifterza sure thing - what's up? | 14:18 |
drifterza | Then when it comes to tests/inventory - how do you allocate the external roles to [group] | 14:19 |
odyssey4me | drifterza nope - it just specifies a dependent role - ie a role that must be executed before the role in question | 14:19 |
*** chris_hultin is now known as chris_hultin|AWA | 14:19 | |
odyssey4me | the roles that need to be in place for the playbooks are specified in ansible-role-requirements.yml | 14:19 |
drifterza | Yeah I have that there | 14:20 |
odyssey4me | and the playbook is able to order roles | 14:20 |
*** hughmFLEXin has joined #openstack-ansible | 14:20 | |
drifterza | but lets say for argument sake | 14:20 |
drifterza | I have influxdb in the ansible-role-requirements.yml how would I put that in the tests/inventory file to be a group | 14:20 |
asettle | odyssey4me: it should build? anyway, we are currently working on the second patch necessary for infra. Andreas will fix it. | 14:20 |
asettle | But it means its more or less done on out part | 14:20 |
*** Mudpuppy has joined #openstack-ansible | 14:21 | |
*** hj-hpe has joined #openstack-ansible | 14:21 | |
odyssey4me | asettle where're you at? if you're grouped then perhaps I can get my questions satisfied more easily | 14:22 |
asettle | odyssey4me: yes, room 120 | 14:24 |
asettle | Workign on the infra side now | 14:24 |
asettle | odyssey4me: ah stop! | 14:26 |
asettle | your'e working over hte top of me | 14:26 |
asettle | I need to do this in a certain process | 14:26 |
odyssey4me | asettle I did nothing. :) | 14:26 |
asettle | Yes you did | 14:26 |
asettle | Come to 120 | 14:26 |
odyssey4me | oh dear, ok - coming | 14:26 |
asettle | https://review.openstack.org/391499 odyssey4me | 14:28 |
asettle | I was working on the rest of the infra patches at the same thing | 14:28 |
asettle | Let's merge the two patches | 14:29 |
*** hughmFLEXin has quit IRC | 14:29 | |
openstackgerrit | Donovan Francesco proposed openstack/openstack-ansible-os_monasca: Refactoring Monasca role to align more with OSA. https://review.openstack.org/375655 | 14:29 |
*** thorst_ has quit IRC | 14:30 | |
*** weezS has joined #openstack-ansible | 14:33 | |
*** lechfl has joined #openstack-ansible | 14:34 | |
*** thorst_ has joined #openstack-ansible | 14:37 | |
*** pester has quit IRC | 14:38 | |
openstackgerrit | Andy McCrae proposed openstack/openstack-ansible-os_swift: [WIP] Attempt to fix swift_pypy memory issues https://review.openstack.org/386566 | 14:39 |
*** thorst_ has quit IRC | 14:42 | |
cloudnull | Mornings. | 14:43 |
openstackgerrit | Jimmy McCrory proposed openstack/openstack-ansible: [WIP] Include barbican role in integrated release https://review.openstack.org/391219 | 14:43 |
logan- | o/ | 14:43 |
*** agrebennikov has joined #openstack-ansible | 14:44 | |
openstackgerrit | Merged openstack/openstack-ansible-os_barbican: Remove duplicate variable definition https://review.openstack.org/391378 | 14:45 |
*** marst has quit IRC | 14:46 | |
*** berendt has joined #openstack-ansible | 14:47 | |
odyssey4me | helloooooo | 14:51 |
odyssey4me | my name is jesse | 14:51 |
odyssey4me | ola ola ola | 14:51 |
*** flg has quit IRC | 14:53 | |
cloudnull | Drifterza I am now | 14:53 |
*** lechfl has left #openstack-ansible | 14:54 | |
jmccrory | evrardjp : https://github.com/openstack/openstack-ansible/blob/master/playbooks/inventory/env.d/nova.yml#L54-L62 | 14:55 |
*** lechfl has joined #openstack-ansible | 14:56 | |
*** thorst_ has joined #openstack-ansible | 14:58 | |
*** asettle has quit IRC | 14:59 | |
*** lechfl has quit IRC | 15:00 | |
*** lechfl has joined #openstack-ansible | 15:00 | |
openstackgerrit | Jimmy McCrory proposed openstack/openstack-ansible: [WIP] Include barbican role in integrated release https://review.openstack.org/391219 | 15:00 |
*** lechfl has quit IRC | 15:00 | |
*** lechfl has joined #openstack-ansible | 15:00 | |
*** weezS has quit IRC | 15:02 | |
*** weezS has joined #openstack-ansible | 15:02 | |
*** thorst_ has quit IRC | 15:02 | |
openstackgerrit | Andy McCrae proposed openstack/openstack-ansible-os_swift: [WIP] Attempt to fix swift_pypy memory issues https://review.openstack.org/386566 | 15:07 |
*** lechfl has quit IRC | 15:07 | |
*** weezS has quit IRC | 15:13 | |
*** weezS has joined #openstack-ansible | 15:16 | |
andymccr | mhayden: https://review.openstack.org/#/c/388819/ | 15:16 |
*** asettle has joined #openstack-ansible | 15:19 | |
*** flg has joined #openstack-ansible | 15:20 | |
* mhayden high fives andymccr | 15:20 | |
andymccr | getting things done! | 15:21 |
*** smatzek has quit IRC | 15:22 | |
*** c-mart has joined #openstack-ansible | 15:23 | |
*** h5t4 has quit IRC | 15:23 | |
*** marst has joined #openstack-ansible | 15:24 | |
openstackgerrit | Andy McCrae proposed openstack/openstack-ansible: [WIP] Include barbican role in integrated release https://review.openstack.org/391219 | 15:27 |
*** rgogunskiy has quit IRC | 15:27 | |
*** winggundamth_ has quit IRC | 15:28 | |
*** asettle has quit IRC | 15:29 | |
*** weezS has quit IRC | 15:32 | |
*** ableto has joined #openstack-ansible | 15:34 | |
*** weezS has joined #openstack-ansible | 15:34 | |
openstackgerrit | Merged openstack/openstack-ansible-os_swift: Add object-reconstructor for swift EC https://review.openstack.org/388819 | 15:37 |
openstackgerrit | Merged openstack/openstack-ansible-os_swift: Swift proxy performance fixes https://review.openstack.org/391484 | 15:39 |
*** berendt has quit IRC | 15:46 | |
*** spotz is now known as spotz_zzz | 15:47 | |
*** smatzek has joined #openstack-ansible | 15:49 | |
openstackgerrit | Jean-Philippe Evrard proposed openstack/openstack-ansible: [WIP] Integration of dragonflow inventory in integrated gate https://review.openstack.org/391522 | 15:50 |
*** smatzek has quit IRC | 15:51 | |
*** smatzek has joined #openstack-ansible | 15:51 | |
openstackgerrit | Merged openstack/openstack-ansible-os_nova: Fix permissions for the Nova lock directory in systemd https://review.openstack.org/391350 | 15:53 |
*** schwicht has quit IRC | 15:55 | |
*** maeker has quit IRC | 15:55 | |
*** flg has quit IRC | 15:59 | |
*** smatzek has quit IRC | 15:59 | |
openstackgerrit | Jean-Philippe Evrard proposed openstack/openstack-ansible-os_neutron: [WIP] Dragonflow https://review.openstack.org/391524 | 15:59 |
*** adrian_otto has quit IRC | 16:00 | |
*** smatzek has joined #openstack-ansible | 16:00 | |
*** adrian_otto has joined #openstack-ansible | 16:01 | |
*** hughmFLEXin has joined #openstack-ansible | 16:03 | |
openstackgerrit | Jean-Philippe Evrard proposed openstack/openstack-ansible-os_neutron: [WIP] Dragonflow https://review.openstack.org/391524 | 16:05 |
openstackgerrit | Jean-Philippe Evrard proposed openstack/openstack-ansible-os_neutron: [WIP] Dragonflow https://review.openstack.org/391524 | 16:06 |
*** schwicht has joined #openstack-ansible | 16:06 | |
*** haad1 has quit IRC | 16:07 | |
*** smatzek_ has joined #openstack-ansible | 16:11 | |
*** smatzek has quit IRC | 16:11 | |
*** adrian_otto has joined #openstack-ansible | 16:13 | |
*** Mudpuppy_ has joined #openstack-ansible | 16:24 | |
*** Mudpuppy has quit IRC | 16:28 | |
*** Mudpuppy_ has quit IRC | 16:29 | |
*** gouthamr has quit IRC | 16:32 | |
*** pjm6 has quit IRC | 16:33 | |
*** fandi has joined #openstack-ansible | 16:34 | |
*** johnmilton has quit IRC | 16:35 | |
*** fedruantine has quit IRC | 16:35 | |
agrebennikov | hi odyssey4me | 16:38 |
agrebennikov | regarding https://review.openstack.org/#/c/391303 | 16:39 |
agrebennikov | do you mean we have to wait until the tag OR put sha? | 16:39 |
*** serverascode has quit IRC | 16:40 | |
*** NachoDuck has quit IRC | 16:40 | |
*** NachoDuck has joined #openstack-ansible | 16:41 | |
*** pegmanm has quit IRC | 16:41 | |
*** mrhillsman has quit IRC | 16:41 | |
*** calebb has quit IRC | 16:42 | |
*** serverascode has joined #openstack-ansible | 16:43 | |
*** calebb has joined #openstack-ansible | 16:45 | |
*** mrhillsman has joined #openstack-ansible | 16:45 | |
*** pegmanm has joined #openstack-ansible | 16:45 | |
*** strobelight has joined #openstack-ansible | 16:46 | |
*** hughmFLE_ has joined #openstack-ansible | 16:48 | |
*** hughmFLEXin has quit IRC | 16:50 | |
openstackgerrit | Andrey Grebennikov proposed openstack/openstack-ansible: Use Ansible from v1.9.6-1 in bootstrap-ansible https://review.openstack.org/391303 | 16:55 |
agrebennikov | odyssey4me, can you please take a look once again? | 16:56 |
openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible: Added lxd password to the secrets file https://review.openstack.org/391527 | 16:57 |
*** smatzek_ has quit IRC | 16:58 | |
cloudnull | agrebennikov: I think odyssey4me is wanting to use the sha instead of the branch name. | 17:00 |
cloudnull | IE : "819c51cd807061845ad5db9c5aaa8e05a623939b" | 17:00 |
cloudnull | which is the current head of the stable1.9 branch | 17:00 |
agrebennikov | I put 1.9.6 | 17:00 |
agrebennikov | to be more transparent | 17:00 |
agrebennikov | since there are about 10 commits after that | 17:01 |
cloudnull | while ansible is not adding more releases to stable 1.9 they are maintaining it | 17:01 |
cloudnull | like a new one about 4 days ago | 17:01 |
*** admin0 has joined #openstack-ansible | 17:02 | |
*** hughmFLEXin has joined #openstack-ansible | 17:02 | |
cloudnull | using the sha is less friendly but it is much more specific and if we need we can add a comment in the bootstrap file as to what that sha pertains to | 17:02 |
agrebennikov | yeah, but there are still tags, and 1.9.6 is the latest at the moment | 17:03 |
admin0 | \o | 17:03 |
agrebennikov | I just checked - at least it doesn't have original issues | 17:03 |
cloudnull | I believe 1.9.6 has a broken lxc module | 17:03 |
cloudnull | https://github.com/ansible/ansible-modules-extras/issues/2042 | 17:04 |
cloudnull | the fix was added to the branch but never released | 17:04 |
agrebennikov | you mean "fixed boto import as per #11755"? | 17:04 |
*** hughmFLE_ has quit IRC | 17:04 | |
cloudnull | so while there's no tag we can use the sha to pull in the latest 1.9.6 even though there's no tag. | 17:05 |
agrebennikov | ok... but what I don't understand then - if stable 1.9 is only accepting bugfixes why we can't use it even though it is dynamic :/ | 17:07 |
stevelle | stable isn't that stable, and it includes bug fixes that introduce new bugs | 17:09 |
*** hj-hpe has quit IRC | 17:12 | |
*** schwicht has quit IRC | 17:13 | |
*** hughmFLEXin has quit IRC | 17:14 | |
*** schwicht has joined #openstack-ansible | 17:14 | |
*** hughmFLEXin has joined #openstack-ansible | 17:15 | |
cloudnull | agrebennikov: another reason is the fact that branches are deleted all the time | 17:18 |
cloudnull | while a sha will forever remain in git history | 17:18 |
agrebennikov | are they?! | 17:18 |
cloudnull | they are. | 17:18 |
cloudnull | like in the openstack case we remove a branch as soon as a release is EOL. | 17:19 |
cloudnull | also notice there's not stable1.{8,7,6} branches | 17:19 |
agrebennikov | because they just changed their mind about how to name stables (seems so) ;) and everything down to 1.5 are still there | 17:20 |
agrebennikov | but anyways - if you guys like non-transparent sha - I can do it for sure | 17:21 |
agrebennikov | it will be just confusing to whoever will try to read through the script in my opinion | 17:21 |
openstackgerrit | Merged openstack/openstack-ansible-os_neutron: Fix perms issue for dnsmasq on CentOS. https://review.openstack.org/391300 | 17:21 |
cloudnull | we like more explicit sha's :) | 17:22 |
*** adrian_otto has quit IRC | 17:22 | |
cloudnull | just add a comment to the right of the var | 17:22 |
cloudnull | similar to here https://github.com/openstack/openstack-ansible/blob/master/playbooks/defaults/repo_packages/openstack_services.yml#L34 | 17:22 |
agrebennikov | I mean - for Non developers this kind of things is always confusing... | 17:22 |
agrebennikov | ok, I see | 17:22 |
agrebennikov | but do you guys mean I'll have to rename it again once the new tag is in place? | 17:23 |
cloudnull | if they create a new tag then we can change it. but at this point i doubt that is going to happen . | 17:24 |
*** m4rx has quit IRC | 17:24 | |
agrebennikov | you think 1.9 is dead now? | 17:25 |
cloudnull | yes. | 17:26 |
agrebennikov | ok.. what about those who are managing production clouds with it? (and not jsut clouds) | 17:26 |
agrebennikov | or you think everybody uses master? :D | 17:27 |
agrebennikov | this is a constant war of developers and us | 17:28 |
cloudnull | i mean there may be a commit or two going into it but there's no new development for 1.9 | 17:28 |
agrebennikov | development - agree, but the bugfixing should continue to happen, right? | 17:29 |
openstackgerrit | Andrey Grebennikov proposed openstack/openstack-ansible: Use HEAD stable-1.9 Ansible in bootstrap-ansible https://review.openstack.org/391303 | 17:30 |
cloudnull | at rax we have lots of production on ansible 1.x so it should remain stable and usable. | 17:30 |
ioni | i noticed something fishy with ceilometer when using stable/newton latest | 17:31 |
cloudnull | as for bug fixes i dont think ansible is doing anything there. | 17:31 |
cloudnull | looking at github issues https://github.com/ansible/ansible/issues?q=is%3Aopen+is%3Aissue+label%3Aaffects_1.9+sort%3Acreated-asc | 17:31 |
ioni | ceilometer on compute hosts doesn't get init updated from 14.0.0 to 14.0.1 and services are not restarted | 17:31 |
cloudnull | they have several pages of issues dating back to 2013 | 17:31 |
cloudnull | most of which seem like they're not being worked on. | 17:31 |
agrebennikov | oh wow... | 17:32 |
cloudnull | agrebennikov: even worse https://github.com/ansible/ansible/issues?utf8=%E2%9C%93&q=is%3Aopen%20sort%3Acreated-desc%20label%3Aaffects_1.9%20label%3Abugfix_pull_request%20 -- according to the labels there are no pending bugfix prs in queue. | 17:36 |
cloudnull | so yes. i think stable1.9 will remain "stable" with nothing new added to it going forward. | 17:36 |
cloudnull | even bug fixes. | 17:36 |
agrebennikov | em... meaning - no more commits At All? 0_o | 17:37 |
openstackgerrit | Chhavi Agarwal proposed openstack/openstack-ansible-os_nova: Disable SMT for ppc64 hypervisor https://review.openstack.org/391532 | 17:37 |
cloudnull | https://github.com/ansible/ansible/commits/stable-1.9 | 17:39 |
openstackgerrit | Marc GariƩpy proposed openstack/openstack-ansible-os_nova: Add CentOS support for os_nova https://review.openstack.org/378963 | 17:40 |
*** hj-hpe has joined #openstack-ansible | 17:40 | |
cloudnull | last update was a submodule update. there've been a few commits since then to allow rpms to be built | 17:40 |
agrebennikov | well... seems they fixed everything)) now it is ideally working | 17:41 |
cloudnull | before then the last real code change was https://github.com/ansible/ansible/commit/10a38a7652002053c5613fabd583a550115c08fb which again was fix the lxc module which they broke as noted here: https://github.com/ansible/ansible-modules-extras/issues/2042 | 17:41 |
cloudnull | anyway. | 17:42 |
cloudnull | glad it's working on the branch head though | 17:42 |
agrebennikov | ok, now Jessie just have to approve it | 17:42 |
*** Mudpuppy has joined #openstack-ansible | 17:43 | |
*** weezS has quit IRC | 17:44 | |
cloudnull | +2 from me | 17:44 |
cloudnull | now we need odyssey4me to remove his -2 | 17:44 |
agrebennikov | yep, saw it | 17:44 |
agrebennikov | tnx | 17:45 |
cloudnull | thank you for testing all of that | 17:45 |
*** javeriak has joined #openstack-ansible | 17:45 | |
agrebennikov | I'm deploying production)) this is why it is not just for fun for me | 17:45 |
*** javeriak has quit IRC | 17:46 | |
cloudnull | cool | 17:46 |
*** javeriak has joined #openstack-ansible | 17:46 | |
cloudnull | this is all with stable/mitaka? | 17:47 |
*** johnmilton has joined #openstack-ansible | 17:47 | |
*** Mudpuppy_ has joined #openstack-ansible | 17:48 | |
*** Mudpuppy has quit IRC | 17:51 | |
*** Mudpuppy_ is now known as Mudpuppy | 17:52 | |
*** admin0 has quit IRC | 17:55 | |
agrebennikov | cloudnull, correct | 17:56 |
*** chris_hultin|AWA is now known as chris_hultin | 17:57 | |
*** admin0 has joined #openstack-ansible | 17:58 | |
*** jheroux has quit IRC | 17:58 | |
mgariepy | can i do recheck before it has ended on zuul ? | 17:58 |
*** poopcat has joined #openstack-ansible | 17:59 | |
cloudnull | mgariepy: no. | 18:02 |
cloudnull | you have to upload a new patch to force it to rerun | 18:02 |
mgariepy | damn :*( | 18:02 |
mgariepy | or wait for the tests to complete.. | 18:02 |
*** poopcat has quit IRC | 18:05 | |
*** chhavi has quit IRC | 18:05 | |
*** poopcat has joined #openstack-ansible | 18:06 | |
cloudnull | that's an option too | 18:09 |
cloudnull | :) | 18:10 |
baz | Are container MTUs supposed to be sticky? IOW changing, or adding, the container_mtu value in openstack_user_config.yml, after inventory has been generated at least once, doesn't seem to update it in inventory. | 18:10 |
cloudnull | once you've set container_mtu I believe you need to rerun the lxc-container-create play in order for the container's to recieve the new value. | 18:14 |
*** worstadmin has joined #openstack-ansible | 18:16 | |
*** weezS has joined #openstack-ansible | 18:19 | |
*** admin0 has quit IRC | 18:25 | |
*** electrofelix has quit IRC | 18:29 | |
*** ableto has quit IRC | 18:33 | |
*** schwicht has quit IRC | 18:34 | |
*** schwicht has joined #openstack-ansible | 18:35 | |
*** weezS has quit IRC | 18:35 | |
*** weezS has joined #openstack-ansible | 18:35 | |
baz | cloudnull: I've even tried destroying the affected containers and rerunning, it wouldn't change the inventory. I worked around it by just editing the json and then the playbooks did the right thing. | 18:38 |
baz | the question is whether it's intended to be that way so you don't accidently shoot yourself in the foot by changing an MTU to be bigger than your layer 2 network is going to accept by changing it after first run. | 18:40 |
*** javeriak has quit IRC | 18:44 | |
*** javeriak has joined #openstack-ansible | 18:44 | |
*** h5t4 has joined #openstack-ansible | 18:46 | |
kylek3h | baz: Did you try setting lxc_net_mtu and lxc_container_default_mtu? I've been playing with running multi-VM OSA over vxlan networks (for testing) and I had to set those to 1450 to get that working. | 18:52 |
*** kvcobb has joined #openstack-ansible | 18:54 | |
*** hj-hpe has quit IRC | 18:59 | |
drifterza | weee | 19:01 |
dxiri | is there a way that I can check on the status of openstack as a whole? | 19:01 |
mgariepy | baz, I might be wrong but i don't think the different bridge are turned off and on again when it change the mtu. | 19:02 |
dxiri | I am seeing that "system information" on the dashboard usually says everything is fine, when in fact sometimes it isn't | 19:02 |
drifterza | no there isn't a way except looking at the logs | 19:03 |
drifterza | something being up doesn't mean it actually is working | 19:05 |
drifterza | :P | 19:05 |
drifterza | hence why we have a central syslog role | 19:05 |
*** javeriak has quit IRC | 19:05 | |
baz | it doesn't update openstack_inventory.json and as a result none of the files that are generated from the values stored there get the new value either. | 19:05 |
drifterza | What I found useful is putting logs into elasticsearch, makes it alot easier to identify issues | 19:06 |
*** h5t4 has quit IRC | 19:10 | |
*** retreved has quit IRC | 19:11 | |
*** h5t4 has joined #openstack-ansible | 19:12 | |
*** hybridpollo has joined #openstack-ansible | 19:17 | |
dxiri | ah...I don't have central logging yet, that's a good start | 19:41 |
*** aludwar has quit IRC | 19:42 | |
*** aludwar has joined #openstack-ansible | 19:43 | |
drifterza | yeah I usually tail -f /var/log/log-server/*/*.log | grep -i error | 20:04 |
drifterza | when you have the rsyslog central server up | 20:04 |
openstackgerrit | Nolan Brubaker proposed openstack/openstack-ansible: Check for configured groups in the environment https://review.openstack.org/383920 | 20:05 |
*** javeriak has joined #openstack-ansible | 20:06 | |
drifterza | or like tail -f /var/log/log-server/nova*/nova*.log | grep -i error | 20:06 |
drifterza | for service specific things | 20:06 |
*** strobelight has quit IRC | 20:09 | |
*** javeriak has quit IRC | 20:10 | |
*** flg has joined #openstack-ansible | 20:14 | |
*** marst has quit IRC | 20:14 | |
*** marst has joined #openstack-ansible | 20:14 | |
*** marst has quit IRC | 20:15 | |
*** marst has joined #openstack-ansible | 20:15 | |
*** h5t4 has quit IRC | 20:17 | |
*** marst has quit IRC | 20:19 | |
*** luzC has quit IRC | 20:20 | |
*** castulo has quit IRC | 20:20 | |
*** askb has joined #openstack-ansible | 20:32 | |
*** m4rx has joined #openstack-ansible | 20:32 | |
*** haad1 has joined #openstack-ansible | 20:35 | |
dxiri | does this looks right to you? physical_interface_mappings = flat:eth0,vlan:br-vlan | 20:37 |
dxiri | can the physical interface mapping be a bridge? | 20:37 |
dxiri | I'm assuming no | 20:37 |
dxiri | br-vlan is using eth0 phisically in my case | 20:37 |
*** dgonzalez has quit IRC | 20:42 | |
drifterza | no that doesnt look right | 20:46 |
drifterza | something like this physical_interface_mappings = vlan:eth11 | 20:47 |
drifterza | but thats on the neutron_agent_containers | 20:47 |
drifterza | it entirely depends how your openstack_user_config.yml file was configured | 20:47 |
*** javeriak has joined #openstack-ansible | 20:48 | |
cloudnull | dxiri: flat networks have to be an interface | 20:50 |
*** bazyar has joined #openstack-ansible | 20:50 | |
bazyar | Hola! | 20:51 |
cloudnull | while vlan type networks can be a bridge | 20:51 |
bazyar | I have a sort of embarassing question, in that the answer is likely to be really simple | 20:51 |
cloudnull | hola bazyar | 20:51 |
dxiri | hoa bazyar | 20:51 |
bazyar | We're doing an openstack ansible deployment, and when Creating an Image in horizon, the feature to load an Image from a URL is not present | 20:52 |
cloudnull | yup that's a thing | 20:52 |
cloudnull | glance v2 does not support that | 20:52 |
bazyar | What kind of a thing? :) | 20:52 |
bazyar | Oh that kind of a thing. | 20:52 |
dxiri | cloudnull: so you are saying that vlan:br-vlan is actually correct provided I have a br-vlan bridge? | 20:53 |
bazyar | okay, so, is there some kind of workaround that is viable for end users? Obviously the admins can pop into the CLI .. | 20:53 |
cloudnull | bazyar: so this is how i do remote image uploads https://github.com/openstack/openstack-ansible-ops/blob/master/multi-node-aio/openstack-service-setup.sh#L98-L105 | 20:54 |
cloudnull | otherwise you can download the image locally and then import it via horizon | 20:55 |
cloudnull | I think we can change it to use v1 | 20:56 |
cloudnull | but best I can tell that feature is gone in v2 https://ask.openstack.org/en/question/82889/rest-api-v2-create-image-with-url-to-copy-from/ | 20:59 |
cloudnull | ^ -cc neillc stevelle sigmavirus ? | 20:59 |
*** schwicht has quit IRC | 21:00 | |
*** chris_hultin is now known as chris_hultin|AWA | 21:00 | |
cloudnull | bazyar: also new in newton, there are no flavors so this may be helpful https://github.com/openstack/openstack-ansible-ops/blob/master/multi-node-aio/openstack-service-setup.sh#L7-L43 | 21:00 |
*** dgonzalez has joined #openstack-ansible | 21:01 | |
* cloudnull assuming this is a new deployment | 21:01 | |
bazyar | yes it's a new deployment | 21:01 |
bazyar | that's handy, thanks! | 21:03 |
cloudnull | sorry the news isn't better. | 21:03 |
bazyar | Well I suppose we can write a simple web app, put in your creds and a url | 21:03 |
bazyar | Maybe I will put in a feature request with Horizon | 21:04 |
cloudnull | that works. | 21:05 |
cloudnull | and if there's a way we can reenable it we should explore those options too. | 21:05 |
dxiri | drifterza: are there any special considerations for the central logging host? can It just be a vanilla ubuntu with a single IP and no bridge? | 21:05 |
cloudnull | dxiri: yes. | 21:05 |
drifterza | yes | 21:05 |
dxiri | cool thx :) | 21:06 |
cloudnull | when a vlan network is used neutron creates a vlan tagged interface which can be the bridge | 21:06 |
cloudnull | you'll see something like br-vlan@$SOMETAGID when its being used. | 21:06 |
dxiri | cloudnull: awesome, thanks :) | 21:08 |
*** m4rx has quit IRC | 21:13 | |
*** Hosam has joined #openstack-ansible | 21:18 | |
*** m4rx has joined #openstack-ansible | 21:18 | |
*** m4rx has quit IRC | 21:20 | |
*** askb has quit IRC | 21:21 | |
*** hughmFLEXin has quit IRC | 21:27 | |
*** hughmFLEXin has joined #openstack-ansible | 21:29 | |
*** v1k0d3n has joined #openstack-ansible | 21:35 | |
*** m4rx has joined #openstack-ansible | 21:36 | |
*** afred312_ has quit IRC | 21:37 | |
*** gouthamr has joined #openstack-ansible | 21:41 | |
*** m4rx has quit IRC | 21:45 | |
*** gouthamr has quit IRC | 21:45 | |
*** javeriak has quit IRC | 21:48 | |
*** flg has quit IRC | 21:51 | |
*** javeriak has joined #openstack-ansible | 21:52 | |
*** adrian_otto has joined #openstack-ansible | 21:55 | |
dxiri | guys, when you fix any bugs, do you make a new tag? or do you re-use the 14.0.0 tag for Newton (for example) | 21:57 |
*** hughmFLEXin has quit IRC | 21:59 | |
*** hughmFLEXin has joined #openstack-ansible | 21:59 | |
cloudnull | dxiri: as the release moves on we'll end up creating new tags | 22:03 |
*** afred312 has joined #openstack-ansible | 22:03 | |
cloudnull | the fixes will land in the branch and when ready a new tag will be cut | 22:03 |
*** hughmFLEXin has quit IRC | 22:04 | |
*** dxiri has quit IRC | 22:05 | |
*** dxiri has joined #openstack-ansible | 22:05 | |
*** hughmFLEXin has joined #openstack-ansible | 22:06 | |
*** chris_hultin|AWA is now known as chris_hultin | 22:20 | |
*** hughmFLEXin has quit IRC | 22:20 | |
*** hughmFLEXin has joined #openstack-ansible | 22:20 | |
*** kylek3h is now known as kylek3h_away | 22:28 | |
*** chris_hultin is now known as chris_hultin|AWA | 22:29 | |
*** weezS has quit IRC | 22:40 | |
*** agrebennikov has quit IRC | 22:43 | |
*** adrian_otto has quit IRC | 22:44 | |
stevelle | cloudnull: confirming that feature is not in v1 | 22:48 |
*** Mudpuppy has quit IRC | 22:48 | |
stevelle | err not in v2 | 22:48 |
stevelle | bazyar: there is no comparable feature for v2 API right now for end users. | 22:49 |
*** v1k0d3n has quit IRC | 22:49 | |
*** v1k0d3n has joined #openstack-ansible | 22:50 | |
*** v1k0d3n has quit IRC | 22:50 | |
*** admin0 has joined #openstack-ansible | 22:51 | |
*** haad1 has quit IRC | 22:54 | |
*** adrian_otto has joined #openstack-ansible | 22:54 | |
c-mart | I have a question about overriding the HAProxy configuration. It looks like it's mostly done in a big dictionary called `haproxy_default_services` | 22:54 |
c-mart | Let's I want to do things like turn SSL on for the keystone admin API, override the whitelist of networks that are allowed to connect, etc. | 22:55 |
c-mart | Right now I'm copying the entire `haproxy_default_services` dictionary from /opt/openstack-ansible/vars/configs/haproxy_config.yml into my user_variables.yml, and making tweaks to it in there. | 22:56 |
c-mart | Is that the generally recommended way to accomplish this? | 22:57 |
*** admin0 has quit IRC | 22:57 | |
c-mart | copying the dictionary into my user_variables.yml adds over 100 lines. when I only want to override 2 or 3 of the lines. | 22:58 |
cloudnull | c-mart: sadly we don't have ssl support for individual interfaces. the way it works right now is to ssl the public interface only all additional interfaces after that are http | 22:58 |
*** v1k0d3n has joined #openstack-ansible | 22:59 | |
cloudnull | we could add support for it | 22:59 |
cloudnull | most of the changes would be in the service.cfg.j2 | 22:59 |
cloudnull | file. | 22:59 |
*** thorst has joined #openstack-ansible | 23:00 | |
c-mart | cloudnull, it looks like the only difference between an SSL interface and a non-ssl interface is one line in haproxy.cfg. "ind 10.192.154.100:5000 ssl crt /etc/ssl/private/haproxy.pem ciphers ....." | 23:03 |
*** hughmFLEXin has quit IRC | 23:03 | |
c-mart | bind * | 23:03 |
cloudnull | yea we'd need to add a toggle allowint it to be used in places besides the public interface | 23:03 |
*** hughmFLEXin has joined #openstack-ansible | 23:03 | |
*** v1k0d3n has quit IRC | 23:03 | |
cloudnull | wow. i'm suckin right now at typing... *yea we'd need to add a toggle to allow it to be used in places besides the public interface* | 23:05 |
c-mart | I got you :) | 23:05 |
c-mart | it actually looks easy to override in the `haproxy_default_services` dictionary. the only difference with an SSL service (compared to a non-SSL service) is a line "haproxy_ssl: "{{ haproxy_ssl }}"". | 23:05 |
openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible: Updated envd configs for mixed virt and baremetal (ironic) https://review.openstack.org/391038 | 23:06 |
c-mart | and one line in roles/haproxy_server/templates/service.j2 parses that: "bind {{ vip_bind }}:{{ item.service.haproxy_port }} {% if (item.service.haproxy_ssl | default(false) | bool) and (loop.index == 1 or item.service.haproxy_ssl_all_vips | default(false) | bool) %}ssl crt {{ haproxy_ssl_pem }} ciphers {{ haproxy_ssl_cipher_suite }}{% endif %}" | 23:07 |
c-mart | unless there's more going on that I'm missing, it looks pretty doable. | 23:08 |
*** Hosam has quit IRC | 23:09 | |
*** Hosam has joined #openstack-ansible | 23:10 | |
*** admin0 has joined #openstack-ansible | 23:11 | |
*** javeriak has quit IRC | 23:11 | |
*** Hosam has quit IRC | 23:15 | |
*** smatzek has joined #openstack-ansible | 23:17 | |
*** thorst has quit IRC | 23:21 | |
*** thorst has joined #openstack-ansible | 23:24 | |
*** thorst has quit IRC | 23:32 | |
*** javeriak has joined #openstack-ansible | 23:33 | |
*** hughmFLEXin has quit IRC | 23:33 | |
*** adrian_otto has quit IRC | 23:34 | |
*** adrian_otto has joined #openstack-ansible | 23:41 | |
*** johnmilton has quit IRC | 23:42 | |
*** javeriak has quit IRC | 23:44 | |
*** adrian_otto has quit IRC | 23:54 | |
*** smatzek has quit IRC | 23:55 | |
*** javeriak has joined #openstack-ansible | 23:56 | |
*** LiYuenan has quit IRC | 23:56 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!