*** poul has quit IRC | 00:00 | |
*** threestrands has joined #openstack-ansible | 00:03 | |
*** threestrands has quit IRC | 00:03 | |
*** threestrands has joined #openstack-ansible | 00:03 | |
*** poul has joined #openstack-ansible | 00:07 | |
*** poul has quit IRC | 00:11 | |
*** tux_ has joined #openstack-ansible | 00:12 | |
*** poul has joined #openstack-ansible | 00:17 | |
*** poul has quit IRC | 00:21 | |
*** poul has joined #openstack-ansible | 00:28 | |
*** poul has quit IRC | 00:32 | |
*** toddnni_ has joined #openstack-ansible | 00:36 | |
*** toddnni has quit IRC | 00:36 | |
*** toddnni_ is now known as toddnni | 00:37 | |
*** poul has joined #openstack-ansible | 00:39 | |
*** shananigans has quit IRC | 00:40 | |
*** shananigans has joined #openstack-ansible | 00:40 | |
*** DimGR has quit IRC | 00:40 | |
*** DimGR has joined #openstack-ansible | 00:40 | |
*** hwoarang has quit IRC | 00:43 | |
*** poul has quit IRC | 00:44 | |
*** poul has joined #openstack-ansible | 00:50 | |
*** poul has quit IRC | 00:54 | |
*** poul has joined #openstack-ansible | 01:00 | |
*** poul has quit IRC | 01:05 | |
*** poul has joined #openstack-ansible | 01:11 | |
*** poul has quit IRC | 01:16 | |
*** threestrands_ has joined #openstack-ansible | 01:18 | |
*** threestrands_ has quit IRC | 01:19 | |
*** threestrands_ has joined #openstack-ansible | 01:20 | |
*** threestrands_ has quit IRC | 01:21 | |
*** threestrands_ has joined #openstack-ansible | 01:21 | |
*** threestrands_ has quit IRC | 01:21 | |
*** threestrands_ has joined #openstack-ansible | 01:21 | |
*** threestrands has quit IRC | 01:21 | |
*** poul has joined #openstack-ansible | 01:22 | |
*** poul has quit IRC | 01:26 | |
*** poul has joined #openstack-ansible | 01:32 | |
*** poul has quit IRC | 01:37 | |
*** poul has joined #openstack-ansible | 01:42 | |
*** poul has quit IRC | 01:46 | |
*** poul has joined #openstack-ansible | 01:52 | |
*** poul has quit IRC | 01:56 | |
*** poul has joined #openstack-ansible | 02:03 | |
*** poul has quit IRC | 02:08 | |
*** poul has joined #openstack-ansible | 02:14 | |
*** poul has quit IRC | 02:18 | |
*** poul has joined #openstack-ansible | 02:33 | |
*** poul has quit IRC | 02:38 | |
*** poul has joined #openstack-ansible | 02:44 | |
*** poul has quit IRC | 02:46 | |
*** poul has joined #openstack-ansible | 02:46 | |
*** poul has quit IRC | 02:51 | |
*** poul has joined #openstack-ansible | 02:57 | |
*** poul has quit IRC | 03:02 | |
*** huxinhui__ has quit IRC | 03:12 | |
*** poul has joined #openstack-ansible | 03:18 | |
*** poul has quit IRC | 03:23 | |
*** poul has joined #openstack-ansible | 03:29 | |
*** poul has quit IRC | 03:34 | |
*** poul has joined #openstack-ansible | 03:40 | |
*** poul has quit IRC | 03:45 | |
*** poul has joined #openstack-ansible | 03:51 | |
*** poul has quit IRC | 03:55 | |
*** Bhujay has joined #openstack-ansible | 04:00 | |
*** poul has joined #openstack-ansible | 04:01 | |
*** Bhujay has quit IRC | 04:05 | |
*** poul has quit IRC | 04:06 | |
*** poul has joined #openstack-ansible | 04:12 | |
*** poul has quit IRC | 04:17 | |
*** poul has joined #openstack-ansible | 04:22 | |
*** poul has quit IRC | 04:27 | |
*** Bhujay has joined #openstack-ansible | 04:30 | |
*** poul has joined #openstack-ansible | 04:33 | |
*** poul has quit IRC | 04:37 | |
*** poul has joined #openstack-ansible | 04:44 | |
*** cshen has joined #openstack-ansible | 04:47 | |
*** poul has quit IRC | 04:48 | |
*** cshen has quit IRC | 04:51 | |
*** poul has joined #openstack-ansible | 04:54 | |
*** poul has quit IRC | 04:59 | |
*** poul has joined #openstack-ansible | 05:05 | |
*** poul has quit IRC | 05:09 | |
*** tux_ has quit IRC | 05:12 | |
*** poul has joined #openstack-ansible | 05:14 | |
*** poul has quit IRC | 05:19 | |
*** poul has joined #openstack-ansible | 05:26 | |
*** poul has quit IRC | 05:30 | |
*** poul has joined #openstack-ansible | 05:36 | |
*** poul has quit IRC | 05:41 | |
*** yolanda has joined #openstack-ansible | 05:46 | |
*** poul has joined #openstack-ansible | 05:47 | |
*** Bhujay has quit IRC | 05:49 | |
*** poul has quit IRC | 05:51 | |
*** Bhujay has joined #openstack-ansible | 05:54 | |
*** geekinutah has quit IRC | 05:58 | |
*** geekinutah has joined #openstack-ansible | 05:58 | |
*** biffi has joined #openstack-ansible | 06:00 | |
*** saneax has joined #openstack-ansible | 06:11 | |
*** DanyC has joined #openstack-ansible | 06:20 | |
*** cshen has joined #openstack-ansible | 06:21 | |
*** DanyC has quit IRC | 06:33 | |
openstackgerrit | Nguyen Hung Phuong proposed openstack/openstack-ansible-rsyslog_client master: fix tox python3 overrides https://review.openstack.org/580919 | 06:35 |
---|---|---|
odyssey4me | evrardjp are you happy to proceed with https://review.openstack.org/580156 or do you want me to submit a patch on top which does something more? | 06:37 |
*** maybebuggy has joined #openstack-ansible | 06:39 | |
*** sante has joined #openstack-ansible | 06:47 | |
openstackgerrit | Tuan Do Anh proposed openstack/openstack-ansible-os_nova master: fix tox python3 overrides https://review.openstack.org/580925 | 06:49 |
*** sante has quit IRC | 06:54 | |
*** radeks has joined #openstack-ansible | 06:55 | |
*** mbuil has joined #openstack-ansible | 06:58 | |
*** sante has joined #openstack-ansible | 06:58 | |
evrardjp[m] | good morning odyssey4me | 06:59 |
odyssey4me | o/ | 06:59 |
* odyssey4me is still imbibing his first coffee | 07:00 | |
*** poul has joined #openstack-ansible | 07:02 | |
*** poul_ has joined #openstack-ansible | 07:03 | |
*** poul has quit IRC | 07:07 | |
evrardjp[m] | i haven't released on friday nor I got the chance to do it this weekend. I feel superbad about it. | 07:09 |
*** epalper has joined #openstack-ansible | 07:12 | |
odyssey4me | no worries, there's no time like the present | 07:15 |
*** mardim has joined #openstack-ansible | 07:23 | |
*** tosky has joined #openstack-ansible | 07:35 | |
*** hachi has joined #openstack-ansible | 07:36 | |
*** DanyC has joined #openstack-ansible | 07:40 | |
*** armaan has joined #openstack-ansible | 07:49 | |
*** armaan has quit IRC | 07:49 | |
*** armaan has joined #openstack-ansible | 07:50 | |
openstackgerrit | Merged openstack/openstack-ansible-tests master: Ensure remote_user and become are consistently implemented https://review.openstack.org/580156 | 07:54 |
*** ethfci has joined #openstack-ansible | 07:57 | |
*** rpittau has joined #openstack-ansible | 07:57 | |
*** gillesMo has joined #openstack-ansible | 08:03 | |
*** electrofelix has joined #openstack-ansible | 08:04 | |
*** linshuicheng[m] has quit IRC | 08:04 | |
*** asdf1234asdf[m] has quit IRC | 08:04 | |
*** keithmnemonic[m] has quit IRC | 08:05 | |
*** threestrands_ has quit IRC | 08:12 | |
*** rodolof has joined #openstack-ansible | 08:15 | |
*** asdf1234asdf[m] has joined #openstack-ansible | 08:25 | |
*** keithmnemonic[m] has joined #openstack-ansible | 08:27 | |
*** linshuicheng[m] has joined #openstack-ansible | 08:32 | |
odyssey4me | evrardjp & hwoarang FYI, some patches up to infra to monitor and perhaps also approve: https://review.openstack.org/580696 & https://review.openstack.org/580682 | 08:48 |
*** armaan has quit IRC | 08:54 | |
*** armaan has joined #openstack-ansible | 08:54 | |
openstackgerrit | Merged openstack/openstack-ansible-os_heat master: Execute service setup against a delegated host using Ansible built-in modules https://review.openstack.org/579663 | 08:57 |
*** kourosh has joined #openstack-ansible | 09:02 | |
openstackgerrit | Merged openstack/openstack-ansible-os_horizon master: Execute service setup against a delegated host using Ansible built-in modules https://review.openstack.org/579991 | 09:08 |
openstackgerrit | Merged openstack/openstack-ansible-os_glance master: Execute service setup against a delegated host using Ansible built-in modules https://review.openstack.org/568142 | 09:12 |
openstackgerrit | Merged openstack/openstack-ansible-os_ironic master: Execute service setup against a delegated host using Ansible built-in modules https://review.openstack.org/579514 | 09:15 |
evrardjp | odyssey4me: will do | 09:17 |
openstackgerrit | Tuan Do Anh proposed openstack/openstack-ansible-os_nova master: fix tox python3 overrides https://review.openstack.org/580925 | 09:19 |
*** vnogin has joined #openstack-ansible | 09:28 | |
openstackgerrit | Christian Zunker proposed openstack/openstack-ansible-openstack_hosts stable/pike: Fix template to load openvswitch module on boot https://review.openstack.org/580979 | 09:49 |
evrardjp | odyssey4me: what's the problem for keystone and cinder for the "Execute service setup against a delegated host" ? | 09:52 |
andymccr | if anybody wants to tickle some patches: https://review.openstack.org/#/q/topic:ansible-update+status:open | 09:54 |
andymccr | also this: https://review.openstack.org/#/c/580667/ | 09:54 |
odyssey4me | evrardjp I've noted the issue in my review comments for each of them | 09:54 |
odyssey4me | basically there is no module to do some of the tasks, so we have to upstream some things and I need to figure out a way to change the tasks to work with what we have for now | 09:55 |
odyssey4me | I just need a little more time for them - I'm getting the easier ones out the way first. | 09:56 |
evrardjp | odyssey4me: I haven't seen comments. | 09:58 |
evrardjp | sorry | 09:58 |
evrardjp | I might have not looked well :p | 09:58 |
odyssey4me | That's why they're marked -w for now. | 09:58 |
evrardjp | ok | 09:58 |
evrardjp | for cinder I am not surprised | 09:58 |
evrardjp | for keystone I willcheck what's missing | 09:58 |
evrardjp | andymccr: duely noted. | 09:59 |
evrardjp | I also have plenty of changes that could deserve some reviews. | 09:59 |
andymccr | i can do trades | 09:59 |
evrardjp | but nothign urgent | 09:59 |
odyssey4me | evrardjp for keystone, the issue is that we're not using the catalog - I had a chat with mordred and he clued me into a way to work around that... but we may not need to... I have an idea, just need to spend some time on it | 10:00 |
odyssey4me | you don't need to worry about all those, I'll do them - is there a reason you're worries about them? | 10:00 |
odyssey4me | *worried | 10:00 |
evrardjp | odyssey4me: I am not worried about anything, I just want to make sure we are consistent everywhere, so we reduce our tech debt. | 10:01 |
evrardjp | I am just tracking the status of this one, like every other project we have around : ) | 10:01 |
odyssey4me | yeah, don't worry - that's my aim, and I intend to get it done by M3 | 10:02 |
evrardjp | andymccr: reviewed. Reasonable! :P | 10:02 |
odyssey4me | I'll ping you if I get stuck. | 10:02 |
evrardjp | andymccr: ready for your next match against croatia? It should be okay : p | 10:02 |
andymccr | merci beaucoup | 10:02 |
andymccr | evrardjp: haha yeah now that russia are out, we dont have to fear the wrath of Putin. | 10:03 |
evrardjp | I'd pretty interesting to see my 2 favorite (but I didn't expect that !) countries in final | 10:03 |
evrardjp | andymccr: hahahah | 10:03 |
evrardjp | andymccr: you can barely deal with brexit nowadays | 10:03 |
evrardjp | let's not talk about further foreign politics! : p | 10:03 |
andymccr | haha england is one of your favourites? | 10:04 |
tosky | evrardjp, odyssey4me: so, there are few python3 mass-proposed changes like https://review.openstack.org/#/c/580064/ | 10:10 |
tosky | is it something that should be approved or postponed? That specific change as it is only touches doc and pep8 tox targets | 10:11 |
tosky | and venv, which I'm not sure it's used | 10:11 |
*** cshen has quit IRC | 10:19 | |
*** hachi has quit IRC | 10:20 | |
*** cshen has joined #openstack-ansible | 10:20 | |
openstackgerrit | Merged openstack/openstack-ansible-plugins master: Fix connection plugin to work with Ansible 2.6.0 https://review.openstack.org/580128 | 10:22 |
*** vnogin has quit IRC | 10:32 | |
*** hachi has joined #openstack-ansible | 10:33 | |
*** Bhujay has quit IRC | 10:33 | |
*** vnogin has joined #openstack-ansible | 10:34 | |
*** vnogin has quit IRC | 10:34 | |
evrardjp | tosky: let me check but I am not sure it matters to us right now. We are putting python3 on hold until it gets a better state for other projects | 10:41 |
evrardjp | however we follow the others -- if there is a change that's globally openstack, we should do it | 10:42 |
evrardjp | docs, release notes, and linting are fine for me to bump to python3 | 10:43 |
tosky | evrardjp: I thought so, thanks; I'm just not sure about the "venv" tox target, is it something really used? | 10:43 |
odyssey4me | evrardjp: I wonder whether docs/releasenotes even use the in-repo tox definitions any more? I suspect they may just be using native zuul jobs. If that is the case, then after M3 I think I'll push to eradicate tox from our testing altogether. | 10:43 |
evrardjp | odyssey4me: they don't | 10:43 |
tosky | odyssey4me: but they will be again | 10:43 |
evrardjp | tosky: oh really? | 10:44 |
odyssey4me | oh? | 10:44 |
tosky | let me find the link frm the tc discussion | 10:44 |
evrardjp | we kept it for user friendliness and compatibility | 10:44 |
tosky | https://review.openstack.org/580495 | 10:44 |
evrardjp | but for me, if we could get rid of it, that would be just fine | 10:44 |
tosky | so if that ^^ is built, the tox target for docs will have to stay | 10:45 |
evrardjp | yeah | 10:45 |
evrardjp | I see | 10:45 |
evrardjp | I like tox, so I am fine :) | 10:46 |
evrardjp | I just don't like what we are doing with it | 10:46 |
evrardjp | in OSA | 10:46 |
evrardjp | because it's pretty much hard to contain OSA in a tox environment, if you see what I mean :p | 10:46 |
*** armaan has quit IRC | 10:46 | |
odyssey4me | for docs/releasenotes - happy to leave it in - but for our functional tests tox is just confusing | 10:47 |
*** armaan has joined #openstack-ansible | 10:47 | |
evrardjp | odyssey4me: agreed | 10:47 |
evrardjp | this should be removed | 10:47 |
evrardjp | we define a clear line that way | 10:48 |
evrardjp | "that's something you can run on your machine without fear of pollution" -- "that's something you'll do on your machine, and get polluted" | 10:48 |
evrardjp | pollution is probably not the right wording. | 10:48 |
evrardjp | but you understood me | 10:48 |
*** sante has quit IRC | 10:49 | |
openstackgerrit | Jean-Philippe Evrard proposed openstack/openstack-ansible stable/queens: Update all SHAs for 17.0.7 https://review.openstack.org/580998 | 10:51 |
odyssey4me | heh, pollution - yeah I get you | 10:58 |
openstackgerrit | Jean-Philippe Evrard proposed openstack/openstack-ansible stable/pike: Update all SHAs for 16.0.16 https://review.openstack.org/581002 | 11:06 |
*** Bhujay has joined #openstack-ansible | 11:07 | |
*** maybebuggy has quit IRC | 11:09 | |
*** armaan has quit IRC | 11:10 | |
*** armaan has joined #openstack-ansible | 11:10 | |
*** hachi has quit IRC | 11:12 | |
ebbex_ | can we get this fix into stable/pike aswell? https://review.openstack.org/#/c/547650/ | 11:15 |
odyssey4me | ebbex_: if you submit a backport review, sure - if you're unable to, let us know and I'm sure we can sort that out | 11:19 |
ebbex_ | I tried to just suggest/cherry-pick it into stable/pike from the web-interface there, but there was a merge-conflict. How do I go about submitting a backport review? | 11:26 |
openstackgerrit | Jean-Philippe Evrard proposed openstack/openstack-ansible stable/ocata: Update all SHAs for 15.1.24 https://review.openstack.org/581009 | 11:27 |
ebbex_ | Nm, found some docs on it. I'll give it a go. | 11:30 |
*** guilhermesp has quit IRC | 11:31 | |
*** kaiokmo has quit IRC | 11:31 | |
*** ansmith has quit IRC | 11:34 | |
openstackgerrit | Erik Berg proposed openstack/openstack-ansible-os_neutron stable/pike: neutron_needs_openvswitch should be jinja, not a string https://review.openstack.org/581010 | 11:44 |
*** saneax has quit IRC | 11:48 | |
*** guilhermesp has joined #openstack-ansible | 11:50 | |
*** saneax has joined #openstack-ansible | 11:57 | |
mbuil | evrardjp: I need a bit of help. I consider the following bug as a problem in ODL and not in OSA, as I explain in the comments. I already reported it to ODL but I am not sure what should be the status of the bug then https://bugs.launchpad.net/openstack-ansible/+bug/1776799 | 11:58 |
openstack | Launchpad bug 1776799 in openstack-ansible "Instance can ping gw and google, but Fails to Reach Metadata server with ODL+OVS" [Undecided,Confirmed] - Assigned to Manuel Buil (mbuil) | 11:58 |
*** gillesMo has quit IRC | 12:06 | |
*** armaan has quit IRC | 12:16 | |
*** armaan has joined #openstack-ansible | 12:17 | |
*** tux_ has joined #openstack-ansible | 12:18 | |
kourosh | odyssey4me: https://review.openstack.org/#/c/580390/ is it clear now ? | 12:18 |
*** armaan has quit IRC | 12:21 | |
*** cjloader has joined #openstack-ansible | 12:23 | |
*** cjloader has quit IRC | 12:26 | |
*** tux_ has quit IRC | 12:27 | |
*** cjloader has joined #openstack-ansible | 12:41 | |
*** cjloader has quit IRC | 12:47 | |
evrardjp | mbuil: please tell why you think it's invalid for OSA in the bug and then change the status as invalid | 12:48 |
*** ansmith has joined #openstack-ansible | 12:49 | |
evrardjp | or I can mark it as invalid for you | 12:49 |
evrardjp | as long as you have documented why | 12:49 |
evrardjp | my mail provider's interface has started to crash under the weight of all the openstack emails in my mailbox :) | 12:50 |
evrardjp | hahaha | 12:50 |
evrardjp | 40k is nothing though. | 12:50 |
*** mgariepy has quit IRC | 12:53 | |
*** cjloader has joined #openstack-ansible | 12:57 | |
*** mgariepy has joined #openstack-ansible | 12:59 | |
*** cjloader has quit IRC | 13:02 | |
*** cjloader has joined #openstack-ansible | 13:03 | |
*** cjloader_ has joined #openstack-ansible | 13:07 | |
*** cjloader has quit IRC | 13:07 | |
*** hachi has joined #openstack-ansible | 13:09 | |
*** hachi has quit IRC | 13:11 | |
*** hachi has joined #openstack-ansible | 13:12 | |
mbuil | evrardjp: Ok, I'll summarize why I think it is invalid and mark it as invalid | 13:13 |
Tahvok | Hey guys! | 13:16 |
Tahvok | I'm having some issues with our production environment with 160 compute hosts and about 500 vms. We're started seeing some issues memcached, and upon checking it, it's hitting an open files limit issue. | 13:17 |
Tahvok | We've checked the memcached's process open files configuration, and saw that it's set to 1024 | 13:18 |
*** vakuznet has joined #openstack-ansible | 13:18 | |
Tahvok | But according to /etc/security/limits.conf it should be 2048 | 13:18 |
evrardjp | Tahvok: uncool : ( | 13:19 |
Tahvok | I wonder if anyone can check their environment to confirm that it's an lxc problem? | 13:19 |
Tahvok | cat /proc/<memcached pid>/limits | 13:20 |
evrardjp | sadly i don't have one I can use | 13:20 |
evrardjp | I had to destroy all my envs | 13:20 |
Tahvok | evrardjp: woaa.. | 13:20 |
vakuznet | review please https://review.openstack.org/#/c/578844/ | 13:20 |
Tahvok | odyssey4me: maybe you have any env to check it? | 13:20 |
evrardjp | mnaser: could you give your opinion on https://review.openstack.org/#/c/578844/1 ? It has been a back and forth forever... delte this, do not delete this... | 13:21 |
evrardjp | Tahvok: maybe the systemd unit too | 13:22 |
trident | Tahvok: I think we had to add "LimitNOFILE=8192" under [Service] in /etc/systemd/system/memcached.service.d/limits.conf to up that value. | 13:22 |
evrardjp | Tahvok: interestingly I have in my limits.conf | 13:23 |
evrardjp | memcache soft nofile 5120 │······················· | 13:23 |
evrardjp | memcache hard nofile 5120 │······················· | 13:23 |
evrardjp | but when I check my memcached process | 13:24 |
evrardjp | I get 4096 | 13:24 |
evrardjp | trident: you could have submitted a patch : ) | 13:25 |
evrardjp | we'd gladly have accepted it :) | 13:25 |
evrardjp | trident: anything else you saw? | 13:25 |
Tahvok | trident: I don't have any limits.conf file under /etc/systemd/system/memcached.service.d/ | 13:25 |
Tahvok | And /lib/systemd/system/memcached.service don't have any limit set | 13:27 |
trident | IIRC I didn't do the actual troubleshooting back when we had issues with it. I'll research a bit internally and see if that was all we did or if we saw anything else and will take a look at submitting a patch. | 13:27 |
trident | Tahvok: We only have two lines in that file: | 13:27 |
trident | [Service] | 13:27 |
trident | LimitNOFILE=8192 | 13:27 |
Tahvok | trident: what have set it? osa? | 13:27 |
trident | So we could very well have created it. | 13:27 |
trident | Let me check. | 13:28 |
Tahvok | I can try setting it manually, and if it works, I can submit a patch | 13:28 |
Tahvok | I've found templates/limits.conf.j2 file | 13:29 |
Tahvok | Checking now when it should work | 13:29 |
Tahvok | Accoring to the role it should be set only if memcached_connections > 1024 | 13:31 |
Tahvok | And it's defaulting to 1024 | 13:31 |
trident | Seems to have been there since newton. So what I remembered was probably pre-newton. | 13:34 |
trident | Now we just set "memcached_connections: 8192" and everything works. | 13:34 |
Tahvok | Yep, as it should | 13:35 |
Tahvok | Probably what should I do | 13:35 |
*** lbragstad has joined #openstack-ansible | 13:37 | |
Tahvok | trident: according to what have you set 8192? | 13:39 |
Tahvok | Perhaps you can also run the stats command to see the value of 'listen_disabled_num'? | 13:39 |
Tahvok | Just connect with nc inside the container 'nc 10.53.15.9 11211', and run 'stats' | 13:40 |
*** cjloader_ has quit IRC | 13:40 | |
cshen | Hello, do we still report bug at launchpad? | 13:47 |
*** armaan has joined #openstack-ansible | 13:49 | |
*** jwitko has joined #openstack-ansible | 13:49 | |
*** rmart04 has joined #openstack-ansible | 13:51 | |
trident | Tahvok: STAT listen_disabled_num 0 | 13:52 |
trident | Tahvok: It was probably based on some testing in some specific load scenario. I guess one size does not fit all there :) | 13:53 |
*** cmart has joined #openstack-ansible | 13:54 | |
Tahvok | According to https://github.com/memcached/memcached/wiki/ConfiguringServer#connection-limit | 13:54 |
Tahvok | Zero is bad, and you've probably hit the limit | 13:54 |
*** armaan has quit IRC | 13:54 | |
Tahvok | Or I don't understand the manual, and it's actually good | 13:55 |
*** armaan has joined #openstack-ansible | 13:55 | |
trident | "That value should be zero or close to zero." | 13:55 |
Tahvok | So if it's zero it's good, or I should update the limit? | 13:55 |
Tahvok | "An obscure named statistic counting the number of times memcached has hit its connection limit. " | 13:56 |
Tahvok | Ok, so it's good | 13:57 |
trident | Yes. "You may detect if your instance has been running out of connections by issuing a stats command and looking at "listen_disabled_num". That value should be zero or close to zero." | 13:57 |
trident | But still, even if you never hit the connection limit you could reach the open file limit if that is set too low in relation to the connection limit. | 13:58 |
openstackgerrit | Marc Gariépy (mgariepy) proposed openstack/openstack-ansible-os_neutron master: move haproxy to neutron-metadata_agent https://review.openstack.org/581037 | 13:58 |
Tahvok | trident: that's what I'm trying to understand from the role. Why it sets the connection limit as open files limit? | 13:59 |
*** armaan has quit IRC | 13:59 | |
openstackgerrit | Marc Gariépy (mgariepy) proposed openstack/openstack-ansible-os_neutron master: move haproxy to neutron-metadata_agent https://review.openstack.org/581037 | 14:00 |
openstackgerrit | Erik Berg proposed openstack/openstack-ansible-os_neutron master: Install openvswitch packages on 'ml2.ovs.dvr' configuration https://review.openstack.org/581039 | 14:00 |
mnaser | evrardjp: un | 14:03 |
mnaser | Hmm I didn’t to parse that chance | 14:03 |
evrardjp | ? | 14:03 |
mnaser | Why are we removing xtrabackup | 14:03 |
mnaser | (I’m on mobile so I’ll dig into it soon) | 14:03 |
evrardjp | mnaser: you have time | 14:03 |
openstackgerrit | Erik Berg proposed openstack/openstack-ansible-os_neutron stable/queens: Install openvswitch packages on 'ml2.ovs.dvr' configuration https://review.openstack.org/581040 | 14:04 |
openstackgerrit | Erik Berg proposed openstack/openstack-ansible-os_neutron stable/pike: Install openvswitch packages on 'ml2.ovs.dvr' configuration https://review.openstack.org/581041 | 14:04 |
evrardjp | mnaser: it's been months we've been installing/removing packages on centos -- mariadb especially. mhayden 's last changes made sure idempotency when running galera_client and galera_server was preserved, but it seems it's not the case anymore | 14:04 |
*** adcpdk has quit IRC | 14:04 | |
*** Bhujay has quit IRC | 14:07 | |
*** tux_ has joined #openstack-ansible | 14:14 | |
*** biffi has quit IRC | 14:15 | |
*** tux___ has joined #openstack-ansible | 14:18 | |
*** tux_ has quit IRC | 14:21 | |
cloudnull | mornings | 14:26 |
evrardjp | morning cloudnull | 14:28 |
mgariepy | http://logs.openstack.org/39/581039/1/check/openstack-ansible-functional-ubuntu-xenial/58c4226/job-output.txt.gz#_2018-07-09_14_29_27_533757 | 14:39 |
mgariepy | is there something wrong with the gate ? | 14:42 |
*** sgrasley_ has quit IRC | 14:43 | |
spotz | hey cloudnull | 14:46 |
mnaser | woah | 14:48 |
mnaser | thats weird | 14:48 |
mnaser | re mgariepy patch | 14:49 |
mgariepy | what's weird ? the hatop download failing to download ? | 14:49 |
mgariepy | or the patch itself ? | 14:49 |
mnaser | checking with infra | 14:49 |
mnaser | that hatop download failed | 14:49 |
mgariepy | haha ok ;) | 14:49 |
mnaser | oh you know what | 14:50 |
mnaser | mgariepy: i wonder if the create haproxy_hatop_download_path task is doing things right | 14:50 |
mnaser | but the interesting thing is it didn't go into 'changed' | 14:51 |
mnaser | remained at 'ok' | 14:51 |
mgariepy | did infra added a directory on the nodes ? | 14:51 |
openstackgerrit | caoyuan proposed openstack/openstack-ansible-ops master: Add role description section for Ops https://review.openstack.org/580865 | 14:52 |
*** radeks has quit IRC | 14:55 | |
*** throwsb1 has joined #openstack-ansible | 14:58 | |
*** chyka has joined #openstack-ansible | 15:04 | |
*** mbuil_ has joined #openstack-ansible | 15:04 | |
*** mbuil has left #openstack-ansible | 15:04 | |
*** mbuil has quit IRC | 15:04 | |
*** FrankZhang has joined #openstack-ansible | 15:05 | |
openstackgerrit | Marc Gariépy (mgariepy) proposed openstack/openstack-ansible-haproxy_server master: [DNM] debug haproxy https://review.openstack.org/581056 | 15:06 |
*** mbuil_ has quit IRC | 15:11 | |
*** mbuil has joined #openstack-ansible | 15:13 | |
*** mbuil has quit IRC | 15:17 | |
*** mbuil has joined #openstack-ansible | 15:19 | |
mgariepy | hmm.. mnaser haproxy_server is passing the download. | 15:19 |
mgariepy | rechecking my neutron patch to see. | 15:20 |
*** mwe1 has quit IRC | 15:21 | |
*** rodolof has quit IRC | 15:21 | |
*** mwe1 has joined #openstack-ansible | 15:23 | |
*** cjloader has joined #openstack-ansible | 15:35 | |
*** gyee has joined #openstack-ansible | 15:35 | |
openstackgerrit | Marc Gariépy (mgariepy) proposed openstack/openstack-ansible-os_neutron master: move haproxy to neutron-metadata_agent https://review.openstack.org/581037 | 15:39 |
*** poul_ has quit IRC | 15:39 | |
*** cjloader has quit IRC | 15:40 | |
*** kourosh has quit IRC | 15:43 | |
*** ivve has joined #openstack-ansible | 15:44 | |
*** cjloader has joined #openstack-ansible | 15:51 | |
*** rodolof has joined #openstack-ansible | 15:52 | |
*** cjloader has quit IRC | 15:55 | |
*** cshen_ has joined #openstack-ansible | 15:57 | |
*** cshen has quit IRC | 15:58 | |
openstackgerrit | Merged openstack/openstack-ansible-ops master: Correct log path and set handler https://review.openstack.org/580751 | 15:59 |
*** cshen_ has quit IRC | 16:01 | |
*** jamesdenton has quit IRC | 16:03 | |
mgariepy | mnaser, http://logs.openstack.org/37/581037/3/check/openstack-ansible-functional-centos-7/215a54e/logs/ara-report/result/a2242068-89c1-4d7b-95d1-be1dbb83a23a/ | 16:09 |
mgariepy | now i'm confused haha | 16:09 |
*** epalper has quit IRC | 16:19 | |
*** suggestable has quit IRC | 16:22 | |
jrosser | cloudnull: here's that refstack stuff i mentioned https://github.com/bbc/rd-ansible-refstack | 16:27 |
jrosser | running that repeatedly via jenkins shows some very inconsistent behaviour | 16:28 |
*** rmart04 has quit IRC | 16:30 | |
mnaser | jrosser: i think hogepodge would be interested in that ^ | 16:37 |
jrosser | theres a few loose ends we're just fixing up in there and maybe adding a travis ci config too | 16:39 |
jrosser | odd thing is that sometimes it runs really quickly, 2mins or so, and then other times 30mins | 16:40 |
*** mwe1 has quit IRC | 16:40 | |
*** cjloader has joined #openstack-ansible | 16:48 | |
*** cjloader has quit IRC | 16:53 | |
odyssey4me | jrosser: we found that to get consistent results from tempest, you have to runnin tempest | 16:54 |
odyssey4me | arggh | 16:54 |
odyssey4me | you have to run it in serial | 16:54 |
odyssey4me | multiple workers and the results are all over the place | 16:55 |
odyssey4me | different numbers of tests, different results | 16:55 |
*** chhagarw has joined #openstack-ansible | 16:58 | |
jrosser | odyssey4me: hmm interessting | 16:59 |
*** DanyC has quit IRC | 16:59 | |
*** DanyC has joined #openstack-ansible | 17:00 | |
*** cshen has joined #openstack-ansible | 17:02 | |
*** cjloader has joined #openstack-ansible | 17:03 | |
jrosser | odyssey4me: yes actually we've also seen the variable number of tests too | 17:03 |
*** DanyC has quit IRC | 17:04 | |
*** hachi has quit IRC | 17:06 | |
*** cshen has quit IRC | 17:07 | |
*** cjloader has quit IRC | 17:07 | |
*** cjloader has joined #openstack-ansible | 17:14 | |
*** cjloader has quit IRC | 17:19 | |
*** poopcat has joined #openstack-ansible | 17:20 | |
*** cjloader has joined #openstack-ansible | 17:32 | |
*** cjloader has quit IRC | 17:37 | |
*** cjloader has joined #openstack-ansible | 17:50 | |
*** cjloader has quit IRC | 17:54 | |
mgariepy | anyone here is doing pci passthrough with nova ? | 18:02 |
*** poul has joined #openstack-ansible | 18:06 | |
*** rodolof has quit IRC | 18:07 | |
tux___ | Folks, Does ceph bluestore need journal ? | 18:08 |
mgariepy | tux___, there is the block.wal and the block.db | 18:09 |
tux___ | so i need SSD for them right? | 18:10 |
tux___ | its not journal but kind of | 18:10 |
mgariepy | on my server i am only using db and not wal | 18:12 |
tux___ | Can i ask why and what is the best way? | 18:12 |
mgariepy | the wal will be on the db device, if not separated. | 18:12 |
mgariepy | tux___, https://ceph.com/community/new-luminous-bluestore/ | 18:15 |
*** poul has quit IRC | 18:19 | |
*** poul has joined #openstack-ansible | 18:27 | |
*** cmart has quit IRC | 18:29 | |
*** poul has quit IRC | 18:29 | |
*** cjloader has joined #openstack-ansible | 18:32 | |
*** electrofelix has quit IRC | 18:36 | |
*** cjloader has quit IRC | 18:37 | |
*** tux_ has joined #openstack-ansible | 18:41 | |
*** tux___ has quit IRC | 18:42 | |
*** tux__ has joined #openstack-ansible | 18:42 | |
*** poul has joined #openstack-ansible | 18:44 | |
*** tux_ has quit IRC | 18:45 | |
*** poul has quit IRC | 18:49 | |
*** cshen has joined #openstack-ansible | 18:56 | |
*** cshen has quit IRC | 19:00 | |
*** cmart has joined #openstack-ansible | 19:06 | |
*** cshen has joined #openstack-ansible | 19:10 | |
openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-ops master: Add dynamic retention policies to currator https://review.openstack.org/581118 | 19:15 |
cloudnull | jrosser ^ should help with storage policies based on Elastic-Stack environment side | 19:16 |
cloudnull | **size | 19:16 |
*** poul has joined #openstack-ansible | 19:19 | |
*** poul has quit IRC | 19:23 | |
*** tosky has quit IRC | 19:23 | |
*** cjloader has joined #openstack-ansible | 19:32 | |
*** cjloader has quit IRC | 19:37 | |
*** poul has joined #openstack-ansible | 19:37 | |
*** poul has quit IRC | 19:41 | |
jrosser | cloudnull: ah yes, it's barely touching my storage so far | 19:42 |
jrosser | there's a video from elastic somewhere on youtube where they show how to caclulate how much data to put on each node | 19:43 |
jrosser | for a given query response time | 19:44 |
cloudnull | I kinda adapted their logic with what we're seeing in prod env's now | 19:52 |
*** poul has joined #openstack-ansible | 19:54 | |
openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-ops master: Add dynamic retention policies to currator https://review.openstack.org/581118 | 19:57 |
*** poul has quit IRC | 19:59 | |
*** hachi has joined #openstack-ansible | 19:59 | |
*** mardim has quit IRC | 20:02 | |
ebbex_ | Is 'currator' a project that's misspelled on purpose? | 20:05 |
cloudnull | ebbex_ nope . i just made a typo | 20:24 |
cloudnull | :) | 20:24 |
evrardjp | hey everyone | 20:31 |
*** FrankZhang has quit IRC | 20:31 | |
evrardjp | I have a conflicting schedule tomorrow -- I most likely won't be able to attend the meeting at all | 20:32 |
*** cjloader has joined #openstack-ansible | 20:32 | |
cloudnull | o/ evrardjp | 20:32 |
evrardjp | mnaser: are you still fine for running the meeting? | 20:32 |
evrardjp | cloudnull: hey | 20:32 |
evrardjp | if mnaser is not available, could you run the meeting cloudnull ? | 20:32 |
evrardjp | or anyone else | 20:32 |
evrardjp | I'll remind this tomorrow | 20:33 |
cloudnull | sure thing | 20:33 |
evrardjp | cool | 20:33 |
evrardjp | thanks | 20:33 |
* cloudnull checks schedule just to make sure | 20:33 | |
cloudnull | ++ | 20:33 |
cloudnull | im free. | 20:33 |
cloudnull | between mnaser and I we can tag team it | 20:33 |
mnaser | Yep we can do it together too. I should be okay. | 20:34 |
mnaser | But if cloudnull can offload that would be good | 20:34 |
cloudnull | ++ | 20:34 |
cloudnull | ill run it tomorrow, np | 20:34 |
*** cjloader has quit IRC | 20:36 | |
openstackgerrit | Andy Smith proposed openstack/openstack-ansible-os_barbican master: Update to use oslo.messaging service for RPCand Notify https://review.openstack.org/574864 | 20:36 |
tux__ | Quick question, can we boot machine with Cinder volume? | 20:37 |
cloudnull | tux__ yes | 20:39 |
tux__ | Cool! | 20:39 |
tux__ | cloudnull: I am planning to put cinder on Ceph and boot machine with shared storage.. | 20:39 |
*** poul has joined #openstack-ansible | 20:39 | |
tux__ | is there any performance issue Cinder vs nova disk boot? | 20:40 |
*** ansmith has quit IRC | 20:41 | |
cloudnull | if you have nova w/ ceph and cinder w/ ceph it should all be the same performance profile | 20:42 |
*** poul has quit IRC | 20:44 | |
*** hachi has quit IRC | 20:48 | |
*** cjloader has joined #openstack-ansible | 20:49 | |
*** tux__ has quit IRC | 20:53 | |
*** cjloader has quit IRC | 20:54 | |
*** vakuznet has quit IRC | 20:57 | |
*** vakuznet has joined #openstack-ansible | 20:58 | |
openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-ops master: Add dynamic retention policies to curator https://review.openstack.org/581118 | 21:02 |
*** walk has joined #openstack-ansible | 21:19 | |
*** walk has quit IRC | 21:29 | |
*** jwitko has quit IRC | 21:31 | |
*** cjloader has joined #openstack-ansible | 21:32 | |
*** nurdie has joined #openstack-ansible | 21:32 | |
*** hachi has joined #openstack-ansible | 21:33 | |
*** poul has joined #openstack-ansible | 21:33 | |
*** cjloader has quit IRC | 21:37 | |
*** poul has quit IRC | 21:38 | |
*** vakuznet has quit IRC | 21:38 | |
d34dh0r53 | cloudnull: ping | 21:41 |
*** poul has joined #openstack-ansible | 21:42 | |
cloudnull | pong | 21:43 |
*** mattinator has joined #openstack-ansible | 21:43 | |
*** poopcat has quit IRC | 21:43 | |
*** poopcat has joined #openstack-ansible | 21:44 | |
d34dh0r53 | cloudnull: nvm, I think I found it, gonna do https://github.com/openstack/openstack-ansible/blob/7b2c3d377ac6f52756ef9272a9f74717ea19843c/doc/source/contributor/periodic-work.rst for pike as there is a critical bug we need to pull in | 21:45 |
*** cshen has quit IRC | 21:45 | |
cloudnull | okydokie :) | 21:46 |
cloudnull | is there a PR you need to have reviewed ? | 21:46 |
*** poul has quit IRC | 21:47 | |
d34dh0r53 | cloudnull: not yet | 21:49 |
cloudnull | typie typie :D | 21:50 |
openstackgerrit | David Wilde proposed openstack/openstack-ansible-os_glance stable/pike: [New files - needs update] Update paste, policy and rootwrap configurations 2018-07-09 https://review.openstack.org/581142 | 21:51 |
openstackgerrit | David Wilde proposed openstack/openstack-ansible-os_neutron stable/pike: Update paste, policy and rootwrap configurations 2018-07-09 https://review.openstack.org/581143 | 21:52 |
*** cshen has joined #openstack-ansible | 21:56 | |
*** poul has joined #openstack-ansible | 22:00 | |
*** cshen has quit IRC | 22:00 | |
openstackgerrit | David Wilde proposed openstack/openstack-ansible stable/pike: Update all SHAs for 16.0.15 https://review.openstack.org/581147 | 22:02 |
d34dh0r53 | nvm that | 22:04 |
*** poul has quit IRC | 22:06 | |
*** cmart has quit IRC | 22:13 | |
*** throwsb1 has quit IRC | 22:18 | |
*** poul has joined #openstack-ansible | 22:19 | |
*** threestrands_ has joined #openstack-ansible | 22:20 | |
*** poul has quit IRC | 22:23 | |
*** jappleii__ has joined #openstack-ansible | 22:23 | |
*** jappleii__ has quit IRC | 22:24 | |
*** jappleii__ has joined #openstack-ansible | 22:25 | |
*** threestrands_ has quit IRC | 22:26 | |
*** nurdie has quit IRC | 22:27 | |
*** nurdie has joined #openstack-ansible | 22:28 | |
*** hachi has quit IRC | 22:30 | |
*** cjloader has joined #openstack-ansible | 22:32 | |
*** KeithMnemonic has joined #openstack-ansible | 22:32 | |
*** nurdie has quit IRC | 22:32 | |
*** cjloader has quit IRC | 22:36 | |
*** poul has joined #openstack-ansible | 22:36 | |
*** poul has quit IRC | 22:40 | |
openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-ops master: Add dynamic retention policies to curator https://review.openstack.org/581118 | 22:44 |
*** poul has joined #openstack-ansible | 22:46 | |
*** tux_ has joined #openstack-ansible | 22:50 | |
*** poul has quit IRC | 22:50 | |
openstackgerrit | David Wilde proposed openstack/openstack-ansible stable/pike: Updates Neutron SHA https://review.openstack.org/581155 | 22:54 |
*** tux_ has quit IRC | 22:55 | |
*** BeardedTraveler has joined #openstack-ansible | 22:55 | |
openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-ops master: Add dynamic retention policies to curator https://review.openstack.org/581118 | 22:58 |
*** mattinator has quit IRC | 23:00 | |
*** pmannidi has joined #openstack-ansible | 23:00 | |
openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-ops master: Add dynamic retention policies to curator https://review.openstack.org/581118 | 23:03 |
*** poul has joined #openstack-ansible | 23:04 | |
*** yolanda_ has joined #openstack-ansible | 23:06 | |
*** poul has quit IRC | 23:08 | |
*** yolanda has quit IRC | 23:09 | |
*** ianychoi_ has joined #openstack-ansible | 23:21 | |
*** poul has joined #openstack-ansible | 23:21 | |
*** poopcat1 has joined #openstack-ansible | 23:22 | |
*** poopcat has quit IRC | 23:22 | |
*** toddnni has quit IRC | 23:23 | |
*** toddnni has joined #openstack-ansible | 23:24 | |
*** gyee has quit IRC | 23:25 | |
*** ianychoi has quit IRC | 23:25 | |
*** poul has quit IRC | 23:27 | |
*** gyee has joined #openstack-ansible | 23:28 | |
*** cjloader has joined #openstack-ansible | 23:32 | |
*** BeardedTraveler has quit IRC | 23:36 | |
*** cjloader has quit IRC | 23:36 | |
*** poul has joined #openstack-ansible | 23:40 | |
*** BeardedTraveler has joined #openstack-ansible | 23:41 | |
*** poul has quit IRC | 23:44 | |
openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible master: Update all SHAs for milestone 3 https://review.openstack.org/574006 | 23:50 |
*** poul has joined #openstack-ansible | 23:57 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!