Tuesday, 2015-09-08

« Monday, 2015-09-07 Index Wednesday, 2015-09-09 »
openstackgerritFei Long Wang proposed openstack/zaqar: Fix 500 error when adding pool to wrong group  https://review.openstack.org/22112200:05
*** davideagnello has quit IRC00:15
*** Qiming__ has quit IRC00:24
*** Qiming__ has joined #openstack-zaqar01:25
*** david-ly_ has joined #openstack-zaqar01:51
*** david-lyle has quit IRC01:54
*** zxyf has joined #openstack-zaqar02:15
*** davideagnello has joined #openstack-zaqar02:15
*** davideagnello has quit IRC02:21
*** zxyf has quit IRC02:33
*** zxyf has joined #openstack-zaqar02:33
openstackgerritFei Long Wang proposed openstack/zaqar: Fix duplicated queues on multi pools  https://review.openstack.org/22114203:14
openstackgerritFei Long Wang proposed openstack/zaqar: Fix 500 error when adding pool to wrong group  https://review.openstack.org/22112203:16
*** Qiming__ has quit IRC03:29
*** Qiming__ has joined #openstack-zaqar03:29
*** csoukup has joined #openstack-zaqar03:34
*** zxyf has quit IRC03:42
*** zxyf has joined #openstack-zaqar03:43
*** zxyf has quit IRC03:50
*** zxyf has joined #openstack-zaqar03:50
*** zxyf has quit IRC04:37
*** zxyf has joined #openstack-zaqar04:38
*** zxyf has quit IRC04:42
*** zxyf has joined #openstack-zaqar04:43
*** csoukup has quit IRC04:59
*** zxyf has quit IRC04:59
*** flwang1 has quit IRC05:07
*** csoukup has joined #openstack-zaqar05:15
*** davideagnello has joined #openstack-zaqar05:16
*** csoukup has quit IRC05:19
*** zxyf has joined #openstack-zaqar05:31
*** davideagnello has quit IRC05:38
*** diga has joined #openstack-zaqar06:36
*** fifieldt has joined #openstack-zaqar07:13
openstackgerritFlavio Percoco proposed openstack/python-zaqarclient: WIP: Allow for authentication in functional tests  https://review.openstack.org/22117507:31
*** davideagnello has joined #openstack-zaqar07:38
openstackgerritFlavio Percoco proposed openstack/zaqar: WIP: Fixing gate  https://review.openstack.org/22106807:40
openstackgerritFlavio Percoco proposed openstack/zaqar: Don't set keystone as auth if not enabled  https://review.openstack.org/22117907:40
*** davideagnello has quit IRC07:43
*** achanda has joined #openstack-zaqar07:43
*** dynarro has joined #openstack-zaqar07:51
openstackgerritDoraly Navarro proposed openstack/python-zaqarclient: Added support to v2  https://review.openstack.org/20923807:57
*** zxyf has quit IRC08:00
openstackgerritFlavio Percoco proposed openstack/zaqar: WIP: Fixing gate  https://review.openstack.org/22106808:17
*** achanda has quit IRC08:25
*** achanda has joined #openstack-zaqar08:28
*** gzhai has quit IRC08:30
*** exploreshaifali has joined #openstack-zaqar08:31
openstackgerritFlavio Percoco proposed openstack/zaqar: WIP: Fixing gate  https://review.openstack.org/22106808:39
*** achanda has quit IRC08:52
dynarroflaper87, my patch for v2 is green!08:58
dynarroyay!08:58
openstackgerritFlavio Percoco proposed openstack/zaqar: WIP: Fixing gate  https://review.openstack.org/22106809:01
flaper87dynarro: w0000000000h00000! I just noticed09:01
flaper87greast work, I'll review asap09:01
flaper87great, even09:02
*** diga has quit IRC09:13
dynarro=)09:15
openstackgerritFlavio Percoco proposed openstack/python-zaqarclient: WIP: Allow for authentication in functional tests  https://review.openstack.org/22117509:32
openstackgerritFlavio Percoco proposed openstack/zaqar: WIP: Fixing gate  https://review.openstack.org/22106809:33
*** davideagnello has joined #openstack-zaqar09:39
*** dynarro has quit IRC09:42
*** davideagnello has quit IRC09:44
flaper87therve: https://jenkins05.openstack.org/job/gate-tempest-dsvm-redis-zaqar/77/console almost there10:01
flaper87:)10:01
flaper87I think mongodb's is throwing other weird errors but I'll look at that after lunch10:01
flaper87just wanted to share the good news10:01
therveIt runs stuff :)10:02
flaper87yeah, it uses keystone too10:02
flaper87and some of them say "ok"10:02
flaper87which is not to trust most of the time10:02
flaper87but hey, one step at a time10:02
therveHeh heh10:03
*** Qiming__ has quit IRC10:28
*** flwang1 has joined #openstack-zaqar11:18
openstackgerritFlavio Percoco proposed openstack/python-zaqarclient: WIP: Allow for authentication in functional tests  https://review.openstack.org/22117511:21
*** flwang1 has quit IRC11:26
*** Qiming__ has joined #openstack-zaqar11:27
flaper87therve: http://logs.openstack.org/68/221068/12/check/gate-tempest-dsvm-mongodb-zaqar/8a2afbb/console.html11:30
flaper87closer and closer11:30
flaper87now I gotta figure out where all those BadStatusLines are coming from11:30
flaper87well, in that specific job, zaqar didn't start11:31
flaper87but in the redis one, it succeeded in most of the tests but 211:31
flaper87http://logs.openstack.org/68/221068/12/check/gate-tempest-dsvm-mongodb-zaqar/8a2afbb/logs/screen-zaqar-wsgi.txt.gz11:32
flaper87ohhh11:34
* flaper87 found something11:34
openstackgerritFlavio Percoco proposed openstack/zaqar: WIP: Fixing gate  https://review.openstack.org/22106811:38
openstackgerritFlavio Percoco proposed openstack/zaqar: Enable pooling for redis' job  https://review.openstack.org/22126411:38
*** davideagnello has joined #openstack-zaqar11:40
*** davideagnello has quit IRC11:45
*** flwang1 has joined #openstack-zaqar11:48
openstackgerritFlavio Percoco proposed openstack/zaqar: WIP: Fixing gate  https://review.openstack.org/22106811:59
flaper87awesome, the redis gate was using mongodb11:59
flaper87AWESOME!12:00
flaper87no wonder it was green12:00
ryansblololol12:18
*** flwang1 has quit IRC12:26
*** flwang1 has joined #openstack-zaqar12:26
openstackgerritFlavio Percoco proposed openstack/python-zaqarclient: WIP: Allow for authentication in functional tests  https://review.openstack.org/22117512:32
openstackgerritFlavio Percoco proposed openstack/python-zaqarclient: Pass `group` in pool's functional tests  https://review.openstack.org/22127812:32
*** flwang1 has quit IRC12:42
openstackgerritFlavio Percoco proposed openstack/zaqar: WIP: Fixing gate  https://review.openstack.org/22106812:43
*** diga has joined #openstack-zaqar12:46
*** sriram has joined #openstack-zaqar13:00
flaper87now I gotta understand why these 2 calls are messing w/ me: http://logs.openstack.org/68/221068/15/check/gate-tempest-dsvm-mongodb-zaqar/5eabbbe/console.html13:00
flaper87there's something borked in those tests when it comes to deleting the pool13:00
flaper87and I think this is a client bug13:00
*** diga has quit IRC13:16
openstackgerritFlavio Percoco proposed openstack/zaqar: WIP: Fixing gate  https://review.openstack.org/22106813:22
*** exploreshaifali has quit IRC13:27
*** dynarro has joined #openstack-zaqar13:27
*** amitgandhinz has joined #openstack-zaqar13:37
*** diga has joined #openstack-zaqar13:47
openstackgerritFlavio Percoco proposed openstack/zaqar: WIP: Fixing gate  https://review.openstack.org/22106813:56
*** csoukup has joined #openstack-zaqar14:21
*** david-ly_ is now known as david-lyle14:53
*** fifieldt has quit IRC15:00
*** stanchan has quit IRC15:04
*** malini has joined #openstack-zaqar15:12
openstackgerritDoraly Navarro proposed openstack/python-zaqarclient: Added v1 folder  https://review.openstack.org/21615915:22
*** bradjones has joined #openstack-zaqar15:28
*** bradjones has joined #openstack-zaqar15:28
*** Qiming__ has quit IRC15:35
*** malini has quit IRC15:53
*** malini has joined #openstack-zaqar15:53
*** malini has quit IRC16:22
*** malini has joined #openstack-zaqar16:22
flaper87dyna16:28
flaper87ops16:28
flaper87http://logs.openstack.org/68/221068/17/check/gate-tempest-dsvm-redis-zaqar/8451ae0/logs/etc/zaqar/zaqar.conf.txt.gz16:30
flaper87whyyyyyyyyyyyyyy16:30
flaper87T_T16:30
flaper87can't get the redis gate to use... redis16:30
flaper87I'll beat this, I will16:30
*** achanda has joined #openstack-zaqar16:32
*** davideagnello has joined #openstack-zaqar16:44
*** malini has quit IRC16:44
*** malini has joined #openstack-zaqar16:47
*** sriram1 has joined #openstack-zaqar16:51
*** sriram has quit IRC16:51
*** malini has quit IRC16:52
*** malini has joined #openstack-zaqar16:55
*** achanda has quit IRC16:56
*** achanda_ has joined #openstack-zaqar16:56
*** kgriffs is now known as kgriffs|afk17:00
*** malini has quit IRC17:03
*** achanda_ has quit IRC17:08
*** achanda has joined #openstack-zaqar17:21
*** diga has quit IRC17:21
*** dynarro has quit IRC17:38
*** exploreshaifali has joined #openstack-zaqar17:42
flaper87this channel is dead today :(18:30
ryansbwe've just been enjoying your solo act18:31
*** openstackgerrit has quit IRC18:31
exploreshaifalilol18:31
ryansbsee?18:31
*** openstackgerrit has joined #openstack-zaqar18:31
*** malini has joined #openstack-zaqar18:31
vkmcexactly18:31
flaper87ryansb: looooooooooooooooooool18:33
flaper87it's been fun, hasn't it?18:33
*** achanda has quit IRC18:40
*** achanda has joined #openstack-zaqar18:41
openstackgerritFlavio Percoco proposed openstack/zaqar: WIP: Fixing gate  https://review.openstack.org/22106818:52
* flaper87 round 218:53
* vkmc gets more popcorn18:53
angvpvkmc: uhhhh18:54
* flaper87 prepares some pasta for the crowd18:54
angvpflaper87: which one?18:54
flaper87angvp: does that even matter? :P18:55
vkmchttp://d2ws0xxnnorfdo.cloudfront.net/character/tile/koala-cant-believe-it.jpg18:55
flaper87it's pasta... you just eat18:55
flaper87LOL18:55
flaper87that pretty much shows my face earlier today waiting for the gate's results18:55
vkmchahaah18:55
angvpflaper87: it always matter, is like the fried arepa with the hole in the middle it tastes better18:56
*** achanda has quit IRC18:57
flaper87angvp: oh my god, that's so true. I dunno what's up with that freaking hole but it just makes the arepa better18:58
flaper87brb18:59
*** malini has quit IRC19:06
*** sriram1 has quit IRC19:07
*** sriram1 has joined #openstack-zaqar19:07
*** sriram1 is now known as sriram19:07
*** malini has joined #openstack-zaqar19:07
exploreshaifalito code for "flavor_update" cli how will we fetch data first for the flavor that user want to update?19:21
openstackgerritFlavio Percoco proposed openstack/zaqar: WIP: Fixing gate  https://review.openstack.org/22106819:31
*** achanda has joined #openstack-zaqar19:38
*** achanda has quit IRC19:45
*** kgriffs|afk is now known as kgriffs19:46
*** malini has left #openstack-zaqar19:51
flaper87http://logs.openstack.org/68/221068/19/check/gate-tempest-dsvm-redis-zaqar/2edd330/logs/etc/zaqar/zaqar.conf.txt.gz20:00
flaper87success!20:00
flaper87now, I need to figure out why the gate is failing20:01
flaper87:P20:01
flaper87http://logs.openstack.org/68/221068/19/check/gate-tempest-dsvm-redis-zaqar/2edd330/logs/screen-zaqar-wsgi.txt.gz#_2015-09-08_19_49_57_61420:02
flaper87which seems simple enough20:02
flaper87:P20:02
*** exploreshaifali has quit IRC20:31
*** achanda has joined #openstack-zaqar20:41
*** achanda has quit IRC20:51
*** achanda has joined #openstack-zaqar20:54
*** kgriffs is now known as kgriffs|afk20:55
*** flwang1 has joined #openstack-zaqar21:09
*** sriram has quit IRC21:15
flwang1flaper87: ping21:26
flaper87flwang1: pong21:29
flwang1flaper87: do you know what's the rule for py34 test case skip?21:30
flwang1flaper87:  see http://logs.openstack.org/42/221142/1/check/gate-zaqar-python34/4fbecf5/testr_results.html.gz21:30
*** amitgandhinz has quit IRC21:31
flwang1my patch just passed py34 and failed py27, then i checked the log, i found most of the case of py34 are skipped21:31
flaper87mmhh21:35
flaper87that's weird21:35
*** achanda has quit IRC21:35
flaper87I think there's an evil gnome messing w/ our gate21:35
flaper87py34 tests did run before21:35
*** achanda has joined #openstack-zaqar21:35
flaper87and they did pass21:35
flaper87>.>21:35
flaper87I'm willing to go back in history just to prove this21:35
flwang1flaper87: ok, I will run it locally21:36
flwang1i just pop the question to see if there is a quick answer :)21:36
flaper87flwang1: lemme run if tests are executed locally21:36
flwang1cool, i'm going to do that either21:37
flwang1flaper87: btw, i have another question about pool21:40
flwang1flaper87: for now, we doesn't provide an endpoint to list all the available pool group, so how the operator to know the existing pool group?21:40
flaper87flwang1: does that really matter?21:41
flaper87honest question21:41
flaper87Listing pools is important and it provides information about the pools like groups21:42
flwang1flaper87: yep, i know. i think that's the only way to know the group,  by your eyes ;D21:42
*** achanda_ has joined #openstack-zaqar21:44
flwang1flaper87: and i'm trying to figure out your comments in https://review.openstack.org/#/c/220849/21:44
*** achanda has quit IRC21:44
flwang1for py34, i got the similar  result like gate,  PASSED (id=656, skips=608)21:47
flaper87mmh, that's weird21:49
flaper87I'll have to look into that too21:49
flwang1flaper87: ok, i will keep an eye either21:49
flwang1flaper87: are you running to bed or you will still be online for a while?21:50
flaper87flwang1: I'll be on-line for a bit, trying to get redis' gate working21:51
flaper87well, the gate in general21:51
flaper87:P21:51
flwang1flaper87: cool, so another question for the pools21:51
flwang1about this patch, https://review.openstack.org/#/c/220849/21:52
flwang1you said the None is a valid query condition for pool group21:52
flwang1so it triggered several questions21:52
flwang1the pool group listing is the 1st, like i asked above21:53
flaper87WHY DID I SAY THAT? WHY?21:53
flaper87:P21:53
flwang1you know, i just realize if i take more time on zaqar, then you will be in trouble21:54
flaper87:P21:54
flaper87flwang1: what's the next question?21:54
flwang1flaper87: ok, the 2nd is seems we don't support list pools by pool group name21:55
flwang1flaper87: i think we should support that to avoid a human-eye's  filter, agree?21:56
flaper87flwang1: ah yeah, that sounds reasonable21:56
flwang1flaper87: so,,,,, given we don't support pool group query for now, what the case you were talking about 'None is considered a valid group'?21:57
flaper87flwang1: FWIW, we need to use and explore the flavors functionality a bit more. There are missing parts and there are definitely bugs21:57
flwang1flaper87: right21:58
flaper87flwang1: None is the "default" group21:58
*** achanda_ has quit IRC21:58
flwang1flaper87: yep, i can see your point21:58
flaper87I don't recall whether group is a required parameter but I think it isn't21:58
flwang1flaper87: i think i should reword my question21:58
flaper87because one point was to have a default group21:58
flaper87but we can create it and call it default21:58
flaper87I guess21:58
flwang1so what's the case to query pools without group21:59
flaper87or just force people to assign a group to the pools21:59
flaper87flwang1: ah, there's no case. it'd be like quering pools from the default group21:59
flaper87from an API standpoint, it'd be less confusing to always require a group21:59
flwang1flaper87:  see this line https://github.com/openstack/zaqar/blob/master/zaqar/storage/pooling.py#L49022:01
*** achanda has joined #openstack-zaqar22:02
flwang1we're trying to get all pools and select a weighted one, the function get_group should return all the pools as expected22:02
flaper87flwang1: https://github.com/openstack/zaqar/blob/master/zaqar/storage/pooling.py#L48822:02
flaper87:D22:02
flwang1but for now, if there is no pool with None/null as the pool group, it will fail22:02
* flaper87 's brain works in strange but interesting wais22:03
flaper87ways, even22:03
flaper87I'm down for adding a default group option or always requesting a group to be passed22:03
openstackgerritFlavio Percoco proposed openstack/zaqar: WIP: Fixing gate  https://review.openstack.org/22106822:03
openstackgerritFlavio Percoco proposed openstack/zaqar: Don't create a connection on constructor  https://review.openstack.org/22152322:03
flwang1flaper87: i'm ok to add a new conf named default _pool_group22:04
flwang1but that can't resolve the current bug22:04
flwang1btw, i don't like the current function name _get_group, it's really confused22:06
flwang1it should be _get_pools_by_group or just _get_by_group22:06
flaper87flwang1: please, go ahead and rename it :D22:07
flwang1flaper87: haha22:07
flaper87flwang1: why wouldn't having a default group help fixing that issue?22:07
flaper87I guess I'm missing something22:07
flwang1even you have a default pool, let's name it 'default', when you want to query all the pools, at line https://github.com/openstack/zaqar/blob/master/zaqar/storage/pooling.py#L490, we still don't pass in any group name22:09
*** achanda has quit IRC22:09
*** achanda has joined #openstack-zaqar22:09
flwang1as a result, at this line https://github.com/openstack/zaqar/blob/master/zaqar/storage/mongodb/pools.py#L9322:09
flwang1the driver will still try to query pools with the group name, for now it's 'None', and the query will still return empty22:10
flaper87flwang1: ah, that's because the default group is None https://github.com/openstack/zaqar/blob/master/zaqar/storage/base.py#L77322:10
flaper87flwang1: we are passing it implicitly22:10
flaper87we'll have to change that line if we add the option22:10
flaper87or change `get_group` so that it takes the default group from the config options22:11
flwang1but let's consider the case when there is no default group22:12
flwang1all the group has a custimzed name22:12
flwang1all the pools22:12
flwang1so i'm thinking if we should use pool list instead of get_pools_by_group22:13
flwang1since for this scenario, we don't care about the group name, we just want to get all the pools22:13
*** achanda_ has joined #openstack-zaqar22:13
*** achanda has quit IRC22:13
flaper87no because you'd be using pools from any group and that defeats the purposes of having a default group for pools22:14
flaper87which denotes the default group pool to use to store messages22:14
flaper87we want all pools in the default group22:14
flaper87Let me put it this way22:14
flaper87We don't need a default group to know what the default value of the group field should be. We need it because that's were we'll pick pools from when we're creating queues and no flavor has been specified22:15
flaper87Should we call that "default_flavor" rather than "default_pool" ?22:15
flaper87probably22:15
flaper87I'd be down for that22:15
flwang1flaper87: if so, my question is what happened if there is no pool with default pool/flavor name?22:16
flwang1for example, in my current dev env, i have two pools, redis and mongodb22:17
flwang1and i put them into separated pool group, redis_group and mongodb_group22:17
flwang1my control plane is sqlalchemy22:17
flwang1that's why i ran into this bug22:17
flaper87flwang1: there are 2 possible scenarios. If enable_virtual_pools is True, then one will be created. If it isn't then the api will fail22:17
flwang1i have pools for sure22:17
flwang1but i can't create queues22:17
flaper87flwang1: did you set this to True? https://github.com/openstack/zaqar/blob/master/zaqar/storage/pooling.py#L3322:18
flwang1no22:18
flaper872 solutions: 1 set that to true and let Zaqar create a virtual pool for you. 2 create a pool in the default group22:19
flaper87I'd recommend the later22:19
flaper87I do see your point and I think there's a bug22:19
flaper87I agree with that22:19
flaper87just trying to come up with a good solution22:19
flaper87The 2 solutions I have in mind right now are:22:20
flaper871) Add a config for the default_pool22:20
flaper872) Add an option for the default_flavor22:20
flaper87Either way, the OP has some config to do before running Zaqar w/ pooling22:20
flwang1flaper87: i agree, given pooling will be the typical production scenario, so it definitely needs more care22:21
flaper87flwang1: I think having a 'default_pool' option makes more sense because OPs should be able to opt-out from exposing flavors22:22
flaper87therefore, requiring flavors to be configured would be pointless22:22
flwang1default_pool? does that mean as an operator, i need to follow these steps: 1. set the conf, default_pool=mongo_pool   2. start the service, create a pool with name mongo_pool?22:25
flaper87yup22:25
flaper87flwang1: does that sound terrible?22:26
flwang1flaper87: i'm trying to recall if there are any similar design in any other openstack components22:27
flwang1in other words, a resource's name in the service depends on the conf of the service22:28
flaper87flwang1: we've that in glance_store for ceph pools, for example22:29
flaper87flwang1: I'm all ears if you've a better idea, tbh. I don't think that's a great proposal22:30
flaper87but that's the last thing I remember I thought about22:30
flwang1flaper87: if the enable_virtual_pools is a workaround for that, then i would like hold it in M and draft a spec for that to get more eyes22:31
flwang1how do you think?22:32
flwang1hold it until M, i mean22:32
EmilienMflaper87: do you sleep sometimes?22:32
EmilienMoh wait, it's freeze period :P22:32
flaper87EmilienM: hahahaha, I don't and we cut Zaqar last week!22:33
flaper87BAM! How's that for efficiency ?22:33
flaper87:D22:33
flaper87flwang1: sounds good to me22:33
flaper87lets give it more thoughts and not rush it22:34
flaper87if it turns out being a blocker, we could even consider a backport22:34
flwang1flaper87: +122:34
flwang1flaper87: thanks a for your time, mate22:34
flaper87flwang1: my pleasure :)22:35
flaper87EmilienM: also, don't you remember PyCon US?22:35
flaper87didn't I show my sleeping habits there?22:35
flaper87:D22:35
EmilienMlol22:35
EmilienMflaper87: it was canada22:35
EmilienMbut anyway22:35
flaper87it was still called PyConUS22:37
flaper87and you're not even canadian. :P22:37
* flaper87 goes back to fixing zaqar's gate22:37
openstackgerritFlavio Percoco proposed openstack/zaqar: Don't create a connection on constructor  https://review.openstack.org/22152322:43
openstackgerritFlavio Percoco proposed openstack/zaqar: WIP: Fixing gate  https://review.openstack.org/22106822:43
openstackgerritFei Long Wang proposed openstack/zaqar: Rename get_group to get_pools_by_group  https://review.openstack.org/22153822:53
*** achanda has joined #openstack-zaqar22:55
*** achanda_ has quit IRC22:55
*** achanda_ has joined #openstack-zaqar23:01
*** achanda has quit IRC23:01
*** csoukup has quit IRC23:08
*** achanda has joined #openstack-zaqar23:23
*** achanda_ has quit IRC23:23
*** Qiming__ has joined #openstack-zaqar23:36
« Monday, 2015-09-07 Index Wednesday, 2015-09-09 »

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!