Wednesday, 2016-03-02

Eva-iflwang: can you please address these things: https://etherpad.openstack.org/p/temp00:00
flwangEva-i: i can't access the link above00:06
Eva-iflwang: oki, here's another link http://paste.openstack.org/show/7zdNTPj69JWmSofFzNIm/00:07
flwangEva-i:  In APIs v1 and v1.1 it's possible to create queue with attributes, but there is no validation of their values. Is it okay?    why do we need to check the attributes ?00:09
flwangEva-i: for your 2nd question, the answer is yes. but I would like to do it in a separate patch00:12
flwangand i hate to duplicate the work for websocket and wsgi :(00:12
Eva-iflwang: if you want, I will make this duplicate work.00:55
Eva-iflwang: "why do we need to check the attributes ?" Maybe because we don't want bad values to be written to database. Or because it can cause unexpected behavior.00:57
*** kgriffs is now known as kgriffs|afk01:01
*** achanda has quit IRC01:03
flwangEva-i: i have added the websocket part01:04
flwangEva-i: what's the bad values?01:04
flwangfor the metadata01:04
Eva-iflwang: negative default ttl, for example?01:05
flwangare we on the same page?01:06
flwangi'm talking about this " In APIs v1 and v1.1 it's possible to create queue with attributes, but there is no validation of their values."01:06
flwangfor v1 and v1.1, of course, user can add any k-v pair for metadata01:06
Eva-iflwang: yes01:07
flwangand i don't think in this patch we should care about that01:07
Eva-iflwang: yes, in this patch you try to modify API v2 only. But user actions in API v1 and API v1.1 in our case will affect Zaqar's behavior in API v2, because API v2 is using same database for functioning.01:13
flwangEva-i: i see01:15
flwangbut01:15
flwangit's user's queue, right?01:15
Eva-iflwang: yes01:15
flwangso technically, they should know what they're doing01:15
flwangjust like i said above, if user set the max post size as -1 or 0, they know what they are doing01:16
flwangif user create the queue with v1 and set the metadata with a unreasonable value, then i don't think we should cover this case01:17
flwanglet's see the other reviewers comments01:17
*** sriram has joined #openstack-zaqar01:32
Eva-iflwang: oki, I'll try to post messages with ttl: "hey, I'm ttl" string as value and see if Zaqar will still behave correctly.01:33
flwangfor v1 and v2?01:33
flwangyou can try, but i think you will get a validation error01:34
Eva-iflwang1: I'll create a queue with default ttl attribute "hey, I'm ttl" in API v1 and then try to post messages via API v2.01:34
flwangoh, does your v2 include my patch?01:35
Eva-iflwang: yes01:36
flwangand you can post messages?01:38
flwanglet me check01:38
Eva-iflwang: it's okay, I'm going to test if it's possible01:38
Eva-iflwang: I think now it's possible.01:38
openstackgerritwanghao proposed openstack/zaqar: Show default attributes for queue  https://review.openstack.org/28643301:43
wanghaoflwang: ping01:47
wanghaoflwang: I found we miss metadata validation too in patch :https://review.openstack.org/#/c/280941/7. Please see my commit.01:48
*** achanda has joined #openstack-zaqar01:51
flwangwanghao: nice catch01:51
wanghaoflwang: :)01:51
wanghaoflwang: about this " In APIs v1 and v1.1 it's possible to create queue with attributes, but there is no validation of their values." I suggest we don't change v1 and v1.1 since we should consider backward compatible. For future development, we can deprecate v1(or v1.1) step by step like other projecting is doing.02:18
Eva-iwanghao: yes, deprecating is a nice option I think.02:18
Eva-iwanghao: our Zaqar wiki says that if new Zaqar API gets released, the previous API is automatically considered as deprecated.02:19
Eva-iwanghao: much time passed since our API v1 and API v1.1 were deprecated. Maybe we should stop supporting them.02:19
wanghaoEva-i: Yes, agree with you.02:20
wanghaoEva-i: So if we found some bugs in deprecated API, we just need to avoid them in new API.02:23
Eva-iwanghao: personally I think the change can be considered as backward compatible to all Zaqar APIs, because there's very low probability that someone was using such names like "_max_messages_post_size" as keys inside queue metadata.02:24
flwangv1.1 is still the default version in openstack client02:29
Eva-iwanghao: yes, that's the ideal behavior we should do. But flwang is not ready for new API.02:29
flwangv1 is still used by rackspace02:29
Eva-iwanghao: flaper87 (our previous PTL) said that we need to maintain backward compatibility even in Zaqar API v2. But seems like we do not to follow this rule.02:29
flwangEva-i: i don't agree with you02:29
Eva-iflwang: in what?02:29
flwangflaper87 (our previous PTL) said that we need to maintain backward compatibility even in Zaqar API v2. But seems like we do not to follow this rule.02:30
flwangwe should and we are following the rule02:30
flwangin generally02:30
flwangfor some reason, we have to break it a little bit02:30
flwangsuch as security hole02:30
Eva-iflwang: yes =/02:31
flwangso pls don't say we're not following the rule02:31
flwangsince it may confuse some new comers :)02:32
Eva-ioki, breaking a bit doesn't count =)02:33
wanghaoflwang, Eva-i: If we still support V1 and V1.1 for a time, then I think we add validation about "_max_mesages_post_size" and "_default_message_ttl" is not a bad thing.02:33
wanghaoflwang, Eva-i: in V1 and V1.1 API.02:34
Eva-iflwang: wanghao: here's my testing report http://paste.openstack.org/show/EXBDnXNZw6vzVPd9R9d0/02:35
Eva-iflwang: wanghao: for the patch https://review.openstack.org/#/c/265723/02:35
flwangEva-i: can you paste the error log of zaqar?02:39
Eva-iflwang: yes02:40
Eva-iflwang: here http://paste.openstack.org/show/kRIshUxXNtz5D3NQcVYP/02:41
Eva-iflwang: but the order of requests is different from my report. In the report I moved up request that caused 500 error.02:42
flwangEva-i: cool, so \02:42
flwangthe error is happening at the validation level02:42
flwangthat means we just need to handle it there and don't have to change anything for v1 and v1.102:42
openstackgerritFei Long Wang proposed openstack/zaqar: Support metadata update issue for v1.1 and v2  https://review.openstack.org/28094102:43
Eva-iflwang: who knows, maybe we will make some a patch to Zaqar in the future and the error will happen in some other place.02:43
Eva-iflwang: it's hard to predict02:44
openstackgerritFei Long Wang proposed openstack/zaqar: Support metadata update issue for v1.1 and v2  https://review.openstack.org/28094102:45
Eva-iif we are not allowed to make backward incompatible changes to all our APIs, but we still want to make such change, why not to make this change to all APIs, so there will be at least some integrity.02:47
flwangEva-i: i didn't see there is any integrity issue, it's new feature02:48
flwangwe don't want to touch the old version code for new feature if we can02:48
flwangand again, i didn't see any backward compatibility issue for this change, as for the 500 error you mentioned above, i think it only happens on py3.x02:49
Eva-iflwang: yes, on python 302:50
flwangyou won't see any error for py2.702:50
flwangi'm happy to fix it02:50
Eva-iflwang: what about 400 error responses? It's something we can live with?02:51
flwangif we can fix that, do you still think it's a backward compatibility issue?02:51
flwangif the max post size isn't a int, we will compare the message size with the max size defined in config02:52
Eva-iI don't understand the question.02:52
flwangEva-i: ok, so what's the backward compatibility you're talking about?02:53
Eva-iflwang: I responded to wanghao's message: "I suggest we don't change v1 and v1.1 since we should consider backward compatible. For future development, we can deprecate v1(or v1.1) step by step like other projecting is doing.". Later I said that I don't see a problem with it on all APIs, because "there's very low probability that someone was using such names like "_max_messages_post_size" as keys inside queue metadata."02:56
flwangi see. so the 500 error issue you raised above, i think it's not a backward compatibility issue, agree?02:59
Eva-iflwang: yes02:59
flwangok, cool03:00
flwangwanghao: Eva-i: so are we on the same page now?03:00
Eva-iOki, I have nothing to say about https://review.openstack.org/#/c/265723/. I already provided all information about my concerns about storing bad values in database.03:00
flwangwe don't have to change the v1 and v1.1 api03:00
Eva-iflwang: I better think about other patches now..03:00
flwangEva-i: hehe, cool03:01
flwangEva-i: as for the negative/0 issue, i will fix it03:01
flwangwxy: wanghao: if you guys can help fix the functional test error of https://review.openstack.org/276548  it would awesome03:06
flwangfeel free submit a new patch set and add yourself as a co-author03:06
wxyflwang: I'll have a try later. I'm looking at the osprofiler  patch : https://review.openstack.org/#/c/141356/1503:10
flwangwxy: oh, nice, if you can take over that one, it would be nice03:11
wxyI think it's useful to introduce this feature to zaqar.03:11
flwangzhiyan has moved to alibaba, won't work for openstack03:11
wxyflwang: :)03:14
zhiyan:)03:15
Eva-i:)03:16
flwangzhiyan: you're around, i can't believe my eyes03:16
flwanghow are you03:16
flwangzhiyan: are you still working for ali?03:17
zhiyanI'm petty cool atm, I'm joining a startup, some Alibaba/ex-alibaba Cloud employees working in it atm03:18
zhiyanHow are you feilong?03:19
openstackgerritwangxiyuan proposed openstack/zaqar: Integrate OSprofiler with Zaqar  https://review.openstack.org/14135603:19
wanghaoflwang: Sure, I will fix this.03:21
flwangzhiyan: working as the zaqar PTL, and have fun :D03:23
flwangzhiyan: what's your company name?03:23
flwanglink?03:24
zhiyanFor now we are working on company registration process and dev some initial features for our idea03:24
*** david-lyle has joined #openstack-zaqar03:24
flwangzhiyan: ah, pretty cool03:24
zhiyanflwang: yes I noticed the information form mail list . And it pretty pity I have no time for community contributions.03:28
openstackgerritFei Long Wang proposed openstack/zaqar: Add `_max_messages_post_size` and `_default_message_ttl` for queue  https://review.openstack.org/26572303:36
*** shu-mutou-AFK is now known as shu-mutou03:53
*** sriram has quit IRC03:56
*** flwang1 has quit IRC03:59
openstackgerritwanghao proposed openstack/zaqar: Fix the TTL issue of subscriptions for Redis  https://review.openstack.org/27654804:01
Eva-iflwang: can you talk with me a bit about flavors?04:11
openstackgerritwangxiyuan proposed openstack/zaqar: Integrate OSprofiler with Zaqar  https://review.openstack.org/14135604:14
*** akanksha_ has joined #openstack-zaqar04:30
*** GB21 has joined #openstack-zaqar05:02
*** achanda has quit IRC05:35
*** pcaruana has joined #openstack-zaqar05:36
openstackgerritwanghao proposed openstack/zaqar: Fix the TTL issue of subscriptions for Redis  https://review.openstack.org/27654805:38
*** achanda has joined #openstack-zaqar05:39
openstackgerritMerged openstack/python-zaqarclient: Update pool on pool create if it exists  https://review.openstack.org/26680805:39
*** achanda has quit IRC05:39
*** pcaruana has quit IRC05:49
*** rcernin has joined #openstack-zaqar05:51
*** GB21 has quit IRC05:57
*** achanda has joined #openstack-zaqar06:00
*** exploreshaifali has joined #openstack-zaqar06:25
openstackgerritShu Muto proposed openstack/zaqar-ui: Add update queue action  https://review.openstack.org/28646806:43
*** jtomasek has joined #openstack-zaqar07:19
*** khushbu_ has joined #openstack-zaqar07:53
*** pcaruana has joined #openstack-zaqar08:02
*** achanda has quit IRC08:03
*** exploreshaifali has quit IRC08:06
*** GB21 has joined #openstack-zaqar08:06
*** achanda has joined #openstack-zaqar08:07
*** achanda has quit IRC08:18
openstackgerritwangxiyuan proposed openstack/zaqar: Integrate OSprofiler with Zaqar  https://review.openstack.org/14135608:19
*** GB21 has quit IRC08:21
*** GB21 has joined #openstack-zaqar08:23
*** exploreshaifali has joined #openstack-zaqar08:48
*** khushbu_ has quit IRC09:00
*** flwang1 has joined #openstack-zaqar09:14
*** exploreshaifali has quit IRC09:41
*** lane_kong is now known as lynn09:45
*** lynn is now known as Guest2997009:46
*** Guest29970 is now known as lynn_kong09:46
*** GB21 has quit IRC09:47
*** GB21 has joined #openstack-zaqar09:50
*** AAzza has quit IRC09:53
*** AAzza has joined #openstack-zaqar09:53
*** GB21 has quit IRC09:57
*** AAzza has quit IRC09:57
*** AAzza has joined #openstack-zaqar09:58
*** GB21 has joined #openstack-zaqar10:00
*** exploreshaifali has joined #openstack-zaqar10:02
*** flwang1 has quit IRC10:03
*** lynn_kong is now known as Larrie10:12
*** flwang1 has joined #openstack-zaqar10:12
*** Larrie is now known as larrie10:12
*** shu-mutou is now known as shu-mutou-AFK10:18
*** flwang1 has quit IRC10:25
*** larrie is now known as larrie_kong10:28
*** wxy has quit IRC10:39
*** rguichard has joined #openstack-zaqar10:45
rguichardHi everyone10:45
rguichardI was wondering if a zaqar queue created by tenant A can be reachable by tenant B ?10:46
rguichardI'm talking about true inter-tenant queues10:47
*** AAzza has quit IRC10:48
therverguichard, If you use signed URL to skip authentication then yes10:50
*** AAzza has joined #openstack-zaqar10:50
*** rguichard has quit IRC10:58
*** rguichard has joined #openstack-zaqar11:01
rguichardtherve: by skipping auth, user (without access to tenant A) can access to a queue created by tenant A ?11:02
rguichardi'm not familiar with signed url, I might have misunderstood ^^11:03
therverguichard, Yes it relies on a shared secret11:04
therveUnfortunately it doesn't look very well documented11:04
*** rguichard has quit IRC11:08
*** GB21 has quit IRC11:09
openstackgerritwanghao proposed openstack/python-zaqarclient: Show default attributes for queue  https://review.openstack.org/28711411:09
openstackgerritwanghao proposed openstack/zaqar: Show default attributes for queue  https://review.openstack.org/28643311:13
openstackgerritwanghao proposed openstack/python-zaqarclient: Show default attributes for queue  https://review.openstack.org/28711411:14
*** khushbu_ has joined #openstack-zaqar11:15
*** GB21 has joined #openstack-zaqar11:21
*** AAzza has quit IRC11:49
*** AAzza has joined #openstack-zaqar11:50
*** AAzza has quit IRC12:05
*** AAzza has joined #openstack-zaqar12:08
*** GB21 has quit IRC12:13
*** akanksha_ has quit IRC12:17
*** rguichard has joined #openstack-zaqar12:26
*** GB21 has joined #openstack-zaqar12:37
*** GB21 has quit IRC12:44
*** amitgandhinz has joined #openstack-zaqar13:57
*** kgriffs|afk is now known as kgriffs14:04
*** exploreshaifali has quit IRC14:18
*** khushbu_ has quit IRC14:19
*** mpanetta has joined #openstack-zaqar14:40
*** GB21 has joined #openstack-zaqar14:43
*** itisha has joined #openstack-zaqar14:44
*** GB21 has quit IRC14:53
*** rguichard has quit IRC14:54
*** pt_15 has joined #openstack-zaqar14:55
*** GB21 has joined #openstack-zaqar15:05
*** sriram has joined #openstack-zaqar15:21
*** GB21 has quit IRC15:22
*** pcaruana has quit IRC16:05
*** exploreshaifali has joined #openstack-zaqar16:13
*** larrie_kong has quit IRC16:15
*** larrie_kong has joined #openstack-zaqar16:15
*** larrie_kong has quit IRC16:15
*** larrie_kong has joined #openstack-zaqar16:15
*** david-lyle has quit IRC16:36
*** david-lyle has joined #openstack-zaqar16:38
*** kgriffs is now known as kgriffs|afk16:56
*** kgriffs|afk is now known as kgriffs16:57
*** venkat has joined #openstack-zaqar17:02
*** venkat has quit IRC17:06
*** venkat has joined #openstack-zaqar17:08
*** achanda has joined #openstack-zaqar17:12
*** malini has joined #openstack-zaqar17:27
*** achanda has quit IRC17:27
*** venkat has quit IRC17:33
*** boris-42 has joined #openstack-zaqar17:35
*** malini1 has joined #openstack-zaqar17:45
*** achanda has joined #openstack-zaqar17:45
*** malini has quit IRC17:46
*** khushbu_ has joined #openstack-zaqar18:03
*** malini1 has quit IRC18:05
*** david-lyle has quit IRC18:12
*** david-lyle has joined #openstack-zaqar18:13
*** flwang1 has joined #openstack-zaqar18:33
*** flwang1 has quit IRC18:34
*** mpanetta has quit IRC18:36
*** amitgandhinz has quit IRC18:42
*** amitgandhinz has joined #openstack-zaqar18:45
*** malini has joined #openstack-zaqar18:57
*** malini has quit IRC19:05
*** kgriffs is now known as kgriffs|afk19:32
*** exploreshaifali has quit IRC19:38
*** davideagnello is now known as davideagnello__19:40
*** davideagnello__ is now known as davide85_19:45
*** kgriffs|afk is now known as kgriffs19:53
*** khushbu_ has quit IRC20:01
flwangEva-i: ping20:28
Eva-iflwang: hello!20:28
flwangEva-i: i'm reviewing your comment on ps 10 for https://review.openstack.org/#/c/265723/20:29
Eva-iflwang: I was just repeating myself, you already know all that20:30
Eva-iflwang: I was repeating myself, so others could know the problem20:30
flwangyep, but I want to make it clear to avoid any confusion20:30
flwangso you still think the 400 error is problem/issue?20:31
Eva-iflwang: just a minor problem20:31
Eva-iflwang: personally I can live with it20:31
flwang400 error is an expected error20:32
flwangjust like a validation fail20:32
Eva-iflwang: oki...20:33
flwangryansb: vkmc: may i get your guys comments on https://review.openstack.org/265723 ?20:33
flwangwe only have 2 days20:33
*** rcernin has quit IRC20:36
Eva-iflwang: oki, so the user should know what he's doing20:36
Eva-iflwang:  In all other aspects I like this patch. I guess I should mark the patch +1 or +2.20:37
flwangEva-i: i can definately see your point on this patch. But just like I said before, 1. I don't want to touch old api version code given it's a new feature.  2. I don't want to change too much code since it's a performance impact change20:39
flwangthat said i don't want to add too much check to impact any performance20:39
flwangzaqar is not like other projects, zaqar is really sensitive to performance20:41
flwangpersonally, i don't want to make a perfect(too many checks) validation to lose any performance, that's my baseline20:41
flwangthere are something we should teach(by document) user how to use it instead of adding so many checks to let them try the barrier20:43
flwangthat's just my 2 cents20:43
Eva-iflwang: when I was learning zaqar and trying different requests on different APIs, I opened API reference only in cases when Zaqar returned some error.20:44
ryansbI disagree: a performant system that doesn't verify inputs isn't really ready for consumption20:45
ryansbesp not in a public cloud setting20:45
*** david-lyle has quit IRC20:45
*** david-lyle has joined #openstack-zaqar20:47
Eva-iflwang: yes, this is a new feature for API v2. I don't wish to modify message posting in API v1 and API v1.1, but just modify putting metadata to queue, so bad data can't reach database. And about performance. AFAIK new queue putting happens not so often, but I might be wrong.20:58
Eva-iflwang: If you think queue putting happens often and you're concerned about performance, it was not very good decision for you to add new exception catching in API v2 message posting, when queue does not exist (see L168 in https://review.openstack.org/#/c/265723/10/zaqar/transport/wsgi/v2_0/messages.py). I tried to measure how new exception catching might affect performance, but HTTP delays were so big, so it was impossible to measure.21:02
Eva-iflwang: but in general patch is good, I like it21:02
flwangryansb: not doesn't verify ;)21:03
flwangryansb: you may need to read the whole story21:03
ryansbI see - will do21:03
flwangryansb: but firstly, just review the code :D21:04
ryansbyeah, haven't for a couple revisions21:04
flwangryansb: any progress of the queue metadata update client patch?21:12
flwangdo you need any help?21:12
ryansbnope, I'm all set. Just been fighting to get enough time to finish it up :)21:12
flwangryansb: we need to get it in by Fri, if possible21:13
ryansbyeah, should be able to do that21:13
ryansbAfter all, there's a new core to help me merge it21:14
ryansb;)21:14
flwangryansb: cool, thanks21:14
Eva-iIs it possible to list claims that queue has?21:14
ryansbNot sure, you can get the count of claimed messages by listing the stats for the queue21:15
ryansbafaik the claim controller doesn't let you list them21:16
Eva-iryansb: alright, just wanted to know, thanks21:17
*** njohnston has left #openstack-zaqar21:18
*** flwang1 has joined #openstack-zaqar21:19
flwangryansb: https://review.openstack.org/#/c/270464/21:25
flwangryansb:  https://review.openstack.org/#/c/276603/21:25
ryansbhm, thought I merged that one21:26
flwangryansb:  i think https://review.openstack.org/#/c/276603/ is the last one we want to merge for client release21:26
flwangryansb: yep, it's rebased21:26
ryansbgotcha21:27
flwangryansb: thanks21:27
flwangi'm going to release zaqar client :D21:27
ryansbdon't you want to wait for my patch on queue updates this wk?21:27
ryansbor do we plan on another release soon?21:27
flwangryansb: aaaaaaaaaaaaaaah sorry21:28
flwangryansb: yep, i should wait for you :D21:28
flwangsorry about that21:28
flwangEva-i: can you help review https://review.openstack.org/276548?21:28
Eva-iflwang: i'm currently reviewing it. Found some problems with subscription API in general21:29
flwangEva-i: cool, thanks21:30
flwangEva-i: and https://review.openstack.org/280941 though there is a py34 failure, but i don't think it's related21:30
Eva-iflwang: yes, I will21:49
*** jtomasek has quit IRC21:50
openstackgerritEva Balycheva proposed openstack/zaqar: Fix freeze on some requests  https://review.openstack.org/28489721:58
*** achanda has quit IRC22:06
*** achanda has joined #openstack-zaqar22:13
*** achanda has quit IRC22:20
flwangryansb: urgent patch https://review.openstack.org/#/c/284897/8 new to be reviewed, thanks22:21
*** amitgandhinz has quit IRC22:28
*** sriram has quit IRC23:00
openstackgerritMerged openstack/python-zaqarclient: "pool_group" word should be used instead "pool"  https://review.openstack.org/27660323:16
*** achanda has joined #openstack-zaqar23:20
*** achanda has quit IRC23:28
*** pt_15 has quit IRC23:35
*** itisha has quit IRC23:39

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!