Monday, 2015-02-02

*** TravT has joined #openstack-glance00:17
*** TravT has quit IRC00:21
*** nellysmitt has joined #openstack-glance01:08
*** nellysmitt has quit IRC01:12
*** buzztroll has joined #openstack-glance01:29
*** buzztroll has quit IRC01:32
*** takedakn has joined #openstack-glance01:47
*** takedakn has quit IRC01:55
*** takedakn has joined #openstack-glance01:55
*** changbl has quit IRC01:57
*** buzztroll has joined #openstack-glance01:58
*** buzztroll has quit IRC01:58
*** takedakn has quit IRC02:02
*** annashen has joined #openstack-glance02:06
*** TravT has joined #openstack-glance02:06
*** haomaiwang has joined #openstack-glance02:08
*** TravT has quit IRC02:11
*** TravT has joined #openstack-glance02:16
*** annashen has quit IRC02:20
*** takedakn has joined #openstack-glance02:29
*** annashen has joined #openstack-glance02:30
*** takedakn has quit IRC02:33
*** takedakn has joined #openstack-glance02:37
*** takedakn has quit IRC02:42
openstackgerritMerged openstack/glance: Fix copy-from when user_storage_quota is enabled  https://review.openstack.org/14360802:52
*** changbl has joined #openstack-glance03:01
*** Longgeek has joined #openstack-glance03:04
*** Longgeek has quit IRC03:04
*** Longgeek has joined #openstack-glance03:04
*** nellysmitt has joined #openstack-glance03:08
*** nellysmitt has quit IRC03:13
*** flwang has quit IRC04:30
*** Longgeek has quit IRC04:30
*** Longgeek has joined #openstack-glance04:34
*** ozialien has joined #openstack-glance04:37
openstackgerritMerged openstack/python-glanceclient: Remove openstack.common.strutils  https://review.openstack.org/14523804:49
*** ozialien has quit IRC04:53
*** ozialien has joined #openstack-glance05:02
*** annashen has quit IRC05:03
*** nellysmitt has joined #openstack-glance05:09
*** nellysmitt has quit IRC05:14
*** sigmavirus24 is now known as sigmavirus24_awa05:22
*** Longgeek has quit IRC05:27
*** buzztroll has joined #openstack-glance05:29
*** Longgeek has joined #openstack-glance05:32
*** buzztroll has quit IRC05:34
*** buzztroll has joined #openstack-glance05:50
*** buzztroll has quit IRC05:54
*** annashen has joined #openstack-glance05:55
openstackgerritOpenStack Proposal Bot proposed openstack/glance: Imported Translations from Transifex  https://review.openstack.org/14676506:04
*** buzztroll has joined #openstack-glance06:11
openstackgerritZhi Yan Liu proposed openstack/glance_store: Rename oslo.concurrency to oslo_concurrency  https://review.openstack.org/14463106:15
*** annashen has quit IRC06:20
*** annashen has joined #openstack-glance06:28
*** jyoti-ranjan has joined #openstack-glance06:31
sabarizhiyan: Thanks for the reviews on https://review.openstack.org/#/c/141665/.06:40
sabariPing me if you got some quick concerns. I will be around for a while :)06:40
*** bfic has joined #openstack-glance06:41
*** groen692 has joined #openstack-glance06:44
*** takedakn has joined #openstack-glance06:45
*** sgotliv_ has joined #openstack-glance06:46
*** ozialien has quit IRC06:50
*** annashen has quit IRC06:57
zhiyansabari: Thanks! I will take a look asap!06:59
*** takedakn has quit IRC07:01
*** nellysmitt has joined #openstack-glance07:10
*** ozialien has joined #openstack-glance07:11
*** nlevinki has joined #openstack-glance07:12
*** nellysmitt has quit IRC07:15
*** belmoreira has joined #openstack-glance07:21
*** Longgeek has quit IRC07:21
*** Longgeek has joined #openstack-glance07:30
*** Longgeek has quit IRC07:34
*** Longgeek has joined #openstack-glance07:49
*** sgotliv_ has quit IRC07:50
*** Longgeek has quit IRC07:52
*** jyoti-ranjan has quit IRC07:59
*** chlong has quit IRC08:00
*** sgotliv has joined #openstack-glance08:04
*** eglynn-pto has joined #openstack-glance08:10
openstackgerritRohan Kanade proposed openstack/glance: Handle empty request body with chunked encoding  https://review.openstack.org/7813408:19
*** markus_z has joined #openstack-glance08:22
*** sgotliv has quit IRC08:27
*** sgotliv has joined #openstack-glance08:28
*** buzztroll has quit IRC08:34
*** nellysmitt has joined #openstack-glance08:36
*** pkoniszewski has joined #openstack-glance08:43
*** eglynn-pto is now known as eglynn08:43
*** tshefi has joined #openstack-glance08:46
*** flwang has joined #openstack-glance08:49
*** rwsu has joined #openstack-glance08:49
*** rwsu is now known as rwsu-afk08:50
openstackgerritJulien Danjou proposed openstack/glance: Simplify context by using oslo.context  https://review.openstack.org/14344908:52
*** takedakn has joined #openstack-glance08:56
*** annashen has joined #openstack-glance08:57
*** jistr has joined #openstack-glance08:58
*** nlevinki has quit IRC09:01
*** annashen has quit IRC09:02
*** jyoti-ranjan has joined #openstack-glance09:02
*** nlevinki has joined #openstack-glance09:10
*** eglynn has quit IRC09:14
*** pdb has joined #openstack-glance09:19
*** MattMan has joined #openstack-glance09:19
*** takedakn has quit IRC09:27
*** takedakn has joined #openstack-glance09:28
openstackgerritMerged openstack/python-glanceclient: Remove openstack.common.importutils  https://review.openstack.org/14524409:44
*** eglynn has joined #openstack-glance09:51
*** takedakn has quit IRC10:02
*** eglynn has quit IRC10:02
*** takedakn has joined #openstack-glance10:21
openstackgerritLakshmi N Sampath proposed openstack/glance: Catalog Index Service  https://review.openstack.org/13826910:22
*** buzztroll has joined #openstack-glance10:23
*** takedakn has quit IRC10:24
*** buzztroll has quit IRC10:28
*** bfic has quit IRC10:30
*** bfic has joined #openstack-glance10:31
*** bfic has joined #openstack-glance10:32
*** bfic has quit IRC10:34
*** elig_mh has joined #openstack-glance10:41
*** bfic has joined #openstack-glance10:42
*** bfic has quit IRC10:58
*** annashen has joined #openstack-glance10:58
*** bfic has joined #openstack-glance10:59
*** annashen has quit IRC11:03
*** haomaiwang has quit IRC11:07
*** jyoti-ranjan has quit IRC11:22
openstackgerritLouis Taylor proposed openstack/python-glanceclient: Remove uuidutils from openstack-common  https://review.openstack.org/15208711:22
*** tellesnobrega has joined #openstack-glance11:34
*** nlevinki has quit IRC11:39
*** buzztroll has joined #openstack-glance12:00
*** bfic has quit IRC12:01
*** buzztroll has quit IRC12:01
*** buzztroll has joined #openstack-glance12:02
*** diegows has joined #openstack-glance12:03
*** buzztroll has quit IRC12:03
*** buzztroll has joined #openstack-glance12:04
*** buzztroll has quit IRC12:05
*** buzztrol_ has joined #openstack-glance12:05
*** buzztrol_ has quit IRC12:07
*** buzztroll has joined #openstack-glance12:07
*** nlevinki has joined #openstack-glance12:08
*** buzztroll has quit IRC12:09
*** buzztroll has joined #openstack-glance12:09
*** buzztroll has quit IRC12:10
*** buzztroll has joined #openstack-glance12:11
*** buzztroll has quit IRC12:12
*** buzztroll has joined #openstack-glance12:13
*** buzztroll has quit IRC12:14
*** buzztroll has joined #openstack-glance12:14
*** buzztroll has quit IRC12:16
*** buzztroll has joined #openstack-glance12:16
openstackgerritKamil Rykowski proposed openstack/glance: Notifications for metadefinition resources  https://review.openstack.org/14854612:17
*** buzztroll has quit IRC12:18
*** buzztroll has joined #openstack-glance12:18
*** buzztroll has quit IRC12:19
*** buzztroll has joined #openstack-glance12:20
*** buzztroll has quit IRC12:21
*** buzztroll has joined #openstack-glance12:22
*** buzztroll has quit IRC12:23
*** buzztroll has joined #openstack-glance12:23
*** buzztrol_ has joined #openstack-glance12:25
*** buzztroll has quit IRC12:25
*** buzztroll has joined #openstack-glance12:27
*** buzztrol_ has quit IRC12:27
*** buzztroll has quit IRC12:28
*** buzztroll has joined #openstack-glance12:29
*** buzztroll has quit IRC12:30
*** buzztroll has joined #openstack-glance12:31
*** aix has joined #openstack-glance12:31
*** buzztrol_ has joined #openstack-glance12:32
*** buzztroll has quit IRC12:32
*** belmoreira has quit IRC12:33
*** buzztrol_ has quit IRC12:34
*** buzztroll has joined #openstack-glance12:34
*** buzztroll has quit IRC12:35
*** buzztroll has joined #openstack-glance12:36
*** buzztroll has quit IRC12:37
*** buzztroll has joined #openstack-glance12:38
*** nellysmitt has quit IRC12:38
*** nellysmi_ has joined #openstack-glance12:38
*** buzztroll has quit IRC12:39
*** nellysmi_ has quit IRC12:39
*** buzztroll has joined #openstack-glance12:40
*** delattec has joined #openstack-glance12:40
*** buzztrol_ has joined #openstack-glance12:41
*** buzztroll has quit IRC12:41
*** cdelatte has quit IRC12:42
*** buzztrol_ has quit IRC12:43
*** buzztroll has joined #openstack-glance12:43
*** buzztroll has quit IRC12:44
*** buzztroll has joined #openstack-glance12:45
*** buzztroll has quit IRC12:46
*** buzztroll has joined #openstack-glance12:47
*** buzztroll has quit IRC12:48
*** buzztroll has joined #openstack-glance12:48
*** buzztroll has quit IRC12:50
*** buzztroll has joined #openstack-glance12:50
*** buzztroll has quit IRC12:52
*** buzztroll has joined #openstack-glance12:52
*** buzztroll has quit IRC12:54
*** buzztroll has joined #openstack-glance12:54
*** buzztrol_ has joined #openstack-glance12:56
*** buzztroll has quit IRC12:56
*** buzztroll has joined #openstack-glance12:57
*** buzztrol_ has quit IRC12:57
*** nellysmitt has joined #openstack-glance12:58
*** buzztroll has quit IRC12:59
*** annashen has joined #openstack-glance12:59
*** buzztroll has joined #openstack-glance12:59
*** buzztrol_ has joined #openstack-glance13:01
*** buzztroll has quit IRC13:01
*** buzztrol_ has quit IRC13:02
*** buzztroll has joined #openstack-glance13:03
*** annashen has quit IRC13:04
*** buzztroll has quit IRC13:04
*** buzztroll has joined #openstack-glance13:05
*** buzztrol_ has joined #openstack-glance13:06
*** buzztroll has quit IRC13:06
*** buzztroll has joined #openstack-glance13:08
*** buzztrol_ has quit IRC13:08
*** buzztroll has quit IRC13:10
*** buzztroll has joined #openstack-glance13:10
*** pkoniszewski has quit IRC13:11
*** buzztroll has quit IRC13:11
*** buzztroll has joined #openstack-glance13:12
*** buzztroll has quit IRC13:13
*** buzztroll has joined #openstack-glance13:14
*** takedakn has joined #openstack-glance13:14
*** buzztroll has quit IRC13:15
*** buzztroll has joined #openstack-glance13:15
*** buzztroll has quit IRC13:17
*** buzztroll has joined #openstack-glance13:17
*** belmoreira has joined #openstack-glance13:18
*** buzztroll has quit IRC13:19
*** buzztroll has joined #openstack-glance13:19
*** buzztroll has quit IRC13:23
*** mjturek has joined #openstack-glance13:32
openstackgerritKamil Rykowski proposed openstack/glance: Notifications for metadefinition resources  https://review.openstack.org/14854613:33
*** takedakn has quit IRC13:55
*** takedakn has joined #openstack-glance13:59
*** thangp has joined #openstack-glance14:00
*** takedakn has quit IRC14:08
*** esheffield has joined #openstack-glance14:17
*** belmoreira has quit IRC14:23
*** jaypipes has joined #openstack-glance14:30
*** zigo has quit IRC14:31
*** junhongl__ has quit IRC14:32
*** zigo has joined #openstack-glance14:35
*** gordc has joined #openstack-glance14:36
openstackgerritMerged openstack/python-glanceclient: Remove uuidutils from openstack-common  https://review.openstack.org/15208714:43
*** jasondot_ has joined #openstack-glance14:45
*** junhongl__ has joined #openstack-glance14:46
*** peristeri has joined #openstack-glance14:48
*** openstackgerrit has quit IRC14:52
*** openstackgerrit has joined #openstack-glance14:52
*** sigmavirus24_awa is now known as sigmavirus2414:55
*** flwang has quit IRC14:56
*** annashen has joined #openstack-glance15:00
*** annashen has quit IRC15:05
*** nlevinki has quit IRC15:08
*** nlevinki has joined #openstack-glance15:08
*** spzala has joined #openstack-glance15:11
*** TravT has quit IRC15:16
*** jyoti-ranjan has joined #openstack-glance15:36
openstackgerritIan Cordasco proposed openstack/python-glanceclient: Ignore NoneType when encoding headers  https://review.openstack.org/15215915:39
*** TravT has joined #openstack-glance15:40
*** TravT has quit IRC15:41
*** TravT has joined #openstack-glance15:41
*** cpallares has joined #openstack-glance15:47
*** ericpeterson has joined #openstack-glance15:56
*** vijendar has joined #openstack-glance15:57
nikhil_kkragniz: ever heard back from stuart on this https://review.openstack.org/#/c/146437/ ?16:00
kragniznikhil_k: he said he'd comment on the spec in a minute16:03
kragniznikhil_k: he's still positive about changing the default16:03
nikhil_kack16:04
nikhil_kkragniz: I still have hope for it to land on k216:05
kragnizokay!16:05
kragnizit's ready to go once we decide on a number :P16:05
*** pkoniszewski has joined #openstack-glance16:05
nikhil_k:)16:06
*** zz_jgrimm is now known as jgrimm16:12
*** david-lyle_afk is now known as david-lyle16:19
*** ericpeterson has quit IRC16:20
*** elig_mh has quit IRC16:20
*** buzztroll has joined #openstack-glance16:25
*** nlevinki has quit IRC16:26
*** ericpeterson has joined #openstack-glance16:26
*** TravT_ has joined #openstack-glance16:27
*** TravT has quit IRC16:29
*** TravT_ has quit IRC16:39
*** pkoniszewski has quit IRC16:39
*** TravT has joined #openstack-glance16:39
*** rwsu-afk is now known as rwsu16:40
*** annegent_ has joined #openstack-glance16:49
*** groen692 has quit IRC16:50
openstackgerritLakshmi N Sampath proposed openstack/glance-specs: Catalog Index Service  https://review.openstack.org/13805116:53
ativelkovfolks, I still need one more +2 on https://review.openstack.org/#/c/148574/ - that's a critical we wanted to land in k2. Any volunteers?16:56
kragnizativelkov: I +1ed16:56
*** markus_z has quit IRC16:57
ativelkovkragniz: thanks!16:57
kragnizativelkov: I like the nice long commit message :)16:57
*** tshefi has quit IRC17:00
*** annashen has joined #openstack-glance17:01
*** mjturek has quit IRC17:03
*** annegent_ has quit IRC17:04
*** annashen has quit IRC17:05
sigmavirus24ativelkov: technically we should -1 that because the commit message isn't following the guidelines but the change is too important17:11
sigmavirus24nikhil_k: thoughts on https://review.openstack.org/#/c/148574/17:12
kragnizsigmavirus24: which guidelines, other than the tense of the commit title?17:12
sigmavirus24max line length of 72.17:12
kragnizsigmavirus24: and linewrapping to 7217:12
sigmavirus24That looks like it's longer17:12
kragnizah, right17:12
sigmavirus24just eyeballing it17:12
kragnizI thought the same, but whoever +As it can edit the message17:13
sigmavirus24I could edit it right now but it would wipe out zhiyan's +217:13
sigmavirus24also the other +1s17:13
kragnizright17:14
sigmavirus24Still trying to help nikhil_k with his goal to get more reviewers to follow the guidelines more closely for review (which includes closely reviewing commit messages)17:16
kragnizyeah, it's wrapped to 80 char at the moment17:16
sigmavirus24I was an early reviewer for that and missed it (or maybe I didn't, I don't remember) but it's priority is up there and at this point, I'm not sure it's worth it17:16
nikhil_ksigmavirus24: that's a good point17:17
nikhil_kativelkov: we can mark it as a blocker for k217:17
nikhil_kthat way you don't have to worry about missing it17:17
nikhil_kif the author edits it using the GUI, will it flush the +2?17:18
*** EmilienM is now known as EmilienM|afk17:18
kragniznikhil_k: yes, since the git hash changes17:19
sigmavirus24I think so but I'm not 100% sure17:19
kragnizunless gerrit has changed and does something magic now17:19
nikhil_khmm, swear I've seem some cases when jenkins remembers17:19
kragniznikhil_k: you may be thinking about rebases?17:19
ativelkovIt does. I fixed some typo in some commit and it wiped the +1's17:19
nikhil_kgah17:19
nikhil_kok, that makes sense. then it's prolly rebases only as kragniz is saying ..17:20
ativelkovSorry, I always forget about "max charcount in commit messages"17:20
nikhil_kativelkov: you might want to wait a tiny bit as I will review it in next 30 or so mins17:20
ativelkovnikhil_k: thanks17:20
kragnizativelkov: set the linewrap to 72 for commit messages in your editor17:21
kragnizativelkov: you'll never have to remember again!17:21
ativelkovI edit commit messages in vim )17:21
sigmavirus24We should just add a job to check that for us17:21
nikhil_kI'm looking to test this functionally today https://review.openstack.org/#/c/85211/2217:21
sigmavirus24ativelkov: that's easy to do in vim17:21
nikhil_kmore volunteers are welcome@17:21
nikhil_ksigmavirus24: was there one before, do you know?17:22
sigmavirus24ativelkov: add "autocmd FileType gitcommit setlocal spell tw=72" to your vimrc17:22
sigmavirus24nikhil_k: I think some other projects have it and hacking used to have a check for commit style17:22
sigmavirus24I think hacking removed it though because it was causing issues or something17:22
kragniznikhil_k: I'll have a test later17:22
sigmavirus24ativelkov: you don't need spell for spellchecking unless you want it, but the rest is correct17:23
kragnizsigmavirus24: people were annoyed at being nitted so much about commit messages iirc17:23
sigmavirus24kragniz: well too bad17:23
nikhil_ksigmavirus24: hmm, that makes sense. Hacking did the trick !17:23
sigmavirus24it's in the review guidelines17:23
nikhil_kyeah, pointless to put in guideline and not in hacking17:23
sigmavirus24I don't care how annoying it may seem, it helps everyone when you're looking for what broke the project17:23
nikhil_kmay be it was the urls etc17:23
kragnizI think we may be able to enable it again17:24
sigmavirus24Admittedly, no one says "I totally broke how the engine powering this will work under these conditions" in their message, but they damn well should17:24
sigmavirus24=P17:24
nikhil_khaving a short url might annoy some people17:24
kragnizhttp://lists.openstack.org/pipermail/openstack-dev/2014-December/052519.html17:28
*** sgotliv has quit IRC17:28
kragnizsigmavirus24: nikhil_k ^17:29
sigmavirus24kragniz: yeah, that's what I was thinking of17:32
sigmavirus24nikhil_k: well shortening services are subject to availability, so using one (even if openstack provided) could provide more harmful than helpful17:32
openstackgerritInessa Vasilevskaya proposed openstack/glance: Declarative definitions of type-specific Artifact properties  https://review.openstack.org/11917417:32
openstackgerritInessa Vasilevskaya proposed openstack/glance: A mixin for jsonpatch requests validation  https://review.openstack.org/14858817:32
openstackgerritInessa Vasilevskaya proposed openstack/glance: Artifacts API  https://review.openstack.org/13662917:32
openstackgerritInessa Vasilevskaya proposed openstack/glance: SemVer utility to store SemVer-compatible object versions in DB  https://review.openstack.org/10767617:32
openstackgerritInessa Vasilevskaya proposed openstack/glance: Artifacts Repository - DB  https://review.openstack.org/11599817:32
openstackgerritInessa Vasilevskaya proposed openstack/glance: Artifacts Domain  https://review.openstack.org/13289817:32
openstackgerritInessa Vasilevskaya proposed openstack/glance: Artifacts plugin loader  https://review.openstack.org/13430017:32
nikhil_kand not everyone likes google ;)17:37
nikhil_ksigmavirus24: I see your point :)17:37
*** jyoti-ranjan has quit IRC17:37
sigmavirus24the counter argument, of course, is that links rot no matter what17:37
sigmavirus24so17:37
sigmavirus24we need archive.openstack.org to run an internet archive like service =P17:38
nikhil_klet's ask TravT if his team is willing to write another elastic search17:39
nikhil_kbrb17:39
sigmavirus24lol17:39
*** jistr has quit IRC17:39
sigmavirus24TravT: you're rewriting elastic search in Python? Cool! =P17:39
*** pkoniszewski has joined #openstack-glance17:39
kragniznikhil_k: sounds like a plan!17:40
sigmavirus24should we bolt this onto glance too or... ?17:42
kragnizsigmavirus24: it can go in artifacts17:42
*** pdb has quit IRC17:52
*** TravT has quit IRC17:54
*** TravT has joined #openstack-glance17:55
*** EmilienM|afk is now known as EmilienM18:00
*** annegent_ has joined #openstack-glance18:04
openstackgerritJesse J. Cook proposed openstack/glance: Replace snet config with endpoint config  https://review.openstack.org/15014418:09
*** harlowja has joined #openstack-glance18:11
openstackgerritJesse J. Cook proposed openstack/glance_store: Replace snet config with endpoint config  https://review.openstack.org/13972618:11
openstackgerritInessa Vasilevskaya proposed openstack/glance: Declarative definitions of type-specific Artifact properties  https://review.openstack.org/11917418:13
openstackgerritInessa Vasilevskaya proposed openstack/glance: A mixin for jsonpatch requests validation  https://review.openstack.org/14858818:13
openstackgerritInessa Vasilevskaya proposed openstack/glance: Artifacts API  https://review.openstack.org/13662918:13
openstackgerritInessa Vasilevskaya proposed openstack/glance: Artifacts Repository - DB  https://review.openstack.org/11599818:13
openstackgerritInessa Vasilevskaya proposed openstack/glance: Artifacts Domain  https://review.openstack.org/13289818:13
openstackgerritInessa Vasilevskaya proposed openstack/glance: Artifacts plugin loader  https://review.openstack.org/13430018:13
*** flwang has joined #openstack-glance18:15
*** jasondot_ has quit IRC18:20
*** flwang has quit IRC18:25
*** flwang has joined #openstack-glance18:30
*** TravT has quit IRC18:30
*** cpallares has quit IRC18:31
*** annashen has joined #openstack-glance18:34
*** eglynn has joined #openstack-glance18:41
*** eglynn has quit IRC18:45
*** TravT has joined #openstack-glance18:47
*** TravT has quit IRC18:54
*** buzztroll has quit IRC18:55
*** aix has quit IRC18:59
*** jasondot_ has joined #openstack-glance19:02
*** echevemaster has joined #openstack-glance19:11
*** flwang has quit IRC19:12
kragniznikhil_k: stuart posted comments a little while ago, if you hadn't already seen them19:15
nikhil_kkragniz: just about to19:15
*** EmilienM is now known as EmilienM|afk19:25
nikhil_ksigmavirus24: https://review.openstack.org/#/c/146437/ , if you've a few moments19:28
sigmavirus24nikhil_k: yes?19:29
nikhil_ksigmavirus24: seems like Stuart is of the opinion that this default incr value is delyaed already19:30
nikhil_kbased on your input about os-ansible like projects facing issues, it bring us into a trixy situation19:31
nikhil_kUsualy, I'd be more careful about increasing defaults like this however, he seems to have a good point19:32
sigmavirus24So by default, I think we uses whatever glance has a default in this particular case19:32
sigmavirus24Regardless, I do think there's value in configuring this for os-ansible-deployment regardless of the defaults in glance19:33
sigmavirus24Unless the defaults are really really good ;)19:33
*** nellysmitt has quit IRC19:34
nikhil_kheh19:34
sigmavirus24(part of the reason for all my work on the glance policy stuff)19:35
nikhil_kok, that does add more weight19:35
nikhil_k(to your counter argument)19:35
nikhil_kwas about to say geh instead of gah19:37
nikhil_kthen realized that it may not be the best place to do so19:37
nikhil_k(place/moment/situation etc)19:37
sigmavirus24nikhil_k: I think you're confusing me for brian?19:37
nikhil_klol19:37
nikhil_kok, switching the topic19:38
sigmavirus24'ian' in 'brian' == True19:38
nikhil_k:D19:38
sigmavirus24'ian' != 'brian' ;)19:38
nikhil_ksigmavirus24: oh no, I did see both of your comments19:38
kragnizsigmavirus24: so what you're saying is you ate brian19:39
nikhil_kand have pinged him separately19:39
sigmavirus24no no19:39
sigmavirus24brian at me19:39
nikhil_ksigmavirus24: https://review.openstack.org/#/c/148574/4/glance/common/utils.py19:39
*** eglynn has joined #openstack-glance19:39
sigmavirus24Oh. Hm. nikhil_k I'm also easy swayed by both sides because I'm far too empathetic19:39
nikhil_kpep error on the docstring19:39
sigmavirus24why did hacking not catch that?19:40
sigmavirus24=(19:40
nikhil_kegzaktli19:40
sigmavirus24huh?19:40
nikhil_kexactly19:40
nikhil_kgunna test some tests on that patch, seems important19:41
*** sigmavirus24 is now known as sigmavirus24_awa19:43
*** sigmavirus24_awa is now known as sigmavirus2419:43
nikhil_kam getting a bunch of pep8 errors on that review, completely unrelated19:46
sigmavirus24nikhil_k: what hacking version are you running?19:47
nikhil_ksigmavirus24: rebuilding the venv now19:48
nikhil_kthey are in the wsme utils19:48
nikhil_kabout old style objectts and such19:48
sigmavirus24I remember ye olde classes of yore19:49
kragnizI didn't think that check was merged in hacking yet?19:49
*** EmilienM|afk is now known as EmilienM19:50
kragnizignore me, I was thinking of the static method one19:51
nikhil_kI think it merge quite a while ago19:51
nikhil_kjd had some patches for the same19:51
kragnizyeah, I'm sure19:51
nikhil_kwonder why I'm seeing this now19:52
*** belmoreira has joined #openstack-glance19:52
kragnizit wasn't the one I was thinking of19:52
kragnizit's odd the gate didn't catch it19:52
nikhil_kanyone use xiki much?19:52
nikhil_kyeah19:52
kragnizlet me run tests in my env19:52
kragnizno, what's xiki?19:52
nikhil_khttps://github.com/trogdoro/xiki19:52
nikhil_kseems pretty cool19:53
nikhil_kgunna get some lunch while the tests run19:54
kragnizlooks cool19:54
kragniznikhil_k: okay, have a good lunch19:55
*** TravT has joined #openstack-glance19:56
sigmavirus24why does xiki's site remind me of fish19:58
kragniznikhil_k: tox -e pep8 is showing up clean in my env on ativelkov's patch19:59
sigmavirus24kragniz: the tox.ini ignores may be insightful19:59
kragnizsigmavirus24: right20:01
sigmavirus24would be funny if nikhil_k had somehow upgraded pep8 to 1.5.7 without angering pbr20:02
kragnizheh20:02
*** jasondot_ has quit IRC20:02
* kragniz needs to go home20:03
*** flwang1 has quit IRC20:05
*** annashen has quit IRC20:06
*** spzala_ has joined #openstack-glance20:07
sigmavirus24go home kragniz20:08
*** TravT has quit IRC20:08
sigmavirus24kragniz: are you still there?20:08
*** spzala has quit IRC20:08
*** spzala_ is now known as spzala20:08
*** TravT has joined #openstack-glance20:09
*** flwang has joined #openstack-glance20:09
*** TravT has quit IRC20:09
sigmavirus24kragniz-reply | awk '/y(es)?/i { print "Go home kragniz" }'20:09
*** pkoniszewski has quit IRC20:09
*** flwang1 has joined #openstack-glance20:18
*** sgotliv has joined #openstack-glance20:18
*** sgotliv has quit IRC20:19
*** mjturek has joined #openstack-glance20:22
*** cpallares has joined #openstack-glance20:30
*** annashen has joined #openstack-glance20:33
*** jasondot_ has joined #openstack-glance20:33
openstackgerritSteve Lewis proposed openstack/glance: Rewrite SSL tests  https://review.openstack.org/14840020:39
*** annashen has quit IRC20:40
*** annashen has joined #openstack-glance20:45
*** jasondot_ has quit IRC20:45
*** nellysmitt has joined #openstack-glance20:47
openstackgerritSteve Lewis proposed openstack/glance: Rewrite SSL tests  https://review.openstack.org/14840020:47
*** nellysmitt has quit IRC20:54
*** diegows has quit IRC20:54
nikhil_ksigmavirus24: while the other things are fixed21:00
nikhil_kwhat do you think about https://review.openstack.org/#/c/148574/4/glance/tests/unit/common/test_utils.py21:00
nikhil_kCopyright 2015?21:00
nikhil_kand I'm wondering why he removed the ws before Licensed21:00
nikhil_krest of the things look good21:01
nikhil_kativelkov: still around by any chance?21:01
nikhil_kI know it's 12am your time :)21:01
sigmavirus24nikhil_k: left comments21:02
*** thumpba has joined #openstack-glance21:09
thumpbai am trying to upload an image over 5gb. i got this error "413 Request Entity Too Large"21:10
nikhil_kthumpba: check your storage quota21:11
nikhil_kor glance config for size limit21:11
nikhil_ksigmavirus24: https://www.python.org/dev/peps/pep-0257/#multi-line-docstrings is not enforcing blank line on the first one, and did our hacking change?21:12
sigmavirus24nikhil_k: hacking doesn't use pep257 because docstrings aren't that important21:13
thumpbanikhil_k: in glance-api.conf "#image_size_cap=1099511627776"21:13
nikhil_kheh, I remeber being pestered on this21:13
sigmavirus24also pep257 has a few false positives too21:13
thumpbanikhil_k: so just uncomment21:13
nikhil_kthumpba: sure, be careful though21:14
nikhil_kif your node can't handle that much data, it may go down21:14
thumpbanikhil_k: im migrating a instance from another openstack env. the snapshot is raw format 5.3GB21:14
*** krtaylor has joined #openstack-glance21:16
*** diegows has joined #openstack-glance21:17
*** changbl has quit IRC21:18
nikhil_kI getting a bit worried on the size of buffer being too large here21:23
ativelkovnikhil_k: I am here :)21:23
nikhil_kativelkov: hey!21:23
ativelkovI am still in Bay Area, have a flight back to Russia in an hour21:24
nikhil_kativelkov: oh ok, no issues21:25
nikhil_kativelkov: will you be available tomorrow?21:25
ativelkovYes, hopefully :)21:25
nikhil_kativelkov: I'm trying to investigate a potential memory dos using this patch21:26
*** changbl has joined #openstack-glance21:26
nikhil_kativelkov: ok, in that case - I will propose k2 to be closed on wed sometime21:26
*** belmoreira has quit IRC21:26
ativelkovI still have about 40 minutes before the boarding starts. Let's take a look21:26
ativelkovSo, you are concerned by the buffer being allocated?21:27
nikhil_kativelkov: yes, what can be the maximum size of the buffer?21:28
ativelkovIt is set equal to the value returned by the underlying iterator21:29
ativelkovso, it actually does not take any extra memory21:29
ativelkovit just remembers the last chunk read from the external source21:29
ativelkovThe sie of that chunk is usually defined by READ_CHUNK_SIZE of appropriate backend21:29
ativelkovsize*21:29
ativelkovIn case of HTTP store it is 16 Mb which is a bit too much, I believe21:30
*** chipmanc has joined #openstack-glance21:30
ativelkovBut that is a separate issue, as this patch does not take a single bit extra - it just makes sure that if the consumer has requested less then that size, then the remaining is not lost21:31
ativelkovsigmavirus24: are you around?21:33
sigmavirus24ativelkov: o/21:33
ativelkovAbout your comment to that patch.21:34
ativelkovThe test case in test_cooperative_reader_preserves_size_chunk_less_then_read was intended to demonstrate that the sequence of data in the whole content is correct regardless of the chunk sizes21:35
ativelkovso I made it to read the whole data into memory and then verified21:35
sigmavirus24ativelkov: those three tests are all the same code with different parameters21:36
sigmavirus24They can be written as one function that each of those three calls with different parameters21:36
ativelkovahh, got it21:36
ativelkovI thought you want them to do chunk-by-chunk assertion21:36
ativelkovYes, sure, will do21:36
sigmavirus24sorry I wasn't clear21:38
nikhil_ksorry, I think I may be misreading it here21:39
nikhil_kif your allocate result = bytearray() and do result.extend(chunk)21:41
nikhil_kit is storing extra data in memory right?21:41
nikhil_kand like you are saying, the max size would be chunk size marked by external source21:42
ativelkovAh, this on. Got it21:42
ativelkovYes, this would be equal to the read size requested by consumer21:44
nikhil_kThis is the reason why I was proposing to have common constants or constants specific to stores in a place which can be monitored, collaborated upon, contained, say what you may21:44
ativelkovrounded up by the chunk_size21:44
nikhil_kThis _may_ be an issue if your glance node is of small memory and the external source driver keeps a high chunk constants21:45
nikhil_kand someone with this internal knowledge requests a bit too many of copy-from operations21:46
ativelkovwell, we may limit the buffer size then21:46
nikhil_kyeah, exactly21:46
nikhil_khow complicated will that become?21:47
nikhil_k(do you know?)21:47
ativelkovThinking21:47
ativelkovThe issue is not the read chunk size21:48
ativelkovWe should just limit the requested read length21:49
ativelkovActually, read chunk size is the issue we may not avoid at all21:50
ativelkovI mean, if it is set to 16 Gb and the host just has 8 Gb of RAM, we are in trouble anyway21:51
ativelkovbecause even a single read operation will lead to OOM21:52
ativelkovBut what we can do is to avoid very large read values21:53
nikhil_khmm21:53
ativelkovWe actually have two options if the consumer requests too large read size: we may either raise an exception OR return less the requested21:55
*** chipmanc has quit IRC21:56
nikhil_kativelkov: so, in the v1 code it is feeding off the LimitingReader21:56
ativelkovthe latter is a little worse as some consumers may interpret that as the end of stream which is not true21:56
nikhil_kativelkov: right21:57
ativelkovYes, the LimitingReader raises an exception21:57
ativelkovOk, we may use the same approach here21:57
nikhil_kyeah21:57
ativelkovnikhil_k: do you suggest to use the same configuration parameter as the limit value? Or use something lower?21:59
nikhil_kativelkov: heh, thinking22:00
ativelkovActually this parameter should not be too high: this is the size of the buffer, not the size of the whole image22:00
*** flwang has quit IRC22:01
ativelkovMy built-in random number generator suggests 128 Mb as a very pessimistic estimate of the worst possible read size chunk which may be meanigfull22:02
nikhil_kativelkov: yeah, so in the BufferedReader we use something22:02
nikhil_klemme see what that is22:02
*** spzala has quit IRC22:02
sigmavirus24similarly, a user with 8 GB and a read asking for 5GB could also have problems if we're duplicating that 5GB anywhere, we should be trying to use memoryviews if possible to avoid copies22:03
sigmavirus24also for consideration, simultaneously issuing two reads that summed up exceed the system capabilities22:04
nikhil_kok, so this is not using any limits too! https://review.openstack.org/#/c/120866/522:04
sigmavirus24(two or more reads ofc)22:04
nikhil_ksigmavirus24: yeah, although accessing the memory looks a bit icky as is ...22:06
ativelkovWell, we should bot be asking for 5Gb at all22:06
ativelkovFor what we have now, the read size is determined by the httplib of whatever is used by the store client22:06
ativelkovIn swift it is 8K22:07
nikhil_k( ativelkov: the issue is that Cooperative reader is not optional)22:07
nikhil_kyeah, just that some random driver adds a mechanism to read a whole chunk of data22:08
nikhil_ks/whole/huge/22:08
*** spzala has joined #openstack-glance22:09
nikhil_kanyway, we may be over-projecting it here22:09
sigmavirus24ativelkov: so uploads in httplib are by default 8192 bytes22:09
sigmavirus24no way to change it22:09
sigmavirus24yeah22:09
sigmavirus24if you want, add securityimpact to the commit message adn send openstack-security a message explaining the concerns22:09
ativelkovsigmavirus24: yes.22:09
nikhil_kin essence, we need to provide a way for the reader to be smart about not reading gigantic data22:09
sigmavirus24nikhil_k: yeah, and maybe the openstack-security has a good idea about how to do this ;)22:10
nikhil_ksigmavirus24: surely!22:10
sigmavirus24swift may also have experience in this regard22:10
nikhil_kgood point22:10
nikhil_kalthough, they rate limit pretty smart is what I hear22:11
ativelkovFolks, the boarding to my flight starts in about a minute. So, I will address sigmavirus24 's questions to tests, add some reasonable upper limit to read length and submit a new patch22:11
nikhil_kativelkov: sure, that sounds like a good plan22:11
ativelkovwill return back online in about 16 hours22:11
nikhil_kplease drop me a message when you are back22:11
nikhil_kI will try to hold off k222:12
nikhil_kativelkov: safe travels ;)22:12
nikhil_kI may need to -2 this unfortunately22:15
nikhil_kand we don't have IRC logs for today!22:16
nikhil_kfun fun fun..22:16
*** peristeri has quit IRC22:17
sigmavirus24nikhil_k: why don't we have logs?22:22
nikhil_ksigmavirus24: prolly, the cron job did not upload for today22:26
nikhil_kit may be every 24hrs22:26
sigmavirus24weird. I thought they updated live22:26
* sigmavirus24 wonders if other channels are having the same issues22:27
sigmavirus24nikhil_k: http://eavesdrop.openstack.org/irclogs/%23openstack-glance/%23openstack-glance.2015-02-02.log live updating22:27
sigmavirus24(So long as you refresh)22:27
nikhil_kdarn, I'm on the meetings page :P22:28
nikhil_kurl fail22:28
sigmavirus24It's okay nikhil_k. Happens to all of us =P22:28
nikhil_klol22:29
*** annashen has quit IRC22:30
*** ericpete_ has joined #openstack-glance22:32
*** ericpeterson has quit IRC22:34
nikhil_ksigmavirus24: in the worst case, say 401 - this change https://review.openstack.org/#/c/146437/ would retry 25 times (if using swiftclient)!22:39
sigmavirus24brb, getting off vpn22:40
nikhil_k(the information missing is swiftclient retries the entire request 5 times already)22:40
sigmavirus24so the reality being that swiftclient is probably right in retrying the whole request each time22:41
sigmavirus24although22:41
sigmavirus24hm22:41
sigmavirus24So this is the thing22:41
nikhil_k(may be not 401 then, though in some random scenaario that I don't know of)22:41
sigmavirus24httplib prevents requests from properly supporting the "Expects" header being sent by a client22:41
sigmavirus24That would give us the opportunity to not upload the entire thing first22:41
*** annegent_ has quit IRC22:42
sigmavirus24401 being authentication possible but failed iirc, that would return instead of a 100-continue22:42
sigmavirus24so that would make this a lot better22:42
sigmavirus24so that's a fundamental limitation of swiftclient and python's httplib as a whole22:42
sigmavirus24(Arent' you glad I know all of this so you don't have to? =P)22:43
stevellesigmavirus24: do you also do windows?22:43
* nikhil_k ponders into wilderness22:43
sigmavirus24stevelle: I've been branching out into a brick & mortar bitcoin store for artisinally crafted bitcoin. I'm calling it Mordor22:44
stevellesigmavirus24: I have just the logo for your new store...22:44
sigmavirus24I swear. 3 years (ish) maintaining requests and I know way too much about things I never thought I'd ever care about22:44
*** annashen has joined #openstack-glance22:45
nikhil_ksigmavirus24: sorry, I did not get your point in specific. Also, the 401 might not be the case for 25 retries, something like a 500 could be.22:49
sigmavirus24nikhil_k: yeah, I'm thinking we want retries in a much more specific way22:50
nikhil_kAlthough, 100-continue would be applicable in case of the auth retry right? and you're saying swiftclient does not work well with it?22:50
sigmavirus24this is like 80% of the way there22:50
sigmavirus24so 401 is an authentication failure22:50
sigmavirus24if you do a post with Expects: 100-continue22:50
sigmavirus24then technically the client should wait for a "response" (it isn't really a full http response but semantics) of 100 Continue (status line)22:51
sigmavirus24then the client would upload the server22:51
*** flwang has joined #openstack-glance22:51
nikhil_k(yes, we are a bit too familiar with this part of swiftclient)22:51
sigmavirus24since that's comes only if the headers a complete, it could issue a 401 immediately and the body would never be uploaded22:51
sigmavirus24so really22:51
sigmavirus24those 25 retries wouldn't be so bad if we weren't uploading the body22:52
sigmavirus24which is something we can't avoid thanks to httplib22:52
nikhil_kyou're right, although we're retrying to the LB 25 times22:52
nikhil_kand that _can_ global rate limit you22:52
nikhil_kbasically, you don't want glance user to be bloked22:53
sigmavirus24Yeah22:53
sigmavirus24yep22:53
nikhil_k:((22:53
nikhil_kok, let's block this for now22:53
*** nellysmitt has joined #openstack-glance22:55
*** ericpete_ has quit IRC22:55
*** ericpeterson has joined #openstack-glance22:55
sigmavirus24nikhil_k: am I doing the math right on that, 25 retries with exponential retry back off means that the total time would be over 4600 hours?22:55
*** ericpete_ has joined #openstack-glance22:55
sigmavirus24*total time used by sleep22:55
*** alex_xu_ has quit IRC22:58
*** ericpeterson has quit IRC22:59
*** nellysmitt has quit IRC23:00
*** alex_xu has joined #openstack-glance23:01
*** annashen has quit IRC23:03
nikhil_ksigmavirus24: yeah, though that's just defaults23:04
nikhil_kmumhh, yeah may be we can let it slip dunno. Depends on how operators see this23:04
sigmavirus24openstack-operators would be a good place to discuss this23:05
nikhil_kdo you mind adding your excellent suggestion?23:05
nikhil_kdon't want to take away your IP rights here :P23:05
nikhil_k(was sincere in the first comment and kidding in the second)23:06
nikhil_k(IRC can be hard)23:06
*** vijendar has quit IRC23:07
sigmavirus24heh23:08
*** sigmavirus24 is now known as sigmavirus24_awa23:11
*** chlong has joined #openstack-glance23:12
*** TravT has joined #openstack-glance23:15
*** TravT has quit IRC23:24
*** TravT has joined #openstack-glance23:25
*** gordc has quit IRC23:25
*** jwang__ has quit IRC23:28
*** eglynn has quit IRC23:34
*** mjturek has quit IRC23:35
*** annegent_ has joined #openstack-glance23:42
*** TravT has quit IRC23:43
*** TravT has joined #openstack-glance23:44
*** annegent_ has quit IRC23:49
*** thangp has quit IRC23:53
*** annegent_ has joined #openstack-glance23:57

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!