Wednesday, 2015-07-08

*** Guest7393 has quit IRC00:04
*** harshs has quit IRC00:04
*** mgarza has quit IRC00:11
*** mingdang1 has joined #openstack-glance00:11
*** chlong has joined #openstack-glance00:12
openstackgerritWayne Okuma proposed openstack/glance: Glance metadef tables need unique constraints.  https://review.openstack.org/19582000:21
*** tsekiyam_ has joined #openstack-glance00:22
*** dims has joined #openstack-glance00:23
*** jamielennox is now known as jamielennox|away00:24
*** mingdang_ has joined #openstack-glance00:25
*** tsekiyama has quit IRC00:26
*** tsekiyam_ has quit IRC00:27
*** sigmavirus24 is now known as sigmavirus24_awa00:27
*** mingdang1 has quit IRC00:29
*** mtanino has quit IRC00:30
*** jamielennox|away is now known as jamielennox00:35
*** jasondotstar has quit IRC00:43
*** ducttape_ has joined #openstack-glance00:58
*** Longgeek has joined #openstack-glance01:15
*** Longgeek has quit IRC01:20
*** spzala has joined #openstack-glance01:22
*** annegentle has joined #openstack-glance01:23
*** dims_ has joined #openstack-glance01:24
*** dims_ has quit IRC01:24
*** mingdang_ has quit IRC01:27
*** dims has quit IRC01:27
*** annegentle has quit IRC01:27
*** hogepodge has quit IRC01:29
*** wayne__ has quit IRC01:32
*** hogepodge has joined #openstack-glance01:41
openstackgerritLong Quan Sha proposed openstack/python-glanceclient: Fix the download error when the image locations are blank  https://review.openstack.org/19936701:42
*** Ctina has joined #openstack-glance01:58
*** Ctina has quit IRC01:58
*** jskinner has joined #openstack-glance02:02
*** jskinner has quit IRC02:04
*** ericpeterson has joined #openstack-glance02:04
*** ducttape_ has quit IRC02:06
*** ericpeterson has quit IRC02:19
*** jasondotstar has joined #openstack-glance02:22
*** annegentle has joined #openstack-glance02:34
openstackgerritLong Quan Sha proposed openstack/glance: Fix downlaod error when the image status is not active  https://review.openstack.org/19937802:36
*** bkopilov has quit IRC02:36
*** annegentle has quit IRC02:37
*** changbl has joined #openstack-glance02:48
openstackgerritLong Quan Sha proposed openstack/glance: Fix downlaod error when the image status is not active  https://review.openstack.org/19937802:54
*** gberginc has joined #openstack-glance02:54
*** jasondotstar has quit IRC03:02
*** gberginc has quit IRC03:13
*** Longgeek has joined #openstack-glance03:16
*** Longgeek has quit IRC03:22
*** harshs has joined #openstack-glance03:32
*** annegentle has joined #openstack-glance03:37
*** annegentle has quit IRC03:41
*** boris-42 has quit IRC03:52
*** ayoung has quit IRC03:56
*** bkopilov has joined #openstack-glance03:57
*** arnaud___ has joined #openstack-glance03:58
*** annashen has joined #openstack-glance04:01
*** zxen has quit IRC04:05
*** zxen has joined #openstack-glance04:05
*** mtreinish has quit IRC04:07
*** gberginc has joined #openstack-glance04:09
*** r-daneel has joined #openstack-glance04:13
*** mtreinish has joined #openstack-glance04:16
*** david-ly_ has joined #openstack-glance04:19
*** sgotliv has joined #openstack-glance04:21
*** david-lyle has quit IRC04:22
*** annashen has quit IRC04:28
*** chlong has quit IRC04:35
*** arnaud___ has quit IRC04:37
*** chlong has joined #openstack-glance04:44
*** arnaud___ has joined #openstack-glance04:44
*** chlong has quit IRC04:51
*** changbl has quit IRC04:52
openstackgerritLong Quan Sha proposed openstack/glance: Fix downlaod error when the image status is not active  https://review.openstack.org/19937805:06
*** dims has joined #openstack-glance05:11
openstackgerritLong Quan Sha proposed openstack/glance: Fix downlaod error when the image status is not active  https://review.openstack.org/19937805:14
*** Longgeek has joined #openstack-glance05:16
openstackgerritLong Quan Sha proposed openstack/glance: Fix download error when the image status is not active  https://review.openstack.org/19937805:17
*** arnaud___ has quit IRC05:20
*** chlong has joined #openstack-glance05:20
*** boris-42 has joined #openstack-glance05:21
*** ajayaa has quit IRC05:22
*** arnaud___ has joined #openstack-glance05:25
*** annegentle has joined #openstack-glance05:26
*** annegentle has quit IRC05:30
*** harshs has quit IRC05:34
*** dims has quit IRC05:40
*** ajayaa has joined #openstack-glance05:45
*** krykowski has joined #openstack-glance05:50
*** lakshmiS_ has joined #openstack-glance05:50
*** ig0r__ has joined #openstack-glance05:51
*** sgotliv has quit IRC05:52
*** sgotliv has joined #openstack-glance05:52
*** ig0r_ has quit IRC05:52
*** zxen has quit IRC05:55
*** nlevinki has joined #openstack-glance05:55
*** zxen has joined #openstack-glance05:55
openstackgerritChangBo Guo(gcb) proposed openstack/glance: Don't choose and set eventlet's hub type by Glance  https://review.openstack.org/19940205:57
openstackgerritOpenStack Proposal Bot proposed openstack/glance: Imported Translations from Transifex  https://review.openstack.org/19720606:04
*** nlevinki has quit IRC06:05
*** bkopilov has quit IRC06:19
*** tobe has joined #openstack-glance06:19
*** nlevinki has joined #openstack-glance06:20
openstackgerritOpenStack Proposal Bot proposed openstack/glance_store: Imported Translations from Transifex  https://review.openstack.org/19451006:20
*** mingdang1 has joined #openstack-glance06:21
*** abhishekk has joined #openstack-glance06:24
*** groen692 has joined #openstack-glance06:27
*** bkopilov has joined #openstack-glance06:32
*** mingdang1 has quit IRC06:45
*** markus_z has joined #openstack-glance06:46
*** markus_z has quit IRC06:58
*** arnaud___ has quit IRC07:02
*** arnaud___ has joined #openstack-glance07:06
*** arnaud___ has quit IRC07:06
*** annegentle has joined #openstack-glance07:14
*** annegentle has quit IRC07:19
*** e0ne has joined #openstack-glance07:25
*** ccrouch has quit IRC07:33
*** exploreshaifali has joined #openstack-glance07:38
*** dims has joined #openstack-glance07:41
*** dims_ has joined #openstack-glance07:42
*** jistr has joined #openstack-glance07:43
*** dims has quit IRC07:45
*** dims_ has quit IRC07:46
*** tobe has quit IRC07:46
*** e0ne is now known as e0ne_07:49
*** e0ne_ is now known as e0ne07:51
*** e0ne is now known as e0ne_07:57
*** e0ne_ is now known as e0ne07:59
*** e0ne has quit IRC08:00
*** tobe has joined #openstack-glance08:16
*** chlong has quit IRC08:21
*** pdb is now known as pbourke08:23
*** tobe has quit IRC08:25
*** tobe has joined #openstack-glance08:25
*** boris-42 has quit IRC08:32
*** belmoreira has joined #openstack-glance08:38
*** tobe has quit IRC08:40
*** dims has joined #openstack-glance08:43
*** dims_ has joined #openstack-glance08:44
*** dims__ has joined #openstack-glance08:45
*** dims___ has joined #openstack-glance08:46
openstackgerritAlexey Galkin proposed openstack/glance: Improve code readability in functional test for the WSGIServer  https://review.openstack.org/19809308:46
*** dims has quit IRC08:47
*** dims_ has quit IRC08:49
*** dims__ has quit IRC08:49
*** dims___ has quit IRC08:50
*** GeetikaBatra has joined #openstack-glance09:02
*** e0ne has joined #openstack-glance09:03
*** annegentle has joined #openstack-glance09:03
*** annegentle has quit IRC09:08
*** r-daneel has quit IRC09:08
*** belmoreira has quit IRC09:12
*** markus_z has joined #openstack-glance09:16
*** tobe has joined #openstack-glance09:20
*** e0ne is now known as e0ne_09:21
*** belmoreira has joined #openstack-glance09:24
*** e0ne_ is now known as e0ne09:26
*** mingdang1 has joined #openstack-glance09:26
*** mingdang_ has joined #openstack-glance09:29
*** mingdang1 has quit IRC09:32
*** haypo has joined #openstack-glance09:34
*** bdossant has joined #openstack-glance09:36
*** e0ne is now known as e0ne_09:37
*** lakshmiS_ has quit IRC09:45
*** jasondotstar has joined #openstack-glance09:45
*** GeetikaBatra has quit IRC09:51
*** GeetikaBatra has joined #openstack-glance09:52
*** aix has joined #openstack-glance09:54
*** mingdang_ has quit IRC09:55
*** e0ne_ is now known as e0ne10:00
*** e0ne is now known as e0ne_10:11
*** GeetikaBatra is now known as GB2110:13
*** e0ne_ is now known as e0ne10:13
*** tobe has quit IRC10:29
*** GB21 has quit IRC10:36
*** e0ne is now known as e0ne_10:40
*** e0ne_ is now known as e0ne10:42
*** annegentle has joined #openstack-glance10:52
*** mingdang1 has joined #openstack-glance10:56
*** annegentle has quit IRC10:56
*** vijendar has joined #openstack-glance10:59
*** mingdang1 has quit IRC11:00
*** GeetikaBatra has joined #openstack-glance11:12
*** GeetikaBatra has quit IRC11:13
*** GeetikaBatra has joined #openstack-glance11:16
*** GeetikaBatra is now known as GB2111:25
*** mingdang1 has joined #openstack-glance11:29
*** krykowski_ has joined #openstack-glance11:32
*** krykowski has quit IRC11:34
*** e0ne is now known as e0ne_11:34
*** e0ne_ is now known as e0ne11:35
*** e0ne has quit IRC11:38
*** shosagoudar has joined #openstack-glance11:39
*** Longgeek has quit IRC11:41
shosagoudarhey guys, glance is failing to give result for "glance -d image-list"11:41
*** ducttape_ has joined #openstack-glance11:41
*** Longgeek has joined #openstack-glance11:42
*** Longgeek has quit IRC11:42
*** Longgeek has joined #openstack-glance11:42
shosagoudarfrom /var/log/glance/api.log, its saying "WARNING keystonemiddleware.auth_token [-] Authorization failed for token"11:42
shosagoudarwhat could be the issue/how to debug?11:43
*** Longgeek has quit IRC11:43
*** GB21 has quit IRC11:46
*** GeetikaBatra has joined #openstack-glance11:46
*** dims has joined #openstack-glance11:47
*** zul has quit IRC11:48
*** dims_ has joined #openstack-glance11:48
*** dims__ has joined #openstack-glance11:49
*** GeetikaBatra_ has joined #openstack-glance11:50
*** exploreshaifali has quit IRC11:51
*** GeetikaBatra has quit IRC11:52
*** dims has quit IRC11:52
*** dims_ has quit IRC11:53
*** dims__ has quit IRC11:54
*** ducttape_ has quit IRC11:56
jokke_yelling out for help here as well. Any ideas why our kilo tests are failing in glance_store? http://logs.openstack.org/36/199136/1/check/gate-glance_store-python27/7d74387/console.html#_2015-07-07_14_57_14_25811:57
kragnizjokke_: I'm going to blame pbr11:58
kragnizbut that might be unfair11:59
kragnizshosagoudar: can you get a token from keystone using the creds you're using to talk to glance?12:00
jokke_kragniz: _something_ seems to have requirement t oslo.config >=1.11.0 but I can't find what it is :(12:00
*** krykowski has joined #openstack-glance12:04
*** ajayaa has quit IRC12:06
*** krykowski_ has quit IRC12:07
shosagoudarkragniz : I am getting the following error when tried to issue the token using "openstack token issue"12:10
shosagoudar"openstack token issue --os-auth-type password  --os-user-domain-name default  --os-user-domain-id default --os-username glance12:10
shosagoudarERROR: openstack Invalid username or password (Disable debug mode to suppress these details.) (HTTP 401) (Request-ID: req-e71b9dde-1fa0-4be4-b8a3-e4066e301dde)"12:10
shosagoudarbut the same works for admin user,12:11
shosagoudaras its credentials are sources using "source admin.rc"12:11
shosagoudaris it the issue?12:11
shosagoudarthe above command to get the token for glance user failed even without asking for password12:12
kragnizit sounds like a keystone issue, or the credentials are wrong or not set up properly12:13
shosagoudarbut keystone is working fine for admin user12:15
kragnizyou're probably using the wrong credentials, then12:16
*** belmoreira has quit IRC12:17
*** krykowski has quit IRC12:19
*** gberginc has quit IRC12:19
shosagoudarlet me update the password then for glance12:20
shosagoudarkragniz: you are correct, openstack-keystone service has died,12:22
*** belmoreira has joined #openstack-glance12:23
*** Longgeek has joined #openstack-glance12:25
*** jasondotstar has quit IRC12:25
openstackgerritChangBo Guo(gcb) proposed openstack/glance: test with evenlet monkey_patch  https://review.openstack.org/19953912:25
openstackgerritChangBo Guo(gcb) proposed openstack/glance: test with eventlet monkey_patch  https://review.openstack.org/19953912:28
*** exploreshaifali has joined #openstack-glance12:28
*** GeetikaBatra has joined #openstack-glance12:29
*** annegentle has joined #openstack-glance12:30
*** zul has joined #openstack-glance12:30
*** chlong has joined #openstack-glance12:31
jokke_ok ... stable/kilo for _store and client should be on track if we get the changes on flight in and those dependency issues in _store gate fixed12:31
*** GeetikaBatra_ has quit IRC12:32
*** GeetikaBatra has quit IRC12:39
*** mingdang1 has quit IRC12:43
*** abhishekk has quit IRC12:44
*** GeetikaBatra has joined #openstack-glance12:44
*** shosagoudar has quit IRC12:47
*** ninag has joined #openstack-glance12:49
*** dims has joined #openstack-glance12:50
*** dims has quit IRC12:54
*** shosagoudar has joined #openstack-glance12:55
GeetikaBatrahello everyone, I am trying to run image scrubbers, apparently it was not working, so as I traced it, it says module' object has no attribute 'register_options'12:55
GeetikaBatraI searched a little bit, this is the case of  mutual top-level imports12:56
GeetikaBatracan anyone please help me on this12:56
openstackgerritLong Quan Sha proposed openstack/python-glanceclient: Fix the download error when the image locations are blank  https://review.openstack.org/19954912:57
*** mfedosin has quit IRC12:59
*** ninag has quit IRC13:00
*** mfisch has quit IRC13:00
*** ninag has joined #openstack-glance13:00
*** mfedosin has joined #openstack-glance13:01
*** julim has joined #openstack-glance13:01
*** GeetikaBatra has quit IRC13:02
*** cdelatte has joined #openstack-glance13:03
*** jasondotstar has joined #openstack-glance13:05
*** peristeri has joined #openstack-glance13:05
*** GeetikaBatra has joined #openstack-glance13:13
*** shosagoudar has quit IRC13:16
mclarenjokke_: I'm motivated to look into that13:17
*** changbl has joined #openstack-glance13:19
*** ayoung has joined #openstack-glance13:20
*** dims has joined #openstack-glance13:22
*** GeetikaBatra_ has joined #openstack-glance13:25
*** GeetikaBatra has quit IRC13:27
jokke_mclaren: please let me know if you find the cause ... I'm trying to dig into that as well13:32
*** shosagoudar has joined #openstack-glance13:32
mclarensure13:33
*** ducttape_ has joined #openstack-glance13:34
mclarenjokke_: wondering if we need to explicitly set/bound python-keystone client in requirements.txt13:37
mclarenjokke_: yeah, I think that fixes it.13:38
*** annegentle has quit IRC13:45
*** annegentle has joined #openstack-glance13:45
mclarenit looks very similar to https://bugs.launchpad.net/designate/+bug/146398813:48
openstackLaunchpad bug 1463988 in keystonemiddleware kilo "requirements.txt out of sync for stable/kilo" [Low,Confirmed]13:48
*** vijendar has quit IRC13:51
*** vijendar has joined #openstack-glance13:51
jokke_we need to get Doug unblock this https://review.openstack.org/#/c/173977/13:51
jokke_mclaren: lets see if we get that sync to pytho-cinderclient in and if that fixes our issue as I suspect13:53
*** annegentle has quit IRC14:02
*** bkopilov has quit IRC14:03
*** mtanino has joined #openstack-glance14:04
*** edmondsw has joined #openstack-glance14:05
*** GeetikaBatra_ has quit IRC14:09
*** shosagoudar has quit IRC14:17
*** mfisch has joined #openstack-glance14:19
*** mfisch has quit IRC14:20
*** mfisch has joined #openstack-glance14:20
*** pbourke has quit IRC14:20
*** pbourke has joined #openstack-glance14:20
*** vijendar has quit IRC14:22
*** vijendar has joined #openstack-glance14:22
*** vijendar1 has joined #openstack-glance14:26
*** annegentle has joined #openstack-glance14:27
*** vijendar has quit IRC14:27
*** kebray has joined #openstack-glance14:33
*** flwang has quit IRC14:40
*** nlevinki has quit IRC14:44
*** ajayaa has joined #openstack-glance14:45
*** GeetikaBatra has joined #openstack-glance14:47
*** bpoulos has joined #openstack-glance14:47
openstackgerritMike Fedosin proposed openstack/glance_store: Fix expired token issue while uploading chunks to swift  https://review.openstack.org/19904914:48
openstackgerritMike Fedosin proposed openstack/glance_store: Fix expired token issue while uploading chunks to swift  https://review.openstack.org/19904914:52
*** belmoreira has quit IRC14:53
*** GeetikaBatra_ has joined #openstack-glance14:58
*** GeetikaBatra_ is now known as GB2114:58
*** GeetikaBatra has quit IRC14:58
mfedosinsigmavirus24_awa, jokke_ , mclaren , hi, folks! I really want to hear your opinions about https://review.openstack.org/#/c/199049/3 it fixes a very nasty bug with token expiration during upload that we encountered many times.14:58
*** ninag has quit IRC15:00
mfedosinativelkov, you're welcome too :) ^15:00
*** ninag has joined #openstack-glance15:01
nikhil_khemanthm: ^15:02
* hemanthm looking15:03
*** dims has quit IRC15:04
*** dims has joined #openstack-glance15:05
mfedosinnikhil_k, hemanthm \o/ review it too, please15:05
openstackgerritLong Quan Sha proposed openstack/python-glanceclient: Fix the download error when the image locations are blank  https://review.openstack.org/19954915:06
jokke_mfedosin: elegant15:07
*** ninag has quit IRC15:07
*** shosagoudar has joined #openstack-glance15:08
jokke_mfedosin: we could use that with swift+config as well, no?15:08
*** dims has quit IRC15:10
hemanthmmfedosin: we've been bitten by this a lot. I had a quick look, it looks ok to me. However, I don't necessarily like to include re-aunthenticating logic here because it really belongs in the client.15:10
*** bkopilov has joined #openstack-glance15:10
hemanthmmfedosin: swiftclient does re-authenticate though. But, it fails miserably to resume the upload after re-authenticating when its working with a stream15:10
mfedosinjokke_, I think we can15:10
hemanthmit works perfectly with a file though because it can seek and tell15:11
hemanthmlet me point you to a patch that's trying to solve the same problem but in a different way15:11
mfedosinhemanthm, yes please15:11
jokke_hemanthm: that's what I was thinking as well15:11
hemanthmmfedosin, jokke_: https://review.openstack.org/#/c/120891/15:12
hemanthmthat patch needs some love. I can start the work if there is interest15:13
*** mclaren has quit IRC15:14
*** bkopilov has quit IRC15:15
*** primechuck has joined #openstack-glance15:15
jokke_hemanthm: Honestly, what Mike is proposing is a bugfix, that dependency patch of the review you linked is still new feature IMO and I think we should get spec out for that if someone wants to revive it15:17
jokke_I'm personally not huge fan of the buffered approach as that brings us the thread pool issues back15:18
*** boris-42 has joined #openstack-glance15:21
mfedosinhemanthm, yeah, very cool! but i'm interested in one thing. Swift doesn't know that it's a stream, because it accepts separated objects each time. so if there was a Unauthorized error, we don't start chunk upload and nothing changes for swift and the stream and  the number of uploaded bytes.15:22
mfedosinI'm going to ask Alexey Galkin to test it very well today and tomorrow15:22
mfedosinwith different configurations and in HA mode15:22
*** dims has joined #openstack-glance15:23
mfedosinI will tell you the results when it's done :)15:23
hemanthmmfedosin: cool, thanks!15:23
hemanthmjokke_: +1, I'm not necessarily saying 'no' to this approach. Even with bufferedReader, it's not that everyone will use it. It's configurable. But, just saying that I'm not necessarily a fan of having re-authenticating logic in there, which belongs in the client to me. Every case is different anyway15:25
*** tsekiyama has joined #openstack-glance15:27
*** bkopilov has joined #openstack-glance15:27
jokke_hemanthm: I hear ya! I think we need to accept that if you use stream as input you will loose some benefits of static file15:28
jokke_hemanthm: that's just reality, but we should not have that as an issue as the failure comes at the point when we try to upload next chunk, no? So our data point should be always on the correct place?15:30
*** spzala has quit IRC15:30
jokke_hemanthm: so do you have an idea where the swiftclient actually loses the sync on that?15:31
hemanthmjokke_: +115:31
hemanthmjokke_: I tries to seek on the stream, which is not available. Let me link you to the code15:32
jokke_aha15:32
jokke_ok, that makes sense15:32
*** vijendar1 has quit IRC15:33
*** vijendar has joined #openstack-glance15:33
jokke_mfedosin: don't we loose the chunk we're uploading on your approach as well?15:35
jokke_mfedosin: we do reauthenticate, but we do not resend the chunk after that, we continue to the next chunk15:35
hemanthmjokke_: +1, good point15:36
mfedosinjokke_, I thought we resent it, but I need to check it again :) thanks15:37
jokke_mfedosin: flagged it in the review15:38
mfedosintechnically we can't start upload if it was a error... my test checks it btw - that there were 7 uploaded chunks15:39
*** e0ne has joined #openstack-glance15:40
*** zul has quit IRC15:41
*** david-ly_ is now known as david-lyle15:42
*** exploreshaifali has quit IRC15:42
jokke_mfedosin: hmm-m ... that's tricky ... that is expecting that the swiftclient does not read anything from the input on that failure scenario15:43
jokke_mfedosin: have you pulled the image down and verified checksum that it actually matches with the original, as I'm pretty sure that would corrupt the data.15:45
*** annegentle has quit IRC15:45
*** annegentle has joined #openstack-glance15:46
*** groen692 has quit IRC15:47
mfedosinjokke_, I'm not sure with swiftclient at all :) I'm currently talking with Alexey, he's going to start testing it right now.15:47
*** jasondotstar has quit IRC15:48
jokke_now I don't know swiftclient well enough so it might depend when the token expires. If they do it same way we do that they create the object and then upload it it's fine as long as the token expires between the two objects but we're again screwed if it expires between creating the object and uploading it as that would read stuff from the reader and corrupt again15:48
jokke_damn, this is actually really nasty scenario to solve without buffering of some kind15:49
*** spzala__ has joined #openstack-glance15:55
jokke_I'm more and more leaning towards the trusts and renewing the trust-token between every chunk15:56
*** jistr has quit IRC15:56
*** jasondotstar has joined #openstack-glance15:58
mfedosinjokke_, this patch is the last desperate attempt to avoid the use of trusts :D15:59
*** spzala__ is now known as spzala15:59
jokke_mfedosin: I'm more and more thinking we shouldn't avoid them ... specially as this change does not even address the issue for normal multitenant case16:00
mfedosinare there some alternatives?16:01
mfedosinI think no16:01
mfedosinso, yes, you're right, we should start moving in that way16:02
*** kebray has quit IRC16:04
*** zul has joined #openstack-glance16:08
*** dontalton has joined #openstack-glance16:10
*** bdossant has quit IRC16:13
*** arnaud___ has joined #openstack-glance16:14
*** markus_z has quit IRC16:15
*** dims has quit IRC16:15
*** dims has joined #openstack-glance16:16
*** flwang has joined #openstack-glance16:18
*** dims has quit IRC16:21
*** arnaud___ has quit IRC16:22
mfedosinkragniz, can you look? https://review.openstack.org/#/c/199061/ we have an issue with bad import and many people are struggling from this bug: https://review.openstack.org/#/c/199549/ for example16:24
*** jasondotstar has quit IRC16:25
*** GeetikaBatra has joined #openstack-glance16:27
*** changbl has quit IRC16:29
*** jaypipes has quit IRC16:29
*** kebray has joined #openstack-glance16:29
*** GB21 has quit IRC16:30
*** ajayaa has quit IRC16:33
*** dims has joined #openstack-glance16:40
*** dontalton is now known as bitblt16:41
*** bitblt has quit IRC16:41
*** bitblt has joined #openstack-glance16:41
*** bitblt has quit IRC16:42
*** primechuck has quit IRC16:44
*** arnaud___ has joined #openstack-glance16:45
openstackgerritMerged openstack/glance: Improve code readability in functional test for the WSGIServer  https://review.openstack.org/19809316:46
*** harshs has joined #openstack-glance16:47
*** arnaud___ has quit IRC16:53
*** ayoung has quit IRC16:59
*** ByPasS has joined #openstack-glance17:01
jokke_mfedosin: still around?17:04
ByPasSHi guys, having a question about snapshot quotas. In my setup I'm using ceph as a backend. Pool being user from creating a new VM is VMs. When I do a nova image-create (snapshop) the snapshot ends up in the image pool which is being used by glance and can list snapshots from glance if I look in the properties of the image ( image type snapshot ). What are the actual quotas being used for the amount of snapshots and/or images that can be created17:05
ByPasSby a tenant ?17:05
mfedosinjokke_, yep, I'm here17:06
jokke_ByPasS: honestly I didn't know we have snapshot quotas17:06
jokke_mfedosin: I'm trying to understand that piece of code17:06
jokke_ref the upload to swift17:06
haypohey, i'm still looking for reviews on my glance_store patches: https://review.openstack.org/#/c/184601/ & https://review.openstack.org/#/c/184603/17:07
mfedosinjokke_, what line #?17:07
ByPasSthere is a quota section but it doesnt seem to be related directly on the actual amount or not clear to me (image_member_quota / image_property_quota / image_tag_quota / image_location_quota / user_storage_quota)17:08
jokke_mfedosin: currently I'm amazed around 54617:08
jokke_mfedosin: so how the ChunkReader knows where to read from?17:08
jokke_mfedosin: so if I understand correctly it just waks through the file descriptor17:09
jokke_walks17:09
nikhil_kByPasS: there are not quotas on that17:09
nikhil_kno*17:09
jokke_mfedosin: and even we create new one every round of that while loop, it just continues where the marker is in that fd17:10
jokke_mfedosin: that would be on L955ish +17:13
mfedosinjokke_, yes. to change the number of read bytes swift must execute 'read', but it doesn't happen,  so the position must be the same, I think17:14
jokke_mfedosin: it must read something for that request ... ref my comment failure happening on upload vs. object creation17:15
jokke_mfedosin: so if it fails on upload swift has read x amount of data to send with the request, we move forward on fd and never seek back, we retry and that chunk of data (rather than swift large object chunk) is lost17:16
jokke_== corrupted image17:16
mfedosinokay, I got you. It's easy to fix anyway.17:17
jokke_is it?17:17
jokke_isn't the fd stream rather that static file?17:17
mfedosinthe obvious thing is to check token expiration before each chunk upload17:18
*** mingdang1 has joined #openstack-glance17:18
mfedosinand reauth if it happened17:19
jokke_mfedosin: yes, and make sure that the lifetime of that token is enough to be 100% sure we can send that request within the time17:19
mfedosinso no upload - no problems17:19
*** primechuck has joined #openstack-glance17:19
jokke_++ I like your way of thinking ;)17:19
jokke_just wanted to make sure I'm not getting crazy with this corrupted image scenario of mine ;)17:20
hemanthmmfedosin: is that going to add one extra auth call for every chunk?17:20
jokke_hemanthm: yup17:20
hemanthmhow about caching the expiration timestamp instead?17:21
* jokke_ hopes that we actually get the expiration time from the keystone17:21
jokke_not just True|False if it's valid17:21
mfedosinhemanthm, it's not reauth on each chunk, just a small check. it doesn't have big overhead17:21
hemanthmmfedosin: must be a head call right?17:22
mfedosinhemanthm, yes, why not?17:22
*** mingdang1 has quit IRC17:22
hemanthmit may result in too many requests17:23
mfedosinbtw, do we have an access to token exp time param from glance_store?17:23
hemanthmmfedosin: chunk size in configurable17:23
hemanthmso if you choose a smalle chunk size, it will result in too many auth requests17:23
mfedosinI mean can we know its value?17:23
hemanthmmultiply that by the number of simultaneous images that maybe happening17:23
mfedosinby default it's 200mb17:24
mfedosinwhat the reason to make it lower?17:24
jokke_hemanthm: has a point ... we might hit to the ratelimiting on big deployments ... this is good point to improve documentation and advice those big environment deployers to make sure their chunk size is large enough to avoid that17:25
mfedosinjokke_, ++17:26
hemanthmmfedosin: there isn't one specific reason why some operators may choose to go with smaller chunks17:27
jokke_I think default large object size is something around 5GB so that 200MB default is bit ridiculous anyways17:27
jokke_hemanthm: but this is good reason for them to go bigger ;)17:27
hemanthmfor instance: parallel downloads17:27
*** bkopilov has quit IRC17:28
hemanthmjokke_: yes but on the other hand, if you have a bigger chunk, you are probably wasting the bandwidth on errors17:28
*** e0ne has quit IRC17:28
hemanthmretrying a 1GB chunk vs 200mb or whatever17:29
hemanthmjust trade-offs really17:29
jokke_hemanthm: well at the moment we're wasting the bandwidth of everything uploaded thus far. I think we cannot go worse17:29
hemanthmjokke_: yes, yes, I'm just saying there are reasons why one could go either way17:29
mfedosinI talked with keystone guys, they told that token cached in their middleware17:30
jokke_hemanthm: thus the advice "if you are (likely) hitting the ratelimits, increase the chunk size or live with it" Problem solved/tradeoff made17:30
hemanthmjokke_: its not really a trade-off in my view, it appers to be an upper cap17:31
jokke_mfedosin: so is there some way we can query the token metadata from the middleware?17:31
mfedosinno, but there are two options: 1. normally (in case of big chunk size) we send a head request to keystone and check token expiration17:32
*** spzala_ has joined #openstack-glance17:33
mfedosin2. in case of small chunks token cached in keystone middleware for 5 mins17:33
jokke_mfedosin: will that query return the expiration time or will it return True|False depending if the token is still valid?17:33
mfedosinso we can easily checks it's status without any request to keystone17:34
mfedosintrue|false17:34
jokke_so that is absolutely pointless then17:34
jokke_as it will not remove our problem anywhere17:34
*** spzala has quit IRC17:35
jokke_as we will still do the new request without knowing that we have time to send the request while the token is still valid17:35
*** spzala_ is now known as spzala17:35
mfedosinjokke_, agree, there is that possibility17:35
*** bkopilov has joined #openstack-glance17:36
jokke_but if we move to trusts, we know exactly how long the trust is valid, we can extend it by ourselves and all these issues are just gone17:36
jokke_+ it works on all of our tenancy modes not just single or swift+config17:37
mfedosinjokke_, can not argue :) but anyway I will think about other possible solutions...17:39
*** dims has quit IRC17:39
*** dims has joined #openstack-glance17:39
mfedosinjokke_, hemanth excuse me, I have to go. see you tomorrow! thanks for support, folks17:40
jokke_mfedosin: sure, good night! o/~17:40
hemanthmmfedosin: later, have a good one17:41
*** vijendar1 has joined #openstack-glance17:41
*** vijendar has quit IRC17:43
*** vijendar1 has quit IRC17:43
*** vijendar has joined #openstack-glance17:43
*** exploreshaifali has joined #openstack-glance17:48
*** delattec has joined #openstack-glance17:52
*** annashen has joined #openstack-glance17:53
*** arnaud___ has joined #openstack-glance17:54
*** bkopilov has quit IRC17:54
*** cdelatte has quit IRC17:56
*** Longgeek has quit IRC17:57
*** Longgeek has joined #openstack-glance17:57
*** Longgeek has quit IRC17:57
*** aix has quit IRC17:57
*** Longgeek has joined #openstack-glance17:59
*** arnaud___ has quit IRC18:00
*** ducttape_ has quit IRC18:00
*** spzala_ has joined #openstack-glance18:06
*** kebray has quit IRC18:06
*** spzala has quit IRC18:08
*** spzala_ is now known as spzala18:08
*** bkopilov has joined #openstack-glance18:09
*** ayoung has joined #openstack-glance18:11
*** ducttape_ has joined #openstack-glance18:13
*** GeetikaBatra is now known as GB2118:17
*** ajayaa has joined #openstack-glance18:20
*** boris-42 has quit IRC18:22
openstackgerritChris St. Pierre proposed openstack/glance: Purge dead file-backed scrubber queue code  https://review.openstack.org/16105118:23
*** kebray has joined #openstack-glance18:25
*** exploreshaifali has quit IRC18:36
*** jamielennox is now known as jamielennox|away18:47
*** TravT has quit IRC18:48
*** TravT has joined #openstack-glance18:48
*** jamielennox|away is now known as jamielennox18:54
*** sigmavirus24_awa is now known as sigmavirus2418:56
*** arnaud___ has joined #openstack-glance18:56
*** arnaud___ has quit IRC19:01
shosagoudarkragniz: This entry @ /etc/glance/glance-api.conf => [keystone_authtoken] helped to fix the issue19:02
shosagoudarauth_host = controller19:02
shosagoudarauth_port = 3535719:02
shosagoudarauth_protocol = http19:02
shosagoudaradmin_tenant_name = service19:02
shosagoudaradmin_user = XXXXXX19:02
shosagoudaradmin_password = XXXXXX19:02
shosagoudarauth_uri = __http://controller:500019:02
*** MentalRay has joined #openstack-glance19:08
MentalRayHello.  Is anyone has a juno or kilo setup running on 10gbe and has tested the snapshot speed?19:08
*** e0ne has joined #openstack-glance19:09
*** bitblt has joined #openstack-glance19:13
*** ajayaa has quit IRC19:22
*** r-daneel has joined #openstack-glance19:23
*** kebray has quit IRC19:28
nikhil_kGB21: ^19:33
*** zul has quit IRC19:34
*** shosagoudar has quit IRC19:34
*** kebray has joined #openstack-glance19:36
*** changbl has joined #openstack-glance19:37
*** e0ne has quit IRC19:47
*** ajayaa has joined #openstack-glance19:47
*** arnaud___ has joined #openstack-glance19:57
*** bpoulos has left #openstack-glance20:00
*** arnaud___ has quit IRC20:02
*** exploreshaifali has joined #openstack-glance20:05
*** vilobhmm has joined #openstack-glance20:08
*** openstackgerrit has quit IRC20:10
*** openstackgerrit has joined #openstack-glance20:10
*** e0ne has joined #openstack-glance20:11
*** e0ne has quit IRC20:12
*** wayne__ has joined #openstack-glance20:17
*** belmoreira has joined #openstack-glance20:18
*** GB21 has quit IRC20:19
*** kebray has quit IRC20:20
*** kebray has joined #openstack-glance20:23
*** sgotliv has quit IRC20:26
*** shosagoudar has joined #openstack-glance20:30
*** shosagoudar has quit IRC20:35
*** jasondotstar has joined #openstack-glance20:40
*** wayne__ has quit IRC20:42
*** kebray has quit IRC20:43
*** kebray has joined #openstack-glance20:48
*** spzala has quit IRC20:50
*** annegentle has quit IRC20:55
*** jasondotstar has quit IRC21:08
*** ducttape_ has quit IRC21:15
*** annegentle has joined #openstack-glance21:25
*** ducttape_ has joined #openstack-glance21:26
*** e0ne has joined #openstack-glance21:29
*** fifieldt has quit IRC21:30
*** TravT has quit IRC21:33
*** belmoreira has quit IRC21:34
*** ajayaa has quit IRC21:36
*** e0ne has quit IRC21:37
*** TravT has joined #openstack-glance21:39
*** TravT has quit IRC21:42
*** fifieldt has joined #openstack-glance21:43
*** arnaud___ has joined #openstack-glance21:45
*** jasondotstar has joined #openstack-glance21:48
*** annegentle has quit IRC21:49
*** annegentle has joined #openstack-glance21:49
*** arnaud___ has quit IRC21:50
*** jasondotstar has quit IRC22:00
openstackgerritIan Cordasco proposed openstack/python-glanceclient: Remove custom SSL compression handling  https://review.openstack.org/18934422:02
*** mingdang1 has joined #openstack-glance22:04
*** boris-42 has joined #openstack-glance22:04
*** spzala has joined #openstack-glance22:04
*** ducttape_ has quit IRC22:07
*** TravT has joined #openstack-glance22:07
jamielennoxkragniz: around?22:08
*** peristeri has quit IRC22:10
*** tpeoples has quit IRC22:11
*** kebray has quit IRC22:16
*** MentalRay has quit IRC22:18
*** ducttape_ has joined #openstack-glance22:18
*** annegentle has quit IRC22:21
*** mingdang1 has quit IRC22:22
*** Guest69012 has joined #openstack-glance22:23
*** ericpeterson has joined #openstack-glance22:24
*** ducttape_ has quit IRC22:24
*** ducttape_ has joined #openstack-glance22:25
*** ericpeterson has quit IRC22:25
*** shosagoudar has joined #openstack-glance22:31
*** Guest69012 has quit IRC22:32
*** shosagoudar has quit IRC22:35
*** sigmavirus24 is now known as sigmavirus24_awa22:35
*** primechuck has quit IRC22:47
*** wayne__ has joined #openstack-glance22:47
*** edmondsw has quit IRC22:50
*** boris-42 has quit IRC22:56
*** boris-42 has joined #openstack-glance22:57
*** ducttape_ has quit IRC23:09
*** annashen has quit IRC23:12
*** shalq has quit IRC23:17
*** shalq has joined #openstack-glance23:17
*** ByPasS has quit IRC23:18
*** exploreshaifali has quit IRC23:21
*** zul has joined #openstack-glance23:29
*** arnaud___ has joined #openstack-glance23:33
*** arnaud___ has quit IRC23:38
*** TravT has quit IRC23:48

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!