Thursday, 2017-10-26

« Wednesday, 2017-10-25 Index Friday, 2017-10-27 »
*** newmember has quit IRC00:00
*** links has joined #openstack-glance00:23
*** namnh has joined #openstack-glance00:55
*** trungnv has quit IRC01:15
*** trungnv has joined #openstack-glance01:49
*** AlexeyAbashkin has joined #openstack-glance01:51
*** gyee has quit IRC01:52
*** AlexeyAbashkin has quit IRC01:55
*** spectr has quit IRC02:03
*** spectr has joined #openstack-glance02:05
*** dalgaaf has quit IRC02:09
*** dalgaaf has joined #openstack-glance02:10
*** Sukhdev has joined #openstack-glance02:20
*** dillaman has quit IRC02:22
*** masuberu has quit IRC02:34
openstackgerritOpenStack Proposal Bot proposed openstack/glance master: Updated from global requirements  https://review.openstack.org/51110402:50
*** AlexeyAbashkin has joined #openstack-glance02:51
openstackgerritOpenStack Proposal Bot proposed openstack/glance master: Updated from global requirements  https://review.openstack.org/51110402:51
openstackgerritOpenStack Proposal Bot proposed openstack/glance master: Updated from global requirements  https://review.openstack.org/51110402:53
*** rosmaita has quit IRC02:53
*** masber has joined #openstack-glance02:55
*** AlexeyAbashkin has quit IRC02:55
*** masber has quit IRC02:57
*** masber has joined #openstack-glance02:57
*** masber has quit IRC03:19
*** nicolasbock has quit IRC03:22
*** AlexeyAbashkin has joined #openstack-glance03:51
*** AlexeyAbashkin has quit IRC03:55
*** masber has joined #openstack-glance04:02
*** masber has quit IRC04:04
*** masber has joined #openstack-glance04:04
*** pdeore has joined #openstack-glance04:20
*** udesale has joined #openstack-glance04:22
*** markvoelker has quit IRC04:23
*** abhishekk has joined #openstack-glance04:29
*** udesale has quit IRC04:34
*** rmcallis has quit IRC04:41
*** rmcallis has joined #openstack-glance04:44
*** markvoelker has joined #openstack-glance04:55
*** gcb has joined #openstack-glance05:16
*** markvoelker has quit IRC05:24
openstackgerritOpenStack Proposal Bot proposed openstack/glance master: Updated from global requirements  https://review.openstack.org/51110405:24
*** markvoelker has joined #openstack-glance05:24
*** markvoelker has quit IRC05:28
*** ratailor has joined #openstack-glance05:33
*** nikhil has quit IRC05:45
*** aavraham has joined #openstack-glance05:54
*** AlexeyAbashkin has joined #openstack-glance06:03
*** e0ne has joined #openstack-glance06:10
*** AlexeyAbashkin has quit IRC06:19
*** Sukhdev has quit IRC06:19
*** mosulica has joined #openstack-glance06:27
*** e0ne has quit IRC06:28
*** udesale has joined #openstack-glance06:30
*** starhunter has joined #openstack-glance06:33
*** starhunter has quit IRC06:47
*** rcernin has quit IRC07:04
*** tshefi has joined #openstack-glance07:09
*** tesseract has joined #openstack-glance07:09
*** e0ne has joined #openstack-glance07:15
*** markvoelker has joined #openstack-glance07:25
*** markvoelker has quit IRC07:59
*** gcb has quit IRC08:01
*** AlexeyAbashkin has joined #openstack-glance08:03
*** namnh has quit IRC08:04
*** namnh has joined #openstack-glance08:04
*** arcolife has joined #openstack-glance08:26
*** d0ugal has quit IRC08:32
*** d0ugal_ has joined #openstack-glance08:32
*** d0ugal_ has quit IRC08:33
*** d0ugal has joined #openstack-glance08:33
*** d0ugal has quit IRC08:33
*** d0ugal has joined #openstack-glance08:33
*** rmcallis has quit IRC08:39
*** rmcallis has joined #openstack-glance08:44
*** markvoelker has joined #openstack-glance08:57
*** AlexeyAbashkin has quit IRC09:02
*** AlexeyAbashkin has joined #openstack-glance09:06
*** mine0901 has joined #openstack-glance09:11
*** namnh has quit IRC09:24
*** namnh has joined #openstack-glance09:24
*** markvoelker has quit IRC09:29
*** AlexeyAbashkin has quit IRC09:37
*** AlexeyAbashkin has joined #openstack-glance09:46
*** AlexeyAbashkin has quit IRC09:53
*** aavraham has quit IRC09:54
*** aavraham has joined #openstack-glance09:55
*** masber has quit IRC10:09
*** namnh has quit IRC10:16
*** markvoelker has joined #openstack-glance10:26
*** e0ne has quit IRC10:28
*** e0ne has joined #openstack-glance10:30
*** e0ne has quit IRC10:30
*** e0ne has joined #openstack-glance10:31
*** e0ne has quit IRC10:32
*** e0ne has joined #openstack-glance10:33
*** e0ne has quit IRC10:33
*** gcb has joined #openstack-glance10:43
*** nicolasbock has joined #openstack-glance10:54
*** markvoelker has quit IRC10:59
*** nicolasbock has quit IRC11:06
*** pdeore has quit IRC11:06
*** AlexeyAbashkin has joined #openstack-glance11:07
*** udesale has quit IRC11:13
*** arcolife has quit IRC11:17
*** nicolasbock has joined #openstack-glance11:20
*** masber has joined #openstack-glance11:22
*** bkopilov_ has quit IRC11:28
*** links has quit IRC11:36
*** markvoelker has joined #openstack-glance11:57
*** mine0901 has quit IRC12:00
*** mosulica has quit IRC12:02
*** ratailor has quit IRC12:03
*** markvoelker has quit IRC12:29
*** markvoelker has joined #openstack-glance12:40
*** gcb has quit IRC12:42
*** gcb has joined #openstack-glance12:42
*** gcb has quit IRC12:48
*** mvk has quit IRC12:52
*** pdeore has joined #openstack-glance12:54
*** e0ne has joined #openstack-glance13:03
*** mvk has joined #openstack-glance13:32
*** rosmaita has joined #openstack-glance13:35
*** dosaboy has quit IRC13:48
jokke_rosmaita: you around?13:49
rosmaitayep13:49
jokke_cool13:49
*** e0ne has quit IRC13:53
*** abhishek_k has joined #openstack-glance13:53
rosmaitajokke_ : can you take a quick look at https://review.openstack.org/#/c/508566/2 ? you had +2'd the first patch set13:54
jokke_+2W13:56
rosmaitaty13:57
rosmaitaCourtesy meeting reminder on #openstack-meeting-4: ativelkov, cpallares, flaper87, flwang1, hemanthm, jokke_, kragniz, lakshmiS, mclaren, mfedosin, nikhil_k, Nikolay_St, Olena, pennerc, rosmaita, sigmavirus24, sabari, TravT, ajayaa, GB21, bpoulos, harshs, abhishekk, bunting, dshakhray, wxy, dhellmann, kairat, alex_bash, smcginnis, arcolife13:58
abhishek_kjokke_: could you please have a look at https://review.openstack.org/#/c/440876/, if time permits?13:58
*** McClymontS has joined #openstack-glance13:59
jokke_ouch, that's old14:00
*** dosaboy has joined #openstack-glance14:00
abhishek_kjokke_ yes14:01
smcginniso/14:06
openstackgerritMerged openstack/glance-specs master: Add lite spec for language neutralization  https://review.openstack.org/50856614:07
*** rcernin has joined #openstack-glance14:08
*** pdeore has quit IRC14:09
*** marst has joined #openstack-glance14:13
*** catintheroof has joined #openstack-glance14:17
*** newmember has joined #openstack-glance14:25
*** nikhil has joined #openstack-glance14:41
*** burgerk has joined #openstack-glance14:51
*** abhishek_k has quit IRC15:00
*** McClymontS has quit IRC15:01
*** aavraham has left #openstack-glance15:01
*** spectr has quit IRC15:02
*** rcernin has quit IRC15:04
*** tshefi has quit IRC15:08
nikhilrosmaita: sorry to stall your priority. hopefully it's worth it https://review.openstack.org/#/c/510449/15:11
nikhillemme know if there are any more reviews to attend, I only checked the oct 13 ml note15:11
*** e0ne has joined #openstack-glance15:15
*** newmember has quit IRC15:19
*** newmember has joined #openstack-glance15:19
*** catintheroof has quit IRC15:20
*** catintheroof has joined #openstack-glance15:20
rosmaitanikhil: ty, good comment on that review15:22
*** catintheroof has quit IRC15:25
*** jdwidari has joined #openstack-glance15:29
*** jdwidari has quit IRC15:29
*** AlexeyAbashkin has quit IRC15:29
*** jdwidari has joined #openstack-glance15:31
*** jdwidari has quit IRC15:31
*** jdwidari has joined #openstack-glance15:31
rosmaitanikhil: if you have a few minutes, would like your opinion on https://review.openstack.org/#/c/512020/15:32
*** mvk has quit IRC15:39
*** gyee has joined #openstack-glance15:43
*** jdwidari has left #openstack-glance15:49
*** catintheroof has joined #openstack-glance15:51
*** catintheroof has quit IRC15:55
*** reedip_afk has joined #openstack-glance15:58
reedip_afkhi all , I am facing an issue with Glance. We moved glance from a controller to a dedicated Baremetal machine. The DB is also set up on the Baremetal machine15:58
rosmaitasounds good so far ...15:59
reedip_afkbut when we run a POST command , we get an error16:00
reedip_afk2017-10-26 15:47:19.029 2768 ERROR glance.common.wsgi   File "/usr/lib/python2.7/dist-packages/glance/common/client.py", line 539, in _do_request16:00
reedip_afk2017-10-26 15:47:19.029 2768 ERROR glance.common.wsgi     raise exception.ServerError()16:00
reedip_afk2017-10-26 15:47:19.029 2768 ERROR glance.common.wsgi ServerError: The request returned 500 Internal Server Error.16:00
reedip_afkthe glance_registry.log shows the following error16:00
reedip_afk  File "/usr/lib/python2.7/dist-packages/keystonemiddleware/auth_token/_cache.py", line 77, in reserve16:01
reedip_afk    c = memorycache.get_client(self._memcached_servers)16:01
reedip_afk  File "/usr/lib/python2.7/dist-packages/keystonemiddleware/openstack/common/memorycache.py", line 44, in get_client16:01
reedip_afk    import memcache16:01
reedip_afkImportError: No module named memcache16:01
*** reedip_afk is now known as reedip_16:01
*** catintheroof has joined #openstack-glance16:01
reedip_The thing is, we defined the memcached on the controller along with Keystone...16:01
reedip_and other Openstack CLIs are working smoothly16:01
reedip_Glance was previously on COntroller, but due to lack of space we migrated it to another machine .. thats when we hit this issue16:02
reedip_rosmaita, @all : any suggestions as to where are we going wrong ?16:03
rosmaitareedip_ the ImporError indicates that the python environment in which Glance is running doesn't have the python module available16:04
rosmaitaso even though you have memcached running on the server, glance can't communicate with it16:05
reedip_rosmaita : so do I need to install memcache in the separate baremetal machine ?16:05
rosmaitaare you using a distribution?16:05
reedip_hmm ... that sounds right... but how can I make glance communicate with the Controller ? I mean is there a memcache conf in the config file ?16:05
reedip_Ubuntu 14.0416:06
rosmaitareedip_ give me a few minutes to look over that code16:06
reedip_rosmaita : sure thing , thanks :)16:06
*** MikeW has joined #openstack-glance16:07
MikeWHey can anyone point me to a tool for purging images that go deleted from their physical backend? Can't seem to delete them from glance and therefore the UI now that they don't exist physically16:08
rosmaitareedip_ : what release are you running?16:09
reedip_rosmaita : newton16:10
rosmaitareedip_ ty16:10
reedip_rosmaita : one questoon16:10
reedip_question *16:10
reedip_do we need to mention the memcached server in glance-api.conf as http:// ??16:10
rosmaitaMikeW so your situation is that the image data has been deleted from the backend, but the image record still exists in Glance?16:10
reedip_rosmaita : or just simple IP address16:10
reedip_:1121116:10
rosmaitareedip_ i think the 11211 is the port ... not sure if :11211 is an alternative way to say "localhost:11211" or not16:13
rosmaitabut pretty sure you don't need the http://16:13
reedip_rosmaita: sorry , repeating the question. Do we need to specify memcached as http:IP_ADDRESS:11211 ? or IP_ADDRES:1121116:13
rosmaitai think ip_address:port should be OK (it's what they do in devstack)16:14
reedip_ok :)16:14
rosmaitathat's for the memcached_servers setting under [keystone_authtoken16:15
rosmaita], right?16:15
reedip_yes16:15
reedip_rosmaita16:15
rosmaitayeah, don't think you need the http://16:15
rosmaitaactually, the http:// would probably be incorrect16:16
reedip_ok, I dont have http :)16:17
reedip_I think I may have found an issue, the glance-api had memcache commented, glance-registry didnt. Let me try to comment both and run it once16:18
reedip_got the same error16:19
rosmaitareedip_ : you mean the ImportError ?16:22
reedip_rosmaita : yes, I commented mecache, restarted glance-api and glance-registry16:26
rosmaitareedip_: when you had glance running on the controller, was that Ubuntu 14.04 also?16:27
reedip_rosmaita : then checked the upload image16:27
reedip_rosmaita : yes, 14.0416:27
rosmaitareedip_ one last question before i give you advice ... you're still seeing the 'ImportError: No module named memcache' in the glance registry log?16:28
MikeWrosmaita yes that's correct16:29
reedip_rosmaita : wait, let me check ...16:29
reedip_rosmaita : no,now it is showing 503 service unavailable due to transient error in glance-api.log16:30
rosmaitaMikeW: and i guess those images are showing as status == active when you look at them in the API?16:30
reedip_rosmaita: on the glance-registry, it is showing Unauthorized Access16:30
rosmaitareedip_ i think you said you un-commented the memcache line in the glance-api.conf? that may have caused the problem you are seeing there now16:31
MikeWrosmaita yep16:32
reedip_rosmaita: no I commented the memcache line in both the configurations16:32
reedip_rosmaita: should I uncomment both ?16:32
rosmaitareedip_ not sure ... i think if you don't use memcache, you'll increase the load on your keystone16:34
reedip_rosmaita : one update, image-upload is failing, creation isnt .... !16:35
rosmaitaMikeW what happens when you try to delete one of those? what are you seeing in the api log? (and what release are you using?)16:35
reedip_image-create is working, rosmaita16:35
rosmaitareedip_ what storage backend are you using?16:36
reedip_lvm rosmaita16:36
reedip_lvm is on one baremetal machine, and the controller is on another baremetal machine16:37
*** starhunter has joined #openstack-glance16:41
*** e0ne has quit IRC16:43
*** e0ne has joined #openstack-glance16:44
*** e0ne has quit IRC16:44
*** e0ne has joined #openstack-glance16:45
*** e0ne has quit IRC16:46
*** e0ne has joined #openstack-glance16:47
*** e0ne has quit IRC16:47
MikeWrosmaita Sorry had to repair the state in the DB I had been trying some manual fixes16:49
MikeWThe glance service complains about the file backend not existing16:49
MikeWUnknown schema file for location... that's because I've switched over to rbd... switching back to file won't be possible at this time16:50
reedip_rosmaita : any advice ?16:50
rosmaitareedip_ are you using the v1 or v2 API to do the image create?16:52
reedip_rosmaita : create is with V216:52
reedip_and I think the upload , which is happening by a script, is with v1 ...16:52
reedip_does it have an affect ?16:53
rosmaitanot sure, trying to figure out what's going on16:53
*** AlexeyAbashkin has joined #openstack-glance16:53
rosmaitareedip_ what is your flavor setting in glance-api.conf (under [paste_deploy])16:54
*** mvk has joined #openstack-glance16:54
jokke_MikeW: add file store back to the enabled stores (even if you have rdb as default and you should be able to delete those images ... when you've got rid of them you can remove the file store from enabled again16:54
rosmaitajokke_: ty for jumping in!16:55
reedip_just a minute rosmaita16:56
*** e0ne has joined #openstack-glance16:56
*** AlexeyAbashkin has quit IRC16:57
reedip_rosmaita : flavor=keystone16:59
reedip_rosmaita: in both glance-api and glance-registry17:00
rosmaitaok17:00
reedip_rosmaita: this is the conf for glance-api and glance-registry17:05
reedip_rosmaita: http://paste.openstack.org/show/624735/17:05
reedip_rosmaita : Hi, I noticed one weird thing ...17:11
rosmaitareedip_ i'm listening17:11
reedip_rosmaita : HEAD is available for v1 version, while GET, PATCH and DELETE for v217:11
*** e0ne has quit IRC17:12
reedip_rosmaita : The command the script is running , is for HEAD with v117:12
MikeWjokke_ That worked I have a couple other stale images from a third backend that no longer exists...17:12
reedip_rosmaita: with memcache enabled, both glance-api and glance-registry give 503 error17:12
MikeWIt was a cinder_volume backend... what store type is that I can't remember17:12
rosmaitaMikeW : 'cinder'17:13
reedip_rosmaita: but with v2, I am not getting the 503 error. The create ( as mentioned above ) works. GET command on the same image should and does return 404 ( its not present in V2 , obviously , but it is not failing in authentication and goes to image GET )17:13
reedip_rosmaita ; if I am correct, it seems that while moving glance from controller to separate machine, only Glance V2 was installed , but not V1. However, to be sure, can you let me know how I can check if glance V1 is installed and working on a node ?17:15
MikeWrosmaita Lol I guessed that right after I asked it haha... actually these two are in my ceph cluster which is good, but I can't delete them17:16
MikeWHowever, I can create and delete all other images... this is due to I believe our ceph cluster being wiped (we're in early testing) so the images don't exist there anymore17:17
rosmaitaMikeW i think that sounds right, you may have to delete those by hand from the DB17:19
rosmaitareedip_ do GET /versions on the glance endpoint (no v1 or v2 in the request, just /versions)17:19
reedip_{"versions": [{"status": "CURRENT", "id": "v2.3", "links": [{"href": "http://192.168.200.13:9292/v2/", "rel": "self"}]}, {"status": "SUPPORTED", "id": "v2.2", "links": [{"href": "http://192.168.200.13:9292/v2/", "rel": "self"}]}, {"status": "SUPPORTED", "id": "v2.1", "links": [{"href": "http://192.168.200.13:9292/v2/", "rel": "self"}]}, {"status": "SUPPORTED", "id": "v2.0", "links": [{"href": "http://192.168.200.13:9292/v2/", "rel": "self"}]},17:21
reedip_{"status": "SUPPORTED", "id": "v1.1", "links": [{"href": "http://192.168.200.13:9292/v1/", "rel": "self"}]}, {"status": "SUPPORTED", "id": "v1.0", "links": [{"href": "http://192.168.200.13:9292/v1/", "rel": "self"}]}]}17:21
rosmaitaok, so v1 is enabled17:21
reedip_seems to be enabled17:21
reedip_yeah17:21
MikeWrosmaita is there any example scripts i can follow? I did try that earlier, but they were still visible int he UI17:21
rosmaitaMikeW : i don't know of any, we don't officially support people going directly to the DB17:22
rosmaita:)17:22
rosmaitaMikeW when you did it earlier, did you just change the image status to deleted, or did you also set the deleted column in that row to 1 ?17:23
MikeWrosmaita I think I did both of those things, but they showed up in the UI as deleted17:25
rosmaitaMikeW you mean horizon?17:27
MikeWrosmaita Yep actually your comment helped I just changed status and the flag... before I thought the deleted flag only existed in the image_locations table17:28
rosmaitareedip_ , MikeW : i need to grab lunch, will be back in roughly 1/2 hour17:28
reedip_rosmaita : sure :)17:29
rosmaitaMikeW ok, cool, no it's in all tables17:29
MikeWNo worries I'm solid thanks for your help!!!17:29
rosmaitanp17:29
*** newmember has quit IRC17:33
reedip_rosmaita : I checked the V2 create, it worked fine. I checked v1 create, it gave the same error ( 503 ) as I got with image-upload17:41
reedip_rosmaita: these are new images which I tested out17:42
rosmaitareedip_: are you using a client, or direct calls to the API?17:43
reedip_rosmaita : I thought u were in lunch :)17:43
rosmaita(and now i am really going to get lunch .. back in 30 min)17:43
rosmaita:)17:43
reedip_rosmaita : Right now I tried a client and saw the error in the tail logs17:44
reedip_after modifiying the env variables ..17:44
reedip_no issues rosmaita ...17:44
*** tesseract has quit IRC17:45
*** AlexeyAbashkin has joined #openstack-glance17:48
*** reedip_ has quit IRC17:50
*** newmember has joined #openstack-glance17:50
*** AlexeyAbashkin has quit IRC17:52
*** catintheroof has quit IRC18:13
*** Sukhdev has joined #openstack-glance18:25
*** AlexeyAbashkin has joined #openstack-glance18:30
*** starhunter has quit IRC18:32
*** Sukhdev has quit IRC18:33
*** AlexeyAbashkin has quit IRC18:34
*** AlexeyAbashkin has joined #openstack-glance18:47
*** catintheroof has joined #openstack-glance18:51
*** AlexeyAbashkin has quit IRC18:52
*** catintheroof has quit IRC18:56
*** catintheroof has joined #openstack-glance19:05
*** catintheroof has quit IRC19:09
*** catintheroof has joined #openstack-glance19:28
*** harlowja has quit IRC19:46
*** McClymontS has joined #openstack-glance20:15
*** McClymontS has quit IRC20:17
*** newmember has quit IRC20:28
*** AlexeyAbashkin has joined #openstack-glance20:31
*** harlowja has joined #openstack-glance20:33
*** burgerk has quit IRC20:34
*** AlexeyAbashkin has quit IRC20:35
*** AlexeyAbashkin has joined #openstack-glance20:47
*** catintheroof has quit IRC20:49
*** AlexeyAbashkin has quit IRC20:52
tonybjokke_, abhishekk : I saw a discusion about a bug/change I might dislike ... what's the # I can check now if you like21:28
*** marst has quit IRC22:00
rosmaitatonyb: https://review.openstack.org/#/c/440876/22:05
rosmaitatonyb: i think we decided not to do it, so don't worry if you don't have time22:06
tonybrosmaita: okay It's preety clear so I can drop a review (which agrees with jokke_ and smcginnis)22:07
rosmaitatonyb: that works, thanks ... it will be helpful for the next time something like this comes up22:08
tonybrosmaita: okay.22:10
*** AlexeyAbashkin has joined #openstack-glance22:46
*** AlexeyAbashkin has quit IRC22:50
*** AlexeyAbashkin has joined #openstack-glance23:07
*** AlexeyAbashkin has quit IRC23:11
*** AlexeyAbashkin has joined #openstack-glance23:27
*** AlexeyAbashkin has quit IRC23:32
*** links has joined #openstack-glance23:46
« Wednesday, 2017-10-25 Index Friday, 2017-10-27 »

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!