Tuesday, 2020-07-28

« Monday, 2020-07-27 Index Wednesday, 2020-07-29 »
*** gmann has quit IRC00:51
*** gmann has joined #openstack-glance00:51
*** CeeMac has quit IRC00:52
*** CeeMac has joined #openstack-glance00:55
*** baojg has quit IRC01:38
*** baojg has joined #openstack-glance01:41
*** rcernin has quit IRC02:59
*** rcernin has joined #openstack-glance03:03
*** gyee has quit IRC04:10
*** m75abrams has joined #openstack-glance04:15
*** evrardjp has quit IRC04:33
*** evrardjp has joined #openstack-glance04:33
*** ratailor has joined #openstack-glance04:37
openstackgerritAbhishek Kekane proposed openstack/glance master: Victoria milestone 2 release notes  https://review.opendev.org/74283504:55
*** udesale has joined #openstack-glance05:27
openstackgerritAbhishek Kekane proposed openstack/glance master: Add new config options in sample config generator  https://review.opendev.org/74345205:37
openstackgerritAbhishek Kekane proposed openstack/glance master: Refresh Glance example configs for Victoria milestone 2  https://review.opendev.org/74345305:37
*** bhagyashris|away is now known as bhagyashris06:01
*** lpetrut has joined #openstack-glance06:04
openstackgerritMerged openstack/glance_store master: [goal] Migrate glance_store jobs to focal  https://review.opendev.org/74310906:05
*** baojg has quit IRC06:15
*** amoralej|off is now known as amoralej07:05
*** nikparasyr has joined #openstack-glance07:11
openstackgerritzhufl proposed openstack/glance_store master: [Trivial]Add missing white space between words  https://review.opendev.org/74347407:15
*** baojg has joined #openstack-glance07:21
*** rcernin has quit IRC07:32
*** ralonsoh has joined #openstack-glance07:53
*** bhagyashris is now known as bhagyashris|lunc08:10
*** rcernin has joined #openstack-glance08:48
*** priteau has joined #openstack-glance08:49
*** rcernin has quit IRC08:54
*** bhagyashris|lunc is now known as bhagyashris09:41
*** Luzi has joined #openstack-glance09:45
*** k_mouza has joined #openstack-glance09:57
*** udesale_ has joined #openstack-glance09:58
*** udesale has quit IRC10:01
*** rcernin has joined #openstack-glance10:19
*** rcernin has quit IRC10:43
*** bhagyashris is now known as bhagyashris|away11:06
*** k_mouza has quit IRC11:13
*** k_mouza has joined #openstack-glance11:19
*** k_mouza has quit IRC11:19
*** k_mouza has joined #openstack-glance11:20
*** k_mouza has quit IRC11:34
*** bhagyashris|away is now known as bhagyashris11:36
*** k_mouza has joined #openstack-glance11:45
*** ratailor has quit IRC11:45
*** k_mouza has quit IRC11:53
*** priteau has quit IRC11:55
*** priteau has joined #openstack-glance11:56
*** evrardjp has quit IRC12:00
*** tkajinam has quit IRC12:02
*** amoralej is now known as amoralej|lunch12:05
*** waleedm has joined #openstack-glance12:12
waleedmHi guys, I have an issue with ovs-dpdk setup, that I couldn't upload image to glance12:12
waleedm glance_store.exceptions.BackendException: Failed to add container to Swift12:12
waleedm21984:2020-07-28 11:49:39.381 46 ERROR glance.common.wsgi Got error from Swift: Container PUT failed: http://172.16.1.60:8080/v1/AUTH_72b4e0ef8dba43dca5a60a4c39a44e22/glance 503 Service Unavailable  [first 60 chars of response] b'<html><h1>Service Unavailable</h1><p>The server is currently'12:13
waleedmany one could help with that12:13
*** k_mouza has joined #openstack-glance12:19
smcginniswaleedm: It's a 503 error coming from your Swift service. Check on your Swift deployment and correct whatever issue is there. Then is should likely work.12:23
*** k_mouza has quit IRC12:24
waleedmsmcginnis, ooh I see that swift containers restarting12:31
waleedmwill check the logs there12:31
*** ralonsoh has quit IRC12:34
*** ralonsoh has joined #openstack-glance12:34
smcginniswaleedm: Good luck!12:35
*** k_mouza has joined #openstack-glance12:37
*** k_mouza has quit IRC12:41
*** k_mouza has joined #openstack-glance12:58
*** rcernin has joined #openstack-glance12:59
*** k_mouza has quit IRC13:02
*** rcernin has quit IRC13:03
*** amoralej|lunch is now known as amoralej13:07
*** k_mouza has joined #openstack-glance13:11
*** k_mouza has quit IRC13:16
*** baojg has quit IRC13:20
*** baojg has joined #openstack-glance13:21
*** k_mouza has joined #openstack-glance13:23
*** k_mouza has quit IRC13:27
*** Luzi has quit IRC13:40
*** k_mouza has joined #openstack-glance13:59
*** k_mouza has quit IRC14:03
*** k_mouza has joined #openstack-glance14:04
dansmithabhishekk: so, I put up some WIP patches yesterday,14:11
dansmithwhich lets us get a periodic callback during the data transfer and some granularity14:11
dansmithto update the task and/or check to see if we have been preempted14:11
dansmithI'm working on the rest of the POC on top of that now14:11
abhishekkdansmith, I saw those patches and setting message in task sounds the right approach to me14:12
dansmithcool14:12
dansmithit's also nice to get some feedback that the upload is proceeding, both in the logs and ont he task14:12
abhishekk+114:16
dansmithabhishekk: so, just so I have it right, the only thing that should delete a file from staging is a successful import, right?14:23
dansmithwhat happens if I stage 1TiB and then decide not to do anything.. can I unstage?14:24
abhishekkdansmith, in that case you need to delete that image14:24
dansmithbut if I don't the data will hang around for a long time I guess, and presumably the customer won't be charged (much) because the image size is still zero?14:25
dansmithI wonder if we could solve our cleanup-after-fail problems by having a periodic task that will clean up the staging area when files there are more than 48 hours old?14:25
abhishekkdansmith, right14:25
abhishekkwe can do it14:25
dansmiththen we could worry less about the case where we fail, leave residue, and need to worry about deleting the staging file out from under other threads14:26
abhishekkalso if you are using glance-direct import method then only data will remain in staging14:26
dansmithwe could also touch the image whenever we start an import to renew its TTL14:26
dansmithyou mean no residue in staging with web-download right/14:27
abhishekkyes14:27
dansmithyeah, got that14:27
*** waleedm has quit IRC14:39
dansmithjokke: did you say you were going to be on vacation soon?14:39
*** lpetrut has quit IRC14:40
abhishekkhe might be14:40
abhishekkrosmaita, jokke below patches are required to tag V2 milestone, please review them14:47
abhishekkhttps://review.opendev.org/74281014:47
abhishekkhttps://review.opendev.org/74283514:47
abhishekkhttps://review.opendev.org/74345214:47
abhishekkhttps://review.opendev.org/74345314:47
rosmaitai think i need a vacation too14:49
abhishekk:P14:50
abhishekkMe too :D14:50
rosmaita:D14:50
dansmithabhishekk: https://review.opendev.org/#/c/743453/1/etc/glance-api.conf ?14:53
abhishekkdansmith, good catch14:57
abhishekklooks like something wrong with config generator14:57
dansmithglance has its own conf generator separate from the oslo one?14:57
abhishekkyes14:57
dansmith...why? :)14:57
dansmithlegacy I assume14:58
abhishekkyes14:58
dansmithinterested in switching to avoid problems like this and the need to maintain two lists of opts?14:58
abhishekkyes, again this was pending due to lack of resources :(14:59
dansmithack15:00
*** baojg has quit IRC15:13
openstackgerritAbhishek Kekane proposed openstack/glance master: Add new config options in sample config generator  https://review.opendev.org/74345215:23
openstackgerritAbhishek Kekane proposed openstack/glance master: Refresh Glance example configs for Victoria milestone 2  https://review.opendev.org/74345315:23
*** baojg has joined #openstack-glance15:25
*** baojg has quit IRC15:26
*** baojg has joined #openstack-glance15:27
* abhishekk dinner break, will be back in 45 mins15:27
*** baojg has quit IRC15:33
*** udesale_ has quit IRC15:40
*** m75abrams has quit IRC15:40
jokkedansmith: around end of Aug15:41
dansmithah okay15:41
dansmithjust wondering if we're up against a clock for finishing the locking conversation15:42
jokkedansmith: no we o use oslo config generator15:43
dansmiths/o/do/ ?15:44
jokkecorrect15:44
jokkethis keyboard is horrible, constant typos, sorry15:44
dansmiththen why do you have to add new opts to it separately?15:44
dansmithand, I don't understand the grouping failure then15:45
dansmithmeaning, we don't have to maintain separate lists, that I know of15:47
jokkeah it just got fixed when I was typing the failure in review15:52
jokkenow it's coming right15:53
jokkedansmith: we're generating multiple config files so what options are pulled into the specific config files are defined in glance/etc/oslo-config-generator/15:55
*** waleedm has joined #openstack-glance15:56
dansmithah so it's just a usage thing I guess, and you can't just let 'er rip because you have to filter what goes into which generation step?15:57
jokkedansmith: correct16:00
dansmithso can we write a test that processes all the generator lists and determines if any registered opts are left out after we consume them all?16:01
jokkewas specially important when we had both api and registry around as their configs came from same code base but had totally different stuff in them16:01
dansmithi.e. to prevent developers like me from realizing that this special handling is required and not adding to the generator lists16:01
abhishekkwe also note it down somewhere in developers doc16:02
*** k_mouza has quit IRC16:02
jokkedansmith: that should have been caught it review ;(16:04
dansmithsure, but... I like to make computers do the work so humans don't have to.. humans are lossy.16:04
openstackgerritAbhishek Kekane proposed openstack/glance master: Add new config options in sample config generator  https://review.opendev.org/74345216:07
openstackgerritAbhishek Kekane proposed openstack/glance master: Refresh Glance example configs for Victoria milestone 2  https://review.opendev.org/74345316:07
*** priteau has quit IRC16:08
*** amoralej is now known as amoralej|off16:19
*** k_mouza has joined #openstack-glance16:23
*** k_mouza has quit IRC16:28
*** k_mouza has joined #openstack-glance16:31
*** k_mouza has quit IRC16:36
*** k_mouza has joined #openstack-glance16:37
dansmithabhishekk: FYI, I have a stack of test-only changes in front of this task-heartbeating PoC which are valuable regardless16:41
dansmithwill be pushing in a bit,16:41
abhishekkdansmith, ack16:41
dansmithbut anywhere I'm touching something that doesn't really have test coverage today, I'm adding tests first for the existing behavior before I modify16:41
*** k_mouza has quit IRC16:42
*** k_mouza has joined #openstack-glance16:42
*** k_mouza has quit IRC16:47
*** waleedm has quit IRC16:51
*** k_mouza has joined #openstack-glance16:52
*** k_mouza has quit IRC16:57
*** k_mouza has joined #openstack-glance17:05
openstackgerritDan Smith proposed openstack/glance master: WIP: Heartbeat the actual work of the task  https://review.opendev.org/74342617:08
openstackgerritDan Smith proposed openstack/glance master: WIP: Update task message during import  https://review.opendev.org/74342717:08
openstackgerritDan Smith proposed openstack/glance master: Add testing for _CompleteTask in api_image_import  https://review.opendev.org/74359317:08
openstackgerritDan Smith proposed openstack/glance master: Add a test to make sure import get_flow() includes all the steps we expect  https://review.opendev.org/74359417:08
openstackgerritDan Smith proposed openstack/glance master: Add tests for _ImportToStore.execute()  https://review.opendev.org/74359517:08
openstackgerritDan Smith proposed openstack/glance master: Add image_delete_property_atomic() helper  https://review.opendev.org/74359617:08
openstackgerritDan Smith proposed openstack/glance master: WIP: Import locking  https://review.opendev.org/74359717:08
dansmithabhishekk: ^17:08
dansmithjokke: abhishekk: rosmaita: that last patch there is _totally_ not working braindump material on using the task's updated_at to gate the lock busting, along with heartbeating of the task during the transfer in the earlier patches17:09
*** k_mouza has quit IRC17:09
dansmithI haven't even tried to run any of it, but it's laid out like I'm thinking if you feel like skimming it for the approach17:09
jokkedansmith: will do17:10
*** nikparasyr has left #openstack-glance17:10
abhishekkdansmith, ack17:11
*** k_mouza has joined #openstack-glance17:11
*** k_mouza has quit IRC17:16
*** k_mouza has joined #openstack-glance17:28
*** k_mouza has quit IRC17:32
rosmaitadansmith: that will be helpful, will take a look later today17:36
*** k_mouza has joined #openstack-glance17:36
*** k_mouza has quit IRC17:41
*** k_mouza has joined #openstack-glance17:45
*** k_mouza has quit IRC17:49
*** ralonsoh has quit IRC17:49
*** k_mouza has joined #openstack-glance17:54
*** k_mouza has quit IRC17:59
openstackgerritMerged openstack/glance master: [Doc] Policy support to copy unowned images  https://review.opendev.org/74281018:01
openstackgerritMerged openstack/glance master: Victoria milestone 2 release notes  https://review.opendev.org/74283518:01
openstackgerritAbhishek Kekane proposed openstack/glance stable/train: Fix broken glance-cache-manage utility  https://review.opendev.org/74288918:06
*** k_mouza has joined #openstack-glance18:12
*** k_mouza has quit IRC18:16
*** k_mouza has joined #openstack-glance18:20
*** k_mouza has quit IRC18:24
*** k_mouza has joined #openstack-glance18:30
* abhishekk signing out for the day18:34
*** k_mouza has quit IRC18:39
openstackgerritDan Smith proposed openstack/glance master: Heartbeat the actual work of the task  https://review.opendev.org/74342620:37
openstackgerritDan Smith proposed openstack/glance master: Update task message during import  https://review.opendev.org/74342720:37
openstackgerritDan Smith proposed openstack/glance master: WIP: Import locking  https://review.opendev.org/74359720:37
*** rosmaita has quit IRC20:43
*** rosmaita has joined #openstack-glance20:46
*** evrardjp has joined #openstack-glance20:55
*** gyee has joined #openstack-glance21:02
*** rcernin has joined #openstack-glance22:09
*** rcernin has quit IRC22:22
*** rcernin has joined #openstack-glance22:36
*** rcernin has quit IRC22:50
*** rcernin has joined #openstack-glance22:50
*** tkajinam has joined #openstack-glance22:52
openstackgerritDan Smith proposed openstack/glance master: Heartbeat the actual work of the task  https://review.opendev.org/74342622:54
openstackgerritDan Smith proposed openstack/glance master: Update task message during import  https://review.opendev.org/74342722:54
openstackgerritDan Smith proposed openstack/glance master: WIP: Import locking  https://review.opendev.org/74359722:54
« Monday, 2020-07-27 Index Wednesday, 2020-07-29 »

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!