| *** k_mouza has quit IRC | 00:00 | |
| *** slaweq has joined #openstack-meeting-4 | 00:10 | |
| *** macz has quit IRC | 00:11 | |
| *** slaweq has quit IRC | 00:15 | |
| *** slaweq has joined #openstack-meeting-4 | 00:19 | |
| *** k_mouza has joined #openstack-meeting-4 | 00:23 | |
| *** slaweq has quit IRC | 00:24 | |
| *** k_mouza has quit IRC | 00:27 | |
| *** k_mouza has joined #openstack-meeting-4 | 00:27 | |
| *** k_mouza has quit IRC | 00:31 | |
| *** k_mouza_ has joined #openstack-meeting-4 | 00:31 | |
| *** k_mouza_ has quit IRC | 00:32 | |
| *** k_mouza has joined #openstack-meeting-4 | 00:33 | |
| *** JamesBenson has joined #openstack-meeting-4 | 00:33 | |
| *** k_mouza has quit IRC | 00:34 | |
| *** k_mouza has joined #openstack-meeting-4 | 00:34 | |
| *** slaweq has joined #openstack-meeting-4 | 00:37 | |
| *** JamesBenson has quit IRC | 00:37 | |
| *** k_mouza has quit IRC | 00:38 | |
| *** slaweq has quit IRC | 00:42 | |
| *** slaweq has joined #openstack-meeting-4 | 00:44 | |
| *** slaweq has quit IRC | 00:48 | |
| *** slaweq has joined #openstack-meeting-4 | 00:51 | |
| *** k_mouza has joined #openstack-meeting-4 | 00:52 | |
| *** slaweq has quit IRC | 00:55 | |
| *** k_mouza has quit IRC | 00:56 | |
| *** slaweq has joined #openstack-meeting-4 | 00:57 | |
| *** Liang__ has joined #openstack-meeting-4 | 00:58 | |
| *** slaweq has quit IRC | 01:01 | |
| *** slaweq has joined #openstack-meeting-4 | 01:02 | |
| *** k_mouza has joined #openstack-meeting-4 | 01:10 | |
| *** slaweq has quit IRC | 01:13 | |
| *** k_mouza has quit IRC | 01:16 | |
| *** slaweq has joined #openstack-meeting-4 | 01:16 | |
| *** roman_g has quit IRC | 01:17 | |
| *** slaweq has quit IRC | 01:21 | |
| *** slaweq has joined #openstack-meeting-4 | 01:28 | |
| *** slaweq has quit IRC | 01:32 | |
| *** dave-mccowan has joined #openstack-meeting-4 | 01:35 | |
| *** dave-mccowan has quit IRC | 01:42 | |
| *** k_mouza has joined #openstack-meeting-4 | 01:45 | |
| *** k_mouza has quit IRC | 01:50 | |
| *** k_mouza has joined #openstack-meeting-4 | 01:50 | |
| *** slaweq has joined #openstack-meeting-4 | 01:50 | |
| *** k_mouza has quit IRC | 01:52 | |
| *** k_mouza_ has joined #openstack-meeting-4 | 01:52 | |
| *** slaweq has quit IRC | 01:55 | |
| *** k_mouza_ has quit IRC | 01:56 | |
| *** slaweq has joined #openstack-meeting-4 | 01:58 | |
| *** slaweq has quit IRC | 02:10 | |
| *** slaweq has joined #openstack-meeting-4 | 02:23 | |
| *** slaweq has quit IRC | 02:30 | |
| *** slaweq has joined #openstack-meeting-4 | 02:31 | |
| *** slaweq has quit IRC | 02:35 | |
| *** slaweq has joined #openstack-meeting-4 | 02:47 | |
| *** macz has joined #openstack-meeting-4 | 02:50 | |
| *** slaweq has quit IRC | 02:52 | |
| *** macz has quit IRC | 03:32 | |
| *** macz has joined #openstack-meeting-4 | 03:33 | |
| *** macz has quit IRC | 03:37 | |
| *** igordc has quit IRC | 05:11 | |
| *** Luzi has joined #openstack-meeting-4 | 05:58 | |
| *** gcheresh has joined #openstack-meeting-4 | 06:19 | |
| *** lpetrut has quit IRC | 06:21 | |
| *** macz has joined #openstack-meeting-4 | 06:22 | |
| *** macz has quit IRC | 06:27 | |
| *** slaweq has joined #openstack-meeting-4 | 06:39 | |
| *** slaweq has quit IRC | 06:44 | |
| *** pcaruana has joined #openstack-meeting-4 | 07:27 | |
| *** slaweq has joined #openstack-meeting-4 | 08:44 | |
| *** ralonsoh has joined #openstack-meeting-4 | 08:45 | |
| *** Liang__ has quit IRC | 09:34 | |
| *** liuyulong has quit IRC | 10:06 | |
| *** e0ne has joined #openstack-meeting-4 | 10:10 | |
| *** roman_g has joined #openstack-meeting-4 | 10:14 | |
| *** macz has joined #openstack-meeting-4 | 10:30 | |
| *** macz has quit IRC | 10:35 | |
| *** slaweq has quit IRC | 12:39 | |
| *** slaweq has joined #openstack-meeting-4 | 13:17 | |
| *** abhishekk has joined #openstack-meeting-4 | 13:39 | |
| *** tosky has joined #openstack-meeting-4 | 13:57 | |
| *** rosmaita has joined #openstack-meeting-4 | 13:58 | |
| abhishekk | #startmeeting glance | 14:00 |
|---|---|---|
| openstack | Meeting started Thu Nov 21 14:00:03 2019 UTC and is due to finish in 60 minutes. The chair is abhishekk. Information about MeetBot at http://wiki.debian.org/MeetBot. | 14:00 |
| openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 14:00 |
| *** openstack changes topic to " (Meeting topic: glance)" | 14:00 | |
| abhishekk | #topic roll call | 14:00 |
| openstack | The meeting name has been set to 'glance' | 14:00 |
| *** openstack changes topic to "roll call (Meeting topic: glance)" | 14:00 | |
| jokke_ | o/ | 14:00 |
| abhishekk | #link https://etherpad.openstack.org/p/glance-team-meeting-agenda | 14:00 |
| davee_ | o/ | 14:00 |
| abhishekk | o/ | 14:00 |
| *** yebinama has joined #openstack-meeting-4 | 14:00 | |
| rosmaita | o/ | 14:01 |
| yebinama | o/ | 14:01 |
| abhishekk | cool, nice turnaround today | 14:01 |
| abhishekk | Lets start | 14:01 |
| abhishekk | Skipping updates part as don't have any update to share | 14:01 |
| abhishekk | #topic release/periodic jobs update | 14:01 |
| *** openstack changes topic to "release/periodic jobs update (Meeting topic: glance)" | 14:01 | |
| abhishekk | So, milestone 1 is just two weeks away | 14:02 |
| abhishekk | and we have plenty on the plate to finish | 14:02 |
| abhishekk | Need reviews on specs | 14:02 |
| jokke_ | yes, will get on that today or tomorrow | 14:03 |
| abhishekk | On periodic jobs front everything is good | 14:03 |
| jokke_ | hopefully both | 14:03 |
| abhishekk | jokke_, thank you | 14:03 |
| tosky | o/ | 14:03 |
| abhishekk | both are interrelated | 14:03 |
| abhishekk | enough from this topic | 14:04 |
| abhishekk | #topic import image in multi stores | 14:04 |
| *** openstack changes topic to "import image in multi stores (Meeting topic: glance)" | 14:04 | |
| abhishekk | #link https://review.opendev.org/#/c/669201/11 | 14:04 |
| abhishekk | Specs looks in good shape and everything is covered what we discussed in PTG | 14:05 |
| abhishekk | thanks to yebinama for that | 14:05 |
| yebinama | Thanks for the reviews :) | 14:05 |
| yebinama | There is just one point left | 14:06 |
| abhishekk | We just had one question, are we only targeting this to change import API and not old upload API | 14:06 |
| abhishekk | yebinama, do you have anything else in mind? | 14:06 |
| jokke_ | ok, I put this as priority review on top of my queue | 14:06 |
| abhishekk | great | 14:06 |
| yebinama | abhishekk No that was the same point | 14:06 |
| abhishekk | rosmaita, if you get some time, please have a look as well | 14:06 |
| rosmaita | ack | 14:07 |
| rosmaita | i'll make some time today | 14:07 |
| abhishekk | yebinama, jokke_ will address that on specs, lets move ahead | 14:07 |
| jokke_ | abhishekk: yes, only image import. As the image upload is asynchronous, keeping the client hanging there for 3hours waiting glance to upload the image to 10 stores sounds like horrible idea | 14:07 |
| abhishekk | rosmaita, \o/ | 14:07 |
| jokke_ | sorry, image upload is synchronous, not async | 14:07 |
| abhishekk | jokke_, yes, makes sense | 14:08 |
| yebinama | jokke_ ok | 14:08 |
| jokke_ | we would also need to make the image upload to cache the data locally instead of streaming it right through etc. too many things that can go wrong | 14:09 |
| abhishekk | jokke_, right | 14:09 |
| abhishekk | moving ahead | 14:10 |
| abhishekk | #topic copy existing image in multiple stores | 14:10 |
| *** openstack changes topic to "copy existing image in multiple stores (Meeting topic: glance)" | 14:10 | |
| abhishekk | #link https://review.opendev.org/#/c/694724/2 | 14:10 |
| abhishekk | This design is dependent on importing image in multiple stores | 14:10 |
| abhishekk | I have tried to cover all the discussion from the shanghai PTG | 14:11 |
| abhishekk | Would like to have some reviews before I could start with the PoC | 14:11 |
| abhishekk | Initial idea is, I will introduce one new task which will copy the existing image in staging area and link that task to regular import flow | 14:12 |
| jokke_ | abhishekk: I've been toying around this already. I'll put this second on the queue right after the import and look how they align easiest way to get them done | 14:12 |
| abhishekk | jokke_, great | 14:12 |
| abhishekk | that's it, moving to Open discussion | 14:13 |
| abhishekk | #topic Open Discussion | 14:13 |
| *** openstack changes topic to "Open Discussion (Meeting topic: glance)" | 14:14 | |
| jokke_ | Just on the copy import job. | 14:14 |
| abhishekk | go ahead | 14:14 |
| jokke_ | The way I've been looking into it is to have it's own flow, first doing some verifications (like having access to all the stores etc.) and then pulling it down (likely) to staging and ... | 14:15 |
| jokke_ | yebinama: this nxt part involves you as well | 14:15 |
| abhishekk | jokke_, that is what I have covered in the specs (hopefully I have covered verification part as well) | 14:16 |
| jokke_ | we'd like to have that multi store upload loop task in a place where it can be easily importd to the copy job as well, so not integrated part of the current glance-direct flow | 14:16 |
| *** lkoranda has joined #openstack-meeting-4 | 14:16 | |
| jokke_ | so we don't need to duplicate it all over the place | 14:17 |
| abhishekk | makes sense | 14:17 |
| yebinama | yes sure | 14:17 |
| jokke_ | best case scenario would be to import the tasks into those 2 and just inject them to the correct part of the flow if needed | 14:17 |
| abhishekk | +q | 14:18 |
| abhishekk | +1 | 14:18 |
| jokke_ | there is lots of tasks in those flows I've been hoping to do the same but just haven't had time to refactor them | 14:18 |
| abhishekk | I can do that once PoC or yebinama's patch is up for reference | 14:19 |
| jokke_ | yebinama: so if you write the task itself in a way that it can handle uploading to 1 store or to multiples, that would be best as then we can just replace the current upload task with that in all of our flows and get the benefit everywhere | 14:19 |
| yebinama | Yep that's what I've done | 14:20 |
| jokke_ | yebinama: amazing!!!! | 14:20 |
| yebinama | I've modified set_data to handle a list of stores | 14:20 |
| yebinama | (or one if using old configuration) | 14:20 |
| jokke_ | gr8 ... I'll have a look on your patch after I've reviewed the spec and lets get those moving | 14:21 |
| yebinama | I think I'll just have to slightly change it | 14:21 |
| abhishekk | ++ | 14:21 |
| yebinama | since I set image.locations at the end | 14:21 |
| yebinama | I will have to update it instead | 14:21 |
| jokke_ | yeah, we need to look into that for failure control | 14:21 |
| abhishekk | yebinama, you need to check before every import if image is still available or not | 14:21 |
| yebinama | abhishekk yes I need to change that to | 14:22 |
| jokke_ | yebinama: yeah, that was one thing we were discussing in the PTG, we want to check in between every store that the user did not delete the image in between and we just keep wasting resources | 14:22 |
| *** lkoranda has quit IRC | 14:23 | |
| yebinama | jokke_ if you have time to take a look at the code I've already uploaded, maybe you could say if this feels right or not | 14:23 |
| jokke_ | I hopefully have also test environment soon so I can play around how this actually behaves :D | 14:23 |
| jokke_ | yebinama: yes I will do | 14:23 |
| yebinama | great :) | 14:23 |
| abhishekk | jokke_, o/ | 14:24 |
| yebinama | It's based ont the first version of the specs but the essential is here | 14:24 |
| abhishekk | anything else on this | 14:24 |
| jokke_ | yebinama: cool, np lets get this hammered down asap | 14:25 |
| jokke_ | I think I'm covered on this for now | 14:25 |
| abhishekk | cool | 14:25 |
| abhishekk | tosky, thank you for your backport patch, stable/stein job is passing now after making it base patch | 14:25 |
| abhishekk | #link https://review.opendev.org/#/c/695176/ | 14:26 |
| tosky | oh, I missed the changed topic | 14:26 |
| abhishekk | jokke_, rosmaita kindly have a look and lets get this rolling | 14:26 |
| tosky | I explained everything in my last comment on https://review.opendev.org/#/c/691308/ | 14:26 |
| tosky | so I needed another patch to make the usage of python2 explicit (a backport of a jokke_'s patch) and another one to satisfy the request to remove py35 | 14:27 |
| tosky | for a grand total of 5 patches :) | 14:27 |
| abhishekk | tosky, yes thank you for following up with infra team | 14:27 |
| tosky | also, if you can please merge this grenade patch: https://review.opendev.org/#/c/695102/ | 14:27 |
| jokke_ | tosky: thanks for taking care of that :) | 14:28 |
| abhishekk | tosky, ack | 14:29 |
| rosmaita | tox is weird | 14:29 |
| abhishekk | +2, :D | 14:30 |
| abhishekk | cool, anything else | 14:31 |
| abhishekk | we have 30 minutes left :D | 14:31 |
| davee_ | Did I read correctly that a new goal is to rewrite the new developer and PTL get started docs for all projects to make them more consistent and same location for each project? | 14:31 |
| jokke_ | ok, so I have + vote on all of them that are left :P | 14:31 |
| *** tosky_ has joined #openstack-meeting-4 | 14:31 | |
| jokke_ | davee_: I'm not sure I heard that there is community goal to have per project contributor and ptl guides, which we do have | 14:32 |
| *** tosky has quit IRC | 14:32 | |
| jokke_ | I'm sure if people are interested of moving/rewriting them they can allocate some bodies to do that :P | 14:33 |
| abhishekk | :P | 14:33 |
| *** tosky_ is now known as tosky | 14:33 | |
| abhishekk | shall we wrap early to utilize remaining time? | 14:34 |
| davee_ | well if it does drop, I will volunteer to work on that one | 14:35 |
| jokke_ | I don't have anything else apart from that cluster awareness approach if we want to discuss that here | 14:35 |
| abhishekk | jokke_, we can | 14:35 |
| jokke_ | davee_: feel free to have a look what the community goa is actually after and close any gaps we might have if you have spare time for it | 14:36 |
| jokke_ | So I got some BBQ, wine and beer into me at Sunday night with good friend of mine and we were discussing about message queues, as you would in that state | 14:37 |
| jokke_ | And we were talking about the problem of having fanout rpc calls that needs to be somehow coordinated and only ran once | 14:37 |
| abhishekk | I could also use some BBQ and beer while working on Copy tasks :P | 14:39 |
| abhishekk | jokke_, any workaround you found? | 14:39 |
| jokke_ | So most likely the easiest and smartest way to do this is actually define "dry runs" for those tasks we want to be done on some other node than the one receiving the original request, and when we get responses of either success or failure from the dry run we then use more traditional rpc call to actually request the operation to be performed by only one node | 14:40 |
| jokke_ | the dry run doesn't need to be actual non changing run of the function called, but we would need to define those dry run functions that are checking the prerequisites. Like for delete "can this node access all the locations - if yes, respond success; if no respond failure | 14:42 |
| *** fdegir has quit IRC | 14:42 | |
| jokke_ | and then the original requestor filters the successes from the response queue, picks one randomly and sends the actual call to that host | 14:42 |
| abhishekk | if that node return failure then we will divert that call to another node? | 14:43 |
| *** fdegir has joined #openstack-meeting-4 | 14:43 | |
| jokke_ | well the node has already checked that it meets the requisites, so if it fails then we need to log error out as something more drastic is going on why we can't fulfil the request we thought we should | 14:44 |
| abhishekk | ok | 14:44 |
| jokke_ | so at that point we just report failure to the client and log error out of it | 14:44 |
| *** georgk has quit IRC | 14:44 | |
| abhishekk | got it | 14:44 |
| *** georgk has joined #openstack-meeting-4 | 14:45 | |
| abhishekk | sounds like a good plan | 14:45 |
| jokke_ | so for example delete, if the client is connected to node that can't reach all locations, the client will just see the request taking bit longer due to this rpc dance | 14:45 |
| jokke_ | we always process the calls locally if we can to optimize the time used | 14:45 |
| *** Luzi has quit IRC | 14:46 | |
| *** davee_ has quit IRC | 14:46 | |
| abhishekk | right | 14:46 |
| jokke_ | so ofr end user the difference would be that the calls that previously would just fail, might now take longer but succeed ... the responses etc. will be the same | 14:46 |
| abhishekk | yes | 14:47 |
| jokke_ | but by doing this "dry run" we avoid all kind of locking and race condition hell we would have had to tackle otherwise | 14:48 |
| abhishekk | So we need dry run logic for each plugin/task | 14:48 |
| jokke_ | for each call we plan to do over the cluster awareness rpc | 14:48 |
| abhishekk | yes | 14:48 |
| abhishekk | delete, import, copying and caching (so far) | 14:49 |
| jokke_ | which is great in a sense that we don't need to know everything and have it defined. We make the framework to work and we introduce those things based on where we see the need to utilize the cluster awareness | 14:49 |
| jokke_ | mhm | 14:49 |
| abhishekk | agree | 14:50 |
| *** davee_ has joined #openstack-meeting-4 | 14:50 | |
| abhishekk | cool, I will spend some time after milestone 1 on this | 14:50 |
| jokke_ | I think we can literally start with the delete as it's the most simple use case and expand from there | 14:50 |
| abhishekk | you stole my words :D | 14:50 |
| jokke_ | _BUT_ we need to get the framework to work first ... which is causing the grey hair and hopefully I have debugging environment for it soon | 14:51 |
| *** rosmaita has quit IRC | 14:51 | |
| *** bobmel has joined #openstack-meeting-4 | 14:51 | |
| jokke_ | If this sounds reasonable. I get back to work and modify the approach accordingly | 14:52 |
| abhishekk | jokke_, yes once we have environment it will be pretty easy to debug and analyze | 14:52 |
| abhishekk | sounds good to me | 14:52 |
| jokke_ | that's all from me unless anyone has questions about this | 14:52 |
| abhishekk | I don't have any, will ping you if something pops up | 14:53 |
| *** tosky has quit IRC | 14:54 | |
| abhishekk | Cool, thank you guys, see you next week | 14:54 |
| jokke_ | thanks all | 14:54 |
| yebinama | bye | 14:54 |
| *** yebinama has quit IRC | 14:54 | |
| abhishekk | #endmeeting | 14:54 |
| *** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/" | 14:54 | |
| openstack | Meeting ended Thu Nov 21 14:54:56 2019 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 14:54 |
| openstack | Minutes: http://eavesdrop.openstack.org/meetings/glance/2019/glance.2019-11-21-14.00.html | 14:55 |
| openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/glance/2019/glance.2019-11-21-14.00.txt | 14:55 |
| openstack | Log: http://eavesdrop.openstack.org/meetings/glance/2019/glance.2019-11-21-14.00.log.html | 14:55 |
| *** tosky has joined #openstack-meeting-4 | 14:57 | |
| *** abhishekk has quit IRC | 14:57 | |
| *** tosky has left #openstack-meeting-4 | 14:57 | |
| *** JamesBenson has joined #openstack-meeting-4 | 14:59 | |
| *** igordc has joined #openstack-meeting-4 | 15:01 | |
| *** pcaruana has quit IRC | 15:02 | |
| *** lkoranda has joined #openstack-meeting-4 | 15:02 | |
| *** rosmaita has joined #openstack-meeting-4 | 15:03 | |
| *** rosmaita has left #openstack-meeting-4 | 15:04 | |
| *** lkoranda has quit IRC | 15:04 | |
| *** igordc has quit IRC | 15:05 | |
| *** igordc has joined #openstack-meeting-4 | 15:06 | |
| *** igordc has quit IRC | 15:14 | |
| *** igordc has joined #openstack-meeting-4 | 15:14 | |
| *** pcaruana has joined #openstack-meeting-4 | 15:20 | |
| *** bobmel has quit IRC | 15:43 | |
| *** armstrong_ has joined #openstack-meeting-4 | 16:54 | |
| *** JamesBen_ has joined #openstack-meeting-4 | 16:54 | |
| *** JamesBen_ has quit IRC | 16:55 | |
| *** e0ne has quit IRC | 16:56 | |
| *** JamesBenson has quit IRC | 16:58 | |
| *** gcheresh has quit IRC | 17:26 | |
| *** michael-beaver has joined #openstack-meeting-4 | 17:50 | |
| *** pcaruana has quit IRC | 17:51 | |
| *** pcaruana has joined #openstack-meeting-4 | 18:14 | |
| *** gmann is now known as gmann_afk | 18:38 | |
| *** pcaruana has quit IRC | 18:42 | |
| *** ralonsoh has quit IRC | 18:55 | |
| *** pcaruana has joined #openstack-meeting-4 | 19:06 | |
| *** armstrong_ has quit IRC | 19:41 | |
| *** admcleod has quit IRC | 20:14 | |
| *** admcleod has joined #openstack-meeting-4 | 20:17 | |
| *** e0ne has joined #openstack-meeting-4 | 20:36 | |
| *** gmann_afk is now known as gmann | 20:45 | |
| *** openstack has joined #openstack-meeting-4 | 21:16 | |
| *** ChanServ sets mode: +o openstack | 21:16 | |
| *** dave-mccowan has joined #openstack-meeting-4 | 21:21 | |
| *** pcaruana has quit IRC | 21:25 | |
| *** gcheresh has joined #openstack-meeting-4 | 21:32 | |
| *** e0ne has quit IRC | 21:33 | |
| *** gcheresh has quit IRC | 21:38 | |
| *** e0ne has joined #openstack-meeting-4 | 22:29 | |
| *** e0ne has quit IRC | 22:30 | |
| *** slaweq has quit IRC | 23:17 | |
| *** slaweq has joined #openstack-meeting-4 | 23:27 | |
| *** slaweq has quit IRC | 23:32 | |
| *** slaweq has joined #openstack-meeting-4 | 23:35 | |
| *** slaweq has quit IRC | 23:40 | |
| *** slaweq has joined #openstack-meeting-4 | 23:44 | |
| *** slaweq has quit IRC | 23:48 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!