Thursday, 2020-07-30

*** k_mouza has joined #openstack-glance01:19
*** k_mouza has quit IRC01:24
*** k_mouza has joined #openstack-glance01:49
*** k_mouza has quit IRC01:53
*** gyee has quit IRC02:34
*** k_mouza has joined #openstack-glance02:42
*** k_mouza has quit IRC02:47
*** k_mouza has joined #openstack-glance03:20
*** k_mouza has quit IRC03:25
*** evrardjp has quit IRC04:33
*** evrardjp has joined #openstack-glance04:33
*** takamatsu has quit IRC04:38
*** takamatsu has joined #openstack-glance04:38
*** ratailor has joined #openstack-glance05:11
*** udesale has joined #openstack-glance05:13
*** ralonsoh has joined #openstack-glance05:43
openstackgerritAbhishek Kekane proposed openstack/glance master: Change database migration version to victoria  https://review.opendev.org/74391406:20
*** lpetrut has joined #openstack-glance06:22
*** Luzi has joined #openstack-glance06:27
*** amoralej|off is now known as amoralej06:55
*** bhagyashris is now known as bhagyashris|lunc07:28
*** rcernin has quit IRC07:32
*** nikparasyr has joined #openstack-glance07:38
*** rosmaita has quit IRC08:13
*** rosmaita has joined #openstack-glance08:24
*** rcernin has joined #openstack-glance08:28
*** rcernin has quit IRC08:34
*** k_mouza has joined #openstack-glance09:36
*** bhagyashris|lunc is now known as bhagyashris09:37
*** k_mouza has quit IRC10:13
*** k_mouza has joined #openstack-glance10:35
*** rcernin has joined #openstack-glance10:37
*** rcernin has quit IRC10:54
*** udesale_ has joined #openstack-glance11:54
*** udesale has quit IRC11:57
*** amoralej is now known as amoralej|lunch12:05
*** k_mouza has quit IRC12:24
*** m75abrams has joined #openstack-glance12:25
*** lpetrut_ has joined #openstack-glance12:33
*** lpetrut has quit IRC12:36
*** k_mouza has joined #openstack-glance12:39
*** k_mouza has quit IRC12:43
*** tkajinam has quit IRC12:47
*** m75abrams has quit IRC12:57
*** amoralej|lunch is now known as amoralej13:05
*** ratailor has quit IRC13:07
*** k_mouza has joined #openstack-glance13:16
*** k_mouza has quit IRC13:20
*** k_mouza has joined #openstack-glance13:26
*** k_mouza has quit IRC13:30
abhishekkrosmaita, could you please put your insight on https://review.opendev.org/74391413:40
*** k_mouza has joined #openstack-glance13:41
openstackgerritDan Smith proposed openstack/glance master: Flesh out FakeImage for extra_properties  https://review.opendev.org/74383913:41
openstackgerritDan Smith proposed openstack/glance master: Add image_delete_property_atomic() helper  https://review.opendev.org/74359613:41
openstackgerritDan Smith proposed openstack/glance master: Heartbeat the actual work of the task  https://review.opendev.org/74342613:41
openstackgerritDan Smith proposed openstack/glance master: Update task message during import  https://review.opendev.org/74342713:41
openstackgerritDan Smith proposed openstack/glance master: Implement time-limited import locking  https://review.opendev.org/74359713:41
openstackgerritDan Smith proposed openstack/glance master: Add testing for _CompleteTask in api_image_import  https://review.opendev.org/74359313:44
openstackgerritDan Smith proposed openstack/glance master: Add a test to make sure import get_flow() includes all the steps we expect  https://review.opendev.org/74359413:44
openstackgerritDan Smith proposed openstack/glance master: Add tests for _ImportToStore.execute()  https://review.opendev.org/74359513:44
openstackgerritDan Smith proposed openstack/glance master: Flesh out FakeImage for extra_properties  https://review.opendev.org/74383913:44
openstackgerritDan Smith proposed openstack/glance master: Add image_delete_property_atomic() helper  https://review.opendev.org/74359613:44
openstackgerritDan Smith proposed openstack/glance master: Heartbeat the actual work of the task  https://review.opendev.org/74342613:44
openstackgerritDan Smith proposed openstack/glance master: Update task message during import  https://review.opendev.org/74342713:44
openstackgerritDan Smith proposed openstack/glance master: Implement time-limited import locking  https://review.opendev.org/74359713:44
*** k_mouza has quit IRC13:45
*** k_mouza has joined #openstack-glance13:50
*** yoctozepto has quit IRC13:54
*** k_mouza has quit IRC13:54
*** yoctozepto has joined #openstack-glance13:55
*** k_mouza has joined #openstack-glance13:59
abhishekkrosmaita, smcginnis, jokke weekly meeting at #openstack-meeting14:00
*** k_mouza has quit IRC14:04
*** Luzi_ has joined #openstack-glance14:10
*** k_mouza has joined #openstack-glance14:10
*** Luzi has quit IRC14:11
*** k_mouza has quit IRC14:14
*** k_mouza has joined #openstack-glance14:15
openstackgerritDan Smith proposed openstack/glance master: Implement time-limited import locking  https://review.opendev.org/74359714:17
*** lpetrut_ has quit IRC14:19
*** k_mouza has quit IRC14:19
*** k_mouza has joined #openstack-glance14:22
*** k_mouza has quit IRC14:27
*** alistarle has joined #openstack-glance14:34
smcginnisabhishekk: Looks like definitely not needed: https://review.opendev.org/#/c/701041/14:38
abhishekksmcginnis, ack14:38
*** bhagyashris is now known as bhagyashris|away14:47
jokkealistarle: if you have time after the meeting I'm happy to have a chat about the rbd stuff14:54
*** alistarle has quit IRC14:56
dansmithguess not :)14:56
jokkeI guess so14:56
dansmithrosmaita: I don't really know what "cinder multiple stores" means, but I assume you have a job for testing that in cinder itself right?15:00
rosmaitadansmith: not really15:00
rosmaitaiirc15:00
rosmaitathe situation is that15:00
dansmithfor some reason?15:00
rosmaitaglance cinder store can only use one volume-type15:01
rosmaitaso if you want your glance users to use >1 volume type15:01
dansmithcurrently, yeah15:01
dansmithyeah I get what the spec is about15:01
rosmaitaok, so then it doesn't really affect multiple cinder backends15:01
dansmithokay, I thought there was also a problem with multiple cinder backends, not just the volume type thing15:02
rosmaitai guess what i'm saying is that there is no clean mapping to what glance_store is doing and cinder tests15:02
dansmithbut certainly cinder has a job where multiple volume types are available right?15:03
rosmaitadansmith: not that i'm aware of, but i may have too simplistic a view of the situation15:03
rosmaitadansmith: i hope so15:03
*** k_mouza has joined #openstack-glance15:04
dansmithpoint is, maybe it would be good to make this glance spec include the "cinder backing job, and with multiple volume types" as a work item15:04
dansmithwhich, if you have a job for that already, we just need to inherit and configure glance accordingly15:04
rosmaitathere is probably a tempest api test, it would be in wiht the volumeadmin tests because the default is you must be admin to create volume types15:05
dansmithand you can have multiple volume types on a single backend or you need multiple backends for that?15:07
rosmaitayou can have multiple types on a single backend15:08
dansmithokay,15:08
*** k_mouza has quit IRC15:08
dansmithand doesn't devstack create one or more for you ahead of running any tests?15:08
rosmaitatypes or backends?15:09
dansmithtypes15:09
abhishekkdansmith, rosmaita15:09
abhishekkhttps://review.opendev.org/#/c/743800/215:09
abhishekkthis patch I proposed in devstack15:10
dansmithcool15:10
abhishekkI guess it also creates multiple backends in cinder15:10
dansmithrosmaita: presumably you need at least one type (the default) to be defined right?15:10
rosmaitasince train, there is a default that comes automatically with cinder15:10
rosmaitacleverly named __DEFAULT__15:10
rosmaitabut i think tempest creates its own so it knows they are there and what they are named15:11
*** k_mouza has joined #openstack-glance15:12
dansmithokay I would have expected devstack to do that,15:12
dansmithso that if you run devstack and not cinder, you can create volumes15:12
rosmaitadevstack probably does something, but i don't know what15:13
dansmithabhishekk: are you going to create a job that depends on that devstack patch and configures it thusly?15:13
abhishekkdansmith, I have already created15:13
abhishekkhttps://review.opendev.org/74237315:14
dansmithah sweet!15:15
dansmithabhishekk: so those code changes are bugs you found by running it for real?15:15
rosmaitai think so, looks like an image was uploaded to glance to store in cinder before the cinder service was started15:16
abhishekkdansmith, nope, that is Poc for the specs which you are discussing with Brian15:16
*** k_mouza has quit IRC15:16
dansmithabhishekk: what I mean is, you have some code changes in with the change to add the job15:17
dansmithlike this: https://review.opendev.org/#/c/742373/4/glance/api/authorization.py15:17
abhishekkrosmaita, I have moved the upload image function in devstack after service of cinder starts15:17
rosmaitayes, i saw that ... good job!15:17
abhishekkdansmith, yes15:17
dansmithabhishekk: okay i think I see.. this is the _actual_ change plus the job15:18
abhishekkdansmith, yes,15:19
dansmithgotcha15:19
*** k_mouza has joined #openstack-glance15:21
abhishekkdansmith, went through your comments on Introspect plugin fix, will address them soon15:21
abhishekkthank you for review15:21
dansmithabhishekk: cool15:21
dansmithabhishekk: by the way, if we were to snap the qcow header during streaming, we could assert that the thing they uploaded was actually a qcow, in the case where the format is restricted15:23
dansmithjust another benefit if desired15:23
abhishekkdansmith, yes15:24
*** gyee has joined #openstack-glance15:25
*** k_mouza has quit IRC15:25
* abhishekk going for dinner, be back in 45 mins15:26
*** k_mouza has joined #openstack-glance15:28
*** k_mouza has quit IRC15:32
*** k_mouza has joined #openstack-glance15:33
*** Luzi_ has quit IRC15:36
*** k_mouza has quit IRC15:37
openstackgerritMerged openstack/glance_store master: [Trivial]Add missing white space between words  https://review.opendev.org/74347415:43
* abhishekk back from break15:58
openstackgerritAbhishek Kekane proposed openstack/glance master: Change database migration version to victoria  https://review.opendev.org/74391415:58
*** udesale_ has quit IRC16:13
*** amoralej is now known as amoralej|off16:22
openstackgerritErno Kuvaja proposed openstack/glance master: Fix active image when all uploads fail  https://review.opendev.org/74401016:23
openstackgerritErno Kuvaja proposed openstack/glance master: Fix active image without data  https://review.opendev.org/74401116:23
openstackgerritErno Kuvaja proposed openstack/glance master: Fix active image without data  https://review.opendev.org/74401116:29
openstackgerritErno Kuvaja proposed openstack/glance master: Fix active image when all uploads fail  https://review.opendev.org/74401016:52
openstackgerritErno Kuvaja proposed openstack/glance master: Fix active image without data  https://review.opendev.org/74401116:52
dansmithabhishekk: for example: https://pastebin.com/Rxuat4GA16:58
dansmithabhishekk: https://pastebin.com/zx5cLdYM16:58
dansmithno need to store the full image16:59
abhishekkdansmith, looking16:59
dansmiththat only (needs to) store 32 bytes of the image to figure out the virtual size17:02
abhishekkdansmith, yeah17:02
abhishekkI was under assumption that it requires entire image in local disk17:03
dansmithand would let you enforce upload format restrictions too17:03
dansmithnope17:03
abhishekkyeah17:04
abhishekkSO there is no need to introspect plugin at all17:05
dansmithit would be ideal to do this in the stream everywhere, unless there's some format we need to handle otherwise17:05
dansmithwhat other formats does glance care about? vmdk and hdi or something?17:06
dansmithah I found the list17:06
abhishekkglance do support various formats17:07
abhishekkyep, all those in the list17:07
dansmithwell, it'd probably be worth checking them all to see if we can do the same, but for most of the composite formats the goal is the same, so I'm sure they have a usable header17:08
dansmitheven grabbing the first 2k of the file, dropping it into a temp file and running qemu-img on it will probably do the right thing in a lot of cases17:08
abhishekkworth trying17:09
dansmithqemu-img doesn't claim to support vhd, only vhdx but it might be similar enough that it does.. it can't create them at least17:10
openstackgerritAbhishek Kekane proposed openstack/glance-specs master: Make cinder driver compatible with multiple stores  https://review.opendev.org/69515217:13
abhishekkdansmith, ack17:14
abhishekkdansmith, also AFAIK I never come across any bug in glance which claims using images other than qcow2 or raw17:17
dansmithsurely anyone that uses the hyperv or vmware driver (at least) uses those image types though right?17:17
abhishekkbut yeah, we need to cover about all the disk-formats which we say we support17:17
abhishekkyes17:17
dansmithyeah17:18
dansmithvhd is quite a bit more complex to find the magic size value, but you still don't have to store the whole thing17:24
abhishekkok17:25
dansmithwe could also do our best to figure out the virtual size for upload (format checking is easy), and then on import, if we couldn't guess the size, then we run qemu-img as a last resord17:25
abhishekkIf we were able to do it then the whole introspect spec will change17:26
dansmithI don't want to derail anything, but it does seem like it'd be a lot better if we can do it via stream to me17:27
abhishekkOr at the moment we can proceed with calculating virtual size for qcow and raw?17:27
dansmithmeaning do it via stream for those formats, and via qemu-img for others?17:28
abhishekkyes, meaning for traditional image create we will do it via stream and in plugin we will do it via qemu-img17:29
dansmithoh okay sure17:29
dansmithbest effort for regular upload17:29
abhishekkOk, I will try to modify specs on that basis17:30
dansmithin all cases, we know the format they *claim* the image is supposed to be before they start either type of upload right?17:30
abhishekkyes, disk-format needs to be set before upload starts17:31
dansmithack, so it's legit to not calculate virtual_size if they say it is format X and our inspection tells us that is wrong?17:33
dansmithassume you will pass a -f to qemu-img and fail if it refuses to parse  the image?17:33
abhishekkyes, like that17:34
dansmithcool17:35
openstackgerritErno Kuvaja proposed openstack/python-glanceclient master: Fixes "stores" property added to the image  https://review.opendev.org/74402417:41
*** ralonsoh has quit IRC18:00
*** nikparasyr has left #openstack-glance18:11
* abhishekk signing out for the day18:23
jokkedansmith: just while you're testing stuff. ^^ client patch stops it to adding stores property when image-create-via-import is used with --stores ... once that is merged and released I have API patch for it ready18:25
jokkedansmith: I'm pretty sure you'll appreciate the "stores" not being shown without being actually populated18:26
openstackgerritErno Kuvaja proposed openstack/glance master: Add "stores" to disallowed properties  https://review.opendev.org/74403018:50
openstackgerritErno Kuvaja proposed openstack/glance master: Add "stores" to disallowed properties  https://review.opendev.org/74403019:30
dansmithjokke: ack21:12
*** tkajinam has joined #openstack-glance22:05
openstackgerritGhanshyam Mann proposed openstack/glance master: [goal] Migrate glance jobs to focal  https://review.opendev.org/74309222:30
openstackgerritGhanshyam Mann proposed openstack/python-glanceclient master: [goal] Migrate testing to ubuntu focal  https://review.opendev.org/74407523:06
*** rcernin has joined #openstack-glance23:13
*** rcernin has quit IRC23:14
*** rcernin has joined #openstack-glance23:14
openstackgerritMerged openstack/glance master: Change database migration version to victoria  https://review.opendev.org/74391423:37

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!