Friday, 2024-09-06

opendevreviewmelanie witt proposed openstack/nova master: docs: Show the recommended way to PXE boot an instance  https://review.opendev.org/c/openstack/nova/+/92830900:27
*** bauzas_ is now known as bauzas01:17
*** bauzas_ is now known as bauzas01:37
*** __ministry is now known as Guest265801:41
*** dtantsur_ is now known as dtantsur01:57
*** bauzas_ is now known as bauzas02:06
opendevreviewsean mooney proposed openstack/nova master: [WIP] Add functional repoducer for ephemeral disks  https://review.opendev.org/c/openstack/nova/+/92831002:11
*** bauzas_ is now known as bauzas02:35
*** bauzas_ is now known as bauzas02:51
*** bauzas_ is now known as bauzas02:59
*** bauzas_ is now known as bauzas03:12
*** bauzas_ is now known as bauzas03:20
*** bauzas_ is now known as bauzas04:50
*** bauzas_ is now known as bauzas05:55
*** chuanm2 is now known as chuanm06:24
*** bauzas_ is now known as bauzas07:17
*** bauzas_ is now known as bauzas07:30
*** chuanm2 is now known as chuanm08:04
elodillesmelwitt: sean-k-mooney explained perfectly o:) thanks sean-k-mooney o/08:10
*** bauzas- is now known as bauzas08:40
*** bauzas_ is now known as bauzas09:09
*** bauzas_ is now known as bauzas09:49
*** bauzas_ is now known as bauzas09:57
*** bauzas_ is now known as bauzas10:27
*** bauzas_ is now known as bauzas10:43
opendevreviewFabian Wiesel proposed openstack/nova master: Vmware: Remove uuid parameter from get_vmdk_info call  https://review.opendev.org/c/openstack/nova/+/91062711:07
*** bauzas_ is now known as bauzas11:49
*** bauzas_ is now known as bauzas12:09
opendevreviewOpenStack Release Bot proposed openstack/os-vif stable/2024.2: Update .gitreview for stable/2024.2  https://review.opendev.org/c/openstack/os-vif/+/92835313:08
opendevreviewOpenStack Release Bot proposed openstack/os-vif stable/2024.2: Update TOX_CONSTRAINTS_FILE for stable/2024.2  https://review.opendev.org/c/openstack/os-vif/+/92835513:08
opendevreviewOpenStack Release Bot proposed openstack/os-vif master: Update master for stable/2024.2  https://review.opendev.org/c/openstack/os-vif/+/92835613:08
opendevreviewOpenStack Release Bot proposed openstack/osc-placement stable/2024.2: Update .gitreview for stable/2024.2  https://review.opendev.org/c/openstack/osc-placement/+/92835813:08
opendevreviewOpenStack Release Bot proposed openstack/osc-placement stable/2024.2: Update TOX_CONSTRAINTS_FILE for stable/2024.2  https://review.opendev.org/c/openstack/osc-placement/+/92835913:08
opendevreviewOpenStack Release Bot proposed openstack/osc-placement master: Update master for stable/2024.2  https://review.opendev.org/c/openstack/osc-placement/+/92836013:08
opendevreviewOpenStack Release Bot proposed openstack/python-novaclient stable/2024.2: Update .gitreview for stable/2024.2  https://review.opendev.org/c/openstack/python-novaclient/+/92836313:08
opendevreviewOpenStack Release Bot proposed openstack/python-novaclient stable/2024.2: Update TOX_CONSTRAINTS_FILE for stable/2024.2  https://review.opendev.org/c/openstack/python-novaclient/+/92836413:08
opendevreviewOpenStack Release Bot proposed openstack/python-novaclient master: Update master for stable/2024.2  https://review.opendev.org/c/openstack/python-novaclient/+/92836613:08
sean-k-mooneydansmith: so i tought i had a fix for https://review.opendev.org/c/openstack/nova/+/928310/1/nova/tests/functional/regressions/test_bug_backing_file_partion_tables.py13:38
sean-k-mooneyand then whe i treid it i reasised that its more complex then i hoped13:39
sean-k-mooneytl;dr is the mbr/gpt inspector is not only looking for a gpt partion table to exist its also looking for a os partion13:39
sean-k-mooneyfor epmeral and swap disk that is not really a valid expecatoin13:40
sean-k-mooneyso just addign a gpt tabel and vfat partion is not enough to pass the safty check 13:40
dansmithIt's not looking at the gpt part at all,13:42
dansmithit's looking at the PMBR to make sure you have the right single entry13:42
sean-k-mooneyyes its looking at the mbr part13:42
dansmiththe mbr needs to have at least one partition that is not type EE, or a single type EE starting at the first sector13:44
sean-k-mooneyi likely can make that happen13:44
sean-k-mooneybut using our existign create partion tbale and create partion functions didnt seam to be enough13:45
dansmithcan you show me fdisk -l of what we create?13:45
sean-k-mooneysure ill need to recreate the image but ill chuck taht in termbin in a sec13:46
sean-k-mooneyhttps://termbin.com/86m613:49
sean-k-mooneyi can get it to pass the first test_create_file but not test_cache_file13:49
opendevreviewMerged openstack/os-vif master: Update master for stable/2024.2  https://review.opendev.org/c/openstack/os-vif/+/92835613:49
dansmithokay that doesn't show the mbr part because it skips right over, but must have a real pmbr13:50
dansmithcan you grab just the first like 4k of that and post it for me somewhere?13:50
dansmith(if it's easy)13:50
sean-k-mooneysure i have this running in a debugger adn im stop right after we hcage created the image but before we call mkfs on it13:51
sean-k-mooneyim wonder fi that will alter the output but ill grab the first 4k first and then proceed13:51
dansmithhmm, how is mkfs going to run on just the partition of a file?13:52
dansmith...without kpartx or something13:52
sean-k-mooneyim actully expecting it to recreate teh gpt and partion table13:52
dansmithmkfs will definitely not do that13:52
sean-k-mooneyok then we might need to actuly loop mount it13:53
dansmithif you run mkfs on a file it will create a filesystem starting at byte/sector 0 in the file, wiping the table13:53
sean-k-mooneythe current code calls mkfs direcly on the file13:53
dansmithokay so maybe we're creating a partition table for the unformatted case, but if we format with a filesystem, we immediately blow that away and then hand the guest a whole-disk filesystem with no partition table?13:54
sean-k-mooneyya so that might be the problem im coing to quickly copy that file and leave mkfs run 13:54
dansmithand to be clear, changing that is not easy13:54
sean-k-mooneydansmith: so creating the partition tabel and partion was what i added to try and "fix" this13:54
sean-k-mooneythe exisign code just ran mkfs on the file13:54
dansmithoh okay13:54
sean-k-mooneyor block device depending on the code path13:55
dansmithbut we were creating a fs in the file and that was being detected as GPT?13:55
sean-k-mooneyi can comment out my changes and verify i think it was detecated as a flatfile before but when used as a backinf file we expected something differnt13:56
sean-k-mooneyits proably better if i copy the files to a file share so you can look at it and also comment out the code i added to see the behavior before and after13:56
dansmithand was this with vfat? because apparently vfat looks a lot like an MBR (unsurprisingly)13:57
dansmithso maybe that inspector needs to look for something specific to not think fat is an MBR13:57
sean-k-mooneyya so i chose vfat for the repoducer beacuse it is what we use if you dont specify a a format in the config and os_type is not set in the galnce image13:58
sean-k-mooneyif ostype is set in the glance iamge we will either use ntfs or ext4 but you have everal options for the config option13:58
dansmithlol yep, vfat has a boot record and the same signature as an MBR in the first sector13:59
dansmiththanks a lot 1980s MSFT13:59
sean-k-mooneyok that might be the issue14:00
dansmith"boot record" meaning 16-bit real-mode x86 executable code to show the message "this is not a bootable disk" :D14:00
dansmithI have to run do something but when I get back I'll see what I can do to not be fooled into thinking a vfat is an MBR, but we'll see14:00
dansmithstill seems like we should be able to skip the backing file and skip the safety check on blank disks we create ourselves14:01
sean-k-mooneywell we have a few options but ya lets talk about it later14:01
dansmithbrb14:01
sean-k-mooneyyep i was also goign to explore that route by adding a flag to the image backend create_image to say if we should safty check it14:02
sean-k-mooneybut before doing that i wanted to see if i could avoid chaning the interface14:02
sean-k-mooneyhttps://fileshare.seanmooney.info/ephemeral_before_mkfs.img and https://fileshare.seanmooney.info/ephemeral_after_mkfs.img are teh relevent images, so the mkfs call undid what i was trying to do so that what nova produces today14:04
sean-k-mooneythis is the fdisk output https://termbin.com/bvvp14:05
sean-k-mooneyi renamed the files to .img and fixed the hardcoded extion im doing localy so ignore the fact it refecnce .qcow in the output14:06
sean-k-mooneywe alway use raw backing files for epmeral disks14:06
sean-k-mooneywell or ploop for openvz but we can ignore that14:07
sean-k-mooneythat proably broken too now but i dont think we care as much14:07
sean-k-mooneywe have not had any testing of openvz/Virtuozzo supprort for years so its unlikely that even still works without this14:08
dansmithyeah, mkfs will definitely overwrite the partition table bits, the problem is vfat creates one again itself and adds a boot record (because it's actually a partition within a partition)14:20
dansmithso this should not fail if you choose extN right?14:20
sean-k-mooneyill check but i dont expect it to no, im just tryin gto figure out how to confirm that since the funcitonl test sute is complaining about privespe when i change the default14:24
sean-k-mooneyoh14:24
sean-k-mooneyno thats ok14:24
sean-k-mooneyit failed after the safty check14:24
sean-k-mooneywe call _update_utime_ignore_eacces(base) after the safty checks14:25
sean-k-mooneyso ya the inspecotr for ext4 returns RawFileInspecotr instead of the mbr/gpt one14:26
sean-k-mooneydansmith: so i had a proposal to change our default to not format ephmeral disk14:27
sean-k-mooneyif i was to quickly implemnte that and wrap the mkfs call in an if then that woudl work for the default case14:28
sean-k-mooneyalthernitivly i guess we coudl add a vfat inspector? or special case that in the mbr/gpt one14:28
dansmithit's not that we need a vfat inspector, it's that we'd need the gpt one to not detect the vfat VBR as an MBR, or not obsess over the lack of partitions14:30
dansmithor ideally, just not if it thinks it's a VBR instead of an MBR14:30
sean-k-mooneyi would prefer not to need to update oslo for this if we can avoid it but there are workaroudn that we can suggest to people in the interim14:30
dansmithI'm looking into options14:30
dansmithwell, again, we shouldn't need to be inspecting blank images we're creating at all14:30
dansmithso that's the non-oslo fix14:30
sean-k-mooneyright so i can implemant that with a new parmater to create_image in the image backend and default inspect_backingfile to true14:31
sean-k-mooneythen explcitly set it to false for epmeral disks14:31
sean-k-mooneyor ephmeral but only when vfat14:32
dansmithall ephemeral should be fine I think14:32
sean-k-mooneyif we are ok with that approch ill stop trying ot make it pass and just swap to tuning it off for now when we are creating blank images14:32
dansmithbut yeah, that's really what we want to do I think and I'll work in parallel to stop the detection just in case anyone uses a raw vfat in a glance parition14:33
dansmith*image14:33
sean-k-mooneydansmith: are you ok with defering stoping creatin backing files for epmereal disks to the larger image backend refactor14:33
dansmithcertainly deferring it past the targeted fix for this14:34
sean-k-mooneyack14:34
dansmithand yeah, I think continuing to slice the current backend is just asking for trouble, even for something smallish like not using backing files I think14:34
sean-k-mooneyi feel like while i coudl make it work it woudl be more error prone espcialy when it compes to move ops and upgrade behavior14:35
dansmithyeah14:36
dansmithsean-k-mooney: are you okay with excluding images of floppy disks?14:43
dansmithI don't mean a fake image you created to boot from floppy, but like an actual dd image of a floppy created on MS-DOS 6 or something14:43
sean-k-mooneyyes im also happy with droping floopy drive supprot form hw_disk_bus if we have not already14:43
dansmithAFAIK, qemu dropped floppy support a while back anyway right?14:44
sean-k-mooneyit did in q3514:44
dansmithah okay14:44
sean-k-mooneyand i think we did downstream14:44
sean-k-mooneybtu not sure about upstream with pc14:44
dansmithwell, we could check a range, but I think it's easier if we just check for the descriptor that says "this was created on a hard disk"14:44
dansmithsean-k-mooney: https://review.opendev.org/c/openstack/oslo.utils/+/92844814:53
dansmithI will get a test image up too14:54
sean-k-mooneyim using oslo.utils form a local git repo so i can apply that and test it in my funcitonal test14:56
*** bauzas_ is now known as bauzas14:57
dansmithcool14:57
sean-k-mooneySwitched to branch "review/dan_smith/cut-the-fat" :)15:01
dansmithyou're welcome :)15:01
gibilol15:02
opendevreviewDan Smith proposed openstack/nova master: DNM: Test with FAT image  https://review.opendev.org/c/openstack/nova/+/92845115:11
dansmithsean-k-mooney: we'll make sure this ^ fails the same way you're seeing with ephemeral and then add in the oslo change to see that it cures15:11
sean-k-mooneydansmith: sorry was on a call, so if i include your oslo fix and revert back to vfat it seams to be working. its failing at the same point where it tries to use privesep post the safty check16:25
sean-k-mooneyill look a little closer now and confirm16:25
sean-k-mooneyok so ya the inspector is now RawFileinspector when using vfat16:27
dansmithcool16:28
dansmithsean-k-mooney: if you could file a bug with the fail/trace it would be good to get that attached to the oslo fix when we ask for the merge/release16:29
dansmithunless.. is it in the zuul results from your repro change?16:29
dansmithah, I got it16:30
dansmithI can file the bug then16:30
sean-k-mooneyok i was going to try and do it before i finsih for today but eys its in the zuul change16:30
dansmithI got it, you should weekend16:30
sean-k-mooneyone thing we could try is we could update the dnm patch to depned on the oslo one and try and run the expermintal job16:31
sean-k-mooneyim not sure that will work but i planned to do that when working on the nova change to not run the inspection on ephmeral disks16:31
dansmithI will after it fails,16:31
dansmithI wanted one run repro'ing the problem with the dedicated test image16:32
sean-k-mooneyack, we might need other zuul config to make depens on to oslo.utils work and at present the job cant run form oslo.utils on nova but we can figure all that out next week16:33
opendevreviewBalazs Gibizer proposed openstack/nova master: Add igb value to hw_vif_model image property  https://review.opendev.org/c/openstack/nova/+/92845616:33
dansmithrequired_projects should just work16:33
*** bauzas_ is now known as bauzas16:35
sean-k-mooneygibi: :) as an fyi we shoudl also add a trait here https://github.com/openstack/os-traits/blob/master/os_traits/compute/net.py#L26-L3816:35
dansmithtempest.api.image.v2.test_images_formats.ImagesFormatTest.test_compute_rejects_invalid(fat-vbr) [19.473212s] ... FAILED16:35
dansmithas expected ^16:35
gibisean-k-mooney: yeah there is a bunch of TODOs16:35
gibibut good point I missed that so far16:36
sean-k-mooneygibi: it wont break without it but it needed to make the image metadata prefileter be able to select host with igb support17:06
sean-k-mooneygibi: if i recall correctly when we try to generate requried traits we check if its a knwo valide trait ad drop the request if we dont find a match17:07
opendevreviewsean mooney proposed openstack/nova master: [WIP] adapt to vfat support in oslo.utils  https://review.opendev.org/c/openstack/nova/+/92846217:17
opendevreviewsean mooney proposed openstack/nova master: [WIP] Add functional repoducer for ephemeral disks  https://review.opendev.org/c/openstack/nova/+/92831017:19
opendevreviewsean mooney proposed openstack/nova master: [WIP] adapt to vfat support in oslo.utils  https://review.opendev.org/c/openstack/nova/+/92846217:19
opendevreviewDan Smith proposed openstack/nova master: DNM: Test with FAT image  https://review.opendev.org/c/openstack/nova/+/92845117:25
opendevreviewsean mooney proposed openstack/nova master: [WIP] Add functional repoducer for ephemeral disks  https://review.opendev.org/c/openstack/nova/+/92831017:26
opendevreviewsean mooney proposed openstack/nova master: [WIP] adapt to vfat support in oslo.utils  https://review.opendev.org/c/openstack/nova/+/92846217:26
sean-k-mooneyill take a look on monday at actuly doing what we said to not need th oslo release but https://review.opendev.org/c/openstack/nova/+/928462 will at least try and test test with your oslo patch17:26
sean-k-mooneyi added dosfstools to bindep for now as a test requirement so hopefully that will fix the functional job an allow the test to pass17:27
*** bauzas_ is now known as bauzas17:28
sean-k-mooneyanyway enjoy your weekend folks o/17:28
dansmithsean-k-mooney: cool thanks see you monday17:31
*** bauzas_ is now known as bauzas17:36
opendevreviewDan Smith proposed openstack/nova master: DNM: Test with FAT image  https://review.opendev.org/c/openstack/nova/+/92845117:37
*** bauzas_ is now known as bauzas17:56
* artom tries really hard to propose a "DNM: Test with SKINNY image" patch18:21
artom*to avoid proposing18:21
dansmithartom: yeah, all manner of puns ahead19:10
JayFYou know, when I saw that comment, my thought was "oh god there's another image type?!" and completely missed the joke :D 19:17
dansmithJayF: does ironic support any naked vfat images for anything?19:18
JayFno19:18
JayFI saw your commit in oslo utils, I don't think it'd impact ironic19:18
dansmithit certainly won't yet because you're using the earlier stuff which doesn't detect MBRs, but yeah I was just wondering if you might have any false positives from some case you do support19:19
dansmithit's really silly that we format ephemerals at all, but especially silly that we will format them as FAT32 just so windows guests would have something to see, even though it's totally useless to them19:19
*** bauzas_ is now known as bauzas20:04
*** bauzas_ is now known as bauzas20:16
opendevreviewMerged openstack/nova stable/2023.2: hardware: Correct log  https://review.opendev.org/c/openstack/nova/+/92747321:06
zigoHowdy here! New fun OpenStack cli tool: https://salsa.debian.org/openstack-team/clients/oscs21:16
*** bauzas_ is now known as bauzas22:26
*** bauzas_ is now known as bauzas22:42
opendevreviewmelanie witt proposed openstack/nova master: DNM try minimalistic imagebackend refactor  https://review.opendev.org/c/openstack/nova/+/92563523:10
*** bauzas_ is now known as bauzas23:32
*** bauzas_ is now known as bauzas23:40

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!