Friday, 2020-01-17

« Thursday, 2020-01-16 Index Saturday, 2020-01-18 »
*** tetsuro has joined #openstack-nova00:13
*** mriedem has quit IRC00:25
openstackgerritmelanie witt proposed openstack/nova master: DNM: try to get some debug info for bug 1844929  https://review.opendev.org/70147800:30
openstackbug 1844929 in OpenStack Compute (nova) "grenade jobs failing due to "Timed out waiting for response from cell" in scheduler" [High,Confirmed] https://launchpad.net/bugs/184492900:30
*** adrianc_ has quit IRC00:30
*** adrianc has joined #openstack-nova00:33
*** macz has quit IRC00:38
*** tkajinam_ has quit IRC00:43
*** tkajinam has joined #openstack-nova00:43
*** yedongcan has joined #openstack-nova00:50
*** tbachman has joined #openstack-nova00:50
*** openstackgerrit has quit IRC00:57
brinzhangstephenfin: thanks, that's true, we should update the updated_at field before aggregate or host save()01:00
*** tkajinam_ has joined #openstack-nova01:00
*** tkajinam has quit IRC01:00
*** openstackgerrit has joined #openstack-nova01:09
openstackgerritBrin Zhang proposed openstack/nova master: Populate 'updated_at' when aggregate is updated  https://review.opendev.org/58027101:09
brinzhangstephenfin, efried: done01:10
*** zhanglong has joined #openstack-nova01:12
*** yedongcan has quit IRC01:12
openstackgerritBrin Zhang proposed openstack/nova master: FUP Populate the 'updated_at' when aggregate metadata is updated  https://review.opendev.org/70279001:13
*** tbachman has quit IRC01:16
*** ociuhandu has joined #openstack-nova01:31
*** bnemec has quit IRC01:31
*** macz has joined #openstack-nova01:34
*** ociuhandu has quit IRC01:35
*** macz has quit IRC01:39
*** tbachman has joined #openstack-nova01:57
*** gyee has quit IRC02:07
*** awalende has joined #openstack-nova02:32
*** awalende has quit IRC02:36
*** jawad_axd has joined #openstack-nova02:39
*** jawad_axd has quit IRC02:43
*** logan- has quit IRC02:48
*** logan_ has joined #openstack-nova02:50
*** logan_ is now known as logan-02:50
*** johanssone has quit IRC02:56
*** johanssone has joined #openstack-nova02:57
*** kaisers has quit IRC02:57
*** kaisers has joined #openstack-nova02:57
*** jawad_axd has joined #openstack-nova03:00
*** jawad_axd has quit IRC03:04
*** TxGirlGeek has quit IRC03:08
*** Liang__ has joined #openstack-nova03:19
*** psachin has joined #openstack-nova03:19
*** Liang__ is now known as LiangFang03:21
*** macz has joined #openstack-nova03:22
*** macz has quit IRC03:27
*** brault has quit IRC03:27
*** brault has joined #openstack-nova03:29
openstackgerritDustin Cowles proposed openstack/nova master: Provider Config File: Functions to merge provider configs to provider tree  https://review.opendev.org/67652203:55
openstackgerritDustin Cowles proposed openstack/nova master: Provider Config File: Enable loading and merging of provider configs  https://review.opendev.org/69346003:55
dustincefried, gibi: ^ series ready for re-review, thanks!!04:02
*** mkrai_ has joined #openstack-nova04:09
*** LiangFang has quit IRC04:41
*** Liang__ has joined #openstack-nova04:44
*** mkrai_ has quit IRC04:47
*** mkrai__ has joined #openstack-nova04:47
*** udesale has joined #openstack-nova04:49
*** dustinc is now known as dustinc|PTO04:52
*** TxGirlGeek has joined #openstack-nova05:00
*** ociuhandu has joined #openstack-nova05:30
*** Liang__ has quit IRC05:33
*** rpittau|afk has quit IRC05:34
*** evrardjp has quit IRC05:34
*** awestin1 has quit IRC05:34
*** evrardjp has joined #openstack-nova05:34
*** rpittau|afk has joined #openstack-nova05:34
*** awestin1 has joined #openstack-nova05:34
*** ociuhandu has quit IRC05:35
*** mkrai__ has quit IRC05:39
*** mkrai_ has joined #openstack-nova05:39
*** mkrai_ has quit IRC05:40
*** mkrai_ has joined #openstack-nova05:40
openstackgerritBrin Zhang proposed openstack/nova master: Follow-up: Add delete_on_termination to volume-attach API  https://review.opendev.org/68065505:51
*** TxGirlGeek has quit IRC05:54
*** udesale has quit IRC05:56
*** udesale has joined #openstack-nova05:56
*** TxGirlGeek has joined #openstack-nova05:58
*** macz has joined #openstack-nova06:01
*** macz has quit IRC06:06
*** TxGirlGeek has quit IRC06:10
*** jamesdenton has quit IRC06:10
*** jamesdenton has joined #openstack-nova06:12
*** Liang__ has joined #openstack-nova06:12
*** ratailor has joined #openstack-nova06:23
*** tkajinam__ has joined #openstack-nova06:37
*** tkajinam_ has quit IRC06:39
*** abhishekk has quit IRC06:40
*** tkajinam_ has joined #openstack-nova06:42
*** abhishekk has joined #openstack-nova06:42
*** tkajinam__ has quit IRC06:44
*** jaosorior has joined #openstack-nova06:51
*** Dinesh_Bhor has quit IRC07:02
*** davee__ has joined #openstack-nova07:09
*** lee1 has joined #openstack-nova07:13
*** Liang__ has quit IRC07:15
*** samc-bbc has quit IRC07:18
*** NobodyCam has quit IRC07:18
*** knikolla has quit IRC07:18
*** davee___ has quit IRC07:18
*** trident has quit IRC07:18
*** lifeless has quit IRC07:19
*** mtreinish has quit IRC07:19
*** klindgren_ has quit IRC07:19
*** tbarron has quit IRC07:19
*** ianw has quit IRC07:19
*** lyarwood has quit IRC07:19
*** tobberydberg has quit IRC07:19
*** zigo has quit IRC07:19
*** obre has quit IRC07:19
*** gibi has quit IRC07:19
*** rnoriega_ has quit IRC07:19
*** antonym has quit IRC07:19
*** amorin has quit IRC07:19
*** brtknr has quit IRC07:19
*** Liang__ has joined #openstack-nova07:19
*** openstackstatus has quit IRC07:20
*** kiseok7 has joined #openstack-nova07:24
*** rchurch has joined #openstack-nova07:30
*** CeeMac has joined #openstack-nova07:33
*** slaweq has joined #openstack-nova07:35
*** macz has joined #openstack-nova07:39
*** macz has quit IRC07:44
*** damien_r has joined #openstack-nova07:55
*** brault has quit IRC07:56
*** awalende has joined #openstack-nova08:04
*** jawad_axd has joined #openstack-nova08:04
*** samc-bbc has joined #openstack-nova08:05
*** NobodyCam has joined #openstack-nova08:05
*** knikolla has joined #openstack-nova08:05
*** trident has joined #openstack-nova08:05
*** lifeless has joined #openstack-nova08:05
*** mtreinish has joined #openstack-nova08:05
*** tbarron has joined #openstack-nova08:05
*** klindgren_ has joined #openstack-nova08:05
*** ianw has joined #openstack-nova08:05
*** tobberydberg has joined #openstack-nova08:05
*** zigo has joined #openstack-nova08:05
*** obre has joined #openstack-nova08:05
*** gibi has joined #openstack-nova08:05
*** rnoriega_ has joined #openstack-nova08:05
*** antonym has joined #openstack-nova08:05
*** amorin has joined #openstack-nova08:05
*** brtknr has joined #openstack-nova08:05
*** maciejjozefczyk has joined #openstack-nova08:06
*** jamesdenton has quit IRC08:08
*** bcm has quit IRC08:08
*** zzzeek has quit IRC08:08
*** bcm has joined #openstack-nova08:09
*** tkajinam_ has quit IRC08:11
*** zzzeek has joined #openstack-nova08:11
*** jamesdenton has joined #openstack-nova08:12
*** tesseract has joined #openstack-nova08:16
*** rpittau|afk is now known as rpittau08:28
*** tosky has joined #openstack-nova08:29
*** macz has joined #openstack-nova08:30
*** tetsuro has quit IRC08:31
*** iurygregory has joined #openstack-nova08:32
*** macz has quit IRC08:35
*** ccamacho has joined #openstack-nova08:35
*** lee1 is now known as lyarwood08:36
*** zhanglong has quit IRC08:42
kiseok7Hello all, I would like to add a code on upstream; an option in [cinder] section to allow to attach only volumes in the specified AZ. how I can process it? it need a blue print?08:44
lyarwoodkiseok7: doesn't [cinder]/cross_az_attach=False provide this?08:46
lyarwoodkiseok7: or did you want use a specific cinder AZ08:47
lyarwoodwant to*08:47
*** ralonsoh has joined #openstack-nova08:50
kiseok7lyarwood: yes, it provides a part of. with [cinder]/cross_az_attach=False, nova creates instance with a volume in same AZ. but in my case, I need to attach another volume to the instance in different AZ.08:56
*** Liang__ has quit IRC08:57
*** iurygregory_ has joined #openstack-nova09:01
lyarwoodkiseok7: kk, I thought the AZ stuff in cinder was just left over from when it was nova-volume in our tree tbh, it might be worth writing this up on the mailing list for a wider discussion.09:02
*** iurygregory has quit IRC09:03
*** rcernin_ has joined #openstack-nova09:04
kiseok7lyarwood: thank for help . I will try it.09:04
*** rcernin has quit IRC09:04
bauzasgood morning Nova09:21
*** xek has joined #openstack-nova09:21
*** martinkennelly has joined #openstack-nova09:27
*** psachin has quit IRC09:35
*** derekh has joined #openstack-nova09:36
*** ociuhandu has joined #openstack-nova09:38
*** ociuhandu has quit IRC09:39
*** mkrai_ has quit IRC09:39
*** tetsuro has joined #openstack-nova09:47
*** Jeffrey4l has quit IRC09:50
*** tetsuro has quit IRC09:51
*** tetsuro has joined #openstack-nova09:56
*** ociuhandu has joined #openstack-nova10:00
brinzhangbauzas: good morning10:03
bauzasbrinzhang: morning !10:04
brinzhangnova has the nova-live-migration zuul fail, can you try to check?10:04
brinzhangbauzas: that impact so many patch :(10:04
bauzasbrinzhang: orly?10:05
bauzasI can look  at the gate10:05
brinzhangYeah, cool~10:05
*** dtantsur|afk is now known as dtantsur10:06
*** jangutter has joined #openstack-nova10:06
*** tetsuro has quit IRC10:07
*** jangutter has quit IRC10:13
*** jangutter has joined #openstack-nova10:13
*** ratailor has quit IRC10:18
*** ratailor has joined #openstack-nova10:18
*** ociuhandu has quit IRC10:19
*** Jeffrey4l has joined #openstack-nova10:21
*** ociuhandu has joined #openstack-nova10:28
*** jaosorior has quit IRC10:29
*** ociuhandu has quit IRC10:29
*** rcernin_ has quit IRC10:34
*** ratailor has quit IRC10:44
*** ociuhandu has joined #openstack-nova10:46
*** ociuhandu has quit IRC10:51
*** bhagyashris has joined #openstack-nova11:01
*** ociuhandu has joined #openstack-nova11:03
*** ratailor has joined #openstack-nova11:09
*** dviroel has joined #openstack-nova11:10
*** bhagyashris has quit IRC11:12
*** bhagyashris has joined #openstack-nova11:15
*** ociuhandu_ has joined #openstack-nova11:26
*** ociuhandu_ has quit IRC11:28
*** ociuhandu has quit IRC11:28
*** ociuhandu has joined #openstack-nova11:28
*** admin0 has joined #openstack-nova11:33
admin0hi all .. if all  3 controllers crashed ( no db anymore, wiped out) and all I have is the compute node now ( with the disk file) how do I boot it up ? i can't seem to find the libvirt xml anywhere11:33
*** jawad_axd has quit IRC11:35
yoctozeptoadmin0: libvirtd alive? could ask it via virsh11:37
admin0virsh list --all == blank11:37
yoctozeptooh, you probably mean that node died too11:37
admin0i have to showcase how openstack saves data even when the 3 controllers are dead .so instealled openstack,booted up some instances, nuked the 3 controllers and rebooted the compute node11:38
admin0so all i see now is the disk files in nova11:38
admin0but not the .xml definitions11:39
yoctozeptowell, the definitions are in the database...11:39
yoctozeptoif you want to show just that data is where it is11:39
yoctozeptocould boot any other vm and attach this image11:39
sean-k-mooneyadmin0: well nova does not exactly save data on the compute nodes but in the live case there will be libvirt domain xmls11:39
admin0but for the test-case, all 3 controllers and db is nuked and unavailable11:39
yoctozeptoadmin0: yeah, but you said you have the disk files11:40
admin0i do have them11:40
yoctozeptocould boot any vm in there11:40
yoctozeptoon that compute host11:40
yoctozeptoif you really want to show it is there for some reason11:40
sean-k-mooneyso when the contler are gone you can still use virsh to start the instaces11:40
admin0the only way i see is install virt-manager on my machne, add the compute node, and then create a new instance pointing to this disk11:40
sean-k-mooneyby the way you proably need to use sudo virsh list --all11:40
yoctozepto^ and this11:41
sean-k-mooneyif you dont use sudo you wont see the system slice11:41
yoctozeptosean-k-mooney: admin0 mentioned downing the compute11:41
admin0i am logged in as root, did sudo virsh list --all .. see nothing11:41
yoctozeptoso it's likely it's reallly not there11:41
admin0yes .. the compute node was also rebooted11:41
yoctozeptoyeah11:41
yoctozeptothen either restore controllers11:41
sean-k-mooneyok in that case have you confirmed the libvirtd systemd service is running11:42
admin0so test case is "oops something bad happened" . controllers are nuked, db is gone and compute nodes are rebooted11:42
sean-k-mooneyno the domains will be there11:42
sean-k-mooneyit wont be affect by the reboot11:42
admin0which folder11:42
sean-k-mooneyill have to check but first you should make sure the libvirt is running11:43
sean-k-mooneydo sudo systemctl status libvirtd11:43
admin0its active and running11:43
sean-k-mooneyand you have no domain definitions?11:44
sean-k-mooneydid you put your instnace dir on nfs?11:44
yoctozeptosean-k-mooney is right, I just verified instance files are really persistent11:44
yoctozeptosorry, I got confused11:44
admin0nope -- https://gist.github.com/a1git/d5d6c0cbb1e89ce6f7a7c5476b43f47211:44
yoctozeptomy path is: /etc/libvirt/qemu/11:45
admin0its local disk11:45
admin0oh11:45
admin0i was lookign into the wrong place11:45
admin0i see the instance definitions11:45
*** macz has joined #openstack-nova11:45
admin0but i cannot see them using sudo virsh list --all then ?11:45
yoctozeptohmm, strange11:45
sean-k-mooneyhow have you deployed openstack by the way11:45
*** tbachman has quit IRC11:46
sean-k-mooneydevstack? ooo? kolla?11:46
yoctozepto(I have kolla and sean-k-mooney was right regarding behavior in there)11:47
admin0osa ( openstack ansible )11:47
yoctozeptoah, the third option11:47
admin0:D11:47
yoctozeptoor the fourth actually ;D11:47
yoctozepto(counting devstack)11:47
admin0well, hav been trying to do kolla many times .. but still on osa11:47
yoctozeptono problem11:47
sean-k-mooneyok so you libvirt is running in an lxc container or on the host?11:48
admin0thing is if i ask some hard questions on kolla related to config or troubleshooting, there is no help on kolla but on osa its more in depth and instant .. which probably is because of rackspace11:48
admin0its on metal11:48
sean-k-mooneyok can you try  virsh --connect qemu:///system list11:48
yoctozeptoadmin0: :O no help on kolla? how is that?11:48
sean-k-mooneywell i guess with --all11:49
sean-k-mooneythe xmls should be in /etc/libvirt/qemu11:50
yoctozeptoadmin0: finally try: virsh define /etc/libvirt/qemu/that_one_file_you_missed_so_much.xml - maybe there was an error in there11:50
*** macz has quit IRC11:50
admin0error: invalid argument: could not find capabilities for arch=x86_64  -- wow .same server ..11:51
yoctozeptosee, now you got help from kolla, your argument is no longer valid (pun intended)11:51
yoctozepto;D11:51
yoctozeptokidding aside, this really looks lolz11:52
sean-k-mooneyit looks like libvirt cannot find the x86_64 emulator11:52
admin0i will try kolla again .. won't doubt that .. but this is #nova channel :D11:52
yoctozeptomhm, at least its config/definitions11:53
yoctozeptoadmin0: yeah, I'm just teasing11:53
yoctozeptothough reboot does not get rid of those11:53
sean-k-mooneywell its complaining that virsh capabilities is not working11:53
sean-k-mooneyno a reboot would not cause this and nither would nuking the contolers11:54
sean-k-mooneythis host has been broken by something else that is unrelated11:54
yoctozepto+1, I know the drill11:54
admin0in virsh capabilities i do see  <arch>x86_64</arch>    reported with the flags11:54
yoctozeptosome issues popping up only after reboot11:55
yoctozeptoas in "cleanup gone wrong and discovered weeks later"11:55
yoctozeptoodd11:55
yoctozeptouhm11:56
yoctozeptois kvm loaded by any chance?11:56
yoctozeptoboth main and cpu-specific?11:56
yoctozeptolsmod | grep kvm11:56
yoctozeptoadmin0: ^11:56
admin0but this is a simulated "oops something bad happened"  .. i rebooted the box , rebooted the vms multiple times before nuking the controllers and restart to make sure no skeletons in the closet pop up11:56
admin0i see kvm_intel, and kvm and irqbypass11:57
yoctozeptohmm, odd11:57
yoctozeptoand what about11:57
yoctozeptodmesg | grep kvm11:57
admin0null on that11:57
yoctozeptothen fine11:57
sean-k-mooneyadmin0: this behavior is not related to the host reboot or the contoler unless you are useing shard stroageve form the contolers on the compute nodes11:58
admin0modprobe kvm && dmesg | grep kvm = also nothing11:58
yoctozeptoeverything's all right but it does not work11:58
yoctozeptonah, that should be nothing11:58
sean-k-mooneye.g. you put your instnace data dir on an nfs share11:58
admin0this has no ceph and no cinder .. its local storage11:58
admin0i have the disks file locally11:58
yoctozeptoyeah, the error is that x86_64 missing11:58
yoctozeptosomehow11:58
yoctozeptowhat distro is this anyways?11:58
yoctozepto(right time to ask that heh)11:59
admin0ubuntu 16.0411:59
sean-k-mooneyadmin0: i think you need to set up your experiment again clenly11:59
yoctozeptoquite an oldie there11:59
*** pcaruana has joined #openstack-nova11:59
admin0ok.. then for the purpose of this, how do do virsh capabilities and edit hte nova file manually so that it just boots up, gets the IP and rsync, recovery is possible11:59
sean-k-mooneythe behavior you are seeing is not consitent with how nova operates11:59
admin0i undestand it may not boot in a very performant or optimal state, but the scope is recovery here12:00
sean-k-mooneynormally you would just do virsh start on the domains12:00
sean-k-mooneyno need to edit them12:00
admin0same would be if the virsh/os crashed and i manually had to copy the disk and xml to another (non-similar) compute node12:00
yoctozeptoadmin0: is qemu-kvm installed?12:00
admin0qemu-kvm is already the newest version (1:2.10+dfsg-0ubuntu3.8~cloud1).12:01
admin0   <type arch='x86_64' machine='pc-i440fx-artful'>hvm</type>12:01
yoctozeptothen I'm out of cards with this issue, really what comes to mind is some bug in ubuntu's libvirt that you have discovered12:01
admin0i guess that pc-* is the issue ?12:01
yoctozeptowell, you could try modifying that12:01
yoctozeptopc-i440fx-xenial should be there12:02
yoctozepto(at least that's what common sense suggests)12:02
admin0i see https://gist.github.com/a1git/f3696c126a732cda88757c09263bc2de  in virsh capabilites related to x86_6412:02
yoctozeptonothing suspicious12:03
sean-k-mooneythe machine type is normal12:03
gibiefried: I got pulled downstream this morning so my review on the provider config progressing slowly. sorry12:03
sean-k-mooneyit will now show up in the cpu feature list12:03
sean-k-mooney*not12:04
sean-k-mooneyits basicaly the "motherboard" for lack of a better name the vm uses12:04
*** zbr|rover is now known as zbr|drover12:09
admin0i edited pc-i440fx-artful  to pc-i440fx-xenial  .. same error as  invalid argument: could not find capabilities for arch=x86_64 . i have the virsh capabilities in full , lsmod and the vm definition here => https://gist.github.com/a1git/4528c53090f8934b9218586817c5191112:09
*** ratailor has quit IRC12:09
*** jawad_axd has joined #openstack-nova12:10
sean-k-mooneyadmin0: its not related to the model12:10
admin0ok .. but based on the output, there is no way this instance can boot up ?12:11
sean-k-mooneyadmin0: you could set it to "pc" which is an aliase for the latest model supproted that is no q3512:11
sean-k-mooneyadmin0: the machine types are not listed in that output12:11
admin0how do i list them ?12:12
*** mkrai_ has joined #openstack-nova12:13
sean-k-mooneyits likely because the x68 emulator is also not listed12:13
sean-k-mooneyyou shoudl have a section like this12:16
sean-k-mooney<guest>12:16
sean-k-mooney    <os_type>hvm</os_type>12:16
sean-k-mooney    <arch name='x86_64'>12:16
sean-k-mooney      <wordsize>64</wordsize>12:16
sean-k-mooney      <emulator>/usr/local/bin/qemu-system-x86_64</emulator>12:16
sean-k-mooney      <machine maxCpus='255'>pc-i440fx-4.1</machine>12:16
sean-k-mooney      <machine canonical='pc-i440fx-4.1' maxCpus='255'>pc</machine>12:16
sean-k-mooneyin my case it extends quite far12:16
admin0i will try to remove the libvirt-bin package and reinstall it12:17
sean-k-mooneyits not libvirt that is the issue12:17
sean-k-mooneyit cant find the x86 qemu bindary12:17
stephenfinsean-k-mooney: Any decisions on what we want to do about https://github.com/openstack/nova/blob/master/nova/virt/libvirt/vif.py#L299-L301 ?12:17
stephenfinThat function doesn't exist12:17
sean-k-mooneyso you need to reinstall qemu12:17
sean-k-mooneyset_vif_host_backedn_brdige_config?12:18
sean-k-mooneystephenfin: what is the context?12:18
stephenfinyes12:18
stephenfinit hasn't existed since commit 92323586b5d03b31c18657ad64646a8ce3b8a74212:18
stephenfin<stephenfin> yo, sean-k-mooney, looks like you added https://github.com/openstack/nova/blob/b44b540fc70504f3869ef23022642095de0ea99e/nova/virt/libvirt/vif.py#L299-L30112:19
stephenfin<stephenfin> sean-k-mooney: but that function has existed since it was removed in commit 92323586b5d03b31c18657ad64646a8ce3b8a74212:19
stephenfin<stephenfin> sean-k-mooney: so that means that code is not being called by anything yet. In either case, want to work on the fix or will I?12:19
stephenfin<stephenfin> sean-k-mooney: fwiw, I'm running pytype over the code base to see what it reveals. That's one of two actual issues it has found so far12:19
sean-k-mooneyoh you pinged me earlier i did not see it12:19
jawad_axdHi all! Question is: I want to move couple of vms from one openstack evn(with local storage) to another openstack env(with ceph backend). Both vms have 40G root disk and 100G ephemeral disk.I can not take snapshot of instances since they are using ephemeral disks. How can I take backup of these vms with ephemeral disks  and boot those two instance in new environment(with ceph backend)?12:20
stephenfinThe easy fix would be to re-add the function, but if no one has hit this yet (it's been there since 18.0.0) perhaps we can remove the call12:20
sean-k-mooneystephenfin: the only place that is called is here https://github.com/openstack/nova/blob/b44b540fc70504f3869ef23022642095de0ea99e/nova/virt/libvirt/vif.py#L611-L61212:20
stephenfinI call look into it if you don't have time12:20
sean-k-mooneyso it the non os-vif code path for linux bridge12:21
stephenfinyup12:21
sean-k-mooneyi think that was there just for nova-net?12:21
admin0sean-k-mooney, i redid libvirt-bin , restarted libvirtd and now i see it12:21
admin0under hvm12:21
admin0trying to define the instance now12:21
admin0defined :)12:22
sean-k-mooneystephenfin: i think we can remvoe that branch12:22
stephenfinsean-k-mooney: aha, yes https://github.com/openstack/nova/blob/b44b540fc70504f3869ef23022642095de0ea99e/nova/network/os_vif_util.py#L527-L52812:22
stephenfinwe sure can12:22
stephenfinI'll go kill it12:22
stephenfinthanks, sean-k-mooney12:22
sean-k-mooneystephenfin: anything that would be taking it would be broken at the moment anyway12:22
stephenfinbut first, 🏊+🥪12:23
admin0ok .. nova is taken care of .. neutron next  i think: -> Cannot get interface MTU on 'brqb3371910-95': No such device12:23
*** ociuhandu has quit IRC12:23
yoctozeptoadmin0: cool12:23
yoctozeptoso it's a bug in libvirt losing hvm12:23
admin0thanks yoctozepto, sean-k-mooney  .. can i mention a thank you when i put put this article on my openstackfaq.com site12:24
sean-k-mooneyadmin0: you might want to take this to #openstack by the way12:24
admin0i did started on kolla aio https://www.openstackfaq.com/openstack-kolla-all-in-one/12:24
sean-k-mooneyadmin0: sure if you want12:24
yoctozeptoadmin0: /me appreciates appreciation12:25
sean-k-mooneyjawad_axd:  there is noe cross cloud migration support native to nova12:25
sean-k-mooneyjawad_axd: so your best bet would be to do the backup from within the vm.12:25
sean-k-mooneye.g. snapshot root disk12:25
jawad_axd@sean-k-mooney : Not migration, just want to take snapshot of instance with ephemeral disk?12:26
sean-k-mooneycreate a vm on the ohter cloud by downloand an uploadign the snap shot.12:26
sean-k-mooneyboot it in rescue mode and then rsync the contentes fo the ephemeral volumes12:26
sean-k-mooneyyou can take a snapshot but it will only snapshot the root disk12:26
admin0jawad_axd, or you can just boot 2 vms, rsync the data you need12:26
sean-k-mooneythat is basicly what i was saying12:27
yoctozepto(this is the point where one suggests using dd over socat)12:27
jawad_axdSnapshot doest work with ephemeral disk[E.g flavor has root disk and ephemral disk], while snapshot works with just root disk when in flavor ephemeral disk=0 .12:27
jawad_axdah ok12:28
sean-k-mooneyreally it should still work with the root disk. at least i taught it did12:28
sean-k-mooneyi just wont snapshot the ephemeral disks12:28
jawad_axdIts not even snapshotting the root disk.12:28
sean-k-mooneyephemeral disk are intened for fast local storage by the way. not data persitency12:29
sean-k-mooneyi see12:29
sean-k-mooneythat should be filed as a bug. thre may be a reson for that but i dont know of one off the top of my head12:29
sean-k-mooneythen what i would do is as follows12:30
sean-k-mooneyboot a second vm on the new cloud12:30
sean-k-mooneyboot both vms in rescue mode12:30
sean-k-mooneythen use dd/rsync/clonzilla to copy all disks between the two12:30
sean-k-mooneythen unrescue the new vm12:30
sean-k-mooneyif you are moving to ceph i would also recomend replaceign the epmeeral disk with cinder volumens12:31
sean-k-mooneyif your user have permission on both clouds then this is something they could do themsese if its a private cloud followign instuctions12:32
jawad_axdOk, I am trying to understand your instructions.12:33
sean-k-mooneybasically on the new cloud create a vm with X root disk and n cinder volumns to repalce the ephemeral disks12:34
sean-k-mooneythen use rescue mode  on both vms to boot the vms with a different imave with a disk imagain tool12:35
sean-k-mooneyand then use your  tool of choice to copy the data form 1 vm to the other12:36
sean-k-mooneythen unrescue to reboot from the vm root disk12:36
jawad_axdOkay..12:36
jawad_axdI am going to try it.Thank you!12:36
*** eharney has joined #openstack-nova12:37
sean-k-mooneythere are some third part disater recovery tools that claim to be able to do this for you12:38
sean-k-mooneybut i dont really recommend using them12:38
sean-k-mooneymainly because they tend to mess with the nova db in ways we would not support12:38
jawad_axdok12:39
*** iurygregory_ is now known as iurygregory12:40
*** udesale_ has joined #openstack-nova12:45
*** udesale has quit IRC12:48
*** ociuhandu has joined #openstack-nova12:57
*** ociuhandu has quit IRC13:03
*** tbachman has joined #openstack-nova13:06
*** mmethot has quit IRC13:08
*** mkrai_ has quit IRC13:19
*** lpetrut has joined #openstack-nova13:23
*** derekh has quit IRC13:32
*** dave-mccowan has joined #openstack-nova13:37
*** kozhukalov has joined #openstack-nova13:39
*** pcaruana has quit IRC13:45
gibiefried: left comments in the first provider config patch: https://review.opendev.org/#/c/673341 I think my comments about the schema would be interesting to you too13:50
*** mkrai_ has joined #openstack-nova13:53
*** liuyulong has joined #openstack-nova13:58
gibidustinc|PTO: ^^13:59
*** mlavalle has joined #openstack-nova13:59
openstackgerritVladyslav Drok proposed openstack/nova master: Make removal of host from aggregate consistent  https://review.opendev.org/69639214:01
*** derekh has joined #openstack-nova14:02
dustinc|PTOThanks gibi, I read through your comments but won’t be able to follow up until Tuesday.14:08
gibidustinc|PTO: no worries I also need to read your other patches in the series14:09
gibidustinc|PTO: have a nice PTO14:09
dustinc|PTOThanks :)14:09
*** mriedem has joined #openstack-nova14:10
*** nweinber__ has joined #openstack-nova14:11
*** ociuhandu has joined #openstack-nova14:14
*** pcaruana has joined #openstack-nova14:22
*** ociuhandu has quit IRC14:27
*** mkrai_ has quit IRC14:28
openstackgerritBalazs Gibizer proposed openstack/nova stable/stein: DNM: try to trace bug 1859766  https://review.opendev.org/70270014:31
openstackbug 1859766 in OpenStack Compute (nova) stein "functional tests intermittently fails with "ReadOnlyFieldError: Cannot modify readonly field uuid"" [Undecided,New] https://launchpad.net/bugs/1859766 - Assigned to Balazs Gibizer (balazs-gibizer)14:31
*** mkrai_ has joined #openstack-nova14:32
*** dave-mccowan has quit IRC14:32
*** ociuhandu has joined #openstack-nova14:33
*** dave-mccowan has joined #openstack-nova14:35
*** mmethot has joined #openstack-nova14:35
*** ociuhandu has quit IRC14:37
*** ociuhandu has joined #openstack-nova14:38
*** awalende has quit IRC14:42
*** tbachman has quit IRC14:42
lyarwoodDid anyone get to the bottom of `mysql: command not found` on the subnodes in the LM jobs?14:43
gibilyarwood: based on the bug https://bugs.launchpad.net/nova/+bug/1860021 we still have the problem14:46
openstackLaunchpad bug 1860021 in devstack "nova-live-migration fails 100% with "mysql: command not found" on subnode" [Undecided,In progress] - Assigned to Radosław Piliszek (yoctozepto)14:46
lyarwoodgibi: thanks, I couldn't find that for some reason.14:46
lyarwoodand yeah glance on the subnode is the issue14:47
* lyarwood checks the review14:47
*** jangutter has quit IRC14:51
*** mkrai_ has quit IRC14:52
*** damien_r has quit IRC14:54
*** TxGirlGeek has joined #openstack-nova14:55
efriedthanks gibi14:56
lyarwoodg-api on computes is just weird tbh, now if I could just figure out where the hell that's set14:56
lyarwoodah it is devstack-gate15:00
efriedlyarwood: If we turn that off, won't it break grenade?15:02
efriedsean-k-mooney pointed out the commit from mriedem where that was introduced.15:02
*** jangutter has joined #openstack-nova15:02
*** ratailor has joined #openstack-nova15:04
*** ociuhandu has quit IRC15:04
lyarwoodefried: I'd have to check that commit for context, is there a rolling g-api upgrade test in grenade?15:05
*** jawad_axd has quit IRC15:05
efriedI have no earthly idea. Grenade has always been a swirling mystery to me.15:06
*** jangutter has quit IRC15:06
efriedlyarwood: https://github.com/openstack/devstack-gate/commit/183a58eab185c2e6f48afb4d99417d49e88c0f5a#diff-987768d02fbf43ebb74ad9a359222903R2715:07
lyarwoodWell that's two of us15:07
* lyarwood clicks15:07
*** jawad_axd has joined #openstack-nova15:08
efriedShooting in the dark, we can proposed a d-g patch to remove g-api from that list, and a nova patch to depend on it, and see what goes kablooey.15:08
*** zbr|drover has quit IRC15:08
lyarwoodefried: yup just doing that now15:08
lyarwoodefried: I can't think why that would break anything in grenade tbh15:09
efriedoh, k, /me stops doing that.15:09
lyarwoodefried: but if it does I'll dig into it15:09
efriedgreat, thank you lyarwood15:09
*** ratailor_ has joined #openstack-nova15:09
openstackgerritLee Yarwood proposed openstack/nova master: DNM Test the removal of g-api from subnodes  https://review.opendev.org/70310015:10
dansmithhas anyone asked glance if they're doing that on purpose? (or is it just our jobs?)15:10
dansmithbecause they've been working on some multi-worker multi-store stuff lately which likely needs g-api on different nodes to accomplish15:11
*** ratailor has quit IRC15:11
sean-k-mooneyrunning the glacne api on multiple nodes does not require them to initalise the glance db multiple times15:12
*** jawad_ax_ has joined #openstack-nova15:13
lyarwoodright we aren't talking about that bug here, just if running g-api on a subnode is valid.15:13
sean-k-mooneyso if they are which would be resonable devstack need to be updated so that we can make sure the db is only setup on the contoler15:13
sean-k-mooneylyarwood: sure you can do that15:13
*** jawad_axd has quit IRC15:13
sean-k-mooneynormally we would not need too but you can15:14
melwittI can't find where in the chat log someone mentioned it would be needed for grenade15:14
sean-k-mooneyi have seen it done on small 1-3 node deployments15:14
dansmithspecifically for edge it's a thing15:14
sean-k-mooneywhere all the contoler were also computes and they split the contol plane across them15:14
melwitthttp://eavesdrop.openstack.org/irclogs/%23openstack-qa/%23openstack-qa.2020-01-16.log.html#t2020-01-16T18:56:1415:15
sean-k-mooneymelwitt: it might be need for grenade to test that we can upgrade nova independly of glance or something like that15:15
lyarwoodyeah of course, I guess devstack-gate just needs some additional subnode flavours if you will covering a pure compute subnode, mixed subnode with g-api etc15:15
*** ratailor_ has quit IRC15:15
sean-k-mooneylyarwood: or we could move to zullv315:16
lyarwoodor that15:16
sean-k-mooneyalthogh devstack would still need to have configuration for the db15:16
sean-k-mooneyalso crap im late for the bug call15:16
*** zbr|drover has joined #openstack-nova15:17
lyarwoodsean-k-mooney: you're not missing much :)15:17
sean-k-mooneymy only bug was closed so i didnt have anything to talk about.15:17
sean-k-mooneyi just realise what time it was15:18
sean-k-mooneybackporting functional test is annoying15:18
*** jawad_ax_ has quit IRC15:18
*** awalende has joined #openstack-nova15:18
sean-k-mooneyapparently we rewrite how the numa ones work each cycle15:19
melwittI'm working on testing out grenade with zuul v3 in nova (https://review.opendev.org/701478 depends-on https://review.opendev.org/548936 and https://review.opendev.org/70300515:20
melwittnot as a fix for the gate but to get away from the gzipped log files15:21
sean-k-mooneydid my change not work15:22
sean-k-mooneyi saw a ping about it last night15:22
sean-k-mooneybut i did not fully get the context15:22
sean-k-mooneybut yes i would like use to adopt the v3 approch if we can too15:22
gmannsean-k-mooney: it fixed for zuulv3 jobs not legacy which are d-g dependents not on devstack roles15:23
*** awalende has quit IRC15:23
melwittyep, what gmann said15:23
*** kozhukalov has quit IRC15:23
sean-k-mooneyah ok15:23
openstackgerritBalazs Gibizer proposed openstack/nova stable/stein: Remove global state from the FakeDriver  https://review.opendev.org/70310215:24
openstackgerritBalazs Gibizer proposed openstack/nova stable/stein: Enhance service restart in functional env  https://review.opendev.org/70310315:24
melwittso I found that proposed grenade patch that moves it to v3 and it mostly works. just needs a few updates15:24
gmannmelwitt: yeah only remaining things there is that does not work for plugin case yet. which is something should be figured out before we merge that15:25
sean-k-mooneymelwitt: yep i have been trying to get peopel to review it ever few weeks for a while15:25
sean-k-mooneygmann: there is one other case too15:25
melwittgmann: oh I see15:25
sean-k-mooneygmann: it can be done as a follow up but you cant specify a different local_conf section per version15:26
sean-k-mooneyyou can do it for localrc15:26
gmannsean-k-mooney: i could not get chance to find gzip log place for legacy jobs. busy for tempest plugins py2-drop drama bug.15:26
sean-k-mooneybut localrc does not allow you to set the post-config updates15:26
gmannsean-k-mooney: yeah that(different local_conf section) is true, i failed to do that while IPv6 enable for legacy jobs.15:28
gmannbut i am not sure why devstsack fix is wrong, waiting for frickler re-reply15:28
*** mkrai_ has joined #openstack-nova15:29
*** ratailor has joined #openstack-nova15:29
*** ratailor has quit IRC15:29
*** ociuhandu has joined #openstack-nova15:31
*** ociuhandu has quit IRC15:32
*** ociuhandu has joined #openstack-nova15:32
sean-k-mooneygmann: we will need that to be able to test placement reshapes on upgrade in grenade15:34
sean-k-mooneybecause we sill need to change form using vcpu_pin_set to cpu_share_set and cpu_dedicated_set15:34
sean-k-mooneyalthough we dont test that today so its not required to move15:34
sean-k-mooneyim sure there are other examples too but having the ablity to specifc new/old/shared local_conf sections in the zuul.yaml will be useful15:35
*** mrch_ has quit IRC15:37
*** mrch_ has joined #openstack-nova15:37
toskymelwitt: "mostly" - for some reasons, after we switched to Python 3, several python 2 packages are installed anyway, including python-openstackclient15:38
toskymelwitt: so whenever "openstack foo" is called, the py2 version is used; and when the sahara plugin (or heat plugin) tries creating resources with "openstack dosomething", its own osc plugin (py3 only) is not found15:39
gmannsean-k-mooney:  or we can do that via direct config change via roles. something to explore may be.15:39
toskyI'm failing to understand where the issue is15:39
toskygmann, sean-k-mooney or the from-<foo> update plugin maybe15:40
melwittI see15:40
sean-k-mooneygmann: we could but im not sure that would be better. if it requrie new roles to be written i think it would be worse the adding supprot for local.conf in grenade15:40
lyarwoodrandom question, what's the best way of checking the stability of a given job over the last x number of months?15:40
sean-k-mooneytosky: it might be the fact that on older brances we install everything twice. once under py3 then again under py215:41
gmannlyarwood: http://status.openstack.org/openstack-health/#/15:41
sean-k-mooneytosky: we only stopped doing that in ussuri15:41
gmannyou can filter the jobs and time period15:41
toskysean-k-mooney: devstack, you mean? A pure devstack job does not install all those stuff15:41
gmannbut data is only for the gate pipeline15:41
sean-k-mooneytosky: yes in devsack15:42
lyarwoodgmann: ack thanks15:42
toskysean-k-mooney: but comparing with a devstack job, I see much more components; so something happens in the grenade-specific roles15:42
sean-k-mooneyhttps://github.com/openstack/devstack/commit/63ab664baf99716e9a5d29eb82f974f8c345681615:42
sean-k-mooneytosky: ^15:42
lyarwoodgmann: so this wouldn't help if I wanted to look at NV jobs in the check queue right?15:43
lyarwoodgmann: trying to figure out a way of showing something is now stable and can be made voting15:43
gmannoh . yeah n-v jobs data are not there15:43
lyarwoodkk np15:43
lyarwoodand thanks :)15:43
toskysean-k-mooney: but then I shouldn't see this in master15:44
toskysean-k-mooney: so there must be something else too15:44
sean-k-mooneyon master no but grenade installs with train frist then upgrdaes to master15:45
sean-k-mooneyso all the train deps will be installed with both15:45
toskyoh, right15:45
sean-k-mooneythen we will upgrade to train without updateing the python 2 deps15:45
toskythis means that when we install train/py3 we have a problem15:45
toskynot a problem normally, as train is technically py2 for devstack15:46
toskybut I'm not sure how to solve15:46
sean-k-mooneyyes well a traing/py3 intsall install both under py3 and py215:46
sean-k-mooneytosky: well no15:46
sean-k-mooneytrain should would with python 3 aswell15:46
efriedgibi: if you have a second, could you please remind me the context around why we're parsing a RP name to identify an interface?15:46
sean-k-mooneytosky: what is the specific issue you are having15:48
sean-k-mooneyone way to solve it would be do a pip freeze and unistall any openstack package that is installed15:48
sean-k-mooneyon python 215:49
*** mkrai_ has quit IRC15:50
toskysean-k-mooney: see my comment above: both versions of osc are installed, but the osc plugins are py3 only, and then the py2 openstack fails to use them15:52
*** TxGirlGeek has quit IRC15:53
*** jawad_axd has joined #openstack-nova15:54
sean-k-mooneyya so that is the same issue we have with console_scripts entry points15:55
sean-k-mooneythe python 2 version of osc console sript overites teh python 3 version on train15:56
sean-k-mooneyso grenade or devstack could be updated to explictly remvoe osc everytime it stacks15:56
sean-k-mooneyand install it again15:57
sean-k-mooneythat should fix it15:57
*** damien_r has joined #openstack-nova15:58
toskymaybe devstack; at the end, if it's USE_PYTHON3, pip uninstall python-openstackclient (keeping the 3 version)15:58
*** jawad_axd has quit IRC15:59
sean-k-mooneytosky: well it would want to do it near the start not the end16:01
*** macz has joined #openstack-nova16:01
sean-k-mooneybecause you want to have it installed and ensure any place we use it in devstack to do things wew use the correct one16:01
*** udesale_ has quit IRC16:01
sean-k-mooneyalso you want it to deffinetly happen before the local.sh gets executed as its common to use the client to do things in the local.sh16:02
*** udesale has joined #openstack-nova16:03
toskysean-k-mooney: so basically tune the piece of code you mentioned above to not install the py2 version of osc?16:03
sean-k-mooneyam i guess you could do that too. i was thinking of adding a new function that gets invoked after the install phase but before the post-config phase16:04
toskygmann: any thoughts about this ^ ?16:05
gmannsorry, did note read that. too many bugs for py2 :(16:06
gmanndid not16:06
*** lpetrut has quit IRC16:08
*** udesale has quit IRC16:10
gmanni will followup on that later on review16:10
*** damien_r has quit IRC16:10
*** jawad_axd has joined #openstack-nova16:15
*** slaweq has quit IRC16:16
*** sapd1_x has joined #openstack-nova16:17
KeithMnemonic1hello all. one last plea to get this merged https://review.opendev.org/683008  . We have confirmation from the customer that this resolves the issue they were seeing with their Lenovo storage.16:17
KeithMnemonic1this was that issue we had with the cinder stuff jungleboyj: if you recall and the DS6200.16:18
stephenfinartom, efried: Did you folks get any closer to figuring out that nova-live-migration gate issue yesterday?16:19
*** TxGirlGeek has joined #openstack-nova16:19
*** maciejjozefczyk has quit IRC16:19
sean-k-mooneylyarwood: could you review KeithMnemonic1 backport16:19
jungleboyjKeithMnemonic1:  Ah, glad that you guys were able to make a change there.16:19
*** jawad_axd has quit IRC16:19
*** jdillaman has quit IRC16:20
KeithMnemonic1it was the issue gorka said, losing track of the luns16:20
jungleboyjBakcport makes sense to me.16:22
*** belmoreira has joined #openstack-nova16:24
*** gyee has joined #openstack-nova16:27
*** Sundar has joined #openstack-nova16:30
SundarHi sean-k-mooney: How's the deployment coming along?16:31
openstackgerritsean mooney proposed openstack/nova stable/rocky: Remove 'test_cold_migrate_with_physnet_fails' test  https://review.opendev.org/70311516:32
openstackgerritsean mooney proposed openstack/nova stable/rocky: Block rebuild when NUMA topology changed  https://review.opendev.org/70311616:32
openstackgerritsean mooney proposed openstack/nova stable/rocky: Disable NUMATopologyFilter on rebuild  https://review.opendev.org/70311716:32
openstackgerritsean mooney proposed openstack/nova stable/rocky: FUP for in-place numa rebuild  https://review.opendev.org/70311816:32
sean-k-mooneySundar: i have been trying to do some backport today before the weekend so ill likely get back to it again tomorow16:32
sean-k-mooneywell monday16:32
Sundarsean-k-mooney: NP. Have a good weekend.16:33
artomstephenfin, https://review.opendev.org/#/c/702960/16:34
stephenfinartom: ta16:37
*** udesale has joined #openstack-nova16:37
*** mrch_ has quit IRC16:40
belmoreiraHi, I'm trying to boot an aarch64 image on x86_64 compute node and initially I though would be easy... but I'm still struggling. I was assuming that I just needed to define the arch in the image and nova will use that to trigger qemu-system-arm, but apparently not. Googling about it I can't find any answer... only similar questions. Do you have any pointer?16:42
sean-k-mooneyyou can only do that if you set the virt type to qemu16:43
sean-k-mooneyand then i belive you have to set a nova config option16:43
sean-k-mooneyi belive you have to configre the machine types16:44
sean-k-mooneyhttps://docs.openstack.org/nova/latest/configuration/config.html#libvirt.hw_machine_type16:44
belmoreirasean-k-mooney yes, I'm doing the machine type16:45
*** mriedem has quit IRC16:46
sean-k-mooneyok then i think provide virt_type=qemu is deiend and you have the arch set in the image i think that shoudl work16:47
sean-k-mooneyyou might need to set a cpu model but if you do that would force the host to only be able to run aarch6416:47
sean-k-mooneywe do not have a way to set a cpu model per arch16:47
belmoreirawhat I tried: virt_type=qemu and hw_machine_type=aarch64=machinetype116:49
belmoreiraalso the image is set with the correct arch16:49
sean-k-mooneywhat is the error you get16:49
sean-k-mooneyyou might need to set [libvirt]/cpu_models16:49
belmoreiralibvirt.libvirtError: XML error: No PCI buses available16:50
sean-k-mooneywell machinetype1 is not a real machein type16:51
sean-k-mooneyit was an example for the config you need to use a real one16:51
kashyapYeah, belmoreira: Also any reason you're using 'virt_type' as 'qemu', instead of 'kvm'?16:51
sean-k-mooneykashyap: because its aarch64 on x8616:51
sean-k-mooneyso it has to be qemu16:51
kashyapAh, didn't read the full scroll, my bad16:52
kashyapbelmoreira: To get the supported machine types on your host, run `qemu-system-aarch64 -machine help`16:52
kashyap(Or whatever the QEMU binary name is on your host.)16:52
*** rpittau is now known as rpittau|afk16:53
sean-k-mooneytry seting hw_machine_type=aarch64=virt16:53
belmoreiraohh :) that's the machine type16:53
sean-k-mooneyvirt should be an alias to the newst arm machien type your qemu supprots16:54
sean-k-mooneyfor me that is virt-4.116:54
sean-k-mooneythere are some specifc system it can emulate but virt is what you want mostlike with openstack16:55
kashyapbelmoreira: Yes, 'virt' is actually the _recommended_ machine type for AArch6416:56
belmoreirathanks for let me know what the machine type means16:56
kashyapI've documented it "why" in the libvirt driver.py16:56
sean-k-mooneythinks of the machine type as the "motherboard" of the vm16:56
sean-k-mooneyits not quite the same thing but its close enough16:57
kashyap Yes, that's the analogy I use.  A "virtual motherboard" with some default devices built-in16:57
*** dtantsur is now known as dtantsur|afk16:58
sean-k-mooneyincluding hopefully a pci bus which is what it was previously unhappy about16:58
kashyapsean-k-mooney: Yes, it does include16:59
kashyapbelmoreira: sean-k-mooney: I mention it in the commit message here, FWIW, https://opendev.org/openstack/nova/commit/e155baefb016:59
*** udesale has quit IRC17:00
belmoreiraafter changing to hw_machine_type=aarch64=virt I'm still getting the same error17:02
sean-k-mooneykashyap: that chages the default for armv7 which is a completely different architecture17:03
sean-k-mooneyoh i guess you did it for both17:04
kashyapYes17:04
kashyapsean-k-mooney: Not denying that.  But the point stands, for AArch64, Armv7, etc, the recommended machine type is 'virt' :-)17:04
* kashyap needs to head out shortly17:04
sean-k-mooneybelmoreira: the people that work at/with lenaro are probly your best bet17:05
sean-k-mooneybelmoreira: we have no upstream testing of cross architecure support17:05
*** sapd1_x has quit IRC17:06
belmoreirasean-k-mooney kashyap thanks for your tips. I will continue to dig into this and will let you know when I find more17:06
sean-k-mooneyi have dont this with libvirt a few times in the past but never actully done it with openstack17:06
sean-k-mooneyby the way are you setting hw_machinet_type in the image too https://github.com/openstack/glance/blob/master/etc/metadefs/compute-libvirt-image.json#L6017:08
belmoreiraIn the image I just set the arch. Let me try17:10
sean-k-mooneyyour setting https://github.com/openstack/glance/blob/54329c6a21b0d3f845b09e79f710fc795976a175/etc/metadefs/glance-common-image-props.json#L26-L2917:11
sean-k-mooneyas architecture=aarch6417:11
sean-k-mooneyor architecture=arm17:11
sean-k-mooneysorry that should be  hw_architecture=aarch6417:12
efrieddansmith: This should hopefully be relatively simple for you to understand and sanity check if you don't mind please: https://review.opendev.org/#/c/702261/17:12
dansmithheh first file has random whitespace damage17:13
dansmithbut will look in a sec17:13
sean-k-mooneybelmoreira: so ya checking https://github.com/openstack/nova/blob/c6218428e9b29a2c52808ec7d27b4b21aadc0299/nova/virt/arch.py#L21 it should be hw_architecture=aarch6417:14
belmoreirasean-k-mooney also using hw_architecture=aarch64. I'm getting the same error. Thanks. I will review my config17:20
*** tosky has quit IRC17:21
*** liuyulong has quit IRC17:25
*** ociuhandu_ has joined #openstack-nova17:25
*** ociuhandu has quit IRC17:27
*** martinkennelly has quit IRC17:29
*** ociuhandu_ has quit IRC17:29
*** evrardjp has quit IRC17:34
openstackgerritIlya Etingof proposed openstack/nova master: [WIP] Add JSON schema for network_data.json  https://review.opendev.org/70313317:34
*** evrardjp has joined #openstack-nova17:34
*** gentoorax has quit IRC17:40
*** CeeMac has quit IRC17:40
*** gentoorax has joined #openstack-nova17:48
openstackgerritsean mooney proposed openstack/nova stable/queens: Block rebuild when NUMA topology changed  https://review.opendev.org/70314017:48
openstackgerritsean mooney proposed openstack/nova stable/queens: Disable NUMATopologyFilter on rebuild  https://review.opendev.org/70314117:48
openstackgerritsean mooney proposed openstack/nova stable/queens: FUP for in-place numa rebuild  https://review.opendev.org/70314217:48
*** gentoorax is now known as gentoorax_away17:49
*** gentoorax_away is now known as gentoorax17:49
gmannstephenfin: before you start you beer. i pushed 4-5 policies change on this, if you can check on your Monday which will be earlier than mine so pinging in advance :) - https://review.opendev.org/#/q/status:open+project:openstack/nova+branch:master+topic:bp/policy-defaults-refresh17:53
gibiefried: regarding RP name parsing: Nova needs to know which PF (known by nova based on PCI address) is represented by which RP in placement. That RP is created by neutron and neutron does not use PCI addresses but uses the device name instead. So now nova also gather the device name and use that to find the device RP in placement17:57
efriedmm, okay, this is the same thing we're doing for vgpus?17:58
gibiefried: the neutron behavior is originating from the fact that device mapping in the neutron agent config was always based on device name17:58
gibiefried: for vgpus we don't need to agree on a common ID between diferrent projects so I guess the vgpu case is easier17:59
efriedokay, but I think we're using the name to identify the mdev, or something.17:59
efriedanyway, I get it.17:59
efriedthanks for the response.17:59
efriedI'm going through your review of provider config bottom patch fyi17:59
gibiefried: it could be that the mdev is coming from the host OS and it is a name in the host OS not a uuid17:59
gibiefried: thanks for the review18:00
*** derekh has quit IRC18:00
sean-k-mooneylyarwood: can you take a look at https://review.opendev.org/#/c/702971/ and the related patchs and the other backport to rocky and queens on monday18:03
*** ociuhandu has joined #openstack-nova18:03
openstackgerritStephen Finucane proposed openstack/nova master: Switch to hacking 2.x  https://review.opendev.org/69573318:08
openstackgerritStephen Finucane proposed openstack/nova master: vif: Remove dead code  https://review.opendev.org/70314618:08
openstackgerritStephen Finucane proposed openstack/nova master: pytype: Resolve issues with 'nova.virt.libvirt'  https://review.opendev.org/70314718:08
openstackgerritStephen Finucane proposed openstack/nova master: pytype: Resolve issues with 'nova.virt.vmwareapi'  https://review.opendev.org/70314818:08
openstackgerritStephen Finucane proposed openstack/nova master: pytype: Resolve issues with 'nova.virt.hyperv'  https://review.opendev.org/70314918:08
openstackgerritStephen Finucane proposed openstack/nova master: pytype: Resolve issues with 'nova.virt.powervm'  https://review.opendev.org/70315018:08
openstackgerritStephen Finucane proposed openstack/nova master: pytype: Resolve issues with 'nova.virt.xenapi'  https://review.opendev.org/70315118:08
openstackgerritStephen Finucane proposed openstack/nova master: pytype: Resolve issues with 'nova.virt.ironic'  https://review.opendev.org/70315218:08
openstackgerritStephen Finucane proposed openstack/nova master: pytype: Resolve final issues with 'nova.virt'  https://review.opendev.org/70315318:09
openstackgerritStephen Finucane proposed openstack/nova master: pytype: Resolve issues with 'nova.cmd', 'nova.console', 'nova.db'  https://review.opendev.org/70315418:09
*** ralonsoh has quit IRC18:11
*** ociuhandu has quit IRC18:18
*** ociuhandu has joined #openstack-nova18:18
*** ociuhandu has quit IRC18:19
*** ociuhandu has joined #openstack-nova18:20
*** ociuhandu has quit IRC18:21
*** ociuhandu has joined #openstack-nova18:21
*** jawad_axd has joined #openstack-nova18:22
efriedstephenfin: came across this: https://review.opendev.org/#/c/688603/18:23
efried<poke>18:23
*** dave-mccowan has quit IRC18:23
*** ociuhandu has quit IRC18:26
*** jawad_axd has quit IRC18:27
*** awalende has joined #openstack-nova18:43
*** bnemec has joined #openstack-nova18:44
*** bnemec is now known as beekneemech18:45
*** ociuhandu has joined #openstack-nova18:46
*** awalende has quit IRC18:48
*** pcaruana has quit IRC18:51
*** ociuhandu has quit IRC18:52
*** jawad_axd has joined #openstack-nova18:53
*** jawad_axd has quit IRC18:58
*** lpetrut has joined #openstack-nova18:58
*** jawad_axd has joined #openstack-nova19:13
*** jawad_axd has quit IRC19:18
*** Sundar has quit IRC19:22
*** TxGirlGeek has quit IRC19:25
*** TxGirlGeek has joined #openstack-nova19:26
*** TxGirlGeek has quit IRC19:27
*** TxGirlGeek has joined #openstack-nova19:28
*** ociuhandu has joined #openstack-nova19:30
*** tesseract has quit IRC19:32
*** jawad_axd has joined #openstack-nova19:34
*** ociuhandu has quit IRC19:35
*** jawad_axd has quit IRC19:38
*** tosky has joined #openstack-nova19:41
*** belmoreira has quit IRC19:49
*** jawad_axd has joined #openstack-nova19:55
*** TxGirlGeek has quit IRC19:57
*** TxGirlGeek has joined #openstack-nova19:58
*** jawad_axd has quit IRC20:00
*** TxGirlGeek has quit IRC20:00
*** openstackstatus has joined #openstack-nova20:01
*** ChanServ sets mode: +v openstackstatus20:01
*** TxGirlGeek has joined #openstack-nova20:02
*** TxGirlGeek has quit IRC20:03
*** TxGirlGeek has joined #openstack-nova20:03
*** martinkennelly has joined #openstack-nova20:08
*** jawad_axd has joined #openstack-nova20:21
*** jawad_axd has quit IRC20:25
*** haleyb has quit IRC20:28
*** haleyb has joined #openstack-nova20:31
*** nweinber__ has quit IRC20:36
*** belmoreira has joined #openstack-nova20:38
*** belmoreira has quit IRC20:38
*** jawad_axd has joined #openstack-nova20:42
*** jawad_axd has quit IRC20:46
*** ociuhandu has joined #openstack-nova20:46
*** ociuhandu has quit IRC20:48
*** ociuhandu has joined #openstack-nova20:48
*** mmethot has quit IRC20:51
*** dave-mccowan has joined #openstack-nova20:51
*** eharney has quit IRC20:59
*** jawad_axd has joined #openstack-nova21:02
*** ociuhandu has quit IRC21:03
*** ociuhandu has joined #openstack-nova21:04
*** jawad_axd has quit IRC21:07
*** ociuhandu has quit IRC21:13
openstackgerritArtom Lifshitz proposed openstack/nova master: Functional tests for NUMA live migration  https://review.opendev.org/67259521:22
openstackgerritArtom Lifshitz proposed openstack/nova master: NUMA LM: Add func test for bug 1845146  https://review.opendev.org/68740421:22
openstackbug 1845146 in OpenStack Compute (nova) train "NUMA aware live migration failed when vCPU pin set" [High,Fix committed] https://launchpad.net/bugs/1845146 - Assigned to Dan Smith (danms)21:22
*** jawad_axd has joined #openstack-nova21:23
*** jawad_axd has quit IRC21:27
*** dave-mccowan has quit IRC21:28
*** dave-mccowan has joined #openstack-nova21:30
*** ociuhandu has joined #openstack-nova21:44
*** jawad_axd has joined #openstack-nova21:44
*** ociuhandu has quit IRC21:48
*** jawad_axd has quit IRC21:49
*** brinzhang has quit IRC21:50
*** kozhukalov has joined #openstack-nova22:00
*** mmethot has joined #openstack-nova22:01
*** jawad_axd has joined #openstack-nova22:04
*** jawad_axd has quit IRC22:09
*** TxGirlGeek has quit IRC22:20
*** martinkennelly has quit IRC22:20
*** jawad_axd has joined #openstack-nova22:25
*** eharney has joined #openstack-nova22:26
*** jawad_axd has quit IRC22:30
gibiefried, dustinc|PTO : I've finished reviewing the provider config series.22:31
gibinow I might dream about jsonschema in yaml files :D22:32
*** ociuhandu has joined #openstack-nova22:35
*** xek has quit IRC22:36
*** ociuhandu has quit IRC22:40
*** jawad_axd has joined #openstack-nova22:46
*** dklyle has quit IRC22:48
*** david-lyle has joined #openstack-nova22:48
*** david-lyle has quit IRC22:49
*** dklyle has joined #openstack-nova22:49
*** jawad_axd has quit IRC22:50
*** slaweq has joined #openstack-nova22:50
*** KeithMnemonic1 has quit IRC22:51
*** jawad_axd has joined #openstack-nova23:07
*** jawad_axd has quit IRC23:12
*** kozhukalov has quit IRC23:13
*** slaweq has quit IRC23:14
*** dave-mccowan has quit IRC23:15
*** awalende has joined #openstack-nova23:26
*** jawad_axd has joined #openstack-nova23:27
*** awalende has quit IRC23:30
*** jawad_axd has quit IRC23:32
*** rchurch has quit IRC23:33
*** rchurch has joined #openstack-nova23:35
*** macz has quit IRC23:38
*** jawad_axd has joined #openstack-nova23:48
*** jawad_axd has quit IRC23:53
*** dviroel has quit IRC23:57
*** tetsuro has joined #openstack-nova23:59
*** rcernin_ has joined #openstack-nova23:59
« Thursday, 2020-01-16 Index Saturday, 2020-01-18 »

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!