Tuesday, 2020-08-11

*** sapd1 has joined #openstack-nova00:18
*** sapd1 has quit IRC00:39
*** zhanglong has joined #openstack-nova00:41
*** hemna has quit IRC01:01
*** hemna has joined #openstack-nova01:01
*** hemna has quit IRC01:17
*** hemna has joined #openstack-nova01:18
*** ayoung has joined #openstack-nova01:42
ayoungDumb idea time.  Say I wanted to live migrate a VM from one openstack instance to another, across cluster boundaries.  Would this be at all feasable?01:43
*** zhanglong has quit IRC02:04
*** ganso has quit IRC02:04
*** zhanglong has joined #openstack-nova02:06
*** ganso has joined #openstack-nova02:09
*** sapd1 has joined #openstack-nova02:09
*** zhanglong has quit IRC02:10
*** gyee has quit IRC02:11
*** zhanglong has joined #openstack-nova02:12
*** zhanglong has quit IRC02:21
*** hamalq_ has quit IRC02:21
*** zhanglong has joined #openstack-nova02:22
sean-k-mooneyayoung: only by using libvirt directly and then manuly updating the db02:23
sean-k-mooneyayoung: in other words no not really02:23
sean-k-mooneyayoung: not in any way that would be supportable by nova02:23
ayoungOf course it would be horrible.  But so is leaving a cluster in place because it has key workloads.02:25
ayoungSo, yeah, diret libvirt would be necessary, and the receiving cluster would need to be able to take that running VM and make a database entry for it.  On the old host, you would need to finish the migration and then set the VM into a non-runnable mode, too.02:26
sean-k-mooneythe eaiser approch would be to snapshot the vms and then copy the images and restore them on another cloud02:26
ayoungSo, say I needed to do something like this to migrate ahead to Victoria02:27
ayoungYeah, but that means downtime, right?02:27
ayoungWe can snapshot and restore today02:27
sean-k-mooneythe live snapshot would not but you would hten need to restore the snapshot (createing a second instance of the applcaiotn) and somehow sync there state02:27
ayoungopenstack vm  --steal  <source>02:28
sean-k-mooneyif you looking for a solution before the end of they year it will need to be somethign you develop your self unfortuntely02:28
sean-k-mooneywhat versions are you dealing with02:28
sean-k-mooneyis it n to n+1 or multiple versions02:29
ayoungOh, old stuff by your standards. OSP 16 is...Train?02:29
ayoungI'02:29
sean-k-mooneyayoung: do you work for redhat02:29
ayoungI'm really more interested in being able to talk someone thriough waht it would take and why it is a bad idea02:29
ayoungYep, I work for Red Hat.  I used to be Keystone core, but now I see stuff....02:29
ayoungsell stuff02:30
sean-k-mooneywell its a bad idea in general because you cant assume two openstack clouds are using the same hypervior02:30
sean-k-mooneyone could be libvirt and the other vmware02:30
sean-k-mooneyin which case you cant live migrate02:30
sean-k-mooneyayoung: ah ok im in the compute dfg02:30
ayoungNah, that is not a problem.  We know it is all libvirt when we are talking about this. People have old clusters...I have one  on RDO Liberty....02:30
sean-k-mooneyyes so there is the paralle cloud migration work that is being done02:31
ayoungI suspect that even the live migrationm would not make them happy, but I need to be able to talk it through.  I suspect that the payloads would not suffer the cloud split anyway.02:31
sean-k-mooneythat works by runing basicaly a proxy vm on each cloud that can acess the hosts running the vms then it somehow orchestrates the migration betwen the clouds02:31
ayoungSo migrate from Nova to proxy and then from Proxy to new cloud?02:32
ayoungAh, proxy VM, not proxy host02:32
sean-k-mooneyi think how its ment to work is the first recreate the flavors network imaves on the new cloud02:32
sean-k-mooneyboth a new vm on the new cloud with thos imnages02:32
sean-k-mooneythen migrate the runing instnce form one cloud to the prepared vm on the new cloud02:33
sean-k-mooneysomething like that02:33
ayoungSo the proxy is smart enough to "trick" the old and new Novas that all is well02:33
sean-k-mooneyi think the plan is to recreate the resouces on the new cloud with the same uuid/flavors ectra02:33
sean-k-mooneye.g. spin up a nova managed vm02:33
sean-k-mooneythen swap out the root disk ectra using a migration02:34
sean-k-mooneyits totally a hack but its one thing that people are looking at02:34
sean-k-mooneythe proxy just provides connectivity between the cloud i think02:34
ayoungSo it is not a completely crazy idea, but it requires a substantial amoung of work to make it stable.02:34
sean-k-mooneyoh its crazy i would never use it in production or recommend it to customer02:34
sean-k-mooneythat does not mean that marketing dont like it and want to sell it02:35
sean-k-mooneyand there are people working on maiking it work02:35
sean-k-mooneyjust because its a crazy idea does not mean its a worse idea then doing FFU form libverty to train02:35
sean-k-mooneyif your on osp 7 still it makes sense in a strange way02:36
ayoungmind if I use " oh its crazy i would never use it in production or recommend it to customer" in my next deck?02:36
sean-k-mooneyi mean you can if you want02:37
ayoungI am sure some sick bastid somewhere got live migration from vmware to libirt (or the reverse) working02:37
sean-k-mooneyits not something the compoent teams are currently plannign on supporting02:37
*** rcernin has quit IRC02:37
sean-k-mooneyit being developl by the upgrades dfg with input form the feild teams and support02:37
sean-k-mooneyvmware proablyt have the reverse working02:38
sean-k-mooneyayoung: but realistitly its very unlikely02:38
sean-k-mooneythe virtual devices are completely differnt02:38
ayoungI was actually thinking through the steps required for oVirt to Kubevirt and realized it was the same kind of problem02:39
sean-k-mooneyyes althoguh in that case i think there is less state to recreate02:39
ayoungWhat makes that one interesting is that it is possibly a migration to the same hardware, but a different libvirst (in a container)02:39
sean-k-mooneyin both ovirt and kubevirt there isnt realy and nic state to recreate and if you are uing an external storage solution you can proably jsut reuse it since kubvirt allow much more acess to the xml02:40
*** zhanglong has quit IRC02:40
sean-k-mooneyayoung: i mean technically you can do that with openstack too02:40
ayoungRight.  Hence me being here and asking the question of people I trust to have the basis for answering.02:41
ayoungThe real question is if you could set up a system to do that, and to make it work with old deployments.02:42
ayoungLike RDO liberty to OSP 1702:42
sean-k-mooneyayoung: https://www.redhat.com/en/blog/migrating-openstack-platform-13-openstack-platform-16-os-migrate02:42
*** zhanglong has joined #openstack-nova02:42
ayoungNever show stuff like that to sales....02:43
sean-k-mooneyhttps://github.com/os-migrate/os-migrate02:43
sean-k-mooneyayoung: its now offically a supported part of the product starting in 16.102:43
sean-k-mooneyit might be tech preview02:44
sean-k-mooneyim also not sure if it live or cold migration02:44
sean-k-mooneyShut down the instances that are going to be migrated. Currently this OpenStack to OpenStack migration solution only supports cold migration.02:44
sean-k-mooneyso ya cold right now02:45
sean-k-mooneyif you know it was libvirt or osp on both end02:45
sean-k-mooneyyou proably could make live migration work too eventurally02:45
ayoungLike OSP 13 to 16 ...02:46
sean-k-mooneythis really isnt something supportable upstream in nova.02:46
sean-k-mooneyayoung: its intended for moving fom 13 to 16 yes02:46
sean-k-mooneyas an alterniivte to an inplace update02:46
ayoungI actually have just that use case....02:46
sean-k-mooneyjust deploy a second cloud the cold migrate the workloads02:46
*** rcernin has joined #openstack-nova02:48
sean-k-mooneyanyway its almost 4am here and i was just checking a few thing on my laptop when i work up so im going back to bed o/02:48
ayoungOK, thank you for all this.  It might be very useful, if only to drive discussions.02:49
*** dklyle has quit IRC02:52
*** david-lyle has joined #openstack-nova02:52
*** zhanglong has quit IRC03:00
*** zhanglong has joined #openstack-nova03:01
*** tobberydberg_ has quit IRC03:04
*** dpawlik2 has quit IRC03:04
*** bnemec has quit IRC03:04
*** kevinbenton has quit IRC03:04
*** mkrai has joined #openstack-nova03:04
*** irclogbot_3 has quit IRC03:05
*** kevinbenton has joined #openstack-nova03:05
*** hemna has quit IRC03:05
*** bnemec has joined #openstack-nova03:06
*** hemna has joined #openstack-nova03:06
*** irclogbot_0 has joined #openstack-nova03:07
*** sapd1 has quit IRC03:08
*** tobberydberg has joined #openstack-nova03:10
*** ayoung has quit IRC03:18
*** ayoung has joined #openstack-nova03:22
*** mvorwerk_ has quit IRC03:24
*** mvorwerk has joined #openstack-nova03:24
*** Liang__ has joined #openstack-nova03:28
*** ayoung has quit IRC03:29
*** ayoung has joined #openstack-nova03:32
*** psachin has joined #openstack-nova03:37
*** Liang__ has quit IRC03:40
*** Liang__ has joined #openstack-nova03:41
*** ratailor has joined #openstack-nova03:46
*** yaawang_ has quit IRC03:48
*** yaawang_ has joined #openstack-nova03:48
*** rcernin has quit IRC03:54
*** ayoung has quit IRC04:03
*** ayoung has joined #openstack-nova04:04
*** Liang__ has quit IRC04:07
*** Liang__ has joined #openstack-nova04:09
*** rcernin has joined #openstack-nova04:21
*** links has joined #openstack-nova04:32
*** evrardjp has quit IRC04:33
*** evrardjp has joined #openstack-nova04:33
*** zhanglong has quit IRC04:36
*** ratailor has quit IRC04:43
*** ratailor has joined #openstack-nova04:43
*** udesale has joined #openstack-nova05:29
*** belmoreira has joined #openstack-nova05:56
*** belmoreira has quit IRC05:58
*** mvorwerk has quit IRC05:58
*** mvorwerk has joined #openstack-nova05:58
*** belmoreira has joined #openstack-nova06:14
*** zhanglong has joined #openstack-nova06:18
*** mvorwerk_ has joined #openstack-nova06:35
*** danpawlik has joined #openstack-nova06:37
*** mvorwerk has quit IRC06:37
*** slaweq_ has joined #openstack-nova06:40
*** udesale has quit IRC06:51
*** udesale has joined #openstack-nova06:52
*** danpawlik has quit IRC06:54
*** danpawlik has joined #openstack-nova06:55
*** jsuchome has joined #openstack-nova06:55
*** mkrai has quit IRC06:59
*** tesseract has joined #openstack-nova07:19
*** dougsz has joined #openstack-nova07:30
*** yedongcan has joined #openstack-nova07:32
*** tosky has joined #openstack-nova07:41
*** maciejjozefczyk has joined #openstack-nova07:42
*** tbachman has quit IRC07:59
*** brinzhang_ has quit IRC08:09
*** yedongcan has quit IRC08:10
*** sapd1 has joined #openstack-nova08:17
*** priteau has joined #openstack-nova08:27
*** priteau has quit IRC08:42
*** luyao has joined #openstack-nova08:54
*** psachin has quit IRC08:54
luyaostephenfin, alex_xu: thanks for review, I updated and split the patch. https://review.opendev.org/#/c/714653/08:56
*** priteau has joined #openstack-nova08:59
*** rcernin has quit IRC09:11
*** tbachman has joined #openstack-nova09:15
*** martinkennelly has joined #openstack-nova09:23
*** psachin has joined #openstack-nova09:31
*** rcernin has joined #openstack-nova09:34
*** tkajinam has quit IRC09:36
*** sapd1 has quit IRC09:36
*** markvoelker has joined #openstack-nova09:45
*** zhanglong has quit IRC09:45
*** jangutter has joined #openstack-nova09:47
*** udesale_ has joined #openstack-nova09:49
*** markvoelker has quit IRC09:49
*** jangutter_ has quit IRC09:51
*** udesale has quit IRC09:52
*** zhanglong has joined #openstack-nova09:54
*** rcernin has quit IRC09:56
*** nightmare_unreal has joined #openstack-nova09:56
lyarwoodjsuchome: apologies for not getting back to you yesterday10:08
lyarwoodjsuchome: I still wanted to write up a job that would actually exercise this10:08
lyarwoodjsuchome: the job I posted previously did not10:08
lyarwoodjsuchome: I'll try to find some time this week but I'm fighting a few fires downstream at the moment10:08
*** priteau has quit IRC10:11
*** yaawang_ has quit IRC10:13
jsuchomelyarwood: thanks, I was afraid I scared you away :-)10:28
*** jangutter_ has joined #openstack-nova10:30
*** Liang__ has quit IRC10:31
*** jangutter has quit IRC10:32
*** mgariepy has quit IRC10:46
*** markvoelker has joined #openstack-nova10:52
*** markvoelker has quit IRC10:56
*** k_mouza has joined #openstack-nova11:29
*** k_mouza has quit IRC11:30
*** rcernin has joined #openstack-nova11:31
*** k_mouza has joined #openstack-nova11:33
*** markvoelker has joined #openstack-nova11:35
openstackgerritAlex Deiter proposed openstack/nova master: Detach is broken for multi-attached fs-based volumes  https://review.opendev.org/74171211:36
*** markvoelker has quit IRC11:40
*** zhanglong has quit IRC11:58
*** martinkennelly has quit IRC11:58
*** raildo has joined #openstack-nova11:58
*** martinkennelly has joined #openstack-nova11:58
*** zhanglong has joined #openstack-nova12:00
*** martinkennelly has quit IRC12:00
*** martinkennelly has joined #openstack-nova12:00
*** ratailor has quit IRC12:03
*** k_mouza has quit IRC12:11
*** mgariepy has joined #openstack-nova12:20
*** iurygregory has quit IRC12:25
*** iurygregory has joined #openstack-nova12:26
*** nweinber has joined #openstack-nova12:36
*** liuyulong has joined #openstack-nova12:39
*** zhanglong has quit IRC12:43
*** eharney has quit IRC12:54
*** Luzi has joined #openstack-nova12:55
*** JamesBenson has joined #openstack-nova12:57
*** slaweq_ is now known as slaweq12:59
*** Luzi has quit IRC13:00
*** vishalmanchanda has joined #openstack-nova13:04
*** eharney has joined #openstack-nova13:07
*** dave-mccowan has joined #openstack-nova13:12
openstackgerritsean mooney proposed openstack/nova master: Remove deprecated scheduler filters  https://review.opendev.org/74480013:26
*** dave-mccowan has quit IRC13:29
*** eharney has quit IRC13:29
*** dougsz has quit IRC13:32
*** links has quit IRC13:34
openstackgerritStephen Finucane proposed openstack/nova master: tests: Add reproducer for bug #1879878  https://review.opendev.org/74495013:38
openstackbug 1879878 in OpenStack Compute (nova) "VM become Error after confirming resize with Error info CPUUnpinningInvalid on source node " [Medium,In progress] https://launchpad.net/bugs/1879878 - Assigned to Stephen Finucane (stephenfinucane)13:38
openstackgerritStephen Finucane proposed openstack/nova master: Don't unset Instance.old_flavor, new_flavor until necessary  https://review.opendev.org/74495813:38
openstackgerritStephen Finucane proposed openstack/nova master: compute: Add type hints for resize functions  https://review.opendev.org/74534113:38
openstackgerritStephen Finucane proposed openstack/nova master: manager: Move context manager up one level  https://review.opendev.org/74567413:38
openstackgerritStephen Finucane proposed openstack/nova master: WIP: compute: Add more type hints for resize functions  https://review.opendev.org/74567513:38
*** eharney has joined #openstack-nova13:41
*** ociuhandu_ has joined #openstack-nova13:46
*** mkrai has joined #openstack-nova13:47
*** ociuhandu has quit IRC13:47
*** sapd1 has joined #openstack-nova13:53
*** jangutter has joined #openstack-nova13:56
*** mlavalle has joined #openstack-nova13:57
*** jangutter_ has quit IRC13:59
*** smcginnis has quit IRC14:01
*** smcginnis has joined #openstack-nova14:05
*** rcernin has quit IRC14:08
*** flaviof has joined #openstack-nova14:14
*** rcernin has joined #openstack-nova14:19
*** gbajson has joined #openstack-nova14:20
*** gbajson has left #openstack-nova14:21
*** rcernin has quit IRC14:24
*** rcernin has joined #openstack-nova14:27
*** rcernin has quit IRC14:31
*** mriedem has joined #openstack-nova14:35
*** david-lyle has quit IRC14:44
*** dklyle has joined #openstack-nova14:45
*** sapd1 has quit IRC14:55
*** liuyulong has quit IRC14:57
*** mvorwerk has joined #openstack-nova15:02
*** mvorwerk_ has quit IRC15:05
*** mkrai has quit IRC15:07
*** brtknr has left #openstack-nova15:08
*** maciejjozefczyk has quit IRC15:14
sean-k-mooneystephenfin: lyarwood can i get some priority review on https://review.opendev.org/#/c/738432/15:15
*** mlavalle has quit IRC15:15
sean-k-mooneyi want to get that backported sooner rather then later15:16
sean-k-mooneyperferably strating it this week15:16
sean-k-mooneyi would like to see if we can get that in 16.1.1 maybe 16.1.2 downstream but would prefer to do that by backporting upstream15:17
sean-k-mooneythis only need to go back to train but its important to fix15:17
*** mlavalle has joined #openstack-nova15:17
*** belmoreira has quit IRC15:25
*** mkrai has joined #openstack-nova15:37
*** psachin has quit IRC15:41
*** jangutter_ has joined #openstack-nova15:46
*** jangutter has quit IRC15:50
artommelwitt, if you're online already, could you give https://review.opendev.org/#/c/743710/5 a look? It's blocking a bugfix on top15:51
*** mgariepy has quit IRC16:05
*** sapd1 has joined #openstack-nova16:06
*** hamalq has joined #openstack-nova16:10
*** hamalq_ has joined #openstack-nova16:11
*** hamalq has quit IRC16:16
*** tesseract has quit IRC16:20
*** hamalq_ has quit IRC16:29
*** hamalq has joined #openstack-nova16:30
*** udesale_ has quit IRC16:34
*** zzzeek has quit IRC16:47
*** tosky has quit IRC16:59
sean-k-mooneyalex_xu: maybe you could take a look at the patch artom linked above ^ https://review.opendev.org/#/c/743710/516:59
sean-k-mooneyif melwitt is not about16:59
sean-k-mooneyits pretty small and would be nice to get landed to unblock the other17:00
*** k_mouza has joined #openstack-nova17:04
*** mgariepy has joined #openstack-nova17:06
*** sapd1 has quit IRC17:07
*** k_mouza has quit IRC17:09
*** JamesBen_ has joined #openstack-nova17:14
*** mvorwerk has quit IRC17:14
*** JamesBenson has quit IRC17:14
*** aj_mailing has joined #openstack-nova17:15
*** mkrai has quit IRC17:19
melwittartom, sean-k-mooney: I can look if no one else gets to it first17:20
artommelwitt, cheers!17:20
*** hamalq has quit IRC17:31
lyarwoodsean-k-mooney: I'll look this evening17:37
*** maciejjozefczyk has joined #openstack-nova17:37
artomlyarwood, you can't, you're the author17:38
artomWith gibi and bauzas on PTO, melwitt and alex_xu are the only 2 cores who can +A it17:38
melwittand dansmith17:43
dansmithartom: ouch artom, ouch17:47
artomdansmith, not my fault you're off in 1/4 U2 land17:47
artomU0.517:47
lyarwoodartom: sorry I was talking about another patch17:53
artomlyarwood, whoops, apologies, here I go assuming stuff17:53
lyarwoodhttps://review.opendev.org/#/c/738432/17:53
artomdansmith, aww, thanks, you're bumped to U1 now ;)17:54
* dansmith scowls17:54
artomYou think I'm just going to stop making lame puns?17:56
*** jsuchome has quit IRC18:01
*** k_mouza has joined #openstack-nova18:23
*** mlavalle has quit IRC18:54
*** mlavalle has joined #openstack-nova18:54
*** nightmare_unreal has quit IRC19:03
openstackgerritMerged openstack/nova stable/queens: objects: Update keypairs when saving an instance  https://review.opendev.org/74327119:04
*** k_mouza has quit IRC19:20
*** k_mouza has joined #openstack-nova19:26
*** k_mouza has quit IRC19:26
*** k_mouza has joined #openstack-nova19:27
*** k_mouza has quit IRC19:32
*** mriedem has left #openstack-nova19:42
lyarwoodsean-k-mooney: http://paste.openstack.org/show/796745/  - getting this in a two node stable/queens env, any ideas?19:55
lyarwoodhttps://bugs.launchpad.net/os-vif/+bug/1749972 - of course I've hit this before lol19:55
openstackLaunchpad bug 1749972 in os-vif "`brctl setageing $bridge 0` fails on Ubuntu 16.04 4.4.0-21-generic" [Undecided,Invalid]19:55
lyarwoodvirt-builder is both awesome and a PITA sometimes19:56
* lyarwood updates and reboots19:56
openstackgerritMerged openstack/nova master: func: Introduce a server_expected_state kwarg to InstanceHelperMixin._live_migrate  https://review.opendev.org/74371019:57
*** gyee has joined #openstack-nova19:59
*** nweinber has quit IRC20:01
openstackgerritMerged openstack/nova master: Add regression test for bug 1879787  https://review.opendev.org/74123020:48
openstackbug 1879787 in OpenStack Compute (nova) "post_live_migration does not handle Neutron errors" [Medium,In progress] https://launchpad.net/bugs/1879787 - Assigned to Artom Lifshitz (notartom)20:48
*** openstackgerrit has quit IRC20:52
-openstackstatus- NOTICE: The openstackgerrit IRC bot (gerritbot) will be offline for a short period while we redeploy it on a new server20:52
*** vishalmanchanda has quit IRC21:14
*** raildo has quit IRC21:15
*** martinkennelly has quit IRC21:30
*** zzzeek has joined #openstack-nova21:38
*** ayoung has quit IRC21:48
*** ayoung has joined #openstack-nova21:49
*** slaweq has quit IRC21:51
sean-k-mooneylyarwood: just so its still on your list https://review.opendev.org/#/c/738432/ :)21:55
artomsean-k-mooney, FWIW it's on mine, I normally do reviews on Thursdays21:59
artom(yes, I've compartmentalized my week like that)21:59
artomTbh, it would help if the commit message was in better English :/21:59
sean-k-mooneyartom: cool but i would really like to get that merged before the end of the week22:00
artomNo shade on the original author, I realize writing commit messae (or anything, really), in a second language is hard22:00
artomsean-k-mooney, it's not your patch though... are you going to iterate on it?22:00
sean-k-mooneyif need but i want to get this downstream into 16.1 sooner rather then later22:01
sean-k-mooneyi have just been trying to get people to review22:01
sean-k-mooneyi tested the first verision but i need to retet the latest version22:01
*** ociuhandu_ has quit IRC22:05
*** maciejjozefczyk has quit IRC22:20
*** mlavalle has quit IRC22:30
*** gregwork has joined #openstack-nova22:45
*** rcernin has joined #openstack-nova22:45
*** tkajinam has joined #openstack-nova22:54
*** JamesBen_ has quit IRC23:01
*** JamesBenson has joined #openstack-nova23:04
*** logan- has quit IRC23:05
*** JamesBenson has quit IRC23:10
artomnova-grenade-multinode just failed twice in a row with apparently the same errors23:45

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!