Tuesday, 2021-04-27

« Monday, 2021-04-26 Index Wednesday, 2021-04-28 »
*** mlavalle has quit IRC00:01
*** luksky has quit IRC00:08
*** sapd1 has quit IRC00:37
*** zzzeek has quit IRC00:38
*** zzzeek has joined #openstack-nova00:39
*** __ministry has joined #openstack-nova01:15
*** sapd1 has joined #openstack-nova01:16
*** gyee has quit IRC01:22
*** whoami-rajat has joined #openstack-nova01:36
*** hamalq has quit IRC01:37
*** ricolin has quit IRC01:37
openstackgerritBrin Zhang proposed openstack/nova-specs master: Proposal for a safer remote console with password authentication  https://review.opendev.org/c/openstack/nova-specs/+/78811601:53
openstackgerritBrin Zhang proposed openstack/nova master: Replaces tenant_id with project_id from List/Update Servers APIs  https://review.opendev.org/c/openstack/nova/+/76429201:54
*** brinzhang_ has joined #openstack-nova02:09
*** brinzhang0 has quit IRC02:12
*** rcernin has quit IRC02:39
*** rcernin has joined #openstack-nova02:40
__ministryDear all02:41
__ministryI had met this error: https://bugs.launchpad.net/nova/+bug/189265902:41
openstackLaunchpad bug 1892659 in OpenStack Compute (nova) "aborted: Failed to allocate the network(s), not rescheduling" [Undecided,Expired]02:41
__ministryAnybody can help me to fix this?02:42
*** hemanth_n has joined #openstack-nova02:57
*** k_mouza has joined #openstack-nova02:59
*** k_mouza has quit IRC03:03
*** ircuser-1 has joined #openstack-nova03:50
*** k_mouza has joined #openstack-nova04:02
*** sapd1_x has joined #openstack-nova04:07
*** k_mouza has quit IRC04:07
*** supamatt has joined #openstack-nova04:08
*** ratailor has joined #openstack-nova04:33
*** LinPeiWen92 has quit IRC04:47
*** vishalmanchanda has joined #openstack-nova04:50
*** sapd1_x has quit IRC05:20
*** LinPeiWen has joined #openstack-nova05:34
*** slaweq has joined #openstack-nova05:52
*** luksky has joined #openstack-nova05:59
*** ralonsoh has joined #openstack-nova06:04
*** lpetrut has joined #openstack-nova06:11
*** swp20 has joined #openstack-nova06:43
openstackgerritBrin Zhang proposed openstack/nova master: Replaces tenant_id with project_id from List/Update Servers APIs  https://review.opendev.org/c/openstack/nova/+/76429206:43
openstackgerritBrin Zhang proposed openstack/nova master: Replace all_tenants with all_projects in List Server APIs  https://review.opendev.org/c/openstack/nova/+/76531106:43
*** dklyle has quit IRC06:55
*** damien_r has joined #openstack-nova07:09
*** andrewbonney has joined #openstack-nova07:15
gibi__ministry: hi! have you followed the pointers / questions in the comment of that bug report?07:24
__ministryoh, this bug not reported by me. I will follow log to see more, thank you.07:27
gibi__ministry: those questions there might help you figuring out what went wrong07:27
__ministrygibi: yes, I was trying config neutron-api with rpc_response_time options, because bug not appear always, I doing monitor this bug.07:30
*** martinkennelly has joined #openstack-nova07:31
*** jobewan has quit IRC07:33
*** tosky has joined #openstack-nova07:41
*** ricolin has joined #openstack-nova07:43
*** rpittau|afk is now known as rpittau07:45
*** ociuhandu has joined #openstack-nova07:48
sean-k-mooneylbragstad: it uses ksa directly also because we were trying to move to it before the openstack sdk was really a thing07:52
sean-k-mooneylbragstad: we can move to neutorn client now and stephenfin has patches to move it i belive. i would prefer us to move to the sdk but i dont really see an issue in using ksa directly07:53
*** ratailor_ has joined #openstack-nova07:53
*** ratailor has quit IRC07:55
*** ociuhandu has quit IRC07:58
*** lucasagomes has joined #openstack-nova08:04
*** rcernin has quit IRC08:08
*** ociuhandu has joined #openstack-nova08:17
*** jobewan has joined #openstack-nova08:20
*** ratailor__ has joined #openstack-nova08:25
*** ratailor_ has quit IRC08:27
*** dtantsur|afk is now known as dtantsur08:30
*** ociuhandu has quit IRC08:37
openstackgerritBrin Zhang proposed openstack/nova master: Replaces tenant_id with project_id from Rebuild Server API  https://review.opendev.org/c/openstack/nova/+/76638008:40
*** ociuhandu has joined #openstack-nova08:41
*** rcernin has joined #openstack-nova08:45
*** sapd1_x has joined #openstack-nova09:00
openstackgerritStephen Finucane proposed openstack/nova master: mypy: Add type annotations to 'nova.pci'  https://review.opendev.org/c/openstack/nova/+/67620909:16
openstackgerritStephen Finucane proposed openstack/nova master: mypy: Add nova.cmd, nova.conf, nova.console  https://review.opendev.org/c/openstack/nova/+/70565709:16
openstackgerritStephen Finucane proposed openstack/nova master: mypy: Add type annotations to top-level modules  https://review.opendev.org/c/openstack/nova/+/70565809:16
openstackgerritStephen Finucane proposed openstack/nova master: trivial: Clean manager.Manager, service.Service signatures  https://review.opendev.org/c/openstack/nova/+/76480609:16
*** yoctozepto4 has joined #openstack-nova09:26
*** yoctozepto has quit IRC09:26
*** yoctozepto4 is now known as yoctozepto09:26
*** rcernin has quit IRC09:46
openstackgerritXinran WANG proposed openstack/nova-specs master: Repropose smartnic support spec  https://review.opendev.org/c/openstack/nova-specs/+/78363210:03
*** rcernin has joined #openstack-nova10:04
*** rcernin has quit IRC10:18
openstackgerritDaniel Bengtsson proposed openstack/nova master: Use the new type HostDomainOpt.  https://review.opendev.org/c/openstack/nova/+/78824010:20
*** ociuhandu has quit IRC10:23
*** ociuhandu has joined #openstack-nova10:24
*** k_mouza has joined #openstack-nova10:27
*** ociuhandu has quit IRC10:28
*** tesseract has joined #openstack-nova10:47
*** rcernin has joined #openstack-nova10:50
openstackgerritBalazs Gibizer proposed openstack/nova-specs master: Allow provider re-parenting in placement  https://review.opendev.org/c/openstack/nova-specs/+/78824310:54
*** ociuhandu has joined #openstack-nova10:54
gibibauzas: ^^ I've moved the proposal from the storyboard to a nova spec for review. I've added the saferty mechanism altenratives to the spec. If you have time please check it. I have problems with the PATCH way too10:55
*** ociuhandu has quit IRC11:01
*** dtantsur is now known as dtantsur|brb11:03
*** macz_ has joined #openstack-nova11:24
*** macz_ has quit IRC11:28
*** ociuhandu has joined #openstack-nova11:29
*** ociuhandu has quit IRC11:33
*** ociuhandu has joined #openstack-nova11:45
*** sapd1_x has quit IRC11:46
*** __ministry has quit IRC11:49
*** ociuhandu has quit IRC11:50
*** ociuhandu has joined #openstack-nova12:01
*** ociuhandu has quit IRC12:06
openstackgerritBalazs Gibizer proposed openstack/placement master: Add support for RP re-parenting and orphaning  https://review.opendev.org/c/openstack/placement/+/78402012:10
*** hemanth_n has quit IRC12:12
*** damien_r has quit IRC12:12
*** damien_r has joined #openstack-nova12:16
*** tkajinam has quit IRC12:18
*** tkajinam has joined #openstack-nova12:18
*** ociuhandu has joined #openstack-nova12:18
*** damien_r has quit IRC12:22
*** tkajinam has quit IRC12:24
*** tkajinam has joined #openstack-nova12:25
*** ociuhandu has quit IRC12:26
*** damien_r has joined #openstack-nova12:28
bauzasgibi: ack, will look12:30
gibibauzas: thansk12:30
*** macz_ has joined #openstack-nova12:37
*** rcernin has quit IRC12:41
*** macz_ has quit IRC12:42
fricklerhas anyone seen the situation where nova-compute logs "Migration running for 0 secs, memory 100% remaining; (bytes processed=0, remaining=0, total=0)" and then goes on with that for days? usually these byte counts should be > 0, possibly some libvirt bug?12:45
*** damien_r has quit IRC12:52
*** xek_ has joined #openstack-nova12:53
sean-k-mooneyfrickler: we have seen that in the past12:53
*** dtantsur|brb is now known as dtantsur12:54
*** ociuhandu has joined #openstack-nova12:54
*** tbarron has left #openstack-nova12:54
sean-k-mooneyi cant recall what was the cause but i know the env had rabbitmq issuues and network issues12:55
*** xek has quit IRC12:56
sean-k-mooneyfrickler: the first message by the way is normally  (bytes processed=0, remaining=0, total=0)12:58
*** macz_ has joined #openstack-nova12:58
sean-k-mooneythen it get updated when the migration actully starts12:58
sean-k-mooney2018-04-16 20:46:31.747 767495 INFO nova.virt.libvirt.driver [req-7af65a7d-9d61-4b4b-955d-07d7791b18ac 13515e05a63e48e0b9adb991b250c5f7 8bc196f362b442a4891986517b60389c - - -] [instance: e9c1de25-daa8-43f6-b9b8-a909c19255d9] Migration running for 0 secs, memory 100% remaining; (bytes processed=0, remaining=0, total=0)12:59
sean-k-mooney2018-04-16 20:46:37.422 767495 DEBUG nova.virt.libvirt.driver [req-7af65a7d-9d61-4b4b-955d-07d7791b18ac 13515e05a63e48e0b9adb991b250c5f7 8bc196f362b442a4891986517b60389c - - -] [instance: e9c1de25-daa8-43f6-b9b8-a909c19255d9] Migration running for 5 secs, memory 100% remaining; (bytes processed=0, remaining=0, total=0) _live_migration_monitor12:59
sean-k-mooney/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py:642812:59
sean-k-mooney2018-04-16 20:46:43.713 767495 DEBUG nova.virt.libvirt.driver [req-7af65a7d-9d61-4b4b-955d-07d7791b18ac 13515e05a63e48e0b9adb991b250c5f7 8bc196f362b442a4891986517b60389c - - -] [instance: e9c1de25-daa8-43f6-b9b8-a909c19255d9] Migration running for 10 secs, memory 0% remaining; (bytes processed=387830565, remaining=0, total=4312604672) _live_migration_monitor12:59
sean-k-mooney/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py:642812:59
sean-k-mooneylike htat12:59
fricklerin my case, it stays the same for 80000 seconds or so now, migration not finishing at all13:00
sean-k-mooneyfrickler: do you happen to have ceph?13:01
fricklersean-k-mooney: for volume storage, yes. root disk is local13:01
sean-k-mooneythat was form https://bugzilla.redhat.com/show_bug.cgi?id=156672313:01
openstackbugzilla.redhat.com bug 1566723 in RBD "Instance live migration times out after <x> seconds with nova - doesn't copy instance memory" [High,Closed: errata] - Assigned to jdillama13:01
*** ociuhandu has quit IRC13:02
*** macz_ has quit IRC13:02
sean-k-mooneyfrickler: apparently restarting OSDs durign the migration could cause locking issues in librbd in the past13:03
frickleroh, I can check whether this is actually a boot-from-volume instance13:03
*** damien_r has joined #openstack-nova13:03
sean-k-mooneyfrickler: there is also https://bugs.launchpad.net/nova/+bug/158314513:04
openstackLaunchpad bug 1644248 in OpenStack Compute (nova) "duplicate for #1583145 Nova incorrectly tracks live migration progress" [High,Fix released]13:04
sean-k-mooneyoh the other one is fixed13:04
sean-k-mooneyhttps://bugs.launchpad.net/nova/+bug/164424813:04
openstackLaunchpad bug 1644248 in OpenStack Compute (nova) "Nova incorrectly tracks live migration progress" [High,Fix released]13:04
*** ratailor__ has quit IRC13:09
sean-k-mooneybauzas: gibi lyarwood  if we were to impleemnte the generic nova manage command for updating image metadata13:18
sean-k-mooneyhow would ye feel about backpoarting hat13:18
sean-k-mooney*that13:18
sean-k-mooneyelod: any tought form a stable core perspective13:18
sean-k-mooneycontext is we have a custoemr downstream that really want to fix a few instance by adding os-type=windows to the inatnce that were booted before they fixed there windows images13:19
sean-k-mooneyand today they will have to do a manual db update to do that13:20
sean-k-mooneythen live/cold migrate teh inststances so they land up in the correct host aggrate after13:20
*** ociuhandu has joined #openstack-nova13:21
bauzassean-k-mooney: in general, we don't accept to backport features like this13:21
bauzas(upstream)13:21
sean-k-mooneybauzas: in general but we have backported nova-manage command on the bases it resolved operator pain in the past13:22
sean-k-mooneylike the heal allocations ones13:22
*** tkajinam has quit IRC13:27
*** tkajinam has joined #openstack-nova13:27
bauzassean-k-mooney: yup, because it's a bugfix13:28
bauzasbut fwiw, we abandoned the backports for the placement audit https://review.opendev.org/q/I537ed74503d208957f0a97af3ab754a6750dac2013:29
*** sapd1_x has joined #openstack-nova13:30
elodsean-k-mooney: bauzas is right: in general, we don't accept to backport features like this13:41
fricklersean-k-mooney: turns out this migration was in status "queued", being held up by another one in progress that is having trouble getting the disk synced, seems I didn't look close enough there. thanks for your help anyway13:43
sean-k-mooneyfrickler: glad you figured it out13:43
sean-k-mooneyelod: bauzas yep i know and in general we do not allow custoemr to do db udate eitehr. i dont partically want to do a downstream only backport of that feature. i think it would be generic useful but if we do not want to backport it that is fine13:45
*** k_mouza has quit IRC13:46
*** lpetrut has quit IRC14:00
*** tesseract has quit IRC14:00
elodsean-k-mooney: well, according to policy, there could be exceptions. I still tend to say no for this backport (though I haven't seen the implementation)14:09
elodexception* -- if stable cores agree...14:10
sean-k-mooneyelod: its not written yet :)14:10
sean-k-mooneyelod: it would be https://review.opendev.org/c/openstack/nova/+/774896/8/nova/cmd/manage.py excpet instead of setting just machine_type you could set any image metatadata value that does not chagne resouce usage14:12
sean-k-mooneyelod: anyway its fine i was going to say if it was short to implement and contovertial then maybe instead of deliving a custom sql srcript we could implement this and backport it for our customer to use14:13
*** k_mouza has joined #openstack-nova14:17
gibielod, sean-k-mooney: we discussed backport nova-manage "feature" in the past. Like heal allocation. It is useful, it is self contained in mostly in the manage.py and it is not impacting any of our public APIs14:19
gibiso it is pretty safe to backport14:19
gibiI was lazy and did not backported the port allocation part of the heal allocation command to stable but we did agreed with mriedem in the past that that could happen14:19
gibialso I'm supporting to backporting thigs that helps avoiding the need of direct and manual db update14:20
gibinobody likes customer bugs where the db was manually changed for some reason and it caused inconsitencies14:21
*** k_mouza has quit IRC14:22
elodin that case... if it really is as gibi says, and the implementation looks OK in the sense of backportability... then so be it :]14:25
elodif there are no objections from other stable cores14:26
gibi:)14:26
gibiI can be pretty convincing :)14:27
sean-k-mooneywell we need to write it and get project core to agree on it first.14:37
sean-k-mooneyjust wondering if we should plan to make it backportable when writing it or not basically and if there was apite to backport it at all14:38
*** dklyle has joined #openstack-nova14:58
*** k_mouza has joined #openstack-nova15:01
*** k_mouza has quit IRC15:05
*** sorrison has quit IRC15:06
*** sorrison has joined #openstack-nova15:08
*** mlavalle has joined #openstack-nova15:08
*** k_mouza has joined #openstack-nova15:18
*** macz_ has joined #openstack-nova15:21
*** smcginni1 is now known as smcginnis15:24
openstackgerritJessie Lass proposed openstack/nova master: Add emulation support if host arch != guest arch.  https://review.opendev.org/c/openstack/nova/+/77215615:33
*** ociuhandu has quit IRC15:43
gibimelwitt: hi! I have left comments in the consumer_type patch series.15:52
*** mlavalle has quit IRC15:53
gibiif you like them then I might as a favor to look at my RP re-parenting spec / impl :)15:57
sean-k-mooneyspeaking of placemnt there is no resource provider allocation candiate create command in osc-placment15:58
sean-k-mooneyit might be nice to have one for debuging15:58
sean-k-mooneygranted we can use curl pretty simply but was debuging something there and it would have been nice to have15:59
gibisean-k-mooney: I think we have openstack --os-placement-api-version 1.29 allocation candidate list16:01
sean-k-mooneyoh cool16:02
sean-k-mooneythis is a train version of osc-placment16:02
sean-k-mooneyso i guess its jsut a little too old for that16:02
gibicould be a newer addition I dont know16:02
sean-k-mooneyya max api verion i have is 1.2216:02
gibiI just plugged 1.29 in my case as that is the max I think16:06
gibiyou don't need 1.29 support for ac query, it only need 1.1016:07
*** lucasagomes has quit IRC16:12
*** ociuhandu has joined #openstack-nova16:13
*** jamesden_ has joined #openstack-nova16:21
*** jamesdenton has quit IRC16:22
*** ociuhandu has quit IRC16:27
*** ociuhandu has joined #openstack-nova16:29
*** gyee has joined #openstack-nova16:30
*** rpittau is now known as rpittau|afk16:33
*** ociuhandu_ has joined #openstack-nova16:34
*** ociuhandu has quit IRC16:38
*** ociuhandu_ has quit IRC16:39
*** dtantsur is now known as dtantsur|afk17:05
*** andrewbonney has quit IRC17:05
openstackgerritMerged openstack/nova stable/victoria: Centralize sqlite FK constraint enforcement  https://review.opendev.org/c/openstack/nova/+/78506717:06
openstackgerritMerged openstack/nova stable/victoria: Add functional test for bug 1837995  https://review.opendev.org/c/openstack/nova/+/78506817:07
openstackbug 1837995 in OpenStack Compute (nova) ""Unexpected API Error" when use "openstack usage show" command" [Undecided,In progress] https://launchpad.net/bugs/1837995 - Assigned to melanie witt (melwitt)17:07
*** mlavalle has joined #openstack-nova17:27
*** hamalq has joined #openstack-nova17:53
*** hamalq has quit IRC17:54
*** hamalq has joined #openstack-nova17:54
*** vishalmanchanda has quit IRC18:14
*** valleedelisle has joined #openstack-nova18:22
openstackgerritMerged openstack/nova stable/victoria: Dynamically archive FK related records in archive_deleted_rows  https://review.opendev.org/c/openstack/nova/+/78506918:23
*** dtantsur has joined #openstack-nova18:25
*** dtantsur|afk has quit IRC18:28
*** _dvd has quit IRC18:29
*** openstackstatus has quit IRC18:31
*** openstackstatus has joined #openstack-nova18:33
*** ChanServ sets mode: +v openstackstatus18:33
*** lbragstad has quit IRC19:17
*** lbragstad has joined #openstack-nova19:30
openstackgerritLee Yarwood proposed openstack/nova stable/ussuri: Update image_base_image_ref during rebuild.  https://review.opendev.org/c/openstack/nova/+/78794319:32
*** ralonsoh has quit IRC19:37
openstackgerritLee Yarwood proposed openstack/nova stable/train: Make _rebase_with_qemu_img() generic  https://review.opendev.org/c/openstack/nova/+/78078219:52
openstackgerritLee Yarwood proposed openstack/nova stable/train: Rebase qcow2 images when unshelving an instance  https://review.opendev.org/c/openstack/nova/+/78562719:52
openstackgerritLee Yarwood proposed openstack/nova stable/train: Update image_base_image_ref during rebuild.  https://review.opendev.org/c/openstack/nova/+/78794519:53
openstackgerritLee Yarwood proposed openstack/nova stable/train: Update image_base_image_ref during rebuild.  https://review.opendev.org/c/openstack/nova/+/78794519:58
*** rcernin has joined #openstack-nova20:30
*** damien_r has quit IRC21:01
openstackgerritmelanie witt proposed openstack/nova stable/victoria: Initialize global data separately and run_once in WSGI app init  https://review.opendev.org/c/openstack/nova/+/78506021:07
*** whoami-rajat has quit IRC21:09
*** slaweq has quit IRC21:22
*** rcernin has quit IRC21:22
*** rcernin has joined #openstack-nova21:40
*** lbragstad has quit IRC21:46
*** rcernin has quit IRC21:46
*** rcernin has joined #openstack-nova22:00
*** macz_ has quit IRC22:03
*** rcernin has quit IRC22:07
*** rcernin has joined #openstack-nova22:16
*** macz_ has joined #openstack-nova22:28
*** macz_ has quit IRC22:33
*** luksky has quit IRC22:34
*** lbragstad has joined #openstack-nova22:39
*** rcernin has quit IRC22:47
*** rcernin has joined #openstack-nova22:50
*** rcernin has quit IRC22:50
*** rcernin has joined #openstack-nova22:51
*** tosky has quit IRC23:08
*** martinkennelly has quit IRC23:30
*** mlavalle has quit IRC23:51
*** rcernin has quit IRC23:54
« Monday, 2021-04-26 Index Wednesday, 2021-04-28 »

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!