Friday, 2021-02-05

« Thursday, 2021-02-04 Index Saturday, 2021-02-06 »
*** zzzeek has quit IRC00:01
*** zzzeek has joined #openstack-nova00:02
openstackgerritMerged openstack/nova stable/train: Use cell targeted context to query BDMs for metadata  https://review.opendev.org/c/openstack/nova/+/77140700:12
*** kukacz has quit IRC00:14
*** kukacz has joined #openstack-nova00:20
*** Underknowledge has quit IRC00:23
*** Underknowledge has joined #openstack-nova00:24
*** tosky has quit IRC00:27
openstackgerritArtom Lifshitz proposed openstack/nova master: WIP: libvirt: start tracking NUMACell.socket for hosts  https://review.opendev.org/c/openstack/nova/+/76681600:28
openstackgerritArtom Lifshitz proposed openstack/nova master: WIP: extra specs/image pros: add `socket` PCI NUMA affinity  https://review.opendev.org/c/openstack/nova/+/77274800:28
openstackgerritArtom Lifshitz proposed openstack/nova master: WIP: Add `socket` PCI NUMA affinity policy request prefilter  https://review.opendev.org/c/openstack/nova/+/77274900:28
openstackgerritArtom Lifshitz proposed openstack/nova master: WIP: Track host NUMA topology in PCI manager  https://review.opendev.org/c/openstack/nova/+/77414900:28
openstackgerritArtom Lifshitz proposed openstack/nova master: WIP: pci: implement the `socket` NUMA affinity policy  https://review.opendev.org/c/openstack/nova/+/77277900:28
*** jangutter has quit IRC00:37
*** jangutter has joined #openstack-nova00:38
*** pmannidi has quit IRC00:40
*** pmannidi has joined #openstack-nova00:42
*** dviroel has quit IRC00:50
*** songwenping__ has joined #openstack-nova01:18
*** songwenping_ has quit IRC01:21
*** LinPeiWen has joined #openstack-nova01:24
*** zzzeek has quit IRC01:33
*** zzzeek has joined #openstack-nova01:34
openstackgerritMerged openstack/nova master: hyperv: Configures chassis asset tags for VMs.  https://review.opendev.org/c/openstack/nova/+/75272301:38
*** spatel has joined #openstack-nova01:44
*** zzzeek has quit IRC01:45
*** zzzeek has joined #openstack-nova01:48
*** pmannidi has quit IRC01:56
*** zzzeek has quit IRC01:57
*** pmannidi has joined #openstack-nova01:58
openstackgerritMerged openstack/nova stable/ussuri: Reproduce bug 1907522 in functional test  https://review.opendev.org/c/openstack/nova/+/77393001:59
openstackbug 1907522 in OpenStack Compute (nova) ussuri "test_*_with_qos_min_bw_allocation fails in the nova-multi-cell job with: nova.exception.MigrationPreCheckError: Migration pre-check error: Failed to create port bindings for host <host>" [Medium,In progress] https://launchpad.net/bugs/1907522 - Assigned to Balazs Gibizer (balazs-gibizer)01:59
*** zzzeek has joined #openstack-nova01:59
*** dasp has quit IRC02:04
*** hamalq has quit IRC02:14
*** haleyb has quit IRC02:18
*** haleyb has joined #openstack-nova02:19
*** dasp has joined #openstack-nova02:32
*** lbragstad has quit IRC02:35
*** pmannidi has quit IRC03:02
*** pmannidi has joined #openstack-nova03:04
*** songwenping__ has quit IRC03:15
*** lbragstad has joined #openstack-nova03:15
*** songwenping__ has joined #openstack-nova03:15
*** mkrai has joined #openstack-nova03:18
*** rcernin has quit IRC03:24
*** brinzhang_ has quit IRC03:26
*** rcernin has joined #openstack-nova03:27
*** khomesh24 has joined #openstack-nova03:33
*** Underknowledge has quit IRC03:33
*** Underknowledge2 has joined #openstack-nova03:33
*** Underknowledge2 is now known as Underknowledge03:34
*** hemanth_n has joined #openstack-nova03:35
*** brinzhang_ has joined #openstack-nova03:35
*** pmannidi has quit IRC03:43
*** tbachman has quit IRC03:51
*** tbachman_ has joined #openstack-nova03:51
*** zzzeek has quit IRC04:08
*** zzzeek has joined #openstack-nova04:09
openstackgerritMerged openstack/nova master: Fix ForbiddenWithAccelerators to HTTPForbidden for shelve API  https://review.opendev.org/c/openstack/nova/+/77000704:13
openstackgerritMerged openstack/nova master: pci: Improve testing of 'nova.pci.request' module  https://review.opendev.org/c/openstack/nova/+/76444604:14
*** ratailor has joined #openstack-nova04:57
*** amodi has quit IRC05:05
*** songwenping__ has quit IRC05:09
*** songwenping__ has joined #openstack-nova05:10
*** hack-char has quit IRC05:35
*** hack-char has joined #openstack-nova05:37
*** mkrai has quit IRC05:37
*** mkrai has joined #openstack-nova05:37
*** vishalmanchanda has joined #openstack-nova05:38
openstackgerritMerged openstack/nova stable/ussuri: Set instance host and drop migration under lock  https://review.opendev.org/c/openstack/nova/+/77076905:42
openstackgerritKhomesh Thakre proposed openstack/nova master: api: Reject requests to reset the state of SHELVE_OFFLOADED servers  https://review.opendev.org/c/openstack/nova/+/77323806:01
*** spatel has quit IRC06:36
openstackgerritWenping Song proposed openstack/nova master: Replaces tenant_id with project_id from List/Show usage APIs  https://review.opendev.org/c/openstack/nova/+/76850906:40
openstackgerritWenping Song proposed openstack/nova master: Replace tenants* with projects* of policies  https://review.opendev.org/c/openstack/nova/+/76531506:40
openstackgerritWenping Song proposed openstack/nova master: Replace os-simple-tenant-usage with os-simple-project-usage  https://review.opendev.org/c/openstack/nova/+/76885206:40
*** slaweq has joined #openstack-nova07:02
*** mkrai has quit IRC07:10
*** lpetrut has joined #openstack-nova07:17
*** songwenping__ has quit IRC07:20
*** khomesh24 has quit IRC07:41
*** alexe9191 has joined #openstack-nova07:46
*** rpittau|afk is now known as rpittau07:57
*** rcernin has quit IRC07:57
*** vesper11 has joined #openstack-nova07:58
*** ralonsoh has joined #openstack-nova08:02
*** rcernin has joined #openstack-nova08:14
*** xek has joined #openstack-nova08:14
*** tesseract has joined #openstack-nova08:16
*** andrewbonney has joined #openstack-nova08:18
openstackgerritWenping Song proposed openstack/nova master: Nova supports password encrypted VNC  https://review.opendev.org/c/openstack/nova/+/62233608:18
*** rcernin has quit IRC08:19
alexe9191Good day everyone, is there an issue anyone aware of in OpenStack rocky in the scheduler? it seems to think that some of my hosts belong to the nova AZ, while nova-api is reporting that they are in a different zone.08:23
*** rcernin has joined #openstack-nova08:26
*** vesper11 has quit IRC08:30
*** jangutter has quit IRC08:32
*** rcernin has quit IRC08:32
*** mkrai has joined #openstack-nova08:36
*** tosky has joined #openstack-nova08:41
*** dklyle has quit IRC08:41
*** rcernin has joined #openstack-nova08:44
alexe9191somehow removing one host of the aggregate and re-adding it fixed the problem for the whole aggregate. I think there is some kind of a update all mechanism when adding/removing hosts to aggregates.08:49
*** rcernin has quit IRC08:50
*** mgoddard has quit IRC08:51
*** mgoddard has joined #openstack-nova08:51
bauzasalexe9191: have you named an aggregate with a 'nova' name for its AZ ?08:54
alexe9191no08:55
alexe9191that's the default one08:55
bauzasI mean, is there an aggregate having a metadata value for AZ being "nova" ?08:55
bauzask08:55
alexe9191nop08:55
bauzashttps://docs.openstack.org/nova/stein/user/aggregates.html#availability-zones-azs08:55
alexe9191could be that at some certain point someone did something and just renamed it later without updating the aggregates..,,08:55
bauzashmmm08:56
bauzasnot sure, since the API verifies whether there are instances08:56
alexe9191the api was reporting that the host is in the correct az08:56
alexe9191nova service-list | grep host08:56
alexe9191showed the correct values08:56
bauzasare you sure the API is correct ?08:56
bauzasack ok08:57
alexe9191the scheduler was not though...08:57
alexe9191also in the DB the mapping between the host and it's aggregate was also correct08:57
bauzasalexe9191: how do you know the scheduler was wrong, then ?08:57
alexe9191the scheduler was saying that host X is in AZ: nova08:57
alexe9191which is wrong08:57
alexe9191cause it's not08:57
bauzaswhen ?08:57
bauzasthe AZFilter, you mean ?08:58
alexe9191when trying to build a machine, the AZfilter08:58
alexe9191yes08:58
alexe9191        metadata = utils.aggregate_metadata_get_by_host(08:58
alexe9191                host_state, key='availability_zone')08:58
alexe9191        if 'availability_zone' in metadata:08:58
alexe9191            hosts_passes = availability_zone in metadata['availability_zone']08:58
alexe9191            host_az = metadata['availability_zone']08:58
alexe9191        else:08:58
alexe9191            hosts_passes = availability_zone == CONF.default_availability_zone08:58
alexe9191            host_az = CONF.default_availability_zone08:58
alexe9191        if not hosts_passes:08:58
alexe9191            LOG.debug("Availability Zone '%(az)s' requested. "08:58
alexe9191                      "%(host_state)s has AZs: %(host_az)s",08:58
alexe9191                      {'host_state': host_state,08:58
alexe9191                       'az': availability_zone,08:58
alexe9191                       'host_az': host_az})08:58
alexe9191ow sorry, I should've used spwan my apologies08:58
bauzasby Rocky, we now have a placement prefilter for AZs08:59
alexe9191Indeed:)  We are gonna switch to that08:59
bauzasyou could use it08:59
bauzasand verify whether it works08:59
alexe9191well not it does, i removed ONE host from the aggregate and re-added it08:59
bauzasthat being said, I don't know why the filter wouldn't work09:00
alexe9191and that solved the problem for all the hosts being wrongly reported in nova AZ09:00
*** rcernin has joined #openstack-nova09:01
*** rcernin has quit IRC09:06
openstackgerritWenping Song proposed openstack/nova master: Replaces tenant_id with project_id from List/Show usage APIs  https://review.opendev.org/c/openstack/nova/+/76850909:07
openstackgerritWenping Song proposed openstack/nova master: Replace tenants* with projects* of policies  https://review.opendev.org/c/openstack/nova/+/76531509:07
*** jangutter has joined #openstack-nova09:10
brinzhang_gmann: I am updating the os-simple-project-usage patch https://review.opendev.org/c/openstack/nova/+/768852, could you please help to review why the test cannot request the 2.90 version after I register the router with a new class?09:13
brinzhang_gmann: the test case in https://review.opendev.org/c/openstack/nova/+/768852/9/nova/tests/unit/api/openstack/compute/test_simple_project_usage.py#68109:15
*** ociuhandu has joined #openstack-nova09:21
*** ociuhandu has quit IRC09:22
*** ociuhandu has joined #openstack-nova09:23
*** nightmare_unreal has joined #openstack-nova09:27
*** rcernin has joined #openstack-nova09:27
*** jangutter_ has joined #openstack-nova09:29
*** derekh has joined #openstack-nova09:32
*** ociuhandu has quit IRC09:33
*** jangutter has quit IRC09:33
*** jangutter has joined #openstack-nova09:39
*** ociuhandu has joined #openstack-nova09:40
*** ociuhandu has quit IRC09:40
*** jangutter_ has quit IRC09:41
*** ociuhandu has joined #openstack-nova09:41
*** rcernin has quit IRC09:43
*** dtantsur|afk is now known as dtantsur10:01
*** brinzhang_ has quit IRC10:08
*** mkrai has quit IRC10:09
*** ociuhandu has quit IRC10:18
*** rcernin has joined #openstack-nova10:19
*** rcernin has quit IRC10:21
*** ociuhandu has joined #openstack-nova10:29
*** ociuhandu has quit IRC10:31
*** ociuhandu has joined #openstack-nova10:31
openstackgerritElod Illes proposed openstack/nova master: WIP: Tool to list launchpad bug status  https://review.opendev.org/c/openstack/nova/+/77422310:38
openstackgerritSylvain Bauza proposed openstack/nova master: Add a routed networks scheduler pre-filter  https://review.opendev.org/c/openstack/nova/+/74906810:42
openstackgerritSylvain Bauza proposed openstack/nova master: Add a routed networks scheduler pre-filter  https://review.opendev.org/c/openstack/nova/+/74906810:42
bauzasgibi: sean-k-mooney: finally done ^10:42
* bauzas goes running10:42
*** hemanth_n has quit IRC10:52
*** dviroel has joined #openstack-nova10:57
*** alexe9191 has quit IRC11:06
gibibauzas: ack, added to my queue11:10
*** k_mouza has joined #openstack-nova11:23
*** jangutter has quit IRC11:24
*** jangutter has joined #openstack-nova11:24
*** jangutter has quit IRC11:29
*** jangutter has joined #openstack-nova11:30
*** tbachman_ has quit IRC11:30
*** tbachman has joined #openstack-nova11:37
*** ociuhandu has quit IRC11:45
*** ociuhandu has joined #openstack-nova12:00
*** ociuhandu has quit IRC12:06
*** ociuhandu has joined #openstack-nova12:14
*** zul has joined #openstack-nova12:15
sean-k-mooneybauzas: nice ill review it today12:15
*** ociuhandu has quit IRC12:18
*** ociuhandu has joined #openstack-nova12:19
*** ociuhandu has quit IRC12:19
*** ociuhandu has joined #openstack-nova12:20
*** ociuhandu has quit IRC12:25
*** ociuhandu has joined #openstack-nova12:31
*** ociuhandu has quit IRC12:35
*** artom has joined #openstack-nova12:37
*** ociuhandu has joined #openstack-nova12:46
*** ociuhandu has quit IRC12:53
*** lbragstad_ has joined #openstack-nova12:56
*** lbragstad has quit IRC12:56
*** ociuhandu has joined #openstack-nova13:03
*** ociuhandu has quit IRC13:03
*** ociuhandu has joined #openstack-nova13:04
*** ratailor has quit IRC13:06
*** ociuhandu has quit IRC13:11
*** ociuhandu has joined #openstack-nova13:12
*** ociuhandu has quit IRC13:12
*** LinPeiWen has quit IRC13:17
*** ociuhandu has joined #openstack-nova13:20
*** ociuhandu has quit IRC13:24
*** ociuhandu has joined #openstack-nova13:37
openstackgerritKashyap Chamarthy proposed openstack/nova master: libvirt: Allow disabling CPU flags via `cpu_model_extra_flags`  https://review.opendev.org/c/openstack/nova/+/77424013:41
kashyapgibi (or anyone): --^ When you can, can you have a quick look of the above?  I'm not sure if I quite got the parsing right there13:46
*** ociuhandu has quit IRC13:47
*** spatel has joined #openstack-nova13:48
*** ociuhandu has joined #openstack-nova13:48
*** tkajinam has quit IRC13:50
*** zoharm has joined #openstack-nova13:54
*** ociuhandu has quit IRC13:55
*** ociuhandu has joined #openstack-nova13:57
*** whoami-rajat__ has joined #openstack-nova14:01
*** nweinber has joined #openstack-nova14:08
*** ociuhandu has quit IRC14:09
sean-k-mooneykashyap: that is not something we can really do at this point in the cycle14:15
sean-k-mooneykashyap: it requires a spec and we are well passed that point14:15
sean-k-mooneykashyap: there was an outstandign debate around support +/- syntax partly due to parsing issues with hypenated flags that may exists14:17
sean-k-mooneybut there was also concern about haveing to config options14:17
sean-k-mooneyits a somewhat small feature which if gibi and other were open to allowing as a specless blueprint we could psersue but we need to resolve the config opention issue first14:19
sean-k-mooneythe parsing is relitivly simple to fix since we also have it comma sperated so we just need to d a starts with check14:20
sean-k-mooneyso we can go with the +/- sysntax if we want too but just wanted to raise that old issue and the procedual point that technicaly we should not be adding feature now14:20
*** ociuhandu has joined #openstack-nova14:34
*** spatel has quit IRC14:35
kashyapsean-k-mooney: Spec?  WTF?14:40
kashyapsean-k-mooney: Spec is *really* overkill14:40
kashyapsean-k-mooney: I have an old blueprint; that more than suffices14:40
kashyaphttps://blueprints.launchpad.net/nova/+spec/allow-disabling-cpu-flags14:40
kashyapsean-k-mooney: Okay ... I was AFK, only now fully catching up.  You do say "specless blueprint"14:41
kashyapThat's good14:41
kashyapsean-k-mooney: The BP exists for more than a year14:41
kashyapsean-k-mooney: The startswith check is also there, of course.   Not sure if you've read the change14:42
kashyapsean-k-mooney: I can argue in good faith that this is also a bug-fix.  As it absolutely helps during upgrades for operators.14:43
kashyapsean-k-mooney: And what hyphenated flags are you talking about?  Example, please.  There are no hyphenated CPU flags14:44
*** k_mouza has quit IRC14:44
kashyapsean-k-mooney: The +/- syntax is the simplest way to go.14:44
*** k_mouza has joined #openstack-nova14:44
sean-k-mooneykashyap:correct right now  but this was discussed at the ptg many moons ago now and there was some disagrepmetn on that syntax14:44
sean-k-mooneyim not against it but we shoudl not assuem the kernel will not add hypenated cpu flags14:45
sean-k-mooneyits simple to supprot14:45
kashyapWhat's the disagreement?  I don't recall.  Please, let's keep things concrete14:45
kashyapsean-k-mooney: Indeed, it is simple.  I hope we don't get bogged down in the weeds14:45
sean-k-mooneyjust change flag = flag.strip('-') to flag = flag[1:]14:46
sean-k-mooneykashyap: the was a view expressed that deployment tools may prefer 2 config opitons instead of 114:46
kashyapLooking at your comments ...14:46
kashyapsean-k-mooney: Thanks for the quick review14:46
sean-k-mooneyif you do flag = flag[1:] it wont matter if the kernel adds hypeinated flags in the futrue. there are a number that have undercosres which is why im not sure they wont add ones with - https://unix.stackexchange.com/questions/43539/what-do-the-flags-in-proc-cpuinfo-mean14:48
* kashyap clicks14:48
*** artom has quit IRC14:48
sean-k-mooneyoh possible aes-ni14:49
sean-k-mooneyah no that is shortened to just ase14:51
sean-k-mooney*aes14:51
kashyapsean-k-mooney: Yep; note: strip(+) will strip it from the beginning and end.  *Not* from the middle14:52
* kashyap --> meetings :)14:52
sean-k-mooneyah it does have that limitation14:54
sean-k-mooneythat is different then other languages14:54
kashyapAnyway; can do the sliced index14:54
sean-k-mooneyhttps://docs.python.org/3/library/stdtypes.html#str.strip i was expectin git to work more like sub but i guess that makes sense i have used ti to strip leading and trailing whitespace before14:57
sean-k-mooneyand i knew it maintained that14:57
sean-k-mooneyby the way im not against implementing this i just want use to do the paperwork correctly14:57
sean-k-mooneyso basically add it to the adgendar for next weeks nova meeting and get the bp approved for wallby if the core team agrees14:58
*** artom has joined #openstack-nova15:00
gibikashyap, sean-k-mooney: yepp that bp needs an approval, but honestly it is pretty late in the cycle. we past M2 so if it is not super urgent to fix some bad situation somewhere then I don't think it fits in Wallaby. We have 18 approved bps and I think we will only have time to finish like maybe 2/3 of it15:01
kashyapgibi: It does fix a major problem15:02
kashyapgibi: I'll explain in a bit; running a meeting15:03
gibiis it a bug?15:03
gibiack15:03
*** lbragstad_ is now known as lbragstad15:03
sean-k-mooneygibi: a downtream one basically a kernel abi break15:06
sean-k-mooneythough it wont nessisarly fix it it just will help prevent new people form hitting it15:06
kashyapsean-k-mooney: Not just downstream15:06
kashyapAffects upstream too15:06
sean-k-mooneyto be clear this wont acutlly help improve upgrade without a vm reboot15:07
sean-k-mooneyanyway ya i should join that too15:07
sean-k-mooneythe call15:08
kashyapsean-k-mooney: It won't; but let's not get bogged down into details, please :)15:09
kashyapgibi: In short, that fix (which allows selectively disabling CPU flags) helps migrating instances from any Intel host that doesn't have "TSX" to a destination host that has "TSX"15:12
*** rpittau is now known as rpittau|afk15:17
gibikashyap: lets bring it up next week on the nova meeting. I will review your patch now. If next week we see that it has a positive review and close to merge then I can accept to approve the bp late and at the same time merge the code and forget all about it15:20
kashyapgibi: Thank you; sure.15:25
openstackgerritStephen Finucane proposed openstack/nova master: policy: Copy rules before providing them to enforcer  https://review.opendev.org/c/openstack/nova/+/77425215:31
stephenfingmann: ^15:31
stephenfinJust to be safe15:31
*** ociuhandu has quit IRC15:32
*** ociuhandu has joined #openstack-nova15:33
artomWait, is making a field nullable in an object mean a version bump?15:33
artomWait, no, ignore me15:33
*** ociuhandu has quit IRC15:38
*** dklyle has joined #openstack-nova15:40
*** nightmare_unreal has quit IRC15:45
sean-k-mooneygmann: is https://opendev.org/openstack/openstack-tempest-skiplist new?15:51
sean-k-mooneyi dont recall seeing this before i assuem we do not use it in nova?15:51
sean-k-mooneyah this is a ooo thing15:52
sean-k-mooneythats fine i was concerned that we would be skipping tests without knowing it just be cause ooo or another poejct hit an issue15:53
openstackgerritArtom Lifshitz proposed openstack/nova master: WIP: libvirt: start tracking NUMACell.socket for hosts  https://review.opendev.org/c/openstack/nova/+/76681615:54
openstackgerritArtom Lifshitz proposed openstack/nova master: WIP: extra specs/image pros: add `socket` PCI NUMA affinity  https://review.opendev.org/c/openstack/nova/+/77274815:54
openstackgerritArtom Lifshitz proposed openstack/nova master: WIP: Add `socket` PCI NUMA affinity policy request prefilter  https://review.opendev.org/c/openstack/nova/+/77274915:54
openstackgerritArtom Lifshitz proposed openstack/nova master: WIP: Track host NUMA topology in PCI manager  https://review.opendev.org/c/openstack/nova/+/77414915:54
openstackgerritArtom Lifshitz proposed openstack/nova master: WIP: pci: implement the `socket` NUMA affinity policy  https://review.opendev.org/c/openstack/nova/+/77277915:54
*** lpetrut has quit IRC15:57
*** ociuhandu has joined #openstack-nova16:00
*** ociuhandu has quit IRC16:00
*** ociuhandu has joined #openstack-nova16:01
*** ociuhandu has quit IRC16:05
*** ociuhandu has joined #openstack-nova16:06
*** ociuhandu has quit IRC16:06
*** ociuhandu_ has joined #openstack-nova16:06
*** martinkennelly has joined #openstack-nova16:11
*** macz_ has joined #openstack-nova16:15
*** tosky has quit IRC16:29
*** xek has quit IRC16:31
stephenfingmann: I removed that legacy PolicyFixture. 482 unit test failures. Haven't run functional tests yet. This is going to take some work :-)16:32
*** k_mouza_ has joined #openstack-nova16:36
*** nweinber has quit IRC16:36
*** k_mouza has quit IRC16:37
*** nweinber has joined #openstack-nova16:37
kashyapgibi: Thanks for the quick review.  Yes, let's talk on the Nova meeting week16:48
*** zoharm has quit IRC17:00
*** ociuhandu_ has quit IRC17:05
*** ociuhandu has joined #openstack-nova17:08
*** ociuhandu has quit IRC17:08
*** ralonsoh has quit IRC17:14
*** ociuhandu has joined #openstack-nova17:15
*** ociuhandu has quit IRC17:25
*** ociuhandu has joined #openstack-nova17:26
*** ociuhandu has quit IRC17:47
*** ociuhandu has joined #openstack-nova17:49
mnaseranyone know off the top of their head if you can specify volume type when using bfv (so nova creating the volume?)17:57
*** ociuhandu_ has joined #openstack-nova17:57
sean-k-mooneymnaser: via the block device mappings i think that came up at some point17:59
mnasersean-k-mooney: yeah, i'm looking at the code to see if that is currently possible17:59
mnaser> If you want to create a volume to a specific storage backend, you need to use an image which has cinder_img_volume_type property. In this case, a new volume will be created as storage_backend1 volume type.18:00
sean-k-mooneymnaser: we talked about it at the ptg but i cant recally if we said yes or not18:00
sean-k-mooneyi know we were relutant to support it as we did not want to keep proxing thigns to other services18:01
sean-k-mooneybut we may have allowed this18:01
stephenfinmnaser: yes, you can18:01
*** ociuhandu has quit IRC18:01
*** ociuhandu_ has quit IRC18:02
mnaser> Microversion 2.67 adds the optional parameter ``volume_type`` to block_device_mapping_v2, which can be used to specify ``volume_type`` when creating a server.18:02
mnaseraha!18:02
stephenfinmnaser: If you're using novaclient, you can pass the 'volume_type' key to the '--block-device' parameter18:03
stephenfin(of 'nova boot', of course)18:03
* stephenfin has a patch up to support that for OSC but it hasn't merged yet18:03
sean-k-mooneyhttps://specs.openstack.org/openstack/nova-specs/specs/stein/implemented/boot-instance-specific-storage-backend.html18:04
sean-k-mooneyadded in stien yes18:04
sean-k-mooneyyou can manually specifcy the bdms as a json blob too right?18:05
*** derekh has quit IRC18:05
sean-k-mooneyso you can use that to add it18:05
mnaserneat.  this cloud is running train so i can take advantage of it18:05
mnaserawesome, thank you so much stephenfin / sean-k-mooney :)18:05
sean-k-mooneyso openstack server create --block-device-mapping {stuff}18:06
*** dtantsur is now known as dtantsur|afk18:06
sean-k-mooneymnaser: im not sure the current osc suport will actully work but you can defeintl do it with nova clinet until stephenfin patch lands18:08
sean-k-mooneymnaser: https://review.opendev.org/c/openstack/python-openstackclient/+/77169918:10
*** k_mouza_ has quit IRC18:11
dansmithstephenfin: I'm seeing all your db rechecks because I'm subscribed to all of them and there are a bunch18:13
dansmithstephenfin: any hunch on what the common fails are18:13
dansmithI feel like I'm seeing a lot of cinder fails these days18:13
sean-k-mooneywe have some ocational issue with the ssh verifciaton in some of the cinder tests18:17
sean-k-mooneyalthough i have not seen any one test stand out to me that much18:18
dansmithare the ssh things specific to cinder tests? I didn't think so18:18
dansmithlately when I need to recheck it seems like it's always some volume-related test18:18
sean-k-mooneyi have noticed it on some of the volumn ones but i think that just a seperate issue18:18
dansmithusually related to not being able to delete a volume18:18
*** hoonetorg has quit IRC18:19
*** spatel has joined #openstack-nova18:20
sean-k-mooneyhttps://review.opendev.org/c/openstack/nova/+/769720 just fialed with image import18:20
sean-k-mooneyin the nova-ceph-multistore job18:21
sean-k-mooneyand it previously failed in gate with tempest.scenario.test_encrypted_cinder_volumes.TestEncryptedCinderVolumes18:21
dansmiththis one is a timeout18:22
*** hoonetorg has joined #openstack-nova18:22
sean-k-mooneywell not a job time out though so something falied but ya18:23
dansmithyes, job timeout18:23
dansmithstopped in the middle of an otherwise successful-looking tempest18:23
sean-k-mooneyhttps://review.opendev.org/c/openstack/nova/+/769720?18:24
dansmithnova-ceph-multistore TIMED_OUT18:24
dansmithyeah18:24
dansmithRUN END RESULT_TIMED_OUT: [untrusted : opendev.org/openstack/tempest/playbooks/devstack-tempest.yaml@master]18:24
sean-k-mooneythats not what im seeing is says failure for me in the dashborad18:25
sean-k-mooneyhttps://zuul.opendev.org/t/openstack/build/b7ad596d805b4f4fb428a047459d7ed818:25
dansmithoh sorry you mean the not yet reported job?18:25
sean-k-mooneyno the zull summary tab18:25
dansmithack, was looking at the original zuul -1 on PS5, I see now18:26
dansmiththat report you linked is an actual fail, but unrelated to the nova-glance interaction18:26
sean-k-mooneyya it hit two since test failure in gate and check18:27
sean-k-mooneyin different jobs that were unrelated18:27
dansmiththat fail doesn't seem to be giving it up to me, but I'd guess our http request to pull the image the test is asking for is stalled18:33
melwittfwiw I have reported a qemu bug recently related to block copy which is used in some volume tests https://bugs.launchpad.net/qemu/+bug/1914282 and this one presents as a volume not reaching the expected state within some timeout (usually 196s)18:34
openstackLaunchpad bug 1914282 in QEMU "block copy job sometimes hangs on the last block for minutes" [Undecided,New]18:34
melwitt*within some timeout in our tempest tests18:35
sean-k-mooneythat looks like what happend in one fo those failures18:36
melwittI'm not sure exactly how often it happens because I haven't figured out a unique fingerprint to logstash for18:36
melwittbut anecdotally I've seen it at least a few times lately18:37
melwittthis is another volume related one that I've only seen two logstash hits for https://bugs.launchpad.net/nova/+bug/191429618:37
openstackLaunchpad bug 1914296 in OpenStack Compute (nova) "tests involving encrypted volumes sometimes (rarely) fail with libvirtError: [...] Volume is not in LUKS format" [Medium,Confirmed]18:37
*** tosky has joined #openstack-nova18:37
dansmithboom urllib.error.URLError: <urlopen error [Errno 110] ETIMEDOUT>18:38
*** spatel has quit IRC18:38
melwittand then some of the ssh fails I've seen are this where instance fails to get pub key from metadata API (in cases where force_config_drive=False) https://bugs.launchpad.net/openstack-gate/+bug/191284518:39
openstackLaunchpad bug 1912845 in OpenStack-Gate "504 Gateway Timeout while trying to verify_metadata for a server" [Undecided,New]18:39
sean-k-mooneythe encpted volume one failed with "libvirt.libvirtError: internal error: unable to execute QEMU command 'blockdev-add': Volume is not in LUKS format"18:39
sean-k-mooneyhttps://zuul.opendev.org/t/openstack/build/57b34c2d89cb44dc8f716dcc4fdaf792/log/controller/logs/screen-n-cpu.txt#2885318:39
melwittyeah, that's one of the 3 gate bugs I reported and linked ^18:40
sean-k-mooneyyep18:40
melwittI showed that one to lyarwood and he said he's never seen it before18:40
*** amodi has joined #openstack-nova18:40
*** spatel has joined #openstack-nova18:40
sean-k-mooneythats what faild in the gate queue for the multi-cell-job then the image download swalled in the check queue in the multistore jobs18:41
*** k_mouza has joined #openstack-nova18:46
melwittoh yeah and I also reported a bug where lvcreate hangs once and then hangs on every attempt to lvcreate after that https://bugs.launchpad.net/cinder/+bug/191203118:46
openstackLaunchpad bug 1912031 in Cinder "lvcreate sometimes hangs and does not return, subsequent lvcreate commands hang from then on" [Medium,Triaged]18:46
melwittthat also presents as volumes not reaching expected states within time18:46
sean-k-mooneyso safe to say there are just one or two volume issues :P18:47
melwittseems like some kind of internal (in lvm) locking problem where deadlock happens and then things are screwed from then on. I dunno18:47
melwittyeah, it's a #hotmess18:47
sean-k-mooneyya some of thoes issues are really not cinders fault18:48
sean-k-mooneybut it is one of the places we tend to have issue with more offten just because of all the layesr invovled18:49
melwittyeah, it doesn't look like cinder itself but I thought they'd be most likely to know what's wrong or where to direct the bug next18:49
melwittor know what could possibly be done about it18:49
*** k_mouza has quit IRC18:50
*** hoonetorg has quit IRC19:06
*** hoonetorg has joined #openstack-nova19:10
*** andrewbonney has quit IRC19:15
*** hoonetorg has quit IRC19:22
*** hoonetorg has joined #openstack-nova19:28
*** nweinber has quit IRC19:55
*** hoonetorg has quit IRC20:18
*** hoonetorg has joined #openstack-nova20:22
dansmithsean-k-mooney: that failed multistore test run yielded a tempest fix, a serious glance bug, and a negative test in tempest to poke the bug20:24
dansmithso... thanks :)20:24
*** slaweq has quit IRC20:37
*** vishalmanchanda has quit IRC20:58
*** slaweq has joined #openstack-nova21:16
*** slaweq has quit IRC21:22
*** Underknowledge3 has joined #openstack-nova21:39
*** Underknowledge has quit IRC21:41
*** Underknowledge3 is now known as Underknowledge21:41
*** xek has joined #openstack-nova21:51
*** macz_ has quit IRC21:52
*** spatel has quit IRC22:02
*** spatel has joined #openstack-nova22:03
*** spatel has quit IRC22:04
*** k_mouza has joined #openstack-nova22:12
*** k_mouza has quit IRC22:17
*** dasp_ has joined #openstack-nova22:18
*** dasp has quit IRC22:20
*** spatel has joined #openstack-nova22:22
*** spatel has quit IRC22:26
*** rchurch has quit IRC22:29
*** rchurch has joined #openstack-nova22:32
*** whoami-rajat__ has quit IRC22:39
*** eharney has quit IRC23:13
*** tbachman has quit IRC23:18
*** tbachman has joined #openstack-nova23:18
*** xek has quit IRC23:20
*** tbachman_ has joined #openstack-nova23:21
*** tbachman has quit IRC23:23
*** tbachman_ is now known as tbachman23:23
*** tesseract has quit IRC23:42
« Thursday, 2021-02-04 Index Saturday, 2021-02-06 »

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!