| *** gyee has quit IRC | 00:33 | |
| *** mlavalle has quit IRC | 00:33 | |
| *** mlavalle has joined #openstack-nova | 00:33 | |
| *** mlavalle has quit IRC | 00:33 | |
| *** rodolof has joined #openstack-nova | 00:37 | |
| *** wolverineav has quit IRC | 00:45 | |
| *** wolverineav has joined #openstack-nova | 00:48 | |
| *** ileixe has joined #openstack-nova | 01:05 | |
| *** Nel1x has joined #openstack-nova | 01:16 | |
| *** wolverineav has quit IRC | 01:24 | |
| *** wolverineav has joined #openstack-nova | 01:25 | |
| *** wolverineav has quit IRC | 01:30 | |
| *** wolverineav has joined #openstack-nova | 01:31 | |
| *** hongbin has joined #openstack-nova | 01:36 | |
| *** dakshina-ilangov has joined #openstack-nova | 01:39 | |
| *** k_mouza has joined #openstack-nova | 01:43 | |
| openstackgerrit | zhongshengping proposed openstack/nova master: Update mailinglist from dev to discuss https://review.openstack.org/621827 | 01:46 |
|---|---|---|
| *** jamesdenton has joined #openstack-nova | 01:46 | |
| *** qwebirc716083 has joined #openstack-nova | 01:47 | |
| *** rambo_li has joined #openstack-nova | 01:48 | |
| *** k_mouza has quit IRC | 01:48 | |
| qwebirc716083 | join #openstack-nova | 01:51 |
| *** qwebirc716083 has quit IRC | 01:52 | |
| *** cfriesen has quit IRC | 02:05 | |
| *** wolverineav has quit IRC | 02:07 | |
| *** dklyle has quit IRC | 02:12 | |
| *** dklyle has joined #openstack-nova | 02:13 | |
| *** Dinesh_Bhor has joined #openstack-nova | 02:13 | |
| *** mrsoul has joined #openstack-nova | 02:14 | |
| *** wolverineav has joined #openstack-nova | 02:14 | |
| *** qwebirc783492 has joined #openstack-nova | 02:18 | |
| *** wolverineav has quit IRC | 02:21 | |
| *** qwebirc584207 has joined #openstack-nova | 02:25 | |
| *** qwebirc783492 has quit IRC | 02:28 | |
| *** qwebirc584207 has quit IRC | 02:30 | |
| *** Zer0Byte_ has quit IRC | 02:36 | |
| *** mhen has quit IRC | 02:37 | |
| *** mhen has joined #openstack-nova | 02:37 | |
| openstackgerrit | Tushar Patil proposed openstack/nova-specs master: Support filtering of allocation_candidates by forbidden aggregates https://review.openstack.org/609960 | 02:38 |
| *** Dinesh_Bhor has quit IRC | 02:39 | |
| openstackgerrit | Jack Ding proposed openstack/nova master: Improve libvirt image and snapshot handling https://review.openstack.org/616692 | 02:42 |
| *** psachin has joined #openstack-nova | 02:44 | |
| *** Dinesh_Bhor has joined #openstack-nova | 02:48 | |
| openstackgerrit | Zhenyu Zheng proposed openstack/nova master: Handle tags in _bury_in_cell0 https://review.openstack.org/621856 | 02:51 |
| *** imacdonn has quit IRC | 02:52 | |
| *** imacdonn has joined #openstack-nova | 02:53 | |
| *** igordc has quit IRC | 02:56 | |
| *** hongbin has quit IRC | 03:07 | |
| *** Nel1x has quit IRC | 03:16 | |
| openstackgerrit | Merged openstack/nova master: Remove utils.execute() calls from xenapi. https://review.openstack.org/619700 | 03:21 |
| *** Dinesh_Bhor has quit IRC | 03:56 | |
| *** rodolof has quit IRC | 03:57 | |
| *** rambo_li has quit IRC | 04:00 | |
| *** wolverineav has joined #openstack-nova | 04:08 | |
| *** wolverineav has quit IRC | 04:12 | |
| *** itlinux has joined #openstack-nova | 04:12 | |
| *** rodolof has joined #openstack-nova | 04:19 | |
| *** wolverineav has joined #openstack-nova | 04:19 | |
| *** ileixe has quit IRC | 04:24 | |
| *** hongbin has joined #openstack-nova | 04:24 | |
| *** ileixe has joined #openstack-nova | 04:28 | |
| *** wolverineav has quit IRC | 04:37 | |
| *** janki has joined #openstack-nova | 04:40 | |
| openstackgerrit | Takashi NATSUME proposed openstack/nova master: api-ref: Body verification for the lock action https://review.openstack.org/622835 | 04:41 |
| *** mmethot has quit IRC | 04:41 | |
| *** rodolof has quit IRC | 04:55 | |
| *** mordred has quit IRC | 04:57 | |
| *** mordred has joined #openstack-nova | 04:57 | |
| *** Dinesh_Bhor has joined #openstack-nova | 05:02 | |
| *** hongbin has quit IRC | 05:19 | |
| *** ileixe has quit IRC | 05:31 | |
| *** ileixe has joined #openstack-nova | 05:31 | |
| *** licanwei has joined #openstack-nova | 05:43 | |
| *** izza_ has quit IRC | 05:44 | |
| *** gouthamr has quit IRC | 05:46 | |
| *** izza_ has joined #openstack-nova | 05:47 | |
| izza_ | hi guys | 05:47 |
| izza_ | can anyone help us here on windows provisioning on openstack | 05:48 |
| *** sridharg has joined #openstack-nova | 05:48 | |
| *** gouthamr has joined #openstack-nova | 05:53 | |
| *** wolverineav has joined #openstack-nova | 05:56 | |
| *** ratailor has joined #openstack-nova | 06:00 | |
| *** wolverineav has quit IRC | 06:00 | |
| *** gouthamr has quit IRC | 06:15 | |
| *** gouthamr has joined #openstack-nova | 06:18 | |
| *** gouthamr has quit IRC | 06:29 | |
| openstackgerrit | Yongli He proposed openstack/nova master: Adds the server group info into show server detail API. https://review.openstack.org/621474 | 06:30 |
| *** gouthamr has joined #openstack-nova | 06:32 | |
| openstackgerrit | Yongli He proposed openstack/nova master: Add numa topology and pci devices into server detail API https://review.openstack.org/621476 | 06:34 |
| *** tetsuro has joined #openstack-nova | 06:41 | |
| *** Luzi has joined #openstack-nova | 06:42 | |
| *** tetsuro has quit IRC | 06:43 | |
| *** Dinesh_Bhor has quit IRC | 06:57 | |
| *** gouthamr has quit IRC | 06:58 | |
| *** ralonsoh has joined #openstack-nova | 06:58 | |
| *** ileixe has quit IRC | 07:01 | |
| *** ileixe has joined #openstack-nova | 07:02 | |
| *** gouthamr has joined #openstack-nova | 07:07 | |
| *** pcaruana has joined #openstack-nova | 07:10 | |
| openstackgerrit | Yongli He proposed openstack/nova-specs master: add 'show-server-group' spec https://review.openstack.org/612255 | 07:13 |
| *** Dinesh_Bhor has joined #openstack-nova | 07:16 | |
| *** takamatsu has joined #openstack-nova | 07:21 | |
| openstackgerrit | Yongli He proposed openstack/nova-specs master: add spec "show-server-numa-topology" https://review.openstack.org/612256 | 07:26 |
| openstackgerrit | Takashi NATSUME proposed openstack/nova master: api-ref: Body verification for the lock action https://review.openstack.org/622835 | 07:30 |
| openstackgerrit | Takashi NATSUME proposed openstack/nova master: api-ref: Body verification for the lock action https://review.openstack.org/622835 | 07:39 |
| *** dpawlik has joined #openstack-nova | 07:40 | |
| *** ileixe has quit IRC | 07:40 | |
| *** gouthamr has quit IRC | 07:40 | |
| *** gouthamr has joined #openstack-nova | 07:42 | |
| *** slaweq has joined #openstack-nova | 07:48 | |
| *** sahid has joined #openstack-nova | 07:56 | |
| *** brault has joined #openstack-nova | 07:57 | |
| *** takashin has left #openstack-nova | 08:01 | |
| *** ttsiouts has joined #openstack-nova | 08:05 | |
| openstackgerrit | Zhenyu Zheng proposed openstack/nova master: Handle tags in _bury_in_cell0 https://review.openstack.org/621856 | 08:10 |
| *** ttsiouts has quit IRC | 08:16 | |
| *** ttsiouts has joined #openstack-nova | 08:17 | |
| *** spatel has joined #openstack-nova | 08:19 | |
| *** spatel has quit IRC | 08:19 | |
| *** awalende has joined #openstack-nova | 08:20 | |
| *** priteau has joined #openstack-nova | 08:21 | |
| *** ttsiouts has quit IRC | 08:21 | |
| *** helenafm has joined #openstack-nova | 08:22 | |
| izza_ | hi | 08:25 |
| izza_ | can anyone help us here how to install windows in trial version in openstack | 08:25 |
| izza_ | i saw procedure but it is looking for a license windows | 08:25 |
| *** tssurya has joined #openstack-nova | 08:32 | |
| *** awalende_ has joined #openstack-nova | 08:33 | |
| tssurya | mriedem: yea here https://bugs.launchpad.net/nova/+bug/1805984 | 08:33 |
| openstack | Launchpad bug 1805984 in OpenStack Compute (nova) "Placement is not aware of disable compute nodes" [Undecided,New] | 08:33 |
| *** ttsiouts has joined #openstack-nova | 08:34 | |
| *** awalende has quit IRC | 08:35 | |
| *** jmlowe has quit IRC | 08:35 | |
| *** ttsiouts has quit IRC | 08:37 | |
| izza_ | hi | 08:38 |
| openstackgerrit | Rui Zang proposed openstack/nova-specs master: Virtual persistent memory libvirt driver implementation https://review.openstack.org/622893 | 08:38 |
| izza_ | is it possible to install windows trial version on openstack? | 08:39 |
| *** k_mouza has joined #openstack-nova | 08:43 | |
| *** k_mouza has quit IRC | 08:48 | |
| *** ttsiouts has joined #openstack-nova | 08:50 | |
| openstackgerrit | Rui Zang proposed openstack/nova-specs master: support virtual persistent memory https://review.openstack.org/601596 | 08:51 |
| *** ttsiouts has quit IRC | 09:01 | |
| *** ttsiouts has joined #openstack-nova | 09:01 | |
| *** brault has quit IRC | 09:03 | |
| *** brault has joined #openstack-nova | 09:04 | |
| *** maciejjozefczyk has quit IRC | 09:04 | |
| *** dpawlik has quit IRC | 09:04 | |
| *** maciejjozefczyk has joined #openstack-nova | 09:04 | |
| *** wolverineav has joined #openstack-nova | 09:05 | |
| *** dpawlik has joined #openstack-nova | 09:05 | |
| *** ttsiouts has quit IRC | 09:06 | |
| *** ttsiouts has joined #openstack-nova | 09:07 | |
| *** wolverineav has quit IRC | 09:09 | |
| *** ccamacho has joined #openstack-nova | 09:20 | |
| *** xek has joined #openstack-nova | 09:21 | |
| *** Dinesh_Bhor has quit IRC | 09:25 | |
| *** trident has quit IRC | 09:29 | |
| *** k_mouza has joined #openstack-nova | 09:29 | |
| *** Dinesh_Bhor has joined #openstack-nova | 09:30 | |
| *** trident has joined #openstack-nova | 09:31 | |
| *** k_mouza has quit IRC | 09:32 | |
| *** k_mouza has joined #openstack-nova | 09:33 | |
| *** ttsiouts has quit IRC | 09:35 | |
| *** ttsiouts has joined #openstack-nova | 09:36 | |
| *** rcernin has quit IRC | 09:38 | |
| *** ttsiouts has quit IRC | 09:40 | |
| *** ttsiouts has joined #openstack-nova | 09:46 | |
| *** derekh has joined #openstack-nova | 09:49 | |
| *** maciejjozefczyk has quit IRC | 10:07 | |
| *** maciejjozefczyk has joined #openstack-nova | 10:08 | |
| openstackgerrit | Bhagyashri Shewale proposed openstack/nova master: PCPU: Define numa dedicated CPU resource class https://review.openstack.org/561770 | 10:18 |
| openstackgerrit | Bhagyashri Shewale proposed openstack/nova master: NUMACell, InstanceNUMACell: Adopt 'PCPU' changes https://review.openstack.org/576021 | 10:18 |
| openstackgerrit | Bhagyashri Shewale proposed openstack/nova master: Report PCPU to placement https://review.openstack.org/577038 | 10:18 |
| openstackgerrit | Bhagyashri Shewale proposed openstack/nova master: Virt driver: Build guest xml https://review.openstack.org/577372 | 10:18 |
| *** maciejjozefczyk has quit IRC | 10:27 | |
| *** izza_ has quit IRC | 10:30 | |
| *** maciejjozefczyk has joined #openstack-nova | 10:31 | |
| *** Dinesh_Bhor has quit IRC | 10:31 | |
| openstackgerrit | Theodoros Tsioutsias proposed openstack/nova master: Introduce the PENDING instance state https://review.openstack.org/566473 | 10:34 |
| *** cdent has joined #openstack-nova | 10:37 | |
| *** k_mouza has quit IRC | 10:39 | |
| *** k_mouza has joined #openstack-nova | 10:40 | |
| openstackgerrit | Stephen Finucane proposed openstack/osc-placement master: tox: Hide deprecation warnings from stdlib https://review.openstack.org/611884 | 10:42 |
| *** dtantsur|afk is now known as dtantsur | 10:50 | |
| *** mschuppert has joined #openstack-nova | 10:51 | |
| *** ttsiouts has quit IRC | 10:52 | |
| *** ttsiouts has joined #openstack-nova | 10:53 | |
| openstackgerrit | Merged openstack/nova master: Always read-deleted=yes on lazy-load https://review.openstack.org/575190 | 10:54 |
| *** Dinesh_Bhor has joined #openstack-nova | 10:54 | |
| *** erlon has joined #openstack-nova | 10:57 | |
| *** ttsiouts has quit IRC | 10:57 | |
| *** Dinesh_Bhor has quit IRC | 10:59 | |
| *** kashyap has joined #openstack-nova | 11:02 | |
| kashyap | stephenfin: Hi, I got (again) logged out of IRC here. So if you pinged me, I haven't noticed. | 11:03 |
| kashyap | But yes, this is on the top of my pile: https://review.openstack.org/#/c/575735/ | 11:03 |
| * kashyap looks now | 11:06 | |
| zigo | I'm getting this in my nova-compute.log: http://paste.openstack.org/show/736696/ Where should I look to fix this? | 11:10 |
| zigo | "Placement API returning an error response: JSON does not validate: 0 is less than the minimum of 1" in nova-placement-api.log too ... | 11:11 |
| *** xek has quit IRC | 11:12 | |
| zigo | bauzas: ^ help ? :) | 11:12 |
| * bauzas looks | 11:12 | |
| gibi | zigo: '[{'DISK_GB': {'max_unit': 0, 'step_size': 1, 'min_unit': 1, 'reserved': 0, 'allocation_ratio': 1.0, 'total': 0}' it is an invalid part as total needs to be >= 1 | 11:14 |
| gibi | zigo: if there is no resouce of DISK_GB then we should not include the resource class to the request at all | 11:14 |
| zigo | gibi: Ok, so it lacks space on the Ceph backend, or something? | 11:15 |
| kashyap | gibi: Hi, I'm just doing another test for this: https://review.openstack.org/#/c/575735/ | 11:16 |
| gibi | zigo: somehow the nova-compute sees 0 disk | 11:16 |
| zigo | Right. | 11:16 |
| kashyap | gibi: And then add a comment there today. Was off yesterday; sorry for the terrible delay. | 11:16 |
| zigo | I just wonder how/where it looks. | 11:16 |
| gibi | kashyap: no worries, ping me if your fine with that patch an I will upgrade my vote | 11:17 |
| *** k_mouza_ has joined #openstack-nova | 11:17 | |
| kashyap | Yeah, Georg is right; the patch is correct. I just want to match my test w/ Georg's | 11:17 |
| gibi | kashyap: sure, do your test :) | 11:17 |
| kashyap | In progress; nested KVM envs... | 11:18 |
| zigo | Oh, I believe there's an issue in my Ceph cluster. | 11:19 |
| zigo | None of my PGs are active... | 11:19 |
| gibi | zigo: https://github.com/openstack/nova/blob/3a8dd02c81e4d8393f5bb5e105bbff0e628594d6/nova/compute/resource_tracker.py#L721 | 11:19 |
| gibi | zigo: this is the place where the compute node calls the virt driver to get the available resourves | 11:19 |
| zigo | gibi: Thanks ! | 11:20 |
| *** k_mouza has quit IRC | 11:20 | |
| *** k_mouza_ has quit IRC | 11:21 | |
| *** xek has joined #openstack-nova | 11:26 | |
| openstackgerrit | Lee Yarwood proposed openstack/nova stable/pike: Update docs for _destroy_evacuated_instances https://review.openstack.org/621203 | 11:34 |
| openstackgerrit | Lee Yarwood proposed openstack/nova stable/pike: Add regression test for bug #1764883 https://review.openstack.org/621204 | 11:34 |
| openstack | bug 1764883 in OpenStack Compute (nova) "Evacuation fails if the source host returns while the migration is still in progress" [Undecided,Fix released] https://launchpad.net/bugs/1764883 - Assigned to Lee Yarwood (lyarwood) | 11:34 |
| openstackgerrit | Lee Yarwood proposed openstack/nova stable/pike: compute: Ensure pre-migrating instances are destroyed during init_host https://review.openstack.org/621205 | 11:34 |
| *** xek has quit IRC | 11:38 | |
| *** tbachman has quit IRC | 11:44 | |
| kashyap | There goes another 18 mintes for `make stack`. | 11:49 |
| *** maciejjozefczyk has quit IRC | 11:49 | |
| *** maciejjozefczyk has joined #openstack-nova | 11:49 | |
| * kashyap wonders how 'fast' are people's DevStack setups here; e.g. how quickly (in minutes) can you spin up a new DevStack? | 11:50 | |
| gibi | kashyap: Total runtime 632 | 11:54 |
| gibi | kashyap: ubuntu 18.04, RECLONE=False, OFFLINE=False, horizon and tempest disabled | 11:55 |
| kashyap | gibi: Is that in seconds? | 11:55 |
| kashyap | (That 632) | 11:55 |
| gibi | kashyap: yes | 11:55 |
| kashyap | gibi: And is that on baremetal? Or in a VM (that's capable of nested virt) | 11:56 |
| gibi | kashyap: in a kvm VM, with 8G ram and 2 vcpu | 11:56 |
| kashyap | Interesting. I'm doing something same (on a pre-prod Haswell hardware from 5 years ago) | 11:57 |
| kashyap | ENABLED_SERVICES=g-api,g-reg,key,n-api,n-cpu,placement-api,n-sch,n-cond,n-sproxy,mysql,rabbit,dstat,quantum,q-svc,q-agt,q-dhcp,q-l3,q-meta | 11:57 |
| kashyap | gibi: The above are my services ^ | 11:57 |
| kashyap | I think I'll get a different timing if I run it on an SSD disk. | 11:57 |
| gibi | kashyap: this is my local conf http://paste.openstack.org/show/736698/ | 11:58 |
| * kashyap clicks | 11:58 | |
| gibi | kashyap: I'm running this on a fairly new hp 840 G5 | 11:58 |
| sean-k-mooney | kashyap: devstack is still one of the fasest installes i have used | 11:59 |
| kashyap | gibi: That's mine: http://paste.openstack.org/show/736699/ | 12:00 |
| sean-k-mooney | in genreal even with RECLONE=True i rarely exceed 15Mins on baremetal or 20 on a vm | 12:00 |
| kashyap | sean-k-mooney: Oh, agreed. It is "the" fastest, IMO | 12:00 |
| sean-k-mooney | kashyap: kolla-ansible is fater if you have the images | 12:00 |
| kashyap | I don't have RECLONE enabled. (I'll assume it defaults to 'false') | 12:00 |
| sean-k-mooney | but not by much | 12:01 |
| sean-k-mooney | kashyap: it does | 12:01 |
| sean-k-mooney | i normally run in offline mode however | 12:01 |
| kashyap | What does 'OFFLINE' do, remind me again, please | 12:01 |
| * cdent wonders when it becomes time to make a devstack-that-containerizes | 12:01 | |
| sean-k-mooney | it skips cloning and uses the git repos you have and also skps installing packages | 12:02 |
| sean-k-mooney | it just configres teh services/dbs and runs them | 12:02 |
| gibi | kashyap: my runs from a nvme ssd | 12:02 |
| sean-k-mooney | on baremetal with OFFLINE=True a compute node will stack in under a miniute | 12:03 |
| kashyap | Yeah, I NVMe on my laptop as well; mine is running on a slow remote machine; /me refreshes his local env. | 12:03 |
| kashyap | [OT] Meanwhile, check this out folks: http://qemu-advent-calendar.org/ | 12:03 |
| kashyap | Today's image is by yours truly :D | 12:03 |
| kashyap | (If you liked it, we also organized it in 2016: http://www.qemu-advent-calendar.org/2016/) | 12:03 |
| kashyap | And this year is 15 years of QEMU. | 12:04 |
| kashyap | If you're wondering WTH is this QEMU Advent, then read the "About" paragraph (https://www.qemu-advent-calendar.org/2018/#about) | 12:04 |
| kashyap | [quote] | 12:05 |
| kashyap | The QEMU Advent Calendar 2018 features a QEMU disk image each day of December until Christmas. Each day a new package becomes available for download | 12:05 |
| kashyap | [...] | 12:05 |
| kashyap | The disk images contain interesting operating systems and software that run under the QEMU emulator. Some of them are well-known or not-so-well-known operating systems, old and new, others are custom demos and neat algorithms. | 12:05 |
| kashyap | [/quote] | 12:05 |
| kashyap | If anyone has ideas for images, more than welcome! | 12:05 |
| gibi | kashyap: :) | 12:06 |
| jangutter | kashyap: Will December 24's image be a virtualization platform capable of running December 24's image? | 12:06 |
| kashyap | gibi: Some 3 years ago, I tried to compress an OpenStack DevStack install under 200 MB. But I could only come up to 618 MB. :-( | 12:07 |
| kashyap | (The artifact is still here: https://kashyapc.fedorapeople.org/virt/advent-qemu/) | 12:07 |
| kashyap | jangutter: 24th / 25th is usually a custom surprise. | 12:07 |
| kashyap | jangutter: And even custom-coded by some community members. Not going to ruin the surprise further :D | 12:07 |
| jangutter | kashyap: I still fondly remember the QNX boot floppies. | 12:07 |
| kashyap | So here's an open challenge: I wonder if anyone can really get a "xz-compressed" DevStack disk image that is _under_ 280 MB. | 12:08 |
| kashyap | jangutter: Heh | 12:08 |
| kashyap | An extremely minimal DevStack that fits under 280 MB in a disk image requires ugly hacks like removing directories (e.g doc, man pages) from the OS. Tried some of those and gave up as it was a really uphill battle | 12:10 |
| sean-k-mooney | kashyap: i mean it does not sound that hard | 12:11 |
| kashyap | Try it. | 12:11 |
| sean-k-mooney | espially if i dont have to include the git repos | 12:11 |
| kashyap | I dare you, double-dare you :D | 12:11 |
| *** sayalilunkad has quit IRC | 12:11 | |
| kashyap | sean-k-mooney: Yeah, that's also I considered | 12:12 |
| kashyap | Removing the 'git repos' | 12:12 |
| gibi | I root for you, sean-k-mooney | 12:12 |
| kashyap | It's going to take a full week of concentrated effort to prepare this image. If one attempts at all | 12:12 |
| * kashyap spent many evenings fighting with compression algos, doing dirty hacks in the OS (Operating System), trying to compress a few more MBs ... | 12:13 | |
| kashyap | (In the past, i.e.) | 12:13 |
| sean-k-mooney | kashyap: well what base os did you start with | 12:13 |
| kashyap | sean-k-mooney: Bare-minimal Fedora -- with @base (300 packages or so) | 12:13 |
| jangutter | kasyap: you just want someone to port OpenStack to OpenEmbedded | 12:14 |
| kashyap | That's the kickstart: https://kashyapc.fedorapeople.org/virt/fed-minimal.ks | 12:14 |
| kashyap | s/base/core/ | 12:14 |
| *** ttsiouts has joined #openstack-nova | 12:14 | |
| jangutter | kasyap: it should be pretty trivial if the image just loads a 1GB blob from the network into RAM. | 12:14 |
| jangutter | kashyap: use the "curl XX | sudo bash" compression method. | 12:15 |
| kashyap | Haha, yikes | 12:15 |
| sean-k-mooney | jangutter: i mean that is how you install docker right :p | 12:16 |
| sean-k-mooney | actully i wonder if my old docker devstack still works... | 12:18 |
| *** ratailor has quit IRC | 12:19 | |
| jangutter | kashyap: you know the history behind tcc? ( https://en.wikipedia.org/wiki/Tiny_C_Compiler ) | 12:20 |
| kashyap | jangutter: Hehe, funny you mention that! That was one of the images I prepared for the 2016 Advent Calendar! | 12:20 |
| sean-k-mooney | jangutter: wasnt it for an obfucation compition intally | 12:20 |
| kashyap | jangutter: Checkout the day-16 image: https://www.qemu-advent-calendar.org/2016/#day-16 | 12:21 |
| jangutter | sean-k-mooney: yep. It just goes to show you that in every thousand cool hacks at least once something really useful emerges. | 12:22 |
| *** khomesh has joined #openstack-nova | 12:23 | |
| sean-k-mooney | i used to use this as my primay dev env in a vm for about 6-9 months | 12:23 |
| sean-k-mooney | https://github.com/SeanMooney/docker-devstack | 12:23 |
| jangutter | kashyap: Ah, day 13 of 2016 - turtles all the way down. | 12:24 |
| sean-k-mooney | its 2 docker continers one of which had a dev environment e.g. ide, wireshark firefoxd, rdp server and another that run systemd and was where devstack woudl be run | 12:24 |
| sean-k-mooney | jangutter: well i had a 10 node openstack dev cluster already | 12:25 |
| kashyap | jangutter: Yep, do read the README before you run it :D | 12:25 |
| kashyap | Because it will create a "loop" of nested guests until your system runs out of memory (a.k.a crashes) | 12:26 |
| jangutter | kashyap: In other words it emulates nearly all my OpenStack setups perfectly. | 12:27 |
| sean-k-mooney | why do i get the feeling ill have to learn to debug casandra with all the edge stuff in the future | 12:29 |
| jangutter | sean-k-mooney: You're just making doomed predictions that nobody believes.... like Cassandra did. | 12:30 |
| sean-k-mooney | no im reading the mail tread that jsut said we need a weakly consitent backend for openstack to replace mysql and casandra is the only "db" i know of that is weakly consitent | 12:32 |
| sean-k-mooney | jangutter: i was reading http://lists.openstack.org/pipermail/openstack-discuss/2018-December/000606.html | 12:32 |
| *** ttsiouts has quit IRC | 12:35 | |
| *** ttsiouts has joined #openstack-nova | 12:36 | |
| jangutter | sean-k-mooney: and yet.... python still has the GIL. | 12:36 |
| *** ttsiouts has quit IRC | 12:36 | |
| *** ttsiouts_ has joined #openstack-nova | 12:36 | |
| *** sayalilunkad has joined #openstack-nova | 12:37 | |
| sean-k-mooney | jangutter: well that serves a different usecase | 12:38 |
| sean-k-mooney | eventual consitence does not mean you allow data races | 12:38 |
| sean-k-mooney | you just may be working on old data | 12:39 |
| sean-k-mooney | but it was still valid data | 12:39 |
| jangutter | sean-k-mooney: yeah, like RCU. | 12:39 |
| sean-k-mooney | yep | 12:40 |
| kashyap | gibi: stephenfin: I think this can be merged, FWIW; added my +1 with notes: https://review.openstack.org/#/c/575735/ (handle logfiles for tcp-based consoles) | 12:40 |
| gibi | kashyap: thanks. I upgrade my vote | 12:42 |
| *** ttsiouts_ has quit IRC | 12:50 | |
| *** ttsiouts has joined #openstack-nova | 12:51 | |
| *** tbachman has joined #openstack-nova | 12:54 | |
| *** ttsiouts_ has joined #openstack-nova | 12:55 | |
| *** ttsiouts has quit IRC | 12:55 | |
| openstackgerrit | Merged openstack/nova master: Deprecate the nova-console service https://review.openstack.org/610075 | 13:05 |
| *** janki has quit IRC | 13:08 | |
| mdbooth | This is interesting. Profiling the execution with testtools.run of a single functional test, top results by individual call time: http://paste.openstack.org/show/736703/ | 13:08 |
| mdbooth | Am I reading that right, do we call Compute.API.__init__() 616 times? | 13:09 |
| cdent | sure looks that way | 13:09 |
| mdbooth | That seems suboptimal | 13:10 |
| cdent | also a tshirt | 13:10 |
| mdbooth | Hehe | 13:10 |
| *** k_mouza has joined #openstack-nova | 13:11 | |
| mdbooth | In wallclock time, it's db access which is slow. | 13:12 |
| sean-k-mooney | well at least its not a global | 13:12 |
| *** ttsiouts_ has quit IRC | 13:14 | |
| mdbooth | I wonder where we're creating new Compute.API objects. It's not the cheapest operation. | 13:14 |
| *** ttsiouts has joined #openstack-nova | 13:14 | |
| openstackgerrit | Merged openstack/nova master: Deprecate the nova-xvpvncproxy service https://review.openstack.org/610076 | 13:18 |
| openstackgerrit | Merged openstack/nova stable/rocky: hardware: fix memory check usage for small/large pages https://review.openstack.org/599413 | 13:18 |
| *** ttsiouts has quit IRC | 13:19 | |
| *** ttsiouts has joined #openstack-nova | 13:19 | |
| cdent | mdbooth: you are likely on the edge of a deep deep hole. One which, if you choose to enter, will lead to riches beyond your dreams. But you might be there a while. | 13:22 |
| *** udesale has joined #openstack-nova | 13:26 | |
| mdbooth | cdent: Hehe. Yeah, I'm going to reduce the scope to establishing why mriedem had to revert my functional test. | 13:34 |
| mdbooth | And for that I need a stand-out, obvious culprit. | 13:34 |
| mdbooth | The above was just a surprising observation. | 13:34 |
| *** dtantsur is now known as dtantsur|brb | 13:39 | |
| *** dpawlik has quit IRC | 13:41 | |
| *** dpawlik has joined #openstack-nova | 13:44 | |
| *** diliprenkila has joined #openstack-nova | 13:48 | |
| *** dpawlik has quit IRC | 13:49 | |
| *** diliprenkila has quit IRC | 13:49 | |
| *** k_mouza has quit IRC | 13:49 | |
| *** priteau has quit IRC | 13:50 | |
| *** dpawlik has joined #openstack-nova | 13:50 | |
| *** khomesh has quit IRC | 13:51 | |
| *** mriedem has joined #openstack-nova | 13:52 | |
| kaisers | mdbooth: regarding https://review.openstack.org/#/c/554195/ - some time ago you were'nt happy with the issue details, i tried to shed a bit more light on things, could you revisit this at some point pls? | 14:01 |
| mdbooth | kaisers: Is the fix still required in the context of the systemd bugfix? | 14:03 |
| kaisers | mdbooth: yes, the problem ist that we added the --user flag. that fails for multiple reasons | 14:04 |
| kaisers | (i listed them in the commit message and the bugs new description | 14:04 |
| kaisers | ) | 14:04 |
| *** rodolof has joined #openstack-nova | 14:05 | |
| *** priteau has joined #openstack-nova | 14:05 | |
| mdbooth | kaisers: Which version of CentOS doesn't support --user? | 14:06 |
| kaisers | latest as of two days ago | 14:06 |
| mdbooth | Which operating systems don't ship with the systemd fix? | 14:06 |
| mdbooth | kashyap: So CentOS 7? | 14:06 |
| kaisers | The problem ist not the fix for systemd but that it ships with an older systemd that does not support the --user flag | 14:06 |
| kaisers | centos 7 comes with v219, the bug came up with v229 (i think) and was fixed with 23x | 14:08 |
| kaisers | Fixed in v238 according to https://github.com/systemd/systemd/blob/master/NEWS | 14:09 |
| kaisers | mmh, sorry, bug described with v233 in that news link, not v229 | 14:10 |
| *** bzhao__ has quit IRC | 14:18 | |
| openstackgerrit | Chris Dent proposed openstack/nova master: Correct lower-constraints.txt and the related tox job https://review.openstack.org/622972 | 14:20 |
| cdent | stephenfin: ^ has an issue that needs to be resolved before it can be merged, but gets close | 14:20 |
| gibi | stephenfin, mriedem: hi! the last two notification transformation patch is good to go from my perspective https://review.openstack.org/#/q/topic:bp/versioned-notification-transformation-stein+status:open | 14:25 |
| *** psachin has quit IRC | 14:27 | |
| stephenfin | cdent: I'd kill the test, personally. lbragstad added it in 6244a442784 and, while I get what it's doing, I don't think the lower-constraints thing is more of an issue | 14:27 |
| stephenfin | Good to get a second opinion though | 14:27 |
| stephenfin | kaisers: The bug's introduced in v233 and fixed in v238? | 14:28 |
| kaisers | stephenfin: I'm not sure when it was introduced but that's the version for which it is reported in the systemd changelog. | 14:29 |
| kashyap | mdbooth: Hi, was AFK for a break; reading the scroll | 14:29 |
| mriedem | gibi: ack | 14:29 |
| kaisers | stephenfin: But as stated earlier, the more direct problem is that centos 7 comes with v219 and e.g. xenial with 229, both not supporting the --user flag | 14:29 |
| kashyap | mdbooth: Okay, I see kaisers already mentioned which version of systemd ships in CentOS and which one you care about | 14:30 |
| kaisers | stephenfin: scratch that last comment, v229 does support it | 14:30 |
| kaisers | so the old version issue only comes up with centos | 14:30 |
| stephenfin | kaisers: Yup, gotcha | 14:30 |
| mdbooth | mriedem: Hey, about that functional test. Appreciate it made sense to take it out, but I'm trying to work out how we can safely get it back in. Problem is that we basically have no idea why it was failing and now way of finding out that I can think of without running it in CI. Could I perhaps fire up a non-voting job which enabled DEBUG output? | 14:31 |
| mdbooth | I responded on the bug that I *suspect* a performance issue in CI. | 14:31 |
| gibi | mdbooth: does it only fail in CI? | 14:31 |
| mdbooth | gibi: Well it never fails locally. I've run it hundreds of times. | 14:31 |
| stephenfin | kaisers: OK, I can't speak for mdbooth but the last thing I'd like to see is a comment in the code itself explaining that this is only required for CentOS 7 | 14:32 |
| mriedem | mdbooth: i suspect globals | 14:32 |
| gibi | mdbooth: let me try it and see if I can make it fail | 14:32 |
| mriedem | could try the REQUIRES_LOCKING variable or whatever | 14:32 |
| stephenfin | Presumably once CentOS 8 (or 8.1) is out and starts gaining traction, we can remove this again | 14:32 |
| mdbooth | stephenfin kaisers: Also there's a better way to detect systemd | 14:32 |
| mriedem | but i also suggesting writing a libvirt driver extension which overrides methods rather than mock them | 14:32 |
| mriedem | *suggested | 14:32 |
| kaisers | stephenfin: mdbooth: I'm still not sure why the third issue comes up, the --user flag failing when run via oslo_concurrency.processutils.execute. The error shown is similar to running --user as root but the python call should be executed as user nova afaics. I'm still digging into this but currently this fails, too | 14:32 |
| mdbooth | mriedem: What makes you think globals? | 14:32 |
| aspiers | dansmith, mriedem: any thoughts on latest patch set of SEV spec? I tried to capture the results of our Berlin conversations, and sean-k-mooney seems happier now IIUC | 14:33 |
| mriedem | mdbooth: i'd have to look at the bug report again | 14:33 |
| kaisers | mdbooth: regarding the systemd detection i'm all ears, i'm using the method danpb recommended to me some time ago | 14:33 |
| mriedem | in the middle of a different evacuate issue with CI | 14:33 |
| mriedem | aspiers: i haven't looked yet | 14:33 |
| *** janki has joined #openstack-nova | 14:33 | |
| aspiers | mriedem: for your convenience :) https://review.openstack.org/#/c/609779/14..15/specs/stein/approved/amd-sev-libvirt-support.rst | 14:33 |
| kaisers | stephenfin: I'll add the CentOS / systemd release version info to the change | 14:34 |
| stephenfin | gibi: ack. I need to get some reviews done. Only just finished reading 3 weeks of emails (yes, it is already Wednesday :-\) | 14:34 |
| aspiers | mriedem: it looks like only 16MB will need to be accounted for per VM in CONF.reserved_host_memory_mb | 14:35 |
| gibi | stephenfin: no worries, this is the last two patches and we have still time til milestone 2 :) | 14:35 |
| *** k_mouza has joined #openstack-nova | 14:35 | |
| mdbooth | mriedem: Interesting. What difference would it make to override rather than mock? Are you thinking class variables? | 14:36 |
| mriedem | aspiers: and that's something the operator needs to calculate and configure that option based on how many sev instances they think will be on a given host? | 14:36 |
| kaisers | stephenfin: oh, i misread, you do _not_ want that change pointed out to be specifically for centos 7, sry | 14:36 |
| mriedem | mdbooth: i've just seen enough weird mock failures with the libvirt driver to know i don't trust it | 14:37 |
| mriedem | running tests in isolation is fine, | 14:37 |
| aspiers | mriedem: yes, although I suspect in practice that value would be large enough anyway to swallow that amount without extra thought by the operator | 14:37 |
| mriedem | but then running full libvirt driver test suites i've seen weird mock failures | 14:37 |
| mriedem | aspiers: and why can't the driver just report the overhead value if it's a sev-enabled vm? | 14:37 |
| mriedem | *of | 14:37 |
| mriedem | gah | 14:38 |
| aspiers | :) | 14:38 |
| stephenfin | kaisers: No, I do want it | 14:38 |
| kaisers | stephenfin: ok, I'll add | 14:38 |
| stephenfin | kaisers: ta | 14:38 |
| mriedem | aspiers: so yeah, why can't the driver just report the overhead calculation per vm? | 14:39 |
| aspiers | mriedem: it could do that, although as I said in Berlin this is not an increased overhead compared to the non-SEV case | 14:40 |
| mriedem | maybe we won't use it b/c of placement we won't do the ram claim | 14:40 |
| *** k_mouza has quit IRC | 14:40 | |
| mriedem | aspiers: yeah i still don't understand that, | 14:40 |
| aspiers | mriedem: if you read the latest patch set hopefully all will become clear :) | 14:40 |
| mriedem | i'm very confused by saying, "well operators might need to bump the reserved ram option if the compute hosts these types of instances, but at the same time maybe not because there is no increase in ram usage on the host" | 14:41 |
| aspiers | I've tried very hard to explain this in detail in patchset 15 | 14:41 |
| aspiers | please take a look, and if it's still not clear then let me know | 14:41 |
| dansmith | mriedem: did you see the libvirt statement that the overhead amount is unknowable? | 14:41 |
| mriedem | i've seen that before yes | 14:42 |
| mriedem | but aspiers just said it's about 16MB per Vm | 14:42 |
| aspiers | dansmith: it turns out that it's a more knowable than we thought :) again, patchset goes into great detail on this :) | 14:42 |
| aspiers | *patchset 15 | 14:42 |
| * dansmith throws his hands up | 14:42 | |
| mriedem | right, so, | 14:42 |
| mriedem | at this point, i will likely just +2 out of exhaustion on the spec and we'll push it through and doc the hell out of this in the admin guide | 14:43 |
| mriedem | b/c it's a snowflake feature | 14:43 |
| mriedem | being brutally honest | 14:43 |
| mriedem | not because i'm against it, | 14:43 |
| mriedem | i'm just too dumb to understand it | 14:43 |
| aspiers | haha, I highly doubt that :) | 14:43 |
| mriedem | no really i'm not very smart | 14:44 |
| aspiers | but totally understand that you have limited time for it | 14:44 |
| aspiers | rest assured I will be doc'ing the hell out of it | 14:44 |
| aspiers | that intention is also captured in the spec | 14:44 |
| aspiers | http://logs.openstack.org/79/609779/15/check/openstack-tox-docs/eaf9d54/html/specs/stein/approved/amd-sev-libvirt-support.html#documentation-impact | 14:45 |
| lbragstad | stephenfin cdent hitting issues with I7cd27fe8c39ddfc6ec20f4cfe4d62912d4cebaa4 ? | 14:45 |
| *** mlavalle has joined #openstack-nova | 14:46 | |
| cdent | lbragstad: causes issues in https://review.openstack.org/#/c/622972/ (see commit message) | 14:46 |
| lbragstad | yeah - i don't have a strong attachment to that test... | 14:48 |
| lbragstad | i changed something though so i wanted to test it | 14:48 |
| *** eharney has joined #openstack-nova | 14:48 | |
| mriedem | still looking for another core on the allocation ratio data migration patch https://review.openstack.org/#/c/613499/ it's pretty easy | 14:48 |
| mriedem | and we can flush this runway bp today | 14:48 |
| dansmith | yeah, I've had that open since middle of yesterday | 14:49 |
| dansmith | I'll get some protein to go with my caffeine and see if I can make myself do it | 14:51 |
| mriedem | power through | 14:53 |
| mriedem | bauzas: i'm removing reshaper from the runway queue again | 14:53 |
| mriedem | dec 4 came and went | 14:53 |
| stephenfin | mriedem, dansmith, cdent, gibi, anyone else around: are you happy with me doing this? https://review.openstack.org/622987 | 14:55 |
| *** amodi has quit IRC | 14:55 | |
| stephenfin | I'm removing osc-placement notifications from this channel | 14:55 |
| cdent | wfm | 14:55 |
| stephenfin | *gerritbot notifications | 14:55 |
| mriedem | sure | 14:56 |
| mriedem | reminds me that osc-placement is falling behind on parity | 14:56 |
| gibi | stephenfin: I think the original reason to keep that was to know when we need to keep placement changes in sync in placement code in nova and in the separated placement | 14:56 |
| mriedem | osc-placement | 14:57 |
| mriedem | not placement | 14:57 |
| *** awaugama has joined #openstack-nova | 14:59 | |
| *** Sundar has joined #openstack-nova | 14:59 | |
| bauzas | mriedem: ack, ok | 14:59 |
| *** cfriesen has joined #openstack-nova | 14:59 | |
| bauzas | mriedem: I'll tho ping people later about reviewing it ;) | 15:01 |
| *** yan0s has joined #openstack-nova | 15:02 | |
| yan0s | hi guys, I'm having a trouble with policy.json file in /etc/nova/ | 15:04 |
| mriedem | bauzas: you also have some review comments to address it looks like | 15:04 |
| yan0s | how can I debug if it actually being parsed? | 15:04 |
| bauzas | mriedem: just the ones from artom but yeah :) | 15:04 |
| bauzas | I was waiting for other comments | 15:04 |
| mriedem | yan0s: interesting question which someone was having trouble with last week, i don't have a great answer... | 15:06 |
| mriedem | i'm not sure if enabling debug logging will dump anything from oslo.policy when the check is performed? | 15:06 |
| yan0s | I have set "compute:create": "is_admin:True" and "compute:create": "is_admin:True" | 15:06 |
| mriedem | those are the same | 15:07 |
| yan0s | but users of any role can still create instances | 15:07 |
| yan0s | that's wrong right? | 15:07 |
| yan0s | "os_compute_api:servers:create": "is_admin:True" | 15:07 |
| yan0s | that was the second rule | 15:07 |
| mriedem | what is your is_admin definition? | 15:07 |
| mriedem | and which release is this? | 15:07 |
| yan0s | rocky | 15:07 |
| yan0s | but with juju | 15:07 |
| mriedem | and [oslo_policy]/policy_file in nova.conf is not changed from the default policy.json? | 15:08 |
| mriedem | and policy.json is in /etc/nova/policy.json or somewhere else? | 15:08 |
| mriedem | we do have this CLI https://github.com/openstack/nova/blob/master/nova/cmd/policy.py#L73 but it's not really what you're looking for probably | 15:09 |
| yan0s | policy.json is in /etc/nova/ | 15:09 |
| yan0s | is there a field in nova.conf that defines the policy.json directory? | 15:10 |
| mriedem | the options are in this group https://docs.openstack.org/nova/latest/configuration/config.html#oslo-policy | 15:11 |
| *** lpetrut has joined #openstack-nova | 15:12 | |
| *** mmethot has joined #openstack-nova | 15:12 | |
| *** dtantsur|brb is now known as dtantsur | 15:13 | |
| openstackgerrit | Matt Riedemann proposed openstack/nova master: Add docs for (initial) allocation ratio configuration https://review.openstack.org/622588 | 15:16 |
| yan0s | [oslo_policy] was missing from the nova.conf | 15:16 |
| yan0s | thanks mriedem! | 15:16 |
| mriedem | yan0s: well, it doesn't need to be in nova.conf if you're not changing defaults | 15:17 |
| mriedem | if the defaults are what you need anyway, it should just work | 15:17 |
| yan0s | adding policy_file = policy.json under it fixed it | 15:17 |
| mriedem | hmm, that shouldn't matter, that's already the default in code... | 15:17 |
| mriedem | lbragstad: ^ | 15:17 |
| yan0s | no I need a specific configuration | 15:17 |
| mriedem | yan0s: why? | 15:18 |
| yan0s | I need user roles with different access rights | 15:18 |
| mriedem | sure, that's in policy.json though, | 15:19 |
| mriedem | nova.conf is already pointing at policy_file=policy.json by default | 15:19 |
| yan0s | is there a better way of doing this? | 15:19 |
| mriedem | because of defaults in the code | 15:19 |
| mriedem | https://docs.openstack.org/nova/latest/configuration/config.html#oslo_policy.policy_file Default:policy.json | 15:19 |
| mriedem | overriding policy rules is fine and expected, i just wonder why the config defaults weren't working | 15:20 |
| mriedem | because someone was having a similar issue last week | 15:20 |
| yan0s | could it be a juju charm specific issue? | 15:20 |
| mriedem | i think the person last week was using kolla but it's hard to remember | 15:20 |
| * lbragstad reads scrollback | 15:20 | |
| mriedem | lbragstad: apparently [oslo_policy]/policy_file default not being read for some reason in some deployments | 15:21 |
| mriedem | explicitly putting policy_file=policy.json in nova.conf fixed it, but that shouldn't be necessary given it's already the default value | 15:21 |
| lbragstad | as far as the logging goes (which doesn't seem to be the root issue) we did just release a new version of oslo.policy that allows for better logging | 15:21 |
| lbragstad | https://review.openstack.org/#/c/619260/ | 15:22 |
| *** itlinux has quit IRC | 15:22 | |
| lbragstad | and the default from policy.json isn't changing for what's documented in code? | 15:22 |
| mriedem | no they are using /etc/nova/policy.json | 15:23 |
| mriedem | "adding policy_file = policy.json under it fixed it" | 15:23 |
| mriedem | we don't test policy overrides in tempest/dsvm jobs, but patrole should, i should find one of those jobs and see if they have to explicitly configure this in nova.conf | 15:25 |
| kashyap | If anyone has a few spare minutes, this already has a +2: https://review.openstack.org/#/c/620327/ -- "libvirt: Refactor handling of PCIe root ports" | 15:25 |
| stephenfin | mriedem: Would you mind taking a look at this when you have time? https://review.openstack.org/#/c/554523/ | 15:26 |
| stephenfin | kashyap: on it | 15:26 |
| kashyap | stephenfin: Thanks! The more important bit I need to work out is a clean solution for long "TODO" in the code... | 15:27 |
| stephenfin | just reading that atm | 15:27 |
| dansmith | mriedem: when you get a sec, check my comment on the initial ratio migration patch | 15:28 |
| dansmith | (please) | 15:28 |
| *** munimeha1 has joined #openstack-nova | 15:29 | |
| * kashyap gets back to writing an ugly script that sets up TLS for live migration w/o shared storage with DevStack | 15:29 | |
| stephenfin | kashyap: I think you've already stated the fix, no? (third paragraph of that TODO) | 15:29 |
| *** amodi has joined #openstack-nova | 15:29 | |
| kashyap | stephenfin: Yep, so you actually read it, then :D | 15:30 |
| stephenfin | I'm 100% for detailed code comments ;) | 15:30 |
| stephenfin | ...so long as they're kept up-to-date | 15:30 |
| kashyap | Thanks! I spent unjustifiable time to write that comment :D | 15:31 |
| stephenfin | kashyap: In any case, that's a future problem. +Wd | 15:31 |
| kashyap | stephenfin: The "hidden" bit is to workout XML wrangling to get the machine type from the right XML bit | 15:31 |
| kashyap | Thanks! | 15:31 |
| openstackgerrit | Balazs Gibizer proposed openstack/nova master: Remove port allocation during detach https://review.openstack.org/622421 | 15:31 |
| kashyap | stephenfin: Thanks! That's a near-term problem, as "certain Linux distributions" might / will change default machine types | 15:33 |
| yan0s | also, does any service neds to be restarted for updates in policy.json to take effect? | 15:33 |
| mriedem | dansmith: replied | 15:33 |
| mriedem | just tell me what you want me to do and i'll make the change | 15:33 |
| *** amodi has quit IRC | 15:35 | |
| *** amodi_ has joined #openstack-nova | 15:35 | |
| mriedem | yikun: fyi, https://blueprints.launchpad.net/nova/+spec/live-migration-force-after-timeout is now in a runway slot until dec 19 | 15:35 |
| *** amodi_ is now known as amodi | 15:35 | |
| *** awalende_ has quit IRC | 15:35 | |
| dansmith | mriedem: well, I was going to volunteer to fix it since it's my complaint, but I think I'd rather it not tweak updated_at unless it's going to do a full refresh so it's consistent | 15:35 |
| mriedem | i'll do it, i've got the series local already - i've been tweaking it along the way for my minor stuff | 15:36 |
| mriedem | can you take a look at the next in line before i do? | 15:36 |
| mriedem | the one that adds the cli hook | 15:36 |
| dansmith | okay, other than that I'm good with it | 15:36 |
| dansmith | okay | 15:36 |
| *** amodi has quit IRC | 15:36 | |
| dansmith | mriedem: that migration is going to do deleted records too, is that the intent? | 15:37 |
| dansmith | mriedem: two comments on there | 15:39 |
| mriedem | ew, no i dont think we want that | 15:40 |
| openstackgerrit | Takashi NATSUME proposed openstack/nova master: api-ref: Body verification for the lock action https://review.openstack.org/622835 | 15:40 |
| *** amodi has joined #openstack-nova | 15:40 | |
| mriedem | i'll address those as well | 15:41 |
| mriedem | stephenfin: done | 15:41 |
| stephenfin | Thank you | 15:41 |
| mriedem | stephenfin: note that the pike backport hasn't been released yet | 15:41 |
| mriedem | even though it was done on august | 15:42 |
| mriedem | *merged | 15:42 |
| mriedem | so....probably time to think about doing an os-vif pike release | 15:42 |
| mriedem | stephenfin: do you want to queue that up? | 15:42 |
| stephenfin | mriedem: Sure thing | 15:43 |
| *** ttsiouts has quit IRC | 15:45 | |
| openstackgerrit | Matt Riedemann proposed openstack/nova master: Use tempest [compute]/build_timeout in evacuate tests https://review.openstack.org/623011 | 15:47 |
| *** k_mouza has joined #openstack-nova | 15:47 | |
| *** lpetrut has quit IRC | 15:49 | |
| *** k_mouza has quit IRC | 15:49 | |
| *** k_mouza has joined #openstack-nova | 15:50 | |
| *** tssurya has quit IRC | 15:54 | |
| stephenfin | mriedem: https://review.openstack.org/623016 | 15:54 |
| openstackgerrit | Merged openstack/os-vif stable/ocata: Check if interface belongs to a Linux Bridge before removing https://review.openstack.org/554523 | 15:54 |
| mriedem | woohoo, summit and ptg are separate, $700 summit only with no lunch, ptg is $400 w/ lunch (oh thank you), and $1200 for both | 15:55 |
| mriedem | so longer week, more expensive, no lunch, what's not to love?! | 15:55 |
| tbachman | do they have gift-bags? | 15:55 |
| mriedem | byogb | 15:56 |
| dansmith | come on, even for atcs? | 15:56 |
| tbachman | darn | 15:56 |
| mriedem | no idea about atcs | 15:56 |
| *** ttsiouts has joined #openstack-nova | 15:56 | |
| stephenfin | mriedem: Oh, I wonder if we should include this too, if we're doing a release? https://review.openstack.org/#/c/505731/ | 15:56 |
| stephenfin | I'll prepare an ocata release too. Nothing else on the backlog | 15:56 |
| cdent | efried: is https://review.openstack.org/#/c/613613/ still alive (kill safe connect) | 15:58 |
| efried | cdent: I think so. Just needs core reviews. | 15:58 |
| cdent | roger, just doing a to do list review, and it came round | 16:00 |
| *** slaweq has quit IRC | 16:02 | |
| *** tbachman has quit IRC | 16:03 | |
| mriedem | stephenfin: question in https://review.openstack.org/#/c/505731/4 | 16:04 |
| stephenfin | looking | 16:04 |
| melwitt | o/ | 16:06 |
| *** awalende has joined #openstack-nova | 16:08 | |
| *** tbachman has joined #openstack-nova | 16:08 | |
| mriedem | stephenfin: i guess it's always been there? https://kernel.googlesource.com/pub/scm/linux/kernel/git/shemminger/bridge-utils/+/38837a8e19540690c80f5a3b0971e0e1495a4a3e/brctl/brctl_cmd.c#124 | 16:08 |
| stephenfin | mriedem: :D I was looking at the exact same thing | 16:09 |
| lbragstad | yan0s i think it depends on how the service init's the oslo.policy enforcer object | 16:09 |
| openstackgerrit | Chris Dent proposed openstack/nova master: Correct lower-constraints.txt and the related tox job https://review.openstack.org/622972 | 16:10 |
| lbragstad | yan0s there is a configuration option to reload policy rules when they change on disk, i believe | 16:10 |
| lbragstad | s/configuration option/option parameter to the enforcer/ | 16:10 |
| mriedem | lbragstad: that would be here https://github.com/openstack/nova/blob/master/nova/policy.py#L68 | 16:10 |
| stephenfin | mriedem: It's in Ubuntu 16.04 http://manpages.ubuntu.com/manpages/xenial/man8/brctl.8.html and there's no changelog section, so I assume it's always been there too | 16:11 |
| lbragstad | mriedem yeah - some documentation on it here https://docs.openstack.org/oslo.policy/latest/reference/api/oslo_policy.policy.html#oslo_policy.policy.Enforcer | 16:11 |
| *** jmlowe has joined #openstack-nova | 16:12 | |
| *** awalende has quit IRC | 16:12 | |
| mriedem | hmm, so nova-api isn't dynamically reloading rules? | 16:13 |
| mriedem | i only see ENFORCER.load_rules() called when we initialize it | 16:13 |
| mriedem | yan0s: did you restart nova-api when you changed nova.conf to set the policy_file option? | 16:14 |
| sean-k-mooney | o/ | 16:14 |
| gibi | mdbooth: I run ~30 consecutive full nova functional tests with random test case order to reproduce the test failure but I failed | 16:15 |
| gibi | mdbooth: so I think it is more likely a timing issue as the gate runs the test slower than I | 16:16 |
| sean-k-mooney | stephenfin: brctl? | 16:16 |
| stephenfin | yes | 16:16 |
| sean-k-mooney | i was wondering whtat the context was | 16:17 |
| *** pcaruana has quit IRC | 16:18 | |
| openstackgerrit | Lee Yarwood proposed openstack/nova master: libvirt: Add workaround to remove instance dir during cleanup with rbd https://review.openstack.org/618478 | 16:19 |
| openstackgerrit | Balazs Gibizer proposed openstack/nova master: Remove port allocation during detach https://review.openstack.org/622421 | 16:20 |
| *** maciejjozefczyk has quit IRC | 16:21 | |
| *** maciejjozefczyk has joined #openstack-nova | 16:23 | |
| openstackgerrit | Merged openstack/os-vif stable/pike: ovs-hybrid: should permanently keep MAC entries https://review.openstack.org/505731 | 16:27 |
| *** amodi has quit IRC | 16:27 | |
| stephenfin | gibi: I know no one wants to see that patch, but the notification samples would be so much easier to grok if they were a consistently sorted 😅 (especially the common payloads) | 16:28 |
| yan0s | yes I did restart it | 16:29 |
| yan0s | nova-api-os-compute | 16:29 |
| yan0s | nova-api-os-compute.service | 16:29 |
| *** janki has quit IRC | 16:30 | |
| mriedem | yan0s: ok so it might have just been that you restarted the service that reloaded the policy file rather than needing to configure nova.conf | 16:31 |
| mriedem | i thought we always dynamically read the policy file on each auth check | 16:31 |
| *** amodi_ has joined #openstack-nova | 16:31 | |
| mriedem | but i guess not | 16:31 |
| mdbooth | gibi: Yeah, I *suspect* that it's just a canary. I think that create is taking close to the 5 second timeout, and when the gate is clogged its the first thing to get pushed over. | 16:31 |
| cfriesen | sean-k-mooney: regarding https://review.openstack.org/#/c/620959/, I believe the traits are already defined as part of https://specs.openstack.org/openstack/nova-specs/specs/rocky/implemented/report-cpu-features-as-traits.html | 16:32 |
| mdbooth | gibi: Problem is I can't prove it. I spent time this morning looking at a profiler and I can see a couple of opportunities for making that test slightly faster, but if I guessed wrong it's just going to be merge ping-pong. | 16:32 |
| *** Luzi has quit IRC | 16:33 | |
| mdbooth | gibi: The other thing, of course, would be to increase the timeout. | 16:33 |
| *** gyee has joined #openstack-nova | 16:34 | |
| *** tbachman has quit IRC | 16:35 | |
| openstackgerrit | Matt Riedemann proposed openstack/nova master: Add ratio online data migration when load compute node https://review.openstack.org/613499 | 16:36 |
| openstackgerrit | Matt Riedemann proposed openstack/nova master: Add compute_node ratio online data migration script https://review.openstack.org/609995 | 16:36 |
| openstackgerrit | Matt Riedemann proposed openstack/nova master: Note the aggregate allocation ratio restriction in scheduler docs https://review.openstack.org/620713 | 16:36 |
| openstackgerrit | Matt Riedemann proposed openstack/nova master: Add docs for (initial) allocation ratio configuration https://review.openstack.org/622588 | 16:36 |
| mriedem | dansmith: done ^ | 16:36 |
| *** ttsiouts has quit IRC | 16:36 | |
| *** itlinux has joined #openstack-nova | 16:37 | |
| *** ttsiouts has joined #openstack-nova | 16:37 | |
| dansmith | mriedem: got 'em | 16:39 |
| mriedem | thanks | 16:39 |
| mriedem | approving the non-docs changes | 16:39 |
| mdbooth | mriedem: What do you think would be acceptable criteria for re-proposing that patch, btw? | 16:40 |
| mriedem | the racy test? | 16:40 |
| dansmith | mriedem: I'll look at the following ones in a bit | 16:40 |
| mriedem | dansmith: thanks | 16:40 |
| mdbooth | mriedem: Yeah. | 16:40 |
| mriedem | mdbooth: idk, maybe not using mocks/stubs on the libvirt driver in functional tests? | 16:40 |
| mriedem | like i said, might be better to subclass the libvirt driver and override what you need | 16:41 |
| mdbooth | mriedem: I suspect the *race* is against a slow test worker. | 16:41 |
| mdbooth | I can't see any evidence of an ordering thing. | 16:41 |
| mriedem | could also add the REQUIRES_LOCKING = True variable, but i don't know if that will help anything | 16:41 |
| mdbooth | Which isn't to say that it's not an ordering thing, but without being able to reproduce it we're really just trying stuff. | 16:41 |
| mdbooth | So... when have we tried enough stuff? | 16:41 |
| mriedem | just, doing file i/o and mocks and such in a functional test like that with a real driver - i'm not really surprised there were side effects | 16:41 |
| *** ttsiouts has quit IRC | 16:42 | |
| mriedem | mdbooth: i can't answer that | 16:42 |
| mdbooth | mriedem: Me neither :/ | 16:42 |
| *** dpawlik has quit IRC | 16:42 | |
| mdbooth | However, like I say I don't see any evidence of side effects, or globals, or anything like that. | 16:42 |
| mdbooth | The failures look like it was just too slow to me. | 16:43 |
| mdbooth | I can post performance improvements. | 16:43 |
| *** dpawlik has joined #openstack-nova | 16:44 | |
| efried | My boss just made me look at my remaining vacation time for the year. Turns out... I'm gone until January, starting this afternoon. melwitt mriedem Sundar edmondsw FYI. | 16:45 |
| mdbooth | efried: \o/ | 16:45 |
| aspiers | efried: whoa nice, enjoy ;-) | 16:45 |
| efried | :) thanks | 16:45 |
| lbragstad | mriedem yan0s fwiw - i keystone doesn't either, but i can't really think of a reason not to? | 16:46 |
| lbragstad | s/i// | 16:46 |
| mriedem | lbragstad: perf? | 16:46 |
| melwitt | efried: thanks for the heads up. enjoy your time off :) | 16:46 |
| *** artom has quit IRC | 16:46 | |
| *** udesale has quit IRC | 16:46 | |
| mriedem | efried: ack | 16:46 |
| lbragstad | mriedem possibly - i could time it | 16:46 |
| *** artom has joined #openstack-nova | 16:47 | |
| *** udesale has joined #openstack-nova | 16:47 | |
| mriedem | efried: i'll just rebase and abuse any changes of yours that i need | 16:47 |
| efried | mriedem: It would be easier just to merge them right now. | 16:47 |
| mriedem | bah | 16:47 |
| *** tbachman has joined #openstack-nova | 16:47 | |
| mriedem | my queue is already deep and i haven't started on either of the 2 things i said i'd do today | 16:47 |
| Sundar | efried: Have fun and Happy Holidays! | 16:49 |
| efried | Thanks | 16:49 |
| openstackgerrit | Eric Fried proposed openstack/nova master: Add cyborg client to requirements https://review.openstack.org/623026 | 16:51 |
| openstackgerrit | Eric Fried proposed openstack/nova master: WIP: Cyborg PCI handling https://review.openstack.org/623027 | 16:51 |
| *** awalende has joined #openstack-nova | 16:55 | |
| yan0s | No I definitely needed to change the nova.conf | 16:56 |
| *** awalende has quit IRC | 16:56 | |
| yan0s | I was restarting the service in every try | 16:56 |
| yan0s | @lbragstad | 16:57 |
| yan0s | @mriedem | 16:57 |
| mriedem | hmm, well i'm stumped then | 16:58 |
| lbragstad | yeah - by default, oslo.policy isn't going to reload policy files on disk | 16:58 |
| mriedem | lbragstad: but they shouldn't have had to explicitly configure nova.conf with [oslo_policy]/policy_file = policy.json | 16:58 |
| mriedem | since that's the default in code | 16:58 |
| *** priteau has quit IRC | 16:59 | |
| mriedem | anyway, probably just something i'd need to mess with in devstack to see if i can recreate it | 16:59 |
| lbragstad | this sounds like two different issues | 16:59 |
| lbragstad | yan0s if you're in #openstack-oslo this might be more relevant to talk about there | 17:03 |
| *** priteau has joined #openstack-nova | 17:07 | |
| openstackgerrit | Eric Fried proposed openstack/nova master: Add cyborg client to requirements https://review.openstack.org/623026 | 17:07 |
| openstackgerrit | Eric Fried proposed openstack/nova master: WIP: Cyborg PCI handling https://review.openstack.org/623027 | 17:07 |
| *** slaweq has joined #openstack-nova | 17:08 | |
| *** priteau has quit IRC | 17:08 | |
| *** priteau has joined #openstack-nova | 17:10 | |
| *** yan0s has quit IRC | 17:16 | |
| *** wolverineav has joined #openstack-nova | 17:17 | |
| *** slaweq has quit IRC | 17:20 | |
| *** slaweq has joined #openstack-nova | 17:21 | |
| mriedem | gibi: not sure if you saw my comment in that notifications patch, but if we planned on switching the default format to unversioned, marking it as deprecated would be weird | 17:25 |
| *** helenafm has quit IRC | 17:28 | |
| openstackgerrit | Stephen Finucane proposed openstack/nova master: Address nits on I08991796aaced2abc824f608108c0c786181eb65 https://review.openstack.org/614322 | 17:29 |
| openstackgerrit | Stephen Finucane proposed openstack/nova master: Address nits on I1f1fa1d0f79bec5a4101e03bc2d43ba581dd35a0 https://review.openstack.org/614323 | 17:29 |
| stephenfin | mriedem: I'd suggested going the other way, leaving it to deployers to manually set things if some tool can't consume versioned notifications. Maybe that's too severe though | 17:31 |
| *** sahid has quit IRC | 17:32 | |
| mriedem | stephenfin: by some tool you mean *all* tools? | 17:32 |
| mriedem | at least all tools in openstack | 17:32 |
| mriedem | as far as i know, nothing in openstack which consumes nova notifications uses versioned notifications | 17:33 |
| mriedem | and it's on us to add that support to those already understaffed projects | 17:33 |
| stephenfin | Apparently so. I thought there were some, based on some mailing list post from a while back | 17:33 |
| sean-k-mooney | didnt we say we were removing the unversioned notification in denver | 17:33 |
| mriedem | there are lots of projects that consume nova's notifications, but not versioned | 17:33 |
| mriedem | no | 17:33 |
| mriedem | we said we'd never remove them | 17:34 |
| stephenfin | Not removing - just deprecating | 17:34 |
| stephenfin | Yeah | 17:34 |
| stephenfin | until they eventually break, presumably | 17:34 |
| sean-k-mooney | sorry your right we said we woudl keep them but not add new unversioned notifications | 17:34 |
| mriedem | we haven't been adding new unversioned notifications since...we had versioned notifications | 17:35 |
| mriedem | getting telemetry over the hump is probably the biggest hurdle | 17:35 |
| mriedem | within openstack | 17:35 |
| sean-k-mooney | right but i gues what i ment is freezing the unversioned code. | 17:35 |
| mriedem | it's already frozen | 17:35 |
| sean-k-mooney | including bug fixes | 17:36 |
| mriedem | deprecation would just be signaling, don't write new stuff with this | 17:36 |
| mriedem | i can't remember the last time we had a bug fix that dealt with unversioned notifications | 17:36 |
| mriedem | my concern is https://bugs.launchpad.net/nova/+bug/1805659 | 17:37 |
| openstack | Launchpad bug 1805659 in OpenStack Compute (nova) "nova notifications hammering the message bus" [Low,Confirmed] | 17:37 |
| mriedem | which jmlowe brought up | 17:37 |
| *** k_mouza_ has joined #openstack-nova | 17:37 | |
| mriedem | today we default to send both, versioned and unversioned, which kills rpc | 17:37 |
| mriedem | s/kills/doesn't help/ | 17:37 |
| mriedem | if nothing is consuming versioned yet, then that is a shitty default imo | 17:37 |
| mriedem | i know we want to get people off the old stuff, but no one is doing that | 17:38 |
| sean-k-mooney | ya just readign that makes sense but im kind of reluctent to default to old | 17:38 |
| mriedem | and honestly without a schema that consumers can use, it's probably not really something they care about | 17:38 |
| *** cdent has quit IRC | 17:38 | |
| mriedem | since they can't do version negotiation | 17:38 |
| sean-k-mooney | can we default to versioned going forward instead and tell peopel to enable both/unversions if they have a service that uses them? | 17:39 |
| mriedem | we can do whatever | 17:39 |
| mriedem | me? i'm going to go make lunch and try to think about something else. | 17:40 |
| *** mriedem is now known as mriedem_away | 17:40 | |
| sean-k-mooney | ok :) | 17:40 |
| *** k_mouza has quit IRC | 17:40 | |
| *** k_mouza_ has quit IRC | 17:41 | |
| *** mrhillsman has quit IRC | 17:51 | |
| *** zioproto has quit IRC | 17:51 | |
| *** mrhillsman has joined #openstack-nova | 17:52 | |
| *** zioproto has joined #openstack-nova | 17:52 | |
| cfriesen | sean-k-mooney: I replied to your comments on https://review.openstack.org/#/c/620959/ | 17:54 |
| *** Sundar has quit IRC | 17:55 | |
| sean-k-mooney | cfriesen: yep i know the feature flags are already in placement but they currently mean find ma a host wtih X not enable X on the vm | 17:55 |
| sean-k-mooney | cfriesen: qemu does not always requrie the host to have X to enable X for the guest | 17:55 |
| sean-k-mooney | AVX is an exampel you can enable AVX in a guest as long as the host has SSE4 suport | 17:56 |
| cfriesen | sean-k-mooney: not quite true. according to the spec the exposed traits represent the features of the CPU model that you would get in the guest. | 17:56 |
| sean-k-mooney | the new spec | 17:57 |
| cfriesen | In https://specs.openstack.org/openstack/nova-specs/specs/rocky/implemented/report-cpu-features-as-traits.html it says "The libvirt virt-driver should only return the CPU features which are available to the guest." | 17:57 |
| sean-k-mooney | cfriesen: we currently report all cpu feature on the host i belive | 17:57 |
| sean-k-mooney | i dont think we filter by the configured cpu model | 17:58 |
| *** ttsiouts has joined #openstack-nova | 17:58 | |
| cfriesen | sean-k-mooney: see _get_cpu_traits() in virt/libvirt/driver.py | 17:59 |
| openstackgerrit | Merged openstack/nova master: Add a bug tag for nova doc https://review.openstack.org/619434 | 17:59 |
| cfriesen | sean-k-mooney: "if mode is 'custom', use cpu_model to generate CPU features" | 18:00 |
| *** N3l1x has joined #openstack-nova | 18:01 | |
| sean-k-mooney | when the traits were defiend in os tratis they were ment to model the host capablity though | 18:02 |
| cfriesen | so on x86-64 specifying a trait currently *should* result in a guest with the specified CPU feature present, as far as I can tell | 18:02 |
| *** sridharg has quit IRC | 18:02 | |
| sean-k-mooney | cfriesen: that seams to be the case but that was not the intent of the trait | 18:02 |
| cfriesen | why would you care whether a host has a feature if you can't get it in the guest? | 18:02 |
| *** derekh has quit IRC | 18:03 | |
| sean-k-mooney | the trait was ment to allow you to ensure it was not emulated in software | 18:03 |
| sean-k-mooney | the way it currently works i could get avx emulated in software using sse4 which will allow the application to run but will have worese perfromance | 18:04 |
| cfriesen | so I guess you'd need to still use the ComputeCapabilitiesFilter for that? | 18:04 |
| cfriesen | combine that with requesting the trait in the flavor, and you'd get both, no? | 18:04 |
| sean-k-mooney | it still misses the point that HW_CPU_X86_AVX is ment to only be used if the host support it in hardware | 18:06 |
| cfriesen | sean-k-mooney: if ComputeCapabilitiesFilter fails hosts that don't have it in hardware, and specifying the trait requests that it's available in the guest, that seems like it'd work. | 18:07 |
| cfriesen | The other option is to simply not specify CPU models with features unsupported by your hardware...which is up to the operator. | 18:07 |
| sean-k-mooney | it would work but i realy dislike that we are not useing the HW e.g. hardware namespace to model only hardware things | 18:08 |
| cfriesen | sean-k-mooney: have you got any specs/docs for the intent of the trait? | 18:08 |
| sean-k-mooney | that was my intent when i asked for namespacing in os traits https://github.com/openstack/os-traits/commit/23d81d4451dd29c23150b29b8fa9d3025ee8878f#diff-f290aedb8b7fdc21b2b04be76222f6c3 | 18:09 |
| *** dave-mccowan has joined #openstack-nova | 18:10 | |
| sean-k-mooney | the HW namespace was for hardware features | 18:10 |
| cfriesen | we use the "hw" namespace for all sorts of virtual hardware stuff | 18:10 |
| sean-k-mooney | we only started doing that this cylce with the vtpm spec | 18:11 |
| cfriesen | number of numa nodes, cpu distribution between numa nodes, etc | 18:11 |
| cfriesen | oh, you mean for trait | 18:11 |
| sean-k-mooney | yes | 18:11 |
| sean-k-mooney | anyway looks like we approved and implmented https://specs.openstack.org/openstack/nova-specs/specs/rocky/implemented/report-cpu-features-as-traits.html#libvirt so we are stuck with it | 18:12 |
| sean-k-mooney | i was hopping not to make the same mistakes we did with flavors in os-traits but if i can rely on traits to modele this correctly i will always need filters | 18:13 |
| cfriesen | I think it'd be worth adding something to the release notes warning operators to consider this when adding CPU models to the list. | 18:13 |
| cfriesen | In practice, I would expect that most operators advertising high-performance would not want emulated features, no? | 18:13 |
| sean-k-mooney | ya or better to the config option so its in the docs for setting the models/extra flags | 18:14 |
| cfriesen | right, that makes sense | 18:14 |
| sean-k-mooney | cfriesen: yes but as a tenat i can no longer rely on it being a hardware feature in a public cloud | 18:14 |
| sean-k-mooney | i get the opertor usecase but this originally came form the mano folks | 18:15 |
| cfriesen | gotta run for lunch | 18:15 |
| sean-k-mooney | o/ | 18:15 |
| sean-k-mooney | ill comment back on the spec. | 18:16 |
| sean-k-mooney | since we are already missuing them wwe might as well continue | 18:16 |
| *** ralonsoh has quit IRC | 18:21 | |
| *** alex_xu has quit IRC | 18:24 | |
| *** alex_xu has joined #openstack-nova | 18:26 | |
| *** wolverineav has quit IRC | 18:34 | |
| *** wolverineav has joined #openstack-nova | 18:37 | |
| *** priteau has quit IRC | 18:38 | |
| *** ccamacho has quit IRC | 18:40 | |
| *** wolverineav has quit IRC | 18:41 | |
| *** wolverineav has joined #openstack-nova | 18:43 | |
| *** dpawlik has quit IRC | 18:45 | |
| openstackgerrit | Matt Riedemann proposed openstack/nova-specs master: Per aggregate scheduling weight (spec) https://review.openstack.org/599308 | 18:45 |
| *** dpawlik has joined #openstack-nova | 18:46 | |
| mriedem_away | johnthetubaguy: bauzas: ^ when you're around, i'm +2 on ^ now - seems like a good compromise from the per-flavor weights it started from | 18:46 |
| mriedem_away | mgagne_: since you said you had something like this downstream already ^ it would be good if you can ack that works for you as well | 18:46 |
| *** mriedem_away is now known as mriedem | 18:46 | |
| *** manjeets_ is now known as manjeets | 18:47 | |
| *** alex_xu has quit IRC | 18:47 | |
| *** alex_xu has joined #openstack-nova | 18:50 | |
| *** ccamacho has joined #openstack-nova | 18:50 | |
| *** eharney has quit IRC | 18:52 | |
| mgagne_ | mriedem: done. thanks | 18:52 |
| *** ccamacho has quit IRC | 19:00 | |
| *** wolverineav has quit IRC | 19:01 | |
| *** betherly has joined #openstack-nova | 19:01 | |
| *** betherly has quit IRC | 19:06 | |
| *** wolverineav has joined #openstack-nova | 19:16 | |
| *** wolverineav has quit IRC | 19:16 | |
| *** wolverineav has joined #openstack-nova | 19:17 | |
| *** wolverineav has quit IRC | 19:29 | |
| *** ttsiouts has quit IRC | 19:30 | |
| *** ttsiouts has joined #openstack-nova | 19:30 | |
| *** wolverineav has joined #openstack-nova | 19:31 | |
| openstackgerrit | Jack Ding proposed openstack/nova master: Preserve UEFI NVRAM variable store https://review.openstack.org/621646 | 19:32 |
| *** ttsiouts has quit IRC | 19:35 | |
| *** wolverineav has quit IRC | 19:39 | |
| *** wolverineav has joined #openstack-nova | 19:43 | |
| *** wolverineav has quit IRC | 19:46 | |
| *** wolverineav has joined #openstack-nova | 19:46 | |
| *** tbachman has quit IRC | 19:53 | |
| *** spatel has joined #openstack-nova | 20:03 | |
| *** jaosorior has joined #openstack-nova | 20:03 | |
| *** eharney has joined #openstack-nova | 20:05 | |
| *** dtantsur is now known as dtantsur|afk | 20:06 | |
| *** wolverineav has quit IRC | 20:06 | |
| *** wolverineav has joined #openstack-nova | 20:07 | |
| *** wolverineav has quit IRC | 20:18 | |
| *** peeejayz has quit IRC | 20:22 | |
| *** k_mouza has joined #openstack-nova | 20:30 | |
| *** Swami has joined #openstack-nova | 20:32 | |
| *** k_mouza has quit IRC | 20:34 | |
| *** erlon has quit IRC | 20:35 | |
| *** tbachman has joined #openstack-nova | 20:43 | |
| *** dpawlik has quit IRC | 20:44 | |
| *** maciejjozefczyk has quit IRC | 20:48 | |
| *** slaweq has quit IRC | 20:49 | |
| *** wolverineav has joined #openstack-nova | 20:56 | |
| *** wolverineav has quit IRC | 20:58 | |
| *** wolverineav has joined #openstack-nova | 20:58 | |
| *** dpawlik has joined #openstack-nova | 20:59 | |
| *** tssurya has joined #openstack-nova | 20:59 | |
| *** dpawlik has quit IRC | 21:03 | |
| efried | jaypipes, mriedem: Are you waiting for CERN to deploy on ironic nodes before reviewing series at https://review.openstack.org/#/c/615677/ ? | 21:09 |
| mriedem | efried: not really | 21:10 |
| mriedem | i'm not intentionally avoiding it | 21:11 |
| efried | Cool, I know you're stretched pretty thin. | 21:11 |
| mriedem | but my waist line continues to grow | 21:11 |
| mriedem | here is an easy gate related fix https://review.openstack.org/#/c/623011/ | 21:13 |
| mriedem | efried: i've been ignoring some other stuff for awhile so trying to burn that list down first | 21:15 |
| mriedem | reviewing your series will be my xmas gift to you | 21:15 |
| efried | mriedem: +2 on the tempest timeout | 21:15 |
| mriedem | thanks | 21:15 |
| efried | Thanks :) | 21:15 |
| *** sambetts|afk has quit IRC | 21:31 | |
| *** sambetts_ has joined #openstack-nova | 21:33 | |
| *** priteau has joined #openstack-nova | 21:33 | |
| efried | mriedem: reserved=total for which resource? And how do you stop the virt driver from overwriting that? (Re ML post about CERN workaround for low alloc candidates limit) | 21:38 |
| mriedem | VCPU? all of them? | 21:40 |
| dansmith | for the compute node | 21:40 |
| dansmith | for all of them yeah | 21:40 |
| mriedem | the compute would probably need to know if it's service is disabled and if so, not ovewrite it | 21:40 |
| mriedem | *its | 21:41 |
| dansmith | mriedem: I think we discussed just having an rpc cast to compute to have it do it, vs. a periodic | 21:41 |
| mriedem | dansmith: sure, but the next update_available_resource periodic would overwrite it | 21:41 |
| mriedem | when reporting inventory | 21:41 |
| dansmith | the compute can stop calling the virt driver's update method if it's disabled I would think | 21:41 |
| sean-k-mooney | efried: the virt dirver really should not be touching the reserved value excpet when its first creating the RP | 21:41 |
| mriedem | sean-k-mooney: the ironic driver does all the time | 21:41 |
| mriedem | when the node is being cleaned | 21:41 |
| dansmith | sean-k-mooney: uh, why? | 21:41 |
| dansmith | the reserved amount is owned by the virt driver, IMHO | 21:41 |
| mriedem | that's exactly why the placement api change was made so that reserved can equal total | 21:42 |
| dansmith | only the virt driver knows what it should be | 21:42 |
| sean-k-mooney | dansmith: well for the same reason as teh have the cpu allocation ratios vs inital cpu allocation ratios spec | 21:42 |
| efried | agreed, all the inventory values ought to be owned by the virt driver, period. We start making exceptions, we end up with messes like allocation ratio... and reserved. | 21:42 |
| sean-k-mooney | controling via api or config | 21:42 |
| efried | but making that contract stick for this kind of workaround is going to be tricksy. | 21:42 |
| dansmith | sean-k-mooney: that's not an example that helps your case I think :) | 21:42 |
| mriedem | the alternative was a trait i think | 21:43 |
| efried | unless we do it with a handy-dandy provider config yaml file https://review.openstack.org/#/c/612497/ | 21:43 |
| mriedem | and a pre-request placement filter in nova-scheduler | 21:43 |
| mriedem | or something like that | 21:43 |
| mriedem | this isn't blues clues | 21:43 |
| dansmith | mriedem: yeah, that's also an option | 21:43 |
| mriedem | so api sets a trait (or removes it), virt doesn't overwrite it, and scheduler filters on it (essentially it becomes the ComputeFilter) | 21:44 |
| efried | omg, now you totally remind me of Steve from blues clues. | 21:44 |
| sean-k-mooney | efried: provider config yaml for what? | 21:44 |
| mriedem | efried: there were a couple of steves | 21:44 |
| mriedem | or was it one and then another guy? | 21:44 |
| dansmith | mriedem: not scheduler filters, request filter | 21:44 |
| efried | no, there was only one steve. | 21:44 |
| sean-k-mooney | how does that allw you to set it via the api and not have the compute overriede | 21:44 |
| efried | the other guy was... | 21:44 |
| efried | joe? | 21:44 |
| mriedem | yes joe | 21:45 |
| mriedem | http://www.gstatic.com/tv/thumb/persons/250022/250022_v9_ba.jpg | 21:45 |
| * mriedem swoons | 21:45 | |
| mriedem | sean-k-mooney: b/c the compute/virt driver isn't supposed to overwrite externally set traits | 21:45 |
| mriedem | and the api can set traits just like it mirrors aggregates | 21:46 |
| sean-k-mooney | anyway if we say only the entity that created the RP may set the reserved value on the invetories im fine with that if we document it | 21:46 |
| dansmith | I thought there was some other reason for doing the rpc cast on disable, but I can't remember what it was | 21:46 |
| dansmith | maybe so ironic driver can do something? | 21:47 |
| sean-k-mooney | on disableing a compute node. i think some dirver can take actions on disable and ironic might be one of them but i dont remember eiter | 21:47 |
| efried | we can ask each driver's upt to do | 21:48 |
| efried | if self.disabled: | 21:48 |
| efried | <do a right thing to disable the inventory> | 21:48 |
| dansmith | efried: we still have to do it as soon as the api is called though, | 21:48 |
| dansmith | so waiting for the next periodic is not good enough | 21:48 |
| efried | mm | 21:48 |
| dansmith | oh yeah, so.. | 21:49 |
| efried | do we have a ComputeDriver hook that we call on disable? | 21:49 |
| mriedem | right i could disable an entire cell, | 21:49 |
| dansmith | disable is on the service not the node, right? | 21:49 |
| efried | or could/should we implement one? | 21:49 |
| mriedem | er half a cell, and then live migrate stuff within the cell | 21:49 |
| dansmith | so if you disable the thing running on ironic, the nodes will still be schedule-able | 21:49 |
| mriedem | dansmith: yes on the service | 21:49 |
| mriedem | efried: we don't have one for os-services disable no | 21:49 |
| dansmith | so you have to do the service->nodes translation, and set the trait on all the nodes | 21:49 |
| mriedem | we had one for os-hosts update status, but that was something else that only xen implemented | 21:50 |
| dansmith | but if you rpc to the compute, it gets to do that itself | 21:50 |
| mriedem | dansmith: yup | 21:50 |
| efried | um, or we could make upt that thing - i.e. call it immediately on disable | 21:50 |
| *** takashin has joined #openstack-nova | 21:50 | |
| dansmith | mriedem: that also gets wonky if you disable a service and then they rebalance, but you have set the trait on some nodes that rebalanced out | 21:50 |
| sean-k-mooney | mriedem: so the trait way woudl be add status_down trait and change placment query to include status_down forbien trait? | 21:50 |
| *** priteau has quit IRC | 21:50 | |
| dansmith | I guess they'll eventually un-disable, but.. ick | 21:50 |
| dansmith | well, not actualy | 21:50 |
| dansmith | because we just said virt has to leave those alone if the api set them | 21:51 |
| mriedem | sean-k-mooney: essentially yes | 21:51 |
| mriedem | if ComputeFilter is enabled or something | 21:51 |
| dansmith | efried: right point being we don't have an rpc call for disable right now, but I think we probably should | 21:51 |
| mriedem | or some new boolean that replaces ComputeFilter | 21:51 |
| efried | oh, because the disabling is being prompted not by the compute itself. | 21:51 |
| * efried crawls back into hole | 21:52 | |
| mriedem | correct | 21:52 |
| dansmith | it's an api call | 21:52 |
| dansmith | in most cases | 21:52 |
| mriedem | https://developer.openstack.org/api-ref/compute/#compute-services-os-services | 21:52 |
| dansmith | however, | 21:52 |
| sean-k-mooney | well the trait could elminate the host before the filster so we dont need the computeFilter anymore | 21:52 |
| mriedem | if the hypervisor dies the libvirt driver auto-disables it's own compute service | 21:52 |
| dansmith | mriedem: computes can self-disable, so you'd also have to have them be able to set/clear the trait | 21:52 |
| efried | this would be a great use case for sean-k-mooney's reverse-required traits :P | 21:52 |
| mriedem | i smell spec | 21:52 |
| dansmith | if you just let the compute always manage this in response to an rpc call, the ownership of it is a lot more clear I think | 21:52 |
| efried | ++ | 21:52 |
| mriedem | sure i'm fine with rpc call to compute to do the thing | 21:53 |
| sean-k-mooney | efried: you mean the " you cant be schduled to this RP without asking for trait X" | 21:53 |
| mriedem | btw this was the old thing from the os-hosts API https://github.com/openstack/nova/blob/master/nova/compute/api.py#L5026 | 21:53 |
| efried | sean-k-mooney: yeah, that one. | 21:53 |
| mriedem | we could maybe re-use that | 21:53 |
| mriedem | that was only used by this before https://developer.openstack.org/api-ref/compute/#update-host-status | 21:54 |
| mriedem | which is deprecated | 21:54 |
| dansmith | I wonder if jaypipes is okay with a status_enabled or status_disabled trait on compute nodes | 21:55 |
| sean-k-mooney | mriedem was that repalce by the mark host down thing that we added for opnfv | 21:55 |
| mriedem | sean-k-mooney: on | 21:55 |
| mriedem | *no | 21:55 |
| dansmith | m-h-d is not just for opnfv | 21:56 |
| mriedem | sean-k-mooney: https://specs.openstack.org/openstack/nova-specs/specs/pike/implemented/deprecate-os-hosts.html | 21:56 |
| sean-k-mooney | dansmith: ya i know but they where the group i had the most conversation with | 21:56 |
| sean-k-mooney | mriedem the more you know. we have/had a lot of duplicate/legacy apis | 21:57 |
| *** rcernin has joined #openstack-nova | 22:03 | |
| *** betherly has joined #openstack-nova | 22:06 | |
| *** rodolof has quit IRC | 22:11 | |
| *** rodolof has joined #openstack-nova | 22:11 | |
| *** betherly has quit IRC | 22:11 | |
| *** awaugama has quit IRC | 22:13 | |
| *** rodolof has quit IRC | 22:17 | |
| *** efried is now known as efried_out_til_j | 22:17 | |
| *** efried_out_til_j is now known as efried_cya_jan | 22:17 | |
| *** wolverineav has quit IRC | 22:24 | |
| *** wolverineav has joined #openstack-nova | 22:24 | |
| *** udesale has quit IRC | 22:25 | |
| *** mchlumsky has quit IRC | 22:30 | |
| cfriesen | just saw mriedem's mail on placement and disabled computes...rather than mucking around with inventory values why not just explicitly add a separate field that says whether a given RP is enabled or not? | 22:30 |
| mriedem | field? | 22:33 |
| mriedem | omg have you talked to jay or chris ever? | 22:34 |
| mriedem | it's a trait at best | 22:34 |
| mriedem | but jay might not even like that | 22:34 |
| edleafe | cfriesen: because that feels like having placement mirror nova's design. IMO it would be cleaner to set reserved=total | 22:34 |
| mriedem | since it's not a capability | 22:34 |
| edleafe | mriedem: although it would be fun watching Jay foam at the mouth | 22:35 |
| *** dave-mccowan has quit IRC | 22:35 | |
| mriedem | yes i was hoping dan pinging him would summon the beast | 22:35 |
| sean-k-mooney | well the cappablity is its abiltiy to provide resouces. | 22:35 |
| sean-k-mooney | there is proably a general usecase there but ya likely not a new field | 22:35 |
| mriedem | https://assets.rbl.ms/14621189/980x.jpg | 22:36 |
| *** wolverineav has quit IRC | 22:36 | |
| sean-k-mooney | for a second i tought it was a crock and wasl like aw its a lab | 22:37 |
| cfriesen | edleafe: I don't like modifying "reserved" when nova hasn't really reserved anything, and I'm concerned that the math makes no sense if we set "reserved" equal to total but have already-allocated resources as well | 22:37 |
| cfriesen | some sort of flag saying "don't consider this RP" makes more sense, I think | 22:38 |
| sean-k-mooney | cfriesen: if it was a non nova specific one like avaiable then maybe | 22:38 |
| cfriesen | oh, sure. I don't care about the actual name. :) | 22:38 |
| edleafe | cfriesen: I don't like it at all; I just hate it much, much less than adding a nova-specific field | 22:39 |
| sean-k-mooney | cfriesen: if you want jay and other to buy in to it you should :) | 22:39 |
| edleafe | cfriesen: It should be a nova filter ideally | 22:39 |
| mriedem | that's what the trait would do | 22:39 |
| mriedem | provide filtering | 22:39 |
| cfriesen | edleafe: it is already | 22:39 |
| cfriesen | the problem is that if placement only returns disabled compute nodes then nova filters them all out and ends up with novalidhost | 22:40 |
| sean-k-mooney | mriedem: yes and it would just be using required/forben traits which already exist so no placment change requried | 22:40 |
| *** itlinux has quit IRC | 22:40 | |
| sean-k-mooney | we would be jsut establishing it as a patteren | 22:40 |
| *** owalsh_ has joined #openstack-nova | 22:40 | |
| *** amodi_ has quit IRC | 22:41 | |
| sean-k-mooney | the issue is that we are usign placement to store metadata.. again about the resouce which is kindo fo what a trait is but not entirely | 22:41 |
| mriedem | if people don't think that lots of external services, like vcenter agents and such, are going to be dynamically adding/removing traits to coerce scheduling behavior in nova,... | 22:41 |
| mriedem | how many people have already talked about adding basically encoding into traits for the lack of metadata | 22:42 |
| *** owalsh has quit IRC | 22:42 | |
| edleafe | mriedem: "disabled" is a nova concept, not a placement one. If you don't want to use a scheduler filter on the nova side, then create a "disabled" agg, and add/remove compute nodes as needed, then use the upcoming negative member_of. | 22:42 |
| sean-k-mooney | mriedem: i was talking to an onap person at one point and when i told them what placement was they ask if the could use traits to tag the compute nodes with there uuids so they could say where to boot... | 22:42 |
| sean-k-mooney | edleafe: there are paralles in other service | 22:43 |
| mriedem | edleafe: even using forbidden aggregates means nova needs to know to filter on that | 22:43 |
| mriedem | which is tpatil's spec | 22:43 |
| mriedem | https://review.openstack.org/#/c/609960/ | 22:43 |
| mriedem | which is totally complicated for me btw | 22:44 |
| mriedem | but again, i might just be dumb | 22:44 |
| sean-k-mooney | edleafe: you can mark a neutron dataplane as down i would be surprised if cinder does not have something similar | 22:44 |
| edleafe | mriedem: Sure, just include that in every request, since you never want to schedule to a disabled host | 22:44 |
| mriedem | that's what we'd do with a disabled trait as well | 22:44 |
| mriedem | https://developer.openstack.org/api-ref/block-storage/v3/?expanded=freeze-a-cinder-backend-host-detail#freeze-a-cinder-backend-host | 22:45 |
| mriedem | sean-k-mooney: you mean like that ^ | 22:45 |
| sean-k-mooney | yep | 22:45 |
| sean-k-mooney | i think it woudl be common usecase that other servcies woudl use if we figured out a generic way of doing it in nova | 22:46 |
| sean-k-mooney | * in placement | 22:46 |
| *** wolverineav has joined #openstack-nova | 22:47 | |
| cfriesen | how about a "resource unavailable" trait? | 22:47 |
| sean-k-mooney | cfriesen: that is the trait we were suggesting by another name | 22:47 |
| cfriesen | yes | 22:48 |
| cfriesen | just trying to come up with a suitably generic name | 22:49 |
| sean-k-mooney | edleafe: any comment on using a trait? | 22:50 |
| *** wolverineav has quit IRC | 22:51 | |
| edleafe | sean-k-mooney: You mean besides the design that a trait is not for status? | 22:51 |
| sean-k-mooney | edleafe: yep beside the general object ot using placement as a metdata store / etcd standin | 22:52 |
| *** rcernin has quit IRC | 22:52 | |
| edleafe | sean-k-mooney: :) | 22:52 |
| *** rcernin has joined #openstack-nova | 22:52 | |
| *** wolverineav has joined #openstack-nova | 22:53 | |
| mriedem | here are some sufficiently out of band proxy via nova via placement things you guys will probably all like then https://review.openstack.org/#/c/552190/ https://review.openstack.org/#/c/549067/ | 22:54 |
| sean-k-mooney | vmware are aware that openstack in not vspher/vcloud right ... | 22:57 |
| sean-k-mooney | the vmware-vm-groups sound kindof like the tenant aggreate affintiy usecase | 22:58 |
| sean-k-mooney | oh actully | 22:59 |
| sean-k-mooney | ok the usecase is compulte different to what i was expecte form the intro and problem descripteion | 22:59 |
| *** wolverineav has quit IRC | 23:05 | |
| *** munimeha1 has quit IRC | 23:07 | |
| *** wolverineav has joined #openstack-nova | 23:12 | |
| *** mlavalle has quit IRC | 23:16 | |
| *** spatel has quit IRC | 23:22 | |
| *** owalsh_ is now known as owalsh | 23:25 | |
| *** wolverineav has quit IRC | 23:27 | |
| sean-k-mooney | does blazer not use its specs repos | 23:27 |
| *** ttsiouts has joined #openstack-nova | 23:30 | |
| sean-k-mooney | its in tree never mind | 23:30 |
| *** mriedem has quit IRC | 23:31 | |
| *** ttsiouts has quit IRC | 23:32 | |
| tssurya | mriedem: we have filed the bug already regarding placement not knowing about disabled computes: https://bugs.launchpad.net/nova/+bug/1805984 | 23:40 |
| openstack | Launchpad bug 1805984 in OpenStack Compute (nova) "Placement is not aware of disable compute nodes" [Undecided,New] | 23:40 |
| sean-k-mooney | tssurya: its not really a bug its a new feature that shoudl live in nova | 23:41 |
| sean-k-mooney | well not quite | 23:41 |
| sean-k-mooney | its not currently expected that placement would know | 23:41 |
| sean-k-mooney | so its no a bug in that sence | 23:41 |
| *** _alastor_ has quit IRC | 23:44 | |
| *** wolverineav has joined #openstack-nova | 23:45 | |
| tssurya | sean-k-mooney: right agreed its not a bug since it was decided as a won't fix on the placement side (https://bugs.launchpad.net/nova/+bug/1708958) | 23:49 |
| openstack | Launchpad bug 1708958 in OpenStack Compute (nova) "disabling a compute service does not disable the resource provider" [Wishlist,Won't fix] | 23:49 |
| tssurya | but mriedem wanted a bug (was replying to his ML post) | 23:50 |
| sean-k-mooney | tssurya: i set it to triage and wish list with the suggestion of converting to a spec or specless blueprint | 23:50 |
| tssurya | to just track the issue | 23:50 |
| sean-k-mooney | tssurya: if it was neutron i would have just set the RFE tag on the bug but nova does not use that | 23:50 |
| sean-k-mooney | its definetly an edge case an i can see it causeing issues for larger deployments | 23:51 |
| sean-k-mooney | did you see the conversation we had on this an hour ago | 23:52 |
| tssurya | sean-k-mooney: was just scrolling back up to read it :D | 23:56 |
| tssurya | I can see a couple of plausible solutions being proposed | 23:56 |
| sean-k-mooney | yep there are 2 or 3 options | 23:56 |
| tssurya | probably the one where reserved=total + disabling periodic updates on disabled computes to avoid overwrite is the better option | 23:57 |
| sean-k-mooney | it looks like we should be able to come up with somethign | 23:57 |
| tssurya | considering adding another periodic task just for this might be a overhead | 23:57 |
| sean-k-mooney | tssurya: im not sure about that | 23:57 |
| sean-k-mooney | i guess we will see the traits approch or using a disabled aggreate seam like a clean solution | 23:58 |
| tssurya | oh disabled aggregates! didn't see that part yet, reading now | 23:58 |
| sean-k-mooney | tssurya: well a disable aggreage is just an aggrage that we "nova" adds host that are down too and we jsut use the not member_of proposal to avoid | 23:59 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!
