*** slaweq has joined #openstack-nova | 01:11 | |
*** factor has joined #openstack-nova | 01:11 | |
*** slaweq has quit IRC | 01:15 | |
*** zhubx has joined #openstack-nova | 01:24 | |
*** boxiang has quit IRC | 01:25 | |
openstackgerrit | Merged openstack/nova master: DB API changes to get non-matching aggregates from metadata https://review.opendev.org/671074 | 01:34 |
---|---|---|
*** gbarros has quit IRC | 01:44 | |
*** boxiang has joined #openstack-nova | 01:46 | |
*** zhubx has quit IRC | 01:47 | |
*** brinzhang has quit IRC | 02:45 | |
openstackgerrit | Merged openstack/nova master: New objects for NUMA live migration https://review.opendev.org/634827 | 02:57 |
openstackgerrit | Merged openstack/nova master: LM: Use Claims to update numa-related XML on the source https://review.opendev.org/635229 | 02:57 |
*** JamesBenson has joined #openstack-nova | 03:06 | |
*** JamesBenson has quit IRC | 03:08 | |
*** slaweq has joined #openstack-nova | 03:11 | |
*** slaweq has quit IRC | 03:16 | |
*** itlinux has quit IRC | 03:16 | |
*** markvoelker has joined #openstack-nova | 03:29 | |
*** markvoelker has quit IRC | 03:34 | |
*** logan- has quit IRC | 04:48 | |
*** idlemind has quit IRC | 04:48 | |
*** Roamer` has quit IRC | 04:48 | |
*** coreycb has quit IRC | 04:48 | |
*** niceplace_ has quit IRC | 04:48 | |
*** donnyd has quit IRC | 04:48 | |
*** cz2 has quit IRC | 04:48 | |
*** gmann has quit IRC | 04:48 | |
*** jrosser has quit IRC | 04:48 | |
*** masayukig has quit IRC | 04:48 | |
*** rajinir has quit IRC | 04:48 | |
*** dustinc has quit IRC | 04:48 | |
*** dustinc has joined #openstack-nova | 04:49 | |
*** gmann has joined #openstack-nova | 04:49 | |
*** cz2 has joined #openstack-nova | 04:49 | |
*** coreycb has joined #openstack-nova | 04:49 | |
*** donnyd has joined #openstack-nova | 04:49 | |
*** jrosser has joined #openstack-nova | 04:49 | |
*** logan- has joined #openstack-nova | 04:50 | |
*** panda has quit IRC | 04:51 | |
*** idlemind has joined #openstack-nova | 04:54 | |
*** rajinir has joined #openstack-nova | 04:54 | |
*** panda has joined #openstack-nova | 04:54 | |
*** markvoelker has joined #openstack-nova | 04:59 | |
*** markvoelker has quit IRC | 05:03 | |
*** slaweq has joined #openstack-nova | 05:11 | |
*** slaweq has quit IRC | 05:16 | |
openstackgerrit | Merged openstack/nova master: Note about Destination.forbidden_aggregates https://review.opendev.org/680945 | 05:34 |
openstackgerrit | Merged openstack/nova master: Add a new request filter to isolate aggregates https://review.opendev.org/671075 | 05:36 |
openstackgerrit | Merged openstack/nova master: db: Add resources column in instance_extra table https://review.opendev.org/678447 | 06:12 |
*** factor has quit IRC | 06:29 | |
openstackgerrit | Merged openstack/nova master: object: Introduce Resource and ResourceList objs https://review.opendev.org/678448 | 06:33 |
openstackgerrit | Merged openstack/nova master: Add resources dict into _Provider https://review.opendev.org/678449 | 06:33 |
openstackgerrit | Merged openstack/nova master: Set user_id/project_id from context when creating a Migration https://review.opendev.org/679413 | 06:33 |
openstackgerrit | Merged openstack/nova master: Retrieve the allocations early https://review.opendev.org/678450 | 06:33 |
*** ircuser-1 has quit IRC | 06:47 | |
*** slaweq has joined #openstack-nova | 07:11 | |
*** slaweq has quit IRC | 07:15 | |
*** jawad_axd has joined #openstack-nova | 07:32 | |
*** slaweq has joined #openstack-nova | 07:40 | |
*** slaweq has quit IRC | 07:40 | |
*** slaweq has joined #openstack-nova | 07:44 | |
*** slaweq has quit IRC | 07:48 | |
*** slaweq has joined #openstack-nova | 07:51 | |
*** slaweq has quit IRC | 07:51 | |
*** slaweq has joined #openstack-nova | 07:52 | |
*** slaweq has quit IRC | 07:56 | |
*** slaweq has joined #openstack-nova | 07:56 | |
*** pcaruana has joined #openstack-nova | 08:10 | |
*** jawad_axd has quit IRC | 08:19 | |
*** slaweq has quit IRC | 08:31 | |
*** jawad_axd has joined #openstack-nova | 08:56 | |
*** markvoelker has joined #openstack-nova | 09:00 | |
*** markvoelker has quit IRC | 09:04 | |
*** zhubx has joined #openstack-nova | 09:08 | |
*** boxiang has quit IRC | 09:10 | |
*** slaweq has joined #openstack-nova | 09:11 | |
*** Roamer` has joined #openstack-nova | 09:16 | |
openstackgerrit | Merged openstack/nova master: Docs for isolated aggregates request filter https://review.opendev.org/667952 | 09:20 |
*** slaweq has quit IRC | 09:20 | |
*** pcaruana has quit IRC | 09:39 | |
*** jawad_axd has quit IRC | 10:10 | |
openstackgerrit | Merged openstack/nova master: NUMA live migration support https://review.opendev.org/634606 | 11:12 |
*** slaweq has joined #openstack-nova | 11:16 | |
openstackgerrit | garyk proposed openstack/nova master: Deconstruct the mother of all locks https://review.opendev.org/682242 | 11:23 |
*** sapd1_x has joined #openstack-nova | 11:31 | |
*** awalende has joined #openstack-nova | 11:45 | |
*** awalende has quit IRC | 12:01 | |
*** awalende has joined #openstack-nova | 12:01 | |
*** awalende has quit IRC | 12:02 | |
*** awalende_ has joined #openstack-nova | 12:02 | |
*** bbowen has quit IRC | 12:02 | |
*** zhubx has quit IRC | 12:08 | |
*** sapd1_x has quit IRC | 12:08 | |
*** boxiang has joined #openstack-nova | 12:08 | |
*** factor has joined #openstack-nova | 12:10 | |
*** awalende_ has quit IRC | 12:11 | |
*** awalende has joined #openstack-nova | 12:31 | |
*** awalende has quit IRC | 12:32 | |
*** luksky has joined #openstack-nova | 13:03 | |
*** markvoelker has joined #openstack-nova | 13:10 | |
*** markvoelker has quit IRC | 13:15 | |
*** jawad_axd has joined #openstack-nova | 14:14 | |
*** bbowen has joined #openstack-nova | 14:20 | |
*** markvoelker has joined #openstack-nova | 14:21 | |
*** markvoelker has quit IRC | 14:22 | |
*** gbarros has joined #openstack-nova | 14:42 | |
*** MarkMielke has joined #openstack-nova | 14:46 | |
MarkMielke | oslo_utils doesn't seem to have unit tests, but nova does... if oslo_utils needs a fix, is there any special downstream nova process that should be followed to pick it up, and test with it? | 14:48 |
MarkMielke | specifically, I'm talking about https://review.opendev.org/682247 which I just submitted | 14:49 |
sean-k-mooney | oh your fixing that issue | 15:05 |
sean-k-mooney | that is on my todo list | 15:05 |
sean-k-mooney | i personally would add tests to oslo utils | 15:05 |
sean-k-mooney | thats breaking fedora with the virt preview repo enabeld currently | 15:07 |
sean-k-mooney | alshtough im not sure it affct any distros default packages yet? | 15:07 |
MarkMielke | right | 15:07 |
MarkMielke | qemu 4.1 provides important nVMX patches | 15:08 |
*** markvoelker has joined #openstack-nova | 15:08 | |
MarkMielke | so not necessarily in distro | 15:08 |
MarkMielke | can use qemu 4.1 on RHEL 7 if need be | 15:09 |
MarkMielke | all of the tests for outputs seem to be in nova | 15:09 |
MarkMielke | seems like unit test confusion :-) | 15:09 |
sean-k-mooney | non of them shoudl be in nova | 15:09 |
sean-k-mooney | they should all be in oslo_untils | 15:10 |
sean-k-mooney | but i think that code was original ported from nova | 15:10 |
sean-k-mooney | so i guess they did not mvoe the tests | 15:10 |
*** gbarros has quit IRC | 15:10 | |
MarkMielke | I want to add a test, but I'm not familiar with setting it up from scratch, and I don't want to take on doing it all :-) | 15:11 |
sean-k-mooney | nova really should not be asserting the parseing behavior of oslo code so i sustpect the nova tests are just legacy test we did not remove | 15:11 |
MarkMielke | two character fix :-( hehe | 15:11 |
sean-k-mooney | you could add more test in nova but personally i think those are techdebt | 15:11 |
MarkMielke | i agree from observing | 15:12 |
sean-k-mooney | well you could file a bug for the lack of test in oslo_utils | 15:12 |
MarkMielke | good idea | 15:12 |
sean-k-mooney | and submit the ptach without tests. you would have to use a depend on to test the feature in nova | 15:12 |
*** markvoelker has quit IRC | 15:13 | |
sean-k-mooney | but we are pass the non client lib freeze so i dont exepct there to be another oslo release in Train | 15:13 |
MarkMielke | hmm - i wondered about that | 15:13 |
MarkMielke | how important patches get in to dependency libraries | 15:13 |
sean-k-mooney | form a rhel perspective we can always backport this downstream | 15:14 |
MarkMielke | patches to the packages, you mean? | 15:14 |
sean-k-mooney | but i dont really consider this an important patch unless your saying the advance virt strema now ships this by default on rhel 7 | 15:14 |
MarkMielke | well i wondered in general - importance depends upon perspective, so i agree others might not consider it important | 15:15 |
MarkMielke | qemu 4.1 is important for nested virtualization use case | 15:15 |
MarkMielke | it's the first release that officially supports nested virtualization live migration | 15:15 |
sean-k-mooney | nested virt work without it | 15:15 |
MarkMielke | nah, they've eliminated it in 3.1 and 4.0 | 15:15 |
sean-k-mooney | nested virt live migration also work without it | 15:15 |
MarkMielke | because it was fundamentally broken | 15:15 |
MarkMielke | they have a live migration blocker implemented | 15:15 |
MarkMielke | that many distros disable | 15:15 |
sean-k-mooney | you mean live migat of th l1 guest | 15:16 |
MarkMielke | it's basically unsafe | 15:16 |
sean-k-mooney | not the l2 guest | 15:16 |
MarkMielke | there is special KVM state in the L0 hypervisor that isn't transferred prior to qemu 4.1 | 15:16 |
MarkMielke | basically results in undefined memory at the target | 15:16 |
MarkMielke | undefined behaviour is the result ... better not actually be doing nested virtualization previously :-) | 15:17 |
sean-k-mooney | right but are you saying that qemu 4.1 fix live migration of l1 vms that contin l2 vm or live migration of l2 vms | 15:17 |
MarkMielke | yes | 15:17 |
sean-k-mooney | ok that is different | 15:17 |
MarkMielke | the patches were added - and it passes for Oracle and others | 15:17 |
sean-k-mooney | you could previosly safely migrate the l2 guests | 15:17 |
MarkMielke | unfortunately i have a use case that it doesn't work for | 15:17 |
MarkMielke | but they've tried to solve all the edge cases | 15:17 |
MarkMielke | it uses several new kernel features only in Linux 4.19 and later | 15:18 |
MarkMielke | so RHEL 8 would be a candidate for some of it | 15:18 |
sean-k-mooney | rhel 8 is based on 4.18 | 15:18 |
sean-k-mooney | but ya it could be backported | 15:18 |
MarkMielke | yuck i thought it used 4.19 | 15:19 |
sean-k-mooney | nope which is annoying | 15:19 |
sean-k-mooney | but rhel kernel version dont really mena anything | 15:19 |
MarkMielke | Red Hat will just backport most of the patches anyways :-) | 15:19 |
sean-k-mooney | rhel 7 was 3.x and has patch from 4.15 | 15:19 |
*** sapd1_x has joined #openstack-nova | 15:20 | |
sean-k-mooney | i work for redhat by the way which is why i said we could backport the oslo utils change if it was need becaue we stated shiping qemu 4.1 by default on rhel 7 with the advance vert stream | 15:21 |
MarkMielke | https://github.com/qemu/qemu/commit/ebbfef2f34cfc749c045a4569dedb4f748ec024a | 15:21 |
sean-k-mooney | but i dont think we have or we would have got a bug report | 15:21 |
MarkMielke | there are a few patches in the set... but that's one of the important ones | 15:21 |
MarkMielke | I've been tracking these changes and the need for them since 2018, so it being almost usable is great. :-) | 15:24 |
MarkMielke | lots of nVMX patches in Linux 5.0, 5.1, and 5.2 though... so 4.18 will just be annoying to patch to for you | 15:25 |
sean-k-mooney | out of interest why to you need to migrate the l1 guests? are the l1 guest your tenant guest and they are using nested virt on your cloud? | 15:26 |
MarkMielke | in my particular use case - the users have "simulations" of network equipment running in guests | 15:26 |
MarkMielke | previously they were on physical workstations | 15:26 |
MarkMielke | now they are in virtual machines | 15:26 |
MarkMielke | could be an embedded Linux using KVM, or could be Vxworks | 15:27 |
MarkMielke | so those machines are basically not safe to live migration until now | 15:27 |
MarkMielke | i've found the only safe recipe is one by one: | 15:27 |
sean-k-mooney | yes but live migration is really only for mantaince | 15:27 |
MarkMielke | 1) confirm no L2 guests running in the L1 hypervisor | 15:27 |
sean-k-mooney | is that your usecase | 15:27 |
MarkMielke | 2) rmmod kvm_intel | 15:28 |
MarkMielke | 3) live migrate | 15:28 |
MarkMielke | 4) modprobe kvm_intel | 15:28 |
MarkMielke | it's terribly painful for 1700+ machines | 15:28 |
MarkMielke | yes, maintenance - basically to patch the hypervisors | 15:28 |
sean-k-mooney | if you do step 1 then why do you need 2 and 4 | 15:28 |
MarkMielke | or to balance load if necessary (although because of the limitations we basically ensure it is never necessary) | 15:28 |
sean-k-mooney | if there are no l2 guest it should be safe to migrate the l1 | 15:28 |
MarkMielke | because they might have used KVM in past | 15:28 |
MarkMielke | if they used it, and then not using it - it still transfers bad state | 15:29 |
MarkMielke | undefined memory where the KVM state should be | 15:29 |
MarkMielke | the qemu people say it's dangerous always | 15:29 |
MarkMielke | but i haven't hit one problem doing the above | 15:29 |
MarkMielke | i believe it triggers re-initialization of the memory | 15:30 |
sean-k-mooney | ok i was not aware it permently tainted the guest | 15:30 |
MarkMielke | yeah that's why they made live migration blocker | 15:30 |
MarkMielke | they don't want to support it at all after they realized how bad it was | 15:30 |
sean-k-mooney | they have not comunicated that well | 15:30 |
MarkMielke | nope :-) | 15:30 |
MarkMielke | they just went from it working sort of | 15:30 |
sean-k-mooney | if they did we might have considerd blocking it in nova | 15:31 |
MarkMielke | to live migration fails if VMX is enabled on the guest :-) | 15:31 |
MarkMielke | but Ubuntu, Fedora, etc. disable the live migration blocker | 15:31 |
MarkMielke | which I also did in my custom builds | 15:31 |
MarkMielke | because I still need to do it - even if I choose to almost never do it | 15:31 |
*** xek_ has joined #openstack-nova | 15:31 | |
sean-k-mooney | ya i use nested vert all the time. and often migrate l1 guests | 15:32 |
sean-k-mooney | i have never had a problem | 15:32 |
sean-k-mooney | that said i have never migrated an l1 guest with l2 guests | 15:32 |
sean-k-mooney | although i normally end up migrating l2 guest more often the l1 | 15:32 |
sean-k-mooney | os that s proably why | 15:33 |
MarkMielke | i've never done l2 guest myself - but i know that the users do it on their own, because that's really their use case | 15:33 |
MarkMielke | they just know they want to move the guest from point A to point B | 15:33 |
MarkMielke | no idea it's L2 or not :-) | 15:33 |
sean-k-mooney | well on my dev systems im spinning up l1 guests to run devstack and then testing live migartion move l2 guests around | 15:34 |
MarkMielke | ah right | 15:34 |
MarkMielke | openstack on openstack :-) | 15:34 |
*** gbarros has joined #openstack-nova | 15:34 | |
sean-k-mooney | so for me l1 is simulating a cloud and l2 is my test workload | 15:34 |
sean-k-mooney | and yes but not with tripleO | 15:34 |
MarkMielke | tripleO doesn't even mean tripleO anymore, right? doesn't it mean OpenStack on K8? haha | 15:35 |
sean-k-mooney | not yet | 15:35 |
sean-k-mooney | but yat they are slowlow dismanteling the undercloud | 15:35 |
sean-k-mooney | personally i much prefer kolla-ansible or OSA | 15:36 |
MarkMielke | me too | 15:36 |
sean-k-mooney | triplo is too complicated | 15:36 |
sean-k-mooney | and has too much techdebt in all its layers | 15:36 |
MarkMielke | it's somewhat purist without regard to consequences | 15:36 |
MarkMielke | my view :-) | 15:37 |
sean-k-mooney | im not sure i would agree. i think it use to be more pure and simple | 15:37 |
sean-k-mooney | and now with contariation its less pure and more complicated | 15:37 |
sean-k-mooney | lucally while i have to debug customer systems ocationally (mainly via logs) i dont actuly need to use triplO day to day | 15:38 |
MarkMielke | Kayobe is the one that was appealing to me | 15:39 |
MarkMielke | Ironic in stand-alone mode | 15:39 |
MarkMielke | Kolla | 15:39 |
MarkMielke | Ansible | 15:39 |
sean-k-mooney | yep when i work at intel i pitched basically what they implemented internlaly | 15:39 |
sean-k-mooney | i wrote the original kolla biforst container | 15:39 |
MarkMielke | cool | 15:40 |
sean-k-mooney | i really wanted to see koll ansibel become the default openstack installer but i dont really work on the installer anymore | 15:40 |
MarkMielke | I think it will pick up. | 15:42 |
sean-k-mooney | if kaobe does then yes | 15:42 |
sean-k-mooney | *kayobe | 15:42 |
MarkMielke | It's so much simpler. | 15:43 |
sean-k-mooney | yep | 15:43 |
sean-k-mooney | its simple to debug and extend | 15:43 |
sean-k-mooney | the config overrde mechanisum is easy to use | 15:43 |
sean-k-mooney | and no puppet/ruby | 15:43 |
sean-k-mooney | which is defintly a win | 15:43 |
MarkMielke | Running Kubernetes on hypervisors seems overly complex to me personally. It's not really the right use case for it. | 15:43 |
MarkMielke | If you were running Docker containers - sure... but virtual machines from within Nova/libvirtd/qemu? I don't think so. | 15:44 |
sean-k-mooney | the last thing i was trying to push in kolla before i stope working on it was move to running the contaienr using systemd service file | 15:44 |
sean-k-mooney | so that tehre was a determinisitc order to them on host reboot | 15:44 |
MarkMielke | the move away from "Docker" may help with that :-) | 15:45 |
sean-k-mooney | what are they moving too | 15:45 |
MarkMielke | podman, etc. | 15:45 |
sean-k-mooney | ah ok | 15:45 |
sean-k-mooney | ya podman now create the unit file for you | 15:45 |
MarkMielke | RHEL 8 pushing that hard | 15:45 |
sean-k-mooney | in the lates version | 15:45 |
MarkMielke | doesn't come with Docker even in Extras. :-) | 15:45 |
sean-k-mooney | not as much as you would think | 15:45 |
sean-k-mooney | well docker yes | 15:46 |
MarkMielke | we didn't move up to RHEL 8 yes - will start to soon - but Docker being gone was a surprise to me | 15:46 |
sean-k-mooney | but redhat is not really encouraging use to work upstream in kolla | 15:46 |
sean-k-mooney | to move kolla ansible to podman | 15:46 |
MarkMielke | right | 15:46 |
sean-k-mooney | i was thinking about getting involved again to help with that but people internally didnt care that much so i focused on nova | 15:47 |
MarkMielke | only so much time in day :-) | 15:47 |
sean-k-mooney | they didnt disucrage me but suggested i look at getting involved in triplo instead | 15:48 |
sean-k-mooney | and i have no interst in that | 15:48 |
MarkMielke | at OpenStack conference, I thought it was amusing when they were talking about future of TripleO | 15:48 |
MarkMielke | and one of the Kayobe people spoke up "we've already done this" | 15:48 |
*** markvoelker has joined #openstack-nova | 15:49 | |
MarkMielke | it's fine though - community needs to develop ideas and then discover intersection of common objectives | 15:49 |
sean-k-mooney | well i mention trying to adopt kayobe when the topic of simplify triople o came up and it was more or less ignored | 15:49 |
sean-k-mooney | there is too much of a sunken cost falacy around triplo | 15:50 |
MarkMielke | yeah i see that | 15:50 |
MarkMielke | but despite working a bit in parallel and duplication of work | 15:51 |
sean-k-mooney | they have a vaild point that we would have to support migarate all existing customer to it | 15:51 |
MarkMielke | they're converging | 15:51 |
sean-k-mooney | but that seams simpler to solve then simplfying triple0 | 15:51 |
MarkMielke | if TripleO is using containers and Ansible for deployment by the end of it | 15:51 |
sean-k-mooney | they will diverge again when triplo moves to k8s | 15:51 |
MarkMielke | it's not really that different from Kayobe | 15:51 |
*** redrobot has quit IRC | 15:52 | |
MarkMielke | more superficial than not | 15:52 |
MarkMielke | just taking the long way around to get to that point | 15:52 |
MarkMielke | :-) | 15:52 |
sean-k-mooney | well kayobe and kolla-ansible will not move to running the contaienr in k8s | 15:53 |
sean-k-mooney | so while the continer may be the same | 15:53 |
sean-k-mooney | all the tooling around upgrades and operation will diverge | 15:53 |
MarkMielke | yeah, the orchestration around how runc launches will be different | 15:53 |
MarkMielke | but fundamentally, it'll be the same technology doing the same thing underneath | 15:53 |
MarkMielke | two groups vehemently disagreeing | 15:54 |
MarkMielke | but fundamentally agreeing :-) | 15:54 |
*** markvoelker has quit IRC | 15:54 | |
MarkMielke | you can see how I am jaded :-) | 15:55 |
MarkMielke | i haven't used podman yet much - but the idea that it supports Kubernetes pods, | 15:56 |
MarkMielke | is interesting | 15:56 |
sean-k-mooney | well it does and it does not | 15:56 |
sean-k-mooney | it suport the cncf cri | 15:56 |
sean-k-mooney | it also provides cli compatiablity with docker | 15:57 |
sean-k-mooney | so you can use it to interact/manage pods but on its own it would do any of the orchstartion fo the pods that k8s does | 15:58 |
MarkMielke | probably with some limitations, it still means that something designer for Kubernetes | 15:58 |
MarkMielke | can almost work in stand-alone capacity | 15:58 |
sean-k-mooney | for example without the newst version it wont start the contaner after a host reboot | 15:58 |
MarkMielke | systemd :-) | 15:58 |
sean-k-mooney | the newest version will creat systemd files for you to implement docker restart policies | 15:58 |
sean-k-mooney | before that you had to do it by hand | 15:58 |
MarkMielke | as you mentioned earlier - | 15:59 |
MarkMielke | i like the systemd model of managing containers | 15:59 |
MarkMielke | vs the brainless auto-restart | 15:59 |
sean-k-mooney | where as the k8s kubelet would have done that via the podsepc | 15:59 |
MarkMielke | dependency management, as well as notification of when an application is up and healthy | 15:59 |
sean-k-mooney | so its more a tool for defineing pods on a local system without any of the orchetration | 16:00 |
MarkMielke | primarily for development stand-alone vs running in a production cluster with overhead | 16:00 |
MarkMielke | right? | 16:00 |
sean-k-mooney | kind of but it can be used as a building block for you orchelstartion | 16:00 |
sean-k-mooney | it does support heatbeat continer for examle | 16:01 |
sean-k-mooney | but no direct graphs fo dependce | 16:01 |
sean-k-mooney | that said systemd supports that so who know what will happnen | 16:01 |
MarkMielke | that's what i would mostly use systemd for | 16:01 |
sean-k-mooney | ya you are just missing the syntax in podman to express the depences | 16:01 |
sean-k-mooney | then rely on the before/after freatuers in systemd or targets | 16:02 |
sean-k-mooney | to tie it all toghter | 16:02 |
MarkMielke | today we cheat a bit... /etc/systemd/system/docker.conf.d/ lists dependencies, but they all dependencies for all contianers | 16:02 |
MarkMielke | so delay docker start until pre-requisites are met | 16:02 |
MarkMielke | it's not great for inter-container dependencies | 16:02 |
MarkMielke | i.e. PostgreSQL should be up before Jira | 16:04 |
MarkMielke | we mostly rely on PostgreSQL coming up really really fast :-) | 16:04 |
MarkMielke | and Jira, in Java, coming up slow | 16:04 |
sean-k-mooney | what i wanted to fix in kolla is that the ovsdb shoudl be up before the ovs-vswtichd starts | 16:04 |
MarkMielke | do you containerize those too? or you just mean in general | 16:05 |
sean-k-mooney | no ovs is containerised | 16:05 |
sean-k-mooney | it runs with net=host | 16:05 |
MarkMielke | interesting - I guess it's fine since the data plane is in kernel | 16:05 |
sean-k-mooney | not always | 16:06 |
sean-k-mooney | that is what i was trying to fix | 16:06 |
sean-k-mooney | if you are using ovs-dpdk where the dataplane is in userspace | 16:06 |
sean-k-mooney | the ovsdb need to be started first | 16:06 |
MarkMielke | ah | 16:06 |
sean-k-mooney | so that the vswtihcd can detect that dpdk is enabled when it starts up | 16:06 |
MarkMielke | ovs-dpdk... that's an interesting one for a related subject... | 16:07 |
MarkMielke | it's presumedly faster than kernel, but I also discovered that the Red Hat builds of Docker use seccomp | 16:07 |
MarkMielke | and seccomp normally triggers some of the more expensive Spectre mitigations | 16:08 |
MarkMielke | i think i have that right | 16:08 |
MarkMielke | do you disable that? | 16:08 |
sean-k-mooney | by default redhat does not tend to disabel security feature | 16:09 |
sean-k-mooney | im not sure it would impact dpdk performace it might | 16:10 |
sean-k-mooney | when we mesure something like that as an imparct | 16:10 |
sean-k-mooney | we usually docmet how to disable it and let it up to the custoemr | 16:10 |
MarkMielke | it disables indirect branch spectulation for the threads :-( | 16:10 |
MarkMielke | i started changing them to prctl instead of seccomp | 16:11 |
sean-k-mooney | if there threat profile allwos it then there is no reas for them to not do it but they need to make that threat assement themselves | 16:11 |
MarkMielke | but then I found that Red Hat build of OpenJDK also uses prctl :-) | 16:11 |
MarkMielke | so now we often disable it entirely (shocker!) | 16:11 |
MarkMielke | hehe | 16:12 |
*** gbarros has quit IRC | 16:12 | |
sean-k-mooney | my dev machines uses to have almost all the mitgation disabled at one point | 16:13 |
MarkMielke | i settled on a config which ends up being similar to RHEL 7.7 ended up setting by default | 16:13 |
MarkMielke | spectre_v2=retpoline | 16:13 |
sean-k-mooney | it got kind fo annoying to have to keep updating my grub config | 16:13 |
MarkMielke | ok - well i should get a few other things done. Thanks for the chat. I think I'll open that bug with regard to oslo_utils unit tests being left in nova. | 16:15 |
sean-k-mooney | o/ | 16:15 |
MarkMielke | and if it's easy to add test i'll add to oslo_utils, but if too hard, i may add another test or two for nova as separate submission | 16:15 |
*** ralonsoh has joined #openstack-nova | 16:16 | |
sean-k-mooney | ralonsoh: its a sunday what are you doing on irc | 16:17 |
ralonsoh | hahahaah and you?? | 16:17 |
ralonsoh | sean-k-mooney, I'm trying to fix an small problem | 16:17 |
MarkMielke | it's always a small problem | 16:17 |
sean-k-mooney | im playing eve online and have it open on another monitor | 16:17 |
ralonsoh | hahahahhaah | 16:17 |
MarkMielke | then before you know it | 16:17 |
MarkMielke | your whole weekend is gone on that small problem :-) | 16:17 |
ralonsoh | no no, it's going to be just a simple commit | 16:18 |
MarkMielke | so was mine | 16:18 |
MarkMielke | haha | 16:18 |
MarkMielke | two characters | 16:18 |
sean-k-mooney | ralonsoh: im also watching the gate to make sure everythin merges | 16:18 |
*** yankcrime has joined #openstack-nova | 16:20 | |
*** markvoelker has joined #openstack-nova | 16:24 | |
*** markvoelker has quit IRC | 16:29 | |
*** factor has quit IRC | 16:50 | |
*** factor has joined #openstack-nova | 16:50 | |
*** macz has joined #openstack-nova | 16:57 | |
*** sapd1_x has quit IRC | 17:28 | |
*** ociuhandu has joined #openstack-nova | 17:29 | |
*** slaweq_ has joined #openstack-nova | 17:36 | |
MarkMielke | Correction for above conversation... oslo_utils does have tests for units. I missed them because I was looking for qemu-info info sample output and "virtual size". This does exist in Nova. However, there is unit tests for parsing the value portion of the qemu-img info output in oslo_utils, and I can easily add tests here for QEMU 4.1. | 17:49 |
*** slaweq_ has quit IRC | 18:02 | |
*** ociuhandu has quit IRC | 18:12 | |
*** pcaruana has joined #openstack-nova | 18:17 | |
*** slaweq_ has joined #openstack-nova | 18:25 | |
*** slaweq_ has quit IRC | 18:42 | |
*** factor has quit IRC | 19:17 | |
*** gbarros has joined #openstack-nova | 19:34 | |
*** gbarros has quit IRC | 19:59 | |
openstackgerrit | Merged openstack/nova master: Claim resources in resource tracker https://review.opendev.org/678452 | 20:13 |
*** ralonsoh has quit IRC | 20:15 | |
*** gbarros has joined #openstack-nova | 20:18 | |
*** gbarros has quit IRC | 20:23 | |
*** pcaruana has quit IRC | 20:24 | |
*** slaweq_ has joined #openstack-nova | 20:30 | |
*** macz has quit IRC | 20:32 | |
*** gbarros has joined #openstack-nova | 20:43 | |
*** gbarros has quit IRC | 20:51 | |
*** gbarros has joined #openstack-nova | 21:00 | |
openstackgerrit | Merged openstack/nova master: libvirt: Enable driver discovering PMEM namespaces https://review.opendev.org/678453 | 21:22 |
*** jawad_axd has quit IRC | 21:31 | |
*** markvoelker has joined #openstack-nova | 21:31 | |
*** markvoelker has quit IRC | 21:35 | |
openstackgerrit | Merged openstack/nova master: libvirt: report VPMEM resources by provider tree https://review.opendev.org/678454 | 21:36 |
openstackgerrit | Merged openstack/nova master: libvirt: Support VM creation with vpmems and vpmems cleanup https://review.opendev.org/678455 | 21:36 |
*** luksky has quit IRC | 21:42 | |
*** slaweq has quit IRC | 22:14 | |
*** slaweq_ has quit IRC | 22:14 | |
*** jhesketh has quit IRC | 22:21 | |
*** macz has joined #openstack-nova | 22:47 | |
*** macz has quit IRC | 22:47 | |
*** factor has joined #openstack-nova | 22:51 | |
*** factor has quit IRC | 22:51 | |
*** markvoelker has joined #openstack-nova | 23:03 | |
*** xek_ has quit IRC | 23:04 | |
*** rcernin has joined #openstack-nova | 23:04 | |
*** markvoelker has quit IRC | 23:09 | |
*** ircuser-1 has joined #openstack-nova | 23:27 | |
*** icarusfactor has joined #openstack-nova | 23:29 | |
*** icarusfactor is now known as factor | 23:29 | |
*** boxiang has quit IRC | 23:30 | |
*** boxiang has joined #openstack-nova | 23:31 | |
*** zhubx has joined #openstack-nova | 23:34 | |
*** boxiang has quit IRC | 23:37 | |
*** brinzhang has joined #openstack-nova | 23:55 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!