| *** rodolof has quit IRC | 00:07 | |
| *** dave-mccowan has quit IRC | 00:23 | |
| *** sapd1_ has joined #openstack-nova | 00:36 | |
| *** sapd1_ has quit IRC | 00:44 | |
| *** brinzhang has joined #openstack-nova | 00:53 | |
| *** dave-mccowan has joined #openstack-nova | 00:57 | |
| *** Nel1x has quit IRC | 01:02 | |
| *** sapd1_ has joined #openstack-nova | 01:07 | |
| *** sapd1_ has quit IRC | 01:19 | |
| *** markvoelker has quit IRC | 01:21 | |
| *** markvoelker has joined #openstack-nova | 01:22 | |
| *** markvoelker has quit IRC | 01:26 | |
| *** tetsuro has joined #openstack-nova | 01:27 | |
| *** hongbin has quit IRC | 01:45 | |
| *** tiendc has joined #openstack-nova | 01:46 | |
| *** sapd1_ has joined #openstack-nova | 01:50 | |
| *** thanhnb has joined #openstack-nova | 01:54 | |
| *** fanzhang has joined #openstack-nova | 01:54 | |
| *** wolverineav has joined #openstack-nova | 02:02 | |
| *** fanzhang has quit IRC | 02:04 | |
| *** lei-zh has joined #openstack-nova | 02:07 | |
| *** mrsoul has quit IRC | 02:11 | |
| *** mschuppert has quit IRC | 02:11 | |
| *** lbragstad has quit IRC | 02:13 | |
| *** Dinesh_Bhor has joined #openstack-nova | 02:15 | |
| *** lbragstad has joined #openstack-nova | 02:16 | |
| *** Dinesh_Bhor has quit IRC | 02:17 | |
| openstackgerrit | Takashi NATSUME proposed openstack/nova master: Add descriptions of numbered resource classes and traits https://review.openstack.org/621494 | 02:20 |
|---|---|---|
| *** bhagyashris has joined #openstack-nova | 02:21 | |
| *** itlinux has quit IRC | 02:29 | |
| *** mhen has quit IRC | 02:32 | |
| *** mhen has joined #openstack-nova | 02:34 | |
| *** Dinesh_Bhor has joined #openstack-nova | 02:35 | |
| *** fanzhang has joined #openstack-nova | 02:54 | |
| *** wxy-xiyuan has joined #openstack-nova | 02:54 | |
| *** alex_xu has joined #openstack-nova | 02:55 | |
| *** wolverineav has quit IRC | 02:55 | |
| *** wolverineav has joined #openstack-nova | 02:56 | |
| *** psachin has joined #openstack-nova | 02:59 | |
| openstackgerrit | Zhenyu Zheng proposed openstack/nova master: WIP detach root volume API changes https://review.openstack.org/623981 | 03:05 |
| *** hongbin has joined #openstack-nova | 03:05 | |
| *** Kevin_Zheng has joined #openstack-nova | 03:09 | |
| *** wolverineav has quit IRC | 03:13 | |
| *** lbragstad has quit IRC | 03:38 | |
| *** udesale has joined #openstack-nova | 03:40 | |
| *** wolverineav has joined #openstack-nova | 03:44 | |
| *** Dinesh_Bhor has quit IRC | 03:46 | |
| *** Dinesh_Bhor has joined #openstack-nova | 03:55 | |
| *** hongbin has quit IRC | 04:00 | |
| *** tetsuro has quit IRC | 04:03 | |
| *** wolverineav has quit IRC | 04:19 | |
| *** wolverineav has joined #openstack-nova | 04:19 | |
| *** zzzeek has quit IRC | 04:41 | |
| *** zzzeek has joined #openstack-nova | 04:41 | |
| *** dave-mccowan has quit IRC | 04:53 | |
| *** bhagyashris has quit IRC | 05:00 | |
| *** pooja_jadhav has joined #openstack-nova | 05:00 | |
| *** sapd1_ has quit IRC | 05:05 | |
| *** sapd1_ has joined #openstack-nova | 05:18 | |
| openstackgerrit | Ghanshyam Mann proposed openstack/nova stable/rocky: DNM: For testing multinode and tempest-slow job https://review.openstack.org/623990 | 05:21 |
| *** sapd1_ has quit IRC | 05:23 | |
| *** khomesh has joined #openstack-nova | 05:24 | |
| *** wolverineav has quit IRC | 05:26 | |
| *** sridharg has joined #openstack-nova | 05:27 | |
| *** pooja_jadhav has quit IRC | 05:31 | |
| openstackgerrit | Ghanshyam Mann proposed openstack/nova stable/queens: DNM: For testing multinode and tempest-slow job https://review.openstack.org/623992 | 05:32 |
| *** wolverineav has joined #openstack-nova | 05:43 | |
| *** wolverineav has quit IRC | 05:46 | |
| *** ratailor has joined #openstack-nova | 05:56 | |
| *** brinzhang_ has joined #openstack-nova | 06:01 | |
| *** sapd1_ has joined #openstack-nova | 06:03 | |
| openstackgerrit | Merged openstack/nova master: Transform scheduler.select_destinations notification https://review.openstack.org/508506 | 06:05 |
| brinzhang | #join #oo | 06:10 |
| openstackgerrit | Zhenyu Zheng proposed openstack/nova master: Bump compute service to indicate attach/detach root volume is supported https://review.openstack.org/614750 | 06:10 |
| openstackgerrit | Zhenyu Zheng proposed openstack/nova master: WIP detach root volume API changes https://review.openstack.org/623981 | 06:12 |
| *** brinzhang has quit IRC | 06:13 | |
| *** wolverineav has joined #openstack-nova | 06:24 | |
| *** _alastor_ has joined #openstack-nova | 06:29 | |
| *** takashin has left #openstack-nova | 06:44 | |
| openstackgerrit | Takashi NATSUME proposed openstack/nova master: Remove mox in unit/network/test_neutronv2.py (3) https://review.openstack.org/574104 | 06:47 |
| *** sapd1_ has quit IRC | 06:48 | |
| *** sapd__ has joined #openstack-nova | 06:48 | |
| *** moshele has joined #openstack-nova | 06:53 | |
| *** sapd__ has quit IRC | 06:55 | |
| *** Luzi has joined #openstack-nova | 06:58 | |
| *** wolverineav has quit IRC | 07:00 | |
| belmoreira | leakypipes: thanks. I will give you feedback asap | 07:04 |
| *** belmoreira has quit IRC | 07:04 | |
| *** alexchadin has joined #openstack-nova | 07:16 | |
| *** belmoreira has joined #openstack-nova | 07:16 | |
| *** belmoreira has quit IRC | 07:18 | |
| *** belmoreira has joined #openstack-nova | 07:18 | |
| *** dpawlik has joined #openstack-nova | 07:22 | |
| *** rcernin has quit IRC | 07:23 | |
| openstackgerrit | Rui Zang proposed openstack/nova-specs master: support virtual persistent memory https://review.openstack.org/601596 | 07:23 |
| *** udesale has quit IRC | 07:24 | |
| openstackgerrit | Rui Zang proposed openstack/nova-specs master: Virtual persistent memory libvirt driver implementation https://review.openstack.org/622893 | 07:25 |
| *** moshele has quit IRC | 07:26 | |
| *** moshele has joined #openstack-nova | 07:32 | |
| *** ondrejme has joined #openstack-nova | 07:40 | |
| *** slaweq has joined #openstack-nova | 07:47 | |
| *** rodolof has joined #openstack-nova | 07:49 | |
| *** ccamacho has joined #openstack-nova | 07:55 | |
| *** Dinesh_Bhor has quit IRC | 07:57 | |
| *** _alastor_ has quit IRC | 08:00 | |
| *** sahid has joined #openstack-nova | 08:03 | |
| *** trident has quit IRC | 08:10 | |
| *** evrardjp_ is now known as evrardjp | 08:11 | |
| *** tetsuro has joined #openstack-nova | 08:11 | |
| *** helenafm has joined #openstack-nova | 08:11 | |
| *** trident has joined #openstack-nova | 08:13 | |
| *** wolverineav has joined #openstack-nova | 08:16 | |
| *** xek has joined #openstack-nova | 08:18 | |
| *** wolverineav has quit IRC | 08:20 | |
| *** imacdonn has quit IRC | 08:22 | |
| *** bhagyashris has joined #openstack-nova | 08:22 | |
| *** imacdonn has joined #openstack-nova | 08:22 | |
| *** skatsaounis has joined #openstack-nova | 08:25 | |
| *** jonher_ has joined #openstack-nova | 08:30 | |
| *** jonher has quit IRC | 08:31 | |
| *** jonher_ is now known as jonher | 08:31 | |
| *** adrianc has quit IRC | 08:31 | |
| *** adrianc has joined #openstack-nova | 08:43 | |
| openstackgerrit | Zhenyu Zheng proposed openstack/nova master: Bump compute service to indicate attach/detach root volume is supported https://review.openstack.org/614750 | 08:45 |
| openstackgerrit | Zhenyu Zheng proposed openstack/nova master: WIP detach root volume API changes https://review.openstack.org/623981 | 08:46 |
| *** udesale has joined #openstack-nova | 08:49 | |
| *** bhagyashris has quit IRC | 08:51 | |
| *** ralonsoh has joined #openstack-nova | 08:53 | |
| kaisers | kaisers | 08:57 |
| *** bhagyashris has joined #openstack-nova | 08:59 | |
| *** Dinesh_Bhor has joined #openstack-nova | 09:00 | |
| openstackgerrit | Silvan Kaiser proposed openstack/nova master: Exec systemd-run without --user flag in Quobyte driver https://review.openstack.org/554195 | 09:00 |
| *** Dinesh_Bhor has quit IRC | 09:09 | |
| openstackgerrit | Balazs Gibizer proposed openstack/nova master: Final release note for versioned notification transformation https://review.openstack.org/624022 | 09:14 |
| *** k_mouza has joined #openstack-nova | 09:15 | |
| *** tssurya has joined #openstack-nova | 09:16 | |
| *** leakypipes has quit IRC | 09:19 | |
| openstackgerrit | Lee Yarwood proposed openstack/nova master: compute: Reject migration requests when source is down https://review.openstack.org/623489 | 09:28 |
| *** derekh has joined #openstack-nova | 09:31 | |
| *** bhagyashris has quit IRC | 09:38 | |
| openstackgerrit | Balazs Gibizer proposed openstack/nova master: Transfer port.resource_request to the scheduler https://review.openstack.org/567268 | 09:44 |
| openstackgerrit | Balazs Gibizer proposed openstack/nova master: Extend RequestGroup object for mapping https://review.openstack.org/619527 | 09:44 |
| openstackgerrit | Balazs Gibizer proposed openstack/nova master: Calculate RequestGroup resource provider mapping https://review.openstack.org/616239 | 09:44 |
| openstackgerrit | Balazs Gibizer proposed openstack/nova master: Fill the RequestGroup mapping during schedule https://review.openstack.org/619528 | 09:44 |
| openstackgerrit | Balazs Gibizer proposed openstack/nova master: Pass resource provider mapping to neutronv2 api https://review.openstack.org/616240 | 09:44 |
| openstackgerrit | Balazs Gibizer proposed openstack/nova master: Recalculate request group - RP mapping during re-schedule https://review.openstack.org/619529 | 09:44 |
| openstackgerrit | Balazs Gibizer proposed openstack/nova master: Send RP uuid in the port binding https://review.openstack.org/569459 | 09:44 |
| openstackgerrit | Balazs Gibizer proposed openstack/nova master: Test boot with more ports with bandwidth request https://review.openstack.org/573317 | 09:44 |
| openstackgerrit | Balazs Gibizer proposed openstack/nova master: Reject interface attach with QoS aware port https://review.openstack.org/570078 | 09:44 |
| openstackgerrit | Balazs Gibizer proposed openstack/nova master: Reject networks with QoS policy https://review.openstack.org/570079 | 09:44 |
| openstackgerrit | Balazs Gibizer proposed openstack/nova master: Remove port allocation during detach https://review.openstack.org/622421 | 09:44 |
| openstackgerrit | Balazs Gibizer proposed openstack/nova master: Ensure that allocated PF matches the used PF https://review.openstack.org/623543 | 09:44 |
| *** tetsuro has quit IRC | 09:44 | |
| *** k_mouza has quit IRC | 09:45 | |
| *** k_mouza has joined #openstack-nova | 09:46 | |
| *** Dinesh_Bhor has joined #openstack-nova | 09:46 | |
| *** Dinesh_Bhor has quit IRC | 09:47 | |
| *** sapd1_ has joined #openstack-nova | 09:54 | |
| *** lei-zh has quit IRC | 10:00 | |
| openstackgerrit | Merged openstack/nova master: Add ratio online data migration when load compute node https://review.openstack.org/613499 | 10:05 |
| *** sapd1_ has quit IRC | 10:06 | |
| openstackgerrit | Merged openstack/nova master: Add compute_node ratio online data migration script https://review.openstack.org/609995 | 10:11 |
| openstackgerrit | Merged openstack/nova master: Note the aggregate allocation ratio restriction in scheduler docs https://review.openstack.org/620713 | 10:11 |
| *** izza_ has joined #openstack-nova | 10:17 | |
| izza_ | hi | 10:17 |
| izza_ | anyone here already deployed volume with attached image (windows) in openstack tripleo | 10:18 |
| izza_ | need help pls | 10:18 |
| *** udesale has quit IRC | 10:18 | |
| *** betherly has joined #openstack-nova | 10:22 | |
| *** jarodwl has quit IRC | 10:25 | |
| *** priteau has joined #openstack-nova | 10:28 | |
| openstackgerrit | Merged openstack/nova stable/rocky: Ignore MoxStubout deprecation warnings https://review.openstack.org/623545 | 10:30 |
| *** dpawlik has quit IRC | 10:39 | |
| *** cdent has joined #openstack-nova | 10:41 | |
| *** dpawlik has joined #openstack-nova | 10:45 | |
| *** sapd1_ has joined #openstack-nova | 10:52 | |
| *** sapd1_ has quit IRC | 10:58 | |
| *** k_mouza has quit IRC | 11:09 | |
| *** thanhnb has quit IRC | 11:10 | |
| *** udesale has joined #openstack-nova | 11:11 | |
| *** erlon has joined #openstack-nova | 11:18 | |
| *** tiendc has quit IRC | 11:19 | |
| *** izza_ has quit IRC | 11:21 | |
| openstackgerrit | Chris Dent proposed openstack/nova master: Add python 3.7 unit and functional tox jobs https://review.openstack.org/624055 | 11:24 |
| *** dtantsur|afk is now known as dtantsur | 11:25 | |
| openstackgerrit | Chris Dent proposed openstack/nova master: Use external placement in functional tests https://review.openstack.org/617941 | 11:29 |
| openstackgerrit | Chris Dent proposed openstack/nova master: Delete the placement code https://review.openstack.org/618215 | 11:29 |
| *** k_mouza has joined #openstack-nova | 11:30 | |
| *** sapd1_ has joined #openstack-nova | 11:39 | |
| *** sapd1_ has quit IRC | 11:43 | |
| *** tbachman has quit IRC | 11:46 | |
| cdent | thanks for continuing to +2 the placement functional stuff gibi, we'll get it merged one of these days | 11:46 |
| gibi | cdent: this morning when I did a git pull I got happy as the pull brought in the deletion of placement related files. But then I had to realize that it was just api sample removal not your patch (yet) | 11:48 |
| cdent | :) | 11:48 |
| *** brinzhang_ has quit IRC | 12:20 | |
| *** dpawlik has quit IRC | 12:23 | |
| openstackgerrit | Chris Dent proposed openstack/nova master: Add python 3.7 unit and functional tox jobs https://review.openstack.org/624055 | 12:23 |
| *** dpawlik has joined #openstack-nova | 12:23 | |
| cdent | dansmith looks like the multi_cell query job is not happy with python 3.7 ^ | 12:24 |
| openstackgerrit | Yikun Jiang proposed openstack/nova master: Add live migration timeout action https://review.openstack.org/619143 | 12:24 |
| openstackgerrit | Yikun Jiang proposed openstack/nova master: Remove live_migration_progress_timeout config https://review.openstack.org/619142 | 12:24 |
| *** ratailor has quit IRC | 12:40 | |
| *** tssurya has quit IRC | 12:41 | |
| *** pchavva has joined #openstack-nova | 12:56 | |
| *** jistr is now known as jistr|medchk | 12:57 | |
| *** k_mouza has quit IRC | 13:02 | |
| *** sahid has quit IRC | 13:05 | |
| *** tbachman has joined #openstack-nova | 13:05 | |
| *** psachin has quit IRC | 13:05 | |
| *** tbachman has quit IRC | 13:10 | |
| *** dave-mccowan has joined #openstack-nova | 13:12 | |
| *** tbachman has joined #openstack-nova | 13:12 | |
| *** dpawlik has quit IRC | 13:17 | |
| openstackgerrit | Balazs Gibizer proposed openstack/nova master: Ensure that allocated PF matches the used PF https://review.openstack.org/623543 | 13:20 |
| openstackgerrit | Balazs Gibizer proposed openstack/nova master: Refactor PortResourceRequestBasedSchedulingTestBase https://review.openstack.org/624080 | 13:20 |
| *** k_mouza has joined #openstack-nova | 13:20 | |
| *** dpawlik has joined #openstack-nova | 13:20 | |
| *** priteau has quit IRC | 13:23 | |
| *** k_mouza has quit IRC | 13:26 | |
| *** k_mouza has joined #openstack-nova | 13:27 | |
| *** ohorecny2 has joined #openstack-nova | 13:28 | |
| *** k_mouza_ has joined #openstack-nova | 13:29 | |
| *** dpawlik has quit IRC | 13:30 | |
| *** k_mouza has quit IRC | 13:32 | |
| *** sapd1_ has joined #openstack-nova | 13:32 | |
| *** dpawlik has joined #openstack-nova | 13:32 | |
| *** sahid has joined #openstack-nova | 13:35 | |
| *** davidsha_ has joined #openstack-nova | 13:35 | |
| *** sapd1_ has quit IRC | 13:36 | |
| *** jmlowe has quit IRC | 13:45 | |
| *** takashin has joined #openstack-nova | 13:45 | |
| *** owalsh_ has joined #openstack-nova | 13:47 | |
| *** owalsh has quit IRC | 13:50 | |
| *** priteau has joined #openstack-nova | 13:50 | |
| *** owalsh has joined #openstack-nova | 13:50 | |
| *** owalsh_ has quit IRC | 13:52 | |
| *** jistr|medchk is now known as jistr | 13:56 | |
| *** s10 has joined #openstack-nova | 13:56 | |
| *** tetsuro has joined #openstack-nova | 13:57 | |
| *** mriedem has joined #openstack-nova | 14:00 | |
| openstackgerrit | Lee Yarwood proposed openstack/nova master: libvirt: Add workaround to cleanup instance dir during evac with rbd https://review.openstack.org/618478 | 14:02 |
| lyarwood | melwitt: ^ when you're around would you mind taking another look at that? I honestly can't see a way for cleanup to be called erroneously on the source host during a evacuation failure. | 14:17 |
| *** lbragstad has joined #openstack-nova | 14:17 | |
| *** openstackstatus has joined #openstack-nova | 14:18 | |
| *** ChanServ sets mode: +v openstackstatus | 14:18 | |
| *** takashin has quit IRC | 14:20 | |
| *** jding1_ has quit IRC | 14:22 | |
| *** k_mouza has joined #openstack-nova | 14:22 | |
| *** jackding has joined #openstack-nova | 14:22 | |
| *** jmlowe has joined #openstack-nova | 14:24 | |
| *** jmlowe has quit IRC | 14:24 | |
| *** k_mouza_ has quit IRC | 14:25 | |
| *** jmlowe has joined #openstack-nova | 14:25 | |
| *** aspiers has quit IRC | 14:26 | |
| *** tetsuro has quit IRC | 14:27 | |
| *** s10 has quit IRC | 14:28 | |
| *** takashin has joined #openstack-nova | 14:28 | |
| *** jmlowe has quit IRC | 14:30 | |
| *** takashin has left #openstack-nova | 14:32 | |
| *** awaugama has joined #openstack-nova | 14:34 | |
| *** jmlowe has joined #openstack-nova | 14:35 | |
| *** mlavalle has joined #openstack-nova | 14:37 | |
| *** alexchadin has quit IRC | 14:42 | |
| sean-k-mooney | bauzas: melwitt could one of ye apporve https://review.openstack.org/#/c/618239/ as release liaison/ptl when ye get a chance. | 14:42 |
| sean-k-mooney | the main change is fixing the os-vif side of https://bugs.launchpad.net/neutron/+bug/1734320 + https://bugs.launchpad.net/os-vif/+bug/1801072 | 14:43 |
| openstack | Launchpad bug 1734320 in os-vif "Eavesdropping private traffic" [High,In progress] - Assigned to sean mooney (sean-k-mooney) | 14:43 |
| openstack | Launchpad bug 1801072 in os-vif "vif_plug_ovs.linux_net.delete_net_dev is called outside the privsep context" [Critical,Fix released] - Assigned to sean mooney (sean-k-mooney) | 14:43 |
| *** sapd1_ has joined #openstack-nova | 14:51 | |
| *** aspiers has joined #openstack-nova | 14:53 | |
| *** KeithMnemonic has joined #openstack-nova | 14:54 | |
| KeithMnemonic | Is it possible to please get some reviews on this patch? https://review.openstack.org/#/c/573066/ | 14:55 |
| *** mvkr has quit IRC | 14:55 | |
| sean-k-mooney | KeithMnemonic: you realise that libvirt/qemu has a limit on how many volumes you can attach to an instance too | 14:58 |
| *** tbachman has quit IRC | 14:58 | |
| KeithMnemonic | yes there is a pci limit i thought | 14:58 |
| KeithMnemonic | is that 26? | 14:58 |
| sean-k-mooney | i think its 20 not 26 | 14:58 |
| KeithMnemonic | it is more than 20 i am pretty sure, problem is this bug is still open https://bugs.launchpad.net/nova/+bug/1770527 so we have a customer asking for it | 14:59 |
| openstack | Launchpad bug 1770527 in OpenStack Compute (nova) "openstack server add volume fails over 26vols" [Wishlist,In progress] - Assigned to Tsuyoshi Nagata (yukari-papa) | 14:59 |
| sean-k-mooney | the 26 limit on device names i sobviousl just because tehre are 26 ascii/english letter | 14:59 |
| sean-k-mooney | KeithMnemonic: it may depend on the qemu/libvirt version | 15:00 |
| KeithMnemonic | https://access.redhat.com/documentation/en-us/red_hat_enterprise_linux/5/html/virtualization/sect-virtualization-virtualization_limitations-kvm_limitations | 15:00 |
| KeithMnemonic | Hence, of the 32 available PCI devices for a guest, 4 are not removable. This means there are 28 PCI slots available for additional devices per guest. Every para-virtualized network or block device uses one slot. Each guest can use up to 28 additional devices made up of any combination of para-virtualized network, para-virtualized disk devices, or other PCI devices using VT-d. | 15:01 |
| *** cfriesen has joined #openstack-nova | 15:02 | |
| sean-k-mooney | does the 4 include the vnc/spice resouces | 15:03 |
| sean-k-mooney | you can use virtio-scsi too which may allow mulitple volumes per pci device | 15:04 |
| *** cfriesen has quit IRC | 15:08 | |
| *** priteau has quit IRC | 15:10 | |
| *** KeithMnemonic has quit IRC | 15:10 | |
| *** Luzi has quit IRC | 15:18 | |
| mriedem | lyarwood: surprise surprise multiattach swap volume across 2 hosts is broken | 15:18 |
| lyarwood | mriedem: wasn't mdbooth looking at blocking all attempts to swap/migrate multiattach volumes? | 15:21 |
| lyarwood | he isn't around today btw | 15:21 |
| mriedem | he was for at least cases of the multiattach volume having >1 read/write attachment | 15:22 |
| mriedem | https://review.openstack.org/#/c/572790/ | 15:22 |
| mriedem | but this isn't that issue, | 15:22 |
| *** moshele has quit IRC | 15:22 | |
| mriedem | the swap volume code in compute updates the bdm record for the "old" volume and changes the volume_id to the "new" volume | 15:22 |
| openstackgerrit | Merged openstack/nova master: Add docs for (initial) allocation ratio configuration https://review.openstack.org/622588 | 15:22 |
| mriedem | essentially orphaning the old volume, so we don't cleanup properly | 15:22 |
| mriedem | this https://github.com/openstack/nova/blob/ae3064b7a820ea02f7fc8a1aa4a41f35a06534f1/nova/compute/manager.py#L5798-L5806 | 15:23 |
| mriedem | the bdm that gets updated is the old bdm (source volume), but save_volume_id is the new volume | 15:24 |
| *** tbachman has joined #openstack-nova | 15:24 | |
| mriedem | we're also clearly wrongly updating the old bdm.connection_info with the new vol connection_info, | 15:24 |
| mriedem | for new volume attach flows that doesn't matter as we don't use the bdm.connection_info, but it's still wrong | 15:24 |
| *** mvkr has joined #openstack-nova | 15:25 | |
| mriedem | looks like that code assumes we did a cinder-induced retype/migration, "# correct volume_id returned by Cinder." | 15:25 |
| mriedem | but that's not the case here | 15:25 |
| mriedem | if only we had that volume_id uniqute constraint in the bdms table :) | 15:27 |
| mriedem | the bdm update would blow up hard | 15:27 |
| lyarwood | if only, sooooooooooo Matt also had a plan to block the direct use of this API FWIW at some point recently | 15:28 |
| lyarwood | so only allow it to be used via volume migration API | 15:28 |
| *** wwriverrat has joined #openstack-nova | 15:29 | |
| lyarwood | but this still sounds valid, do we have a launchpad bug for this? | 15:29 |
| mriedem | not yet, i'm debugging the failures in the tempest-slow job here https://review.openstack.org/#/c/606981/ - i'll be dumping notes in a launchpad bug | 15:29 |
| * lyarwood is up to his eyeballs in puppet, TripleO yaml files and Brexit chaos but can look later today | 15:30 | |
| mriedem | i'm not sure how the compute api would block swap volume unless we checked the volume status to see if it's either 'retyping' or 'migrating' and fail otherwise | 15:30 |
| mriedem | and if we'd restrict that based on a policy check | 15:31 |
| mriedem | because swap volume is admin-only today already | 15:31 |
| lyarwood | Yeah not sure what he had in mind tbh | 15:32 |
| *** rodolof has quit IRC | 15:35 | |
| *** rodolof has joined #openstack-nova | 15:35 | |
| mriedem | https://bugs.launchpad.net/nova/+bug/1807723 | 15:43 |
| openstack | Launchpad bug 1807723 in OpenStack Compute (nova) "swap multiattach volume intermittently fails when servers are on different hosts" [Medium,Confirmed] | 15:43 |
| *** itlinux has joined #openstack-nova | 15:44 | |
| kashyap | lyarwood: What about Bregret? | 15:46 |
| *** jmlowe has quit IRC | 15:46 | |
| *** mmethot has quit IRC | 15:46 | |
| kashyap | lyarwood: I mean, what are you "dealing" with? Aren't you just supposed to just "suffer the consequences", or you have the power to "do something"? :D | 15:46 |
| *** itlinux has quit IRC | 15:46 | |
| kashyap | lyarwood: Oh ... disregard me; just "caught up" with the Tories. | 15:47 |
| stephenfin | jangutter: Reviewed https://review.openstack.org/#/c/607610/. Looks good to me, for the most part, the few updates suggested by others aside | 15:47 |
| stephenfin | jangutter: If you rework today, let me know and I'll swing by again | 15:48 |
| jangutter | stephenfin: thanks, respinning! | 15:48 |
| jangutter | sean-k-mooney: any objection to choosing "Option 1" in the spec now? | 16:00 |
| sean-k-mooney | jangutter: i have not looked in a while but didnt i say that in a previous version | 16:00 |
| sean-k-mooney | ah its still at the same version so sure | 16:01 |
| jangutter | sean-k-mooney: yeah, doing a respin now, just wanted to make doubly sure. I mean, I sold a _lot_ of tickets to "Sean vs Jay's punch-the-ginger contest". | 16:02 |
| *** maciejjozefczyk has quit IRC | 16:03 | |
| sean-k-mooney | jangutter: every know you dont punch ginger people in case its contagious :P | 16:03 |
| jangutter | sean-k-mooney: that's why boxing gloves were developed to be so thick. | 16:04 |
| sean-k-mooney | if you want to leave it till later to decide we can but you already have patches for option 1 | 16:05 |
| sean-k-mooney | my main concern was serialiastion size | 16:05 |
| sean-k-mooney | we can adress that at a later date in other ways | 16:06 |
| *** macza has joined #openstack-nova | 16:08 | |
| openstackgerrit | Jack Ding proposed openstack/nova-specs master: Select cpu model from a list of cpu models https://review.openstack.org/620959 | 16:11 |
| *** lpetrut has joined #openstack-nova | 16:12 | |
| openstackgerrit | Ben Nemec proposed openstack/nova master: Migrate upgrade checks to oslo.upgradecheck https://review.openstack.org/603499 | 16:14 |
| *** mmethot has joined #openstack-nova | 16:17 | |
| *** tbachman has quit IRC | 16:17 | |
| *** munimeha1 has joined #openstack-nova | 16:21 | |
| *** mmethot has quit IRC | 16:24 | |
| *** jmlowe has joined #openstack-nova | 16:24 | |
| *** mmethot has joined #openstack-nova | 16:26 | |
| *** jmlowe has quit IRC | 16:34 | |
| *** openstackgerrit has quit IRC | 16:35 | |
| *** openstackgerrit has joined #openstack-nova | 16:40 | |
| openstackgerrit | Jan Gutter proposed openstack/nova-specs master: Spec to implement os-vif generic datapath offloads https://review.openstack.org/607610 | 16:40 |
| *** psachin has joined #openstack-nova | 16:42 | |
| *** gyee has joined #openstack-nova | 16:47 | |
| *** k_mouza_ has joined #openstack-nova | 16:50 | |
| *** tbachman has joined #openstack-nova | 16:51 | |
| *** helenafm has quit IRC | 16:52 | |
| *** ccamacho has quit IRC | 16:52 | |
| *** k_mouza has quit IRC | 16:53 | |
| *** k_mouza_ has quit IRC | 16:55 | |
| *** itlinux has joined #openstack-nova | 16:56 | |
| melwitt | o/ | 16:58 |
| *** udesale has quit IRC | 16:58 | |
| sean-k-mooney | melwitt: o/ | 16:59 |
| *** spatel has joined #openstack-nova | 17:00 | |
| sean-k-mooney | johnthetubaguy: o/ care to take another look at https://review.openstack.org/#/c/591607/11 | 17:02 |
| *** rodolof has quit IRC | 17:02 | |
| *** rodolof has joined #openstack-nova | 17:02 | |
| *** igordc has joined #openstack-nova | 17:04 | |
| *** ohorecny2 has quit IRC | 17:07 | |
| *** rodolof has quit IRC | 17:14 | |
| *** munimeha1 has quit IRC | 17:14 | |
| *** rodolof has joined #openstack-nova | 17:15 | |
| *** _alastor_ has joined #openstack-nova | 17:17 | |
| *** khomesh has quit IRC | 17:18 | |
| melwitt | mriedem: I was thinking we should cancel the dec 20 nova meeting bc efried_cya_jan is out and I think dansmith is out that day too. and I was considering taking the day off as well | 17:20 |
| *** sahid has quit IRC | 17:21 | |
| *** dtantsur is now known as dtantsur|afk | 17:21 | |
| mriedem | shrug | 17:21 |
| mriedem | i'll be around | 17:21 |
| mriedem | i can run it if needed | 17:21 |
| dansmith | I won't be | 17:22 |
| *** s10 has joined #openstack-nova | 17:23 | |
| melwitt | mriedem: ok, if you are able to run it then that works too. I was thinking there might be a lack of quorum | 17:25 |
| s10 | Please review backports for https://review.openstack.org/#/q/topic:bug/1806064 | 17:26 |
| sean-k-mooney | lyarwood: ^ that proably for you | 17:28 |
| *** derekh has quit IRC | 17:29 | |
| *** rodolof has quit IRC | 17:32 | |
| *** rodolof has joined #openstack-nova | 17:33 | |
| *** moshele has joined #openstack-nova | 17:34 | |
| jangutter | mriedem: would you be able to take a look at https://review.openstack.org/#/c/607610/ in your copious free time...? Jay's already +2'ed the previous revision. | 17:43 |
| mriedem | uhh | 17:44 |
| sean-k-mooney | by the way was there a proposal to do another spec review day tomorow or was i imagining that | 17:48 |
| melwitt | sean-k-mooney: I suggested it and we discussed it in the nova meeting and decided to give it a miss. I replied on the ML accordingly | 17:49 |
| sean-k-mooney | melwitt: ah ok | 17:49 |
| *** amodi has joined #openstack-nova | 17:51 | |
| *** moshele has quit IRC | 17:53 | |
| openstackgerrit | Surya Seetharaman proposed openstack/python-novaclient master: API microversion 2.68: Handles Down Cells https://review.openstack.org/579563 | 17:53 |
| mriedem | lbragstad: have you seen this? http://logs.openstack.org/81/606981/4/check/tempest-slow/fafde23/controller/logs/screen-n-api.txt.gz#_Dec_08_01_45_42_745709 | 17:53 |
| * lbragstad waits for logs to load | 17:55 | |
| mriedem | seems like something in an api-paste middleware | 17:55 |
| mriedem | b/c it's logged before we call the actual controller method to handle that request | 17:55 |
| mriedem | oh i bet i know what it is | 17:57 |
| lbragstad | it's related to https://review.openstack.org/#/c/619260/3/oslo_policy/policy.py | 17:57 |
| mriedem | nova's RequestContext calls check_is_admin during init | 17:57 |
| mriedem | which is for every request | 17:58 |
| lbragstad | does that call enforce()? | 17:58 |
| mriedem | calls return _ENFORCER.authorize('context_is_admin', target, credentials) | 17:59 |
| mriedem | which calls enforce | 17:59 |
| lbragstad | ah - it does | 17:59 |
| lbragstad | right | 18:00 |
| lbragstad | makes sense | 18:00 |
| lbragstad | oh - weird, target is being overloaded as credentials? | 18:00 |
| lbragstad | i suppose, is it too early in the pipeline for nova to know what the actual target is? | 18:00 |
| mriedem | yeah | 18:01 |
| lbragstad | huh | 18:01 |
| lbragstad | interesting | 18:01 |
| mriedem | remember this? https://review.openstack.org/#/c/564349/ | 18:01 |
| lbragstad | oh - yeah... kinda | 18:03 |
| *** ralonsoh has quit IRC | 18:04 | |
| lbragstad | looks like that would still address the issue | 18:04 |
| mriedem | this is where we get _DeprecatedPolicyValues https://github.com/openstack/oslo.context/blob/0daf01065d1d51694e06aaecb3dcf4dcc78710fe/oslo_context/context.py#L318 | 18:05 |
| mriedem | passing that in as the target | 18:05 |
| lbragstad | right | 18:05 |
| lbragstad | you should be able to pass context objects as credentials | 18:05 |
| lbragstad | but we don't really link anything about target to context | 18:05 |
| lbragstad | at least in oslo.policy | 18:06 |
| mriedem | seems we should just pass target={} | 18:06 |
| mriedem | since we don't know | 18:06 |
| lbragstad | (we wanted to use context objects as a replacement for a dictionary called credentials since it makes things easier for services using oslo.policy - instead of just assuming service developers know what to put in credentials or how the internals of oslo.policy parses it) | 18:07 |
| lbragstad | and it relays a bunch of useful information about the user making the request - which is what credentials was trying achieve anyway | 18:07 |
| lbragstad | but yeah - if you don't know anything about the target, an empty dictionary would seem safer than overloading target as a set of context attributes | 18:08 |
| *** sridharg has quit IRC | 18:10 | |
| lbragstad | for example - in keystone we protect APIs like this https://github.com/openstack/keystone/blob/master/keystone/api/users.py#L137 | 18:12 |
| *** jmlowe has joined #openstack-nova | 18:12 | |
| lbragstad | we look at the context object associated with the request and generate "credentials" https://github.com/openstack/keystone/blob/master/keystone/common/rbac_enforcer/enforcer.py#L380 | 18:12 |
| lbragstad | and then pass that to oslo.policy https://github.com/openstack/keystone/blob/master/keystone/common/rbac_enforcer/enforcer.py#L81-L82 | 18:12 |
| *** moshele has joined #openstack-nova | 18:14 | |
| openstackgerrit | Dan Smith proposed openstack/nova master: Make compute rpcapi version calculation check all cells https://review.openstack.org/623284 | 18:18 |
| openstackgerrit | Dan Smith proposed openstack/nova master: Make service.get_minimum_version_all_cells() cache the results https://review.openstack.org/623283 | 18:18 |
| openstackgerrit | Georg Hoesch proposed openstack/nova master: refactor get_console_output() for console logfiles https://review.openstack.org/575735 | 18:19 |
| *** wolverineav has joined #openstack-nova | 18:20 | |
| *** psachin has quit IRC | 18:23 | |
| *** sapd1_ has quit IRC | 18:24 | |
| *** wolverineav has quit IRC | 18:24 | |
| *** dtrainor has joined #openstack-nova | 18:36 | |
| *** davidsha_ has quit IRC | 18:36 | |
| dtrainor | Howdy. I'm trying to troubleshoot a failed deployment that ultimately results in "Message: No valid host was found. There are not enough hosts available., Code: 500". Digging deeper, it looks like RamFilter is returning 0 hosts because the hosts appears to return a value of 0 MB RAM http://paste.openstack.org/show/736921/ | 18:38 |
| etp | Do max_placement_results and host aggregates/AggregateInstanceExtraSpecsFilter work together or am I looking at configuration error? Say cloud has 100 hypervisors, max_placement_results = 10, two host aggregates 50 hypervisors each, flavor extra specs matching latter aggregate with hypervisors 51-100 | 18:38 |
| dtrainor | the nodes get properly introspected. the introspection data is good. there may be a bug in the Ravello hypervisor that this is being deployed on which ahs been known to return 0MB if the host BIOS returned a negative number (read something about an overcommit ratio sometimes causing this) | 18:38 |
| *** wolverineav has joined #openstack-nova | 18:41 | |
| *** tssurya has joined #openstack-nova | 18:41 | |
| dtrainor | I'm using all default values for this downstream queens deployment. The flavors show a minimum requirement of 4096MB, that's the only place I can find this number occurring. | 18:42 |
| *** cfriesen has joined #openstack-nova | 18:43 | |
| *** wolverineav has quit IRC | 18:44 | |
| *** wolverineav has joined #openstack-nova | 18:47 | |
| dansmith | etp: 10 is small enough that you're likely to not get back any hosts in the aggregate you're looking for yeah | 18:50 |
| dansmith | etp: unless you're enabling a request filter in nova that helps to ensure that you do | 18:50 |
| dansmith | which is currently az or tenant filtering | 18:50 |
| *** sapd1_ has joined #openstack-nova | 18:51 | |
| *** tssurya has quit IRC | 18:53 | |
| TheJulia | Hopefully someone can help jog my memory... A long time ago I remember there was a discussion of how nova represents a baremetal node being torn down. I believe the state then and now is that the instance is generally "ACTIVE" until the node is actually deleted, and I think the motivation behind that was resource accounting wise. Does anyone remember this discussion (it would have been 2+ years ago I think) | 18:53 |
| *** sapd1_ has quit IRC | 18:55 | |
| dansmith | TheJulia: the instance goes away immediately, AFAIK, as that's the way delete is supposed to work, but nova tries to make the node not schedule-able until the cleaning is done | 18:57 |
| *** sapd1_ has joined #openstack-nova | 18:58 | |
| mriedem | dtrainor: you shouldn't need the RamFilter in queens | 18:58 |
| TheJulia | I've got a QE person reporting that they are seeing it sit in "ACTIVE" until cleaning is over | 18:58 |
| dansmith | the strategy we proposed for doing this betterly was to set the reserved amount of resource equal to the total for a node so that it appeared to not have any room until after it's cleaning | 18:58 |
| mriedem | dtrainor: the placement service does the filtering on MEMORY_MB | 18:58 |
| TheJulia | and I thought there was some reason for that, just struggling to decompress those memories | 18:58 |
| dansmith | TheJulia: okay I could be wrong, but I don't think that's what is supposed to happen | 18:58 |
| etp | dansmith: tnx, we have only one az atm and aggregate should be for all tenants so I think request filter doesn't help here, I'll revert config back to default | 18:59 |
| mriedem | dtrainor: you're scheduling to baremetal nodes there? | 18:59 |
| mriedem | dtrainor: if those are baremetal nodes, you should read up on https://docs.openstack.org/ironic/latest/install/configure-nova-flavors.html | 19:00 |
| mriedem | dtrainor: i guess the Core/Ram/Disk filters weren't deprecated until stein but they should have been since pike i think https://docs.openstack.org/nova/latest/admin/configuration/schedulers.html#ramfilter | 19:01 |
| dansmith | TheJulia: self.ironicclient.call("node.set_provision_state", node.uuid, | 19:01 |
| dansmith | "deleted") | 19:01 |
| dansmith | TheJulia: does that take a long time? | 19:02 |
| TheJulia | dansmith: that can take hours upon hours depending on the hardware the operator configuration | 19:02 |
| dansmith | TheJulia: yeah, looks like that has a poll loop after it | 19:02 |
| TheJulia | dansmith: to be precise, that should return immediately | 19:02 |
| TheJulia | but the background it runs for a long time | 19:02 |
| dtrainor | sorry, i'm back. mriedem, I'm familiar with that doc, yep. I'm familiar with how it's scheduled and can even make this deployment work on different platforms, e.g. on top of different hardware. that's what leaves me puzzled. | 19:02 |
| *** wolverineav has quit IRC | 19:03 | |
| *** wolverineav has joined #openstack-nova | 19:03 | |
| dansmith | TheJulia: yeah, so I guess it does have to go through a full cleaning before the instance appears to actually go away | 19:03 |
| dtrainor | VCPU, MEMORY_MB, and DISK_GB are all set to 0 to disable scheduling based on properties for a bare metal flavor. i am using bare metal nodes with the intent of using the default flavor properties such as these | 19:03 |
| dansmith | TheJulia: but the instance shouldn't be just ACTIVE, it should be ACTIVE with a task-state of "deleting" at least | 19:04 |
| TheJulia | mriedem: I'm fairly sure somewhere there was a statement saying that it would no longer work and was deprecated, but that was a long time ago since we kept compatability for a while | 19:04 |
| TheJulia | dansmith: that is what it reports now afaik | 19:04 |
| mriedem | dtrainor: ok, well i can tell you the IronicHostManager, baremetal filters and core/ram/disk filters have all been deprecated and can cause issues when trying to schedule to baremetal nodes | 19:06 |
| mriedem | so you shouldn't be using those | 19:06 |
| mriedem | and should be scheduling based on custom resource classes | 19:06 |
| dtrainor | right, that was my understanding | 19:07 |
| dtrainor | all the nodes are created by default with a resource_class of 'baremetal', which my understanding is, this should match a flavor based on a flavor's properties of e.g. resources:CUSTOM_BAREMETAL='1' | 19:08 |
| dtrainor | again, these all being defaults | 19:08 |
| *** igordc has quit IRC | 19:08 | |
| *** mvkr has quit IRC | 19:09 | |
| *** wolverineav has quit IRC | 19:09 | |
| *** igordc has joined #openstack-nova | 19:09 | |
| dtrainor | i have nova-compute and nova-scheduler log files, I don't want to ask for too much but maybe another set of eyes would help me find something that I'm not able to see? | 19:10 |
| TheJulia | dansmith: do you know, off the top of your head, if nova only represents a deletion in progress in the task_status field? | 19:10 |
| TheJulia | dansmith: I mean, in documentation | 19:10 |
| * TheJulia finds nova's vm state diagram and lists | 19:11 | |
| *** wolverineav has joined #openstack-nova | 19:11 | |
| dansmith | TheJulia: from the outside, that's the indication the user has yeah | 19:16 |
| dansmith | TheJulia: normally it happens fairly quick of course | 19:16 |
| TheJulia | yeah | 19:16 |
| *** N3l1x has joined #openstack-nova | 19:16 | |
| mriedem | dtrainor: paste your nova.conf for the scheduler | 19:18 |
| mriedem | dtrainor: in addition, are the cpu/ram/disk values on the flavor overridden to report 0? | 19:19 |
| mriedem | 1 | 19:19 |
| mriedem | see, "Another set of flavor properties must be used to disable scheduling based on standard properties for a bare metal flavor:" from https://docs.openstack.org/ironic/latest/install/configure-nova-flavors.html | 19:20 |
| dtrainor | my scheduler section is pretty boring by default with only one change http://paste.openstack.org/show/736924/ reading... | 19:24 |
| dtrainor | yes, the values are set to 0, as this is a default https://github.com/openstack/tripleo-heat-templates/blob/stable/queens/extraconfig/post_deploy/undercloud_post.sh#L124 | 19:25 |
| cdent | mriedem or yikun_ : https://github.com/openstack/nova/blob/master/nova/objects/compute_node.py#L213 has trouble when the compute node is 'deleted' and the context hasn't diddled read_deleted | 19:27 |
| mriedem | where are we reading deleting compute_nodes? | 19:27 |
| mriedem | *deleted | 19:27 |
| dtrainor | so by default, a node's resource class is not uppercase, which sounds like it's required per https://docs.openstack.org/ironic/queens/install/configure-nova-flavors.html . I just changed the resource class of a node from 'baremetal' to 'BAREMETAL', I'll try a deployment with that. | 19:28 |
| cdent | this is showing up in the status test that I'm moving for placement fixture: line 265 here https://review.openstack.org/#/c/617941/28/nova/tests/functional/test_nova_status.py | 19:28 |
| cdent | cn2.create() is of a node that is deleted (so that it can be "not seen" during the test) | 19:28 |
| dtrainor | I think the thing that bothers me the most is that this deployment succeeds on other sets of hardware, i'm starting to suspect a bug on the platform on which this is deployed but i can't prove it | 19:28 |
| cdent | I can diddle the context, but wanted to be sure that was the right things to do | 19:28 |
| mriedem | cdent: yeah you didn't copy part of that change from yikun | 19:28 |
| * cdent shakes fist at merges | 19:29 | |
| mriedem | cdent: https://review.openstack.org/#/c/613499/16/nova/tests/unit/cmd/test_status.py | 19:29 |
| cdent | thanks | 19:29 |
| mriedem | dtrainor: hmm i'm not sure how you have the RamFilter enabled then | 19:29 |
| cdent | latency is the everything killer | 19:30 |
| mriedem | dtrainor: especially since we removed that from the default enabled filters list in pike https://review.openstack.org/#/c/491854/ | 19:30 |
| mriedem | although i see you're using the ironic_host_manager, | 19:31 |
| mriedem | which is also deprecated and you shouldn't need | 19:31 |
| dtrainor | like i said earier, I'm using a downstream release of queens, so i think that may be adding to the confusion | 19:31 |
| dtrainor | right | 19:31 |
| dtrainor | feels like queens was a weird transition state to deprecate some scheduling bits in place of some more modern techniques, which may very well lead to me doing something Wrong(TM) | 19:32 |
| mriedem | https://github.com/openstack/nova/blob/stable/queens/nova/conf/scheduler.py#L309 | 19:32 |
| mriedem | https://github.com/openstack/nova/blob/stable/queens/nova/conf/scheduler.py#L341 | 19:32 |
| dtrainor | very good. thanks for the links. | 19:32 |
| mriedem | the default on use_baremetal_filters is False so you shouldn't be using those | 19:32 |
| mriedem | anyway, i'd change host_manager=host_manager in nova.conf and see if that helps | 19:33 |
| mriedem | as i said, the deprecations should have happened earlier, but we likely didn't catch this stuff until tripleo failed by using the old stuff | 19:34 |
| mriedem | and we don't deprecate things in stable branches | 19:34 |
| dtrainor | understood. | 19:34 |
| mriedem | there is a mention of this in https://docs.openstack.org/releasenotes/nova/queens.html | 19:34 |
| openstackgerrit | Chris Dent proposed openstack/nova master: Use external placement in functional tests https://review.openstack.org/617941 | 19:34 |
| dtrainor | interesting. again thanks for the links! | 19:36 |
| dtrainor | i'll do some homework. | 19:36 |
| openstackgerrit | Chris Dent proposed openstack/nova master: Use external placement in functional tests https://review.openstack.org/617941 | 19:38 |
| openstackgerrit | Chris Dent proposed openstack/nova master: Delete the placement code https://review.openstack.org/618215 | 19:38 |
| openstackgerrit | Matt Riedemann proposed openstack/nova master: DNM: add debug logging for bug 1807723 https://review.openstack.org/624181 | 19:43 |
| openstack | bug 1807723 in OpenStack Compute (nova) "swap multiattach volume intermittently fails when servers are on different hosts" [Medium,Confirmed] https://launchpad.net/bugs/1807723 | 19:43 |
| *** wolverineav has quit IRC | 19:46 | |
| *** wolverineav has joined #openstack-nova | 19:47 | |
| *** rodolof has quit IRC | 19:49 | |
| *** wolverineav has quit IRC | 19:52 | |
| *** xek has quit IRC | 19:52 | |
| *** xek has joined #openstack-nova | 19:52 | |
| *** _alastor_ has quit IRC | 20:00 | |
| openstackgerrit | Matt Riedemann proposed openstack/nova master: Fix target used in nova.policy.check_is_admin https://review.openstack.org/624185 | 20:04 |
| *** cdent has quit IRC | 20:04 | |
| *** bringha has joined #openstack-nova | 20:10 | |
| *** igordc has quit IRC | 20:12 | |
| openstackgerrit | Matt Riedemann proposed openstack/nova master: Fix target used in nova.policy.check_is_admin https://review.openstack.org/624185 | 20:13 |
| *** wolverineav has joined #openstack-nova | 20:14 | |
| mriedem | gibi: there is a runway slot open https://etherpad.openstack.org/p/nova-runways-stein so i'll throw https://blueprints.launchpad.net/nova/+spec/bandwidth-resource-provider in there bug you've got two separate entries queued up so I assume you meant to keep those separate wrt runways slots | 20:15 |
| mriedem | *but you've got | 20:15 |
| *** mvkr has joined #openstack-nova | 20:16 | |
| *** wolverineav has quit IRC | 20:19 | |
| *** wolverineav has joined #openstack-nova | 20:20 | |
| *** tbachman has quit IRC | 20:25 | |
| *** jmlowe has quit IRC | 20:26 | |
| *** lpetrut has quit IRC | 20:27 | |
| *** pchavva has quit IRC | 20:27 | |
| *** bringha has quit IRC | 20:28 | |
| mriedem | dansmith: melwitt: i think we can move forward with moving nova-cells-v1 to the experimental queue https://review.openstack.org/#/c/623538 | 20:31 |
| dansmith | mriedem: I figured you'd drop the +W when ready, but.. got it | 20:32 |
| mriedem | don't want to +W my own change | 20:32 |
| *** jmlowe has joined #openstack-nova | 20:32 | |
| *** jmlowe has quit IRC | 20:33 | |
| sean-k-mooney | mriedem: did you mention the intel nfv ci was broken recently | 20:33 |
| mriedem | yes | 20:34 |
| mriedem | well, | 20:34 |
| mriedem | it just skips | 20:34 |
| mriedem | so not sure why it's litsening on nova changes | 20:34 |
| mriedem | *listening | 20:34 |
| dansmith | mriedem: well, we left enough +2s on there, but ... as you wish | 20:34 |
| sean-k-mooney | im currently setting up a replacement for it at home | 20:35 |
| sean-k-mooney | im going to dedicate one of my dev servers too it. assumeing the noise stays low ill leave it that way for at least the time being. im going to see if i can use other resource i have acess too also. | 20:36 |
| sean-k-mooney | my plan is to add the nova core team to the list of people that can leave a comment to have it run and try to have it run on all chagne to a subset of file. | 20:38 |
| sean-k-mooney | e.g. the libvirt dirver and neutron code | 20:38 |
| *** erlon has quit IRC | 20:40 | |
| dtrainor | mriedem, setting host_manager=host_manager didn't seen to make a difference. The deployment still fails with the same errors. | 20:40 |
| dtrainor | blows my mind. this exact sample deployment with the exact same config on other hardware works just fine. | 20:41 |
| dtrainor | using the exact same defaults, no less | 20:41 |
| sean-k-mooney | dtrainor: whats the error you get? | 20:42 |
| dtrainor | initially "No valid host was found. There are not enough hosts available., Code: 500", digging deeper in, scheduler is filtering all the hosts out http://paste.openstack.org/show/736932/ | 20:45 |
| sean-k-mooney | looks like the ramfilter is filtering out the final hosts | 20:46 |
| dtrainor | yep | 20:46 |
| sean-k-mooney | is this an ironic deployment or something else | 20:46 |
| *** moshele has quit IRC | 20:46 | |
| dtrainor | initially it was, but per mriedem's suggestion, i tried a host_manager deployment with the same results. i don't much understand the difference between an ironic deployment and a host deployment though i suppose | 20:47 |
| dtrainor | also i want to point out that this is a downstream queens | 20:47 |
| dtrainor | i know that factors in to this to a degree | 20:47 |
| sean-k-mooney | ya i was looking at mast an saw the entrypoint was gone | 20:48 |
| sean-k-mooney | in queens you still have https://github.com/openstack/nova/blob/stable/queens/setup.cfg#L84-L87 | 20:48 |
| sean-k-mooney | dtrainor: what do you see if you look at the hyperviors api? | 20:48 |
| sean-k-mooney | e.g. do you have ram listed for the nodes | 20:49 |
| dtrainor | that's what i'm looking at right now, so far no. i see 0 for all disk vcpus and memory, they are all of type 'ironic' | 20:50 |
| sean-k-mooney | dtrainor: that would be expected in rocky | 20:50 |
| sean-k-mooney | in rocky we disable the ram filter | 20:50 |
| dtrainor | right, that's what i was reading | 20:50 |
| dtrainor | in lie of resource matching | 20:51 |
| sean-k-mooney | i wonder did a backport of the reporting change get lanned into osp 13 that could be cause the issue | 20:51 |
| sean-k-mooney | i think there is an "openstack hypervior stats" command you can run but if the hypervior is listed as 0 ram there the scuderl would appear to be doing the right thing | 20:52 |
| dtrainor | 'openstack hypervisor stats show' lists all zeroes | 20:53 |
| sean-k-mooney | and the current hyperviors are ironic nodes or libvirt? | 20:54 |
| dtrainor | they all have a hypervisor_type of 'ironic' | 20:54 |
| sean-k-mooney | ok well from rocky on that would be expected but for queens not so much | 20:55 |
| dtrainor | gotcha | 20:56 |
| *** moshele has joined #openstack-nova | 20:58 | |
| *** jmlowe has joined #openstack-nova | 20:58 | |
| *** moshele has quit IRC | 21:00 | |
| *** tbachman has joined #openstack-nova | 21:00 | |
| mriedem | the RamFilter should not be running | 21:05 |
| mriedem | so something is messed up with your configuration | 21:05 |
| *** rodolof has joined #openstack-nova | 21:06 | |
| sean-k-mooney | in queens? | 21:06 |
| mriedem | correct | 21:06 |
| sean-k-mooney | mriedem: the cpu disk and ram filster should be disabled in rocky definetly but i tought we used them in queens | 21:06 |
| mriedem | no | 21:06 |
| sean-k-mooney | oh if that change happend in queen then ya | 21:06 |
| mriedem | haven't needed them since pike | 21:06 |
| sean-k-mooney | ah ok | 21:07 |
| sean-k-mooney | it should be an easy fix then to just disable them | 21:07 |
| sean-k-mooney | not sure why triplo whould have enabled them in that case however | 21:07 |
| sean-k-mooney | oh i think i messed that we removed the caching schduler recently https://github.com/openstack/nova/blob/master/setup.cfg#L86-L88 | 21:09 |
| sean-k-mooney | did that happen before the summit? | 21:09 |
| sean-k-mooney | ah october 18th excelent https://github.com/openstack/nova/commit/25dadb94db37e0f1c6769bf586ec06c3b5ea3051#diff-380c6a8ebbbce17d55d50ef17d3cf906 | 21:10 |
| mriedem | dtrainor: clearly your scheduler is picking up non-default filters because TripleOCapabilitiesFilter is in the list | 21:10 |
| mriedem | dtrainor: so you need to figure out which config file is being used for nova-scheduler and where the enabled_filters option is being set | 21:10 |
| mriedem | because you need to remove RamFilter from that list | 21:10 |
| mriedem | dtrainor: likely a queens version of this http://git.openstack.org/cgit/openstack/tripleo-heat-templates/tree/environments/undercloud.yaml#n57 | 21:11 |
| mriedem | dtrainor: see http://git.openstack.org/cgit/openstack/tripleo-heat-templates/commit/environments/undercloud.yaml?id=04b235652b44701b8703f63aee10fac6fad13ced | 21:11 |
| dtrainor | reading :) | 21:11 |
| mriedem | https://bugs.launchpad.net/tripleo/+bug/1787910 | 21:11 |
| openstack | Launchpad bug 1787910 in OpenStack Compute (nova) rocky "OVB overcloud deploy fails on nova placement errors" [High,Fix committed] - Assigned to Matt Riedemann (mriedem) | 21:11 |
| dtrainor | thank you both | 21:11 |
| mriedem | i'm pretty sure that's exactly your issue | 21:11 |
| sean-k-mooney | this is what generate the config but i dont know where the parmaters are set https://github.com/openstack/tripleo-heat-templates/blob/stable/queens/puppet/services/nova-scheduler.yaml#L90-L91 | 21:14 |
| dtrainor | yeah, that smells about right. idk how I overlooked that bug, I had been searching about this topic for a while now | 21:14 |
| mriedem | dansmith: in the cross-cell resize spec there are a couple of places we talked about moving the policy check from conductor to api https://review.openstack.org/#/c/616037/1/specs/stein/approved/cross-cell-resize.rst@247 - thinking about that, if we move the policy check to api and it's true (cross-cell resize is ok for a given request), do you think it's legit to change the rpc call from api->conductor into a cast? i'm thinki | 21:14 |
| mriedem | es... | 21:14 |
| dtrainor | this is great stuff. thank you. i need to run an errand, i'll be back at this later on. | 21:15 |
| dtrainor | thanks for the help mriedem, sean-k-mooney. helps tremendously. | 21:15 |
| mriedem | yw | 21:15 |
| sean-k-mooney | dtrainor: so it look like upstrea queens enaable the ram filter https://github.com/openstack/tripleo-heat-templates/blob/stable/queens/environments/undercloud.yaml#L23 | 21:16 |
| mriedem | yes | 21:16 |
| dtrainor | gotcha. | 21:16 |
| sean-k-mooney | mriedem: you mentioned it should be drop after pike right so the change form rocky needs to be backported to queens | 21:17 |
| mriedem | for tripleo sure | 21:17 |
| sean-k-mooney | dtrainor: so you need to backport https://github.com/openstack/tripleo-heat-templates/commit/49916c09216479a8dd54e55b4c6e86dae8246fa3 | 21:17 |
| sean-k-mooney | and ya the reference the bug mriedem found | 21:18 |
| sean-k-mooney | so dumb question. why is that not causeing the triplo gate to explode ? | 21:19 |
| sean-k-mooney | on stable queens at least | 21:19 |
| *** sapd1_ has quit IRC | 21:21 | |
| *** sapd1_ has joined #openstack-nova | 21:24 | |
| *** efried_cya_jan has quit IRC | 21:29 | |
| *** s10 has quit IRC | 21:30 | |
| mriedem | i believe tripleo found the bug after we removed the ironic driver code to report vcpu/ram/disk inventory for ironic nodes in stein | 21:35 |
| mriedem | so things "worked" before that with the RamFilter | 21:35 |
| mriedem | and we deprecated the core/ram/disk filters in rocky | 21:35 |
| mriedem | oh i guess that was stein as well https://review.openstack.org/#/c/596502/ | 21:36 |
| mriedem | should have been earlier | 21:36 |
| sean-k-mooney | in that case it would seam to indicate taht OSP13 may have backported the stein change but unless that closed a bug im not sure why they would have | 21:36 |
| *** rodolof has quit IRC | 21:36 | |
| *** rodolof has joined #openstack-nova | 21:37 | |
| *** wolverineav has quit IRC | 21:44 | |
| *** wolverineav has joined #openstack-nova | 21:46 | |
| *** takashin has joined #openstack-nova | 21:53 | |
| *** sapd1_ has quit IRC | 21:58 | |
| mriedem | cfriesen: i've got something you might like to lose sleep over | 22:00 |
| cfriesen | oh, goody | 22:00 |
| mriedem | so RequestSpec has a limits field | 22:00 |
| mriedem | which if we ever update that thing, it's on accident | 22:00 |
| mriedem | e.g. if we resize from flavor1 to flavor2 and it's persisted, it's on accident, | 22:01 |
| mriedem | and if we revert the resize back to flavor1, we definitely don't wipe out the limits | 22:01 |
| mriedem | looking at something like unshelve, the limits passed down to compute to do the claim (which would only be used for pci/numa claims now) possibly does not reflect the actual flavor being used | 22:01 |
| openstackgerrit | Jack Ding proposed openstack/nova master: [WIP] Flavor extra spec and image properties validation https://review.openstack.org/620706 | 22:02 |
| mriedem | actually unshelve might be safe here, | 22:03 |
| *** sapd1_ has joined #openstack-nova | 22:03 | |
| mriedem | i was thinking unshelve would use stale limits https://github.com/openstack/nova/blob/08d617084e5aa69ada0898d674022621d130aef3/nova/conductor/manager.py#L813 | 22:03 |
| mriedem | but those get overwritten in the filter_properties dict here based on the selected host from the scheduler https://github.com/openstack/nova/blob/08d617084e5aa69ada0898d674022621d130aef3/nova/conductor/manager.py#L841 | 22:04 |
| mriedem | god it's a mess | 22:04 |
| mriedem | tl;dr probably shouldn't ever trust RequestSpec.limits | 22:04 |
| mriedem | and we probably shouldn't even persist it | 22:04 |
| cfriesen | was just going to ask why it's persisted. :) | 22:04 |
| mriedem | because limits are totally based on configured filters at any given time you scheduled | 22:04 |
| mriedem | dansmith: ^ | 22:04 |
| mriedem | cfriesen: everything was persisted with the request spec and we've just be winding that back case by case ever since | 22:05 |
| mriedem | because it's a turducken of original request / last flavor used but also as a glorified parameter bag to send requests to the scheduler | 22:05 |
| *** _alastor_ has joined #openstack-nova | 22:06 | |
| mriedem | limits are just everywhere. the rpc cast to build_and_run_instance contains a (1) limits parameter, a (2) nested limits entry within filter_properties and (3) the RequestSpec.limits | 22:07 |
| mriedem | it's *awesome* | 22:07 |
| *** sapd1_ has quit IRC | 22:07 | |
| cfriesen | what the heck...NUMATopologyLimits contains cpu_allocation_ratio, ram_allocation_ratio, and "network_metadata"? how does that make any sense? | 22:09 |
| mriedem | the network_metadata is the physnet/numa node stuff stephenfin added in rocky | 22:10 |
| cfriesen | okay, so not crazy | 22:10 |
| cfriesen | so it sounds like either we need to persist the limits properly and update them properly when they change, or else not persist them and create them before calling the scheduler. that sound right? | 22:12 |
| mriedem | *create them *after* calling the scheduler, but yes | 22:13 |
| mriedem | those are the options really | 22:13 |
| mriedem | either never trust them across requests, or make sure they are always updated | 22:13 |
| mriedem | i'd opt to never trust them | 22:13 |
| mriedem | i.e. we can only revert the flavor in the request spec here https://github.com/openstack/nova/blob/08d617084e5aa69ada0898d674022621d130aef3/nova/compute/api.py#L3489 because the instance stashes the old_flavor | 22:14 |
| mriedem | we don't stash the old limits anywhere | 22:14 |
| mriedem | anyway, i just needed to dump my brain here while i was looking at this limits code to see if i could re-use it | 22:15 |
| cfriesen | you've probably jinxed me now, and our test guys will be firing off an email with a limit-related failure | 22:20 |
| mriedem | misery loves company | 22:20 |
| mriedem | this is likely also semi broken depending on how you choose to manage allocation rations now, either via config (what this would use) or via placement api https://github.com/openstack/nova/blob/08d617084e5aa69ada0898d674022621d130aef3/nova/scheduler/filters/numa_topology_filter.py#L71 | 22:21 |
| mriedem | *ratios | 22:21 |
| mriedem | if i'm managing VCPU/MEMORY_MB allocation ratios via the placement api, ^ will not reflect what is actually being used | 22:22 |
| mriedem | that might have been true before placement if you were only managing allocation ratios in aggregate | 22:23 |
| *** awaugama has quit IRC | 22:23 | |
| dansmith | mriedem: is there anything in reqspec that wasn't an ill-conceived steaming pile of poo? | 22:27 |
| mriedem | umm | 22:28 |
| mriedem | well, it is the only place we track that is_bfv thing! | 22:29 |
| mriedem | otherwise it's caused probably more harm than it was worth | 22:29 |
| mriedem | oh yeah and because of that numa filter limits those are per-host, | 22:30 |
| mriedem | so RequestSpec.limits is really per operation | 22:31 |
| openstackgerrit | Merged openstack/nova stable/rocky: Add functional regression test for bug 1806064 https://review.openstack.org/623931 | 22:31 |
| openstack | bug 1806064 in OpenStack Compute (nova) rocky "Volume remains in attaching/reserved status, if the instance is deleted after TooManyInstances exception in nova-conductor" [Medium,In progress] https://launchpad.net/bugs/1806064 - Assigned to s10 (vlad-esten) | 22:31 |
| mriedem | alex also found out that we never actually update the numa/pci requests in the reqspec when we resize to another flavor that might have different numa/pci reqs https://review.openstack.org/#/c/621077/ | 22:31 |
| mriedem | just lots of fun | 22:32 |
| *** efried has joined #openstack-nova | 22:39 | |
| *** itlinux has quit IRC | 22:43 | |
| openstackgerrit | Michael Still proposed openstack/nova master: Remove utils.execute() from quobyte libvirt storage driver. https://review.openstack.org/619702 | 22:43 |
| openstackgerrit | Michael Still proposed openstack/nova master: Move nova.libvirt.utils away from using nova.utils.execute(). https://review.openstack.org/619703 | 22:43 |
| openstackgerrit | Michael Still proposed openstack/nova master: Imagebackend should call processutils.execute directly. https://review.openstack.org/619704 | 22:43 |
| openstackgerrit | Michael Still proposed openstack/nova master: Remove final users of utils.execute() in libvirt. https://review.openstack.org/619705 | 22:43 |
| openstackgerrit | Michael Still proposed openstack/nova master: Remove the final user of utils.execute() from virt.images https://review.openstack.org/620007 | 22:43 |
| openstackgerrit | Michael Still proposed openstack/nova master: Remove utils.execute() from the hyperv driver. https://review.openstack.org/620008 | 22:43 |
| openstackgerrit | Michael Still proposed openstack/nova master: Remove utils.execute() from virt.disk.api. https://review.openstack.org/620009 | 22:43 |
| openstackgerrit | Michael Still proposed openstack/nova master: Move a generic bridge helper to a linux_net privsep file. https://review.openstack.org/620010 | 22:43 |
| openstackgerrit | Michael Still proposed openstack/nova master: Move bridge creation to privsep. https://review.openstack.org/620180 | 22:43 |
| openstackgerrit | Michael Still proposed openstack/nova master: Move some linux network helpers to use privsep. https://review.openstack.org/621398 | 22:43 |
| openstackgerrit | Michael Still proposed openstack/nova master: Move simple execute call to processutils. https://review.openstack.org/621527 | 22:43 |
| openstackgerrit | Michael Still proposed openstack/nova master: Move interface enabling to privsep. https://review.openstack.org/621528 | 22:43 |
| openstackgerrit | Michael Still proposed openstack/nova master: Move setting mac addresses for network devices to privsep. https://review.openstack.org/621529 | 22:43 |
| openstackgerrit | Michael Still proposed openstack/nova master: Move interface disabling to privsep. https://review.openstack.org/622150 | 22:43 |
| openstackgerrit | Michael Still proposed openstack/nova master: Move binding ips to privsep. https://review.openstack.org/622151 | 22:43 |
| openstackgerrit | Michael Still proposed openstack/nova master: create_veth_pair is unused, remove it. https://review.openstack.org/624226 | 22:43 |
| openstackgerrit | Michael Still proposed openstack/nova master: Create specialist set_macaddr_and_vlan helper. https://review.openstack.org/624227 | 22:43 |
| openstackgerrit | Michael Still proposed openstack/nova master: Move create_tap_dev into privsep. https://review.openstack.org/624228 | 22:43 |
| mriedem | so much for ever getting zuul to run tests on your change now | 22:44 |
| *** wolverineav has quit IRC | 22:49 | |
| *** _alastor_ has quit IRC | 22:55 | |
| *** rcernin has joined #openstack-nova | 22:59 | |
| mriedem | dansmith: i figured out how i'm getting 1 server out of the API when listing and there is a copy in both cells: https://github.com/openstack/nova/blob/08d617084e5aa69ada0898d674022621d130aef3/nova/compute/api.py#L2684 | 23:03 |
| dansmith | mriedem: oh is that the filter for the BR if the instance is already created? | 23:04 |
| mriedem | yeah i think that's what it's for | 23:04 |
| mriedem | laski added it | 23:04 |
| dansmith | yeah, well, at least it makes sense | 23:04 |
| *** panda is now known as panda|off | 23:06 | |
| *** wolverineav has joined #openstack-nova | 23:10 | |
| *** rodolof has quit IRC | 23:10 | |
| *** spatel has quit IRC | 23:17 | |
| *** dave-mccowan has quit IRC | 23:19 | |
| *** slaweq has quit IRC | 23:19 | |
| *** igordc has joined #openstack-nova | 23:25 | |
| *** mlavalle has quit IRC | 23:26 | |
| *** igordc has quit IRC | 23:30 | |
| *** N3l1x has quit IRC | 23:38 | |
| *** igordc has joined #openstack-nova | 23:41 | |
| *** itlinux has joined #openstack-nova | 23:48 | |
| openstackgerrit | Matt Riedemann proposed openstack/nova master: WIP: Cross-cell resize https://review.openstack.org/603930 | 23:49 |
| *** hshiina has joined #openstack-nova | 23:56 | |
| mriedem | jangutter: i'll star that offload spec but it's going to be greek to me | 23:58 |
| mriedem | and i'll have to come back to it, done for the day | 23:58 |
| *** mmethot has quit IRC | 23:58 | |
| *** mriedem is now known as mriedem_away | 23:59 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!