*** ijw has quit IRC | 00:07 | |
*** ijw has joined #openstack-nova | 00:07 | |
*** rajathagasthya has joined #openstack-nova | 00:07 | |
*** ijw has quit IRC | 00:11 | |
*** rcernin has quit IRC | 00:12 | |
*** moshele has joined #openstack-nova | 00:14 | |
*** sterdnotshaken1 has quit IRC | 00:16 | |
*** Apoorva has quit IRC | 00:27 | |
*** tbachman has joined #openstack-nova | 00:27 | |
*** masber has joined #openstack-nova | 00:37 | |
mwynne | mriedem: There's nothing of any use in the logs. | 00:38 |
---|---|---|
mwynne | I had to reboot all my compute nodes. No idea why. | 00:38 |
mwynne | mriedem: Would you happen to know if I can specify a specific subnet for nota-manage's discover_hosts to search? | 00:39 |
*** thorst_afk has joined #openstack-nova | 00:45 | |
*** thorst_afk has quit IRC | 00:49 | |
*** Shunli has joined #openstack-nova | 00:52 | |
*** kbaegis has quit IRC | 00:53 | |
*** kbaegis has joined #openstack-nova | 00:54 | |
*** dixiaoli has joined #openstack-nova | 00:55 | |
*** chyka has joined #openstack-nova | 00:56 | |
*** dixiaoli has quit IRC | 00:56 | |
*** dixiaoli has joined #openstack-nova | 00:56 | |
*** itlinux has joined #openstack-nova | 00:57 | |
*** gmann has quit IRC | 01:01 | |
*** gmann has joined #openstack-nova | 01:01 | |
*** chyka has quit IRC | 01:01 | |
*** phuongnh has joined #openstack-nova | 01:08 | |
*** itlinux has quit IRC | 01:09 | |
*** kiennt has joined #openstack-nova | 01:13 | |
mriedem | mwynne: nope, doesn't work that way | 01:14 |
mriedem | it's not discovering hosts based on IPs | 01:14 |
*** ijw has joined #openstack-nova | 01:14 | |
*** chyka has joined #openstack-nova | 01:16 | |
*** ijw has quit IRC | 01:19 | |
alex_xu | mriedem: yea, I will check them | 01:19 |
*** masber has quit IRC | 01:20 | |
mriedem | thanks | 01:21 |
*** chyka has quit IRC | 01:21 | |
*** thorst_afk has joined #openstack-nova | 01:23 | |
*** dikonoor has joined #openstack-nova | 01:29 | |
*** kbaegis has quit IRC | 01:29 | |
*** kbaegis has joined #openstack-nova | 01:29 | |
*** dave-mccowan has joined #openstack-nova | 01:30 | |
*** gcb has quit IRC | 01:33 | |
*** kbaegis has quit IRC | 01:34 | |
*** gcb has joined #openstack-nova | 01:34 | |
openstackgerrit | Matt Riedemann proposed openstack/nova master: Centralize allocation deletion in ComputeManager https://review.openstack.org/496976 | 01:40 |
*** thorst_afk has quit IRC | 01:46 | |
*** yamahata has quit IRC | 01:48 | |
*** edmondsw has joined #openstack-nova | 01:51 | |
*** masber has joined #openstack-nova | 01:51 | |
*** rajathagasthya has quit IRC | 01:53 | |
*** zhurong has joined #openstack-nova | 01:54 | |
*** edmondsw has quit IRC | 01:55 | |
*** iceyao has joined #openstack-nova | 01:58 | |
*** coreywright has quit IRC | 02:06 | |
*** yangyape_ has joined #openstack-nova | 02:07 | |
*** dave-mccowan has quit IRC | 02:07 | |
*** tinwood has quit IRC | 02:10 | |
*** yangyapeng has quit IRC | 02:10 | |
*** tinwood has joined #openstack-nova | 02:11 | |
*** thorst_afk has joined #openstack-nova | 02:19 | |
*** thorst_afk has quit IRC | 02:19 | |
*** iceyao has quit IRC | 02:20 | |
*** dave-mccowan has joined #openstack-nova | 02:23 | |
*** coreywright has joined #openstack-nova | 02:24 | |
*** sridharg has joined #openstack-nova | 02:24 | |
*** sridharg has quit IRC | 02:27 | |
*** libin_ has joined #openstack-nova | 02:28 | |
*** sridharg has joined #openstack-nova | 02:29 | |
*** sridharg has quit IRC | 02:32 | |
*** sridharg has joined #openstack-nova | 02:33 | |
*** litao__ has joined #openstack-nova | 02:33 | |
*** baoli has joined #openstack-nova | 02:34 | |
*** sridharg has quit IRC | 02:34 | |
*** sridharg has joined #openstack-nova | 02:35 | |
*** baoli has quit IRC | 02:38 | |
*** sridharg has quit IRC | 02:40 | |
*** sridharg has joined #openstack-nova | 02:41 | |
*** sridharg has quit IRC | 02:41 | |
*** iceyao has joined #openstack-nova | 02:41 | |
*** sridharg has joined #openstack-nova | 02:41 | |
*** markvoelker_ has quit IRC | 02:41 | |
*** iceyao has quit IRC | 02:45 | |
*** hongbin has joined #openstack-nova | 02:46 | |
*** iceyao has joined #openstack-nova | 02:48 | |
*** artom has quit IRC | 03:07 | |
alex_xu | mriedem: looks like we didn't remove allocations after rescheduling also | 03:14 |
openstackgerrit | Alex Xu proposed openstack/nova master: Add functional test for rescheduling https://review.openstack.org/496995 | 03:17 |
*** links has joined #openstack-nova | 03:18 | |
openstackgerrit | Alex Xu proposed openstack/nova master: Add functional test for rescheduling https://review.openstack.org/496995 | 03:20 |
*** gbarros has joined #openstack-nova | 03:20 | |
*** thorst_afk has joined #openstack-nova | 03:20 | |
mriedem | alex_xu: hmm, yeah probably not, which sounds similar to https://bugs.launchpad.net/nova/+bug/1712411 | 03:22 |
openstack | Launchpad bug 1712411 in OpenStack Compute (nova) pike "Allocations may not be removed from dest node during failed migrations" [High,Triaged] | 03:22 |
mriedem | remove allocations during reschedule is now going to be like deallocating ports from a host | 03:23 |
mriedem | alex_xu: do you want to open a new bug for the reschedule issue? | 03:23 |
*** thorst_afk has quit IRC | 03:25 | |
*** dave-mccowan has quit IRC | 03:27 | |
openstackgerrit | Merged openstack/nova master: Delete instance allocations when the instance is deleted https://review.openstack.org/496942 | 03:29 |
*** moshele has quit IRC | 03:32 | |
*** nicolasbock has quit IRC | 03:35 | |
*** felipemonteiro has quit IRC | 03:38 | |
*** edmondsw has joined #openstack-nova | 03:39 | |
*** itlinux has joined #openstack-nova | 03:42 | |
*** edmondsw has quit IRC | 03:44 | |
*** hongbin has quit IRC | 03:57 | |
*** itlinux has quit IRC | 04:00 | |
alex_xu | mriedem: yea, I already opened one https://bugs.launchpad.net/nova/+bug/1712718 | 04:02 |
openstack | Launchpad bug 1712718 in OpenStack Compute (nova) "Allocations records aren't removed after rescheduling" [Undecided,New] | 04:02 |
*** itlinux has joined #openstack-nova | 04:02 | |
alex_xu | mrhillsman: yea, very similar with https://bugs.launchpad.net/nova/+bug/1712411 | 04:04 |
openstack | Launchpad bug 1712411 in OpenStack Compute (nova) pike "Allocations may not be removed from dest node during failed migrations" [High,Triaged] | 04:04 |
alex_xu | mriedem: yea, very similar with https://bugs.launchpad.net/nova/+bug/1712411 | 04:04 |
alex_xu | just for the case instance boot rescheduling | 04:05 |
*** tpatil has joined #openstack-nova | 04:12 | |
*** coreywright has quit IRC | 04:12 | |
*** iceyao has quit IRC | 04:16 | |
*** thorst_afk has joined #openstack-nova | 04:21 | |
*** mkrcmari__ has joined #openstack-nova | 04:22 | |
*** claudiub has joined #openstack-nova | 04:23 | |
*** thorst_afk has quit IRC | 04:26 | |
*** gyee has quit IRC | 04:31 | |
*** coreywright has joined #openstack-nova | 04:31 | |
*** kbaegis has joined #openstack-nova | 04:34 | |
*** iceyao has joined #openstack-nova | 04:34 | |
*** kbaegis has quit IRC | 04:38 | |
*** iceyao has quit IRC | 04:39 | |
*** markvoelker has joined #openstack-nova | 04:42 | |
*** iceyao has joined #openstack-nova | 04:44 | |
*** mvk_ has joined #openstack-nova | 04:45 | |
*** mkrcmari__ has quit IRC | 04:49 | |
*** zen369 has joined #openstack-nova | 04:53 | |
*** itlinux has quit IRC | 04:54 | |
*** udesale has joined #openstack-nova | 04:57 | |
*** chyka has joined #openstack-nova | 04:58 | |
*** zhurong has quit IRC | 04:58 | |
*** chyka has quit IRC | 05:02 | |
*** zhurong has joined #openstack-nova | 05:06 | |
*** rcernin has joined #openstack-nova | 05:11 | |
*** gouthamr has quit IRC | 05:13 | |
*** markvoelker has quit IRC | 05:17 | |
*** trinaths has joined #openstack-nova | 05:18 | |
*** thorst_afk has joined #openstack-nova | 05:22 | |
*** thorst_afk has quit IRC | 05:26 | |
*** rcernin has quit IRC | 05:27 | |
*** edmondsw has joined #openstack-nova | 05:28 | |
*** armax has quit IRC | 05:28 | |
*** diga has joined #openstack-nova | 05:31 | |
*** edmondsw has quit IRC | 05:32 | |
*** kiennt has quit IRC | 05:34 | |
*** shan has joined #openstack-nova | 05:50 | |
*** lpetrut has joined #openstack-nova | 05:51 | |
*** lajoskatona has joined #openstack-nova | 05:52 | |
*** moshele has joined #openstack-nova | 05:53 | |
*** kiennt has joined #openstack-nova | 05:55 | |
*** moshele has quit IRC | 05:57 | |
*** mdnadeem has joined #openstack-nova | 06:00 | |
*** hemna_ has quit IRC | 06:01 | |
*** ratailor has joined #openstack-nova | 06:01 | |
*** kiennt has quit IRC | 06:09 | |
*** Oku_OS-away is now known as Oku_OS | 06:09 | |
*** cfriesen_ has quit IRC | 06:11 | |
*** shan is now known as shan|afk | 06:11 | |
*** rcernin has joined #openstack-nova | 06:12 | |
*** mvk has joined #openstack-nova | 06:12 | |
openstackgerrit | Alex Xu proposed openstack/nova master: Add functional test for rescheduling https://review.openstack.org/496995 | 06:14 |
*** markvoelker has joined #openstack-nova | 06:14 | |
*** mvk_ has quit IRC | 06:16 | |
*** pcaruana has joined #openstack-nova | 06:21 | |
*** kbaegis has joined #openstack-nova | 06:22 | |
*** thorst_afk has joined #openstack-nova | 06:23 | |
*** kbaegis has quit IRC | 06:27 | |
*** thorst_afk has quit IRC | 06:27 | |
*** slaweq has joined #openstack-nova | 06:32 | |
*** tpatzig_ has joined #openstack-nova | 06:37 | |
*** tpatzig_ has quit IRC | 06:39 | |
*** FL1SK has quit IRC | 06:40 | |
*** moshele has joined #openstack-nova | 06:46 | |
*** markvoelker has quit IRC | 06:47 | |
*** belmoreira has joined #openstack-nova | 06:52 | |
openstackgerrit | Alex Xu proposed openstack/nova master: Remove allocation when booting instance rescheduled or aborted https://review.openstack.org/496995 | 06:54 |
*** tbachman has quit IRC | 06:59 | |
*** josecastroleon has quit IRC | 07:00 | |
*** lpetrut has quit IRC | 07:01 | |
*** Shunli has quit IRC | 07:02 | |
*** zsli_ has joined #openstack-nova | 07:02 | |
*** tbachman has joined #openstack-nova | 07:02 | |
openstackgerrit | liusheng proposed openstack/nova master: Trivail: remove unused instance_group_members_add method https://review.openstack.org/497115 | 07:14 |
*** lpetrut has joined #openstack-nova | 07:16 | |
*** edmondsw has joined #openstack-nova | 07:16 | |
openstackgerrit | liusheng proposed openstack/nova master: Trivial: remove unused instance_group_member_delete method https://review.openstack.org/497115 | 07:17 |
*** damien_r1 has quit IRC | 07:19 | |
*** damien_r has joined #openstack-nova | 07:19 | |
*** hferenc has quit IRC | 07:19 | |
*** tesseract has joined #openstack-nova | 07:20 | |
*** edmondsw has quit IRC | 07:20 | |
*** hferenc has joined #openstack-nova | 07:21 | |
*** zen369 has quit IRC | 07:23 | |
*** thorst_afk has joined #openstack-nova | 07:24 | |
*** ragiman has joined #openstack-nova | 07:24 | |
*** hferenc has quit IRC | 07:27 | |
*** hferenc has joined #openstack-nova | 07:28 | |
*** thorst_afk has quit IRC | 07:28 | |
*** hferenc has quit IRC | 07:30 | |
*** alexchadin has joined #openstack-nova | 07:31 | |
*** hferenc has joined #openstack-nova | 07:32 | |
*** neha_alhat has joined #openstack-nova | 07:33 | |
*** jpena|off is now known as jpena | 07:36 | |
*** markvoelker has joined #openstack-nova | 07:44 | |
*** dtantsur|afk is now known as dtantsur | 07:46 | |
*** mnestratov|2 has joined #openstack-nova | 07:48 | |
*** tesseract-RH has joined #openstack-nova | 07:49 | |
*** markus_z has joined #openstack-nova | 07:49 | |
*** tesseract-RH has quit IRC | 07:50 | |
*** tesseract-RH has joined #openstack-nova | 07:50 | |
*** tesseract has quit IRC | 07:52 | |
*** lpetrut has quit IRC | 07:57 | |
*** tesseract-RH has quit IRC | 08:01 | |
*** kiennt has joined #openstack-nova | 08:02 | |
*** tesseract-RH has joined #openstack-nova | 08:02 | |
*** gixxer1k has joined #openstack-nova | 08:05 | |
*** yamamoto has joined #openstack-nova | 08:10 | |
*** kbaegis has joined #openstack-nova | 08:10 | |
*** libin_ has quit IRC | 08:11 | |
*** kbaegis has quit IRC | 08:15 | |
*** markvoelker has quit IRC | 08:16 | |
*** bkopilov has joined #openstack-nova | 08:22 | |
*** thorst_afk has joined #openstack-nova | 08:25 | |
*** thorst_afk has quit IRC | 08:29 | |
openstackgerrit | jichenjc proposed openstack/nova master: Do not attempt volume swap when guest is stopped/suspended https://review.openstack.org/389798 | 08:30 |
*** jangutter has joined #openstack-nova | 08:31 | |
*** neha_alhat has quit IRC | 08:31 | |
*** tpatil has quit IRC | 08:33 | |
*** psachin has joined #openstack-nova | 08:36 | |
*** diga has quit IRC | 08:40 | |
*** lucas-afk is now known as lucasagomes | 08:41 | |
*** sahid has joined #openstack-nova | 08:44 | |
*** cdent has joined #openstack-nova | 08:48 | |
openstackgerrit | jichenjc proposed openstack/nova master: WIP: use conf for keystone session creation https://review.openstack.org/485121 | 08:49 |
*** FL1SK has joined #openstack-nova | 08:50 | |
*** alexchadin has quit IRC | 08:53 | |
*** alexchadin has joined #openstack-nova | 08:54 | |
*** moshele has quit IRC | 08:55 | |
*** dikonoo has joined #openstack-nova | 08:58 | |
*** dikonoor has quit IRC | 09:01 | |
openstackgerrit | jichenjc proposed openstack/nova master: fix race condition of instance host https://review.openstack.org/494458 | 09:02 |
*** mvk has quit IRC | 09:03 | |
*** cdent has quit IRC | 09:04 | |
*** edmondsw has joined #openstack-nova | 09:04 | |
*** cdent has joined #openstack-nova | 09:05 | |
*** mvk has joined #openstack-nova | 09:07 | |
*** edmondsw has quit IRC | 09:09 | |
ratailor | Can anybody tell me how to debug functional test ? | 09:10 |
*** sambetts|afk is now known as sambetts | 09:11 | |
*** slaweq has quit IRC | 09:11 | |
*** slaweq has joined #openstack-nova | 09:12 | |
*** markvoelker has joined #openstack-nova | 09:13 | |
*** yamamoto has quit IRC | 09:16 | |
*** slaweq has quit IRC | 09:16 | |
*** yamamoto has joined #openstack-nova | 09:17 | |
*** claudiub|2 has joined #openstack-nova | 09:17 | |
*** tesseract-RH has quit IRC | 09:18 | |
*** claudiub has quit IRC | 09:20 | |
*** mvk has quit IRC | 09:20 | |
*** ociuhandu has quit IRC | 09:21 | |
*** tesseract has joined #openstack-nova | 09:23 | |
*** moshele has joined #openstack-nova | 09:24 | |
*** thorst_afk has joined #openstack-nova | 09:25 | |
*** cdent has quit IRC | 09:26 | |
*** yamamoto has quit IRC | 09:27 | |
*** trinaths has left #openstack-nova | 09:27 | |
openstackgerrit | jichenjc proposed openstack/nova master: propagate OSError to MigrationPreCheckError https://review.openstack.org/469779 | 09:28 |
*** yamamoto has joined #openstack-nova | 09:29 | |
openstackgerrit | jichenjc proposed openstack/nova master: WIP: fix warning: enable-extensions https://review.openstack.org/497170 | 09:30 |
*** lpetrut has joined #openstack-nova | 09:30 | |
*** thorst_afk has quit IRC | 09:30 | |
*** yamamoto has quit IRC | 09:30 | |
openstackgerrit | Stephen Finucane proposed openstack/nova-specs master: Websockify security proxy framework https://review.openstack.org/496160 | 09:30 |
*** psachin has quit IRC | 09:31 | |
*** mkucia has joined #openstack-nova | 09:31 | |
*** zsli_ has quit IRC | 09:33 | |
*** sahid has quit IRC | 09:42 | |
*** claudiub has joined #openstack-nova | 09:42 | |
*** claudiub|2 has quit IRC | 09:44 | |
*** markvoelker has quit IRC | 09:46 | |
ratailor | Dinesh_Bhor, do you know how to debug functional test ? | 09:48 |
*** alexchadin has quit IRC | 09:49 | |
*** sahid has joined #openstack-nova | 09:53 | |
*** alexchadin has joined #openstack-nova | 09:54 | |
owalsh | moshele: do you have a minute to confirm some details about pci alias config? | 09:56 |
*** zz9pzza has quit IRC | 09:58 | |
*** kbaegis has joined #openstack-nova | 09:59 | |
*** slaweq has joined #openstack-nova | 09:59 | |
*** cdent has joined #openstack-nova | 10:02 | |
*** kbaegis has quit IRC | 10:03 | |
moshele | owalsh: yes | 10:08 |
*** shravani has joined #openstack-nova | 10:10 | |
owalsh | moshele: it appears to be required for nova-compute (comment #2 in https://bugs.launchpad.net/puppet-nova/+bug/1702730) | 10:12 |
openstack | Launchpad bug 1702730 in puppet-nova "[pci]/alias option is not present in the nova configuration on the computes" [Medium,New] - Assigned to Sai Sindhur Malleni (smalleni) | 10:12 |
*** zz9pzza has joined #openstack-nova | 10:13 | |
moshele | owalsh: yes, it was added when I fixed the cold migration and resize for pci devices | 10:13 |
*** dtantsur is now known as dtantsur|brb | 10:14 | |
owalsh | moshele: ack, thanks | 10:15 |
moshele | owalsh: np | 10:15 |
*** alexchadin has quit IRC | 10:16 | |
*** abalutoiu has joined #openstack-nova | 10:16 | |
*** abalutoiu has quit IRC | 10:21 | |
*** chyka has joined #openstack-nova | 10:22 | |
*** kbaegis has joined #openstack-nova | 10:24 | |
*** thorst_afk has joined #openstack-nova | 10:26 | |
*** ociuhandu has joined #openstack-nova | 10:26 | |
*** chyka has quit IRC | 10:27 | |
*** thorst_afk has quit IRC | 10:31 | |
*** yamamoto has joined #openstack-nova | 10:31 | |
*** nicolasbock has joined #openstack-nova | 10:33 | |
*** jjung has joined #openstack-nova | 10:35 | |
*** yamamoto has quit IRC | 10:36 | |
*** kiennt has quit IRC | 10:37 | |
sean-k-mooney | stephenfin: o/ congrats on the 2.0 patchwork release. did you ever get around to prototyping zuul intergration with the new rest api? | 10:40 |
stephenfin | sean-k-mooney: Not yet, but it's coming | 10:40 |
stephenfin | soon as I finish one or two other side projects | 10:40 |
* stephenfin best push git-pw 1.0 today, actually | 10:41 | |
*** abalutoiu has joined #openstack-nova | 10:41 | |
stephenfin | Also, thanks :) | 10:41 |
sean-k-mooney | nice will cool to see. | 10:41 |
sean-k-mooney | stephenfin: im still subscribed to patchwork@lists.ozlabs.org from when i was testing the proxy support so i recived your annouce email which is always nice to see. any plans in place to get the oficall host instance over to 2.0 in the near future | 10:43 |
stephenfin | sean-k-mooney: https://lists.ozlabs.org/pipermail/patchwork/2017-August/004550.html | 10:43 |
stephenfin | (yup, this weekend :)) | 10:44 |
*** xinliang has quit IRC | 10:44 | |
sean-k-mooney | awsome. i would love to set up an experimental ci to test new patchs to ovs to ensure i can still deploy ovs-dpdk with kolla and devstack | 10:45 |
sean-k-mooney | need to figure out how to do that upstream though or wait till i deploy our new dev cloud | 10:45 |
*** mdnadeem has quit IRC | 10:49 | |
*** dixiaoli has quit IRC | 10:51 | |
*** dpawlik_ is now known as dpawlik | 10:51 | |
*** edmondsw has joined #openstack-nova | 10:52 | |
*** nicolasbock has quit IRC | 10:54 | |
*** edmondsw has quit IRC | 10:57 | |
*** xinliang has joined #openstack-nova | 10:57 | |
*** phuongnh has quit IRC | 10:59 | |
*** markus_z has quit IRC | 11:01 | |
*** udesale has quit IRC | 11:04 | |
*** jpena is now known as jpena|lunch | 11:05 | |
*** mdnadeem has joined #openstack-nova | 11:07 | |
*** cdent has quit IRC | 11:08 | |
*** nicolasbock has joined #openstack-nova | 11:08 | |
openstackgerrit | Jianghua Wang proposed openstack/nova master: XenAPI: image handler option improvement https://review.openstack.org/497201 | 11:09 |
*** smatzek has joined #openstack-nova | 11:13 | |
*** ratailor has quit IRC | 11:14 | |
*** markus_z has joined #openstack-nova | 11:17 | |
*** ociuhandu has quit IRC | 11:17 | |
*** ociuhandu has joined #openstack-nova | 11:18 | |
*** kbaegis has quit IRC | 11:20 | |
*** gixxer1k has quit IRC | 11:24 | |
*** ociuhandu has quit IRC | 11:25 | |
*** gixxer1k has joined #openstack-nova | 11:25 | |
*** kbaegis has joined #openstack-nova | 11:26 | |
*** thorst_afk has joined #openstack-nova | 11:27 | |
*** alexchadin has joined #openstack-nova | 11:31 | |
*** thorst_afk has quit IRC | 11:32 | |
*** yamamoto has joined #openstack-nova | 11:33 | |
*** alexchadin has quit IRC | 11:36 | |
*** alexchadin has joined #openstack-nova | 11:37 | |
*** yamamoto has quit IRC | 11:38 | |
*** abalutoiu has quit IRC | 11:38 | |
*** gixxer1k has quit IRC | 11:39 | |
*** abalutoiu has joined #openstack-nova | 11:40 | |
*** markvoelker has joined #openstack-nova | 11:44 | |
*** edmondsw has joined #openstack-nova | 11:50 | |
*** elod has quit IRC | 11:52 | |
*** litao__ has quit IRC | 11:55 | |
*** sridharg has quit IRC | 11:57 | |
*** chyka has joined #openstack-nova | 11:59 | |
openstackgerrit | Alex Xu proposed openstack/nova master: Remove allocation when booting instance rescheduled or aborted https://review.openstack.org/496995 | 12:00 |
*** abalutoiu has quit IRC | 12:01 | |
*** jpena|lunch is now known as jpena | 12:02 | |
*** chyka has quit IRC | 12:04 | |
openstackgerrit | liusheng proposed openstack/nova master: Trivial: remove unused instance_group_member_delete method https://review.openstack.org/497115 | 12:04 |
*** abalutoiu has joined #openstack-nova | 12:05 | |
*** mdnadeem has quit IRC | 12:05 | |
*** sridharg has joined #openstack-nova | 12:09 | |
*** abalutoiu has quit IRC | 12:14 | |
openstackgerrit | Viktor Varga proposed openstack/nova master: Remove mox from unit/conductor/test_conductor.py (1) https://review.openstack.org/496691 | 12:15 |
*** thorst_afk has joined #openstack-nova | 12:16 | |
*** markvoelker has quit IRC | 12:16 | |
*** mkucia has quit IRC | 12:17 | |
*** iceyao has quit IRC | 12:21 | |
*** mriedem has quit IRC | 12:21 | |
pooja_jadhav | mriedem :Hi | 12:22 |
openstackgerrit | Ed Leafe proposed openstack/nova master: docs: Document the scheduler workflow https://review.openstack.org/475810 | 12:22 |
*** mdnadeem has joined #openstack-nova | 12:25 | |
pooja_jadhav | mriedem: Should we consider the urn format uuid like "urn:11111111-2222-4f44-5555-66666666666" or "urn:uuid:11111111-2222-4f44-5555-66666666666" for the nova APIs or not? | 12:25 |
*** cdent has joined #openstack-nova | 12:28 | |
*** abalutoiu has joined #openstack-nova | 12:31 | |
*** markvoelker has joined #openstack-nova | 12:32 | |
*** yamamoto has joined #openstack-nova | 12:34 | |
*** artom has joined #openstack-nova | 12:38 | |
*** lyan has joined #openstack-nova | 12:39 | |
*** yamamoto has quit IRC | 12:41 | |
*** iceyao has joined #openstack-nova | 12:41 | |
*** eharney has joined #openstack-nova | 12:46 | |
*** markus_z has quit IRC | 12:47 | |
*** ekuris has quit IRC | 12:49 | |
*** alexchadin has quit IRC | 12:52 | |
*** alexchadin has joined #openstack-nova | 12:53 | |
*** moshele has quit IRC | 12:54 | |
*** kornicameister has quit IRC | 12:54 | |
*** udesale has joined #openstack-nova | 12:55 | |
*** mriedem has joined #openstack-nova | 12:58 | |
*** pchavva has joined #openstack-nova | 12:59 | |
mriedem | stephenfin: want to nudge this through? https://review.openstack.org/#/c/496930/ | 12:59 |
stephenfin | mriedem: Looks good to me. +Wd | 13:00 |
*** dtantsur|brb is now known as dtantsur | 13:00 | |
mriedem | thanks | 13:01 |
*** catintheroof has joined #openstack-nova | 13:02 | |
openstackgerrit | Gábor Antal proposed openstack/nova master: Transform instance.live_migration_force_complete notification https://review.openstack.org/480561 | 13:02 |
openstackgerrit | Gábor Antal proposed openstack/nova master: Transform instance.live_migration_rollback_dest notification https://review.openstack.org/480214 | 13:02 |
*** chyka has joined #openstack-nova | 13:03 | |
*** kornicameister has joined #openstack-nova | 13:06 | |
*** chyka has quit IRC | 13:07 | |
VAhl | Is it possible to change port on the Placement-api? If yes, which parameter should be set in the [placement] section in nova.conf | 13:07 |
*** artom has quit IRC | 13:08 | |
*** zz9pzza has quit IRC | 13:09 | |
*** rmart04 has joined #openstack-nova | 13:09 | |
VAhl | found it. It is sites-available/nova-placement-api.conf | 13:10 |
*** zz9pzza has joined #openstack-nova | 13:11 | |
stephenfin | mriedem: I cherry-picked that cell deprecation to stable/pike, if we want to bring it in https://review.openstack.org/#/c/497166 | 13:11 |
stephenfin | (mostly so we can stay compliant with the deprecation policy) | 13:11 |
*** sree has joined #openstack-nova | 13:12 | |
mriedem | :/ | 13:12 |
*** markus_z has joined #openstack-nova | 13:13 | |
*** lucasxu has joined #openstack-nova | 13:15 | |
*** sree has quit IRC | 13:16 | |
*** jjung has quit IRC | 13:17 | |
*** rabel has joined #openstack-nova | 13:21 | |
openstackgerrit | Eric Fried proposed openstack/nova master: Monkey patch the blockdiag extension https://review.openstack.org/476159 | 13:22 |
mriedem | alex_xu: thanks for starting this https://review.openstack.org/#/c/496995/ - i've got some comments inline | 13:23 |
mriedem | cdent: dansmith: ^ | 13:23 |
* cdent sticks in queue | 13:23 | |
*** udesale has quit IRC | 13:26 | |
*** shan|afk has quit IRC | 13:26 | |
*** udesale has joined #openstack-nova | 13:26 | |
*** udesale has quit IRC | 13:26 | |
*** gouthamr has joined #openstack-nova | 13:27 | |
*** burt has joined #openstack-nova | 13:29 | |
rabel | hi there. we have a patch for the vmware driver: https://review.openstack.org/#/c/494169/ ( cdent already reviewed it ). i posted a comment with vmware-recheck-patch about a week ago, but nothing happens. can you help me on how to trigger vmware ci tests? | 13:30 |
* cdent looks | 13:30 | |
cdent | rabel: you may have a hit time when the vmware ci wasn’t happy. I’ve tried to trigger another | 13:32 |
rabel | cdent: thank you! | 13:32 |
mriedem | it hasn't been happy for about 6 months | 13:32 |
mriedem | but, there haven't been a ton of changes proposed to make it a priority | 13:33 |
cdent | mriedem: I’m happy to report that that is almost but not quite on the agenda to get some attention soon | 13:33 |
mriedem | heh | 13:33 |
*** dave-mccowan has joined #openstack-nova | 13:33 | |
*** jmlowe_ has quit IRC | 13:33 | |
mriedem | alex_xu: i'm not sure if you want to handle the reschedule for resize in the same patch, i know it's getting late for you and we don't have a functional regression test for the resize + reschedule case | 13:34 |
cdent | there’s been the usual such and such is in the way | 13:34 |
*** yamamoto has joined #openstack-nova | 13:36 | |
*** yufei has joined #openstack-nova | 13:37 | |
*** yufei has left #openstack-nova | 13:37 | |
alex_xu | mriedem: yea, I also thought the resize case is another patch | 13:38 |
alex_xu | mriedem: cdent just replied this comment https://review.openstack.org/#/c/496995/5/nova/compute/manager.py@1733 | 13:39 |
*** edmondsw has quit IRC | 13:40 | |
*** abalutoiu has quit IRC | 13:40 | |
lajoskatona | cdent: Gibi asked me to think about adding an extra testclass to test_servers to test the server moving stuff with custom resources | 13:41 |
lajoskatona | cdent: now I have a new class, and the setup works with custom resources and resorce providers, whatever.... | 13:41 |
cdent | lajoskatona: that’s a good idea | 13:42 |
*** yamamoto has quit IRC | 13:42 | |
lajoskatona | cdent: BUT: all tests are failing, due to exception from scheduler: 2017-08-24 14:49:41,491 DEBUG [nova.scheduler.manager] Got no allocation candidates from the Placement API. This may be a temporary occurrence as compute nodes start up and begin reporting inventory to the Placement service. | 13:43 |
cdent | can you push up your code as a wip so it is easier to look at? | 13:44 |
lajoskatona | cdent: shall I upload as WIP, and somebody should check it what am I missing from the workflow? | 13:44 |
cdent | :) | 13:44 |
cdent | yes! | 13:44 |
lajoskatona | cdent, ok, I upload :-) | 13:44 |
alex_xu | mriedem: cdent in the original RT behaviour, the instance claim will release the resource, we also nill out instance's host and name, that also means the resource will be released by RT | 13:44 |
mriedem | i'm replying | 13:45 |
*** links has quit IRC | 13:46 | |
mriedem | guh | 13:47 |
mriedem | ok replied | 13:47 |
mriedem | alex_xu: so you've got a point, as usual :) | 13:48 |
*** awaugama has joined #openstack-nova | 13:48 | |
mriedem | if the instance.host is None, then the API isn't going to cast to the compute to complete the deletion which would remove the allocation | 13:48 |
mriedem | and we don't currently remove the allocations in the API during a 'local' delete | 13:48 |
mriedem | so we're kind of stuck | 13:48 |
cdent | is there a reason we don’t do it from the API? | 13:49 |
mriedem | hasn't been fixed yet | 13:49 |
cdent | s/don’t/don’t want to/ | 13:49 |
mriedem | no, it's just an open bug https://bugs.launchpad.net/nova/+bug/1679750 | 13:49 |
openstack | Launchpad bug 1679750 in OpenStack Compute (nova) "Allocations are not cleaned up in placement for instance 'local delete' case" [Medium,Confirmed] | 13:49 |
mriedem | cdent: it was less of a problem at the time it was reported because the periodic task would heal and remove the allocations | 13:49 |
mriedem | well, actually let me see about that | 13:50 |
mriedem | yeah, actually the periodic task should still clean these up, in _remove_deleted_instances_allocations | 13:50 |
mriedem | that gets all allocations for the node | 13:50 |
*** eharney has quit IRC | 13:50 | |
mriedem | and if we get InstanceNotFound looking up the instance, it deletes the allocations for that instance | 13:51 |
*** zz9pzza has quit IRC | 13:51 | |
*** eharney has joined #openstack-nova | 13:54 | |
mriedem | left some more comments | 13:55 |
mriedem | probably need to get dansmith's opinion when he's around. i think we could go with this patch even though the periodic would cleanup the allocations for the node once the instance is deleted, and if we removed the allocations from the api during local delete that would also take care of it - but we don't have that fix yet | 13:56 |
*** edmondsw has joined #openstack-nova | 13:56 | |
dansmith | about whether or not we should delete allocations on local delete/ | 13:57 |
*** zz9pzza has joined #openstack-nova | 13:58 | |
mriedem | no, | 13:59 |
mriedem | https://review.openstack.org/#/c/496995/ | 13:59 |
mriedem | on build_results.FAILED - so unexpected failures during build, or BuildAbortException | 14:00 |
mriedem | but, it's meeting time | 14:00 |
*** derekh has joined #openstack-nova | 14:04 | |
*** mgariepy has quit IRC | 14:06 | |
*** mgariepy has joined #openstack-nova | 14:07 | |
*** hongbin has joined #openstack-nova | 14:08 | |
openstackgerrit | Lajos Katona proposed openstack/nova master: WIP: Test server movings with custom resources https://review.openstack.org/497399 | 14:08 |
cdent | lajoskatona: will take a look at that ^ once the nova meeting is done | 14:10 |
*** jmlowe has joined #openstack-nova | 14:12 | |
openstackgerrit | Eric Fried proposed openstack/nova master: Add formatting to scheduling activity diagram https://review.openstack.org/476204 | 14:15 |
efried | edleafe stephenfin sfinucan ^^ | 14:17 |
*** gyee has joined #openstack-nova | 14:17 | |
stephenfin | efried: Cheers. Looking | 14:17 |
efried | stephenfin edleafe Rebased on top of the monkeypatch one and updated for the latest text in the doc. | 14:18 |
efried | Not too much to see until the docs build completes, I guess :) | 14:18 |
openstackgerrit | Merged openstack/nova master: How about not logging errors every time we shelve offload? https://review.openstack.org/496930 | 14:20 |
stephenfin | efried: Yup, that's what I was hoping for. +2d, on the assumption the gate will catch any typos :) | 14:20 |
dtantsur | hi folks, it's me again :) do you think we should document setting https://github.com/openstack/nova/blob/master/nova/conf/compute.py#L634 to 0 in case of ironic? | 14:20 |
dtantsur | I don't think the compute instance is a popular cause of build failures for ironic, as opposed to the even world around it | 14:21 |
*** kbaegis has quit IRC | 14:21 | |
efried | dtantsur Are you saying ironic overrides that default today, or are you suggesting that it do so? | 14:21 |
*** marst has joined #openstack-nova | 14:22 | |
dtantsur | efried: I'm suggesting we document overriding it for nova-compute processes bound to ironic | 14:22 |
dtantsur | (maybe in ironic docs, we have a section on configuring nova) | 14:22 |
dtantsur | I'm just checking if my understanding of it is correct | 14:22 |
efried | dtantsur Oh, you're suggesting no code changes, just documenting that the user, if using ironic, will want to set it to zero. | 14:22 |
dtantsur | correct | 14:23 |
*** rmart04_ has joined #openstack-nova | 14:23 | |
efried | dtantsur So the way I understand that config var, it'll disable the compute host entirely if <N> consecutive builds fail. On the theory that we ought to stop trying to schedule to that host, because it's obviously sick. Why is ironic different in this regard? | 14:24 |
*** kbaegis has joined #openstack-nova | 14:24 | |
dtantsur | efried: because the nova-compute hosts merely pipe requests to ironic | 14:24 |
dtantsur | disabling a compute host will make some part of your ironic fleet unavailable, and that may NOT be the part that caused failures | 14:25 |
efried | I would think that's always the case ("may NOT be the part that caused failures"). | 14:26 |
*** zen369 has joined #openstack-nova | 14:26 | |
openstackgerrit | Alex Xu proposed openstack/nova master: Remove allocation when booting instance rescheduled or aborted https://review.openstack.org/496995 | 14:26 |
*** rmart04 has quit IRC | 14:26 | |
*** rmart04_ is now known as rmart04 | 14:26 | |
dtantsur | yeah, usually our failures are caused by network problems or misconfiguration of ironic | 14:26 |
dtantsur | not by the nova-compute process being broken | 14:26 |
efried | (btw dtantsur I'm not arguing against what you're suggesting - just playing devil's advocate) | 14:26 |
dtantsur | yeah, got it :) | 14:26 |
efried | Well, right; if it's network problems that are persistent enough to cause 10 consecutive failures, you should go fix the problems and then re-enable the compute host. | 14:27 |
efried | Ditto with misconfiguration, even more so. | 14:27 |
dtantsur | then why kill nova-compute, but not nova-api? :) | 14:27 |
dtantsur | both are not the source of the problem, both merely pass the requests on | 14:27 |
efried | Heh, guess that's a dansmith question. | 14:28 |
dtantsur | also, not the whole ironic deployment may be broken, but you're disabling a *random* part of it | 14:28 |
efried | That doesn't seem like an argument specific to ironic. | 14:28 |
dtantsur | no, because nova-compute for e.g. libvirt is tied to its libvirt instances | 14:29 |
dansmith | so, | 14:29 |
dtantsur | while nova-compute for ironic handles some randomly chosen share of ironic nodes | 14:29 |
dtantsur | which can change with time, btw | 14:29 |
dansmith | the request for that came with ironic people in the room, talking about such failures, and I'm pretty sure they were on board | 14:29 |
*** slaweq has quit IRC | 14:29 | |
dansmith | dtantsur: if you fail to build ten things _consecutively_ don't you think that's cause for concern? | 14:29 |
dtantsur | can we can specific people please then? I'm just seeing it as a source of wrong bug reports coming to me | 14:29 |
dansmith | like, why not drop that compute out and let the ring rebalance? | 14:30 |
dtantsur | dansmith: rebalanace annnnndd? fail 10 times more, because the problem was not fixed? | 14:30 |
dtantsur | and this way until we run out of computes? | 14:30 |
dansmith | dtantsur: well, it depends on what the problem is of course | 14:30 |
dtantsur | my point is that with VMs killing a nova-compute process can cut a misbahaving compute node. with ironic it does mostly nothing, until we run out of computes (that's where everything breaks) | 14:31 |
dansmith | dtantsur: the conversation in the room centered around (a) not letting one compute node be a black hole and (b) making it super obvious that something was wrong | 14:31 |
dtantsur | this assumes the compute node does *something*. in case of ironic it's a small orchestrator, essentially | 14:32 |
dansmith | dtantsur: but really, if ironic is failing 100% of the builds, what is the harm? leaving them in isn't going to fix anything | 14:32 |
*** zen369 has quit IRC | 14:32 | |
dtantsur | it's suprising for users, I think. e.g. they had a networking problem, ironic reported valid failures, they fixed them, and... nothing works | 14:32 |
dansmith | dtantsur: you can configure two computes differently such that one will behave differently right? like pointing them at two different glance mirrors, and one loses the ability to talk to glance | 14:32 |
dtantsur | but I cannot do this for ironic though | 14:33 |
dansmith | dtantsur: you know it's consecutive failures not total failures right? | 14:33 |
dtantsur | well, when something breaks, it's usually several attempts in a raw | 14:33 |
*** artom has joined #openstack-nova | 14:33 | |
dansmith | either way, some documentation on "this may not be the behavior you want for ironic" is fine, but I definitely don't want to just say "for ironic this should be zero" | 14:33 |
dtantsur | I would be less opinionated here, but I suspect the users are going to see "no valid hosts found" in response, right? | 14:34 |
dansmith | once all the computes are disabled? yes. | 14:34 |
cdent | lajoskatona: I’ve responded on that review with some info on what’s going wrong. | 14:34 |
*** zz9pzza has quit IRC | 14:34 | |
dansmith | dtantsur: the other thing that helps is that if you're really at 100% fail, eventually you stop wasting time, cpu, and network bandwidth trying to build and prepare things that are going to fail | 14:34 |
dtantsur | I'm reserving my opinion on this error :) it's too hard to debug, and it can mean anything (especially when RetryFilter is used) | 14:34 |
dansmith | so getting to zero disabled computes doesn't seem like a bad thing to me if literally 100% of the builds will fail | 14:35 |
dtantsur | does it include attempts from the RetryFilter? | 14:36 |
dansmith | I'm not sure what you mean.. are you asking if three retries against the same compute count as three failures? | 14:36 |
dtantsur | (side note: I became aware of this option after seeing https://review.openstack.org/#/c/496851/ ) | 14:37 |
dtantsur | dansmith: yep | 14:37 |
dansmith | dtantsur: sure, it's all the same | 14:37 |
dtantsur | dansmith: meaning, if people have retry count >= 10, one misconfigured instance can bring down a compute node? | 14:38 |
dansmith | dtantsur: if they configure retries high and don't adjust this, then sure | 14:38 |
*** yamamoto has joined #openstack-nova | 14:38 | |
dtantsur | okay, I think this is at least worth mentioning in our docs, because it may cause surprises (well, it did cause surprises already for tripleo people) | 14:39 |
*** artom has quit IRC | 14:39 | |
openstackgerrit | Ed Leafe proposed openstack/nova master: docs: Document the scheduler workflow https://review.openstack.org/475810 | 14:39 |
dansmith | dtantsur: what sort of mention do you want? | 14:39 |
dansmith | note that the text of that config option mentions retries, | 14:40 |
dansmith | so hopefully someone upping that to a crazy level will see that | 14:40 |
dtantsur | dansmith: I want to have a mention of it in https://docs.openstack.org/ironic/latest/install/configure-compute.html | 14:41 |
dtantsur | maybe just something like "Mind the following option, if you don't like <behavior>, change it to 0" | 14:41 |
dansmith | dtantsur: sure, ironic docs that talk about ideal nova settings when using the two together is certainly a good idea :) | 14:42 |
dtantsur | yep, that was my initial idea | 14:42 |
*** armax has joined #openstack-nova | 14:42 | |
dansmith | I have no problem with that | 14:42 |
alex_xu | mriedem: would you mind take care of https://review.openstack.org/496995, since the time is late for me | 14:43 |
dtantsur | cool, thanks all! | 14:44 |
*** yamamoto has quit IRC | 14:44 | |
mriedem | alex_xu: yup, i'll take over, thanks for working on it | 14:45 |
alex_xu | mriedem: thanks, good luck for rc2 :) | 14:45 |
mriedem | mnestratov|2: fyi https://bugs.launchpad.net/nova/+bug/1712801 | 14:45 |
openstack | Launchpad bug 1712801 in OpenStack Compute (nova) "Virtuozzo conainers lack SCSI info in libvirt XML" [Undecided,New] | 14:45 |
*** alexchadin has quit IRC | 14:46 | |
dtantsur | sahid: actually, could you take a quick look at https://docs.openstack.org/ironic/latest/install/configure-compute.html to check if everything is still correct there? there are a few options that I don't remember well | 14:46 |
dtantsur | oops, wrong ping | 14:46 |
*** zz9pzza has joined #openstack-nova | 14:46 | |
*** ralonsoh has joined #openstack-nova | 14:46 | |
dtantsur | sorry sahid, I meant dansmith (and please don't ask how I made this typo) | 14:46 |
sahid | :) | 14:47 |
*** jangutter has quit IRC | 14:47 | |
*** ralonsoh has quit IRC | 14:47 | |
mnestratov|2 | mriedem: thanks, this is our guy filed the bug in context of review https://review.openstack.org/#/c/495756/ | 14:47 |
*** jangutter has joined #openstack-nova | 14:48 | |
dansmith | dtantsur: we don't need the hostmanager thing after the resource class transition right? | 14:49 |
* dtantsur tries to remember | 14:49 | |
dansmith | I'm also not sure why you tell people to use a crazy host_subset_size without explaining why they may or may not want that | 14:50 |
dansmith | especially in pike where we shouldn't have any scheduler races | 14:50 |
dtantsur | I think using a value > 1 is still a good idea, as two instances cannot get on one host | 14:51 |
dtantsur | probably not so huge, and I agree that we need an explanation | 14:51 |
dtantsur | and yes, it seems like we should have deprecated ironic_host_manager in pike | 14:51 |
lajoskatona | cdent: thanks I check it | 14:52 |
dansmith | dtantsur: with claims in the scheduler and resource classes, you can not have two instances pick the same host | 14:53 |
efried | edleafe "Return a list of selected host + alternates, along with their allocations to the conductor" <== Is [allocations to the conductor] a thing, or are [a list of selected hosts + alternates, along with their allocations] being returned to the conductor? | 14:53 |
efried | (Trying to figure out if there should be a comma after 'allocations'.) | 14:53 |
dtantsur | dansmith: right, I may be severely outdated on this | 14:53 |
dansmith | dtantsur: but without that, an insane host_subset_size just means there is zero weight applied to any host, which I would expect some people would not want | 14:53 |
edleafe | efried: the latter | 14:54 |
dtantsur | so, what would you recommend, keeping it 1? or setting it to something moderate? | 14:54 |
edleafe | we return a whole big glob of stuff to the conductor | 14:54 |
efried | edleafe k, so yes comma. There's another typo; will post an edit. | 14:54 |
dansmith | dtantsur: I would rather you explain why you're prescribing one thing or the other, and maybe just call out that it's moot with RC usage | 14:55 |
dtantsur | dansmith: then I wonder why we had to do https://review.openstack.org/#/c/493989/.. maybe it was before we moved the CI to resource classes though.. | 14:55 |
openstackgerrit | Eric Fried proposed openstack/nova master: docs: Document the scheduler workflow https://review.openstack.org/475810 | 14:55 |
dtantsur | vdrok: do you remember ^^^? | 14:55 |
*** dikonoo has quit IRC | 14:55 | |
*** zz9pzza has quit IRC | 14:56 | |
dtantsur | or maybe it was because of backports... | 14:56 |
dansmith | dtantsur: yeah I dunno | 14:56 |
openstackgerrit | Eric Fried proposed openstack/nova master: Monkey patch the blockdiag extension https://review.openstack.org/476159 | 14:56 |
dtantsur | I cannot combine my brain back in a working state after the release drill | 14:56 |
dansmith | dtantsur: for devstack there's likely no reason to weigh any of the options and so increasing that value just means we make the scheduler choose randomly amongst empty hosts | 14:58 |
dansmith | which might be better for the gate for some reason, I dunno | 14:58 |
dansmith | but not for regular people that might want to weigh hosts with newer hardware differently or something like that | 14:58 |
dtantsur | weighing hosts for ironic is something new to me, but it makes sense indeed | 14:59 |
dansmith | dtantsur: well, maybe it's new because you disable weighing entirely with that 999999 thing :P | 14:59 |
edleafe | efried: I can't vim | 14:59 |
*** mdnadeem has quit IRC | 14:59 | |
efried | edleafe :) | 14:59 |
*** damien_r has left #openstack-nova | 14:59 | |
dtantsur | dansmith: haha, no, I did not even know it was possible. have I ever mentioned my poor knowledge of nova? | 15:00 |
dansmith | dtantsur: I don't know that our in-tree weighers would mean anything for ironic nodes, but weighers are some of the more likely things for someone in a deployment to write customly to get the host selection they want | 15:00 |
dansmith | heh | 15:00 |
dtantsur | yeah, and "prefer newer hardware" makes some sense to me indeed, for example | 15:00 |
*** kbaegis has quit IRC | 15:00 | |
dansmith | yep | 15:00 |
openstackgerrit | sahid proposed openstack/nova master: libvirt: bandwidth param should be set in guest migrate https://review.openstack.org/497455 | 15:01 |
openstackgerrit | sahid proposed openstack/nova master: libvirt: add method to configure migration speed https://review.openstack.org/497456 | 15:01 |
openstackgerrit | sahid proposed openstack/nova master: libvirt: slowly live-migration to ensure network is ready https://review.openstack.org/497457 | 15:01 |
dtantsur | okay, thanks again dansmith. may I ping you for review when I write an update for this docs page? | 15:01 |
dansmith | dtantsur: sure | 15:01 |
dtantsur | cool, I'll try to finish it today | 15:01 |
*** Swami has joined #openstack-nova | 15:01 | |
openstackgerrit | David Rabel proposed openstack/nova master: Adds support for graceful shutdown for VMware instances https://review.openstack.org/494169 | 15:02 |
*** artom has joined #openstack-nova | 15:02 | |
*** markus_z has quit IRC | 15:02 | |
*** yingjun has joined #openstack-nova | 15:03 | |
mriedem | here is the bug for the resize + reschedule not removing allocations issue https://bugs.launchpad.net/nova/+bug/1712850 | 15:06 |
openstack | Launchpad bug 1712850 in OpenStack Compute (nova) "Allocations are not removed from destination node when rescheduling during resize/migrate" [High,Triaged] | 15:06 |
*** cfriesen_ has joined #openstack-nova | 15:06 | |
*** abalutoiu has joined #openstack-nova | 15:06 | |
vdrok | dtantsur: /me is on holiday today, but it was needed because all weights are the same in ci for our nodes, so the same ones were selected during parallel tests for instance build, and were racing as iirc claim happens on compute | 15:07 |
vdrok | So reschedules were happening constantly, and Max reschedules is 3 by default | 15:07 |
rabel | is "Intel PCI CI" always non-voting? | 15:08 |
rabel | that is: can i ignore that it failed without a reason? according to https://wiki.openstack.org/wiki/ThirdPartySystems/Intel-PCI-CI it is non-voting | 15:09 |
cdent | rabel: pretty much, yeah | 15:09 |
*** jistr|trng is now known as jistr | 15:09 | |
rabel | cool, thanks. | 15:09 |
mriedem | rabel: you can yell at sean-k-mooney about that | 15:10 |
*** rmart04 has quit IRC | 15:12 | |
*** iceyao has quit IRC | 15:14 | |
dtantsur | dansmith: see vdrok's comment above ^^^. is it going away with resource classes? especially wrt "claim happens on compute"? | 15:14 |
*** abalutoiu has quit IRC | 15:14 | |
sean-k-mooney | haha well its not run by our team but what was the questing releating to the pci ci | 15:14 |
dansmith | dtantsur: yep | 15:15 |
rabel | the question was just if i can ignore if it fails. ;) | 15:15 |
dtantsur | good to know | 15:15 |
sean-k-mooney | ah well yes and no. if you are not touching the pci code probably if you are you might want to take a look at it | 15:15 |
* dtantsur tries to understand why consecutive_build_service_disable_threshold option does not show up in sample configuration files Oo | 15:15 | |
*** sterdnotshaken has joined #openstack-nova | 15:15 | |
*** lajoskatona has left #openstack-nova | 15:16 | |
sean-k-mooney | the pci ci is testing a very limited scope | 15:16 |
*** ragiman has quit IRC | 15:17 | |
openstackgerrit | Eric Fried proposed openstack/nova master: docs: Document the scheduler workflow https://review.openstack.org/475810 | 15:18 |
sean-k-mooney | we had planned to combine it with the nfv ci and expand the scope to introduce livemigration and other testing but we lost 2 headcount including our ci lead so that did not go ahead | 15:18 |
dtantsur | dansmith: why aren't compute_group_opts here https://github.com/openstack/nova/blob/master/nova/conf/compute.py#L1122-L1130 ? I think it causes this option to not appear in the sample conf | 15:18 |
*** yingjun has quit IRC | 15:19 | |
dansmith | dtantsur: I dunno what sort of black magic is involved in all this.. maybe ask mriedem or sfinucan or edleafe | 15:19 |
dtantsur | ack | 15:20 |
*** sterdnotshaken has quit IRC | 15:20 | |
*** hemna_ has joined #openstack-nova | 15:21 | |
dtantsur | I also see compute_driver option twice - in [DEFAULT] and in [compute], wut? | 15:22 |
* dtantsur knows the fix | 15:23 | |
mriedem | yeah that looks like a bug, the former i mean | 15:23 |
dtantsur | mriedem: well, actually the option is in [DEFAULT]. lemme bake a quick patch, you'll see what I mean | 15:24 |
efried | mriedem dtantsur L1141 should be compute_group_opts, not compute_opts. | 15:25 |
dtantsur | this is what I'm fixing right now, yes :) | 15:25 |
efried | Cool | 15:25 |
efried | Looks like Intel PCI CI is out of disk space or something. All runs failing, log links 404. | 15:26 |
openstackgerrit | Dmitry Tantsur proposed openstack/nova master: Fix sample configuration generation for compute-related options https://review.openstack.org/497460 | 15:26 |
dtantsur | efried, mriedem ^^^ | 15:26 |
efried | dtantsur +1, good catch. | 15:27 |
openstackgerrit | Eric Fried proposed openstack/nova master: Monkey patch the blockdiag extension https://review.openstack.org/476159 | 15:27 |
*** yingjun has joined #openstack-nova | 15:28 | |
*** sterdnotshaken has joined #openstack-nova | 15:28 | |
openstackgerrit | Eric Fried proposed openstack/nova master: Add formatting to scheduling activity diagram https://review.openstack.org/476204 | 15:30 |
*** sahid has quit IRC | 15:30 | |
efried | edleafe Found another error in https://review.openstack.org/#/c/475810/ , fixed it, and rebased ^^ for cumulative edits. | 15:30 |
efried | sfinucan ^ cc | 15:30 |
openstackgerrit | Matt Riedemann proposed openstack/nova master: Fix sample configuration generation for compute-related options https://review.openstack.org/497460 | 15:31 |
*** bnemec has joined #openstack-nova | 15:31 | |
efried | gr, stephenfin (split personality these days?) | 15:33 |
*** chyka has joined #openstack-nova | 15:33 | |
*** yufei has joined #openstack-nova | 15:34 | |
stephenfin | efried: I had an away message set of sfinucan, but it seems to have been unset | 15:34 |
stephenfin | I'll just switch it off altogether. stephenfin has been in use for long enough now | 15:34 |
*** sfinucan has quit IRC | 15:35 | |
stephenfin | ...and done | 15:35 |
* efried sheds a single tear for the passing of sfinucan | 15:35 | |
mriedem | he died in a tent in greece somewhere | 15:36 |
mriedem | from a splitting hangover | 15:36 |
efried | With that kind of hangover, death is a mercy. | 15:36 |
*** dtp has joined #openstack-nova | 15:37 | |
*** ijw has joined #openstack-nova | 15:37 | |
*** yingjun has quit IRC | 15:38 | |
efried | dtantsur You got the pike backport? | 15:38 |
*** yamamoto has joined #openstack-nova | 15:40 | |
mriedem | efried: i just posted it | 15:41 |
mriedem | well, 5 minutes ago | 15:41 |
*** cali_boxer has joined #openstack-nova | 15:41 | |
efried | hm, no bot? | 15:41 |
mriedem | not for stable | 15:41 |
mriedem | we could add that | 15:41 |
mriedem | it's somewhere in project-config | 15:42 |
efried | And no cherry-pick comments in the original? | 15:42 |
mriedem | that's only if you cherry pick from gerrit, | 15:42 |
mriedem | which if you that before it's merged, you don't get the cherry picked from line in the commit in the cherry pick | 15:42 |
mriedem | it's a whole big deal | 15:42 |
efried | geez | 15:42 |
mriedem | dansmith: let me know when you'd like to process and discuss https://review.openstack.org/#/c/496995/ | 15:42 |
* efried goes through the bug report to find the new link. | 15:43 | |
dansmith | yeah sorry on a call | 15:43 |
mriedem | efried: just click the change id | 15:43 |
mriedem | it'll be the same | 15:43 |
efried | or that | 15:43 |
*** Oku_OS is now known as Oku_OS-away | 15:43 | |
*** windsn has joined #openstack-nova | 15:44 | |
*** yamamoto has quit IRC | 15:45 | |
*** cali_boxer has quit IRC | 15:46 | |
*** sambetts is now known as sambetts|afk | 15:47 | |
*** amotoki is now known as amotoki__away | 15:47 | |
*** yufei has quit IRC | 15:50 | |
*** jjung has joined #openstack-nova | 15:51 | |
openstackgerrit | Merged openstack/os-vif master: Updated from global requirements https://review.openstack.org/488086 | 15:52 |
*** itlinux has joined #openstack-nova | 15:53 | |
*** zz9pzza has joined #openstack-nova | 15:54 | |
*** belmoreira has quit IRC | 15:54 | |
*** rcernin has quit IRC | 15:54 | |
*** shiyer has quit IRC | 15:57 | |
*** pcaruana has quit IRC | 15:57 | |
*** tesseract has quit IRC | 16:03 | |
*** itlinux has quit IRC | 16:03 | |
*** openstackgerrit has quit IRC | 16:04 | |
*** openstackgerrit has joined #openstack-nova | 16:05 | |
openstackgerrit | Dan Smith proposed openstack/nova master: Add uuid to migration object and migrate-on-load https://review.openstack.org/496934 | 16:05 |
openstackgerrit | Dan Smith proposed openstack/nova master: Add placeholder migrations for Pike backports https://review.openstack.org/496932 | 16:05 |
openstackgerrit | Dan Smith proposed openstack/nova master: Add uuid to migration table https://review.openstack.org/496933 | 16:05 |
cdent | \o/ | 16:05 |
*** abalutoiu has joined #openstack-nova | 16:06 | |
*** links has joined #openstack-nova | 16:06 | |
*** abalutoiu_ has joined #openstack-nova | 16:08 | |
*** liverpooler has quit IRC | 16:11 | |
*** yufei has joined #openstack-nova | 16:11 | |
*** abalutoiu has quit IRC | 16:12 | |
*** jangutter has quit IRC | 16:12 | |
*** itlinux has joined #openstack-nova | 16:13 | |
*** yufei has quit IRC | 16:26 | |
*** mvk has joined #openstack-nova | 16:34 | |
*** links has quit IRC | 16:38 | |
openstackgerrit | Matt Riedemann proposed openstack/nova master: Remove allocation when booting instance rescheduled or aborted https://review.openstack.org/496995 | 16:38 |
*** yamamoto has joined #openstack-nova | 16:41 | |
*** yufei has joined #openstack-nova | 16:44 | |
*** efoley has joined #openstack-nova | 16:44 | |
*** yamahata has joined #openstack-nova | 16:46 | |
*** yamamoto has quit IRC | 16:47 | |
*** dtantsur is now known as dtantsur|afk | 16:47 | |
*** Swami has quit IRC | 16:49 | |
*** lucasagomes is now known as lucas-afk | 16:51 | |
*** psachin has joined #openstack-nova | 16:51 | |
*** Apoorva has joined #openstack-nova | 16:51 | |
*** efoley has quit IRC | 16:54 | |
*** derekh has quit IRC | 16:55 | |
*** vikrant has joined #openstack-nova | 16:58 | |
*** cdent has quit IRC | 17:04 | |
*** yufei has left #openstack-nova | 17:05 | |
*** slaweq has joined #openstack-nova | 17:06 | |
*** shan has joined #openstack-nova | 17:13 | |
mriedem | blarg we only show faults if the instance is in ERROR or DELETED status | 17:16 |
mriedem | and when a resize/migrate fails on the dest during _prep_resize we don't set the instance to ERROR state | 17:16 |
mriedem | which i guess makes sense since it's fine on the source | 17:17 |
mriedem | but you'd wonder why the thing didn't resize or move | 17:17 |
dansmith | mriedem: I'm returning to that review for like the fifth time | 17:17 |
dansmith | need to turn off my email and chat or something | 17:17 |
mriedem | this time it's personal | 17:17 |
dansmith | hah | 17:17 |
dansmith | Review The Patch 5: Do or Die | 17:18 |
dansmith | mriedem: hmm, yeah, I guess right now if we reschedule the scheduler would actually create a doubled move allocation huh? | 17:20 |
mriedem | tripled | 17:21 |
mriedem | i think | 17:21 |
dansmith | well, N'd for N retries right? | 17:21 |
mriedem | the point of the move / double stuff in the scheduler is to not overwrite the existing allocations | 17:21 |
mriedem | yup | 17:21 |
dansmith | yeah | 17:21 |
mriedem | quintupled? | 17:21 |
dansmith | we're awesome | 17:21 |
mriedem | yeah so i was mostly worried that alex's patch was doing things in a too generic way, but i've since talked myself out of that | 17:22 |
mriedem | but left the detailed comments in there | 17:22 |
dansmith | so, this functional test has a mock in it, which is kinda contrary to the goal here right? | 17:22 |
mriedem | the mock is just to force the build failure on the source host and trigger a reschedule - i suppose you could do that by saying, boot on host A which we know won't fit a flavor or something so the claim fails | 17:23 |
dansmith | or just not make it a functional test | 17:23 |
mriedem | but you need to get by the scheduler and to the compute | 17:23 |
mriedem | we have a similar functional regression test that tests reschedule similar to this | 17:23 |
mriedem | similarly | 17:23 |
dansmith | meaning it uses a mock? | 17:24 |
mriedem | a fixture | 17:24 |
mriedem | but yeah | 17:24 |
mriedem | https://github.com/openstack/nova/blob/master/nova/tests/functional/regressions/test_bug_1671648.py#L90 | 17:24 |
dansmith | okay I guess I can't keep track of our intentions here | 17:24 |
mriedem | given there are 4 services involved with a reschedule i like having the functional test | 17:24 |
dansmith | yeah, just having a fake driver that fails the first spawn or something seems like less unit-test-esque interaction, but whatever | 17:25 |
mriedem | could do that too - would be simpler | 17:26 |
mriedem | later cleanup i suppose | 17:26 |
mriedem | or in this one, whatever | 17:26 |
*** rcernin has joined #openstack-nova | 17:27 | |
mriedem | things get complicated with a special compute driver i think b/c you have to set that in config before starting the compute service you're using, which is done in setUp, unless you make it a standalone test class, or start a new 3rd compute and boot directly to that host | 17:28 |
dansmith | mriedem: and we're saying this belongs in ServerMovingTests because why? it's a reschedule? | 17:28 |
dansmith | sure, but it's more cleanerer I think | 17:28 |
mriedem | i assume he threw it there because there are other tests checking allocation stuff in there | 17:28 |
mriedem | but it's not a move, yeah | 17:28 |
mriedem | didn't think abou that | 17:28 |
dansmith | yeah we could probably rename that test class at this point to be TestAllTheAllocationThingsWeEffedUpKthx | 17:29 |
mriedem | so maybe we split that out to a separate test class with it's own fake driver in a follow up? | 17:29 |
dansmith | okay | 17:29 |
*** vikrant has quit IRC | 17:31 | |
dansmith | okay +Wd with those comments | 17:32 |
*** Swami has joined #openstack-nova | 17:33 | |
mriedem | cool. i'm working on the regression test for the migrate + reschedule one, which is turning out to be non-trivial | 17:34 |
dansmith | awesome | 17:35 |
mriedem | just hard to poll for the failure | 17:35 |
mriedem | have to check action events or listen for notifications | 17:35 |
mriedem | ^ super usability for end api users when a resize / migrate fails | 17:36 |
dansmith | whatever, users love a challenge, amirite? | 17:39 |
*** gixxer1k has joined #openstack-nova | 17:39 | |
mriedem | playing hard to get works in dating | 17:39 |
mriedem | why can't it work in software? | 17:39 |
artom | Because it only works for girls, and there are no girls in software | 17:40 |
* mriedem backs away | 17:40 | |
mriedem | enjoy your twitter doom | 17:40 |
artom | I'm not on Twitter | 17:41 |
mriedem | ok ok, well, i'm sure mel's boot will find you | 17:43 |
*** yamamoto has joined #openstack-nova | 17:43 | |
artom | Mel is clearly a figment of our imagination, because of my previous assertion | 17:44 |
*** catinthe_ has joined #openstack-nova | 17:44 | |
*** catintheroof has quit IRC | 17:45 | |
rabel | sean-k-mooney: it seems that "Intel PCI CI"s pci-test is not non-voting in https://review.openstack.org/#/c/494169/4 . is that correct? can you tell me how to rerun it? | 17:46 |
mriedem | rabel: it is non-voting | 17:46 |
mriedem | otherwise there would be a -1 next to 'Verified' | 17:46 |
mriedem | don't let the red FAILURE on the actual job status trick you | 17:46 |
rabel | mriedem: ok, thanks. i was confused by having (non-voting) on other tests, but not this one | 17:47 |
rabel | so no -1 means i'm fine? :) | 17:47 |
mriedem | ah i don't know how other 3rd party CIs do that | 17:47 |
mriedem | well, jenkins is the vote you care about | 17:47 |
mriedem | for CI | 17:47 |
mriedem | and the vmware CI | 17:47 |
mriedem | but the latter is on the fritz | 17:48 |
mriedem | cdent has to call down to larry in the basement to kick it | 17:48 |
rabel | :D | 17:48 |
openstackgerrit | Merged openstack/nova master: api-ref: fix key_name note formatting https://review.openstack.org/496718 | 17:48 |
*** yamamoto has quit IRC | 17:48 | |
artom | To be fair, if your patch actually touched on anything PCI, it might be a good idea to see why the Intel CI failed | 17:48 |
artom | But since it doesn't, you can ignore it | 17:48 |
openstackgerrit | Merged openstack/nova master: Remove VMware driver _get_vm_ref_from_uuid method https://review.openstack.org/444959 | 17:49 |
rabel | will it help to write vmware-recheck-patch from time to time if it does not run? | 17:49 |
*** windsn has quit IRC | 17:49 | |
*** lpetrut has quit IRC | 17:50 | |
openstackgerrit | Evgeny Antyshev proposed openstack/nova master: No scsi unit information in instance XML https://review.openstack.org/495756 | 17:54 |
openstackgerrit | Eric Berglund proposed openstack/nova master: WIP: PowerVM Driver: config drive https://review.openstack.org/409404 | 17:58 |
*** shan has quit IRC | 18:01 | |
*** rajathagasthya has joined #openstack-nova | 18:03 | |
openstackgerrit | Merged openstack/nova master: Move common definition into common layer https://review.openstack.org/489491 | 18:04 |
openstackgerrit | Merged openstack/nova master: Remove RamFilter and DiskFilter in default filter https://review.openstack.org/492765 | 18:04 |
openstackgerrit | Octave Orgeron proposed openstack/nova master: Enables MySQL Cluster Support for Nova https://review.openstack.org/446643 | 18:05 |
mriedem | dansmith: per your comment in alex's change for another test, i think that's covered in https://review.openstack.org/#/c/470578/ | 18:07 |
dansmith | oh okay I hadn't seen that yeah | 18:07 |
mriedem | starting the compute runs update_available_resource which does the thing to remove the now deleted allocation | 18:07 |
mriedem | so yay | 18:07 |
*** itlinux has quit IRC | 18:08 | |
*** shan has joined #openstack-nova | 18:14 | |
*** sridharg has quit IRC | 18:15 | |
*** dixiaoli has joined #openstack-nova | 18:22 | |
openstackgerrit | Matt Riedemann proposed openstack/nova master: Add functional test for rescheduling during a migration https://review.openstack.org/497541 | 18:23 |
mriedem | dansmith et al ^ is the functional recreate test for the reschedule + migrate bug | 18:24 |
*** lpetrut has joined #openstack-nova | 18:24 | |
*** dixiaoli has quit IRC | 18:26 | |
*** hemna_ has quit IRC | 18:28 | |
*** beagles has left #openstack-nova | 18:29 | |
*** egonzalez has joined #openstack-nova | 18:31 | |
mriedem | ugh, you know what, don't we merge allocations for resize to same host in the scheduler | 18:31 |
*** jpena is now known as jpena|off | 18:32 | |
mriedem | so i can't remove the allocations for the dest node blindly in prep_resize b/c dest node might == source node for resize to same host, but we also shouldn't leave the allocations as the doubled up ones | 18:32 |
dansmith | we don't? we have a test for that | 18:33 |
mriedem | this is where prep_resize fails on the dest host, before we ever confirm/revert | 18:33 |
mriedem | i think our existing resize to same host tests are all driven on confirm/revert | 18:34 |
dansmith | right but the scheduler is the thing that doubles | 18:34 |
mriedem | i know | 18:34 |
dansmith | that move_claim thingy | 18:34 |
* dansmith is confused | 18:34 | |
mriedem | and the compute is what's cleaning up | 18:34 |
mriedem | in the before times, if this happened, the RT periodic would just overwrite the allocations for the instance based on what it's currently consuming | 18:35 |
mriedem | are we still doing that? | 18:35 |
dansmith | what is the thing you think we're not doing? handling the case where prep_resize fails? or the initial doubling before we get that far? | 18:35 |
mriedem | yeah so before we did the has_ocata_computes thing, the periodic would overwrite the doubled allocation using _update_usage_from_instance | 18:36 |
mriedem | self.reportclient.update_instance_allocation | 18:36 |
dansmith | right | 18:36 |
mriedem | if you don't have ocata computes, that won't correct this now | 18:36 |
dansmith | which won't happen in pike land | 18:36 |
mriedem | we're not handling the case that prep_resize fails | 18:36 |
mriedem | and cleaning up the allocation | 18:36 |
mriedem | that the scheduler created | 18:36 |
dansmith | yeah, so you're talking about the case where we've doubled things in the scheduler and don't undouble them if we fail in prep right? | 18:37 |
mriedem | yup | 18:37 |
mriedem | so maybe this falls under the same bug i reported for when live migration fails and we don't cleanup | 18:37 |
dansmith | I would like to point out that if we were doing the allocation thing in the conductor instead of the scheduler, we'd have this all in an auto-cleanup context manager that would roll back the doubling if we failed to kick off a thing | 18:37 |
mriedem | this is essentially the same kind of fix probably, a periodic checking for failed migrations and cleaning up allocations related to them | 18:37 |
dansmith | well, we should clean up allocations any time we have a solid failure and know where the instance remains, | 18:38 |
dansmith | and a failure in prep is that case, right? we know we didn't move anything | 18:38 |
mriedem | prep_resize is a cast from conductor so i'm not sure how that would auto-cleanup in this case | 18:39 |
dansmith | it's a cast from conductor to compute? | 18:39 |
mriedem | yeah | 18:39 |
dansmith | ah, yeah, I see | 18:39 |
mriedem | so, remove the dest node allocation when not resizing to same host is simple | 18:39 |
dansmith | that's legacy from when the api was doing it I think, but.. | 18:40 |
mriedem | the resize to same host cleanup is shittier, since we basically need to overwrite the allocation back to the original flavor | 18:40 |
*** ijw has quit IRC | 18:40 | |
mriedem | which is basically just doing our RT overwrite stuff again, but in a different place | 18:40 |
dansmith | well, | 18:40 |
*** eharney has quit IRC | 18:40 | |
dansmith | we can just subtract what the new flavor would have had in it right? | 18:40 |
dansmith | not just regenerate, but subtract the new_flavor from our allocation if it's same host | 18:41 |
dansmith | merge_resources() with new_flavor and -1 as the sign | 18:41 |
dansmith | that will avoid trampling on shared things | 18:41 |
mriedem | sure | 18:41 |
mriedem | god i should probably have a test for the resize to same host case then too... | 18:42 |
mriedem | and it's nearly 2pm here | 18:42 |
mriedem | anyway, will work on the easy one first | 18:42 |
dansmith | mriedem: so you mean the fix for the thing you're testing in 497541 yes? | 18:44 |
*** yamamoto has joined #openstack-nova | 18:44 | |
mriedem | yeah | 18:45 |
mriedem | i don't know if we should do the resize to same host fix in here too or leave that for another bug | 18:45 |
mriedem | since it'd be a different test | 18:45 |
dansmith | if it doesn't really overlap then separate is probably best | 18:46 |
mriedem | and arguably resize to same host failures are less severe for holding up the release | 18:46 |
dansmith | yes, for real-world people | 18:46 |
mriedem | the ones on mtv? | 18:46 |
dansmith | realistically, the way this is going, we're going to be fixing these kinds of issues for a year | 18:46 |
dansmith | heh | 18:46 |
mriedem | no shit, this is whack a mole at it's finest | 18:46 |
dansmith | like, I'm fairly worried about how this is all going to go down | 18:46 |
cburgess | Worried about what specifically? | 18:47 |
*** imacdonn has quit IRC | 18:47 | |
mriedem | worried about the number of bugs that have shaken out in the last 3 weeks | 18:47 |
dansmith | cburgess: the thousand places we haven't already found and fixed | 18:47 |
*** imacdonn has joined #openstack-nova | 18:47 | |
cburgess | Oh.. so.. normal release cycle? :) | 18:47 |
mriedem | well, | 18:47 |
dansmith | cburgess: squared. | 18:48 |
cburgess | But seriously.. is there something that makes you more concerned this cylce then usual? | 18:48 |
cburgess | Just the volume of bugs? | 18:48 |
dansmith | cburgess: no specifically what we were just talking about | 18:48 |
mriedem | ocata was using placement but not for claims | 18:48 |
dansmith | cburgess: placement claims stuff | 18:48 |
cburgess | Ahh ok | 18:48 |
mriedem | now we're basically redoing the resource tracker with placement, but triplicating it everywhere when things fail | 18:48 |
cburgess | That means we can blame jaypipes right? | 18:49 |
mriedem | btw chet, wtf, you just show up? | 18:49 |
dansmith | doing the allocations stuff as part of RT was a huge mistake from the beginning | 18:49 |
mriedem | in our hour of need | 18:49 |
cburgess | mriedem To... ? | 18:49 |
openstackgerrit | Ildiko Vancsa proposed openstack/nova-specs master: Add spec to use cinder's new attachment API https://review.openstack.org/497552 | 18:49 |
dansmith | it should have been all clean and separate | 18:49 |
cburgess | mriedem Oh I just looked at the back scroll yeah | 18:49 |
cburgess | I try and stay current but fail mostly so when I do see something of interested I ask. | 18:49 |
edmondsw | is there any way to toggle whether an existing flavor is public or not? I don't see an update flavor API in the API docs, and the os-flavor-access APIs don't appear to do that either based on the docs... | 18:50 |
*** yamamoto has quit IRC | 18:50 | |
mriedem | something interesting like me and dan crying over the state of things | 18:50 |
mriedem | edmondsw: there is no update flavors api | 18:50 |
cburgess | mriedem Well.. more specifically seeing 2 cores I have a lot of respect for seriously debating concerns around stability makes me notice. | 18:50 |
mriedem | os-flavor-access restricts access per tenant | 18:50 |
mriedem | cburgess: heh as it should :) | 18:50 |
mriedem | anyway, fixing this bug quick | 18:50 |
cburgess | I want to know why so I can better steer our plans in the future of what releases to move to and when. | 18:51 |
edmondsw | mriedem right, that's what I was afraid of... boo... | 18:51 |
dansmith | cburgess: that's stage 1 concern, stage 2 is seeing us polishing up resumes | 18:51 |
dansmith | speaking of which, has anyone seen my bottle of resume polish? | 18:51 |
cburgess | dansmith Yes... very yes. | 18:51 |
cburgess | Wait there is a polish for that? Maybe thats why I've been stuck in this same job for 6 years... :P | 18:52 |
edmondsw | seems odd that we have an API to allow you to restrict access by tenant but not to open it up to all tenants | 18:52 |
dansmith | cburgess: https://cdn.dribbble.com/users/327319/screenshots/1695561/resume_polish-01_1x.png | 18:52 |
edmondsw | oh well | 18:52 |
cburgess | dansmith OMG I'm going to have to use that on social media some how. Thats brilliant. | 18:53 |
*** dtp has quit IRC | 18:57 | |
mriedem | hmm looks like remove_provider_from_instance_allocation handles the resize to same host for me | 18:58 |
*** mnestratov|2 has quit IRC | 18:59 | |
*** masber has quit IRC | 19:00 | |
*** pchavva has quit IRC | 19:13 | |
*** sterdnotshaken has quit IRC | 19:17 | |
*** sterdnotshaken has joined #openstack-nova | 19:21 | |
*** eharney has joined #openstack-nova | 19:22 | |
*** sterdnotshaken1 has joined #openstack-nova | 19:23 | |
*** sterdnotshaken has quit IRC | 19:25 | |
*** abalutoiu_ has quit IRC | 19:28 | |
*** tbachman has quit IRC | 19:29 | |
openstackgerrit | Dan Smith proposed openstack/nova master: Add uuid to migration object and migrate-on-load https://review.openstack.org/496934 | 19:30 |
*** tbachman has joined #openstack-nova | 19:31 | |
mriedem | ok fix incoming | 19:35 |
openstackgerrit | Matt Riedemann proposed openstack/nova master: Cleanup allocations in failed prep_resize https://review.openstack.org/497592 | 19:35 |
mriedem | dansmith: ^ should handle both resize to same host and different hosts, but don't have a functional test for the resize to same host case | 19:35 |
mriedem | yet | 19:35 |
mriedem | oomichi: can you help review ^ too please? | 19:39 |
mriedem | we're pretty short staffed right now | 19:39 |
*** egonzalez has quit IRC | 19:41 | |
*** awaugama has quit IRC | 19:43 | |
dansmith | mriedem: why not do the flavor->resources conversion in the caller and then just re-use the existing migration method in the RT? | 19:44 |
dansmith | other than that the method is identical to the above in terms of functionality | 19:44 |
mriedem | because the existing method uses instance.flavor | 19:44 |
mriedem | which is not the new flavor yet | 19:44 |
mriedem | the instance.flavor = new_flavor in finish_resize | 19:45 |
dansmith | ah, I misread the first line | 19:45 |
mriedem | it's sneaky | 19:45 |
dansmith | could still refactor it to take a flavor | 19:46 |
dansmith | just seems like it's too similar to duplicate | 19:46 |
mriedem | well, the name is misleading, and the error message if it fails | 19:46 |
*** yamamoto has joined #openstack-nova | 19:46 | |
mriedem | cdent was doing similar dedup here https://review.openstack.org/#/c/496936/ | 19:48 |
guimaluf | hi guys, I'm getting "Instance failed network setup after 1 attempt(s)" followed by "Timed out waiting for a reply to message ID Timed out waiting for a reply to message ID". My compute node run neutron-{ovs,dhcp,metadata}-agent, and neutron-server and ml2 plugin on my neutron node. Rabbitmq is working. Any clue or direction? | 19:48 |
guimaluf | I couldn't find nothing meaningful on neutron-server logs, nor neutron-agents | 19:48 |
*** yamamoto has quit IRC | 19:51 | |
*** yamamoto has joined #openstack-nova | 19:51 | |
*** dtp has joined #openstack-nova | 19:54 | |
*** sterdnotshaken has joined #openstack-nova | 19:54 | |
*** sterdnotshaken1 has quit IRC | 19:57 | |
*** psachin has quit IRC | 19:57 | |
*** psachin has joined #openstack-nova | 19:59 | |
*** gouthamr has quit IRC | 20:01 | |
mriedem | cool got the resize to same host test done too | 20:04 |
*** gouthamr has joined #openstack-nova | 20:05 | |
*** ijw has joined #openstack-nova | 20:05 | |
cfriesen_ | guimaluf: maybe enable debug logs in neutron/nova? try to isolate whether neutron got the message, whether it processed the message, whether it sent a reply, and whether nova received the reply. | 20:07 |
*** rabel has quit IRC | 20:07 | |
guimaluf | cfriesen_, is so difficult to check neutron agents logs, cause there is an process in loop filling the screen with trash info | 20:08 |
guimaluf | cfriesen_, I've enabled the debug and trying to check it out... :/ | 20:08 |
mriedem | dansmith: i've got the func test for the resize to same host part of this, so i'll push that up quick also | 20:08 |
*** esberglu has quit IRC | 20:08 | |
mriedem | and deal with merging those methods in a follow u | 20:09 |
mriedem | *up | 20:09 |
*** esberglu has joined #openstack-nova | 20:09 | |
*** jmlowe has quit IRC | 20:09 | |
*** esberglu has quit IRC | 20:10 | |
*** esberglu has joined #openstack-nova | 20:10 | |
dansmith | okay | 20:10 |
*** shan has quit IRC | 20:10 | |
openstackgerrit | Matt Riedemann proposed openstack/nova master: Cleanup allocations in failed prep_resize https://review.openstack.org/497592 | 20:11 |
mriedem | there it is | 20:11 |
*** artom has quit IRC | 20:11 | |
mriedem | if the func test refactor part bothers you i could pull the new resize test into the patch before this one | 20:12 |
mriedem | might make review cleaner | 20:12 |
*** jmlowe has joined #openstack-nova | 20:13 | |
dansmith | already +2d it | 20:13 |
mriedem | sweet exhaustion | 20:13 |
mriedem | now, who do we make temporary core | 20:13 |
cfriesen_ | mriedem: https://review.openstack.org/#/c/497592 looks okay (with lots of room for cleanup though). were you planning on adding that testcase in test_servers.py or leaving that for a future patch? | 20:14 |
*** sterdnotshaken has quit IRC | 20:14 | |
mriedem | cfriesen_: see PS2 | 20:14 |
*** sterdnotshaken has joined #openstack-nova | 20:14 | |
dansmith | mriedem: we can wait a bit and see if someone pops up and if not I can just slam it in with an emergency war declaration | 20:14 |
mriedem | ok, but keep in mind we have to backport and merge in stable/pike too before the rc2 tag | 20:15 |
dansmith | oh today is thursday huh | 20:15 |
mriedem | and dims and doug are east coast choppers | 20:15 |
dansmith | so better do it now then eh? | 20:16 |
*** thorst_afk has quit IRC | 20:16 | |
dims | dansmith : mriedem : i will be up until say 10:30-11:00 pm my time | 20:16 |
mriedem | let cfriesen_ +1 it :) | 20:16 |
cfriesen_ | heh | 20:17 |
dansmith | ooh, oomichi for the win | 20:19 |
*** thorst_afk has joined #openstack-nova | 20:19 | |
mriedem | dansmith: oomichi: don't forget this one in the middle https://review.openstack.org/#/c/497541/1 | 20:20 |
mriedem | the middle child is always left out | 20:20 |
dansmith | mriedem: I just slammed that one since it's just a test | 20:22 |
*** gouthamr has quit IRC | 20:22 | |
*** thorst_afk has quit IRC | 20:24 | |
*** abalutoiu_ has joined #openstack-nova | 20:26 | |
*** ijw has quit IRC | 20:28 | |
*** eharney has quit IRC | 20:28 | |
mriedem | ok | 20:28 |
*** itlinux has joined #openstack-nova | 20:30 | |
*** ijw has joined #openstack-nova | 20:31 | |
*** lucasxu has quit IRC | 20:31 | |
cfriesen_ | mriedem: it seems wrong to have a test called "test_rescheduling_when_migrating_instance" that doesn't actually test anything around rescheduling. | 20:32 |
*** mriedem1 has joined #openstack-nova | 20:32 | |
*** jmlowe has quit IRC | 20:32 | |
mriedem1 | starting the backport parade | 20:32 |
*** mriedem has quit IRC | 20:33 | |
*** derekh has joined #openstack-nova | 20:34 | |
*** mriedem1 is now known as mriedem | 20:35 | |
mriedem | dansmith: ok we've got 4 backports for stable/pike, the 3 for this series starting here https://review.openstack.org/#/c/497542/ | 20:35 |
mriedem | and this guy https://review.openstack.org/#/c/497461/ | 20:36 |
*** bhagyashris_ has joined #openstack-nova | 20:36 | |
mriedem | then that's rc2 | 20:36 |
*** psachin has quit IRC | 20:36 | |
dansmith | waiting for master to merge though right? | 20:36 |
mriedem | yeah i suppose, you could line up +2s w/o approvals | 20:36 |
*** thorst_afk has joined #openstack-nova | 20:36 | |
mriedem | or jus twait | 20:37 |
mriedem | gate seems backed up today | 20:37 |
* mriedem sends the gate some fiber | 20:37 | |
dansmith | okay all set | 20:37 |
mriedem | queues aren't big though so not sure if it's just me | 20:37 |
*** bhagyashri_s has quit IRC | 20:37 | |
*** pooja_jadhav has quit IRC | 20:37 | |
*** ps_jadhav has quit IRC | 20:37 | |
mriedem | cool | 20:38 |
mriedem | i'll start the rc2 proceedings | 20:38 |
dansmith | yeah I dunno why it's so slow with a relatively low workload | 20:38 |
dansmith | that conf thing is about to blow through | 20:39 |
*** ps_jadhav has joined #openstack-nova | 20:39 | |
*** pooja_jadhav has joined #openstack-nova | 20:39 | |
dansmith | mriedem: your prep resize one at the end has a bunch of fails | 20:41 |
dansmith | like pep8 even I think | 20:41 |
*** jmlowe has joined #openstack-nova | 20:41 | |
mriedem | https://review.openstack.org/#/c/497610/ | 20:41 |
mriedem | no way | 20:42 |
dansmith | (497606,1) Cleanup allocations in failed prep_resize (6m/~--~~~--~-~~_~/rem:12m) | 20:42 |
*** hamzy has quit IRC | 20:42 | |
mriedem | pretty sure i ran that before pushing | 20:42 |
mriedem | doing it again | 20:42 |
dansmith | but that looks like maybe functional too? | 20:43 |
*** edmondsw has quit IRC | 20:43 | |
mriedem | passed locally | 20:43 |
mriedem | pep8 that is | 20:43 |
dansmith | everything | 20:43 |
dansmith | py27, pep8, cells, functional, devstack | 20:43 |
dansmith | http://logs.openstack.org/06/497606/1/check/gate-nova-tox-functional-ubuntu-xenial/0481e72/console.html | 20:43 |
dansmith | nice | 20:43 |
mriedem | oh infra | 20:44 |
mriedem | ok | 20:44 |
mriedem | whew | 20:44 |
openstackgerrit | Merged openstack/nova master: Fix sample configuration generation for compute-related options https://review.openstack.org/497460 | 20:44 |
dansmith | all of them failed the same way | 20:44 |
dansmith | mriedem: well, whew, if it's not about to block us from landing anything else | 20:44 |
*** yamamoto has quit IRC | 20:45 | |
*** derekh has quit IRC | 20:46 | |
openstackgerrit | Eric Berglund proposed openstack/nova master: WIP: PowerVM Driver: config drive https://review.openstack.org/409404 | 20:46 |
*** smatzek has quit IRC | 20:47 | |
*** jjung has quit IRC | 20:47 | |
*** slaweq has quit IRC | 20:47 | |
*** catinthe_ has quit IRC | 20:53 | |
*** catintheroof has joined #openstack-nova | 20:54 | |
*** jmlowe has quit IRC | 20:54 | |
*** sterdnotshaken has quit IRC | 20:54 | |
*** sterdnotshaken has joined #openstack-nova | 20:54 | |
dansmith | well, I guess I'll wander off for a bit and then come back to check on stuff | 20:55 |
*** catintheroof has quit IRC | 20:58 | |
*** slaweq has joined #openstack-nova | 20:59 | |
*** itlinux has quit IRC | 21:03 | |
*** itlinux has joined #openstack-nova | 21:05 | |
openstackgerrit | Merged openstack/nova master: Updated from global requirements https://review.openstack.org/497058 | 21:05 |
*** gouthamr has joined #openstack-nova | 21:06 | |
openstackgerrit | Ed Leafe proposed openstack/nova master: Return alternates along with their allocations https://review.openstack.org/486253 | 21:07 |
openstackgerrit | Ed Leafe proposed openstack/nova master: Add allocations to the values returned from the scheduler https://review.openstack.org/495854 | 21:07 |
*** abalutoiu_ has quit IRC | 21:09 | |
mriedem | dansmith: i just realized that vikings game one of the season is monday night 9/11 at the PTG at ~5:30pm, therefore we will need to be out early and at a sports bar | 21:12 |
mriedem | post haste | 21:12 |
mriedem | my beloved vikings will be trouncing mordred's loser saints | 21:12 |
openstackgerrit | melanie witt proposed openstack/nova master: Claim and report zero root disk for boot-from-volume instances https://review.openstack.org/428505 | 21:14 |
*** rcernin has quit IRC | 21:19 | |
*** dave-mccowan has quit IRC | 21:20 | |
*** itlinux has quit IRC | 21:24 | |
*** itlinux has joined #openstack-nova | 21:25 | |
*** ijw has quit IRC | 21:28 | |
openstackgerrit | Merged openstack/nova master: Remove allocation when booting instance rescheduled or aborted https://review.openstack.org/496995 | 21:30 |
openstackgerrit | Merged openstack/nova master: Add functional test for rescheduling during a migration https://review.openstack.org/497541 | 21:31 |
*** lpetrut has quit IRC | 21:37 | |
*** yamamoto has joined #openstack-nova | 21:46 | |
*** ijw has joined #openstack-nova | 21:49 | |
*** edmondsw has joined #openstack-nova | 21:49 | |
*** yamamoto has quit IRC | 21:51 | |
*** slaweq has quit IRC | 21:52 | |
*** edmondsw has quit IRC | 21:54 | |
mriedem | master branch change for this is merged now https://review.openstack.org/#/c/497461/ | 21:57 |
*** ijw has quit IRC | 21:57 | |
mriedem | and this https://review.openstack.org/#/c/497542/ | 21:57 |
*** catintheroof has joined #openstack-nova | 21:59 | |
*** ijw has joined #openstack-nova | 22:02 | |
dansmith | ack | 22:03 |
dansmith | mriedem: okay and that cleanup one on master is still waiting to fail | 22:05 |
*** esberglu has quit IRC | 22:10 | |
*** burt has quit IRC | 22:10 | |
*** lyan has quit IRC | 22:20 | |
*** dtp has quit IRC | 22:29 | |
*** ijw has quit IRC | 22:33 | |
dims | mriedem : will vikings make playoffs this year? | 22:34 |
mriedem | https://www.youtube.com/watch?v=p3-eavMSBnk | 22:35 |
mordred | mriedem: I shall heartily look forward to that game | 22:35 |
dansmith | mmm, sportsball | 22:36 |
mriedem | i hope peterson feels at home in nola where he turned over the ball 10 times in the NFC championship game that the vikings should have won | 22:37 |
mriedem | and the one where favre's legs got broken | 22:37 |
mriedem | that's why he has to wear so much copper fit now | 22:37 |
mriedem | https://www.youtube.com/watch?v=L2HcwLgpBSY | 22:38 |
dansmith | yeah, and I hope mattingly liked those home run swishes | 22:38 |
dansmith | you know with that .. ball .. the round...ish..one | 22:38 |
mriedem | favre works on the farm as much as push cleared brush | 22:38 |
mriedem | *bush | 22:38 |
mriedem | george dubya | 22:38 |
mriedem | where is clarkb during all this?! | 22:39 |
dansmith | mriedem: so I will need to update the rc2 tag once the things land on pike right? | 22:40 |
dansmith | 'cause you'll be watching some meaty dudes throw balls around? | 22:40 |
mriedem | dansmith: that's not happening tonight | 22:40 |
mriedem | dansmith: i'll be here for the taggin' | 22:40 |
dansmith | oh okay | 22:40 |
mriedem | like i said, monday night of the ptg | 22:40 |
mriedem | 5:30 | 22:40 |
dansmith | oh, monday at the ptg | 22:41 |
dansmith | I thought you meant tonight | 22:41 |
mriedem | get the whole crew together for team building | 22:41 |
dansmith | yeah, didn't read | 22:41 |
mriedem | and curse words | 22:41 |
clarkb | mriedem: MNF? | 22:41 |
mriedem | yes | 22:41 |
*** gixxer1k has quit IRC | 22:41 | |
clarkb | I now have visions of mriedem explaining football rules to the nova team in buffalo wild wings | 22:42 |
clarkb | "that didn't count because you can't put your hands on their faces" "you can give them a concussion but no hands on the face" | 22:42 |
mriedem | "no gdi dan, that was a FALSE start" | 22:42 |
mriedem | i hope there is somewhere better than a bww nearby | 22:43 |
clarkb | "the ball is live on a punt, that returner completely failed at his one job" | 22:43 |
clarkb | er | 22:43 |
clarkb | kickoff not punt | 22:43 |
mriedem | you can get the ball back on a botched punt return | 22:43 |
dansmith | I can't tell which of those statements is real or fake | 22:43 |
* melwitt knows most of the rules of football | 22:43 | |
mriedem | i'm pretty sure the vikings have lost games they otherwise had in the bag b/c of a 4th quarter dropped punt return in the red zone | 22:44 |
mriedem | RED ZONE! | 22:44 |
clarkb | mriedem: theer was a case of a returning not picking up the ball on a kickoff last season iirc. So kicking team scored a touchdown | 22:44 |
mriedem | melwitt: good, you're miles ahead of artom then | 22:44 |
clarkb | its liev after 10 yeards doesn't matter who touched it | 22:44 |
mriedem | clarkb: oh right onside | 22:44 |
melwitt | and agreed, bw3 sucks. I wonder if they have wings n more in denver. that would be sweet | 22:45 |
clarkb | well in this case it was in the end zone but ya | 22:45 |
clarkb | melwitt: bw3 is across the street though | 22:45 |
mriedem | i can't listen to a bunch of denverites talk about the broncos | 22:45 |
melwitt | oh, you've already researched this | 22:45 |
mriedem | ha | 22:45 |
mriedem | yes | 22:45 |
mriedem | melwitt: btw, welcome back | 22:45 |
melwitt | thanks! | 22:46 |
cburgess | What is bw3? | 22:46 |
cburgess | melwitt Did you come some place fun? | 22:46 |
melwitt | a crappy wing place/sports bar | 22:46 |
clarkb | "in college he only needs one foot in, in the pros you need two" | 22:46 |
cburgess | Ew... gross | 22:46 |
melwitt | yeah, was in tahoe, twas fun | 22:46 |
cburgess | Nice! | 22:47 |
cburgess | I haven't been up there in almost a decade. Keep meaning to go one summer, I hear its amazing. Only been skiing in the winters. | 22:47 |
*** yamamoto has joined #openstack-nova | 22:47 | |
mriedem | cburgess: you can't come some place | 22:48 |
mriedem | geez | 22:48 |
cburgess | Do what? | 22:48 |
mriedem | nvm | 22:48 |
melwitt | I know what it is and noticed it | 22:48 |
clarkb | mriedem: I perpetually have the problem of tryingto explain wtf is going on during sportsball to everyone else around me. I have learned its extra bad when at live event | 22:48 |
melwitt | hehehe | 22:48 |
melwitt | cburgess: oh yeah, same here in that this was my first summer trip there. I didn't know what to expect but it was really fun. 13/10 would recommend | 22:49 |
mriedem | clarkb: at least you have people around | 22:49 |
clarkb | I had the twins signaling touchdowns on command last season though | 22:49 |
clarkb | I think they need retraining this year | 22:49 |
melwitt | mriedem and clarkb are gonna be likethis watching MNF | 22:50 |
mriedem | i really should be mowing the lawn actually | 22:50 |
mriedem | laura can hear me giggling from the kitchen | 22:50 |
melwitt | o/ laura | 22:50 |
mriedem | alright i'm going to go do that | 22:51 |
clarkb | melwitt: and ya I've had to look for food options around ptg, trying to sort out infra team options | 22:52 |
*** edmondsw has joined #openstack-nova | 22:52 | |
clarkb | melwitt: IHOP and buffalo wild wings are across the street | 22:52 |
clarkb | be warned though IHOP does not serve alcohol | 22:52 |
*** yamamoto has quit IRC | 22:53 | |
cburgess | Hmm there are 2 waffles houses but they are driving distance. ( | 22:58 |
*** itlinux has quit IRC | 23:00 | |
*** marst has quit IRC | 23:05 | |
*** rajathagasthya has quit IRC | 23:09 | |
*** Apoorva has quit IRC | 23:22 | |
*** Apoorva has joined #openstack-nova | 23:23 | |
*** hongbin has quit IRC | 23:23 | |
*** claudiub has quit IRC | 23:26 | |
*** Swami has quit IRC | 23:32 | |
*** Apoorva_ has joined #openstack-nova | 23:35 | |
*** Apoorva has quit IRC | 23:38 | |
*** chyka has quit IRC | 23:41 | |
openstackgerrit | melanie witt proposed openstack/nova master: Request zero root disk for boot-from-volume instances https://review.openstack.org/428481 | 23:43 |
openstackgerrit | melanie witt proposed openstack/nova master: Claim and report zero root disk for boot-from-volume instances https://review.openstack.org/428505 | 23:43 |
*** catintheroof has quit IRC | 23:46 | |
*** _pewp_ has quit IRC | 23:48 | |
*** yamamoto has joined #openstack-nova | 23:49 | |
*** _pewp_ has joined #openstack-nova | 23:52 | |
*** yamamoto has quit IRC | 23:55 | |
*** artom has joined #openstack-nova | 23:56 | |
*** artom has quit IRC | 23:56 | |
*** artom has joined #openstack-nova | 23:57 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!