*** gbarros has quit IRC | 00:10 | |
*** gbarros has joined #openstack-nova | 00:11 | |
*** gbarros has quit IRC | 00:22 | |
*** fanzhang has joined #openstack-nova | 00:59 | |
*** ejat has quit IRC | 00:59 | |
*** gbarros has joined #openstack-nova | 01:04 | |
*** slaweq has joined #openstack-nova | 01:11 | |
*** slaweq has quit IRC | 01:16 | |
*** mhen has quit IRC | 01:21 | |
*** mhen has joined #openstack-nova | 01:22 | |
*** mrsoul has joined #openstack-nova | 01:30 | |
*** Nel1x has quit IRC | 01:33 | |
*** tetsuro has joined #openstack-nova | 01:49 | |
*** mriedem has joined #openstack-nova | 01:57 | |
mriedem | muwahahaha | 01:57 |
---|---|---|
openstackgerrit | Matt Riedemann proposed openstack/nova master: add zvm into support matrix https://review.openstack.org/532720 | 02:01 |
*** hongbin has joined #openstack-nova | 02:19 | |
*** efried1 has joined #openstack-nova | 02:26 | |
*** efried has quit IRC | 02:28 | |
*** efried1 is now known as efried | 02:28 | |
*** gbarros has quit IRC | 02:43 | |
*** psachin has joined #openstack-nova | 02:44 | |
*** slaweq has joined #openstack-nova | 03:11 | |
*** slaweq has quit IRC | 03:15 | |
*** vivsoni_ has quit IRC | 03:22 | |
*** tetsuro has quit IRC | 03:26 | |
*** brinzhang has joined #openstack-nova | 03:33 | |
*** udesale has joined #openstack-nova | 03:57 | |
openstackgerrit | Merged openstack/nova master: Revert "libvirt: slow live-migration to ensure network is ready" https://review.openstack.org/590538 | 03:58 |
openstackgerrit | Merged openstack/nova master: Trivial fix to remove extra 'will' on microversion doc https://review.openstack.org/591235 | 03:58 |
openstackgerrit | Merged openstack/nova master: Adds a test for _get_provider_ids_matching() https://review.openstack.org/590150 | 03:58 |
openstackgerrit | Merged openstack/nova master: Test case for multiple forbidden traits https://review.openstack.org/591070 | 03:58 |
*** kevinbenton has quit IRC | 04:00 | |
*** kevinbenton has joined #openstack-nova | 04:00 | |
openstackgerrit | Merged openstack/nova master: placement: use simple code paths when possible https://review.openstack.org/590388 | 04:05 |
openstackgerrit | Merged openstack/nova master: Handle unicode characters in migration params https://review.openstack.org/591080 | 04:05 |
openstackgerrit | Merged openstack/nova master: improve migration script https://review.openstack.org/591030 | 04:05 |
*** vivsoni has joined #openstack-nova | 04:09 | |
*** mriedem has quit IRC | 04:21 | |
*** dklyle has joined #openstack-nova | 04:23 | |
*** takashin has quit IRC | 04:24 | |
*** jaosorior has joined #openstack-nova | 04:28 | |
*** dave-mccowan has quit IRC | 04:28 | |
*** abhishekk has joined #openstack-nova | 04:37 | |
*** dklyle has quit IRC | 04:38 | |
*** Bhujay has joined #openstack-nova | 04:50 | |
*** rcernin has quit IRC | 04:54 | |
*** rcernin has joined #openstack-nova | 04:54 | |
*** alex_xu has joined #openstack-nova | 05:03 | |
*** psachin has quit IRC | 05:04 | |
*** bhagyashris has joined #openstack-nova | 05:15 | |
*** openstackgerrit has quit IRC | 05:18 | |
*** hongbin has quit IRC | 05:20 | |
*** links has joined #openstack-nova | 05:30 | |
*** takashin has joined #openstack-nova | 05:35 | |
*** takashin has quit IRC | 05:41 | |
*** jaosorior has quit IRC | 05:59 | |
*** janki has joined #openstack-nova | 05:59 | |
*** pcaruana has joined #openstack-nova | 05:59 | |
*** dpawlik has joined #openstack-nova | 06:00 | |
*** bhagyashris has quit IRC | 06:01 | |
*** ircuser-1 has joined #openstack-nova | 06:02 | |
*** takashin has joined #openstack-nova | 06:04 | |
*** dpawlik has quit IRC | 06:05 | |
*** pcaruana has quit IRC | 06:05 | |
*** gvrangan has joined #openstack-nova | 06:08 | |
*** ratailor has joined #openstack-nova | 06:11 | |
*** dpawlik has joined #openstack-nova | 06:12 | |
*** pcaruana has joined #openstack-nova | 06:19 | |
*** openstackgerrit has joined #openstack-nova | 06:20 | |
openstackgerrit | Matt Riedemann proposed openstack/nova stable/rocky: Revert "libvirt: slow live-migration to ensure network is ready" https://review.openstack.org/591275 | 06:20 |
prometheanfire | :D | 06:23 |
prometheanfire | one step at a time | 06:23 |
*** udesale has quit IRC | 06:25 | |
*** mriedem has joined #openstack-nova | 06:27 | |
*** alexchadin has joined #openstack-nova | 06:33 | |
*** adrianc has joined #openstack-nova | 06:36 | |
*** slaweq has joined #openstack-nova | 06:37 | |
*** ispp has joined #openstack-nova | 06:52 | |
*** skatsaounis_ has joined #openstack-nova | 06:56 | |
*** udesale has joined #openstack-nova | 07:02 | |
*** rcernin has quit IRC | 07:03 | |
*** evrardjp has joined #openstack-nova | 07:08 | |
*** sahid has joined #openstack-nova | 07:10 | |
*** psachin has joined #openstack-nova | 07:14 | |
*** alexchadin has quit IRC | 07:31 | |
openstackgerrit | Takashi NATSUME proposed openstack/nova master: Transform volume.usage notification https://review.openstack.org/580345 | 07:34 |
*** alexchadin has joined #openstack-nova | 07:35 | |
*** holser_ has joined #openstack-nova | 07:37 | |
openstackgerrit | Takashi NATSUME proposed openstack/nova master: Transform compute_task notifications https://review.openstack.org/482629 | 07:39 |
*** ccamacho has joined #openstack-nova | 07:40 | |
*** rpittau has joined #openstack-nova | 07:43 | |
*** pcaruana has quit IRC | 07:43 | |
openstackgerrit | Takashi NATSUME proposed openstack/nova master: Transform libvirt.error notification https://review.openstack.org/484851 | 07:44 |
*** jaosorior has joined #openstack-nova | 07:46 | |
*** holser_ has quit IRC | 07:52 | |
*** holser_ has joined #openstack-nova | 07:54 | |
*** jpena|off is now known as jpena | 07:55 | |
*** pcaruana has joined #openstack-nova | 07:57 | |
*** slaweq_ has joined #openstack-nova | 07:57 | |
openstackgerrit | Konstantinos Samaras-Tsakiris proposed openstack/nova-specs master: Placement model for PCI devices https://review.openstack.org/591037 | 07:57 |
*** slaweq has quit IRC | 07:59 | |
*** ispp has quit IRC | 08:11 | |
*** psachin has quit IRC | 08:17 | |
*** psachin has joined #openstack-nova | 08:20 | |
*** mdbooth has joined #openstack-nova | 08:33 | |
openstackgerrit | Lee Yarwood proposed openstack/nova master: WIP scheduler: check request_spec.instance_group before updating https://review.openstack.org/590733 | 08:34 |
*** tssurya has joined #openstack-nova | 08:34 | |
*** derekh has joined #openstack-nova | 08:36 | |
*** jaosorior_ has joined #openstack-nova | 08:36 | |
*** jaosorior has quit IRC | 08:40 | |
*** rodolof has joined #openstack-nova | 08:40 | |
*** alexchadin has quit IRC | 08:41 | |
*** alexchadin has joined #openstack-nova | 08:43 | |
*** dtantsur|afk is now known as dtantsur | 08:49 | |
*** giblet_off is now known as gibi | 08:55 | |
*** slaweq_ is now known as slaweq | 09:05 | |
mriedem | gibi: oh hi | 09:11 |
mriedem | we are timezone buddies! | 09:11 |
gibi | mriedem: Ohh welcome in this side of the globe! | 09:12 |
*** alexchadin has quit IRC | 09:12 | |
gibi | mriedem: are you in China? | 09:12 |
*** mriedem_ has joined #openstack-nova | 09:15 | |
*** mriedem has quit IRC | 09:15 | |
*** mriedem_ is now known as mriedem | 09:16 | |
openstackgerrit | garyk proposed openstack/nova master: Docs: remove invalid link for remote debugging https://review.openstack.org/591316 | 09:18 |
*** liuyulong has joined #openstack-nova | 09:18 | |
*** ccamacho has quit IRC | 09:21 | |
mriedem | mdbooth: http://lists.openstack.org/pipermail/openstack-dev/2018-August/133198.html - the functional test job runs mysql (and postgresql) "opportunistic" tests | 09:23 |
mriedem | with mysql and pg backends | 09:23 |
mdbooth | mriedem: So both are configured? IIRC the opportunistic tests run only if the specific DB is actually available. | 09:24 |
mdbooth | mriedem: You're up early, btw. In Europe somewhere? | 09:24 |
*** cdent has joined #openstack-nova | 09:25 | |
*** mriedem_ has joined #openstack-nova | 09:25 | |
mriedem_ | mdbooth: china | 09:25 |
mdbooth | Ah, so you've been up for a while :) | 09:26 |
mriedem_ | https://github.com/openstack/nova/blob/master/tools/test-setup.sh sets up the mysql and pg dbs for the opportunistic tests | 09:26 |
mdbooth | mriedem_: Thank you! | 09:26 |
*** mriedem has quit IRC | 09:27 | |
*** adrianc has quit IRC | 09:27 | |
*** mriedem_ has quit IRC | 09:30 | |
*** mriedem has joined #openstack-nova | 09:31 | |
mriedem | mdbooth: btw is rajesh aware of the spec for that metadata case sensitivity issue? | 09:33 |
*** alexchadin has joined #openstack-nova | 09:33 | |
mdbooth | mriedem: I was just putting a +1 on it and I noticed your comments. Reading... | 09:33 |
mdbooth | ratailor: ^^^ ? | 09:34 |
ratailor | mdbooth, I don't know about spec. | 09:35 |
gibi | mriedem: do you know if we can remove this in Stein? https://github.com/openstack/nova/blob/16f89fd093217d22530570e8277b561ea79f46ff/nova/virt/ironic/driver.py#L147-L149 | 09:35 |
mdbooth | At first glance it doesn't sound like a very good idea to me, tbh. | 09:36 |
*** rpittau has quit IRC | 09:36 | |
*** rpittau has joined #openstack-nova | 09:36 | |
mdbooth | So.. we've allowed users to define their own metadata for however long, and now we want to change it just because of a mysql misconfiguration? | 09:36 |
ratailor | mdbooth, let me go through the comments on patch. | 09:36 |
mriedem | gibi: maybe... | 09:37 |
*** tbachman_ has joined #openstack-nova | 09:37 | |
mdbooth | That seems user hostile | 09:37 |
mriedem | gibi: we have a nova-status upgrade check for the ironic instance / flavor migration to resource classes | 09:37 |
ratailor | mdbooth, mriedem in that case, should I abandon the patch ? | 09:37 |
mriedem | gibi: i think we have something in the ptg etherpad about this, removing support for granular resources with ironic | 09:37 |
gibi | mriedem: Is it L25 in the etherpad? | 09:38 |
*** ccamacho has joined #openstack-nova | 09:39 | |
*** jaosorior_ is now known as jaosorior | 09:39 | |
gibi | mriedem: it seems so. So I'm plugging my pain (https://review.openstack.org/#/c/583667/19/nova/tests/functional/test_servers.py@5135) into that item. thanks | 09:39 |
mdbooth | ratailor: It's up to you, but personally I'd see if the bp and spec still have weight behind them, especially given that they're user hostile and your patch shows that fixing the underlying issue isn't hard. | 09:40 |
mriedem | ratailor: mdbooth: right it's obviously still an issue, | 09:40 |
mriedem | and the spec was merged at some point, so there was a plan with code, | 09:40 |
*** tbachman has quit IRC | 09:40 | |
*** tbachman_ is now known as tbachman | 09:40 | |
mriedem | but then auggy was gone and sdague was gone and that whole HP team | 09:41 |
mriedem | er IBM team or whatever | 09:41 |
mriedem | gibi: yes that's the one | 09:41 |
mriedem | definitely want to remove that in stein if we can | 09:41 |
gibi | mriedem: thanks. I've added a note | 09:41 |
sean-k-mooney | mriedem: are you in china right now or is this very early for you. im guessing its quite late but just wondering what time zone your in since your not normally on at this time | 09:43 |
mriedem | sean-k-mooney: i'm in china this week | 09:43 |
mdbooth | ratailor: Looks like the proposed code wasn't merged and was abandoned. | 09:44 |
mdbooth | mriedem: Thanks for pointing that out. I'll follow up on the ML with a question around if this is still something we want to do. | 09:45 |
mdbooth | ratailor: Unless you want to do that? | 09:45 |
ratailor | mdbooth, no problem. | 09:45 |
mriedem | Kevin_Zheng: i think resize to same host might have fixed the doubled allocation issue after all - we move the "source" allocations to the migration record and the target (new flavor) allocations to the instance | 09:54 |
*** adrianc has joined #openstack-nova | 09:54 | |
mriedem | Kevin_Zheng: although we'll still have allocations for both flavors against the same resource provider (compute node), so they are essentially doubled in placement... | 09:55 |
Kevin_Zheng | you mean already fixed? | 09:57 |
mriedem | well, depends on what is considered the issue; the instance, as a consumer, will only have allocations for the new_flavor during the resize, | 09:57 |
mriedem | but the resource provider (compute node) will have allocations for both the old_flavor and new_flavor, but to different consumers | 09:58 |
mriedem | so that is still an issue | 09:58 |
mriedem | if i resize from 2 VCPU to 4 VCPU, during the resize to same host, the host RP will have 6 VCPU being used, rather than 4 | 09:58 |
Kevin_Zheng | Ok got it | 09:58 |
Kevin_Zheng | But if it only has two more? | 09:59 |
sean-k-mooney | mriedem: that is only while the resize is happening correct | 09:59 |
Kevin_Zheng | Like only has 4 | 09:59 |
Kevin_Zheng | And we do 2->4 | 09:59 |
mriedem | sean-k-mooney: correct | 09:59 |
mriedem | Kevin_Zheng: if the host only has 4 VCPU inventory, the resize to same host would fail | 09:59 |
Kevin_Zheng | Yeah, but that’s our case | 10:00 |
mriedem | yeah... | 10:00 |
mriedem | alright, going to dinner | 10:00 |
Kevin_Zheng | Coll | 10:00 |
Kevin_Zheng | Cool | 10:00 |
*** mriedem has quit IRC | 10:01 | |
mdbooth | ratailor: I wonder if we can get zzzeek to comment on http://lists.openstack.org/pipermail/openstack-dev/2018-August/133202.html | 10:08 |
*** jaosorior has quit IRC | 10:09 | |
*** jaosorior has joined #openstack-nova | 10:11 | |
ratailor | mdbooth, Thanks for putting it on ML nicely, I think we should get comment from him. | 10:11 |
openstackgerrit | Takashi NATSUME proposed openstack/nova master: [placement] api-ref: Add missing aggregates example https://review.openstack.org/591332 | 10:12 |
*** panda is now known as panda|ruck | 10:15 | |
openstackgerrit | Rajesh Tailor proposed openstack/nova master: Fix case-sensitivity for metadata keys https://review.openstack.org/504885 | 10:25 |
*** ccamacho has quit IRC | 10:31 | |
*** ccamacho has joined #openstack-nova | 10:32 | |
*** abhishekk has quit IRC | 10:32 | |
*** nalhat has joined #openstack-nova | 10:35 | |
*** threestrands has quit IRC | 10:36 | |
nalhat | Hi, Is any one aware about the filters used by nova: 'AggregateInstanceExtraSpecsFilter' while instance reservation(Blazar) | 10:38 |
nalhat | I was referring this doc: https://docs.openstack.org/blazar/latest/cli/instance-reservation.html for instance reservation by Blazar, at the time of creating an instance in nova with reservation id this filter comes in picture | 10:40 |
*** links has quit IRC | 10:44 | |
*** gouthamr has quit IRC | 10:44 | |
*** links has joined #openstack-nova | 10:49 | |
*** links has quit IRC | 10:50 | |
*** alexchadin has quit IRC | 10:53 | |
*** sambetts_ is now known as sambetts | 11:00 | |
*** holser_ has quit IRC | 11:03 | |
*** alexchadin has joined #openstack-nova | 11:03 | |
*** sambetts is now known as sambetts|afk | 11:04 | |
*** slaweq_ has joined #openstack-nova | 11:06 | |
*** slaweq has quit IRC | 11:06 | |
*** jpena is now known as jpena|lunch | 11:14 | |
*** sapd1 has joined #openstack-nova | 11:16 | |
*** alexchadin has quit IRC | 11:17 | |
*** alexchadin has joined #openstack-nova | 11:20 | |
*** slagle has joined #openstack-nova | 11:22 | |
*** panda|ruck is now known as panda|ruck|lunch | 11:23 | |
*** udesale has quit IRC | 11:27 | |
*** tbachman has quit IRC | 11:33 | |
*** mriedem has joined #openstack-nova | 11:36 | |
*** alexchadin has quit IRC | 11:36 | |
*** alexchadin has joined #openstack-nova | 11:38 | |
*** erlon has joined #openstack-nova | 11:39 | |
*** tbachman has joined #openstack-nova | 11:43 | |
*** holser_ has joined #openstack-nova | 11:44 | |
*** erlon has quit IRC | 11:44 | |
*** sambetts|afk is now known as sambetts | 11:45 | |
*** dave-mccowan has joined #openstack-nova | 11:51 | |
openstackgerrit | Takashi NATSUME proposed openstack/nova master: Remove mox in test_compute_api.py (4) https://review.openstack.org/568462 | 11:52 |
*** alexchadin has quit IRC | 11:53 | |
openstackgerrit | Matt Riedemann proposed openstack/nova stable/queens: VMware: fix TypeError while get console log https://review.openstack.org/591365 | 11:54 |
openstackgerrit | Takashi NATSUME proposed openstack/nova master: Remove mox in virt/test_block_device.py https://review.openstack.org/566153 | 12:00 |
*** adrianc has quit IRC | 12:02 | |
*** panda|ruck|lunch is now known as panda|ruck | 12:02 | |
openstackgerrit | Takashi NATSUME proposed openstack/nova master: Remove mox in libvirt/test_driver.py (5) https://review.openstack.org/570842 | 12:05 |
*** rpittau is now known as rpittau|afk | 12:10 | |
openstackgerrit | Takashi NATSUME proposed openstack/nova master: Remove mox in libvirt/test_driver.py (6) https://review.openstack.org/571330 | 12:10 |
*** rpittau|afk is now known as rpittau | 12:10 | |
*** jpena|lunch is now known as jpena | 12:13 | |
openstackgerrit | Chris Dent proposed openstack/nova master: DNM: Add placement perf info gathering to end of nova-next https://review.openstack.org/591367 | 12:13 |
*** liuyulong has quit IRC | 12:14 | |
openstackgerrit | Takashi NATSUME proposed openstack/nova master: Remove mox in libvirt/test_driver.py (7) https://review.openstack.org/571992 | 12:14 |
*** jaosorior has quit IRC | 12:18 | |
openstackgerrit | Takashi NATSUME proposed openstack/nova master: Remove mox in libvirt/test_driver.py (8) https://review.openstack.org/571993 | 12:18 |
*** jaosorior has joined #openstack-nova | 12:19 | |
*** ratailor has quit IRC | 12:20 | |
*** mchlumsky has joined #openstack-nova | 12:22 | |
openstackgerrit | Takashi NATSUME proposed openstack/nova master: Remove mox in unit/network/test_neutronv2.py (3) https://review.openstack.org/574104 | 12:22 |
*** erlon has joined #openstack-nova | 12:27 | |
*** jistr is now known as jistr|call | 12:32 | |
*** adrianc has joined #openstack-nova | 12:36 | |
*** brinzhang has quit IRC | 12:41 | |
*** nicolasbock has joined #openstack-nova | 12:48 | |
*** psachin has quit IRC | 12:56 | |
*** jroll has quit IRC | 12:59 | |
*** jroll has joined #openstack-nova | 13:00 | |
*** mriedem has quit IRC | 13:03 | |
*** jistr|call is now known as jistr | 13:04 | |
*** eharney has joined #openstack-nova | 13:05 | |
openstackgerrit | Takashi NATSUME proposed openstack/nova master: [placement] api-ref: Add missing aggregates example https://review.openstack.org/591332 | 13:10 |
*** alexchadin has joined #openstack-nova | 13:12 | |
*** gbarros has joined #openstack-nova | 13:14 | |
*** SteelyDan is now known as dansmith | 13:25 | |
*** jaypipes has joined #openstack-nova | 13:26 | |
*** mvkr has quit IRC | 13:29 | |
*** josecastroleon has quit IRC | 13:29 | |
*** gvrangan has quit IRC | 13:33 | |
openstackgerrit | Chris Dent proposed openstack/nova master: DNM: Add placement perf info gathering to end of nova-next https://review.openstack.org/591367 | 13:47 |
*** tbachman_ has joined #openstack-nova | 13:49 | |
efried | Scheduler meeting in 10 minutes in #openstack-meeting-alt | 13:50 |
*** eharney has quit IRC | 13:51 | |
*** tbachman has quit IRC | 13:51 | |
*** tbachman_ is now known as tbachman | 13:51 | |
*** tbachman has quit IRC | 13:52 | |
*** tbachman has joined #openstack-nova | 13:52 | |
*** tbachman has quit IRC | 13:56 | |
*** awaugama has joined #openstack-nova | 13:59 | |
*** tetsuro__ has joined #openstack-nova | 13:59 | |
*** mvkr has joined #openstack-nova | 13:59 | |
*** tetsuro__ has quit IRC | 14:02 | |
*** tetsuro has joined #openstack-nova | 14:03 | |
*** eharney has joined #openstack-nova | 14:06 | |
*** bnemec-pto is now known as bnemec | 14:10 | |
*** _ix has quit IRC | 14:11 | |
*** tbachman has joined #openstack-nova | 14:15 | |
*** tbachman has quit IRC | 14:22 | |
*** tbachman has joined #openstack-nova | 14:24 | |
*** janki has quit IRC | 14:24 | |
*** janki has joined #openstack-nova | 14:24 | |
*** Bhujay has quit IRC | 14:27 | |
*** alexchadin has quit IRC | 14:30 | |
*** alexchadin has joined #openstack-nova | 14:30 | |
dansmith | sahid: we wanted to make sure you saw this: https://review.openstack.org/#/c/591275/ | 14:30 |
dansmith | sahid: and that the rationale was clear, because we discussed mostly on irc | 14:30 |
dansmith | basically, I think that doing that in the libvirt driver will always be racy because of where the plug happens, | 14:31 |
dansmith | but since mriedem added it generically in the compute manager (where it can be done properly) it has the same effect you were going for | 14:32 |
dansmith | and, the two conflict of course because the wait in compute manager will "eat" the notification so that the libvirt wait will never see it | 14:32 |
dansmith | sahid: I also wonder if the race we identified is why you were seeing it not always work sometimes | 14:33 |
dansmith | the person that reported it on pike was always seeing it fail to win the race and thus never increase the speed limit | 14:33 |
gibi | tetsuro: would you mind if I rebase you report client 1.29 patches? | 14:33 |
gibi | tetsuro: I would like to see if 1.28 and 1.29 are still compatible codewise before I move forward with the split | 14:34 |
sahid | dansmith: initially i proposed to continue live-migration is a timeout occurs, since we know that some network issues might happen wich does not necessary mean the live-migration is failling | 14:34 |
tetsuro | gibi: no I don't mind at all. thanks! | 14:34 |
dansmith | sahid: right, which I'm not okay with, but I wonder if the "network issues" you saw were actually just because your approach was racy | 14:35 |
dansmith | sahid: here's the patch that added it to compute manager: https://review.openstack.org/#/c/558001/10/nova/compute/manager.py | 14:35 |
*** josecastroleon has joined #openstack-nova | 14:35 | |
dansmith | sahid: which starts the wait *before* the pre-live-on-dest call runs which actually does the plug, so it's not racy | 14:35 |
*** josecastroleon has quit IRC | 14:36 | |
*** josecastroleon has joined #openstack-nova | 14:36 | |
dansmith | and you can see, that patch will consume the notification so that your wait in libvirt would never see it | 14:36 |
sean-k-mooney | dansmith: sahid well reducing the live migration bandwith was really the equvalent of a random sleep(x) as it was never guarneteed to be enough as even with the minium migration bandwith i could still complete before the netwroking was set up | 14:36 |
dansmith | sean-k-mooney: yeah I said that several times on the initial review :) | 14:37 |
dansmith | the assertion was made that we could only do it where he had it because of when/where the plug happens, | 14:39 |
dansmith | and that slowing the migration was the only way to catch it first, | 14:39 |
dansmith | but that clearly wasn't correct | 14:39 |
dansmith | so matt's version in compute manager does the full wait before we even start, which is definitely better | 14:39 |
sahid | how that is supposed to work? linux bridge agent is configuring the network only when it see the new tap device created | 14:40 |
sahid | that is basically why i took that way to fix the issue, libvirt is creating the tap device when calling migrateToURI | 14:41 |
dansmith | right, but that happens when we plug the vif, yeah? | 14:41 |
sahid | no | 14:41 |
dansmith | sahid: did you look at the bug reported by the guy on pike? | 14:41 |
dansmith | the event came *before* we even started listening for it | 14:41 |
sean-k-mooney | dansmith: for linux bridge no. we we do plug we call brctl add-interface bridge but the tap does not exist at that point | 14:42 |
dansmith | sean-k-mooney: do you mean add-br? | 14:42 |
sean-k-mooney | no ill get the link to the code in os-vif | 14:43 |
gibi | tetsuro: depending of the size of the confict I will do the rebase tomorrow | 14:43 |
dansmith | sean-k-mooney: sahid you should also look at matt's comments on the CI test patch where he follows the sequence of events in a CI run which was configured in such a way that we'd hit the timeout | 14:44 |
sean-k-mooney | actully wait for linux bridge plugin plug jsut creates teh bridge if it does not exist | 14:44 |
dansmith | sean-k-mooney: did you look at the bug where we can see the event coming *before* we start the live migration? | 14:44 |
dansmith | https://bugs.launchpad.net/nova/+bug/1786346 | 14:44 |
openstack | Launchpad bug 1786346 in OpenStack Compute (nova) rocky "live migrations slow" [High,In progress] - Assigned to Matt Riedemann (mriedem) | 14:44 |
dansmith | and since that happens and we don't stop the migration, | 14:45 |
dansmith | the migration continues for a really long time at 1MB/s | 14:45 |
tetsuro | gibi: Sure... and feel free to ask me to do that. I'll check the IRC log, anyway. | 14:45 |
dansmith | the event did arrive, but before we were listening for it | 14:45 |
dansmith | so we failed unnecessarily, | 14:45 |
dansmith | and then the migration ran "forever" | 14:45 |
sean-k-mooney | actully if we pass the interface it does add it https://github.com/openstack/os-vif/blob/master/vif_plug_linux_bridge/linux_net.py#L149 its been a while since i looked at this code | 14:46 |
gibi | tetsuro: OK | 14:46 |
dansmith | sean-k-mooney: during plug you mean? | 14:46 |
sean-k-mooney | ya | 14:46 |
openstackgerrit | Balazs Gibizer proposed openstack/nova master: Add request_spec.RequestGroup versioned object https://review.openstack.org/568840 | 14:46 |
dansmith | well, the event coming before we wait for it is a pretty clear sign :) | 14:46 |
openstackgerrit | Balazs Gibizer proposed openstack/nova master: Add requested_resources field to RequestSpec https://review.openstack.org/567267 | 14:46 |
openstackgerrit | Balazs Gibizer proposed openstack/nova master: Add bandwidth related standard resource classes https://review.openstack.org/570847 | 14:46 |
openstackgerrit | Balazs Gibizer proposed openstack/nova master: Transfer port.resource_request to the scheduler https://review.openstack.org/567268 | 14:46 |
openstackgerrit | Balazs Gibizer proposed openstack/nova master: Send resource allocations in the port binding https://review.openstack.org/569459 | 14:46 |
openstackgerrit | Balazs Gibizer proposed openstack/nova master: Test boot with more ports with bandwidth request https://review.openstack.org/573317 | 14:46 |
sean-k-mooney | dansmith: which event the neturon one? | 14:47 |
dansmith | sean-k-mooney: the plug event from neutron yeah | 14:47 |
*** cfriesen has joined #openstack-nova | 14:48 | |
*** _ix has joined #openstack-nova | 14:48 | |
sahid | it would be interesting to see the neutron logs | 14:48 |
sean-k-mooney | ya that will happen when the l2 agent polls the bridge config but im not sure that requires teh tap to exist, the fact that we have called brctl addif during plg might be enough for neutorn to "wire it up" and send the event | 14:49 |
*** ccamacho has quit IRC | 14:50 | |
sean-k-mooney | dansmith: nova/os-vif/libvirt handels l1 "phyical layer" neutron only wires up l2+ | 14:50 |
dansmith | sean-k-mooney: I'm not sure what your point is | 14:52 |
sean-k-mooney | dansmith: my point is im not sure the the neutron l2 agent ever check the tap actully exits vs just looking at the output of brctl show | 14:53 |
dansmith | sean-k-mooney: ah okay, well, seems like that has to be the case | 14:53 |
sean-k-mooney | not sure if that is a problem or not | 14:53 |
sean-k-mooney | when the tap shows up it should become part of the bridge correctly | 14:54 |
dansmith | well, tbh, getting the event before libvirt does the migration is really advantageous, because we can get our ducks lined up before we even start | 14:54 |
dansmith | because we don't need the sleep()-equivalent speed limit that way | 14:54 |
sean-k-mooney | im not sure if an TC rules for qos or iptables rules would be applied to the tap however but i have no evidnce either way | 14:55 |
openstackgerrit | Balazs Gibizer proposed openstack/nova master: Use placement 1.28 in scheduler report client https://review.openstack.org/583667 | 14:56 |
sean-k-mooney | dansmith: ya makeing sure the network is configure so that it will jsut work when the tap shows up is good as it mean the RARP packets qemu sends before teh vm unpauses to set up mac learning will work | 14:56 |
*** ccamacho has joined #openstack-nova | 14:56 | |
*** hongbin has joined #openstack-nova | 15:01 | |
*** takashin has left #openstack-nova | 15:01 | |
sean-k-mooney | dansmith: do you have a link to matts change? | 15:02 |
*** tbachman has quit IRC | 15:02 | |
mdbooth | sean-k-mooney: https://review.openstack.org/#/c/558001/10/nova/compute/manager.py I assume | 15:02 |
mdbooth | If you're still talking about the same thing. | 15:02 |
dansmith | sean-k-mooney: which one? | 15:03 |
sean-k-mooney | dansmith: moving the wait to compute manager | 15:03 |
dansmith | yeah pasted above, and mdbooth just pasted | 15:03 |
sean-k-mooney | i wanted to check the neutron logs for a message | 15:03 |
*** alexchadin has quit IRC | 15:04 | |
dansmith | sean-k-mooney: oh then you want the LB test patch | 15:04 |
sean-k-mooney | ya i think i found it | 15:04 |
sean-k-mooney | https://review.openstack.org/#/c/590585/ | 15:04 |
*** tetsuro has quit IRC | 15:05 | |
dansmith | sean-k-mooney: some good analysis in his comments on this: https://review.openstack.org/#/c/590538/ | 15:05 |
sean-k-mooney | dansmith: i wanted to check if this code was getting executed when plug was happening https://github.com/openstack/neutron/blob/master/neutron/plugins/ml2/drivers/linuxbridge/agent/linuxbridge_neutron_agent.py#L529-L532 | 15:07 |
openstackgerrit | Merged openstack/nova master: add zvm into support matrix https://review.openstack.org/532720 | 15:08 |
openstackgerrit | Eric Fried proposed openstack/nova master: DNM: Remove blacklisted py3 xen tests https://review.openstack.org/591419 | 15:17 |
openstackgerrit | Eric Fried proposed openstack/nova master: DNM: Remove blacklisted py3 xen tests https://review.openstack.org/591419 | 15:18 |
*** rodolof has quit IRC | 15:18 | |
*** janki has quit IRC | 15:19 | |
openstackgerrit | Balazs Gibizer proposed openstack/nova master: Enable nested allocation candidates in scheduler https://review.openstack.org/585672 | 15:19 |
openstackgerrit | Balazs Gibizer proposed openstack/nova master: Functional test for booting with nested resources https://review.openstack.org/527728 | 15:19 |
openstackgerrit | Balazs Gibizer proposed openstack/nova master: Functional test for moving with nested resources https://review.openstack.org/587350 | 15:19 |
gibi | tetsuro: it went better than I expected ^^ | 15:19 |
*** holser_ has quit IRC | 15:24 | |
*** tbachman has joined #openstack-nova | 15:31 | |
openstackgerrit | Balazs Gibizer proposed openstack/nova master: Add request_spec.RequestGroup versioned object https://review.openstack.org/568840 | 15:35 |
openstackgerrit | Balazs Gibizer proposed openstack/nova master: Add requested_resources field to RequestSpec https://review.openstack.org/567267 | 15:35 |
openstackgerrit | Balazs Gibizer proposed openstack/nova master: Add bandwidth related standard resource classes https://review.openstack.org/570847 | 15:35 |
openstackgerrit | Balazs Gibizer proposed openstack/nova master: Transfer port.resource_request to the scheduler https://review.openstack.org/567268 | 15:35 |
openstackgerrit | Balazs Gibizer proposed openstack/nova master: Send resource allocations in the port binding https://review.openstack.org/569459 | 15:36 |
openstackgerrit | Balazs Gibizer proposed openstack/nova master: Test boot with more ports with bandwidth request https://review.openstack.org/573317 | 15:36 |
*** pcaruana has quit IRC | 15:37 | |
*** gouthamr has joined #openstack-nova | 15:54 | |
dansmith | sean-k-mooney: sahid: as I said in the bug, it's easy for a loaded allinone gate worker to be slow enough that we win the race, | 16:07 |
dansmith | which I'm sure was happening when we originally tested it | 16:08 |
dansmith | if you look at mriedem's detailed analysis from last week, | 16:08 |
dansmith | he shows how he is able to poke it with the upstream jobs by tweaking the timing a bit | 16:08 |
dansmith | comments on PS2 here: https://review.openstack.org/#/c/590538/ | 16:08 |
*** dklyle has joined #openstack-nova | 16:10 | |
*** eharney has quit IRC | 16:11 | |
*** slaweq_ has quit IRC | 16:15 | |
sean-k-mooney | dansmith: right so the depeds on drops the time out to 30 seconds and truns on wait for plugs. the linux bridge live migration tests then fail. was this triggered sice the revert | 16:17 |
*** sahid has quit IRC | 16:18 | |
*** gyee has joined #openstack-nova | 16:23 | |
openstackgerrit | Chris Dent proposed openstack/nova master: DNM: Add placement perf info gathering to end of nova-next https://review.openstack.org/591367 | 16:24 |
*** eharney has joined #openstack-nova | 16:24 | |
sean-k-mooney | im going to set up a lb env and test this locally. i want to test live migration betwen ovs and lb anyway so ill just check lb to lb first | 16:25 |
*** sambetts is now known as sambetts|afk | 16:26 | |
*** namnh has joined #openstack-nova | 16:26 | |
*** ccamacho has quit IRC | 16:31 | |
*** slaweq_ has joined #openstack-nova | 16:31 | |
*** jpena is now known as jpena|off | 16:34 | |
*** slaweq_ has quit IRC | 16:36 | |
gryf | hi, can I get attention to this patch: https://review.openstack.org/#/c/536351/3 ? | 16:40 |
*** pcaruana has joined #openstack-nova | 16:40 | |
*** masayukig has quit IRC | 16:43 | |
sean-k-mooney | gryf: looking now. | 16:45 |
gryf | sean-k-mooney, thank you | 16:47 |
*** mvkr has quit IRC | 16:48 | |
*** itlinux has joined #openstack-nova | 16:49 | |
*** slaweq_ has joined #openstack-nova | 16:52 | |
*** slaweq_ has quit IRC | 16:57 | |
*** dtantsur is now known as dtantsur|afk | 16:59 | |
*** derekh has quit IRC | 17:01 | |
openstackgerrit | Merged openstack/nova master: [placement] api-ref: Add missing aggregates example https://review.openstack.org/591332 | 17:03 |
*** namnh has quit IRC | 17:09 | |
*** slaweq_ has joined #openstack-nova | 17:11 | |
*** sapcc-bot1 has joined #openstack-nova | 17:12 | |
*** sapcc-bot2 has joined #openstack-nova | 17:14 | |
*** namnh has joined #openstack-nova | 17:14 | |
*** slaweq_ has quit IRC | 17:15 | |
*** openstackgerrit has quit IRC | 17:19 | |
*** NobodyCam has quit IRC | 17:19 | |
*** NobodyCam has joined #openstack-nova | 17:19 | |
*** namnh has quit IRC | 17:22 | |
*** eharney has quit IRC | 17:31 | |
*** eandersson has quit IRC | 17:32 | |
*** slaweq_ has joined #openstack-nova | 17:32 | |
*** tssurya has quit IRC | 17:36 | |
*** slaweq_ has quit IRC | 17:37 | |
sean-k-mooney | gryf: its not clear to me how the value is used | 17:38 |
*** sapcc-bot has quit IRC | 17:39 | |
*** jamesdenton has quit IRC | 17:39 | |
*** mvkr has joined #openstack-nova | 17:39 | |
*** manjeets has quit IRC | 17:40 | |
*** stephenfin_ has quit IRC | 17:42 | |
*** nalhat has quit IRC | 17:45 | |
*** stephenfin has joined #openstack-nova | 17:45 | |
efried | johnthetubaguy: --^ | 17:54 |
*** pcaruana has quit IRC | 17:59 | |
*** jamesdenton has joined #openstack-nova | 18:04 | |
*** slaweq_ has joined #openstack-nova | 18:11 | |
*** slaweq_ has quit IRC | 18:15 | |
*** imacdonn has quit IRC | 18:26 | |
*** slaweq_ has joined #openstack-nova | 18:32 | |
*** slaweq_ has quit IRC | 18:37 | |
*** namnh has joined #openstack-nova | 18:37 | |
*** tssurya has joined #openstack-nova | 18:39 | |
*** namnh has quit IRC | 18:42 | |
*** imacdonn has joined #openstack-nova | 18:51 | |
*** gbarros has quit IRC | 18:53 | |
*** slaweq_ has joined #openstack-nova | 18:53 | |
*** gbarros has joined #openstack-nova | 18:53 | |
*** slaweq_ has quit IRC | 18:57 | |
*** hemna_ has joined #openstack-nova | 18:58 | |
*** jpena|off is now known as jpena | 19:04 | |
*** jpena is now known as jpena|off | 19:06 | |
*** openstackgerrit has joined #openstack-nova | 19:14 | |
openstackgerrit | Eric Fried proposed openstack/nova master: DNM: Remove blacklisted py3 xen tests https://review.openstack.org/591419 | 19:14 |
*** ameade_ has joined #openstack-nova | 19:18 | |
*** mgagne_ has joined #openstack-nova | 19:24 | |
*** rajinir has quit IRC | 19:25 | |
*** knikolla has quit IRC | 19:25 | |
*** idlemind has quit IRC | 19:25 | |
*** ameade has quit IRC | 19:25 | |
*** serverascode_ has quit IRC | 19:25 | |
*** tommylikehu has quit IRC | 19:25 | |
*** ujjain has quit IRC | 19:25 | |
*** mgagne has quit IRC | 19:25 | |
*** Miouge has quit IRC | 19:25 | |
*** ameade_ is now known as ameade | 19:25 | |
*** Miouge- has joined #openstack-nova | 19:25 | |
*** ujjain has joined #openstack-nova | 19:27 | |
*** purplerbot has quit IRC | 19:27 | |
*** amotoki has quit IRC | 19:27 | |
*** knikolla has joined #openstack-nova | 19:28 | |
*** amotoki has joined #openstack-nova | 19:30 | |
*** holser_ has joined #openstack-nova | 19:31 | |
*** slaweq_ has joined #openstack-nova | 19:32 | |
*** holser_ has quit IRC | 19:35 | |
*** slaweq_ has quit IRC | 19:36 | |
*** eharney has joined #openstack-nova | 19:40 | |
*** Sundar has joined #openstack-nova | 19:42 | |
*** adrianc has quit IRC | 19:45 | |
openstackgerrit | Chris Dent proposed openstack/nova master: DNM: Add placement perf info gathering to end of nova-next https://review.openstack.org/591367 | 19:45 |
*** awaugama has quit IRC | 19:52 | |
*** tbachman has quit IRC | 19:56 | |
*** efried has quit IRC | 19:58 | |
*** rajinir has joined #openstack-nova | 20:05 | |
*** tssurya has quit IRC | 20:07 | |
*** slaweq_ has joined #openstack-nova | 20:11 | |
*** efried has joined #openstack-nova | 20:13 | |
openstackgerrit | melanie witt proposed openstack/nova master: Add functional test for affinity with multiple cells https://review.openstack.org/585073 | 20:14 |
openstackgerrit | melanie witt proposed openstack/nova master: Make scheduler.utils.setup_instance_group query all cells https://review.openstack.org/540258 | 20:14 |
*** slaweq_ has quit IRC | 20:16 | |
*** purplerbot has joined #openstack-nova | 20:25 | |
openstackgerrit | Eric Fried proposed openstack/nova master: Improve debug logs for GET /allocation_candidates https://review.openstack.org/591510 | 20:25 |
*** tbachman has joined #openstack-nova | 20:26 | |
*** gbarros has quit IRC | 20:28 | |
*** gbarros has joined #openstack-nova | 20:30 | |
*** gbarros has quit IRC | 20:30 | |
*** slaweq_ has joined #openstack-nova | 20:32 | |
*** slaweq_ has quit IRC | 20:36 | |
*** erlon has quit IRC | 20:45 | |
*** slaweq_ has joined #openstack-nova | 20:53 | |
*** slaweq_ has quit IRC | 20:57 | |
*** burt has quit IRC | 20:59 | |
*** erlon has joined #openstack-nova | 21:05 | |
*** cdent has quit IRC | 21:06 | |
*** slaweq_ has joined #openstack-nova | 21:11 | |
*** slaweq_ has quit IRC | 21:16 | |
*** itlinux has quit IRC | 21:26 | |
*** slagle has quit IRC | 21:26 | |
*** slaweq_ has joined #openstack-nova | 21:33 | |
*** slaweq_ has quit IRC | 21:43 | |
*** hongbin has quit IRC | 21:54 | |
*** slaweq_ has joined #openstack-nova | 22:00 | |
*** erlon has quit IRC | 22:00 | |
*** rcernin has joined #openstack-nova | 22:01 | |
*** slaweq_ has quit IRC | 22:04 | |
*** Sundar has quit IRC | 22:05 | |
*** _ix has quit IRC | 22:11 | |
*** slaweq_ has joined #openstack-nova | 22:11 | |
*** imacdonn has quit IRC | 22:12 | |
*** tbachman_ has joined #openstack-nova | 22:15 | |
*** slaweq_ has quit IRC | 22:16 | |
*** tbachman has quit IRC | 22:17 | |
*** tbachman_ is now known as tbachman | 22:17 | |
*** scarab_ has joined #openstack-nova | 22:20 | |
*** tbachman_ has joined #openstack-nova | 22:21 | |
*** tbachman has quit IRC | 22:23 | |
*** tbachman_ is now known as tbachman | 22:23 | |
*** scarab_ has quit IRC | 22:25 | |
*** scarab_ has joined #openstack-nova | 22:27 | |
*** scarab_ has quit IRC | 22:32 | |
*** scarab_ has joined #openstack-nova | 22:33 | |
*** rtjure has quit IRC | 22:35 | |
*** scarab_ has quit IRC | 22:37 | |
*** imacdonn has joined #openstack-nova | 22:38 | |
*** namnh has joined #openstack-nova | 22:38 | |
*** namnh has quit IRC | 22:44 | |
*** slaweq_ has joined #openstack-nova | 22:53 | |
*** slaweq_ has quit IRC | 22:58 | |
*** slaweq_ has joined #openstack-nova | 23:11 | |
*** slaweq_ has quit IRC | 23:15 | |
*** namnh has joined #openstack-nova | 23:51 | |
*** slaweq_ has joined #openstack-nova | 23:53 | |
*** slaweq_ has quit IRC | 23:57 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!