| *** efried has quit IRC | 00:05 | |
| *** macza has quit IRC | 00:09 | |
| *** macza_ has joined #openstack-nova | 00:09 | |
| *** efried has joined #openstack-nova | 00:10 | |
| *** slaweq has joined #openstack-nova | 00:11 | |
| *** efried has quit IRC | 00:14 | |
| *** efried has joined #openstack-nova | 00:14 | |
| *** efried has quit IRC | 00:15 | |
| *** slaweq has quit IRC | 00:16 | |
| *** tetsuro has joined #openstack-nova | 00:25 | |
| *** brinzhang has joined #openstack-nova | 00:33 | |
| *** brinzhang has quit IRC | 00:34 | |
| *** wolverineav has quit IRC | 00:36 | |
| *** wolverineav has joined #openstack-nova | 00:37 | |
| *** amodi has quit IRC | 00:39 | |
| *** BrinZhang has joined #openstack-nova | 00:40 | |
| *** wolverineav has quit IRC | 00:42 | |
| openstackgerrit | Takashi NATSUME proposed openstack/nova master: Remove mox in unit/network/test_neutronv2.py (4) https://review.openstack.org/574106 | 00:45 |
|---|---|---|
| openstackgerrit | Takashi NATSUME proposed openstack/nova master: Remove mox in unit/network/test_neutronv2.py (5) https://review.openstack.org/574110 | 00:45 |
| openstackgerrit | Takashi NATSUME proposed openstack/nova master: Remove mox in unit/network/test_neutronv2.py (6) https://review.openstack.org/574113 | 00:45 |
| openstackgerrit | Takashi NATSUME proposed openstack/nova master: Remove mox in unit/network/test_neutronv2.py (7) https://review.openstack.org/574974 | 00:46 |
| openstackgerrit | Takashi NATSUME proposed openstack/nova master: Remove mox in unit/network/test_neutronv2.py (8) https://review.openstack.org/575311 | 00:46 |
| openstackgerrit | Merged openstack/nova stable/rocky: Create BDMs/tags in cell with instance when over-quota https://review.openstack.org/623932 | 00:56 |
| *** mmethot has joined #openstack-nova | 00:58 | |
| *** wolverineav has joined #openstack-nova | 01:05 | |
| *** wolverineav has quit IRC | 01:07 | |
| *** wolverineav has joined #openstack-nova | 01:07 | |
| *** amodi has joined #openstack-nova | 01:11 | |
| openstackgerrit | Merged openstack/nova master: Move nova-cells-v1 to experimental queue https://review.openstack.org/623538 | 01:23 |
| openstackgerrit | Takashi NATSUME proposed openstack/nova master: Remove mox in unit/network/test_neutronv2.py (9) https://review.openstack.org/575581 | 01:38 |
| openstackgerrit | Takashi NATSUME proposed openstack/nova master: Remove mox in unit/network/test_neutronv2.py (10) https://review.openstack.org/576017 | 01:38 |
| openstackgerrit | Takashi NATSUME proposed openstack/nova master: Remove mox in unit/network/test_neutronv2.py (11) https://review.openstack.org/576018 | 01:38 |
| openstackgerrit | Takashi NATSUME proposed openstack/nova master: Remove mox in unit/network/test_neutronv2.py (12) https://review.openstack.org/576019 | 01:38 |
| openstackgerrit | Takashi NATSUME proposed openstack/nova master: Remove mox in unit/network/test_neutronv2.py (13) https://review.openstack.org/576020 | 01:38 |
| *** lei-zh has joined #openstack-nova | 01:52 | |
| *** yedongcan has joined #openstack-nova | 01:55 | |
| *** _alastor_ has joined #openstack-nova | 02:01 | |
| *** hshiina has quit IRC | 02:01 | |
| *** BrinZhang has quit IRC | 02:05 | |
| *** _alastor_ has quit IRC | 02:06 | |
| *** mrsoul has joined #openstack-nova | 02:07 | |
| *** lei-zh1 has joined #openstack-nova | 02:20 | |
| *** lei-zh has quit IRC | 02:22 | |
| *** tetsuro has quit IRC | 02:26 | |
| *** mhen has quit IRC | 02:30 | |
| *** daikk115 has joined #openstack-nova | 02:32 | |
| *** mhen has joined #openstack-nova | 02:33 | |
| *** macza_ has quit IRC | 02:33 | |
| daikk115 | Hi all, I got the error during live migration between two same CPU compute hosts (different BIOS versions lead to different CPU models: SandyBridge-IBRS and SandyBridge). | 02:35 |
| daikk115 | How can I deal with this problem? | 02:35 |
| *** macza has joined #openstack-nova | 02:37 | |
| *** cfriesen has quit IRC | 02:38 | |
| *** macza has quit IRC | 02:41 | |
| *** jistr has quit IRC | 02:42 | |
| *** tetsuro has joined #openstack-nova | 02:48 | |
| *** jistr has joined #openstack-nova | 02:50 | |
| *** psachin has joined #openstack-nova | 02:52 | |
| *** Dinesh_Bhor has joined #openstack-nova | 02:57 | |
| *** brinzhang has joined #openstack-nova | 02:57 | |
| *** daikk115 has quit IRC | 03:12 | |
| *** Dinesh_Bhor has quit IRC | 03:13 | |
| *** hongbin has joined #openstack-nova | 03:15 | |
| *** Dinesh_Bhor has joined #openstack-nova | 03:20 | |
| *** bzhao__ has joined #openstack-nova | 03:28 | |
| *** cfriesen has joined #openstack-nova | 03:42 | |
| *** udesale has joined #openstack-nova | 03:48 | |
| *** gyee has quit IRC | 03:53 | |
| *** moshele has joined #openstack-nova | 03:54 | |
| *** jamesden_ has joined #openstack-nova | 03:54 | |
| *** jamesdenton has quit IRC | 03:55 | |
| *** markvoelker has joined #openstack-nova | 03:57 | |
| *** moshele has quit IRC | 03:58 | |
| openstackgerrit | Yikun Jiang proposed openstack/nova master: Add live migration timeout action https://review.openstack.org/619143 | 04:00 |
| openstackgerrit | Yikun Jiang proposed openstack/nova master: Remove live_migration_progress_timeout config https://review.openstack.org/619142 | 04:00 |
| *** markvoelker has quit IRC | 04:02 | |
| *** udesale has quit IRC | 04:08 | |
| *** mriedem_away has quit IRC | 04:15 | |
| *** lei-zh1 has quit IRC | 04:19 | |
| *** alex_xu has quit IRC | 04:19 | |
| *** _alastor_ has joined #openstack-nova | 04:23 | |
| *** wolverineav has quit IRC | 04:29 | |
| *** wolverineav has joined #openstack-nova | 04:30 | |
| *** slaweq has joined #openstack-nova | 04:30 | |
| *** udesale has joined #openstack-nova | 04:43 | |
| *** lpetrut has joined #openstack-nova | 04:55 | |
| *** Dinesh_Bhor has quit IRC | 04:56 | |
| *** Dinesh_Bhor has joined #openstack-nova | 04:57 | |
| *** igordc has quit IRC | 04:59 | |
| *** jarodwl has joined #openstack-nova | 05:03 | |
| *** wolverineav has quit IRC | 05:05 | |
| *** hongbin has quit IRC | 05:07 | |
| *** wolverineav has joined #openstack-nova | 05:13 | |
| *** Dinesh_Bhor has quit IRC | 05:17 | |
| *** Dinesh_Bhor has joined #openstack-nova | 05:19 | |
| *** ratailor has joined #openstack-nova | 05:25 | |
| *** lpetrut has quit IRC | 05:35 | |
| *** _alastor_ has quit IRC | 05:50 | |
| *** tetsuro has quit IRC | 05:51 | |
| *** tetsuro has joined #openstack-nova | 05:53 | |
| *** wolverineav has quit IRC | 05:54 | |
| *** bhagyashris_ has joined #openstack-nova | 05:54 | |
| *** sridharg has joined #openstack-nova | 06:09 | |
| openstackgerrit | Fan Zhang proposed openstack/nova master: Log disk transfer stats in live migration monitor. https://review.openstack.org/619395 | 06:12 |
| *** fanzhang has quit IRC | 06:15 | |
| *** wolverineav has joined #openstack-nova | 06:18 | |
| *** _alastor_ has joined #openstack-nova | 06:18 | |
| *** moshele has joined #openstack-nova | 06:19 | |
| *** _alastor_ has quit IRC | 06:23 | |
| *** betherly has quit IRC | 06:24 | |
| *** macza has joined #openstack-nova | 06:28 | |
| *** macza has quit IRC | 06:32 | |
| *** sdake has quit IRC | 06:35 | |
| *** sdake has joined #openstack-nova | 06:40 | |
| *** rcernin has quit IRC | 06:43 | |
| *** wolverineav has quit IRC | 06:44 | |
| openstackgerrit | Takashi NATSUME proposed openstack/nova master: Remove mox in unit/network/test_neutronv2.py (14) https://review.openstack.org/576027 | 06:46 |
| openstackgerrit | Takashi NATSUME proposed openstack/nova master: Remove mox in unit/network/test_neutronv2.py (15) https://review.openstack.org/576031 | 06:47 |
| openstackgerrit | Takashi NATSUME proposed openstack/nova master: Remove mox in unit/network/test_neutronv2.py (16) https://review.openstack.org/576299 | 06:47 |
| openstackgerrit | Takashi NATSUME proposed openstack/nova master: Remove mox in unit/network/test_neutronv2.py (17) https://review.openstack.org/576344 | 06:47 |
| openstackgerrit | Takashi NATSUME proposed openstack/nova master: Remove mox in unit/network/test_neutronv2.py (18) https://review.openstack.org/576673 | 06:47 |
| *** cfriesen has quit IRC | 06:48 | |
| *** Luzi has joined #openstack-nova | 06:49 | |
| *** ohorecny2 has joined #openstack-nova | 06:58 | |
| *** wolverineav has joined #openstack-nova | 07:01 | |
| openstackgerrit | Takashi NATSUME proposed openstack/nova master: Remove mox in unit/network/test_neutronv2.py (19) https://review.openstack.org/576676 | 07:10 |
| openstackgerrit | Takashi NATSUME proposed openstack/nova master: Remove mox in unit/network/test_neutronv2.py (20) https://review.openstack.org/576689 | 07:10 |
| openstackgerrit | Takashi NATSUME proposed openstack/nova master: Remove mox in unit/network/test_neutronv2.py (21) https://review.openstack.org/576709 | 07:10 |
| openstackgerrit | Takashi NATSUME proposed openstack/nova master: Remove mox in unit/network/test_neutronv2.py (22) https://review.openstack.org/576712 | 07:10 |
| *** sunnaichuan has joined #openstack-nova | 07:13 | |
| *** brinzhang has quit IRC | 07:27 | |
| *** wolverineav has quit IRC | 07:29 | |
| *** macza has joined #openstack-nova | 07:30 | |
| *** zufar has joined #openstack-nova | 07:30 | |
| zufar | Hi all, i want to ask something, I am installing openstack queens but have trouble when starting instance | 07:31 |
| zufar | when I am check nova compute log, they give me this error "ERROR nova.compute.manager [instance: b70b0595-a8e8-492d-8b9f-7a66b7b7cdbd] ImageUnacceptable: Image a42bcec5-6820-487f-a278-ba804c7a3db1 is unacceptable: Image has no associated data" | 07:31 |
| zufar | anyone know whats happen? | 07:31 |
| *** macza has quit IRC | 07:34 | |
| openstackgerrit | Merged openstack/nova master: Remove utils.execute() from quobyte libvirt storage driver. https://review.openstack.org/619702 | 07:37 |
| openstackgerrit | Merged openstack/nova master: Move nova.libvirt.utils away from using nova.utils.execute(). https://review.openstack.org/619703 | 07:41 |
| *** trident has quit IRC | 07:42 | |
| sunnaichuan | zufar: your image a42bcec5-6820-487f-a278-ba804c7a3db1 can't be used. Check if the format is wrong or corrupted | 07:44 |
| *** trident has joined #openstack-nova | 07:44 | |
| zufar | sunnaichuan: some time its success deploy on the node. sometime error giving this error. | 07:46 |
| zufar | I am using this command to build the images, `openstack image create --disk-format qcow2 --file xenial-server-cloudimg-amd64-disk1.img --public ubuntu` | 07:46 |
| sunnaichuan | Not clear about that. It looks not a random error... | 07:49 |
| *** oanson has quit IRC | 07:54 | |
| sunnaichuan | zufar: there is a bug report: https://bugs.launchpad.net/nova/+bug/1755756 | 07:56 |
| openstack | Launchpad bug 1755756 in OpenStack Compute (nova) "ImageUnacceptable: Image is unacceptable: 'qemu-img info' parsing failed" [Undecided,New] - Assigned to pandatt (pandatt) | 07:56 |
| sunnaichuan | Err, not the same one :[. | 07:57 |
| *** ratailor has quit IRC | 08:00 | |
| *** ratailor has joined #openstack-nova | 08:00 | |
| *** sunnaichuan is now known as naichuans | 08:02 | |
| *** ccamacho has joined #openstack-nova | 08:04 | |
| *** fanzhang has joined #openstack-nova | 08:09 | |
| *** bhagyashris_ has quit IRC | 08:10 | |
| *** mgoddard has quit IRC | 08:10 | |
| *** mgoddard has joined #openstack-nova | 08:10 | |
| *** bhagyashris__ has joined #openstack-nova | 08:11 | |
| zufar | sunnaichuan: this is my glance images, nova) "ImageUnacceptable: Image is unacce | 08:13 |
| zufar | sorry, http://paste.opensuse.org/view//73535128 | 08:13 |
| *** helenafm has joined #openstack-nova | 08:15 | |
| *** imacdonn has quit IRC | 08:22 | |
| *** imacdonn has joined #openstack-nova | 08:23 | |
| naichuans | zufar: could you see the image under glance/images/? | 08:24 |
| *** _alastor_ has joined #openstack-nova | 08:25 | |
| *** maciejjozefczyk has joined #openstack-nova | 08:25 | |
| *** brinzhang has joined #openstack-nova | 08:25 | |
| *** maciejjozefczyk has joined #openstack-nova | 08:26 | |
| *** maciejjozefczyk has quit IRC | 08:26 | |
| *** ralonsoh has joined #openstack-nova | 08:29 | |
| *** _alastor_ has quit IRC | 08:30 | |
| *** takashin has left #openstack-nova | 08:30 | |
| *** tssurya has joined #openstack-nova | 08:31 | |
| *** maciejjozefczyk has joined #openstack-nova | 08:37 | |
| *** bhagyashris__ has quit IRC | 08:38 | |
| *** priteau has joined #openstack-nova | 08:39 | |
| zufar | hi naichuans, i think the problem is in the directory glance images | 08:39 |
| zufar | I am using 3 controller node, and only 1 node is having the images | 08:39 |
| naichuans | zufar: looks so :) | 08:40 |
| zufar | I have rsync this and success. thank you | 08:41 |
| naichuans | Np. | 08:41 |
| *** brinzhang has quit IRC | 08:51 | |
| *** dpawlik has quit IRC | 09:03 | |
| *** dpawlik has joined #openstack-nova | 09:04 | |
| *** wolverineav has joined #openstack-nova | 09:07 | |
| naichuans | bauzas: Hi, Sylvain, do you familiar with qemu? I meet a problem when I try to do a live disk mirror. | 09:07 |
| *** dpawlik has quit IRC | 09:08 | |
| kashyap | naichuans: Hi, what's the problem? | 09:08 |
| naichuans | Thanks, kashyap. I run below command: "virsh qemu-monitor-command --hmp 1b2757fb-655f-4eec-b1b5-88bd67013aa0 'drive_mirror -f /var/lib/nova/instance/1b2757fb-655f-4eec-b1b5-88bd67013aa0/disk /data/testvm-mirror.img'" | 09:10 |
| naichuans | but get an error: "Device '/var/lib/nova/instance/1b2757fb-655f-4eec-b1b5-88bd67013aa0/disk' not found" | 09:11 |
| kashyap | naichuans: First of all...that's a red flag to me: you should not run 'qemu-monitor-command' behind libvirt's back. | 09:11 |
| *** mdbooth has joined #openstack-nova | 09:11 | |
| kashyap | (At least not on production VMs.) | 09:11 |
| naichuans | Ah, just for a test :) | 09:11 |
| kashyap | naichuans: Ah, OK. Even for test, I'm curious if you've tried this: | 09:12 |
| kashyap | $ virsh migrate --verbose --copy-storage-all --p2p --live cvm1 qemu+tcp://user@dest/system | 09:12 |
| *** wolverineav has quit IRC | 09:12 | |
| kashyap | Under the hood, the above is using QEMU's 'dirve-mirror'. | 09:12 |
| naichuans | Oh, then it should be the cmd I needed. I'm checking the qemu3.0 new feature: copy_mode for live mirror. | 09:13 |
| naichuans | How to specify it to use `write-blocking` option in the command? | 09:14 |
| kashyap | naichuans: I think you're referring to: "Support for "active" mirror using the new option "copy-mode" to the "drive-mirror" monitor option." | 09:15 |
| naichuans | yes | 09:15 |
| kashyap | Again, 'write-blocking' is a deep QMP (QEMU Monitor Protocol) option; if you want to try that, you have to use QMP commands by shell | 09:16 |
| kashyap | This is probably better discussed on #qemu, OFTC IRC network. | 09:16 |
| *** zufar has quit IRC | 09:17 | |
| naichuans | I see, thanks. If I use the cmd you provide above, it would use 'write-blocking' by default, right? I saw there is `--live` flag | 09:17 |
| *** sahid has joined #openstack-nova | 09:18 | |
| *** sahid has quit IRC | 09:18 | |
| *** sahid has joined #openstack-nova | 09:18 | |
| kashyap | naichuans: "It depends". I.e. -- | 09:18 |
| naichuans | Thank you very much, Kashyap. Will check it. | 09:19 |
| openstackgerrit | Lee Yarwood proposed openstack/nova master: libvirt: Add workaround to cleanup instance dir during evac with rbd https://review.openstack.org/618478 | 09:19 |
| kashyap | naichuans: If you're using 3.0 or above, I don't think 'write-blocking' will be use by default; you have to explicitly specify it. | 09:20 |
| kashyap | naichuans: And with 3.0 or above, 'copy-mode' will default to "background". | 09:20 |
| * kashyap is assuming you've read the relevant QEMU documentation; so not expanding on what these terms mean | 09:20 | |
| *** lpetrut has joined #openstack-nova | 09:21 | |
| naichuans | I see, the release log also said that. passive or backgroud is default. Will check how to specify it to use `write-blocking` | 09:21 |
| *** mdbooth_ has joined #openstack-nova | 09:22 | |
| *** mdbooth has quit IRC | 09:25 | |
| *** trinaths has joined #openstack-nova | 09:26 | |
| *** derekh has joined #openstack-nova | 09:36 | |
| *** dpawlik has joined #openstack-nova | 09:39 | |
| *** dpawlik has quit IRC | 09:39 | |
| *** dpawlik has joined #openstack-nova | 09:39 | |
| openstackgerrit | Brin Zhang proposed openstack/nova master: Remove the unused parameter from os-hypervisors https://review.openstack.org/624333 | 09:44 |
| *** rodolof has joined #openstack-nova | 09:47 | |
| *** rodolof has quit IRC | 09:57 | |
| *** rodolof has joined #openstack-nova | 09:57 | |
| fanzhang | hi kashyap if you have some time, please help review this patch https://review.openstack.org/#/c/612272/ | 10:06 |
| fanzhang | kashyap I discussed with melwitt , and she said she would ask you to take a look at your earliest convenience. I just notice you here, so... | 10:07 |
| kashyap | fanzhang: Hi, will look. I'm troubleshooting something else at the moment. | 10:07 |
| fanzhang | kashyap thanks a lot, no need to hurry, :) | 10:08 |
| *** rodolof has quit IRC | 10:09 | |
| *** rodolof has joined #openstack-nova | 10:10 | |
| *** Dinesh_Bhor has quit IRC | 10:10 | |
| *** priteau has quit IRC | 10:24 | |
| *** tetsuro has quit IRC | 10:33 | |
| *** Dinesh_Bhor has joined #openstack-nova | 10:34 | |
| *** cdent has joined #openstack-nova | 10:43 | |
| openstackgerrit | Chris Dent proposed openstack/nova master: Delete the placement code https://review.openstack.org/618215 | 10:48 |
| kashyap | fanzhang: I'll be off from next week until 01-Jan, I'll do my best to get to it this week | 10:50 |
| *** sridharg has quit IRC | 10:54 | |
| *** udesale has quit IRC | 10:56 | |
| *** tetsuro has joined #openstack-nova | 10:59 | |
| *** tobias-urdin is now known as tobias-urdin|lun | 11:00 | |
| *** tobias-urdin|lun is now known as tobias-urdin_afk | 11:01 | |
| *** moshele has quit IRC | 11:02 | |
| *** erlon has joined #openstack-nova | 11:07 | |
| lyarwood | mdbooth_: https://review.openstack.org/#/c/618478/ - can you hit this again? I've added some additional context around migrations after melwitt reviewed yesterday, would love to close this out this week if possible. | 11:08 |
| *** mdbooth_ is now known as mdbooth | 11:09 | |
| mdbooth | lyarwood: ack | 11:09 |
| *** sridharg has joined #openstack-nova | 11:09 | |
| *** sridharg has quit IRC | 11:09 | |
| *** dtantsur|afk is now known as dtantsur | 11:18 | |
| *** sridharg has joined #openstack-nova | 11:20 | |
| *** tobias-urdin_afk is now known as tobias-urdin | 11:27 | |
| *** rodolof has quit IRC | 11:35 | |
| *** rodolof has joined #openstack-nova | 11:35 | |
| *** Dinesh_Bhor has quit IRC | 11:37 | |
| openstackgerrit | Chris Dent proposed openstack/os-resource-classes master: Initial automated testing for os-resource-classes https://review.openstack.org/624366 | 11:38 |
| openstackgerrit | Yikun Jiang proposed openstack/nova master: Add live migration timeout action https://review.openstack.org/619143 | 11:42 |
| openstackgerrit | Yikun Jiang proposed openstack/nova master: Remove live_migration_progress_timeout config https://review.openstack.org/619142 | 11:42 |
| *** tbachman has quit IRC | 11:46 | |
| *** sridharg has quit IRC | 11:47 | |
| openstackgerrit | Chris Dent proposed openstack/os-resource-classes master: Initial automated testing for os-resource-classes https://review.openstack.org/624366 | 11:56 |
| openstackgerrit | Chris Dent proposed openstack/os-resource-classes master: Rename ORDERED_CLASSES to STANDARDS https://review.openstack.org/624369 | 11:56 |
| openstackgerrit | Chris Dent proposed openstack/os-resource-classes master: Sync STANDARDS with placement/nova rc_fields https://review.openstack.org/624370 | 11:56 |
| *** k_mouza has joined #openstack-nova | 11:56 | |
| *** dpawlik has quit IRC | 11:56 | |
| *** dpawlik has joined #openstack-nova | 11:57 | |
| *** sridharg has joined #openstack-nova | 12:00 | |
| *** erlon has quit IRC | 12:01 | |
| *** macza has joined #openstack-nova | 12:02 | |
| openstackgerrit | Yikun Jiang proposed openstack/nova master: Add live migration timeout action https://review.openstack.org/619143 | 12:05 |
| openstackgerrit | Yikun Jiang proposed openstack/nova master: Remove live_migration_progress_timeout config https://review.openstack.org/619142 | 12:05 |
| *** macza has quit IRC | 12:06 | |
| lbragstad | johnthetubaguy sometime soon we should go through https://review.openstack.org/#/c/596520/ again? | 12:08 |
| lbragstad | i'll have to ping jaypipes, too | 12:08 |
| lbragstad | looks like wxy-xiyuan worked some changes into the latest revision | 12:08 |
| *** erlon has joined #openstack-nova | 12:14 | |
| *** wolverineav has joined #openstack-nova | 12:18 | |
| *** wolverineav has quit IRC | 12:22 | |
| *** macza has joined #openstack-nova | 12:23 | |
| *** moshele has joined #openstack-nova | 12:27 | |
| *** macza has quit IRC | 12:28 | |
| *** jamesden_ is now known as jamesdenton | 12:29 | |
| *** tetsuro has quit IRC | 12:33 | |
| *** ShilpaSD has joined #openstack-nova | 12:33 | |
| *** tetsuro has joined #openstack-nova | 12:33 | |
| *** psachin has quit IRC | 12:35 | |
| *** rodolof has quit IRC | 12:41 | |
| *** rodolof has joined #openstack-nova | 12:41 | |
| *** naichuans has quit IRC | 12:41 | |
| *** tssurya has quit IRC | 12:46 | |
| *** k_mouza has quit IRC | 12:48 | |
| openstackgerrit | Chris Dent proposed openstack/os-resource-classes master: Tune up documentation to be more useful https://review.openstack.org/624384 | 12:50 |
| *** tetsuro has quit IRC | 12:54 | |
| *** dave-mccowan has joined #openstack-nova | 12:54 | |
| *** tbachman has joined #openstack-nova | 13:00 | |
| *** dave-mccowan has quit IRC | 13:01 | |
| *** yedongcan has left #openstack-nova | 13:01 | |
| *** ratailor has quit IRC | 13:04 | |
| *** tbachman has quit IRC | 13:05 | |
| *** tbachman has joined #openstack-nova | 13:08 | |
| *** panda|off is now known as panda | 13:10 | |
| sean-k-mooney | anyone know how to use logstash and write querries | 13:12 |
| sean-k-mooney | i cant get the message filtering to work | 13:12 |
| sean-k-mooney | tags:"screen-n-cpu.txt" and message:"os_vif error: [Errno 24] Too many open files" and project:"openstack/neutron" | 13:12 |
| cdent | sean-k-mooney: sorry, I'm no help. I generally just flail around, mostly using message: and that's it | 13:13 |
| sean-k-mooney | for some reason its ignoreing the message section and retruning message strings without the message in it | 13:14 |
| cdent | maybe it is confused by [ or ]? | 13:15 |
| sean-k-mooney | maybe i tried excaping them ill try a few more things | 13:15 |
| *** tssurya has joined #openstack-nova | 13:21 | |
| *** macza has joined #openstack-nova | 13:25 | |
| *** erlon has quit IRC | 13:28 | |
| *** macza has quit IRC | 13:29 | |
| *** macza has joined #openstack-nova | 13:46 | |
| *** erlon has joined #openstack-nova | 13:46 | |
| *** macza has quit IRC | 13:50 | |
| *** davidsha has joined #openstack-nova | 13:57 | |
| *** k_mouza has joined #openstack-nova | 13:59 | |
| *** macza has joined #openstack-nova | 14:06 | |
| *** mriedem has joined #openstack-nova | 14:06 | |
| *** mvkr has quit IRC | 14:07 | |
| *** dave-mccowan has joined #openstack-nova | 14:07 | |
| *** macza has quit IRC | 14:10 | |
| *** psachin has joined #openstack-nova | 14:11 | |
| *** dave-mccowan has quit IRC | 14:14 | |
| openstackgerrit | Matt Riedemann proposed openstack/nova master: Handle tags in _bury_in_cell0 https://review.openstack.org/621856 | 14:18 |
| *** rodolof has quit IRC | 14:19 | |
| *** rodolof has joined #openstack-nova | 14:19 | |
| openstackgerrit | Matt Riedemann proposed openstack/nova stable/queens: Create BDMs/tags in cell with instance when over-quota https://review.openstack.org/623934 | 14:20 |
| mriedem | lyarwood: ready for you https://review.openstack.org/#/q/topic:bug/1806064+branch:stable/queens | 14:22 |
| mriedem | gibi: do you remember why we don't include tags in the instance payload in versioned notifications? | 14:22 |
| mriedem | i guess it's on instance create and update, but not the regular action paylodas | 14:23 |
| mriedem | *payloads | 14:23 |
| *** _alastor_ has joined #openstack-nova | 14:24 | |
| gibi | mriedem: maybe because they doesn't change in other cases | 14:25 |
| *** awaugama has joined #openstack-nova | 14:28 | |
| *** _alastor_ has quit IRC | 14:28 | |
| *** pchavva has joined #openstack-nova | 14:29 | |
| *** udesale has joined #openstack-nova | 14:33 | |
| gibi | mriedem: maybe this helps remebering https://review.openstack.org/#/c/407228/36/nova/notifications/objects/instance.py@119 | 14:35 |
| jangutter | mriedem: thanks, and it's Kandarian, not Greek. Sincere sympathies and hope your soul remains intact. | 14:36 |
| gibi | mriedem: I think we wanted to avoid some lazy load issues | 14:36 |
| *** rodolof has quit IRC | 14:37 | |
| *** rodolof has joined #openstack-nova | 14:37 | |
| *** mlavalle has joined #openstack-nova | 14:37 | |
| *** rodolof has quit IRC | 14:38 | |
| *** rodolof has joined #openstack-nova | 14:38 | |
| *** mvkr has joined #openstack-nova | 14:44 | |
| mriedem | gibi: yeah i figured that was the reason | 14:53 |
| mriedem | and we could add it in later if someone needed it | 14:53 |
| gibi | mriedem: yeah, it is not hard to add | 14:53 |
| mriedem | reminds me i have an old patch to optimize the instance tags creation stuff since we do a lot of unnecessary db stuff | 14:53 |
| gibi | mriedem: btw vitrage has a patch up to consume nova versioned notifications | 14:53 |
| gibi | mriedem: so we will have one modul that trasition from legacy to versioned | 14:54 |
| mriedem | cool - are they migrating from legacy or adding versioned from scratch? | 14:54 |
| mriedem | ah ok | 14:54 |
| gibi | mriedem: https://review.openstack.org/#/c/623274/ | 14:54 |
| *** cfriesen has joined #openstack-nova | 14:58 | |
| *** eharney has joined #openstack-nova | 15:00 | |
| *** markvoelker has joined #openstack-nova | 15:00 | |
| *** psachin has quit IRC | 15:05 | |
| openstackgerrit | Matt Riedemann proposed openstack/nova stable/pike: Add functional regression test for bug 1806064 https://review.openstack.org/623935 | 15:06 |
| openstack | bug 1806064 in OpenStack Compute (nova) queens "Volume remains in attaching/reserved status, if the instance is deleted after TooManyInstances exception in nova-conductor" [Medium,In progress] https://launchpad.net/bugs/1806064 - Assigned to Matt Riedemann (mriedem) | 15:06 |
| *** itlinux has quit IRC | 15:06 | |
| openstackgerrit | Matt Riedemann proposed openstack/nova stable/pike: Create BDMs/tags in cell with instance when over-quota https://review.openstack.org/623937 | 15:10 |
| openstackgerrit | Matt Riedemann proposed openstack/nova stable/pike: Create BDMs/tags in cell with instance when over-quota https://review.openstack.org/623937 | 15:10 |
| *** Luzi has quit IRC | 15:12 | |
| mriedem | dansmith: looks like https://review.openstack.org/#/c/623282/ last failed on the test added, | 15:12 |
| mriedem | so we likely need to reset the global somewhere more....global | 15:12 |
| mriedem | maybe in the test setUp? | 15:12 |
| mriedem | or in the base TestCase setup where we reset other globals? | 15:12 |
| dansmith | mriedem: ah, I applied a fix for that to the next patch by accident I think | 15:13 |
| dansmith | I don't think we need to reset it anywhere other than just in that test | 15:13 |
| stephenfin | sean-k-mooney: RE: https://bugs.launchpad.net/nova/+bug/1805891, this is where things break down https://github.com/openstack/nova/blob/master/nova/compute/resource_tracker.py#L209-L210 | 15:14 |
| openstack | Launchpad bug 1805891 in OpenStack Compute (nova) "pci numa polices are not followed" [High,Triaged] - Assigned to sean mooney (sean-k-mooney) | 15:14 |
| stephenfin | Looks like we're not persisting that field in the DB :-\ | 15:15 |
| openstackgerrit | Dan Smith proposed openstack/nova master: Only warn about not having computes nodes once in rpcapi https://review.openstack.org/623282 | 15:16 |
| openstackgerrit | Dan Smith proposed openstack/nova master: Make compute rpcapi version calculation check all cells https://review.openstack.org/623284 | 15:16 |
| openstackgerrit | Dan Smith proposed openstack/nova master: Make service.get_minimum_version_all_cells() cache the results https://review.openstack.org/623283 | 15:16 |
| dansmith | mriedem: moved that down a patch, mah bad | 15:16 |
| *** oanson has joined #openstack-nova | 15:17 | |
| mriedem | ack | 15:18 |
| *** eharney_ has joined #openstack-nova | 15:23 | |
| *** bhdn has quit IRC | 15:23 | |
| *** eharney has quit IRC | 15:26 | |
| openstackgerrit | Chris Dent proposed openstack/nova master: Add python 3.7 unit and functional tox jobs https://review.openstack.org/624055 | 15:26 |
| cdent | gibi: there are some functional test failures related to waiting for notifications in ^ | 15:26 |
| *** rodolof has quit IRC | 15:27 | |
| *** eharney_ is now known as eharney | 15:27 | |
| cdent | dansmith, mriedem: that ^ fixes some unit test failures in py37 and a real issue in the multi cell query stuff with StopIteration | 15:27 |
| *** rodolof has joined #openstack-nova | 15:27 | |
| *** ircuser-1 has joined #openstack-nova | 15:28 | |
| gibi | cdent: ack | 15:28 |
| cdent | gibi: I haven't investigate the failures closely yet, but I'm assuming some kind of deadlock | 15:28 |
| gibi | cdent: I made a note to look at it at some point | 15:29 |
| mriedem | moar jubz | 15:29 |
| gibi | cdent: is it in PS3 as PS2 passed the functional jobs | 15:29 |
| mriedem | is there a tl;dr from the tc on when we're going to stop running 20 different python unit test/functional jobs per change? | 15:29 |
| cdent | mriedem: i have it on good authority from clarkb that unit test jobs are not "the problem" | 15:29 |
| mriedem | we still have race failures in py jobs that reset the gate | 15:30 |
| mriedem | http://status.openstack.org/elastic-recheck/#1793364 | 15:30 |
| mriedem | http://status.openstack.org/elastic-recheck/#1800472 | 15:30 |
| mriedem | just wondering if at some point py27 goes to experimental queue or something, and py35 gets dropped | 15:30 |
| cdent | mriedem: heh, on the tl;dr: I'm not really sure as I lost interest when "stop running 20 different..." was taken off the table | 15:30 |
| cdent | I, perhaps, wanted somethign a bit too aggressive: one distro, one python version | 15:31 |
| cdent | but you know | 15:31 |
| cdent | <- me | 15:31 |
| cdent | mriedem: anyway, if we don't want another gate job, that's fine, but we still need the tox jobs and the bug fixes are real (and backwards compatible) | 15:31 |
| mriedem | i'm just not sure why we couldn't move py27 stuff to experimental, | 15:31 |
| mriedem | so we can test fixes for py27, but not gate on it for every change | 15:31 |
| mriedem | sure i'm just in this mindset about the broken gate | 15:32 |
| *** munimeha1 has joined #openstack-nova | 15:32 | |
| * cdent nods | 15:32 | |
| cdent | in the discussions that I was party to, people were wed to this notion of "testing what people are using (now)" rather than "testing what people will be using when the code is released" | 15:32 |
| cdent | given the former, 2.7 matters | 15:33 |
| *** wwriverrat has quit IRC | 15:33 | |
| *** bhdn has joined #openstack-nova | 15:33 | |
| cdent | mriedem: I'd be super keen on moving 2.7 to experimental | 15:34 |
| mriedem | commented in the change | 15:34 |
| mriedem | you can say to your tc buddies, "the troll hath spoken in my patch" | 15:34 |
| mriedem | if 2.7 matters, can we decide which of the 20 py3 versions matters? | 15:35 |
| mriedem | and move the others to experimental? | 15:35 |
| mriedem | speaking of gate bug fixes, need another +2 on https://review.openstack.org/#/c/615347 | 15:36 |
| *** ivve has joined #openstack-nova | 15:37 | |
| *** tbachman has quit IRC | 15:38 | |
| *** k_mouza has quit IRC | 15:38 | |
| coreycb | cdent: will placement be removed from nova in stein? | 15:39 |
| cdent | coreycb: that's the goal, yes | 15:39 |
| cdent | coreycb: that's part of what is driving the goals in http://lists.openstack.org/pipermail/openstack-dev/2018-September/134541.html | 15:40 |
| coreycb | cdent: ok. I just won't be able to get the new placment package into main (ie. get security support etc) until it's removed from nova. | 15:40 |
| cdent | coreycb: depending on who you talk to, we're relatively close | 15:40 |
| coreycb | cdent: ok :) | 15:41 |
| cdent | this needs to merge https://review.openstack.org/#/c/617941/ and then it's child can be considered | 15:41 |
| coreycb | cdent: seems pretty close if that's the case. thanks, I'll keep an eye on it. | 15:42 |
| cdent | thank you | 15:44 |
| openstackgerrit | Merged openstack/nova stable/queens: Add functional regression test for bug 1806064 https://review.openstack.org/623933 | 15:45 |
| openstack | bug 1806064 in OpenStack Compute (nova) queens "Volume remains in attaching/reserved status, if the instance is deleted after TooManyInstances exception in nova-conductor" [Medium,In progress] https://launchpad.net/bugs/1806064 - Assigned to Matt Riedemann (mriedem) | 15:45 |
| openstackgerrit | Silvan Kaiser proposed openstack/nova master: Exec systemd-run without --user flag in Quobyte driver https://review.openstack.org/554195 | 15:46 |
| *** Gaasmann has joined #openstack-nova | 15:46 | |
| cdent | melwitt: I've proposed some gerrit acl config changes to os-resource-classes and os-traits in https://review.openstack.org/624387 which will need your +1 (if you're in fact +1). The justification is effectively: why wait? | 15:48 |
| *** k_mouza has joined #openstack-nova | 15:50 | |
| mriedem | huh, this would probably be annoying for anyone pointing nova-api at cell0 for [database]/connection http://logstash.openstack.org/#dashboard/file/logstash.json?query=message%3A%5C%22The%20nova-osapi_compute%20service%20version%20is%20from%20before%20Ocata%5C%22%20AND%20tags%3A%5C%22screen-n-api.txt%5C%22&from=7d | 15:53 |
| *** wolverineav has joined #openstack-nova | 15:54 | |
| *** markvoelker has quit IRC | 15:55 | |
| *** markvoelker has joined #openstack-nova | 15:56 | |
| *** wolverineav has quit IRC | 15:58 | |
| mriedem | dansmith: looks like something must have regressed this recently since we're seeing it in master and queens only http://logs.openstack.org/82/623282/2/check/tempest-full/0a4f66a/controller/logs/screen-n-api.txt.gz?level=WARNING#_Dec_11_06_09_01_928385 - not sure why tests aren't failing though, since when we hit that warning we are pulling instances from cell0 and not even looking for an instance mapping | 15:59 |
| ShilpaSD | gibi: Hi | 16:00 |
| *** markvoelker has quit IRC | 16:01 | |
| dansmith | mriedem: hmm, with creating the record or looking for them I wonder? | 16:02 |
| mriedem | don't really understand since nova-osapi_compute service should be created in the cell0 db here https://github.com/openstack/nova/blob/master/nova/api/openstack/wsgi_app.py#L59 | 16:04 |
| *** k_mouza has quit IRC | 16:05 | |
| mriedem | and that would use https://github.com/openstack/nova/blob/master/nova/objects/service.py#L219 | 16:05 |
| *** tbachman has joined #openstack-nova | 16:06 | |
| *** k_mouza has joined #openstack-nova | 16:08 | |
| *** ccamacho has quit IRC | 16:09 | |
| mriedem | wtf, same request, we lookup the instance twice, first time we don't get that warning | 16:09 |
| mriedem | http://logs.openstack.org/82/623282/2/check/tempest-full/0a4f66a/controller/logs/screen-n-api.txt.gz#_Dec_11_06_09_01_468549 | 16:09 |
| mriedem | 2nd time we do http://logs.openstack.org/82/623282/2/check/tempest-full/0a4f66a/controller/logs/screen-n-api.txt.gz#_Dec_11_06_09_01_919760 | 16:10 |
| openstackgerrit | Chris Dent proposed openstack/nova master: Add python 3.7 unit and functional tox jobs https://review.openstack.org/624055 | 16:10 |
| cdent | made 3.7 experimental | 16:11 |
| *** trinaths has left #openstack-nova | 16:11 | |
| *** munimeha1 has quit IRC | 16:11 | |
| *** udesale has quit IRC | 16:14 | |
| *** rodolof has quit IRC | 16:15 | |
| *** rodolof has joined #openstack-nova | 16:16 | |
| *** moshele has quit IRC | 16:17 | |
| *** itlinux has joined #openstack-nova | 16:22 | |
| *** rodolof has quit IRC | 16:23 | |
| *** rodolof has joined #openstack-nova | 16:24 | |
| openstackgerrit | Balazs Gibizer proposed openstack/nova master: Ensure that allocated PF matches the used PF https://review.openstack.org/623543 | 16:29 |
| openstackgerrit | Matt Riedemann proposed openstack/nova master: DNM: debug old compute API service version lookup https://review.openstack.org/624438 | 16:32 |
| mriedem | dansmith: comments/questions for your patch here https://review.openstack.org/#/c/623284/ | 16:34 |
| cdent | mriedem: do you have a working theory on ^^ or is it mostly fishing at this point | 16:34 |
| mriedem | cdent: fishing | 16:34 |
| mriedem | i'm surprised it doesn't break the gate | 16:34 |
| mriedem | it == the api thinking we have old api services and looking up instances from cell0 rather than the actual cell they are in | 16:35 |
| mriedem | unless coincidentally those instances *are* in cell0 | 16:35 |
| mriedem | or tempest just doesn't care about a 404 | 16:36 |
| openstackgerrit | Jack Ding proposed openstack/nova-specs master: Select cpu model from a list of cpu models https://review.openstack.org/620959 | 16:37 |
| cdent | mriedem: ah, okay, so you're going to log all the service creations to fill in some blanks: who is doing this!? roger | 16:39 |
| mriedem | yeah | 16:39 |
| cdent | good luck | 16:40 |
| cdent | i'm trying to get the mysql opportunistic to fail, but struggling | 16:40 |
| *** sean-k-mooney has quit IRC | 16:43 | |
| dansmith | mriedem: replied | 16:43 |
| *** rodolof has quit IRC | 16:44 | |
| *** rodolof has joined #openstack-nova | 16:44 | |
| *** sean-k-mooney has joined #openstack-nova | 16:49 | |
| *** macza has joined #openstack-nova | 16:49 | |
| *** eharney has quit IRC | 16:51 | |
| *** itlinux_ has joined #openstack-nova | 16:59 | |
| *** itlinux has quit IRC | 17:03 | |
| mdbooth | mriedem: Here's an interesting thing. You noted the other day that setting created_disks = False doesn't make the evacuate tests fail. After working it through it turns out that's correct behaviour for all 4 cases, and if you want to make that fail something you'd need to make the initial spawn() fail instead... Except that a spawn failure actually calls cleanup *twice*. | 17:03 |
| mdbooth | Basically I added a similar functional test making spawn fail instead, and I was trying to debug why my Rbd disks were being deleted anyway when I was setting created_disks = False. | 17:04 |
| openstackgerrit | Stephen Finucane proposed openstack/nova master: Fix typo https://review.openstack.org/624442 | 17:05 |
| mdbooth | It's because we call _shutdown_instance() in ComputeManager, which calls driver.destroy() | 17:05 |
| mdbooth | mriedem: Which leaves that code in a weird limbo. | 17:05 |
| mdbooth | That is, the code ensures the correct behaviour of _cleanup_failed_start(), but it's irrelevant because we call it again anyway. | 17:06 |
| *** moshele has joined #openstack-nova | 17:07 | |
| *** eharney has joined #openstack-nova | 17:07 | |
| *** sahid has quit IRC | 17:08 | |
| *** tssurya has quit IRC | 17:08 | |
| * mriedem head explodes | 17:10 | |
| mdbooth | mriedem: Yeah. | 17:10 |
| mriedem | my goal is to add tests that don't pass without the code fix, | 17:10 |
| mriedem | so however that needs to happen... | 17:10 |
| mdbooth | mriedem: That's kinda the thing. I wrote those, but because the code structure is weird they still didn't fail. However, if you took the code out, the resulting code would be fragile. | 17:11 |
| openstackgerrit | Stephen Finucane proposed openstack/nova master: objects: Store InstancePCIRequest.numa_policy in DB https://review.openstack.org/624444 | 17:11 |
| openstackgerrit | Stephen Finucane proposed openstack/nova master: conf: Call out where pci.alias should be set https://review.openstack.org/624445 | 17:11 |
| stephenfin | sean-k-mooney: ^ | 17:11 |
| mdbooth | mriedem: Explaining why you *didn't* include the code would involve understanding ^^^ | 17:11 |
| mdbooth | And nobody wants to do that | 17:11 |
| stephenfin | I feel like a moron. I've no idea what I did to miss that the first day | 17:11 |
| mdbooth | mriedem: I'll have another go at it tomorrow. | 17:12 |
| *** moshele has quit IRC | 17:13 | |
| *** helenafm has quit IRC | 17:18 | |
| openstackgerrit | Jack Ding proposed openstack/nova master: Improve libvirt image and snapshot handling https://review.openstack.org/616692 | 17:19 |
| *** ohorecny2 has quit IRC | 17:20 | |
| openstackgerrit | Jack Ding proposed openstack/nova master: Correct instance port binding for rebuilds/reboots https://review.openstack.org/603844 | 17:20 |
| *** gyee has joined #openstack-nova | 17:22 | |
| jackding | hi mriedem: could you revisit https://review.openstack.org/#/c/616692/ and https://review.openstack.org/#/c/603844/ when you got a chance? | 17:23 |
| sean-k-mooney | stephenfin: isnt the alais ment to be set in the schduler not the api | 17:23 |
| stephenfin | sean-k-mooney: Nope, https://github.com/openstack/nova/blob/master/nova/compute/api.py#L815-L816 | 17:26 |
| stephenfin | It's nova-api that converts the flavor extra spec to an InstancePCIRequests object | 17:27 |
| *** k_mouza has quit IRC | 17:27 | |
| sean-k-mooney | ok | 17:27 |
| stephenfin | and unfortunately also the resource tracker, hence nova-compute https://github.com/openstack/nova/blob/master/nova/compute/resource_tracker.py#L307-L309 | 17:28 |
| sean-k-mooney | i knew this had to be set on the controller but i jsut assumed it was teh scduelr that read it | 17:28 |
| sean-k-mooney | if its the api that is fine as long as operators know that too | 17:28 |
| sean-k-mooney | the resouce tracker should not need the alias definion | 17:29 |
| sean-k-mooney | at least not in the compute agent config | 17:29 |
| sean-k-mooney | uhg | 17:30 |
| stephenfin | Yup, it's icky | 17:30 |
| sean-k-mooney | damit it does | 17:30 |
| sean-k-mooney | that is defintely not documented | 17:30 |
| stephenfin | It actually is https://docs.openstack.org/nova/latest/admin/pci-passthrough.html#configure-pci-devices-compute | 17:31 |
| stephenfin | But it's hidden | 17:31 |
| stephenfin | sort of | 17:31 |
| stephenfin | "From the Newton release, to resize guest with PCI device, configure the PCI alias on the compute node as well." | 17:31 |
| sean-k-mooney | stephenfin: the whitelist should be set on the compute and alais on the contoller that is how i have understood it was ment to work | 17:31 |
| stephenfin | Me too | 17:32 |
| sean-k-mooney | your updating the config docs mind patching https://docs.openstack.org/nova/latest/admin/pci-passthrough.html#configure-pci-devices-compute to make that bold | 17:33 |
| *** rodolof has quit IRC | 17:33 | |
| *** rodolof has joined #openstack-nova | 17:33 | |
| sean-k-mooney | luckally i was seting it on all nodes just because i adapted my controler local.conf into my compute node one | 17:34 |
| sean-k-mooney | stephenfin: speaking of which do you have 2 node capably of sriov or one? | 17:34 |
| stephenfin | sean-k-mooney: Can do, and I only have one | 17:35 |
| sean-k-mooney | ok i have spent most of the day debuging a netwrokg issue | 17:35 |
| sean-k-mooney | im going to need to use a node inbetween my current 2 nodes to sniff packets and see which side is broken | 17:36 |
| sean-k-mooney | adrianc: FYI at least on my hardware the sriov live migration patches are not working correctly | 17:37 |
| adrianc | sean-k-mooney: what are you seeing ? | 17:38 |
| sean-k-mooney | adrianc: after migrating the vm unicast packet from the source node to the vm are droped | 17:39 |
| sean-k-mooney | in my case i have an all in one node and a compute node | 17:39 |
| sean-k-mooney | the vm started on teh all-in-one node and i migrated it to the compute-only node | 17:40 |
| openstackgerrit | Matt Riedemann proposed openstack/nova master: Handle tags in _bury_in_cell0 https://review.openstack.org/621856 | 17:40 |
| adrianc | sean-k-mooney: on the source the VF used for macVtap has MAC address of zero ? | 17:40 |
| sean-k-mooney | i can see the packets being transmited with tshark on teh all-in-one node but they are not recived on the destination | 17:41 |
| sean-k-mooney | adrianc: ill check it not set to the vm mac any more but not sure its 0 | 17:41 |
| sean-k-mooney | adrianc: its set to ba:2a:94:20:f7:ba | 17:42 |
| sean-k-mooney | the vm mac is fa:16:3e:0e:87:08 | 17:42 |
| adrianc | sean-k-mooney: so not an openstack VM MAC | 17:42 |
| sean-k-mooney | correct | 17:43 |
| adrianc | sean-k-mooney: mac appears well set on destination VF ? | 17:43 |
| sean-k-mooney | yep both the macvtap and the dest vf have the mac set | 17:43 |
| sean-k-mooney | if i reboot the vm the dhcp request from the vm is recived on the other node and it replys | 17:44 |
| adrianc | sean-k-mooney: so the code does what its suppose to do :) now need to figure out the issue | 17:44 |
| sean-k-mooney | however the unicast dhcp offer is transmitted on the all-in-one node but not recived on the compute | 17:44 |
| sean-k-mooney | well you can live migrate back and forth | 17:45 |
| sean-k-mooney | if i migate the vm back the networking works agiag | 17:45 |
| adrianc | sean-k-mooney: mmmm, maybe mac is still in FDB on the source ? | 17:45 |
| sean-k-mooney | adrianc: i checked with bridge fdb show and no | 17:46 |
| sean-k-mooney | it is actully never there | 17:46 |
| *** ralonsoh has quit IRC | 17:46 | |
| sean-k-mooney | the ipv6 multicast mac is set on the host that has the vm 33:33:ff:0e:87:08 | 17:46 |
| sean-k-mooney | but fa:16:3e:0e:87:08 never show up in bridge fdb show either when the vm is sawned or before or after migration | 17:48 |
| adrianc | sean-k-mooney: let me try to repro on my setup | 17:48 |
| sean-k-mooney | adrianc: sure no worries im going to grab something to eat | 17:52 |
| adrianc | sean-k-mooney: probably some minor tweaking needed (i hope) my setup seems busted, ill take a look tomorrow (20:00 here) | 17:54 |
| sean-k-mooney | adrianc: fyi if i assign an ip on the same subnet to the pf i can ping the vm on the host its on | 17:54 |
| sean-k-mooney | adrianc: sure no worries | 17:54 |
| openstackgerrit | Chris Dent proposed openstack/os-resource-classes master: Initial automated testing for os-resource-classes https://review.openstack.org/624366 | 17:54 |
| openstackgerrit | Chris Dent proposed openstack/os-resource-classes master: Rename ORDERED_CLASSES to STANDARDS https://review.openstack.org/624369 | 17:54 |
| openstackgerrit | Chris Dent proposed openstack/os-resource-classes master: Sync STANDARDS with placement/nova rc_fields https://review.openstack.org/624370 | 17:54 |
| openstackgerrit | Chris Dent proposed openstack/os-resource-classes master: Tune up documentation to be more useful https://review.openstack.org/624384 | 17:55 |
| adrianc | bon appetit | 17:55 |
| *** lpetrut has quit IRC | 17:56 | |
| *** gyee has quit IRC | 17:56 | |
| *** sridharg has quit IRC | 17:56 | |
| *** rodolof has quit IRC | 17:58 | |
| *** mchlumsky has quit IRC | 17:59 | |
| *** rodolof has joined #openstack-nova | 17:59 | |
| *** derekh has quit IRC | 18:00 | |
| *** k_mouza has joined #openstack-nova | 18:02 | |
| *** mchlumsky has joined #openstack-nova | 18:03 | |
| *** moshele has joined #openstack-nova | 18:04 | |
| *** mvkr has quit IRC | 18:04 | |
| *** k_mouza has quit IRC | 18:06 | |
| *** davidsha has quit IRC | 18:06 | |
| *** dtantsur is now known as dtantsur|afk | 18:07 | |
| *** Swami has joined #openstack-nova | 18:09 | |
| *** sridharg has joined #openstack-nova | 18:13 | |
| *** brault has joined #openstack-nova | 18:14 | |
| *** wolverineav has joined #openstack-nova | 18:19 | |
| *** brault has quit IRC | 18:19 | |
| *** _alastor_ has joined #openstack-nova | 18:22 | |
| *** wolverineav has quit IRC | 18:24 | |
| *** wolverineav has joined #openstack-nova | 18:26 | |
| *** wolverineav has quit IRC | 18:27 | |
| *** wolverineav has joined #openstack-nova | 18:27 | |
| *** sridharg has quit IRC | 18:34 | |
| *** moshele has quit IRC | 18:35 | |
| *** sorrison has quit IRC | 18:47 | |
| *** sorrison has joined #openstack-nova | 18:48 | |
| *** _alastor_ has quit IRC | 18:53 | |
| *** sridharg has joined #openstack-nova | 18:58 | |
| *** _alastor_ has joined #openstack-nova | 18:59 | |
| *** mchlumsky has quit IRC | 19:00 | |
| *** mchlumsky has joined #openstack-nova | 19:01 | |
| *** cdent has quit IRC | 19:04 | |
| *** wolverineav has quit IRC | 19:09 | |
| *** wolverineav has joined #openstack-nova | 19:10 | |
| melwitt | mriedem: not sure what you'll think of this, workaround for non-shared instance dirs not being cleaned up during evacuate with ceph https://review.openstack.org/618478 | 19:12 |
| *** sridharg has quit IRC | 19:12 | |
| *** sridharg has joined #openstack-nova | 19:15 | |
| *** _alastor_ has quit IRC | 19:25 | |
| *** igordc has joined #openstack-nova | 19:25 | |
| *** lbragstad has quit IRC | 19:30 | |
| mriedem | melwitt: i think it's ugly | 19:31 |
| *** lbragstad has joined #openstack-nova | 19:31 | |
| mriedem | comments inline anyway | 19:32 |
| melwitt | I think it's ugly too, which is why I've struggled with it | 19:32 |
| melwitt | I can't think of another way to handle it in a backportable way | 19:32 |
| *** moshele has joined #openstack-nova | 19:34 | |
| *** wolverineav has quit IRC | 19:37 | |
| *** moshele has quit IRC | 19:38 | |
| *** sridharg has quit IRC | 19:38 | |
| *** munimeha1 has joined #openstack-nova | 19:40 | |
| *** wolverineav has joined #openstack-nova | 19:46 | |
| openstackgerrit | Merged openstack/nova stable/queens: Create BDMs/tags in cell with instance when over-quota https://review.openstack.org/623934 | 19:47 |
| *** wolverineav has quit IRC | 19:48 | |
| *** wolverineav has joined #openstack-nova | 19:49 | |
| openstackgerrit | Matt Riedemann proposed openstack/nova master: DNM: add debug logging for bug 1807723 https://review.openstack.org/624181 | 19:50 |
| openstack | bug 1807723 in OpenStack Compute (nova) "swap multiattach volume intermittently fails when servers are on different hosts" [Medium,Confirmed] https://launchpad.net/bugs/1807723 | 19:50 |
| *** macza has quit IRC | 19:51 | |
| *** macza has joined #openstack-nova | 19:53 | |
| *** wolverineav has quit IRC | 19:58 | |
| *** tbachman has quit IRC | 20:01 | |
| *** erlon has quit IRC | 20:04 | |
| *** codyhill has joined #openstack-nova | 20:10 | |
| melwitt | mriedem, dansmith, gibi: there's a proposal to switch the os-traits, os-resource-classes, and osc-placement projects to use the placement.config gerrit acls here https://review.openstack.org/624387 to add your opinion if you have one | 20:12 |
| codyhill | Hello folks. I was working with the #openstack-ironic folks about trying to get vendor_data.json to work with baremetal deployments with Nova and Ironic. So far the issue i’m having is that cloud-init doesn’t seem to “Discover” the baremetal node as an OpenStack Datasource. So it runs the generice EC2 setup. Which doesn’t include vendor_data.json. The recomendation from the folks in #openstack-ironic was to try and use config drive. And it | 20:13 |
| codyhill | looks like the config-drive doesn’t write the vendor_data.json to the config-drive. Any help would be great. | 20:13 |
| *** sambetts_ has quit IRC | 20:14 | |
| mriedem | melwitt: isn't the only difference the core team at this point? | 20:15 |
| mriedem | which right now is a difference of cdent and tetsuro in placement-core | 20:15 |
| melwitt | yeah | 20:15 |
| mriedem | ok voted | 20:17 |
| melwitt | thanks | 20:17 |
| *** sambetts_ has joined #openstack-nova | 20:17 | |
| *** mriedem has quit IRC | 20:22 | |
| *** mriedem has joined #openstack-nova | 20:24 | |
| codyhill | To add a little more info to my situation. I am running OpenStack Newton. And I’m using static Vendor Data (not dynamic). | 20:30 |
| *** pchavva has quit IRC | 20:33 | |
| *** eharney has quit IRC | 20:34 | |
| *** wolverineav has joined #openstack-nova | 20:36 | |
| mriedem | codyhill: and you have vendordata_jsonfile_path set properly in nova.conf for the nova-compute service? | 20:36 |
| *** wolverineav has quit IRC | 20:36 | |
| mriedem | https://docs.openstack.org/newton/config-reference/compute/config-options.html | 20:36 |
| *** wolverineav has joined #openstack-nova | 20:36 | |
| mriedem | and you have vendordata_providers = StaticJson? | 20:37 |
| mriedem | *StaticJSON | 20:37 |
| mriedem | i think either of those will work | 20:40 |
| mriedem | but building the config driver happens on the nova-compute host | 20:40 |
| mriedem | not the api node | 20:40 |
| mriedem | *config drive | 20:40 |
| codyhill | mriedem: I havn’t touched nove_compute. only nove API | 20:40 |
| codyhill | Let me try that. | 20:40 |
| mriedem | as for ironic, i'm not sure what support the ironic driver had for config drive in newton | 20:41 |
| mriedem | but yeah my guess is since vendordata_jsonfile_path isn't set in nova.conf on nova-compute it's just not serving anything up | 20:41 |
| *** eharney has joined #openstack-nova | 20:49 | |
| codyhill | mriedem: Thanks for your help. I’ll give this a shot. (I’m in a meeting right now) But i’ll report my findings in about an hour. | 20:49 |
| mriedem | good luck | 20:50 |
| *** sambetts_ has quit IRC | 20:52 | |
| *** sambetts_ has joined #openstack-nova | 20:54 | |
| openstackgerrit | Merged openstack/nova stable/queens: Move the nova-next job in-tree and update it https://review.openstack.org/620777 | 20:55 |
| openstackgerrit | Merged openstack/nova stable/queens: Test websocketproxy with TLS in the nova-next job https://review.openstack.org/620776 | 20:55 |
| openstackgerrit | Merged openstack/nova stable/queens: Make the nova-next job voting and gating https://review.openstack.org/620888 | 20:55 |
| *** rodolof has quit IRC | 21:01 | |
| *** rodolof has joined #openstack-nova | 21:01 | |
| openstackgerrit | Matt Riedemann proposed openstack/nova master: DNM: debug old compute API service version lookup https://review.openstack.org/624438 | 21:08 |
| *** mvkr has joined #openstack-nova | 21:18 | |
| melwitt | mriedem: I noticed you have commented "recheck slow node" on some patches and was wondering, are you categorizing a failure to boot due to a timeout waiting for network-vif-plugged as that? example: http://logs.openstack.org/35/575735/4/gate/tempest-slow/7e5803b/controller/logs/screen-n-cpu.txt.gz#_Dec_11_16_33_46_458364 | 21:25 |
| mriedem | network-vif-plugged takes about 5 seconds | 21:26 |
| mriedem | so if we timeout because we ddn't get that after 5 minutes, we likely screwed up somewhere | 21:26 |
| mriedem | and rax isn't the slow nodes | 21:26 |
| melwitt | ok | 21:26 |
| melwitt | I'll check if neutron sent it. if so, we probably have another race or issue where we get the event before we start waiting or something | 21:27 |
| mriedem | note 2 seconds before that a vif is unplugged http://logs.openstack.org/35/575735/4/gate/tempest-slow/7e5803b/controller/logs/screen-n-cpu.txt.gz#_Dec_11_16_33_44_406723 | 21:28 |
| mriedem | there are a bunch of unplugged vif messages for that same request | 21:29 |
| mriedem | this is the timeout waiting for network-vif-plugged | 21:29 |
| mriedem | http://logs.openstack.org/35/575735/4/gate/tempest-slow/7e5803b/controller/logs/screen-n-cpu.txt.gz#_Dec_11_16_33_43_583022 | 21:29 |
| melwitt | yeah, I saw that. I thought maybe it's some cleanup it does in response to the timeout (the _cleanup_failed_start routine) | 21:29 |
| melwitt | unplugs all the vifs and then raises VirtualInterfaceCreateException | 21:30 |
| mriedem | looks like this is the first plug | 21:30 |
| mriedem | http://logs.openstack.org/35/575735/4/gate/tempest-slow/7e5803b/controller/logs/screen-n-cpu.txt.gz#_Dec_11_16_28_41_912716 | 21:30 |
| mriedem | which is 5 minutes before | 21:30 |
| mriedem | likely yes, spawn() times out, unplugs vifs, meanwhile tempest is also timing out and destroying the instance concurrently which is doing its own unplugs | 21:31 |
| mriedem | jesus does that test really plug 7 ports to the same vm? | 21:31 |
| mriedem | Dec 11 16:33:43.583022 ubuntu-xenial-rax-iad-0001127841 nova-compute[368]: WARNING nova.virt.libvirt.driver [None req-8a094b29-c0e9-445c-848e-3c827f681858 tempest-TaggedBootDevicesTest-731133270 tempest-TaggedBootDevicesTest-731133270] [instance: 01e6b7fe-bfa0-4d51-bcdf-03e65971ed74] Timeout waiting for [('network-vif-plugged', u'c1777114-78f7-4533-8725-d01139d29c02'), ('network-vif-plugged', u'caade525-9701-47b4-a5d1-bc11076 | 21:32 |
| mriedem | 5'), ('network-vif-plugged', u'a5b3eb7e-696c-4870-abf1-b3ee43545dbe'), ('network-vif-plugged', u'ede8a324-5ed5-4737-bf6c-1b2f21b4f090'), ('network-vif-plugged', u'99e00244-9a75-4a25-9742-5c67b86ba0b2'), ('network-vif-plugged', u'11c3d630-37f4-4fd3-ba88-8355f7253ea6'), ('network-vif-plugged', u'05bb2644-68b1-4f07-a44e-f2277b444792')] for instance with vm_state building and task_state spawning.: Timeout: 300 seconds | 21:32 |
| mriedem | Dec 11 16:28:45.973940 ubuntu-xenial-rax-iad-0001127841 nova-compute[368]: DEBUG nova.compute.manager [req-9fb4fde1-0cb0-4896-b0c3-5f8535a0fbd1 req-17f33770-c6cf-4fef-ade4-72fab2d05def service nova] [instance: 01e6b7fe-bfa0-4d51-bcdf-03e65971ed74] Processing event network-vif-plugged-caade525-9701-47b4-a5d1-bc11076c47f5 {{(pid=368) _process_instance_event /opt/stack/nova/nova/compute/manager.py:7952}} | 21:32 |
| melwitt | I wasn't sure, I'm not that familiar with the tagged devices test. I didn't get that far yet | 21:33 |
| mriedem | artom wrote it | 21:33 |
| mriedem | Dec 11 16:28:48.063359 ubuntu-xenial-rax-iad-0001127841 nova-compute[368]: DEBUG nova.compute.manager [req-4f071ef5-d1a5-4cfb-820b-2d562666e534 req-86897002-4096-4477-a6ae-19515f45c40f service nova] [instance: 01e6b7fe-bfa0-4d51-bcdf-03e65971ed74] Processing event network-vif-plugged-a5b3eb7e-696c-4870-abf1-b3ee43545dbe {{(pid=368) _process_instance_event /opt/stack/nova/nova/compute/manager.py:7952}} | 21:33 |
| mriedem | Dec 11 16:28:48.059696 ubuntu-xenial-rax-iad-0001127841 nova-compute[368]: DEBUG nova.compute.manager [req-4f071ef5-d1a5-4cfb-820b-2d562666e534 req-86897002-4096-4477-a6ae-19515f45c40f service nova] [instance: 01e6b7fe-bfa0-4d51-bcdf-03e65971ed74] Processing event network-vif-plugged-ede8a324-5ed5-4737-bf6c-1b2f21b4f090 {{(pid=368) _process_instance_event /opt/stack/nova/nova/compute/manager.py:7952}} | 21:33 |
| mriedem | Dec 11 16:28:48.061523 ubuntu-xenial-rax-iad-0001127841 nova-compute[368]: DEBUG nova.compute.manager [req-4f071ef5-d1a5-4cfb-820b-2d562666e534 req-86897002-4096-4477-a6ae-19515f45c40f service nova] [instance: 01e6b7fe-bfa0-4d51-bcdf-03e65971ed74] Processing event network-vif-plugged-99e00244-9a75-4a25-9742-5c67b86ba0b2 {{(pid=368) _process_instance_event /opt/stack/nova/nova/compute/manager.py:7952}} | 21:33 |
| mriedem | Dec 11 16:28:48.055772 ubuntu-xenial-rax-iad-0001127841 nova-compute[368]: DEBUG nova.compute.manager [req-4f071ef5-d1a5-4cfb-820b-2d562666e534 req-86897002-4096-4477-a6ae-19515f45c40f service nova] [instance: 01e6b7fe-bfa0-4d51-bcdf-03e65971ed74] Processing event network-vif-plugged-11c3d630-37f4-4fd3-ba88-8355f7253ea6 {{(pid=368) _process_instance_event /opt/stack/nova/nova/compute/manager.py:7952}} | 21:33 |
| mriedem | Dec 11 16:28:48.057381 ubuntu-xenial-rax-iad-0001127841 nova-compute[368]: DEBUG nova.compute.manager [req-4f071ef5-d1a5-4cfb-820b-2d562666e534 req-86897002-4096-4477-a6ae-19515f45c40f service nova] [instance: 01e6b7fe-bfa0-4d51-bcdf-03e65971ed74] Processing event network-vif-plugged-05bb2644-68b1-4f07-a44e-f2277b444792 {{(pid=368) _process_instance_event /opt/stack/nova/nova/compute/manager.py:7952}} | 21:34 |
| mriedem | looks like we got 6 of 7 | 21:34 |
| mriedem | c1777114-78f7-4533-8725-d01139d29c02 was the missing port event | 21:34 |
| melwitt | that's a lot of ports | 21:36 |
| mriedem | not for cfriesen | 21:37 |
| melwitt | haha | 21:37 |
| mriedem | cfriesen eats that many ports for f'ing breakfast | 21:38 |
| cfriesen | Kellog's Port Loops...breakfast of champions. | 21:38 |
| *** eharney has quit IRC | 21:42 | |
| openstackgerrit | Matt Riedemann proposed openstack/nova master: Remove GROUP BY clause from CellMapping.get_by_project_id https://review.openstack.org/619061 | 21:42 |
| mriedem | zzzeek: ^ updated to remove that GROUP BY, i'm doing the grouping in python - thanks for the mysql mode note on that | 21:43 |
| *** markvoelker has joined #openstack-nova | 21:45 | |
| melwitt | yup, only 6 network-vif-plugged events sent in the neutron service log matching 'network-vif-plugged', u'server_uuid': u'01e6b7fe-bfa0-4d51-bcdf-03e65971ed74 | 21:46 |
| mriedem | http://logstash.openstack.org/#dashboard/file/logstash.json?query=message%3A%5C%22TaggedBootDevicesTest%5C%22%20AND%20message%3A%5C%22Timeout%20waiting%20for%20%5B('network-vif-plugged'%5C%22%20AND%20tags%3A%5C%22screen-n-cpu.txt%5C%22&from=7d fwiw only hits on that one change | 21:47 |
| mriedem | so maybe it just got really really unlucky | 21:47 |
| melwitt | only event I find related to that port is: | 21:47 |
| melwitt | Dec 11 16:28:19.663912 ubuntu-xenial-rax-iad-0001127841 neutron-server[23986]: INFO neutron.notifiers.nova [-] Nova event response: {u'status': u'completed', u'tag': u'c1777114-78f7-4533-8725-d01139d29c02', u'name': u'network-changed', u'server_uuid': u'01e6b7fe-bfa0-4d51-bcdf-03e65971ed74', u'code': 200} | 21:47 |
| melwitt | I feel like I've seen that before, where network-changed can happen instead of network-vif-plugged. I can't remember why/how | 21:48 |
| *** markvoelker has quit IRC | 21:49 | |
| mriedem | hmm, not sure, sean-k-mooney might remember the different cases in which those events are sent | 21:51 |
| mriedem | but neutron might be doing something like, oh we're already going to send the network-changed event for this port, so don't also send it for network-vif-plugged, | 21:52 |
| mriedem | maybe the events are queued up by port_id and it gets overwritten | 21:52 |
| melwitt | yeah, could be. I'll try to remember to pick sean-k-mooney's brain about it later | 21:52 |
| melwitt | thanks for the help in looking at it | 21:53 |
| *** wolverineav has quit IRC | 21:54 | |
| *** wolverineav has joined #openstack-nova | 21:55 | |
| *** wolverineav has quit IRC | 21:55 | |
| *** wolverineav has joined #openstack-nova | 21:55 | |
| *** itlinux_ has quit IRC | 21:57 | |
| *** rcernin has joined #openstack-nova | 21:59 | |
| openstackgerrit | Matt Riedemann proposed openstack/nova master: Lazy-load SchedulerReportClient from API and drop _create_client lock https://review.openstack.org/623246 | 22:10 |
| openstackgerrit | Matt Riedemann proposed openstack/nova master: DRY up SchedulerReportClient init https://review.openstack.org/623247 | 22:10 |
| mriedem | is jay done for the year? | 22:10 |
| codyhill | mriedem: Worked! I wish I could use Metadata service for this. But it looks like that is a bug between cloud-init and ironic. But with config-drive… This works for me! Thanks for the help! | 22:11 |
| mriedem | codyhill: cool | 22:11 |
| mriedem | maybe we should update the docs somewhere to mention that you need to set the config on nova-compute if you're using config drive... | 22:12 |
| mriedem | codyhill: any suggestions there ^ to help others from beating their heads? | 22:12 |
| *** moshele has joined #openstack-nova | 22:15 | |
| *** awaugama has quit IRC | 22:21 | |
| *** markvoelker has joined #openstack-nova | 22:24 | |
| *** wolverineav has quit IRC | 22:24 | |
| *** wolverineav has joined #openstack-nova | 22:25 | |
| *** itlinux has joined #openstack-nova | 22:26 | |
| *** slaweq has quit IRC | 22:26 | |
| *** _alastor_ has joined #openstack-nova | 22:41 | |
| *** slaweq has joined #openstack-nova | 22:44 | |
| *** itlinux has quit IRC | 22:45 | |
| *** moshele has quit IRC | 22:48 | |
| *** slaweq has quit IRC | 22:48 | |
| openstackgerrit | Matt Riedemann proposed openstack/nova master: Cleanup vendordata docs https://review.openstack.org/624518 | 22:49 |
| melwitt | mriedem: he's attending the oath techpulse conference this week, says penick | 22:50 |
| openstackgerrit | Matt Riedemann proposed openstack/nova master: Cleanup vendordata docs https://review.openstack.org/624518 | 22:50 |
| mriedem | codyhill: ^ | 22:50 |
| mriedem | oh great, techpulse | 22:50 |
| mriedem | we're flatlining here | 22:50 |
| melwitt | when I test fails for ssh timeout and says this: | 22:54 |
| melwitt | tempest.lib.exceptions.SSHTimeout: Connection to the 172.24.5.148 via SSH timed out. | 22:54 |
| melwitt | User: cirros, Password: O0*bEQwoQf2_bEu | 22:54 |
| melwitt | does that really mean it used that password to login to cirros? because that's not the usual password it says it will be "login as 'cirros' user. default password: 'cubswin:)'. use 'sudo' for root." | 22:54 |
| melwitt | because that should never work I don't think | 22:57 |
| melwitt | oh, it doesn't use password "Creating ssh connection to '172.24.5.148:22' as 'cirros' with public key authentication" | 23:09 |
| mriedem | note infra is dealing with a cirros issue where ssh fails b/c networking isn't setup in the guest b/c config drive is too small | 23:11 |
| mriedem | https://bugs.launchpad.net/openstack-gate/+bug/1808010 | 23:11 |
| openstack | Launchpad bug 1808010 in OpenStack-Gate "Tempest cirros boots fail due to lack of disk space" [Undecided,New] | 23:11 |
| melwitt | clicky | 23:12 |
| *** slaweq has joined #openstack-nova | 23:14 | |
| melwitt | looks like that's the culprit. I don't see the "no space left" messages but I do see "WARN: failed: route add -net "0.0.0.0/0" gw "10.1.0.1"" | 23:16 |
| *** _alastor_ has quit IRC | 23:17 | |
| melwitt | so I guess it's not the same but has the same failure to add the route | 23:18 |
| *** slaweq has quit IRC | 23:19 | |
| melwitt | added a comment to lp | 23:35 |
| *** slaweq has joined #openstack-nova | 23:36 | |
| *** slaweq has quit IRC | 23:40 | |
| *** xek_ has joined #openstack-nova | 23:43 | |
| *** xek has quit IRC | 23:46 | |
| *** dklyle has joined #openstack-nova | 23:51 | |
| *** erlon has joined #openstack-nova | 23:56 | |
| *** rodolof has quit IRC | 23:57 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!