| *** mturpin has quit IRC | 01:18 | |
| *** markvoelker has quit IRC | 01:35 | |
| *** markvoelker has joined #openstack-operators | 01:36 | |
| *** markvoelker has quit IRC | 01:37 | |
| *** mpopow has joined #openstack-operators | 02:49 | |
| *** mpopow has quit IRC | 02:54 | |
| *** VW_ has joined #openstack-operators | 03:26 | |
| *** subscope has joined #openstack-operators | 03:38 | |
| *** ruagair has quit IRC | 03:44 | |
| *** ruagair has joined #openstack-operators | 03:45 | |
| *** mpopow has joined #openstack-operators | 04:05 | |
| *** VW_ has quit IRC | 04:06 | |
| *** vinsh has joined #openstack-operators | 04:10 | |
| *** vinsh has quit IRC | 04:21 | |
| *** markvoelker has joined #openstack-operators | 04:37 | |
| *** blairo has joined #openstack-operators | 05:07 | |
| *** blair has quit IRC | 05:10 | |
| *** emagana has joined #openstack-operators | 05:15 | |
| *** saneax has joined #openstack-operators | 05:32 | |
| *** mpopow has quit IRC | 05:51 | |
| *** blairo has quit IRC | 06:11 | |
| *** simon-AS559 has quit IRC | 06:12 | |
| *** blair has joined #openstack-operators | 06:21 | |
| *** simon-AS559 has joined #openstack-operators | 06:26 | |
| *** mpopow has joined #openstack-operators | 06:52 | |
| *** mpopow has quit IRC | 06:56 | |
| *** Marga_ has joined #openstack-operators | 07:01 | |
| *** Marga_ has quit IRC | 07:04 | |
| *** subscope has quit IRC | 07:05 | |
| *** Marga_ has joined #openstack-operators | 07:19 | |
| *** Marga_ has quit IRC | 07:19 | |
| *** vinsh has joined #openstack-operators | 07:22 | |
| *** matrohon has joined #openstack-operators | 07:22 | |
| *** blair has quit IRC | 07:24 | |
| *** vinsh has quit IRC | 07:26 | |
| *** mpopow has joined #openstack-operators | 07:52 | |
| *** mpopow has quit IRC | 07:57 | |
| *** fifieldt has joined #openstack-operators | 07:57 | |
| *** fifieldt has quit IRC | 07:58 | |
| *** blair has joined #openstack-operators | 08:04 | |
| *** belmoreira has joined #openstack-operators | 08:11 | |
| *** blair has quit IRC | 08:17 | |
| *** racedo_ has joined #openstack-operators | 08:20 | |
| *** derekh has joined #openstack-operators | 08:22 | |
| *** fawadkhaliq has joined #openstack-operators | 08:52 | |
| *** derekh has quit IRC | 09:27 | |
| *** derekh has joined #openstack-operators | 09:28 | |
| *** mpopow has joined #openstack-operators | 09:41 | |
| *** subscope has joined #openstack-operators | 09:43 | |
| *** mpopow has quit IRC | 09:46 | |
| *** fawadkhaliq has quit IRC | 09:56 | |
| *** blair has joined #openstack-operators | 10:06 | |
| *** andyhky has quit IRC | 10:29 | |
| *** andyhky has joined #openstack-operators | 10:31 | |
| *** fawadkhaliq has joined #openstack-operators | 10:31 | |
| *** VW_ has joined #openstack-operators | 10:41 | |
| *** VW_ has quit IRC | 10:42 | |
| *** VW_ has joined #openstack-operators | 10:42 | |
| *** belmoreira has quit IRC | 10:48 | |
| *** simon-AS559 has quit IRC | 11:28 | |
| *** mpopow has joined #openstack-operators | 11:30 | |
| *** simon-AS559 has joined #openstack-operators | 11:30 | |
| *** simon-AS5591 has joined #openstack-operators | 11:32 | |
| *** jaypipes has joined #openstack-operators | 11:32 | |
| *** simon-AS559 has quit IRC | 11:34 | |
| *** mpopow has quit IRC | 11:41 | |
| *** subscope has quit IRC | 11:44 | |
| *** subscope has joined #openstack-operators | 11:47 | |
| *** saneax has quit IRC | 11:54 | |
| *** saneax has joined #openstack-operators | 11:55 | |
| *** racedo_ has quit IRC | 11:55 | |
| *** Marga_ has joined #openstack-operators | 12:12 | |
| *** esker has quit IRC | 12:14 | |
| *** simon-AS5591 has quit IRC | 12:16 | |
| *** SimonChung has quit IRC | 12:21 | |
| *** Marga_ has quit IRC | 12:21 | |
| *** Marga_ has joined #openstack-operators | 12:22 | |
| *** fawadkhaliq has quit IRC | 12:26 | |
| *** VW_ has quit IRC | 12:32 | |
| *** VW_ has joined #openstack-operators | 12:33 | |
| *** VW_ has quit IRC | 12:35 | |
| *** VW_ has joined #openstack-operators | 12:36 | |
| *** fawadkhaliq has joined #openstack-operators | 12:44 | |
| *** fawadk has joined #openstack-operators | 12:50 | |
| *** fawadkhaliq has quit IRC | 12:50 | |
| *** VW_ has quit IRC | 12:53 | |
| *** VW_ has joined #openstack-operators | 12:54 | |
| *** VW_ has quit IRC | 12:59 | |
| *** VW_ has joined #openstack-operators | 13:00 | |
| *** VW_ has quit IRC | 13:00 | |
| *** VW_ has joined #openstack-operators | 13:00 | |
| *** radez_g0n3 is now known as radez | 13:01 | |
| *** VW__ has joined #openstack-operators | 13:03 | |
| *** VW_ has quit IRC | 13:03 | |
| *** VW__ has quit IRC | 13:03 | |
| *** VW_ has joined #openstack-operators | 13:04 | |
| *** VW_ has quit IRC | 13:04 | |
| *** VW_ has joined #openstack-operators | 13:05 | |
| *** fawadkhaliq has joined #openstack-operators | 13:08 | |
| *** fawadk has quit IRC | 13:11 | |
| *** VW_ has quit IRC | 13:15 | |
| *** VW_ has joined #openstack-operators | 13:15 | |
| *** fifieldt has joined #openstack-operators | 13:17 | |
| *** fifieldt has quit IRC | 13:17 | |
| *** dminer has joined #openstack-operators | 13:17 | |
| *** VW_ has quit IRC | 13:18 | |
| *** VW_ has joined #openstack-operators | 13:19 | |
| *** VW_ has quit IRC | 13:19 | |
| *** VW_ has joined #openstack-operators | 13:20 | |
| *** VW_ has quit IRC | 13:22 | |
| *** VW_ has joined #openstack-operators | 13:23 | |
| *** fawadkhaliq has quit IRC | 13:29 | |
| *** esker has joined #openstack-operators | 13:32 | |
| *** rlrevell has joined #openstack-operators | 13:38 | |
| *** VW_ has quit IRC | 13:38 | |
| *** emagana has quit IRC | 13:43 | |
| *** j05h1 has joined #openstack-operators | 13:49 | |
| *** j05h1 has quit IRC | 13:52 | |
| *** j05h1 has joined #openstack-operators | 13:53 | |
| *** markvoelker has quit IRC | 13:56 | |
| *** VW_ has joined #openstack-operators | 14:05 | |
| *** VW_ has quit IRC | 14:07 | |
| *** VW_ has joined #openstack-operators | 14:08 | |
| *** dboik has joined #openstack-operators | 14:11 | |
| *** ferest has joined #openstack-operators | 14:16 | |
| *** openstack has joined #openstack-operators | 14:19 | |
| *** ferest has quit IRC | 14:21 | |
| *** saneax has quit IRC | 14:41 | |
| *** emagana has joined #openstack-operators | 14:42 | |
| *** mdorman has joined #openstack-operators | 14:52 | |
| *** vinsh has joined #openstack-operators | 14:53 | |
| *** blair has quit IRC | 14:53 | |
| *** blair has joined #openstack-operators | 14:54 | |
| *** mpopow has joined #openstack-operators | 15:01 | |
| *** markvoelker has joined #openstack-operators | 15:03 | |
| *** dboik has quit IRC | 15:05 | |
| *** VW_ has quit IRC | 15:18 | |
| *** fifieldt has joined #openstack-operators | 15:22 | |
| *** fifieldt has quit IRC | 15:23 | |
| *** VW_ has joined #openstack-operators | 15:23 | |
| mdorman | mfisch: i confess i’m a bit envious of the amount of superuser posts you get :) | 15:29 |
|---|---|---|
| mfisch | mdorman: dont hate the player hate the game | 15:34 |
| mfisch | I offered this time | 15:35 |
| *** dboik has joined #openstack-operators | 15:35 | |
| mdorman | nah i think it’s cool | 15:37 |
| *** alop has joined #openstack-operators | 15:40 | |
| *** gyee has joined #openstack-operators | 15:41 | |
| *** dboik_ has joined #openstack-operators | 15:42 | |
| *** dboik has quit IRC | 15:44 | |
| *** markvoelker has quit IRC | 15:45 | |
| mfisch | mdorman: I'm going to miss your talk with my moderator duties | 15:46 |
| mdorman | there’s always youtbue | 15:47 |
| mdorman | i’m gonna miss a lot of the puppet work day for hte same reason | 15:47 |
| *** blair has quit IRC | 15:50 | |
| *** matrohon has quit IRC | 16:08 | |
| *** subscope has quit IRC | 16:12 | |
| *** vinsh_ has joined #openstack-operators | 16:15 | |
| *** vinsh has quit IRC | 16:18 | |
| *** alaski has quit IRC | 16:29 | |
| *** matrohon has joined #openstack-operators | 16:30 | |
| *** rlrevell has quit IRC | 16:30 | |
| *** rlrevell has joined #openstack-operators | 16:31 | |
| *** rlrevell1 has joined #openstack-operators | 16:33 | |
| *** rlrevell1 has left #openstack-operators | 16:33 | |
| *** rlrevell1 has joined #openstack-operators | 16:34 | |
| *** alaski has joined #openstack-operators | 16:35 | |
| *** rlrevell has quit IRC | 16:35 | |
| *** alop has quit IRC | 16:37 | |
| *** alop has joined #openstack-operators | 16:39 | |
| *** Marga_ has quit IRC | 16:42 | |
| *** derekh_ has joined #openstack-operators | 16:44 | |
| *** esker has quit IRC | 16:46 | |
| *** derekh has quit IRC | 16:47 | |
| mgagne | anyone with this bug? https://bugs.launchpad.net/neutron/+bug/1328546 | 16:50 |
| openstack | Launchpad bug 1328546 in neutron "Race condition when hard rebooting instance" [Medium,Invalid] - Assigned to Li Ma (nick-ma-z) | 16:50 |
| mgagne | someone sais it got fixed in nova (no link to commit/change) but after looking at the code, I don't see any relevant fix | 16:50 |
| mgagne | and managed to reproduce the problem | 16:50 |
| *** blair has joined #openstack-operators | 16:50 | |
| *** derekh_ has quit IRC | 16:51 | |
| mgagne | Nova calls ensure_bridge, finds that the bridge still exists, continue and then neutron agent removes it before the vif is added to it | 16:52 |
| *** blair has quit IRC | 16:53 | |
| *** matrohon has quit IRC | 17:01 | |
| *** Marga_ has joined #openstack-operators | 17:06 | |
| *** andyhky has quit IRC | 17:15 | |
| *** andyhky has joined #openstack-operators | 17:16 | |
| *** Marga_ has quit IRC | 17:16 | |
| *** emagana has quit IRC | 17:24 | |
| *** Marga_ has joined #openstack-operators | 17:25 | |
| *** emagana has joined #openstack-operators | 17:26 | |
| *** hitalia has joined #openstack-operators | 17:29 | |
| mgagne | jlk: ping | 17:35 |
| *** rlrevell has joined #openstack-operators | 17:39 | |
| jlk | mgagne: howdy | 17:40 |
| *** rlrevell1 has quit IRC | 17:40 | |
| mgagne | jlk: have you ever encounter the problem mentioned above? | 17:41 |
| jlk | mgagne: huh, not that I'm aware of | 17:41 |
| mgagne | damn :-/ | 17:41 |
| jlk | We don't hard reboot all that often though | 17:41 |
| mgagne | if you hard-reboot an instance which is the only one using a network on the ocmpute node, you have a race condition where the agent will delete the bridge between the bridge creation (in nova) and the domain creation | 17:42 |
| *** mturpin has joined #openstack-operators | 17:42 | |
| jlk | yeah, okay. We run into something very similar | 17:42 |
| mgagne | and tbh, I don't know how to fix it :-/ | 17:42 |
| jlk | snapshotting a single instance on a HV will fail | 17:42 |
| mgagne | yep, same bug | 17:43 |
| jlk | because it'll take down the net | 17:43 |
| jlk | so yes, we do run into this | 17:43 |
| mgagne | and calling plug_vifs doesn't fix it | 17:43 |
| jlk | lemme find hte bug and PR | 17:43 |
| mgagne | jlk https://bugs.launchpad.net/nova/+bug/1293540 ? | 17:43 |
| openstack | Launchpad bug 1293540 in OpenStack Compute (nova) "nova should make sure the bridge exists before resuming a VM after an offline snapshot" [Low,Confirmed] - Assigned to Luo Gangyi (luogangyi) | 17:43 |
| jlk | that's it | 17:44 |
| jlk | I even tagged it for backport | 17:44 |
| mgagne | yea, the change proposes adding a call to plug_vifs. the race is between that function (and ensure_bridge) and create_domain :-/ | 17:44 |
| jlk | sweeeet. | 17:45 |
| mgagne | so I'm not sure the change will fix it for real | 17:45 |
| jlk | perhaps not. | 17:45 |
| jlk | our current work around is to leave tiny instances on each HV | 17:45 |
| mgagne | however, I still don't understand why the race doesn't show up in create_domain | 17:45 |
| mgagne | doesn't work well when each tenant has a private network | 17:45 |
| jlk | ah, yeah | 17:46 |
| mgagne | so yea, I'm looking for ideas =) | 17:46 |
| mgagne | and there is no answer in #openstack-nova :/ | 17:47 |
| jlk | ouch | 17:51 |
| *** blair has joined #openstack-operators | 17:54 | |
| *** blair has quit IRC | 17:55 | |
| *** blair has joined #openstack-operators | 17:56 | |
| *** esker has joined #openstack-operators | 17:56 | |
| *** VW__ has joined #openstack-operators | 17:58 | |
| *** VW_ has quit IRC | 17:59 | |
| *** blair has quit IRC | 18:00 | |
| mgagne | I think the workaround will be to remove the call to remove_empty_bridges and call it from a cron instead | 18:08 |
| *** vinsh has joined #openstack-operators | 18:08 | |
| *** vinsh_ has quit IRC | 18:11 | |
| jlk | do you run with delete namespaces ? | 18:13 |
| jlk | We have it turned off, but considering turning it on again | 18:13 |
| mgagne | We don't use namespaces afaik | 18:14 |
| jlk | ah, okay. | 18:14 |
| *** emagana has quit IRC | 18:15 | |
| *** emagana has joined #openstack-operators | 18:17 | |
| *** andyhky has quit IRC | 18:25 | |
| *** alaski has quit IRC | 18:25 | |
| *** dboik_ has quit IRC | 18:25 | |
| *** mpopow has quit IRC | 18:25 | |
| *** beddari has quit IRC | 18:25 | |
| *** morganfainberg has quit IRC | 18:25 | |
| *** mfink- has quit IRC | 18:25 | |
| *** radez_g0n3 has joined #openstack-operators | 18:26 | |
| *** emagana has quit IRC | 18:26 | |
| *** wabu has quit IRC | 18:26 | |
| *** radez has quit IRC | 18:26 | |
| *** tomasq has quit IRC | 18:26 | |
| *** tomasq has joined #openstack-operators | 18:27 | |
| *** andyhky has joined #openstack-operators | 18:27 | |
| *** alaski has joined #openstack-operators | 18:27 | |
| *** dboik_ has joined #openstack-operators | 18:27 | |
| *** mpopow has joined #openstack-operators | 18:27 | |
| *** beddari has joined #openstack-operators | 18:27 | |
| *** morganfainberg has joined #openstack-operators | 18:27 | |
| *** mfink- has joined #openstack-operators | 18:27 | |
| *** wabu has joined #openstack-operators | 18:27 | |
| *** radez_g0n3 is now known as radez | 18:27 | |
| *** emagana has joined #openstack-operators | 18:28 | |
| *** SimonChung has joined #openstack-operators | 18:31 | |
| *** VW__ has quit IRC | 18:33 | |
| *** VW_ has joined #openstack-operators | 18:35 | |
| *** harlowja has quit IRC | 18:52 | |
| *** harlowja has joined #openstack-operators | 18:52 | |
| *** blair has joined #openstack-operators | 18:57 | |
| *** blair has quit IRC | 19:02 | |
| *** Rockyg has joined #openstack-operators | 19:03 | |
| *** VW__ has joined #openstack-operators | 19:05 | |
| *** emagana has quit IRC | 19:05 | |
| *** emagana has joined #openstack-operators | 19:05 | |
| *** VW_ has quit IRC | 19:07 | |
| *** VW_ has joined #openstack-operators | 19:08 | |
| *** VW__ has quit IRC | 19:09 | |
| *** VW_ has quit IRC | 19:10 | |
| *** VW_ has joined #openstack-operators | 19:10 | |
| *** Marga_ has quit IRC | 19:11 | |
| *** subscope has joined #openstack-operators | 19:29 | |
| *** Marga_ has joined #openstack-operators | 19:42 | |
| *** hitalia has quit IRC | 19:45 | |
| *** Marga_ has quit IRC | 19:46 | |
| *** matrohon has joined #openstack-operators | 19:50 | |
| *** blair has joined #openstack-operators | 19:58 | |
| *** blair has quit IRC | 20:03 | |
| *** hitalia has joined #openstack-operators | 20:14 | |
| *** Marga_ has joined #openstack-operators | 20:29 | |
| *** SimonChung1 has joined #openstack-operators | 20:30 | |
| *** SimonChung has quit IRC | 20:30 | |
| *** radez is now known as radez_g0n3 | 20:36 | |
| *** VW_ has quit IRC | 20:56 | |
| *** Marga_ has quit IRC | 20:58 | |
| *** Marga_ has joined #openstack-operators | 20:59 | |
| *** blair has joined #openstack-operators | 20:59 | |
| *** VW_ has joined #openstack-operators | 21:03 | |
| *** blair has quit IRC | 21:04 | |
| *** Marga_ has quit IRC | 21:10 | |
| *** Marga_ has joined #openstack-operators | 21:10 | |
| *** esker has quit IRC | 21:11 | |
| *** Marga_ has quit IRC | 21:17 | |
| *** Marga_ has joined #openstack-operators | 21:18 | |
| *** mpopow has quit IRC | 21:20 | |
| *** mpopow has joined #openstack-operators | 21:21 | |
| *** blair has joined #openstack-operators | 21:26 | |
| *** matrohon has quit IRC | 21:30 | |
| *** rlrevell has quit IRC | 21:32 | |
| *** emagana has quit IRC | 21:34 | |
| *** emagana has joined #openstack-operators | 21:35 | |
| *** Rockyg has quit IRC | 21:39 | |
| *** VW_ has quit IRC | 21:40 | |
| *** VW_ has joined #openstack-operators | 21:42 | |
| *** VW_ has quit IRC | 21:47 | |
| *** VW_ has joined #openstack-operators | 21:52 | |
| *** mpopow has quit IRC | 21:52 | |
| *** emagana has quit IRC | 22:00 | |
| *** Marga_ has quit IRC | 22:04 | |
| *** Marga_ has joined #openstack-operators | 22:04 | |
| *** emagana has joined #openstack-operators | 22:05 | |
| *** hitalia has quit IRC | 22:06 | |
| *** saneax has joined #openstack-operators | 22:07 | |
| *** subscope has quit IRC | 22:09 | |
| *** subscope has joined #openstack-operators | 22:18 | |
| *** dminer has quit IRC | 22:30 | |
| *** esker has joined #openstack-operators | 22:42 | |
| *** mpopow has joined #openstack-operators | 22:46 | |
| *** mpopow has quit IRC | 22:51 | |
| *** blair has quit IRC | 22:53 | |
| *** hitalia has joined #openstack-operators | 22:56 | |
| *** esker has quit IRC | 22:57 | |
| *** reed_ has joined #openstack-operators | 23:00 | |
| *** emagana has quit IRC | 23:03 | |
| *** reed_ has quit IRC | 23:08 | |
| *** subscope has quit IRC | 23:10 | |
| *** dboik_ has quit IRC | 23:12 | |
| *** VW_ has quit IRC | 23:22 | |
| *** esker has joined #openstack-operators | 23:22 | |
| *** alop has quit IRC | 23:25 | |
| *** blair has joined #openstack-operators | 23:32 | |
| *** mdorman has quit IRC | 23:36 | |
| *** hitalia has quit IRC | 23:37 | |
| *** esker has quit IRC | 23:37 | |
| *** mturpin has quit IRC | 23:43 | |
| *** hitalia has joined #openstack-operators | 23:44 | |
| *** dboik has joined #openstack-operators | 23:55 | |
| *** dboik_ has joined #openstack-operators | 23:56 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!