| *** thorst has quit IRC | 00:00 | |
| *** thorst has joined #openstack-powervm | 00:23 | |
| *** thorst has quit IRC | 00:26 | |
| *** thorst has joined #openstack-powervm | 00:27 | |
| *** thorst has quit IRC | 00:31 | |
| *** thorst has joined #openstack-powervm | 00:31 | |
| *** thorst has quit IRC | 00:37 | |
| *** tjakobs has joined #openstack-powervm | 00:41 | |
| *** efried has quit IRC | 00:42 | |
| *** YuYangWang has joined #openstack-powervm | 00:45 | |
| *** YuYangWang has quit IRC | 00:45 | |
| *** efried has joined #openstack-powervm | 00:53 | |
| *** tjakobs has quit IRC | 00:57 | |
| *** thorst has joined #openstack-powervm | 01:37 | |
| *** thorst has quit IRC | 01:41 | |
| *** thorst has joined #openstack-powervm | 01:41 | |
| *** thorst has quit IRC | 01:42 | |
| *** thorst has joined #openstack-powervm | 02:26 | |
| *** thorst has quit IRC | 02:27 | |
| *** thorst has joined #openstack-powervm | 02:31 | |
| *** thorst has quit IRC | 02:31 | |
| *** thorst has joined #openstack-powervm | 02:32 | |
| *** thorst has quit IRC | 02:36 | |
| *** tjakobs has joined #openstack-powervm | 02:39 | |
| *** tjakobs has quit IRC | 02:52 | |
| *** jwcroppe has quit IRC | 03:53 | |
| *** tjakobs has joined #openstack-powervm | 04:52 | |
| *** tjakobs has quit IRC | 05:22 | |
| *** thorst has joined #openstack-powervm | 05:35 | |
| *** thorst has quit IRC | 05:40 | |
| *** k0da has joined #openstack-powervm | 08:43 | |
| *** thorst has joined #openstack-powervm | 09:36 | |
| *** thorst has quit IRC | 09:41 | |
| *** seroyer has joined #openstack-powervm | 11:32 | |
| *** thorst has joined #openstack-powervm | 11:55 | |
| *** smatzek has joined #openstack-powervm | 12:23 | |
| *** kylek3h_away has quit IRC | 12:27 | |
| *** apearson has quit IRC | 12:32 | |
| *** mdrabe has joined #openstack-powervm | 12:35 | |
| thorst | efried: you in yet? | 12:52 |
|---|---|---|
| *** kylek3h_away has joined #openstack-powervm | 12:59 | |
| *** kylek3h_away has quit IRC | 12:59 | |
| *** kylek3h_away has joined #openstack-powervm | 13:00 | |
| *** apearson has joined #openstack-powervm | 13:08 | |
| efried | thorst, yes | 13:10 |
| thorst | https://bugs.launchpad.net/oslo.messaging/+bug/1587763 | 13:11 |
| openstack | Launchpad bug 1587763 in oslo.messaging "py34 gate failure due to amqp can't find module 'vine'" [Undecided,Fix released] - Assigned to ChangBo Guo(gcb) (glongwave) | 13:11 |
| thorst | we're impacted by that. | 13:11 |
| thorst | sorry...this one | 13:12 |
| thorst | https://bugs.launchpad.net/oslo.messaging/+bug/1637938 | 13:12 |
| openstack | Launchpad bug 1637938 in oslo.messaging "Test fail with import error and timeout exception" [Undecided,New] | 13:12 |
| *** edmondsw has joined #openstack-powervm | 13:12 | |
| thorst | efried: I think I have a bad workaround... | 13:18 |
| thorst | set kombu to <4.0 | 13:18 |
| efried | thorst, isn't this going to break the world? | 13:21 |
| thorst | one would think. I ran rechecks on your nova stuff and it was OK | 13:21 |
| thorst | but oslo-messaging is broke | 13:21 |
| thorst | so I think its fairly pervasive. | 13:21 |
| thorst | yeah, my workaround 'works'. I would like to push it to unwedge us (as a partial fix) | 13:21 |
| efried | fine by me. | 13:22 |
| thorst | I guess I'll hop in openstack-infra and give a heads up | 13:22 |
| adreznec | thorst: yeah, did you see my comment on your change about that? | 13:22 |
| adreznec | I started debugging on the plane but ran out of time to actually test before landing | 13:22 |
| thorst | adreznec: which change set? I changed one to Parital-Fix... | 13:22 |
| adreznec | 391048 | 13:22 |
| adreznec | Must have missed it | 13:22 |
| thorst | ahh, no | 13:23 |
| thorst | independent debug | 13:23 |
| thorst | lol | 13:23 |
| adreznec | My question is why your job is ignoring upper-constraints | 13:23 |
| adreznec | Since that's set to 3.0.37 | 13:23 |
| thorst | whoa...weird | 13:23 |
| thorst | how do upper constraints get defined. | 13:23 |
| thorst | sorry...bad word | 13:23 |
| thorst | how do upper constraints get used. | 13:24 |
| adreznec | https://github.com/openstack/requirements/blob/9c4978ff5cc9d6f560aab790072ad8486978fc1d/upper-constraints.txt#L165 | 13:24 |
| thorst | right...but how do they get used | 13:24 |
| thorst | this is just tox | 13:24 |
| adreznec | Ah... | 13:24 |
| thorst | does tox not respect upper-constraints? | 13:25 |
| adreznec | I wonder if there's not enforcement there for just tox runs | 13:25 |
| adreznec | I know devstack has the USE_CONSTRAINTS setting | 13:25 |
| *** kylek3h_away is now known as kylek3h | 13:25 | |
| thorst | adreznec: interesting | 13:26 |
| adreznec | We're not explicitly listing kombu as a dependency in nova-powervm, are we? | 13:26 |
| thorst | I see why we're not enforcing it | 13:26 |
| thorst | I'll fix | 13:26 |
| thorst | no, but that's not why... | 13:26 |
| thorst | I got it | 13:26 |
| adreznec | ? | 13:26 |
| thorst | you'll see in the review...its easier that way | 13:26 |
| thorst | just a sec | 13:26 |
| adreznec | k | 13:26 |
| *** seroyer has quit IRC | 13:27 | |
| *** tblakes has joined #openstack-powervm | 13:31 | |
| *** jwcroppe has joined #openstack-powervm | 13:32 | |
| openstackgerrit | Drew Thorstensen (thorst) proposed openstack/nova-powervm: Use upper constraints https://review.openstack.org/391829 | 13:34 |
| thorst | adreznec efried: ^^ | 13:34 |
| adreznec | thorst: makes sense | 13:35 |
| adreznec | We probably need that for the others as well? | 13:35 |
| adreznec | Still though... | 13:36 |
| openstackgerrit | Drew Thorstensen (thorst) proposed openstack/networking-powervm: Use upper constraints https://review.openstack.org/391832 | 13:36 |
| thorst | adreznec: yeah...I'm doing that now...gah :-) | 13:36 |
| efried | thorst, what's 'plain'? | 13:36 |
| efried | Where did you crib this from? | 13:37 |
| adreznec | Nova | 13:37 |
| adreznec | Probably | 13:37 |
| thorst | nova | 13:37 |
| adreznec | plain = flat text | 13:37 |
| adreznec | IIRC | 13:37 |
| efried | works for me. | 13:37 |
| *** smatzek has quit IRC | 13:37 | |
| openstackgerrit | Drew Thorstensen (thorst) proposed openstack/ceilometer-powervm: Use upper constraints https://review.openstack.org/391833 | 13:37 |
| thorst | I'll propose it to oslo-messaging as well. | 13:38 |
| efried | Is it appropriate for oslo-messaging to be connected to the openstack requirements project that way? | 13:39 |
| efried | I guess your reviewers will let you know... | 13:39 |
| thorst | hmm | 13:39 |
| thorst | well, it is an openstack project? | 13:39 |
| thorst | efried: I think this needs to go back to mitaka...maybe liberty | 13:41 |
| thorst | agree? | 13:41 |
| adreznec | IIRC upper-constraints is broken in liberty | 13:41 |
| adreznec | Unless that got fixed | 13:42 |
| thorst | ahh, OK - mitaka then | 13:44 |
| adreznec | I guess lets make sure it actually fixes things before worrying about backporting :P | 13:45 |
| thorst | OK - all branches are proposed up through mitaka | 13:46 |
| thorst | and yeah, it fixes | 13:46 |
| thorst | already verified | 13:46 |
| adreznec | Odd | 13:46 |
| thorst | check your review board. | 13:46 |
| *** tjakobs has joined #openstack-powervm | 13:47 | |
| *** seroyer has joined #openstack-powervm | 13:48 | |
| efried | thorst, isn't 'SUSPENDED' a terminal state? | 13:49 |
| thorst | I wasn't sure if you would hair pin turn on suspended | 13:49 |
| thorst | like you do when its powered off | 13:49 |
| efried | Like, you can suspend the instance, then walk away indefinitely, then come back and resume it later on? | 13:49 |
| thorst | yeah, but you can also suspend and them immediately resume | 13:49 |
| thorst | like the whole power off | 13:49 |
| efried | How? | 13:49 |
| thorst | well, I'm assuming you can | 13:50 |
| efried | With power, there's an actual operation called reboot that does that. Is there a corollary with suspend/resum? | 13:50 |
| efried | e | 13:50 |
| thorst | efried: it doesn't even matter if there is a reboot | 13:50 |
| thorst | the user could issue that command quickly | 13:50 |
| thorst | the two in succession quickly | 13:50 |
| thorst | FORCE_IMMED_OFF, POWER_ON | 13:51 |
| efried | I contend that we don't need to use the event delay in that scenario. | 13:51 |
| openstackgerrit | Merged openstack/nova-powervm: Use upper constraints https://review.openstack.org/391829 | 13:51 |
| thorst | I contend that we do for the same reason we need it for reboot...although I admit that reboot has a better timing window | 13:51 |
| openstackgerrit | Merged openstack/ceilometer-powervm: Use upper constraints https://review.openstack.org/391833 | 13:51 |
| thorst | gah, looks like mitaka is borked for some other reason | 13:52 |
| openstackgerrit | Drew Thorstensen (thorst) proposed openstack/nova-powervm: WIP: Clean up of OVS port on source host post migration https://review.openstack.org/391657 | 13:52 |
| openstackgerrit | Drew Thorstensen (thorst) proposed openstack/nova-powervm: Refactor events into own class https://review.openstack.org/391048 | 13:52 |
| openstackgerrit | Drew Thorstensen (thorst) proposed openstack/nova-powervm: WIP: Add delay queue for events https://review.openstack.org/391164 | 13:52 |
| openstackgerrit | Merged openstack/networking-powervm: Use upper constraints https://review.openstack.org/391832 | 13:53 |
| efried | what's the use case for quick suspend/resume? | 13:53 |
| thorst | efried: before we go down the state debate...which we should get to | 13:53 |
| thorst | can I shift to getting builds going again? | 13:54 |
| thorst | we're not quite out of woods yet. | 13:54 |
| efried | sho | 13:54 |
| thorst | http://logs.openstack.org/40/391840/1/check/gate-nova-powervm-pep8-ubuntu-trusty/ba48579/console.html | 13:54 |
| thorst | mitaka...looks like new rules got pushed back | 13:54 |
| thorst | need to find what change we fixed that under.. | 13:56 |
| thorst | actually, looks like we merged that change back to stable/mitaka, but these are strings that no longer exist in newton | 13:58 |
| thorst | so we need a specific fix for these in stable/mitaka | 13:58 |
| thorst | wonderful | 13:58 |
| thorst | how do you want to handle...ignore the rule...or fix them? | 13:58 |
| thorst | my vote is add an ignore rule. | 13:59 |
| *** smatzek has joined #openstack-powervm | 14:00 | |
| thorst | efried: I'll wait for your resp before I go down the rabbit hole | 14:03 |
| openstackgerrit | Merged openstack/nova-powervm: Refactor events into own class https://review.openstack.org/391048 | 14:03 |
| efried | thorst, fix 'em. | 14:05 |
| efried | I can take it if you like. | 14:05 |
| thorst | efried: if you have time, I wouldn't mind pawning off to you :-) | 14:06 |
| efried | k, on it. | 14:06 |
| thorst | well, if you're taking that...should we go back to SUSPENDED state discussion or want to revisit later? | 14:06 |
| efried | thorst, do you have the bug handy? The one we used for same issue in the other branches? | 14:07 |
| thorst | efried: no..couldn't find it easily | 14:07 |
| efried | k, I'll track it down. | 14:07 |
| efried | We can talk about SUSPENDED. | 14:07 |
| thorst | seroyer: can you hairpin turn between SUSPENDING, SUSPENDED, RESUMING, RUNNING? | 14:10 |
| thorst | all within maybe 15 seconds...could you flow through those states (generally speaking) | 14:11 |
| *** dwayne_ has joined #openstack-powervm | 14:12 | |
| efried | thorst, seroyer - while it might be interesting to know if you *could* do that, I think the real question is *would* you? | 14:12 |
| thorst | I again defer to seroyer there... | 14:12 |
| efried | What's the symptom if you get it wrong? That the VM shows up in the wrong state? | 14:13 |
| thorst | we don't support pause (suspend) in openstack today...but not sure about other symptoms | 14:13 |
| thorst | yeah, wrong state shows up, allowing improper actions to be invoked against it | 14:13 |
| efried | Permanently, or until some periodic task refreshes it? | 14:13 |
| thorst | until next sync_power_state | 14:13 |
| efried | which happens how frequently? | 14:13 |
| thorst | configurable....but I think 5-10 minute intervals | 14:13 |
| thorst | 'eventual consistency' I've heard it called before. | 14:14 |
| efried | Presumably you can't resume a VM unless it's SUSPENDED, right? | 14:14 |
| thorst | true...and if the workflow takes more than 15 seconds...which I suspect it does | 14:15 |
| efried | So - in the absence of a 'reboot' equivalent for suspend/resume, given that you're already delaying 15s on SUSPENDING... | 14:15 |
| thorst | ahh, so leave SUSPENDING, but not suspended. | 14:15 |
| thorst | yeah, I'm OK with that | 14:16 |
| thorst | I feel like splitting hairs, but I'm cool with it | 14:16 |
| efried | ...there would be no way for a consumer to issue the resume quick enough to hurt things. | 14:16 |
| efried | Yeah, leave SUSPENDING for sure - that's clearly a transitional state. | 14:16 |
| efried | All assuming there's no 'reboot' equivalent for suspend/resume. | 14:16 |
| thorst | efried: you know the irony...this was supposed to be a very quick function for me to add | 14:16 |
| thorst | and it turned into a not so fun one. | 14:17 |
| thorst | way more complex than I thought originally, but happy with its current form | 14:17 |
| efried | Were you imitating libvirt code? | 14:17 |
| thorst | imitating...making better... (in my opinion) | 14:17 |
| efried | Cause this is certainly a nontrivial thing to do. | 14:17 |
| efried | So unless you were straight copy/pasting, not sure where your quick-to-implement expectation came from ;-) | 14:18 |
| thorst | what I did is more verbose...but I know I am going to need this extended for the Overlay Eventing we'll need to add soon | 14:18 |
| thorst | efried: yeah, I wasn't a huge fan of what we had originally...like the objects more | 14:18 |
| efried | Especially since Power's state model is totally different from libvirt's and OpenStack's. | 14:18 |
| thorst | I think also...we need to start thinking about a new version tag. | 14:18 |
| efried | where? | 14:19 |
| thorst | nova-powervm | 14:19 |
| thorst | for stable/newton | 14:19 |
| thorst | something like 3.0.1 | 14:19 |
| thorst | we have some significant fixes back there... | 14:19 |
| efried | I can't find the bug for the logging interpolation thing. Wonder if we subsumed it in some other change. Okay if I create a new one? | 14:21 |
| thorst | efried: yep | 14:21 |
| efried | aha, found it. 1632441 | 14:23 |
| seroyer | thorst, efried: No, I can't think of any reason to suspend/resume like a reboot. Doesn't really make sense. | 14:35 |
| efried | thanks seroyer | 14:35 |
| *** tjakobs has quit IRC | 14:38 | |
| openstackgerrit | Ravi Kumar Kota proposed openstack/nova-powervm: Clean up of OVS port on source host post migration https://review.openstack.org/391657 | 15:08 |
| efried | thorst, oh, this is ugly. I need both upper constraints and pep8 fixes. Is there a way to do this other than combining both change sets? | 15:14 |
| *** tjakobs has joined #openstack-powervm | 15:15 | |
| thorst | efried: nope | 15:23 |
| *** tblakes has quit IRC | 15:26 | |
| *** apearson has quit IRC | 15:30 | |
| *** apearson has joined #openstack-powervm | 15:31 | |
| *** tblakes has joined #openstack-powervm | 15:54 | |
| efried | thorst, adreznec: https://review.openstack.org/#/c/391901/ (not sure why the bot isn't putting these in IRC) | 16:06 |
| efried | That squashes all the fixes for nova-powervm in mitaka - let's see if it builds. Then gotta do similar (but, alas, not the same) for networking and ceilometer. | 16:07 |
| adreznec | Maybe it broke | 16:07 |
| adreznec | Not sure | 16:07 |
| efried | thorst, I think this is a 911: https://review.openstack.org/#/c/391562/ | 16:08 |
| *** apearson has quit IRC | 16:09 | |
| *** apearson has joined #openstack-powervm | 16:09 | |
| efried | gr, adreznec, got some insight on this? http://logs.openstack.org/01/391901/1/check/gate-nova-powervm-python27-ubuntu-trusty/eaf9215/console.html | 16:11 |
| efried | Do we need to cap our nova req or something? | 16:12 |
| *** AlexeyAbashkin has quit IRC | 16:13 | |
| *** AlexeyAbashkin has joined #openstack-powervm | 16:15 | |
| *** apearson has quit IRC | 16:16 | |
| *** apearson has joined #openstack-powervm | 16:26 | |
| *** apearson has quit IRC | 16:28 | |
| *** apearson has joined #openstack-powervm | 16:28 | |
| *** tblakes_ has joined #openstack-powervm | 16:32 | |
| *** tblakes has quit IRC | 16:32 | |
| *** tblakes_ is now known as tblakes | 16:33 | |
| *** seroyer has quit IRC | 16:51 | |
| *** seroyer has joined #openstack-powervm | 16:54 | |
| *** k0da has quit IRC | 16:56 | |
| thorst | efried: Yeah, that seems hot. | 17:03 |
| thorst | +2 | 17:04 |
| thorst | backporting to stable/newton? | 17:04 |
| adreznec | efried: sorry, was in another meeting | 17:09 |
| adreznec | Did you get that figured out? | 17:09 |
| *** thorst has quit IRC | 17:10 | |
| *** thorst has joined #openstack-powervm | 17:11 | |
| *** thorst_ has joined #openstack-powervm | 17:12 | |
| *** thorst has quit IRC | 17:15 | |
| *** thorst_ has quit IRC | 17:16 | |
| *** esberglu has joined #openstack-powervm | 17:21 | |
| *** thorst has joined #openstack-powervm | 17:21 | |
| *** thorst has quit IRC | 17:21 | |
| *** thorst has joined #openstack-powervm | 17:22 | |
| *** apearson has quit IRC | 17:24 | |
| *** thorst has quit IRC | 17:26 | |
| *** thorst has joined #openstack-powervm | 17:26 | |
| *** jwcroppe has quit IRC | 17:27 | |
| *** jwcroppe has joined #openstack-powervm | 17:28 | |
| *** jwcroppe_ has joined #openstack-powervm | 17:31 | |
| *** jwcroppe has quit IRC | 17:32 | |
| *** apearson has joined #openstack-powervm | 17:36 | |
| *** jwcroppe_ has quit IRC | 17:42 | |
| thorst | efried: I hard reset...anything I need to chase? | 17:53 |
| *** apearson has quit IRC | 18:08 | |
| *** tblakes has quit IRC | 18:24 | |
| *** tblakes has joined #openstack-powervm | 18:26 | |
| *** apearson has joined #openstack-powervm | 19:00 | |
| *** k0da has joined #openstack-powervm | 19:10 | |
| *** apearson has quit IRC | 19:17 | |
| efried | adreznec, thorst, no, I haven't figured out https://review.openstack.org/#/c/391901/ yet | 19:34 |
| efried | thorst, I think the source of the logging one wasn't backported, was it? | 19:36 |
| efried | https://review.openstack.org/#/c/385144/ ? | 19:36 |
| openstackgerrit | Merged openstack/nova-powervm: Remove self.instance from ConfigDrivePowerVM log https://review.openstack.org/391562 | 19:41 |
| *** tblakes has quit IRC | 19:47 | |
| *** smatzek has quit IRC | 19:58 | |
| *** tblakes has joined #openstack-powervm | 20:18 | |
| thorst | efried: nope | 20:32 |
| *** esberglu has quit IRC | 20:43 | |
| *** jwcroppe has joined #openstack-powervm | 20:44 | |
| *** jwcroppe has quit IRC | 20:55 | |
| *** seroyer has quit IRC | 21:14 | |
| *** openstackgerrit has quit IRC | 21:18 | |
| *** openstackgerrit has joined #openstack-powervm | 21:19 | |
| *** thorst has quit IRC | 21:19 | |
| *** thorst has joined #openstack-powervm | 21:19 | |
| *** apearson has joined #openstack-powervm | 21:20 | |
| *** thorst has quit IRC | 21:23 | |
| *** kylek3h has quit IRC | 21:37 | |
| *** thorst has joined #openstack-powervm | 21:45 | |
| *** thorst has quit IRC | 21:49 | |
| *** tjakobs has quit IRC | 22:23 | |
| *** tblakes has quit IRC | 22:34 | |
| *** thorst has joined #openstack-powervm | 22:37 | |
| *** edmondsw has quit IRC | 22:39 | |
| *** apearson has quit IRC | 22:45 | |
| *** thorst has quit IRC | 23:03 | |
| *** thorst has joined #openstack-powervm | 23:04 | |
| *** thorst has quit IRC | 23:17 | |
| *** kylek3h has joined #openstack-powervm | 23:22 | |
| *** apearson has joined #openstack-powervm | 23:29 | |
| *** seroyer has joined #openstack-powervm | 23:36 | |
| *** k0da has quit IRC | 23:47 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!