*** thorst has joined #openstack-powervm | 00:01 | |
*** thorst has quit IRC | 00:03 | |
*** thorst has joined #openstack-powervm | 01:04 | |
*** thorst has quit IRC | 01:10 | |
*** mdrabe has quit IRC | 02:34 | |
*** thorst has joined #openstack-powervm | 03:35 | |
*** thorst has quit IRC | 03:41 | |
*** esberglu has quit IRC | 04:01 | |
*** thorst has joined #openstack-powervm | 04:38 | |
*** thorst has quit IRC | 04:43 | |
*** thorst has joined #openstack-powervm | 06:47 | |
*** thorst has quit IRC | 06:52 | |
*** k0da has joined #openstack-powervm | 07:29 | |
*** thorst has joined #openstack-powervm | 08:49 | |
*** thorst has quit IRC | 08:53 | |
*** tonyb_ has joined #openstack-powervm | 09:30 | |
*** tonyb has quit IRC | 09:35 | |
*** thorst has joined #openstack-powervm | 10:26 | |
*** thorst has quit IRC | 10:29 | |
*** smatzek has joined #openstack-powervm | 11:26 | |
*** jpasqualetto has joined #openstack-powervm | 12:08 | |
openstackgerrit | OpenStack Proposal Bot proposed openstack/ceilometer-powervm master: Updated from global requirements https://review.openstack.org/477917 | 12:08 |
---|---|---|
openstackgerrit | OpenStack Proposal Bot proposed openstack/networking-powervm master: Updated from global requirements https://review.openstack.org/477976 | 12:14 |
openstackgerrit | OpenStack Proposal Bot proposed openstack/nova-powervm master: Updated from global requirements https://review.openstack.org/477984 | 12:17 |
*** edmondsw has joined #openstack-powervm | 12:19 | |
*** kylek3h has joined #openstack-powervm | 12:29 | |
AndyWojo | I am filling out the OpenStack Survey that just got opened up, and PowerVM is not on the hypervisor list for me to choose. | 12:40 |
*** mdrabe has joined #openstack-powervm | 12:49 | |
*** jay1_ has joined #openstack-powervm | 12:57 | |
*** esberglu has joined #openstack-powervm | 13:00 | |
esberglu | #startmeeting powervm_driver_meeting | 13:01 |
openstack | Meeting started Tue Jun 27 13:01:15 2017 UTC and is due to finish in 60 minutes. The chair is esberglu. Information about MeetBot at http://wiki.debian.org/MeetBot. | 13:01 |
openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 13:01 |
openstack | The meeting name has been set to 'powervm_driver_meeting' | 13:01 |
efried | \o | 13:01 |
mdrabe | o/ | 13:01 |
edmondsw | o/ | 13:02 |
efried | AndyWojo Well, I wouldn't say what we've got in tree is usable at this point. Were there other third-party (out-of-tree) drivers in the survey? | 13:02 |
esberglu | #link https://etherpad.openstack.org/p/powervm_driver_meeting_agenda | 13:02 |
esberglu | #topic In Tree Driver | 13:02 |
esberglu | #link https://etherpad.openstack.org/p/powervm-in-tree-todos | 13:02 |
esberglu | Anything to talk about here? Or still just knocking through the todos? | 13:03 |
edmondsw | AndyWojo which survey is that? I thought the Ocata survey was closed a while back. We are working to get on the survey. | 13:03 |
jay1_ | efried: what operations are ready for test in IT ? | 13:04 |
efried | jay1_ That hasn't changed in a while. SSP disk was the last thing we merged. | 13:05 |
jay1_ | ok.. | 13:05 |
edmondsw | jay1_ no network yet IT | 13:05 |
jay1_ | that would be the next one to do ? | 13:05 |
edmondsw | jay1_ but you can deploy with SSP boot disk and do some things like stop, restart... see the support matrix | 13:06 |
edmondsw | efried you have a quick link for that? | 13:06 |
efried | Config drive will probably be next, cause it's easy. | 13:06 |
edmondsw | jay1_ network will be one of the priorities for queens, along with config drive | 13:06 |
efried | #link https://docs.openstack.org/developer/nova/support-matrix.html | 13:06 |
jay1_ | okay | 13:06 |
jay1_ | efried, in that matrix PowerVM refers OOT only ? | 13:08 |
efried | jay1_ IT only | 13:08 |
jay1_ | ah ok. | 13:08 |
efried | OOT we have a lot more green check marks | 13:08 |
esberglu | http://nova-powervm.readthedocs.io/en/latest/support-matrix.html | 13:09 |
esberglu | That's OOT | 13:09 |
edmondsw | esberglu we need to change the OOT version's checkmarks to green... would be much easier to read | 13:09 |
edmondsw | I'll throw that on the TODO | 13:09 |
esberglu | +2 | 13:10 |
esberglu | Alright sounds like that's it IT | 13:11 |
esberglu | #topic Out Of Tree Driver | 13:12 |
jay1_ | when is the next ISCSI integration point ? | 13:13 |
jay1_ | is that integration done ? | 13:13 |
efried | Have you heard anything from chhavi about the latest pypowervm + https://review.openstack.org/#/c/467599/ ? | 13:14 |
jay1_ | no | 13:14 |
efried | She was going to sniff test that to make sure we didn't need any further pypowervm fixes so we can cut a new release. I want to get that done pretty quickly here. | 13:14 |
edmondsw | efried agreed | 13:14 |
edmondsw | jay1_ please talk to chhavi about this. I'll send a note as well to try to push this along | 13:15 |
jay1_ | edmondsw: sure | 13:16 |
edmondsw | note sent | 13:18 |
esberglu | If it turns out you do need pypowervm fixes let me know and I can push a run through CI with it when ready | 13:18 |
esberglu | Nvm just clicked on the review | 13:19 |
esberglu | I don't think it would hit any changes going through our CI? | 13:20 |
efried | It what? | 13:20 |
efried | The pypowervm that's merged right now is copacetic. Last thing merged was the power_off_progressive change, and you already tested that. | 13:21 |
efried | The question is whether we're going to need anything else in 1.1.6 | 13:21 |
esberglu | Well any pypowervm changes would be related to ISCSI right? Which isn't part of the CI | 13:21 |
efried | esberglu Well, right, but a regression test wouldn't be a bad thing. | 13:21 |
esberglu | So I don't know that the changed paths would get hit | 13:21 |
esberglu | Yeah I can push one anyways just to be safe | 13:21 |
edmondsw | mdrabe efried should we talk about https://review.openstack.org/#/c/471926/ now? | 13:23 |
efried | okay | 13:23 |
edmondsw | we've had emails flying back and forth... hash it out? | 13:23 |
edmondsw | mdrabe you still here? | 13:24 |
mdrabe | Yea I'm gonna whip that up this afternoon I think | 13:24 |
edmondsw | what exactly does that whipping entail? ;) | 13:24 |
mdrabe | With the caching, and evacuating on instance deletion events | 13:24 |
edmondsw | how do you plan to demonstrate perf improvement to satisfy efried? | 13:25 |
mdrabe | Respond to efried's comments and introduce the caching to event.py | 13:25 |
mdrabe | Stop calling that instance object retrieval | 13:25 |
efried | I think we're out of runway to get arnoldje to test this. | 13:25 |
edmondsw | right, I was afraid of that | 13:25 |
efried | Who's his replacement, and does said replacement have the wherewithal and time to do it? | 13:26 |
edmondsw | I haven't heard of a replacement... I can ask | 13:26 |
mdrabe | If anything I can test it myself, though I don't have any fancy performance tools | 13:26 |
AndyWojo | edmondsw: The OpenStack User Survey. Only PowerKVM was on the list, I selected other and filled in PowerVM, since I'm in the middle of implementating it | 13:27 |
efried | mdrabe Yeah, I'm obviously concerned that it *works*, but that's not sufficient for me to want to merge it. We have to have a demonstrable nontrivial performance improvement to justify the risk. | 13:28 |
mdrabe | For the caching I'm still concerned in the pvc case around management of LPARs | 13:28 |
efried | When arnoldje validated the PartitionState change, he was able to produce hard numbers. | 13:28 |
efried | My fear is that this change is bigger & more pervasive, but will yield a smaller return. | 13:29 |
mdrabe | I've no hard numbers, but he said something of a 10-12% deploy time improvement | 13:29 |
edmondsw | AndyWojo I think the last user survey is closed. But I'm hoping to have PowerVM on the October one. | 13:30 |
mdrabe | But there're fewer NVRAM events that PartitionState events | 13:30 |
mdrabe | during deploy | 13:30 |
mdrabe | than* | 13:30 |
AndyWojo | edmondsw: they just sent an e-mail out about the user survey is now open, and it's for June - Dec | 13:30 |
edmondsw | mdrabe efried yeah, arnoldje had estimated something like 5% improvement for this | 13:30 |
efried | 7.2% improvement was what he said for the PartitionState change. | 13:30 |
AndyWojo | Openstack Operators List | 13:31 |
edmondsw | AndyWojo ok, hadn't seen that yet... guess we missed the boat. Will shoot for the next one then | 13:31 |
edmondsw | annasort gave me a couple names to do perf testing now, I'll ping them to you efried mdrabe | 13:35 |
mdrabe | edmondsw Yea I got em | 13:35 |
efried | edmondsw Ping anyway, maybe your names are different than mine. | 13:35 |
edmondsw | pinged you both on slack | 13:36 |
mdrabe | K so I'll work on that. good? | 13:37 |
efried | Cool man. | 13:37 |
esberglu | Alright lets move on to CI then | 13:38 |
esberglu | #topic PowerVM CI | 13:38 |
esberglu | The network issues caused quite a bit of inconsistency so I redeployed last night | 13:39 |
esberglu | Then the control node's /boot/ dir filled up which also caused a bunch of inconsistencies | 13:40 |
esberglu | Is the proper way to clean that out | 13:40 |
efried | Just can't get a break, can ya | 13:40 |
esberglu | apt-get autoremove? | 13:40 |
*** thorst has joined #openstack-powervm | 13:40 | |
edmondsw | esberglu what filled that partition? Ideas on how to prevent that in future? | 13:40 |
esberglu | edmondsw: I'm pretty sure you can just run apt-get autoremove and it cleans it out, however I'm no expert on apt | 13:41 |
esberglu | But since it was at 100% that command was also failing | 13:41 |
esberglu | So I had to manually go in and clean out the old ones | 13:41 |
efried | I wouldn't expect /boot to be affected by autoremove. | 13:42 |
efried | Do you have old kernels lying around? | 13:42 |
efried | I had that happen. | 13:42 |
esberglu | efried: Yeah | 13:42 |
efried | dpkg -l | grep linux-image | 13:43 |
efried | If you see more than one rev, you can *probably* apt-get remove all but the newest. | 13:43 |
esberglu | efried: That sounds scary, what happens if the newest errantly gets deleted? | 13:44 |
efried | You don't boot. | 13:44 |
efried | But don't do that. | 13:44 |
edmondsw | :) | 13:44 |
esberglu | efried: Yeah we just have to make sure that the logic is really good | 13:44 |
*** thorst has quit IRC | 13:44 | |
efried | This is not something I would automate, dude. | 13:44 |
efried | Do it once to free up space. | 13:44 |
efried | Manually type in the full package names of the old ones. | 13:45 |
esberglu | efried: Yeah but I want to add a step that would clean this every time | 13:45 |
edmondsw | you could automate detection of the problem... cron job that emails you if it sees things are getting filled up? | 13:45 |
edmondsw | but right, don't automate cleanup | 13:45 |
esberglu | And I read something last night saying apt-get autoremove would do that | 13:45 |
efried | "every time" isn't a thing that should happen for old kernel images. | 13:45 |
efried | autoremove won't hurt. | 13:45 |
efried | But I don't think it's likely to help /boot most of the timee. | 13:45 |
efried | time | 13:45 |
esberglu | efried: Okay. I'll try to find that article I was reading, but stick with manual cleanup for now | 13:47 |
efried | You could definitely work up a cron job to keep you informed of filling file systems. | 13:47 |
esberglu | That's all I had for CI | 13:47 |
esberglu | #topic Driver Testing | 13:47 |
esberglu | We kinda covered this above | 13:48 |
esberglu | Any other thoughts about it? | 13:48 |
jay1_ | any tentative dcut as such, to close the pike changes ? | 13:52 |
*** smatzek has quit IRC | 13:52 | |
edmondsw | jay1_ the stuff we're still working on for pike is mostly doc changes | 13:53 |
*** thorst has joined #openstack-powervm | 13:54 | |
edmondsw | I've got a change in progress for disabling the compute service if there's no VIOS or we can't talk to NovaLink REST API | 13:54 |
edmondsw | that's about it, I think | 13:55 |
jay1_ | edmondsw: how about ISCSI merging, do we have any planned date ? | 13:55 |
*** thorst has quit IRC | 13:56 | |
edmondsw | jay1_ oh, I thought you were talking about IT... we're not doing iSCSI IT for pike, but yeah, we will be doing that OOT | 13:56 |
edmondsw | efried, I think there are still some IT changes that we need to push to OOT for pike, right? anything else you can think of? | 13:57 |
edmondsw | jay1_ you can look over the TODO etherpad: https://etherpad.openstack.org/p/powervm-in-tree-todos | 13:57 |
jay1_ | edmondsw: sure | 13:57 |
efried | edmondsw Should all be in the etherpad, I hope. | 13:57 |
edmondsw | yep | 13:57 |
esberglu | #topic Other Discussion | 13:59 |
esberglu | Any last words? | 14:00 |
edmondsw | supercalifragilisticexpialodocious | 14:01 |
esberglu | lol | 14:02 |
esberglu | #endmeeting | 14:02 |
openstack | Meeting ended Tue Jun 27 14:02:10 2017 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 14:02 |
openstack | Minutes: http://eavesdrop.openstack.org/meetings/powervm_driver_meeting/2017/powervm_driver_meeting.2017-06-27-13.01.html | 14:02 |
openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/powervm_driver_meeting/2017/powervm_driver_meeting.2017-06-27-13.01.txt | 14:02 |
openstack | Log: http://eavesdrop.openstack.org/meetings/powervm_driver_meeting/2017/powervm_driver_meeting.2017-06-27-13.01.log.html | 14:02 |
esberglu | efried: Turns out there is a command for removing old kernels | 14:19 |
esberglu | purge-old-kernels | 14:19 |
*** smatzek has joined #openstack-powervm | 14:21 | |
edmondsw | esberglu cool | 14:27 |
edmondsw | efried do we need to s/e/str(e)/ for something like this? | 14:28 |
edmondsw | LOG.debug('Instance with PowerVM UUID %s not found: %s', pvm_uuid, e) | 14:28 |
edmondsw | I can never remember... | 14:28 |
edmondsw | efried nm, seems like it should work as-is | 14:33 |
efried | edmondsw I can never remember that one either. | 14:44 |
efried | It's also a different answer for py2/py3 | 14:45 |
efried | But I think the oslo_log library fixed it up so you don't need to do anything to it anymore. | 14:45 |
edmondsw | cool | 14:45 |
efried | And according to the guidelines, you're actually not _supposed_ to do anything to it, because that allows the string processing to be deferred into the logger, so it only happens if the log message is going to be emitted. | 14:46 |
*** mdrabe has quit IRC | 14:52 | |
openstackgerrit | Eric Fried proposed openstack/nova-powervm master: Clean up log messages https://review.openstack.org/476695 | 14:56 |
*** mdrabe has joined #openstack-powervm | 15:10 | |
*** k0da has quit IRC | 15:11 | |
*** thorst has joined #openstack-powervm | 15:13 | |
esberglu | efried: edmondsw: thorst: Any powervm patches that need a CI recheck? It's back online | 15:20 |
efried | I don't see anything in my queue | 15:21 |
esberglu | efried: I rechecked the log one for you | 15:22 |
esberglu | https://review.openstack.org/#/c/399579/ | 15:22 |
esberglu | Anyone know what the status of that is? It's been sitting around for a while | 15:23 |
efried | thorst ^^ ?? | 15:23 |
thorst | I think it's still a TODO with manas, but must be very low priority | 15:23 |
thorst | mdrabe: can you verify? | 15:23 |
mdrabe | Manas hasn't mentioned that at all to me | 15:24 |
efried | I can fix up the typos. | 15:24 |
efried | Haven't we already done the work for this? | 15:24 |
thorst | not ure | 15:25 |
thorst | *sure | 15:25 |
*** thorst has quit IRC | 15:29 | |
openstackgerrit | Eric Fried proposed openstack/nova-powervm master: Allow dynamic enable/disable of SRR capability https://review.openstack.org/399579 | 15:31 |
efried | mdrabe IIRC, this capability was implemented at the core level - we didn't need changes in pypowervm or the community code. | 15:32 |
mdrabe | I thought it was a different attribute though | 15:32 |
efried | I'm 95% sure there was no enforcement/checking at or above pypowervm, so it should just work. | 15:33 |
mdrabe | There probably should be enforcement | 15:33 |
esberglu | efried: edmondsw: We aren't using zuul-merger correctly | 15:33 |
mdrabe | Not enforcement, but validation | 15:33 |
esberglu | https://docs.openstack.org/infra/zuul/merger.html#serving-zuul-git-repos | 15:33 |
esberglu | We should be using the refs that it creates, not pulling from gerrit | 15:33 |
efried | mdrabe There's a capability bit in managed_system | 15:34 |
mdrabe | There actually might be logic that says "Hey you're trying to flip RR while the partition is active - FAIL" | 15:35 |
mdrabe | I'd need to look at the code though, I haven't done that | 15:36 |
efried | mdrabe https://github.com/powervm/pypowervm/commit/97f15c2e646e4d5273f1dd8ddb684430819a09b6 | 15:38 |
efried | mdrabe There's no checks like that in pypowervm or nova_powervm. And if there are in pvc, that's not the business of this blueprint. | 15:40 |
esberglu | efried: edmondsw: Actually I take that back. Since we have the patching logic we need to use gerrit. And I don't really want to be pulling some stuff from gerrit and some from the zuul-mergers | 15:40 |
mdrabe | efried: https://github.com/powervm/pypowervm/blob/develop/pypowervm/utils/validation.py#L500-L510 | 15:40 |
mdrabe | I don't think nova-powervm uses that, but pvc does | 15:40 |
efried | hmph, I stand corrected. | 15:40 |
efried | mdrabe So then it looks like we would need a pypowervm change. | 15:42 |
efried | Still not really sure a nova-powervm blueprint is pertinent. | 15:43 |
mdrabe | Yea, it'd probably be pretty lightweight | 15:43 |
mdrabe | Yea I'm wondering why the bp was put up | 15:43 |
efried | mdrabe Might as well get that change into this 1.1.6, I guess. | 15:48 |
mdrabe | efried I'll send a note to Manas to see if he wants to drive that, I got an unrelated question for ya... | 15:52 |
mdrabe | Do you remember why the high bit on LPAR UUIDs can't be set? | 15:52 |
efried | mdrabe I'm already working on the pypowervm change FYI. | 15:52 |
mdrabe | Oh nice | 15:52 |
efried | mdrabe The Power platform uses a different UUID format version than OpenStack. | 15:53 |
efried | I don't know the specific version numbers and whatnot, could find it out if necessary. | 15:53 |
efried | But the one Power uses always has the high bit zero, and the one OpenStack uses doesn't. | 15:53 |
efried | mdrabe Yeah, that double lookup thing sucks ass. | 15:54 |
mdrabe | efried: Hypothetical: What if we just knocked off the high bit of every instance UUID on deploy? | 15:56 |
efried | mdrabe At first blush, I don't hate that idea at all. | 15:57 |
efried | We're already compromised collision-wise. | 15:57 |
efried | It's just a chance we're taking. | 15:57 |
efried | So we might as well commit to it. | 15:57 |
mdrabe | Compromised how? | 15:57 |
efried | The hypothetical situation where there's two instances whose UUIDs only differ by that one bit. | 15:58 |
efried | Oh | 15:58 |
efried | Yeah | 15:58 |
efried | That's why. | 15:58 |
efried | We *do* knock that bit off. | 15:58 |
efried | We can't tell Nova to change the UUID. | 15:58 |
efried | So in nova it is what it is. | 15:58 |
efried | So yeah, in the scenario where two instances are created with UUIDs that only differ by that one bit, I believe creation of the second one will just fail. | 15:59 |
mdrabe | By the time it gets to the driver it's already set in motion? | 15:59 |
efried | Oh yeah. By the time we get to the driver, the Instance object has already been created and populated. | 16:00 |
mdrabe | Yea and probably other objects that reference the UUID | 16:00 |
efried | Totally. | 16:00 |
efried | I suppose we could... fail to deploy any instance that came at us with the high bit set. | 16:01 |
efried | So, half of them :) | 16:01 |
efried | Not a viable solution. | 16:01 |
efried | The only real problem is the reverse mapping. | 16:01 |
efried | And of course, any solutions to that problem are pretty heavyweight and/or brittle. | 16:02 |
efried | Like trying to maintain a mapping cache in the driver. | 16:02 |
mdrabe | Right, I don't wanna have to look up the instance object at all given the LPAR UUID, if all I'm trying to find is the instance UUID | 16:02 |
efried | mdrabe Right, here's where I thought it would be nice to have a (nova) API for instance_exists(uuid) | 16:03 |
efried | A very quick db check to see if that UUID is in there at all. It would still have to go across the wire, but it would be sending basically a bool instead of a whole Instance object. | 16:03 |
efried | Making a case for the usefulness of that API in the community might be tough. | 16:04 |
mdrabe | I remember discussing that with arnoldje and there was something weird about that but I can't remember what | 16:05 |
*** thorst has joined #openstack-powervm | 16:11 | |
efried | mdrabe 5511 | 16:25 |
efried | thorst ^^ | 16:26 |
mdrabe | thnx | 16:26 |
efried | And I say we merge that spec. | 16:26 |
efried | objections? | 16:26 |
mdrabe | efried +1 | 16:29 |
efried | mdrabe +1 to merging the spec too? | 16:29 |
*** burgerk has joined #openstack-powervm | 16:29 | |
mdrabe | Yea, we'll get some test around | 16:30 |
mdrabe | around it* | 16:30 |
*** smatzek_ has joined #openstack-powervm | 16:35 | |
efried | thorst If you get a chance, clarify that process? | 16:36 |
efried | Talking about merging https://review.openstack.org/#/c/399579/ -- not sure what order that's supposed to happen, or what it commits us to, or whatever. | 16:36 |
thorst | it just means that we will get it done | 16:36 |
thorst | by Pike | 16:36 |
thorst | if already done, then just merge away :-) | 16:37 |
efried | The nova-powervm side will just be updating the pypowervm rev, which the bot will do for us ultimately. | 16:37 |
thorst | nice | 16:37 |
thorst | then yeah, I'm good with the merge | 16:37 |
thorst | I'll do a quick review | 16:37 |
*** smatzek has quit IRC | 16:37 | |
efried | thorst 5511 as well please | 16:37 |
thorst | there are no changes to the resize flow for this? | 16:38 |
efried | thorst AFAICT, the resize flow doesn't ever touch this in nova-powervm. | 16:38 |
thorst | the spec says that the 'resize' will update that attribute | 16:38 |
thorst | so if you deployed it the old way | 16:39 |
efried | I suppose you could mebbe do it via an extra_spec in your flavor when you resize. | 16:39 |
thorst | you could update it to the new way | 16:39 |
efried | wha? | 16:39 |
efried | Right, original flavor has the bit off, new flavor has the bit on. | 16:39 |
efried | But nothing in the community code looks at that field specifically. | 16:40 |
thorst | ok. Yeah, if that's all transparent and this is just a pypowervm change...then +2 | 16:40 |
thorst | which it sounds like it is | 16:40 |
efried | thorst I'm *pretty* sure that's the case. mdrabe said he would get some testing done around it. | 16:40 |
thorst | cool | 16:41 |
thorst | I -1'd 5511...I don't think that attribute was always there | 16:41 |
thorst | seems like a get(attr, False) would be safer | 16:42 |
efried | thorst The attr is definitely there - responded with link. | 16:44 |
*** burgerk_ has joined #openstack-powervm | 16:46 | |
thorst | since beginning of time? | 16:47 |
thorst | well | 16:47 |
thorst | nevermind | 16:47 |
efried | thorst It's pypowervm-to-pypowervm. | 16:50 |
efried | If you're running the code I changed, you're running against the code that always has that field in the dict. | 16:50 |
*** burgerk has quit IRC | 16:51 | |
efried | ...which defaults to False if the REST API doesn't return that field. | 16:51 |
efried | esberglu http://184.172.12.213/95/476695/6/check/nova-powervm-out-of-tree-pvm/77b2712/powervm_os_ci.html -- new test we need to disable? | 16:55 |
efried | esberglu https://review.openstack.org/#/c/413606/ | 17:03 |
efried | esberglu And we don't implement that driver method. | 17:03 |
*** jay1_ has quit IRC | 17:05 | |
*** smatzek has joined #openstack-powervm | 17:07 | |
*** smatzek_ has quit IRC | 17:08 | |
*** burgerk_ has quit IRC | 17:09 | |
esberglu | efried: 5512 | 17:38 |
*** k0da has joined #openstack-powervm | 17:53 | |
efried | mdrabe 5511 is merged. | 17:58 |
*** k0da has quit IRC | 17:58 | |
efried | esberglu +2 | 17:58 |
esberglu | efried: thx | 17:58 |
efried | Instance recheckability? | 17:58 |
efried | Instant* | 17:59 |
efried | esberglu ^ ? | 17:59 |
esberglu | efried: Yep | 17:59 |
efried | schweet | 17:59 |
*** jay1_ has joined #openstack-powervm | 18:05 | |
*** dwayne has quit IRC | 19:01 | |
*** dwayne has joined #openstack-powervm | 19:17 | |
*** jay1_ has quit IRC | 19:35 | |
efried | esberglu Did you rebuild VIOSes recently in any of the CI nodes? | 19:44 |
efried | Wherever this guy ran doesn't have a media repo http://184.172.12.213/95/476695/6/check/nova-powervm-out-of-tree-pvm/feab235/powervm_os_ci.html | 19:45 |
efried | And I guess we don't have the logic to create one if it doesn't exist?? I really thought we did. | 19:45 |
edmondsw | efried added a late comment on 5511 | 19:47 |
efried | edmondsw Okay. You feel like proposing the change? | 19:48 |
efried | (s) | 19:48 |
edmondsw | sure | 19:48 |
esberglu | efried: No not recently. Probably a month ago? | 19:50 |
efried | esberglu Do you have a way to figure out which VIOS that guy ran on, and verify whether there's a media repo there? | 19:51 |
efried | If there ain't, I suspect we may have a timing bug :( | 19:51 |
efried | I mean, if there is. | 19:51 |
openstackgerrit | Merged openstack/nova-powervm master: Updated from global requirements https://review.openstack.org/477984 | 19:53 |
esberglu | efried: Command for checking? | 19:53 |
efried | esberglu Uhhh. Stand by. | 19:54 |
efried | esberglu pvmctl repo list | 19:54 |
esberglu | efried: Yeah it does | 20:12 |
*** thorst has quit IRC | 20:21 | |
*** smatzek has quit IRC | 20:31 | |
*** k0da has joined #openstack-powervm | 20:33 | |
efried | esberglu I rechecked that guy. I expect we'll never see this problem again. Probably not worth fixing tbh. | 20:39 |
esberglu | efried: Sounds good. How did you know that's what it was? Just so I can keep an eye out | 20:40 |
efried | esberglu HTTP error 400 for method PUT on path /rest/api/web/File/contents/91878c76-0088-4bfb-97bc-2589b3cca13c: Bad Request -- The target VIOS does not have a MediaRepository. One must be created before attempting to upload an ISO file into the repository. | 20:40 |
efried | That should never happen. | 20:40 |
efried | Cause we check and create the repo before we use it. | 20:41 |
esberglu | Weird | 20:41 |
efried | And the creation shouldn't be necessary here, cause it already exists. | 20:41 |
efried | Yeah. | 20:41 |
efried | Actually | 20:42 |
efried | This seems like it would have to be a REST server problem. | 20:42 |
efried | esberglu We don't get the REST logs yet, do we? | 20:43 |
esberglu | efried: Nope... | 20:44 |
esberglu | Now that I don't have to redeploy every 2 minutes I'm starting to burn through the backlog a lot quicker | 20:44 |
esberglu | So it should be coming soon | 20:44 |
efried | esberglu Okay, so yeah, that's gotta be a problem on the REST side, and we won't get any debug from changh et al without the logs. | 20:45 |
esberglu | efried: Still a one-off though you're thinking? | 20:46 |
efried | esberglu Unless that pvm-rest and/or VIOS is broke. | 20:46 |
efried | Cause nothing in that code path has changed in forever. | 20:46 |
esberglu | Eh I don't think so. I wasn't seeing any issues on that system | 20:47 |
efried | esberglu Any idea what's going on here? http://184.172.12.213/95/476695/6/check/nova-powervm-out-of-tree-pvm/b6c645f/console.html | 20:47 |
efried | I'm posting another recheck there. | 20:48 |
esberglu | efried: That's the error we used to git when get was failing clones. Except I believe it was error 9 instead of 24 | 20:48 |
esberglu | lol | 20:48 |
esberglu | get when git.o.o | 20:49 |
esberglu | So probably just a networking glitch? We never found the root cause | 20:52 |
*** k0da has quit IRC | 20:54 | |
*** jpasqualetto has quit IRC | 20:59 | |
*** thorst has joined #openstack-powervm | 21:36 | |
*** thorst has quit IRC | 21:42 | |
*** k0da has joined #openstack-powervm | 21:42 | |
*** esberglu has quit IRC | 21:43 | |
*** esberglu has joined #openstack-powervm | 21:58 | |
*** esberglu has quit IRC | 22:04 | |
*** dwayne has quit IRC | 22:06 | |
*** mdrabe has quit IRC | 22:14 | |
*** thorst has joined #openstack-powervm | 22:16 | |
*** thorst has quit IRC | 22:17 | |
*** kylek3h has quit IRC | 22:23 | |
edmondsw | esberglu why would we want to update pypowervm past 1.0.0.4 for ocata CI runs? | 22:51 |
*** dwayne has joined #openstack-powervm | 23:03 | |
*** k0da has quit IRC | 23:22 | |
*** k0da has joined #openstack-powervm | 23:32 | |
*** thorst has joined #openstack-powervm | 23:51 | |
*** thorst has quit IRC | 23:52 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!