| *** edmondsw has joined #openstack-powervm | 01:32 | |
| *** edmondsw has quit IRC | 01:36 | |
| *** edmondsw has joined #openstack-powervm | 03:20 | |
| *** edmondsw has quit IRC | 03:24 | |
| *** tjakobs has joined #openstack-powervm | 03:33 | |
| *** tjakobs has quit IRC | 03:43 | |
| *** edmondsw has joined #openstack-powervm | 06:56 | |
| *** edmondsw has quit IRC | 07:00 | |
| *** edmondsw has joined #openstack-powervm | 08:44 | |
| *** edmondsw has quit IRC | 08:49 | |
| *** edmondsw has joined #openstack-powervm | 10:32 | |
| *** edmondsw has quit IRC | 10:36 | |
| *** edmondsw has joined #openstack-powervm | 12:32 | |
| *** edmondsw has quit IRC | 12:36 | |
| *** edmondsw has joined #openstack-powervm | 12:38 | |
| *** esberglu has joined #openstack-powervm | 12:38 | |
| *** edmondsw has quit IRC | 12:42 | |
| *** edmondsw has joined #openstack-powervm | 12:44 | |
| *** edmondsw has quit IRC | 12:48 | |
| *** edmondsw has joined #openstack-powervm | 12:49 | |
| *** mmedvede has quit IRC | 12:58 | |
| *** efried has quit IRC | 13:03 | |
| *** efried has joined #openstack-powervm | 13:04 | |
| *** adreznec_ has joined #openstack-powervm | 13:09 | |
| *** openstackgerrit has quit IRC | 13:11 | |
| *** adreznec has quit IRC | 13:11 | |
| *** adreznec_ is now known as adreznec | 13:11 | |
| *** mmedvede has joined #openstack-powervm | 13:26 | |
| *** AlexeyAbashkin has joined #openstack-powervm | 13:28 | |
| *** efried has quit IRC | 13:34 | |
| *** efried has joined #openstack-powervm | 13:34 | |
| *** chhagarw has joined #openstack-powervm | 13:53 | |
| *** tjakobs has joined #openstack-powervm | 13:58 | |
| *** chhagarw has quit IRC | 14:00 | |
| *** chhagarw has joined #openstack-powervm | 14:00 | |
| *** openstackgerrit has joined #openstack-powervm | 14:03 | |
| openstackgerrit | Eric Fried proposed openstack/nova-powervm master: Fix boot volume connectivity type discovery https://review.openstack.org/566420 | 14:03 |
|---|---|---|
| efried | edmondsw, mdrabe, tjakobs: ^ | 14:04 |
| edmondsw | efried ack | 14:05 |
| *** chhagarw has quit IRC | 14:06 | |
| *** AlexeyAbashkin has quit IRC | 14:36 | |
| openstackgerrit | Eric Fried proposed openstack/nova-powervm master: Fix boot volume connectivity type discovery https://review.openstack.org/566420 | 15:11 |
| edmondsw | efried looks good overall, couple minor things maybe you can change quick | 15:43 |
| edmondsw | and I sent a note about some stuff that might lead to a followon | 15:44 |
| efried | edmondsw: saw the note. No action on my part atm, right? | 15:45 |
| edmondsw | not for the note, no, but check the minor comments I put in the review | 15:45 |
| openstackgerrit | Eric Fried proposed openstack/nova-powervm master: Fix boot volume connectivity type discovery https://review.openstack.org/566420 | 15:47 |
| efried | edmondsw: ^ | 15:47 |
| edmondsw | efried +2 | 15:48 |
| efried | thx | 15:48 |
| edmondsw | efried what's the plan on https://review.openstack.org/#/c/563314/ ? | 15:48 |
| efried | edmondsw: Trying to remember where we left all of that. | 15:49 |
| efried | We fixed it in pypowervm but can't backport the req bump | 15:49 |
| efried | (which still hasn't merged btw) | 15:49 |
| efried | but they are reverting that part of the thing that broke us anyway. | 15:50 |
| efried | but I don't know if they've done that yet, or if they have whether the revert has been released yet. | 15:50 |
| edmondsw | efried so we still need 563314 for stable branches, where we can't bump pypowervm, right? | 15:51 |
| efried | no, we shouldn't, because https://review.openstack.org/#/q/I178f14cdc670d7a696778891e587ef75de208fc2 | 15:51 |
| edmondsw | oh ok | 15:51 |
| edmondsw | so abandon? | 15:52 |
| efried | well, only if ^ has been released on stable etc. | 15:52 |
| efried | and whatever version was broken ought to be blacklisted in requirements. | 15:52 |
| edmondsw | I thought the oslo.versionedobjects changes were never released on stable | 15:53 |
| edmondsw | i.e., no broken version exists | 15:53 |
| efried | Except we were somehow broken on stable, weren't we? | 15:53 |
| efried | or maybe that was anecdotal and never confirmed. | 15:53 |
| edmondsw | I think that may have been theory? | 15:53 |
| edmondsw | esberglu you remember? | 15:53 |
| efried | I abandoned. | 15:54 |
| esberglu | efried: I ran manual runs on stable and never had any issues | 15:54 |
| esberglu | edmondsw: ^ | 15:54 |
| efried | okay | 15:54 |
| edmondsw | efried then again, I think Vlad had said he hit this with stable/queens. I'm not sure how, though | 15:56 |
| efried | right | 15:56 |
| edmondsw | I distinctly remember mriedem pointing out that oslo.versionedobjects hadn't released the change that broke this | 15:56 |
| efried | edmondsw: Oh, are you composing a reply to Vlad? | 15:59 |
| efried | so I should quit doing that? | 15:59 |
| efried | now I remember - I talked to Vlad and he had the correct version of oslo-versionedobjects installed, but thought he might at some point have had a pip snafu, so we're not completely sure it was truly a queens deploy he was broken on. | 16:01 |
| efried | edmondsw: I responded to Vlad. | 16:06 |
| *** openstackgerrit has quit IRC | 16:19 | |
| esberglu | efried: edmondsw: I disabled all zuul jobs in production CI. This allowed nodes to be added to jenkins, but no jobs were being launched on them. I no longer saw the nodes being connected/disconnected | 16:20 |
| esberglu | I've now enabled CI on nova-powervm only | 16:20 |
| esberglu | I'm going to see if we can get runs going through at a lower capacity | 16:20 |
| esberglu | And narrow down if this is a capacity issue or other issue | 16:21 |
| esberglu | If it's capacity, it would make sense why we aren't seeing this on staging (the bad nic type was an issue, but capacity wasn't) | 16:22 |
| esberglu | I have no idea why upgrading from ocata to queens would cause this though | 16:22 |
| esberglu | efried: edmondsw: Either of you good at debugging ssh connections? | 16:23 |
| esberglu | If it isn't a capacity thing, I'm running out of ideas | 16:23 |
| efried | hah, punt | 16:23 |
| efried | I nominate the security guy | 16:24 |
| esberglu | efried: edmondsw: If it does end up being a capacity issue, we can stop running CI on all nova changes and make IT CI on demand for a while | 16:25 |
| esberglu | Just update so that it only runs on "powervm:intree-check" or something like that | 16:26 |
| efried | or keyed on changes in certain paths | 16:26 |
| esberglu | efried: Yeah that's probably better tbh, we probably still can't merge the IT code if it's on demand scenario CI only | 16:27 |
| edmondsw | esberglu what kind of capacity are we talking? | 16:36 |
| edmondsw | efried no, I'm gonna let you reply to Vlad | 16:36 |
| efried | good, cause I did | 16:37 |
| edmondsw | cool | 16:37 |
| esberglu | edmondsw: Ugh a run just failed. I had 4 runs going simultaneously | 16:37 |
| esberglu | It made it farther than most were when I was running a full load though (20+ at a time) | 16:38 |
| efried | edmondsw: I'm thinking we want to wait for e.g. gfm to look at that connectivity type patch before we merge it? | 17:12 |
| edmondsw | efried agreed | 17:13 |
| edmondsw | fyi, he and I are presenting to a customer atm so responses will be delayed | 17:13 |
| efried | I'm in no hurry. | 17:17 |
| *** efried1 has joined #openstack-powervm | 20:46 | |
| *** efried has quit IRC | 20:53 | |
| *** efried1 is now known as efried | 20:53 | |
| *** edmondsw has quit IRC | 21:15 | |
| *** edmondsw has joined #openstack-powervm | 21:15 | |
| *** esberglu has quit IRC | 21:20 | |
| *** edmondsw has quit IRC | 21:20 | |
| *** esberglu has joined #openstack-powervm | 21:33 | |
| *** tjakobs has quit IRC | 21:49 | |
| -openstackstatus- NOTICE: Any devstack job failure due to rsync errors related to tripleo-incubator can safely be rechecked now | 22:57 | |
| *** esberglu has quit IRC | 23:31 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!