| *** svenkat has joined #openstack-powervm | 00:38 | |
| *** thorst_afk has joined #openstack-powervm | 00:40 | |
| *** thorst_afk has quit IRC | 00:43 | |
| *** thorst_afk has joined #openstack-powervm | 00:43 | |
| *** svenkat has quit IRC | 00:47 | |
| *** thorst_afk has quit IRC | 00:47 | |
| *** thorst_afk has joined #openstack-powervm | 01:44 | |
| openstackgerrit | Eric Berglund proposed openstack/nova-powervm master: DNM: ci check https://review.openstack.org/328315 | 01:59 |
|---|---|---|
| *** esberglu has quit IRC | 01:59 | |
| *** thorst_afk has quit IRC | 02:00 | |
| *** esberglu has joined #openstack-powervm | 02:38 | |
| *** esberglu has quit IRC | 02:42 | |
| *** https_GK1wmSU has joined #openstack-powervm | 03:04 | |
| *** https_GK1wmSU has left #openstack-powervm | 03:06 | |
| *** thorst_afk has joined #openstack-powervm | 03:23 | |
| *** thorst_afk has quit IRC | 03:27 | |
| *** thorst_afk has joined #openstack-powervm | 05:23 | |
| *** thorst_afk has quit IRC | 05:28 | |
| *** edmondsw has joined #openstack-powervm | 06:43 | |
| *** esberglu has joined #openstack-powervm | 06:48 | |
| *** edmondsw has quit IRC | 06:48 | |
| *** esberglu has quit IRC | 06:52 | |
| *** cjvolzka has quit IRC | 06:56 | |
| *** thorst_afk has joined #openstack-powervm | 07:24 | |
| *** thorst_afk has quit IRC | 07:29 | |
| *** edmondsw has joined #openstack-powervm | 08:31 | |
| *** openstackgerrit has quit IRC | 08:33 | |
| *** edmondsw has quit IRC | 08:36 | |
| *** thorst_afk has joined #openstack-powervm | 09:25 | |
| *** esberglu has joined #openstack-powervm | 09:30 | |
| *** thorst_afk has quit IRC | 09:30 | |
| *** esberglu has quit IRC | 09:34 | |
| *** edmondsw has joined #openstack-powervm | 10:19 | |
| *** edmondsw has quit IRC | 10:24 | |
| *** smatzek_ has joined #openstack-powervm | 11:12 | |
| *** esberglu has joined #openstack-powervm | 11:18 | |
| *** thorst_afk has joined #openstack-powervm | 11:21 | |
| *** esberglu has quit IRC | 11:23 | |
| *** edmondsw has joined #openstack-powervm | 11:29 | |
| *** edmondsw has quit IRC | 11:31 | |
| *** smatzek_ is now known as smatzek | 12:21 | |
| *** svenkat has joined #openstack-powervm | 12:21 | |
| *** svenkat_ has joined #openstack-powervm | 12:27 | |
| *** svenkat has quit IRC | 12:28 | |
| *** svenkat_ is now known as svenkat | 12:28 | |
| *** edmondsw has joined #openstack-powervm | 12:33 | |
| *** openstackgerrit has joined #openstack-powervm | 12:58 | |
| openstackgerrit | Matthew Edmonds proposed openstack/nova-powervm master: force python2.7 for tox pep8 https://review.openstack.org/490014 | 12:58 |
| edmondsw | efried ^ for the issue we were talking about yesterday | 13:01 |
| edmondsw | esberglu ^ | 13:01 |
| efried | edmondsw ack | 13:02 |
| *** apearson has joined #openstack-powervm | 13:06 | |
| *** esberglu has joined #openstack-powervm | 13:11 | |
| esberglu | efried: Tossed that change on staging last night, all looked good. About to kick off the image rebuild. | 13:14 |
| esberglu | Then I just need to wait for the current ready nodes to clear out (which I will speed up by deleting any without runs going yet) | 13:15 |
| efried | esberglu Cool man. Please let me know when done, or post rechecks on https://review.openstack.org/476274 & https://review.openstack.org/476945 | 13:15 |
| esberglu | efried: Will do. I'm curious to see how this affects success rates | 13:18 |
| efried | esberglu Can't think offhand how many pypowervm changes we've made since 1.1.4 expressly with the goal of fixing/improving CI. | 13:19 |
| efried | esberglu Nothing except power_off. | 13:20 |
| efried | But that one was definitely buggy until 1.1.6. | 13:21 |
| esberglu | efried: Yeah. Which might explain some of the timeouts on rebuild tests | 13:21 |
| efried | yup. | 13:21 |
| efried | Hopefully those go away. | 13:22 |
| efried | 'cept... | 13:22 |
| efried | The bug in pypowervm shouldn't have affected the community code. It was only exposed by the way pvmctl was using it. | 13:22 |
| efried | So I'm actually not expecting it to fix those timeouts - at least not for change sets other than the above two. | 13:23 |
| efried | Which means: after this, if we still see timeouts consistently, we should really dig in and try to figure out WHY. <== edmondsw esberglu thorst_afk | 13:24 |
| efried | Cause I wanna say those have been plaguing us for a while. | 13:24 |
| edmondsw | efried yeah, I think we all agree that we need to get to the bottom of those, but we keep getting sidetracked | 13:25 |
| efried | yeah | 13:25 |
| *** kylek3h has joined #openstack-powervm | 13:29 | |
| -openstackstatus- NOTICE: We have disable infracloud-vanilla due to the compute host running mirror.regionone.infracloud-vanilla.o.o being offline. Please recheck your failed jobs to schedule them to another cloud. | 13:57 | |
| esberglu | efried: Posted rechecks on those patches. The image is still building but those runs will be close to the top of the queue once the new nodes are ready | 13:58 |
| *** apearson has quit IRC | 14:00 | |
| efried | esberglu Thanks. | 14:07 |
| *** apearson has joined #openstack-powervm | 14:25 | |
| *** kylek3h has quit IRC | 14:39 | |
| *** smatzek has quit IRC | 14:47 | |
| esberglu | efried: I'm heading out for the roch. summer outing. The ready nodes are spawning and should be running tempest within the hour. If the results from those runs is weird or anything else seems off slack me and I will take a look when I get back | 14:57 |
| efried | esberglu Ack, have fun. | 14:57 |
| esberglu | Thanks | 14:57 |
| *** thorst_afk has quit IRC | 15:14 | |
| *** thorst_afk has joined #openstack-powervm | 16:55 | |
| thorst_afk | efried: your demands for UT have caused me to find a bug in my new metrics code | 17:24 |
| *** edmondsw has quit IRC | 19:15 | |
| *** edmondsw has joined #openstack-powervm | 19:17 | |
| *** edmondsw has quit IRC | 19:21 | |
| *** edmondsw has joined #openstack-powervm | 19:23 | |
| *** edmondsw has quit IRC | 19:27 | |
| *** edmondsw has joined #openstack-powervm | 19:29 | |
| *** edmondsw has quit IRC | 19:33 | |
| *** edmondsw has joined #openstack-powervm | 19:35 | |
| *** edmondsw has quit IRC | 19:39 | |
| *** svenkat has quit IRC | 19:40 | |
| *** edmondsw has joined #openstack-powervm | 19:41 | |
| *** edmondsw has quit IRC | 19:45 | |
| *** edmondsw has joined #openstack-powervm | 19:46 | |
| efried | edmondsw Responded in https://review.openstack.org/#/c/471146/ | 19:47 |
| efried | It turns out I *did* send out a ML notice. | 19:47 |
| *** edmondsw has quit IRC | 19:47 | |
| *** edmondsw has joined #openstack-powervm | 19:47 | |
| efried | edmondsw Responded in https://review.openstack.org/#/c/471146/ | 19:48 |
| efried | It turns out I *did* send out a ML notice. | 19:48 |
| *** edmondsw has quit IRC | 19:50 | |
| *** apearson has quit IRC | 19:57 | |
| *** edmondsw has joined #openstack-powervm | 20:01 | |
| *** apearson has joined #openstack-powervm | 20:04 | |
| *** edmondsw has quit IRC | 20:05 | |
| *** edmondsw has joined #openstack-powervm | 20:07 | |
| *** edmondsw has quit IRC | 20:09 | |
| *** edmondsw has joined #openstack-powervm | 20:10 | |
| edmondsw | efried good enough for me... I'll change to +1 | 20:12 |
| edmondsw | efried is the CI still borked? | 20:18 |
| efried | It seems to be. esberglu | 20:18 |
| edmondsw | seeing a lot of failures... is there a way to tell if anything is passing? | 20:18 |
| efried | edmondsw I think there's a jenkins-ish dashboard of some kind. But I don't know where it is. | 20:18 |
| edmondsw | I'll see if I can find it | 20:19 |
| *** apearson has quit IRC | 20:20 | |
| efried | edmondsw There's also this: http://ci-watch.tintri.com/project?project=nova | 20:22 |
| efried | Most recent on the left. | 20:22 |
| efried | Our CI looks pretty shitty. | 20:22 |
| edmondsw | efried cool... so it is working intermittently | 20:23 |
| edmondsw | but not well | 20:23 |
| efried | I'm not sure if it's working at all. | 20:24 |
| efried | Yeah I guess it is. | 20:24 |
| efried | "Server Fault" - that's helpful. We need to look into that. | 20:25 |
| edmondsw | efried "no available compute node found"... wasn't esberglu taking some nodes out of service to do something and maybe they didn't come back properly? | 20:28 |
| efried | edmondsw If you're seeing that in an openstack log of any kind, it has nothing to do with CI nodes being in or out of the pool. | 20:29 |
| edmondsw | oh, ok | 20:29 |
| edmondsw | yeah, that was here: http://184.172.12.213/46/471146/6/check/nova-in-tree-pvm/50bef07/powervm_os_ci.html | 20:29 |
| efried | zoinks, that looks like a cellsv2 problem edmondsw | 20:50 |
| efried | As if discover-hosts didn't run or didn't succeed. | 20:51 |
| edmondsw | yeah, I don't know why I was thinking of the nodes changes... | 20:53 |
| edmondsw | efried I've seen that in a few runs today | 20:54 |
| edmondsw | not sure if they were all on that patch set or not... | 20:54 |
| edmondsw | I don't think so... | 20:54 |
| efried | edmondsw Need to look at the stack logs and see if the discover-hosts thing looks copacetic. | 20:56 |
| esberglu | efried: edmondsw: Hey just got back. Gonna relocate home and then look into this, don't have my charger here | 21:06 |
| *** thorst_afk has quit IRC | 21:06 | |
| edmondsw | esberglu sure, tx | 21:06 |
| *** apearson has joined #openstack-powervm | 21:08 | |
| *** esberglu has quit IRC | 21:08 | |
| *** thorst_afk has joined #openstack-powervm | 21:11 | |
| *** thorst_afk has quit IRC | 21:15 | |
| *** smatzek has joined #openstack-powervm | 21:15 | |
| *** smatzek has quit IRC | 21:29 | |
| *** esberglu has joined #openstack-powervm | 21:37 | |
| *** edmondsw has quit IRC | 21:39 | |
| *** edmondsw has joined #openstack-powervm | 21:40 | |
| *** edmondsw has quit IRC | 21:46 | |
| *** thorst_afk has joined #openstack-powervm | 21:46 | |
| *** thorst_afk has quit IRC | 21:50 | |
| *** efried has quit IRC | 22:32 | |
| *** apearson has quit IRC | 22:32 | |
| *** svenkat has joined #openstack-powervm | 23:49 | |
| *** thorst_afk has joined #openstack-powervm | 23:55 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!