*** thorst has joined #openstack-powervm | 00:02 | |
*** thorst has quit IRC | 00:07 | |
*** svenkat has quit IRC | 00:22 | |
*** thorst has joined #openstack-powervm | 00:34 | |
*** thorst has quit IRC | 00:38 | |
*** thorst has joined #openstack-powervm | 01:38 | |
*** edmondsw has joined #openstack-powervm | 01:41 | |
*** thorst has quit IRC | 01:43 | |
*** edmondsw has quit IRC | 01:46 | |
*** apearson has joined #openstack-powervm | 02:31 | |
*** thorst has joined #openstack-powervm | 02:40 | |
*** thorst has quit IRC | 02:58 | |
*** efried has quit IRC | 03:04 | |
*** efried has joined #openstack-powervm | 03:14 | |
*** edmondsw has joined #openstack-powervm | 03:30 | |
*** edmondsw has quit IRC | 03:34 | |
*** apearson has quit IRC | 04:04 | |
*** apearson has joined #openstack-powervm | 04:05 | |
*** shyama has joined #openstack-powervm | 04:06 | |
openstackgerrit | Shyama proposed openstack/nova-powervm master: Update File i/o to support live-migration and use slot map https://review.openstack.org/432322 | 04:12 |
---|---|---|
*** apearson has quit IRC | 04:35 | |
*** thorst has joined #openstack-powervm | 04:55 | |
*** thorst has quit IRC | 05:00 | |
*** tonyb_ is now known as tonyb | 05:25 | |
*** thorst has joined #openstack-powervm | 05:56 | |
*** thorst has quit IRC | 06:01 | |
*** thorst has joined #openstack-powervm | 06:57 | |
*** thorst has quit IRC | 07:01 | |
*** k0da has joined #openstack-powervm | 07:29 | |
*** thorst has joined #openstack-powervm | 07:57 | |
*** thorst has quit IRC | 08:17 | |
*** thorst has joined #openstack-powervm | 09:14 | |
*** thorst has quit IRC | 09:18 | |
*** thorst has joined #openstack-powervm | 11:15 | |
*** thorst has quit IRC | 11:19 | |
*** thorst has joined #openstack-powervm | 11:41 | |
*** smatzek has joined #openstack-powervm | 11:44 | |
*** smatzek has quit IRC | 11:46 | |
*** smatzek has joined #openstack-powervm | 11:46 | |
*** edmondsw has joined #openstack-powervm | 12:10 | |
efried | thorst Any idea how we bring https://review.openstack.org/#/c/453301/ to the attention of someone who can merge it? | 12:18 |
*** jpasqualetto has joined #openstack-powervm | 12:18 | |
efried | (Is tonyb such a one?) | 12:18 |
efried | thorst https://review.openstack.org/#/c/432322/ is good by me. Need a final nod from you. | 12:20 |
*** jpasqualetto has quit IRC | 12:27 | |
thorst | efried: looking ... sorry for being slow...debugging another gigantic broadcast storm in our SVT env... | 12:31 |
thorst | efried: on 453301, I'd say tonyb. | 12:35 |
efried | thorst Oh, tonyb is on medical leave. | 12:38 |
thorst | hmm...not sure then | 12:39 |
*** jpasqualetto has joined #openstack-powervm | 12:39 | |
thorst | adreznec: ? | 12:39 |
efried | I'll ask sdague. He's the one who mentioned eventlet changes. | 12:39 |
thorst | ahh, good idea. | 12:40 |
efried | thorst Still needing you to review https://review.openstack.org/#/c/453233/ when you get a chance. As soon as that requirements change goes through, that's eligible. | 12:42 |
thorst | what does IMAGE_API.download return back to us there? | 12:43 |
thorst | I had actually reviewed it...but didn't hit +2 yet | 12:43 |
efried | The iterable chunks thingy. | 12:43 |
efried | thorst https://github.com/openstack/nova/blob/master/nova/image/glance.py#L296 the result of that guy | 12:44 |
thorst | the chunky monkey...got it | 12:44 |
*** svenkat has joined #openstack-powervm | 12:44 | |
efried | sdague +2ed the reqs change. | 12:47 |
openstackgerrit | Merged openstack/nova-powervm master: Update File i/o to support live-migration and use slot map https://review.openstack.org/432322 | 12:48 |
thorst | nice | 12:48 |
efried | shyama ^^ FYI | 12:50 |
-openstackstatus- NOTICE: The Gerrit service on http://review.openstack.org is being restarted to address hung remote replication tasks, and should return to an operable state momentarily | 12:52 | |
*** svenkat has quit IRC | 12:52 | |
*** svenkat has joined #openstack-powervm | 12:52 | |
BorD__ | quick question, if you select default processor compatibility mode with a POWER8 server, and you boot VIOS, what processor mode should it be running in? | 13:12 |
waler | power7 | 13:13 |
adreznec | BorD__: I believe it runs in POWER7 proc compat mode by default | 13:13 |
BorD__ | is there a reason for that? | 13:13 |
waler | yep | 13:14 |
waler | it's based on AIX6.1 | 13:14 |
adreznec | Yep, that's the reason | 13:14 |
waler | AIX 6.1 supported POWER8, but didn't exploit it (whereas 7.x did) | 13:15 |
BorD__ | thanks! on another note, have you seen a concise document that gives HMC and NIM ports for use through a firewall? I have seen http://www-01.ibm.com/support/docview.wss?uid=isg3T1011808 and http://www-01.ibm.com/support/docview.wss?uid=nas8N1019111 | 13:16 |
BorD__ | I was hoping for something I could just hand off to firewall guys instead of making them read all of this. | 13:17 |
*** mdrabe has joined #openstack-powervm | 13:17 | |
*** esberglu has joined #openstack-powervm | 13:18 | |
esberglu | efried: thorst: Production CI spawned the ready nodes, but the local2remote stuff is broken | 13:18 |
efried | esberglu Right, I shoulda thought of that. Let me get you a fix right quick. | 13:19 |
efried | esberglu Wait, when you say it's broken, do you mean the patch won't apply, or it applies but doesn't work? | 13:20 |
esberglu | efried: It applies but doesn't work | 13:22 |
efried | esberglu What's the symptom | 13:22 |
esberglu | efried: Something about the novalink packages not being installed. One sec and I can get the actual message | 13:23 |
esberglu | Unable to connect to the NovaLink services. Check to make sure the pvm-core and pvm-rest services are running (systemctl status), and verify that this partition has PowerVM management authority. If you are currently updating pvm-novalink, you may see this error. Wait for the update to finish, then try again. | 13:24 |
esberglu | When trying to do pvmctl commands | 13:25 |
efried | esberglu Are you sure you're updating the right copy of pypowervm? | 13:25 |
efried | Note that 1.1.1 was published last night, if that makes a difference to ya. | 13:25 |
esberglu | Nah this is on develop | 13:25 |
*** tjakobs__ has joined #openstack-powervm | 13:25 | |
waler | BorD__, that NIM URL has a good breakdown list a fair way into the document. The HMC one is a bit more catch-all, as it can depend on what you hoping to work "behind the firewall." | 13:25 |
BorD__ | yeah I agree, however I am running into firewall guys that do not want to read, and i was hoping i could just point to an ibm blessed page that just had the list. We will make do. Thanks again! | 13:26 |
esberglu | efried: I rebased the patch last night but that made no difference | 13:30 |
efried | esberglu Yeah, it shouldn't have been a merge conflict. | 13:31 |
efried | Do you have a system where this is happening? | 13:31 |
efried | esberglu Yeah, so pvmctl is actually using the pypowervm in /usr/local/lib, not the one in /opt/stack | 13:35 |
efried | jenkins@powervm-ci-powervm-devstacked-9356:/home/powervmci$ python -c 'import pypowervm; print pypowervm.__file__' | 13:36 |
efried | okeeeeey, not sure why the second line isn't printing. | 13:36 |
efried | Also pip show pypowervm | 13:37 |
efried | If you're gonna clone a pypowervm into /opt/stack, you've gotta pip install -e it. | 13:37 |
esberglu | The one in /usr/local/lib has the patch | 13:37 |
efried | eaux | 13:37 |
openstackgerrit | Merged openstack/nova-powervm master: Updated from global requirements https://review.openstack.org/451045 | 13:39 |
*** jpasqualetto_ has joined #openstack-powervm | 13:43 | |
*** jpasqualetto has quit IRC | 13:43 | |
*** jpasqualetto_ has quit IRC | 13:44 | |
*** jpasqualetto has joined #openstack-powervm | 13:44 | |
*** smatzek has quit IRC | 13:46 | |
*** tjakobs__ has quit IRC | 13:59 | |
a1fisher | Hi Guys, quick question on running the powervm-sea-agent. I'm assuming I need to run 'networking-powervm-sea-agent'? If so I'm getting a | 14:08 |
a1fisher | sorry an error "MultiBridgeNoMapping: The system has more than one network bridge, but the bridge_mappings have not been specified. Please configure the bridge_mappings before proceeding." I have bridge_mapping set in the mls ini file. | 14:09 |
*** smatzek has joined #openstack-powervm | 14:10 | |
thorst | a1fisher: paste your bridge_mapping (its a slightly different format). Also make sure you specify --config-file when you start the process | 14:10 |
*** nbante has joined #openstack-powervm | 14:11 | |
a1fisher | Ah, looks like it was the --config-file option that was missing. Seems to be working with ./networking-powervm-sea-agent --config-file /etc/neutron/plugins/ml2/ml2_conf.ini | 14:17 |
a1fisher | Do you guys run the agent as a service normally? | 14:17 |
thorst | a1fisher: all depends on the distribution...but I believe most run as a service | 14:18 |
thorst | our devstacks run as a screen...but that's generally only useful for development and is awful for the real world | 14:18 |
a1fisher | ok, thanks for your help. On to the next issue :-) | 14:18 |
thorst | heh | 14:21 |
*** apearson has joined #openstack-powervm | 14:25 | |
waler | a1fisher, I'm sure once we get the first compute integrated, things will become more obvious how things are supposed to work together (he says being optimistic) | 14:26 |
*** shyama has quit IRC | 14:34 | |
thorst | waler: what could go wrong | 14:41 |
thorst | ;-) | 14:41 |
efried | thorst https://review.openstack.org/453301 is merging now. Since https://review.openstack.org/453233 has a Depends-On, it could get +W and it would wait behind that guy anyway. | 14:47 |
efried | Though I wouldn't mind seeing the latter go through CI first (esberglu) | 14:47 |
thorst | efried: yeah, maybe lets let it run through CI? | 14:49 |
esberglu | efried: The ready nodes are about to start spawning. So assuming installing pvm-rest-server-dev fixed the last of the problems (I think it did) | 14:49 |
esberglu | We should be able to get runs through within the hour | 14:49 |
thorst | https://pbs.twimg.com/media/Bp11KmKCUAAp9pz.jpg | 14:50 |
*** efried has quit IRC | 14:52 | |
*** shyama has joined #openstack-powervm | 14:56 | |
*** tjakobs__ has joined #openstack-powervm | 15:00 | |
*** mdrabe has quit IRC | 15:13 | |
*** mdrabe has joined #openstack-powervm | 15:20 | |
esberglu | efried: thorst: CI is back up | 15:28 |
thorst | esberglu: exceeding expectations once again | 15:32 |
thorst | I'll kick off a recheck since efried has gone AWOL | 15:33 |
*** chas has joined #openstack-powervm | 15:33 | |
*** chas has quit IRC | 15:35 | |
thorst | esberglu: didn't the recheck command change recently? Its not 'recheck powervm' anymore? | 15:35 |
esberglu | powervm: recheck | 15:35 |
*** chas has joined #openstack-powervm | 15:36 | |
thorst | makes sense | 15:36 |
esberglu | or powevm-recheck, powervm recheck, powervm:recheck | 15:36 |
esberglu | With any sort of whitespace in between | 15:36 |
esberglu | Because recheck powervm was kicking off rechecks for pretty much everything | 15:36 |
thorst | yep | 15:37 |
thorst | I remembered that bit :) | 15:37 |
esberglu | Runs are failing right now, one of the pypowervm patches we apply needs a rebase | 15:38 |
esberglu | I'm fixing it now | 15:38 |
thorst | esberglu: ok | 15:38 |
*** chas has quit IRC | 15:40 | |
*** k0da has quit IRC | 15:42 | |
esberglu | thorst: I'm having a weird issue trying to push the rebase up | 15:42 |
esberglu | http://paste.openstack.org/show/605521/ | 15:43 |
esberglu | It says 4726 is closed | 15:43 |
esberglu | But the actual change is number 4727 | 15:43 |
esberglu | thorst: Worked around it | 15:47 |
esberglu | Should be back in business now | 15:48 |
openstackgerrit | Eric Berglund proposed openstack/nova-powervm master: DNM: ci check https://review.openstack.org/328315 | 15:51 |
*** nbante has quit IRC | 15:53 | |
*** efried has joined #openstack-powervm | 16:07 | |
*** chas has joined #openstack-powervm | 16:11 | |
efried | esberglu We shouldn't need 4727 (Abort the fifo pipe) anymore. | 16:13 |
*** chas has quit IRC | 16:15 | |
efried | esberglu Just kill it. | 16:17 |
esberglu | Yeah I was just about to ask you about that | 16:17 |
efried | I'm proposing. | 16:19 |
efried | esberglu 5097 | 16:19 |
efried | Until https://review.openstack.org/#/c/453233/ merges, OOT CI runs (on unrelated changes) may be broken. But they woulda been anyway. | 16:20 |
efried | Fortunately (!?) you got a reprieve because https://review.openstack.org/#/c/453301/ glitched in the gate while merging. | 16:21 |
*** chas has joined #openstack-powervm | 16:21 | |
*** shyama has quit IRC | 16:23 | |
*** esberglu has quit IRC | 16:24 | |
*** esberglu has joined #openstack-powervm | 16:24 | |
*** chas has quit IRC | 16:26 | |
*** esberglu has quit IRC | 16:29 | |
*** esberglu has joined #openstack-powervm | 16:43 | |
*** apearson has quit IRC | 16:46 | |
*** apearson has joined #openstack-powervm | 16:48 | |
*** apearson has quit IRC | 16:50 | |
*** apearson has joined #openstack-powervm | 16:52 | |
*** shyama has joined #openstack-powervm | 16:56 | |
*** apearson has quit IRC | 17:19 | |
esberglu | thorst: adreznec: Man CI just isn't cooperating right now. Nodepool is failing to detect and delete nodes that have been used already | 17:21 |
thorst | is the cleanup just not working? | 17:21 |
esberglu | I think it is a problem with nodepool, not with our post run cleanup script. If that's what you mean | 17:25 |
esberglu | Normally post run nodepool detects that the run completed and deletes the node from jenkins then deletes the instance | 17:25 |
esberglu | (at least I'm pretty sure it's nodepool responsible for that) | 17:26 |
*** dwayne__ has quit IRC | 17:27 | |
*** apearson has joined #openstack-powervm | 17:33 | |
esberglu | We aren't on the latest nodepool, I wonder if we need to upgrade. Looking into what it takes to move from 0.3.0 to 0.4.0 | 17:35 |
thorst | esberglu: we do have those in VMs and we could backup the image. | 17:36 |
esberglu | thorst: Have what in vms? | 17:37 |
thorst | esberglu: the nodepool | 17:39 |
esberglu | I'm not following what you mean | 17:39 |
thorst | basically, I could snapshot the VM. Then if you screw up nodepool we could revert | 17:46 |
thorst | (although, we have playbooks to rebuild the nodepool, so it doesn't really matter) | 17:46 |
esberglu | Yeah I was just gonna do a management redeploy | 17:47 |
thorst | ahh, OK | 17:48 |
esberglu | Looks like we have to set up a "zookeeper cluster" with nodepool 0.4.0 | 17:48 |
esberglu | No idea what that entails | 17:48 |
esberglu | Reading through the email chain from the 0.4.0 release | 17:48 |
adreznec | esberglu: should we just pin on an older release for now? | 18:00 |
esberglu | We are pinned on an older release | 18:00 |
esberglu | 0.3.0 | 18:00 |
adreznec | Ah ok | 18:01 |
adreznec | that's what I thought | 18:01 |
esberglu | Idk why it suddenly isn't working | 18:01 |
adreznec | I figured maybe we unpinned or something since you talked about 0.4.0 | 18:01 |
esberglu | I wonder if something just got messed up during the deploy. I'm gonna try redeploying mgmt while I look into 0.4.0 | 18:02 |
adreznec | Seems reasonable | 18:03 |
*** jpasqualetto has quit IRC | 18:06 | |
esberglu | I'm killing all of the current runs. Shouldn't affect anyone since they were gonna fail anyway until 5099 gets in | 18:07 |
*** dwayne__ has joined #openstack-powervm | 18:20 | |
*** jpasqualetto has joined #openstack-powervm | 18:22 | |
*** jpasqualetto has quit IRC | 18:34 | |
*** chas has joined #openstack-powervm | 18:36 | |
*** chas has quit IRC | 18:40 | |
*** jpasqualetto has joined #openstack-powervm | 18:50 | |
thorst | efried: see comment on 5096 | 19:11 |
esberglu | Still trying to get the CI back up, just one thing after another at this point | 19:15 |
esberglu | Now mysql won't start on the mgmt node | 19:15 |
*** shyama has quit IRC | 19:26 | |
*** k0da has joined #openstack-powervm | 19:30 | |
*** mdrabe_ has joined #openstack-powervm | 19:30 | |
efried | thorst 5096 back atcha. | 19:31 |
*** mdrabe has quit IRC | 19:31 | |
*** smatzek has quit IRC | 19:40 | |
*** apearson has quit IRC | 19:57 | |
*** apearson has joined #openstack-powervm | 20:03 | |
*** smatzek has joined #openstack-powervm | 20:07 | |
esberglu | I'm hoping that the issues deleting the nodes was somehow tied into the mysql issue | 20:07 |
esberglu | I got past the mysql thing so *fingers crossed* CI is coming back up | 20:08 |
*** mdrabe__ has joined #openstack-powervm | 20:36 | |
*** mdrabe_ has quit IRC | 20:37 | |
*** mdrabe__ is now known as mdrabe | 20:47 | |
openstackgerrit | OpenStack Proposal Bot proposed openstack/nova-powervm master: Updated from global requirements https://review.openstack.org/453865 | 20:49 |
*** thorst has quit IRC | 20:50 | |
*** thorst has joined #openstack-powervm | 20:51 | |
*** thorst has quit IRC | 20:55 | |
efried | adreznec Guess we take ^^ and remove same from 453233 | 21:00 |
*** svenkat has quit IRC | 21:01 | |
adreznec | efried: Yup, seems reasonable | 21:04 |
openstackgerrit | Merged openstack/nova-powervm master: Updated from global requirements https://review.openstack.org/453865 | 21:07 |
*** k0da has quit IRC | 21:12 | |
*** smatzek has quit IRC | 21:13 | |
*** thorst has joined #openstack-powervm | 21:18 | |
*** k0da has joined #openstack-powervm | 21:20 | |
*** thorst has quit IRC | 21:22 | |
efried | adreznec esberglu (tjakobs__ thorst): https://review.openstack.org/#/q/topic:bug/1679720 -- removed requirements.txt change, manually cherry-picked back to ocata & newton. tjakobs__ and I tested the backports with stock pypowervm relevant to each release; and with 1.1.1. | 21:40 |
esberglu | Awesome | 21:40 |
esberglu | I'm still trying to figure out why nodepool won't delete the damn nodes anymore | 21:42 |
esberglu | But your runs should go through | 21:42 |
esberglu | *are going through | 21:42 |
efried | good | 21:43 |
esberglu | Just hope they pass first time through lol | 21:44 |
*** thorst has joined #openstack-powervm | 21:53 | |
*** efried has quit IRC | 22:07 | |
*** thorst has quit IRC | 22:12 | |
*** k0da has quit IRC | 22:14 | |
*** apearson has quit IRC | 22:16 | |
*** edmondsw has quit IRC | 22:22 | |
*** mdrabe has quit IRC | 22:23 | |
*** edmondsw has joined #openstack-powervm | 22:24 | |
*** edmondsw has quit IRC | 22:29 | |
*** chas has joined #openstack-powervm | 22:36 | |
*** chas has quit IRC | 22:41 | |
*** tjakobs__ has quit IRC | 22:53 | |
*** chas has joined #openstack-powervm | 22:57 | |
*** thorst has joined #openstack-powervm | 22:59 | |
*** chas has quit IRC | 23:01 | |
*** thorst has quit IRC | 23:04 | |
*** chas has joined #openstack-powervm | 23:33 | |
*** thorst has joined #openstack-powervm | 23:34 | |
*** chas has quit IRC | 23:38 | |
*** apearson has joined #openstack-powervm | 23:48 | |
*** thorst has quit IRC | 23:49 | |
*** apearson has quit IRC | 23:50 | |
*** apearson has joined #openstack-powervm | 23:51 | |
*** apearson has quit IRC | 23:52 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!