edmondsw | #startmeeting PowerVM Driver Meeting | 15:01 |
---|---|---|
openstack | Meeting started Tue Nov 6 15:01:55 2018 UTC and is due to finish in 60 minutes. The chair is edmondsw. Information about MeetBot at http://wiki.debian.org/MeetBot. | 15:01 |
openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 15:01 |
*** openstack changes topic to " (Meeting topic: PowerVM Driver Meeting)" | 15:01 | |
openstack | The meeting name has been set to 'powervm_driver_meeting' | 15:02 |
edmondsw | #link agenda https://etherpad.openstack.org/p/powervm_driver_meeting_agenda | 15:02 |
edmondsw | efried mdrabe ping | 15:02 |
edmondsw | may be a short meeting if nobody's around :) | 15:05 |
efried | o/ sorry | 15:06 |
edmondsw | np | 15:06 |
edmondsw | #topic In-Tree Driver | 15:06 |
*** openstack changes topic to "In-Tree Driver (Meeting topic: PowerVM Driver Meeting)" | 15:06 | |
edmondsw | we merged a couple things this week: | 15:06 |
edmondsw | 1) https://review.openstack.org/#/c/610174/ | 15:06 |
edmondsw | 2) https://review.openstack.org/#/c/468560/ | 15:06 |
edmondsw | I don't recall anything else to discuss IT... anyone else? | 15:07 |
edmondsw | alright, moving on | 15:08 |
edmondsw | #topic Out-of-Tree Driver | 15:08 |
*** openstack changes topic to "Out-of-Tree Driver (Meeting topic: PowerVM Driver Meeting)" | 15:08 | |
edmondsw | we merged the corresponding tempfile change OOT similar to IT: https://review.openstack.org/#/c/613342/ | 15:08 |
edmondsw | and https://review.openstack.org/#/c/614781/ | 15:09 |
edmondsw | oh, and there was a corresponding IT change for that, which I should have mentioned above : https://review.openstack.org/#/c/614643/ | 15:10 |
edmondsw | the only other thing I have for the OOT driver is that there's been a customer issue with NovaLink GPFS volumes since we switched to the LOOP backstore | 15:11 |
edmondsw | from what I hear, seems to be a kernel issue, but the NovaLink guys are working on a workaround | 15:12 |
edmondsw | if they don't get that resolved, we may have to revert the change that we put in a while back to switch to loop: b86a9480c3c39f357b862c6a57ca6a2eb092558c | 15:12 |
edmondsw | anything else for OOT discussion? | 15:13 |
edmondsw | so quiet today | 15:14 |
edmondsw | #topic Device Passthrough | 15:14 |
*** openstack changes topic to "Device Passthrough (Meeting topic: PowerVM Driver Meeting)" | 15:14 | |
edmondsw | efried ^ | 15:14 |
efried | Nothing to report. I still owe updates to the specs and code. | 15:14 |
edmondsw | ack | 15:15 |
edmondsw | #topic PowerVM CI | 15:15 |
*** openstack changes topic to "PowerVM CI (Meeting topic: PowerVM Driver Meeting)" | 15:15 | |
edmondsw | we found the CI not voting again late last week and mmedvede helped fix it | 15:15 |
edmondsw | I believe it was a nodepool issue, same as last time. Not sure what's causing that | 15:16 |
edmondsw | mujahid doesn't seem to be around to give us his thoughts | 15:16 |
edmondsw | http://ci-watch.tintri.com/ doesn't seem to be running anymore, so mmedvede setup http://ciwatch.mmedvede.net | 15:17 |
edmondsw | we appear to be voting there, though I'm seeing more red than I'd like | 15:18 |
edmondsw | I'll ask mujahid to take a look at that | 15:18 |
edmondsw | #topic Open Discussion | 15:18 |
*** openstack changes topic to "Open Discussion (Meeting topic: PowerVM Driver Meeting)" | 15:18 | |
edmondsw | efried and I will be at the summit in Berlin next week, so no meeting | 15:19 |
edmondsw | floor is open for any other topics | 15:19 |
efried | FYI I've been working on perf improvements in the resource tracker. It's nothing powervm specific, but it's what's consuming my time the past couple of work days. | 15:20 |
edmondsw | ack | 15:20 |
mmedvede | with regard to nodepool problem I helped to fix - it may happen again I am afraid. nodepool is stuck with too many open files error. I did not change ulimits | 15:21 |
edmondsw | mmedvede any idea what causes that? | 15:21 |
edmondsw | I'm with you, expecting this to keep happening unless we figure out what's causing it | 15:21 |
edmondsw | or put in some mitigation or something | 15:22 |
mmedvede | edmondsw: no, other than it is somehow not closing files | 15:22 |
efried | edmondsw: We fixed a file descriptor leak recently... | 15:22 |
efried | oh, it was in tempfile usage. And it never made it to prod. | 15:22 |
mmedvede | simple mitigation would be periodic restart of nodepool every day | 15:22 |
edmondsw | mmedvede would we lose things with the restart? | 15:23 |
mmedvede | nodepool keeps its state in database. Still slight possibility something would be lost, but it is usually safe to restart | 15:23 |
edmondsw | good to know | 15:24 |
edmondsw | maybe we can setup a cron job for the middle of the night or something | 15:24 |
edmondsw | I'll suggest that to mujahid | 15:24 |
edmondsw | I remembered one other thing I should mention... and mmedvede you'll also be interested in this | 15:24 |
edmondsw | a while back we hit an issue with greenlet 0.4.14 where they'd made a change that didn't work on Ubuntu 16.04 | 15:25 |
edmondsw | they've since fixed that in greenlet with a different change in 0.4.15, which I believe I already noted previously | 15:25 |
edmondsw | but I was also working with Ubuntu to fix the gcc bug that was the real issue | 15:25 |
edmondsw | and I have now successfully tested a new gcc5 package on xenial-proposed with greenlet 0.4.14 | 15:26 |
edmondsw | so once they promote that from proposed (which they've been waiting to do until I'd confirmed the fix), even 0.4.14 should be ok | 15:26 |
edmondsw | eom | 15:27 |
mmedvede | this is good news, thank you | 15:27 |
edmondsw | yep... shouldn't have to worry about other things besides greenlet breaking on Ubuntu 16.04 due to that gcc bug | 15:28 |
edmondsw | alright, I think that's it for today | 15:29 |
edmondsw | #endmeeting | 15:29 |
*** openstack changes topic to "This channel is for PowerVM-related development and discussion. For general OpenStack support, please use #openstack." | 15:29 | |
openstack | Meeting ended Tue Nov 6 15:29:04 2018 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 15:29 |
openstack | Minutes: http://eavesdrop.openstack.org/meetings/powervm_driver_meeting/2018/powervm_driver_meeting.2018-11-06-15.01.html | 15:29 |
openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/powervm_driver_meeting/2018/powervm_driver_meeting.2018-11-06-15.01.txt | 15:29 |
openstack | Log: http://eavesdrop.openstack.org/meetings/powervm_driver_meeting/2018/powervm_driver_meeting.2018-11-06-15.01.log.html | 15:29 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!