| *** seroyer has quit IRC | 00:47 | |
| *** thorst has quit IRC | 00:58 | |
| *** thorst has joined #openstack-powervm | 01:02 | |
| *** esberglu has quit IRC | 01:03 | |
| *** thorst has quit IRC | 01:08 | |
| *** thorst has joined #openstack-powervm | 01:15 | |
| *** seroyer has joined #openstack-powervm | 01:17 | |
| *** thorst has quit IRC | 01:20 | |
| *** thorst has joined #openstack-powervm | 01:26 | |
| *** thorst has quit IRC | 01:29 | |
| *** jwcroppe has joined #openstack-powervm | 02:04 | |
| *** thorst has joined #openstack-powervm | 02:50 | |
| *** thorst has quit IRC | 02:54 | |
| *** thorst has joined #openstack-powervm | 02:54 | |
| *** thorst has quit IRC | 02:55 | |
| *** seroyer has quit IRC | 03:04 | |
| *** thorst has joined #openstack-powervm | 03:05 | |
| *** thorst has quit IRC | 03:11 | |
| *** tjakobs has joined #openstack-powervm | 03:43 | |
| *** tjakobs has quit IRC | 03:48 | |
| *** shyama has joined #openstack-powervm | 03:59 | |
| *** jwcroppe has quit IRC | 05:09 | |
| *** thorst has joined #openstack-powervm | 05:11 | |
| *** thorst has quit IRC | 05:16 | |
| *** adi___ has quit IRC | 05:41 | |
| *** adi___ has joined #openstack-powervm | 05:46 | |
| *** jwcroppe has joined #openstack-powervm | 05:58 | |
| *** jwcroppe has quit IRC | 06:04 | |
| *** kotra03 has joined #openstack-powervm | 06:21 | |
| *** kotra03 has quit IRC | 06:26 | |
| *** jwcroppe has joined #openstack-powervm | 06:56 | |
| *** jwcroppe has quit IRC | 07:02 | |
| *** AlexeyAbashkin has quit IRC | 07:07 | |
| *** k0da has joined #openstack-powervm | 07:43 | |
| *** AlexeyAbashkin has joined #openstack-powervm | 07:46 | |
| *** viclarson has joined #openstack-powervm | 08:04 | |
| *** jwcroppe has joined #openstack-powervm | 08:42 | |
| *** jwcroppe has quit IRC | 08:51 | |
| *** thorst has joined #openstack-powervm | 09:13 | |
| *** thorst has quit IRC | 09:19 | |
| *** viclarson has quit IRC | 09:25 | |
| *** jwcroppe has joined #openstack-powervm | 10:32 | |
| *** jwcroppe has quit IRC | 10:38 | |
| *** viclarson has joined #openstack-powervm | 10:42 | |
| *** viclarson has quit IRC | 11:07 | |
| *** seroyer has joined #openstack-powervm | 11:26 | |
| *** thorst has joined #openstack-powervm | 11:51 | |
| *** viclarson has joined #openstack-powervm | 12:16 | |
| *** seroyer has quit IRC | 12:30 | |
| viclarson | hi | 12:33 |
|---|---|---|
| viclarson | how vm d obtain ip in novalink? | 12:34 |
| viclarson | via dhcp or via config injection? | 12:35 |
| *** apearson has joined #openstack-powervm | 12:48 | |
| *** seroyer has joined #openstack-powervm | 12:51 | |
| *** kylek3h has joined #openstack-powervm | 12:52 | |
| *** tblakes has joined #openstack-powervm | 12:55 | |
| *** edmondsw has joined #openstack-powervm | 12:59 | |
| *** mdrabe has joined #openstack-powervm | 13:09 | |
| *** tjakobs has joined #openstack-powervm | 13:24 | |
| *** esberglu has joined #openstack-powervm | 13:39 | |
| *** kriskend has joined #openstack-powervm | 13:57 | |
| viclarson | modified interfaces.template | 14:13 |
| viclarson | # The loopback network interface | 14:13 |
| viclarson | auto lo | 14:13 |
| viclarson | iface lo inet loopback | 14:13 |
| viclarson | auto eth0 | 14:13 |
| viclarson | iface eth0 inet dhcp | 14:13 |
| viclarson | auto eth1 | 14:13 |
| viclarson | iface eth1 inet manual | 14:13 |
| viclarson | i think it's enough | 14:13 |
| viclarson | otherwise i had eth0 non-configured | 14:14 |
| efried | thorst, re your review of https://review.openstack.org/#/c/378000/ - got a sec to discuss? | 14:24 |
| efried | I like the way you're thinking. My only concern is with the heal/optimize or reset events, we would be hammering neutron for all those device details. Then again, I think we're doing that anyway. How expensive are those RPC calls? | 14:25 |
| *** esberglu has quit IRC | 14:38 | |
| *** edmondsw has quit IRC | 14:38 | |
| *** k0da has quit IRC | 14:38 | |
| *** esberglu has joined #openstack-powervm | 14:39 | |
| *** k0da has joined #openstack-powervm | 14:39 | |
| *** edmondsw has joined #openstack-powervm | 14:39 | |
| *** burgerk has joined #openstack-powervm | 14:40 | |
| *** tjakobs has quit IRC | 14:41 | |
| efried | thorst, ready to merge https://review.openstack.org/#/c/382026/ ? | 14:43 |
| esberglu | Just wanted to make sure that everyone is aware of the newton coordinated release date of October 6th | 14:48 |
| efried | What does that mean? | 14:49 |
| efried | Anyone know how to clean up /opt/stack/logs? Everything I've tried (removing the date-stamped file, truncating the date-stamped file) results in the logs no longer being written, even after restarting the respective service. | 14:52 |
| esberglu | Everyone trying to stay in line with the openstack release schedule will be putting out their newton release | 14:53 |
| *** tjakobs has joined #openstack-powervm | 15:05 | |
| *** k0da has quit IRC | 15:24 | |
| *** shyama has quit IRC | 15:27 | |
| efried | esberglu, insight into these failures? http://184.172.12.213/00/378000/19/check/networking-powervm-pvm-dsvm-tempest-full/5ef045a/powervm_os_ci.html | 15:32 |
| esberglu | Still haven’t figured out the multiple networks found error. Just hitting that | 15:37 |
| thorst | efried: sorry...'stuff' happened. I think we're already doing those RPC calls | 15:46 |
| thorst | btw - I was talking with btang, and those rpc loops in the code today...may full on elevate this to a bug. The calls are spending a ton of CPU in that tight loop | 15:47 |
| thorst | hovering around 70% on a core | 15:47 |
| efried | thorst, any idea which part is spiking the CPU? | 15:50 |
| efried | If we're only calling every 2s, we shouldn't see a continuous hover. | 15:51 |
| efried | I would believe the event listener could do that, though. | 15:51 |
| openstackgerrit | Merged openstack/networking-powervm: Time out port update waiting for vif plug https://review.openstack.org/382026 | 15:53 |
| thorst | efried: I believe its due to the vNIC queries? | 15:54 |
| efried | oh, yeah, that'd do it. | 15:54 |
| efried | So this wasn't a problem for the SEA driver? | 15:54 |
| thorst | efried: nope | 15:55 |
| efried | okay. | 15:56 |
| thorst | viclarson: Sorry - just saw your question. I use DHCP for mine... My actual /etc/network/interfaces that lands on the VM is similar to yours | 15:56 |
| thorst | except eth1 has: iface eth1 inet6 auto | 15:56 |
| thorst | that way it gets the Link Local IPv6 address | 15:56 |
| *** mdrabe has quit IRC | 15:57 | |
| *** mdrabe has joined #openstack-powervm | 16:01 | |
| *** seroyer has quit IRC | 16:04 | |
| viclarson | thorst why we need eth1 configured? | 16:06 |
| thorst | viclarson: That allows for the Secure RMC connection between the hypervisor and the VM. It allows for operations like live migration, adding/removing CPUs live, etc... | 16:07 |
| thorst | we call it 'DLPAR' operations. | 16:08 |
| viclarson | my eth1 configured as 3: eth1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast state UNKNOWN group default qlen 1000 | 16:12 |
| viclarson | link/ether 56:1d:fc:63:63:3f brd ff:ff:ff:ff:ff:ff | 16:12 |
| viclarson | inet6 fe80::541d:fcff:fe63:633f/64 scope link | 16:12 |
| viclarson | valid_lft forever preferred_lft forever | 16:12 |
| viclarson | is it enough? | 16:12 |
| *** seroyer has joined #openstack-powervm | 16:17 | |
| thorst | should be...if you're using the image we provided it should already have the RMC software packages installed | 16:20 |
| thorst | so I think you're good. | 16:20 |
| thorst | viclarson: ^^ | 16:20 |
| *** mdrabe has quit IRC | 16:31 | |
| *** mdrabe has joined #openstack-powervm | 16:31 | |
| *** shyama has joined #openstack-powervm | 16:45 | |
| *** svenkat has joined #openstack-powervm | 17:01 | |
| *** tblakes has quit IRC | 17:04 | |
| thorst | efried mdrabe: Can you make sure I addressed your concerns here: https://review.openstack.org/#/c/381772/ | 17:20 |
| thorst | before I ask the nova core team to review, I'd like to make sure we're all +1 on it. | 17:20 |
| efried | thorst, couple more comments from edmondsw | 17:23 |
| thorst | efried: Yeah, but I don't want to flood the nova channel with minor updates | 17:23 |
| efried | I understand. | 17:23 |
| thorst | I'd rather collect them all and do one change.... | 17:23 |
| thorst | so if you and mdrabe are +1, then I'll get edmondsw done and do a new one | 17:23 |
| viclarson | after creating vm with flavor hd 20GB i see | 17:34 |
| viclarson | root@ubuntu:/home/ubuntu# mount | 17:34 |
| efried | thorst, reviewed. | 17:34 |
| viclarson | sadf | 17:35 |
| viclarson | mounted /dev/sdb2 on / type ext4 (rw,errors=remount-ro) | 17:35 |
| viclarson | mounted /dev/sr0 on /tmp/tmpzmGh0G type iso9660 (ro,sync,relatime) | 17:35 |
| viclarson | and /dev/sda1 (20GB) formatted to ext4fs but not mounted | 17:36 |
| viclarson | something went wrong? | 17:36 |
| viclarson | also /tmp/tmp... doesnt exist | 17:36 |
| thorst | viclarson: did you change the partition tables at all? | 17:36 |
| viclarson | manually? | 17:37 |
| viclarson | no | 17:37 |
| viclarson | what is expected configuration? | 17:38 |
| thorst | so PowerVM has a boot partition. Should be in any image that loads. Its about 17 meg or so. Then there is the actual data partition. So you should typically see a /dev/sda1 (boot partition - 17 meg) and then /dev/sdb2 (the remainin 20 gigs). | 17:40 |
| viclarson | (parted) print all | 17:41 |
| viclarson | Model: IBM 3303 NVDISK (scsi) | 17:41 |
| viclarson | Disk /dev/sda: 21.5GB | 17:41 |
| viclarson | Sector size (logical/physical): 512B/512B | 17:41 |
| viclarson | Partition Table: gpt | 17:41 |
| viclarson | Number Start End Size File system Name Flags | 17:41 |
| viclarson | 1 1049kB 8389kB 7340kB prep | 17:41 |
| viclarson | 2 8389kB 21.5GB 21.5GB ext4 | 17:41 |
| viclarson | first drive | 17:41 |
| viclarson | Model: IBM 3303 NVDISK (scsi) | 17:42 |
| viclarson | Disk /dev/sdb: 21.5GB | 17:42 |
| viclarson | Sector size (logical/physical): 512B/512B | 17:42 |
| viclarson | Partition Table: gpt | 17:42 |
| viclarson | Number Start End Size File system Name Flags | 17:42 |
| viclarson | 1 1049kB 8389kB 7340kB prep | 17:42 |
| viclarson | 2 8389kB 2146MB 2138MB ext4 | 17:42 |
| viclarson | abd second | 17:42 |
| viclarson | and second | 17:42 |
| viclarson | i requested boot from image, no additional volumes | 17:43 |
| viclarson | is it some intermediate state? | 17:50 |
| viclarson | thorst: ^^ | 18:01 |
| thorst | viclarson: no, that 7 meg thing looks right to me | 18:13 |
| *** tblakes has joined #openstack-powervm | 18:13 | |
| thorst | ahh, I know what the problem is | 18:13 |
| thorst | I think I do at least.... | 18:13 |
| thorst | this is dual VIOS...its SSP, right? | 18:14 |
| viclarson | y | 18:14 |
| thorst | efried: Could we be doing some sort of dual VIOS thing with the SSP load up? | 18:15 |
| thorst | I know that the image I provided didn't have the MPIO drivers loaded into them | 18:15 |
| thorst | so it was meant for single VIOS... I'm not sure how to add MPIO after the fact. | 18:15 |
| viclarson | multipath? | 18:16 |
| viclarson | doesnt matter | 18:17 |
| thorst | multipath means that there are multiple paths to the same disk. | 18:17 |
| thorst | and there have to be multi path device drivers loaded in the OS | 18:17 |
| thorst | so that the OS, looking through two different busses (ex. two different vSCSIs) recognizes it as the same disk | 18:17 |
| thorst | brb | 18:17 |
| viclarson | mpio=multipath? | 18:17 |
| *** thorst is now known as thorst_afk | 18:17 | |
| thorst_afk | mpio == multipath, yeah | 18:17 |
| thorst_afk | multi path i/o | 18:17 |
| thorst_afk | brb | 18:17 |
| viclarson | cya | 18:18 |
| viclarson | could you plz provide image which can work | 18:18 |
| viclarson | perhaps it's time for aix | 18:18 |
| mdrabe | thorst: About the blueprint, is the goal to use existing os-vif plugins like OVS, meaning we wouldn't support SEA just yet? | 18:45 |
| thorst_afk | mdrabe: yep | 18:45 |
| *** thorst_afk is now known as thorst_ | 18:45 | |
| thorst_ | mdrabe: do you know if we have a linux image with MPIO that is ubuntu laying around? | 18:45 |
| mdrabe | thorst_: Not that I'm aware unfortunately | 18:46 |
| thorst_ | mdrabe: OK - I'll check with some of the testers | 18:47 |
| efried | thorst_ - "dual VIOS thing with the SSP load up" - what do you mean? | 18:50 |
| thorst_ | efried: Sorry - you validated that the disk driver for SSP works with dual VIOS right? | 18:51 |
| efried | Shoot, I think so. Like 18 months ago when we first developed it. | 18:51 |
| efried | I mean, other than that problem pvc recently saw where mappings supposedly needed to be serialized. | 18:52 |
| efried | What's the problem we're seeing? | 18:52 |
| *** k0da has joined #openstack-powervm | 19:00 | |
| efried | thorst_, help me brainstorm this a sec... | 19:05 |
| efried | We're operating on the assumption that the neutron port update is synchronous, right? | 19:06 |
| efried | That is, the compute manager grabs the port and tells neutron to send the port update; and waits for that guy to come back before it proceeds with the rest of the operation (spawn or attach). | 19:06 |
| efried | With your review suggestions, I'm ripping the whole neutron side of the ProvisionRequest queues out, which leaves port_update empty. | 19:08 |
| efried | BUT | 19:08 |
| efried | I'm thinking we add in a bridge mapping update there. | 19:08 |
| efried | I.e. refresh the agent's view of the pport label:physloc mappings *and* send that back to neutron via the _report_state RPC. | 19:08 |
| efried | That way, by the time we get to the vif driver, the neutron view of the agent is "guaranteed" to be up to date - at least with whatever the view was when the port was assigned, which is what we want. | 19:09 |
| efried | Thus eliminating the potential staleness window we were seeing. | 19:10 |
| *** shyama has quit IRC | 19:13 | |
| thorst_ | efried: Just wondering if we handled MPIO | 19:31 |
| thorst_ | looking at other q's...sorry, was talking SR-IOV | 19:31 |
| thorst_ | efried: its not 100% synchronous. The port update happens very early on... | 19:32 |
| thorst_ | well, what port update are we talking about? | 19:32 |
| efried | thorst_, the one we register as an RPC callback. | 19:41 |
| efried | The one from which we were previously queueing a "neutron port request". | 19:41 |
| efried | We were kinda counting on that coming in first anyway with this whole queuing thing. We would discard any custom events that came in if they didn't have a corresponding neutron req already registered. | 19:42 |
| thorst_ | efried: yeah, that should be like an instant back | 19:52 |
| efried | Instant enough for us to do a managed system GET? | 19:53 |
| thorst_ | I'm basically saying if there are custom events, and the data within them are good, that's all we really need | 19:53 |
| efried | Yeah, this is a separate discussion. | 19:53 |
| thorst_ | efried: I don't follow that second q | 19:53 |
| thorst_ | oooo | 19:54 |
| efried | This is for getting the proper picture of pport label:physloc mappings back to the mech driver, so by the time it feeds those back to the vif driver, they're accurate. | 19:54 |
| thorst_ | I see what you're saying | 19:54 |
| thorst_ | yeah yeah...I see. | 19:54 |
| thorst_ | hmm...I guess from an SR-IOV side, we could try that | 19:54 |
| thorst_ | but I'd only want to do that if the request came in was a SR-IOV request. | 19:54 |
| efried | Yeah, there's no equivalent in SEA. | 19:55 |
| efried | The SEA agent's port_update is now a no-op. | 19:55 |
| thorst_ | keep in mind a port update could come in for like anything...a QoS policy change for instance | 19:55 |
| thorst_ | but I'm still OK with that | 19:56 |
| thorst_ | managed system get is pretty quick I though | 19:56 |
| efried | yes, it is. | 19:56 |
| *** svenkat has quit IRC | 20:59 | |
| openstackgerrit | Eric Fried proposed openstack/networking-powervm: Refactor, consolidate, and clean up agents https://review.openstack.org/378000 | 21:14 |
| openstackgerrit | Eric Fried proposed openstack/networking-powervm: Refactor, consolidate, and clean up agents https://review.openstack.org/378000 | 21:16 |
| efried | thorst_ ^^ Good call. This cut out a ton. | 21:17 |
| *** apearson has quit IRC | 21:18 | |
| openstackgerrit | Eric Fried proposed openstack/networking-powervm: Refactor, consolidate, and clean up agents https://review.openstack.org/378000 | 21:19 |
| thorst_ | efried: you're the one doing the hard work. | 21:20 |
| thorst_ | I'm just trying to figure out how to make the I/O not zap out for a few seconds on LPM | 21:21 |
| thorst_ | :-) | 21:21 |
| *** dwayne has quit IRC | 21:21 | |
| *** tblakes has quit IRC | 21:22 | |
| *** thorst_ has quit IRC | 21:26 | |
| *** thorst_ has joined #openstack-powervm | 21:26 | |
| *** thorst_ has quit IRC | 21:31 | |
| *** kriskend has quit IRC | 21:45 | |
| *** edmondsw has quit IRC | 21:53 | |
| *** mdrabe has quit IRC | 22:07 | |
| *** esberglu has quit IRC | 22:15 | |
| *** seroyer has quit IRC | 22:23 | |
| *** tjakobs has quit IRC | 22:27 | |
| *** burgerk has quit IRC | 22:33 | |
| *** esberglu has joined #openstack-powervm | 22:48 | |
| *** esberglu has quit IRC | 22:48 | |
| *** k0da has quit IRC | 22:50 | |
| *** tjakobs has joined #openstack-powervm | 23:35 | |
| *** dwayne has joined #openstack-powervm | 23:43 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!