| *** thorst has quit IRC | 00:01 | |
| *** jpasqualetto has joined #openstack-powervm | 00:22 | |
| *** thorst has joined #openstack-powervm | 00:36 | |
| *** thorst has quit IRC | 00:53 | |
| *** edmondsw has quit IRC | 01:29 | |
| *** mdrabe has joined #openstack-powervm | 01:48 | |
| *** thorst has joined #openstack-powervm | 01:51 | |
| *** mdrabe has quit IRC | 01:57 | |
| *** thorst has quit IRC | 02:04 | |
| *** thorst has joined #openstack-powervm | 02:31 | |
| *** thorst has quit IRC | 02:38 | |
| *** tjakobs has joined #openstack-powervm | 03:12 | |
| *** tjakobs has quit IRC | 03:18 | |
| *** thorst has joined #openstack-powervm | 03:36 | |
| *** thorst has quit IRC | 03:55 | |
| *** jayasankar_ has joined #openstack-powervm | 04:56 | |
| *** nbante has joined #openstack-powervm | 05:08 | |
| *** jayasankar_ has quit IRC | 05:14 | |
| *** jayasankar_ has joined #openstack-powervm | 05:27 | |
| *** shyama has joined #openstack-powervm | 05:39 | |
| *** thorst has joined #openstack-powervm | 05:52 | |
| *** thorst has quit IRC | 05:57 | |
| *** thorst has joined #openstack-powervm | 06:53 | |
| *** thorst has quit IRC | 06:57 | |
| *** shyama has quit IRC | 07:20 | |
| *** k0da has joined #openstack-powervm | 07:20 | |
| *** shyama has joined #openstack-powervm | 07:21 | |
| *** k0da has quit IRC | 07:50 | |
| *** thorst has joined #openstack-powervm | 07:54 | |
| *** nbante has quit IRC | 08:07 | |
| *** thorst has quit IRC | 08:12 | |
| *** k0da has joined #openstack-powervm | 09:05 | |
| *** thorst has joined #openstack-powervm | 09:09 | |
| *** thorst has quit IRC | 09:13 | |
| *** esberglu has joined #openstack-powervm | 09:58 | |
| *** esberglu has quit IRC | 10:02 | |
| *** thorst has joined #openstack-powervm | 10:10 | |
| *** jayasankar_ has quit IRC | 10:12 | |
| *** thorst has quit IRC | 10:14 | |
| *** edmondsw has joined #openstack-powervm | 10:21 | |
| *** jayasankar_ has joined #openstack-powervm | 10:24 | |
| *** edmondsw has quit IRC | 10:26 | |
| *** smatzek has joined #openstack-powervm | 10:42 | |
| *** thorst has joined #openstack-powervm | 11:11 | |
| *** thorst has quit IRC | 11:15 | |
| *** shyama has quit IRC | 11:18 | |
| *** shyama has joined #openstack-powervm | 11:19 | |
| *** jwcroppe has joined #openstack-powervm | 11:27 | |
| *** thorst has joined #openstack-powervm | 11:34 | |
| *** a1fisher has joined #openstack-powervm | 12:11 | |
| *** edmondsw has joined #openstack-powervm | 12:22 | |
| *** jpasqualetto has quit IRC | 12:23 | |
| *** jpasqualetto has joined #openstack-powervm | 12:23 | |
| *** efried has joined #openstack-powervm | 12:27 | |
| *** apearson has joined #openstack-powervm | 12:38 | |
| *** jpasqualetto has quit IRC | 12:45 | |
| *** kylek3h_ has quit IRC | 12:49 | |
| *** jwcroppe has quit IRC | 12:53 | |
| *** dwayne__ has quit IRC | 12:55 | |
| *** k0da has quit IRC | 12:56 | |
| *** jpasqualetto has joined #openstack-powervm | 12:58 | |
| *** k0da has joined #openstack-powervm | 13:11 | |
| *** mdrabe has joined #openstack-powervm | 13:15 | |
| efried | adreznec Were you going to propose requirements update bots for networking- and ceilometer-powervm? | 13:23 |
|---|---|---|
| efried | Do you have a way of doing same for pypowervm? I think that guy is out of sync at this point. | 13:23 |
| adreznec | efried: Ah yeah, forgot about that. I'll get to that today here | 13:24 |
| adreznec | pypowervm is just manual at this point | 13:24 |
| efried | ight | 13:24 |
| adreznec | no scripting around that | 13:24 |
| efried | thorst I don't see a good way to get around coordinated upload without changing pypowervm. | 13:27 |
| efried | We would have to spoof the local_api trait. I kinda don't want to do that. | 13:27 |
| *** smatzek has quit IRC | 13:28 | |
| *** kylek3h has joined #openstack-powervm | 13:29 | |
| *** esberglu has joined #openstack-powervm | 13:31 | |
| efried | thorst I'm also not sure there's a good way to support FUNC without threads. | 13:32 |
| efried | Soooo.... | 13:32 |
| efried | I'm going to work on a biggish pypowervm change that gets rid of coordinated and deprecates FUNC. | 13:33 |
| efried | 'cept coordinated is in public APIs too. So I have to deprecate that guy too. | 13:36 |
| thorst | efried: func may need threads but n ot the pipe | 13:43 |
| thorst | so it halves the threads | 13:43 |
| thorst | but i think we could still make it work :-) | 13:44 |
| *** dwayne__ has joined #openstack-powervm | 13:51 | |
| *** jayasankar_ has quit IRC | 13:55 | |
| *** jpasqualetto has quit IRC | 13:58 | |
| *** burgerk has joined #openstack-powervm | 14:03 | |
| *** burgerk has quit IRC | 14:08 | |
| esberglu | efried: thorst: adreznec: All of the OOT CI runs are failing as of last night | 14:10 |
| esberglu | ListServerFiltersTestJSON | 14:11 |
| thorst | esberglu: yeah, I thought that volume was quite high | 14:11 |
| thorst | is it immediately obvious why its failing? | 14:11 |
| esberglu | is timing out trying to create vif | 14:11 |
| thorst | hmm... | 14:11 |
| esberglu | http://184.172.12.213/00/376200/27/check/nova-out-of-tree-pvm/8c53bcc/logs/ | 14:11 |
| thorst | the VIF is attached to a VM, right? | 14:11 |
| *** jpasqualetto has joined #openstack-powervm | 14:11 | |
| thorst | yep...it is | 14:13 |
| thorst | super odd, because most of the other tests create vifs... | 14:14 |
| thorst | so what's special about this one | 14:14 |
| esberglu | Yeah and nothing has changed in the test | 14:14 |
| esberglu | But you can see all the other ones going through fine | 14:14 |
| thorst | hmm....I can even see it sending the device up from neutron | 14:18 |
| thorst | "Sending device up to Neutron for fa:16:3e:62:cb:5d" | 14:18 |
| thorst | are any other CI's experiencing issues? | 14:19 |
| esberglu | Nope | 14:19 |
| esberglu | brb, coffee break | 14:23 |
| thorst | esberglu: its always that test? | 14:24 |
| thorst | basically what I'm seeing is that neutron sends the event saying 'provisioned vif' and its just not showing up in the nova logs as received | 14:24 |
| thorst | yeah, we never got the 'external_instance_event' passed back to nova, which is why it failed | 14:29 |
| thorst | not sure why we didn't get that back | 14:29 |
| thorst | efried: you familiar with this at all? I don't think so, it's events, but not the novalink ones... | 14:30 |
| efried | I looked at it a leeeetle bit when we were doing the SR-IOV stuff. svenkat may be more familiar. | 14:30 |
| efried | Are we using SEA in the CI? | 14:31 |
| thorst | efried: yeah, this is SEA | 14:32 |
| esberglu | thorst: Yep always that test | 14:32 |
| efried | And is our SEA plugin/agent responsible for forwarding events? | 14:32 |
| thorst | efried: kinda? | 14:32 |
| thorst | sea agent sends the device up...that goes to the neutron server...neutron server sends event for device up over to nova api...nova api sends that external instance event to nova-compute (I think) | 14:32 |
| efried | And you're saying we see it leave neutron, but not get to nova? | 14:34 |
| efried | So it'd be out of our hands by that point anyway? | 14:34 |
| thorst | I see it leave the sea_agent | 14:35 |
| thorst | and not get to nova | 14:35 |
| thorst | so I guess I need to find out what logging takes place in the neutron server. | 14:35 |
| thorst | efried: just for your knowledge...the thing that sends it to nova is neutron/notifiers/nova.py | 14:37 |
| *** dwayne__ has quit IRC | 14:41 | |
| efried | thorst Is it bad form for one driver to import libs from another driver's namespace? | 14:41 |
| efried | Let me be more specific: IterableToFileAdapter actually came from xenapi, and it's still there. | 14:41 |
| efried | So can I import nova.virt.xenapi.image.utils and use it from there? | 14:42 |
| efried | I understand why we wouldn't want to do that OOT, because we wouldn't know if it changed underneath us. | 14:42 |
| efried | But in-tree.... | 14:42 |
| *** tjakobs has joined #openstack-powervm | 14:42 | |
| thorst | efried: Absolutely bad form | 14:49 |
| efried | Better to duplicate it? | 14:49 |
| thorst | that one, yes | 14:50 |
| thorst | we had it in earlier iterations | 14:50 |
| efried | If there was a nova/image/utils.py, I would suggest moving it there. | 14:50 |
| thorst | just go back to the Mitaka release, and we have it there | 14:50 |
| efried | But there isn't. | 14:50 |
| efried | Yes, in the OOT driver. | 14:50 |
| efried | I'm talking in-tree. | 14:50 |
| efried | Now we'll have duplicated code in-tree. | 14:50 |
| thorst | right...in-tree is supposed to mirror OOT (and then when merged OOT can cut some stuff out) | 14:50 |
| efried | mmph, I've definitely not been using a philosophy as strong as "mirror". | 14:51 |
| *** mdrabe has quit IRC | 14:51 | |
| efried | But okay. | 14:51 |
| thorst | efried: well, you're bringing changes back to oot... | 14:52 |
| thorst | which is essentially keeping them symmetrical | 14:52 |
| efried | Somewhat. | 14:52 |
| efried | I'm not retrofitting 100% of the UT improvements. | 14:52 |
| thorst | hmm | 14:52 |
| thorst | back to the CI issue...I see in the neutron server this is happening | 14:53 |
| thorst | 2017-03-29 23:16:12.793 [00;32mDEBUG neutron.notifiers.nova [[01;36mreq-61ad865a-d06d-43f5-bda3-ce1d90c20308 [00;36mservice neutron[00;32m] [01;35m[00;32mIgnoring state change previous_port_status: DOWN current_port_status: DOWN port_id 4626c642-d1d6-4bfa-9c3a-7ca952f60853[00m [00;33mfrom (pid=6399) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:210[00m | 14:53 |
| thorst | 2017-03-29 23:16:15.271 [00;32mDEBUG neutron.notifiers.nova [[01;36mreq-2362ce84-51c4-4298-9f59-0954b33733fc [00;36mNone None[00;32m] [01;35m[00;32mIgnoring state change previous_port_status: DOWN current_port_status: BUILD port_id 4626c642-d1d6-4bfa-9c3a-7ca952f60853[00m [00;33mfrom (pid=6401) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:210[00m | 14:53 |
| thorst | 2017-03-29 23:16:15.277 [00;32mDEBUG neutron.notifiers.nova [[01;36mreq-7d356fc3-dd81-4d53-9d31-adad673ce9b2 [00;36mNone None[00;32m] [01;35m[00;32mIgnoring state change previous_port_status: DOWN current_port_status: BUILD port_id 4626c642-d1d6-4bfa-9c3a-7ca952f60853[00m [00;33mfrom (pid=6401) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:210[00m | 14:53 |
| thorst | it never gets a current_port_status of ACTIVE... | 14:53 |
| thorst | like all the other ports. | 14:53 |
| thorst | brb | 14:53 |
| thorst | I even see a message from neutron: "Provisioning for port 4626c642-d1d6-4bfa-9c3a-7ca952f60853 completed by entity L2." | 14:59 |
| esberglu | Which is very odd seeing the previous message of | 15:01 |
| esberglu | "Transition to ACTIVE for port object 4626c642-d1d6-4bfa-9c3a-7ca952f60853 will not be triggered until provisioned by entity L2" | 15:01 |
| *** mdrabe has joined #openstack-powervm | 15:01 | |
| *** newbie|2 has joined #openstack-powervm | 15:03 | |
| *** jwcroppe has joined #openstack-powervm | 15:07 | |
| thorst | esberglu: try doing this for me...set the neutron agent configuration option 'heal_and_optimize_interval' to some super high value...liek 50000 | 15:15 |
| esberglu | Ok. Starting a manual run now | 15:17 |
| thorst | I think what is happening is that the heal and optimize is pulling down the VIF and then setting it back to a build state | 15:20 |
| thorst | which really shouldn't matter...but I think it may be interfering... | 15:22 |
| esberglu | We had issues with that before on the undercloud | 15:23 |
| *** dwayne__ has joined #openstack-powervm | 15:26 | |
| *** k0da has quit IRC | 15:32 | |
| thorst | if that's the fix...what we can do is just update networking-powervm to only run the heal if we don't have provision requests pending | 15:41 |
| thorst | I thought we had put that in earlier... | 15:41 |
| esberglu | thorst: Thought that we set heal_and_opt or thought we updated networking-powervm? | 15:58 |
| thorst | esberglu: I don't follow? | 16:05 |
| thorst | I thought we set it somewhere...but it looks like it is running in this case for some reason | 16:06 |
| *** shyama has quit IRC | 16:42 | |
| *** shyama has joined #openstack-powervm | 16:43 | |
| -openstackstatus- NOTICE: The Gerrit service on review.openstack.org is being restarted briefly to relieve performance issues, and should return to service again momentarily. | 17:04 | |
| esberglu | thorst: No luck setting heal_and_optimize_interval | 17:23 |
| thorst | esberglu: are there new logs there? | 17:24 |
| *** newbie|2 has quit IRC | 17:28 | |
| esberglu | thorst: I can send you the login info for the instance, otherwise I can upload them somewhere | 17:29 |
| thorst | esberglu: can we get them uploaded onto our log server? | 17:38 |
| esberglu | http://184.172.12.213/manual/heal_and_opt/ | 17:50 |
| esberglu | thorst ^ | 17:50 |
| esberglu | probably should have zipped them but oh well | 17:50 |
| *** k0da has joined #openstack-powervm | 17:51 | |
| *** adi______ has joined #openstack-powervm | 17:54 | |
| *** jayasankar_ has joined #openstack-powervm | 17:56 | |
| *** adi_____ has quit IRC | 17:59 | |
| *** adi______ is now known as adi_____ | 17:59 | |
| *** jayasankar_ has quit IRC | 18:03 | |
| shyama | efried: I am looking at UT for https://review.openstack.org/#/c/432322/3 . The current test for this class https://github.com/openstack/nova-powervm/blob/master/nova_powervm/tests/virt/powervm/volume/test_fileio.py#L52-L54 mocks the whole feed task and the sub task methods do not get executed | 18:06 |
| shyama | how do i get them to be run as part of the UT | 18:06 |
| *** k0da has quit IRC | 18:28 | |
| *** gianpero has joined #openstack-powervm | 19:18 | |
| gianpero | Hi, anybody knows if there is any plan to integrate VMware vRealize with IBM PowerVM NL? | 19:20 |
| thorst | gianpero: I know that PowerVC (which uses PowerVM and NovaLink) have VMware vRealize integration | 19:20 |
| thorst | so I think its there today... If VMware vRealize supports a generic OpenStack then I'd assume it could support PowerVM NL's OpenStack drivers. | 19:21 |
| thorst | but again, PowerVC uses those OpenStack drivers too. | 19:21 |
| gianpero | thorst: But it isn't a direct between vRA and NL? | 19:21 |
| thorst | gianpero: not that I know of. | 19:22 |
| thorst | I think its all through OpenStack | 19:22 |
| gianpero | so I have to install the nova module on vRA, on the NL LPAR | 19:23 |
| gianpero | ? | 19:23 |
| thorst | gianpero: I don't think so...I thought it was just install an OpenStack (ex. PowerVC) which manages PowerVM | 19:24 |
| thorst | then connect vRA to that OpenStack | 19:24 |
| thorst | but I'm not a vRA expert. | 19:24 |
| gianpero | am asking because, am not sure which one is the routemap on orchestration from IBM | 19:25 |
| gianpero | I had read about vRA, ICO, and OpenStack | 19:26 |
| gianpero | not sure where to point our efforts | 19:26 |
| thorst | gianpero: I can give you a name of someone from PowerVC who could maybe help out with that? If you want that name, just PM me and I'll send you his e-mail | 19:28 |
| gianpero | thorst: tks, I'll PM you. | 19:29 |
| *** efried has quit IRC | 19:43 | |
| *** efried has joined #openstack-powervm | 19:55 | |
| *** shyama has quit IRC | 20:33 | |
| *** esberglu has quit IRC | 20:44 | |
| *** k0da has joined #openstack-powervm | 20:49 | |
| *** esberglu has joined #openstack-powervm | 21:02 | |
| *** edmondsw has quit IRC | 21:30 | |
| *** edmondsw has joined #openstack-powervm | 21:31 | |
| *** edmondsw has quit IRC | 21:35 | |
| *** k0da has quit IRC | 21:46 | |
| efried | thorst So one thing: Are we worried about an old pvm-novalink using a new pypowervm and thereby suffering from the perf problems of API upload? | 21:51 |
| efried | apearson How old would the pvm-novalink have to be? | 21:51 |
| thorst | efried: I'm not too worried about it | 21:53 |
| thorst | because we can point to a new NL level to get good perf | 21:53 |
| efried | ight | 21:53 |
| *** mdrabe has quit IRC | 21:58 | |
| *** esberglu has quit IRC | 22:00 | |
| *** jpasqualetto has quit IRC | 22:02 | |
| *** thorst has quit IRC | 22:03 | |
| *** efried has quit IRC | 22:03 | |
| *** dwayne__ has quit IRC | 22:06 | |
| apearson | efried - i'm not really sure when this was 'fixed'. We don't know if it was a combination of the web servlet technology we had, or whether it was a problem in java7. We moved off of 7 after the first release...but we've done an upgrade to our servlet stuff in pretty much every release, so depending on where the fix came... | 22:09 |
| apearson | That said, no I'm not worried...novalink is designed to be kept up to date. If they're seeing performance issues, updating to the latest fix release will address it. | 22:09 |
| *** gianpero has quit IRC | 22:29 | |
| *** apearson has quit IRC | 22:35 | |
| *** tjakobs has quit IRC | 22:44 | |
| *** gianpero has joined #openstack-powervm | 22:50 | |
| *** jwcroppe has quit IRC | 22:57 | |
| *** dwayne__ has joined #openstack-powervm | 23:00 | |
| *** thorst has joined #openstack-powervm | 23:04 | |
| *** thorst has quit IRC | 23:08 | |
| *** thorst has joined #openstack-powervm | 23:14 | |
| *** thorst has quit IRC | 23:17 | |
| *** edmondsw has joined #openstack-powervm | 23:31 | |
| *** edmondsw has quit IRC | 23:35 | |
| *** tjakobs has joined #openstack-powervm | 23:40 | |
| *** openstack has joined #openstack-powervm | 23:44 | |
| *** tjakobs has quit IRC | 23:45 | |
| *** thorst has joined #openstack-powervm | 23:47 | |
| *** thorst has quit IRC | 23:59 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!