*** toan has joined #openstack-powervm | 00:00 | |
*** AlexeyAbashkin has quit IRC | 00:02 | |
*** k0da has quit IRC | 00:19 | |
*** k0da has joined #openstack-powervm | 00:30 | |
*** k0da has quit IRC | 00:35 | |
*** edmondsw has joined #openstack-powervm | 03:53 | |
*** edmondsw has quit IRC | 04:02 | |
*** chhavi has joined #openstack-powervm | 04:48 | |
*** edmondsw has joined #openstack-powervm | 05:18 | |
*** edmondsw has quit IRC | 05:23 | |
*** edmondsw has joined #openstack-powervm | 07:07 | |
*** edmondsw has quit IRC | 07:12 | |
*** chhavi__ has joined #openstack-powervm | 07:20 | |
*** chhavi has quit IRC | 07:22 | |
*** AlexeyAbashkin has joined #openstack-powervm | 07:53 | |
-openstackstatus- NOTICE: Our CI system Zuul is currently not accessible. Wait with approving changes and rechecks until it's back online. Currently waiting for an admin to investigate. | 08:48 | |
*** edmondsw has joined #openstack-powervm | 08:56 | |
*** edmondsw has quit IRC | 09:00 | |
-openstackstatus- NOTICE: Zuul is back online, looks like a temporary network problem. | 09:09 | |
*** k0da has joined #openstack-powervm | 09:42 | |
*** AlexeyAbashkin has quit IRC | 11:15 | |
*** k0da has quit IRC | 11:15 | |
*** AlexeyAbashkin has joined #openstack-powervm | 11:40 | |
*** chhavi__ has quit IRC | 12:43 | |
*** chhavi__ has joined #openstack-powervm | 12:44 | |
*** edmondsw has joined #openstack-powervm | 13:16 | |
catmando | anyone about? | 13:37 |
---|---|---|
catmando | i'm still having trouble creating volumes from images using the REST API | 13:37 |
edmondsw | catmando creating volumes from images? | 13:42 |
catmando | yes | 13:42 |
edmondsw | do you mean creating an image? | 13:42 |
catmando | https://www.ibm.com/support/knowledgecenter/SSXK2N_1.3.3/com.ibm.powervc.standard.help.doc/powervc_pg_kickoff_hmc.html | 13:42 |
catmando | specifically the POST to volumes | 13:43 |
catmando | that takes, according to the OpenStack docs | 13:43 |
catmando | an imageRef | 13:43 |
catmando | but it always fails | 13:43 |
catmando | with "Unable to fetch connection information from backend: 'Volume' object has no attribute 'id]'" | 13:43 |
edmondsw | catmando 1st tip for working with PowerVC APIs is to go to your web browser, login to PowerVC, turn on the browser's developer tools (they all have them now) so that you can see the REST calls the browser is making, and then do what you want in PowerVC and see what REST calls it made | 13:44 |
edmondsw | from that you can figure out just about anything | 13:44 |
catmando | edmondsw: good call, i shall do that | 13:45 |
catmando | thank you, as usual | 13:45 |
edmondsw | yw | 13:45 |
edmondsw | catmando I think you're saying you were trying the POST /v3/{project_id}/volumes API | 13:46 |
catmando | indeed | 13:46 |
edmondsw | that won't work / isn't necessary in PowerVC because in PowerVC all volumes are image-backed | 13:46 |
edmondsw | i.e. if you have an image, you already have a volume | 13:46 |
catmando | yes, but when i create a new instance | 13:46 |
catmando | a copy is created | 13:46 |
edmondsw | yes | 13:47 |
catmando | in my case it's on Storwize and the default background copy speed is 2MB/s | 13:47 |
catmando | which means that a deployment can take a _very_ long time | 13:47 |
catmando | sometimes the HMC seems to get confused and it declares an instance dead | 13:48 |
catmando | even though it's still trying to boot | 13:48 |
edmondsw | it should be doing a flash copy | 13:48 |
edmondsw | and thus very fat | 13:48 |
edmondsw | fast | 13:48 |
catmando | it's not, trust me | 13:48 |
edmondsw | must be something weird going on | 13:49 |
edmondsw | storwize is generally very fast | 13:49 |
catmando | i don't think it's storwize | 13:49 |
catmando | the copy really is available | 13:49 |
edmondsw | oh, you just said it was :) | 13:49 |
catmando | but powervc / hmc don't seem to like it | 13:49 |
catmando | unless it's reached 100% | 13:49 |
catmando | which, at 2MB/s background speed can take a while | 13:50 |
catmando | sometimes it works, sometimes it does not | 13:50 |
catmando | i've filed a bug report | 13:50 |
edmondsw | good call | 13:50 |
catmando | with a screencapture | 13:50 |
edmondsw | I assume you mean you opened a PMR with IBM support? | 13:50 |
catmando | yes | 13:51 |
edmondsw | tx, just making sure :) | 13:52 |
edmondsw | chhavi__ are you around to look at ^ ? | 13:53 |
esberglu | edmondsw: Not gonna call a meeting, but do have some things to discuss | 14:00 |
esberglu | edmondsw: https://morpheus.pok.stglabs.ibm.com:8443/#/c/6208/ | 14:02 |
edmondsw | esberglu looking | 14:02 |
esberglu | Can I get a review on that? OOT CI is failing until that merges | 14:02 |
esberglu | I spent some time yesterday working IT SEA CI | 14:03 |
edmondsw | +2 | 14:03 |
esberglu | Things are looking pretty good, got a passing run here | 14:03 |
esberglu | http://184.172.12.213/manual/it_v7/powervm_os_ci.html | 14:03 |
esberglu | https://morpheus.pok.stglabs.ibm.com:8443/#/c/6210/ | 14:04 |
esberglu | Oh crap | 14:04 |
edmondsw | ? | 14:04 |
esberglu | Didn't mean to post that | 14:04 |
catmando | edmondsw: you're right. the issue is that powervc implements extended glance, as opposed to cinder, when creating instances | 14:05 |
esberglu | Anyhow, that's the IT CI work, just have the TODOs in the commit message | 14:05 |
catmando | the docs are confusing on that point | 14:06 |
esberglu | edmondsw: OVS on the other hand is not going so well. I've been trying to get OOT stack spawns working | 14:06 |
esberglu | I have been exploring 2 paths there | 14:07 |
esberglu | 1) Using the NEUTRON_CREATE_INITIAL_NETWORKS=False | 14:07 |
esberglu | Then creating my own network and spawning instances | 14:07 |
esberglu | The spawns work, but the instances have not connectivity in or out | 14:07 |
esberglu | I'm worried that by specifying that option, something isn't getting set up properly by devstack | 14:08 |
esberglu | 2) Setting that option to True | 14:08 |
esberglu | In which case I can't get a working stack | 14:08 |
esberglu | Because devstack is creating 2 networks, both named private | 14:08 |
esberglu | Then fails because it is expecting there to be a network named public later in the stack | 14:09 |
edmondsw | esberglu something to do with your local.conf? | 14:10 |
esberglu | edmondsw: Most likely. I've been working through the ovs/neutron stack code trying to figure out what's up | 14:11 |
edmondsw | thorst is in the office today if you want to pick his brain | 14:11 |
esberglu | edmondsw: The last thing is the vSCSI patch. I still have to add a few things and update the UT | 14:12 |
esberglu | But if I could get a review on that and on the OVS patch this week that would be great | 14:12 |
esberglu | OVS first if you don't have enough time | 14:13 |
edmondsw | esberglu I'm real stretched on time but I'll try | 14:18 |
esberglu | edmondsw: I understand. efried put a pretty solid review up on it already | 14:19 |
edmondsw | esberglu yep, if I don't get through it this week just go ahead and address the comments I already made | 14:20 |
esberglu | edmondsw: Will do | 14:20 |
edmondsw | esberglu this wouldn't be relevant to your case, would it? | 14:25 |
edmondsw | "Note: In a node using a release of Open vSwitch provided from another source than your Linux distribution you have to enable in your local.conf skipping of OVS installation step by setting SKIP_OVS_INSTALL=True. For example when stacking together with networking-ovs-dpdk Neutron plug-in to avoid conflicts between openvswitch and ovs-dpdk you have to add this to the local.conf file" | 14:25 |
edmondsw | I know you're not trying dpdk | 14:25 |
esberglu | edmondsw: Nope our ovs is from Ubuntu | 14:26 |
edmondsw | esberglu did you set OVS_PHYSICAL_BRIDGE ? | 14:27 |
esberglu | edmondsw: Yeah I set the OVS options as detailed here | 14:28 |
esberglu | https://docs.openstack.org/devstack/latest/guides/neutron.html | 14:28 |
edmondsw | show me? | 14:29 |
*** svenkat has joined #openstack-powervm | 14:30 | |
esberglu | edmondsw: neo4. Regular login. /opt/stack/devstack/local.conf | 14:32 |
esberglu | I don't have the "neutron options" section in there right now because that is used for the net creation which I have as False | 14:33 |
esberglu | The gateway ips, and allocation pools and stuff | 14:33 |
*** svenkat_ has joined #openstack-powervm | 14:33 | |
*** svenkat has quit IRC | 14:34 | |
*** svenkat_ is now known as svenkat | 14:34 | |
esberglu | edmondsw: Did you pull latest devstack? | 14:34 |
edmondsw | on neo4? I set that up months ago | 14:35 |
edmondsw | i just lost connectivity to neo4 | 14:35 |
*** k0da has joined #openstack-powervm | 14:35 | |
esberglu | Yeah, same. Unstacking deletes br-ex | 14:35 |
esberglu | But I had a change in there that removed that | 14:35 |
esberglu | That's why I was asking if you pulled latest devstack | 14:35 |
edmondsw | wait, neo4 isn't the one I setup, that was neo5... so why were you asking me about devstack? | 14:36 |
edmondsw | oh, ok... no, I didn't do anything but login before it kicked me out | 14:36 |
esberglu | edmondsw: Yeah that's the other thing I was gonna ask about | 14:38 |
esberglu | https://github.com/openstack-dev/devstack/blob/master/lib/neutron_plugins/ovs_base#L46 | 14:38 |
esberglu | So that deletes all the ovs bridges, including br-ex | 14:38 |
esberglu | Since we have br-ex set as the public bridge | 14:39 |
esberglu | Is that a devstack bug or is that a problem with how we set up our interfaces? | 14:39 |
-openstackstatus- NOTICE: We're currently seeing an elevated rate of timeouts in jobs and the zuulv3.openstack.org dashboard is intermittently unresponsive, please stand by while we troubleshoot the issues. | 14:39 | |
edmondsw | esberglu seems like a devstack bug to me | 14:41 |
edmondsw | svenkat what do you think? | 14:41 |
edmondsw | and would you have some time today to help esberglu get devstack working with ovs? | 14:42 |
svenkat | edmondsw looking… | 14:42 |
edmondsw | esberglu devstack should only be cleaning up things that it created. If you created br-ex, then it shouldn't clean it up. That what you're thinking? | 14:43 |
*** csky_ has joined #openstack-powervm | 14:43 | |
svenkat | I have not seen this problem in my devstack environments. i have done vm deployments in devstack environment and access to host stayed on. | 14:44 |
svenkat | edmondsw - canyou send me the local.conf you used? | 14:44 |
esberglu | svenkat: I can | 14:44 |
esberglu | svenkat: Might be a problem with my local.conf. In the pdf you sent me you don't specify br-ex as the PUBLIC_BRIDGE, which is what it uses during the ovs del-br | 14:45 |
svenkat | esberglu - oh ok.. why did you modify local.conf, what happens othewise? | 14:46 |
esberglu | svenkat: I had that in there from previous discussions with thorst | 14:47 |
*** chhavi__ has quit IRC | 15:34 | |
*** AlexeyAbashkin has quit IRC | 16:26 | |
*** AlexeyAbashkin has joined #openstack-powervm | 16:38 | |
*** AlexeyAbashkin has quit IRC | 16:47 | |
*** edmondsw has quit IRC | 17:06 | |
*** svenkat has quit IRC | 17:07 | |
*** k0da has quit IRC | 17:42 | |
*** edmondsw has joined #openstack-powervm | 17:56 | |
*** edmondsw has quit IRC | 18:04 | |
*** svenkat has joined #openstack-powervm | 18:13 | |
*** AlexeyAbashkin has joined #openstack-powervm | 18:14 | |
*** AlexeyAbashkin has quit IRC | 18:18 | |
*** AlexeyAbashkin has joined #openstack-powervm | 18:34 | |
*** AlexeyAbashkin has quit IRC | 18:38 | |
*** k0da has joined #openstack-powervm | 18:53 | |
*** edmondsw has joined #openstack-powervm | 18:59 | |
*** k0da has quit IRC | 19:03 | |
*** svenkat_ has joined #openstack-powervm | 19:13 | |
*** svenkat has quit IRC | 19:14 | |
*** svenkat_ is now known as svenkat | 19:14 | |
*** esberglu has quit IRC | 19:49 | |
*** esberglu has joined #openstack-powervm | 19:50 | |
*** tonyb_ has quit IRC | 19:52 | |
*** tonyb has joined #openstack-powervm | 19:52 | |
-openstackstatus- NOTICE: The zuul scheduler has been restarted after lengthy troubleshooting for a memory consumption issue; earlier changes have been reenqueued but if you notice jobs not running for a new or approved change you may want to leave a recheck comment or a new approval vote | 20:15 | |
*** csky_ has quit IRC | 20:25 | |
*** csky_ has joined #openstack-powervm | 20:26 | |
*** csky_ has quit IRC | 20:31 | |
*** csky_ has joined #openstack-powervm | 20:34 | |
*** mdrabe has quit IRC | 20:35 | |
*** mdrabe has joined #openstack-powervm | 20:42 | |
*** csky_ has quit IRC | 20:56 | |
*** csky_ has joined #openstack-powervm | 20:57 | |
*** csky_ has quit IRC | 21:01 | |
*** chhavi__ has joined #openstack-powervm | 21:30 | |
*** chhavi__ has quit IRC | 21:34 | |
*** AlexeyAbashkin has joined #openstack-powervm | 21:34 | |
*** k0da has joined #openstack-powervm | 21:38 | |
*** AlexeyAbashkin has quit IRC | 21:38 | |
*** csky_ has joined #openstack-powervm | 21:54 | |
*** csky__ has joined #openstack-powervm | 21:55 | |
*** AlexeyAbashkin has joined #openstack-powervm | 21:57 | |
*** csky_ has quit IRC | 21:59 | |
*** svenkat has quit IRC | 21:59 | |
*** AlexeyAbashkin has quit IRC | 22:02 | |
*** esberglu has quit IRC | 22:58 | |
*** esberglu has joined #openstack-powervm | 22:59 | |
*** edmondsw has quit IRC | 23:02 | |
*** esberglu has quit IRC | 23:03 | |
*** edmondsw has joined #openstack-powervm | 23:05 | |
*** edmondsw has quit IRC | 23:10 | |
*** esberglu has joined #openstack-powervm | 23:13 | |
*** esberglu has quit IRC | 23:15 | |
*** k0da has quit IRC | 23:16 | |
*** k0da has joined #openstack-powervm | 23:32 | |
*** edmondsw has joined #openstack-powervm | 23:44 | |
*** edmondsw has quit IRC | 23:48 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!