| *** svenkat has joined #openstack-powervm | 00:35 | |
| *** k0da has quit IRC | 00:53 | |
| *** svenkat has quit IRC | 01:45 | |
| *** jwcroppe has joined #openstack-powervm | 04:55 | |
| *** k0da has joined #openstack-powervm | 07:03 | |
| *** k0da has quit IRC | 08:34 | |
| *** k0da has joined #openstack-powervm | 09:46 | |
| *** smatzek has joined #openstack-powervm | 10:52 | |
| *** edmondsw has quit IRC | 11:14 | |
| *** edmondsw has joined #openstack-powervm | 12:09 | |
| *** tblakes has joined #openstack-powervm | 12:09 | |
| *** svenkat has joined #openstack-powervm | 12:49 | |
| *** apearson has joined #openstack-powervm | 12:56 | |
| *** mdrabe has joined #openstack-powervm | 13:08 | |
| *** esberglu has joined #openstack-powervm | 13:13 | |
| *** tjakobs has joined #openstack-powervm | 13:16 | |
| *** tjakobs has quit IRC | 13:22 | |
| *** smatzek has quit IRC | 13:32 | |
| *** jpasqualetto has joined #openstack-powervm | 13:55 | |
| *** smatzek has joined #openstack-powervm | 13:57 | |
| *** kriskend_ has joined #openstack-powervm | 14:14 | |
| *** tjakobs has joined #openstack-powervm | 14:36 | |
| *** burgerk has joined #openstack-powervm | 15:05 | |
| openstackgerrit | Taylor Jakobson proposed openstack/nova-powervm master: Add iSER support https://review.openstack.org/445667 | 15:16 |
|---|---|---|
| *** jwcroppe has quit IRC | 15:28 | |
| *** jwcroppe has joined #openstack-powervm | 15:29 | |
| *** jwcroppe has quit IRC | 15:33 | |
| efried | tjakobs yt? | 15:38 |
| tjakobs | ya | 15:38 |
| efried | Where (what releases) is this iscsi stuff? | 15:39 |
| efried | Trying to figure out if proposed pypowervm change 4985 will break backward compatibility. I think it will, if someone uses a new pypowervm against an older REST. | 15:39 |
| tjakobs | i think the first iscsi stuff was in newton | 15:40 |
| efried | Oh, then definitely. | 15:40 |
| efried | Commented accordingly - please revise. | 15:40 |
| *** jwcroppe has joined #openstack-powervm | 15:43 | |
| efried | tjakobs ...and test accordingly (sorry) | 15:49 |
| *** mdrabe has quit IRC | 16:26 | |
| *** mdrabe has joined #openstack-powervm | 16:26 | |
| *** k0da has quit IRC | 16:26 | |
| *** jpasqualetto has quit IRC | 16:45 | |
| *** jpasqualetto has joined #openstack-powervm | 16:57 | |
| *** jpasqualetto has quit IRC | 17:50 | |
| *** jpasqualetto has joined #openstack-powervm | 18:09 | |
| *** jayasankar_ has joined #openstack-powervm | 18:11 | |
| jayasankar_ | Hi All, While I deploy a VM on SDN host with SSP, I'm getting the error http://paste.openstack.org/show/603176/ | 18:19 |
| *** mdrabe has quit IRC | 18:22 | |
| esberglu | jayansankar_: This is using the in-tree driver correct? | 18:22 |
| jayasankar_ | Yes | 18:23 |
| *** burgerk_ has joined #openstack-powervm | 18:26 | |
| *** burgerk has quit IRC | 18:29 | |
| esberglu | ssp isn't supported yet in-tree unless you have the in-flight changeset for it | 18:29 |
| esberglu | https://review.openstack.org/#/c/443189/ | 18:31 |
| *** kriskend_ has quit IRC | 18:32 | |
| *** mdrabe has joined #openstack-powervm | 18:34 | |
| *** kriskend has joined #openstack-powervm | 18:34 | |
| jayasankar_ | esberglu: Yes I applied that change set | 18:35 |
| *** burgerk_ has quit IRC | 19:01 | |
| *** apearson has quit IRC | 19:01 | |
| *** apearson has joined #openstack-powervm | 19:03 | |
| *** apearson has quit IRC | 19:19 | |
| efried | esberglu http://184.172.12.213/60/443960/2/check/networking-powervm-out-of-tree-pvm/1efa7b8/console.html - this looks like the failure we thought we were circumventing with the change sets you dropped earlier. Can you debug? | 19:53 |
| efried | jayasankar_ Looking... | 19:53 |
| efried | jayasankar_ Looks like you don't have your cluster set up. If you reinstalled, you'll need to recreate (or rediscover) your SSP on your VIOS. | 19:54 |
| efried | But | 19:54 |
| efried | I should put in a better error message for this. | 19:54 |
| efried | Can you leave a -1 with a comment to that effect on this change set? | 19:54 |
| jayasankar_ | efried: Yes, I recreated the cluster as well, and I was able to see it in pvmctl cluster list on the host | 19:55 |
| efried | Before or after this error? | 19:56 |
| jayasankar_ | before the error | 19:56 |
| efried | hmph. Okay, I'll log into your system and poke around some. | 19:56 |
| jayasankar_ | before starting the first deploy | 19:56 |
| jayasankar_ | The other observation is that, though the VM's are going into error state those are holding the cores and the latest deploy gave me the below error | 19:57 |
| jayasankar_ | neo@neo34:/opt/stack/logs$ openstack server create B18_VM --image Ubuntu_16-04-01_2g --flavor ds4G | 19:57 |
| jayasankar_ | Quota exceeded for cores: Requested 4, but already used 20 of 20 cores (HTTP 403) (Request-ID: req-bc20b77d-685d-4ccc-81c1-b14b3f3f10b4) | 19:57 |
| efried | eek, you're using a 20-CPU flavor? | 19:58 |
| jayasankar_ | No, I was using the flavor ds4G with 4cpu's | 19:59 |
| efried | How many times did you try to deploy? | 19:59 |
| jayasankar_ | 4 got error and 5th got the above msg at the command line. | 20:00 |
| jayasankar_ | 4 error VM's are already there in the Instances list. | 20:00 |
| efried | But you've cleaned up since then? | 20:01 |
| jayasankar_ | These are all recent deploys, just kept them for debugging.. | 20:01 |
| *** apearson has joined #openstack-powervm | 20:01 | |
| efried | Are you still on neo34? | 20:02 |
| jayasankar_ | Yeah. | 20:02 |
| efried | I'm looking at the n-cpu log and only seeing that one error. | 20:02 |
| jayasankar_ | Yeah.. that is the pblm.. | 20:03 |
| efried | The first attempt to start the driver failed with the error you pastebin'd. The second appears to have succeeded. But I don't see any deploys after that. And I don't see any nova instances. And I don't see any LPARs. | 20:03 |
| jayasankar_ | Yeah.. that is the behavior even I observed that is why I didn't delete those Err vm's from the instance list. | 20:04 |
| efried | But... | 20:05 |
| efried | There's no evidence that any VMs were ever created | 20:05 |
| jayasankar_ | None went through after the reconfiguration | 20:06 |
| efried | What reconfiguration? Did you restack at some point? | 20:06 |
| jayasankar_ | Yeah.. reinstalled Neo for getting additional file storage | 20:06 |
| efried | Okay, but the spawn failures were _before_ the reinstall? | 20:07 |
| jayasankar_ | I don't think so. bcz after the scratch install only I installed Devstack and created SSP and started fresh deploy | 20:08 |
| efried | jayasankar_ Okay, I think the problem is more fundamental. | 20:12 |
| efried | No host-to-cell mapping found for selected host neo34. Setup is incomplete. | 20:12 |
| efried | ^^ from the conductor | 20:12 |
| efried | I don't understand cells. | 20:12 |
| openstackgerrit | Taylor Jakobson proposed openstack/nova-powervm master: Add iSER support https://review.openstack.org/445667 | 20:15 |
| efried | jayasankar_ Okay, this is interesting. I found this launchpad bug: https://bugs.launchpad.net/packstack/+bug/1673305 | 20:15 |
| openstack | Launchpad bug 1673305 in Packstack "No host-to-cell mapping found for selected host packstack. Setup is incomplete." [Undecided,New] | 20:15 |
| efried | jayasankar_ After I ran the nova-manage command suggested by amoralej, I was able to get a deploy started. | 20:19 |
| jayasankar_ | ah.. | 20:19 |
| *** k0da has joined #openstack-powervm | 20:20 | |
| jayasankar_ | it got failed again.. | 20:21 |
| efried | Damn, it's that same failure you were seeing before. I can't suss this. | 20:24 |
| efried | Okay, so here's what I'd like you to do. | 20:25 |
| efried | Upload the logs somewhere we can get at 'em. Maybe box or something? Preferably a public spot so you can legally paste the URL into the change set. | 20:26 |
| efried | -1 the change set, with two comments: | 20:26 |
| efried | First, need a better error message (i.e. better than "list index out of range") when there's no cluster. | 20:27 |
| efried | Second, need to nail down this glance error. | 20:27 |
| efried | And actually, also put a link to the above launchpad bug, noting that we had to run that nova-manage command before we could even get started. | 20:27 |
| jayasankar_ | sure | 20:28 |
| efried | I'm going to have to rebase the world anyway here, which I probably won't finish up until next week. Once that's done, we can try again, and maybe those latter two issues will magically resolve themselves. | 20:28 |
| jayasankar_ | ha. | 20:29 |
| efried | I just rebased the bottom change set (https://review.openstack.org/#/c/438119/) so once you get done with the above, you could re-test that guy. | 20:30 |
| efried | For that one, you're just verifying that the driver starts successfully, and spawn/delete go through (though they don't actually create LPARs) | 20:31 |
| efried | tjakobs I think you've got some more work to do on https://review.openstack.org/#/c/445667/ | 20:32 |
| efried | tjakobs Did you get it passing locally with the pypowervm patch loaded into your tox env? | 20:32 |
| efried | I suspect not. | 20:32 |
| efried | I think the autospec isn't quite right. | 20:33 |
| tjakobs | i didn't put the whole patch on, but i added the 1 arg to discover_iscsi | 20:33 |
| efried | There's an easier way; I'll show you in a minute. | 20:34 |
| *** smatzek has quit IRC | 20:34 | |
| efried | But having done that, did it pass locally? | 20:34 |
| tjakobs | i added it to py34 and got pep8/py34 passing and py27 failing | 20:34 |
| efried | hmph. That surprises me, given the error I'm seeing in the change set. | 20:34 |
| jayasankar_ | Adam: Can you tell how to upload logs ? | 20:34 |
| efried | Anyway, the easiest way is to cd .tox/pyXX/src/pypowervm and then git review -d <number>. That'll pull down the change set as it sits on gerrit. That way you know you're consistent. | 20:35 |
| efried | adreznec yt? | 20:35 |
| efried | esberglu Maybe you can help too | 20:35 |
| efried | Bueller? Bueller? | 20:36 |
| jayasankar_ | esberglu: where and how I can keep the logs into ? | 20:37 |
| tjakobs | efried: tried the git review -d from .tox/pyXX/src/pypowervm and got this `ValueError: No JSON object could be decoded`. I'm just going to cp the files in and try | 20:38 |
| adreznec | efried: jayasankar_ Sorry, was moving between locations | 20:38 |
| adreznec | Upload which logs exactly? devstack logs? | 20:38 |
| efried | tjakobs You'll be better off getting set up properly. | 20:38 |
| efried | oh | 20:38 |
| efried | Unless that directory didn't exist. | 20:39 |
| efried | Cause maybe we're using global reqs now. | 20:39 |
| efried | Noooo, we shouldn't be. | 20:39 |
| efried | Did that directory exist? | 20:39 |
| tjakobs | ya | 20:39 |
| efried | First, if you had made manual changes, you would have to reset or stash before you could download. | 20:39 |
| jayasankar_ | adreznec: Yes devstack logs | 20:39 |
| efried | Second, you'll have to set up your git remote. | 20:39 |
| efried | adreznec Yeah, we want to upload some logs from a local test to a public place so jayasankar_ can link them from a review comment on openstack gerrit. | 20:40 |
| efried | A launchpad bug isn't appropriate because the change set is in flight. | 20:40 |
| efried | Do we use box for that? | 20:40 |
| esberglu | efried: Sorry I was afk for a while, catching up | 20:40 |
| adreznec | jayasankar_: Your best bet is going to be to upload them to http://paste.openstack.org/ since that's what most of upstream uses | 20:40 |
| adreznec | There are CLI utilities for pushing a file to paste | 20:41 |
| adreznec | Like pastebinit | 20:41 |
| efried | coo | 20:41 |
| adreznec | So you could do like "pastebinit -i your.log -b http://paste.openstack.org" | 20:42 |
| jayasankar_ | ah..ok, I can point the whole whole logs folder ? | 20:42 |
| adreznec | I don't know if it does recursion | 20:42 |
| adreznec | I've never used it that way | 20:42 |
| jayasankar_ | efried: you want me to add only n-cpu or any more ? | 20:42 |
| efried | jayasankar_ n-cpu, n-sch, and n-cond | 20:43 |
| jayasankar_ | sure. | 20:43 |
| esberglu | efried: Regarding the failure you linked earlier. The nodes just hadn't finished clearing out so that typo fix wasn't in yet | 20:45 |
| efried | esberglu Okay, cool. We ready to recheck yet? | 20:46 |
| esberglu | Yeah. It might take a little while to go through. A bunch of the CI neos got shut off for memory upgrades so the queue got a little backed up | 20:47 |
| esberglu | Those are coming back online now | 20:47 |
| esberglu | CI should catch back up pretty quickly once they are all back up | 20:47 |
| *** svenkat has quit IRC | 20:47 | |
| efried | esberglu Okay, posted recheck. Thanks. | 20:48 |
| *** tblakes has quit IRC | 20:48 | |
| jayasankar_ | adreznec: I uploaded using that command but I'm wondering I haven't got notification on the paste link ? | 20:50 |
| adreznec | jayasankar_: That's weird, it should have given you links back in the terminal | 20:51 |
| jayasankar_ | Yeah.. | 20:52 |
| *** k0da has quit IRC | 20:58 | |
| *** apearson has quit IRC | 20:58 | |
| *** apearson has joined #openstack-powervm | 21:08 | |
| *** apearson has quit IRC | 21:21 | |
| *** jpasqualetto has quit IRC | 21:23 | |
| openstackgerrit | Taylor Jakobson proposed openstack/nova-powervm master: Add iSER support https://review.openstack.org/445667 | 21:24 |
| *** kriskend has quit IRC | 21:24 | |
| *** edmondsw has quit IRC | 21:24 | |
| *** edmondsw has joined #openstack-powervm | 21:29 | |
| *** edmondsw has quit IRC | 21:31 | |
| *** edmondsw has joined #openstack-powervm | 21:34 | |
| *** jpasqualetto has joined #openstack-powervm | 21:35 | |
| *** edmondsw has quit IRC | 21:39 | |
| *** jwcroppe has quit IRC | 21:40 | |
| *** esberglu has quit IRC | 21:41 | |
| *** esberglu has joined #openstack-powervm | 21:41 | |
| *** esberglu has quit IRC | 21:46 | |
| *** tjakobs has quit IRC | 21:48 | |
| *** jpasqualetto has quit IRC | 21:58 | |
| *** mdrabe has quit IRC | 22:15 | |
| *** k0da has joined #openstack-powervm | 22:17 | |
| efried | adreznec esberglu, in case we ever feel down about the reliability of our CI, we need look no further than xenserver for an ego boost. | 22:47 |
| efried | That POS fails like 50% of the time. | 22:47 |
| *** jayasankar_ has quit IRC | 22:50 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!