| *** littleidea has quit IRC | 00:19 | |
| *** littleidea has joined #openstack | 00:19 | |
| *** littleidea_ has joined #openstack | 00:20 | |
| *** littleidea has quit IRC | 00:23 | |
| *** littleidea_ is now known as littleidea | 00:23 | |
| *** reldan has joined #openstack | 00:25 | |
| *** rpedde has joined #openstack | 00:28 | |
| *** nelson has quit IRC | 00:29 | |
| *** nelson has joined #openstack | 00:29 | |
| *** joearnold has quit IRC | 00:32 | |
| nelson | Suggestion: include a "swift-version" program in the next release, which should (dare I say it?) print the version of swift. | 00:33 |
|---|---|---|
| *** kashyapc has quit IRC | 00:34 | |
| *** dirakx has joined #openstack | 00:35 | |
| *** adiantum has quit IRC | 00:38 | |
| *** reldan has quit IRC | 00:39 | |
| uvirtbot | New bug: #706147 in swift "Documentation doesn't explain 404 error" [Undecided,New] https://launchpad.net/bugs/706147 | 00:46 |
| *** cyonyx has quit IRC | 00:47 | |
| *** te has quit IRC | 00:47 | |
| *** drico has quit IRC | 00:48 | |
| *** adiantum has joined #openstack | 00:52 | |
| *** littleidea_ has joined #openstack | 00:55 | |
| nelson | what does it mean when one machine asks three account-servers for a HEAD, and two return a 404 but one returns 204? | 00:55 |
| *** littleidea has quit IRC | 00:58 | |
| *** littleidea_ is now known as littleidea | 00:58 | |
| *** drico has joined #openstack | 00:59 | |
| *** dragondm has quit IRC | 01:00 | |
| *** dfg has quit IRC | 01:01 | |
| *** kashyapc has joined #openstack | 01:04 | |
| creiht | nelson: then two of the account servers that are supposed to have the account info could not find them | 01:07 |
| creiht | the one that returned 204 does have the information | 01:07 |
| nelson | yep. but the account replicator is running, and the account auditor (seems not to) be complaining. | 01:08 |
| creiht | strange | 01:08 |
| nelson | I'm sure that I've misconfigured something, but the software isn't noticing what it is. | 01:09 |
| nelson | aka Swift vs. Naive Swift Admin. Admin 1, Swift 0. | 01:09 |
| creiht | so if you do | 01:09 |
| creiht | heh | 01:09 |
| *** rpedde has quit IRC | 01:09 | |
| creiht | swift-get-nodes /etc/swift/account.ring.gz ACCOUNT_HASH | 01:09 |
| creiht | it should give you the ssh command to physically look for the account dbs | 01:10 |
| *** MarkAtwood has quit IRC | 01:10 | |
| creiht | if you look for those does it find them? | 01:10 |
| nelson | Oooh! Look at that! | 01:10 |
| * creiht ponders what nelson is looking at | 01:12 | |
| nelson | nifty program tells me exactly what commands to run. | 01:12 |
| creiht | heh | 01:12 |
| nelson | Only ... exactly what is ACCOUNT_HASH? | 01:12 |
| creiht | usually it looks something like | 01:13 |
| creiht | AUTH_some_hash | 01:13 |
| creiht | it is the part that is at the end of your storage url | 01:13 |
| nelson | Gee, if the program would only put hash chars in front of its other output, then I could pipe its output to /bin/sh | 01:13 |
| nelson | just the hex part and not the AUTH_ part? | 01:14 |
| creiht | the whole thing | 01:14 |
| creiht | my test account on the saio looks like: AUTH_d305e9dbedbc47df8b25ab46f3152f81 | 01:15 |
| *** miclorb_ has quit IRC | 01:16 | |
| nelson | two of the five nodes have it. They're all running account-servers | 01:18 |
| nelson | But a, c, and d got asked for it, but only c and e have it. | 01:18 |
| nelson | That sure points to my account ring being fux0red. | 01:19 |
| creiht | nelson: have you checked that all the machines have the same ring? | 01:19 |
| nelson | An account hash should always start with AUTH_, right? Shouldn't swift-get-nodes check for that on the command line? | 01:21 |
| nelson | (I know, I know, internal tool released to the public, sharp edges & such) | 01:21 |
| creiht | depends on your setup | 01:21 |
| creiht | In our situtation we have several resellers, and thus several different prefixes | 01:21 |
| nelson | oh; I thought I read somewhere that the account will always start with AUTH_ or was that devauth? | 01:22 |
| creiht | that is for devauth | 01:22 |
| nelson | okay. Yes, the account.ring.gz is the same across the cluster. | 01:23 |
| creiht | ok then that is good | 01:23 |
| gholt | Could be permissions problems on the two "bad" nodes. | 01:24 |
| nelson | no, it's bad, because if it was inconsistent, then I'd just fix it and be on my way. | 01:24 |
| nelson | :) | 01:24 |
| creiht | hehe | 01:24 |
| creiht | nelson: yeah, on the two nodes that are supposed ot have it, I would check logs on that machine, see if anything is going wring | 01:24 |
| nelson | They're returning a 404. | 01:25 |
| nelson | and they don't have it. | 01:25 |
| nelson | so then the question becomes: why does the proxy think they should? | 01:25 |
| creiht | I would look in their logs for obvious errors like permission denied | 01:25 |
| creiht | when the acct was created | 01:25 |
| nelson | I just checked ownership, and it looks like swift:swift across the board. | 01:26 |
| creiht | the proxy thinks that is where they should be, because that is where the ring says they should be | 01:26 |
| nelson | yep. BTW, ownership is correct, except that node d doesn't have /srv/node/sdc1/accounts | 01:28 |
| nelson | and it's running account-server (which isn't whinging) | 01:28 |
| nelson | yep, never once whinges ... not even at start-up time. | 01:29 |
| creiht | nelson: if you run swift-auth-recreate accounts, what do you get? | 01:29 |
| creiht | probably on the auth server | 01:29 |
| nelson | I get the help message because I didn't give it the config file. :-) | 01:30 |
| creiht | heh | 01:30 |
| nelson | Recreating accounts failed. (401) | 01:31 |
| creiht | you have to specify -K YOUR_SUPER_AUTH_KEY | 01:31 |
| nelson | I did. | 01:32 |
| nelson | but I notice that it's looking in auth-server.conf for cert-file which isn't specified, otherwise it won't do ssl | 01:33 |
| nelson | oh, wait, sorry, it is. | 01:33 |
| nelson | cert_file. I was searching for cert-file. | 01:33 |
| nelson | urgh. The self-doc says that -U should be followed by the super_admin, and that didn't work. | 01:35 |
| nelson | but you just said to use -K super_auth and that did work. | 01:36 |
| nelson | re-created two accounts. | 01:36 |
| creiht | ok, now check if the accounts are on the servers they are supposed to be on | 01:36 |
| creiht | if not, look at those server logs to see what went wrong | 01:36 |
| nelson | they are. | 01:37 |
| nelson | and now swift-stats-populate is running again. | 01:37 |
| creiht | heh | 01:37 |
| nelson | any idea what I did wrong? | 01:37 |
| creiht | well my best guess was that maybe the accounts were created when you had your messed up rings | 01:38 |
| creiht | which got it into some weird state | 01:38 |
| nelson | possibly. | 01:38 |
| nelson | I'll leave a note on my doc bug report. Thanks for your help!!! This had me stuck for a few days, staring. | 01:39 |
| creiht | heh | 01:39 |
| creiht | np | 01:39 |
| nelson | I was treating it as a learning experience. | 01:39 |
| * creiht is going to go enjoy the weekend now | 01:39 | |
| nelson | woot woot! Have fun! | 01:40 |
| nelson | swift-stats-populate just ran to completion for containers. Now working on objects | 01:40 |
| *** adiantum has quit IRC | 01:41 | |
| *** drico has quit IRC | 01:42 | |
| *** adiantum has joined #openstack | 01:47 | |
| *** miclorb_ has joined #openstack | 01:57 | |
| nelson | mwahahaha! it's finished. | 01:58 |
| *** drico has joined #openstack | 01:59 | |
| *** jdurgin has quit IRC | 02:00 | |
| *** Ryan_Lane has quit IRC | 02:03 | |
| *** pvo_away is now known as pvo | 02:07 | |
| *** adiantum has quit IRC | 02:11 | |
| *** adiantum has joined #openstack | 02:17 | |
| *** littleidea has quit IRC | 02:20 | |
| *** littleidea has joined #openstack | 02:20 | |
| *** littleidea_ has joined #openstack | 02:24 | |
| *** littleidea has quit IRC | 02:25 | |
| *** littleidea_ is now known as littleidea | 02:25 | |
| *** adiantum has quit IRC | 02:27 | |
| *** littleidea has joined #openstack | 02:29 | |
| *** maplebed has quit IRC | 02:30 | |
| *** adiantum has joined #openstack | 02:31 | |
| *** adiantum has quit IRC | 02:43 | |
| *** adiantum has joined #openstack | 02:49 | |
| *** Pentheus has quit IRC | 02:50 | |
| *** littleidea_ has joined #openstack | 02:53 | |
| *** littleidea has quit IRC | 02:55 | |
| *** littleidea_ is now known as littleidea | 02:55 | |
| *** stewart has quit IRC | 02:56 | |
| *** adiantum has quit IRC | 02:56 | |
| *** drico has quit IRC | 02:57 | |
| *** drico has joined #openstack | 02:59 | |
| *** adiantum has joined #openstack | 03:02 | |
| *** westmaas has joined #openstack | 03:22 | |
| *** littleidea has quit IRC | 03:37 | |
| *** littleidea has joined #openstack | 03:37 | |
| *** littleidea_ has joined #openstack | 03:39 | |
| *** littleidea has quit IRC | 03:42 | |
| *** littleidea_ is now known as littleidea | 03:42 | |
| uvirtbot | New bug: #706174 in glance "PUT is reading entire image into memory" [High,In progress] https://launchpad.net/bugs/706174 | 03:46 |
| *** adiantum has quit IRC | 03:47 | |
| *** miclorb_ has quit IRC | 03:50 | |
| *** adiantum has joined #openstack | 03:54 | |
| *** Ryan_Lane has joined #openstack | 03:54 | |
| *** drico has quit IRC | 03:57 | |
| *** miclorb has joined #openstack | 03:58 | |
| *** drico has joined #openstack | 03:59 | |
| *** Ryan_Lane_ has joined #openstack | 04:01 | |
| *** Ryan_Lane has quit IRC | 04:03 | |
| *** laner has joined #openstack | 04:04 | |
| *** Ryan_Lane_ has quit IRC | 04:06 | |
| *** Cybodog has quit IRC | 04:16 | |
| *** adiantum has quit IRC | 04:30 | |
| *** adiantum has joined #openstack | 04:35 | |
| *** Ryan_Lane_ has joined #openstack | 04:37 | |
| *** laner has quit IRC | 04:39 | |
| *** omidhdl has joined #openstack | 04:42 | |
| *** Ryan_Lane_ has quit IRC | 04:43 | |
| *** ShermanBoyd has joined #openstack | 04:59 | |
| *** drico_ has joined #openstack | 05:00 | |
| *** drico has quit IRC | 05:00 | |
| *** westmaas has quit IRC | 05:02 | |
| *** westmaas has joined #openstack | 05:11 | |
| *** adiantum has quit IRC | 05:12 | |
| *** adiantum has joined #openstack | 05:17 | |
| *** westmaas has quit IRC | 05:19 | |
| *** westmaas has joined #openstack | 05:31 | |
| *** allsystemsarego has joined #openstack | 05:56 | |
| *** drico has joined #openstack | 05:59 | |
| *** adiantum has quit IRC | 06:00 | |
| *** pvo is now known as pvo_away | 06:01 | |
| *** drico_ has quit IRC | 06:03 | |
| *** wreese has quit IRC | 06:05 | |
| *** adiantum has joined #openstack | 06:06 | |
| *** zenmatt has quit IRC | 06:29 | |
| uvirtbot | New bug: #706192 in glance "Generates exception when updating properties" [Medium,In progress] https://launchpad.net/bugs/706192 | 06:31 |
| *** adiantum has quit IRC | 06:47 | |
| *** jakedahn has joined #openstack | 06:49 | |
| *** littleidea has quit IRC | 07:24 | |
| *** miclorb has quit IRC | 07:33 | |
| *** drico has quit IRC | 07:52 | |
| *** drico has joined #openstack | 07:59 | |
| *** opengeard has quit IRC | 08:10 | |
| *** BK_man has quit IRC | 08:32 | |
| *** opengeard has joined #openstack | 08:32 | |
| *** kashyapc has quit IRC | 08:34 | |
| *** codehotter has quit IRC | 08:37 | |
| *** BK_man has joined #openstack | 08:37 | |
| *** kashyapc has joined #openstack | 08:50 | |
| *** drico has quit IRC | 08:59 | |
| *** drico has joined #openstack | 08:59 | |
| *** jbaker_ has joined #openstack | 09:14 | |
| *** jimbaker has quit IRC | 09:14 | |
| *** brd_from_italy has joined #openstack | 09:20 | |
| *** jakedahn has quit IRC | 09:41 | |
| *** jakedahn_ has joined #openstack | 09:41 | |
| *** BK_man has quit IRC | 09:55 | |
| *** jakedahn_ has quit IRC | 09:59 | |
| *** reldan has joined #openstack | 10:04 | |
| *** reldan has quit IRC | 10:12 | |
| *** brd_from_italy has quit IRC | 11:09 | |
| *** ShermanBoyd has quit IRC | 11:09 | |
| *** nijaba has quit IRC | 11:36 | |
| *** flashn has joined #openstack | 11:50 | |
| *** stewart has joined #openstack | 12:13 | |
| *** rossij has quit IRC | 12:14 | |
| *** allsystemsarego has quit IRC | 12:15 | |
| *** opengeard has quit IRC | 12:38 | |
| *** jbaker_ has quit IRC | 12:48 | |
| *** allsystemsarego has joined #openstack | 12:56 | |
| *** drico has quit IRC | 12:59 | |
| *** drico has joined #openstack | 12:59 | |
| *** allsystemsarego has quit IRC | 13:01 | |
| *** rossij has joined #openstack | 13:03 | |
| *** opengeard has joined #openstack | 13:10 | |
| *** kashyapc has quit IRC | 13:12 | |
| *** pvo_away is now known as pvo | 13:15 | |
| *** nijaba has joined #openstack | 13:15 | |
| *** dendro-afk is now known as dendrobates | 13:22 | |
| *** omidhdl has quit IRC | 13:29 | |
| *** omidhdl has joined #openstack | 13:30 | |
| *** opengeard has quit IRC | 13:33 | |
| *** omidhdl has quit IRC | 13:45 | |
| *** kashyapc has joined #openstack | 13:50 | |
| *** adiantum has joined #openstack | 14:01 | |
| *** dendrobates is now known as dendro-afk | 14:17 | |
| *** adiantum has quit IRC | 14:20 | |
| *** dirakx has quit IRC | 14:24 | |
| *** adiantum has joined #openstack | 14:26 | |
| *** hagarth has joined #openstack | 14:38 | |
| *** cynb has joined #openstack | 14:38 | |
| *** cynb has quit IRC | 14:39 | |
| *** zenmatt has joined #openstack | 14:47 | |
| *** adiantum has quit IRC | 14:48 | |
| *** dendro-afk is now known as dendrobates | 14:53 | |
| *** adiantum has joined #openstack | 14:54 | |
| *** cynb has joined #openstack | 14:55 | |
| *** cynb1 has joined #openstack | 14:59 | |
| *** cynb has quit IRC | 15:01 | |
| *** cynb1 has quit IRC | 15:17 | |
| *** notmyname has quit IRC | 15:18 | |
| *** notmyname has joined #openstack | 15:18 | |
| *** ChanServ sets mode: +v notmyname | 15:18 | |
| *** adiantum has quit IRC | 15:20 | |
| *** dirakx has joined #openstack | 15:20 | |
| *** littleidea has joined #openstack | 15:24 | |
| *** adiantum has joined #openstack | 15:25 | |
| *** notmyname has quit IRC | 15:25 | |
| *** notmyname has joined #openstack | 15:26 | |
| *** ChanServ sets mode: +v notmyname | 15:26 | |
| *** notmyname has quit IRC | 15:27 | |
| *** notmyname has joined #openstack | 15:27 | |
| *** ChanServ sets mode: +v notmyname | 15:27 | |
| *** notmyname has quit IRC | 15:29 | |
| *** notmyname has joined #openstack | 15:29 | |
| *** ChanServ sets mode: +v notmyname | 15:29 | |
| *** notmyname has quit IRC | 15:30 | |
| *** notmyname has joined #openstack | 15:31 | |
| *** ChanServ sets mode: +v notmyname | 15:31 | |
| *** befreax has joined #openstack | 15:31 | |
| *** dendrobates is now known as dendro-afk | 15:34 | |
| *** lcfseth has joined #openstack | 15:36 | |
| *** lcfseth has left #openstack | 15:40 | |
| *** adiantum has quit IRC | 15:41 | |
| *** adiantum has joined #openstack | 15:48 | |
| *** pvo is now known as pvo_away | 15:52 | |
| *** kashyapc has quit IRC | 15:57 | |
| *** adiantum has quit IRC | 15:57 | |
| *** adiantum has joined #openstack | 16:10 | |
| *** notmyname has quit IRC | 16:12 | |
| *** notmyname has joined #openstack | 16:12 | |
| *** ChanServ sets mode: +v notmyname | 16:12 | |
| *** dudeman has joined #openstack | 16:23 | |
| dudeman | hey | 16:24 |
| dudeman | whats the best way to debug using the "hacking nova" instructions? my instance just stays in pending forever | 16:26 |
| *** adiantum has quit IRC | 16:28 | |
| dudeman | INSTANCE i-00000001 ami-tty 10.0.0.3 10.0.0.3 pending test (admin, saturn) 0 m1.tiny 2011-01-22 15:56:50.626067 nova | 16:29 |
| dudeman | 2011-01-22 07:57:11,727 WARNING nova.virt.libvirt_conn [-] instance instance-00000001: ignoring error injecting data into image ami-tty (nbd device /dev/nbd15 did not show up) | 16:31 |
| *** adiantum has joined #openstack | 16:33 | |
| *** adiantum has quit IRC | 16:43 | |
| dudeman | . | 16:45 |
| dudeman | . | 16:45 |
| *** aliguori has quit IRC | 16:46 | |
| dudeman | whats the best way to debug using the "hacking nova" instructions? my instance just stays in pending forever | 16:46 |
| dudeman | libvir: QEMU error : Domain not found: no domain with matching name 'instance-00000001' | 16:48 |
| dudeman | using 64bit ubuntu | 16:50 |
| *** adiantum has joined #openstack | 16:50 | |
| dudeman | i cant get nova to run and cant find any answers on the cause | 16:51 |
| dudeman | whats the best way to debug using the "hacking nova" instructions? my instance just stays in pending forever | 16:51 |
| dudeman | root@saturn:~# euca-describe-instances RESERVATION r-0a5cn243 admin INSTANCE i-00000001 ami-tty 10.0.0.3 10.0.0.3 pending test (admin, saturn) 0 m1.tiny 2011-01-22 16:43:33.259283 nova root@saturn:~# euca-describe-images IMAGE ari-tty nova/tty-ramdisk admin available public x86_64 ramdisk IMAGE ami-tty nova/tty admin | 16:52 |
| dudeman | and I thought setting up a cloud on a cisco UCS was hard, this stuff cant even be tested easily | 16:54 |
| dudeman | i am talking to myself here | 16:55 |
| dudeman | whats the best way to debug using the "hacking nova" instructions? my instance just stays in pending forever | 16:55 |
| dudeman | ssh -i test.pem root@10.0.0.3 ssh: connect to host 10.0.0.3 port 22: No route to host | 16:56 |
| dudeman | libvir: QEMU error : Domain not found: no domain with matching name 'instance-00000001' | 16:57 |
| dudeman | log shows libvir: QEMU error : Domain not found: no domain with matching name 'instance-00000001' | 16:59 |
| *** adiantum has quit IRC | 16:59 | |
| dudeman | hello? | 17:00 |
| dudeman | anyone? | 17:00 |
| dudeman | bueller? | 17:00 |
| *** adiantum has joined #openstack | 17:01 | |
| dudeman | libvir: QEMU error : Domain not found: no domain with matching name 'instance-00000001' | 17:01 |
| dudeman | whats the best way to debug using the "hacking nova" instructions? my instance just stays in pending forever | 17:02 |
| dudeman | such a quiet irc channel for so many users | 17:04 |
| dudeman | how. do. I. debug. nova??? | 17:04 |
| Jbain | I suggest flea bombing | 17:07 |
| Jbain | (I have no idea) | 17:07 |
| *** adiantum has quit IRC | 17:13 | |
| *** adiantum has joined #openstack | 17:15 | |
| *** fitzdsl has quit IRC | 17:20 | |
| *** fitzdsl has joined #openstack | 17:20 | |
| *** fitzdsl has joined #openstack | 17:21 | |
| *** fitzdsl has quit IRC | 17:33 | |
| *** fitzdsl has joined #openstack | 17:33 | |
| *** fitzdsl has quit IRC | 17:37 | |
| *** fitzdsl has joined #openstack | 17:37 | |
| *** j05h1 has joined #openstack | 17:41 | |
| *** j05h has quit IRC | 17:41 | |
| *** pvo_away is now known as pvo | 17:48 | |
| *** lcfseth has joined #openstack | 17:53 | |
| *** edleafe has joined #openstack | 17:53 | |
| *** hagarth1 has joined #openstack | 17:54 | |
| *** deshantm_ has joined #openstack | 17:54 | |
| *** jeevan_u1las has joined #openstack | 17:55 | |
| *** pvo is now known as pvo_away | 17:56 | |
| JordanRinke | word | 17:56 |
| vishy | dudeman: pending is usually a permisions issue | 17:57 |
| vishy | dudeman: are you running from root's home directory? | 17:57 |
| *** ChrisAM has quit IRC | 17:58 | |
| *** dabo has quit IRC | 17:58 | |
| *** hagarth has quit IRC | 17:58 | |
| *** asksol has quit IRC | 17:58 | |
| *** ivan has quit IRC | 17:58 | |
| *** comstud has quit IRC | 17:58 | |
| *** deshantm has quit IRC | 17:58 | |
| *** mfoemmel has quit IRC | 17:58 | |
| *** jeevan_ullas has quit IRC | 17:58 | |
| *** Daviey has quit IRC | 17:58 | |
| *** ChrisAM1 has joined #openstack | 17:58 | |
| *** ChrisAM1 has joined #openstack | 17:58 | |
| vishy | dudeman: check /var/log/libvirt/qemu/instance-00000001.log | 17:58 |
| *** ChrisAM1 is now known as ChrisAM | 17:58 | |
| *** asksol has joined #openstack | 17:59 | |
| *** mfoemmel has joined #openstack | 17:59 | |
| *** befreax has quit IRC | 18:00 | |
| vishy | dudeman: in general the channel dies on friday afternoon through the weekend | 18:00 |
| dudeman | vish: not anymore, was in root, now in /opt | 18:02 |
| *** lcfseth has left #openstack | 18:02 | |
| dudeman | so perms are not a prob now | 18:02 |
| dudeman | tha last line in the log is | 18:02 |
| dudeman | pci_add_option_rom: failed to find romfile "pxe-rtl8139.bin" | 18:03 |
| *** Daviey has joined #openstack | 18:03 | |
| *** ivan has joined #openstack | 18:03 | |
| dudeman | vish: do I need download and copy to /usr/share/qemu ? | 18:06 |
| dudeman | pxe-rtl8139.bin | 18:06 |
| dudeman | oops :) | 18:06 |
| dudeman | I think I found it, installing kvm-pxe pkg now | 18:09 |
| *** adiantum has quit IRC | 18:12 | |
| *** BK_man has joined #openstack | 18:16 | |
| dudeman | vishy: I think its working, can ping .3 address now, no errors in log or screen windows, waiting for it to finish starting, running on laptop like you did at baylisa, so I'm waiting... :) | 18:17 |
| dudeman | thanks for your help!! | 18:17 |
| *** jeevan_u1las is now known as jeevan_ullas | 18:17 | |
| *** jeevan_ullas has joined #openstack | 18:18 | |
| *** adiantum has joined #openstack | 18:19 | |
| *** cynb has joined #openstack | 18:23 | |
| *** cynb1 has joined #openstack | 18:26 | |
| *** cynb has quit IRC | 18:27 | |
| *** adiantum has quit IRC | 18:31 | |
| *** dirakx has quit IRC | 18:32 | |
| *** sandywalsh has quit IRC | 18:35 | |
| *** hggdh has quit IRC | 18:37 | |
| *** adiantum has joined #openstack | 18:38 | |
| *** hggdh has joined #openstack | 18:39 | |
| dudeman | in the console log I see this message: System is configured for NO sshd. | 18:43 |
| *** sandywalsh has joined #openstack | 18:48 | |
| *** blueadept has joined #openstack | 18:50 | |
| dudeman | i cant ssh to nova | 18:51 |
| *** BK_man has quit IRC | 18:51 | |
| dudeman | console log has this line System is configured for NO sshd. | 18:52 |
| dudeman | euca-autorize works, but still cant ssh to nova | 18:52 |
| JordanRinke | what image are you using? | 18:55 |
| JordanRinke | it sounds like the image you are using doesn't have an ssh server running | 18:56 |
| dudeman | the tty one | 18:57 |
| dudeman | i know but how to tell it to start one? | 18:57 |
| dudeman | cant find nova.conf option | 18:57 |
| dudeman | for sshd | 18:58 |
| JordanRinke | you have to modify the image itself | 18:58 |
| JordanRinke | either the instance or the image | 18:58 |
| dudeman | why, this is the test image? | 18:59 |
| *** pvo_away is now known as pvo | 18:59 | |
| dudeman | the nova pages at ansolabd/deploy say nothing of this | 18:59 |
| JordanRinke | the image decides what servers run, nothing in nova controls that. I haven't used the TTY image much | 19:00 |
| JordanRinke | so I don't know if it is running SSH and just needs key injection or not | 19:00 |
| JordanRinke | did you do key injection when you ran the euca-run-instances command? | 19:00 |
| *** adiantum has quit IRC | 19:01 | |
| dudeman | i followed http://ansolabs.com/articles/hacking-nova.html exactly | 19:01 |
| JordanRinke | ok give me a second to take a look and that and see what we have | 19:02 |
| dudeman | searching google for how to enable this does not find much | 19:02 |
| dudeman | no errors in log | 19:03 |
| dudeman | can ping the .3 address | 19:03 |
| dudeman | euca-authorize works | 19:03 |
| JordanRinke | you did a euca-auth for tcp 22? | 19:04 |
| dudeman | euca-authorize -P tcp -p 22 default | 19:07 |
| JordanRinke | when you try to ssh what do you get? no response or connection refused? | 19:09 |
| dudeman | root@saturn:/opt# ssh -i test.pem root@10.0.0.3 ssh: connect to host 10.0.0.3 port 22: Connection refused | 19:10 |
| JordanRinke | I am not sure if it is merged to trunk, can you see if you have a script called nova-debug available? | 19:13 |
| dudeman | yes its there | 19:15 |
| *** j05h has joined #openstack | 19:17 | |
| *** j05h1 has quit IRC | 19:17 | |
| dudeman | that script doesnt seem to work though | 19:18 |
| *** hggdh has quit IRC | 19:18 | |
| JordanRinke | what does it do when you try to use it? | 19:19 |
| dudeman | ./nova/tools/nova-debug instance-00000001 ./nova/tools/nova-debug: line 28: cd: /var/lib/nova/instances/instance-00000001: No such file or directory error: failed to get domain 'instance-00000001' error: Domain not found: no domain with matching name 'instance-00000001' disk: No such file or directory | 19:20 |
| dudeman | and lots of other errors | 19:20 |
| dudeman | that script is not looking in the correct place for the console log | 19:20 |
| JordanRinke | so the instances are in a different folder for you? | 19:21 |
| JordanRinke | can you try giving it the full path? nova-debug /nova/bin/instances/instance-000001 or whatever it is for you | 19:21 |
| dudeman | in /opt/nova/instances | 19:22 |
| dudeman | ok | 19:22 |
| dudeman | nova-debug does not accept args like that | 19:23 |
| JordanRinke | hmm give me a sec to look at that too :-D | 19:24 |
| *** dendro-afk is now known as dendrobates | 19:25 | |
| JordanRinke | do a | 19:25 |
| *** hggdh has joined #openstack | 19:25 | |
| JordanRinke | INSTANCES_PATH=/opt/nova/instances | 19:25 |
| JordanRinke | and then try it with just the instance name | 19:26 |
| dudeman | yup, did that and its running | 19:27 |
| JordanRinke | cool now you should be able to get a console on that machine and see if it is running ssh etc | 19:27 |
| *** jfluhmann_ has joined #openstack | 19:27 | |
| JordanRinke | let me know if you need anything else, i will be checking irc every once in a while | 19:28 |
| dudeman | i already knew it was not running ssh, i want to enable it | 19:29 |
| dudeman | euca-authorize does not enable it | 19:29 |
| dudeman | this aint in the docs | 19:29 |
| JordanRinke | well now you have a console on that machine, you can confirm if it is running SSH | 19:29 |
| JordanRinke | and you can start it if it isn't | 19:30 |
| JordanRinke | in theory it should be running SSH but with this you can at least check it and be sure, and or start it if you need to | 19:30 |
| dudeman | there is no ssh and no prompt, just a log of the startup in that window | 19:31 |
| JordanRinke | the nova-debug command should give you an option to set the root password, and give you a console to the virtual machine | 19:31 |
| dudeman | nope | 19:32 |
| JordanRinke | give me a moment to try and find a lab box to jump in to | 19:32 |
| dudeman | root@saturn:/opt# ./nova/tools/nova-debug instance-00000001 error: failed to get domain 'instance-00000001' error: Domain not found: no domain with matching name 'instance-00000001' /dev/loop0 mount: special device /dev/mapper//loop0p1 does not exist ./nova/tools/nova-debug: line 45: t/etc/init/ttyS0.conf: No such file or directory chroot: failed to run command `passwd': No such file or directory chroot: failed to run command ` | 19:32 |
| JordanRinke | hmm | 19:33 |
| dudeman | i watch vish do this on thursday and there was none of this ssh probs with the tty image | 19:33 |
| JordanRinke | yeah that is why I am curious, like I said.. in theory it should be running SSH no problems | 19:34 |
| JordanRinke | but trunk is volatile source so something could be wrong with the iptables rules etc | 19:34 |
| dudeman | its weird, just trying to run nova in virtualbox following the deploy/hacking instructions exactly | 19:34 |
| dudeman | is there a "stable" version? | 19:35 |
| JordanRinke | not really right now, there will be soon but everyone is pushing to get stuff ready for release in a few weeks | 19:35 |
| JordanRinke | once that happens there should be | 19:36 |
| JordanRinke | Anso has some "stable" packages but they are a bit behind current source | 19:36 |
| dudeman | its funny, i thought this would be easier than a cloud on UCS | 19:36 |
| JordanRinke | yeah, it can be, right now it is hectic so the code is a bit tricky | 19:37 |
| JordanRinke | usually with good instructions it is cake | 19:37 |
| dudeman | so youre saying I should not try to run it now as its not stable? i watched vish do this just 2 days ago | 19:41 |
| *** pvo is now known as pvo_away | 19:43 | |
| dudeman | thanks for your help jordan | 19:43 |
| JordanRinke | no, I am just saying it might not be as out of the box functional as expected. little changes here and there throw the docs off | 19:43 |
| dudeman | ok, I killed the VM and I feel better already :) | 19:44 |
| JordanRinke | so, I just tried my lab and I was able to SSH no problem | 19:45 |
| JordanRinke | so somewhere along the way our environments are different, but I am using the latest code just like you | 19:47 |
| dudeman | but with no errors in the log I have nothing to go on | 19:48 |
| JordanRinke | yeah, I am trying to decide what the next logical step is | 19:49 |
| JordanRinke | where did you get the .3 address from? | 19:50 |
| uvirtbot | New bug: #706387 in glance "Missing AUTHORS file" [High,New] https://launchpad.net/bugs/706387 | 19:51 |
| JordanRinke | my euca-describe-images isn't listing the IP address, so I had to look in the DB to get the right IP for my instance | 19:52 |
| JordanRinke | so curious how you get the IP for the instance | 19:52 |
| JordanRinke | got* | 19:53 |
| JordanRinke | my best guess is that it might be the wrong IP at least that is my best guess right now lol | 19:53 |
| dudeman | its assigned automagically | 19:55 |
| dudeman | the network window shows .3 as leased | 19:55 |
| JordanRinke | ah, from the nova-network log, ok | 19:55 |
| JordanRinke | can you start another instance? | 19:56 |
| JordanRinke | see if it leases out .4 and try that one | 19:56 |
| dudeman | no | 20:01 |
| JordanRinke | what does that no apply to? | 20:02 |
| dudeman | its giving python errors now | 20:02 |
| dudeman | root@saturn:/opt# ./nova.sh run /usr/lib/pymodules/python2.6/paste/deploy/loadwsgi.py:8: UserWarning: Module nova was already imported from /opt/nova/nova/__init__.pyc, but /usr/lib/pymodules/python2.6 is being added to sys.path import pkg_resources | 20:02 |
| JordanRinke | ah, i was saying run another instance, something like euca-run-instances ami-tty | 20:03 |
| JordanRinke | not another nova.sh, sorry for not being clear. you should only be running one nova.sh | 20:04 |
| dudeman | it did not work i had to reboot the vm and its still giving these errors | 20:04 |
| dudeman | i am | 20:04 |
| JordanRinke | so, what happens if you run | 20:04 |
| JordanRinke | euca-run-instances ami-tty | 20:05 |
| dudeman | it doesnt | 20:06 |
| dudeman | nova wont start now | 20:06 |
| JordanRinke | it errors? | 20:06 |
| JordanRinke | ah ok | 20:06 |
| JordanRinke | gotcha | 20:06 |
| dudeman | this sw is not stable | 20:06 |
| JordanRinke | it is just picky right now | 20:06 |
| dudeman | thanks for your help but I'm afraid were just wasting time | 20:06 |
| JordanRinke | well if you want dude I can catch you another day and we can go through an install or mess with it | 20:07 |
| vishy | dudeman: pxe rom is not required | 20:07 |
| *** pothos_ has joined #openstack | 20:07 | |
| vishy | nova-debug only works on ubuntu images | 20:08 |
| JordanRinke | also, we are about to post a new install doc for bexar soon which might be useful | 20:08 |
| JordanRinke | lol vishy is here now, he can remedy my stumbling around troubleshooting technique | 20:08 |
| vishy | so you can ping but no ssh? | 20:09 |
| *** pothos has quit IRC | 20:09 | |
| JordanRinke | hey gets connection refused on ssh attempt | 20:09 |
| *** pothos_ is now known as pothos | 20:09 | |
| dudeman | the console log said there was NO sshd | 20:10 |
| vishy | interesting, and do i see somewhere that the console log reported no sshd? that is odd | 20:10 |
| dudeman | euca-authorize did not help | 20:10 |
| dudeman | using 64 bit maverick as you said, inside virtualbox both host and guest are maverick | 20:11 |
| vishy | andd tty starts but shows no ssd in the console log? | 20:11 |
| vishy | * sshd | 20:12 |
| vishy | euca-get-console-output i-1 should look something like this: http://pastie.org/1488023 | 20:13 |
| vishy | no mention of sshd anywhere... | 20:15 |
| dudeman | hmm | 20:17 |
| *** j05h1 has joined #openstack | 20:18 | |
| *** j05h has quit IRC | 20:18 | |
| JordanRinke | vishy: you ever get your windows images up and running on libvirt? | 20:20 |
| vishy | JordanRinke: yes it works, just waiting on a reasonable image. | 20:21 |
| JordanRinke | reasonable image | 20:21 |
| JordanRinke | ? | 20:21 |
| vishy | has virtio drivers | 20:22 |
| vishy | starts a terminal services client | 20:22 |
| JordanRinke | I can put an image together for you, I am a windows eng :-D | 20:22 |
| vishy | has some way of setting the password via userdata | 20:22 |
| JordanRinke | just tell me what all you need | 20:22 |
| vishy | have someone doing it but he's on vaca until next week | 20:22 |
| JordanRinke | hmmm password would be beyond the image, but i believe someone is working on a client for that | 20:23 |
| vishy | not really | 20:24 |
| *** dudeman has quit IRC | 20:24 | |
| JordanRinke | not really? | 20:24 |
| vishy | we're writing a little script to hit metadatasever, grab userdata and set password | 20:24 |
| vishy | going to go into the image and run on boot | 20:24 |
| JordanRinke | ah, i think ed leafe is working on an actual client to do resets etc as a service | 20:25 |
| vishy | yes we want something way simpler than that | 20:26 |
| JordanRinke | yeah that makes sense, are you making an actual sysprep image or just a fully configured image? | 20:26 |
| vishy | I prefer not to put rootkits on users machines | 20:26 |
| JordanRinke | (for my testing on hyper-v right now I am using a fully configured image) | 20:26 |
| vishy | not sure, it is a demo version | 20:26 |
| vishy | byo license | 20:26 |
| JordanRinke | fully configured would be easiest | 20:27 |
| JordanRinke | im guessing that is what you will use | 20:27 |
| *** dudeman has joined #openstack | 20:28 | |
| JordanRinke | well if you need any help with the windows stuff let me know, I spent 5 years building windows os images and doing driver integration etc | 20:28 |
| vishy | JordanRinke: cool | 20:30 |
| vishy | dudeman: I have had it take a while for ssh to show up, but haven't seen pingable + no ssh with the tty image before | 20:32 |
| dudeman | thanks for the help guys, i cant spend any more time on this now | 20:32 |
| dudeman | i have 8g on this system also so its not really slow | 20:33 |
| dudeman | i deleted the vm image and reinstalling maverick | 20:33 |
| vishy | dudeman: no worries | 20:33 |
| vishy | dudeman: let me know if you need any other help | 20:33 |
| JordanRinke | dudeman: if you want to give it another go at some point just let us know | 20:33 |
| dudeman | whats the best source of info? | 20:33 |
| vishy | here... | 20:34 |
| vishy | :) | 20:34 |
| dudeman | haha | 20:34 |
| JordanRinke | eventually it will be the wiki, but like i said.. a lot of flux right now | 20:34 |
| *** kpepple has joined #openstack | 20:34 | |
| dudeman | let me clarify | 20:34 |
| vishy | dudeman: docs and wiki, but they both get out of date pretty quickly. They will be much more stable/helpful after bexar when things are a little more stable | 20:35 |
| *** jfluhmann_ has quit IRC | 20:36 | |
| dudeman | how can I make sure I have all the dependencies installed in the maverick vm before I start, when I tried to add some after running nova.sh it hosed my python install | 20:36 |
| dudeman | other tha making sure I take a snapshot *before* I run nova.sh :) | 20:36 |
| vishy | nova.sh install will install all of the deps | 20:37 |
| vishy | the current version from git will anyway | 20:38 |
| vishy | :) | 20:38 |
| kpepple | can anyone answer a quick question about 'nova-manage db sync' ? having a strange problem with newest ubuntu packages … it's upgrading the wrong db | 20:40 |
| JordanRinke | i don't know much about it, but what is happening? | 20:43 |
| vishy | kpepple: which db is it upgrading? | 20:44 |
| vishy | kpepple: meaning you have your db in mysql? | 20:44 |
| kpepple | upgraded install with "--sql_connection=mysql://root:nova@localhost/nova" set in my /etc/nova/nova-manage.conf. when i run 'nova-manage db sync' as root, it doesn't migrate the mysql db but instead creates a sqlite db in /var/lib/nova | 20:45 |
| kpepple | known bug ? user error ? | 20:45 |
| dudeman | vishy: ok, I'll re read some of the docs and try again later, making to to take a snapshot before I start :) | 20:45 |
| *** dudeman has quit IRC | 20:45 | |
| vishy | kpepple: the current packages use /etc/nova/nova.conf | 20:45 |
| JordanRinke | isnt everything in /etc/nova/nova.conf now? | 20:45 |
| vishy | not nova-manage.conf | 20:45 |
| kpepple | ahhhh … so without the flag, it goes over to sqlite ? | 20:45 |
| kpepple | ok | 20:45 |
| vishy | kpepple: it uses the default which is sqlite | 20:46 |
| kpepple | thanks, i'll move my flags over there and try again | 20:46 |
| kpepple | that did it, thanks | 20:47 |
| vishy | kpepple: cool | 20:47 |
| *** opengeard has joined #openstack | 20:48 | |
| *** jfluhmann_ has joined #openstack | 20:50 | |
| uvirtbot | New bug: #706405 in nova "MySQL Gone Away Generated" [Undecided,New] https://launchpad.net/bugs/706405 | 21:01 |
| *** reldan has joined #openstack | 21:03 | |
| *** jfluhmann_ has quit IRC | 21:03 | |
| *** jfluhmann_ has joined #openstack | 21:18 | |
| *** ctennis has quit IRC | 21:20 | |
| uvirtbot | New bug: #706415 in nova "Use Glance instead of KRM json to Relate Images" [Undecided,In progress] https://launchpad.net/bugs/706415 | 21:37 |
| *** cynb has joined #openstack | 21:45 | |
| *** cynb1 has quit IRC | 21:47 | |
| *** Ryan_Lane_ has joined #openstack | 21:48 | |
| *** laner has joined #openstack | 21:52 | |
| *** ctennis has joined #openstack | 21:52 | |
| *** Ryan_Lane_ has quit IRC | 21:54 | |
| *** laner is now known as Ryan_Lane | 21:54 | |
| openstackhudson | Project nova build #443: SUCCESS in 1 min 32 sec: http://hudson.openstack.org/job/nova/443/ | 22:17 |
| openstackhudson | Tarmac: This patch skips VM shutdown if already in the halted state. | 22:17 |
| *** sandywalsh has quit IRC | 22:21 | |
| *** Ryan_Lane_ has joined #openstack | 22:25 | |
| *** laner has joined #openstack | 22:26 | |
| *** Ryan_Lane has quit IRC | 22:27 | |
| *** Ryan_Lane_ has quit IRC | 22:29 | |
| *** reldan has quit IRC | 22:32 | |
| *** stewart has quit IRC | 22:54 | |
| *** laner has quit IRC | 23:04 | |
| *** Cybodog has joined #openstack | 23:04 | |
| *** dirakx has joined #openstack | 23:09 | |
| *** kpepple has left #openstack | 23:24 | |
| *** arcane has quit IRC | 23:29 | |
| *** arcane has joined #openstack | 23:29 | |
| *** reldan has joined #openstack | 23:57 | |
| *** Cybodog has quit IRC | 23:58 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!