Wednesday, 2011-05-18

*** jeffjapan has joined #openstack00:03
*** zul has joined #openstack00:03
*** mcclurmc_ has quit IRC00:06
*** cascone has joined #openstack00:09
*** kashyap has quit IRC00:15
*** kashyap has joined #openstack00:16
*** salv-orlando has left #openstack00:22
*** rchavik has joined #openstack00:23
*** obino has quit IRC00:25
*** galstrom has joined #openstack00:26
*** j05h has quit IRC00:26
*** kashyap has quit IRC00:27
*** shentonfreude has joined #openstack00:27
*** kashyap has joined #openstack00:27
*** galstrom has quit IRC00:28
*** galstrom has joined #openstack00:29
*** j05h has joined #openstack00:29
*** galstrom has quit IRC00:29
*** Tv has quit IRC00:33
*** kashyap has quit IRC00:34
*** adjohn has joined #openstack00:39
*** j05h has quit IRC00:46
*** adjohn has quit IRC00:47
*** blamar__ has joined #openstack00:49
*** kashyap has joined #openstack00:50
*** maplebed has joined #openstack00:53
*** joearnold has quit IRC00:55
*** dysinger has quit IRC00:58
*** dragondm has quit IRC01:03
*** exlt has quit IRC01:11
*** jdurgin has quit IRC01:12
*** dragondm has joined #openstack01:12
*** Tv has joined #openstack01:13
*** Tv has left #openstack01:13
*** fairchild has joined #openstack01:14
*** dolphm has joined #openstack01:14
*** exlt has joined #openstack01:17
*** littleidea has quit IRC01:17
*** hallyn is now known as hallyn_afk01:19
*** miclorb has quit IRC01:20
*** littleidea has joined #openstack01:22
*** galthaus has joined #openstack01:24
galthausnova networking question - in VLAN DHCP manager, do the nova compute services need public ip addresses?01:25
*** namaqua has joined #openstack01:26
galthausI'm trying to understand how and who talks to what.01:26
*** adjohn has joined #openstack01:27
*** namaqua has quit IRC01:27
kpepplegalthaus: if i understand the question, it's not nova-compute that needs the address, it's your nova-network host01:29
*** dysinger has joined #openstack01:31
*** galthaus has quit IRC01:31
*** galthaus has joined #openstack01:33
galthauskpepple: Okay, I think I knew that.01:34
*** freeflying has quit IRC01:35
galthauskpepple: I guess I was more wondering on a node that is only running nova-compute.  Does it need a public IP to access the rabbit server or can it use an admin network?01:35
*** freeflying has joined #openstack01:35
*** maplebed has quit IRC01:35
galthausAssuming the rabbit server or database server is on an admin network.01:36
kpepplegalthaus: i would assume that the rabbit queue server and nova-compute would communicate over a private mgmt ip network01:36
galthausI think what is muddying my view is that nova.conf is used for everything.01:36
galthausIt is unclear what subcomponents rely on what parts.01:37
kpepplegalthaus: logical arch picture on my blog -- http://ken.pepple.info/openstack/2011/04/22/openstack-nova-architecture/01:37
galthausSo, S3_HOST and CC_HOST in the nova.conf file are public ips for this services.01:37
galthausnice!  The hand-drawn style is really useful.01:38
kpepplegalthaus: i wish my hand drawing was that good ... :)01:39
galthauskpepple: So, it looks like the rabbit and mysql (and I presume ldap/auth) can be admin-based IP addresses.01:42
galthausThe s3_host, cc_host, ec2_url are the public interfaces for this services.01:42
kpepplegalthaus: yes ... not sure about the s3_host parameter tho01:44
kpepplegalthaus: ahh ... the s3_host is when you are using the s3 image manager01:45
galthauskpepple: I guess the next question that follows for me: What do the VMs have to be able to talk to?  Any of the public services?01:46
kpepplegalthaus: depends on the network_manager ... usually a bridge or VPN tunnel but not any of the actual nova services01:48
galthauskpepple: Thanks for the answers and the time.  I have some stuff to play with now.01:49
kpepplegalthaus: np01:49
*** dragondm has quit IRC01:58
*** jkoelker has quit IRC01:58
*** sebastianstadil has quit IRC02:00
*** blamar__ has quit IRC02:02
*** primeministerp1 has joined #openstack02:07
primeministerp1hey now, anyone have any idea why I would be seeing this when starting nova-network02:07
primeministerp1CRITICAL nova [-] unsupported operand type(s) for &: 'NoneType' and 'int'02:07
primeministerp1if I had to guess i'm missing some table data02:07
*** ovidwu_ has joined #openstack02:07
primeministerp1maybe zone data?02:08
*** ovidwu_ has quit IRC02:08
*** irclog_ has joined #openstack02:09
kpeppleprimeministerp1: anything around that error message like a stack trace ?02:09
primeministerp1hmm02:10
primeministerp1i can prob generate one02:10
primeministerp1let me see02:11
kpeppleprimeministerp: no, i meant in the logs02:11
primeministerp1May 17 22:06:18 jil-h-i-08-a 2011-05-17 22:06:18,498 AUDIT nova [-] Starting network node (version 2011.3-workspace:tarmac-20110430024629-rc93dzxqvwptexqs)02:11
primeministerp1May 17 22:06:18 jil-h-i-08-a 2011-05-17 22:06:18,498 AUDIT nova [-] Starting network node (version 2011.3-workspace:tarmac-20110430024629-rc93dzxqvwptexqs)02:11
primeministerp1May 17 22:06:18 jil-h-i-08-a 2011-05-17 22:06:18,513 CRITICAL nova [-] unsupported operand type(s) for &: 'NoneType' and 'int'02:11
primeministerp1May 17 22:06:18 jil-h-i-08-a 2011-05-17 22:06:18,513 CRITICAL nova [-] unsupported operand type(s) for &: 'NoneType' and 'int'02:11
primeministerp1that's what i see when i start the nova-network service02:11
* kpepple looks through nova-networking code02:12
primeministerp1woot02:12
primeministerp1if i had to guess02:12
primeministerp1it's a zone problem02:12
primeministerp1there's nothing in the zone table02:12
primeministerp1yet  there's a default zone of nova02:12
kpeppleprimeministerp: hard to say ... but it sounds like something in sql-alchemy (our db access library) is complaining ... you might want to turn on debug mode in your nova.conf file to see where we are hitting it02:15
primeministerp1sure02:15
primeministerp1verbose  in my nova.conf right?02:16
*** Jaike has joined #openstack02:16
kpeppleyes02:16
primeministerp1lots of junk02:17
kpeppleyes02:17
primeministerp1can I paste it here or will it bump me02:18
kpepplepaste it at our pastie -- http://paste.openstack.org/02:18
*** sebastianstadil has joined #openstack02:18
*** galthaus has quit IRC02:18
primeministerp1http://paste.openstack.org/show/1364/02:19
primeministerp1kpepple:  ^^02:19
primeministerp1service.py:280 seems to be a big taker02:19
*** dolphm has quit IRC02:20
* kpepple examines the output02:20
* kpepple thinks he has the answer02:20
*** dolphm has joined #openstack02:20
kpeppleprimeministerp1: in your nova.conf file do you have your lockfile directory set ?02:21
*** enigma1 has joined #openstack02:21
primeministerp1hmm02:21
primeministerp1not sure02:21
primeministerp1let me see02:21
primeministerp1hehe02:21
primeministerp1nope02:21
primeministerp1—lockfile=/somepath02:22
primeministerp1i'm assuming?02:22
kpeppleprimeministerp1: i think it's actually 'lock_path' instead of lockfile02:22
kpeppleprimeministerp1: and it should be a directory02:22
primeministerp1so —lock_path=/path/to/lockfile_dir02:22
primeministerp1is there a default location?02:23
primeministerp1which people use?02:23
kpeppleprimeministerp1: the code defaults to '../' but it seems like /var/something would be a better place02:23
primeministerp1does the dir need specific perms?02:24
primeministerp1or ownership?02:24
primeministerp1that still tanked the service02:24
kpeppleprimeministerp1: nothing special, just make user nova can write/read to it02:24
*** enigma1 has quit IRC02:26
kpeppleprimeministerp1: what version of nova are you running ?02:26
primeministerp1openstack-nova-2011.2.1039-77.402:26
primeministerp1openstack-nova-api-2011.2.1039-77.402:26
primeministerp1openstack-nova-doc-2011.2.1039-77.402:26
primeministerp1python-nova-2011.2.1039-77.402:26
primeministerp1openstack-nova-network-2011.2.1039-77.402:26
primeministerp1openstack-nova-scheduler-2011.2.1039-77.402:26
primeministerp1we're running on sles 1102:27
primeministerp1sp102:27
primeministerp1so the packages could be old02:27
primeministerp1built out of our build system by a partner02:27
*** markvoelker has joined #openstack02:27
kpeppleprimeministerp1: ok, i am on trunk which is 107702:27
primeministerp1could see if they have newer code02:27
primeministerp1i'm assuming that means I'm on trunk 103902:27
primeministerp1let me see if i can find something newer02:28
kpeppleprimeministerp1: i am wondering if we are seeing some SLES specific issue. The exact error that you are seeing (according to log) is in File "/usr/lib64/python2.6/site-packages/nova/utils.py", line 599, in inner (nova): TRACE:     lock = lockfile.FileLock(lock_file_path), which is just creating the lockfile ...02:29
kpeppleyes, you are on trunk 103902:29
primeministerp1so that's a big problem02:29
primeministerp1looks like i'll have to comple myself or rebuild the packages02:30
kpepplehmmm ... this is strange .. in the lockfile package, the "&: 'NoneType' and 'int'" is actually referring to the ident command coming back with no output02:30
primeministerp1so i'm seeing packages that are 2011.2-6.102:33
primeministerp1maybe trunk 1061?02:33
kpeppleprimeministerp1: the 1039 version was the 'cactus' release, which may have been the latest packaged version for SLES02:33
primeministerp1could be02:33
primeministerp1i was rummaging through our build repos02:34
primeministerp1that 's what i came up w/02:34
primeministerp1so basically we need newer code02:34
primeministerp1at a minimum02:34
*** enigma1 has joined #openstack02:35
kpeppleprimeministerp1: not necessarily ... anything past 1039 is unreleased and beta ... which may or may not fix the problem. or introduce new problems :)02:36
kpeppleprimeministerp1: do you see this error in any of the other daemons ... like nova-compute or nova-api ?02:36
primeministerp1no just nova-networks02:37
kpeppleprimeministerp1: hold on. are you starting two copies of nova-network at once ? everything is repeated in your paste file02:37
primeministerp1and it happens when I start the deamon02:37
primeministerp1no02:37
primeministerp1just one02:37
primeministerp1that i know of02:37
kpeppleprimeministerp1: how are you starting nova-network ?02:38
primeministerp1sysv02:38
primeministerp1"/etc/init.d/nova-network start?02:38
primeministerp1er "02:38
kpepplehmmm ... so it's not normal that you are seeing every line repeated in the log file02:40
primeministerp1i wouldn't think so02:40
primeministerp1looking at the init script now02:40
primeministerp1wonder if it's running already02:40
primeministerp1should i have a single nova.conf, or ones for each svs?02:41
kpepplesingle nova.conf02:41
*** dolphm has quit IRC02:41
primeministerp1could it be bc i have 2 nics?02:42
primeministerp1and nothing defined for that in my nova.conf02:42
primeministerp1like the options from nova.network.manager?02:43
primeministerp1i have some of those options02:43
primeministerp1but no —flat-network-bridge02:43
primeministerp1or —flat_interface02:43
primeministerp1i do have a br10002:43
kpepplecould be ... but haven't seen this before02:43
primeministerp1running on my eth102:43
kpepplecan you do this ? run just 'man ident' ...02:44
primeministerp1looking for what02:44
primeministerp1IDENT(1)02:44
primeministerp1ident is there02:44
primeministerp1and installed02:44
kpepplecrap, it looks like you are hitting an outstanding bug ... see https://bugs.launchpad.net/nova/+bug/76471802:45
uvirtbotLaunchpad bug 764718 in nova "nova-network not working with python-lockfile version 0.9.1" [Undecided,New]02:45
primeministerp1kpepple: also could it be because of missing db that isn't being returned when the ident is run02:45
primeministerp1kpepple: so any ideas?02:47
kpeppleprimeministerp1: it's a bug in lockfile, see http://code.google.com/p/pylockfile/issues/detail?id=8#c602:48
primeministerp1so downgrade lockfile?02:49
kpepplei think so ... we are using version 0.8 (from the tools/pip-requires file in nova)02:50
primeministerp1ok02:52
primeministerp1downgraded02:52
primeministerp1that started it02:53
primeministerp1sweet02:53
primeministerp1so i'm assuming that anything I had previous scheduled will now start02:53
kpepplecool ... and i hope so ...02:54
primeministerp1we'll see02:54
primeministerp1already looks better02:54
*** sebastianstadil has quit IRC03:00
*** osier has joined #openstack03:03
*** enigma1 has quit IRC03:03
*** joearnold has joined #openstack03:05
primeministerp1kpepple:  something's definately happening now03:05
kpeppleif that a good thing ?03:05
primeministerp1kpepple:  well this is what i see now03:06
primeministerp1jil-h-i-08-a:/var/log/nova # euca-describe-instances03:06
primeministerp1RESERVATIONr-0gt09j00HyperVdefault03:06
primeministerp1INSTANCEi-00000002ami-00000003shutdown test (HyperV, JIL-H-I-C2-02) 0 m1.tiny 2011-05-17T22:57:48Z nova03:06
primeministerp1why would it be in a state of shutdown03:07
kpeppleif you look in your nova-compute log, you'll probably see some errors about what happened ... you could be a lot of things but not having VT-x enabled in BIOS is a possible culprit03:07
kpepples/you/it/03:08
HugoKuomorning03:10
*** enigma1 has joined #openstack03:12
*** santhosh has joined #openstack03:12
*** pcrews has quit IRC03:13
primeministerp1kpepple:  now seems something is hung in scheduling03:15
kpeppleprimeministerp1: if the instance doesn't spawn, you'll probably see scheduling errors03:15
kpeppleprimeministerp1: or your services are offline. you can check this with `nova-manage services list`03:16
*** littleidea has quit IRC03:16
primeministerp1ahh03:16
primeministerp1jil-h-i-08-a nova-network enabled  :-) 2011-05-18 03:16:3703:17
primeministerp1jil-h-i-08-a nova-scheduler enabled  :-) 2011-05-18 03:16:3403:17
primeministerp1jil-h-i-08-a nova-console enabled  XXX None03:17
primeministerp1jil-h-i-10-a nova-network enabled  XXX None03:17
primeministerp1jil-h-i-10-a nova-scheduler enabled  XXX None03:17
primeministerp1jil-h-i-10-a nova-volume enabled  XXX None03:17
primeministerp1JIL-H-I-C2-02 nova-compute enabled  XXX 2011-05-18 03:16:4303:17
primeministerp1JIL-H-I-C2-03 nova-compute enabled  XXX 2011-05-18 03:16:5003:17
primeministerp1so that's why we were seeing 2 nova-networks03:17
kpeppleahhh03:17
primeministerp1and another scheduler on 1003:18
primeministerp1ahh03:18
primeministerp1going to remove those from the db03:18
primeministerp1and see if it makes a difference03:18
primeministerp1kpepple: does that make sense?03:18
kpepplemultiple nova-schedulers aren't a problem (they just take tasks and determine which compute node to run them on).03:19
kpepplemultiple nova-networks can be an issue, depending on configuration03:19
primeministerp1ok03:19
kpeppleit looks like some of your nodes are offline though ... the XXX means they are configured but not alive03:20
primeministerp1how do i make them alive?03:20
primeministerp1the boxes are up03:20
primeministerp1could be other bugs on the compute nodes03:20
kpepplethey need to update the last_modified column in the services table on the db every 15 seconds to be considered alive ...03:21
*** enigma1 has quit IRC03:21
kpepplethey may not be configured for the correct db (or db settings), they might have clock scew (should use ntp to sync all clocks) or the services might have crashed03:22
primeministerp1gotcha03:23
primeministerp1kpepple:  is there an easy way to delete the bunk services?03:27
primeministerp1using nova-manage?03:27
primeministerp1or do i have to just delete the db records03:27
primeministerp1also i think i figured out the problem03:27
kpeppleyou can disable them with nova-manage service disable03:28
*** koolhead17 has quit IRC03:29
primeministerp1but i need to remove them03:29
primeministerp1completely03:29
*** littleidea has joined #openstack03:30
*** enigma1 has joined #openstack03:31
kpepplethere isn't a nova-manage command for that ... you'll probably have to modify the DB directly ... unless anyone else knows of a better way03:31
primeministerp1gotcha03:31
*** joearnold has quit IRC03:35
*** enigma1 has quit IRC03:37
*** hadrian has quit IRC03:40
primeministerp1kpepple: so nova networks randomly created a bridge interface03:46
primeministerp1w/ an ip that exists03:46
primeministerp1kpepple:  is that normal?03:46
kpeppledepends on the network manager that you are using ... FLATDHCP and VLAN do, FLAT doesn't (if i remember correctly)03:48
kpeppleit's configurable in nova.conf03:48
primeministerp1ahh03:48
primeministerp1i see03:48
primeministerp1my dhcp_strart is wrong03:48
primeministerp1in my nova networks03:48
primeministerp1table03:48
kpeppleyeah networking is hard :)03:50
kpepplelet me see here ... there are a bunch of flags that you need and some nova-manage-fu03:50
kpeppleprimeministerp1: i'm being called into a meeting for 2 hours ...03:52
primeministerp1kpepple: thx for the help03:52
primeministerp1kpepple: i owe you a beer03:53
primeministerp1;)03:53
kpeppletake a look at this page (http://wiki.openstack.org/FlagsGrouping), it lists all the flags grouped by area ... scroll down to your network manager and it should provide some help03:53
kpepplegood luck03:53
*** Zangetsue has joined #openstack03:55
*** blamar__ has joined #openstack03:55
*** blamar has quit IRC04:09
*** lvaughn_ has quit IRC04:09
*** jaypipes has quit IRC04:09
*** hggdh has quit IRC04:09
*** crescendo has quit IRC04:09
*** fabiokung_ has quit IRC04:09
*** laurensell has quit IRC04:09
*** med_out has quit IRC04:09
*** ovidwu has quit IRC04:09
*** h1nch has quit IRC04:09
*** jaypipes has joined #openstack04:11
*** crescendo has joined #openstack04:11
*** blamar has joined #openstack04:12
*** lvaughn_ has joined #openstack04:12
*** hggdh has joined #openstack04:12
*** fabiokung_ has joined #openstack04:12
*** laurensell has joined #openstack04:12
*** med_out has joined #openstack04:12
*** ovidwu has joined #openstack04:12
*** h1nch has joined #openstack04:12
*** santhosh has quit IRC04:14
*** andy-hk has quit IRC04:23
*** shentonfreude has quit IRC04:24
*** andy-hk has joined #openstack04:25
*** cascone has quit IRC04:33
*** koolhead17 has joined #openstack04:36
*** santhosh has joined #openstack04:38
*** cascone has joined #openstack04:38
*** f4m8_ is now known as f4m804:45
*** kashyap has quit IRC04:48
*** ccustine has quit IRC04:49
*** adjohn has quit IRC05:05
*** kashyap has joined #openstack05:08
*** koolhead17 has quit IRC05:17
*** irclog_ has quit IRC05:19
*** mahadev has joined #openstack05:19
*** irclog_ has joined #openstack05:19
*** irclog_ has quit IRC05:21
*** mahadev has quit IRC05:21
*** blamar__ has quit IRC05:21
*** irclog_ has joined #openstack05:21
*** mahadev has joined #openstack05:21
*** cascone has quit IRC05:22
*** mahadev has quit IRC05:22
*** med_out has quit IRC05:27
*** mahadev has joined #openstack05:27
*** medberry has joined #openstack05:30
*** medberry has quit IRC05:30
*** medberry has joined #openstack05:30
*** photron has joined #openstack05:38
*** adjohn has joined #openstack05:45
*** Jaike has quit IRC05:47
*** Jaike has joined #openstack05:51
*** kazuhiko has joined #openstack05:55
*** guigui has joined #openstack05:56
*** cascone has joined #openstack05:57
*** Zangetsue has quit IRC05:57
*** littleidea has quit IRC06:07
*** Zangetsue has joined #openstack06:08
*** MarkAtwood has joined #openstack06:12
*** MarkAtwood has quit IRC06:16
*** matiu has quit IRC06:24
*** lionel has quit IRC06:26
*** lionel has joined #openstack06:26
*** mcclurmc_ has joined #openstack06:36
*** katkee has joined #openstack06:42
*** sebastianstadil has joined #openstack06:44
*** mahadev_ has joined #openstack06:47
*** mahadev has quit IRC06:48
*** mahadev_ is now known as mahadev06:48
*** stewart has quit IRC06:52
*** rcc has joined #openstack06:56
*** obino has joined #openstack07:01
*** dobber has joined #openstack07:03
*** kazuhiko has quit IRC07:04
*** jedi4ever has joined #openstack07:06
*** stewart has joined #openstack07:09
*** mahadev has quit IRC07:12
*** daveiw has joined #openstack07:25
*** nacx has joined #openstack07:30
*** stewart has quit IRC07:36
*** sebastianstadil has quit IRC07:38
*** Jaike is now known as fayce07:41
*** allsystemsarego has joined #openstack07:46
*** guigui has quit IRC07:50
*** guigui has joined #openstack07:53
*** krish|wired-in has joined #openstack07:54
*** mgoldmann has joined #openstack07:56
*** mRy has joined #openstack08:01
mRyany OpenStack developers available for contract work?08:03
*** bkkrw has joined #openstack08:07
*** sebastianstadil has joined #openstack08:08
doudeHi, I've got a problem with nova-network. It cannot register to service list of nova08:20
*** bkkrw has quit IRC08:20
doudeand it does,n't receive any call from other services08:21
doudehere the log of service list: http://pastebin.com/LLtAyj7V08:22
*** katkee has quit IRC08:22
doudethe nova-networtk works on the same host than a nova-compute service and use the same config file08:23
*** katkee has joined #openstack08:23
doudeDo you know what the matter ? Perhaps a problem with rabbitmq server ? How I can purge it ?08:24
doudeI use the trunk code bzr 108408:26
*** bkkrw has joined #openstack08:28
sorendoude: How big is your nova-network.log?08:29
sorendoude: Can you pastebin the whole thing?08:29
doudesoren: not so big, a logrotate clean it few hours ago : http://pastebin.com/t2MTXHzn08:34
*** jeffjapan has quit IRC08:34
doudesoren: i didn't find anything in the log file. Perhaps a config error. It worked befor, I didn't change the config. I just needed to reboot the host08:35
sorenIt might be stuck waiting for a lock that is held by a process that has died (and thus will never relinquish the lock).08:36
sorenpastebin "ls -l /var/lock/nova"08:37
*** Eyk has joined #openstack08:38
*** fayce has quit IRC08:40
*** fabiand__ has joined #openstack08:46
doudesoren: ha yes. I found the stale lock file08:48
doudesoren: thanks for your help and sorry for the noise08:48
sorendoude: Excellent. I knew adding the "attempting to grab lock" thing to the log would pay off :)08:48
sorendoude: I spent a good few hours staring at nova-compute at some point wondering why it just sat there. :)08:49
doudesoren: yes. Thanks again08:50
doudesoren: I loose an hour for that :(08:50
sorendoude: Sure thing.08:50
doudesoren: Just another question. Is it possible to mix hypervisor types (libvirt/KVM and vmware for example) in the same region with nova ?08:52
sorenNot yet.08:53
sorenWell... yes, sort of.08:53
sorenThe problem is that the images aren't marked as being made for this or the other hypervisor.08:54
soren...so you'd have to rely on luck to get images to run in the right places :)08:54
uvirtbotNew bug: #784472 in nova "Images added through objectstore and EC2 RegisterImage are never made available to the OpenStack API" [Undecided,Triaged] https://launchpad.net/bugs/78447208:56
doudesoren: ok. Is it plan in the roadmap or is it a desire feature ?08:57
sorendoude: It's on the roadmap.08:57
doudesoren: ok, I missed it. And if I define a region for each type of hypervisor, it will work ? I will have the same problem for image ? Can I set objectstore for each region ?09:00
sorendoude: I'm not sure about the implementation details, to be honest.09:01
doudesoren: Ok. Thanks you again for your help09:03
*** dh has quit IRC09:03
*** dh has joined #openstack09:04
*** ChameleonSys has quit IRC09:06
sorendoude: Certainly.09:06
*** fayce has joined #openstack09:07
*** ChameleonSys has joined #openstack09:07
*** guigui has quit IRC09:07
*** cascone has quit IRC09:10
*** cascone has joined #openstack09:13
*** irclog_ has quit IRC09:13
*** irclog_ has joined #openstack09:14
*** Eyk has quit IRC09:16
*** irclog_ has quit IRC09:16
*** irclog_ has joined #openstack09:16
*** Eyk has joined #openstack09:19
*** irclog_ has quit IRC09:20
*** irclog_ has joined #openstack09:20
*** irclog_ has quit IRC09:21
*** irclog_ has joined #openstack09:21
*** dysinger has quit IRC09:25
*** irclog_ has quit IRC09:25
*** Eyk has quit IRC09:26
*** Eyk has joined #openstack09:26
*** irclog_ has joined #openstack09:27
*** irclog_ has quit IRC09:28
*** irclog_ has joined #openstack09:28
*** irclog_ has quit IRC09:29
*** irclog_ has joined #openstack09:30
*** irclog_ has quit IRC09:31
*** irclog_ has joined #openstack09:31
katkeehello openstackers, in nova, create_networks uses the first IP address as a gateway, what about HSRP/VRRP network where the first IP should be the 3 one? can we add a specific flag to specify the IP to be used a a gateway?09:35
*** andy-hk has left #openstack09:35
*** andy-hk has joined #openstack09:35
*** rchavik has quit IRC09:37
*** rchavik has joined #openstack09:39
*** fayce has quit IRC09:40
*** manelmed has joined #openstack09:48
manelmedhi09:48
manelmedi would know the mean of 0.0.0.0/0 in the description of default group09:49
manelmedi configure valn with my br0 but vnet0 still ping vnet1!!09:52
manelmedwho know about vlans please?09:54
*** robix has joined #openstack10:03
*** obino has quit IRC10:03
*** masudo has joined #openstack10:05
*** guigui has joined #openstack10:06
ttxmanelmed: 0.0.0.0/0 means anywhere in the IPv4 space10:09
ttxmanelmed: I don't know the answer to your other question.10:09
ttxkatkee: you can probably work around that with direct DB calls... but it sounds like we could benefit from you filing a bug about that.10:11
*** fayce has joined #openstack10:11
*** masudo has quit IRC10:12
* ttx lunches.10:12
*** irclog_ has quit IRC10:12
*** sebastianstadil has quit IRC10:13
*** sebastianstadil has joined #openstack10:14
katkeettx: i would like to create a bug but i don't know how to use launchpad to create one...10:14
*** irclog_ has joined #openstack10:18
*** irclog_ has quit IRC10:19
*** irclog_ has joined #openstack10:20
*** NDCGarrett has quit IRC10:21
manelmedttx: how can i change it10:23
*** katkee has quit IRC10:24
kpepplekatkee: creating a bug is easy. sign up for a launchpad account, navigate to https://bugs.launchpad.net/nova, click "report a bug" (right side of page), enter the summary, then describe your issue. add as much detail as possible. if you can't do this, ping me offline (see https://launchpad.net/~ken-pepple) and I will file it for you ... i imagine that some of my customers will want what you are asking for also ...10:26
manelmedi have 2 VMs attached to br0 , i want to configure vlan to isolate them10:31
*** adjohn has quit IRC10:32
*** krish|wired-in has quit IRC10:37
*** krish|wired-in has joined #openstack10:37
*** katkee has joined #openstack10:41
*** NDCGarrett has joined #openstack10:56
*** NDCGarrett has quit IRC10:56
*** NDCGarrett has joined #openstack10:56
*** markvoelker has quit IRC10:56
*** markvoelker has joined #openstack10:57
*** rchavik has quit IRC11:01
*** katkee has quit IRC11:18
*** markvoelker has quit IRC11:26
*** markvoelker has joined #openstack11:26
*** littleidea has joined #openstack11:38
*** msivanes has joined #openstack11:38
*** msivanes has left #openstack11:38
*** msivanes has joined #openstack11:39
*** dysinger has joined #openstack11:43
*** ctennis has quit IRC11:49
*** s1cz has quit IRC11:50
*** ChameleonSys has quit IRC11:56
*** s1cz has joined #openstack11:58
*** stewart has joined #openstack12:01
*** ctennis has joined #openstack12:06
*** ctennis has joined #openstack12:06
*** ChameleonSys has joined #openstack12:08
*** katkee has joined #openstack12:09
*** zul has quit IRC12:10
*** zul has joined #openstack12:10
*** aliguori has joined #openstack12:11
*** fayce has quit IRC12:16
*** Shentonfreude has joined #openstack12:21
*** stewart has quit IRC12:24
*** daveiw has quit IRC12:25
*** hadrian has joined #openstack12:25
*** krish|wired-in has quit IRC12:28
*** Eyk has quit IRC12:31
*** katkee has quit IRC12:36
*** stewart has joined #openstack12:43
*** dprince has joined #openstack12:44
*** daveiw has joined #openstack12:45
*** cascone has quit IRC12:47
*** h0cin has joined #openstack12:48
*** dendrobates is now known as dendro-afk12:51
*** Eyk has joined #openstack12:58
*** cascone has joined #openstack12:59
*** fayce has joined #openstack13:00
*** osier has quit IRC13:03
*** krish|wired-in has joined #openstack13:05
*** Eyk has quit IRC13:06
*** mdomsch has joined #openstack13:15
*** lborda has joined #openstack13:15
*** guigui has quit IRC13:15
*** mattray has joined #openstack13:23
*** santhosh has quit IRC13:29
*** santhosh has joined #openstack13:30
*** Zangetsue_ has joined #openstack13:30
*** Zangetsue has quit IRC13:32
*** Zangetsue_ is now known as Zangetsue13:32
*** cascone has quit IRC13:33
*** manelmed has quit IRC13:35
*** lorin1 has joined #openstack13:36
*** mattray has quit IRC13:39
*** f4m8 is now known as f4m8_13:47
*** amccabe has joined #openstack13:48
*** joshfng has joined #openstack13:49
*** adjohn has joined #openstack13:52
*** rnirmal has joined #openstack13:54
*** littleidea has quit IRC14:00
primeministerpwoot14:01
primeministerpgreetings programs!!!!14:01
*** patcoll has joined #openstack14:02
*** robbiew has joined #openstack14:02
*** fed007 has joined #openstack14:03
fed007Hello Openstack!14:03
*** tblamer has joined #openstack14:05
fed007Quick question for someone:   My nova-api service is running (I have a PID) but netstat is not showing a listening port of 8773 as is configured in nova.conf   ??  what gives?14:06
kpepplefed007: are you sure it is running (not started and quit) ? can you telnet to 8773 ?14:08
kpepplefed007: the /var/log/nova/nova-api.log should be a place to start14:09
fed007well that could be - I was not able to telent to the port....14:09
fed007the log file is empty14:09
*** obino has joined #openstack14:10
*** jmeredit has joined #openstack14:10
fed007I used the automated shell script to installl/14:10
kpepplefed007: hmmm ... do a quick `ps -ef | grep nova-api` and see if it's running14:11
*** mahadev has joined #openstack14:11
fed007nova     26400 26393  0 08:11 ?        00:00:00 /usr/bin/python /usr/bin/nova-api --flagfile=/etc/nova/nova.conf14:11
*** rcc has quit IRC14:12
fed007That tells me it is running14:12
kpepplefed007: more curious ... maybe stop that, add verbose to the nova.conf file and then restart it. your novaa-api.log file should be full of stuff ...14:12
*** Eyk has joined #openstack14:12
fed007roger that!14:13
*** Zangetsue has quit IRC14:14
fed007hmmm verbose what on14:14
fed007was on14:14
*** littleidea has joined #openstack14:14
fed007I had removed the EC2_url14:15
fed007and went with all sub parameters14:15
*** adjohn has quit IRC14:15
fed007like ec2_host ,ec2_pport14:15
fed007etc...14:15
fed007the parameter list had mentioined EC2_url was deprecated14:15
kpepplefed007: strange. and nothing in the nova-api.log file ? you're not using syslog (nova.conf) are you ?14:16
*** dubsquared has joined #openstack14:18
fed007kepple:  Not sure what you mean by "you're not using syslog (nova.conf) are you ?"    I am editing /etc/nova/nova.conf   logging is set to  --logdir=/var/log/nova  and the logs I am looking at are /var/log/nova14:18
kpepplefed007: ok, there is a use_syslog flag that pushes everything to syslog instead of individual log files14:19
fed007I followed this install     http://docs.openstack.org/bexar/openstack-compute/admin/content/ch03s02.html14:19
fed007but I had an old openstack attempt on the system....   but all the appropriate files should be overwritten with my new install14:20
*** daveiw has quit IRC14:20
kpepplefed007: hold on, those are instructions for Bexar (B), we are now on Cactus (C)14:21
annegentlekpepple: yah I was just going to say the same thing14:21
*** littleidea has quit IRC14:21
fed007OK I am looking for the new install reference14:22
kpepplefed007: you should probably be using the instructions at http://wiki.openstack.org/InstallFromSource if you are looking for single machine, development trunk install.14:22
*** daveiw has joined #openstack14:22
annegentlethis page gives you plenty to choose from http://wiki.openstack.org/InstallInstructions based on what your end goal is14:23
fed007Well we are about to drop $50K on a my first private cloud (my business) so single machine to get me familiar then multinode....14:23
kpepplefed007: ok, i'd suggest using one of the package installs ... it cuts out a lot of the dependency issues and such14:24
*** youngproguru has quit IRC14:25
fed007cool - thx,  do you guys suggest anything other than the apt-get remove /uninstall to clean the existing install?14:25
kpepplefed007: if you are using MySQL, you should probably drop the nova database ... there are a LOT of DB changes between Bexar and Cactus14:26
fed007Also this test system does not have VT on the CPU14:26
annegentlehow was it installed in the first place? that might change your approach14:26
fed007I have played with most of the installs it seems - the last automated script was really nice14:27
fed007Do I need to have VT support on the CPU to test openstack with Hybridfox /KVM?14:28
*** Eyk has quit IRC14:30
*** jkoelker has joined #openstack14:31
annegentlefed007: you might like the StackOps distro, http://sourceforge.net/projects/stackops/files/14:31
kpepplefed007: without VT-x support in the CPU, i think you need to use UML for virtualization (i don't believe KVM works without it). it will be slower but should still work.14:31
fed007OK - I'll run my tests in Virtualbox on a system I know has VT support14:32
fed007anngentle :  Thank -you for that link14:33
*** santhosh has quit IRC14:35
fed007Thanks everyone - I have one last question.   I will have several production database servers I am converting to be VM in this new cloud.   I thought I would use swift but this is not the usecasse for swift....   so should I put my Databases in compute VM instance storage?14:35
fed007I run MySQL servers14:35
kpepplefed007: most people would put their mysql dbs on nova-volume storage (which is similar to Amazon's EBS). if you put it on the root filesystem of your VM image, it will be gone when you start a new server.14:37
*** guigui has joined #openstack14:40
*** dijenerate has quit IRC14:41
fed007certainly it would not be on the root VM  - the hardware server is still a compute server though correct?  or is nova-volume another NFS type reference   (I haven't got this far in openstack yet so my terms may be off)14:41
kpepplefed007: it would usually be another iSCSI / AoE / Sheepdog server ... but you could probably do it on the same server (assuming you have the storage space)14:44
fed007thanks kepple14:44
kpepplefed007: np14:44
*** gaveen has joined #openstack14:45
fed007I need to get to work!14:45
fed007bye14:45
*** fed007 has quit IRC14:46
*** krish|wired-in has left #openstack14:47
*** robix has quit IRC14:48
*** robix has joined #openstack14:52
*** mahadev has quit IRC14:55
*** dragondm has joined #openstack14:56
*** MarkAtwood has joined #openstack14:56
*** adjohn has joined #openstack14:59
*** littleidea has joined #openstack15:01
*** guigui has quit IRC15:02
*** fabiand__ has left #openstack15:03
*** daveiw has quit IRC15:04
*** ctennis has quit IRC15:10
*** cp16net has joined #openstack15:10
*** adjohn has quit IRC15:19
*** alex-meade has joined #openstack15:21
*** enigma1 has joined #openstack15:24
*** mahadev has joined #openstack15:26
*** jedi4ever has quit IRC15:27
*** hallyn_afk is now known as hallyn15:27
radekhi did anyone had any luck connecting RS Iphone app to openstack ? it seems to auth and gets list of servers but crashes when trying to get details of the instance ?15:29
radek:/15:29
*** nphase has joined #openstack15:31
*** robix has quit IRC15:34
*** joearnold has joined #openstack15:37
glencradek - I've heard that some of the guys here at Rackspace have done that; I'll see if I can get them to respond to you15:38
*** jonkelly has joined #openstack15:38
*** littleidea has quit IRC15:39
*** littleidea has joined #openstack15:40
*** dobber has quit IRC15:41
*** joearnold has quit IRC15:44
*** fayce has quit IRC15:45
*** romey has joined #openstack15:45
*** mRy_ has joined #openstack15:46
romeyI was curious as to how to setup the 5 servers I have tabbed for an openstack instance.  should all 5 run nova, swift and glance, or all swift, nova and one or two with glance...15:50
*** mRy has quit IRC15:50
radekthanks glenc15:50
*** ctennis has joined #openstack15:51
*** alex-meade has quit IRC15:53
*** ameade has joined #openstack15:54
notmynameromey: the services are very independent now. that is, you can't synchronize nova instances to where the data is stored in swift.15:56
notmynameromey: I'd recommend that, unless you are simply doing examples or proof of concept and need 5 servers for each, you should probably keep them separate15:57
*** jonkelly has quit IRC15:58
*** bkkrw has quit IRC15:59
*** lvaughn_ has quit IRC16:00
antonymradek: yeah, i got it working, but I did experience a few crashes here and there16:01
uvirtbotNew bug: #784693 in nova "Error during report_driver_status(): 'XenAPIConnection' object has no attribute 'session'" [Undecided,In progress] https://launchpad.net/bugs/78469316:02
romeyokay, so you'd suggest 3 servers each with nova, swift and glance respectively?  then maybe add the other servers as swift only?16:02
mRy_If we have servers running in one datacenter, can use SWIFT to backup the VM's using snapshots to another location? If so then would it be practicle if the VM's are 100GB+ in size?16:02
antonymradek: i was using an ipad with it, there was a bug where it periodically wouldn't list things correctly and you'd get it complaining about metadata, there was a fix put in for that issue and i suspect that may be why the ipad app occasionally was crashing16:03
radekhi16:06
radekfor me it never lists details of the instance16:07
radek:/16:07
radeki've tried different endpoints http:/ip:8774/v1.0 which didnt work16:08
radek http:/ip:8774/v1.1 seems to list instances but crashes on details view16:08
radekdid you ever tried iphone not the ipad version ?16:09
notmynameromey: I can only speak for swift. you should use at least 3 servers for swift, but starting with 4 or 5 servers is good16:09
*** QueSeca has joined #openstack16:09
primeministerpanyone see johnper this am16:09
*** QueSeca has quit IRC16:10
*** ivan has quit IRC16:10
*** ivan has joined #openstack16:11
romeyokay.  thanks.  I was hoping there was a sizing guide or something to help you design your cluster, what should be redundant, etc.16:11
*** salv-orlando has joined #openstack16:12
*** kashyap has quit IRC16:12
antonymradek: i think i only used /v1.0/ on mine, hadn't tried v.1.1 yet16:14
antonymradek: i didn't try the iphone app, just the ipad app, i'll try it again this afternoon, in the middle or reconfiguring my clusters16:15
radekdid you used it with cactus or bextar ?16:15
antonymi believe it was trunk from last week16:15
antonymso past cactus :)16:15
radekcool thanks16:16
antonymno prob16:16
*** miclorb has joined #openstack16:16
antonymi was able to build through it though, was trying to find which things were broken so i could generate tickets16:16
annegentleprimeministerp: I'll find johnpur for ya16:17
*** ctennis has quit IRC16:17
primeministerpannegentle: thx16:18
*** Eyk has joined #openstack16:19
*** MotoMilind has joined #openstack16:19
*** blamar__ has joined #openstack16:20
*** johnpur has joined #openstack16:24
*** ChanServ sets mode: +v johnpur16:24
*** thingee has joined #openstack16:33
*** katkee has joined #openstack16:41
*** hallyn has quit IRC16:43
*** ctennis has joined #openstack16:46
*** ctennis has joined #openstack16:46
*** joearnold has joined #openstack16:49
*** llang629___ has joined #openstack16:52
*** llang629___ is now known as llang62916:52
*** llang629 has left #openstack16:53
*** dendro-afk is now known as dendrobates16:53
*** hallyn has joined #openstack16:57
*** jdurgin has joined #openstack16:58
*** nacx has quit IRC17:02
*** salv-orlando has quit IRC17:05
*** j05h has joined #openstack17:07
*** jehreg has joined #openstack17:09
jehreggreetings17:09
jehregAny humans in here ?17:10
* annegentle waves humanly17:12
*** hub_cap has joined #openstack17:13
jehregHi.17:13
jehregI poped in yesterday and with 350 people in the channel, no one said hi.  That's got to be a lurking record. :-)17:14
jehregI am looking for some Swift help, if anyone is available.17:14
annegentlehee. well most of the team is probably at lunch, but I may be able help17:15
jehregI downloaded SAIO and got it running in a virtualbox. Nova works great. But can't get Cyberduck to connect to Swift.17:16
annegentleOk, I just went through this myself.17:17
jehregThis is Cactus, AFAIK.17:17
jehregIs there any known bugs/limitations ?  The doc is sparse on this.17:17
jehregAll the recipes I see out there are of the previous OpenStack version, so a lot of instructions no longer apply.17:18
annegentleI just posted this: http://docs.openstack.org/cactus/openstack-object-storage/admin/content/storing-large-photos-or-videos-on-the-cloud.html17:18
jehregWhat problems did you run into ?17:18
jehregOK, I will look.17:18
*** Rishi_ has joined #openstack17:18
jehregAh, yes, I followed those instructions yesterday, to no avail.17:18
*** jmeredit has quit IRC17:18
annegentlebasically, you must enable HTTPS and your iptables and config file must enable the traffic on 44317:18
jehregCyberduck keeps responding that it cannot parse the server's response.17:19
annegentlecan you tail the logs on the Swift proxy server/SAIO?17:19
jehregYes, I had all of that done, port 443, SSL, user accounts. Cyberduck kept telling me that it could not figure out the server reponse.  It was authenticating according to the swift log files.17:19
jehregYes, I can do so in 15 mins.17:20
Rishi_Hi, Can anyone help me out with this https://bugs.launchpad.net/nova/+bug/746401 I have been struggling for quite some time hence am trying my luck here17:20
uvirtbotLaunchpad bug 746401 in nova "uec-publish-tarball throws UnknownError" [Undecided,New]17:20
annegentlealso we found you have to create a container before cyberduck would show anything17:20
jehregOoh, got a trick to create a container ?  I tried via a POST on command line but got permission denied.17:21
jehregbooting vm17:21
annegentleyesterday we did it with the st tool, let me find it17:21
uvirtbotNew bug: #784743 in nova "IllegalFlagValue: flag --host_state_interval" [Undecided,New] https://launchpad.net/bugs/78474317:21
annegentlethough I've also done it in Cyberduck with "New Folder" or some such17:21
vishyRishi: do you get any errors in the api log?17:22
vishyUnknownError is a response from nova-api so it should have a traceback along with it17:23
*** joearnold has quit IRC17:23
*** vernhart has quit IRC17:24
Rishi_vishy one second let me check the api log file17:24
annegentlejehreg: for example, st -A https://50.57.41.66/auth/v1.0 -U stacku:student -K password post filename17:24
Rishi_this is one : 2011-05-04 12:48:56,322 ERROR nova.api [TGO16X2658F7ZF6GV2IH rishi myproject] Unexpected error raised: BotoServerError: 503 Service Unavailable17:25
*** jehreg has quit IRC17:26
annegentlejehreg: er, that'll put in an object not in a container, though17:26
annegentlejehreg: and we never could get Cyberduck to connect to an SAIO installed on Virtualbox, something to do with the IP address assignments etc. Sorry I don't know more.17:27
*** joearnold has joined #openstack17:27
*** sebastianstadil has quit IRC17:27
*** hallyn is now known as hallyn_afk17:28
*** hub_cap is now known as hub-cap17:32
*** kakella has joined #openstack17:32
*** kakella has left #openstack17:32
*** jehreg has joined #openstack17:35
jehregback17:35
jehregHome internet dropped.17:35
jehregannegentle: still here ?17:35
*** hub-cap is now known as hub_cap17:36
*** sebastianstadil has joined #openstack17:37
*** koolhead17 has joined #openstack17:38
*** Eyk_ has joined #openstack17:40
*** blamar has quit IRC17:43
*** Eyk has quit IRC17:44
*** vernhart has joined #openstack17:44
*** mgius has joined #openstack17:45
*** obino has quit IRC17:46
katkeehello, what is the command to delete an image shown by euca-describe-images?17:46
primeministerpgreetings programs!17:47
vishyeuca-deregister17:47
jehregCan anyone help with a Swift configuration problem ?17:47
katkeevishy: thanks17:48
*** alandman has joined #openstack17:48
*** |omni| has joined #openstack17:49
*** koolhead17 has left #openstack17:49
primeministerphey all17:50
primeministerpto start this discussion on this side of the fence17:50
katkeeis it possible to use floating ips with FlatManager?17:50
primeministerpwe want to use use our existing dhcp infrastructure for address assignment17:50
primeministerpi thought we would use the flatDHCP for this17:50
primeministerpbut I must be wrong as it appears to be injecting ip's onto the bridge interfaces17:51
primeministerpto act as our default gateways17:51
vishyno it doesn't17:51
vishyflat does17:51
vishyoh sorry17:51
vishyon the host yes it does17:51
|omni|Hoping someone can help answer a few questions regarding openstack. We're building and testing an XCP setup to use for web and application hosting in our rack for customers (although on a small scale, only a couple of xen boxes and shared storage via openfiler). OpenStack looks interesting and I've read a ton but can someone point me to some resource online that explains how it can be used with Xen and the relationship of VMs and stora17:51
|omni|ge with Compute and Storage?17:51
primeministerpvishy: i guess can you clarify?17:52
vishyi misread what you were saying17:52
primeministerpvishy: np17:52
|omni|On one of the demo videos on openstack.org they show how volume devices can be added directly to a VM instance, it looks like it's in object storage, but that doesn't seem to be the case17:52
primeministerpvishy: i'm trying to clarify w/o confusing myself17:52
vishyprimeministerp: there needs to be a way for nova to know what ips a machine has17:52
primeministerpvishy: yes a dhcp request17:53
primeministerpto our dhcp server17:53
vishyif you use existing dhcp, then there needs to be a way for nova to know what was given out17:53
primeministerpvishy: why?17:53
vishyso it can display it to the user17:53
primeministerpvishy: the dhcp server keeps those records17:53
*** hub-cap has joined #openstack17:53
vishyhow else does the user know how to connect to the instance?17:53
primeministerpvishy: can't it query the guest to see what was given out17:53
primeministerpvishy: or if there was a dhcp-relay between then it would be able to see the dhcp request in the first place17:54
vishynot without an agent on the guest17:54
primeministerp*nod17:54
primeministerpwell17:54
vishyprimeministerp: that is what nova-dhcpbridge does essentially17:54
vishyit is run by dnsmasq when the ip is given out17:54
vishyand it updates novas database17:55
primeministerpvishy: problem is we have very complicated ip infrastructure w/  linux virt clusters and lots of vlan/bridge interfaces17:55
primeministerpvishy: all is managed via our dhcp17:55
*** hub_cap has quit IRC17:55
*** hub-cap is now known as hub_cap17:55
primeministerpvishy: we don't want to have to recreate that w/in the openstack structure17:55
primeministerpvishy: trying to find out the best way to use what we've got17:55
*** dendrobates is now known as dendro-afk17:56
*** jehreg has quit IRC17:56
primeministerpvishy: so do i just reserve a range on our dhcp side17:56
vishyprimeministerp: well ultimately melange will handle this and (hopefully) allow you to plug in your stuff17:56
vishyin the meantime17:56
primeministerpvishy: that won't be used, and have the ips in the range handed out by nova17:57
primeministerpvishy: i was under the assumption that something internal to nova was making the dhcp request on behalf of the guest17:58
vishyprimeministerp: the existing nova networking modes uses nova-network as the gateway and runs a dhcp server17:58
vishyon nova-network17:58
primeministerpvishy: gothca17:58
primeministerper gotcha17:58
primeministerpvishy: so there's really no way w/ nova-network to use our existing dhcp infrastructure for the guests17:59
vishyprobably not17:59
primeministerpvishy: that adds clarity17:59
vishyyou will have to do some custom hacking to make it work17:59
primeministerpvishy: so basically it's largely self contained17:59
*** j05h has left #openstack17:59
primeministerpvishy: so we basically block out set of ips w/in each subnet and dedicate those ranges to cloud networking18:00
primeministerpvishy: have network devices outside of that get ips from a range handed out by the dhcp server18:00
primeministerpvishy: ultimately having i guess 218:00
vishyprimeministerp: I think you could add another networking mode that would work, as long as you can plug in something to your dhcp system that would update the records in the db with the ip that you are giving out...18:00
primeministerpoverlaping dhcpds18:00
*** jedi4ever has joined #openstack18:01
*** joearnold has quit IRC18:01
*** fairchild has quit IRC18:01
primeministerpvishy: when it creates the bridge how does bridge get outside of it's network18:04
*** lvaughn has joined #openstack18:05
*** mdomsch has quit IRC18:06
alandmanvishy: I work with primeminsterp. I don't understand how routing works on the bridge that's created with the IP address of the default gateway18:07
*** tblamer has quit IRC18:07
*** mdomsch has joined #openstack18:08
alandmanvishy: If we were to use a unique subnet for the the openstack VM's how would those VM's access the outside world?18:09
vishynova-network is a gateway18:10
vishyit snats for the vms18:10
vishyso traffic goes through nova-network18:11
*** manelmed has joined #openstack18:11
primeministerpvishy: but we don't understand how it get's out the bridge to our network18:12
vishynova-network has a public address18:13
primeministerpvishy: if it doesn't have an ip or now anything about the network on the other side18:13
vishybasically nova-network is functioning just like a router18:13
alandmanvishy: Where do you define the nova-network public address?18:13
primeministerpvishy: we understand that, but a router has 2 interfaces18:14
vishyyou can set it up with two interfaces18:14
primeministerpvishy: that still doesn't makes sense18:14
vishyflatdhcp: is smart enough to create a bridge and iptables route stuff out18:14
primeministerpvishy: hmm18:14
primeministerpvishy: ok, we are trying to keep this as simple as possible18:15
primeministerpwe are attempting to build a hyperv openstack cloud18:15
primeministerpvishy: so you can understand why we want simple18:15
vishyprimeministerp: I don't know how else to explain things18:15
primeministerpvishy: we already have multiple linux virt clusters built using the linux-ha stack that are not openstack managed18:15
vishynova-network runs dnsmasq to give out ips18:16
primeministerpvishy: but we still don't understand how it routes18:16
primeministerpvishy: we get that it has it's own independent dhcp infrastructure18:16
primeministerpvishy: we don't understand how it knows what to snat to18:17
primeministerpvishy: and can't we just have it route?18:17
primeministerpvishy: instead of snatting?18:17
vishyit routes properly18:17
vishybut we give out rfc1918 by default18:17
vishyso it has to snat to the public ip of nova-network18:17
vishyso that packets from the public can get back18:18
primeministerpvishy: so where are the routing tables kept?18:18
primeministerpvishy: because on our nova-network node18:19
primeministerpvishy: which has one bridge interface18:19
primeministerpand one interface on our lan18:19
*** kashyap has joined #openstack18:20
primeministerpvishy: and we don't see those routes on our nova-network hosts routing tables;18:20
vishy?18:20
vishyreally?18:20
primeministerpreally18:21
primeministerpvishy: we are using all rfc1918 addrs internally18:21
primeministerpand routing between them all18:21
primeministerpwe have 16 subnets18:21
*** tblamer has joined #openstack18:21
primeministerpso you can see that we would just rather route to our default gw18:22
*** markvoelker has quit IRC18:22
*** Ryan_Lane has joined #openstack18:22
vishynova-network gets an ip on br100 that is the first ip in the fixed_range18:22
vishywhich should give it the route to that network18:23
vishyideally br100 is on a second nic that is used for vm traffic, but it does work with just one nic18:25
primeministerpvishy: i think we're slowly getting it18:26
*** jmeredit has joined #openstack18:26
vishyprimeministerp: sorry I'm not a network administrator, or I might have better terminology for what it is doing :)18:26
*** nelson has quit IRC18:26
*** nelson has joined #openstack18:27
primeministerpvishy: no worries you've been a great help w/ our understanding of how this works18:27
primeministerpvishy: we are network/ops18:27
primeministerpvishy: it's why we're confused18:27
primeministerpvishy: ;)18:27
vishyprimeministerp: I know that DoE/Magellan has done some fancy hacks to allow all of the computes to act as gateways18:28
primeministerpgothca18:28
primeministerpvishy: can we add comments in the nova.conf file18:28
vishyprimeministerp: I think they set up their dhcp servers to forward dhcp requests to nova-network18:28
vishyprimeministerp: yes18:28
vishy#18:28
primeministerpvishy: wasn't sure if it need something else18:28
primeministerpvishy: need to clean it up so i can get it18:28
primeministerpvishy: could we use dnsmasque as a dhcp-relay?18:29
primeministerpor maybe the other way around18:29
primeministerphave it act as dhcp for whole network and have our dhcpd pull addrs from that18:29
*** kashyap has quit IRC18:30
*** kashyap has joined #openstack18:30
vishyprimeministerp: I would think that you can, yes, although I haven't set that up before.18:30
vishyprimeministerp: This will all be much easier when the network services are done :)18:32
primeministerpvishy: i'll drink to that18:32
primeministerpvishy: ideally we just lacp the nodes into our switch and let it do the rest18:32
vishyprimeministerp: I have no idea what that means, but sure :)18:33
vishyI was hoping desai was online so he could explain how they have it working18:33
vishybut it looks like he isn't here18:33
primeministerpvishy: np, honestly we were trying to implement on top of what we already had, however it appears that it has to be it's own thingie18:34
primeministerpvishy: so new vlans are being create as we speak to isolate this18:35
katkeeno address range available for DHCP request via br100, dnsmasq no responding to DHCP request anymore... any ideas?18:37
*** |omni| has quit IRC18:39
vishykatkee: sounds very sad18:40
vishykatkee: is dnsmasq running?18:40
katkeevishy: yes18:41
*** fabiand__ has joined #openstack18:41
katkeevishy: trying debug mode18:41
vishykatkee: any weird messages in /var/log/messages?18:41
katkeevishy: nope, only no address range...18:42
vishykatkee: sounds like the mac/ip didn't get written to the .conf file for some reason18:43
katkeevishy: i did nova.sh scrub clean etc... many times and started all over again but don't know why dnsmasq started bugging18:43
*** blamar_ has joined #openstack18:43
katkeenova/networks/nova-br100.conf contains the mac of the request seen in tcpdump...18:44
vishyand does nova-br100.pid contain the right pid?18:44
vishymaybe it didn't get hupped properly?18:45
vishyyou could try a manual kill -HUP <pid>18:45
*** Ryan_Lane has quit IRC18:45
vishyor just try killall dnsmasq; restart nova-network18:45
katkeevishy: trying that.18:46
katkeevishy: still not working. pid file is correct.18:47
vishysomething else is dhcping maybe?18:48
katkeevishy: --dhcp-range=10.0.0.2,static,120s  and br100 has ip 10.87.69.101... is it normal?18:48
vishykatkee: perhaps your ips are out of order on the bridge18:49
katkeevishy: the bridge is isolated, no other dhpc server than dnsmasq,   ips out of order? can you explain?18:50
*** |omni| has joined #openstack18:50
vishyyou are using flatdhcp right?18:50
vishykatkee: when nova creates br100 and bridges it into eth018:51
vishykatkee: it moves the ip from eth0 onto the bridge18:51
katkeevishy: yes FlatDHCP18:51
vishykatkee: and it also adds 10.0.0.1 to the bridge18:51
vishyso if you do ip addr you should see both addresses on the bridge18:51
vishyI've18:52
katkeevishy: i set public_interface to eth1 with publi ip on it and brctl doesn't show eth1 bridged on br10018:52
vishyho there you go18:52
*** NDCGarrett has quit IRC18:52
katkeevishy: ;)18:52
*** foxtrotgulf has joined #openstack18:52
vishypublic_interface doesn't do bridging18:52
katkeevishy: i need to set flat_interface?18:52
vishyyup18:52
katkeevishy: ok...18:53
*** NDCGarrett has joined #openstack18:53
*** NDCGarrett has quit IRC18:53
*** NDCGarrett has joined #openstack18:53
katkeevishy: cleaning all the stuff... (by the way your script is saving my life... we have been testing sooo many stuff with openstack today)18:53
*** mszilagyi has joined #openstack18:54
vishykatkee: awesome18:54
*** brd_from_italy has joined #openstack18:58
katkeevishy: still doesn't work...   i don't understand because this configuration worked before ... very strange18:59
katkeevishy: eth0 is in br100 but it is shutown during my tests... can it be the cause?18:59
*** prudhvi has quit IRC18:59
vishynot sure19:01
*** jmeredit has quit IRC19:01
*** Ryan_Lane has joined #openstack19:06
katkeevishy: i am going to reinstall everything.19:08
*** jmeredit has joined #openstack19:09
*** vernhart has quit IRC19:11
katkeevishy: working again ;)19:15
*** Ryan_Lane has quit IRC19:19
*** kang___ has quit IRC19:23
*** Ryan_Lane has joined #openstack19:24
*** smoser has quit IRC19:25
*** smoser has joined #openstack19:26
*** dprince has quit IRC19:32
*** Eyk_ has quit IRC19:38
*** dijenerate has joined #openstack19:38
*** fabiand__ has left #openstack19:47
*** tblamer has quit IRC19:49
*** Rishi_ has quit IRC19:53
*** nelson has quit IRC19:53
*** nelson has joined #openstack19:53
nelsonDoes an X-Copy-From: operation overwrite the existing Content-Type?19:54
nelson(in swift)19:54
ShermanBoydhow big a root filesystem do I need for openstack19:58
*** mahadev_ has joined #openstack19:59
nelsonShermanBoyd: swift or nova?20:00
*** tblamer has joined #openstack20:02
*** jedi4ever has quit IRC20:02
*** jmeredit has quit IRC20:02
*** mahadev has quit IRC20:03
*** mahadev_ is now known as mahadev20:03
*** jmeredit has joined #openstack20:03
nelsonTo answer my own question: only if you supply a Content-Type: header. Otherwise it uses the existing one.20:03
*** hallyn_afk is now known as hallyn20:03
*** jedi4ever has joined #openstack20:05
*** dprince has joined #openstack20:05
katkeeis there a document explaining iptables rules?20:07
*** jedi4ever has quit IRC20:10
notmynamenelson: the general rule with copy requests is that they will use the metadata in the copy request if it is supplied. if nothing is supplied, the old metadata is used. this implies that you can't copy and strip metadata at the same time20:12
*** dendro-afk is now known as dendrobates20:12
*** JuanPerez has joined #openstack20:13
nelsonnotmyname: handy to know, thanks.20:14
uvirtbotNew bug: #784837 in glance "glance-api.log permission error when using upstart script" [Undecided,New] https://launchpad.net/bugs/78483720:16
*** photron has left #openstack20:17
*** lvaughn has quit IRC20:20
*** mahadev has quit IRC20:24
*** mahadev has joined #openstack20:24
*** dprince has quit IRC20:30
*** Ryan_Lane has quit IRC20:32
*** patcoll has quit IRC20:32
annegentlekatkee: I tend to use this doc when trying to work on iptables rules: https://help.ubuntu.com/community/IptablesHowTo. Also, this page is very step-by-step for specific scenarios (like allow HTTP traffic) http://cloudservers.rackspacecloud.com/index.php/Ubuntu_-_Setup20:35
*** enigma1 has quit IRC20:38
*** johnpur has quit IRC20:40
*** MarkAtwood has quit IRC20:42
*** enigma has joined #openstack20:43
*** JuanPerez has quit IRC20:45
*** MarkAtwood has joined #openstack20:48
*** mgoldmann has quit IRC20:49
*** syah has quit IRC20:50
*** h0cin has quit IRC20:52
*** heckj has joined #openstack20:56
*** heckj has left #openstack20:57
*** heckj has joined #openstack20:57
heckjjoin #openstack-meeting21:02
heckjerp21:02
*** nerens has joined #openstack21:04
*** ctennis has quit IRC21:05
*** lorin1 has quit IRC21:10
*** nerens has quit IRC21:11
*** markvoelker has joined #openstack21:11
*** dhersam has joined #openstack21:12
*** syah has joined #openstack21:12
*** foxtrotgulf has quit IRC21:13
dhersamIn a SAIO environment with SSL enabled the GET account test (step 11 in instructions) fails with: 403 Forbidden.  Any suggestions on how to troubleshoot it?21:15
*** ctennis has joined #openstack21:19
*** AimanA has joined #openstack21:25
dubsquareddhersam:  have you verified that all your services have started?  netstat -tlpn21:25
*** dendrobates is now known as dendro-afk21:25
*** jmeredit has quit IRC21:26
dhersamdubsquared: I can see them all running with swift-init all status.  I ran netstat and can see them there too21:27
*** brd_from_italy has quit IRC21:27
dubsquaredcan you share the link you are reading from?21:28
dhersamTo provide some context: Everything was working before I enabled SSL and tried to use the external IP instead of localhost in order to connect with Cyberduck21:28
dhersamdubsquared: Sure: http://swift.openstack.org/development_saio.html21:28
dhersamI found an IRC log (http://eavesdrop.openstack.org/irclogs/%23openstack/%23openstack.2011-04-17.log) that helped to get the X-Storage-Url to stop returning 127.0.0.1, but now I get the 403 forbidden error using curl, st or Cyberduck21:30
*** mahadev_ has joined #openstack21:30
dubsquaredso step 10 works for you just fine?21:30
*** nelson has quit IRC21:31
*** nelson has joined #openstack21:31
uvirtbotNew bug: #784865 in nova "When metadata fails, we eat the exception and don't return a useful message" [Low,In progress] https://launchpad.net/bugs/78486521:32
*** mahadev has quit IRC21:32
*** mahadev_ is now known as mahadev21:32
dhersamdubsquared: Yes, step 10 works21:32
*** sebastianstadil has quit IRC21:32
*** hub_cap has quit IRC21:33
*** mahadev has quit IRC21:34
*** mahadev has joined #openstack21:34
*** Eyk has joined #openstack21:34
*** salv-orlando has joined #openstack21:35
dhersamI'm not seeing much in the proxy logs - can you set log_level at the [DEFAULT] level in proxy-server.conf?  It didn't seem to have any effect.21:35
dhersamHere's the proxy-server.conf: http://paste.openstack.org/show/1369/21:35
*** Shentonfreude has quit IRC21:36
*** mahadev_ has joined #openstack21:39
dubsquaredhmm21:41
*** maplebed has joined #openstack21:41
dubsquaredi feel like something is missing there...21:41
dhersamdubsquared: I echo your "hmm" :)21:41
*** romey has quit IRC21:41
dubsquaredgimme a sec...21:41
dhersamdubsquared: No problem21:41
*** mahadev has quit IRC21:42
*** mahadev_ is now known as mahadev21:42
dubsquaredany chance you have run swauth-prep?21:43
dhersamdubsquared: Yes, I ran it before creating a new user21:44
dubsquaredok.21:44
*** cascone has joined #openstack21:44
dhersamI added -A <https url> because it was hanging since it defaults to http://localhost:8080/auth/21:47
dubsquaredand you're getting a 400 or 403 on step 11?21:47
dhersam40321:47
dubsquaredOdd, thats usually something easy…wrong superuser key, url, etc21:48
dhersamDo the rings in remakerings need to use the external IP?  I've tried both ways and it didn't seem to make a difference21:49
*** jmeredit has joined #openstack21:49
*** Ryan_Lane has joined #openstack21:50
dubsquaredshouldn't make a difference to the auth21:50
*** matiu has joined #openstack21:51
dhersamI'll try creating a new account in case I was missing something obvious21:51
*** Ryan_Lane1 has joined #openstack21:53
*** Ryan_Lane has quit IRC21:54
*** Ryan_Lane1 is now known as Ryan_Lane21:54
*** Ryan_Lane has joined #openstack21:54
*** mahadev has quit IRC21:54
*** mahadev has joined #openstack21:55
*** gaveen has quit IRC21:55
*** lvaughn has joined #openstack21:55
*** joearnold has joined #openstack21:56
*** jakedahn has joined #openstack21:57
*** enigma has quit IRC21:58
*** mahadev_ has joined #openstack22:00
*** enigma has joined #openstack22:00
*** lborda has quit IRC22:01
*** mahadev has quit IRC22:03
*** mahadev_ is now known as mahadev22:03
*** gaveen has joined #openstack22:08
*** amccabe has quit IRC22:09
*** jakedahn has quit IRC22:10
dhersamI started over from scratch with the resetswift script, then ran remakerings and recreateaccounts and steps 10 and 11 worked great - and even better, Cyberduck logins now work!22:11
dhersamdubsquared: Thanks for your time22:12
*** allsystemsarego has quit IRC22:14
*** salv-orlando has quit IRC22:14
*** ameade has quit IRC22:15
*** dhersam has left #openstack22:18
*** mahadev has quit IRC22:23
*** mahadev has joined #openstack22:23
*** jmeredit has quit IRC22:23
*** Ryan_Lane has quit IRC22:25
*** gondoi has quit IRC22:25
*** katkee has quit IRC22:25
*** manelmed has quit IRC22:32
*** mdomsch has quit IRC22:32
ShermanBoydnelson: both swift & nova22:34
*** joearnold has quit IRC22:35
*** msivanes has quit IRC22:37
*** joearnold has joined #openstack22:38
*** MarkAtwood has quit IRC22:39
*** blamar__ has quit IRC22:40
*** MarkAtwood has joined #openstack22:40
*** gaveen has quit IRC22:41
*** markvoelker has left #openstack22:42
*** dubsquared has quit IRC22:43
*** Eyk has quit IRC22:51
*** pguth66 has joined #openstack22:53
*** tblamer has quit IRC22:54
*** jkoelker has quit IRC23:01
*** robix has joined #openstack23:04
*** thingee has quit IRC23:08
*** Chipaca has joined #openstack23:10
*** robix has quit IRC23:10
Chipacahi all23:14
Chipacaa silly/lazy question (that i've googled to no avail): what's the easiest way to get a lucid ami?23:14
*** obino has joined #openstack23:15
*** cp16net has quit IRC23:15
Chipacaah, probably http://uec-images.ubuntu.com/releases/10.04/release/23:17
vishyChipaca: http://uec-images.ubuntu.com/releases/lucid/alpha-2/lucid-server-uec-amd64.tar.gz23:17
vishyoops yeah yours23:18
vishymine is old23:18
Chipaca:)23:18
vishythen uec-publish-tarball23:18
Chipacaawesome23:19
*** matiu has quit IRC23:21
*** rnirmal has quit IRC23:21
*** matiu has joined #openstack23:22
*** matiu has joined #openstack23:22
*** mszilagyi has quit IRC23:24
*** adjohn has joined #openstack23:24
*** dubs_ has joined #openstack23:27
*** cw_ has joined #openstack23:27
*** westmaas_ has joined #openstack23:27
*** cweidenk1ller has joined #openstack23:28
*** alandman has quit IRC23:28
*** mahadev_ has joined #openstack23:32
*** robix has joined #openstack23:32
*** mahadev has quit IRC23:32
*** NDCGarrett has quit IRC23:32
*** blamar_ has quit IRC23:32
*** zul has quit IRC23:32
*** freeflying has quit IRC23:32
*** cweidenkeller has quit IRC23:32
*** cw has quit IRC23:32
*** dubs has quit IRC23:32
*** westmaas has quit IRC23:32
*** mahadev_ is now known as mahadev23:32
*** NDCGarrett has joined #openstack23:33
*** NDCGarrett has quit IRC23:33
*** NDCGarrett has joined #openstack23:33
*** freeflying has joined #openstack23:33
*** littleidea has quit IRC23:36
*** littleidea has joined #openstack23:36
nelson ShermanBoyd: I'm running 14GB root, 221GB on my two storage partitions (one per disk)23:37
nelsonThe root is /dev/md0. Not sure if it's set up as mirrored or striped.23:38
nelsonroot is ext3, storage are xfs.23:39
*** zul has joined #openstack23:40
*** blamar_ has joined #openstack23:40
*** r5 has joined #openstack23:43
*** adjohn has quit IRC23:45
*** obino has quit IRC23:47
*** heckj has quit IRC23:47
*** Chipaca has left #openstack23:54
*** guynaor has joined #openstack23:54
*** robix has quit IRC23:57
*** jeffjapan has joined #openstack23:57

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!