Monday, 2010-12-06

*** eldarnugaev has joined #openstack00:14
*** allsystemsarego has quit IRC00:17
*** GasbaKid has quit IRC00:21
*** londo_ has quit IRC00:33
*** londo_ has joined #openstack00:34
*** kashyapc has joined #openstack00:38
*** eldarnugaev has quit IRC00:44
*** ar1 has joined #openstack01:06
*** ksteward has quit IRC01:14
*** dizz has joined #openstack01:21
*** ctennis has quit IRC01:24
*** adjohn has joined #openstack01:24
*** kashyapc has quit IRC01:37
*** mdomsch has joined #openstack01:44
*** HugoKuo has quit IRC02:01
*** HouseAway is now known as AimanA02:03
*** DubLo7 has joined #openstack02:10
*** DubLo7 has quit IRC02:12
adjohnAnyone know the current status of raw-disk-images? https://blueprints.launchpad.net/nova/+spec/raw-disk-images02:14
*** dubsquared has joined #openstack02:23
*** jimbaker has joined #openstack02:23
*** kashyapc has joined #openstack02:24
*** sirp1 has joined #openstack02:31
*** sirp1 has quit IRC02:53
*** xfaf has joined #openstack03:01
*** rchavik has joined #openstack03:22
*** winston-d has joined #openstack03:31
winston-dHi, all.03:31
winston-dDoes anyone here had try multi-host Nova installation?03:31
dubsquaredwinston-d:  yes03:33
winston-dHi Dubsquared03:35
winston-dDid it work?03:36
winston-dI've followed the instructions on wiki.openstack.org, and I've installed Nova on 6 physical machines.  I wonder whether I can see a list of Nova components03:37
dubsquaredhello, winston-d!  what exactly are you looking for?03:37
dubsquaredif the nodes have checked in properlyQ?03:38
winston-dThings like how many nodes act as Nova-Compute, what is the status of those specific physical nodes.03:38
winston-dChecked in?  How?  Wiki and http://nova.openstack.org/adminguide/multi.node.install.html doesn't mention that03:39
dubsquaredWell, there is two different installs for Nova…the controller (five+ Nova services), then the nodes (just compute iirc)03:39
winston-dOK.  And how does 'the nodes' register or check-in to controller?03:40
winston-dVia configuration file under /etc/nova ? or some commands03:41
dubsquaredIn /etc/nova/nova.conf, you set the cc host ip03:41
dubsquaredthen from the controller, you can check on mysql03:41
dubsquaredselect * from services;03:41
dubsquaredand you can see all the compute nodes reporting03:41
winston-dOK. I did added CC host IP in my nodes' configuration file.03:42
winston-dIs there any more convenient way to grab list of compute nodes besides SQL query?03:43
*** sirp1 has joined #openstack03:44
xtoddxyou can use `nova-manage service list` to see compute workers03:44
winston-dErr..  Nova-2010.1 release doesn't have this sub-command for nova-manage03:45
winston-dGuess I should branch latest version from launchpad03:47
winston-dThanks xtoddx03:48
winston-dAnother question, do I have to have multiple Nova-API/Scheduler/Network/Volume services to avoid single point of failure?03:49
alekibangomultiple nova-api is desirable for best setup03:53
xtoddxwinson-d: yes, but should work fine with just one unless you have specific HA requirements03:53
alekibangoalso db and messaging should be  clustered03:53
winston-dalekibango, is there rule of thumb the ratio of nova-api node vs. compute node?  such as 1:50?03:56
alekibangoi would say 2-4 api servers are enough for most setups03:56
alekibangobut i am not the smartest one here :)03:56
alekibangoalso might change if you are geographicaly distributed03:56
winston-di see. thanks.03:56
alekibangoas you would like to avoid failure of the cloud when just some cluster is under fire (or flood)03:57
winston-dor power shutdown. :)03:57
winston-dis EUCA2OOLS the only way to interact with Nova cloud?03:59
alekibangonot the only way, but the only sane one... iirc03:59
alekibangowinston-d: are u using some configuration management ?04:00
alekibangolike puppet/chef or something like this04:00
winston-dno, not right now.  actually I'm very very new to cloud.  had no experience of AWS and rackspace.  I only played with OpenNebula for a while.04:01
alekibangohow did you like opennebula compared to openstack?04:01
winston-dWell, OpenNebula is well documented, relatively easy to setup and use (native commands such as: one node-list, one cluster list...)04:03
winston-dAnd also easier to subscribe to their mailing list :-p04:03
winston-dBut it doesn't have a S3-like storage service.  That's why I start looking at OpenStack04:04
winston-dwell, time to have lunch.  be back soon.  Thank you alekibango, xtoddx and dubsquared for helping me out.04:07
dubsquaredhave fun, anytime!04:07
*** daleolds has joined #openstack04:09
uvirtbotNew bug: #685730 in swift "object-replicator: replica deletion decision is wrong if replica_count != 3?" [Undecided,New] https://launchpad.net/bugs/68573004:16
*** david has joined #openstack04:18
*** david is now known as Guest9737704:18
*** Guest97377 is now known as davidX-04:19
*** rchavik has quit IRC04:21
*** sirp1 has quit IRC04:27
*** jimbaker has quit IRC04:36
*** sirp1 has joined #openstack04:41
*** mdomsch has quit IRC04:46
*** omidhdl has joined #openstack04:46
*** Xenith has quit IRC04:51
*** Xenith has joined #openstack04:51
*** sirp1 has quit IRC04:54
*** iammartian has quit IRC04:57
*** omidhdl has left #openstack05:07
*** rchavik has joined #openstack05:12
*** HugoKuo has joined #openstack05:27
*** maplebed has joined #openstack05:29
*** suchitp has joined #openstack05:30
*** suchitp has left #openstack05:31
*** f4m8_ is now known as f4m805:46
*** ctennis has joined #openstack06:01
dubsquaredIs there a latest list of the required packages for nodes?  nova-compute, nova-network, etc?06:09
*** that1dude has joined #openstack06:12
*** ramkrsna has joined #openstack06:13
*** HugoKuo has quit IRC06:24
winston-dHas anyone succeeded in building Nova from latest revision?06:32
winston-dI got an import error: ImportError: No module named sphinx.setup_command06:33
winston-dOr anyone can give me a pointer which revision works so that I can revert to older version?06:35
*** matiu has quit IRC06:35
*** matiu has joined #openstack06:40
*** matiu has joined #openstack06:40
*** maplebed has quit IRC06:49
*** guigui has joined #openstack06:52
*** HugoKuo has joined #openstack06:53
*** dubsquared1 has joined #openstack07:03
*** dubsquared has quit IRC07:04
*** matiu has quit IRC07:05
ttxGood morning07:23
winston-dmorning07:29
*** GasbaKid has joined #openstack07:31
*** arcane has quit IRC07:33
*** daleolds has quit IRC07:34
*** arcane has joined #openstack07:34
*** jc_smith has joined #openstack07:41
*** almaisan-away is now known as al-maisan08:20
sorenwinston-d: Install python-spinx, and you should be good.08:27
*** ramkrsna has quit IRC08:31
*** guigui has quit IRC08:31
*** guigui has joined #openstack08:32
*** ramkrsna has joined #openstack08:44
*** rchavik has quit IRC08:52
*** befreax has joined #openstack09:04
*** allsystemsarego has joined #openstack09:14
*** jc_smith has quit IRC09:20
*** irahgel has joined #openstack09:26
alekibangosoren: today i would like to rebuild/install some your packages on debian. which packages i should take for debian squeeze (testing)?09:35
alekibangoi think you already told me this, but i cant remember your suggestion :)09:36
alekibangoyou meant building from bzr or from deb sources?09:38
sorenJust grab the lastest from the trunk ppa.09:45
*** MarkAtwood has joined #openstack09:45
alekibangoso, source packages... ok09:46
sorenIt's the same stuff.09:46
sorenWhichever way to want to retrieve it is up to you.09:46
alekibangoi would rather generate it using ubuntu nova branch09:47
sorendon't use that.09:47
alekibangok09:47
sorenWhy would you?09:47
alekibangoto be able to do it again at some point in time09:47
alekibango(choosen)09:47
sorenWhich branch are you referreing to?09:48
alekibangoyour branch which generates those packages... or it is not ?09:48
alekibangohwo do you make them?09:49
sorenWhich branch are you referring to?09:49
alekibangoi was thinking about https://code.launchpad.net/~nova-core/nova/ubuntu-packaging09:50
*** fabiand has quit IRC09:50
alekibangohow are u generating those packages?09:50
sorenIt's abandonded.09:50
*** fabiand has joined #openstack09:50
alekibangoah ok09:50
sorenhttps://code.launchpad.net/~openstack-ubuntu-packagers/ubuntu/natty/nova/ubuntu09:50
*** perestrelka has quit IRC10:03
*** perestrelka has joined #openstack10:03
*** MarkAtwood has quit IRC10:21
*** kashyapc has quit IRC10:29
*** kashyapc has joined #openstack10:29
*** adjohn has quit IRC10:30
*** kashyapc has quit IRC10:46
*** rds__ has joined #openstack10:50
*** rchavik has joined #openstack10:55
*** eldarnugaev has joined #openstack11:15
*** krish has joined #openstack11:20
*** krish has left #openstack11:21
soren\o/11:55
* soren is very close to having working security groups again11:57
*** jkakar has quit IRC11:57
*** kirkland has joined #openstack12:09
*** omidhdl has joined #openstack12:10
*** ctennis has quit IRC12:26
*** stewart has quit IRC12:30
*** omidhdl has quit IRC12:41
*** stewart has joined #openstack12:43
*** ramkrsna has quit IRC12:43
*** omidhdl has joined #openstack12:45
*** guigui has quit IRC12:48
*** ctennis has joined #openstack12:59
*** ctennis has joined #openstack12:59
zykes-does Swift have some kind of fault tolerance ?13:00
sorenYeah.13:00
sorenThat's what it does.13:00
sorenOtherwise, we'd just use Apache :)13:01
zykes-;p13:01
zykes-what does it use for underlying architecture ?13:01
sorenWhich part of its architecture counts as "underlying" to you?13:02
zykes-ah, nvm13:02
zykes-anyways, soren do you know when they are coming to europe ?13:02
zykes-summit or so13:02
soren"they"?13:02
zykes-OS Summit / Talk13:02
zykes-or event13:02
sorenNo. There was some chatter about hosting one of the summits next year in Europe, but nothing's certain.13:03
zykes-k13:03
zykes-hoping that they will do that, or at least join in on LinuxTag or something13:03
*** kirkland has quit IRC13:08
*** kirkland has joined #openstack13:08
*** Cybodog has quit IRC13:24
*** hazmat has joined #openstack13:26
*** eldarnugaev has quit IRC13:27
*** jfluhmann has quit IRC13:27
*** abecc has joined #openstack13:33
*** abecc has joined #openstack13:34
*** mdomsch has joined #openstack13:42
*** ar1 has quit IRC13:42
*** westmaas has joined #openstack13:42
*** rchavik has quit IRC13:43
*** xfaf is now known as zul13:43
*** omidhdl has left #openstack13:46
*** rchavik has joined #openstack13:58
*** dirakx has quit IRC14:04
creiht_zykes-: swift is very fault tollerant14:07
*** creiht_ is now known as creiht14:08
creihtit stores 3 (by default) replicas of each piece of data14:09
creihtwe also do a lot to work around failure scenarios14:10
*** eldarnugaev has joined #openstack14:10
creihtfor example if a node is not available on write, it will write to a handoff node14:11
*** ppetraki has joined #openstack14:13
ttxcreiht: I could use 15 minutes of your time this morning, to confirm https://blueprints.launchpad.net/swift/1.2 -- let me know if you have any availability14:13
creihtwe have replicatiom that runs continually that ensures the 3 replicas are where they are supposed to be14:13
creihtttx: sure, i will ping you when I get into the office14:14
ttxcreiht: cool, thanks14:14
*** gaveen has joined #openstack14:18
* soren takes off for a couple of hours14:22
*** dovetaildan has quit IRC14:26
*** dovetaildan has joined #openstack14:28
*** zul has quit IRC14:37
*** zul has joined #openstack14:37
*** Podilarius has joined #openstack14:39
*** masumotok_ has quit IRC14:40
*** kashyapc has joined #openstack14:40
*** eldarnugaev_ has joined #openstack14:46
*** eldarnugaev has quit IRC14:46
*** eldarnugaev_ is now known as eldarnugaev14:46
*** gondoi has joined #openstack14:47
*** f4m8 is now known as f4m8_14:53
*** dubsquared has joined #openstack14:56
*** westmaas has quit IRC14:57
*** aliguori has joined #openstack15:03
*** EdwinGrubbs has quit IRC15:09
*** EdwinGrubbs has joined #openstack15:09
*** guigui1 has joined #openstack15:11
*** daleolds has joined #openstack15:14
*** eldarnugaev has quit IRC15:18
*** befreax has quit IRC15:21
pikenanne if your around, I just updated the wiki with my contributor info.15:22
annegentlepiken: thanks Philip. I still need to add my EchoSign info. :)15:23
pikenI need to find out what happened with legal at work, they still haven't finished the CLA for the company for some weird reason.15:23
*** dirakx has joined #openstack15:24
*** JimCurry has joined #openstack15:24
*** iammartian has joined #openstack15:25
*** dendroba` is now known as dendro-afk15:30
*** dendro-afk is now known as dendrobates15:30
*** dendrobates has joined #openstack15:30
*** ChanServ sets mode: +v dendrobates15:30
*** krish_ has joined #openstack15:34
*** JuanPerez has joined #openstack15:35
*** krish_ has quit IRC15:37
*** eldarnugaev has joined #openstack15:38
*** eldarnugaev_ has joined #openstack15:40
*** eldarnugaev has quit IRC15:40
*** eldarnugaev_ is now known as eldarnugaev15:40
creihtttx: ping15:45
ttxcreiht: see pm15:45
*** ChanServ sets mode: +v creiht15:45
*** sirp1 has joined #openstack15:47
*** eldarnugaev has joined #openstack15:47
*** gundlach has joined #openstack15:56
*** MarkAtwood has joined #openstack16:05
*** guigui1 has quit IRC16:08
*** MarkAtwood has quit IRC16:08
*** jimbaker has joined #openstack16:09
*** MarkAtwood has joined #openstack16:09
*** jbaker has joined #openstack16:09
*** jimbaker has quit IRC16:09
*** jbaker is now known as jimbaker16:10
chmouelis there some documentation around how to get nova-volumes plugged aside of having a nova-volumes vg created what should I do to be used after ?16:14
*** dragondm has joined #openstack16:27
*** dragondm has quit IRC16:28
*** dragondm has joined #openstack16:28
annegentlechmouel: sorry, I haven't seen any doc about nova-volume yet16:30
dubsquaredchmouel:  that is one of the items im going to start playing with this week16:31
dubsquaredif i get any definitive documentation up, ill let you/annegentle know :D16:31
annegentledubsquared: woo thanks! There's some discussion about volume groups here: https://answers.launchpad.net/nova/+question/13402016:32
*** kashyapc has quit IRC16:33
chmouelsweet, was wondering if there was any doco pointers before starting grepping, thanks..16:36
dubsquaredannegentle:  awesome thanks!  we just got the rest of out lab builtout, and this is a big feature we're going to want to use.  ill be in touch throughout the week...16:38
*** eldarnugaev has left #openstack16:47
*** kashyapc has joined #openstack16:50
*** reldan has joined #openstack16:52
*** JordanRinke2 has quit IRC16:53
*** littleidea has joined #openstack16:56
*** jimbaker has quit IRC16:58
*** jimbaker has joined #openstack16:58
*** JuanPerez has quit IRC17:00
*** jimbaker has quit IRC17:03
*** jimbaker has joined #openstack17:03
*** JimCurry has quit IRC17:10
*** dagger has quit IRC17:14
*** dagger has joined #openstack17:15
*** finch has quit IRC17:16
*** nijaba has quit IRC17:16
*** uvirtbot has quit IRC17:16
*** finch has joined #openstack17:16
*** ianweller has quit IRC17:16
*** odyi has quit IRC17:16
*** odyi has joined #openstack17:17
*** uvirtbot has joined #openstack17:17
*** ianweller has joined #openstack17:18
*** nijaba has joined #openstack17:18
*** nijaba has joined #openstack17:18
*** sophiap has joined #openstack17:20
*** dagger has quit IRC17:21
alekibangodubsquared: please start on etherpad, you know how?17:25
dubsquaredalekibango: yup17:26
alekibangourl?17:26
dubsquaredhaven't started, yet :D17:27
*** dagger has joined #openstack17:34
*** dagger has joined #openstack17:34
*** Ryan_Lane has joined #openstack17:38
*** mdomsch has quit IRC17:39
*** dagger has quit IRC17:43
*** maplebed has joined #openstack17:44
*** joearnold has joined #openstack17:45
*** kirkland has quit IRC17:49
*** reldan has quit IRC17:50
*** dagger has joined #openstack17:53
*** dagger has joined #openstack17:53
*** joearnold has quit IRC17:55
*** dagger has quit IRC18:01
*** jdarcy has joined #openstack18:02
*** hggdh has quit IRC18:02
*** dagger has joined #openstack18:10
*** dagger has joined #openstack18:10
*** BK_man has joined #openstack18:16
*** reldan has joined #openstack18:23
*** reldan_ has joined #openstack18:25
*** reldan has quit IRC18:25
*** reldan_ is now known as reldan18:25
BK_manvishy: ping18:30
edayugh, we have 22 outstanding reviews. I think it's time for a review party18:30
xtoddxeday: agreed18:33
*** GasbaKid has quit IRC18:34
BK_mangents, back to OpenSSL issue - it's the same on my Mac. It have OpenSSL 0.9.8l installed and I run genrootca.sh on my mac, not on RHEL6 (OpenSSL 1.0). Any thoughts?18:36
BK_manare there OpenSSL gurus? :-)18:36
*** MarkAtwood has quit IRC18:37
*** sirp1 has quit IRC18:39
*** Adiantum has joined #openstack18:40
edayxtoddx: sorry about the logging branch comments, I'm not trying to be a PITA, just want to share as much as we can sooner than later :)18:42
xtoddxeday: no worries.  it was worth me reviewing all the swift logging api to see what the plan should be.18:44
*** al-maisan is now known as almaisan-away18:45
*** jakedahn has joined #openstack18:46
*** hggdh has joined #openstack18:48
sandywalshTrying to start an instance on xenserver. Compute correctly says "Asking xapi to fetch <image> ..." but xenserver complains with http://paste.openstack.org/show/238/18:49
sandywalshlooks like a marshaling problem18:49
sandywalshanyone seen such a thing before?18:49
*** joearnold has joined #openstack18:57
_cerberus_sandywalsh: I had something similar. I think if you haven't cleared your env recently you probably should. I dropped my db and reregistered images and it worked fine18:57
*** JuanPerez has joined #openstack18:58
sandywalshhmm, ok, I'll try that. thx _cerberus_18:58
_cerberus_sandywalsh: You may want to go as far as recloning the branch as well, and just flying through the wiki instructions. Shouldn't take too long18:59
_cerberus_I think some bad metadata gets left over from other interactions, though I haven't confirmed19:00
sandywalshmetadata?19:00
_cerberus_Say from switching from qemu to xenserver perhaps?19:01
sandywalshhmm, ok, I'll give this one last shot and try that if there's no joy19:01
*** Ryan_Lane has quit IRC19:04
*** jakedahn has quit IRC19:07
*** Ryan_Lane has joined #openstack19:07
*** JuanPerez has quit IRC19:07
sorenvishy: Can you ping me when you're around?19:13
*** rchavik has quit IRC19:14
xtoddxsoren: i think vishy is going to be offline most of the day19:15
sorenxtoddx: Alrighty.19:15
sorenxtoddx: Thanks for letting me know!19:15
xtoddxnp19:15
*** sirp1 has joined #openstack19:18
*** maplebed is now known as green19:20
*** green is now known as maplebed19:20
*** miclorb_ has joined #openstack19:22
*** miclorb_ has joined #openstack19:23
xtoddxcreiht: i know you have a natural aversion for common libraries, but I'd like to get feedback on lp:~xtoddx/nova/newlog if you don't mind19:23
creihthehe19:25
creihtI'm against common libraries for the sake of having common libraries, but for something that makes sense, I am all ears19:26
xtoddxcreiht: well, i think logging makes sense.19:27
*** MarkAtwood has joined #openstack19:27
creihtxtoddx: ok, branch pulled, can you point me to the specific part I should look at :)19:27
xtoddxnova/log.py19:28
pikencreiht: common libraries for things are good. Like common logging libraries using logging base class. They make it easy to have all format outputs the same.19:28
xtoddxis a candidate for openstack-common19:28
* soren could have sworn "more stuff in common" was one of the arguments why Nova had to move to eventlet19:28
xtoddxyou can see how we use it at nova/api/ec2/__init__.py19:29
creihtsoren: I think that argument was everyone wanting to be less twisted :)19:29
xtoddxthe variable named LOG is where magic happens19:29
creihtxtoddx: cool... will look19:29
sorenbah19:29
vishysoren: I can't stay away19:29
sorenvishy: I know that feeling.19:29
creihtpiken: Like I was trying to say, I'm for having common libs for things that make sense19:29
*** littleidea has quit IRC19:30
sorenvishy: I have a working prototype of an iptables based security groups implementation.19:30
pikenBK_man: you around and still needed help with RH?19:30
BK_manpiken: yep19:30
creihtbah... standup time19:30
sorenvishy: ...but testing it is proving rather annoying.19:30
creihtxtoddx: will look shortly19:30
BK_manpiken: found this link: http://old.nabble.com/utf8string-vs-printablestring-mismatch-in-certificate-checking-td27232471.html19:30
vishysoren: i can imagine19:30
sorenvishy: Well.. No, I don't think you can :)19:31
BK_manpiken: now looking how nova generates CSR in python code19:31
*** littleidea has joined #openstack19:31
pikenBK_man: what was the issue you were having?19:31
sorenvishy: It's all pretty easy except for a small detail.19:31
BK_manpiken: CSR have UTF8-encoded strings and CA cert have PRINTABLE encoded strings19:31
sorenvishy: nova.network.linux_net.ensure_bridge() adds a couple of rules to the beginning of the FORWARD chain.19:31
vishyah19:32
pikenBK_man: hmm, I have never run into that issue on our install here.19:32
BK_manpiken: my issue: http://paste.openstack.org/show/232/19:32
vishysoren: we actually cleaned that up a bit19:32
BK_manpiken: are you on RHEL6?19:32
sorenvishy: Your ideas are intriguing to me, and I wish to subscribe to your newsletter.19:33
sorenvishy: Tell me more.19:33
pikenBK_man: no, 5.5 which has more issues then I care to deal with because of the older version of ioctl.19:33
BK_manfinally found this in code:19:34
BK_manflags.DEFINE_string('credential_cert_subject',19:34
BK_man                    '/C=US/ST=California/L=MountainView/O=AnsoLabs/'19:34
BK_man                    'OU=NovaDev/CN=%s-%s',19:34
BK_man                    'Subject for certificate for users')19:34
sorenvishy: The troublesome rules are the two ACCEPT rules at the end.19:34
sorenvishy: They kind of get in the way of my attempts to block stuff.19:34
BK_mannow need to understand why it comes as UTF8STRING to openssl rather than PRINTABLE19:35
sorenvishy: If I run nova-network on another box, I'm golden.19:35
sorenvishy: ...but I don't.19:35
vishysoren: gotcha the in-interface and out-interface19:35
sorenvishy: Precisely.19:35
sorenFWIW, I'm working on getting rid of the calls to openssl.19:35
vishysoren: in our current we add them to nova-forward instead of forward19:35
vishysoren: not sure if that helps you19:36
sorenvishy: ...and what's the jump condition for nova-forward?19:36
vishylooks like it is unconditional19:37
*** rlucio has joined #openstack19:37
sorenvishy: That's a rather limited win then :)19:38
vishy:)19:38
sorenvishy: Do you also have an iptables implementation of security groups?19:38
sorenvishy: Or is that rule for something different19:38
soren?19:38
vishysoren: no, we are using yours19:38
sorenphew19:38
vishysoren: so the issue only exists when you are trying to run nova-network on the same box as nova-compute19:39
sorenvishy: This new one is great. It actually works, and /actually/ applies changes in an atomically safe manner.19:39
sorenvishy: Yup.19:39
*** schisamo has joined #openstack19:39
sorenlibvirt things it's being all atomic and whatnot, but totally isn't.19:39
* soren pats himself on the back19:39
vishysoren: http://pastie.org/135312619:40
vishysoren: that is our current setup for nova-network19:40
jdarcyDoes anybody have any *good* way to filter Openstack-related email?  It's showing up with so many different things in so many different headers that my filters are getting out of hand.19:40
vishysoren: oops ignore that19:40
sorenvishy: Too late. Cannot be unseen.19:40
BK_manGents, that's clear indication why we have openssl issue: http://paste.openstack.org/show/239/19:41
vishysoren: my pastie script is failing...grr19:41
sorenvishy: pastebinit19:41
soren$ echo 'hi vish!' | pastebinit19:41
sorenhttp://pastebin.com/VCdgBHSB19:41
sorenWorks great.19:42
*** mdomsch has joined #openstack19:43
*** kashyapc has quit IRC19:43
vishyhttp://pastie.org/135314119:43
vishynever had any problem with pastie before :(19:43
edayjdarcy: I filter on * (^TO|^From.*|^Subject:.*|^X-Launchpad.*:.*)openstack19:45
sorenvishy: Do you think all your cool stuff will make its way back into nova trunk before the freeze?19:45
edayjdarcy: but also look for nova, swift, and glance (not just openstack)19:45
vishysoren: yes19:45
vishysoren: we have bugs set aside for the gap19:45
sorenvishy: Hm... I'm going to trample all over those rules in my iptables secgroup implementation.19:46
vishysoren: they didn't make it into our current sprint, but they are high priority for next sprint19:46
sorenvishy: Cool.19:46
vishy(which starts friday)19:46
sorenvishy: I can't help but wonder if nova-network could use another bridge (so that the rules wouldn't match)..19:49
* soren will look into that once his meeting finishes19:49
*** finch has left #openstack19:56
*** gundlach has quit IRC19:57
*** jc_smith has joined #openstack19:59
*** pothos_ has joined #openstack20:04
vishysoren: interesting idea20:04
creihtso getting back to this, do other project do i18n logging?20:05
*** pothos has quit IRC20:06
*** pothos_ is now known as pothos20:06
creihtxtoddx: well... my first problem with the logging stuff is that it requires gflags :)20:07
xtoddxcreiht: gflags is going away20:08
creihtk20:08
xtoddxwe're going to use what jaypipes proposed for openstack-common option processing20:08
*** gundlach has joined #openstack20:09
jaypipesxtoddx: I don't think creiht is pleased with that... I believe he would first want me to add the ability to have an option not show up on the --help output.20:10
creihtxtoddx: so what would flags.DEFINE_string look like after that?20:10
creihtjaypipes: ?20:11
*** jbryce has joined #openstack20:11
jaypipescreiht: you were complaining the other day that all "registered" options show up in help...20:11
creihtjaypipes: I still think it is silly to have a command line option for *every single* config option :)20:11
xtoddxcreiht: config.MODULENAME_OPTIONNAME20:12
xtoddxwhere it is read20:12
xtoddxand there is some sort of define_module_option(...) function for defining options20:12
xtoddxnot sure on the syntax20:12
creihtxtoddx: if this becomes common, wouldn't make sense for some of those to not be there20:12
creihtfor example, I doubt the 'default_log_levels' would be equal across projects20:12
*** hggdh has quit IRC20:13
xtoddxright.  we'd need them passed into _set_default_log_levels or something in that case20:13
creihtk20:13
jaypipesxtoddx: mc = ModuleConfig(__name__); mc.add_option(...)20:14
jaypipescreiht: it's not about having common options set across the project. it's about having one way *of registering and processing options*.20:15
creihtjaypipes: then the easy answer seems to be use python's standard way of doing that :)20:15
gundlacheday: https://code.launchpad.net/~gundlach/nova/compute-terminate/+merge/4287420:15
xtoddxwell, i tend to think that things that are in -common should take things as arguments instead of options.  have the client do the lifting of the options and turn them into a dict or something20:15
jaypipescreiht: gah... that's exactly what openstack-common does.20:16
*** rlucio has quit IRC20:16
creihtyo dawg, I heard you like libraries, so I put your libraries in libraries20:17
creiht:)20:17
creihtjaypipes: so why do we need anything extra?20:17
jaypipescreiht: with the benefit that you can add an option in any module and that the openstack.config module takes care of prefixing your option name with the name of the module.  other than that, it uses OptParse and ConfigParser.20:17
xtoddxso things can be per-module20:17
edaycreiht: so we don't need to register options with both command line opts and config file opts libs20:18
xtoddxand it hides the work of merging cmdline and config files20:18
xtoddxguys, stop beating me to the things i wanna say!20:18
creihtheh20:18
* jaypipes was trying to find a common ground between Gflags, getopt, optparse, and ConfigParser usage in swift and nova...20:18
xtoddx... and glance!20:19
* jaypipes was trying to have a compromise solution... unfortunately, creiht's idea of compromise seems to be similar to the Republicans in the US Senate... ;P20:19
creihtxtoddx: so for this logging stuff, what does it add?20:19
* creiht sighs20:19
jaypipescreiht: there's no real reason swift must use openstack-common... just let glance and nova use it then20:20
xtoddxa level named AUDIT, something we want to use to track actions with authz/n and security implications20:20
xtoddxa default formatter to dump lots of data20:20
xtoddxthe ability to throw even more data into debug level logs20:20
xtoddxand knowledge of a request context, so we can trace a request through the entire system20:20
creihtjaypipes: so what you are saying, is that the main thing it adds is allowing one to easily link command line and conig args?20:21
sorenvishy: I'm having trouble grokking this.20:21
xtoddxdid this chat go political?20:21
creihtjaypipes makes everything political20:21
creiht:)20:21
sorenvishy: The name of the bridge to which an instance's tap device is attached is set in the data store, right?20:21
sorenvishy: libvirt_conn.to_xml certainly suggests that that is the case.20:22
jaypipescreiht: yeah, sorry, it's a bad habit of mine...20:22
vishysoren: it is a property of the network20:22
edaycreiht: yeah, that's what the openstack-common config module would do.. very thin wrapper over both to link the two20:22
xtoddxjaypipes: just saw your commit on merge prop, who/when/why re: priority loss?20:22
sorenvishy: That's a "yes", right?20:22
jaypipesxtoddx: ask dendrobates20:22
vishysoren: yes network.bridge20:22
sorenvishy: Ok.20:23
creihteday: ok cool, swift doesn't need to do that, so I can ignore it... you guys do whatever you want :)20:23
sorenvishy: ...and the same bridge name is used by nova-network for something or the other.20:23
jaypipescreiht: yes, that's exactly what it is.20:23
creihtstill doesn't change the fact that I think it is silly :)20:23
xtoddxvish: i wonder how many more questions asked of you today will be answered "look at the network model"20:23
edaycreiht: I like having every option via both config and command line :)20:23
sorenvishy: I'm probably struggling with this because all nova-network has ever done for me is hand me ip addresses :)20:24
*** Daviey has quit IRC20:24
*** ramkrsna has joined #openstack20:25
soren..so I've never actually assembled the puzzle.20:25
*** Daviey has joined #openstack20:26
vishynp, keep asking questions.  It isn't really good if i'm the only person who knows how it works...20:26
vishyi'm sure there are bad assumptions /implementations at various points that haven't been uncovered yet20:27
* jaypipes apologized for making everything political...20:27
sorenvishy: So are my assumptions correct? The name of the bridge to which the guests' network interfaces are attached and the name of the bridge through which traffic for a particular network flows (which may or may not be on the same host) is the same?20:29
*** reldan has quit IRC20:30
sorenvishy: ...and if so, is there any particular reason why this must remain so?20:30
vishysoren: yes, and on multiple hosts there is no reason why the bridge needs to be the same20:31
*** joearnold has quit IRC20:32
vishysoren: on the same host i'm not sure what the implications of multiple bridges are20:32
sorenvishy: You can't bridge bridges.20:32
pikenyou can't bridge IB interfaces either :(20:32
sorenvishy: That doesn't help me at all, then :)20:33
sorengah20:33
vishysoren: all instances in a particular project need to be bridged into the same vlan20:33
sorenvishy: Ideas?20:33
vishysoren: (or interface) but the bridge name doesn't matter20:33
*** ramkrsna has quit IRC20:33
vishysoren: the bridge on the network host is for gateway/dhcp20:35
vishysoren: i don't think the bridge name there matters either20:36
vishysoren: so I would think it could have a different name so it wouldn't conflict with the one for the instances20:36
*** GasbaKid has joined #openstack20:36
vishysoren: as long as they are bridged in to the same interface/vlan20:36
soren..but then dhcp wouldn't work.20:36
creihtxtoddx: so are there any parts of this that you want, to see in swift (for your usage)?20:37
sorenvishy: As I said, bridges can't be bridged, and interfaces can't be on more than one bridge.20:37
creihtwe already have a lot of logging stuff in swift, and am leary to replace it all just for the sake of replacing it, unless there is some benefit to doing so20:37
vishysoren: ah, I didn't realize you can't attach multiple bridges to the same interface20:38
sorenvishy: so back to square one.20:38
vishysoren: perhaps there is another way of setting up the FORWARD rule20:38
xtoddxwe'd like to have audits of auth events, and creation of accounts, etc20:38
*** rnirmal has joined #openstack20:38
sorenvishy: Possibly.20:39
*** westmaas has joined #openstack20:39
vishysoren: why do those forward rules create problems?20:39
sorenvishy: Because they insert themselves at the top of FORWARD and ACCEPT everything.20:39
sorenvishy: ...which, obviously, makes blocking things rather difficult.20:39
vishyhmm20:40
vishythey are going in at the end of the forward chain for me20:40
sorenvishy: Can I see your _confirm_rule?20:41
vishy_execute("sudo iptables -A FORWARD -j nova_forward")20:41
vishy-A append20:41
sorenFascinating.20:41
sorenIn my linux_net it calls upon _confirm_rule to actually add it.20:41
vishyoh yes20:41
soren_confirm_rule does     _execute("sudo iptables -I %s %s" % (chain, cmd))20:41
sorenOh, hang on.20:42
sorenHang on, hang on.20:42
vishyyeah, that is why it is useful to have multiple chains20:43
vishyso we have extra rules in a chain called nova-extra which is before nova-forward20:43
sorenthe thing is that the ACCEPT rule is actually correct in some cases.20:43
sorenErr..20:43
sorenWell, of course it is, otherwise you wouldn't have added it.20:44
sorenbut, what I mean is..20:44
sorenIt's actually correct in some cases where a node runs both network and compute.20:44
*** dfg_ has joined #openstack20:44
sorenHmm..20:44
vishywe had a similar issue with postrouting rules20:44
sorenThe rule is supposed to allow traffic to pass through the node from whereever to compute nodes "behind" it, and from compute nodes "behind" it to whereever.20:45
vishywhere we had to ensure that a new rule was at the beginning of some of the rules, but after other rules20:45
sorenRight?20:45
sorenPrecisely.20:45
sorenWhat if..20:45
vishyyes20:45
vishywould it help to accept by ip rather than bridge?  Just allow the whole private ip range?20:46
sorenYeah, what if we change ensure_bridge to add a chain for local guests?20:46
sorenvishy: That wouldn't help.20:46
sorenvishy: I'd still be unable to block things.20:46
sorenSo if ensure_bridge adds a chain that my new iptables secgroup impl can use.20:47
soren..I win?20:47
vishyso a specific chain for guests on the local box?20:47
sorenWell..20:47
sorenTechnically, yes.20:47
sorenIt would add an unconditional jump to that chain.20:48
soren...and my new secgroup stuff would use that chain for its magic, only adding rules for local guests.20:48
*** rbergeron has quit IRC20:48
soren..and if they don't match, we go back to the regular scheduled programme^W^W^Wother rules in the FORWARD chain.20:48
sorenSounds like a win to me.20:49
vishyyeah sounds good20:49
vishychain nova-local or some such20:49
soren...if there's no local guests, it's a very cheap no-op chain.20:49
*** rbergeron has joined #openstack20:49
sorenmuhahahah20:49
* soren hacks20:49
sorenThis is turning out really well.20:49
vishysoren: the main difference in the code i sent you is just that nova-network is creating the nova-xxx chains instead of expecting them to be set up in advance20:50
vishyso hopefully it won't break your stuff too badly20:50
sorenYou sent me code?20:51
sorenOh, that pastie?20:51
vishyyeah20:58
*** zaitcev has joined #openstack21:03
*** eyepv6 has joined #openstack21:04
*** littleidea has quit IRC21:08
*** littleidea has joined #openstack21:09
sorenvishy: Oh, and once this is done, I'll be supporting granting access for other security groups, too.21:14
vishycool21:14
*** arthurc has joined #openstack21:14
*** adjohn has joined #openstack21:17
*** adjohn has quit IRC21:18
dubsquaredanyone want to help me figure out why i can ping my instances on a newly installed node?21:24
dubsquareds/can/cant21:24
*** GasbaKid has quit IRC21:25
*** GasbaKid has joined #openstack21:25
*** maplebed has quit IRC21:30
*** maplebed has joined #openstack21:30
JordanRinkewhat network manager are you using? and you can ping on the controller and vm's running on the controller but not from the node, or anything on the node?21:36
sorendubsquared: What do you see in euca-get-console-output?21:37
*** mdomsch has quit IRC21:38
dubsquaredcurrently working through some changes with nova.network.manager.FlatDHCPManager21:38
dubsquaredsoren:  using nova-debug, im at a login prompt21:40
*** rlucio has joined #openstack21:40
* soren looks at nova-debug and goes "EEEP!"21:41
*** littleidea has quit IRC21:43
*** joearnold has joined #openstack21:44
dubsquaredI'm using the default network manager; the controller can launch instances, and I can ping and ssh to those, anything that launches on the node is unreachable21:46
*** jizzo has joined #openstack21:48
uvirtbotNew bug: #686195 in swift "proxy.server.best_response doesn't include response headers" [Low,Confirmed] https://launchpad.net/bugs/68619521:52
chmoueldubsquared: did you do euca-authorize on the port you want to open ?21:54
dubsquaredchmouel:  yup21:55
dubsquaredwell, on the controller, that's the only place that needs to be done ja?21:55
dubsquarediirc that will propagate to all the nodes21:55
*** rnirmal has quit IRC21:56
*** rnirmal has joined #openstack21:56
chmouelyeah seems so21:57
*** sophiap has quit IRC22:00
*** jdarcy has quit IRC22:04
*** dragondm has quit IRC22:04
*** eyepv6 has quit IRC22:05
*** sophiap has joined #openstack22:07
dubsquaredgoing to throw this out there, and if someone could tell me this is accurate —>  default network manager is vlanmode, and you must have a switch that supports managed vlans for this to work across nodes.  if not, i should run flatDHCP manager mode.22:11
*** abecc has quit IRC22:12
*** arthurc has quit IRC22:17
creihtxtoddx: doesn't seem difficult to add the AUDIT messaging in logging22:17
*** joshuamckenty has joined #openstack22:18
xtoddxcreiht: true, but it would be nice to pull the formatting along with it22:18
xtoddxi'll think about it more later when i'm in more of a logging mindset22:18
*** westmaas has quit IRC22:19
creihthrm22:20
*** Ryan_Lane has quit IRC22:29
*** hggdh has joined #openstack22:29
*** joearnold has quit IRC22:30
*** dirakx has quit IRC22:30
*** littleidea has joined #openstack22:33
vishydubsquared correct22:36
vishydubsquared if your switch doesn't support managed vlans you will have no luck22:36
creihtxtoddx: I will ponder it some more as well22:36
*** brd_from_italy has joined #openstack22:37
*** dragondm has joined #openstack22:38
*** johnpur has joined #openstack22:39
*** ChanServ sets mode: +v johnpur22:39
JordanRinkevishy is there anyone that is just a networking god that can just drill in an understanding of all the network managers, how they work and how to configure them like I was a 5 year old?22:42
*** allsystemsarego has quit IRC22:43
*** jkakar has joined #openstack22:48
vishyprobably not22:49
vishy:)22:49
vishyJordanRinke: one issue is that we haven't quite figured out how to make flatdhcp manager work properly yet22:50
vishybut i do have an idea involving multiple ips22:50
*** GasbaKid has quit IRC22:51
*** dagger has quit IRC22:52
*** GasbaKid has joined #openstack22:54
dubsquaredlol @ vishy22:58
dubsquaredvishy:  i just started using flatDHCP manager and im pulling my hair out22:58
dubsquaredglad to hear it's a 'work in progress'22:58
vishydubsquared: the current version will only work22:59
vishydubsquared if you have two separate eth devices22:59
vishyone for instances and one for public22:59
dubsquaredwell damn.22:59
dubsquaredguess ill have to go run some cables tomorrow22:59
vishyi think i might be able to work around it by giving a public and private ip to the same bridge23:00
dubsquaredoh yeah, i recall you mentioning that23:00
dubsquaredcan you do that? did you test it?23:00
chmouelgundlach: about the ostack api in nova how do i specify an image id from a public image ?23:01
*** Ryan_Lane has joined #openstack23:01
chmouelgundlach: and what's a public image?23:01
*** brd_from_italy has quit IRC23:01
chmouelgundlach: the /var/lib/nova/images uploaded stuff ?23:01
gundlachjaypipes: do you have the answer to chmouel's q?  you've done work most recently w/ glance and images23:01
Ryan_LaneAny openstack people at the cloudstock event in SF today?23:02
gundlachchmouel: i haven't gotten a public image loaded yet in nova, so i'm not sure :)23:02
*** gundlach has quit IRC23:02
chmouelgundlach: ah k no worries i thought you were the one writting this code :)23:03
*** ppetraki has quit IRC23:05
*** gondoi has quit IRC23:05
*** hggdh has quit IRC23:06
spectorclan Ryan_Lane: Mike Mayo is speaking at the event23:07
Ryan_LaneYeah. Looks like I missed his talk. I wonder where he is. I'd like to meet him23:08
*** BK_man has quit IRC23:08
*** miclorb_ has quit IRC23:09
dubsquared--ec2_subdomain=ec2 would mean any requests to api.example.org get directed to the EC2 API. —> im getting a 400 bad request when i hit my ec2_subdomain23:10
*** ctennis has quit IRC23:10
*** hggdh has joined #openstack23:11
spectorclanRyan_Lane: sorry, don't have his number to call23:11
Ryan_LaneIt's cool. I'll see if I can find him23:13
JordanRinkedubsquared1: let's try it, give the interface multiple IPs - depending how/if the traffic is tagged it might work23:13
*** dagger has joined #openstack23:14
*** dagger has joined #openstack23:14
*** BK_man has joined #openstack23:15
*** irahgel has left #openstack23:16
JordanRinkevishy: how do we get better doc out there on networking? It seems to be the one thing that is a big mystery right now - and subsequently the biggest hurdle for massive deployments (I am also networking stupid so maybe I just don't understand it)23:20
Ryan_LaneAh. I didn't miss it. It's happening right now.23:21
*** ctennis has joined #openstack23:22
*** ctennis has joined #openstack23:22
vishywell i guess step one is figure out how to do flatdhcp properly23:37
vishyon multiple machines with one interface23:37
vishythe problem is bridging into the existing interface makes things splode23:37
*** iammartian_ has joined #openstack23:42
*** iammartian_ has left #openstack23:43
JordanRinkeonce you add the interface to the bridge and set IP info on it, it is fine though23:45
*** Podilarius has left #openstack23:46
*** Ryan_Lane has quit IRC23:47
*** iammartian has left #openstack23:49
*** aliguori has quit IRC23:50
*** jkakar has quit IRC23:53
*** MarkAtwood has quit IRC23:53
*** joearnold has joined #openstack23:56
*** GasbaKid has quit IRC23:56
*** jizzo has quit IRC23:57
*** aimon has joined #openstack23:57
*** jc_smith has quit IRC23:57
*** jc_smith has joined #openstack23:57
*** rnirmal has quit IRC23:58
*** miclorb_ has joined #openstack23:58

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!