Wednesday, 2015-08-12

Tango|2gus: Hi Angus, so glad to see you pop up :)00:03
*** david-lyle has quit IRC00:03
openstackgerritBradley Jones proposed openstack/magnum-ui: Initial skeleton repo  https://review.openstack.org/21175000:04
Tango|2gus: One of the essential blueprint we have is to get the external load balancer to work with the k8s cluster as deployed by Magnum00:04
-openstackstatus- NOTICE: Zuul was restarted due to an error; events (such as approvals or new patchsets) since 23:01 UTC have been lost and affected changes will need to be rechecked00:04
Tango|2gus: From looking at your k8s openstack driver, all we need to do is to configure correctly since we already have all the networking00:05
gusTango|2: yes, modulo possible bugs.00:06
gusI haven't actually used recently k8s versions, and I think some of the details haven't kept up with the recent k8s networking rearchs.00:07
Tango|2gus: I was trying different ways but have not been able to get the load balancer part to come up correctly.00:07
gusTango|2: yeah that ;)00:07
gusthere's been a very recent PR or two that I was pulled in to review, so I think those are probably necessary.00:08
gusmy real problem is that I don't have a current k8s + openstack test environment so I made a few recent changes blind, which is poor form.00:08
*** mikal has joined #openstack-containers00:08
Tango|2gus: ok, I can look for those.  But maybe what can really help is to synch up with you on how you set up your dev environment00:09
*** sthillma_ has joined #openstack-containers00:09
Tango|2gus: oh ok, then would it help it I run in my environment based on your suggestion, and provide you the observation and logs?00:10
*** sthillma has quit IRC00:11
*** sthillma_ is now known as sthillma00:11
*** yuanying-alt has joined #openstack-containers00:11
gusTango|2: yes, both of those things ;)  I'll learn about Magnum today and work on getting my own test setup going.00:13
*** yuanying-alt has quit IRC00:15
gusTango|2: https://github.com/GoogleCloudPlatform/kubernetes/pull/1220300:15
gusTango|2: https://github.com/GoogleCloudPlatform/kubernetes/pull/1226200:15
*** sthillma_ has joined #openstack-containers00:16
gusTango|2: https://github.com/GoogleCloudPlatform/kubernetes/pull/1228800:16
gusI think that's the important ones..00:16
*** sthillma has quit IRC00:17
*** sthillma_ is now known as sthillma00:17
Tango|2gus: Let  me email you my current config option to the kube-controller-manager and the parameters for the k8s driver.  Can you take a look to see if they are correct, or if I am missing anything?00:18
*** jruano has quit IRC00:23
gusTango|2: yep.  -> gus@inodes.org00:24
Tango|2gus: Thanks so much.  I will check to see if it's possible for me to set up a dev environment in public so you can log in as well00:26
Tango|2gus: So do you usually hang out on google-containers, in case I want to ping?00:27
*** dane_leblanc has quit IRC00:27
gusTango|2: I'm not machine constrained, so assuming it's easy to set up my own test env, don't put devote too much effort to making yours available.00:28
gusTango|2: I /joined right before posting, but my irc client will lurk here and catch references to "gus" from now on.00:28
gus(and I'm in Sydney, so an hour or so ago is the start of my workday)00:31
Tango|2gus: If you want to set up Magnum, you would want a physical server.  A VM will be too slow.  You can find the instruction for devstack here:  https://github.com/openstack/magnum/blob/master/doc/source/dev/dev-quickstart.rst00:31
Tango|2gus: Basically, Magnum will create VM for the master and the nodes and install all the services00:32
gusoh right, since this all runs in the guest (see how much I've learned already! ;)00:32
Tango|2gus: It sets up a private neutron subnet for the cluster, and a router to get to the public subnet00:33
Tango|2gus: So the load balancer is the only way to publish a service from the k8s cluster to the external network00:34
gusack, that seems sensible - and I can see why it's important to get external-lb working ;)00:35
*** achanda_ has joined #openstack-containers00:35
Tango|2gus: Yep, we can't go to production without this00:35
Tango|2gus: and we are trying to be somewhat production ready in Liberty00:36
openstackgerritBradley Jones proposed openstack/magnum-ui: Initial skeleton repo  https://review.openstack.org/21175000:36
*** manjeets has quit IRC00:36
gusTango|2: and do you need any fixes to be in a k8s release, or can you build+deploy a k8s from git?00:36
*** achanda has quit IRC00:38
*** Drago has quit IRC00:39
Tango|2gus: We would pick up any k8s release that's required.  With the way we currently build our image, we have to pick up an actual release from k8s00:39
*** achanda_ has quit IRC00:39
gusTango|2: ack.00:39
Tango|2gus: I have built k8s from git before and copied over the binaries, but that would be for development only00:40
openstackgerritDaneyon Hansen proposed openstack/magnum: Magnum Container Networking Spec  https://review.openstack.org/20468600:51
*** david-lyle has joined #openstack-containers00:54
vilobhmmsdake : ping00:56
eghobogus: ping?00:58
guseghobo: ?00:58
eghobojust curious, do you know anything about Rackspace driver for kub?00:59
eghobohttps://github.com/GoogleCloudPlatform/kubernetes/pull/1190400:59
eghoboI couldn't figure out how to test/debug these drivers, any suggestions?01:00
*** harshs has joined #openstack-containers01:00
guseghobo: a bit, yes.  It was basically a cut+paste of my openstack driver from some time ago (unfortunately - I wrote the openstack driver originally with the intention of better code sharing with a future rackspace variant - and I haven't gone back to refactor it into that original vision)01:01
*** sthillma has quit IRC01:02
guseghobo: yeah, that doesn't seem right.  In what way does it fail with --cloud_provider=rackspace ?01:03
*** harshs_ has joined #openstack-containers01:03
eghobo'kube-apiserver.service: Main process exited, code=exited, status=2/INVALIDARGUMENT'01:04
gusthat's it, no additional logs or errors?01:04
eghobono01:05
gusbasically: removing that flag completely disables any cloud-provider logic - so k8s won't be able to create load-balancers, find nodes automatically, etc.01:05
*** harshs has quit IRC01:05
*** harshs_ is now known as harshs01:05
gusSo: if that makes the tests pass, then the tests aren't actually testing anything rackspace-specific ;)01:06
eghoboyes, I got it (I found driver later ;))01:07
*** gangil has quit IRC01:07
gusSo, without having investigated any further yet: I think that failure is uncovering a real problem - and removing the option is just papering over whatever the real problem is.01:07
*** eliqiao has quit IRC01:07
eghoboI agree, my problem was I was interested to investigate but don't know how01:08
gus(and we need more comprehensive testing in k8s for both openstack and rackspace drivers)01:08
eghobocould you point me to any test which I can use as example?01:09
openstackgerritBradley Jones proposed openstack/magnum-ui: Initial skeleton repo  https://review.openstack.org/21175001:10
guseghobo: ah. I'd start by finding the (stderr?) logs of the failing test job.01:10
guseghobo: or if it really does just exit immediately, then try to run kube-apiserver with that flag locally and just chase through where it goes wrong.01:11
*** yuanying-alt has joined #openstack-containers01:12
*** adrian_otto has joined #openstack-containers01:13
eghobook let me play with it ;)01:15
*** yuanying-alt has quit IRC01:16
*** zhenguo has joined #openstack-containers01:16
openstackgerritBradley Jones proposed openstack/magnum-ui: Initial skeleton repo  https://review.openstack.org/21175001:17
*** Marga__ has joined #openstack-containers01:19
*** Marga_ has quit IRC01:20
*** moravec has joined #openstack-containers01:20
*** wanghua has joined #openstack-containers01:20
*** agireud has joined #openstack-containers01:24
*** suro-patz has quit IRC01:26
sdakevilobhmm i'm alive01:26
*** humble_ has joined #openstack-containers01:26
*** wanghua has quit IRC01:29
vilobhmmsdake : is it still a good time to talk01:30
vilobhmmwill hardly take 5 min01:30
sdakewound me01:30
vilobhmmhttps://blueprints.launchpad.net/magnum/+spec/objects-from-bay01:30
vilobhmmright now [1] https://github.com/openstack/magnum/blob/stable/kilo/magnum/objects/pod.py01:30
vilobhmm[2] https://github.com/openstack/magnum/blob/stable/kilo/magnum/objects/replicationcontroller.py01:30
vilobhmm[3] https://github.com/openstack/magnum/blob/stable/kilo/magnum/objects/service.py01:30
vilobhmmobjects for pod, rc, service01:31
vilobhmmand we have similar for bay01:31
sdakeyes i am familiar with that code01:31
vilobhmmso what is expected is for native clients like k8s01:31
sdakebasically read operations need to happen via the rest endpoint01:31
vilobhmmwhats is the current state01:31
sdakewrite operations need to happen via the rest endpoint instead of the conductor01:31
sdakeread operations happen in the api service01:32
sdakethe read operation needs to be sent to ht econductor via rpc01:32
sdakei'd focus on read first, then write01:32
vilobhmmok01:32
*** erkules has joined #openstack-containers01:32
sdakethe read operation needs to be sent to the conductor via rpc01:32
sdakethe conductor has information about the endpoints and hsa a python native cient to access the ssytem with01:32
sdakeone requirement is it has to work whether the folks are using native clients or not01:33
sdakeso a mix of the two is expected01:33
sdakeit is necessary in some way to convert the k8s id into a uuid01:33
sdakethat will remain consistent for the run of the system01:34
vilobhmmconsider pod object to understand better, api->object pod-> db for native client does nativeclient->object pod->db ?01:34
sdakethe id of the bay/pod/rc01:34
sdakewe never hit the db in this new model01:34
sdakereads happen entirely from the rest endpoint01:34
sdakethe rest endpoint hsa a db in memory (etcd)01:35
*** erkules_ has quit IRC01:35
vilobhmmcan you point to some code for example ?01:35
sdakei had some no idea where it went01:35
vilobhmmok01:35
*** hongbin has joined #openstack-containers01:35
sdakei should have pushed up a review but never did01:35
sdakefail on my part01:35
sdakei was not very far along01:35
vilobhmmi thought one source of truth will be info stored in magnum db as table pod where as other will be stored in kubernates01:36
sdakei got as far as getting the reads into the conductor01:36
sdakenope, that is two sources of truth01:36
sdakeone source of truth = all stored in k8s db01:36
sdakeif we have to use the db to make it work i think that is ok01:36
sdakebut I wasn't sure if  this woudl be possible with native clients, since they dont store to the db01:37
sdakelets say python-magnumclient stores to the db via api->conductor01:37
vilobhmmok01:37
sdakethen native client reads from kubernetes01:37
sdakethat would work01:37
vilobhmmagreed01:38
sdakelets say natie-client stores to etcd via api->conductor->rest endpoint->k8s api handler01:38
sdakepython-magnumclient reads from where?  the mysql db?  There is nothing stored in it ;)01:38
*** tobe_ has joined #openstack-containers01:39
*** jruano has joined #openstack-containers01:40
sdakerather01:40
sdakenative client stores to etcd via native client->rest endpoint -> etcd01:40
vilobhmmhmmm….makes sense..but can't even the python magnum client via the magnum api talk -> conductor->rest-endpoint-k8s api handler or that is not architecturally possible ?01:40
sdakeyes that is exactly what needs to happen01:40
sdakethat is not what happens today01:40
sdakeatm reads happen as follows01:41
*** moravec has quit IRC01:41
sdakepython-magnumclient->rest api->mysql01:41
vilobhmmok01:41
sdakei think its a couple weeks of work if someone had complete 8 hours a day time to focus on it01:42
vilobhmmhow they should happen is python-magnumclient->rest api->conductor->rest-endpoint-k8s-api handler ?01:42
sdakemaybe less if familiar with architecture01:42
sdakeyup01:42
vilobhmmsure…seems feasible01:42
sdakeanother requirement is that data returned by magnum should be the same whether its created by native client or python-magnumclient01:43
vilobhmmbut in that case will we still need the pod, rc, service objects ?01:43
sdakefor native client?01:43
sdakenope01:43
vilobhmmor the respective tables associated with them01:43
vilobhmmmakes sense01:43
vilobhmmfor native client01:43
sdakei am not clear on this point but i dont think so01:43
sdakethe db tables have to go01:44
vilobhmmyup01:44
sdakefor native or python client01:44
vilobhmmagree01:44
vilobhmmso i think i am clear now01:44
vilobhmmi will just illustrate what needs to be done01:44
sdakeyou could do write first if you want too01:44
sdakejust dont do both at same time, think it will make it dramtically harder01:44
vilobhmmok01:44
sdakebut read more likely to be successful01:45
sdakewith write if you remove writes to db, where to python-magnumclient reads come from01:45
vilobhmm1. read path as of today is python-magnumclient->rest api->mysql should be python-magnumclient->rest api->conductor->rest-endpoint-k8s-api handler for both native and python clients01:45
sdakefor native client should be native client->rest-endpoint-k8s-api01:45
vilobhmmsure…my bad01:45
vilobhmm2. validate if #1 is achieved do we really need pod, service, rc objects and respective magnum db tables01:46
sdakewe need to prserve the api01:46
sdakethe main reason being people want to use heat with magnum01:46
vilobhmmwhat do you mean by preserve the api ?01:47
vilobhmmsure01:47
sdakepod api object needs to stay as ell as service/rc01:47
vilobhmmok01:47
*** harshs has quit IRC01:48
vilobhmmapi object can stay but the storage where they gets stored needs to be the same which happens to be done via k8s rest api ?01:48
vilobhmmsdake : ^^01:48
sdakeright01:48
vilobhmmrather than tight coupling with db01:48
vilobhmmgot it01:49
vilobhmmnow the next question is how do you know that the attirbutes of api obj are exactly similar to what is there is k8s ?01:49
vilobhmmhopefully they should be ....01:49
sdakewe pass a manifest01:50
vilobhmmok01:50
sdakeone reason this work was so hard in the past is the damn api to k8s kept changing01:50
vilobhmmalrite01:50
vilobhmmok01:50
sdakeand we had no python client in magnum as well01:50
vilobhmmok01:50
sdakeboth those problems are solved now01:50
vilobhmm:)01:50
vilobhmmi think i am clear with the problem and the approach to solve it01:51
vilobhmmthanks :)01:51
vilobhmmi will drop an email to the mailing list ; and will jot down the details as we discussed here01:51
vilobhmmso that everyeone is aware of the approach proposed01:52
vilobhmmand start work on implementing may be will start with read…will see01:52
*** erkules has quit IRC01:52
sdakethe real challenge is going to be to get the data to look the same coming out of python client when  created by native or python client01:52
vilobhmmsdake : does that sound fair to you ?01:52
sdakewfm make it happen i'll love you forever ;-)01:52
vilobhmm:)01:53
vilobhmmthank you again!01:53
vilobhmmsdake : ^^01:53
sdakeenjoy01:53
*** erkules has joined #openstack-containers01:54
*** alejandrito has quit IRC01:55
*** vilobhmm has quit IRC02:05
*** eliqiao has joined #openstack-containers02:11
*** y_sawai has joined #openstack-containers02:14
*** y_sawai has quit IRC02:14
*** wanghua has joined #openstack-containers02:20
*** humble_ has quit IRC02:21
*** mathspanda has joined #openstack-containers02:21
*** jwcroppe has joined #openstack-containers02:23
*** Marga__ has quit IRC02:30
*** Marga_ has joined #openstack-containers02:30
*** david-lyle has quit IRC02:33
*** jruano has quit IRC02:34
*** adrian_otto has quit IRC02:34
*** adrian_otto has joined #openstack-containers02:35
*** funzo has joined #openstack-containers02:36
*** funzo has quit IRC02:40
*** agireud has quit IRC02:42
*** Tennyson has joined #openstack-containers02:45
*** eghobo has quit IRC02:47
*** agireud has joined #openstack-containers03:00
*** yuanying-alt has joined #openstack-containers03:01
*** adrian_otto has quit IRC03:02
*** humble_ has joined #openstack-containers03:02
*** vilobhmm has joined #openstack-containers03:02
*** jruano has joined #openstack-containers03:03
*** vilobhmm1 has joined #openstack-containers03:04
*** yuanying-alt has quit IRC03:05
*** wanghua has quit IRC03:05
*** vilobhmm has quit IRC03:07
*** banix has quit IRC03:08
*** agireud has quit IRC03:10
*** jwcroppe has quit IRC03:15
*** tobe_ has quit IRC03:15
*** tobe_ has joined #openstack-containers03:16
*** fawadkhaliq has joined #openstack-containers03:22
*** humble__ has joined #openstack-containers03:24
*** vahidh has quit IRC03:25
*** vahidh has joined #openstack-containers03:26
*** achanda has joined #openstack-containers03:27
*** david-lyle has joined #openstack-containers03:30
*** sdake_ has joined #openstack-containers03:35
*** sdake has quit IRC03:39
*** sdake_ is now known as sdake03:46
*** hongbin has quit IRC03:49
*** yuanying-alt has joined #openstack-containers04:01
*** jruano has quit IRC04:03
*** vilobhmm has joined #openstack-containers04:03
*** vilobhmm1 has quit IRC04:03
*** yuanying-alt has quit IRC04:06
*** manjeets has joined #openstack-containers04:06
*** funzo has joined #openstack-containers04:06
*** unicell has joined #openstack-containers04:06
manjeetsi added unit tests and when i run tox it says py27 commands failed04:09
manjeetsany suggestion04:09
*** funzo has quit IRC04:11
manjeetsis there any to way log tox output ?04:24
yuanyingtox only said "py27 commands failed"?04:24
*** madhuri has joined #openstack-containers04:34
*** sthillma has joined #openstack-containers04:36
madhurisdake: ping04:36
sdakemadhuri shoot04:36
madhuriWant to discuss TLS?04:37
sdakedo you need to discuss something with me?04:37
madhuriAhh now I am implementing Barbican support to store certs in it04:39
madhurisdake: But may be you can advise on this patch https://review.openstack.org/#/c/207324/04:39
*** sthillma_ has joined #openstack-containers04:39
sdakeyou crit me with a wall of text on that patch review04:40
sdake10pm need to sleep04:40
sdakedidn't look at code in question but we don't want temp files for storing certs if at all possible to avoid04:41
sdakehttps://review.openstack.org/#/c/211817/104:42
madhuriOk then we can discuss tomorrow04:42
sdakewoops wrong link04:42
*** sthillma has quit IRC04:42
*** sthillma_ is now known as sthillma04:42
sdakehttp://paste.openstack.org/raw/412638/04:42
sdakecheck that out madhuri04:42
sdakethe part that is interesting is down at the bottom04:42
madhuriSorry but I didn't get it04:44
madhurisdake: Andrew wants to discuss something?04:45
sdakeroger he does04:45
sdakemadhuri my 3 children (magnum heat kolla) are  all diverse ;-)04:45
madhuri:) cool04:46
madhuriOk I will ping him04:46
madhuriapmelton: Hi04:47
*** tobe_ has quit IRC04:53
yuanyingI also want to discuss about it04:54
*** eghobo has joined #openstack-containers05:00
*** tobe_ has joined #openstack-containers05:04
*** sthillma has quit IRC05:12
*** yuanying-alt has joined #openstack-containers05:17
sdakeapmelton is east coast iirc probaby asleep05:18
*** kmARC has joined #openstack-containers05:20
*** kmARC has quit IRC05:21
*** adrian_otto has joined #openstack-containers05:22
*** kmARC has joined #openstack-containers05:22
*** yuanying-alt has quit IRC05:23
*** adrian_otto has quit IRC05:26
*** vilobhmm has quit IRC05:32
*** fawadkhaliq has quit IRC05:38
*** eghobo_ has joined #openstack-containers05:42
*** eghobo has quit IRC05:45
*** humble__ has quit IRC05:48
*** diga_ has joined #openstack-containers05:50
*** madhuri has quit IRC05:52
*** shunliz_ has joined #openstack-containers05:52
*** eghobo has joined #openstack-containers05:53
*** eghobo_ has quit IRC05:54
*** madhuri has joined #openstack-containers05:54
*** fawadkhaliq has joined #openstack-containers05:59
*** zhenguo has quit IRC06:13
*** irenab has quit IRC06:14
*** yuanying-alt has joined #openstack-containers06:19
*** suro-patz has joined #openstack-containers06:19
*** yuanying-alt has quit IRC06:23
*** chandankumar has joined #openstack-containers06:23
*** suro-patz has quit IRC06:24
*** zz_dimtruck is now known as dimtruck06:26
*** unicell1 has joined #openstack-containers06:28
*** unicell has quit IRC06:28
*** suro-patz has joined #openstack-containers06:29
*** sdake_ has joined #openstack-containers06:35
*** sdake has quit IRC06:39
*** irenab has joined #openstack-containers06:43
*** suro-patz has quit IRC06:54
*** fangfenghua has joined #openstack-containers07:00
*** alex_klimov has joined #openstack-containers07:03
*** alex_klimov has quit IRC07:03
*** alex_klimov has joined #openstack-containers07:04
*** humble__ has joined #openstack-containers07:04
*** xek has quit IRC07:04
*** xek has joined #openstack-containers07:05
*** humble_ has quit IRC07:08
*** diga_ has quit IRC07:09
*** BhavyaM has joined #openstack-containers07:11
*** fawadkhaliq has quit IRC07:12
*** fawadk has joined #openstack-containers07:13
*** ig0r_ has joined #openstack-containers07:15
*** ishant has joined #openstack-containers07:16
*** eghobo has quit IRC07:18
*** achanda has quit IRC07:31
*** Marga__ has joined #openstack-containers07:33
*** liudong has joined #openstack-containers07:34
*** achanda has joined #openstack-containers07:36
*** zhenguo has joined #openstack-containers07:36
*** Marga_ has quit IRC07:37
*** ig0r__ has joined #openstack-containers07:39
*** ig0r_ has quit IRC07:41
*** tobe_ has quit IRC07:44
*** achanda has quit IRC07:46
*** dimtruck is now known as zz_dimtruck07:50
*** tobe_ has joined #openstack-containers07:50
openstackgerritMerged openstack/python-magnumclient: Updated from global requirements  https://review.openstack.org/21092407:58
*** tobe_ has quit IRC08:00
*** sdake_ has quit IRC08:04
*** tobe_ has joined #openstack-containers08:05
*** yuanying-alt has joined #openstack-containers08:07
*** yuanying-alt has quit IRC08:12
*** ig0r__ has quit IRC08:13
*** diga_ has joined #openstack-containers08:14
*** ig0r_ has joined #openstack-containers08:17
*** Marga__ has quit IRC08:17
*** Marga_ has joined #openstack-containers08:18
*** ig0r_ has quit IRC08:19
*** manjeets has quit IRC08:23
*** humble_ has joined #openstack-containers08:26
*** humble__ has quit IRC08:27
*** humble_ has quit IRC08:31
*** humble_ has joined #openstack-containers08:31
Kennan2ping yuanying:08:31
yuanyinghi08:31
Kennan2for this https://review.openstack.org/#/c/205431/  I am ok with that, but I did not if ok to integrate to code now08:32
*** humble_ has quit IRC08:32
Kennan2do you know who is TLS owner (expert) Sdake ?08:32
*** humble_ has joined #openstack-containers08:33
yuanyingexpert?08:33
Kennan2I checked you mail in magnum08:34
Kennan2asked about related implementaion for libiary08:34
Kennan2does it impact this one ?08:34
yuanyingNo08:34
yuanyingOnly about anchor08:35
yuanyingBarbican is necessary08:35
Kennan2I think this one just add barbican client options, it is OK08:35
yuanyingSo, This patch is needed for us08:35
Kennan2BTW, I checked your design guide, it also have another implementions option08:36
Kennan2not use barbican08:36
Kennan2is it in this liberty ?08:36
yuanyingActually, tls support has two part, one is for key storage, other is CA08:36
yuanyingbarbican is only implementation about key storage part (if we don't use db to store key)08:37
yuanyingAnchor is needed for CA, and barbican also support CA08:38
Kennan2ok. yuanying:08:47
Kennan2more clear now08:47
*** ddepaoli has joined #openstack-containers08:47
openstackgerritMerged openstack/magnum: Add barbicanclient support in Magnum.  https://review.openstack.org/20543109:03
*** apuimedo has joined #openstack-containers09:06
*** kmARC has quit IRC09:28
*** Tennyson has quit IRC09:32
*** ishant_ has joined #openstack-containers09:34
*** ishant has quit IRC09:36
*** fangfenghua has quit IRC09:41
*** Kennan2 is now known as Kennan09:42
*** mathspanda has quit IRC09:46
Kennanit seems some of our patched failed for jenkins issue09:49
KennanNoValidHost: No valid host was found. There are not enough hosts available.09:49
tcammannYeah its happenining a lot Kennan :(09:49
KennanI asked it in infra irc, but not get response now09:49
*** jwcroppe has joined #openstack-containers09:49
tcammannMight need to bump memory on that system, couldn't get the root cause of it yet09:49
Kennanyes, it seems nova related issue, maybe infra run out of resouce09:50
*** Marga__ has joined #openstack-containers09:50
tcammannAha! 2015-08-12 09:12:00.301 INFO nova.filters [req-201acad1-d2b3-4adc-aa0a-ae6237d7d743 admin admin] Filter DiskFilter returned 0 hosts09:51
tcammannran out of disk space and failed in that filter it seems09:52
*** Marga_ has quit IRC09:52
tcammannThis is from the nova scheduler log FYI09:52
Kennanok, I checked nova condutor logs, not check that. :)09:53
*** erkules has quit IRC09:54
*** erkules has joined #openstack-containers09:54
*** yuanying-alt has joined #openstack-containers09:56
*** yuanying-alt has quit IRC10:01
*** ig0r_ has joined #openstack-containers10:10
*** kmARC has joined #openstack-containers10:13
*** diga_ has quit IRC10:19
*** jkraj has joined #openstack-containers10:19
*** fangfenghua has joined #openstack-containers10:22
*** yuanying has quit IRC10:30
*** yuanying has joined #openstack-containers10:30
*** jwcroppe has quit IRC10:35
*** jwcroppe has joined #openstack-containers10:36
*** jwcroppe has quit IRC10:40
*** fawadk has quit IRC10:41
*** ig0r_ has quit IRC10:46
*** humble_ has quit IRC10:52
*** ishant_ has quit IRC10:54
*** ishant has joined #openstack-containers10:56
*** ishant has quit IRC10:56
*** tobe_ has quit IRC11:03
*** zhenguo has quit IRC11:03
*** tobe_ has joined #openstack-containers11:04
*** tobe_ has quit IRC11:09
ddepaolihi all!11:09
ddepaoliDoes anyone ever install magnum on an environment different from devstack?11:10
ddepaoliI'm using juno installed with mirantis fuel 6.111:12
*** juggler has quit IRC11:13
*** BhavyaM has quit IRC11:18
*** fangfenghua has quit IRC11:20
*** madhuri has quit IRC11:26
*** tobe_ has joined #openstack-containers11:33
*** julim has joined #openstack-containers11:38
*** tobe_ has quit IRC11:39
*** Marga__ has quit IRC11:40
*** Marga_ has joined #openstack-containers11:41
*** yuanying-alt has joined #openstack-containers11:45
*** yuanying-alt has quit IRC11:49
tcammannddepaoli: it should be possible12:06
tcammannCan use this guide to help https://github.com/openstack/magnum/blob/master/doc/source/dev/dev-manual-devstack.rst12:07
tcammannKennan: did you get anywhere with fixing the functional tests?12:08
ddepaoliok thanks tcammann12:08
*** dave-mccowan has quit IRC12:12
*** shunliz_ has quit IRC12:15
*** funzo has joined #openstack-containers12:22
*** funzo has quit IRC12:27
*** jruano has joined #openstack-containers12:38
*** yuanying-alt has joined #openstack-containers12:46
*** jjlehr has joined #openstack-containers12:51
*** yuanying-alt has quit IRC12:53
*** irenab has quit IRC12:53
*** zz_dimtruck is now known as dimtruck12:55
*** mathspanda has joined #openstack-containers13:05
*** jwcroppe has joined #openstack-containers13:10
*** apuimedo has quit IRC13:16
*** jjlehr has quit IRC13:16
*** irenab has joined #openstack-containers13:21
*** jwcroppe has quit IRC13:23
*** jwcroppe has joined #openstack-containers13:23
*** jwcroppe has quit IRC13:27
*** funzo has joined #openstack-containers13:38
*** ctrath has joined #openstack-containers13:40
*** funzo has quit IRC13:43
*** dane_leblanc has joined #openstack-containers13:43
*** pradk has joined #openstack-containers13:44
*** pradk has quit IRC13:44
*** jjlehr has joined #openstack-containers13:51
*** ctrath has quit IRC13:58
openstackgerritBradley Jones proposed openstack/magnum-ui: Add Bay Model Table View  https://review.openstack.org/21203914:00
*** sdake_ has joined #openstack-containers14:00
*** dave-mccowan has joined #openstack-containers14:01
*** absubram has joined #openstack-containers14:04
*** muralia has joined #openstack-containers14:04
*** muralia has quit IRC14:16
*** muralia has joined #openstack-containers14:16
*** jruano has quit IRC14:17
*** banix has joined #openstack-containers14:17
*** mathspanda has quit IRC14:21
*** wznoinsk has joined #openstack-containers14:22
*** jjfreric has joined #openstack-containers14:31
*** jjfreric has left #openstack-containers14:31
*** jjfreric has joined #openstack-containers14:38
*** banix has quit IRC14:39
*** jjfreric has left #openstack-containers14:42
*** jjfreric_ has joined #openstack-containers14:43
*** EricGonczer_ has joined #openstack-containers14:46
*** adrian_otto has joined #openstack-containers14:47
*** vilobhmm has joined #openstack-containers14:54
*** chandankumar has left #openstack-containers14:58
*** adrian_otto has quit IRC15:00
*** banix has joined #openstack-containers15:03
*** gus has quit IRC15:06
*** gus has joined #openstack-containers15:08
*** funzo has joined #openstack-containers15:09
*** dave-mccowan has quit IRC15:09
*** ctrath has joined #openstack-containers15:09
*** jjfreric_ has quit IRC15:10
*** funzo has quit IRC15:13
*** jjfreric has joined #openstack-containers15:17
*** vilobhmm has quit IRC15:23
*** ddepaoli has quit IRC15:23
*** jjfreric has quit IRC15:25
*** BertrandN has joined #openstack-containers15:26
*** Drago has joined #openstack-containers15:30
*** Drago has quit IRC15:31
*** Drago has joined #openstack-containers15:31
*** suro-patz has joined #openstack-containers15:34
*** suro-patz1 has joined #openstack-containers15:36
*** zhenguo has joined #openstack-containers15:36
*** suro-patz has quit IRC15:38
*** agireud has joined #openstack-containers15:38
*** zhenguo has quit IRC15:42
*** banix has quit IRC15:48
*** suro-patz1 has quit IRC15:50
*** suro-patz has joined #openstack-containers15:51
*** hongbin has joined #openstack-containers15:54
*** jjfreric has joined #openstack-containers15:54
*** jjlehr has quit IRC15:54
*** suro-patz has quit IRC15:55
*** suro-patz has joined #openstack-containers15:55
*** jjfreric1 has joined #openstack-containers15:57
*** suro-patz has quit IRC15:59
*** jjfreric has quit IRC16:00
*** vilobhmm has joined #openstack-containers16:01
*** jjfreric has joined #openstack-containers16:02
*** funzo has joined #openstack-containers16:09
*** sankarshan is now known as sankarshan_away16:11
*** jkraj has quit IRC16:11
*** alex_klimov has quit IRC16:11
*** sdake_ is now known as sdake16:13
*** eghobo has joined #openstack-containers16:13
*** funzo has quit IRC16:14
*** jjfreric has quit IRC16:20
*** jjfreric has joined #openstack-containers16:21
*** jjfreric has quit IRC16:23
*** jjfreric has joined #openstack-containers16:23
*** unicell1 has quit IRC16:25
*** Marga_ has quit IRC16:30
*** Marga_ has joined #openstack-containers16:31
*** sthillma has joined #openstack-containers16:34
vilobhmmsdake : ping16:36
sdakeshoot16:36
vilobhmmI didn't get the etcd part we discussed yest16:36
sdakeya I gotta jet for a eye appointment16:37
sdakei hsould be back in 1-2 hours16:37
vilobhmmok16:37
*** dave-mccowan has joined #openstack-containers16:37
vilobhmmlater16:37
*** diga_ has joined #openstack-containers16:40
*** pradk has joined #openstack-containers16:42
*** Marga_ has quit IRC16:42
*** Marga_ has joined #openstack-containers16:43
*** kmARC has quit IRC16:44
*** diga_ has quit IRC16:46
*** EricGonc_ has joined #openstack-containers16:47
*** unicell has joined #openstack-containers16:48
*** EricGonczer_ has quit IRC16:50
*** sankarshan_away is now known as sankarshan16:50
*** suro-patz has joined #openstack-containers16:54
*** sthillma has quit IRC16:58
*** mfalatic has quit IRC16:58
*** mfalatic has joined #openstack-containers16:59
*** sthillma has joined #openstack-containers16:59
*** eliqiao has quit IRC17:00
*** mfalatic has quit IRC17:02
*** mfalatic has joined #openstack-containers17:03
*** eliqiao has joined #openstack-containers17:03
*** dane_leblanc_ has joined #openstack-containers17:05
*** suro-patz has quit IRC17:05
*** dane_leblanc has quit IRC17:07
*** xek has quit IRC17:08
*** jjlehr has joined #openstack-containers17:11
*** Marga_ has quit IRC17:12
*** suro-patz has joined #openstack-containers17:13
*** achanda has joined #openstack-containers17:13
*** xek has joined #openstack-containers17:13
*** chandankumar has joined #openstack-containers17:16
*** belmoreira has joined #openstack-containers17:19
*** belmoreira has quit IRC17:21
*** dave-mcc_ has joined #openstack-containers17:28
*** dane_leblanc__ has joined #openstack-containers17:28
*** adrian_otto has joined #openstack-containers17:30
*** dane_leblanc_ has quit IRC17:30
*** jwcroppe has joined #openstack-containers17:30
*** unicell has left #openstack-containers17:31
*** dave-mccowan has quit IRC17:31
*** rpothier has joined #openstack-containers17:32
*** banix has joined #openstack-containers17:34
*** kmARC has joined #openstack-containers17:34
*** dane_leblanc__ has quit IRC17:36
*** rpothier has quit IRC17:36
*** dane_leblanc__ has joined #openstack-containers17:37
*** dflorea has joined #openstack-containers17:37
*** dave-mccowan has joined #openstack-containers17:38
*** dave-mcc_ has quit IRC17:40
*** rpothier has joined #openstack-containers17:41
*** harshs has joined #openstack-containers17:46
*** jjlehr has quit IRC17:46
*** absubram has quit IRC17:55
*** absubram has joined #openstack-containers17:57
*** Marga_ has joined #openstack-containers18:01
*** banix has quit IRC18:01
*** dflorea has quit IRC18:06
*** dflorea has joined #openstack-containers18:07
*** banix has joined #openstack-containers18:22
*** eghobo_ has joined #openstack-containers18:27
*** eghobo has quit IRC18:29
*** absubram has quit IRC18:35
*** absubram has joined #openstack-containers18:38
*** kmARC has quit IRC18:42
apmeltontcammann: ping18:43
*** EricGonc_ has quit IRC18:48
*** absubram has quit IRC18:48
*** EricGonczer_ has joined #openstack-containers18:51
*** absubram has joined #openstack-containers18:54
*** sthillma has quit IRC19:02
*** dflorea has quit IRC19:03
*** dflorea has joined #openstack-containers19:04
*** dflorea has quit IRC19:08
*** dflorea has joined #openstack-containers19:08
*** dflorea has quit IRC19:10
*** funzo has joined #openstack-containers19:25
*** funzo has quit IRC19:30
*** chandankumar has quit IRC19:36
*** kmARC has joined #openstack-containers19:39
*** EricGonc_ has joined #openstack-containers19:45
*** EricGonczer_ has quit IRC19:49
*** dflorea has joined #openstack-containers19:59
*** kmARC has quit IRC20:01
*** achanda has quit IRC20:15
*** jruano has joined #openstack-containers20:28
*** apuimedo has joined #openstack-containers20:30
*** jjfreric has quit IRC20:30
*** Marga_ has quit IRC20:39
*** Marga_ has joined #openstack-containers20:39
*** dflorea has quit IRC20:41
*** sthillma has joined #openstack-containers20:41
*** navneet has joined #openstack-containers20:56
*** dflorea has joined #openstack-containers20:58
*** jjfreric has joined #openstack-containers20:58
*** jruano has quit IRC21:00
*** achanda has joined #openstack-containers21:01
*** navneet has quit IRC21:03
*** jjfreric has quit IRC21:06
*** alex_klimov has joined #openstack-containers21:11
*** adrian_otto has quit IRC21:15
*** zul has quit IRC21:21
*** jjlehr has joined #openstack-containers21:25
*** rpothier has quit IRC21:25
*** dflorea has quit IRC21:33
*** dflorea has joined #openstack-containers21:34
*** zul has joined #openstack-containers21:35
*** gangil has joined #openstack-containers21:35
*** adrian_otto has joined #openstack-containers21:37
*** muralia has quit IRC21:37
*** muralia has joined #openstack-containers21:38
*** dflorea has quit IRC21:39
*** eghobo_ has quit IRC21:39
*** funzo has joined #openstack-containers21:41
vilobhmmsdake : ping21:43
*** fawadkhaliq has joined #openstack-containers21:43
*** eghobo has joined #openstack-containers21:45
*** funzo has quit IRC21:45
*** fawadkhaliq has quit IRC21:50
*** ctrath has quit IRC21:50
sdakeshoot vilobhmm21:54
*** jjfreric1 has quit IRC21:55
vilobhmmtrying to understand better lets start with simple case of rc_show21:57
vilobhmmhttps://github.com/openstack/magnum/blob/master/magnum/conductor/api.py#L11621:57
vilobhmmit doesn't have any implementation in https://github.com/openstack/magnum/blob/master/magnum/conductor/handlers/k8s_conductor.py21:57
*** agireud has quit IRC21:57
vilobhmmsince the request gets satisfied from db21:58
vilobhmmwhich is righ21:58
vilobhmmmagnumclient->restapi->db21:58
vilobhmmnow for the way we want it "python-magnum client->rest api->conductor->rest-endpoint-k8s-api handler "21:58
*** jjlehr has quit IRC21:59
*** dflorea has joined #openstack-containers21:59
vilobhmmthere will be a need not to fetch details using https://github.com/openstack/magnum/blob/master/magnum/conductor/api.py#L116 but use rest-endpoint-k8s-api handler 21:59
vilobhmmat present there seems to be none of the api's exposed at https://github.com/openstack/magnum/blob/master/magnum/conductor/handlers/k8s_conductor.py which can be used…something like as its done here https://github.com/openstack/magnum/blob/master/magnum/conductor/handlers/k8s_conductor.py#L14922:01
vilobhmmsdake  : so the question is will need to introduce new api's from k8s to serve our purpose ?22:02
vilobhmmand if so I could not get a valid k8s api reference manual used by magnum22:02
vilobhmmsdake : ^^22:08
openstackgerritMerged openstack/magnum: Add a new field 'master_count' to bay in API  https://review.openstack.org/20724622:09
*** pradk has quit IRC22:18
openstackgerritMerged openstack/magnum: Make simultaneous bay deletion workable  https://review.openstack.org/21095722:22
*** dflorea has quit IRC22:26
*** achanda has quit IRC22:40
sdakevilobhmm sorry got distracted22:41
sdakeso we may or may not end up needing a way to obtain a certificate so the k8s endpoint can be communicated with22:41
sdakethat could be api or via a show operation22:42
sdakei have preference to show persoanlly22:42
sdakelet me look at the source links you provided - 5 minutes22:42
*** devlaps has joined #openstack-containers22:44
vilobhmmsdake : np22:45
*** dane_leblanc__ has quit IRC22:45
sdakevilobhmm if I read your quetion properly what you are basically saying is you need to get UUID from the k8s rest api endpoint22:47
vilobhmmsdake : yes22:47
sdakeI think instead of  getting it (because it provides no such thing) you should generat it22:47
vilobhmmok22:47
sdakebut it does provide some kind of unique id22:47
sdakeI forget exactly what it is22:47
sdakeif you login to the machine you can run kubectl get services22:48
sdakeand see the unique ids it comes up with i htink22:48
vilobhmmok22:48
sdakenow, createreplicationctonroller, totally correct the objects it creates are not documented22:48
sdakethat is because the source is autogenerated using swagger (GROAN)22:48
vilobhmmok22:48
sdakeyou can look at the swagger objects to see what k8s exports22:48
vilobhmmthe point i am coming to22:49
vilobhmmhttps://github.com/openstack/magnum/blob/master/magnum/conductor/api.py#L11622:49
sdakepossibly https://review.openstack.org/#/c/212194/1/jenkins/jobs/projects.yaml22:50
vilobhmmreplace objects.ReplicationController.get_by_uuid(context, uuid) with the respective rest call in k8s which can be part of this module https://github.com/openstack/magnum/blob/master/magnum/common/pythonk8sclient/client/ApivbetaApi.py22:50
sdakerather possibly https://github.com/openstack/magnum/blob/master/magnum/common/pythonk8sclient/client/models/V1beta3_Pod.py#L4322:50
vilobhmmneed not be objects.ReplicationController.get_by_uuid(context, uuid)  specifically but an example since it is getting details from db22:50
sdakeyup but whatever the generation name is or whatever is unique in kubernetes (not sure on the unique id) needs to be used to create a consistent UUID22:51
vilobhmmdoes that make sense sdake ? Is the approach proper ^^22:51
sdakeis which approach proper?  the one you and I just came up with?22:51
sdakeif yes, then yes22:52
vilobhmmin short replace object->db interaction with object->conductor/handlers/k8s_conductor.py->magnum/common/pythonk8sclient/client/ApivbetaApi.py22:53
*** dimtruck is now known as zz_dimtruck22:53
vilobhmmobject->k8s restapi22:53
vilobhmmyou approach seems ok to me22:54
vilobhmmi would think more on it22:54
vilobhmmsdake : swagger seems to be useful thanks22:56
*** dflorea has joined #openstack-containers22:56
sdakeright22:57
sdakethat is the only way this can be done imo :)22:58
sdakeit will slow things down a bit I think22:58
sdakebut really creation and deletion of containers is not a super time sensitive operation22:58
vilobhmmok cool22:58
vilobhmmwill submit something atleast one of the api changes for read path and we can see how it goes…22:59
vilobhmmthanks sdake22:59
*** hongbin has quit IRC23:07
*** EricGonczer_ has joined #openstack-containers23:07
*** EricGonc_ has quit IRC23:11
*** alex_klimov has quit IRC23:11
*** achanda has joined #openstack-containers23:16
*** gangil has quit IRC23:17
*** zul has quit IRC23:17
*** agireud has joined #openstack-containers23:17
*** banix has quit IRC23:36
*** adrian_otto has quit IRC23:45
*** hongbin has joined #openstack-containers23:47
*** Drago has quit IRC23:50
*** zz_dimtruck is now known as dimtruck23:50
*** Marga_ has quit IRC23:52
Kennantcammann: it passed now strange for jenkins23:52
*** dflorea has quit IRC23:54
*** achanda has quit IRC23:59

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!