Wednesday, 2015-09-23

*** vilobhmm111 has quit IRC00:00
*** devkulkarni has quit IRC00:04
*** jerrygb_ has joined #openstack-containers00:05
*** jerrygb_ has quit IRC00:08
*** eghobo has joined #openstack-containers00:08
*** jerrygb has quit IRC00:09
*** Tango has quit IRC00:13
*** rebase33 has joined #openstack-containers00:16
*** Guest18166 is now known as dims_00:17
*** rebase33 has quit IRC00:17
*** suro-patz has quit IRC00:20
*** ganeshna has quit IRC00:21
*** ganeshna has joined #openstack-containers00:21
*** devkulkarni has joined #openstack-containers00:27
*** dimtruck is now known as zz_dimtruck00:28
openstackgerritEli Qiao proposed openstack/magnum: Fix container action debug log not accurate  https://review.openstack.org/22619400:29
openstackgerritEli Qiao proposed openstack/magnum: Functional: Split python client functional testing case  https://review.openstack.org/22390700:33
openstackgerritEli Qiao proposed openstack/magnum: Add functional test cases(containers actions) for swarm  https://review.openstack.org/22612500:33
openstackgerritEli Qiao proposed openstack/magnum: Add functional test cases for swarm  https://review.openstack.org/22163300:33
*** julim has quit IRC00:39
*** mfalatic has quit IRC00:40
*** achanda has quit IRC00:41
*** devkulkarni has quit IRC00:46
*** vilobhmm11 has joined #openstack-containers00:47
*** suro-patz has joined #openstack-containers00:48
*** suro-patz1 has joined #openstack-containers00:49
*** suro-patz has quit IRC00:52
*** sthillma has quit IRC00:53
*** suro-patz1 has quit IRC01:03
*** banix has quit IRC01:09
*** banix has joined #openstack-containers01:10
*** zz_dimtruck is now known as dimtruck01:10
*** achanda has joined #openstack-containers01:11
*** puranamr has joined #openstack-containers01:15
*** suro-patz has joined #openstack-containers01:25
*** hongbin has joined #openstack-containers01:29
*** ganeshna has quit IRC01:36
*** suro-patz has quit IRC01:38
*** ganeshna has joined #openstack-containers01:39
*** shuquan has joined #openstack-containers01:39
*** puranamr has quit IRC01:40
*** jerrygb has joined #openstack-containers01:44
*** jerrygb has quit IRC01:45
*** jerrygb has joined #openstack-containers01:45
*** harshs has quit IRC01:53
*** shuquan has quit IRC01:54
*** kebray has joined #openstack-containers01:56
*** shuquan has joined #openstack-containers01:56
*** shuquan has quit IRC01:57
*** dims_ has quit IRC01:57
*** erkules_ has joined #openstack-containers01:57
*** dims_ has joined #openstack-containers01:57
*** shuquan has joined #openstack-containers01:58
*** erkules has quit IRC01:59
*** banix has quit IRC02:09
*** dims_ has quit IRC02:10
*** dims_ has joined #openstack-containers02:13
*** dims__ has joined #openstack-containers02:18
*** dims_ has quit IRC02:18
*** dims__ has quit IRC02:23
*** eghobo has quit IRC02:24
*** unicell has quit IRC02:33
*** madhuri has joined #openstack-containers02:37
*** ganeshna has quit IRC02:37
*** ganeshna has joined #openstack-containers02:40
madhurihongbin: Hi02:48
madhurihongbin: http://paste.openstack.org/show/473668/02:48
eliqiaohi, seems gate's broken02:48
eliqiaomadhuri: does port 8080 open?02:49
madhurieliqiao: It should be open02:50
madhuriLet me check02:50
*** harshs has joined #openstack-containers02:51
madhurieliqiao: Not opened02:54
madhuriBut I guess we don't have to manually add it02:54
eliqiaoya.02:54
madhuriDo you face the same issue on master?02:55
madhuriI will add a rule for it and then check02:55
eliqiao madhuri: I don't try kube yet.02:55
madhuriOk I will try opening the port02:55
eliqiaocurrently, gate's broken, devstack can not be installed.02:55
eliqiaoI see this error http://logs.openstack.org/94/226194/2/check/gate-functional-dsvm-magnum/7c5e4f7/logs/devstacklog.txt.gz#_2015-09-23_01_37_17_42602:56
eliqiaocreate_barbican_accounts was called 2 times...02:59
hongbinmadhuri: yo03:00
madhurihongbin: Hi03:00
madhuriPlease check the paster URL above03:00
madhurieliqiao: hongbin 8080 is open in the secgroup-rules03:01
madhuriBut actually seems close03:01
hongbinYou are using master?03:01
hongbinand could you confirm the image you are using (it should be *-5)03:02
madhuriYes I am using master03:02
madhurifedora-atomic-503:03
hongbinIt looks the kube-apiserver is not running03:03
hongbindoes the etcd running?03:03
madhuri hongbin No it is not running03:05
hongbinCould you paste two things03:05
hongbin1. The etcd log03:05
madhuriYes sure03:05
hongbin2. the etcd config file03:05
madhuri2. http://paste.openstack.org/show/473669/03:07
madhuriI can't find the etcd logs03:08
hongbinsudo journalctl -u etcd --no-pager03:09
hongbin(If I type everything correct )03:09
*** shuquan has quit IRC03:10
*** shuquan has joined #openstack-containers03:11
madhurihongbin: -- Logs begin at Tue 2015-09-22 17:22:16 UTC, end at Tue 2015-09-22 19:30:54 UTC. --03:12
madhuriNo logs I guess03:12
hongbin......03:12
hongbinhow about restart the etcd03:12
*** david-lyle has joined #openstack-containers03:13
madhurihongbin: even after starting etcd, kubectl fails03:16
hongbinbut etcd succeed?03:16
madhuriYes03:18
hongbinany luck by reboot the vm03:18
madhuriLet me try03:19
madhuriHave you tested fedora-atomic-5?03:19
hongbinYes I do03:19
hongbinSo as the gate03:20
eliqiaohongbin: I checked gate, and found barbican plugin were called 2 times03:20
hongbineliqiao: not sure about that03:21
eliqiao#link http://logs.openstack.org/94/226194/2/check/gate-functional-dsvm-magnum/7c5e4f7/logs/devstacklog.txt.gz#_2015-09-23_01_23_45_34203:21
eliqiaoand it cause devstak failed to setup openstack.03:21
hongbinyuanying: do you have any idea for the two barbican, check eliqiao's link03:21
eliqiaoyuanying: it leads this error http://logs.openstack.org/94/226194/2/check/gate-functional-dsvm-magnum/7c5e4f7/logs/devstacklog.txt.gz#_2015-09-23_01_37_17_42603:22
hongbinmadhuri: I expect all the processes go back after rebooting, does it?03:23
madhurihongbin: after restarting, still etcd was not running03:23
hongbinso strange03:23
madhuriI manually rebooted it and then the same error03:23
hongbinbut restart the etcd will bring it back?03:24
hongbinstrange03:24
madhuriDoes it work well with flannel network-driver?03:24
hongbinNot sure for the flannel staffs03:24
openstackgerritVilobh Meshram proposed openstack/magnum: Objects from Bay : Retrieve k8s API client  https://review.openstack.org/22034403:25
madhuriI restarted the etcd but no luck03:25
*** devkulkarni has joined #openstack-containers03:25
*** shuquan has quit IRC03:25
hongbinmadhuri: sudo systemctl status etcd03:26
hongbinwhat is the status before and after restart03:26
openstackgerritVilobh Meshram proposed openstack/magnum: WIP : Objects from Bay - Replication Controller  https://review.openstack.org/21336803:27
openstackgerritVilobh Meshram proposed openstack/magnum: Objects from Bay : Retrieve k8s API client  https://review.openstack.org/22034403:27
*** shuquan has joined #openstack-containers03:28
madhurihongbin: it failed to start03:28
madhurihttp://paste.openstack.org/show/473682/03:28
hongbindo your vm have external internet access?03:29
hongbinthe log indicates it cannot connect to public discovery service03:30
madhuriOk this is proxy issue03:30
madhuriLet me check03:30
*** fawadkhaliq has joined #openstack-containers03:32
*** dimtruck is now known as zz_dimtruck03:32
hongbinmadhuri: have to leave now03:36
madhurihongbin: Sure. Thank you03:37
madhurihongbin: Good night03:37
hongbinmadhuri: seems you find the root cause, it should be solved soon03:37
hongbinmadhuri: thx.  see you later03:37
*** hongbin has quit IRC03:38
*** devkulkarni has quit IRC03:44
*** shuquan has quit IRC03:45
*** Marga__ has quit IRC03:46
*** Marga_ has joined #openstack-containers03:46
*** dims_ has joined #openstack-containers03:47
*** tbh has joined #openstack-containers03:47
*** kebray has quit IRC03:49
*** Marga_ has quit IRC03:50
*** devkulkarni has joined #openstack-containers03:52
*** shuquan has joined #openstack-containers03:53
*** dims_ has quit IRC03:54
*** jerrygb has quit IRC03:56
*** shuquan has quit IRC03:58
*** Marga_ has joined #openstack-containers04:02
*** eghobo has joined #openstack-containers04:05
*** jwcroppe has joined #openstack-containers04:14
*** achanda has quit IRC04:17
*** Tango has joined #openstack-containers04:21
*** harshs has quit IRC04:26
*** fawadk has joined #openstack-containers04:33
*** fawadkhaliq has quit IRC04:35
*** Marga_ has quit IRC04:36
*** Marga_ has joined #openstack-containers04:37
*** deepthi has joined #openstack-containers04:40
*** Tango|2 has joined #openstack-containers04:46
*** achanda has joined #openstack-containers04:48
*** Tango has quit IRC04:48
*** devkulkarni has quit IRC04:51
*** harshs has joined #openstack-containers04:59
*** mathspanda has joined #openstack-containers05:02
*** ganeshna has quit IRC05:07
*** ganeshna has joined #openstack-containers05:07
*** vimal has joined #openstack-containers05:27
*** harshs_ has joined #openstack-containers05:28
*** harshs has quit IRC05:30
*** harshs_ is now known as harshs05:30
*** ganeshna has quit IRC05:39
*** ganeshna has joined #openstack-containers05:40
*** harshs_ has joined #openstack-containers05:46
*** harshs has quit IRC05:49
*** harshs_ is now known as harshs05:49
eliqiaohongbin: around?05:50
eliqiaoanyone know where's magnum's gate git repository?05:50
*** dims_ has joined #openstack-containers05:50
eliqiaohi dims_05:51
*** tbh has quit IRC05:52
*** tbh has joined #openstack-containers05:53
*** harshs has quit IRC05:53
*** dims_ has quit IRC05:55
eliqiaoping cores!05:57
*** chandankumar has joined #openstack-containers05:58
*** jerrygb has joined #openstack-containers06:08
*** jerrygb has quit IRC06:12
*** fawadk has quit IRC06:14
*** fawadkhaliq has joined #openstack-containers06:17
*** chandankumar has quit IRC06:18
*** jwcroppe has quit IRC06:23
*** jwcroppe has joined #openstack-containers06:23
*** jwcroppe has quit IRC06:28
*** vilobhmm11 has quit IRC06:31
*** fawadk has joined #openstack-containers06:32
*** ganeshna has quit IRC06:32
*** fawadkhaliq has quit IRC06:33
*** ganeshna has joined #openstack-containers06:34
*** suro-patz has joined #openstack-containers06:35
*** j___ has joined #openstack-containers06:41
*** fawadkhaliq has joined #openstack-containers06:51
*** fawadk has quit IRC06:52
*** chandankumar has joined #openstack-containers06:53
*** alex_klimov has joined #openstack-containers06:55
*** eghobo has quit IRC06:55
*** alex_klimov has quit IRC06:56
*** alex_klimov has joined #openstack-containers06:56
*** fawadk has joined #openstack-containers06:58
*** fawadkhaliq has quit IRC07:00
*** BertrandN has joined #openstack-containers07:02
*** Tango|2 has quit IRC07:08
*** fawadkhaliq has joined #openstack-containers07:09
*** vimal has quit IRC07:09
*** fawadk has quit IRC07:10
*** achanda has quit IRC07:14
*** vimal has joined #openstack-containers07:16
*** BertrandN has quit IRC07:20
*** ganeshna has quit IRC07:23
*** jwcroppe has joined #openstack-containers07:23
*** suro-patz has quit IRC07:27
*** BertrandN has joined #openstack-containers07:37
*** fawadkhaliq has quit IRC07:49
*** fawadkhaliq has joined #openstack-containers07:50
*** dims_ has joined #openstack-containers07:52
*** dims_ has quit IRC07:59
eliqiaocores, please look at https://review.openstack.org/226634 , that is blocking gate.08:05
*** ganeshna has joined #openstack-containers08:06
*** jwcroppe has quit IRC08:19
*** ganeshna has quit IRC08:21
*** ganeshna has joined #openstack-containers08:23
eliqiaoping tcammann108:30
eliqiaoping tcammann_08:30
*** junhongl has joined #openstack-containers08:32
*** alex_klimov has quit IRC08:36
*** alex_klimov has joined #openstack-containers08:36
*** jerrygb has joined #openstack-containers09:08
*** dims_ has joined #openstack-containers09:11
*** jerrygb has quit IRC09:13
*** jwcroppe has joined #openstack-containers09:16
*** madhuri has quit IRC09:36
*** ganeshna_ has joined #openstack-containers09:42
*** ganeshna has quit IRC09:43
*** i316653 has joined #openstack-containers09:44
i316653Hi09:44
*** dims_ has quit IRC09:44
*** jwcroppe_ has joined #openstack-containers09:47
i316653How does Magnum find hosts? If there is the error "Message: No valid host was found. There are not enough hosts available." How would I debug this?09:48
*** jwcroppe has quit IRC09:49
tcammann_hello eliqiao09:57
tcammann_i316653: It uses Nova09:57
tcammann_eliqiao: I'll take a look at the patch asap09:58
*** lan has joined #openstack-containers10:00
*** Kennan_Vacation has quit IRC10:01
*** Kennan_Vacation has joined #openstack-containers10:02
*** dims_ has joined #openstack-containers10:09
*** alex_klimov has quit IRC10:09
*** alex_klimov has joined #openstack-containers10:24
*** ganeshna_ has quit IRC10:26
i316653tcammann_: Where does the fedora-21-atomic-3 image then run via Nova? ...and who would I get the error not enough hosts available?10:26
*** i316653 is now known as meehanman10:29
*** jwcroppe_ has quit IRC10:30
*** jwcroppe has joined #openstack-containers10:31
*** ganeshna has joined #openstack-containers10:33
*** jwcroppe has quit IRC10:35
*** BhavyaM has joined #openstack-containers10:38
*** alex_klimov has quit IRC10:39
*** alex_klimov has joined #openstack-containers10:40
*** alex_klimov has quit IRC10:40
*** alex_klimov has joined #openstack-containers10:40
*** ganeshna has quit IRC10:40
*** ganeshna has joined #openstack-containers10:42
*** yuanying_ has joined #openstack-containers11:04
openstackgerritTom Cammann proposed openstack/magnum: Unwedge the gate by only enabling barbican once  https://review.openstack.org/22669911:10
tcammann_meehanman: No valid hosts comes from nova scheduler, I would check those logs11:11
tcammann_You will need a understanding of Nova to debug this issue, I suggest reading some of the docs on Nova's architecture11:11
tcammann_eliqiao: It's gonna take a while for infra to merge that patch, so I've put up one in Magnum which should do the same11:12
*** lan has quit IRC11:13
meehanmanThanks @tcammann_11:16
*** meehanman has quit IRC11:16
*** mathspanda has quit IRC11:18
*** jwcroppe has joined #openstack-containers11:21
*** meehanman has joined #openstack-containers11:21
*** yuanying_ has quit IRC11:23
openstackgerritTom Cammann proposed openstack/magnum: Use --max-complexity flake8 rule  https://review.openstack.org/22418411:24
openstackgerritTom Cammann proposed openstack/magnum: Fix E251 unnecessarily ignored pep8 rule  https://review.openstack.org/22419811:24
openstackgerritTom Cammann proposed openstack/magnum: Fix H405 and E131 ignored pep8 rules  https://review.openstack.org/22418311:24
*** shakamunyi has quit IRC11:25
*** jerrygb has joined #openstack-containers11:35
*** jerrygb has quit IRC11:39
*** devkulkarni has joined #openstack-containers11:42
*** ganeshna has quit IRC11:44
*** jerrygb has joined #openstack-containers11:48
*** achanda has joined #openstack-containers12:03
*** achanda has quit IRC12:18
*** fawadkhaliq has quit IRC12:21
*** fawadkhaliq has joined #openstack-containers12:22
*** devkulkarni has quit IRC12:22
*** jwcroppe_ has joined #openstack-containers12:22
*** zhenguo has quit IRC12:24
tcammann_https://review.openstack.org/226699 - Needed to unwedge the gate!12:24
*** jwcroppe has quit IRC12:25
*** jwcroppe_ is now known as jwcroppe12:29
*** vimal has quit IRC12:32
*** vimal has joined #openstack-containers12:34
*** vimal has quit IRC12:39
*** rpothier has joined #openstack-containers12:45
*** vimal has joined #openstack-containers12:48
*** vimal is now known as vimal|busy12:51
*** vimal|busy is now known as vimal12:51
*** rlrossit has joined #openstack-containers13:02
*** deepthi has quit IRC13:07
*** julim has joined #openstack-containers13:11
*** erkules_ is now known as erkules13:17
*** erkules has joined #openstack-containers13:17
*** dims_ has quit IRC13:21
*** dims_ has joined #openstack-containers13:21
*** jwcroppe has quit IRC13:26
*** Tango|2 has joined #openstack-containers13:30
*** bradjones has quit IRC13:35
*** chandankumar has quit IRC13:39
*** jwcroppe has joined #openstack-containers13:49
*** ganeshna has joined #openstack-containers13:50
*** tbh has quit IRC13:56
*** ganeshna has quit IRC13:57
*** dane_leblanc has joined #openstack-containers14:01
*** jerrygb has quit IRC14:03
*** jerrygb has joined #openstack-containers14:07
*** fawadkhaliq has quit IRC14:15
*** chandankumar has joined #openstack-containers14:18
*** harshs has joined #openstack-containers14:18
*** devkulkarni has joined #openstack-containers14:19
*** zz_dimtruck is now known as dimtruck14:28
*** Drago has joined #openstack-containers14:38
*** Drago has quit IRC14:39
*** Drago has joined #openstack-containers14:40
*** j___ has quit IRC14:47
*** harshs_ has joined #openstack-containers14:48
*** harshs has quit IRC14:50
*** harshs_ is now known as harshs14:50
openstackgerritHongbin Lu proposed openstack/magnum: Implement bay monitoring and notifications  https://review.openstack.org/21533514:52
*** j___ has joined #openstack-containers15:16
*** hongbin has joined #openstack-containers15:22
*** j___ has quit IRC15:25
*** kebray has joined #openstack-containers15:26
*** harshs has quit IRC15:26
*** j___ has joined #openstack-containers15:27
*** adrian_otto has joined #openstack-containers15:28
*** kebray has quit IRC15:30
*** alejandrito has joined #openstack-containers15:33
*** puranamr has joined #openstack-containers15:35
*** kebray has joined #openstack-containers15:45
*** kebray has quit IRC15:46
*** puranamr has quit IRC15:47
*** kebray has joined #openstack-containers15:50
*** puranamr has joined #openstack-containers15:50
*** ganeshna has joined #openstack-containers15:52
*** ganeshna has quit IRC15:52
*** harshs has joined #openstack-containers15:52
*** chandankumar has quit IRC15:52
*** ganeshna has joined #openstack-containers15:56
*** sdake has joined #openstack-containers15:57
*** harshs has quit IRC15:57
*** harshs has joined #openstack-containers15:58
*** harshs has quit IRC15:58
*** BhavyaM has quit IRC15:59
openstackgerritMerged openstack/magnum: Unwedge the gate by only enabling barbican once  https://review.openstack.org/22669915:59
*** alex_klimov has quit IRC16:02
*** sthillma has joined #openstack-containers16:03
*** sthillma_ has joined #openstack-containers16:04
*** sdake has quit IRC16:04
*** sdake_ has joined #openstack-containers16:06
*** sthillma has quit IRC16:08
*** sthillma_ is now known as sthillma16:08
*** vimal has quit IRC16:10
*** sdake has joined #openstack-containers16:10
*** kebray has quit IRC16:11
*** kebray has joined #openstack-containers16:12
*** sdake_ has quit IRC16:14
*** dane_leblanc has quit IRC16:15
*** dane_leblanc has joined #openstack-containers16:15
*** BertrandN has quit IRC16:16
*** amit213 has quit IRC16:17
*** amit213 has joined #openstack-containers16:17
*** manjeets has joined #openstack-containers16:19
manjeetsadrian_otto and hongbin: please check documentation update I rebased the patch https://review.openstack.org/#/c/221504/16:20
openstackgerritHongbin Lu proposed openstack/magnum: Implement bay monitoring and notifications  https://review.openstack.org/21533516:20
hongbinmanjeets: will review that later16:21
manjeetsok16:22
adrian_ottothanks manjeets16:23
tcammann_adrian_otto: +1 on the patch backlog cleaning :)16:25
*** jwcroppe has quit IRC16:25
adrian_ottotcammann1 or tcammann_ are you around?16:26
tcammann_Yes, I just messaged you... ^^16:26
openstackgerritMerged openstack/magnum: Remove coding:utf-8  https://review.openstack.org/21105716:26
adrian_ottoaha, I did find one I wanted to ask you about… an important one in my view: https://review.openstack.org/21177116:27
adrian_ottoAny chance you could post a revision on that patch today?16:27
adrian_ottoor should we find someone to adopt that work?16:27
adrian_ottotcammann1: yes, I think that policy tweak was a good one. I like applying more common sense.16:28
tcammann_Yes, I did need some poking. My home PC and laptop are bust at the moment is going to be my goto excuse. But I'm still in the office :)16:29
tcammann_Need a +2/A on the gate fix to get anything passing CI16:30
adrian_ottotcammann1: I just wanted an indication from you i I should abandon that one, and look for  a foster parent, or jsut leave it for now and expect a revision soon… maybe you could post a comment in the comment stream letting us know you are still working on it.16:30
adrian_ottothe gate fix merged earlier, didn't it?16:30
adrian_ottotcammann_: are you talking about the one in project-config?16:31
openstackgerritMerged openstack/magnum: Docs update for new fedora atomic 1.0.4  https://review.openstack.org/22150416:32
tcammann_adrian_otto: No, you +2'd it earlier but it is the equivilent of the project-config one16:34
*** kebray has quit IRC16:35
tcammann_oh you are right!16:35
tcammann_it did land16:35
adrian_ottook, so we should be in good shape when those rechecks I ordered complete16:35
*** kebray has joined #openstack-containers16:40
*** j___ has quit IRC16:41
*** daneyon has joined #openstack-containers16:43
*** daneyon_ has quit IRC16:43
*** eghobo has joined #openstack-containers16:47
*** banix has joined #openstack-containers16:47
*** puranamr has quit IRC16:47
*** meehanman has quit IRC16:50
*** suro-patz has joined #openstack-containers16:51
*** manjeets has quit IRC16:53
*** unicell has joined #openstack-containers16:54
*** jwcroppe has joined #openstack-containers16:55
adrian_ottoTango|2: ping16:57
*** harshs has joined #openstack-containers16:58
*** Tango|2 has quit IRC16:59
adrian_ottoyuanying: ping16:59
*** mfalatic has joined #openstack-containers17:02
suro-patztcammann_: tcammann1: ping17:02
*** mfalatic has quit IRC17:03
*** dane_leblanc has quit IRC17:04
*** mfalatic has joined #openstack-containers17:04
tcammann_sup!17:06
tcammann_suro-patz:17:06
suro-patzregarding https://review.openstack.org/#/c/220702/, I hear the consensus to rename healthcheck17:07
suro-patzI am planning to rename it to magnum_service17:07
suro-patztcammmann_:^^17:07
suro-patzbefore I start making the wholesome renaming, I thought I will bounce the idea with you once17:08
tcammann_Why not service?17:08
suro-patzI had weighed that option17:08
tcammann_We are probably getting rid of the existing service table with removable of objects from the db17:08
tcammann_*removal17:09
suro-patzthat will create mich more wider touch surface for this patch17:09
suro-patzmuch17:09
openstackgerritAdrian Otto proposed openstack/magnum: Add TLS support in Magnum.  https://review.openstack.org/19490517:09
tcammann_I agree, but consistency with other services is useful.17:09
suro-patzand from code reading point of view I felt magnum already had the notion of service which people are used to17:10
*** achanda has joined #openstack-containers17:10
tcammann_Like I mention in the patch, we have already renamed the api. Why not commit fully and rename the db17:10
suro-patzWe have renamed the CLI - user facing part17:11
*** dane_leblanc has joined #openstack-containers17:13
suro-patztcammann_: I am guessing you still prefer me to change to 'service' than 'magnum-service'17:14
suro-patzmy worry is that will create a very large touch surface, given we are almost at the end of the cycle17:15
*** suro-patz has quit IRC17:24
*** suro-patz has joined #openstack-containers17:25
eghobotcammann_: curent services table, is it for Kub services?17:25
suro-patzeghobo: correct17:25
suro-patzadrian_otto: any comment on the above?17:26
eghoboaha, it's better rename it and move healthcheck to services ;)17:26
suro-patzeghobo: I am proposing making WIP:healthcheck to magnum_service and keep the kub-services as services to reduce code touch points17:27
suro-patzgiven the release cycle timeline17:28
suro-patzbut if community feels that renaming is absolutely needed, I will commit for doing the same. eghobo: tcammann_:17:28
eghoboI see, my personal opinion rename and use right name from beginning. but magnum_services will work as intermedia solution too17:30
adrian_ottomy suggestion on this subject is to table it for the M release.17:31
adrian_ottothis is not going to make a profound difference for users17:31
suro-patzbut the rest of the implementation was all done!17:31
adrian_ottoand there are a bunch of things in flight that will that could use additional eyes and hands17:31
eghoboadrian_otto: make sense17:31
adrian_ottosuro-patz: I'm not saying it's a bad idea, I'm simply concerned about the timing of it.17:32
suro-patzwe can create a tech debt for the renaming to address in M17:32
adrian_ottoyes, that would be appropriate17:32
suro-patzcool!17:32
adrian_ottoWHat I really want is for this topic to get totally finished:17:33
adrian_ottohttps://review.openstack.org/#/q/status:open+project:openstack/magnum+branch:master+topic:bp/secure-kubernetes,n,z17:33
suro-patzadrian_otto: I can offer some help, as the other BP is mostly wrapped up for17:33
adrian_ottoso if you have some free cycles to contribute, please see about adopting one or more of these patches and driving it home17:33
*** devkulkarni has quit IRC17:35
adrian_ottolet me know if any guidance is needed for how to make your own revisions to an existing patch17:35
suro-patzwill get back, if I need any assistance on these17:35
suro-patzdo you have any particular patch in mind out of these 7?17:36
suro-patzI will pick up, as I plough through them17:36
adrian_ottosuro-patz: https://review.openstack.org/207324 is one that got stuck, and needs a good workaround17:39
suro-patzadrian_otto: ack17:41
adrian_ottotx suro-patz!17:43
openstackgerritHongbin Lu proposed openstack/magnum: Rename image property os-distro to os_distro  https://review.openstack.org/22689317:43
*** vilobhmm11 has joined #openstack-containers17:43
*** rlrossit has quit IRC17:48
*** sthillma has quit IRC17:50
*** Tango|2 has joined #openstack-containers17:52
*** devkulkarni has joined #openstack-containers17:53
*** rlrossit has joined #openstack-containers17:53
*** ganeshna has quit IRC18:07
*** jwcroppe has quit IRC18:08
*** annegentle has joined #openstack-containers18:13
*** eghobo_ has joined #openstack-containers18:19
*** eghobo has quit IRC18:22
openstackgerritTom Cammann proposed openstack/magnum: [WIP] Generate heat templates from master template  https://review.openstack.org/21177118:22
tcammann_adrian_otto: put up another patch on that heat template one. I'll try and update the otehr one soon18:23
adrian_ottotcammann_: thanks!!18:25
*** achanda has quit IRC18:26
adrian_ottoit's pretty late to be at work Thanks for staying to get this in.18:26
*** dims__ has joined #openstack-containers18:28
*** achanda has joined #openstack-containers18:30
*** dims_ has quit IRC18:31
openstackgerritHongbin Lu proposed openstack/magnum: Use option --os-distro to set image property  https://review.openstack.org/22689318:34
vilobhmm11adrian_otto : regarding https://review.openstack.org/#/c/217908/ IMHO we should make similar changes for other k8s objects as well (including filing seperate tech-debt bugs to check if we might need it in future); to be consistent18:35
adrian_ottovilobhmm11: ok, I'll read that one now18:40
vilobhmm11adrian_otto : thanks!18:40
adrian_ottovilobhmm11: ok, so this is on the topic of removing unused code, filing bugs for anticipated improvements to use the code at a later time, when we will pull it back in, right?18:41
vilobhmm11adrian_otto : yes18:42
*** eghobo_ has quit IRC18:42
vilobhmm11based on your comment here https://review.openstack.org/#/c/217908/ IMHO we should do it for all k8s objects (Service/rc/pods)18:42
adrian_ottoYes, we can certainly do more of that. I'd caution us from putting too much energy into that at the end of a release cycle.18:42
adrian_ottobut I don't object to it18:43
adrian_ottoI do agree that using a measured, and consistent approach to this is the right approach18:44
vilobhmm11adrian_otto : the patches have already been proposed …they won't consume much of time18:45
vilobhmm11just need to rebase them18:45
vilobhmm11I agree with you plan18:45
adrian_ottogreat!18:46
vilobhmm11adrian_otto : thanks!18:47
*** kebray has quit IRC18:52
*** alex_klimov has joined #openstack-containers19:03
openstackgerritSurojit Pathak proposed openstack/magnum: Backend support for magnum service  https://review.openstack.org/22070219:05
*** Marga_ has quit IRC19:06
*** Marga_ has joined #openstack-containers19:08
*** Marga_ has quit IRC19:13
openstackgerritSurojit Pathak proposed openstack/magnum: Adding API support for magnum service  https://review.openstack.org/22607819:22
*** dims__ has quit IRC19:24
*** dims_ has joined #openstack-containers19:25
*** annegentle has quit IRC19:32
*** annegentle has joined #openstack-containers19:32
*** Marga_ has joined #openstack-containers19:37
*** achanda has quit IRC19:41
*** kebray has joined #openstack-containers19:46
*** Marga_ has quit IRC19:50
*** rlrossit1 has joined #openstack-containers19:52
*** rlrossit has quit IRC19:52
*** rlrossit1 has quit IRC19:57
*** rlrossit has joined #openstack-containers20:01
*** fawadkhaliq has joined #openstack-containers20:02
*** fawadkhaliq has quit IRC20:05
*** jwcroppe has joined #openstack-containers20:08
*** gangil has joined #openstack-containers20:11
*** sdake_ has joined #openstack-containers20:22
openstackgerritHongbin Lu proposed openstack/magnum: Use api version 1 to set image property  https://review.openstack.org/22689320:23
*** sdake has quit IRC20:25
*** sthillma has joined #openstack-containers20:38
*** achanda has joined #openstack-containers20:42
suro-patzhongbin: aware of this failure http://logs.openstack.org/78/226078/3/check/gate-functional-dsvm-magnum/f424944/console.html?20:46
*** achanda has quit IRC20:47
hongbinsuro-patz: yes, trying to fix that20:47
suro-patzhongbin: cool!20:48
*** achanda has joined #openstack-containers20:49
*** dane_leblanc_ has joined #openstack-containers20:53
*** achanda has quit IRC20:55
*** achanda has joined #openstack-containers20:55
*** dane_leblanc has quit IRC20:56
*** puranamr has joined #openstack-containers20:57
*** harshs has quit IRC21:01
*** harshs has joined #openstack-containers21:04
*** rlrossit has left #openstack-containers21:10
openstackgerritJames E. Blair proposed openstack/magnum: Remove ERROR_ON_CLONE references  https://review.openstack.org/22700021:11
*** julim has quit IRC21:12
*** puranamr has quit IRC21:12
*** Marga_ has joined #openstack-containers21:21
daneyonhongbin adrian_otto sdake tcammann_ As discussed during our weekly meeting, my flannel driver implementation for swarm replaces swarm's public discovery with a local etcd discovery. Note: etcd still uses public discovery. In this case, their is no need for several configuration directives such as swarm_discovery_url_format, public_swarm_discovery, public_swarm_discovery_url21:32
daneyonflannel for swarm patch: https://review.openstack.org/#/c/224367/321:32
*** achanda has quit IRC21:32
adrian_ottothanks daneyon. I'll have a look in a moment.21:32
*** eghobo has joined #openstack-containers21:32
*** rpothier has quit IRC21:33
daneyonWe could defaualt public_swarm_discovery to false, which would use etcd. However, if set to true, then flannel would not work.21:33
*** kebray has quit IRC21:34
*** achanda has joined #openstack-containers21:36
*** dane_leblanc_ has quit IRC21:37
daneyonunless the group has a strong opinion about keeping swarm public discovery, I'm inclined to remove all the swarm public discovery stuff and use etcd. I don't see any network drivers that require swarm's public discovery mechanism and I don;t know why  a user/operator would want to use the public discovery if we have a local etcd-based discovery mechanism. Since etcd still uses public discovery, I have filed a bp to address disc21:38
daneyonovery more holistically https://blueprints.launchpad.net/magnum/+spec/bay-type-discovery-options I just want to make sure the core's are on board so I don't have to go back and make major changes to the patch.21:38
adrian_ottothe reason it's there is that we did not have etcd included in every bay21:46
adrian_ottodaneyon: so rather than forcing everyone to set up etcd on their own as a prerequisite to use magnum, we used the public registry as a fallback, and allow you to specify an address of your own if you have one.21:49
daneyonadrian_otto the heat template sets up etcd as part of instantiating the bay. This is just how we do it in the k8s bay type.21:50
daneyonswarm will use etcd for backing discovery of the swarm cluster instead of using Docker Hub21:51
daneyonlet me think for a sec21:51
*** harshs has quit IRC21:51
daneyonadrian_otto what is the value of allowing a user to specify their own public discovery if we have one (etcd) baked into the swarm bay type?21:52
daneyonI think it leaves the door open to issues.21:52
daneyonI am trying to understand why a user would want to manually specify and change configs to use a public discovery over one that is part of the swarm bay deployment.21:53
adrian_ottoI might have one discovery service for my cloud tat's on my network, and all of my bays use that21:53
adrian_ottothat way I don't need to run N copies of etcd for that purpose21:54
*** harshs has joined #openstack-containers21:54
adrian_ottolower system utilization overall by leveraging a more widely shared resource21:54
openstackgerritTon Ngo proposed openstack/magnum: Migrate to Kubernetes Release 1 (docs)  https://review.openstack.org/20730021:54
eghobocan team review https://review.openstack.org/#/c/226893/, it will fix gate21:54
adrian_ottoeghobo: done21:55
daneyonthen maybe discovery should be more pluggable inside magnum.21:55
adrian_ottoyou should be able to specify your own discovery URL today21:56
hongbinadrian_otto: daneyon How about move the etcd to magnum, making magnum-as-a-etcd21:56
adrian_ottodid that code somehow not land?21:56
eghobothx, sorry I didn't realize that you have discussion21:56
adrian_ottohongbin: Do you mean run etcd on a magnum bay by default, and allow all bays to access that for discovery?21:57
*** achanda has quit IRC21:57
daneyonhongbin can you explain a bit more?21:57
hongbinrun a etcd process in magnum control plane, like magnum-etcd21:57
hongbinIt is in parallel with magnum-api and magnum-conductor21:58
hongbinIt solves the efficiency issue21:58
adrian_ottoyes, that makes sense21:58
eghobonot sure, we need discovery just for token21:59
*** sdake_ has quit IRC21:59
eghobowhy we cannot generate it and pass to heat21:59
daneyonadrian_otto the swarm public discovery is only used for bootstrapping a swarm cluster: https://github.com/docker/swarm/tree/master/discovery21:59
adrian_ottodoes etcd have multi-tenancy support, or is it globally writable?21:59
daneyonetcd is not multi-tenant and is not secure21:59
adrian_ottoright, so that justifies enabling it per bay as an optional service22:00
hongbink. then the multi-tenancy is a problem22:00
daneyonso swarm's public discovery is not meant to be used for application discovery services22:00
*** achanda has joined #openstack-containers22:00
adrian_ottosuch that we can use a networking boundary to limit access to etcd22:01
daneyonis their a need to have multiple bays use the same public discovery token? I don;t think so, since each bay is meant to be a clustering system.22:01
*** klindgren has quit IRC22:01
*** muralia has quit IRC22:02
*** klindgren has joined #openstack-containers22:02
*** muralia has joined #openstack-containers22:02
adrian_ottonot technically, no, but Imagine that you have 50,000 bays or more22:03
adrian_ottonow you have triple that: 150,000 etcd processes running on your infrastrucuture22:04
daneyonadrian_otto hongbin eghobo I can see having options for etcd discovery, public (how it's done today) and a local option (default to public). I am still struggling on why we even need Swarm's public discovery. Keep in mind, Swarm's public disocery mechanism is only used for bootstrapping a swarm cluster and not used for app discovery purposes.22:04
adrian_ottohogging up your memory when all you really want to know is the membership info for each swarm cluster22:04
adrian_ottoand you could accomplish that with a single etcd per tenant, rather than one per bay… and in a private cloud scenario, possibly one per cloud.22:05
daneyonadrian_otto that's a good point. I think in that case it would be beneficial for OS to have a k/v store as a service so M can just consume that service instead of creating etcd clusters per bay.22:06
adrian_ottoswarm just keeps a list of the nodes in the discovery service22:07
daneyoncorrect22:07
adrian_ottoso that it does not need tom implement shared state22:07
eghobodaneyon: does it mean we need etcd only for22:07
eghobo$ swarm create22:07
eghobo6856663cdefdec325839a4b7e1de38e8 # <- this is your unique <cluster_id>22:07
adrian_ottothat just guarantees that no two swarm clusters end up with the same hash string22:08
daneyoneghobo etcd could be used for than just bootstrapping the swarm cluster. it can be used for shared config service, app discovery, etc..22:08
daneyonwhereas swarm pub disc is only used for bootstrapping a swarm cluster22:08
daneyoneghobo: https://github.com/openstack/magnum/blob/master/magnum/templates/docker-swarm/fragments/write-swarm-master-service.yaml#L1922:09
adrian_ottoyes, it may be useful to have an etcd in your bay for app level discovery regardless of the bay type22:09
openstackgerritTon Ngo proposed openstack/magnum: Migrate to Kubernetes Release 1 (docs)  https://review.openstack.org/20730022:09
daneyonused for $DISCOVRY_URL22:09
eghobodaneyon: honestly I don't difference between kub and swarm22:10
adrian_ottoI just think that feature should be controlled by a setting in the baymodel that defaults to off.22:10
daneyonadrian_otto we need etcd in all bays that will use flannel for networking.22:10
daneyonit would be helpful if flannel supported diff k/v backends, but it does not.22:11
adrian_ottook, what does flannel use it for?22:11
daneyonshared config22:11
adrian_ottook22:11
eghobodaneyon: but we can run etcd at swarm masters, can't we?22:11
adrian_ottoyes.22:11
daneyoneghobo yes, that's how i implemented it22:12
adrian_ottowe should do it on a separate container on the swarm master node(s) of the bay22:12
hongbinThe problem is we could have multiple masters in future22:12
hongbinmaybe etcd in a dedicated vm22:12
adrian_ottocan etcd support TLS?22:12
*** devkulkarni has quit IRC22:13
daneyoneghobo hongbin adrian_otto https://docs.docker.com/swarm/multi-manager-setup/22:13
vilobhmm11https://coreos.com/etcd/docs/0.4.7/etcd-security/ "etcd supports SSL/TLS as well as authentication through client certificates, both for clients to server as well as peer (server to server / cluster) communication."22:13
daneyon^ keep in mind that we do not provide ha/scale for swarm bay types22:13
vilobhmm11adrian_otto : ^^22:13
eghobohongbin but we can run etcd at each master and join then to cluster22:13
daneyonas the doc states, etcd, consul or zk is required for swarm master ha22:13
hongbineghobo: we need another etcd to bootstrap the etcd cluster in master22:14
daneyonfurther reason to implement a real k/v store for swarm22:14
*** annegent_ has joined #openstack-containers22:14
eghoboloop ;), but it's just for token22:14
daneyonand if we need a real kv store for swarm ha, do we really want to support a separate Docker Hub discovery just for bootstrapping a swarm cluster?22:15
adrian_ottomagnum could have a generate_uuid function that would generate unique seed strings22:15
daneyonI think, at least for the near term, keep it simple.22:15
daneyonless knobs for users to mess with22:15
*** openstackgerrit has quit IRC22:16
*** openstackgerrit has joined #openstack-containers22:16
hongbindaneyon: there is already a project to implement k/v store for openstack https://wiki.openstack.org/wiki/MagnetoDB22:17
hongbinAnd this project is going to die22:17
hongbinsince no activity22:18
*** annegentle has quit IRC22:18
hongbineghobo: that is how k8s HA works currently22:22
hongbineghobo: sorry, mistake22:23
daneyonyeah, doesn't look good.22:23
daneyonand doesn't have support for etcd or consul22:24
eghobodaneyon: sorry, what doesn't support etcd?22:25
daneyonhongbin we could use static list or dns for cluster bootstrapping too: https://github.com/coreos/etcd/blob/master/Documentation/clustering.md22:25
daneyoneghobo the Magneto project22:26
hongbinI am trying to use static before, but cannot figure out how to do it in a heat template22:26
eghoboyep, it's Cassandra I don't see any values at all22:27
*** banix has quit IRC22:27
eghobohongbin, daneyon: can we postpohone decision for couple of days, I need to do some reading22:34
daneyonhongbin maybe we could create a resource that would take the ip_addr output from each master iteration and create the ETCD_INITIAL_CLUSTER and ETCD_INITIAL_CLUSTER_STATE=new env's then starts up the etcd service and all other services22:34
hongbineghobo: np from me22:35
daneyonit sounds like maybe i just need to keep all the swarm public discovery stuff and just change the default of public_swarm_discovery from true to false.22:35
daneyonfalse will use  etcd for bootstrapping the swarm cluster22:36
daneyonkeep in mind that setting this to true will cause breakage22:36
*** alejandrito has quit IRC22:36
daneyonhongbin adrian_otto ^22:36
hongbindaneyon: I think you original proposal is completely switching from public_swarm_discovery to etcd discovery22:38
*** kebray has joined #openstack-containers22:38
daneyonhongbin correct... remove swarm public discovery and just use etcd22:39
hongbinI think I like this better than a breakage config (public_swarm_discovery)22:39
hongbinalthough I haven't review your patch yet. I might change my mind after22:40
hongbin:)22:40
daneyonhongbin we could support multiple discovery mechanisms per bay by changing discovery_url to etcd_discovery_url and swarm_discovery_url22:41
hongbindaneyon: sounds good22:41
daneyonhowever, I think that's overkill22:41
daneyonimo we need to pick one22:42
adrian_ottohummm22:42
daneyonotherwise, we overcomplicate the situation22:42
hongbinI am OK with that22:42
eghobodaneyon +222:42
adrian_ottohaving two settings for this seems excessive22:42
*** dims__ has joined #openstack-containers22:43
daneyonagain, i like using etcd since swarm's public discovery mechanism is only for bootstrapping the swarm cluster and not for cluster ha, app discovery services, etc..22:43
daneyonswarm will use etcd for bootstrapping. We will need etcd to add swarm master ha/scale.22:43
daneyon^ either etcd, consul or zk.22:43
*** dims_ has quit IRC22:46
*** annegent_ has quit IRC22:49
daneyonadrian_otto agreed, but if we run 2 discovery services in a bay, each requires its own unique discovery url.22:49
adrian_ottooh, my you lost me, sorry. Why would we run 2 discovery services in the same bay? I thought the idea was to simply one one per bay, and use it for both purposes?22:51
*** alex_klimov has quit IRC22:54
*** jerrygb has quit IRC22:55
*** jwcroppe has quit IRC22:56
*** jwcroppe has joined #openstack-containers22:57
daneyonadrian_otto If we wanted to continue having Swarm use a public discovery mechanism and support flannel. This is because flannel requires etcd. So 1 discovery service, Docker Hub, for Swarm bootstrapping and 1 for bootstrapping etcd.22:59
*** hongbin has quit IRC22:59
daneyonadrian_otto since etcd, consul or zk is required for swarm master ha, I think it's preferred to simply settle on using etcd for bootstrapping the swarm cluster instead of using Docker Hub.23:01
*** jwcroppe has quit IRC23:01
eghobodaneyon: +123:03
daneyoneghobo thx for the feedback23:03
*** annegentle has joined #openstack-containers23:04
adrian_ottoagreed23:05
*** annegentle has quit IRC23:05
*** eghobo has quit IRC23:05
openstackgerritMerged openstack/magnum: Use api version 1 to set image property  https://review.openstack.org/22689323:12
*** adrian_otto has quit IRC23:19
*** kebray has quit IRC23:25
*** devkulkarni has joined #openstack-containers23:27
*** achanda has quit IRC23:33
*** ganeshna has joined #openstack-containers23:33
openstackgerritMotohiro/Yuanying Otsuka proposed openstack/magnum: Make bay.api_address contains protocol  https://review.openstack.org/22302523:34
*** jwcroppe has joined #openstack-containers23:37
*** dimtruck is now known as zz_dimtruck23:42
*** Tango|2 has quit IRC23:43
*** jwcroppe has quit IRC23:45

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!