Tuesday, 2016-11-01

*** tonanhngo has joined #openstack-containers00:07
*** clsacramento has quit IRC00:12
*** Drago5 has joined #openstack-containers00:14
*** apuimedo has quit IRC00:18
*** dims_ has quit IRC00:20
*** vijendar_ has joined #openstack-containers00:25
*** vijendar has quit IRC00:25
*** vijendar1 has quit IRC00:26
*** vijendar has joined #openstack-containers00:30
*** dims has joined #openstack-containers00:31
*** srwilkers has quit IRC00:35
*** srwilkers has joined #openstack-containers00:38
*** vijendar has quit IRC00:41
*** vijendar_ has quit IRC00:41
*** vijendar has joined #openstack-containers00:42
*** vijendar1 has joined #openstack-containers00:47
openstackgerritfeng.shengqin proposed openstack/python-magnumclient: suport insecure_registry in cluster-template  https://review.openstack.org/39200700:49
*** Drago5 has quit IRC00:51
*** syed_ has quit IRC00:55
openstackgerritfeng.shengqin proposed openstack/python-magnumclient: suport insecure_registry in cluster-template  https://review.openstack.org/39200700:58
*** tonanhngo has quit IRC00:58
*** tushark has quit IRC01:01
*** dave-mccowan has joined #openstack-containers01:09
*** srwilkers has quit IRC01:09
*** vijendar1 has quit IRC01:15
*** vijendar has quit IRC01:15
*** vijendar has joined #openstack-containers01:16
*** Drago5 has joined #openstack-containers01:16
*** mtanino has quit IRC01:17
*** vijendar1 has joined #openstack-containers01:18
*** Wenzhi has joined #openstack-containers01:23
*** vijendar has quit IRC01:32
*** vijendar has joined #openstack-containers01:33
*** vijendar1 has quit IRC01:33
*** Guest56190 is now known as kevinza01:34
*** kevinza is now known as kevinz01:34
*** apuimedo has joined #openstack-containers01:36
*** srwilkers has joined #openstack-containers01:36
*** jmckind_ has quit IRC01:38
*** vijendar1 has joined #openstack-containers01:38
*** sergmelikyan has joined #openstack-containers01:39
*** apuimedo has quit IRC01:44
*** x00350071_ has quit IRC01:44
*** Drago5 has quit IRC01:50
*** mtanino has joined #openstack-containers02:05
*** srwilkers has quit IRC02:05
*** mkrai has joined #openstack-containers02:32
*** vijendar_ has joined #openstack-containers02:38
*** vijendar1 has quit IRC02:38
*** vijendar has quit IRC02:38
*** ramishra has joined #openstack-containers02:40
*** vijendar has joined #openstack-containers02:41
*** sergmelikyan has quit IRC02:42
*** vijendar_ has quit IRC02:43
*** vijendar1 has joined #openstack-containers02:43
*** yuanying has quit IRC02:47
*** yuanying has joined #openstack-containers02:48
*** yuanying has quit IRC02:52
*** dave-mccowan has quit IRC02:53
*** sergmelikyan has joined #openstack-containers03:02
*** sergmelikyan has quit IRC03:06
*** sergmelikyan has joined #openstack-containers03:08
*** tonanhngo has joined #openstack-containers03:10
*** tonanhngo has quit IRC03:15
*** dimtruck is now known as zz_dimtruck03:20
*** Jeffrey4l has joined #openstack-containers03:21
*** ramishra has quit IRC03:21
*** mtanino has quit IRC03:22
openstackgerritchen.xing proposed openstack/magnum: [instll] Update a more simple rabbitmq configuration  https://review.openstack.org/39202503:29
*** sergmelikyan has quit IRC03:31
*** zz_dimtruck is now known as dimtruck03:32
openstackgerritchen.xing proposed openstack/magnum: [instll] Update a more simple rabbitmq configuration  https://review.openstack.org/39202503:33
*** mkrai has quit IRC03:43
*** sergmelikyan has joined #openstack-containers03:57
*** ramishra has joined #openstack-containers04:06
*** mtanino has joined #openstack-containers04:12
*** janonymous has joined #openstack-containers04:12
*** Wenzhi_ has joined #openstack-containers04:17
*** vijendar1 has quit IRC04:17
*** vijendar has quit IRC04:17
*** Wenzhi has quit IRC04:20
*** duonghq_ has joined #openstack-containers04:25
*** sergmelikyan has quit IRC04:38
*** dimtruck is now known as zz_dimtruck04:42
*** yuanying has joined #openstack-containers04:42
*** takashi has joined #openstack-containers04:49
*** yuanying has quit IRC04:57
*** yuanying has joined #openstack-containers04:58
*** yuanying has quit IRC05:08
*** yuanying has joined #openstack-containers05:12
*** yuanying has quit IRC05:28
*** sheel has joined #openstack-containers05:28
*** askb has quit IRC05:29
*** yuanying has joined #openstack-containers05:32
*** yuanying has quit IRC05:36
*** yuanying has joined #openstack-containers05:36
*** yasemin has joined #openstack-containers05:37
*** yasemin has left #openstack-containers05:37
*** anush has joined #openstack-containers05:38
openstackgerritMerged openstack/python-magnumclient: Cluster creation command returns complete cluster uuid  https://review.openstack.org/39081505:42
openstackgerritRyosuke Mizuno proposed openstack/magnum-ui: Add javascript tests for clusterSignCertificate model and service  https://review.openstack.org/39203805:54
*** mtanino has quit IRC05:56
*** ramishra_ has joined #openstack-containers06:00
*** ramishra has quit IRC06:02
*** takashi has quit IRC06:06
*** tonanhngo has joined #openstack-containers06:11
*** yuanying has quit IRC06:11
*** mtanino has joined #openstack-containers06:15
*** tonanhngo has quit IRC06:15
*** yuanying has joined #openstack-containers06:19
*** mtanino has quit IRC06:19
*** chetna has joined #openstack-containers06:19
*** chetna has quit IRC06:21
*** janonymous has quit IRC06:24
*** rcernin has joined #openstack-containers06:29
*** yuanying has quit IRC06:40
*** yuanying has joined #openstack-containers06:57
*** yuanying has quit IRC07:02
*** takashi has joined #openstack-containers07:19
*** AlexeyAbashkin has quit IRC07:20
*** chetna has joined #openstack-containers07:21
*** chetna has quit IRC07:22
*** belmoreira has joined #openstack-containers07:26
*** yuanying has joined #openstack-containers07:29
*** tonanhngo has joined #openstack-containers07:30
*** AlexeyAbashkin has joined #openstack-containers07:33
*** tonanhngo has quit IRC07:35
*** noama has joined #openstack-containers07:38
*** yuanying has quit IRC07:48
*** yuanying has joined #openstack-containers07:50
*** yuanying has quit IRC07:57
*** yuanying has joined #openstack-containers08:00
*** yuanying_ has joined #openstack-containers08:07
*** yuanying has quit IRC08:08
openstackgerritMichael Liu proposed openstack/magnum: magnum support cni network driver  https://review.openstack.org/39171808:09
openstackgerritOpenStack Proposal Bot proposed openstack/magnum-ui: Imported Translations from Zanata  https://review.openstack.org/39137108:12
*** Wenzhi has joined #openstack-containers08:20
*** Wenzhi_ has quit IRC08:21
*** Wenzhi has quit IRC08:26
*** chetna has joined #openstack-containers09:07
*** chetna has quit IRC09:08
openstackgerritMerged openstack/magnum-ui: Imported Translations from Zanata  https://review.openstack.org/39137109:35
*** swatson_ has quit IRC09:35
*** yuanying_ has quit IRC09:44
*** yuanying has joined #openstack-containers09:44
*** duonghq_ has quit IRC09:45
*** dootniz is now known as kragniz09:59
*** tonanhngo has joined #openstack-containers10:22
*** tonanhngo has quit IRC10:27
*** chetna has joined #openstack-containers10:55
*** chetna has quit IRC10:56
*** yuanying has quit IRC10:56
*** chhavi has joined #openstack-containers11:11
openstackgerritMichael Liu proposed openstack/magnum: magnum support cni network driver  https://review.openstack.org/39171811:23
openstackgerritMichael Liu proposed openstack/magnum: magnum support cni network driver  https://review.openstack.org/39171811:26
*** srwilkers has joined #openstack-containers11:35
*** EricGonczer_ has joined #openstack-containers11:47
*** EricGonc_ has joined #openstack-containers11:51
*** EricGonczer_ has quit IRC11:52
*** EricGonc_ has quit IRC11:52
*** EricGonczer_ has joined #openstack-containers11:55
*** jmckind has joined #openstack-containers11:57
*** jmckind has quit IRC12:26
*** JoseMello has joined #openstack-containers12:30
*** jerrygb_ has quit IRC12:38
*** dave-mccowan has joined #openstack-containers12:46
*** jerrygb has joined #openstack-containers12:52
*** srwilkers has quit IRC12:52
*** ramishra_ has quit IRC12:53
*** chetna has joined #openstack-containers12:56
*** chetna has quit IRC12:58
*** vijendar has joined #openstack-containers12:58
*** vijendar1 has joined #openstack-containers12:59
*** ramishra has joined #openstack-containers13:06
openstackgerritSpyros Trigazis proposed openstack/magnum: Add user-domain in role creation  https://review.openstack.org/39177913:06
*** takashi has quit IRC13:12
*** chetna has joined #openstack-containers13:12
*** chetna has quit IRC13:13
*** srwilkers has joined #openstack-containers13:19
*** EricGonczer_ has quit IRC13:25
*** EricGonczer_ has joined #openstack-containers13:26
openstackgerritOpenStack Proposal Bot proposed openstack/magnum: Updated from global requirements  https://review.openstack.org/38831913:28
*** EricGonczer_ has quit IRC13:30
*** EricGonczer_ has joined #openstack-containers13:31
*** fragatina has joined #openstack-containers13:32
*** yuanying has joined #openstack-containers13:32
*** fragatina has quit IRC13:32
*** fragatina has joined #openstack-containers13:33
*** kaliya has joined #openstack-containers13:33
*** absubram has joined #openstack-containers13:36
*** chetna has joined #openstack-containers13:43
*** chetna has quit IRC13:44
*** EricGonczer_ has quit IRC13:45
*** EricGonczer_ has joined #openstack-containers13:46
*** fragatina has quit IRC13:48
*** vijendar has quit IRC13:58
*** jerrygb_ has joined #openstack-containers14:00
*** sergmelikyan has joined #openstack-containers14:00
*** yuanying has quit IRC14:01
*** dave-mccowan has quit IRC14:02
*** jerrygb has quit IRC14:02
*** jmckind has joined #openstack-containers14:05
*** vijendar has joined #openstack-containers14:10
*** mtanino has joined #openstack-containers14:13
*** Drago5 has joined #openstack-containers14:14
*** zz_dimtruck is now known as dimtruck14:14
*** anushkrishnamurt has joined #openstack-containers14:15
*** randallburt has joined #openstack-containers14:16
*** Drago5 has quit IRC14:19
*** randallburt has quit IRC14:21
*** vijendar has quit IRC14:25
*** GB21 has joined #openstack-containers14:26
*** Drago5 has joined #openstack-containers14:28
*** randallburt has joined #openstack-containers14:28
*** jerrygb has joined #openstack-containers14:31
*** randallburt has quit IRC14:33
*** jerrygb_ has quit IRC14:33
*** sergmelikyan has quit IRC14:36
*** randallburt has joined #openstack-containers14:36
*** chris_hultin|AWA is now known as chris_hultin14:38
*** vijendar has joined #openstack-containers14:40
*** vijendar has quit IRC14:42
*** vijendar has joined #openstack-containers14:46
*** Drago5 has quit IRC14:48
*** dave-mccowan has joined #openstack-containers14:48
*** DanyC has joined #openstack-containers14:48
*** DanyC has left #openstack-containers14:54
*** vijendar has quit IRC14:54
*** vijendar has joined #openstack-containers14:59
*** chris_hultin is now known as chris_hultin|AWA15:00
*** dave-mccowan has quit IRC15:00
*** jerrygb_ has joined #openstack-containers15:00
*** vijendar2 has joined #openstack-containers15:01
*** Drago5 has joined #openstack-containers15:01
*** vijendar1 has quit IRC15:03
*** jerrygb has quit IRC15:03
*** chris_hultin|AWA is now known as chris_hultin15:03
*** chhavi has quit IRC15:03
*** chhavi has joined #openstack-containers15:05
*** EricGonc_ has joined #openstack-containers15:06
*** EricGonczer_ has quit IRC15:07
openstackgerritSpyros Trigazis proposed openstack/magnum: [WIP] Spec on cluster upgrades  https://review.openstack.org/39219315:09
*** dave-mccowan has joined #openstack-containers15:13
*** syed_ has joined #openstack-containers15:14
*** dimtruck is now known as zz_dimtruck15:16
*** zz_dimtruck is now known as dimtruck15:17
*** ramishra has quit IRC15:17
*** ramishra has joined #openstack-containers15:19
*** absubram has quit IRC15:31
*** absubram has joined #openstack-containers15:36
*** sheel has quit IRC15:40
*** chetna has joined #openstack-containers15:45
*** adrian_otto has joined #openstack-containers15:45
*** sergmelikyan has joined #openstack-containers15:45
adrian_ottoHello! Our team meeting will being in 15 minutes at 1600 UTC in #openstack-meeting-alt15:45
adrian_ottos/being/begin/15:46
*** rafael__ has joined #openstack-containers15:46
*** chetna has quit IRC15:46
openstackgerritSpyros Trigazis proposed openstack/magnum: [WIP] Spec on cluster upgrades  https://review.openstack.org/39219315:57
*** DanyC has joined #openstack-containers15:59
*** DanyC has quit IRC15:59
*** Drago5 is now known as Drago16:01
*** JoseMello has quit IRC16:02
*** vijendar_ has joined #openstack-containers16:04
*** vijendar has quit IRC16:04
*** vijendar2 has quit IRC16:04
*** rcernin has quit IRC16:06
*** chetna has joined #openstack-containers16:07
*** chetna has quit IRC16:08
*** chetna has joined #openstack-containers16:08
*** vijendar has joined #openstack-containers16:09
*** vijendar1 has joined #openstack-containers16:13
*** vijenda__ has joined #openstack-containers16:13
*** vijendar has quit IRC16:14
*** vijendar_ has quit IRC16:14
*** swatson_ has joined #openstack-containers16:28
*** srwilkers has quit IRC16:34
*** kaliya has quit IRC16:34
*** belmoreira has quit IRC16:35
*** jerrygb has joined #openstack-containers16:41
*** jerrygb_ has quit IRC16:43
*** vijenda__ has quit IRC16:44
*** jerrygb_ has joined #openstack-containers16:44
*** GB21 has quit IRC16:44
*** JoseMello has joined #openstack-containers16:45
*** jerrygb has quit IRC16:46
*** vijendar has joined #openstack-containers16:51
openstackgerritMerged openstack/magnum: Updated from global requirements  https://review.openstack.org/38831916:52
DragoSo strigazi and jvgrant17:01
jvgranttemplate versioning discussion?17:02
DragoYes17:02
jvgrantDrago: i think what we discussed yesterday will cover all the needs that strigazi mentioned17:02
strigaziyes17:02
Dragojvgrant: I think so too, but I want to get something clarified17:02
jvgrantbut it means that the current template and cluster flattening is going to need to happen first if he needs it for upgrades17:03
*** GB21 has joined #openstack-containers17:03
*** DanyC has joined #openstack-containers17:03
Drago1. Create a cluster template with a specific set of attributes. Thiscluster template will have version 1.17:03
Drago2. Create a cluster using the above cluster template.17:03
Drago3. Modify the cluster template resulting to a new cluster template with version 2.17:03
Drago4. Request a cluster to upgrade from version 1 to 2.17:03
Dragostrigazi: You have this in your new spec for upgrades17:04
strigaziyes17:04
Dragostrigazi: Step 3 makes sense as the CT and Cluster relationship is now, where they are linked17:04
strigaziafter NGs, no CT means no upgrades17:05
DragoThat seems like an arbitrary limitation17:06
jvgrantcan you upgrade from no CT to a CT?17:06
Dragostrigazi: CTs and Clusters will have the same set of attributes, so should be able to upgrade by just updating the Cluster attributes17:06
randallburt^^17:06
jvgrantversioning is there to orginize things but upgrade really targets current to target CT?17:06
strigazijvgrant, yes17:07
*** vijendar1 has quit IRC17:07
Dragostrigazi: Right, as I understand it, it's just a convenient way to do attribute updates17:07
*** DanyC has quit IRC17:07
Drago*?17:07
strigaziDrago we can allow non-ct upgrade too at users risk17:08
strigaziDrago, that is exactly what it is17:08
Dragostrigazi: That is another thing I am confused about. How is there more risk involved when there's no CT?17:08
jvgrantstrigazi: does it really matter how the cluster was created?  The upgrade should just have a CT(or new attributes) as a target17:09
Dragostrigazi: Do you only mean from CERN's supported vs non-supported point of view?17:09
strigaziyes, just to underline something17:10
jvgrantstrigazi: by adding versioning we make it easy to just use the same CT as the target to make life easier, but really upgrade just has a target that it is changing to17:10
strigaziwe can let any cluster to be upgraded17:10
strigaziwhat we want is versions17:10
*** vijendar has quit IRC17:11
jvgrantDrago: then i think our current plan will work fine.17:11
DragoOkay, I think what you're saying is clear to me. I think we can introduce what we came up with yesterday17:11
*** harlowja has joined #openstack-containers17:11
Dragojvgrant: Agreed17:11
strigaziI think so too17:11
Dragostrigazi: Well, it's more concrete than the IRC conversation https://etherpad.openstack.org/p/magnum-ocata-nodegroups-fishbowl17:12
strigaziThe work could be decoupled17:12
DragoLine 19 and onward17:12
jvgrantit does mean we need to get the current cluster template flattened into cluster ASAP if we have multiple paths needing this17:12
Dragojvgrant: I think we should explain it, then go over implementation order stuff17:13
strigaziDrago +117:13
jvgrantagreed17:13
*** DanyC has joined #openstack-containers17:14
Dragostrigazi: Okay, so the idea is that CTs will be composed of three different entities. The ParentTemplate (we don't have a good name for this), ClusterTemplate, and ClusterAttributes17:14
*** DanyC has quit IRC17:15
Dragostrigazi: The ParentTemplate object is the thing that links different versions of a CT together17:15
Dragostrigazi: Quick note - CTs will be immutable17:15
strigazi+1 on the last one17:15
DragoWhen you create a *new* CT, it will create the 3 entities17:16
DragoThe version, which is in the ClusterTemplate entity, will be 117:16
DragoYes, +1 to jvgrant for that idea :)17:17
strigaziWhy have Parent Template Object ?17:17
DragoWhen a user updates the CT, a new ClusterTemplate entity and ClusterAttributes entity will be created, and the CT entity will point to the original ParentTemplate17:17
*** anushkrishnamurt has quit IRC17:18
jvgrantthe parent is what keeps the current info and past versions linked17:18
DragoWhen a cluster is created, it points to a ClusterTemplate entity, which has the version and attribute information17:18
jvgrantso when you display the CT it will show the latest, but have links to each previous version17:18
Dragojvgrant: That could all be possible without the ParentTemplate, if the relations were rearranged17:19
strigaziI was thinking something a bit different, let me describe17:19
*** yatin has joined #openstack-containers17:19
jvgrantagreed, it is just one implementation option17:19
Dragostrigazi: The main reason is that you can delete the ClusterTemplate and it will set a flag on the ParentTemplate17:19
DragoBut you will still be able to keep the version information intact17:19
DragoIt also lets you restore the ClusterTemplate, but that's a bonus17:20
strigazithe CT db entry will have a uuid, a version, a parent uuid and two flags, obsolete and marked_for_Delete17:20
DragoWe still want to be able to freely delete and modify a ClusterTemplate, even with versioning in place, and this system should enable all of that. If we did not have the ParentTemplate, it would be harder/more complicated to delete a CT17:21
strigazilet me finish, you can still do it very easily17:21
strigaziI'll write it at the end of the etherpad17:22
DragoAnother problem with not having a ParentTemplate is that your UUID changes for each version17:22
strigazithat is no problem17:23
strigaziI thought about it17:23
*** jerrygb has joined #openstack-containers17:25
*** jerrygb_ has quit IRC17:28
strigaziDrago, jvgrant check the etherpad17:29
Dragostrigazi: Looking17:29
jvgrantlooking at it17:29
Dragostrigazi: What do you mean by "link ti the parent cluster"?17:31
*** yatin has quit IRC17:31
jvgrantseems reasonable. So listing CTs would only list non-obsolete CTs17:31
strigaziyes17:31
jvgrantlink to parent would be add UUID in a Parent_id field?17:31
strigaziDrago, have a field to the parent uuid17:31
Dragostrigazi: Parent is??17:32
strigaziyou have verions N-117:32
jvgrantthe original CT it was updated from17:32
strigaziparent is version N-217:32
DragoOh so CT, not cluster? It says parent cluster and I was very confused17:32
strigaziline?17:32
strigazioh, sorry17:32
*** DanyC has joined #openstack-containers17:33
jvgrantif it is new then it points to itself. otherwise when it is updated it would grab the UUID from the parent field it was updated from17:33
strigaziyes17:33
jvgrantcluster would just need a new field for CT UUID to know what it was created from17:34
strigaziyes17:34
Dragostrigazi: So when you delete a CT, Magnum has to re-link the used CT to the CT before it that was used in order to delete the ones in the middle?17:34
strigaziNO deletions in the middle17:34
strigaziyou can only see and delete the last one17:35
Drago"yes, also if you have 10 versions of the CT and only 1 is referenced, delete the other 9"17:35
Dragostrigazi: ^17:35
jvgrantDrago: this would allow us to just keep the one object approach we originally planned17:35
Dragojvgrant: I think it makes things overly difficult17:35
strigaziThis mean that you have it for refernce, you won't be able to do any more actions with it17:36
strigazinot even list it17:36
strigaziDrago, why?17:37
Dragostrigazi: Well, sure, the user can only delete the last one, but "delete the other 9" sounds like it is something Magnum does17:37
jvgrantnot sure, i'm in the middle on this one. both approaches seem valid and accomplish pretty much the same thing. personally i like less db tables :)17:37
strigazime too17:37
DragoAgain, "-- this action will delete the CTs as well that are marked as deleted unless they are referenced by another cluster "17:37
strigaziThis action is similar to the current fuctionalliyt17:38
DragoMagnum will have to modify the foreign keys to point to the correct CTs in order to delete them17:38
*** srwilkers has joined #openstack-containers17:38
strigazi^^ I don't follow17:38
Dragostrigazi: So if you have versions 1 2 3 4 5, and you delete the CT, magnum will delete the ones that aren't referenced by a cluster, right?17:39
strigaziyes mark_to_delete17:39
strigaziih yes17:39
strigazioh yes17:39
jvgrantso it will delete all the parents...17:40
jvgrantthat could be a problem17:40
strigazidelete the ones that  aren't referenced by a cluster17:40
Dragostrigazi: Right… v2 references v1 as its parent and so on17:40
jvgranti think the delete can only happen once there are not references to any versions17:40
strigazilet me give an example17:41
strigaziyou have 1 2 3 4 517:41
jvgrantunless v1(which is always parent) can't be deleted while any other versions still exist17:41
DragoIt sounds to me like step 5 will *really* delete the CTs because they're already marked to delete17:41
strigazi3 and 4  have created a cluster17:41
*** DanyC has left #openstack-containers17:41
strigaziyou want to delete the CT17:42
DragoAnd "the CT" is really the CT v5, right?17:42
strigazi3 and 4 are marked to_delete and 1 2 and 5 are deleted17:42
strigaziThen17:42
strigaziyou delete the clusters of CT 3 and you delete CT 3 too17:43
strigazifinally, when you delete the clusters of CT 4 you also delete the CT 417:43
strigazi"3 and 4  have created a cluster" --> "3 and 4  have created some  clusters\"17:43
jvgrantwhat is parent of 3 and 4 after 1 is deleted?17:44
strigaziparernt of 3 is 2 and parent of 4 is 317:44
jvgranti guess it doesn't matter as long as the UUIDs still match. as it is not a link, just a uuid17:44
DragoImagine the complexity of these operations when you have 1 2 3 4 5 6 and 2, 4, and 6 have clusters17:44
DragoWhen you delete the CT, you're removing 1 3 5, but you have to update parent on 2 4 and 617:45
DragoThen when the clusters are deleted, you keep having to update parent17:45
strigaziNO, when you delete something17:45
jvgrantwhy? they still share the same UUID value in the parent attribute?17:45
jvgrantit is just something that links them, they don't need the info from v1 right?17:45
strigaziyou don't need the parent anymore for any operation17:45
DragoOh, v1 is the parent always? I was understanding it was a linked list17:46
jvgrantthe parent uuid for all 1-6 would be the uuid for v1 right?17:46
*** vijendar has joined #openstack-containers17:46
*** vijendar_ has joined #openstack-containers17:46
Dragojvgrant: strigazi said above that it's a linked list17:47
jvgrantdon't think it needs to be a linked list.  they just need something that identifies they are all part of the same list?17:47
strigaziNo, the previous one, but we need a way to delete all at once,17:47
Dragojvgrant: "parernt of 3 is 2 and parent of 4 is 3"17:47
jvgrantif it is a linked list then, deleting part of the list seems complicated17:47
strigaziGood point we won't traverse lists17:48
jvgrantcould they all have the v1 value? or is there a reason they need it to be a list?17:48
jvgrantthe version number will give you the order17:48
DragoThis is what I was thinking before I thought of the ParentTemplate concept17:48
strigazithe problem is that we allow different CTs with the same name17:48
jvgrantto find any version i use the parent uuid and the version number17:49
DragoThey can do the same thing, but I think it's organized better to have a ParentTemplate that links everything together17:49
jvgrantthe latest is the parent_uuid and the highest version number17:49
strigaziI think what jaycen says solves it17:49
strigazithe parent must always be v117:49
strigazithanks17:49
DragoYou don't have to duplicate the marked-to-delete field and you can freely delete the CT entry when you want, without having to worry about references17:49
jvgrantyep17:50
jvgranti think this will work17:50
jvgranti like it17:50
Drago(when using a ParentTemplate)17:50
strigazithe mark field is boolean, there is no overhead in having it17:50
jvgranti'm leaning for less db objects17:51
strigazibetter a boolean than a table17:51
jvgranti do see how the parenttemplate object makes for less logic though....17:51
strigaziI disagree17:52
strigazibecause17:52
jvgrantbut is seems pretty straight forward to locate and use the versions this way as well17:52
strigaziWhen the cluster is not deleted17:52
strigazithe v1 cluster plays the role of the parent as it would be in the different object schema17:52
strigazis/cluster/CT17:53
strigaziwhen the CT is deleted you don't have to do any more actions, you need to pay the update17:53
strigaziof the flag17:53
strigaziFor a modern db that's nothing17:54
jvgranti see both ways working, so when close I'm going to go for less complexity which i think keeping everything in the same db table does17:56
DragoI don't think the two approaches are much different performance-wise17:56
strigaziThis way we can decouple tje work17:56
strigaziThe nodegroups work can proceed separately17:56
DragoWhen you delete the CT, you are updating the mark_delete flag on all the versions, even though it logically applies as all-or-none17:56
jvgrantyou could just update it on the parent17:57
strigazi"even though it  logically applies as all-or-none" -> ?17:57
jvgrantand the check for delete uses that value17:57
strigazijvgrant, true17:57
strigazidoable17:57
Dragostrigazi: You will never have different versions having mark_delete as true AND false17:57
jvgranttrue, so the parent is the only one that value matters on17:58
strigaziDrago, yeap true17:58
strigaziok, so the original version v1 will stick until the end17:58
strigaziof all CTs17:58
jvgrantmakes sense as it is the parent and the others have a reference to it anyway17:59
DragoWe have also identified name as a possible field that applies to a CT in a non-version-specific way (i.e. the name doesn't belong to a specific version)17:59
strigaziThat way you don't know when to delete v1 though17:59
jvgrantyeah, that now follows how names work in the rest of magnum. they don't really matter. it is the uuid that does17:59
DragoIt feels wrong to me that we are shoehorning one entry in a table to be special17:59
strigaziI would prefer the name to be the same in all versions18:00
DragoRather than just breaking that out into its own table18:00
jvgrantstrigazi: the user can do that or they could modify the name if they wanted by adding _Vx if they wanted18:00
strigazijvgrant, I get it, I don't have a strong objection against it18:01
jvgrantif we want to enforce the name i think the separate entity approach is better18:01
Dragojvgrant: On that note, we could add a —version flag to cluster-create that would default to latest18:01
strigaziDrago, in GCE you do only latest18:01
DragoI imagine we will find more things that will make the entry for the first version special, and at that point we will regret not making it its own table18:02
strigaziThe user must always see only the latest18:02
jvgrantDrago: i think that is a risk18:02
jvgrantDrago: but nothing stops us from going that way in the future if we need to18:02
strigaziI like the non table solution to decouple the work too18:03
strigazijvgrant +118:03
Dragostrigazi: How does it make a difference?18:03
jvgrantthere is a still one thing that has to be done first on both paths18:03
jvgrantwe have to get rid of the current ClusterTemplate table18:04
strigaziDrago, Not a big difference18:04
Dragostrigazi: Okay18:04
*** anushkrishnamurt has joined #openstack-containers18:04
strigazijvgrant, Not modify?18:04
jvgrantall attributes needed for the cluster need to be in the same object otherwise we have to add versioning to both objects18:05
Dragostrigazi: When we flatten the attributes, both CTs and Clusters will have the same attributes, so we don't need the ClusterTemplate table18:05
jvgrantit is not a hard change, just something we need to do first to make this a lot easier to support both v1 and the future changes18:06
strigaziwait18:06
strigaziso when I do ct-create it will right the cluster-table?18:06
Dragostrigazi: Well, with the versioning we're talking about I think it would make sense to have at least a ClusterTemplate table (different than the current one) and a ClusterAttribute table, so yes18:07
DragoIf we do not implement versioning, it would only write to the table that holds the attributes18:08
strigaziok, so we can't decouple the work :) That's a big difference :)18:08
*** Jeffrey4l has quit IRC18:08
DragoI think that putting things like parent and version (for CT versioning) in the table with the attributes would not be a good choice18:09
strigaziWe want the attribute table for the locking field?18:09
jvgrantthe other question is will v1 api support versioning or will only the v2 api support it?18:10
Dragostrigazi: No, for the reason I just mentioned. If we have things that are CT-only and Cluster-only all in the same table, that doesn't seem like a good DB schema to me18:10
strigaziNot really, no18:11
Dragostrigazi: So break the information up into 3 tables: ClusterAttributes, ClusterTemplate, and Cluster18:11
strigaziQuestion18:11
Dragoand in my opinion, ParentTemplate ;)18:11
strigazicould we have a policy for the CT and C only attrs?18:11
strigaziA per driver policy18:11
Dragostrigazi: What do you mean?18:11
Dragostrigazi: The only attributes that I have in mind are public, version, parent (all CT-only) and stack ID, stack status, etc (Cluster-only)18:12
*** vijendar_ has quit IRC18:12
strigazieach can have a policy file to dictate what is CT and C only and also dictate locking18:13
strigazino18:13
strigaziI'm not sure about this18:13
jvgrantany values in CT or C should only be magnum overhead stuff not any values used by the clusters themselves. Those should all be the same between18:14
jvgrantthat is why the original plan was the there was only 1 cluster table that had flags that indicated if it was a template or actual cluster18:15
strigaziWhy not just copy over?18:15
jvgrantpersonally i still like that idea best.  there would be only 2 tables in the end: Clusters and NodeGroups18:16
jvgranttemplates would just use the same entries just with a flag indicating they are templates18:16
jvgrantsince they share 95% the same values18:16
strigaziFor versioning we definately need the CT table18:16
jvgrantwhich is why Drago suggested splitting the shared attributes out into their own table18:17
jvgrantso CT and Cluster just have the differences, and link to the attributes table entry18:18
strigaziIs this in the spec?18:18
jvgrantnot yet18:18
jvgrantthis is what we started yesterday after realizing we needed the versions :)18:18
strigaziIMO.18:18
strigaziCT, C, NGT and NG18:19
strigaziKeep in mind that the user will have the same experience as in the spec18:19
strigaziYes, there is duplication18:19
jvgrantthis is all the background implementation18:20
strigazibut we keep thing really clean and very safe18:20
strigaziyeap18:20
*** vijendar_ has joined #openstack-containers18:20
DragoDuplicating 40 fields is not clean18:20
jvgrantit means that any change has to be made in multiple tables18:21
strigaziIt is, since you manage them in a very different way18:21
DragoAre you saying that CT and C tables should have all the attributes18:21
jvgrantwe dont' have that right now because the templates are really separate things18:21
strigaziOnly the common, they are 40?18:22
*** jmckind has quit IRC18:22
jvgrantthere are a lot, and we keep adding more18:22
Dragostrigazi: Yes, the idea is that the attributes are all the same between C and CT. Things like stack information doesn't count18:23
strigazicounting18:23
jvgranti think the common attributes entry is a good idea if we want separate CT and C tables18:23
jvgrantit means when we add an attribute we only have to update one table and get it in both template and cluster18:24
jvgrantor modify/delete/rename etc...18:24
DragoSafety can be actually be achieved by going with ClusterAttributes that get linked to from the Cluster and ClusterTemplate tables, rather than only an is_template field18:25
strigazi2718:25
DragoIf you're talking about things like mistakenly deleting a cluster when you meant a clustertemplate if Magnum has a logic bug18:25
strigazihaving the attr table is a very bold move and is an optimization IMO18:27
DragoFrom a quick count, I see 42, but anyway18:27
jvgranti think you 2 are talking about wanting the same thing. With the slight difference of Drago wanting the attr table for easier updates long term18:27
jvgrantboth create separate CT and C tables. only difference is if the values are in that table or linking to a separate entry18:28
DragoI don't know, to me it sounds like strigazi is advocating having all the attributes in both a Cluster and ClusterTemplate table. Am I confused?18:28
strigazino18:29
strigaziI mean that's what I'm saying18:29
strigaziI added the entries in the etherpad18:30
strigaziwhich ones am I missing?18:30
strigazi26 actually18:30
strigazicluster will have whatever it has plus these ones18:31
strigazi26 are the common18:31
DragoOh I see, I counted the stack output ones18:31
Drago:)18:32
jvgrantyou need the cluster ones as well18:32
Dragojvgrant: But not all of the ones you pasted18:33
jvgrantok, not all, but there are a few more, is what i am saying18:33
jvgranteither way the list a decent. i think it is a good optimization to have them shared18:34
DragoI'm just listing everything that'd be in the table. They're not all user-defined attributes18:34
*** GB21 has quit IRC18:34
*** vijendar_ has quit IRC18:35
strigaziA nova instance has 64 fields18:35
*** vijendar_ has joined #openstack-containers18:35
strigaziok. we are a bit stuck now, what I propose is18:37
strigazito describe both in the spec as an alternative18:37
strigaziwe can discuss it with the team18:38
jvgrantagreed, i think writing it out will help and get some more feedback18:38
jvgrantwe need to do this part soon as this will be holding up other things18:39
Dragostrigazi, jvgrant: It might be good to talk about implementation steps for all this work now18:39
strigaziI can't continue for long guys, it's 19:40 here18:40
Dragostrigazi: jvgrant and I have tenatively planned to break the NodeGroup spec into at least two specs (flattening attributes and nodegroups themselves), with a versioning spec based upon the flattening spec in between18:40
jvgrantyeah, thanks for staying on for this discussion18:40
Dragostrigazi: No problem, you're awesome18:41
Dragostrigazi: And also propose a spec for the changes to the heat templates18:41
strigazi:) np, we can plan this and in max two days have a plan18:41
strigaziSo, which is the first spec?18:41
jvgrantflattening seems liek the one we need first18:42
Dragostrigazi: What we'd like to do is figure out the work required to have the data model and heat template structure that will allow us to manage clusters in v2 as early as possible18:42
jvgrantit is partially in the nodegroup spec, but not the attr table stuff that we discussed18:42
DragoAnd then, at whatever pace, layer on the actual implementation18:42
strigaziTo flatten thing we need to decide about the attr table?18:43
strigaziTo flatten things we need to decide about the attr table?18:43
Dragostrigazi: I think it would be good, but not 100% necessary18:44
Dragostrigazi: Most of the data model changes will be reorganization of data that is already there18:44
strigaziWhich part is it?18:45
strigaziData Model Impact ?18:45
Dragostrigazi: For example, we already have a master and minion nodegroup, we can break that out into the nodegroup table. Also, we can consider cluster templates right now to be simply CTs with a single version.18:45
*** vijenda__ has joined #openstack-containers18:45
Dragostrigazi: yes18:45
Dragostrigazi: I haven't looked deeply into it, but new data would be the nodegroup ID, for which there is currently nothing18:46
*** vijendar1 has joined #openstack-containers18:46
Dragostrigazi: Then there is changing the heat templates so that they can be eventually manipulated by the v2 API (adding/removing nodegroups)18:46
*** vijendar_ has quit IRC18:47
DragoSo essentially, I think priority should be placed on adding missing information and code to fill them in with values that will eventually have meaning, and the heat template changes18:47
*** vijendar has quit IRC18:48
DragoAll of the other data model changes can probably be done in any order. But for simplicity's sake, it might be a good idea to write the specs in a way they assume work from a previous spec has been done18:48
Dragojvgrant and I were thinking data model changes for flattening attributes, then versioning, then nodegroups18:49
DragoI think that's all I wanted to say18:50
jvgrantDrago: did you want me to write up one of those specs while you work on the other?18:51
jvgranti can do the versioning one with both options18:52
strigaziWould it be a big overehad to write both options ?18:52
Dragojvgrant: Sure. I figure we'll coordinate on it enough that we'll both push patches to all of them18:52
Dragostrigazi: For flattening and versioning, I don't think so18:52
jvgrantyeah, just helps us split up getting them started18:52
Dragostrigazi: The differences seem pretty constrained18:53
jvgrantok, i'll get started on the versioning one after lunch18:53
DragoOkay, I'll do the flattening one then18:53
strigaziSo you will write for sections? Two for nodegroups and two for versioning?18:53
strigaziSo you will write four sections? Two for nodegroups and two for versioning?18:53
Dragostrigazi: I'm not sure what you mean. I thought you were talking about the options for attr table or not18:54
Dragoand ParentTemplate or not18:54
strigaziYes18:54
strigaziwait18:54
strigaziTwo options for the Data Model, with or without the attr table. And two options for versioning with or without the attr table18:56
Dragostrigazi, jvgrant: I kind of think that we should pick one of the options as the one that specs can be based off of. For example, pick the attr table one as the basis for the versioning spec. If the alternative gets accepted, update the spec18:56
strigaziTwo options for the Data Model, with or without the attr table. And two options for versioning with or without the Parent table18:56
jvgrantStrigazi: yes18:57
strigaziI can do tomorrow a separate section for versioning without the attr table18:57
strigazito have it all18:57
DragoSo that means that the NodeGroup spec will have four different sections in it?18:57
jvgrantDrago: i think the versioning won't need to care about the attr table decision18:57
*** adrian_otto has quit IRC18:58
Dragojvgrant: You're probably right18:58
strigaziok,18:59
strigaziDo it like this then: Two options for the Data Model, with or without the attr table. And two options for versioning with  or without the Parent table18:59
strigaziI'll see it tomorrow and we can discuss it19:00
jvgrantok19:00
jvgrantthanks again for staying on late strigazi19:00
strigazinp, Can you do it early (reasonably)19:00
jvgrantwill try :)19:01
strigazijvgrant, You are in the timezone of Austin?19:01
DragoI will try too. Of course, it won't be as hard for me, since jvgrant is two hours behind19:01
strigaziPhoenix?19:02
jvgrantyep19:02
strigazi9am at phoenix is it ok?19:03
jvgrantyeah19:03
Dragostrigazi: Are you creating an event invite?19:03
strigaziIn google calendar if you have something better you can do it19:04
Dragostrigazi: I can email one out19:04
strigazibetter19:04
Dragostrigazi: Will google calendar email me?19:04
DragoOkay, I will do it19:04
strigaziless google19:04
Dragojvgrant: Are you GMT-4?19:05
Drago*UTC-419:05
strigaziGMT-719:06
jvgrant-719:06
Dragooh19:06
Dragoaha, duh19:06
DragoI'm bad at this19:06
jvgrantuntil sunday that is :)19:06
*** chhavi has quit IRC19:07
strigaziMay I send it, I want to check what happens19:07
Dragostrigazi, jvgrant: I sent it19:08
strigaziok19:08
jvgrantthanks19:08
strigazithe time is correct19:08
strigaziSee you tomorrow19:08
strigazibye19:09
*** strigazi is now known as strigazi_AFK19:09
*** dave-mccowan has quit IRC19:11
*** Administrator__ has joined #openstack-containers19:11
*** zhugaoxiao has quit IRC19:15
*** vijendar1 has quit IRC19:19
*** vijenda__ has quit IRC19:19
openstackgerritRandall Burt proposed openstack/magnum: [WiP] Add cluster driver encapsulation spec  https://review.openstack.org/38983519:19
*** vijendar has joined #openstack-containers19:20
openstackgerritRandall Burt proposed openstack/magnum: [WiP] Add cluster driver encapsulation spec  https://review.openstack.org/38983519:21
*** vijendar has quit IRC19:22
*** vijendar has joined #openstack-containers19:28
*** anushkrishnamurt has quit IRC19:28
*** vijendar_ has joined #openstack-containers19:28
*** dave-mccowan has joined #openstack-containers19:32
*** chetna has quit IRC19:34
*** rcernin has joined #openstack-containers19:41
*** apuimedo has joined #openstack-containers19:43
*** apuimedo has quit IRC19:47
*** adrian_otto has joined #openstack-containers20:00
*** JoseMello has quit IRC20:02
*** vijendar has quit IRC20:03
*** vijendar_ has quit IRC20:03
*** vijendar has joined #openstack-containers20:04
*** vijendar1 has joined #openstack-containers20:08
*** vijendar has quit IRC20:13
*** vijendar1 has quit IRC20:13
*** vijendar has joined #openstack-containers20:19
*** vijendar1 has joined #openstack-containers20:24
*** askb has joined #openstack-containers20:27
openstackgerritRandall Burt proposed openstack/magnum: [WiP] Add cluster driver encapsulation spec  https://review.openstack.org/38983520:29
openstackgerritRandall Burt proposed openstack/magnum: [WiP] Add cluster driver encapsulation spec  https://review.openstack.org/38983520:30
*** vijendar has quit IRC20:33
*** vijendar1 has quit IRC20:33
*** vijendar has joined #openstack-containers20:33
*** vijendar has quit IRC20:35
*** vijendar has joined #openstack-containers20:38
*** vijendar1 has joined #openstack-containers20:40
openstackgerritRandall Burt proposed openstack/magnum: [WiP] Add cluster driver encapsulation spec  https://review.openstack.org/38983520:43
*** vijendar1 has quit IRC20:45
*** vijendar_ has joined #openstack-containers20:45
*** vijendar has quit IRC20:45
openstackgerritMerged openstack/magnum: Move cluster delete method to driver  https://review.openstack.org/38774820:46
*** vijendar_ has quit IRC20:48
openstackgerritRandall Burt proposed openstack/magnum: [WiP] Add cluster driver encapsulation spec  https://review.openstack.org/38983520:52
openstackgerritRandall Burt proposed openstack/magnum: Add cluster driver encapsulation spec  https://review.openstack.org/38983520:52
*** dfflanders has joined #openstack-containers20:54
*** srwilkers has quit IRC20:58
*** vijendar has joined #openstack-containers20:59
*** vijendar_ has joined #openstack-containers20:59
*** absubram has quit IRC21:12
*** vijendar_ has quit IRC21:12
*** vijendar has quit IRC21:13
*** chetna has joined #openstack-containers21:13
*** vijendar has joined #openstack-containers21:14
*** vijendar1 has joined #openstack-containers21:15
*** chetna has quit IRC21:16
*** chetna has joined #openstack-containers21:16
*** vijendar has quit IRC21:26
*** vijendar1 has quit IRC21:28
*** chris_hultin is now known as chris_hultin|AWA21:30
*** vijendar1 has joined #openstack-containers21:30
*** vijendar_ has joined #openstack-containers21:31
Dragoadrian_otto: http://i.imgur.com/mjDFAed.png21:35
*** adrian_otto has quit IRC21:36
randallburtnice diagram21:39
randallburtDrago:  but cloud init doesn't talk directly to heat software config agents. Just does some boostrap configuration wrt the transport for collect-config21:40
Dragorandallburt: I semi-blindly redid what's on the Magnum wiki21:40
DragoLet me look21:40
randallburtDrago:  after that, the config agents talk with heat via the transport21:41
Dragorandallburt: It needs to be updated more, really. It's missing Mesos and technically the Heat agent isn't even there21:42
*** dimtruck is now known as zz_dimtruck21:44
randallburtDrago:  no? what's "Heat Config Elements" then?21:44
Dragorandallburt: Beats me21:45
*** zz_dimtruck is now known as dimtruck21:45
Dragorandallburt: Here's what it looks like now https://wiki.openstack.org/wiki/Magnum#Architecture21:46
*** jerrygb has quit IRC21:46
*** vijendar1 has quit IRC21:47
*** vijendar has joined #openstack-containers21:47
randallburtDrago:  yeah, don't quite understand that part then. If you're not using software deployments, then you'd just have cloud-init configure the coe/instance directly21:48
randallburtDrago:  and if you are, then the config stuff talks between Heat and the coe21:48
*** vijendar_ has quit IRC21:49
*** vijendar1 has joined #openstack-containers21:49
openstackgerritStephen Watson proposed openstack/magnum: [WIP] Adds support for non-ID suffix  https://review.openstack.org/38981121:49
Dragorandallburt: Right. I'll update it21:52
Dragorandallburt: It's the former for swarm and k8s21:52
randallburtDrago:  then no updates without replacing the host :(21:53
Dragorandallburt: Well, it IS an atomic host21:53
randallburtDrago:  lol, but yeah, they're also easy to update "atomically" but not via cloud-init…21:53
Dragorandallburt: True. You're talking about rebasing the host?21:54
randallburtDrago:  yep21:57
randallburtDrago:  still requires a bounce, but that's better than a full rebuild21:57
*** apuimedo has joined #openstack-containers22:01
*** vijendar has quit IRC22:04
*** vijendar has joined #openstack-containers22:04
*** vijendar1 has quit IRC22:04
*** jerrygb has joined #openstack-containers22:04
*** jerrygb has quit IRC22:06
*** vijendar1 has joined #openstack-containers22:06
*** vijendar has quit IRC22:14
*** vijendar1 has quit IRC22:14
openstackgerritMerged openstack/magnum: Use function is_valid_mac from oslo.utils  https://review.openstack.org/38952822:15
*** vijendar has joined #openstack-containers22:16
*** Drago has quit IRC22:17
*** randallburt has quit IRC22:17
*** vijendar1 has joined #openstack-containers22:19
openstackgerritStephen Watson proposed openstack/magnum: [WIP] Adds support for non-ID suffix  https://review.openstack.org/38981122:20
*** vijendar has quit IRC22:26
*** vijendar_ has joined #openstack-containers22:26
*** vijendar1 has quit IRC22:27
openstackgerritJaycen Grant proposed openstack/magnum: [WIP]Spec for adding template versions  https://review.openstack.org/39232722:27
*** vijendar has joined #openstack-containers22:31
*** rcernin has quit IRC22:31
*** vijendar has quit IRC22:35
*** vijendar_ has quit IRC22:36
*** rafael__ has quit IRC22:42
*** EricGonc_ has quit IRC22:51
*** Drago5 has joined #openstack-containers22:52
*** EricGonczer_ has joined #openstack-containers22:54
*** sergmelikyan has quit IRC22:58
*** sergmelikyan has joined #openstack-containers22:58
*** sergmelikyan has quit IRC23:03
*** Drago5 is now known as Drago23:04
*** Drago has quit IRC23:32
*** yuanying has joined #openstack-containers23:37

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!