Tuesday, 2016-11-15

*** Dusty has joined #craton00:08
*** jovon has quit IRC00:37
*** Dusty has quit IRC00:49
*** Dusty has joined #craton01:26
*** Dusty1 has joined #craton01:29
*** Dusty has quit IRC01:30
*** Dusty1 has quit IRC01:47
*** Dusty has joined #craton02:16
*** syed__ has quit IRC02:25
*** rainya has joined #craton02:57
*** rainya has quit IRC03:02
*** rainya has joined #craton03:03
*** rainya has quit IRC03:10
*** mhayden has quit IRC03:12
*** mhayden has joined #craton03:13
*** rainya has joined #craton03:16
*** Dusty has quit IRC03:23
*** rainya has quit IRC03:32
*** Dusty has joined #craton03:32
*** valw has joined #craton03:36
*** Dusty has joined #craton03:41
*** valw_ has joined #craton03:45
*** valw has quit IRC03:47
*** Dusty has joined #craton03:47
*** Dusty has joined #craton03:49
*** Dusty has joined #craton03:53
*** Dusty has joined #craton03:56
*** Dusty has joined #craton03:59
*** Dusty has quit IRC03:59
*** Dusty has joined #craton04:01
*** Dusty has quit IRC04:01
*** Dusty has joined #craton04:02
*** Dusty has joined #craton04:06
*** Dusty has joined #craton04:08
*** Dusty has joined #craton04:09
*** Dusty has quit IRC04:09
*** Dusty has joined #craton04:10
*** Dusty has quit IRC04:10
*** Dusty has joined #craton04:12
*** Dusty has joined #craton04:13
*** Dusty has joined #craton04:14
*** valw_ has quit IRC04:40
*** syed__ has joined #craton05:43
*** tojuvone has joined #craton06:21
*** tojuvone_ has joined #craton06:21
*** tojuvone_ has quit IRC06:21
*** Mudpuppy has quit IRC06:37
*** Mudpuppy has joined #craton07:08
*** Mudpuppy has quit IRC07:13
*** syed__ has quit IRC07:55
sulojimbaker: yeah i think we can do what we are doing .... i will need to spend time on the image a bit .. and bring the time down to low under 3 mins09:26
suloso lets not worry about tempest or other stuff just yet09:26
suloi am going to get the base setup done first .. then work on the image later09:27
*** git-harry has quit IRC09:31
*** git-harry has joined #craton09:31
*** klindgren has quit IRC09:58
*** klindgren has joined #craton09:59
*** tojuvone has quit IRC10:54
*** VW has joined #craton12:41
*** VW has quit IRC12:57
*** VW has joined #craton12:57
*** VW has quit IRC13:04
*** VW has joined #craton13:04
*** VW has quit IRC13:18
sulosoo...13:22
sulofor these functional tests .. i would like to use python-cratonclien ;)13:22
sulois it doable right now ? I havent looked at it recently to know ..13:23
suloactually looks doable .. atlest to start13:29
*** tojuvone has joined #craton13:34
sigmavirussulo: totes13:36
*** Dusty has joined #craton13:42
sulosigmavirus: the only thing is inventory is still per region though13:47
sulorather than per project13:47
sigmavirussulo: well it's both13:47
sulosigmavirus: you are changing that right ?13:47
suloboth ?13:47
sigmavirusbut an Inventory object is per-region13:48
suloah13:48
sigmaviruswell you can't access another project's information right now13:48
sigmavirusthat will only strengthen when we add in RBAC13:48
sulosigmavirus: so that wasnt my concern, although thats very important13:49
sulothe way it is right now13:49
suloregions has different object model than the rest .. i can do inventory.cells13:49
sigmaviruscorrect13:49
sulobut region get all for example would be different ?13:49
sigmavirusinventory.cells.list13:49
sigmavirusright, you'd create your Client(..)13:50
sigmavirusthen do client.regions.list()13:50
*** Mudpuppy has joined #craton13:50
sigmavirusHonestly, I'm still not sure why jimbaker and chrisspencer wanted to not have cells/hosts/etc. hang off a region object but *shrug*13:50
suloright .. thats my point .. if we have inventory13:50
sulothen inventory should work for all13:50
suloyeah that makes no sense at all13:50
sigmavirussulo: what makes no sense at all?13:51
sulohaving inventory exclude region13:51
sulobecause its not the top object in inventory13:51
suloproject is13:51
suloanyway .. i thought you were changing that to have project as the top level item13:52
sigmavirussulo: so something like project = client.projects.get('uuid'), project.regions.list(), project.hosts.list(region_id=1)?13:53
sigmavirusor something else?13:53
suloyeah if we are doing that .. then that works because it gives a consistent way to access resources13:53
sigmavirussulo: the thing is, you can't specify a particular project_id any longer for requests, we removed that13:54
sigmavirusso you can't access the regions/hosts for a project_id that you aren't authenticating with iirc13:54
suloright, all i am saying is .. i dont understand why we have the inventory object13:55
sigmavirussulo: I've been saying that for a while :)13:55
sigmavirusright now, caching seems to be a priority so I'm working on that first13:55
sulogotcha13:55
sigmavirusI seemed to be the only person who disliked the current API design13:57
sigmavirusI think the sole purpose of the inventory object is to prevent you having to constantly specify the region id13:57
sigmavirusbut that seems like an ergonomic consideration for the higher level API that jimbaker wants13:58
sulook, i dont see the benifit, but there must be a reason that chrisspencer and jimbaker wanted that14:00
sulowe can discuss that later today14:00
sigmavirusyep14:01
*** valw has joined #craton14:41
*** valw has quit IRC14:43
*** valw has joined #craton14:43
*** valw has quit IRC15:04
*** valw has joined #craton15:07
*** syed__ has joined #craton15:10
jimbakersulo, sigmavirus - sounds good about finalizing that api. i'm confused at this point ;), hopefully today's meeting will clear things up15:25
jimbakerper our earlier discussion, we are having today's call at 1700 UTC. it's been current in the topic for a while here, but finally revised outlook. my earlier attempt, probably because i used to have my calendar in UTC15:25
jimbakerand outlook just pretends to know about timezones15:26
jimbakermy earlier attempt *failed* to update15:26
jimbakerso delete, insert vs update :)15:27
jimbakersulo, re functional testing - yes do use the cratonclient. i think this should be the point of any such testing15:27
jimbakerbtw, here's one functional test that i have been running as a smoke test https://gist.github.com/jimbaker/df47cabfefa6d6985af9029449b589df15:30
jimbaker"functional test"15:30
jimbakerbut my assumption has been: we have the fixture data from fake data; and we are able to interact with it, then make assertions, using the craton client. simple enough15:31
*** valw has quit IRC15:42
*** valw_ has joined #craton15:43
*** valw_ has quit IRC15:50
*** valw has joined #craton15:54
*** valw_ has joined #craton15:55
*** klindgren_ has joined #craton15:56
*** klindgren has quit IRC15:58
*** valw_ has quit IRC15:58
*** valw has quit IRC15:59
syed__Hi guys15:59
syed__what time will be the meeting today ?15:59
syed__11 ?15:59
*** valw has joined #craton16:01
*** valw has quit IRC16:02
*** valw has joined #craton16:04
*** jovon has joined #craton16:09
*** Mudpuppy_ has joined #craton16:23
*** Mudpuppy has quit IRC16:26
sigmavirussyed__: 11 Central? Yes16:29
*** valw has quit IRC16:38
*** valw has joined #craton16:40
*** valw has quit IRC16:42
*** valw has joined #craton16:42
*** valw has quit IRC16:43
*** valw has joined #craton16:44
jimbakersyed__, 1700 UTC for tues/thurs. i like https://www.timeanddate.com/ to put this into a specific timezone (for you 11:00a CT), but this doesn't work so well as we scale out the team in different locales16:50
jimbakerhence using UTC for all times16:51
*** Mudpuppy_ is now known as Mudpuppy16:54
sigmavirusclient caching is a turning out to be a rabbit hole xD16:56
jimbakersigmavirus, oh. well let's really discuss that momentarily16:57
sigmavirusjimbaker: so much to talk about :P16:57
jimbakeryeah, it's good16:57
jimbakersulo, client/ecosystem meeting on vidyo?17:01
sigmavirussulo: http://specs.openstack.org/openstack/openstack-specs/specs/cors-support.html will be necessary for Horizon17:22
*** valw has quit IRC17:33
*** valw has joined #craton17:43
*** rainya has joined #craton17:44
sigmavirussulo: for doing listings, we could probably just checkum the resource table18:01
jovonhey sigmavirus18:07
sigmavirushey jovon18:07
jovonsince you're working on API's would you you mind if "look over your shoulder" so i can get a better understanding of the process18:08
sigmavirusjovon: you mean working on the client or the craton API itself or ... ?18:08
jovoni was referring to craton API but learning both could never hurt if you don't mind18:09
jovonI really want to understand your methodology18:10
jovonto see how an expert would do it. am i making sense?18:10
sigmavirusI don't mind at all18:11
sigmavirusYep you are :)18:11
jovonawesome! :) thank you18:12
sulosigmavirus: jimbaker: git-harry: https://review.openstack.org/#/c/397872 its far from ready .. but wanted to pass this to see how y'all feel about the general direction of this patch18:14
sulojovon: syed__^18:14
suloideas/reviews are welcome ;)18:15
sigmavirussulo: so, for what it's worth, "tearDownClass" (really tearDown*) are not guaranteed to run so you want to use addCleanup18:16
sulosigmavirus: thanks, will do18:16
sigmaviruswait a second, addCleanup might only be to correspond to setUp18:17
sigmavirusnot setUpClass18:17
suloyeah .. i think we need on module level actually18:17
suloeven setupcalss is prolly not good enough18:18
suloso ill change taht18:18
sigmavirusnevermind there's nothing similar18:18
sigmavirushttp://specs.openstack.org/openstack/openstack-specs/specs/cors-support.html18:18
sigmavirusgah wrong link18:18
sigmavirushttps://docs.python.org/3/library/unittest.html#class-and-module-fixtures18:18
sigmavirusSpecifically: "Note that shared fixtures do not play well with [potential] features like test parallelization and they break test isolation. They should be used with care."18:19
sigmavirusand testr does do parallelization18:19
suloi was going to switch to testr18:20
sulo:|18:20
sigmavirusyou should switch to it :/18:20
jovonSulo  will take a look  after a quick lunch18:20
sulosigmavirus: hehe, yeah18:21
sulojovon: thanks18:21
sigmavirussulo: jimbaker https://review.openstack.org/39787518:22
jimbakersulo, thanks i will take a look at that wip patch re functional testing18:23
jimbakerian, thanks for the ci patch, looks good18:24
*** Dusty has quit IRC18:30
*** harlowja has quit IRC18:38
*** Dusty has joined #craton18:39
*** harlowja has joined #craton19:06
*** valw has quit IRC19:13
*** valw has joined #craton19:26
*** valw has quit IRC19:31
*** rainya has quit IRC19:33
*** valw has joined #craton19:50
*** valw_ has joined #craton20:00
*** valw_ has quit IRC20:02
*** valw__ has joined #craton20:02
*** valw has quit IRC20:03
*** Dusty1 has joined #craton20:03
*** Dusty has quit IRC20:04
sigmavirusjimbaker: sulo so, in our functional tests, we can configure MySQL to log any queries that don't use an index and analyze them for full table scans (if we want to be paranoid)20:08
jimbakersigmavirus, +1, great idea20:08
sigmavirusI worked on a project as a consultant that did this in their tests20:08
sigmavirusI didn't set it up though, so we should probably put that off for a while20:08
sigmavirusjimbaker: better yet20:13
sigmavirusthere are mysql status counters for stuff like this20:13
sigmavirusif we just restart mysql between tests then it'll reset20:13
jimbakersigmavirus, so collect at end as a report20:13
sigmavirus"Select_scan" will count how many full table scans there are and "Select_full_join" will count full table scans against joined tables which have even worse performance20:14
jimbakermakes sense. i fully expect we may have some queries (rare) that should be table scans20:14
jimbakerbut if we see variance, that's what we care about20:14
*** valw__ has quit IRC20:22
*** valw has joined #craton20:24
sigmavirusjimbaker: sure, those we exclude from this kind of chec20:38
sigmavirus*check20:38
jimbakeryeah, we can just reset counters around our expectations20:38
sigmavirusyarp20:41
jimbakerright, using flush status, http://dev.mysql.com/doc/refman/5.7/en/flush.html20:41
jimbakeryeah, so this should just work20:42
*** valw has quit IRC21:00
*** valw has joined #craton21:01
*** Dusty1 has quit IRC21:03
*** Dusty has joined #craton21:07
sigmavirushttps://review.openstack.org/397957 fwiw21:28
sigmaviruslater y'all21:28
*** valw has quit IRC21:30
*** valw has joined #craton21:32
*** valw has quit IRC21:51
*** harlowja has quit IRC21:55
*** jovon has quit IRC21:57
*** valw has joined #craton22:01
*** valw has quit IRC22:03
*** valw has joined #craton22:03
*** harlowja has joined #craton22:13
*** Dusty has quit IRC22:14
*** Dusty has joined #craton22:28
*** Dusty has quit IRC22:28
*** Dusty has joined #craton22:30
*** valw has quit IRC22:42
*** valw has joined #craton22:43
*** valw has quit IRC22:45
*** valw has joined #craton22:45
*** Dusty has joined #craton23:00
*** valw has quit IRC23:05
*** valw has joined #craton23:07
jimbakerDusty, sigmavirus, sulo, so i will get in a submission in for rax.io on craton, given our multicloud discussion at today's meeting. deadline is nov 3023:09
jimbakerDusty, i expect to also bring this up with the platform architecture team this friday. one of my peers on the group is working on supporting FAWS, so this will give me further insight into technical reqs23:10
jimbakeralthough i expect it's going to be mostly, how do we model AWS on craton, vs really much in the way of extension needed for craton. so anything we are collecting can be captured as variables; but the real interesting thing is when we look at aggregating aws service info using our virtualized variable model; and what audit/remediation looks like23:12
*** valw has quit IRC23:15
*** valw has joined #craton23:16
*** valw has quit IRC23:19
*** Dusty has quit IRC23:25
*** valw has joined #craton23:30
*** valw has quit IRC23:34
*** Mudpuppy has quit IRC23:41
*** valw has joined #craton23:49
*** valw has quit IRC23:50

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!