Friday, 2014-01-31

*** amitgandhi has joined #openstack-marconi00:00
*** amitgandhi has quit IRC00:00
*** amitgandhi has joined #openstack-marconi00:01
*** amitgandhi has quit IRC00:01
*** amitgandhi has joined #openstack-marconi00:02
*** amitgandhi has quit IRC00:02
*** amitgandhi has joined #openstack-marconi00:03
*** amitgandhi has quit IRC00:03
*** amitgandhi has joined #openstack-marconi00:04
*** amitgandhi has quit IRC00:04
*** amitgandhi has joined #openstack-marconi00:05
*** amitgandhi has quit IRC00:05
*** amitgandhi has joined #openstack-marconi00:06
*** amitgandhi has quit IRC00:06
*** amitgandhi has joined #openstack-marconi00:07
*** amitgandhi has quit IRC00:07
*** amitgandhi has joined #openstack-marconi00:08
*** amitgandhi has quit IRC00:08
openstackgerritKurt Griffiths proposed a change to openstack/marconi: fix(wsgi): Cleanup limit config options  https://review.openstack.org/6759700:08
*** amitgandhi has joined #openstack-marconi00:09
*** amitgandhi has quit IRC00:09
*** amitgandhi has joined #openstack-marconi00:10
*** amitgandhi has quit IRC00:10
*** amitgandhi has joined #openstack-marconi00:11
*** amitgandhi has quit IRC00:11
*** amitgandhi has joined #openstack-marconi00:12
*** amitgandhi has quit IRC00:12
*** amitgandhi has joined #openstack-marconi00:12
*** amitgandhi has quit IRC00:13
*** amitgandhi has joined #openstack-marconi00:14
*** amitgandhi has quit IRC00:14
*** amitgandhi has joined #openstack-marconi00:15
*** amitgandhi has quit IRC00:15
*** amitgandhi has joined #openstack-marconi00:15
*** amitgandhi has quit IRC00:16
*** amitgandhi has joined #openstack-marconi00:16
*** amitgandhi has quit IRC00:17
*** amitgandhi has joined #openstack-marconi00:17
*** amitgandhi has quit IRC00:18
*** amitgandhi has joined #openstack-marconi00:18
*** amitgandhi has quit IRC00:19
*** amitgandhi has joined #openstack-marconi00:19
*** amitgandhi has quit IRC00:20
*** amitgandhi has joined #openstack-marconi00:20
*** amitgandhi has quit IRC00:21
*** amitgandhi has joined #openstack-marconi00:21
*** amitgandhi has quit IRC00:22
*** amitgandhi has joined #openstack-marconi00:22
*** amitgandhi has quit IRC00:23
*** amitgandhi has joined #openstack-marconi00:23
*** amitgandhi has quit IRC00:24
*** amitgandhi has joined #openstack-marconi00:24
*** amitgandhi has quit IRC00:25
*** amitgandhi has joined #openstack-marconi00:25
*** amitgandhi has quit IRC00:26
*** amitgandhi has joined #openstack-marconi00:26
*** amitgandhi has quit IRC00:27
*** amitgandhi has joined #openstack-marconi00:27
openstackgerritKurt Griffiths proposed a change to openstack/marconi: fix(wsgi): Cleanup limit config options  https://review.openstack.org/6759700:27
*** amitgandhi has quit IRC00:28
*** amitgandhi has joined #openstack-marconi00:28
*** amitgandhi has quit IRC00:29
*** amitgandhi has joined #openstack-marconi00:29
*** amitgandhi has quit IRC00:30
*** amitgandhi has joined #openstack-marconi00:30
*** amitgandhi has quit IRC00:31
*** amitgandhi has joined #openstack-marconi00:31
*** amitgandhi has quit IRC00:32
*** amitgandhi has joined #openstack-marconi00:32
*** amitgandhi has quit IRC00:33
*** amitgandhi has joined #openstack-marconi00:33
*** amitgandhi has quit IRC00:33
*** amitgandhi has joined #openstack-marconi00:34
*** amitgandhi has quit IRC00:34
*** amitgandhi has joined #openstack-marconi00:35
*** amitgandhi has quit IRC00:35
*** amitgandhi has joined #openstack-marconi00:36
*** amitgandhi has quit IRC00:36
*** amitgandhi has joined #openstack-marconi00:37
*** amitgandhi has quit IRC00:37
*** amitgandhi has joined #openstack-marconi00:38
*** amitgandhi has quit IRC00:38
openstackgerritKurt Griffiths proposed a change to openstack/marconi: fix(wsgi): Cleanup limit config options  https://review.openstack.org/6759700:39
*** amitgandhi has joined #openstack-marconi00:39
*** amitgandhi has quit IRC00:39
*** amitgandhi has joined #openstack-marconi00:40
*** amitgandhi has quit IRC00:40
*** amitgandhi has joined #openstack-marconi00:41
*** amitgandhi has quit IRC00:41
*** amitgandhi has joined #openstack-marconi00:42
*** amitgandhi has quit IRC00:42
*** amitgandhi has joined #openstack-marconi00:43
*** amitgandhi has quit IRC00:43
*** amitgandhi has joined #openstack-marconi00:44
*** amitgandhi has quit IRC00:44
*** amitgandhi has joined #openstack-marconi00:45
*** amitgandhi has quit IRC00:45
*** amitgandhi has joined #openstack-marconi00:46
*** amitgandhi has quit IRC00:46
*** amitgandhi has joined #openstack-marconi00:47
openstackgerritKurt Griffiths proposed a change to openstack/marconi: fix(wsgi): Cleanup limit config options  https://review.openstack.org/6759700:47
*** amitgandhi has quit IRC00:47
*** amitgandhi has joined #openstack-marconi00:48
*** amitgandhi has quit IRC00:48
*** amitgandhi has joined #openstack-marconi00:49
*** amitgandhi has quit IRC00:49
*** amitgandhi has joined #openstack-marconi00:50
*** amitgandhi has joined #openstack-marconi00:51
*** amitgandhi has quit IRC00:51
*** amitgandhi has joined #openstack-marconi00:52
*** amitgandhi has quit IRC00:52
openstackgerritKurt Griffiths proposed a change to openstack/marconi: fix(wsgi): Cleanup limit config options  https://review.openstack.org/6759700:52
*** amitgandhi has joined #openstack-marconi00:53
*** amitgandhi has quit IRC00:53
*** amitgandhi has joined #openstack-marconi00:54
*** amitgandhi has quit IRC00:54
*** amitgandhi has joined #openstack-marconi00:55
*** amitgandhi has quit IRC00:55
*** amitgandhi has joined #openstack-marconi00:55
*** amitgandhi has quit IRC00:56
*** amitgandhi has joined #openstack-marconi00:56
*** amitgandhi has quit IRC00:57
*** amitgandhi has joined #openstack-marconi00:58
*** amitgandhi has quit IRC00:58
*** amitgandhi has joined #openstack-marconi00:58
*** amitgandhi has quit IRC00:59
*** amitgandhi has joined #openstack-marconi00:59
*** amitgandhi has quit IRC01:00
*** amitgandhi has joined #openstack-marconi01:00
*** amitgandhi has quit IRC01:01
*** amitgandhi has joined #openstack-marconi01:01
*** amitgandhi has quit IRC01:02
*** amitgandhi has joined #openstack-marconi01:02
*** amitgandhi has quit IRC01:03
*** amitgandhi has joined #openstack-marconi01:03
openstackgerritKurt Griffiths proposed a change to openstack/marconi: fix(wsgi): Cleanup limit config options  https://review.openstack.org/6759701:04
*** amitgandhi has joined #openstack-marconi01:04
kgriffstwo problems: 101:05
*** amitgandhi has quit IRC01:05
*** amitgandhi has joined #openstack-marconi01:05
*** amitgandhi has quit IRC01:06
kgriffs1. the way class initialization works, it seems it is possible for a tearDownClass to get called before all the tests that need it are done running01:06
*** amitgandhi has joined #openstack-marconi01:06
openstackgerritKurt Griffiths proposed a change to openstack/marconi: fix(wsgi): Cleanup limit config options  https://review.openstack.org/6759701:06
*** amitgandhi has quit IRC01:07
*** amitgandhi has joined #openstack-marconi01:07
kgriffs2. Sometimes the wsgiref process can take several seconds to start up and be ready to listen. We can fix this by polling the server until we succeed, before carrying on, rather than doing a sleep and hoping it was long enough01:08
*** amitgandhi has quit IRC01:08
kgriffsfwiw, py26 seems to take the longest for the process to spin up01:08
*** amitgandhi has joined #openstack-marconi01:08
*** amitgandhi has quit IRC01:09
*** amitgandhi has joined #openstack-marconi01:09
kgriffswait01:09
kgriffsok, so that number two is vaild for py27 and pypy01:09
kgriffsbut01:09
*** amitgandhi has quit IRC01:09
*** amitgandhi has joined #openstack-marconi01:10
*** amitgandhi has joined #openstack-marconi01:11
*** amitgandhi has quit IRC01:12
kgriffspy26 - getting a broken pipe, which means the server died in the middle of servicing the request01:12
kgriffsso, maybe that is really what is happening for 1.01:12
*** amitgandhi has joined #openstack-marconi01:12
kgriffsi refactored to bring up the server anew for each test01:12
kgriffsso, nevermind about that class teardown idea01:12
kgriffsbut, then, why is the server falling over?01:12
*** amitgandhi has quit IRC01:13
kgriffsbtw - I rigged tox to only run a single test, to eliminate the possibility of the problem being due to side affects from other tests01:13
*** amitgandhi has joined #openstack-marconi01:13
*** amitgandhi has quit IRC01:14
*** amitgandhi has joined #openstack-marconi01:14
*** amitgandhi has quit IRC01:15
*** amitgandhi has joined #openstack-marconi01:15
*** amitgandhi has quit IRC01:16
*** amitgandhi has joined #openstack-marconi01:16
*** amitgandhi has quit IRC01:17
*** amitgandhi has joined #openstack-marconi01:18
*** amitgandhi has joined #openstack-marconi01:18
*** amitgandhi has quit IRC01:19
*** amitgandhi has joined #openstack-marconi01:19
*** amitgandhi has joined #openstack-marconi01:20
*** amitgandhi has quit IRC01:21
*** amitgandhi has joined #openstack-marconi01:21
kgriffsmy recommendation is to abandon this approach to testing - it is too finicky. We will just need to simulate the WSGI requests for functional tests, and rely on tempest for doing real integration testing where we stand up a server process01:21
*** amitgandhi has quit IRC01:22
kgriffsgood night01:22
*** amitgandhi has joined #openstack-marconi01:22
*** amitgandhi has quit IRC01:23
*** amitgandhi has joined #openstack-marconi01:23
*** amitgandhi has quit IRC01:24
*** amitgandhi has joined #openstack-marconi01:24
*** amitgandhi has joined #openstack-marconi01:25
*** amitgandhi has quit IRC01:25
*** amitgandhi has joined #openstack-marconi01:26
*** amitgandhi has quit IRC01:26
*** amitgandhi has joined #openstack-marconi01:27
*** rossk_ has quit IRC01:27
*** amitgandhi has quit IRC01:27
*** amitgandhi has joined #openstack-marconi01:28
*** amitgandhi has quit IRC01:28
*** amitgandhi has joined #openstack-marconi01:29
*** amitgandhi has quit IRC01:29
*** rossk has joined #openstack-marconi01:29
*** amitgandhi has joined #openstack-marconi01:30
*** haomaiwang has joined #openstack-marconi01:30
*** amitgandhi has quit IRC01:30
*** amitgandhi has joined #openstack-marconi01:31
*** amitgandhi has quit IRC01:31
*** kgriffs is now known as kgriffs_afk01:32
*** amitgandhi has joined #openstack-marconi01:32
*** amitgandhi has quit IRC01:32
*** amitgandhi has joined #openstack-marconi01:33
*** amitgandhi has quit IRC01:33
*** amitgandhi has joined #openstack-marconi01:34
*** amitgandhi has quit IRC01:34
*** haomaiwa_ has quit IRC01:34
*** amitgandhi has joined #openstack-marconi01:35
*** amitgandhi has quit IRC01:35
*** amitgandhi has joined #openstack-marconi01:36
*** amitgandhi has quit IRC01:36
*** amitgandhi has joined #openstack-marconi01:37
*** amitgandhi has quit IRC01:37
*** amitgandhi has joined #openstack-marconi01:38
*** amitgandhi has quit IRC01:38
*** amitgandhi has joined #openstack-marconi01:39
*** amitgandhi has quit IRC01:39
*** amitgandhi has joined #openstack-marconi01:40
*** amitgandhi has quit IRC01:40
*** amitgandhi has joined #openstack-marconi01:41
*** nosnos has joined #openstack-marconi01:41
*** amitgandhi has joined #openstack-marconi01:42
*** amitgandhi has quit IRC01:42
*** amitgandhi has joined #openstack-marconi01:43
*** amitgandhi has quit IRC01:43
*** amitgandhi has joined #openstack-marconi01:43
*** amitgandhi has quit IRC01:44
*** amitgandhi has joined #openstack-marconi01:45
*** amitgandhi has joined #openstack-marconi01:45
*** amitgandhi has quit IRC01:46
*** amitgandhi has joined #openstack-marconi01:46
*** amitgandhi has quit IRC01:47
*** amitgandhi has joined #openstack-marconi01:47
*** amitgandhi has quit IRC01:48
*** amitgandhi has joined #openstack-marconi01:48
*** amitgandhi has quit IRC01:49
*** amitgandhi has joined #openstack-marconi01:49
*** amitgandhi has quit IRC01:50
*** amitgandhi has joined #openstack-marconi01:50
*** amitgandhi has quit IRC01:51
*** amitgandhi has joined #openstack-marconi01:51
*** amitgandhi has quit IRC01:52
*** amitgandhi has joined #openstack-marconi01:52
*** amitgandhi has quit IRC01:53
*** amitgandhi has joined #openstack-marconi01:53
*** amitgandhi has quit IRC01:54
*** amitgandhi has joined #openstack-marconi01:54
*** amitgandhi has quit IRC01:55
*** amitgandhi has joined #openstack-marconi01:55
*** amitgandhi has quit IRC01:56
*** amitgandhi has joined #openstack-marconi01:56
*** amitgandhi has quit IRC01:57
*** amitgandhi has joined #openstack-marconi01:57
*** amitgandhi has quit IRC01:58
*** amitgandhi has joined #openstack-marconi01:58
*** amitgandhi has quit IRC01:59
*** amitgandhi has joined #openstack-marconi01:59
*** amitgandhi has quit IRC02:00
*** amitgandhi has joined #openstack-marconi02:00
*** amitgandhi has joined #openstack-marconi02:01
*** amitgandhi has quit IRC02:02
*** amitgandhi has joined #openstack-marconi02:02
*** amitgandhi has quit IRC02:02
*** amitgandhi has joined #openstack-marconi02:03
*** amitgandhi has quit IRC02:08
*** cpallares has quit IRC02:11
*** balajiiyer1 has joined #openstack-marconi02:29
*** amitgandhi has joined #openstack-marconi02:46
*** rossk has quit IRC02:48
*** amitgandhi has quit IRC02:59
*** alcabrera has joined #openstack-marconi03:18
*** alcabrera|afk has quit IRC03:21
*** rossk has joined #openstack-marconi03:36
*** amitgandhi has joined #openstack-marconi03:54
*** amitgandhi has quit IRC03:58
*** amitgandhi has joined #openstack-marconi04:55
*** balajiiyer1 has quit IRC04:56
*** balajiiyer has joined #openstack-marconi04:56
*** amitgandhi has quit IRC04:59
*** haomaiwang has quit IRC05:09
*** haomaiwang has joined #openstack-marconi05:10
*** balajiiyer has left #openstack-marconi05:23
*** rossk has quit IRC05:28
*** balajiiyer1 has joined #openstack-marconi05:36
*** alcabrera is now known as alcabrera|afk05:43
*** alcabrera|afk has quit IRC05:48
*** amitgandhi has joined #openstack-marconi05:56
*** rossk has joined #openstack-marconi05:59
*** rwsu has quit IRC05:59
*** amitgandhi has quit IRC06:00
*** balajiiyer1 has quit IRC06:02
*** balajiiyer has joined #openstack-marconi06:03
*** rossk has quit IRC06:07
*** balajiiyer1 has joined #openstack-marconi06:28
*** alcabrera|afk has joined #openstack-marconi06:29
*** balajiiyer has quit IRC06:29
*** amitgandhi has joined #openstack-marconi06:56
*** haomai___ has joined #openstack-marconi07:01
*** amitgandhi has quit IRC07:01
*** haomaiwang has quit IRC07:01
*** rossk has joined #openstack-marconi07:21
*** rossk has quit IRC07:39
*** amitgandhi has joined #openstack-marconi07:57
*** amitgandhi has quit IRC08:02
*** reed has joined #openstack-marconi08:35
*** haomai___ has quit IRC08:47
*** haomaiwang has joined #openstack-marconi08:48
*** balajiiyer1 has quit IRC08:54
*** amitgandhi has joined #openstack-marconi08:58
*** amitgandhi has quit IRC09:02
*** flaper87|afk is now known as flaper8709:35
*** amitgandhi has joined #openstack-marconi09:58
*** reed_ has joined #openstack-marconi10:03
*** amitgandhi has quit IRC10:03
*** reed has quit IRC10:04
*** haomaiwang has quit IRC10:39
*** flaper87 is now known as flaper87|afk10:52
*** flaper87|afk is now known as flaper8710:55
*** amitgandhi has joined #openstack-marconi10:59
*** amitgandhi has quit IRC11:04
*** reed_ has quit IRC11:08
*** haomaiwa_ has joined #openstack-marconi11:20
*** amitgandhi has joined #openstack-marconi12:00
*** amitgandhi has quit IRC12:04
*** tedross has joined #openstack-marconi12:37
*** amitgandhi has joined #openstack-marconi13:01
*** amitgandhi has quit IRC13:06
*** haomaiwa_ has quit IRC13:31
*** haomaiwang has joined #openstack-marconi13:32
*** balajiiyer has joined #openstack-marconi13:46
*** amitgandhi has joined #openstack-marconi14:02
*** amitgandhi has quit IRC14:06
*** amitgandhi has joined #openstack-marconi14:09
*** jmckind has joined #openstack-marconi14:11
*** amitgandhi has quit IRC14:14
*** haomai___ has joined #openstack-marconi14:14
*** haomaiwang has quit IRC14:17
*** alcabrera|afk has quit IRC14:21
*** jcru has joined #openstack-marconi14:23
*** nosnos has quit IRC14:37
*** mpanetta has joined #openstack-marconi14:42
*** amitgandhi has joined #openstack-marconi14:44
*** amitgandhi has quit IRC14:45
*** amitgandhi has joined #openstack-marconi14:45
*** alcabrera has joined #openstack-marconi14:47
*** alcabrera has quit IRC14:53
*** alcabrera has joined #openstack-marconi14:55
alcabreragood morning!14:56
flaper87alcabrera: goooooooooooooood morning14:57
flaper87gosh, what a week. I'm so burried with pending things14:58
flaper87:(14:58
alcabrerahang in there, flaper87! :D14:58
*** russellb is now known as rustlebee15:02
*** ametts has quit IRC15:04
*** number80 has joined #openstack-marconi15:05
*** rwsu has joined #openstack-marconi15:13
*** mpanetta has quit IRC15:13
*** mpanetta has joined #openstack-marconi15:14
*** malini is now known as malini_afk15:16
*** vkmc has joined #openstack-marconi15:16
*** vkmc has quit IRC15:16
*** vkmc has joined #openstack-marconi15:16
*** cpallares has joined #openstack-marconi15:44
*** kgriffs_afk is now known as kgriffs15:45
kgriffsgood morning/afternoon15:45
*** flaper87 is now known as flaper87|afk15:47
alcabreragood morning, kgriffs. :)15:48
*** mpanetta has quit IRC15:51
*** mpanetta has joined #openstack-marconi15:51
openstackgerritKurt Griffiths proposed a change to openstack/marconi: fix(wsgi): Cleanup limit config options  https://review.openstack.org/6759715:56
*** caleb_ has joined #openstack-marconi15:58
openstackgerritKurt Griffiths proposed a change to openstack/marconi: WIP: fix(wsgi): Cleanup limit config options  https://review.openstack.org/6759715:59
kgriffsalcabrera: sooo15:59
kgriffsI am just about ready to tear out the functional test server16:00
kgriffsi did a lot of testing on the problem last night16:00
alcabreraI remember reading about this in an email you sent. It's a frustrating, fragile thing, isn't it? :/16:01
kgriffsand, it seems that wsgiref is pretty unreliable, esp. under py2616:01
kgriffsso... two things16:01
kgriffsI added a loop to poll the server until it came up in lieu of that join(1)16:01
kgriffsthat seemed to help16:01
kgriffsbut didn't totally fix it, which tells me we have more than one issue16:01
kgriffsso then, I rigged a way to bubble of errors and stuff from the subprocess16:02
kgriffsup16:02
alcabrerahmm16:02
alcabrerawhat'd you find?16:02
kgriffsalcabrera: so, here is the really strange thing16:03
kgriffs(see also: http://logs.openstack.org/97/67597/23/check/gate-marconi-python26/d4932d1/testr_results.html.gz)16:03
* alcabrera listens16:03
kgriffsrequests fails with a broken pipe error16:03
kgriffswhich usually means the server dropped the connection on us16:03
kgriffsbut wsgiref is still running - it didn't exit16:04
alcabreraso it isn't exploding, it's just - refusing the connection?16:04
kgriffsotherwise, that would have been reported16:04
kgriffs(you would see "none" or an exception msg at the end of that assertion msg, instead of noqi)16:05
alcabreraso, if we dropped the wsgiref server, what would we lose?16:05
kgriffsalcabrera: not refusing the connection16:05
kgriffsit accepts it, then drops it16:05
kgriffsoh, p.s.16:05
kgriffssomething screwy was going on with sharing a static server16:05
kgriffsyou would occasionally see the server failing to start due to the port already in use16:06
alcabrerahmm... :/16:06
kgriffsalcabrera: good question16:06
kgriffsseems like these tests really belong in tempest16:06
kgriffsfor now we could hack the http client to simulate WSGI requests so we talk directly to the app16:07
alcabrera+116:08
alcabreraI'm in favor of that approach, especially since we're starting to make head way into tempest.16:08
kgriffsalcabrera: is malini out today?16:08
alcabrerashe's away for the moment, but she was online earlier.16:08
kgriffsah, ok16:08
mpanettaI think she will be back after lunch16:08
kgriffskk16:10
alcabreraso if we dropped the wsgiref server, I feel like our unit tests would still work out valid results.16:12
alcabreraby which I mean, the tests would give the same amount of information about the correctness of the system.16:12
alcabreraOnly, they'd be faster and more reliable.16:13
kgriffsyes16:13
kgriffsthey wouldn't be "integration" tests16:13
kgriffsbut they would still be "functional"16:13
kgriffsso, this is my plan16:13
alcabrerayup - storage would still be activated - not mocked at all.16:13
kgriffsI will create a http client-compatible class that speaks WSGI directly16:14
kgriffswe can keep the other stuff around for when we want to move to tempest16:14
alcabrerasounds good to me16:17
alcabreraIn a moment, I'm going to go brainstorm on sqlalchemy16:17
alcabreraI want to figure out what's left to do, break it down, and make a plan for getting it done by Feb. 2016:17
*** jamieh has joined #openstack-marconi16:21
kgriffsrock on16:23
kgriffsbtw16:29
kgriffswe should have some configurable restrictions for that endpoint unless there's no auth being used at all. I think a parameter with a list of headers/values that should be present in the request would be enough16:29
kgriffsoops16:29
kgriffssorry16:29
kgriffswrong paste16:29
kgriffshttps://bugs.launchpad.net/marconi/+bug/124292616:29
kgriffsso, I am closing that - that work is encapsulated in the v1.1 blueprint16:30
kgriffsI copied a note about that into the bp16:30
kgriffsalcabrera: https://bugs.launchpad.net/marconi/+bug/121497416:31
kgriffsI think I am going to close this too16:31
kgriffsthis should be very rare, and when it happens, I think 503 is fine16:31
* alcabrera reads16:31
kgriffsesp. now that we have the two-phase insert16:31
kgriffsso you won't end up with partially inserted batches16:31
alcabrerakgriffs: agreed regarding 121497416:31
kgriffskk16:31
alcabrerare: 1242926, I'm okay with dealing with that for v1.1. It seems like a good place to start looking at built-in, configurable access.16:32
alcabreradefinitely more fine-grained than admin/public. :)16:33
alcabrerathough that was a good start16:33
kgriffskk16:33
kgriffsi think that to do it right we need a wsgi pipeline support16:33
kgriffsthen we can do bastion type stuff too16:34
kgriffsnot to mention, operators won't need to create their own app.py16:34
alcabreraagreed16:35
alcabreraI'm curious to see how wsgi.pipeline pans out.16:35
alcabreraI'm having trouble envisioning how it'll ultimately be used, but I'm looking forward to simpler app.pys.16:35
alcabreraif any, at all16:35
* alcabrera starts thinking og X.pipeline as plugin systems16:36
alcabreramarconi/contrib/[auth.py, rbac.py, ...]16:36
*** balajiiyer has quit IRC16:38
*** balajiiyer has joined #openstack-marconi16:46
*** flaper87|afk is now known as flaper8716:50
*** jcru has quit IRC16:50
alcabrerabe back later. :)16:55
*** alcabrera is now known as alcabrera|afk16:55
*** flaper87 is now known as flaper87|afk16:58
*** ametts has joined #openstack-marconi17:03
*** jcru has joined #openstack-marconi17:03
*** mpanetta has quit IRC17:08
*** mpanetta has joined #openstack-marconi17:09
alcabrera|afkflaper87|afk, kgriffs: https://etherpad.openstack.org/p/marconi-sqlalchemy17:19
* alcabrera|afk afk again17:20
*** alcabrera|afk is now known as alcabrera17:39
*** malini_afk is now known as malini17:52
malinio/17:56
maliniseems like I missed some conversation?17:57
alcabreramalini: yes. kgriffs and I were considering dropping wsgiref server from the functional marconi tests, and just using an http-client that speaks wsgi.17:58
alcabrerathe wsgiref server that comes bundled with python is being really unreliable. :/17:58
maliniyou are not planning to change how the tests itself run, rt?17:59
alcabreranah. It'd still have the same functional behavior.17:59
malinitht shud be cool then :)18:00
alcabreraGET arrives, the API layer transfers it to the storage layer, storage layer does its thing, and the response bubbles up. :)18:00
malinisounds good18:00
alcabrerathe only difference is that the request wouldn't be sent to a separate process/server, it'd just be sent to the originating process18:00
maliniI am also planning to have the tests run against devstack18:00
alcabreracool18:00
alcabrerayeah, that'll help a lot!18:01
maliniBut tht is after the dust settles down after the current stuff18:01
alcabreraagreed18:01
maliniwont be till end of Feb18:01
alcabrerawhen you have some time, I think we should talk a little bit about testing strategies for the sqlalchemy-driver, malini.18:01
alcabreraI've started rounding up what we need to finish that up, and testing came to mind. :D18:02
malinigood point!18:02
malinilets chat abt this monday18:02
maliniI am hoping to get back on the tempest stuff on monday too18:02
alcabrerasounds good to me18:03
alcabrera:)18:03
kgriffsmalini: I think these functional tests could just be ported to run in tempest18:08
kgriffsonce we are gating on that, I dont think we need it in tox18:08
malinikgriffs: all of them?18:09
maliniI am not so sure abt tht18:09
kgriffsmalini: we still wouldn't be able to merge anything unless they all passed in the gate, right?18:09
maliniFrom what I understand, tempest is for gating purposes18:09
malinithey dont want all the comprehensive  tests in tempest18:09
maliniour functional tests are very detailed , covering every possible scenario18:10
kgriffsmalini: does tempest run only when a patch is approved?18:10
kgriffs(as a final check)18:10
kgriffs?18:10
malinihmm..not sure abt tht18:10
maliniI'll find out18:10
kgriffsok18:10
maliniMy understanding  abt tempest scope —> It is to make sure that OS components play well together18:11
malinieg. a change in keystone shud not break marconi18:11
alcabreramalini: https://review.openstack.org/#/c/59167/ (see jenkins on this one)18:11
kgriffsoh, so it's like an ueber integration test18:11
kgriffshmmm18:11
alcabrerait seems that some tempest tests are used to gate on18:11
maliniBut if we are testing all possible marconi scenarios, tht will be in the project's scope18:11
kgriffsok18:12
kgriffswell, now I don't know what to do18:12
kgriffsI feel like I want to run all of these before merging each patch18:12
kgriffsbut I want them to run against a real wsgi server, plus keystone and mongodb18:12
malinikgriffs: we can add a job to do tht18:12
maliniagainst devstack18:12
kgriffsreally?18:13
kgriffsthat would be sweet18:13
maliniThts the one I mentioned to alcabrera earlier18:13
alcabreratempest-marconi-mongodb18:13
alcabrerawe need that: ^^18:13
malini+18:13
malinifunctional tests-marconi -mongo db18:13
kgriffsso, here is my proposal18:13
alcabreratempest-marconi-mongodb-sharded, too, if we can help it18:13
maliniyou are getting greedy , alcabrera:D18:13
kgriffswe create a mode where the functional tests run using raw WSGI18:14
alcabrera:D18:14
kgriffsthen we can switch to use the real deal for an integration test job18:14
alcabrera+1 kgriffs18:14
malinikgriffs: when u say real deal, is it devstack ?18:14
kgriffsmalini: I am assuming we can add a gating job to do our devstack test18:14
alcabreraI have an idea there, too. Let's straight on drop wsgiref, whatever we do. I'd like to suggest adding gunicorn to test-requirements, and continue to subprocess sut to that instead of wsgiref.18:14
kgriffsmalini: well...18:14
alcabreras/sut/out18:15
kgriffsI would prefer if we could use uwsgi or gunicorn, but I guess wsgiref is ok18:15
malinikgriffs: yes18:15
maliniI am assuming we can add a gating job to do our devstack test18:15
kgriffsmain thing it is using a web server and standalone dbs18:15
kgriffs(MySQL, Postgres, and MongoDB)18:15
kgriffsonly thing is, doing a full test on MongoDB is a little slow18:15
malinihmm..we can even run devstack with different backend & test the sqlalchemy stuff18:16
kgriffsyes, we could18:16
* alcabrera sees the possibilities of testing unfold before his eyes18:16
alcabreraso many options. :)18:16
kgriffsactually18:16
maliniwe shud add separate jobs for each backend18:16
kgriffsthe unit-ish tests are the slow ones18:16
kgriffsI think the functional ones go pretty quick18:16
maliniI have seen tht in at least one other project -maybe neutron18:16
kgriffsmalini: +118:16
alcabreramalini: +1, I saw that in the nova patch above18:17
kgriffsok, so I am working on an http.WSGIClient18:17
maliniI am looking forward to finishing up what I am doing now :D18:17
kgriffsit implements the same interface as Client()18:17
malinithanks kgriffs!!18:18
alcabreraah, cool18:18
alcabreraI see18:18
alcabreramarconi.tests.functional.http.Client18:18
alcabreraand then it would construct the wsgi:env before passing it along to the endpoint in question. Am I understanding correctly, kgriffs?18:19
kgriffsyep18:21
kgriffsthat way we can switch back and forth between the two depending on whether we are running under tox or devstack18:21
alcabreraawesome18:21
*** caleb_ has quit IRC18:22
maliniI really really LOVE it that you folks are working on the functional tests :)18:23
malinipoptarts for the house!!18:23
alcabrera:)18:23
alcabrerayaaay18:23
* alcabrera helps distribute pop-tarts18:23
malini:D18:23
*** rossk has joined #openstack-marconi18:27
*** rossk_ has joined #openstack-marconi18:29
*** caleb_ has joined #openstack-marconi18:32
*** rossk has quit IRC18:33
*** rossk_ is now known as rossk19:02
openstackgerritKurt Griffiths proposed a change to openstack/marconi: test(functional): Use direct WSGI requests in lieu of a wsgiref server  https://review.openstack.org/7040219:06
*** kgriffs is now known as kgriffs_afk19:14
*** vkmc has quit IRC19:21
*** caleb_ has quit IRC19:58
alcabreraI'm out for the day, guys. I hope you have a great weekend. :)19:59
*** flaper87|afk is now known as flaper8720:01
*** alcabrera has quit IRC20:02
*** flaper87 is now known as flaper87|afk20:10
*** caleb_ has joined #openstack-marconi20:11
*** mpanetta has quit IRC20:23
*** mpanetta has joined #openstack-marconi20:23
*** caleb_ has quit IRC20:30
*** caleb_ has joined #openstack-marconi20:36
*** flaper87|afk is now known as flaper8720:45
*** flaper87 is now known as flaper87|afk20:48
*** thomasem has joined #openstack-marconi20:50
*** caleb_ has quit IRC20:58
*** kgriffs_afk is now known as kgriffs21:03
*** jamieh has quit IRC21:05
*** caleb_ has joined #openstack-marconi21:13
*** caleb_ has quit IRC21:16
*** malini is now known as malini_afk21:18
*** caleb_ has joined #openstack-marconi21:21
*** thomasem has quit IRC21:39
openstackgerritKurt Griffiths proposed a change to openstack/marconi: test(functional): Use direct WSGI requests in lieu of a wsgiref server  https://review.openstack.org/7040221:46
*** openstackgerrit has quit IRC21:53
*** openstackgerrit has joined #openstack-marconi21:53
*** mpanetta has quit IRC21:58
*** whenry has quit IRC22:08
*** tedross has quit IRC22:24
*** whenry has joined #openstack-marconi22:30
openstackgerritKurt Griffiths proposed a change to openstack/marconi: WIP: fix(wsgi): Cleanup limit config options  https://review.openstack.org/6759722:32
openstackgerritKurt Griffiths proposed a change to openstack/marconi: WIP: fix(wsgi): Cleanup limit config options  https://review.openstack.org/6759722:35
*** caleb_` has joined #openstack-marconi22:35
*** caleb_ has quit IRC22:38
openstackgerritKurt Griffiths proposed a change to openstack/marconi: fix(wsgi): Cleanup limit config options  https://review.openstack.org/7046322:39
openstackgerritA change was merged to openstack/marconi: DRY applied to class names  https://review.openstack.org/6835222:58
openstackgerritKurt Griffiths proposed a change to openstack/marconi: test(functional): Use direct WSGI requests in lieu of a wsgiref server  https://review.openstack.org/7040223:01
*** jcru has quit IRC23:03
*** balajiiyer has quit IRC23:04
*** jmckind has quit IRC23:04
openstackgerritKurt Griffiths proposed a change to openstack/marconi: fix(wsgi): Cleanup limit config options  https://review.openstack.org/7046323:07
*** amitgandhi has quit IRC23:32
*** balajiiyer has joined #openstack-marconi23:34
*** balajiiyer has left #openstack-marconi23:34
*** tedross has joined #openstack-marconi23:41
*** ametts has quit IRC23:44
*** caleb_` has quit IRC23:46
*** whenry has quit IRC23:54
*** kgriffs is now known as kgriffs_afk23:54

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!