Wednesday, 2014-09-03

*** praneshp_ has joined #openstack-oslo00:00
*** praneshp has quit IRC00:03
*** praneshp_ is now known as praneshp00:03
*** mtanino has quit IRC00:24
*** yamahata has joined #openstack-oslo00:34
*** yamahata has quit IRC00:36
*** yamahata has joined #openstack-oslo00:36
*** takedakn1 has joined #openstack-oslo00:37
*** takedakn has quit IRC00:37
*** pcm_ has quit IRC01:00
*** tongli has quit IRC01:06
*** vigneshvar has quit IRC01:10
*** dims has joined #openstack-oslo01:11
*** bknudson has joined #openstack-oslo01:18
*** dims has quit IRC01:23
*** dims has joined #openstack-oslo01:23
*** dims_ has joined #openstack-oslo01:26
*** dims has quit IRC01:28
openstackgerritA change was merged to openstack/oslo-incubator: Mark oslo.utils modules obsolete  https://review.openstack.org/11761601:42
*** stevemar has joined #openstack-oslo01:46
openstackgerritJoshua Harlow proposed a change to openstack/taskflow: Use and verify event and latch waited for values with timeouts  https://review.openstack.org/11846001:47
*** dims_ has quit IRC02:03
*** dims has joined #openstack-oslo02:03
*** dims has quit IRC02:08
openstackgerritA change was merged to openstack/oslo-incubator: Mark the config generator as obsolete  https://review.openstack.org/11761402:11
*** dims has joined #openstack-oslo02:13
*** stevemar has quit IRC02:18
*** stevemar has joined #openstack-oslo02:19
openstackgerritamrith proposed a change to openstack/oslo.concurrency: Log stdout, stderr and command on execute() error  https://review.openstack.org/11465902:23
*** amrith is now known as amrith__02:25
*** jeckersb is now known as jeckersb_gone02:28
*** mriedem has left #openstack-oslo02:42
*** mriedem has quit IRC02:42
*** harlowja is now known as harlowja_away02:52
*** dims has quit IRC02:56
*** dims has joined #openstack-oslo02:57
*** dims has quit IRC03:01
*** jecarey_ has joined #openstack-oslo03:04
*** takedakn1 has quit IRC03:07
*** takedakn has joined #openstack-oslo03:12
*** praneshp has quit IRC03:20
*** praneshp has joined #openstack-oslo03:23
*** praneshp has quit IRC03:38
*** praneshp has joined #openstack-oslo03:40
*** praneshp_ has joined #openstack-oslo03:45
*** praneshp has quit IRC03:45
*** praneshp_ is now known as praneshp03:45
*** takedakn has quit IRC04:24
*** jecarey_ has quit IRC04:41
*** amotoki has joined #openstack-oslo04:56
*** harlowja_at_home has joined #openstack-oslo04:59
*** jaosorior has joined #openstack-oslo05:01
*** takedakn has joined #openstack-oslo05:35
YorikSardhellmann: Yes, I did.05:39
*** takedakn has quit IRC05:41
*** harlowja_at_home has quit IRC05:55
openstackgerritOpenStack Proposal Bot proposed a change to openstack/oslo.i18n: Imported Translations from Transifex  https://review.openstack.org/11655306:00
openstackgerritOpenStack Proposal Bot proposed a change to openstack/oslo.db: Imported Translations from Transifex  https://review.openstack.org/11853906:01
*** takedakn has joined #openstack-oslo06:02
openstackgerritOpenStack Proposal Bot proposed a change to openstack/oslo.concurrency: Imported Translations from Transifex  https://review.openstack.org/11854506:07
openstackgerritOpenStack Proposal Bot proposed a change to openstack/oslo.messaging: Imported Translations from Transifex  https://review.openstack.org/11854706:09
openstackgerritOpenStack Proposal Bot proposed a change to openstack/oslo.utils: Imported Translations from Transifex  https://review.openstack.org/11854906:09
openstackgerritYuriy Taraday proposed a change to openstack/oslotest: Remove differences between Python 2.x and 3.x versions  https://review.openstack.org/11855106:12
*** stevemar has quit IRC06:16
*** k4n0 has joined #openstack-oslo06:18
*** harlowja_at_home has joined #openstack-oslo06:20
openstackgerritA change was merged to openstack/oslo.db: Updated from global requirements  https://review.openstack.org/11828606:20
*** flaper87|afk is now known as flaper8706:30
openstackgerritA change was merged to openstack/oslo.log: Fix testr failure under python2.6  https://review.openstack.org/11832706:34
*** takedakn has quit IRC06:37
*** takedakn has joined #openstack-oslo06:37
*** ildikov has joined #openstack-oslo06:58
*** flaper87 is now known as flaper87|afk07:26
*** harlowja_at_home has quit IRC07:33
*** AAzza is now known as AAzza_afk07:33
*** wendar_ is now known as wendar07:36
*** flaper87|afk is now known as flaper8707:39
openstackgerritOpenStack Proposal Bot proposed a change to openstack/oslo-incubator: Updated from global requirements  https://review.openstack.org/11560507:41
openstackgerritOpenStack Proposal Bot proposed a change to openstack/oslo.db: Updated from global requirements  https://review.openstack.org/11856407:41
*** takedakn has quit IRC07:46
*** takedakn has joined #openstack-oslo07:47
*** AAzza_afk is now known as AAzza07:49
openstackgerritA change was merged to openstack/oslo.log: Initial translation setup  https://review.openstack.org/11761007:52
openstackgerritOpenStack Proposal Bot proposed a change to openstack/oslo.log: Updated from global requirements  https://review.openstack.org/11794108:00
*** takedakn has quit IRC08:12
*** oomichi has quit IRC08:25
*** i159 has joined #openstack-oslo08:32
*** pblaho_ has joined #openstack-oslo08:38
openstackgerritJakub Libosvar proposed a change to openstack/oslo.rootwrap: Fix exit of subprocess in case it was terminated by signal  https://review.openstack.org/11856908:42
*** ildikov_ has joined #openstack-oslo08:44
*** ildikov has quit IRC08:47
openstackgerritAlex Frolov proposed a change to openstack/oslo.utils: Transfer class LazyPluggable from nova to oslo.utils  https://review.openstack.org/11857108:51
*** amotoki has quit IRC08:52
*** praneshp has quit IRC08:57
openstackgerritAnn Kamyshnikova proposed a change to openstack/oslo.db: ModelsMigrationsSync:Override compare_server_default  https://review.openstack.org/11520309:04
openstackgerritYuriy Taraday proposed a change to openstack/oslotest: Remove differences between Python 2.x and 3.x versions  https://review.openstack.org/11855109:07
*** dtantsur|afk is now known as dtantsur09:07
openstackgerritAlex Frolov proposed a change to openstack/oslo.utils: Transfer class LazyPluggable from nova to oslo.utils  https://review.openstack.org/11857109:14
*** AJaeger has left #openstack-oslo09:19
openstackgerritAnn Kamyshnikova proposed a change to openstack/oslo.db: ModelsMigrationsSync:Override compare_server_default  https://review.openstack.org/11520309:22
*** AAzza is now known as AAzza_afk09:25
*** pblaho_ is now known as pblaho|afk09:32
openstackgerritYuriy Taraday proposed a change to openstack/oslotest: Remove differences between Python 2.x and 3.x versions  https://review.openstack.org/11855109:32
openstackgerritAlex Frolov proposed a change to openstack/oslo.utils: Transfer class LazyPluggable from nova to oslo.utils  https://review.openstack.org/11858209:33
*** viktors|afk is now known as viktors09:57
*** pcm_ has joined #openstack-oslo10:05
*** jeckersb_gone is now known as jeckersb10:05
*** pcm_ has quit IRC10:05
*** pcm_ has joined #openstack-oslo10:06
*** yamahata has quit IRC10:11
*** jeckersb is now known as jeckersb_gone10:16
*** amrith__ is now known as amrith10:17
*** pblaho|afk is now known as pblaho_10:20
openstackgerritA change was merged to openstack/oslo.vmware: Updated from global requirements  https://review.openstack.org/11795310:33
openstackgerritA change was merged to openstack/taskflow: Use __qualname__ where appropriate  https://review.openstack.org/10668310:34
*** vigneshvar has joined #openstack-oslo10:40
vigneshvarhi guys. Is there a method to release a topic (just opposite to declare_topic_consumer)10:41
*** pblaho_ is now known as pblaho10:49
*** jraim_ has quit IRC11:03
*** ttx has quit IRC11:03
*** jraim__ has joined #openstack-oslo11:06
*** dims has joined #openstack-oslo11:06
*** ttx has joined #openstack-oslo11:09
*** ttx has quit IRC11:09
*** ttx has joined #openstack-oslo11:09
*** dims has quit IRC11:12
*** dims has joined #openstack-oslo11:13
*** dims_ has joined #openstack-oslo11:14
*** dims has quit IRC11:17
flaper87dims_: hey, around?11:20
flaper87dims_: does this look correct to you? https://github.com/openstack/glance_store/blob/master/glance_store/backend.py#L29-L4311:20
dims_good afternoon flaper8711:20
flaper87dims_: hey hey! How are you doing?11:20
flaper87dims_: for some reason, those deprecated options are not working as expected: http://logs.openstack.org/36/100636/21/check/check-tempest-dsvm-postgres-full/469b7be/logs/screen-g-api.txt.gz#_2014-09-03_08_25_01_26011:20
*** pblaho is now known as pblaho|afk11:21
dims_looking11:22
flaper87dims_: thanks :)11:22
*** AAzza_afk is now known as AAzza11:26
dims_flaper87: not sure i understand, the logs point to filesystem_store_datadir filesystem_store_datadirs and the deprecrated opts is not one of them right? (can you explain the problem a bit more?)11:26
flaper87dims_: duh, I'm so dumb11:27
*** vigneshvar has quit IRC11:27
flaper87dims_: filesystem options where moved w/o the deprecation thing11:27
flaper87nvm11:27
flaper87:D11:27
*** dims_ has quit IRC11:29
*** dims has joined #openstack-oslo11:29
*** dims has quit IRC11:34
*** dims has joined #openstack-oslo11:37
dimsflaper87: aha :)11:38
flaper87dims: man, soooo many little things11:38
dims:)11:38
*** yamahata has joined #openstack-oslo11:45
flaper87dims: when is oslo.log going to be released?11:47
flaper87I saw the repo is already there11:47
dimsflaper87: needs quite a bit of work not for at least a few weeks11:47
flaper87dims: ok, thanks for the heads up11:48
flaper87:)11:48
*** dims has quit IRC11:50
*** dims has joined #openstack-oslo11:50
*** dims_ has joined #openstack-oslo11:51
*** dims has quit IRC11:54
*** yamahata has quit IRC11:58
*** yamahata has joined #openstack-oslo12:00
*** kgiusti has joined #openstack-oslo12:00
*** markmcclain has joined #openstack-oslo12:02
*** markmcclain has quit IRC12:02
*** HenryG is now known as HenryG_afk12:04
*** markmcclain has joined #openstack-oslo12:04
*** pblaho|afk is now known as pblaho12:12
openstackgerritDavanum Srinivas (dims) proposed a change to openstack/oslo.log: Move the option definitions into a private file  https://review.openstack.org/11861512:13
openstackgerritDavanum Srinivas (dims) proposed a change to openstack/oslo.log: Make the local module private  https://review.openstack.org/11861612:13
*** miqui has joined #openstack-oslo12:25
*** amrith is now known as _amrith_12:28
*** dims_ has quit IRC12:29
*** dims has joined #openstack-oslo12:30
openstackgerritA change was merged to openstack/oslo.vmware: Refactoring to reduce noise in log files  https://review.openstack.org/11650412:31
openstackgerritA change was merged to openstack/oslo.utils: Updated from global requirements  https://review.openstack.org/11794312:31
openstackgerritA change was merged to openstack/oslo.rootwrap: Updated from global requirements  https://review.openstack.org/11794212:31
openstackgerritA change was merged to openstack/pycadf: define the project goal  https://review.openstack.org/11579612:31
openstackgerritA change was merged to openstack/oslo.concurrency: Mask passwords in exceptions and error messages  https://review.openstack.org/11676312:31
openstackgerritA change was merged to openstack/taskflow: Make the WBE worker banner information more meaningful  https://review.openstack.org/10984012:31
openstackgerritA change was merged to openstack/oslo.utils: Just use int(BOOL) to convert to 1 or 0  https://review.openstack.org/11738512:31
openstackgerritA change was merged to openstack/oslo.messaging: Switch to oslo.utils  https://review.openstack.org/11599612:31
*** dims_ has joined #openstack-oslo12:32
*** dims has quit IRC12:34
openstackgerritKen Giusti proposed a change to openstack/oslo.messaging: An initial implementation of an AMQP 1.0 based messaging driver  https://review.openstack.org/7581512:40
*** freyes has quit IRC12:45
*** dims_ has quit IRC12:45
*** freyes has joined #openstack-oslo12:46
*** dims has joined #openstack-oslo12:46
openstackgerritVictor Sergeyev proposed a change to openstack/oslo.db: Fix DBReferenceError on MySQL and SQLite  https://review.openstack.org/11632412:55
openstackgerritA change was merged to openstack/oslo.concurrency: Address some potential security issues in lockutils  https://review.openstack.org/11612712:58
openstackgerritA change was merged to openstack/taskflow: Allow worker count to be specified when no executor provided  https://review.openstack.org/11484912:58
openstackgerritOleksii Chuprykov proposed a change to openstack/oslo.db: Add create_database_permission_exist function  https://review.openstack.org/10925913:01
openstackgerritDina Belova proposed a change to openstack/oslo-incubator: Delete the token and endpoint on expiry of token of client  https://review.openstack.org/11862813:03
*** _amrith_ is now known as amrith13:10
*** tongli has joined #openstack-oslo13:20
openstackgerritVictor Sergeyev proposed a change to openstack/oslo.db: Reorganize DbTestCase to use provisioning completely  https://review.openstack.org/11017013:20
*** mriedem has joined #openstack-oslo13:21
*** gordc has joined #openstack-oslo13:21
*** zzzeek has joined #openstack-oslo13:23
*** bknudson has quit IRC13:26
openstackgerritAnn Kamyshnikova proposed a change to openstack/oslo.db: ModelsMigrationsSync: Add check for foreign keys  https://review.openstack.org/11623813:28
viktorszzzeek: hi!13:33
zzzeekhey13:34
viktorszzzeek: question as for patch https://review.openstack.org/#/c/110170/ - is it a sense to merge it now? Or we should wait by your spec?13:35
zzzeekI think that one is fine to merge in any case13:36
zzzeekits only the beginning of the series13:36
viktorszzzeek: ok, I just want to ensure, that is will be safe :)13:36
viktorsthanks13:36
zzzeektehyre *all* safe…but we have to wait13:37
zzzeekfor the other two :)13:37
rpodolyakaviktors: don't you trust our CI? :)13:37
jokke_if it's not going to fully be there for j3, do not +A it now ;)13:38
rpodolyakathis one is probably self-sufficient13:38
jokke_Point is that if it's not needed before ff, it should not be consuming the gate resources as the Q is quite a hell of a lot atm13:39
rpodolyakaoh, yeah, that makes sense of course13:39
jokke_the gate is about 18.5hrs atm. and j3 should be carved tomorrow ;)13:40
rpodolyakabtw, what's our policy on FF? does it mean, that changes uploaded *before* the FF date should still be reviewed and merged?13:41
jokke_the changes needs to be merged before the tag13:41
jokke_effectively only the changes that are already in gate Q and are not expected to fail should be going in ... rest for J would need FFE and delayed until the Q has been cleared13:42
jokke_to avoid extra load and merge conflicts13:43
jokke_so preferably depending to each other in +A order already13:43
*** bknudson has joined #openstack-oslo13:44
*** dhellmann has quit IRC13:57
*** dhellmann has joined #openstack-oslo13:58
openstackgerritDoug Hellmann proposed a change to openstack/oslo.utils: Remove unused dependency on oslo.config  https://review.openstack.org/11843814:02
*** jeckersb_gone is now known as jeckersb14:08
*** zz_jgrimm is now known as jgrimm14:09
openstackgerritDavanum Srinivas (dims) proposed a change to openstack/oslo.log: Remove dependency on global CONF  https://review.openstack.org/11864414:11
openstackgerritA change was merged to openstack-dev/pbr: Look for and process sem-ver pseudo headers in git  https://review.openstack.org/10827014:11
*** mtanino has joined #openstack-oslo14:20
openstackgerritJames E. Blair proposed a change to openstack-dev/pbr: Accept capitalized Sem-Ver headers  https://review.openstack.org/11864814:30
*** jecarey has joined #openstack-oslo14:33
*** HenryG_afk is now known as HenryG14:36
*** ildikov has joined #openstack-oslo14:36
*** stevemar has joined #openstack-oslo14:36
openstackgerritJames E. Blair proposed a change to openstack-dev/pbr: Accept capitalized Sem-Ver headers  https://review.openstack.org/11864814:37
*** ildikov_ has quit IRC14:40
*** ildikov has quit IRC14:41
*** i159 has quit IRC14:53
*** AAzza is now known as AAzza_afk14:58
*** pblaho is now known as pblaho|afk14:59
*** mriedem has quit IRC15:00
*** mriedem has joined #openstack-oslo15:01
openstackgerritDavanum Srinivas (dims) proposed a change to openstack/oslo.log: Move the option definitions into a private file  https://review.openstack.org/11861515:05
openstackgerritDavanum Srinivas (dims) proposed a change to openstack/oslo.log: Make the local module private  https://review.openstack.org/11861615:05
openstackgerritDavanum Srinivas (dims) proposed a change to openstack/oslo.log: Remove dependency on global CONF  https://review.openstack.org/11864415:05
*** pblaho|afk is now known as pblaho15:07
*** AAzza_afk is now known as AAzza15:08
*** pblaho is now known as pblaho|afk15:22
*** alexpilotti has joined #openstack-oslo15:34
*** pblaho|afk is now known as pblaho15:34
*** yamahata has quit IRC15:39
flaper87dhellmann: dims you guys around? I'm still having some issues with the DeprecatedOpt thing and I can't quite figure out what's going on. I could use some extra pair of eyes.15:40
flaper87this seems to work as expected: https://github.com/openstack/glance_store/blob/master/glance_store/backend.py#L29-L4315:40
flaper87but doing this doesn't seem to work: https://review.openstack.org/#/c/118611/1/glance_store/driver.py,cm15:40
flaper87I also added `deprecated_opts` to the drivers and it still doesn't work15:41
flaper87By it doesn't work I mean the old config option value is not being read15:41
flaper87It's weird, I even ran register_opt manually in pdb to try it and it didn't work15:41
flaper87just wondering if you guys have seen similar issues15:42
openstackgerritDavanum Srinivas (dims) proposed a change to openstack/oslo.log: Move handlers and formatters out  https://review.openstack.org/11866515:46
*** jeckersb is now known as jeckersb_gone15:47
dimsflaper87: did you try adding group='DEFAULT' into the DeprecatedOpt?15:50
flaper87dims: I'm trying that now15:51
flaper87I think I found the bug in oslo.cfg15:51
flaper87it's precisely related to that15:51
*** dtantsur is now known as dtantsur|afk15:58
openstackgerritDavanum Srinivas (dims) proposed a change to openstack/oslo.log: Extract WritableLogger from log module  https://review.openstack.org/11867116:00
dimsflaper87: bug #?16:01
flaper87dims: still have to open it16:01
flaper87:D16:01
flaper87dims: but it's in this line: https://github.com/openstack/oslo.config/blob/master/oslo/config/cfg.py#L68416:01
flaper87if dgroup is None, it shouldn't fallback to group_name16:02
flaper87IMHO16:02
flaper87it should fallback to DEFAULT16:02
dimsdhellmann: i lined up a bunch of reviews for oslo.log when you get a chance. feel free to update the reviews directly or leave notes for me when you get a chance after the milestone is over. no hurries.16:02
dhellmanndims: ok. I wonder if we should leave CI resources available for the feature freeze, and work on oslo.log more next week?16:03
flaper87oh well, actually, it's hard to tell16:03
dimsflaper87: i'd run that by markmc there was a reason he defaulted that way, (don't remember why)16:03
*** vish1 has joined #openstack-oslo16:03
dimsdhellmann: sounds good16:03
flaper87if we fallback to `group_name` it means we're using the deprecatedopt as a deprecated_name16:03
flaper87but from an oslo.config point of view, no group means DEFAULT16:03
flaper87so, I'd probably go with default which is consistent with oslo.config's API16:04
flaper87dims: sure, I'll ping him16:04
dimsflaper87: if we change behavior we may break someone else :)16:04
dhellmannflaper87: it seems like you'd want the easy case of renaming an option within a group to be the "default" behavior, though16:04
dhellmannflaper87: and yeah, as dims says, changing that behavior is going to break things, so we probably need to fix it through documentation16:05
flaper87dhellmann: yeah, that's the current behaviour16:05
flaper87I'm find with keeping it, I'll just update the docs to make sure we mention that None doesn't mean DEFAULT16:05
dhellmannflaper87: right, which you're proposing to change?16:05
dhellmannflaper87: ok, that sounds good16:05
* flaper87 wasted some hours "debugging" this :P16:05
flaper87dhellmann: yeah I was proposing to change it but the current behaviour makes sense too so, changing it is not worth it16:06
dhellmannflaper87: I've thought about providing a cli in oslo.config that could load option definitions and parse a config file and then report where it is getting a specific option16:07
*** jeckersb` has joined #openstack-oslo16:08
*** vishy has quit IRC16:08
*** vish1 is now known as vishy16:08
*** k4n0 has quit IRC16:08
*** jaosorior has quit IRC16:08
*** sileht has quit IRC16:08
*** jeckersb_gone has quit IRC16:08
*** freyes has quit IRC16:08
*** ujjain2 has quit IRC16:08
*** GheRivero has quit IRC16:08
*** k4n0_ has joined #openstack-oslo16:08
*** ujjain has joined #openstack-oslo16:09
*** freyes has joined #openstack-oslo16:10
*** jaosorior has joined #openstack-oslo16:10
*** sileht has joined #openstack-oslo16:11
*** pblaho has quit IRC16:12
*** GheRivero has joined #openstack-oslo16:13
openstackgerritFlavio Percoco proposed a change to openstack/oslo.config: Explain groups for DeprecatedOpts  https://review.openstack.org/11868016:19
flaper87dims: dhellmann ^ docs updated16:20
flaper87no need to review now, obviously16:20
flaper87just a heads up16:20
dimsdhellmann: anything i can help with? (for the milestone)16:33
*** praneshp has joined #openstack-oslo16:37
*** mriedem1 has joined #openstack-oslo16:40
*** mriedem has quit IRC16:44
*** arnaud has joined #openstack-oslo16:45
*** takedakn has joined #openstack-oslo17:04
openstackgerritBen Nemec proposed a change to openstack/oslo-incubator: Use file locks by default again  https://review.openstack.org/11845717:13
*** harlowja_away is now known as harlowja17:20
dhellmanndims: I've started some notes, but we look like we're in pretty good shape: https://etherpad.openstack.org/p/juno-oslo-feature-freeze17:20
dhellmanndims: https://review.openstack.org/#/c/105362/ may be the only blueprint item we would classify as needing to land before the freeze17:21
dimsdhellmann: ack. will review that17:21
*** mtanino has quit IRC17:31
*** alexpilotti has quit IRC17:39
*** alexpilotti has joined #openstack-oslo17:41
harlowjaso dhellmann  i filed out quite a bit of https://etherpad.openstack.org/p/taskflow-oslo-db-messaging  (for the oslo.messaging part), i'm still sorta on the side that moving to oslo.messaging wouldn't really add that much value (oslo.db i think going there is fine)17:43
*** AAzza has left #openstack-oslo17:43
openstackgerritA change was merged to openstack/taskflow: Cleanup WBE example to be simpler to understand  https://review.openstack.org/10596317:51
dhellmannharlowja: ok, I'll take a look.17:51
harlowjathx17:52
*** morganfainberg is now known as morganfainberg_Z17:53
*** arnaud has quit IRC17:53
*** mtanino has joined #openstack-oslo17:55
dhellmannlifeless: have you seen https://github.com/peritus/bumpversion ? could we use that for managing version tags instead of building logic into pbr?17:58
*** mriedem1 is now known as mriedem18:07
openstackgerritJoshua Harlow proposed a change to openstack/taskflow: Be explicit about publish keyword arguments  https://review.openstack.org/11789618:08
openstackgerritDoug Hellmann proposed a change to openstack/cliff: warn against sorting requirements  https://review.openstack.org/11871518:18
openstackgerritJoshua Harlow proposed a change to openstack/taskflow: Allow the proxy to create and provide a retry policy  https://review.openstack.org/11790118:18
openstackgerritJoshua Harlow proposed a change to openstack/taskflow: Allow the proxy to create and provide a retry policy  https://review.openstack.org/11790118:19
openstackgerritDoug Hellmann proposed a change to openstack/oslo.concurrency: warn against sorting requirements  https://review.openstack.org/11871618:20
openstackgerritDoug Hellmann proposed a change to openstack/oslo.config: warn against sorting requirements  https://review.openstack.org/11871718:21
harlowjapip really needs https://github.com/pypa/pip/issues/988 :-P18:21
openstackgerritDoug Hellmann proposed a change to openstack/oslo.db: warn against sorting requirements  https://review.openstack.org/11871918:23
openstackgerritDoug Hellmann proposed a change to openstack/oslo.i18n: warn against sorting requirements  https://review.openstack.org/11872018:24
openstackgerritDoug Hellmann proposed a change to openstack/oslo.log: warn against sorting requirements  https://review.openstack.org/11872218:25
openstackgerritDoug Hellmann proposed a change to openstack/oslo.messaging: warn against sorting requirements  https://review.openstack.org/11872418:25
openstackgerritDoug Hellmann proposed a change to openstack/oslo.middleware: warn against sorting requirements  https://review.openstack.org/11872518:26
openstackgerritDoug Hellmann proposed a change to openstack/oslo.rootwrap: warn against sorting requirements  https://review.openstack.org/11872618:26
openstackgerritDoug Hellmann proposed a change to openstack/oslo.serialization: warn against sorting requirements  https://review.openstack.org/11872718:27
*** arnaud has joined #openstack-oslo18:27
openstackgerritDoug Hellmann proposed a change to openstack/oslo.utils: warn against sorting requirements  https://review.openstack.org/11872818:28
openstackgerritDoug Hellmann proposed a change to openstack/oslo.vmware: warn against sorting requirements  https://review.openstack.org/11872918:28
openstackgerritDoug Hellmann proposed a change to openstack/stevedore: warn against sorting requirements  https://review.openstack.org/11873018:28
openstackgerritDoug Hellmann proposed a change to openstack/taskflow: warn against sorting requirements  https://review.openstack.org/11873118:29
openstackgerritDoug Hellmann proposed a change to openstack/oslotest: warn against sorting requirements  https://review.openstack.org/11873418:36
openstackgerritDoug Hellmann proposed a change to openstack/oslosphinx: warn against sorting requirements  https://review.openstack.org/11873518:37
openstackgerritDoug Hellmann proposed a change to openstack/oslo-incubator: warn against sorting requirements  https://review.openstack.org/11873618:37
openstackgerritDoug Hellmann proposed a change to openstack/oslo.db: Fix formatting of usage.rst  https://review.openstack.org/11821418:40
dhellmannflaper87: what do you think about an FFE for the AMQP 1.0 work? Can we land it by our RC cut-off of 18 Sept?18:47
dhellmanndims, bnemec, sileht: ^^18:47
dhellmannmarkmc: ^^, though I know you may be too busy to reply this week18:47
dhellmannthe ML thread on that is http://lists.openstack.org/pipermail/openstack-dev/2014-September/044782.html18:48
silehtdhellmann, I'm ok, it will be easier to review next iteration and bug fix, Ken Giusti have done the todo list (pyngys lib, packaging stuff, ...) discuted at Atlanta, so...19:05
silehtdhellmann, next step for that is waiting that a linux distribution deliver the package19:06
dhellmannsileht: well, that's a good point -- if the other libs they need aren't included, does it matter if the driver is in oslo.messaging yet?19:06
dhellmannsileht: we should probably discuss this on the ML thread so Ken sees the conversation and can respond19:07
silehtdhellmann, yep, I will answer tomorrow19:07
dhellmannsileht: ok, thanks19:07
bnemecI wish that wasn't such a huge patch.19:07
bnemecIt's effectively impossible to review in its current state.19:08
dhellmannbnemec: yeah, but I'm not sure how it could be broken up, really :-/19:08
bnemecdhellmann: Yeah, me either.19:08
bnemecOther than maybe some contrived stubbing.19:08
bnemecSo, with the caveats that Red Hat wants this in this cycle and I don't know oslo.messaging very well, I'm okay with it happening this cycle.19:11
bnemecI'm told that it's an unintrusive change (and that seems reasonable based on the review available).19:11
bnemecAnd since we can't possibly review a 2000 line patch, we might as well get it in and let people start banging on it to find the weak spots.19:12
dhellmannbnemec: yeah, the code is restricted to the new driver so it shouldn't break anything else19:12
openstackgerritDavanum Srinivas (dims) proposed a change to openstack/oslo.rootwrap: Initial cut of documentation for oslo.rootwrap  https://review.openstack.org/11875219:26
openstackgerritDavanum Srinivas (dims) proposed a change to openstack/oslo.rootwrap: Initial cut of documentation for oslo.rootwrap  https://review.openstack.org/11875219:28
* flaper87 back from dinner19:39
flaper87dhellmann: I think it's safe and we should let that work land19:40
flaper87I don't think we can break that patch into smaller patches. Lots of code was taken out of the patch when pyngus was create19:40
flaper87created*19:40
dhellmannflaper87: I think that's the general consensus. I did want to make sure there's some sort of clear path for deployers to actually use it, so I asked about the other library they need (I can never remember its name, not pyngus)19:41
flaper87dhellmann: qpid-proton ?19:41
dhellmannflaper87: yeah19:41
dhellmannKen said it's in EPEL and work is happening for Debian19:41
flaper87AFAIU, it's almost in debian/ubuntu and it's already in EPEL19:42
flaper87yeah19:42
dhellmannI wonder if that's sufficient. It is an experimental driver19:42
flaper87I believe it is, I installed everything the other day to play a bit with it19:42
dhellmannI have a few comments so far on the code itself, but I'm suggesting those as follow-up changes to make them easier to review and then we can land the series all at once19:42
jogozzzeek: ping19:42
dhellmannthe main thing so far is the options need to be registered in a unique group19:42
flaper87and I managed to get it running. Other than installing that package, I didn't have to do much19:42
dhellmanncool, that's good to know19:43
jogozzzeek: your thoughts on https://review.openstack.org/#/c/53019/ would be apprecated19:43
jogozzzeek: MySQLdb: Add framework for mysqldb impl19:43
flaper87I think there're things to improve and probably some to clean up but as I mentioned in the review, if we don't let it land we won't be able to test it nor improve it.19:43
flaper87since it's an opt-in driver, I think it's fine19:44
jogozzzeek: AFAIK it is what rackspace is running in production for there DB layer19:44
flaper87hopefully there'll be enough folks interested in testing it19:44
dhellmannflaper87: yeah, like I said, the options are the only thing that I really think we have to fix before landing because it's a pain to move them after19:44
flaper87We can always remove it if the gate and other things don't happen. I'd recommend re-evaluating the driver at the end of Kilo (assuming we let it land)19:44
flaper87dhellmann: +119:45
dhellmannflaper87: re-evaluating is a good idea for *all* of our drivers next cycle19:45
dhellmannflaper87: we've been carrying what I think is a broken zmq driver for ages19:45
flaper87dhellmann: yeah, I wish we had marked it as deprecated during Juno19:46
flaper87Is it too late?19:46
dhellmannflaper87: yeah, we can't deprecate things for juno now, but we can do it early in kilo -- I want to give someone a chance to step up to maintain it if they care about it19:46
flaper87dhellmann: we did that at the Juno summit. 2 guys raised their hands then nothing happened19:46
flaper87AFAICS19:46
flaper87we should do the same and set some goals19:47
flaper87if nothing happens by k-1, the driver will be deprecated in k-219:47
dhellmannflaper87: last chance, with the default of removing things at k2?19:47
flaper87or something along that line19:47
dhellmannheh19:47
flaper87:D19:47
* dhellmann goes to add that to his summit planning list19:47
dhellmannflaper87: see the new entry on https://etherpad.openstack.org/p/kilo-oslo-summit-topics19:49
* flaper87 clicks19:50
* flaper87 interested19:50
openstackgerritDavanum Srinivas (dims) proposed a change to openstack/oslosphinx: Add initial cut for documentation  https://review.openstack.org/11875619:52
dimsdhellmann: zmq broken since we don't run it in any gate/check. afraid, will land up in the same problem with the amqp 1.0 driver :(19:54
dhellmanndims: yeah, I was led to believe Ken had some systems running integration tests though19:54
dhellmanndims: let me find that...19:54
dimsdhellmann: thanks19:55
dhellmannhttp://lists.openstack.org/pipermail/openstack-dev/2014-August/041719.html19:55
dhellmanndims: and https://review.openstack.org/#/c/115752/19:56
dimsdhellmann: that's even better!19:56
dhellmanndims: indeed19:56
kgiustidhellmann: dims: hi - anything I can help with?19:57
dhellmannkgiusti: aha, I knew you were on irc but couldn't remember your handle19:57
dhellmannkgiusti: we're reaching some consensus on allowing a FFE for the driver work you're doing. As part of that, I'd like to understand where the pieces in motion stand. Do you have some sort of summary of that you can point me to? An etherpad maybe?19:58
dhellmannkgiusti: I'd like to know what infra thinks of the test jobs, for instance19:58
dimskgiusti: do you see scrollback? esp flaper87's comments above19:58
* kgiusti looks...19:58
openstackgerritA change was merged to openstack/oslo-incubator: Mark log code as graduating  https://review.openstack.org/11761519:59
kgiustidhellmann: I've kept a short summary of my immediate tasks on the blueprint whiteboard/work items: https://blueprints.launchpad.net/oslo.messaging/+spec/amqp10-driver-implementation20:01
kgiustidhellmann: but I should add more detail regarding what I'm 'blocked' on re: testing.20:01
dhellmannkgiusti: that would be great, thanks20:02
kgiustidhellmann: Ok, let me follow up on that.20:03
dhellmannkgiusti: just to be clear, we want to help land this, I just want to make sure we have all our ducks in a row before we do20:04
dimskgiusti: planning to run amqp10 with tempest - soonish?20:04
kgiustidhellmann: agree completely, thanks!20:04
kgiustidims: I've proposed a CI check test: https://review.openstack.org/#/c/115752/ which does exactly that.  I've got some positive feedback from Ian on it.20:05
kgiustidims: currently, it's blocked waiting for Ian to land his 'bare' fedora 20 node changes: https://review.openstack.org/#/c/117397/  which it depends on.20:06
dimskgiusti: thanks!20:06
*** stevemar has quit IRC20:07
openstackgerritJoshua Harlow proposed a change to openstack/taskflow: Remove attrdict and just use existing types  https://review.openstack.org/11619120:22
openstackgerritMatt Riedemann proposed a change to openstack/oslo.serialization: Check for namedtuple_as_object support before using it  https://review.openstack.org/11785420:24
*** gordc has quit IRC20:24
openstackgerritMatt Riedemann proposed a change to openstack/oslo.serialization: Check for namedtuple_as_object support before using it  https://review.openstack.org/11785420:28
openstackgerritJeremy Stanley proposed a change to openstack-dev/hacking: Work toward Python 3.4 support and testing  https://review.openstack.org/11876520:28
openstackgerritJeremy Stanley proposed a change to openstack-dev/pbr: Work toward Python 3.4 support and testing  https://review.openstack.org/11876620:28
openstackgerritJeremy Stanley proposed a change to openstack/cliff: Work toward Python 3.4 support and testing  https://review.openstack.org/11877220:29
openstackgerritMatt Riedemann proposed a change to openstack/oslo.serialization: Check for namedtuple_as_object support before using it  https://review.openstack.org/11785420:29
*** mriedem has left #openstack-oslo20:29
*** mriedem has joined #openstack-oslo20:30
openstackgerritJeremy Stanley proposed a change to openstack/oslo-incubator: Work toward Python 3.4 support and testing  https://review.openstack.org/11878520:30
openstackgerritJeremy Stanley proposed a change to openstack/oslo.concurrency: Work toward Python 3.4 support and testing  https://review.openstack.org/11878620:30
openstackgerritJeremy Stanley proposed a change to openstack/oslo.config: Work toward Python 3.4 support and testing  https://review.openstack.org/11878720:30
openstackgerritJeremy Stanley proposed a change to openstack/oslo.i18n: Work toward Python 3.4 support and testing  https://review.openstack.org/11878820:30
openstackgerritJeremy Stanley proposed a change to openstack/oslo.log: Work toward Python 3.4 support and testing  https://review.openstack.org/11878920:30
openstackgerritJeremy Stanley proposed a change to openstack/oslo.messaging: Work toward Python 3.4 support and testing  https://review.openstack.org/11879020:30
openstackgerritJeremy Stanley proposed a change to openstack/oslo.middleware: Work toward Python 3.4 support and testing  https://review.openstack.org/11879120:30
openstackgerritJeremy Stanley proposed a change to openstack/oslo.rootwrap: Work toward Python 3.4 support and testing  https://review.openstack.org/11879220:30
openstackgerritJeremy Stanley proposed a change to openstack/oslo.serialization: Work toward Python 3.4 support and testing  https://review.openstack.org/11879320:30
openstackgerritJeremy Stanley proposed a change to openstack/oslo.utils: Work toward Python 3.4 support and testing  https://review.openstack.org/11879420:30
openstackgerritJeremy Stanley proposed a change to openstack/oslo.vmware: Work toward Python 3.4 support and testing  https://review.openstack.org/11879520:30
mriedembknudson: hopefully this simplifies things https://review.openstack.org/#/c/117854/20:30
openstackgerritJeremy Stanley proposed a change to openstack/oslotest: Work toward Python 3.4 support and testing  https://review.openstack.org/11879620:30
openstackgerritJeremy Stanley proposed a change to openstack/pycadf: Work toward Python 3.4 support and testing  https://review.openstack.org/11879720:30
openstackgerritJeremy Stanley proposed a change to openstack/stevedore: Work toward Python 3.4 support and testing  https://review.openstack.org/11881120:31
bknudsonmriedem: does that work? to import json after import x as json?20:31
openstackgerritJeremy Stanley proposed a change to openstack/taskflow: Work toward Python 3.4 support and testing  https://review.openstack.org/11881320:31
bknudsonI tried it and it works.20:32
openstackgerritAndreas Jaeger proposed a change to openstack-dev/cookiecutter: warn against sorting requirements  https://review.openstack.org/11883820:32
dhellmannbknudson: the "as json" changes the name bound in the local scope, but not the sys.modules entry for it20:32
openstackgerritJeremy Stanley proposed a change to openstack-dev/cookiecutter: Work toward Python 3.4 support and testing  https://review.openstack.org/11885520:33
openstackgerritJeremy Stanley proposed a change to openstack-dev/oslo-cookiecutter: Work toward Python 3.4 support and testing  https://review.openstack.org/11885620:33
jokke_this looks exactly like preserving the resources for gating the j3 critical commits ;)20:33
dhellmannjokke_; yeah, those are check jobs but still20:33
jokke_dhellmann: does not help if the check Q is 5hrs before getting into the gate which is what 19hrs atm :D20:34
bknudsonmriedem: I think the logic is reversed20:34
* bnemec is really tempted to not fix that json but in the library20:34
bknudsonif 'namedtuple_as_object' in inspect.getargspec(json.dumps).args -- then it should use simplejson20:35
bnemecBut you know if we do that then we'll end up deciding we have to keep 2.6 around for another cycle and get bit during adoptions.20:35
bknudsonbnemec: you have the luxury of deciding whether to keep 2.6 around.20:35
bnemec*json bu_g_20:35
bnemecbknudson: Right, but oslo.serialization won't get adopted for Juno, and for Kilo 2.6 isn't planned for support.20:36
openstackgerritDoug Hellmann proposed a change to openstack-dev/oslo-cookiecutter: warn against sorting requirements  https://review.openstack.org/11885820:36
openstackgerritMatt Riedemann proposed a change to openstack/oslo.serialization: Check for namedtuple_as_object support before using it  https://review.openstack.org/11785420:39
mriedembknudson: working on too many things at once.. ^20:39
mriedembnemec: oslo.serialization won't get adopted for Juno for which project(s)?20:41
mriedembnemec: anyway, my patch starts in oslo.serialization but i'll have to cherry pick to oslo-incubator for keystone which synced in the bug with namedtuple_as_object20:41
bknudsonI don't think any project will adopt it... it was released recently20:41
mriedemi've got my eye on the nova review20:41
bnemecmriedem: Any of them at this point.  We just released the first version last week and I can't believe anyone is doing adoption at this point in the cycle.20:41
mriedembnemec: we're still looking to merge oslo.db in nova this week20:42
mriedemit's funny because these oslo libs patches aren't tied to blueprints20:42
bnemecO.O20:42
mriedemso i think they are coming in under the FFE radar20:42
bknudsonthere should have been blueprints20:42
bknudsonprotip20:42
mriedemyeah there probably should have been20:42
bnemecHeh20:42
mriedemwe've merged a few new oslo libs in nova w/o blueprints this release though20:42
* dhellmann pretends he didn't hear any of that20:42
bnemecI thought after FF anything without an approved bp or bug got -2'd.20:43
mriedemoslo.db fixes a few nova bugs20:43
mriedemso those are tied in20:43
mriedemlike the retry on deadlock fail that's been hitting the gate pretty well for a month or two20:43
mriedemhmm, i don't have a bug for this https://review.openstack.org/#/c/118751/20:43
bnemecStill scary though.  There have been quite a few significant changes in oslo.db since it graduated.20:44
mriedemguess i should -2 it :P20:44
bnemecmriedem: Would avoid it taking up gate resources. :-P20:44
mriedemmeh20:45
mriedemdrop in the bucket20:45
openstackgerritJoshua Harlow proposed a change to openstack/oslo.utils: Add the ability to extract the query params from a urlsplit  https://review.openstack.org/11888120:45
mriedemi could bring this up in the nova meeting on thursday but then we'll be past juno-3, i could bring it up in the mailing list but i wouldn't mind seeing some of these libs make it into nova in juno, i think jogo is in the same boat20:46
* mriedem debates how quiet to be20:46
* jogo reads backlog20:47
bknudsonI'm just glad my nick isn't juno.20:47
jogomriedem bnemec: I would like to see oslo.db land in Juno20:48
jogoas for oslo.serialization unless it fixes a few known bugs20:48
jogoI don't think we should try for it20:48
mriedemjogo: there is also oslo.utils20:48
jogoas we already have a lot of important things for FFE20:48
jogomriedem: same rule of thumb, if moving to oslo,* has the promise of fixing a few bugs lets do it20:49
jogootherwise we just have tons on our place for FFE20:49
jogomainly ironic20:49
bknudsonoslo.utils didn't work for keystonemiddleware because of tests mocking the time function20:49
dhellmannI would rather have you work on those for k-1, since we don't have some of the gate stuff worked out for the newer libs. oslo.db is good, but the others can safely wait20:49
dhellmannbknudson: right, that's a good point, and part of why we want to delete some of the old stuff from the incubator as soon as we cut our stable branch20:50
jogodhellmann: I expect an oslo.db person to ask for a nova FFE btw20:50
dhellmannjogo: aren't you our liaison?20:50
jogodhellmann: yup, and I am happy to sign up as a core20:50
jogobut the patch author(s) should ask for FFE20:50
dhellmannjogo: it is up the projects to decide when they're ready to adopt. I don't know who submitted that patch off the top of my head20:50
mriedemdhellmann: mirantis peeps20:51
dhellmannmriedem: ok, I'll mention the FFE to them20:51
jogodhellmann: https://review.openstack.org/#/c/101901/20:51
mriedemjogo: i'm also signing up as reviewer for oslo.db,20:51
jogomriedem: awesome20:51
mriedemjogo: maybe we -2 the oslo in-flight changes for now20:51
jogomriedem: shouldn't be too hard to get a 3rd core for oslo.db20:51
mriedemi'll get out the red pen20:52
jogomriedem: ++ to -2ing other oslo sync in flight20:52
jogomriedem: you want to or should I?20:52
jogohttps://review.openstack.org/#/q/project:openstack/nova++is:open+branch:master+file:%255Enova/openstack/common.*,n,z20:52
jogomriedem: or split the -2ing20:52
mriedemdoing it now20:52
bnemecjogo: You may need to sync lockutils before release.20:52
bknudsonI hope the security fixes don't get -2.20:53
jogobnemec: https://review.openstack.org/#/c/116981/ ?20:53
mriedemi'm only looking at libs, not oslo-incubator syncs for bug fixes20:53
openstackgerritJoshua Harlow proposed a change to openstack/taskflow: Move failure to its own type specific module  https://review.openstack.org/10209120:53
*** markmcclain1 has joined #openstack-oslo20:53
jogomriedem: wahat other oslo.* patches are u?20:53
jogoup*20:53
*** markmcclain has quit IRC20:54
mriedemjogo: https://review.openstack.org/#/c/117336/ https://review.openstack.org/#/c/101901/  https://review.openstack.org/#/c/110797/20:55
jogomriedem: odd those don't drop the oslo incubator copies20:55
jogowhich is why I didn't notice them20:55
bknudsonsometimes the oslo-incubator copy is used internally by oslo-incubator20:56
jogobknudson: lol make sense20:56
dhellmannjogo: yeah, again, that's why we want to accelerate deleting code from the incubator so we can make it use the libraries as we graduate things20:58
dhellmannbnemec's point about having to backport extra changes notwithstanding, I think that's still our best path forward20:58
mriedemjogo: i've gone through the current syncs and libs changes, the lib changes have -2 - i said in the oslo.db one to put out a FFE and they already have 2/3 cores20:59
dhellmannjogo, mriedem : I also copied you on the email I just sent to the oslo.db drivers20:59
bnemecdhellmann: Yeah, like I said, I haven't come up with a better option either.20:59
mriedemi'd like to see this fixed and backported to jsonutils before we sync that over https://review.openstack.org/#/c/117854/20:59
dhellmannbnemec: yeah, it feels sort of "cross our fingers and hope" but without a better option...21:00
*** markmcclain1 has quit IRC21:01
*** markmcclain has joined #openstack-oslo21:01
bnemecdhellmann: We can always try it for a cycle and have a postmortem at the L summit.21:01
dhellmannmriedem: I updated the bug for that patch to include oslo.serialization separately and then +2 the patch21:03
openstackgerritJoshua Harlow proposed a change to openstack/taskflow: Hoist the notifier to its own module  https://review.openstack.org/10237221:05
mriedemdhellmann: thanks21:07
mriedemdims: you wanna be the final vote on this? https://review.openstack.org/#/c/117854/21:09
zzzeekjogo: I think that is pretty awful :)21:09
zzzeekjogo: for starters it doesnt even work with eventlet b.c. mysqldb doesnt support eventlet21:10
zzzeekjogo: nor does it work with py3k, because mysqldb doesnt support py3k21:10
bnemecmriedem: I was just waiting for a CI pass.  tripleo has made me paranoid about approving things before CI has voted. :-)21:10
mriedemzzzeek: what are you referring to?21:10
mriedembnemec: ah ok21:11
zzzeekmriedem: https://review.openstack.org/#/c/53019/621:11
mriedemoh the orm thing21:11
mriedemnvm21:11
*** miqui has quit IRC21:11
zzzeekif we are making huge software changes for speed, dumping MySQL for Postgresql woudl be much much easier and much more effective21:12
jogozzzeek: hehe I thought you wouldn't like it. that was a pre--zzzeek atempt at making db faster21:12
zzzeekhow well did it work ?21:12
mriedemzzzeek: i believe rax is running with that in production21:12
jogozzzeek: AFAIK 2x speedup or something21:12
zzzeekjogo: I can get you that with SQLAlchemy and a lot les code21:13
jogozzzeek: mriedem is correct, rax uses this code in production (with eventlet although AFAIK there's is forked)21:13
mriedemyeah they've patched eventlet21:13
zzzeekjogo / mriedem : here is a profile fresh from some ceilometer testing.  three methods that run about 5 SQLAlchemy Core queries, running it 4700 times.   tons of SQLAlchemy calls, but somehow, 90% of the time spent is all in just one place: http://paste.openstack.org/show/104991/21:13
zzzeekthese are quick little select one row, insert three rows transactions21:14
zzzeekso lets rewrite all the SQL and get a 10% increase, and just ignore the elephant in the room21:14
openstackgerritJeremy Stanley proposed a change to openstack/taskflow: Work toward Python 3.4 support and testing  https://review.openstack.org/11881321:14
mriedemmaybe the answer is....db2 :)21:15
zzzeekmriedem: the answer is, stop doing 4700 transactions for something that should be in like, 10 or 2021:15
mriedemor that21:15
jogozzzeek:  ahh https://blueprints.launchpad.net/nova/+spec/db-mysqldb-impl21:15
jogozzzeek: here are the results http://paste.openstack.org/show/31019/21:16
jogozzzeek: so I wanted to bring it to your attention because I very much thought you wouldn't like it21:17
zzzeekjogo: its old news21:17
jogozzzeek: yeah, hopefully we can get RAX off of this and onto something better21:17
jogozzzeek: yup, I just wanted to make sure this was on your radar.21:17
zzzeekjogo: there is nothing sqlalchemy does that has anyhing to do with eventlet.tpool, and if there is, i am disappointed nobody has come to me and showed me that.  is there stil an observed issue?21:17
zzzeekjogo: i mean, seeing all this now after ive been announcing myself for three months makes it look llike people didnt want me to get into this21:18
jogozzzeek: TBH I forgot about it21:18
jogozzzeek: and comstud is a very busy man21:18
jogoas for the tpool part I don't think its directly related to SQLA but I am not the expert on this. all of the patches are up for sharing21:19
zzzeekjogo: the thing about, SQLA ORM == 1 minute, SQLA Core = 30 seconds, MySQLdb = 10 seconds!!!!   OK but the program takes fifteen minutes to run, maybe you dont need to go so far21:20
dimsmriedem: done! :)21:20
mriedemdims: thanks, will get that backported to oslo-incubator on master tonight21:21
jogozzzeek: that test was a single db.api call done 50k times21:22
dimsmriedem: +121:22
jogozzzeek: anyway I brought this up because I should have done so 6 months ago21:22
zzzeekjogo: yeah, so, what is the use of that API call in context.   do people really need to click a button and run that call 50K times?  or is it absorbed into much bigger operations over a long period of time and doesnt make that much of a difference?21:24
jogozzzeek: unfortunately I don't remember of the top of my head, and that call may have changed enough since then that these results are outdated21:26
zzzeekjogo: hre’s some modern speed testing, to load 1M rows with SQLAclhemy ORM, Core, and MySQLdb:  http://stackoverflow.com/a/25534166/3454921:27
*** dhellmann is now known as dhellmann_21:28
zzzeekjogo: MySQLdb loads 1M of these rows in 3 sec, core does it in 4, ORM with column references does it in 4, ORM with full objects does it in like 1321:28
jogothats not bad for 1M lines21:28
zzzeekjogo: well i did some refactoring last week, before i started, ORM with col referencse was at 8 secs.  had to fix one object.21:29
zzzeekjogo: this is the thing.  you add one slow object to python, you are screwed21:29
zzzeekso you do the big rewrite all in MySQLdb.  but you make one mistake in there and dont keep profiling it as part of CI, you can get super slow again21:29
jogozzzeek: yup, so the mysqldb rewrite was done before we had you on board21:30
jogonow that you, I think it needs to go away which means getting rax off of it21:31
zzzeekjogo: here this thing.  teeny cahnge to how we return tuples, doubled the speed: http://docs.sqlalchemy.org/en/latest/changelog/migration_10.html#new-keyedtuple-implementation-dramatically-faster21:31
jogoand using your work21:31
zzzeekjogo: OK well, id have to dig into nova a lot more21:31
openstackgerritDavanum Srinivas (dims) proposed a change to openstack/oslo.db: Add code/api documentation  https://review.openstack.org/11889521:31
jogoanyway having you look at nova  bit more would be great, if you have any questions or issues please don't hesitate to ask me.21:33
zzzeekjogo: OK!21:33
openstackgerritDavanum Srinivas (dims) proposed a change to openstack/oslo.middleware: Add code/api documentation  https://review.openstack.org/11889721:34
harlowjadamn, did nova get a full direct to mysqldb impl?21:35
harlowjainteresting21:35
jogoharlowja: rax is suing it nova didn't merge it21:36
jogoupstream21:36
harlowjarax is suing nova?21:36
harlowjafor reals?21:36
jogousing*21:36
jogolol21:36
harlowja:)21:36
harlowjarax does alot of weird things like that ;)21:37
jogoyup yup21:37
harlowjacough cough cells, lol21:37
harlowjamaybe they just like pain21:40
openstackgerritJoshua Harlow proposed a change to openstack/taskflow: Add proxy heartbeat support  https://review.openstack.org/10439721:44
*** mriedem has quit IRC21:46
*** kgiusti has quit IRC21:49
openstackgerritDavanum Srinivas (dims) proposed a change to openstack/oslo.vmware: Add docs target and generate api docs  https://review.openstack.org/11890521:51
*** jaosorior has quit IRC22:02
*** jecarey has quit IRC22:03
*** openstack has joined #openstack-oslo22:11
-sendak.freenode.net- [freenode-info] if you're at a conference and other people are having trouble connecting, please mention it to staff: http://freenode.net/faq.shtml#gettinghelp22:11
*** markmcclain has quit IRC22:20
*** jeckersb` is now known as jeckersb_gone22:20
openstackgerritA change was merged to openstack-dev/pbr: use get_boolean_option for warnerrors  https://review.openstack.org/11747622:20
openstackgerritA change was merged to openstack/oslo.middleware: Update docs for first release  https://review.openstack.org/11690322:26
*** jgrimm is now known as zz_jgrimm22:29
*** bknudson has quit IRC22:41
*** arnaud has quit IRC22:51
*** pcm_ has quit IRC22:51
*** dims has quit IRC22:52
*** dims has joined #openstack-oslo22:52
*** dims has quit IRC22:57
openstackgerritAaron Rosen proposed a change to openstack-dev/cookiecutter: Add additional gitignores .swo/.swn  https://review.openstack.org/11892323:03
*** openstackstatus has quit IRC23:19
*** openstackstatus has joined #openstack-oslo23:20
*** ChanServ sets mode: +v openstackstatus23:20
*** alexpilotti has quit IRC23:37

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!