| *** hongbin_ has quit IRC | 00:07 | |
| openstackrecheck | Console logs not available after 20:04s for gate-tempest-dsvm-neutron-full-ubuntu-xenial 450139,1,22d2abe | 00:12 |
|---|---|---|
| *** oomichi has quit IRC | 00:19 | |
| *** pvaneck has quit IRC | 00:22 | |
| *** oomichi has joined #openstack-qa | 00:23 | |
| *** mtanino_ has joined #openstack-qa | 00:26 | |
| *** mtanino has quit IRC | 00:27 | |
| openstackrecheck | Console logs not available after 20:13s for gate-watcher-python27-ubuntu-xenial 443070,7,7a6ef57 | 00:32 |
| *** jaesang has joined #openstack-qa | 00:34 | |
| *** catintheroof has joined #openstack-qa | 00:35 | |
| openstackgerrit | Felipe Monteiro proposed openstack/patrole master: Compute API Compute Flavor Rxtx Test. https://review.openstack.org/435139 | 00:37 |
| *** gkadam has quit IRC | 00:40 | |
| masayukig | zhufl: so, did you see your mail on the lists.openstack.org? e.g. http://lists.openstack.org/pipermail/openstack-dev/2017-March/114531.html I'm not sure you already noticed or not, though.. | 00:42 |
| *** Apoorva_ has joined #openstack-qa | 00:48 | |
| *** huanxie has joined #openstack-qa | 00:50 | |
| *** Apoorva has quit IRC | 00:52 | |
| *** Apoorva_ has quit IRC | 00:52 | |
| openstackrecheck | Console logs not available after 20:13s for gate-dragonflow-python27-ubuntu-xenial 445548,10,4658c1b | 00:52 |
| masayukig | gmann: ping | 00:53 |
| *** jamielennox is now known as jamielennox|away | 00:54 | |
| *** tmatsu has joined #openstack-qa | 00:56 | |
| *** tmatsu_ has joined #openstack-qa | 00:58 | |
| *** jamielennox|away is now known as jamielennox | 00:59 | |
| *** tmatsu_ has quit IRC | 00:59 | |
| *** tmatsu_ has joined #openstack-qa | 01:00 | |
| *** tmatsu has quit IRC | 01:01 | |
| *** yangyapeng has joined #openstack-qa | 01:02 | |
| openstackgerrit | Merged openstack-infra/devstack-gate master: Don't fail ping check for pypi mirror on nonstandard port https://review.openstack.org/450420 | 01:06 |
| *** amotoki has joined #openstack-qa | 01:08 | |
| openstackrecheck | Console logs not available after 20:11s for gate-tempest-dsvm-ironic-ipa-wholedisk-bios-pxe_ipmitool-tinyipa-ubuntu-xenial 450104,1,7ad9477 | 01:13 |
| *** markvoelker has quit IRC | 01:13 | |
| *** amotoki has quit IRC | 01:14 | |
| *** markvoelker has joined #openstack-qa | 01:14 | |
| *** rfolco has joined #openstack-qa | 01:18 | |
| openstackgerrit | Merged openstack/tempest master: Deprecate the dvr_extra_resources config switch. https://review.openstack.org/445931 | 01:18 |
| openstackgerrit | Merged openstack-infra/devstack-gate master: Ignore errors for nodepool mirror checks https://review.openstack.org/450456 | 01:18 |
| openstackgerrit | Ken'ichi Ohmichi proposed openstack/tempest master: Rename Cinder V2 API tests https://review.openstack.org/450411 | 01:20 |
| openstackgerrit | Ken'ichi Ohmichi proposed openstack/tempest master: Move Cinder admin tests into unversioned path https://review.openstack.org/450414 | 01:20 |
| *** tuanluong has joined #openstack-qa | 01:21 | |
| openstackgerrit | Ken'ichi Ohmichi proposed openstack/tempest master: Remove unnecessary Cinder v1 code https://review.openstack.org/450441 | 01:21 |
| *** charcol has joined #openstack-qa | 01:23 | |
| *** rfolco_ has joined #openstack-qa | 01:24 | |
| *** tmatsu has joined #openstack-qa | 01:24 | |
| *** larainema has quit IRC | 01:26 | |
| *** tmatsu_ has quit IRC | 01:26 | |
| *** huanxie has quit IRC | 01:27 | |
| *** larainema has joined #openstack-qa | 01:27 | |
| *** rfolco has quit IRC | 01:27 | |
| openstackgerrit | Felipe Monteiro proposed openstack/patrole master: Roles RBAC test for compute extension api os-multinic. https://review.openstack.org/448782 | 01:32 |
| openstackrecheck | Console logs not available after 20:06s for gate-python-cinderclient-pep8-ubuntu-xenial 450129,1,f25cbf9 | 01:33 |
| zhufl | @masayukig: yea someone ever told me about that :( and it seems the problem of our mail box, I will ask our mail administrator for help. besides, does the problem only exist in the web mail list? i.e., can you see my mail properly in your mail box? | 01:37 |
| masayukig | yeah, I can read your mail on my some mail clients properly :) I think it's only on the web mail list. | 01:39 |
| *** catintheroof has quit IRC | 01:41 | |
| zhufl | masayukig: god bless, things are not worst:) | 01:41 |
| *** markvoelker has quit IRC | 01:42 | |
| masayukig | zhufl: :) | 01:42 |
| zhufl | masayukig: and would you please take a look at https://review.openstack.org/#/c/445341/ ? maybe some misunderstandings | 01:43 |
| openstackgerrit | Felipe Monteiro proposed openstack/patrole master: Compute API Compute Flavor Rxtx Test. https://review.openstack.org/435139 | 01:43 |
| *** markvoelker has joined #openstack-qa | 01:44 | |
| masayukig | zhufl: let me check | 01:44 |
| *** yamahata has quit IRC | 01:48 | |
| openstackrecheck | Console logs not available after 20:05s for gate-nova-tox-functional-py35-ubuntu-xenial 408964,38,79bb07a | 01:53 |
| masayukig | zhufl: ah, thanks, I misunderstood. I was thinking you just skipped the assertEqual() :-p | 01:55 |
| *** ramishra has joined #openstack-qa | 01:57 | |
| *** zz_dimtruck is now known as dimtruck | 01:58 | |
| zhufl | masayukig: thanks:) and if you are not too busy, can you look at another simple patch, https://review.openstack.org/#/c/437264/ :) | 02:01 |
| masayukig | zhufl: I'm very busy to watch videos!!!(They are internal videos, actually) So, my eyes on it now :) | 02:07 |
| masayukig | zhufl: JordanP still put -1 on it? | 02:08 |
| *** mtanino_ has quit IRC | 02:12 | |
| openstackrecheck | Console logs not available after 20:11s for gate-trove-functional-dsvm-mysql-ubuntu-xenial 442233,8,cbe52a0 | 02:13 |
| zhufl | masayukig: yea, but I think he may have some misunderstandings:) | 02:21 |
| masayukig | zhufl: heh, yeah, it seems like that | 02:21 |
| zhufl | masayukig: so if you put your opinion here, then he may realize that:-D | 02:27 |
| *** oomichi has quit IRC | 02:28 | |
| masayukig | zhufl: one silly question, where can I see the result of test_server_sequence_suspend_resume ? | 02:29 |
| masayukig | zhufl : I don't see it in http://logs.openstack.org/64/437264/2/check/gate-tempest-dsvm-neutron-full-ubuntu-xenial/cf5aad8/console.html | 02:30 |
| zhufl | masayukig: with @test.attr(type='slow'), does it not run? | 02:32 |
| *** oomichi has joined #openstack-qa | 02:32 | |
| masayukig | zhufl: aha, got it. | 02:33 |
| openstackrecheck | Console logs not available after 20:12s for gate-rally-pep8-ubuntu-xenial 321903,23,cadcfb4 | 02:33 |
| openstackgerrit | Felipe Monteiro proposed openstack/patrole master: Roles RBAC test for compute extension api os-multinic. https://review.openstack.org/448782 | 02:35 |
| *** esberglu has joined #openstack-qa | 02:36 | |
| *** oomichi has quit IRC | 02:39 | |
| *** esberglu has quit IRC | 02:40 | |
| *** oomichi has joined #openstack-qa | 02:42 | |
| gmann | masayukig: pong | 02:43 |
| masayukig | zhufl: I was confused that the patch doesn't have type=slow .. But the latest tempest has it, right? | 02:43 |
| masayukig | gmann: thanks! but I was thinking to ask you about https://review.openstack.org/#/c/450411/ but oomichi already did that :) | 02:45 |
| *** yamahata has joined #openstack-qa | 02:47 | |
| gmann | masayukig: ok, nice | 02:47 |
| zhufl | masayukig: yea the latest version has type=slow on that testcase | 02:48 |
| masayukig | zhufl: +A | 02:50 |
| zhufl | masayukig: thanks:) | 02:51 |
| *** markvoelker has quit IRC | 02:54 | |
| openstackrecheck | Console logs not available after 20:15s for gate-zaqar-pep8-ubuntu-xenial 449905,3,96735db | 02:54 |
| *** markvoelker has joined #openstack-qa | 02:54 | |
| openstackgerrit | Ananda Chintalapati proposed openstack/tempest master: Identity V3 - Endpoint Groups Client https://review.openstack.org/450535 | 03:13 |
| *** aojea has joined #openstack-qa | 03:13 | |
| openstackrecheck | Console logs not available after 20:15s for gate-nova-pep8-ubuntu-xenial 450125,1,eb8f7b8 | 03:14 |
| *** rfolco_ has quit IRC | 03:16 | |
| *** fnaval has joined #openstack-qa | 03:17 | |
| *** aojea has quit IRC | 03:18 | |
| *** zhufl has quit IRC | 03:29 | |
| *** zhufl has joined #openstack-qa | 03:31 | |
| *** artom_ has joined #openstack-qa | 03:31 | |
| *** artom has quit IRC | 03:31 | |
| openstackrecheck | Console logs not available after 20:21s for gate-manila-python27-ubuntu-xenial 444709,8,8932276 | 03:34 |
| *** mriedem has joined #openstack-qa | 03:38 | |
| *** vhosakot has joined #openstack-qa | 03:38 | |
| *** felipemonteiro has quit IRC | 03:43 | |
| *** ajo has quit IRC | 03:50 | |
| *** joanna has joined #openstack-qa | 03:51 | |
| *** ajo has joined #openstack-qa | 03:54 | |
| openstackrecheck | Console logs not available after 20:08s for gate-rally-pep8-ubuntu-xenial 450136,1,f60f83e | 03:54 |
| *** tmatsu_ has joined #openstack-qa | 03:58 | |
| *** tmatsu has quit IRC | 03:59 | |
| *** armax has quit IRC | 04:03 | |
| *** mriedem has quit IRC | 04:05 | |
| *** vhosakot has quit IRC | 04:08 | |
| *** jamielennox is now known as jamielennox|away | 04:09 | |
| openstackgerrit | Merged openstack/tempest master: Do not use skip_checks in TestServerAdvancedOps https://review.openstack.org/437264 | 04:13 |
| openstackrecheck | Console logs not available after 20:09s for gate-python-glanceclient-pep8-ubuntu-xenial 450140,1,228529e | 04:15 |
| *** markvoelker has quit IRC | 04:21 | |
| *** gouthamr has quit IRC | 04:23 | |
| *** markvoelker has joined #openstack-qa | 04:23 | |
| charcol | mtreinish, were you the one who gave a talk on Tempest at summit in Atlanta 2014? | 04:26 |
| *** sridharg has joined #openstack-qa | 04:27 | |
| *** jamielennox|away is now known as jamielennox | 04:30 | |
| openstackrecheck | Console logs not available after 20:10s for gate-tempest-dsvm-neutron-full-ubuntu-xenial 447188,4,c370783 | 04:35 |
| *** yangyapeng has quit IRC | 04:51 | |
| *** yangyapeng has joined #openstack-qa | 04:52 | |
| openstackrecheck | Console logs not available after 20:10s for gate-tempest-dsvm-neutron-dvr-ubuntu-xenial 450032,1,68dc93f | 04:55 |
| *** yangyapeng has quit IRC | 04:56 | |
| *** markvoelker has quit IRC | 05:04 | |
| *** makowals has quit IRC | 05:07 | |
| *** tmatsu_ has quit IRC | 05:08 | |
| *** makowals has joined #openstack-qa | 05:08 | |
| *** tmatsu has joined #openstack-qa | 05:08 | |
| *** tmatsu_ has joined #openstack-qa | 05:11 | |
| *** tmatsu has quit IRC | 05:12 | |
| openstackrecheck | Console logs not available after 20:06s for gate-kolla-dsvm-build-oraclelinux-source-centos-7 446911,8,e8814a7 | 05:15 |
| *** gcheresh_ has joined #openstack-qa | 05:16 | |
| *** edannon has joined #openstack-qa | 05:18 | |
| *** tmatsu_ has quit IRC | 05:19 | |
| *** tmatsu has joined #openstack-qa | 05:24 | |
| *** aojea has joined #openstack-qa | 05:26 | |
| *** aojea has quit IRC | 05:27 | |
| *** aojea has joined #openstack-qa | 05:28 | |
| *** aojea has quit IRC | 05:32 | |
| openstackrecheck | Console logs not available after 20:05s for gate-tripleo-ci-centos-7-scenario003-multinode-puppet 450121,2,7362e5e | 05:35 |
| *** lkuchlan has joined #openstack-qa | 05:35 | |
| *** rcernin has joined #openstack-qa | 05:38 | |
| *** tmatsu has quit IRC | 05:42 | |
| *** lkuchlan has quit IRC | 05:42 | |
| *** tmatsu has joined #openstack-qa | 05:43 | |
| *** tmatsu has quit IRC | 05:43 | |
| *** tmatsu has joined #openstack-qa | 05:44 | |
| *** aojea has joined #openstack-qa | 05:52 | |
| openstackgerrit | Benny Kopilov proposed openstack/tempest master: Volume reset to maintenance mode https://review.openstack.org/449992 | 05:55 |
| openstackrecheck | Console logs not available after 20:06s for gate-kolla-dsvm-build-ubuntu-source-ubuntu-xenial 449040,2,6e791c2 | 05:55 |
| *** nadya has joined #openstack-qa | 06:00 | |
| *** lkuchlan has joined #openstack-qa | 06:02 | |
| *** aojea has quit IRC | 06:03 | |
| *** nadya has quit IRC | 06:07 | |
| *** nadya has joined #openstack-qa | 06:08 | |
| *** nadya has quit IRC | 06:08 | |
| *** agurenko has joined #openstack-qa | 06:10 | |
| openstackrecheck | Console logs not available after 20:03s for gate-zun-python35 443461,4,6e532e0 | 06:15 |
| *** bkopilov_ has quit IRC | 06:19 | |
| *** bkopilov has quit IRC | 06:20 | |
| openstackrecheck | Console logs not available after 20:06s for gate-tempest-dsvm-murano-api-ubuntu-xenial 446316,6,03f4143 | 06:35 |
| *** jamielennox is now known as jamielennox|away | 06:36 | |
| *** oomichi has quit IRC | 06:48 | |
| *** oomichi has joined #openstack-qa | 06:52 | |
| *** sridharg has quit IRC | 06:53 | |
| openstackrecheck | Console logs not available after 20:18s for gate-congress-python35 450143,1,8b495b6 | 06:56 |
| *** mtreinish has quit IRC | 06:57 | |
| *** mtreinish has joined #openstack-qa | 06:58 | |
| openstackgerrit | Sivasathurappan Radhakrishnan proposed openstack/tempest master: Refactor test_live_migration https://review.openstack.org/450588 | 07:05 |
| *** itzikb has joined #openstack-qa | 07:07 | |
| openstackgerrit | Sivasathurappan Radhakrishnan proposed openstack/tempest master: Refactor test_live_migration https://review.openstack.org/450588 | 07:08 |
| *** lkuchlan has quit IRC | 07:12 | |
| *** amotoki has joined #openstack-qa | 07:13 | |
| *** pcaruana has joined #openstack-qa | 07:13 | |
| *** jiaohaolin has joined #openstack-qa | 07:15 | |
| openstackrecheck | Console logs not available after 20:08s for gate-tricircle-pep8-ubuntu-xenial 449922,6,f45771d | 07:16 |
| jiaohaolin | Is anybody here ? | 07:16 |
| jiaohaolin | why can't I use tempest to test Cinder ? It always throws error like this: 'TypeError: __init__() got an unexpected keyword argument 'chunked' ' | 07:16 |
| *** aojea has joined #openstack-qa | 07:17 | |
| *** aojea has quit IRC | 07:17 | |
| *** aojea has joined #openstack-qa | 07:17 | |
| *** lkuchlan has joined #openstack-qa | 07:17 | |
| *** lkuchlan is now known as lkuchlan_wfh | 07:17 | |
| *** tesseract has joined #openstack-qa | 07:18 | |
| *** amotoki has quit IRC | 07:18 | |
| *** zhouyf6 has joined #openstack-qa | 07:18 | |
| *** jamielennox|away is now known as jamielennox | 07:21 | |
| *** nadya has joined #openstack-qa | 07:21 | |
| *** aarefiev_afk is now known as aarefiev | 07:24 | |
| *** seife_ has joined #openstack-qa | 07:29 | |
| *** david_1 has joined #openstack-qa | 07:29 | |
| *** rcernin has quit IRC | 07:29 | |
| *** seife_ has quit IRC | 07:31 | |
| *** david_1 has quit IRC | 07:31 | |
| *** nadya has quit IRC | 07:34 | |
| *** nadya has joined #openstack-qa | 07:34 | |
| openstackrecheck | Console logs not available after 20:07s for gate-requirements-tox-py27-check-uc-ubuntu-xenial 450145,1,e4b5d3d | 07:36 |
| *** makowals has quit IRC | 07:37 | |
| *** martinkopec has joined #openstack-qa | 07:39 | |
| *** nadya has quit IRC | 07:42 | |
| *** nadya has joined #openstack-qa | 07:42 | |
| *** nadya has quit IRC | 07:43 | |
| *** rcernin has joined #openstack-qa | 07:47 | |
| *** sridharg has joined #openstack-qa | 07:47 | |
| *** makowals has joined #openstack-qa | 07:49 | |
| *** gamado has joined #openstack-qa | 07:50 | |
| *** amoralej|off is now known as amoralej | 07:53 | |
| *** aojea_ has joined #openstack-qa | 07:55 | |
| openstackrecheck | Console logs not available after 20:08s for gate-sqlalchemy-migrate-tox-py27sa07-ubuntu-xenial 450148,1,482abfb | 07:56 |
| *** aojea has quit IRC | 07:58 | |
| *** rossella_s has joined #openstack-qa | 07:59 | |
| *** bkopilov_ has joined #openstack-qa | 08:00 | |
| *** bkopilov has joined #openstack-qa | 08:01 | |
| *** zhouyf6_ has joined #openstack-qa | 08:02 | |
| *** zhouyf6 has quit IRC | 08:05 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack-dev/devstack master: Updated from generate-devstack-plugins-list https://review.openstack.org/450616 | 08:06 |
| *** rcernin has quit IRC | 08:06 | |
| openstackgerrit | Benny Kopilov proposed openstack/tempest master: Volume force-delete when volume in maintenance state https://review.openstack.org/449993 | 08:07 |
| *** rcernin has joined #openstack-qa | 08:07 | |
| *** nadya has joined #openstack-qa | 08:10 | |
| *** rcernin has quit IRC | 08:10 | |
| *** rcernin has joined #openstack-qa | 08:10 | |
| *** nadya_ has joined #openstack-qa | 08:11 | |
| *** markus_z has joined #openstack-qa | 08:12 | |
| *** nadya has quit IRC | 08:12 | |
| *** amotoki has joined #openstack-qa | 08:14 | |
| openstackrecheck | Console logs not available after 20:11s for gate-networking-sfc-python27-ubuntu-xenial 449754,2,08cc3e3 | 08:16 |
| *** mvk has quit IRC | 08:17 | |
| *** amotoki has quit IRC | 08:19 | |
| *** david_1 has joined #openstack-qa | 08:21 | |
| *** dgonzalez_ has joined #openstack-qa | 08:21 | |
| *** tpatzig_ has joined #openstack-qa | 08:21 | |
| *** tpatzig_ has quit IRC | 08:23 | |
| *** dgonzalez_ has quit IRC | 08:23 | |
| *** david_1 has quit IRC | 08:23 | |
| *** dgonzalez has quit IRC | 08:24 | |
| *** dsariel has joined #openstack-qa | 08:27 | |
| *** dgonzalez has joined #openstack-qa | 08:30 | |
| *** yamamoto has quit IRC | 08:31 | |
| *** yamahata has quit IRC | 08:31 | |
| openstackgerrit | Benny Kopilov proposed openstack/tempest master: cinder backup force-delete when backup creating test https://review.openstack.org/332670 | 08:32 |
| *** e0ne has joined #openstack-qa | 08:35 | |
| *** lucas-afk is now known as lucasagomes | 08:35 | |
| openstackrecheck | Console logs not available after 20:07s for gate-grenade-dsvm-ironic-ubuntu-xenial 437299,31,96cf92b | 08:37 |
| openstackgerrit | Ian Wienand proposed openstack-dev/devstack master: Run mlock_report under python3 https://review.openstack.org/447328 | 08:38 |
| *** rossella_s has quit IRC | 08:42 | |
| *** rossella_s has joined #openstack-qa | 08:43 | |
| *** rcernin has quit IRC | 08:46 | |
| *** rcernin has joined #openstack-qa | 08:46 | |
| *** mvk has joined #openstack-qa | 08:47 | |
| *** rcernin_ has joined #openstack-qa | 08:48 | |
| *** fnaval has quit IRC | 08:53 | |
| *** lkuchlan_wfh has quit IRC | 08:56 | |
| openstackrecheck | Console logs not available after 20:08s for gate-grenade-dsvm-ironic-inspector-ubuntu-trusty 450158,1,2c3772e | 08:57 |
| *** gfidente has joined #openstack-qa | 08:58 | |
| *** itzikb_ has joined #openstack-qa | 08:59 | |
| *** itzikb has quit IRC | 08:59 | |
| *** tosky has joined #openstack-qa | 09:14 | |
| *** amotoki has joined #openstack-qa | 09:15 | |
| *** Serlex has joined #openstack-qa | 09:16 | |
| openstackrecheck | Console logs not available after 20:06s for gate-python-cinderclient-pep8-ubuntu-xenial 450129,2,36f61b9 | 09:17 |
| *** amotoki has quit IRC | 09:19 | |
| frickler | jiaohaolin: google found https://bugs.launchpad.net/tempest/+bug/1588724 , did you check that you installed the correct requirements? | 09:23 |
| openstack | Launchpad bug 1588724 in tempest "Tempest tests failed for s/liberty" [Undecided,Confirmed] | 09:23 |
| *** tosky has quit IRC | 09:29 | |
| *** yamamoto has joined #openstack-qa | 09:31 | |
| *** tosky has joined #openstack-qa | 09:35 | |
| openstackrecheck | Console logs not available after 20:10s for gate-tempest-dsvm-py35-ubuntu-xenial 376201,19,10f3ad9 | 09:37 |
| *** sshnaidm|off is now known as sshnaidm | 09:45 | |
| openstackgerrit | Merged openstack/tempest master: Fix for test_volume_swap https://review.openstack.org/439648 | 09:45 |
| *** shardy has joined #openstack-qa | 09:51 | |
| *** gfidente has quit IRC | 09:52 | |
| *** yamamoto has quit IRC | 09:56 | |
| openstackrecheck | Console logs not available after 20:13s for gate-tempest-dsvm-full-ceph-plugin-src-os-brick-ubuntu-xenial 447077,2,e001236 | 09:57 |
| openstackgerrit | Ghanshyam Mann proposed openstack/tempest master: Remove remaining usage of cinder v1 API call from Tempest https://review.openstack.org/448851 | 10:00 |
| gmann | oomichi: ^^ can you check this | 10:01 |
| openstackgerrit | Rajat Sharma proposed openstack/tempest master: Removing py34 from tox https://review.openstack.org/450688 | 10:02 |
| *** yamamoto has joined #openstack-qa | 10:04 | |
| *** masayukig[m] has quit IRC | 10:04 | |
| gmann | andreaf: can you check this - https://review.openstack.org/448851 | 10:05 |
| *** nadya_ has quit IRC | 10:07 | |
| *** tuanluong has quit IRC | 10:09 | |
| *** tuanluong has joined #openstack-qa | 10:13 | |
| gmann | andreaf: also can you check what best can be done on this - https://review.openstack.org/#/c/392464/ | 10:14 |
| *** amotoki has joined #openstack-qa | 10:16 | |
| *** mvk has quit IRC | 10:16 | |
| openstackrecheck | Console logs not available after 20:19s for gate-nova-tox-functional-py35-ubuntu-xenial 376200,26,7843240 | 10:18 |
| *** masayukig[m] has joined #openstack-qa | 10:18 | |
| *** gfidente has joined #openstack-qa | 10:19 | |
| *** amotoki has quit IRC | 10:20 | |
| openstackgerrit | Merged openstack/tempest master: Add test case for update volume encryption type https://review.openstack.org/446864 | 10:25 |
| *** sdague has joined #openstack-qa | 10:27 | |
| *** mvk has joined #openstack-qa | 10:31 | |
| *** bkopilov_ has quit IRC | 10:36 | |
| *** bkopilov has quit IRC | 10:36 | |
| openstackrecheck | Console logs not available after 20:10s for gate-mistral-pep8-ubuntu-xenial 449143,2,0af61da | 10:38 |
| *** shardy has quit IRC | 10:44 | |
| *** shardy has joined #openstack-qa | 10:44 | |
| *** lkuchlan has joined #openstack-qa | 10:44 | |
| *** nadya has joined #openstack-qa | 10:44 | |
| openstackgerrit | Merged openstack/tempest master: Should be more clear for device name opt https://review.openstack.org/449903 | 10:45 |
| *** agurenko has quit IRC | 10:46 | |
| *** r-mibu has quit IRC | 10:50 | |
| *** r-mibu has joined #openstack-qa | 10:51 | |
| openstackrecheck | Console logs not available after 20:22s for gate-nova-tox-functional-ubuntu-xenial 447710,2,510e865 | 10:58 |
| *** yamamoto has quit IRC | 11:00 | |
| *** zhouyf6_ has quit IRC | 11:02 | |
| *** zhouyf6_ has joined #openstack-qa | 11:03 | |
| *** markus_z has quit IRC | 11:04 | |
| *** sshwarts has joined #openstack-qa | 11:06 | |
| openstackgerrit | Oksana Voshchana proposed openstack-infra/devstack-gate master: WIP: Test SSL wsgi https://review.openstack.org/414986 | 11:06 |
| *** gszasz has joined #openstack-qa | 11:07 | |
| *** oomichi has quit IRC | 11:09 | |
| *** oomichi has joined #openstack-qa | 11:13 | |
| openstackgerrit | Oksana Voshchana proposed openstack-infra/devstack-gate master: WIP: Test SSL wsgi https://review.openstack.org/414986 | 11:14 |
| *** grafuls has quit IRC | 11:17 | |
| *** amotoki has joined #openstack-qa | 11:17 | |
| *** markus_z has joined #openstack-qa | 11:17 | |
| openstackrecheck | Console logs not available after 20:10s for gate-neutron-lib-pep8-ubuntu-xenial 450007,4,9d193d6 | 11:18 |
| *** amotoki has quit IRC | 11:21 | |
| openstackgerrit | Uday T Kumar proposed openstack/tempest master: Keystone v3 extension os-ep-filter api testcases https://review.openstack.org/447188 | 11:22 |
| *** yamamoto has joined #openstack-qa | 11:25 | |
| *** lucasagomes is now known as lucas-hungry | 11:28 | |
| openstackgerrit | Merged openstack/tempest master: Remove unnecessary Cinder v1 code https://review.openstack.org/450441 | 11:28 |
| *** openstackgerrit has quit IRC | 11:33 | |
| *** openstackgerrit has joined #openstack-qa | 11:35 | |
| openstackgerrit | Sean Dague proposed openstack-dev/devstack master: Provide timings for OSC during devstack run https://review.openstack.org/450431 | 11:35 |
| *** erlon has joined #openstack-qa | 11:38 | |
| *** lkuchlan has quit IRC | 11:38 | |
| openstackrecheck | Console logs not available after 20:14s for gate-vitrage-dsvm-api-ubuntu-xenial 450107,1,fca75f5 | 11:39 |
| openstackgerrit | Merged openstack/tempest master: Unskip test_snapshot_list_param_limit_equals_zero https://review.openstack.org/449283 | 11:41 |
| openstackgerrit | Merged openstack/tempest master: Remove unnecessary show_floatingip https://review.openstack.org/445341 | 11:41 |
| *** jaesang has quit IRC | 11:50 | |
| *** rfolco has joined #openstack-qa | 11:51 | |
| *** tmatsu has quit IRC | 11:51 | |
| openstackrecheck | Console logs not available after 20:27s for gate-nova-tox-functional-py35-ubuntu-xenial 448684,2,f364568 | 11:59 |
| *** lkuchlan has joined #openstack-qa | 11:59 | |
| *** jordanP has joined #openstack-qa | 12:00 | |
| openstackgerrit | Sean Dague proposed openstack-dev/devstack master: initial work to enable systemd service running https://review.openstack.org/448323 | 12:01 |
| openstackgerrit | Sean Dague proposed openstack-dev/devstack master: DNM: testing devstack-gate journald https://review.openstack.org/449312 | 12:02 |
| *** itzikb has joined #openstack-qa | 12:03 | |
| *** itzikb_ has quit IRC | 12:03 | |
| *** markus_z has quit IRC | 12:09 | |
| *** tuanluong has quit IRC | 12:11 | |
| openstackrecheck | Console logs not available after 20:18s for gate-neutron-lib-pep8-ubuntu-xenial 450163,1,5585f31 | 12:19 |
| *** lkuchlan has quit IRC | 12:22 | |
| *** dustins has joined #openstack-qa | 12:24 | |
| *** dave-mccowan has joined #openstack-qa | 12:25 | |
| *** lucas-hungry is now known as lucasagomes | 12:28 | |
| *** grafuls has joined #openstack-qa | 12:30 | |
| *** lkuchlan has joined #openstack-qa | 12:35 | |
| *** gamado has quit IRC | 12:37 | |
| *** tpatzig_ has joined #openstack-qa | 12:39 | |
| *** dgonzalez_ has joined #openstack-qa | 12:39 | |
| *** david_1 has joined #openstack-qa | 12:39 | |
| openstackrecheck | Console logs not available after 20:17s for gate-ironic-pep8-ubuntu-xenial 442402,7,ac63a6b | 12:40 |
| *** itzikb_ has joined #openstack-qa | 12:40 | |
| *** itzikb has quit IRC | 12:40 | |
| *** sapcc-bot has quit IRC | 12:41 | |
| *** david_1 has quit IRC | 12:41 | |
| *** tpatzig_ has quit IRC | 12:41 | |
| *** dgonzalez_ has quit IRC | 12:41 | |
| *** sapcc-bot has joined #openstack-qa | 12:42 | |
| *** aysyd has joined #openstack-qa | 12:42 | |
| *** david_2 has joined #openstack-qa | 12:42 | |
| *** lkuchlan has quit IRC | 12:42 | |
| *** sapcc-bot1 has joined #openstack-qa | 12:42 | |
| *** rossella_s has quit IRC | 12:42 | |
| *** tmatsu has joined #openstack-qa | 12:42 | |
| *** sapcc-bot1 has quit IRC | 12:43 | |
| *** rossella_s has joined #openstack-qa | 12:43 | |
| *** sapcc-bot2 has joined #openstack-qa | 12:43 | |
| *** sapcc-bot has quit IRC | 12:43 | |
| *** gouthamr has joined #openstack-qa | 12:46 | |
| *** databus23_ has quit IRC | 12:47 | |
| *** databus23_ has joined #openstack-qa | 12:47 | |
| *** tmatsu has quit IRC | 12:47 | |
| *** david_2 has quit IRC | 12:48 | |
| *** david_3 has joined #openstack-qa | 12:49 | |
| *** david_3 has quit IRC | 12:50 | |
| *** databus23_ has quit IRC | 12:51 | |
| *** david_4 has joined #openstack-qa | 12:51 | |
| *** databus23_ has joined #openstack-qa | 12:51 | |
| *** sapcc-bot2 has quit IRC | 12:51 | |
| *** carthaca_ has quit IRC | 12:52 | |
| *** sapcc-bot has joined #openstack-qa | 12:52 | |
| *** carthaca_ has joined #openstack-qa | 12:52 | |
| *** databus23_ has quit IRC | 12:53 | |
| *** sapcc-bot has quit IRC | 12:53 | |
| *** sapcc-bot has joined #openstack-qa | 12:53 | |
| *** databus23_ has joined #openstack-qa | 12:53 | |
| *** esberglu has joined #openstack-qa | 12:54 | |
| *** lkuchlan has joined #openstack-qa | 12:55 | |
| *** markus_z has joined #openstack-qa | 12:56 | |
| *** awaugama has joined #openstack-qa | 12:58 | |
| openstackrecheck | Console logs not available after 20:08s for gate-nova-tox-functional-ubuntu-xenial 449763,1,75e6d98 | 13:00 |
| *** yangyapeng has joined #openstack-qa | 13:02 | |
| markus_z | masayukig: Maybe you could have a look too? https://review.openstack.org/#/c/447557/ | 13:04 |
| *** amoralej is now known as amoralej|lunch | 13:08 | |
| sdague | dtroyer / mtreinish ok, the systemd patch I think is ready to go, if you are inclined to take it in | 13:09 |
| *** jiaohaolin has quit IRC | 13:09 | |
| *** sapcc-bot has quit IRC | 13:10 | |
| *** databus23_ has quit IRC | 13:10 | |
| *** sapcc-bot has joined #openstack-qa | 13:10 | |
| *** databus23_ has joined #openstack-qa | 13:10 | |
| *** sapcc-bot has quit IRC | 13:11 | |
| *** sapcc-bot has joined #openstack-qa | 13:12 | |
| *** dustins has quit IRC | 13:13 | |
| *** david_4 has quit IRC | 13:14 | |
| *** carthaca_ has quit IRC | 13:14 | |
| *** sapcc-bot has quit IRC | 13:14 | |
| *** databus23_ has quit IRC | 13:14 | |
| *** sapcc-bot has joined #openstack-qa | 13:14 | |
| *** hichihara has joined #openstack-qa | 13:14 | |
| *** tpatzig_ has joined #openstack-qa | 13:14 | |
| *** dgonzalez_ has joined #openstack-qa | 13:14 | |
| *** carthaca_ has joined #openstack-qa | 13:14 | |
| *** seife_ has joined #openstack-qa | 13:14 | |
| *** databus23_ has joined #openstack-qa | 13:14 | |
| *** david_1 has joined #openstack-qa | 13:14 | |
| *** lkuchlan has quit IRC | 13:15 | |
| *** databus23_ has quit IRC | 13:16 | |
| *** seife_ has quit IRC | 13:16 | |
| *** carthaca_ has quit IRC | 13:16 | |
| *** dgonzalez_ has quit IRC | 13:16 | |
| *** tpatzig_ has quit IRC | 13:16 | |
| *** david_1 has quit IRC | 13:16 | |
| *** strigazi has joined #openstack-qa | 13:17 | |
| *** dgonzalez_ has joined #openstack-qa | 13:17 | |
| *** tpatzig_ has joined #openstack-qa | 13:17 | |
| *** carthaca_ has joined #openstack-qa | 13:17 | |
| *** seife_ has joined #openstack-qa | 13:17 | |
| *** databus23_ has joined #openstack-qa | 13:17 | |
| *** david_1 has joined #openstack-qa | 13:18 | |
| *** amotoki has joined #openstack-qa | 13:18 | |
| *** lkuchlan has joined #openstack-qa | 13:19 | |
| *** dgonzalez_ has quit IRC | 13:19 | |
| *** databus23_ has quit IRC | 13:19 | |
| *** seife_ has quit IRC | 13:19 | |
| *** tpatzig_ has quit IRC | 13:19 | |
| *** carthaca_ has quit IRC | 13:19 | |
| *** david_1 has quit IRC | 13:19 | |
| openstackrecheck | Console logs not available after 20:11s for gate-mogan-pep8-ubuntu-xenial 435330,6,2912770 | 13:20 |
| *** amotoki has quit IRC | 13:23 | |
| *** agurenko has joined #openstack-qa | 13:32 | |
| *** amotoki has joined #openstack-qa | 13:34 | |
| *** nadya has quit IRC | 13:39 | |
| openstackrecheck | Console logs not available after 20:19s for gate-barbican-simple-crypto-devstack-ubuntu-xenial 345575,6,af0b73d | 13:40 |
| *** dimtruck is now known as zz_dimtruck | 13:41 | |
| *** huanxie has joined #openstack-qa | 13:44 | |
| *** zhouyf6_ has quit IRC | 13:45 | |
| *** zhouyf6_ has joined #openstack-qa | 13:46 | |
| *** markvoelker has joined #openstack-qa | 13:49 | |
| *** jordanP has quit IRC | 13:49 | |
| *** ihrachys has joined #openstack-qa | 13:49 | |
| *** krtaylor has quit IRC | 13:56 | |
| *** krtaylor has joined #openstack-qa | 14:00 | |
| openstackrecheck | Console logs not available after 20:10s for gate-nodepool-python27-ubuntu-xenial 450183,1,25deb69 | 14:00 |
| *** hongbin has joined #openstack-qa | 14:01 | |
| *** yamahata has joined #openstack-qa | 14:02 | |
| *** amoralej|lunch is now known as amoralej | 14:03 | |
| *** yamahata has quit IRC | 14:04 | |
| *** mriedem has joined #openstack-qa | 14:09 | |
| *** lkuchlan has quit IRC | 14:09 | |
| *** zz_dimtruck is now known as dimtruck | 14:10 | |
| *** yamamoto has quit IRC | 14:12 | |
| *** yamahata has joined #openstack-qa | 14:16 | |
| *** markvoelker has quit IRC | 14:17 | |
| *** smcginnis has joined #openstack-qa | 14:19 | |
| smcginnis | I'm sure it's simple, but I haven't done much work here. Can anyone tell me if I'm missing something obvious with this? | 14:19 |
| smcginnis | https://review.openstack.org/#/c/441266/ | 14:19 |
| openstackrecheck | Console logs not available after 20:13s for gate-congress-python27-ubuntu-xenial 448906,1,5dd99af | 14:21 |
| sdague | smcginnis: I don't see a cinder.conf here anywhere, so I think cinder API is just not running at all - http://logs.openstack.org/66/441266/1/check/gate-tempest-dsvm-neutron-full-ubuntu-xenial/51ab09d/logs/apache_config/ | 14:23 |
| smcginnis | sdague: Ah, missed that. | 14:24 |
| smcginnis | sdague: We need cinder.conf and cinder-tls-proxy.conf in there? | 14:25 |
| sdague | smcginnis: something has to generate the config for apache | 14:25 |
| sdague | but, honestly, it would be good to not do this with apache, but uwsgi instead. The apache model is so much harder to debug here. | 14:25 |
| *** artom_ is now known as artom | 14:25 | |
| smcginnis | sdague: Do you know what other config is needed besides what is in cinder-tls-proxy? | 14:25 |
| *** tonytan4ever has joined #openstack-qa | 14:26 | |
| smcginnis | sdague: I believe the pike goal is to use Apache though, no? | 14:26 |
| *** armax has joined #openstack-qa | 14:27 | |
| *** felipemonteiro has joined #openstack-qa | 14:27 | |
| *** dustins has joined #openstack-qa | 14:30 | |
| openstackgerrit | Felipe Monteiro proposed openstack/patrole master: Modify policy parser to combine custom and default policy files. https://review.openstack.org/449348 | 14:30 |
| sdague | smcginnis: it might be, apparently that was voted on when I was out of town, which is unfortunate. I'll see if I can accelerate the uwsgi pattern to avoid this. | 14:33 |
| smcginnis | Simpler would be better, IMO. | 14:34 |
| sdague | honestly, I think that as soon as I figure out why one keystone thing was done, I can probably get things working there | 14:35 |
| openstackgerrit | Lance Bragstad proposed openstack-dev/devstack master: Remove installation of keystone policy file https://review.openstack.org/450818 | 14:36 |
| sdague | lbragstad: that works ^^^ ? | 14:36 |
| sdague | if so, I can't +2 it hard enough | 14:37 |
| lbragstad | sdague it should - i tested it on a fresh devstack and ran all the identity tempest tests | 14:38 |
| lbragstad | sdague http://cdn.pasteraw.com/s4oxf0rzvuejk3wwuix4suwiia6whcq | 14:38 |
| sdague | lbragstad: awesome | 14:38 |
| lbragstad | sdague we need it so that we can do - https://review.openstack.org/#/c/449675/ | 14:38 |
| lbragstad | which passes all the keystone specific unit tests, but it failed tempest http://logs.openstack.org/75/449675/4/check/gate-tempest-dsvm-neutron-full-ubuntu-xenial/d78fd47/logs/devstacklog.txt.gz#_2017-03-27_18_29_25_334 | 14:40 |
| openstackrecheck | Console logs not available after 20:11s for gate-rally-dsvm-cli 449538,3,8079939 | 14:41 |
| *** armax has quit IRC | 14:41 | |
| *** armax has joined #openstack-qa | 14:41 | |
| openstackgerrit | Felipe Monteiro proposed openstack/patrole master: Modify policy parser to combine custom and default policy files. https://review.openstack.org/449348 | 14:42 |
| sdague | lbragstad: yep | 14:42 |
| mtreinish | charcol: yes, I was | 14:54 |
| *** fnaval has joined #openstack-qa | 14:57 | |
| *** hichihara has quit IRC | 14:59 | |
| openstackgerrit | Merged openstack/patrole master: Compute API Compute Flavor Rxtx Test. https://review.openstack.org/435139 | 15:01 |
| openstackrecheck | Console logs not available after 20:13s for gate-tripleo-ci-centos-7-scenario003-multinode-puppet 448013,4,f596da9 | 15:01 |
| *** gcheresh_ has quit IRC | 15:08 | |
| *** martinkopec has quit IRC | 15:10 | |
| *** mriedem has quit IRC | 15:10 | |
| *** yamamoto has joined #openstack-qa | 15:13 | |
| openstackrecheck | Console logs not available after 20:19s for gate-tempest-dsvm-neutron-full-ubuntu-xenial 449478,3,9755c5e | 15:21 |
| openstackgerrit | Uday T Kumar proposed openstack/tempest master: Keystone v3 extension os-ep-filter api testcases https://review.openstack.org/447188 | 15:22 |
| *** yamamoto has quit IRC | 15:23 | |
| *** aarefiev is now known as aarefiev_afk | 15:24 | |
| sdague | mtreinish / dtroyer - ok I'm going to hound you on the systemd review so I can start thinking about the next thing - https://review.openstack.org/#/c/448323/ | 15:25 |
| dtroyer | I'm actually giving it a try! :) | 15:26 |
| dtroyer | but WTH... | 15:26 |
| sdague | WTH? | 15:27 |
| dtroyer | what the hell…. I +2 anyway | 15:28 |
| sdague | heh | 15:28 |
| sdague | ah, I didn't realize you were local testing | 15:28 |
| sdague | yeh, I've been running locally this way for the last week | 15:28 |
| mtreinish | sdague: I'm in the middle of thinking about some puppet stuff, once I get to a good break point I'll review it | 15:30 |
| sdague | ok | 15:30 |
| sdague | puppet stuff you say... ? | 15:30 |
| *** rcernin has quit IRC | 15:31 | |
| *** rcernin_ has quit IRC | 15:31 | |
| mtreinish | writing a deploy module for a different mqtt broker | 15:31 |
| mtreinish | emqttd which supports clustering | 15:31 |
| mtreinish | just to see how I would do it (it didn't seem like it'd be hard) | 15:32 |
| *** Serlex has quit IRC | 15:35 | |
| *** agurenko has quit IRC | 15:35 | |
| sdague | dtroyer: you might also want to take a look at this - https://review.openstack.org/#/c/450431/ - I was trying to capture the amount of time spent running osc during a run as part of normal statistics | 15:36 |
| sdague | it's about 40% of the run time of devstack atm, fwiw | 15:36 |
| sdague | sorry, between 30-40% depending on run | 15:37 |
| dtroyer | Does that include the output of OSCs —timing option? | 15:38 |
| openstackgerrit | Felipe Monteiro proposed openstack/patrole master: Add heat stack resources patrole tests. https://review.openstack.org/450328 | 15:38 |
| sdague | dtroyer: it does not | 15:38 |
| sdague | it's just the wrapping call | 15:38 |
| sdague | you can see in the patch what it's dowing | 15:38 |
| sdague | doing | 15:38 |
| dtroyer | I think you need that to be actionable at all because you'll find at least half, often more of the execution time is waiting on API responses, especially in DevStack | 15:39 |
| sdague | is there a way to globally specify that to be run? Because any solution that requires modifying every openstack client call out isn't really going to work | 15:40 |
| dtroyer | I'd have to check if setting it in clouds.yaml would work, I don't think I've ever tried it. | 15:40 |
| dtroyer | in theory it should | 15:40 |
| dtroyer | it is not picked out of the environment | 15:41 |
| openstackrecheck | Console logs not available after 20:09s for gate-dsvm-networking-odl-functional-carbon-snapshot 448065,4,79ff8ef | 15:42 |
| sdague | I can pretty easily dump the full list of commands run here if you think that would be useful, however I expect that we're going to keep getting this basic issue | 15:43 |
| sdague | http://paste.openstack.org/show/604506/ | 15:43 |
| *** itzikb_ has quit IRC | 15:43 | |
| sdague | which is the API cost is 200ms and the wall clock is 1.8s | 15:43 |
| sdague | on my setup here there were 149 calls to osc during a stack.sh | 15:44 |
| dtroyer | a python client is going to be relatively expensive to load. The only solution is to load it fewer times | 15:45 |
| dtroyer | or stop using long-load-time languages | 15:45 |
| sdague | no way to trim some of the load? I remember us talking about things in austin | 15:46 |
| *** e0ne has quit IRC | 15:46 | |
| dtroyer | we did some of thise while still in Austin. | 15:46 |
| sdague | I mean, we could also stop using the pattern of all the functions for building roles that check for the roles first | 15:46 |
| dtroyer | not much change. oslo.config hurts. netifaces hurts | 15:46 |
| dtroyer | yaml hurts | 15:46 |
| dtroyer | sure, that's what I am talking about, de-robustify some of those operations and handle the failures differently would help | 15:47 |
| sdague | yep, that would reduce the call count at least | 15:47 |
| dtroyer | we added —or-show to a lot of create commands for exactly that reason | 15:48 |
| dtroyer | without adding a DSL, there is only so much we can do without hard-coding a bunch of logic like that. —or-oshow seemed obvious, I'm open to other patterns that are common and not do-able by piping a command file into OSC's stdin | 15:49 |
| sdague | yeh, well, I guess the question is do we put this overall timing in to help keep an eye on this, and give us something we can drive down? or not | 15:50 |
| clarkb | we did it for a bunch of other things and did a bunch of work to make them quicker (deb and rpm mirrors, pypi mirror, prebuilt wheels, cached cirros images, and so on) | 15:50 |
| openstackgerrit | Felipe Monteiro proposed openstack/patrole master: Add heat resource types rbac tests. https://review.openstack.org/450867 | 15:51 |
| clarkb | at least for the run in CI case | 15:51 |
| *** fnaval has quit IRC | 15:52 | |
| *** sshwarts has quit IRC | 15:52 | |
| dtroyer | sure, lets' put it in. I'm not a fan of wrapping the command, seems fragile to me, but that lets adding —timing be a drop-in rather than waiting for the proper support to be released in OSC. It would also be nice to get JSON or CSV output for the timing info, which IIRC we don't do today | 15:54 |
| sdague | dtroyer: yeh, the wrapping is more fragile than I like for sure | 15:55 |
| sdague | dtroyer: it would be interesting if there was a way that wrapper could be direct in OSC which would let you gather timings of the python subsystem. Though that gets complicated with the REPL | 15:57 |
| dtroyer | the timing output is emitted on exit, so for batched commands you would get an aggregate of everything called while OSC was loaded | 15:58 |
| dtroyer | I may dig up the osc-as-subprocess trial I did, load it once... | 15:58 |
| *** fnaval has joined #openstack-qa | 15:59 | |
| *** aojea_ has quit IRC | 16:00 | |
| dtroyer | sdague: is OSC running under py3 in DevStack now? | 16:00 |
| sdague | dtroyer: I don't think so | 16:01 |
| dtroyer | kk. I wasn't sure how much of that was on by default yet | 16:01 |
| sdague | dtroyer: it would be cool if the timing data could just be appended to a csv by default, and configured globaly | 16:02 |
| openstackrecheck | Console logs not available after 20:12s for gate-ceilometer-pep8-ubuntu-xenial 446016,5,0096bcd | 16:02 |
| sdague | so it would be a one and done, and then you'd have a db of calls | 16:02 |
| *** edannon has quit IRC | 16:02 | |
| dtroyer | I have an OSC release coming up soon to side-step an os-client-config issue, I'll see if I can get that in too | 16:03 |
| *** vhosakot has joined #openstack-qa | 16:03 | |
| * dtroyer heads to next meeting... | 16:04 | |
| *** erlon has quit IRC | 16:05 | |
| *** mriedem has joined #openstack-qa | 16:13 | |
| sdague | dtroyer: cool | 16:13 |
| sdague | so... interesting thing in just poking at https://pypi.python.org/pypi/import-profiler/0.0.3 | 16:14 |
| openstackgerrit | Merged openstack-dev/devstack master: lib/neutron: allow to add more ml2 extension drivers https://review.openstack.org/444602 | 16:15 |
| *** flwang has quit IRC | 16:17 | |
| sdague | pbr is about 20% of load time because of package utils being dragged in | 16:19 |
| sdague | and osprofiler is 10% of load time because it is unconditionally pulled in for keystoneauth | 16:19 |
| sdague | which seems really weird, as I'd expect to load that on demand only when you were actually profiling a request | 16:20 |
| clarkb | sdague: do you have output you can paste? that sounds interesting to look at | 16:21 |
| *** yamahata has quit IRC | 16:21 | |
| sdague | sure | 16:22 |
| openstackrecheck | Console logs not available after 20:15s for gate-cinder-python27-ubuntu-xenial 442016,3,176e9bf | 16:22 |
| openstackgerrit | Adnan Khan proposed openstack/patrole master: RBAC test for compute extension os-multinic api (for v2.10). https://review.openstack.org/448782 | 16:22 |
| openstackgerrit | Adnan Khan proposed openstack/patrole master: Roles RBAC test for Keystone OS-FEDERATION API v3 roles https://review.openstack.org/446166 | 16:22 |
| sdague | clarkb: http://paste.openstack.org/show/604515/ | 16:23 |
| clarkb | pbr is using pkg resources there to grab version info | 16:24 |
| clarkb | (I think) | 16:24 |
| sdague | yep | 16:24 |
| clarkb | maybe we make that lazy load if you actually ask for the version number | 16:24 |
| sdague | yeh, and once you go down the pkg resources tree, you've just one 250ms load time | 16:25 |
| sdague | sorry, you've just won 250ms additional load time | 16:25 |
| *** pcaruana has quit IRC | 16:26 | |
| *** flwang has joined #openstack-qa | 16:29 | |
| *** bkopilov has joined #openstack-qa | 16:31 | |
| *** bkopilov_ has joined #openstack-qa | 16:31 | |
| *** dustins has quit IRC | 16:31 | |
| *** sridharg has quit IRC | 16:33 | |
| *** agurenko has joined #openstack-qa | 16:35 | |
| *** nadya has joined #openstack-qa | 16:38 | |
| *** rossella_s has quit IRC | 16:42 | |
| openstackrecheck | Console logs not available after 20:13s for gate-tempest-pep8-ubuntu-xenial 450175,1,36f3978 | 16:42 |
| *** markus_z has quit IRC | 16:42 | |
| *** lucasagomes is now known as lucas-afk | 16:43 | |
| *** Apoorva has joined #openstack-qa | 16:45 | |
| oomichi | gmann: yeah, that is good | 16:48 |
| *** gfidente is now known as gfidente|afk | 16:52 | |
| *** nadya has quit IRC | 16:59 | |
| sdague | clarkb / dtroyer - definitely interesting playing with that a little bit. There are 4 times during a normal load that osprofiler might be loaded, for instance, and until you eliminate all of them you don't save the 50ms, but you do save 50ms consistently when you do | 17:00 |
| *** yamahata has joined #openstack-qa | 17:01 | |
| sdague | I do think you could dig out of this through pushing hard on lazy loading into some of these libs | 17:01 |
| openstackrecheck | Console logs not available after 20:12s for gate-tempest-dsvm-cells-ubuntu-xenial 396420,7,cf2df48 | 17:03 |
| clarkb | and libs like pyyaml are actually really tiny compared to others | 17:07 |
| *** mtanino has joined #openstack-qa | 17:11 | |
| *** mtanino has quit IRC | 17:13 | |
| *** mvk has quit IRC | 17:13 | |
| clarkb | and for cryptography I wonder if you can rely on python stdlib if your python is new enough to actually verify certs (is on xenial and centos7 but not trusty iirc) | 17:13 |
| *** amoralej is now known as amoralej|off | 17:18 | |
| *** yangyape_ has joined #openstack-qa | 17:21 | |
| *** yangyapeng has quit IRC | 17:23 | |
| openstackrecheck | Console logs not available after 20:23s for gate-tempest-dsvm-neutron-full-ubuntu-xenial 449703,2,463a7d5 | 17:23 |
| openstackgerrit | Adnan Khan proposed openstack/patrole master: RBAC testcase for compute extension os-multinic api (for v2.10). https://review.openstack.org/448782 | 17:24 |
| *** rbak has joined #openstack-qa | 17:24 | |
| *** rbak has quit IRC | 17:27 | |
| *** dustins has joined #openstack-qa | 17:28 | |
| *** amotoki has quit IRC | 17:31 | |
| *** nadya has joined #openstack-qa | 17:33 | |
| *** nadya has quit IRC | 17:33 | |
| lbragstad | sdague well - looks like https://review.openstack.org/#/c/450818/ passes check | 17:34 |
| *** gszasz has quit IRC | 17:38 | |
| sdague | clarkb: it would be nice if there was a pbr pattern for getting the version number that lazy loaded until you read that variable. I think that there is a bunch of time spent on setting all those up in all our libraries that we almost never touch | 17:39 |
| sdague | mordred: ^^^ | 17:40 |
| sdague | just some sniff testing on import load times for why osc feels slow | 17:40 |
| clarkb | man pbr imports pkg resources all over the place | 17:41 |
| clarkb | but at runtime should only be version that hits it I think | 17:41 |
| clarkb | I will poke at that | 17:41 |
| sdague | clarkb: cool | 17:41 |
| mordred | sdague: I thought it already was lazy - or was at some point in the past at least | 17:41 |
| mordred | but I'm probably wrong about that | 17:41 |
| sdague | mordred: it definitely is not | 17:41 |
| mordred | neat | 17:41 |
| clarkb | it looks like a simple patch let me write one | 17:41 |
| clarkb | at least assuming that at runtime we only import pbr.version | 17:42 |
| sdague | clarkb: well, you are going to need to change common usage as well | 17:42 |
| clarkb | let me double check against osc | 17:42 |
| sdague | https://github.com/openstack/python-openstackclient/blob/master/openstackclient/__init__.py | 17:42 |
| clarkb | sdague: we only need code paths taht run after osc is installed | 17:42 |
| clarkb | the paths that import pkg_resources at install time can likely stay | 17:42 |
| clarkb | sdague: oh ya that negates any beneify to lazy loading in pbr | 17:43 |
| sdague | right, but that's what everyone uses | 17:43 |
| clarkb | mordred: "beneify" is anoyther possible project name | 17:43 |
| sdague | _version__ = pbr.version.VersionInfo('keystoneauth1').version_string() - keystoneauth | 17:43 |
| openstackrecheck | Console logs not available after 20:10s for gate-grenade-dsvm-ironic-ubuntu-xenial 437299,32,9ace78a | 17:43 |
| clarkb | sdague: ya so we actually don't care about fixing it in pbr | 17:43 |
| sdague | clarkb: well, you still do right? | 17:44 |
| *** tosky has quit IRC | 17:44 | |
| clarkb | sdague: I mean it won't change anything | 17:44 |
| sdague | we need a pbr call for getting version which is the equiv of pbr.version.VersionInfo('keystoneauth1').version_string() | 17:44 |
| sdague | that is lazy | 17:44 |
| clarkb | no | 17:44 |
| clarkb | you need to not call version_string() until you need it | 17:44 |
| sdague | clarkb: why not? | 17:44 |
| sdague | ok, well everyone does that | 17:44 |
| clarkb | putting the lazyness in version_string() is the wrong place imo | 17:45 |
| *** aojea has joined #openstack-qa | 17:45 | |
| sdague | why? | 17:45 |
| clarkb | because the assignment to __version__ is going to execute the thunk | 17:45 |
| clarkb | you can't have a lazy thing that is expected to be there from the get go | 17:45 |
| sdague | right, I mean a cantrip of how you would have a lazy version | 17:45 |
| sdague | honestly, I'm not sure I know why everyone is converting to a string in code, but they are | 17:46 |
| clarkb | sdague: its a pythonism | 17:46 |
| sdague | vs. having it be the versioninfo | 17:46 |
| clarkb | the right way to do this is have pbr not import pkg_resources until version_string() is called which is simple. But then you have to rewrite all the libs | 17:47 |
| mordred | well.... | 17:47 |
| mordred | we _could_ have version_string() return an object with __str__ and whatnot overridden | 17:48 |
| mordred | (or add a call that does that, more likely) | 17:48 |
| mordred | so that it doesn't run the pkg_resources code until someone actually dereferences __version__ in consuming code | 17:48 |
| clarkb | mordred: except that the method is literally "version_string" | 17:48 |
| clarkb | mordred: so I would be opposed to returning anything but a string :) | 17:49 |
| mordred | right. so we make a new method | 17:49 |
| mordred | def deferred_version_object | 17:49 |
| clarkb | right thats what I mean about needing to rewrite everything | 17:49 |
| clarkb | and not in pbr | 17:49 |
| mordred | and change the consuming code to be __version__ = version_info.deferred_verison_object() | 17:49 |
| clarkb | so you may as well just fix the user outside of pbr | 17:49 |
| mordred | well - you'd only need a one-line fix in all the projects | 17:50 |
| mordred | as opposed to fixing the places where things consume __version__ | 17:50 |
| sdague | mordred: ++ | 17:50 |
| sdague | because that's vaguely managable | 17:50 |
| clarkb | except you then break the contract with __version__ | 17:50 |
| mordred | do you? | 17:50 |
| mordred | if you treat it like a string it'll behave like a string | 17:50 |
| clarkb | not when you do things like list __dict__ | 17:50 |
| mordred | so "print __version__" would still work, as would str(__version__) | 17:51 |
| clarkb | right you need an explicit cast anywhere you expected a str | 17:51 |
| mordred | not if you override both __str__ and __repr__ you don't | 17:51 |
| clarkb | and __eq__ and __ne__ and hope no one uses "is" | 17:52 |
| mordred | yah | 17:52 |
| mordred | well - I mean, what in the world are they doing if they were using is? :) | 17:52 |
| *** gcheresh_ has joined #openstack-qa | 17:52 | |
| *** mvk has joined #openstack-qa | 17:52 | |
| sdague | clarkb: so, eveything is fine, and there is nothing to fix? | 17:52 |
| mordred | we _could_ return a subclass of str though so that isinstance works | 17:53 |
| clarkb | if osc.__version__ is "x.y.z": do things for that version ? | 17:53 |
| mordred | that's incorrect python | 17:53 |
| clarkb | sdague: no I personally think the fix is in the consumers of version | 17:53 |
| sdague | clarkb: so fix all software | 17:53 |
| mordred | because osc.__version is never going to be the same object as "x.y.z" literal | 17:53 |
| clarkb | sdague: don't get the version until you need it | 17:53 |
| sdague | I find that the "its your problem user" | 17:53 |
| sdague | vs. realizing that in openstack we decided to be clever and not just put constants in here | 17:54 |
| sdague | and we own some of the responsibility for not making everything slow because of it | 17:54 |
| clarkb | sure my concerns are more that the fix proposed is likely going to break something | 17:54 |
| sdague | every change everywhere is going to break something | 17:55 |
| clarkb | because its very hard to make sure the behavior is the same for every way that people likely use version data | 17:55 |
| *** dsariel has quit IRC | 17:55 | |
| sdague | and saying that the fix is thus, change every consuming piece of software, doesn't seem like an answer | 17:55 |
| clarkb | and we know that when we break things this way everything grinds to a hault and people get cranky | 17:55 |
| oomichi | masayukig: we get attension from defcore side for https://review.openstack.org/#/c/450411 | 17:55 |
| clarkb | if you change consuming pieces of software then you mitigate that because api doesn't change just where you consume it | 17:55 |
| clarkb | it was only what a month ago that we last broke the world with a change just like this | 17:56 |
| clarkb | thats what I am saying | 17:56 |
| clarkb | it was bad enough taht people not in openstack were dropping pbr | 17:57 |
| sdague | clarkb: then make something where you can import/call pbr in a certain way to make all that lazy | 17:58 |
| *** pvaneck has joined #openstack-qa | 17:58 | |
| sdague | because on the server side the 250ms add is not really relevant. But the current state of the world basically means that CLIs that have pbr anywhere have a huge tax, even though most of them are never going to touch any of these variables | 17:59 |
| clarkb | sdague: https://review.openstack.org/450913 is all that is necessary to do mordred's thing | 18:00 |
| clarkb | sdague: you just have to change the clients to stop using version_string() and assign only the VersionInfo object | 18:00 |
| sdague | clarkb: right, and I'm saying that's not possible for something like osc | 18:01 |
| clarkb | what? | 18:01 |
| clarkb | I wrote the change you and mordred wanted... | 18:01 |
| sdague | because you have to fix every single library that touches pbr | 18:01 |
| sdague | clarkb: no, you didn't | 18:01 |
| clarkb | ok you don't want to change anything in osc | 18:01 |
| sdague | clarkb: totally good changing osc | 18:01 |
| clarkb | I'm even more opposed to not returning a string in teh function called "version_string" | 18:01 |
| clarkb | sdague: then what is wrong with the change above? | 18:02 |
| sdague | but can't have to change keystoneauth1 keystoneclient and every other lib in openstack that does that patter | 18:02 |
| clarkb | sdague: so you want version_string to return not a string but the lazy VersionInfo object? | 18:03 |
| *** shardy has quit IRC | 18:03 | |
| sdague | yes, even if you have to explicitly opt into it | 18:03 |
| clarkb | it could be modified to return self, I just don't think thats a really clean interface | 18:03 |
| sdague | which osc could do | 18:03 |
| openstackrecheck | Console logs not available after 20:10s for gate-networking-sfc-python27-ubuntu-xenial 449954,5,f97614f | 18:03 |
| sdague | because even if you have that patch, and change osc, the pbr hit just moves | 18:03 |
| sdague | into osc_lib. Then you change it there then it moves to keystoneauth1 | 18:04 |
| sdague | and so and and so for | 18:04 |
| sdague | having actually done that chase on osprofiler | 18:04 |
| clarkb | yes I get that (the chagne currently pushed is essentially that opt in, you assign the VersionInfo object not VersionInfo.version_string()) | 18:04 |
| sdague | the answer can't be, make every included library correct | 18:04 |
| sdague | because that's actually an intractable problem | 18:05 |
| clarkb | its intractable to solve that in pbr too... | 18:05 |
| clarkb | because you can't assume that version_string() is the only way this is getting pulled in | 18:05 |
| sdague | not if you can opt for the delay behavior | 18:05 |
| sdague | clarkb: that's possible | 18:06 |
| sdague | but it would go a long way to figure that out | 18:06 |
| *** tesseract has quit IRC | 18:06 | |
| sdague | and it's definitely a very common way this is all getting pulled in | 18:06 |
| clarkb | oh str() and version_string() are different ugh | 18:09 |
| clarkb | so that won't work as is | 18:09 |
| *** tosky has joined #openstack-qa | 18:09 | |
| clarkb | version_string() is the brief string and str() is the full string | 18:09 |
| *** gcheresh_ has quit IRC | 18:10 | |
| *** nadya has joined #openstack-qa | 18:13 | |
| clarkb | sdague: mordred https://review.openstack.org/450918 is a quick mock up of what a version_string() returning non string looks like | 18:16 |
| clarkb | we can see if that breaks in testing (it likely does want equality and inequality checks implemented) | 18:16 |
| *** gcheresh_ has joined #openstack-qa | 18:19 | |
| *** itzikb_ has joined #openstack-qa | 18:20 | |
| openstackgerrit | Felipe Monteiro proposed openstack/patrole master: Add heat events rbac tests. https://review.openstack.org/450919 | 18:21 |
| openstackgerrit | Merged openstack-dev/devstack master: Update devstack supported OS's on documentation https://review.openstack.org/449245 | 18:23 |
| openstackgerrit | Felipe Monteiro proposed openstack/patrole master: Modify policy parser to combine custom and default policy files. https://review.openstack.org/449348 | 18:23 |
| openstackrecheck | Console logs not available after 20:21s for gate-nova-python27-ubuntu-xenial 382853,3,e0d9d6b | 18:24 |
| mordred | clarkb, sdague: https://review.openstack.org/450921 this is a quick mock up of what I was talking about | 18:27 |
| clarkb | mordred: you actually don't need the version_string_deffered method | 18:28 |
| openstackgerrit | Felipe Monteiro proposed openstack/patrole master: Add heat resource types rbac tests. https://review.openstack.org/450867 | 18:28 |
| clarkb | mordred: VersionInfo itself is already mostly that | 18:28 |
| clarkb | mordred: but sdague doesn't want a different api in pbr because that means changing all of the things | 18:28 |
| mordred | clarkb: okie | 18:28 |
| clarkb | mordred: so I tossed up mock up of what it would be if version_string returned not a string | 18:28 |
| *** aojea has quit IRC | 18:29 | |
| clarkb | and we'll see if testing catches anything that breaks on that | 18:29 |
| mordred | clarkb: oh - nice | 18:29 |
| mordred | clarkb: I like that | 18:29 |
| *** aojea has joined #openstack-qa | 18:29 | |
| clarkb | I prefer your thing because it doesn't change anything under existing users in ways that could break them deepdning on how they use version data | 18:31 |
| clarkb | but sdague is right that it won't fix the pkg_resources overhead for osc until all the things swtich to it | 18:32 |
| *** markvoelker has joined #openstack-qa | 18:32 | |
| clarkb | also why is pkg_resources so slow? | 18:33 |
| *** aojea has quit IRC | 18:34 | |
| clarkb | https://github.com/pypa/setuptools/issues/926 | 18:34 |
| openstackgerrit | Dustin Schoenbrun proposed openstack/tempest master: Enhancement of tempest cleanup documentation https://review.openstack.org/444041 | 18:34 |
| clarkb | mordred: the neutron src pbr job is probably the most interesting as that should run the services and osc | 18:36 |
| mordred | ++ | 18:36 |
| openstackgerrit | Pradeep Kumar proposed openstack/tempest master: Keystone v3 extension os-ep-filter api testcases https://review.openstack.org/447188 | 18:37 |
| clarkb | unfortunate that the setuptools bug doesn't have much more info than what we know (its slow) | 18:38 |
| openstackgerrit | Merged openstack-dev/devstack master: initial work to enable systemd service running https://review.openstack.org/448323 | 18:41 |
| clarkb | http://paste.openstack.org/show/604553/ | 18:44 |
| openstackrecheck | Console logs not available after 20:11s for gate-tempest-dsvm-full-ceph-plugin-src-os-brick-ubuntu-xenial 447077,2,10eb632 | 18:44 |
| clarkb | https://github.com/pypa/setuptools/blob/master/pkg_resources/__init__.py#L682-L695 is where the bulk of the time cost is | 18:48 |
| clarkb | which transitively calls into https://github.com/pypa/setuptools/blob/master/pkg_resources/__init__.py#L2003-L2046 a bunch | 18:50 |
| clarkb | so its slow because disk io is slow | 18:51 |
| clarkb | I take that back its the sort | 18:53 |
| *** nadya has quit IRC | 18:55 | |
| *** armax has quit IRC | 18:55 | |
| *** markvoelker has quit IRC | 18:57 | |
| *** e0ne has joined #openstack-qa | 18:58 | |
| *** sridharg has joined #openstack-qa | 19:00 | |
| *** nadya has joined #openstack-qa | 19:03 | |
| openstackrecheck | Console logs not available after 20:06s for gate-tempest-dsvm-neutron-full-ubuntu-xenial 447188,7,f1c8b9b | 19:04 |
| sdague | clarkb: like I said, I would be totally ok if this was behavior that you opted into before import. I do wonder if stevedore usage in osc is going to make this all irrelevant. Mostly, I'd like to figure out if we can even isolate the issue with your patch. | 19:13 |
| sdague | clarkb: I'll try a local install and see what the import looks like | 19:14 |
| clarkb | sdague: ok | 19:14 |
| clarkb | the tempest job is still running | 19:14 |
| *** nadya has quit IRC | 19:16 | |
| sdague | yeh, stevedore totally also pulls in pkg_resources | 19:16 |
| clarkb | the cost in pkg_resources is they parse every version of every python package they can find on import in order to sort them all | 19:17 |
| sdague | http://paste.openstack.org/show/604558/ | 19:17 |
| clarkb | I'm putting that together on the bug in setuptools but currently trying to infra meeting | 19:17 |
| clarkb | but maybe if I write it down then someone can look at it | 19:17 |
| sdague | yeh, no worries | 19:17 |
| sdague | yeh, given that this just moves things to stevedore, it's definitely not worth the pbr change for real | 19:18 |
| sdague | but it's probably at least some useful data, I guess the real question is to figure out if there is a good place to write this down so the next time someone wonders in 12 months we don't start all over from scratch | 19:19 |
| clarkb | sdague: the really neat thing about this is its slower if you have more packages :) | 19:19 |
| clarkb | so I wonder how much quicker it would be if osc was installed in a venv with minimal deps | 19:20 |
| clarkb | probably not enough to make it worthwhile | 19:20 |
| sdague | clarkb: um... yep | 19:22 |
| sdague | it's actually *noticably* faster for import | 19:22 |
| clarkb | the pbr change is? but only until stevedore arrives right? | 19:23 |
| sdague | http://paste.openstack.org/show/604561/ | 19:23 |
| sdague | no, just putting everything in a venv | 19:23 |
| clarkb | oh interesting | 19:23 |
| sdague | that shaves about 700ms off import time | 19:23 |
| sdague | because python, pkg_resources, and stevedore again are hitting the whole python path | 19:24 |
| clarkb | and its much smaller in a venv than devstack install | 19:24 |
| sdague | yep | 19:24 |
| openstackrecheck | Console logs not available after 20:09s for gate-dragonflow-dsvm-fullstack-ubuntu-xenial 445548,12,3749076 | 19:24 |
| sdague | yeh, the wall clock difference between the 2 is 800ms - 900ms for an openstack server list (no actual servers) | 19:25 |
| sdague | which I think is about 30ms of API time | 19:25 |
| clarkb | wow thats actually way more than I expected | 19:25 |
| sdague | real0m1.928s | 19:26 |
| sdague | user0m1.448s | 19:26 |
| sdague | sys0m0.104s | 19:26 |
| sdague | vs | 19:26 |
| sdague | real0m1.048s | 19:26 |
| sdague | user0m0.696s | 19:26 |
| sdague | sys0m0.052s | 19:26 |
| sdague | dtroyer: if you haven't rage quit the whole problem yet, the above might be interesting | 19:27 |
| *** aojea has joined #openstack-qa | 19:32 | |
| *** databus23_ has joined #openstack-qa | 19:32 | |
| *** dgonzalez_ has joined #openstack-qa | 19:32 | |
| *** tpatzig_ has joined #openstack-qa | 19:32 | |
| *** dgonzalez_ has quit IRC | 19:34 | |
| *** databus23_ has quit IRC | 19:34 | |
| *** tpatzig_ has quit IRC | 19:34 | |
| openstackgerrit | Pradeep Kumar proposed openstack/tempest master: Keystone v3 extension os-ep-filter api testcases https://review.openstack.org/447188 | 19:35 |
| *** nadya has joined #openstack-qa | 19:41 | |
| openstackgerrit | Merged openstack-dev/devstack master: Restrict enabling the manage_volume volume feature https://review.openstack.org/437217 | 19:41 |
| openstackgerrit | Merged openstack/tempest master: Add test case for volume unmanage and manage https://review.openstack.org/433411 | 19:42 |
| *** nadya has quit IRC | 19:42 | |
| openstackgerrit | Felipe Monteiro proposed openstack/patrole master: Modify policy parser to combine custom and default policy files. https://review.openstack.org/449348 | 19:43 |
| openstackrecheck | Console logs not available after 20:14s for gate-tempest-dsvm-ironic-ipa-wholedisk-bios-pxe_ipmitool-tinyipa-ubuntu-xenial 444337,18,4ff7b95 | 19:44 |
| dtroyer | so that venv bit explains a lot to me, I've done nearly all of my import timing testing in a venv | 19:45 |
| dtroyer | also, on my Macbook Air, so SSD | 19:45 |
| *** e0ne has quit IRC | 19:46 | |
| *** dsariel has joined #openstack-qa | 19:47 | |
| *** e0ne has joined #openstack-qa | 19:49 | |
| *** itzikb_ has quit IRC | 19:50 | |
| *** armax has joined #openstack-qa | 19:50 | |
| sdague | yeh, this is on an ssd | 19:56 |
| sdague | dtroyer: that also probably explains why we get dramatically different results and I'm like "this is so slow" :) | 19:57 |
| sdague | because normally it's just in a full devstack | 19:57 |
| sdague | so, if we venv installed osc on a gate node, we'd probably save ~ 2 minutes on a test run | 19:58 |
| sdague | of course, that completely throws a wrench in the osc plugin story | 19:58 |
| dtroyer | for the gate, not really, put them there too. we already know which ones to install | 19:59 |
| dtroyer | have you tried a venv with the usual DevStack-default plugins installed? | 19:59 |
| dtroyer | I don't think that those would make much of a difference, but I wouldn't have guessed a venv would either. | 20:00 |
| sdague | dtroyer: they would need to know how to get into the venv | 20:01 |
| clarkb | I updated https://github.com/pypa/setuptools/issues/926 with what I found so that maybe someone that groks setuptools better can run with it | 20:02 |
| sdague | dtroyer: how do we know which ones to install? | 20:02 |
| dtroyer | via ENABLED_SERVICES and/or LIBS_FFROM_GIT? | 20:03 |
| *** Apoorva has quit IRC | 20:04 | |
| openstackrecheck | Console logs not available after 20:23s for gate-dragonflow-dsvm-fullstack-ubuntu-xenial 443648,4,4ee0e1e | 20:05 |
| *** Apoorva has joined #openstack-qa | 20:05 | |
| *** rbak has joined #openstack-qa | 20:17 | |
| *** rbak has quit IRC | 20:17 | |
| *** rbak has joined #openstack-qa | 20:17 | |
| sdague | dtroyer: ... I'm not quite seeing it | 20:18 |
| sdague | but ok | 20:18 |
| dtroyer | That's from memory… we decide what to install in the first place via ENABLED_SERVICES and whatnot, I thought the client installs were in a separate function, I may be mis-remembering that bit | 20:19 |
| *** dustins has quit IRC | 20:21 | |
| sdague | dtroyer: yeh, I don't know, I'll play with a patch | 20:23 |
| openstackrecheck | Console logs not available after 20:10s for gate-zun-pep8-ubuntu-xenial 429943,7,c34ed1d | 20:25 |
| *** e0ne has quit IRC | 20:26 | |
| sdague | jroll: how does ironic get it's osc plugin installed? | 20:29 |
| jroll | sdague: pip install python-ironicclient | 20:30 |
| *** e0ne has joined #openstack-qa | 20:30 | |
| sdague | dtroyer: yeh, so that's going to be a problem | 20:31 |
| jroll | sdague: what bit exactly? | 20:32 |
| sdague | jroll: so... we could speed up openstack client quite a bit by putting it in a dedicated venv | 20:32 |
| sdague | as it turns out it hits code that scans the entire python library space, quite a few times | 20:32 |
| openstackgerrit | Felipe Monteiro proposed openstack/patrole master: Fix non-existent cinder policy action tests. https://review.openstack.org/450968 | 20:32 |
| jroll | right, I skimmed scrollback | 20:32 |
| sdague | but then a pip install python-ironicclient isn't going to make that plugin available to openstackclient | 20:33 |
| jroll | right, we'll have to change devstack plugins to do the right thing, yeah? | 20:33 |
| sdague | yeh, all of them | 20:33 |
| sdague | and it's not like there is a great interface there | 20:34 |
| jroll | which shouldn't be too bad, install it both globally and in a venv, tell people they'll get speedups if they use the venv | 20:34 |
| clarkb | maybe we just always install osc using all of the known plugins? | 20:34 |
| clarkb | it will still be smaller than devstack as a whole | 20:34 |
| sdague | clarkb: maybe it is ... | 20:34 |
| sdague | I suspect that is going to make for a ton of growth | 20:34 |
| clarkb | ya it could | 20:34 |
| openstackgerrit | Felipe Monteiro proposed openstack/patrole master: Fix non-existent cinder policy action tests. https://review.openstack.org/450968 | 20:34 |
| openstackgerrit | Nicolas Helgeson proposed openstack/patrole master: Identity V3 Tests - Roles https://review.openstack.org/442870 | 20:35 |
| jroll | is disk space a thing to be concerned about in devstack? | 20:35 |
| dtroyer | the 'openstackclient' package will do exactly that. Time to get it released I suppose... | 20:35 |
| clarkb | jroll: its less space and more things that you can stat in python path | 20:35 |
| dtroyer | ^^^ install all known plugins | 20:35 |
| jroll | clarkb: ah, gotcha | 20:35 |
| clarkb | jroll: since the thing that is slow is pkg_resources looks through your entire python path and parses every single version of python package installed there and sorts tehm | 20:36 |
| jroll | right right | 20:36 |
| jroll | sdague: feels like we could do global and venv installs for some time while we move devstack plugins, deprecate the global usage for a cycle | 20:37 |
| jroll | or a few months or something | 20:37 |
| sdague | dtroyer: so... how many crazy ideas are you willing to hear from me today? | 20:40 |
| dtroyer | I have a huge inbox already, so hit me | 20:41 |
| openstackrecheck | Console logs not available after 20:10s for gate-python-zunclient-pep8-ubuntu-xenial 441926,2,8caaf79 | 20:45 |
| *** e0ne has quit IRC | 20:47 | |
| *** esberglu has quit IRC | 20:47 | |
| *** esberglu has joined #openstack-qa | 20:48 | |
| openstackgerrit | Ken'ichi Ohmichi proposed openstack/tempest master: Remove set_mac_address from old remote_client https://review.openstack.org/448742 | 20:50 |
| *** tonytan4ever has quit IRC | 20:50 | |
| *** esberglu has quit IRC | 20:52 | |
| *** gcheresh_ has quit IRC | 20:55 | |
| *** e0ne has joined #openstack-qa | 20:58 | |
| *** markvoelker has joined #openstack-qa | 20:59 | |
| openstackgerrit | Rob Crittenden proposed openstack-dev/devstack master: Move enable_mod_ssl from lib/tls to lib/apache https://review.openstack.org/334675 | 20:59 |
| *** e0ne has quit IRC | 21:01 | |
| sdague | dtroyer: ok, so this is kind of the pattern that I have been pushing on mtreinish for tempest as well (and he mostly ignores me) :) | 21:01 |
| *** e0ne has joined #openstack-qa | 21:02 | |
| sdague | have openstack client be a no dependency project, which builds and manages it's own venv | 21:02 |
| sdague | then: openstack plugin add python-ironicclient | 21:02 |
| *** e0ne has quit IRC | 21:02 | |
| sdague | goes and installs that | 21:02 |
| sdague | because it's managing it's own venv | 21:02 |
| *** e0ne has joined #openstack-qa | 21:02 | |
| dtroyer | how does this work in a distro package world? | 21:03 |
| dtroyer | that's dynamic vendoring :) | 21:03 |
| *** e0ne has quit IRC | 21:03 | |
| sdague | dtroyer: yeh, well, it's a crazy idea :) | 21:03 |
| sdague | but they are sticking everything in docker containers now anyway | 21:03 |
| dtroyer | I've cnsidered it, and really that's just an unpacked py2exe thing, which actually works | 21:03 |
| sdague | honestly, I don't know how it works there | 21:03 |
| *** e0ne has joined #openstack-qa | 21:04 | |
| *** markvoelker has quit IRC | 21:04 | |
| *** e0ne has quit IRC | 21:04 | |
| dtroyer | I can't use py2exe and friends because none of them support entrypoints, or I'd have done that 3 years ago | 21:04 |
| sdague | but, if the options on the table are "do this" or "rewrite in a whole other language" this seems like a much nearer term thing to get a bit more control over the load times | 21:04 |
| *** rfolco has quit IRC | 21:04 | |
| *** e0ne has joined #openstack-qa | 21:04 | |
| *** e0ne has quit IRC | 21:05 | |
| *** e0ne has joined #openstack-qa | 21:05 | |
| sdague | dtroyer: so if it was managing it's own venv you probably could forgo entrypoints | 21:05 |
| dtroyer | one thing we are doing is removing dependencies, unfortunately most of the slow-to-load ones are not going away any time soon | 21:05 |
| sdague | osc actually knows what it installed | 21:05 |
| *** e0ne has quit IRC | 21:05 | |
| openstackrecheck | Console logs not available after 20:15s for gate-nova-tox-functional-ubuntu-xenial 449742,2,2ef8161 | 21:06 |
| sdague | part of the current problem is osc has no idea what's installed, it has to ask python | 21:06 |
| *** e0ne has joined #openstack-qa | 21:06 | |
| dtroyer | so you are now getting closer to a rewrite scale where changing platforms gets more competitive | 21:06 |
| *** e0ne has quit IRC | 21:06 | |
| sdague | dtroyer: maybe | 21:06 |
| sdague | anyway, like I said, crazy idea | 21:07 |
| *** aojea has quit IRC | 21:07 | |
| dtroyer | in practice that's how I use OSC anyway though, just managed with a Makefile for the 5 different combinations I track | 21:07 |
| sdague | dtroyer: sure, but the fact is that's not how most other people use it | 21:08 |
| sdague | which means they are getting a suboptimal experience, and it would be nice to get their experience in line with yours | 21:08 |
| sdague | anyway, time to go work on dinner | 21:08 |
| dtroyer | its crazy ideal like that though that lead to useful things a lot of the time… I'll ponder it a bit more | 21:09 |
| *** dimtruck is now known as zz_dimtruck | 21:10 | |
| *** gouthamr has quit IRC | 21:10 | |
| clarkb | I ran across another packager recently and now I forgot what it was | 21:11 |
| clarkb | but wonder if it solves the py2exe type problems | 21:11 |
| clarkb | dtroyer: https://conda.io/docs/ | 21:15 |
| *** rbak has quit IRC | 21:18 | |
| *** blancos has joined #openstack-qa | 21:18 | |
| *** jrcloud has joined #openstack-qa | 21:18 | |
| dtroyer | clarkb: at a glance it looks like it does handle entrypoint now, I don't think it did when I did my trials | 21:19 |
| *** zackf has quit IRC | 21:20 | |
| *** vhosakot_ has joined #openstack-qa | 21:20 | |
| *** vhosakot has quit IRC | 21:22 | |
| openstackrecheck | Console logs not available after 20:07s for gate-mistral-pep8-ubuntu-xenial 449143,3,490dc3c | 21:26 |
| *** dustins has joined #openstack-qa | 21:26 | |
| clarkb | sdague: fyi the pbr version thing isn't drop in fix http://logs.openstack.org/18/450918/2/check/gate-tempest-dsvm-neutron-src-pbr-ubuntu-xenial/264050b/logs/screen-n-cpu.txt.gz?level=WARNING#_2017-03-28_18_58_01_259 | 21:27 |
| clarkb | mordred: ^ you are probably interested in that too | 21:27 |
| openstackgerrit | Samantha Blanco proposed openstack/patrole master: Removes invalid Neutron policy actions https://review.openstack.org/450999 | 21:27 |
| clarkb | I don't know why its not getting serialized properly as is | 21:27 |
| *** vhosakot_ has quit IRC | 21:28 | |
| mordred | clarkb: zomg. I betcha the libvirt code there is doing something like an "isinstance(str)" | 21:28 |
| *** aojea has joined #openstack-qa | 21:29 | |
| *** mriedem has quit IRC | 21:29 | |
| *** vhosakot has joined #openstack-qa | 21:30 | |
| *** ihrachys has quit IRC | 21:32 | |
| *** gfidente|afk has quit IRC | 21:38 | |
| *** mriedem has joined #openstack-qa | 21:40 | |
| openstackrecheck | Console logs not available after 20:07s for gate-python-barbicanclient-devstack-dsvm-ubuntu-xenial 434317,1,f468b88 | 21:46 |
| *** aojea has quit IRC | 21:49 | |
| *** aojea has joined #openstack-qa | 21:49 | |
| *** aojea has quit IRC | 21:54 | |
| *** awaugama has quit IRC | 21:57 | |
| *** markvoelker has joined #openstack-qa | 21:59 | |
| *** gouthamr has joined #openstack-qa | 22:01 | |
| *** blancos has quit IRC | 22:04 | |
| *** mriedem has quit IRC | 22:04 | |
| *** markvoelker has quit IRC | 22:06 | |
| openstackrecheck | Console logs not available after 20:11s for gate-tempest-dsvm-full-ceph-plugin-src-glance_store-ubuntu-xenial 449637,1,9287257 | 22:06 |
| *** cody-somerville has joined #openstack-qa | 22:08 | |
| *** fnaval has quit IRC | 22:08 | |
| *** mriedem has joined #openstack-qa | 22:18 | |
| *** dustins has quit IRC | 22:19 | |
| *** felipemonteiro has quit IRC | 22:25 | |
| openstackrecheck | Console logs not available after 20:09s for gate-swift-tox-xfs-tmp-func-encryption-ubuntu-xenial 441921,6,857bfd6 | 22:26 |
| oomichi | andreaf: gmann: masayukig: can you take a look at https://review.openstack.org/#/c/447081/ ? | 22:29 |
| *** yamamoto has joined #openstack-qa | 22:30 | |
| *** yamamoto has quit IRC | 22:37 | |
| *** ihrachys has joined #openstack-qa | 22:45 | |
| openstackrecheck | Console logs not available after 20:16s for gate-tempest-dsvm-neutron-full-ubuntu-xenial 450211,1,9111fd0 | 22:46 |
| *** vhosakot has quit IRC | 22:49 | |
| *** david-lyle has quit IRC | 22:51 | |
| *** fnaval has joined #openstack-qa | 22:52 | |
| *** yamamoto has joined #openstack-qa | 22:53 | |
| *** ihrachys has quit IRC | 22:55 | |
| *** dkranz has quit IRC | 22:55 | |
| *** yamamoto has quit IRC | 22:56 | |
| *** zz_dimtruck is now known as dimtruck | 22:56 | |
| charcol | mtreinish, I watched it yesterday and it was really helpful, so thank you! | 23:01 |
| mtreinish | charcol: cool, glad you found it useful | 23:01 |
| mtreinish | although some of the info in that presentation is a bit dated now | 23:01 |
| *** markvoelker has joined #openstack-qa | 23:02 | |
| *** yamamoto has joined #openstack-qa | 23:03 | |
| *** markvoelker has quit IRC | 23:06 | |
| openstackrecheck | Console logs not available after 20:18s for gate-python-cinderclient-releasenotes 449858,4,18ccf23 | 23:07 |
| *** sdague has quit IRC | 23:15 | |
| *** yamamoto has quit IRC | 23:24 | |
| openstackrecheck | Console logs not available after 20:12s for gate-freezer-api-pep8-ubuntu-xenial 441207,6,df64952 | 23:27 |
| *** mriedem has quit IRC | 23:28 | |
| clarkb | mordred: the problem with the lxml thing is its got the python object in C | 23:30 |
| clarkb | mordred: so I think its being extra careful and not so duck typey | 23:31 |
| clarkb | mordred: I actually don't know how to deal with that in a sane way | 23:31 |
| clarkb | likely nova would need to explicitly cast there if we want to do what sdague suggseted | 23:31 |
| *** dave-mccowan has quit IRC | 23:31 | |
| *** catintheroof has joined #openstack-qa | 23:37 | |
| *** chrome0 has quit IRC | 23:40 | |
| *** chrome0 has joined #openstack-qa | 23:43 | |
| *** erlon has joined #openstack-qa | 23:44 | |
| openstackrecheck | Console logs not available after 20:13s for gate-shade-dsvm-functional-legacy 450260,1,07887a3 | 23:47 |
| *** charcol has quit IRC | 23:59 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!