openstackrecheck | openstack/nova change: https://review.openstack.org/60098 failed tempest because of: https://bugs.launchpad.net/bugs/1257641 | 00:01 |
---|---|---|
*** HenryG has quit IRC | 00:04 | |
*** HenryG has joined #openstack-qa | 00:04 | |
openstackgerrit | Matthew Oliver proposed a change to openstack-dev/devstack: Modified the create_nova_conf function to add the $KEYSTONE_AUTH_PORT to the keystone_authtoken section. This is required as without this nova doesn't communicate to the keystone server generating an "Unauthorised (HTTP 401)" page when acceesing /admin/. https://review.openstack.org/60736 | 00:11 |
openstackrecheck | openstack/cinder change: https://review.openstack.org/60924 failed tempest because of: https://bugs.launchpad.net/bugs/1253896 and https://bugs.launchpad.net/bugs/1257641 | 00:21 |
openstackgerrit | Matthew Treinish proposed a change to openstack/tempest: Stop running TempestConfig() on import https://review.openstack.org/60925 | 00:23 |
*** giulivo has quit IRC | 00:23 | |
*** ken1ohmichi has joined #openstack-qa | 00:28 | |
ken1ohmichi | cyeoh: hi, | 00:35 |
*** bknudson has left #openstack-qa | 00:35 | |
cyeoh | ken1ohmichi: hi | 00:36 |
ken1ohmichi | cyeoh: could you give me advice at https://review.openstack.org/#/c/60406/ later ? | 00:36 |
ken1ohmichi | cyeoh: It is about API inconsistency of Nova v2 API. | 00:37 |
cyeoh | ken1ohmichi: yea just having a look. is there a description of what the inconsistency is? | 00:37 |
cyeoh | i'm just wondering if it is a "bug" or just an inconsistency (if its tha latter we can't fix it for V2) | 00:38 |
cyeoh | if its stopping something from working then we can | 00:38 |
ken1ohmichi | cyeoh: thanks, there is description on https://review.openstack.org/#/c/60406/11/tempest/api/compute/admin/test_hosts_negative.py . | 00:38 |
*** diakunchikov__ has joined #openstack-qa | 00:39 | |
cyeoh | ken1ohmichi: I think we should probably just leave the V2 API the way it is for that one | 00:40 |
cyeoh | its not ideal, but I don't think its really worth the pain/risk fixing it | 00:41 |
ken1ohmichi | cyeoh: you mean it is difficult to fix v2 API? | 00:41 |
cyeoh | ken1ohmichi: well there's a couple of issues here | 00:42 |
cyeoh | There could be existing apps which are technically incorrect here (surplus parameter) but they currently work | 00:43 |
cyeoh | because the extra parameter is currently ignored | 00:43 |
ken1ohmichi | cyeoh: you are right. | 00:43 |
ken1ohmichi | cyeoh: My concern is this topic would become big for whole of Nova API. | 00:44 |
cyeoh | If it was causing a real problem wrt to functionality I think it'd be ok to fix it, but as its just a failure to reject extra data, but otherwise work ok I think its better to not risk breaking people's programs | 00:44 |
cyeoh | yea I think the general line we take with the Nova API is if you want better input validation use the V3 API | 00:45 |
ken1ohmichi | cyeoh: I agree with you:) | 00:45 |
ken1ohmichi | cyeoh: thanks for your time! | 00:45 |
*** diakunchikov_ has quit IRC | 00:46 | |
*** kashyap has quit IRC | 00:46 | |
*** ianw has quit IRC | 00:46 | |
cyeoh | np. I'll leave a comment on the patch | 00:46 |
ken1ohmichi | cyeoh: great, thanks in advance | 00:46 |
*** kashyap has joined #openstack-qa | 00:47 | |
*** dmorita has joined #openstack-qa | 00:47 | |
*** openstack has joined #openstack-qa | 00:49 | |
openstackrecheck | openstack/keystone change: https://review.openstack.org/60973 failed tempest because of: https://bugs.launchpad.net/bugs/1257641 | 00:54 |
*** ianw has joined #openstack-qa | 00:56 | |
*** jorisroovers has quit IRC | 01:00 | |
openstackrecheck | openstack/neutron change: https://review.openstack.org/59787 failed tempest because of: https://bugs.launchpad.net/bugs/1251448 and https://bugs.launchpad.net/bugs/1244255 and https://bugs.launchpad.net/bugs/1253896 and https://bugs.launchpad.net/bugs/1257641 and https://bugs.launchpad.net/bugs/1249065 | 01:06 |
clarkb | woah | 01:09 |
openstackrecheck | openstack/tempest change: https://review.openstack.org/60925 failed tempest because of: https://bugs.launchpad.net/bugs/1253896 | 01:10 |
openstackgerrit | A change was merged to openstack-infra/elastic-recheck: move the graph generating code over to facets https://review.openstack.org/60609 | 01:12 |
openstackgerrit | A change was merged to openstack-infra/elastic-recheck: sort the graph list by number of fails https://review.openstack.org/60613 | 01:12 |
openstackgerrit | A change was merged to openstack-infra/elastic-recheck: set y axis on failure rate graph https://review.openstack.org/60630 | 01:12 |
openstackgerrit | Mauro S. M. Rodrigues proposed a change to openstack-dev/grenade: Modify upgrade-* scripts to allow skip configuration if not needed https://review.openstack.org/60795 | 01:12 |
openstackgerrit | Matthew Treinish proposed a change to openstack/tempest: Stop running TempestConfig() on import https://review.openstack.org/60925 | 01:22 |
*** adalbas has quit IRC | 01:22 | |
openstackgerrit | Mauro S. M. Rodrigues proposed a change to openstack-dev/grenade: Modify upgrade-* scripts to allow skip configuration if not needed https://review.openstack.org/60795 | 01:26 |
*** mrodden has quit IRC | 01:26 | |
openstackgerrit | Mauro S. M. Rodrigues proposed a change to openstack-dev/grenade: Tempest should be configured with upgrade projects only https://review.openstack.org/60901 | 01:27 |
openstackgerrit | Mauro S. M. Rodrigues proposed a change to openstack-dev/grenade: Add clean configuration files to upgrade from H to I https://review.openstack.org/53874 | 01:28 |
*** nosnos has joined #openstack-qa | 01:28 | |
*** bill_az has quit IRC | 01:29 | |
openstackrecheck | openstack/neutron change: https://review.openstack.org/60461 failed tempest because of: https://bugs.launchpad.net/bugs/1251448 | 01:39 |
*** mrodden has joined #openstack-qa | 01:43 | |
openstackrecheck | openstack/neutron change: https://review.openstack.org/60587 failed tempest because of: https://bugs.launchpad.net/bugs/1224001 | 01:49 |
openstackrecheck | openstack/heat change: https://review.openstack.org/60991 failed tempest because of: https://bugs.launchpad.net/bugs/1257641 | 01:52 |
*** dkranz has joined #openstack-qa | 01:54 | |
*** jerryz has quit IRC | 01:58 | |
*** mrodden has quit IRC | 02:07 | |
*** rwsu has quit IRC | 02:12 | |
*** notmyname has quit IRC | 02:14 | |
*** notmyname has joined #openstack-qa | 02:15 | |
*** mrodden has joined #openstack-qa | 02:18 | |
*** dkranz has quit IRC | 02:18 | |
openstackrecheck | openstack/neutron change: https://review.openstack.org/60653 failed tempest because of: https://bugs.launchpad.net/bugs/1251448 | 02:23 |
*** zhikunliu has joined #openstack-qa | 02:25 | |
*** rwsu has joined #openstack-qa | 02:25 | |
openstackgerrit | Matthew Oliver proposed a change to openstack-dev/devstack: Added keystone auth port to the nova config https://review.openstack.org/60736 | 02:26 |
*** ivanzhu has joined #openstack-qa | 02:28 | |
openstackgerrit | A change was merged to openstack/tempest: Modify the name of a negative test class https://review.openstack.org/60771 | 02:30 |
*** prekarat has quit IRC | 02:31 | |
*** marun has quit IRC | 02:32 | |
*** marun has joined #openstack-qa | 02:33 | |
*** ken1ohmichi has quit IRC | 02:34 | |
*** fungi has quit IRC | 02:34 | |
*** weshay has quit IRC | 02:36 | |
openstackrecheck | openstack/nova change: https://review.openstack.org/25882 failed tempest because of: https://bugs.launchpad.net/bugs/1257641 | 02:41 |
openstackgerrit | A change was merged to openstack/tempest: Remove redundant whitelist for DHCP agent https://review.openstack.org/60554 | 02:41 |
lifeless | sdague: did you have more q's on https://review.openstack.org/#/c/50542/ ? | 02:48 |
*** Madan has joined #openstack-qa | 02:55 | |
*** masayukig has joined #openstack-qa | 03:04 | |
openstackrecheck | openstack/glance change: https://review.openstack.org/54376 failed tempest because of: https://bugs.launchpad.net/bugs/1253896 | 03:06 |
openstackgerrit | Matthew Treinish proposed a change to openstack/tempest: Stop running TempestConfig() on import https://review.openstack.org/60925 | 03:10 |
*** fungi has joined #openstack-qa | 03:24 | |
*** fungi has quit IRC | 03:25 | |
openstackrecheck | openstack/swift change: https://review.openstack.org/60934 failed tempest because of: https://bugs.launchpad.net/bugs/1257626 | 03:31 |
openstackgerrit | huangtianhua proposed a change to openstack/tempest: Add tests for snapshot_metadata https://review.openstack.org/60791 | 03:34 |
*** fungi has joined #openstack-qa | 03:34 | |
*** jgrimm has quit IRC | 03:37 | |
*** amotoki has joined #openstack-qa | 03:39 | |
openstackrecheck | openstack/neutron change: https://review.openstack.org/59858 failed tempest because of: https://bugs.launchpad.net/bugs/1210483 | 03:42 |
openstackgerrit | Matthew Treinish proposed a change to openstack/tempest: Stop running TempestConfig() on import https://review.openstack.org/60925 | 03:52 |
openstackrecheck | openstack/tempest change: https://review.openstack.org/60791 failed tempest with an unrecognized error | 04:10 |
openstackgerrit | Zhi Kun Liu proposed a change to openstack/tempest: cinder v2 api tests - part1 https://review.openstack.org/59113 | 04:11 |
*** mrodden1 has joined #openstack-qa | 04:16 | |
*** mrodden has quit IRC | 04:16 | |
openstackgerrit | Mauro S. M. Rodrigues proposed a change to openstack-dev/grenade: Modify upgrade-* scripts to allow skip configuration if not needed https://review.openstack.org/60795 | 04:22 |
openstackgerrit | Mauro S. M. Rodrigues proposed a change to openstack-dev/grenade: Tempest should be configured with upgrade projects only https://review.openstack.org/60901 | 04:22 |
openstackgerrit | Mauro S. M. Rodrigues proposed a change to openstack-dev/grenade: Add clean configuration files to upgrade from H to I https://review.openstack.org/53874 | 04:23 |
openstackrecheck | openstack/keystone change: https://review.openstack.org/60742 failed tempest with an unrecognized error | 04:31 |
openstackrecheck | openstack/keystone change: https://review.openstack.org/57811 failed tempest because of: https://bugs.launchpad.net/bugs/1257641 | 04:33 |
*** maurosr_ has quit IRC | 04:34 | |
*** SergeyLukjanov has joined #openstack-qa | 04:38 | |
openstackrecheck | openstack/cinder change: https://review.openstack.org/60746 failed tempest because of: https://bugs.launchpad.net/bugs/1257641 | 04:53 |
openstackrecheck | openstack/swift change: https://review.openstack.org/61006 failed tempest because of: https://bugs.launchpad.net/bugs/1257641 | 04:57 |
*** prekarat has joined #openstack-qa | 05:01 | |
openstackrecheck | openstack/keystone change: https://review.openstack.org/57811 failed tempest because of: https://bugs.launchpad.net/bugs/1257641 | 05:11 |
*** ivanzhu1 has joined #openstack-qa | 05:25 | |
openstackrecheck | openstack/cinder change: https://review.openstack.org/60746 failed tempest with an unrecognized error | 05:28 |
*** psharma has joined #openstack-qa | 05:28 | |
*** ivanzhu has quit IRC | 05:29 | |
*** ivanzhu has joined #openstack-qa | 05:31 | |
*** ivanzhu1 has quit IRC | 05:33 | |
openstackrecheck | openstack/neutron change: https://review.openstack.org/60587 failed tempest with an unrecognized error | 05:37 |
openstackgerrit | Ivan-Zhu proposed a change to openstack/tempest: port test_quotas into v3 part2 https://review.openstack.org/58690 | 05:43 |
openstackrecheck | openstack/heat change: https://review.openstack.org/60770 failed tempest because of: https://bugs.launchpad.net/bugs/1257626 | 05:50 |
*** Anju has joined #openstack-qa | 05:51 | |
openstackgerrit | Ken'ichi Ohmichi proposed a change to openstack/tempest: Do not merge: Add debugging messages https://review.openstack.org/61017 | 06:01 |
openstackrecheck | openstack/nova change: https://review.openstack.org/60992 failed tempest because of: https://bugs.launchpad.net/bugs/1254872 | 06:02 |
openstackgerrit | Yuiko Takada proposed a change to openstack/tempest: Fix the upper values of test_network_quotas https://review.openstack.org/57392 | 06:03 |
*** dkorn has joined #openstack-qa | 06:03 | |
*** masayukig has quit IRC | 06:06 | |
*** SergeyLukjanov is now known as _SergeyLukjanov | 06:10 | |
*** _SergeyLukjanov has quit IRC | 06:10 | |
*** dkorn has quit IRC | 06:11 | |
openstackgerrit | Zhi Kun Liu proposed a change to openstack/tempest: cinder v2 api tests - part1 https://review.openstack.org/59113 | 06:12 |
openstackgerrit | Zhi Kun Liu proposed a change to openstack/tempest: cinder v2 api tests - part2 https://review.openstack.org/59733 | 06:12 |
Anju | afazekas: ping | 06:15 |
*** ivanzhu has quit IRC | 06:28 | |
*** ivanzhu has joined #openstack-qa | 06:30 | |
*** jlibosva has joined #openstack-qa | 06:31 | |
*** ivanzhu has quit IRC | 06:34 | |
*** jamielennox is now known as jamielennox|away | 06:36 | |
openstackrecheck | openstack/ceilometer change: https://review.openstack.org/42838 failed tempest with an unrecognized error | 06:42 |
openstackrecheck | openstack/ceilometer change: https://review.openstack.org/60154 failed tempest with an unrecognized error | 06:46 |
openstackrecheck | openstack/heat change: https://review.openstack.org/60648 failed tempest because of: https://bugs.launchpad.net/bugs/1257641 | 06:46 |
openstackrecheck | openstack/horizon change: https://review.openstack.org/55989 failed tempest because of: https://bugs.launchpad.net/bugs/1257626 | 06:47 |
openstackrecheck | openstack/nova change: https://review.openstack.org/60649 failed tempest because of: https://bugs.launchpad.net/bugs/1257626 | 06:47 |
openstackrecheck | openstack/glance change: https://review.openstack.org/58128 failed tempest with an unrecognized error | 06:47 |
*** ivanzhu has joined #openstack-qa | 06:50 | |
openstackrecheck | openstack/glance change: https://review.openstack.org/59014 failed tempest because of: https://bugs.launchpad.net/bugs/1210483 | 06:51 |
openstackrecheck | openstack/keystone change: https://review.openstack.org/56887 failed tempest with an unrecognized error | 07:07 |
openstackgerrit | Yair Fried proposed a change to openstack/tempest: scenario/network_basic_ops: detach floating-ip https://review.openstack.org/55810 | 07:20 |
openstackgerrit | Ken'ichi Ohmichi proposed a change to openstack/tempest: Do not merge: Add debugging messages https://review.openstack.org/61017 | 07:21 |
openstackrecheck | openstack/neutron change: https://review.openstack.org/60805 failed tempest because of: https://bugs.launchpad.net/bugs/1253896 | 07:23 |
*** jhenner has quit IRC | 07:25 | |
openstackgerrit | Ivan-Zhu proposed a change to openstack/tempest: avoid resource leaks in keypairs tests https://review.openstack.org/61025 | 07:25 |
openstackgerrit | Ivan-Zhu proposed a change to openstack/tempest: port test_keypairs into nova v3 part1 https://review.openstack.org/57389 | 07:25 |
openstackgerrit | Ivan-Zhu proposed a change to openstack/tempest: port test_keypairs into nova v3 part2 https://review.openstack.org/57390 | 07:25 |
openstackrecheck | openstack/glance change: https://review.openstack.org/59014 failed tempest with an unrecognized error | 07:32 |
*** yfried has joined #openstack-qa | 07:32 | |
*** thomasbiege has joined #openstack-qa | 07:33 | |
*** SushilKM has joined #openstack-qa | 07:37 | |
openstackgerrit | Ivan-Zhu proposed a change to openstack/tempest: port test_quotas into v3 part2 https://review.openstack.org/58690 | 07:40 |
openstackgerrit | Zhi Kun Liu proposed a change to openstack/tempest: cinder v2 api tests - part1 https://review.openstack.org/59113 | 07:45 |
*** thomasbiege1 has joined #openstack-qa | 07:46 | |
*** thomasbiege has quit IRC | 07:47 | |
*** SergeyLukjanov has joined #openstack-qa | 07:53 | |
*** SushilKM has quit IRC | 07:53 | |
*** yfried has quit IRC | 08:02 | |
openstackrecheck | openstack/tempest change: https://review.openstack.org/57390 failed tempest because of: https://bugs.launchpad.net/bugs/1257641 | 08:16 |
openstackgerrit | Rohan Kanade proposed a change to openstack/tempest: Allow setting default network for instance spwan https://review.openstack.org/61037 | 08:18 |
*** thomasbiege1 has quit IRC | 08:21 | |
openstackgerrit | Zhi Kun Liu proposed a change to openstack/tempest: cinder v2 api tests - part2 https://review.openstack.org/59733 | 08:22 |
*** Madan1 has joined #openstack-qa | 08:22 | |
*** Madan has quit IRC | 08:24 | |
*** prekarat has quit IRC | 08:25 | |
*** prekarat has joined #openstack-qa | 08:25 | |
*** fbo_away is now known as fbo | 08:29 | |
*** rossella_s has joined #openstack-qa | 08:34 | |
*** Anju has quit IRC | 08:34 | |
*** rossella_s has quit IRC | 08:39 | |
*** giulivo has joined #openstack-qa | 08:51 | |
openstackrecheck | openstack/nova change: https://review.openstack.org/45867 failed tempest because of: https://bugs.launchpad.net/bugs/1257641 | 08:54 |
openstackrecheck | openstack/neutron change: https://review.openstack.org/60805 failed tempest because of: https://bugs.launchpad.net/bugs/1253896 | 08:55 |
openstackrecheck | openstack/neutron change: https://review.openstack.org/61027 failed tempest with an unrecognized error | 08:59 |
*** yassine has joined #openstack-qa | 08:59 | |
openstackrecheck | openstack/nova change: https://review.openstack.org/57143 failed tempest with an unrecognized error | 09:07 |
*** safchain has joined #openstack-qa | 09:09 | |
*** prekarat has quit IRC | 09:10 | |
*** jpich has joined #openstack-qa | 09:10 | |
openstackrecheck | openstack/ceilometer change: https://review.openstack.org/42838 failed tempest because of: https://bugs.launchpad.net/bugs/1257641 | 09:12 |
*** thomasbiege has joined #openstack-qa | 09:22 | |
*** prekarat has joined #openstack-qa | 09:25 | |
openstackrecheck | openstack/python-keystoneclient change: https://review.openstack.org/61046 failed tempest because of: https://bugs.launchpad.net/bugs/1249065 | 09:27 |
*** thomasbiege has quit IRC | 09:31 | |
*** ivanzhu has left #openstack-qa | 09:33 | |
*** SergeyLukjanov is now known as _SergeyLukjanov | 09:34 | |
*** _SergeyLukjanov has quit IRC | 09:34 | |
*** Anju has joined #openstack-qa | 09:35 | |
openstackrecheck | openstack/nova change: https://review.openstack.org/58523 failed tempest because of: https://bugs.launchpad.net/bugs/1254872 | 09:37 |
openstackrecheck | openstack/heat change: https://review.openstack.org/60648 failed tempest because of: https://bugs.launchpad.net/bugs/1257641 | 09:37 |
*** thomasbiege has joined #openstack-qa | 09:41 | |
*** markmcclain has joined #openstack-qa | 09:42 | |
*** SergeyLukjanov has joined #openstack-qa | 09:45 | |
openstackgerrit | Zhi Kun Liu proposed a change to openstack/tempest: port admin/test_servers* into Nova V3 tests part1 https://review.openstack.org/60776 | 09:47 |
openstackgerrit | Zhi Kun Liu proposed a change to openstack/tempest: port admin/test_servers* into Nova V3 tests part2 https://review.openstack.org/60831 | 09:47 |
*** debasish has joined #openstack-qa | 09:54 | |
*** jlibosva has quit IRC | 09:55 | |
*** jlibosva has joined #openstack-qa | 09:58 | |
*** sthaha has quit IRC | 09:59 | |
openstackrecheck | openstack/neutron change: https://review.openstack.org/60461 failed tempest because of: https://bugs.launchpad.net/bugs/1251448 | 10:02 |
openstackrecheck | openstack/horizon change: https://review.openstack.org/54242 failed tempest because of: https://bugs.launchpad.net/bugs/1257641 | 10:06 |
openstackgerrit | Zhi Kun Liu proposed a change to openstack/tempest: port admin/test_servers* into Nova V3 tests part2 https://review.openstack.org/60831 | 10:06 |
*** zhikunliu has quit IRC | 10:07 | |
*** jorisroovers has joined #openstack-qa | 10:13 | |
openstackgerrit | Rohan Kanade proposed a change to openstack/tempest: Allow setting default network for instance spwan https://review.openstack.org/61037 | 10:20 |
openstackrecheck | openstack/neutron change: https://review.openstack.org/60195 failed tempest with an unrecognized error | 10:29 |
*** markmcclain has quit IRC | 10:30 | |
*** jlibosva1 has joined #openstack-qa | 10:31 | |
*** jlibosva has quit IRC | 10:33 | |
*** markmcclain has joined #openstack-qa | 10:33 | |
*** adalbas has joined #openstack-qa | 10:35 | |
openstackrecheck | openstack/horizon change: https://review.openstack.org/54242 failed tempest because of: https://bugs.launchpad.net/bugs/1257626 | 10:40 |
adalbas | giulivo, hi! could you add me as the owner/drafter of this bp: https://blueprints.launchpad.net/tempest/+spec/negative-test-files ? | 10:44 |
giulivo | adalbas, done, thanks for pinging ... I'm going trough a review of the blueprints later today | 10:45 |
adalbas | giulivo,I'm now able to edit it. Tks!! | 10:46 |
*** cyeoh has quit IRC | 10:50 | |
*** dmorita has quit IRC | 10:52 | |
openstackrecheck | openstack/tempest change: https://review.openstack.org/60831 failed tempest with an unrecognized error | 10:55 |
openstackrecheck | openstack/glance change: https://review.openstack.org/59630 failed tempest because of: https://bugs.launchpad.net/bugs/1257641 | 10:56 |
openstackrecheck | openstack/tempest change: https://review.openstack.org/61037 failed tempest because of: https://bugs.launchpad.net/bugs/1257641 | 10:58 |
*** thomasbiege has quit IRC | 10:59 | |
*** Anju has quit IRC | 11:00 | |
*** thomasbiege has joined #openstack-qa | 11:01 | |
*** markmcclain has quit IRC | 11:05 | |
openstackrecheck | openstack/horizon change: https://review.openstack.org/61033 failed tempest with an unrecognized error | 11:11 |
*** jorisroovers has quit IRC | 11:14 | |
openstackrecheck | openstack/neutron change: https://review.openstack.org/60461 failed tempest because of: https://bugs.launchpad.net/bugs/1251448 | 11:15 |
*** prekarat has quit IRC | 11:16 | |
*** rfolco has joined #openstack-qa | 11:18 | |
*** thomasbiege has quit IRC | 11:19 | |
*** jhenner has joined #openstack-qa | 11:28 | |
openstackgerrit | Mauro S. M. Rodrigues proposed a change to openstack-dev/grenade: Modify upgrade-* scripts to allow skip configuration if not needed https://review.openstack.org/60795 | 11:46 |
*** jorisroovers has joined #openstack-qa | 11:46 | |
*** SushilKM has joined #openstack-qa | 11:47 | |
openstackgerrit | mouad benchchaoui proposed a change to openstack/tempest: Fix cinder test cases when cinder extensions are in use https://review.openstack.org/61091 | 11:48 |
openstackgerrit | mouad benchchaoui proposed a change to openstack/tempest: Fix cinder test cases when cinder extensions are in use https://review.openstack.org/61091 | 11:51 |
openstackgerrit | mouad benchchaoui proposed a change to openstack/tempest: Fix cinder test cases when cinder extensions are in use https://review.openstack.org/61091 | 11:52 |
*** amotoki has quit IRC | 11:53 | |
*** SushilKM has quit IRC | 11:54 | |
*** HenryG has quit IRC | 11:55 | |
*** sthaha has joined #openstack-qa | 11:59 | |
openstackrecheck | openstack/heat change: https://review.openstack.org/60532 failed tempest with an unrecognized error | 12:05 |
openstackrecheck | openstack/python-novaclient change: https://review.openstack.org/58418 failed tempest with an unrecognized error | 12:13 |
openstackrecheck | openstack/heat change: https://review.openstack.org/61074 failed tempest with an unrecognized error | 12:17 |
openstackgerrit | Mauro S. M. Rodrigues proposed a change to openstack-dev/grenade: Tempest should be configured with upgrade projects only https://review.openstack.org/60901 | 12:17 |
openstackgerrit | Mauro S. M. Rodrigues proposed a change to openstack-dev/grenade: Add clean configuration files to upgrade from H to I https://review.openstack.org/53874 | 12:17 |
*** weshay has joined #openstack-qa | 12:21 | |
*** sthaha has quit IRC | 12:21 | |
*** SergeyLukjanov is now known as _SergeyLukjanov | 12:21 | |
*** sthaha has joined #openstack-qa | 12:21 | |
*** sthaha has quit IRC | 12:21 | |
*** sthaha has joined #openstack-qa | 12:21 | |
*** _SergeyLukjanov has quit IRC | 12:21 | |
*** cyeoh_ has joined #openstack-qa | 12:27 | |
*** cyeoh_ is now known as cyeoh | 12:27 | |
*** nosnos has quit IRC | 12:29 | |
*** thomasbiege has joined #openstack-qa | 12:30 | |
*** sthaha has quit IRC | 12:30 | |
openstackrecheck | openstack/neutron change: https://review.openstack.org/59948 failed tempest with an unrecognized error | 12:34 |
*** mkollaro has joined #openstack-qa | 12:36 | |
*** SergeyLukjanov has joined #openstack-qa | 12:38 | |
*** cyeoh has quit IRC | 12:38 | |
openstackgerrit | mouad benchchaoui proposed a change to openstack/tempest: Fix cinder test cases when cinder extensions are in use https://review.openstack.org/61091 | 12:43 |
openstackrecheck | openstack/ceilometer change: https://review.openstack.org/42838 failed tempest because of: https://bugs.launchpad.net/bugs/1257641 | 12:44 |
openstackgerrit | mouad benchchaoui proposed a change to openstack/tempest: Make testing neutron's lbaas, vpnaas and metering optional https://review.openstack.org/55133 | 12:46 |
sdague | lifeless: thanks for the link | 12:47 |
*** Grishkin has quit IRC | 12:52 | |
*** Grishkin has joined #openstack-qa | 12:53 | |
*** thomasbiege has quit IRC | 12:55 | |
*** thomasbiege has joined #openstack-qa | 12:56 | |
*** SushilKM has joined #openstack-qa | 12:57 | |
openstackgerrit | adalbas proposed a change to openstack/tempest: Separate negative tests for list_floating_ips https://review.openstack.org/59815 | 12:57 |
openstackrecheck | openstack/python-keystoneclient change: https://review.openstack.org/60859 failed tempest with an unrecognized error | 12:59 |
*** yassine_ has joined #openstack-qa | 13:00 | |
openstackrecheck | openstack/python-novaclient change: https://review.openstack.org/61012 failed tempest with an unrecognized error | 13:02 |
openstackrecheck | openstack/heat change: https://review.openstack.org/61074 failed tempest with an unrecognized error | 13:02 |
*** yassine has quit IRC | 13:02 | |
*** mkollaro has quit IRC | 13:04 | |
*** mkollaro1 has joined #openstack-qa | 13:04 | |
*** SushilKM has quit IRC | 13:04 | |
*** jhenner has quit IRC | 13:04 | |
*** SushilKM has joined #openstack-qa | 13:05 | |
*** jhenner has joined #openstack-qa | 13:06 | |
*** SushilKM has quit IRC | 13:09 | |
openstackrecheck | openstack/nova change: https://review.openstack.org/58746 failed tempest with an unrecognized error | 13:17 |
openstackrecheck | openstack/nova change: https://review.openstack.org/45867 failed tempest with an unrecognized error | 13:17 |
*** zhikunliu has joined #openstack-qa | 13:20 | |
*** mriedem has joined #openstack-qa | 13:22 | |
*** salv-orlando has quit IRC | 13:23 | |
openstackrecheck | openstack/python-neutronclient change: https://review.openstack.org/61102 failed tempest because of: https://bugs.launchpad.net/bugs/1257626 and https://bugs.launchpad.net/bugs/1210483 | 13:25 |
openstackgerrit | Sergey Lukjanov proposed a change to openstack/tempest: Add Savanna-related configs for testing https://review.openstack.org/61112 | 13:26 |
openstackgerrit | Sergey Lukjanov proposed a change to openstack/tempest: Add Savanna client for node group templates https://review.openstack.org/61113 | 13:26 |
openstackgerrit | Sergey Lukjanov proposed a change to openstack/tempest: Add simple node group tmpl API test for Savanna https://review.openstack.org/61114 | 13:26 |
*** HenryG has joined #openstack-qa | 13:29 | |
openstackrecheck | openstack/cinder change: https://review.openstack.org/43449 failed tempest because of: https://bugs.launchpad.net/bugs/1257641 | 13:36 |
openstackrecheck | openstack/nova change: https://review.openstack.org/61107 failed tempest because of: https://bugs.launchpad.net/bugs/1253896 and https://bugs.launchpad.net/bugs/1257641 | 13:37 |
*** sthaha has joined #openstack-qa | 13:37 | |
*** sthaha has joined #openstack-qa | 13:37 | |
*** openstackgerrit has quit IRC | 13:37 | |
*** openstackgerrit has joined #openstack-qa | 13:37 | |
openstackrecheck | openstack/nova change: https://review.openstack.org/57378 failed tempest with an unrecognized error | 13:37 |
*** dims has quit IRC | 13:39 | |
*** thomasbiege has quit IRC | 13:41 | |
*** dims has joined #openstack-qa | 13:41 | |
openstackgerrit | Ann Kamyshnikova proposed a change to openstack/tempest: Verify more information in API tests for LBaaS https://review.openstack.org/61118 | 13:44 |
*** psharma has quit IRC | 13:46 | |
*** mkollaro has joined #openstack-qa | 13:49 | |
*** dkranz has joined #openstack-qa | 13:49 | |
openstackgerrit | Chmouel Boudjnah proposed a change to openstack-dev/devstack: Fix the number of works for non proxies https://review.openstack.org/61122 | 13:50 |
openstackrecheck | openstack/horizon change: https://review.openstack.org/54242 failed tempest because of: https://bugs.launchpad.net/bugs/1210483 | 13:50 |
*** mkollaro1 has quit IRC | 13:52 | |
openstackrecheck | openstack/nova change: https://review.openstack.org/58321 failed tempest because of: https://bugs.launchpad.net/bugs/1253896 | 13:58 |
*** jasondotstar has joined #openstack-qa | 14:01 | |
openstackrecheck | openstack/neutron change: https://review.openstack.org/60207 failed tempest because of: https://bugs.launchpad.net/bugs/1251448 | 14:04 |
*** jhenner has quit IRC | 14:06 | |
openstackrecheck | openstack/nova change: https://review.openstack.org/60938 failed tempest with an unrecognized error | 14:06 |
*** pleia2 has quit IRC | 14:07 | |
*** dkranz has quit IRC | 14:07 | |
*** SushilKM has joined #openstack-qa | 14:07 | |
*** bdperkin has quit IRC | 14:09 | |
*** pleia2 has joined #openstack-qa | 14:09 | |
*** zhikunliu has quit IRC | 14:09 | |
openstackrecheck | openstack/horizon change: https://review.openstack.org/58510 failed tempest with an unrecognized error | 14:11 |
*** Madan1 has quit IRC | 14:12 | |
*** jd__ has quit IRC | 14:13 | |
*** jd__ has joined #openstack-qa | 14:13 | |
*** weshay has quit IRC | 14:13 | |
*** bdperkin has joined #openstack-qa | 14:16 | |
openstackgerrit | Rohan Kanade proposed a change to openstack/tempest: Allow setting default network for instance spawn https://review.openstack.org/61037 | 14:19 |
openstackgerrit | Sergey Lukjanov proposed a change to openstack/tempest: Add Savanna-related configs for testing https://review.openstack.org/61112 | 14:19 |
openstackgerrit | Sergey Lukjanov proposed a change to openstack/tempest: Add Savanna client for node group templates https://review.openstack.org/61113 | 14:19 |
openstackgerrit | Sergey Lukjanov proposed a change to openstack/tempest: Add simple node group tmpl API test for Savanna https://review.openstack.org/61114 | 14:19 |
openstackrecheck | openstack/tempest change: https://review.openstack.org/61118 failed tempest with an unrecognized error | 14:21 |
*** weshay has joined #openstack-qa | 14:25 | |
*** jhenner has joined #openstack-qa | 14:26 | |
openstackrecheck | openstack-dev/devstack change: https://review.openstack.org/61122 failed tempest because of: https://bugs.launchpad.net/bugs/1254872 and https://bugs.launchpad.net/bugs/1257641 | 14:30 |
openstackgerrit | A change was merged to openstack-dev/grenade: Modify upgrade-* scripts to allow skip configuration if not needed https://review.openstack.org/60795 | 14:34 |
openstackgerrit | A change was merged to openstack-dev/grenade: Tempest should be configured with upgrade projects only https://review.openstack.org/60901 | 14:34 |
sdague | maurosr: ok, those 2 grenade changes are in, can you recheck the patches you think should now pass based on them? | 14:35 |
*** salv-orlando has joined #openstack-qa | 14:39 | |
*** thomasbiege has joined #openstack-qa | 14:42 | |
*** salv-orlando_ has joined #openstack-qa | 14:44 | |
openstackgerrit | Salvatore Orlando proposed a change to openstack-dev/devstack: Support ovs-vsctl timeout https://review.openstack.org/61136 | 14:44 |
*** sthaha has quit IRC | 14:45 | |
openstackgerrit | Salvatore Orlando proposed a change to openstack-infra/devstack-gate: Set ovs-vsctl timeout to 10 seconds https://review.openstack.org/61137 | 14:45 |
*** salv-orlando has quit IRC | 14:46 | |
*** salv-orlando_ is now known as salv-orlando | 14:46 | |
openstackrecheck | openstack/cinder change: https://review.openstack.org/43887 failed tempest with an unrecognized error | 14:47 |
openstackgerrit | Lingxian Kong proposed a change to openstack/tempest: add some tests for aggregates https://review.openstack.org/49157 | 14:56 |
*** salv-orlando has quit IRC | 14:56 | |
openstackrecheck | openstack/tempest change: https://review.openstack.org/61112 failed tempest because of: https://bugs.launchpad.net/bugs/1257641 | 14:57 |
openstackgerrit | Matthew Treinish proposed a change to openstack/tempest: Add test-requirements to all tox jobs https://review.openstack.org/60611 | 14:59 |
openstackgerrit | Matthew Treinish proposed a change to openstack/tempest: Add unit tests for rest_client https://review.openstack.org/60379 | 14:59 |
*** Madan has joined #openstack-qa | 15:00 | |
*** thomasbiege1 has joined #openstack-qa | 15:01 | |
dims | mtreinish, sdague - the elastic-recheck page shows "No matches" for 6 bugs. how does graph.json gets generated? | 15:02 |
sdague | dims: from the current er bug list | 15:03 |
sdague | it would not surprise me if we had 6 bugs that aged out | 15:03 |
sdague | the bugs are now sorted by fails on that page, so it's a lot easier to see the ones that aged out when they are clustered at the bottom | 15:04 |
*** thomasbiege has quit IRC | 15:05 | |
dims | sdague, "er bug list" is that in a file in elastic-recheck repo? | 15:06 |
openstackgerrit | A change was merged to openstack/tempest: Race condition in ListImageFilters tests https://review.openstack.org/60604 | 15:07 |
mtreinish | dims: it's a dir: http://git.openstack.org/cgit/openstack-infra/elastic-recheck/tree/queries | 15:10 |
*** dkranz has joined #openstack-qa | 15:11 | |
maurosr | sdague: sorry, was on lunch, will recheck dprince's one | 15:11 |
maurosr | sdague: ok, you did it already | 15:12 |
*** jgrimm has joined #openstack-qa | 15:12 | |
maurosr | tks | 15:12 |
*** reaper has joined #openstack-qa | 15:12 | |
dims | sdague, ah found it - yaml files under queries | 15:12 |
*** reaper has quit IRC | 15:12 | |
openstackrecheck | openstack/heat change: https://review.openstack.org/57717 failed tempest because of: https://bugs.launchpad.net/bugs/1210483 | 15:13 |
sdague | maurosr: it looks like dprince's patch still fails, can you dive into it? | 15:19 |
*** jgrimm has quit IRC | 15:22 | |
mriedem | dims: e.g. https://review.openstack.org/#/c/60917/ | 15:22 |
openstackgerrit | Matthew Treinish proposed a change to openstack/tempest: Do not merge, debug for TempestConfig() on import https://review.openstack.org/61148 | 15:23 |
openstackrecheck | openstack/tempest change: https://review.openstack.org/60379 failed tempest with an unrecognized error | 15:23 |
dims | mriedem, mtreinish - thanks | 15:24 |
openstackgerrit | A change was merged to openstack-dev/devstack: XenAPI: Increase DomU's memory https://review.openstack.org/59792 | 15:24 |
sdague | maurosr: oh, it's on that quota race | 15:24 |
openstackrecheck | openstack-infra/devstack-gate change: https://review.openstack.org/57066 failed tempest because of: https://bugs.launchpad.net/bugs/1257641 | 15:26 |
maurosr | sdague: yup ^.. rechecking with this bug | 15:27 |
mriedem | for anything on this page with no matches (toward the bottom), does that just mean there are stale e-r queries for bugs that are fixed now? http://status.openstack.org/elastic-recheck/ | 15:28 |
maurosr | sdague: grenade passing anyway, this recheck will probably solve it | 15:28 |
openstackrecheck | openstack/tempest change: https://review.openstack.org/60611 failed tempest with an unrecognized error | 15:28 |
sdague | maurosr: yep | 15:29 |
mtreinish | mriedem: it means that there are no hits in the past 2 weeks for the e-r fingerprint (not that it's necessarily been fixed) | 15:29 |
openstackrecheck | openstack/python-keystoneclient change: https://review.openstack.org/61046 failed tempest with an unrecognized error | 15:29 |
mriedem | mtreinish: ok | 15:34 |
mriedem | so...when does the gut feeling come in that we can remove e-r queries for 'fixed' bugs? | 15:34 |
openstackrecheck | openstack-infra/devstack-gate change: https://review.openstack.org/61137 failed tempest with an unrecognized error | 15:34 |
mriedem | i.e. when the bugs are actually marked as fix committed? | 15:34 |
mriedem | like bug 1252514 | 15:34 |
mtreinish | mriedem: yeah I'm fine with doing it if both conditions are met. (no more fingerprints found and bugs been closed/fix commited) | 15:35 |
*** jgrimm has joined #openstack-qa | 15:35 | |
mriedem | mtreinish: ok | 15:35 |
openstackgerrit | Davanum Srinivas (dims) proposed a change to openstack-infra/elastic-recheck: Remove Stale Bugs from elastic-check page https://review.openstack.org/61149 | 15:35 |
mtreinish | I think that's what jog0 has been doing when he does the periodic purges | 15:35 |
mtreinish | mriedem: ^^^ looks like dims beat you to it though | 15:35 |
dims | :) | 15:36 |
mriedem | house cleaning is a race i don't want to be in :) | 15:37 |
openstackrecheck | openstack/cinder change: https://review.openstack.org/43887 failed tempest because of: https://bugs.launchpad.net/bugs/1257641 | 15:38 |
sdague | dims: so if you are up for a bigger patch, I'd actually like to soft delete these | 15:38 |
openstackrecheck | openstack/tempest change: https://review.openstack.org/61112 failed tempest because of: https://bugs.launchpad.net/bugs/1257641 | 15:38 |
sdague | by adding a resolved_at field, then having the loader ignore bugs that have that as some time in the past | 15:39 |
sdague | so that if issues come back, we can realize that we've seen that before a little easier | 15:39 |
openstackrecheck | openstack/nova change: https://review.openstack.org/60322 failed tempest because of: https://bugs.launchpad.net/bugs/1257641 | 15:40 |
dims | ah, will take a stab | 15:40 |
openstackgerrit | Chmouel Boudjnah proposed a change to openstack-dev/devstack: Fix the amount of workers spawned for non proxies https://review.openstack.org/61122 | 15:40 |
*** salv-orlando has joined #openstack-qa | 15:40 | |
openstackgerrit | Salvatore Orlando proposed a change to openstack-dev/devstack: Neutron/Nvp plugin: fix 'ip link' usage https://review.openstack.org/61153 | 15:44 |
*** salv-orlando has quit IRC | 15:48 | |
openstackgerrit | Bob Ball proposed a change to openstack/tempest: Rename create_test_server to create_temp_server https://review.openstack.org/58645 | 15:54 |
*** SergeyLukjanov has quit IRC | 15:55 | |
*** Madan has quit IRC | 15:55 | |
openstackgerrit | Bob Ball proposed a change to openstack/tempest: Rename create_test_server to create_temp_server https://review.openstack.org/58645 | 16:02 |
*** jorisroovers has quit IRC | 16:02 | |
*** jorisroovers has joined #openstack-qa | 16:02 | |
openstackrecheck | openstack/python-keystoneclient change: https://review.openstack.org/61154 failed tempest with an unrecognized error | 16:04 |
maurosr | sdague: dprince's patch passed the tests =) | 16:04 |
*** HenryG_ has joined #openstack-qa | 16:05 | |
*** HenryG has quit IRC | 16:05 | |
*** jroovers has joined #openstack-qa | 16:06 | |
openstackgerrit | Matt Riedemann proposed a change to openstack-infra/elastic-recheck: Add e-r query for nova-network bug 1258848 https://review.openstack.org/61158 | 16:08 |
*** SushilKM has quit IRC | 16:09 | |
*** jorisroovers has quit IRC | 16:10 | |
*** thomasbiege1 has quit IRC | 16:12 | |
openstackgerrit | Dan Smith proposed a change to openstack/tempest: DO NOT MERGE Testing for bug 1258848 https://review.openstack.org/61159 | 16:16 |
*** yfried has joined #openstack-qa | 16:16 | |
*** jroovers has quit IRC | 16:16 | |
openstackrecheck | openstack/heat change: https://review.openstack.org/60991 failed tempest because of: https://bugs.launchpad.net/bugs/1257641 | 16:17 |
*** HenryG_ has quit IRC | 16:21 | |
*** HenryG has joined #openstack-qa | 16:23 | |
sdague | maurosr: awesome | 16:25 |
openstackrecheck | openstack/cinder change: https://review.openstack.org/61142 failed tempest with an unrecognized error | 16:25 |
openstackrecheck | openstack/cinder change: https://review.openstack.org/43887 failed tempest because of: https://bugs.launchpad.net/bugs/1254872 | 16:28 |
*** thomasbiege has joined #openstack-qa | 16:30 | |
openstackrecheck | openstack/tempest change: https://review.openstack.org/58645 failed tempest with an unrecognized error | 16:35 |
openstackgerrit | Elena Ezhova proposed a change to openstack/tempest: Add scenario test for load balancer's health monitor https://review.openstack.org/59729 | 16:37 |
openstackgerrit | Elena Ezhova proposed a change to openstack/tempest: Add scenario test for load balancer https://review.openstack.org/58697 | 16:37 |
openstackgerrit | Bob Ball proposed a change to openstack/tempest: Rename create_test_server to create_temp_server https://review.openstack.org/58645 | 16:39 |
*** mrodden1 has quit IRC | 16:40 | |
openstackrecheck | openstack/glance change: https://review.openstack.org/60333 failed tempest because of: https://bugs.launchpad.net/bugs/1253896 and https://bugs.launchpad.net/bugs/1257641 | 16:41 |
*** mlavalle has joined #openstack-qa | 16:43 | |
*** bdperkin has quit IRC | 16:44 | |
*** bdperkin has joined #openstack-qa | 16:44 | |
*** marun has quit IRC | 16:46 | |
*** HenryG has quit IRC | 16:47 | |
openstackrecheck | openstack/tempest change: https://review.openstack.org/61159 failed tempest because of: https://bugs.launchpad.net/bugs/1257641 | 16:54 |
*** mrodden has joined #openstack-qa | 16:55 | |
*** SushilKM has joined #openstack-qa | 16:56 | |
mtreinish | sdague: what is the point of these tests? http://git.openstack.org/cgit/openstack/tempest/tree/tempest/api/compute/test_auth_token.py | 17:00 |
mtreinish | don't we get that coverage just by running the other tests? | 17:00 |
*** SushilKM has quit IRC | 17:01 | |
openstackgerrit | Steven Hardy proposed a change to openstack/tempest: keystone OS-TRUST extension, test with expiry https://review.openstack.org/61175 | 17:04 |
openstackgerrit | Steven Hardy proposed a change to openstack/tempest: keystone OS-TRUST extension, test list operations https://review.openstack.org/61176 | 17:04 |
openstackgerrit | Steven Hardy proposed a change to openstack/tempest: Add tests for keystone OS-TRUST v3 API https://review.openstack.org/54810 | 17:04 |
openstackrecheck | openstack/heat change: https://review.openstack.org/60991 failed tempest because of: https://bugs.launchpad.net/bugs/1257626 | 17:05 |
*** malini has joined #openstack-qa | 17:05 | |
openstackrecheck | openstack/heat change: https://review.openstack.org/56477 failed tempest with an unrecognized error | 17:07 |
openstackgerrit | Vadim Rovachev proposed a change to openstack/tempest: Create client, tests and config for Ceilometer API https://review.openstack.org/55276 | 17:09 |
*** SergeyLukjanov has joined #openstack-qa | 17:10 | |
*** SergeyLukjanov is now known as _SergeyLukjanov | 17:11 | |
*** _SergeyLukjanov is now known as SergeyLukjanov | 17:11 | |
*** SushilKM has joined #openstack-qa | 17:16 | |
openstackrecheck | openstack/tempest change: https://review.openstack.org/59729 failed tempest with an unrecognized error | 17:18 |
*** yfried has quit IRC | 17:18 | |
openstackrecheck | openstack/nova change: https://review.openstack.org/61075 failed tempest with an unrecognized error | 17:20 |
*** yassine_ has quit IRC | 17:22 | |
*** atiwari has joined #openstack-qa | 17:32 | |
*** yfried has joined #openstack-qa | 17:37 | |
openstackrecheck | openstack/tempest change: https://review.openstack.org/61176 failed tempest with an unrecognized error | 17:40 |
*** safchain has quit IRC | 17:41 | |
openstackrecheck | openstack/tempest change: https://review.openstack.org/61175 failed tempest with an unrecognized error | 17:42 |
openstackrecheck | openstack/python-keystoneclient change: https://review.openstack.org/61046 failed tempest because of: https://bugs.launchpad.net/bugs/1249065 | 17:45 |
openstackrecheck | openstack/tempest change: https://review.openstack.org/55276 failed tempest with an unrecognized error | 17:48 |
*** Anju has joined #openstack-qa | 17:52 | |
Anju | cyeoh : ping | 17:52 |
openstackrecheck | openstack/heat change: https://review.openstack.org/60991 failed tempest with an unrecognized error | 17:55 |
*** HenryG has joined #openstack-qa | 17:56 | |
*** jlibosva1 has quit IRC | 17:57 | |
*** jamielennox|away is now known as jamielennox | 18:03 | |
*** jlibosva has joined #openstack-qa | 18:03 | |
openstackgerrit | Davanum Srinivas (dims) proposed a change to openstack-infra/elastic-recheck: Soft Delete Stale Bugs from elastic-check page https://review.openstack.org/61149 | 18:04 |
openstackgerrit | Steven Hardy proposed a change to openstack/tempest: keystone OS-TRUST extension, test list operations https://review.openstack.org/61176 | 18:04 |
openstackgerrit | Steven Hardy proposed a change to openstack/tempest: Add tests for keystone OS-TRUST v3 API https://review.openstack.org/54810 | 18:04 |
openstackgerrit | Steven Hardy proposed a change to openstack/tempest: keystone OS-TRUST extension, test with expiry https://review.openstack.org/61175 | 18:04 |
afrittoli | mtreinish: ping | 18:05 |
*** SushilKM has quit IRC | 18:07 | |
openstackrecheck | openstack/swift change: https://review.openstack.org/61181 failed tempest because of: https://bugs.launchpad.net/bugs/1257641 | 18:11 |
*** yfried has quit IRC | 18:12 | |
mtreinish | afrittoli: pong | 18:12 |
afrittoli | mtreinish: hi - I submitted a draft implementation for bp input-scenarios-for-scenario - https://review.openstack.org/#/c/60434/ - would you be interested in having a look and let me know what you think? | 18:14 |
*** Anju has quit IRC | 18:14 | |
mtreinish | afrittoli: sure I'll put it on my list for today | 18:14 |
mtreinish | afrittoli: it's a draft can you make it a wip? | 18:14 |
afrittoli | mtreinish: great, thanks! I did a git review -D is that enough or what do I need to do? | 18:15 |
mtreinish | afrittoli: since it's a draft no one can look at it unless you add them to review. You just need to switch it to a normal review in the gerrit ui | 18:16 |
mtreinish | then you can mark it as WIP if you don't think it's ready to merge | 18:16 |
afrittoli | mtreinish: ah ok, done | 18:17 |
afrittoli | I have "WIP do not merge" in the comment | 18:18 |
mtreinish | afrittoli: ok, cool thanks. That's fine, flagging it as WIP just actually enforces that in case it was approved by mistake. | 18:19 |
afrittoli | mtreinish: nice. | 18:21 |
*** dkorn has joined #openstack-qa | 18:21 | |
afrittoli | mtreinish: thanks I look forward to your feedback | 18:22 |
openstackgerrit | Davanum Srinivas (dims) proposed a change to openstack-infra/elastic-recheck: Ability to Soft Delete Stale Bugs from elastic-recheck https://review.openstack.org/61149 | 18:23 |
*** adalbas has quit IRC | 18:24 | |
openstackgerrit | Davanum Srinivas (dims) proposed a change to openstack-infra/elastic-recheck: Delete stale bugs from elastic-recheck page https://review.openstack.org/61186 | 18:25 |
*** hemnafk is now known as hemna | 18:26 | |
*** Flying_Bond has joined #openstack-qa | 18:27 | |
*** Flying_Bond has quit IRC | 18:28 | |
*** yfried has joined #openstack-qa | 18:29 | |
*** klrmn has left #openstack-qa | 18:30 | |
*** klrmn has joined #openstack-qa | 18:31 | |
*** klrmn has left #openstack-qa | 18:32 | |
*** adalbas has joined #openstack-qa | 18:38 | |
openstackrecheck | openstack/tempest change: https://review.openstack.org/61175 failed tempest with an unrecognized error | 18:40 |
openstackrecheck | openstack/nova change: https://review.openstack.org/61184 failed tempest because of: https://bugs.launchpad.net/bugs/1254872 | 18:43 |
openstackgerrit | Matthew Treinish proposed a change to openstack/tempest: Handle skips because of config in skip_because https://review.openstack.org/61188 | 18:45 |
openstackgerrit | Matthew Treinish proposed a change to openstack/tempest: Stop running TempestConfig() on import https://review.openstack.org/60925 | 18:45 |
openstackgerrit | Matthew Treinish proposed a change to openstack/tempest: Do not merge, debug for TempestConfig() on import https://review.openstack.org/61148 | 18:46 |
openstackrecheck | openstack/nova change: https://review.openstack.org/55870 failed tempest because of: https://bugs.launchpad.net/bugs/1254872 | 18:46 |
openstackrecheck | openstack/tempest change: https://review.openstack.org/61159 failed tempest because of: https://bugs.launchpad.net/bugs/1254872 and https://bugs.launchpad.net/bugs/1257641 | 18:48 |
sdague | mtreinish: hmmm... good point. I'd +2 a remove on those | 18:50 |
sdague | it's weird that they are in compute as well | 18:50 |
*** jlibosva has quit IRC | 18:52 | |
mtreinish | sdague: oh great, that removal patch is going to cause a rebase nightmare for: https://review.openstack.org/#/q/status:open+project:openstack/tempest+branch:master+topic:bp/config-cleanup,n,z | 18:53 |
*** mlavalle has quit IRC | 18:55 | |
*** salv-orlando has joined #openstack-qa | 18:56 | |
openstackrecheck | openstack/swift change: https://review.openstack.org/61181 failed tempest because of: https://bugs.launchpad.net/bugs/1257641 | 18:57 |
*** mlavalle has joined #openstack-qa | 18:58 | |
openstackgerrit | Matthew Treinish proposed a change to openstack/tempest: Remove test_auth_token.py https://review.openstack.org/61192 | 19:02 |
*** jlibosva has joined #openstack-qa | 19:04 | |
openstackrecheck | openstack/cinder change: https://review.openstack.org/59321 failed tempest because of: https://bugs.launchpad.net/bugs/1249065 | 19:05 |
*** thomasbiege has quit IRC | 19:05 | |
openstackrecheck | openstack/tempest change: https://review.openstack.org/61176 failed tempest because of: https://bugs.launchpad.net/bugs/1240256 | 19:05 |
sdague | mtreinish: ok, well I just +Aed in the first piece | 19:06 |
sdague | some comments on patch 2 & 3 | 19:06 |
mtreinish | sdague: about your comments on patch 3 look at patch 5 | 19:07 |
sdague | mtreinish: honestly, I find that worse :) | 19:08 |
sdague | decorator really needs to fit on one line | 19:08 |
mtreinish | sdague: so you want me to make 2 separate decorators for each config group? | 19:10 |
mtreinish | I think that gets hard to maintain | 19:10 |
sdague | mtreinish: I think it's easier to maintain and see what's going on than the 4 param decorator. Being overly general in decorators leads to trouble, because of when they execute | 19:12 |
sdague | anyway, that's my opinion here, so given | 19:12 |
*** salv-orlando has quit IRC | 19:13 | |
mtreinish | sdague: actually when they execute is a problem in general. It seems that they're executed at import too which doesn't solve the issue I was trying to solve | 19:14 |
sdague | yes, decorators exec on compilation | 19:14 |
*** adalbas has quit IRC | 19:15 | |
mtreinish | sdague: given that I'm tempted to say rip out config from skip decorators and do the skips inside the methods | 19:15 |
mtreinish | we don't want to have a dep on a config file for importing a tempest file | 19:15 |
*** jhenner has quit IRC | 19:15 | |
sdague | mtreinish: well we have a dependency on config global object right? Which may or may not get modified by a conf file. | 19:16 |
sdague | or are we not at that level of cleanup yet | 19:17 |
mtreinish | sdague: no we get around that with the TempestConfig object. We can't use a global config object because of how test runners load test files, there's no guarantee that all the files will be loaded when an option is going to be used. | 19:18 |
mtreinish | which is why we store TempestConfig in the base test class | 19:18 |
mtreinish | and define all the options in one place | 19:18 |
*** salv-orlando has joined #openstack-qa | 19:19 | |
*** weshay has quit IRC | 19:20 | |
mtreinish | it's kinda a mess | 19:20 |
mtreinish | there's also the issue of loading the options from the config file, because the test runners do the executing not a binary we make | 19:26 |
*** mordred has quit IRC | 19:26 | |
*** mordred has joined #openstack-qa | 19:26 | |
anteaya | sdague: any thoughts if I were to host a tempest meeting aimed at getting different project tempest commiters to talk to each other and share info? | 19:27 |
anteaya | and hopefully yourself and a few other qa'rs would attend | 19:28 |
anteaya | so far, just a thought | 19:28 |
mtreinish | sdague: at this point I'm thinking I'm just going to rework 60925 to raise skip exceptions inline where needed. It's not as clean as decorators but it'll drop the dep on TempestConfig() at import. | 19:28 |
sdague | mtreinish: can we at least make it a helper function which throws the exception itself | 19:29 |
sdague | so it will drop to a single line | 19:29 |
mtreinish | sdague: yeah that's what I was going to do | 19:30 |
sdague | mtreinish: +1 | 19:30 |
openstackrecheck | openstack/nova change: https://review.openstack.org/60322 failed tempest because of: https://bugs.launchpad.net/bugs/1254872 | 19:30 |
sdague | anteaya: re: a meeting, I'm honestly trying to keep my travel relatively minimal during this cycle, especially with the montreal event already on my calendar (as I'll have some other trips to korea prior to atlanta as well) | 19:31 |
*** weshay has joined #openstack-qa | 19:31 | |
anteaya | sdague: irc | 19:31 |
sdague | so I'd much rather push that into next cycle, and figure out what kind of docs we need | 19:31 |
anteaya | and irc meeting | 19:31 |
sdague | anteaya: ok | 19:31 |
anteaya | *an | 19:31 |
anteaya | okay thanks | 19:31 |
anteaya | any time better or worse than other | 19:32 |
openstackrecheck | openstack/tempest change: https://review.openstack.org/60925 failed tempest because of: https://bugs.launchpad.net/bugs/1257641 | 19:32 |
mtreinish | sdague: we have tempest docs? | 19:32 |
anteaya | other than the given of another meeting *sigh* | 19:32 |
*** jlibosva has quit IRC | 19:32 | |
sdague | so what might be interesting is to collect up questions people have so we could start with building up materials that answer those | 19:32 |
sdague | mtreinish: yeh, that docs dir :) | 19:32 |
sdague | http://docs.openstack.org/developer/tempest/ | 19:32 |
anteaya | sdague: I think that would be the point of the first meeting | 19:32 |
anteaya | mostly I just need to gather them | 19:33 |
anteaya | they seem lonely in their individual projects, might make better progress as a group | 19:33 |
anteaya | neutron, trove, ironic so far | 19:33 |
mtreinish | sdague: heh, I guess those count | 19:33 |
mtreinish | anteaya: I've seen patches from ceilometer and savanna too | 19:34 |
anteaya | great | 19:34 |
anteaya | I'd be posting to the ml | 19:34 |
anteaya | so random folk can join in | 19:34 |
*** salv-orlando has quit IRC | 19:34 | |
anteaya | and I can gather from ceilometer and savanna too | 19:34 |
anteaya | so do we like the idea? | 19:34 |
SergeyLukjanov | yup, we're starting working on api tests in savanna and planning to move our integration tests to scenarios tests | 19:35 |
anteaya | SergeyLukjanov: would your devs get anything out of a all projects tempest meeting? | 19:35 |
SergeyLukjanov | anteaya, probably | 19:36 |
SergeyLukjanov | but now we have no open question | 19:36 |
SergeyLukjanov | all of them was answered on-demand | 19:36 |
anteaya | fair enough, you might have info to share though | 19:36 |
anteaya | others might benefit from your knowledge/patches | 19:36 |
anteaya | sdague mtreinish any time I should aim for or avoid when selecting a meeting time? | 19:37 |
sdague | anteaya: yeh, in a lot of ways I think it would just be better to get those folks over into this channel instead of setting up a meeting | 19:38 |
*** klrmn has joined #openstack-qa | 19:38 | |
sdague | because it's not a point in time thing, it's more staying connected | 19:38 |
anteaya | okay | 19:38 |
anteaya | I will do that | 19:38 |
anteaya | thanks | 19:38 |
sdague | basically, if you are pushing tempest patches, you should be in this channel | 19:38 |
anteaya | very good | 19:38 |
sdague | and if you aren't, you are probably doing it wrong | 19:38 |
anteaya | agreed | 19:39 |
anteaya | mlavalle: catching all this? | 19:39 |
mlavalle | anteaya: I always connect to this channel | 19:40 |
anteaya | grand | 19:40 |
anteaya | I haven't been as much myself which is why I didn't know that | 19:41 |
anteaya | so that is on me | 19:41 |
*** SlickNik has joined #openstack-qa | 19:43 | |
*** devananda has joined #openstack-qa | 19:44 | |
anteaya | sdague: SlickNik is doing tempest for trove | 19:44 |
devananda | anteaya: thanks. I want to see us get exercised by tempest. romcheg has been working on it for a few months now and still hasn't landed: https://review.openstack.org/#/c/48109/ | 19:46 |
anteaya | devananda: glad you are hear | 19:47 |
anteaya | *here | 19:47 |
SergeyLukjanov | sdague, agreed with using channel instead of meeting | 19:47 |
*** romcheg has joined #openstack-qa | 19:47 | |
anteaya | hopefully romcheg SlickNik and mlavalle can compare notes and help each other | 19:47 |
mlavalle | anteaya: I also always attend the weekly tempest IRC meetings on Thursday and regularly report what I've done on Neutron testing…. Pretty much the same thing I do on Monday's during the neutron meeting | 19:47 |
anteaya | welcome romcheg | 19:47 |
openstackrecheck | openstack/cinder change: https://review.openstack.org/60715 failed tempest with an unrecognized error | 19:47 |
anteaya | and SergeyLukjanov | 19:47 |
SlickNik | sdague: just getting started on it. Here's what we discussed at the session regarding it: https://etherpad.openstack.org/p/TroveTempestTesting | 19:48 |
anteaya | mlavalle: great, and here are some other folks in the same boat | 19:48 |
SlickNik | romcheg, mlavalle: Hi! | 19:48 |
mlavalle | Hey SlickNick | 19:48 |
mlavalle | SlickNik^^^ | 19:49 |
SlickNik | So mlavalle, you're working on neutron? | 19:50 |
mlavalle | SlickNik: yeah, Neutron testing with Tempest | 19:53 |
*** torandu has joined #openstack-qa | 19:55 | |
*** weshay has quit IRC | 19:57 | |
anteaya | SlickNik: we were in the -infra meeting and since mordred bugging hub_cab to write tempest tests got no where for 3 meetings, hub_cab mentioned you and I figured I may as well take over for mordred | 20:02 |
anteaya | so it will be easier to bug you in here | 20:02 |
anteaya | SlickNik: let me know when you have even a single scrap of anything to look at and I will peek at ti | 20:02 |
anteaya | it | 20:02 |
anteaya | SlickNik: and have you gone over this? http://docs.openstack.org/developer/tempest/ | 20:03 |
dkranz | devananda: I reviewed the ironic/tempest patch. The holdup is that the tests cannot run right now. | 20:06 |
devananda | dkranz: what prevents them? | 20:06 |
dkranz | devananda: ironic is not enabled in devstack I presume. | 20:06 |
dkranz | devananda: In any even, when tempest runs it skips the tests because is is being told ironic is not available | 20:07 |
SlickNik | anteaya: Thanks for the link. That's helpful! | 20:07 |
SlickNik | anteaya: I'll definitely let you know as soon as I have something for you to peek at. | 20:07 |
devananda | dkranz: ironic can't be enabled by default in tempest because it's still an incubated project | 20:07 |
devananda | dkranz: see the infra jobs we have proposed to the experimental ppipe, which will enable it there: https://review.openstack.org/#/c/53917/8 | 20:08 |
*** rfolco has quit IRC | 20:08 | |
devananda | dkranz: it should be enabled & run within the ironic check&gate pipes, and within tempest's experimental pipe, for now. no where else. | 20:09 |
dkranz | devananda: Ah. This is a new thing for tempest. | 20:09 |
devananda | dkranz: at least, that's my understanding after talking with mordred about it | 20:09 |
*** weshay has joined #openstack-qa | 20:09 | |
mtreinish | dkranz: isn't that how the heat slow tests are supposed to work | 20:10 |
mtreinish | it's just that they don't | 20:10 |
dkranz | mtreinish: No, the heat tests are supposed to run in a different job. Heat is on by default. | 20:10 |
dkranz | mtreinish: The slow tests are in experimental only until they can work. | 20:10 |
dkranz | mtreinish: It is just a temporary debugging thing. | 20:11 |
devananda | this is a bit of both | 20:11 |
devananda | ironic being a new project, folks want to see some history of passing tests before it can be in the general pipeline | 20:11 |
dkranz | mtreinish: It seems like maybe we want tempest to run the experimental check auatomatically now | 20:11 |
anteaya | SlickNik: thanks | 20:11 |
*** roaet has joined #openstack-qa | 20:12 | |
anteaya | welcome roaet | 20:12 |
* roaet just learned of this channel | 20:12 | |
dkranz | devananda: Yes, it is. For now, perhaps patch uploaders for ironic in tempest should do check experimental | 20:12 |
roaet | power of e-mail, heh | 20:12 |
devananda | and i agree -- we're changing things pretty rapidly still. our v1 API hasn't quite stabilized. | 20:12 |
anteaya | glad you are here | 20:12 |
roaet | anteaya: did you see my reply to your e-mail/questionaire thing? | 20:12 |
dkranz | devananda: I just tried a "check experimental" | 20:14 |
dkranz | mtreinish: ^^^ | 20:14 |
openstackrecheck | openstack/ceilometer change: https://review.openstack.org/56019 failed tempest with an unrecognized error | 20:14 |
devananda | dkranz: i'm not entirely sure what that means | 20:14 |
dkranz | devananda: If you're job that configures devstack for ironic is in the experimental queue on tempest, then that is how you trigger it | 20:15 |
dkranz | devananda: Or is all that not ready yet? | 20:15 |
devananda | dkranz: i mean, how does one try "check experimental" -- is this a trigger to jenkins? a command to your local tempest env? | 20:16 |
anteaya | this is a jenkins trigger | 20:16 |
dkranz | devananda: Oh, I see. It has not merged yet https://review.openstack.org/#/c/53917/8 | 20:16 |
anteaya | we have an experiemental queue | 20:16 |
devananda | anteaya: link? | 20:17 |
anteaya | it returns results on experiemental jenkins jobs | 20:17 |
* anteaya digs | 20:17 | |
*** jhenner has joined #openstack-qa | 20:17 | |
dkranz | devananda: Once that patch merges, you can do "check experimental" as a tempest review and the jobs will run | 20:17 |
devananda | dkranz: you mean add "check experimental" as a comment on a review in gerrit? | 20:17 |
dkranz | devananda: Exactly | 20:17 |
anteaya | devananda: http://ci.openstack.org/test-infra-requirements.html?highlight=experimental#experimental | 20:17 |
devananda | that seems like not the desired approach | 20:17 |
openstackgerrit | A change was merged to openstack-infra/elastic-recheck: Add e-r query for nova-network bug 1258848 https://review.openstack.org/61158 | 20:18 |
dkranz | devananda: Well, the purpose of this feature was for debugging. | 20:18 |
devananda | i am expecting that every proposed commit to ironic will trigger a run of tempest+ironic | 20:18 |
devananda | and that it would be gating for ironic and python-ironicclient | 20:18 |
anteaya | experiemental is mostly designed to help devs fine tune new jenkins jobs | 20:18 |
anteaya | at least that is the way I think of it | 20:18 |
dkranz | devananda: So to do that you need a job in the regular queue that is just attached to ironic | 20:18 |
devananda | but that it would not run for other projects (eg, nova, keystone) | 20:18 |
devananda | dkranz: which, IIUC, 53917 is proposing | 20:19 |
dkranz | devananda: i did not look at the details. I will do so now. | 20:19 |
devananda | anteaya: thanks. that explains some things, and now i dont know why anyone suggested that ironic/tempest ever go into the experimental queue | 20:19 |
anteaya | devananda: glad to shed some light, not sure of the circumstances under which it was suggested so I have no comment on that part | 20:20 |
* anteaya has to go for a walk, back later | 20:20 | |
devananda | dkranz: is there a way to enable the ironic/tempest tests in general, such that they run but don't affect the vote? | 20:21 |
*** jecarey has joined #openstack-qa | 20:22 | |
devananda | dkranz: eg, instead of disabling those tests (ie not starting the ironic service) in the nova test pipelines right now, could it be run but not affect the success of the test run? | 20:22 |
devananda | that would allow us to potentially debug if a nova change broke ironic, without actually blocking that nova change | 20:22 |
dkranz | devananda: Yes, you have already done that by skipping tests in tempest if ironic is not available | 20:22 |
devananda | dkranz: sorry. i'm not explaining well | 20:22 |
devananda | dkranz: i mean, instead of just skipping ironic tests. can we run them but not affect teh success of the tempest run | 20:23 |
devananda | we skip them now | 20:23 |
dkranz | devananda: We don't have a way to do that since success is currently defined as all non-skipped tests passing | 20:24 |
devananda | ack | 20:24 |
mtreinish | devananda: you could add an ironic tox job and run that nonvoting | 20:24 |
dkranz | devananda: At this point I think we need a clearer statement of all the requirements about what we want here, now and in the future. | 20:24 |
devananda | dkranz: from me, or from infra? | 20:24 |
dkranz | devananda: You, but I'm sure they will have some comment :) | 20:25 |
devananda | heh :) | 20:25 |
dkranz | devananda: Maybe you could just continue that ml thread I started about this. | 20:25 |
devananda | sure | 20:25 |
devananda | i know pretty well what it is that i want for ironic | 20:25 |
dkranz | devananda: It doesn't fit neatly into what we have now. | 20:25 |
devananda | just not the infra details | 20:25 |
dkranz | devananda: Sure | 20:25 |
dkranz | devananda: I think we have all the pieces but have not put them together the way you need before. | 20:26 |
dkranz | devananda: And I'm not clear about the non-technical part having to do with requirements of being incubated or not. | 20:26 |
devananda | dkranz: i'll punt questions on that to mordred. it's possible i misunderstood something :) | 20:27 |
dkranz | devananda: ok :) | 20:27 |
devananda | dkranz: just to confirm expectations, since you didn't reply to my respone on the ML -- the proposed tempest tests for Ironic will exercise the API and service layers, but not actually provision anything at this time | 20:29 |
devananda | dkranz: it would be like using nova with the fake driver. you get to exercize the scheduler, conductor, etc, but not actually start a VM | 20:29 |
devananda | is that acceptable? | 20:29 |
openstackrecheck | openstack/nova change: https://review.openstack.org/61028 failed tempest with an unrecognized error | 20:29 |
mordred | devananda: what? | 20:29 |
dkranz | devananda: The issue is just what to do with tests that are left out of this and cannot run upstream at this time. | 20:30 |
dkranz | devananda: It has been the policy in tempest to not accept tests that do not run. | 20:30 |
devananda | mordred: hi! we're talking about getting tempest to test ironic // but only in the ironic pipe // and not affecting other projects' check or gate yet | 20:30 |
mordred | sounds great to me | 20:30 |
dkranz | devananda: The "solution" for bare-metal type things was to say a third-party system had to report | 20:30 |
mordred | do it | 20:30 |
devananda | dkranz: the tests should run, but only in the ironic pipeline | 20:31 |
mordred | WELL... | 20:31 |
mordred | there is another issue | 20:31 |
dkranz | devananda: But it they are submitted to tempest they have to run there first | 20:31 |
mordred | which is that ironic is not integrated | 20:31 |
mordred | however | 20:31 |
mordred | if you look at what savanna is doing - they've got tempest tests in savanna somewhere, and they copy them in in their tests | 20:31 |
mordred | SergeyLukjanov: ^^ right? | 20:32 |
SergeyLukjanov | mordred, nope | 20:32 |
devananda | dkranz: the solution for testing deployment ON BAREMETAL is third party. but for testing all the Ironic service bits, integration with keystone, rabbit, mysql, db migrations, add/delete resources, etc -- all this can be done with tempest in a single VM | 20:32 |
mordred | oh. well piddle | 20:32 |
SergeyLukjanov | mordred, we have the same tests in savanna, but we'll need to rewrite them to move to the tempest unfortunatelly | 20:32 |
devananda | dkranz: it sounds like you're saying that ironic shouldn't have any tests in tempest because tempest can only test part of ironic | 20:32 |
devananda | dkranz: i'm saying it should test the parts that it can | 20:32 |
dkranz | devananda: I get that. But I thought there were some tests in the ironic tempest patch that needed actual bare-metal, no? | 20:32 |
devananda | hum. there shouldn't be | 20:33 |
* devananda checks | 20:33 | |
dkranz | devananda: I agree with you. We are talking about ow to do that. | 20:33 |
devananda | dkranz: nope. current review only proposes the CRUD actions | 20:33 |
devananda | nothing about power or deploy state changes | 20:33 |
dkranz | devananda: ok, then we just need the job for ironic tests that runs on ironic and tempest | 20:34 |
dkranz | devananda: Sorry I misunderstood that. | 20:34 |
dkranz | devananda: So I don't see why we need experimental jobs | 20:34 |
openstackrecheck | openstack/nova change: https://review.openstack.org/55870 failed tempest with an unrecognized error | 20:34 |
devananda | dkranz: i don't either :) | 20:35 |
openstackrecheck | openstack/nova change: https://review.openstack.org/47788 failed tempest with an unrecognized error | 20:35 |
dkranz | devananda: I will reply to the email thread just to make sure no one has an issue and then that patch can be updated | 20:35 |
devananda | dkranz: thanks much | 20:35 |
dkranz | devananda: to add a regular job to tempest and ironic which just runs ironic tests | 20:35 |
openstackrecheck | openstack/requirements change: https://review.openstack.org/61198 failed tempest because of: https://bugs.launchpad.net/bugs/1240256 and https://bugs.launchpad.net/bugs/1210483 | 20:38 |
mordred | do we not have the pluggable tempest tests now? I thought we did... | 20:40 |
*** klrmn has left #openstack-qa | 20:43 | |
mtreinish | mordred: what do you mean by pluggable? | 20:45 |
mordred | nope. I was wrong - and it just got cleared up in the TC meeting. | 20:45 |
devananda | hm | 20:45 |
devananda | dkranz: according to TC meeting, we cant put ironic in tempest yet anyway ??? | 20:46 |
devananda | dkranz: nvm. misunderstanding .... | 20:47 |
dkranz | mordred: It's kind of unfortunate that we are making tempest tests a requirement for incubation but telling people they can't actually have tests in tempest unless they are incubated... Or are we not saying that? | 20:47 |
openstackgerrit | Davanum Srinivas (dims) proposed a change to openstack-infra/elastic-recheck: Ability to Soft Delete Stale Bugs from elastic-recheck https://review.openstack.org/61149 | 20:47 |
mtreinish | dkranz: requirement for integration | 20:47 |
mtreinish | we'll accept tempest tests if it's incubated | 20:47 |
dkranz | mtreinish: Yes, but how do you know you have tempest tests to be integrated? | 20:48 |
dkranz | mtreinish: Unless you do them before? | 20:48 |
dkranz | mtreinish: ok, good | 20:48 |
dkranz | mtreinish: There was a suggestion otherwise | 20:48 |
mordred | yah. we've got it sorted | 20:49 |
mordred | what mtreinish said | 20:49 |
mordred | you MUST have tempest testing now do graduate | 20:49 |
dkranz | mordred: ok, cool | 20:49 |
mordred | to | 20:49 |
dkranz | mordred: Got that, just seemed like a catch-22 | 20:49 |
dkranz | mordred: Glad it is clear now | 20:49 |
devananda | seems like we just need to sort the details of "incubated project gets tempest tests BUT those are not in the gate pipelines for other projects until graduation" | 20:49 |
mordred | yup. me too | 20:49 |
devananda | which I think we're close to | 20:49 |
mordred | yah | 20:49 |
dkranz | devananda: yeah, we'll see if any one has an objection to my email I just send | 20:50 |
dkranz | sent | 20:50 |
mordred | well - tempest shouldn't run tests for services that arent in the catalog for the cloud it's running against, yeah? :) | 20:50 |
dkranz | mordred: Right, but the ironic job presumably has it | 20:50 |
dkranz | will have it | 20:50 |
openstackgerrit | Davanum Srinivas (dims) proposed a change to openstack-infra/elastic-recheck: Delete stale bugs from elastic-recheck page https://review.openstack.org/61186 | 20:51 |
devananda | dkranz: presumably, ironic is disabled in devstack by default. and then only enabled within the ironic pipelines | 20:51 |
dkranz | devananda: Yes | 20:51 |
devananda | dkranz: that is why you didn't see ironic's tests run in the main tempest pipeline | 20:51 |
dkranz | devananda: But now we are saying it will, just in a different job | 20:51 |
devananda | dkranz: eh? in what different job? | 20:52 |
dkranz | devananda: I think there may be some confusion here | 20:52 |
dkranz | devananda: pipelines are like check,gate,experimental | 20:52 |
dkranz | devananda: But for each pipeline there is a set of jobs that differs from project to project | 20:52 |
devananda | right | 20:53 |
dkranz | devananda: We are talking about adding another job to the check and gate pipelines for ironic and tempest | 20:53 |
devananda | ah | 20:53 |
devananda | no | 20:53 |
devananda | we're talking about adding another job to the check and gate pipelines JUST FOR IRONIC | 20:53 |
devananda | if we put ironic tests in teh tempest check & gate pipelines | 20:53 |
devananda | right? | 20:53 |
dkranz | devananda: But then how can we know if a tempest test will pass? | 20:53 |
*** DennyZhang has joined #openstack-qa | 20:54 | |
devananda | hmm | 20:54 |
devananda | but then ya'll will potentially be blocked if ironic breaks something | 20:54 |
devananda | i thought the point was not to put ironic in anyone else's check/gate until there is confidence | 20:54 |
dkranz | devananda: Well, we would have a situation where an ironic change could not merge until it passed tempest | 20:55 |
dkranz | devananda: Which leaves us with flakies | 20:55 |
devananda | hm | 20:56 |
devananda | so any project that gates itself on tempest must also be in tempest's gate pipe | 20:56 |
dkranz | devananda: Yes | 20:56 |
devananda | k | 20:57 |
devananda | makes sense | 20:57 |
dkranz | devananda: Otherwise you could merge a tempest test that then fails when you try to merge something to ironic | 20:57 |
devananda | right | 20:57 |
devananda | my concern was the opposite -- we'd somehow merge something that would break when run in temepst. but taht doesn't make any sense if both projects are running the same tests | 20:57 |
devananda | *in tempest's gate pipe | 20:57 |
dkranz | devananda: So we have a trade-off between allowing a smooth transition from incubated to integrated, vs potential flakiness from an incubated project | 20:57 |
dkranz | devananda: which is why we originally kept incubated stuff out of tempest | 20:58 |
dkranz | devananda: But now that we are requiring tempest for integration... | 20:58 |
dkranz | devananda: I need to look at the tc discussion about this. | 20:59 |
devananda | dkranz: yea. also https://review.openstack.org/#/c/59454/2/reference/incubation-integration-requirements | 20:59 |
*** romcheg has quit IRC | 21:03 | |
* sdague catches up on this scrollback | 21:03 | |
sdague | so I think we're going to be feeling out some new ground here | 21:04 |
dkranz | sdague: Yeah :) | 21:04 |
sdague | because up until this point tempest was only used for fully integrated gate | 21:04 |
dkranz | sdague: Yes, but it is catch-22 | 21:04 |
sdague | so I expect we'll just have to figure it out as we go along | 21:04 |
dkranz | sdague: Well, we need the first step now because there is an ironic patch pending | 21:05 |
dkranz | sdague: I proposed on the ml a few minutes ago that we accept them | 21:05 |
sdague | dkranz: sure, so I'm fine seeing if we can put the job on tempest and ironic | 21:05 |
*** HenryG has quit IRC | 21:05 | |
dkranz | sdague: As the lesser of evils | 21:05 |
sdague | and see what happens | 21:05 |
dkranz | sdague: Is there a problem with that as a general rule? | 21:05 |
sdague | dims: know you are in project meeting, thanks for the er patches, though I want to put the integration point one step lower | 21:06 |
sdague | dkranz: with the data we have now, I don't think so | 21:06 |
dkranz | sdague: The biggest problem I think is integration explosion. | 21:06 |
dkranz | sdague: going forward | 21:06 |
sdague | yeh, I think we'll just have to manage those as we go along | 21:06 |
dims | sdague, will do | 21:06 |
*** afazekas has quit IRC | 21:06 | |
dkranz | sdague: I have raised this before but I agree | 21:06 |
dkranz | sdague: I this case we can be pretty sure ironic changes won't break anything else | 21:06 |
dkranz | sdague: which other than scalability is the only real concern | 21:07 |
dkranz | sdague: So if you respond positively to my message we can just move forward with this. | 21:07 |
sdague | yes, I'm +1 | 21:09 |
sdague | just wanted to make sure I grokked it all | 21:09 |
*** fbo is now known as fbo_away | 21:10 | |
*** atiwari has quit IRC | 21:10 | |
dkranz | sdague: OK, cool. It's a lot to digest. | 21:10 |
dkranz | sdague: Seems devananda and I were having the exact same discussion as the tc meeting :) | 21:11 |
dkranz | sdague: I need to read the minutes of the tc meeting | 21:11 |
* devananda reads scrollback here | 21:11 | |
* devananda agrees | 21:12 | |
*** DennyZhang has quit IRC | 21:13 | |
devananda | sdague: slightly OT - have any thoughts on tempest/ironic testing of bare metal? | 21:13 |
*** DennyZhang has joined #openstack-qa | 21:13 | |
*** jecarey has quit IRC | 21:15 | |
openstackgerrit | Matthew Treinish proposed a change to openstack/tempest: Stop running TempestConfig() on import https://review.openstack.org/60925 | 21:16 |
mtreinish | sdague: ^^^ is that clean enough for you? | 21:17 |
sdague | devananda: I think we need to find some programatic baremetal somewhere | 21:18 |
devananda | sdague: i suspect the shortest path to /some/ baremetal testing is for tripleo to replace nova-baremetal with ironic, but that won't be part of the gate pipe for a while, AIUI | 21:20 |
openstackgerrit | Matthew Treinish proposed a change to openstack/tempest: Do not merge, debug for TempestConfig() on import https://review.openstack.org/61148 | 21:21 |
openstackgerrit | A change was merged to openstack-infra/devstack-gate: Bump grenade master to use stable/havana. https://review.openstack.org/57066 | 21:25 |
sdague | devananda: yeh, I think as we get reporting back we can evolve that over time | 21:26 |
devananda | ack | 21:26 |
openstackgerrit | Nachi Ueno proposed a change to openstack/tempest: Fix Neutron VPNaaS Test https://review.openstack.org/61234 | 21:28 |
sdague | honestly, devananda, I feel you are plugged into everything enough I don't worry that we'll come to a wedged scenario here | 21:30 |
openstackgerrit | Davanum Srinivas (dims) proposed a change to openstack-infra/elastic-recheck: Ability to Soft Delete Stale Bugs from elastic-recheck https://review.openstack.org/61149 | 21:32 |
openstackgerrit | Davanum Srinivas (dims) proposed a change to openstack-infra/elastic-recheck: Delete stale bugs from elastic-recheck page https://review.openstack.org/61186 | 21:34 |
devananda | sdague: :) | 21:35 |
mtreinish | yes, finally no calls to TempestConfig() during subunit discover | 21:37 |
mtreinish | that took long enough | 21:38 |
openstackrecheck | openstack/nova change: https://review.openstack.org/59277 failed tempest with an unrecognized error | 21:38 |
openstackrecheck | openstack/nova change: https://review.openstack.org/55870 failed tempest with an unrecognized error | 21:38 |
openstackgerrit | Matthew Treinish proposed a change to openstack/tempest: Add test-requirements to all tox jobs https://review.openstack.org/60611 | 21:41 |
openstackgerrit | Matthew Treinish proposed a change to openstack/tempest: Add unit tests for rest_client https://review.openstack.org/60379 | 21:41 |
clarkb | mtreinish: wait was the problem that code executed during import? | 21:51 |
mtreinish | clarkb: dunno, but I spent the last day or so trying to stop doing that | 21:52 |
mtreinish | which was a huge headache | 21:52 |
clarkb | woot now hopefully the hunch is correct | 21:52 |
clarkb | :/ silly headaches | 21:52 |
mtreinish | clarkb: nope doesn't look like it solved it: https://jenkins02.openstack.org/job/check-tempest-dsvm-full/1665/console | 21:53 |
openstackgerrit | Davanum Srinivas (dims) proposed a change to openstack-infra/elastic-recheck: Ability to Soft Delete Stale Bugs from elastic-recheck https://review.openstack.org/61149 | 21:53 |
openstackgerrit | Davanum Srinivas (dims) proposed a change to openstack-infra/elastic-recheck: Delete stale bugs from elastic-recheck page https://review.openstack.org/61186 | 21:54 |
openstackrecheck | openstack/tempest change: https://review.openstack.org/60925 failed tempest with an unrecognized error | 21:56 |
openstackrecheck | openstack/tempest change: https://review.openstack.org/61148 failed tempest with an unrecognized error | 21:57 |
openstackgerrit | Morgan Fainberg proposed a change to openstack/tempest: Sync global requirements to pin sphinx to sphinx>=1.1.2,<1.2 https://review.openstack.org/61243 | 22:00 |
openstackrecheck | openstack/tempest change: https://review.openstack.org/60379 failed tempest with an unrecognized error | 22:01 |
openstackgerrit | Matthew Treinish proposed a change to openstack/tempest: Stop running TempestConfig() on import https://review.openstack.org/60925 | 22:02 |
*** jasondotstar has quit IRC | 22:05 | |
openstackrecheck | openstack/savanna change: https://review.openstack.org/60939 failed tempest with an unrecognized error | 22:06 |
openstackgerrit | Nachi Ueno proposed a change to openstack/tempest: Fix Neutron VPNaaS Test https://review.openstack.org/61234 | 22:06 |
openstackgerrit | Armando Migliaccio proposed a change to openstack-dev/devstack: Neutron/NVP plugin: fix 'ip link' usage https://review.openstack.org/61153 | 22:14 |
*** DennyZhang has quit IRC | 22:17 | |
openstackgerrit | Mauro S. M. Rodrigues proposed a change to openstack-dev/grenade: Add clean configuration files to upgrade from H to I https://review.openstack.org/53874 | 22:20 |
openstackgerrit | Jenkins proposed a change to openstack/tempest: Updated from global requirements https://review.openstack.org/61254 | 22:22 |
dkranz | mtreinish: Can you +A https://review.openstack.org/#/c/60782/ and related https://review.openstack.org/#/c/60781/1 ? | 22:29 |
dkranz | Another patch is blocked on those merging. | 22:29 |
openstackrecheck | openstack/cinder change: https://review.openstack.org/61232 failed tempest because of: https://bugs.launchpad.net/bugs/1257641 | 22:30 |
*** syerrapragada has quit IRC | 22:32 | |
*** syerrapragada has joined #openstack-qa | 22:32 | |
sdague | dkranz: I hit them | 22:34 |
dkranz | stevebaker: Can you please comment on https://review.openstack.org/#/c/59341/ | 22:34 |
dkranz | sdague: Thanks | 22:34 |
dkranz | stevebaker: I know you submitted a patch (Approved) to skip that test. | 22:35 |
dkranz | stevebaker: I'm not sure whether you would agree with the change. | 22:35 |
mtreinish | dkranz, sdague: I'm going to have to rebase my config import patches now with those v3 things approved. Sigh... | 22:39 |
dkranz | mtreinish: :( I've been pushing as many as possible every day for the last week | 22:39 |
mtreinish | dkranz: so you're the one who's been making my life difficult | 22:40 |
mtreinish | dkranz: https://review.openstack.org/#/c/61254/ those v3 changes will probably fail on the docs jobs though. This should fix it | 22:40 |
dkranz | mtreinish: Well, at the last meeting it was requested to try to push them through asap :) | 22:41 |
sdague | mtreinish: there were still some other fixes in patch #2 that were needed anyway | 22:41 |
mtreinish | sdague: true | 22:41 |
*** SergeyLukjanov has quit IRC | 22:41 | |
mtreinish | it's just I have to remember to add the new files, because I don't think anything will fail if I don't | 22:42 |
openstackrecheck | openstack/tempest change: https://review.openstack.org/60925 failed tempest with an unrecognized error | 22:42 |
dkranz | sdague, mtreinish : Next time we do something like the v3 thing we should take action to make sure the window is smaller | 22:42 |
sdague | dkranz: yeh, fair | 22:42 |
dkranz | sdague: Perhaps we should tell folks who move or copy files that they should ping folks for quick review | 22:43 |
dkranz | sdague: I will continue to push on the v3 patches as they come | 22:43 |
*** mlavalle has quit IRC | 22:43 | |
sdague | honestly, it would be nice to get some other tool that auto verifies patch #1 | 22:43 |
dkranz | sdague: I'm kind of comfortable with them now. | 22:43 |
sdague | in those copy patches | 22:43 |
sdague | basically verifies it is the same content | 22:44 |
dkranz | sdague: Yes. I have been doing 'wc -l ...' for that and verifying | 22:44 |
sdague | yeh | 22:44 |
dkranz | sdague: I found some misses and honestly I think it is good enough | 22:44 |
*** mriedem has quit IRC | 22:44 | |
dkranz | sdague: The chance that a file was mis-copied but with the same line count is pretty slim to none | 22:45 |
dkranz | sdague: Reviewing an oslo update is much worse and I haven't bothered to confirm | 22:45 |
openstackgerrit | Matthew Treinish proposed a change to openstack/tempest: Remove remaining code from compute __init__ https://review.openstack.org/60906 | 22:46 |
openstackgerrit | Matthew Treinish proposed a change to openstack/tempest: Remove generic_setup_package() function https://review.openstack.org/60866 | 22:46 |
*** mlavalle has joined #openstack-qa | 22:47 | |
openstackgerrit | Matthew Treinish proposed a change to openstack/tempest: Stop running TempestConfig() on import https://review.openstack.org/60925 | 22:48 |
sdague | mtreinish: you going to reverify that first patch in your series? | 22:48 |
openstackgerrit | Matthew Treinish proposed a change to openstack/tempest: Do not merge, debug for TempestConfig() on import https://review.openstack.org/61148 | 22:48 |
mtreinish | sdague: I need to wait for the requirements bump to land first | 22:49 |
sdague | oh | 22:49 |
mtreinish | I just +2d it I guess since it's from jenkins I should have +Ad it too | 22:50 |
openstackrecheck | openstack/python-keystoneclient change: https://review.openstack.org/61247 failed tempest with an unrecognized error | 22:50 |
openstackrecheck | openstack/tempest change: https://review.openstack.org/61234 failed tempest because of: https://bugs.launchpad.net/bugs/1251448 | 22:50 |
mtreinish | sdague: https://review.openstack.org/#/c/61254/ | 22:50 |
sdague | mtreinish: ok, so requirements change isn't in the gate yet, so I guess reverify would be bad :) | 22:50 |
sdague | I didn't realize gate was bust | 22:50 |
mtreinish | sdague: neither did I until that patch failed | 22:51 |
mtreinish | sdague: http://lists.openstack.org/pipermail/openstack-stable-maint/2013-December/001829.html | 22:51 |
openstackrecheck | openstack/tempest change: https://review.openstack.org/58803 failed tempest with an unrecognized error | 23:00 |
*** mkollaro has quit IRC | 23:03 | |
*** weshay has quit IRC | 23:03 | |
openstackrecheck | openstack/python-glanceclient change: https://review.openstack.org/60980 failed tempest with an unrecognized error | 23:03 |
*** jpich has quit IRC | 23:05 | |
openstackgerrit | Nachi Ueno proposed a change to openstack/tempest: Fix Neutron VPNaaS Test https://review.openstack.org/61234 | 23:06 |
*** jgrimm has quit IRC | 23:10 | |
openstackrecheck | openstack/nova change: https://review.openstack.org/61261 failed tempest because of: https://bugs.launchpad.net/bugs/1257641 | 23:13 |
openstackgerrit | Ken'ichi Ohmichi proposed a change to openstack/tempest: Change unstable test which gets console output https://review.openstack.org/59116 | 23:21 |
*** dims has quit IRC | 23:21 | |
openstackrecheck | openstack/nova change: https://review.openstack.org/61011 failed tempest because of: https://bugs.launchpad.net/bugs/1257641 | 23:22 |
openstackrecheck | openstack/cinder change: https://review.openstack.org/58724 failed tempest with an unrecognized error | 23:23 |
*** HenryG has joined #openstack-qa | 23:27 | |
*** dkranz has quit IRC | 23:32 | |
sdague | mtreinish / jog0 - either of yuo want to look at this - https://review.openstack.org/#/c/61149/ | 23:35 |
openstackrecheck | openstack/python-keystoneclient change: https://review.openstack.org/61242 failed tempest because of: https://bugs.launchpad.net/bugs/1257641 | 23:41 |
openstackrecheck | openstack/nova change: https://review.openstack.org/60975 failed tempest with an unrecognized error | 23:42 |
openstackrecheck | openstack/tempest change: https://review.openstack.org/61017 failed tempest with an unrecognized error | 23:45 |
*** fbo_away is now known as fbo | 23:45 | |
*** torandu has quit IRC | 23:55 | |
openstackrecheck | openstack/tempest change: https://review.openstack.org/59116 failed tempest with an unrecognized error | 23:56 |
*** mlavalle has quit IRC | 23:59 | |
*** mrodden has quit IRC | 23:59 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!