Thursday, 2013-12-12

*** mrodden has quit IRC00:01
*** mlavalle has quit IRC00:01
openstackrecheckopenstack/cinder change: https://review.openstack.org/61088 failed tempest because of: https://bugs.launchpad.net/bugs/125389600:07
openstackrecheckopenstack/glance change: https://review.openstack.org/61600 failed tempest with an unrecognized error00:07
*** pmathews has quit IRC00:22
openstackgerritChenZheng proposed a change to openstack/tempest: Test for the neutron api with provider extension  https://review.openstack.org/5054200:23
openstackrecheckopenstack/keystone change: https://review.openstack.org/60743 failed tempest because of: https://bugs.launchpad.net/bugs/121048300:26
openstackgerritA change was merged to openstack-dev/devstack: Workaround Cinder "wishlist" bug 1255593 for multi-backend volume_clear  https://review.openstack.org/6069400:33
openstackrecheckopenstack-dev/devstack change: https://review.openstack.org/60606 failed tempest because of: https://bugs.launchpad.net/bugs/125389600:36
*** dims has joined #openstack-qa00:43
openstackrecheckopenstack/glance change: https://review.openstack.org/59814 failed tempest because of: https://bugs.launchpad.net/bugs/125762600:43
*** sthaha has joined #openstack-qa00:46
*** sthaha has joined #openstack-qa00:46
*** hemna_ is now known as hemnafk00:47
openstackgerritSean Dague proposed a change to openstack-infra/elastic-recheck: make launchpad integration optional  https://review.openstack.org/6095200:47
*** dmorita has joined #openstack-qa00:48
*** ken1ohmichi has joined #openstack-qa00:48
openstackgerritA change was merged to openstack-infra/elastic-recheck: make launchpad integration optional  https://review.openstack.org/6095200:51
*** weshay has quit IRC00:53
openstackrecheckopenstack/ceilometer change: https://review.openstack.org/61602 failed tempest because of: https://bugs.launchpad.net/bugs/121839101:00
openstackrecheckopenstack/heat change: https://review.openstack.org/61614 failed tempest with an unrecognized error01:09
sdaguedtroyer_zz: you got any objections to - https://review.openstack.org/#/c/53874/ ?01:18
openstackgerritA change was merged to openstack/tempest: Skip autoscaling test until more reliable  https://review.openstack.org/5988701:19
openstackrecheckopenstack/keystone change: https://review.openstack.org/61419 failed tempest because of: https://bugs.launchpad.net/bugs/125389601:19
dtroyer_zzsdague: coolness… +A01:20
*** salv-orlando_ has joined #openstack-qa01:24
openstackgerrithuangtianhua proposed a change to openstack/tempest: Add tests for snapshot_metadata  https://review.openstack.org/6079101:25
openstackgerritLingxian Kong proposed a change to openstack/tempest: add some tests for aggregates  https://review.openstack.org/4915701:26
*** salv-orlando has quit IRC01:27
*** salv-orlando has joined #openstack-qa01:27
*** salv-orlando_ has quit IRC01:28
*** jerryz has joined #openstack-qa01:28
sdaguedtroyer_zz: and with that, I think we're properly up to date on grenade thanks to maurosr01:28
sdagueand the next roll forward will be much easier01:29
openstackrecheckopenstack/keystone change: https://review.openstack.org/60743 failed tempest because of: https://bugs.launchpad.net/bugs/125389601:30
sdaguedtroyer_zz: also https://review.openstack.org/#/c/61418/ that I rushed in this morning01:30
sdaguebut if you have other thoughts on better ways to do it, it can be revisited01:30
openstackrecheckopenstack/ceilometer change: https://review.openstack.org/57304 failed tempest because of: https://bugs.launchpad.net/bugs/125389601:32
*** salv-orlando_ has joined #openstack-qa01:33
*** mriedem has joined #openstack-qa01:34
*** salv-orlando_ has quit IRC01:34
*** salv-orlando__ has joined #openstack-qa01:34
*** nosnos has joined #openstack-qa01:35
*** zhikunliu has joined #openstack-qa01:36
*** salv-orlando has quit IRC01:36
*** salv-orlando__ is now known as salv-orlando01:36
openstackgerritChenZheng proposed a change to openstack/tempest: Test for the neutron api with provider extension  https://review.openstack.org/5054201:37
openstackgerritLingxian Kong proposed a change to openstack/tempest: add some negative tests for flavor  https://review.openstack.org/4958801:44
*** dkranz has joined #openstack-qa01:46
*** DennyZhang has joined #openstack-qa01:53
openstackrecheckopenstack/keystone change: https://review.openstack.org/56887 failed tempest because of: https://bugs.launchpad.net/bugs/125389602:01
openstackrecheckopenstack/horizon change: https://review.openstack.org/61309 failed tempest because of: https://bugs.launchpad.net/bugs/125389602:08
openstackrecheckopenstack/oslo.messaging change: https://review.openstack.org/61282 failed tempest because of: https://bugs.launchpad.net/bugs/125389602:08
openstackrecheckopenstack/horizon change: https://review.openstack.org/60437 failed tempest with an unrecognized error02:08
*** ivanzhu has joined #openstack-qa02:09
openstackgerritZhi Kun Liu proposed a change to openstack/tempest: cinder v2 api tests - part1  https://review.openstack.org/5911302:10
openstackgerritZhi Kun Liu proposed a change to openstack/tempest: cinder v2 api tests - part2  https://review.openstack.org/5973302:11
openstackrecheckopenstack/tempest change: https://review.openstack.org/50542 failed tempest because of: https://bugs.launchpad.net/bugs/125389602:21
openstackgerritMatt Riedemann proposed a change to openstack/tempest: Make the wait_for_server_status timeout message a bit more clear  https://review.openstack.org/6162502:22
mriedemclarkb: ^02:22
mriedemonce you get home :)02:22
openstackrecheckopenstack/cinder change: https://review.openstack.org/61356 failed tempest with an unrecognized error02:23
openstackrecheckopenstack/tempest change: https://review.openstack.org/60906 failed tempest because of: https://bugs.launchpad.net/bugs/125389602:23
openstackrecheckopenstack/tempest change: https://review.openstack.org/49588 failed tempest with an unrecognized error02:24
openstackrecheckopenstack/nova change: https://review.openstack.org/60748 failed tempest because of: https://bugs.launchpad.net/bugs/125389602:32
*** zhikunliu has quit IRC02:33
openstackgerrithuangtianhua proposed a change to openstack/tempest: Add tests for snapshot_metadata  https://review.openstack.org/6079102:42
*** klrmn has joined #openstack-qa02:43
*** ivanzhu has quit IRC02:50
clarkbmriedem: shouldn't the message also state what the desired task_state is? what the desired task_state is supposed to be isn't clear to me02:57
clarkbalmost appears that the expectation is that the task state does not change across polls02:57
mriedemclarkb: the desired task state depends on parameters passed into the method02:57
mriedemnormally it's that the task state is 'None'02:58
mriedemi.e. state transitions are done and you can start doing actions against the server02:58
clarkboh I see02:58
mriedemhowever there is a parameter to short circuit that02:58
clarkbmriedem: in that case I think the message should include the desired task state as well02:58
mriedemand just say that i don't care what the task_state is, go when the vm_state is what i want02:58
mriedemi'm not sure what i'd say the desired task_state is if there is no desired task_state, i.e. don't care what it is02:59
mriedemn/a?02:59
clarkbmriedem: that would work03:00
openstackrecheckopenstack/python-neutronclient change: https://review.openstack.org/61561 failed tempest with an unrecognized error03:02
*** SushilKM has joined #openstack-qa03:06
openstackrecheckopenstack/tempest change: https://review.openstack.org/49157 failed tempest with an unrecognized error03:07
openstackrecheckopenstack/heat change: https://review.openstack.org/61614 failed tempest because of: https://bugs.launchpad.net/bugs/125389603:10
*** diakunchikov__ has quit IRC03:12
*** diakunchikov__ has joined #openstack-qa03:13
*** stephen_rkc__ has quit IRC03:15
openstackrecheckopenstack/python-heatclient change: https://review.openstack.org/61624 failed tempest because of: https://bugs.launchpad.net/bugs/125389603:19
*** syerrapragada1 has joined #openstack-qa03:21
*** syerrapragada has quit IRC03:22
openstackrecheckopenstack/tempest change: https://review.openstack.org/61625 failed tempest because of: https://bugs.launchpad.net/bugs/1250168 and https://bugs.launchpad.net/bugs/125389603:24
openstackrecheckopenstack/swift change: https://review.openstack.org/61585 failed tempest because of: https://bugs.launchpad.net/bugs/1240256 and https://bugs.launchpad.net/bugs/125016803:24
openstackrecheckopenstack/tempest change: https://review.openstack.org/60791 failed tempest because of: https://bugs.launchpad.net/bugs/125389603:25
openstackrecheckopenstack/swift change: https://review.openstack.org/53270 failed tempest because of: https://bugs.launchpad.net/bugs/125389603:30
openstackgerritMatt Riedemann proposed a change to openstack/tempest: Make the wait_for_server_status timeout message a bit more clear  https://review.openstack.org/6162503:30
mriedemclarkb: well i think i'm onto something with that create backup timeout03:36
mriedemin the image api tests where they are testing snapshots, they are not only waiting for the instance to be active but also the image (the snapshot)03:36
mriedemthe compute api create_backup test isn't doing that03:36
mriedemit's not waiting for the image to be active03:36
*** DennyZhang has quit IRC03:37
mriedemi'll post some notes in the bug, won't have time to test it tonight, but i think it's just a problem in tempest being racy, nothing in nova as far as bugs from what i can tell03:37
clarkbcool03:37
openstackrecheckopenstack/nova change: https://review.openstack.org/61028 failed tempest because of: https://bugs.launchpad.net/bugs/1257626 and https://bugs.launchpad.net/bugs/125389603:40
openstackrecheckopenstack/nova change: https://review.openstack.org/59934 failed tempest because of: https://bugs.launchpad.net/bugs/125389603:40
openstackrecheckopenstack/python-novaclient change: https://review.openstack.org/59960 failed tempest because of: https://bugs.launchpad.net/bugs/125389603:41
openstackrecheckopenstack/python-novaclient change: https://review.openstack.org/60750 failed tempest because of: https://bugs.launchpad.net/bugs/125389603:47
openstackgerritMatt Riedemann proposed a change to openstack/tempest: Wait for backup images to be ACTIVE in test_create_backup  https://review.openstack.org/6164703:56
mriedemclarkb: nevermind, i'm hoping that fixes it ^03:56
mriedemalright, time for me to walk to bed03:57
*** mriedem has quit IRC03:59
*** marun has joined #openstack-qa04:06
openstackrecheckopenstack/tempest change: https://review.openstack.org/61625 failed tempest with an unrecognized error04:10
openstackrecheckopenstack/python-novaclient change: https://review.openstack.org/61645 failed tempest because of: https://bugs.launchpad.net/bugs/125389604:10
openstackrecheckopenstack/nova change: https://review.openstack.org/59659 failed tempest because of: https://bugs.launchpad.net/bugs/125389604:11
*** adalbas has quit IRC04:11
openstackgerritA change was merged to openstack/tempest: Don't have tox install pre-release software  https://review.openstack.org/6151304:14
openstackrecheckopenstack/glance change: https://review.openstack.org/60372 failed tempest because of: https://bugs.launchpad.net/bugs/124906504:16
*** SushilKM has quit IRC04:17
openstackgerritKen'ichi Ohmichi proposed a change to openstack/tempest: Remove unnecessary spaces from messages  https://review.openstack.org/6165104:22
openstackrecheckopenstack-dev/devstack change: https://review.openstack.org/61122 failed tempest because of: https://bugs.launchpad.net/bugs/125487204:23
*** pmathews has joined #openstack-qa04:23
*** pmathews has quit IRC04:24
openstackrecheckopenstack/swift change: https://review.openstack.org/61585 failed tempest with an unrecognized error04:30
openstackrecheckopenstack/tempest change: https://review.openstack.org/61647 failed tempest with an unrecognized error04:37
openstackrecheckopenstack/python-novaclient change: https://review.openstack.org/61648 failed tempest with an unrecognized error04:44
Anjuportante:   https://community.hpcloud.com/article/python-swiftclient-linux-installation04:44
AnjuI am follwing this one04:44
AnjuIs any problem of versioning ?04:46
Anjuahh wrong channel04:47
openstackrecheckopenstack/python-novaclient change: https://review.openstack.org/60734 failed tempest because of: https://bugs.launchpad.net/bugs/125389604:50
openstackrecheckopenstack/python-novaclient change: https://review.openstack.org/59960 failed tempest because of: https://bugs.launchpad.net/bugs/125389604:54
*** yfried has quit IRC04:58
*** ken1ohmichi has quit IRC04:59
openstackrecheckopenstack/glance change: https://review.openstack.org/61567 failed tempest because of: https://bugs.launchpad.net/bugs/125389605:10
*** Madan has joined #openstack-qa05:12
*** SergeyLukjanov has joined #openstack-qa05:17
*** yfried has joined #openstack-qa05:25
openstackrecheckopenstack/cinder change: https://review.openstack.org/61356 failed tempest because of: https://bugs.launchpad.net/bugs/125389605:27
*** prekarat has joined #openstack-qa05:28
openstackrecheckopenstack/python-keystoneclient change: https://review.openstack.org/57803 failed tempest because of: https://bugs.launchpad.net/bugs/125389605:29
*** psharma has joined #openstack-qa05:30
openstackrecheckopenstack/horizon change: https://review.openstack.org/60437 failed tempest with an unrecognized error05:32
*** SergeyLukjanov is now known as _SergeyLukjanov05:33
*** _SergeyLukjanov has quit IRC05:33
openstackrecheckopenstack/tempest change: https://review.openstack.org/60791 failed tempest because of: https://bugs.launchpad.net/bugs/125389605:33
*** enikanorov_ has quit IRC05:37
*** enikanorov has joined #openstack-qa05:37
openstackrecheckopenstack/python-novaclient change: https://review.openstack.org/59960 failed tempest with an unrecognized error05:47
*** Madan1 has joined #openstack-qa05:48
*** saurabh_ has joined #openstack-qa05:49
*** Madan has quit IRC05:49
*** SergeyLukjanov has joined #openstack-qa05:51
Anjuclarkb:  ping , clarkb  I am getting an versioning error while running keystone-all05:55
clarkbAnju: can you be more specific? what is the exact error?05:57
Anjuclarkb:  yes05:58
Anjuclarkb:  http://paste.openstack.org/show/54863/05:58
*** rdekel has joined #openstack-qa05:58
Anjuhave  allok05:58
Anjuhave  a look05:59
clarkbI haven't seen that before, not sure what would cause that06:01
Anjuhmm clarkb06:01
Anjuok thanks06:01
openstackrecheckopenstack/cinder change: https://review.openstack.org/44576 failed tempest because of: https://bugs.launchpad.net/bugs/1250168 and https://bugs.launchpad.net/bugs/125487206:10
openstackrecheckopenstack/python-novaclient change: https://review.openstack.org/58684 failed tempest because of: https://bugs.launchpad.net/bugs/125762606:11
*** SergeyLukjanov has quit IRC06:17
*** ivanzhu has joined #openstack-qa06:27
*** Madan1 has quit IRC06:29
*** ivanzhu has quit IRC06:36
*** SushilKM has joined #openstack-qa06:38
openstackrecheckopenstack/nova change: https://review.openstack.org/50314 failed tempest because of: https://bugs.launchpad.net/bugs/125389606:43
openstackgerritA change was merged to openstack-infra/devstack-gate: allow configdrive vs. metadata server to be configured  https://review.openstack.org/5930306:44
openstackrecheckopenstack/heat change: https://review.openstack.org/61322 failed tempest because of: https://bugs.launchpad.net/bugs/125389606:46
*** lifeless has quit IRC06:48
openstackrecheckopenstack/horizon change: https://review.openstack.org/56479 failed tempest with an unrecognized error06:52
*** jlibosva has joined #openstack-qa06:52
openstackrecheckopenstack/cinder change: https://review.openstack.org/59334 failed tempest because of: https://bugs.launchpad.net/bugs/125389606:56
openstackrecheckopenstack/nova change: https://review.openstack.org/59994 failed tempest with an unrecognized error06:57
*** lifeless has joined #openstack-qa07:15
*** Madan has joined #openstack-qa07:20
openstackrecheckopenstack/neutron change: https://review.openstack.org/61663 failed tempest because of: https://bugs.launchpad.net/bugs/125389607:24
openstackrecheckopenstack/neutron change: https://review.openstack.org/61325 failed tempest because of: https://bugs.launchpad.net/bugs/125389607:26
openstackrecheckopenstack/python-novaclient change: https://review.openstack.org/61648 failed tempest with an unrecognized error07:32
openstackrecheckopenstack/nova change: https://review.openstack.org/54987 failed tempest because of: https://bugs.launchpad.net/bugs/121048307:35
*** ivanzhu has joined #openstack-qa07:49
openstackrecheckopenstack/ceilometer change: https://review.openstack.org/61602 failed tempest because of: https://bugs.launchpad.net/bugs/124906507:50
openstackgerritAnn Kamyshnikova proposed a change to openstack/tempest: Verify more information in API tests for LBaaS  https://review.openstack.org/6111807:51
*** ivanzhu has quit IRC07:51
*** ivanzhu has joined #openstack-qa07:51
*** openstackrecheck has quit IRC07:54
*** mkoderer has quit IRC07:55
openstackgerritFeng Ju proposed a change to openstack/tempest: Refactors network scenario test to support more network tests  https://review.openstack.org/5989807:57
*** mkoderer_ has joined #openstack-qa07:57
*** openstackrecheck has joined #openstack-qa07:58
openstackrecheckopenstack/neutron change: https://review.openstack.org/61667 failed tempest because of: https://bugs.launchpad.net/bugs/125389608:01
*** ivanzhu has quit IRC08:01
*** ivanzhu has joined #openstack-qa08:01
openstackgerritFeng Ju proposed a change to openstack/tempest: Refactors network scenario test to support more network tests  https://review.openstack.org/5989808:01
*** safchain has joined #openstack-qa08:08
openstackrecheckopenstack/swift change: https://review.openstack.org/53270 failed tempest because of: https://bugs.launchpad.net/bugs/125389608:10
openstackrecheckopenstack/nova change: https://review.openstack.org/61566 failed tempest because of: https://bugs.launchpad.net/bugs/125487208:14
openstackrecheckopenstack/cinder change: https://review.openstack.org/60715 failed tempest with an unrecognized error08:30
openstackgerritLingxian Kong proposed a change to openstack/tempest: add some tests for aggregates  https://review.openstack.org/4915708:35
*** prekarat has quit IRC08:35
*** jhenner has joined #openstack-qa08:37
openstackrecheckopenstack/tempest change: https://review.openstack.org/59898 failed tempest with an unrecognized error08:42
*** fbo_away is now known as fbo08:42
*** gszasz has joined #openstack-qa08:43
openstackrecheckopenstack/ceilometer change: https://review.openstack.org/61602 failed tempest because of: https://bugs.launchpad.net/bugs/125762608:44
openstackgerritA change was merged to openstack/tempest: Fix Neutron VPNaaS Test  https://review.openstack.org/6123408:45
openstackgerritA change was merged to openstack-infra/devstack-gate: update documentation with specific of rax setup  https://review.openstack.org/6130108:48
*** afazekas has joined #openstack-qa08:51
*** ken1ohmichi has joined #openstack-qa08:58
openstackgerritA change was merged to openstack/tempest: Separate negative tests in flavors/test_flavors  https://review.openstack.org/6022108:58
openstackgerritA change was merged to openstack-dev/devstack: Qemu emulator requires at least 128MB of memory to boot on ppc64  https://review.openstack.org/6060608:58
openstackrecheckopenstack-dev/devstack change: https://review.openstack.org/58588 failed tempest because of: https://bugs.launchpad.net/bugs/125389608:59
*** yassine has joined #openstack-qa08:59
openstackgerritFeng Ju proposed a change to openstack/tempest: Refactors network scenario test to support more network tests  https://review.openstack.org/5989808:59
*** jpich has joined #openstack-qa09:05
*** salv-orlando has quit IRC09:05
*** ken1ohmichi has quit IRC09:08
openstackrecheckopenstack/neutron change: https://review.openstack.org/61673 failed tempest because of: https://bugs.launchpad.net/bugs/125389609:15
*** ekarlso has quit IRC09:17
*** ekarlso has joined #openstack-qa09:17
*** yassine has quit IRC09:21
*** yassine has joined #openstack-qa09:22
*** yassine has quit IRC09:22
*** yassine has joined #openstack-qa09:23
*** jorisroovers has joined #openstack-qa09:23
*** yassine has quit IRC09:23
openstackrecheckopenstack/oslo.messaging change: https://review.openstack.org/59715 failed tempest with an unrecognized error09:23
*** yassine has joined #openstack-qa09:24
*** yassine has quit IRC09:25
*** yassine has joined #openstack-qa09:26
*** jorisroovers has quit IRC09:27
openstackrecheckopenstack/cinder change: https://review.openstack.org/58724 failed tempest with an unrecognized error09:30
openstackrecheckopenstack/neutron change: https://review.openstack.org/61677 failed tempest with an unrecognized error09:30
openstackgerritA change was merged to openstack-dev/devstack: Added keystone auth port to the nova config  https://review.openstack.org/6073609:31
*** marun has quit IRC09:36
*** SushilKM has quit IRC09:37
openstackrecheckopenstack/cinder change: https://review.openstack.org/60715 failed tempest because of: https://bugs.launchpad.net/bugs/125389609:37
*** marun has joined #openstack-qa09:37
openstackgerritLingxian Kong proposed a change to openstack/tempest: add some negative tests for flavor  https://review.openstack.org/4958809:39
openstackrecheckopenstack-dev/devstack change: https://review.openstack.org/56459 failed tempest because of: https://bugs.launchpad.net/bugs/125389609:41
openstackrecheckopenstack/cinder change: https://review.openstack.org/44881 failed tempest because of: https://bugs.launchpad.net/bugs/125762609:41
openstackrecheckopenstack/nova change: https://review.openstack.org/53789 failed tempest because of: https://bugs.launchpad.net/bugs/125389609:41
*** SushilKM has joined #openstack-qa09:43
openstackrecheckopenstack/python-keystoneclient change: https://review.openstack.org/55405 failed tempest because of: https://bugs.launchpad.net/bugs/125389609:46
openstackrecheckopenstack/oslo.messaging change: https://review.openstack.org/59716 failed tempest because of: https://bugs.launchpad.net/bugs/125389609:48
openstackrecheckopenstack/heat change: https://review.openstack.org/61388 failed tempest because of: https://bugs.launchpad.net/bugs/125389609:50
openstackrecheckopenstack/neutron change: https://review.openstack.org/61667 failed tempest because of: https://bugs.launchpad.net/bugs/1253896 and https://bugs.launchpad.net/bugs/122400109:55
openstackgerritAnn Kamyshnikova proposed a change to openstack/tempest: Add filters support to list_* commands  https://review.openstack.org/6168709:56
openstackrecheckopenstack/tempest change: https://review.openstack.org/59898 failed tempest because of: https://bugs.launchpad.net/bugs/125389610:08
openstackrecheckopenstack/tempest change: https://review.openstack.org/49157 failed tempest with an unrecognized error10:13
*** nosnos_ has joined #openstack-qa10:15
*** nosnos_ has quit IRC10:16
*** nosnos_ has joined #openstack-qa10:16
openstackrecheckopenstack/nova change: https://review.openstack.org/59994 failed tempest with an unrecognized error10:17
*** nosnos has quit IRC10:17
*** SergeyLukjanov has joined #openstack-qa10:17
*** nosnos_ has quit IRC10:20
openstackrecheckopenstack/neutron change: https://review.openstack.org/59359 failed tempest because of: https://bugs.launchpad.net/bugs/125389610:21
openstackrecheckopenstack/python-neutronclient change: https://review.openstack.org/61561 failed tempest because of: https://bugs.launchpad.net/bugs/125389610:27
openstackrecheckopenstack/horizon change: https://review.openstack.org/59624 failed tempest because of: https://bugs.launchpad.net/bugs/1210483 and https://bugs.launchpad.net/bugs/125389610:28
openstackrecheckopenstack/neutron change: https://review.openstack.org/60016 failed tempest because of: https://bugs.launchpad.net/bugs/125389610:28
*** diakunchikov__ has quit IRC10:28
openstackrecheckopenstack-dev/devstack change: https://review.openstack.org/59244 failed tempest because of: https://bugs.launchpad.net/bugs/125389610:31
openstackrecheckopenstack/nova change: https://review.openstack.org/61679 failed tempest because of: https://bugs.launchpad.net/bugs/125389610:31
*** salv-orlando has joined #openstack-qa10:34
openstackgerritFeng Ju proposed a change to openstack/tempest: Refactors network scenario test to support more network tests  https://review.openstack.org/5989810:35
openstackgerritFeng Ju proposed a change to openstack/tempest: Adds VM connectivity check after VM resized  https://review.openstack.org/5990710:35
*** diakunchikov has joined #openstack-qa10:39
*** salv-orlando has quit IRC10:42
*** ivanzhu has quit IRC10:42
giulivomtreinish, will we have the meeting today at 17:00 or 22:00 ? (so I can add some "starting with" in the wiki page)10:42
openstackgerritJoe Gordon proposed a change to openstack-infra/elastic-recheck: Add graph for gate hit count  https://review.openstack.org/6142910:44
*** mkollaro has joined #openstack-qa10:47
openstackrecheckopenstack/nova change: https://review.openstack.org/56871 failed tempest because of: https://bugs.launchpad.net/bugs/125389610:49
openstackrecheckopenstack/glance change: https://review.openstack.org/52409 failed tempest with an unrecognized error10:49
openstackrecheckopenstack/cinder change: https://review.openstack.org/58724 failed tempest with an unrecognized error10:49
openstackrecheckopenstack/tempest change: https://review.openstack.org/61687 failed tempest with an unrecognized error10:50
*** debasish has quit IRC10:50
openstackrecheckopenstack/cinder change: https://review.openstack.org/44881 failed tempest because of: https://bugs.launchpad.net/bugs/124906510:51
openstackrecheckopenstack/horizon change: https://review.openstack.org/61131 failed tempest because of: https://bugs.launchpad.net/bugs/125389611:02
openstackgerritAnn Kamyshnikova proposed a change to openstack/tempest: Fix XML to JSON parser  https://review.openstack.org/6140311:09
openstackrecheckopenstack/horizon change: https://review.openstack.org/60443 failed tempest because of: https://bugs.launchpad.net/bugs/125389611:09
openstackrecheckopenstack/neutron change: https://review.openstack.org/61677 failed tempest because of: https://bugs.launchpad.net/bugs/124906511:12
openstackgerritAnn Kamyshnikova proposed a change to openstack/tempest: Verify more information in API tests for LBaaS  https://review.openstack.org/6111811:19
openstackgerritAnn Kamyshnikova proposed a change to openstack/tempest: Add filters support to list_* commands  https://review.openstack.org/6168711:19
openstackrecheckopenstack/python-novaclient change: https://review.openstack.org/59726 failed tempest with an unrecognized error11:25
*** saurabh_ has left #openstack-qa11:28
*** rossella_s has joined #openstack-qa11:34
openstackrecheckopenstack-dev/devstack change: https://review.openstack.org/61328 failed tempest because of: https://bugs.launchpad.net/bugs/125389611:35
*** adalbas has joined #openstack-qa11:36
openstackrecheckopenstack/python-novaclient change: https://review.openstack.org/61012 failed tempest because of: https://bugs.launchpad.net/bugs/125389611:39
*** salv-orlando has joined #openstack-qa11:43
*** salv-orlando has quit IRC11:43
openstackrecheckopenstack/python-novaclient change: https://review.openstack.org/61308 failed tempest because of: https://bugs.launchpad.net/bugs/125389611:43
openstackrecheckopenstack/nova change: https://review.openstack.org/58199 failed tempest because of: https://bugs.launchpad.net/bugs/1250168 and https://bugs.launchpad.net/bugs/125389611:44
*** adalbas changes topic to "Tempest Bug Triage Day: http://status.openstack.org/bugday/"11:48
openstackrecheckopenstack/neutron change: https://review.openstack.org/61694 failed tempest because of: https://bugs.launchpad.net/bugs/125389611:53
*** weshay has joined #openstack-qa11:58
*** dmorita has quit IRC11:59
openstackrecheckopenstack/python-neutronclient change: https://review.openstack.org/61561 failed tempest because of: https://bugs.launchpad.net/bugs/125389612:07
*** adalbas changes topic to "Tempest Bug Triage (today Thu Dec 12th): https://etherpad.openstack.org/p/tempest-bug-triage"12:08
openstackgerritLingxian Kong proposed a change to openstack/tempest: add some negative tests for flavor  https://review.openstack.org/4958812:09
openstackrecheckopenstack/nova change: https://review.openstack.org/61470 failed tempest because of: https://bugs.launchpad.net/bugs/125389612:10
*** Madan has quit IRC12:16
openstackgerritRossella Sblendido proposed a change to openstack/tempest: Serialize plurals correctly in neutron xml client  https://review.openstack.org/5902912:16
adalbasgiulivo, dkranz, afazekas, sdague and others: Bug triage on tempest today. Any help you can give on confirming new bugs and setting their priority/milestones will be helpful.12:22
openstackrecheckopenstack/nova change: https://review.openstack.org/60808 failed tempest because of: https://bugs.launchpad.net/bugs/125389612:22
openstackrecheckopenstack/neutron change: https://review.openstack.org/53821 failed tempest because of: https://bugs.launchpad.net/bugs/125389612:22
adalbasThe topic has a link with some helpful queries and goals12:22
*** rfolco has joined #openstack-qa12:23
openstackgerritandrea-frittoli proposed a change to openstack-dev/devstack: Handle the case of pipe char in value for iniset  https://review.openstack.org/6017012:24
afazekasadalbas: IMHO first we should move the 'Fix Committed ' bugs to 'Fix Released'12:24
*** enikanorov has quit IRC12:24
*** zhikunliu has joined #openstack-qa12:24
*** enikanorov has joined #openstack-qa12:24
adalbasafazekas, yes, good point too.12:25
adalbasOne more step to add to that list.12:25
openstackgerritandrea-frittoli proposed a change to openstack-dev/devstack: Handle the case of pipe char in value for iniset  https://review.openstack.org/6017012:26
openstackrecheckopenstack/glance change: https://review.openstack.org/59630 failed tempest because of: https://bugs.launchpad.net/bugs/125389612:31
openstackrecheckopenstack/nova change: https://review.openstack.org/61075 failed tempest with an unrecognized error12:32
openstackgerritDebasish Chowdhury proposed a change to openstack/tempest: Tempest test for python troveclient  https://review.openstack.org/6171812:32
openstackrecheckopenstack/tempest change: https://review.openstack.org/61118 failed tempest with an unrecognized error12:33
openstackgerritA change was merged to openstack-dev/grenade: Add clean configuration files to upgrade from H to I  https://review.openstack.org/5387412:34
openstackrecheckopenstack/neutron change: https://review.openstack.org/60016 failed tempest because of: https://bugs.launchpad.net/bugs/125389612:34
openstackrecheckopenstack/python-novaclient change: https://review.openstack.org/61367 failed tempest because of: https://bugs.launchpad.net/bugs/1210483 and https://bugs.launchpad.net/bugs/125389612:37
openstackrecheckopenstack/tempest change: https://review.openstack.org/61687 failed tempest with an unrecognized error12:37
openstackrecheckopenstack/cinder change: https://review.openstack.org/58724 failed tempest because of: https://bugs.launchpad.net/bugs/124906512:38
openstackrecheckopenstack/keystone change: https://review.openstack.org/61419 failed tempest because of: https://bugs.launchpad.net/bugs/124906512:39
*** dims has quit IRC12:41
*** dims has joined #openstack-qa12:41
openstackrecheckopenstack/tempest change: https://review.openstack.org/50542 failed tempest because of: https://bugs.launchpad.net/bugs/125389612:41
adalbasafazekas, do you confirm with owners of the bug before marking them Fix Released?12:48
afazekasadalbas: long time ago the bugs moved to fix released state after merge12:49
adalbasafazekas, why was it changed?12:51
afazekasI can't remember, it should be restored to the original setting.12:51
*** masayukig_mobi has joined #openstack-qa12:52
afazekasProbbaly mtreinish knows the answer12:52
*** masayukig_mobi has quit IRC12:52
*** SergeyLukjanov is now known as _SergeyLukjanov12:54
*** _SergeyLukjanov has quit IRC12:54
*** masayukig_mobi has joined #openstack-qa12:55
*** prekarat has joined #openstack-qa12:56
openstackrecheckopenstack/nova change: https://review.openstack.org/53789 failed tempest because of: https://bugs.launchpad.net/bugs/121839113:02
openstackrecheckopenstack/tempest change: https://review.openstack.org/59907 failed tempest because of: https://bugs.launchpad.net/bugs/125389613:02
*** zhikunliu has quit IRC13:14
maurosradalbas: In nova they move fix-commited to fix-release only when the release is done, not after merge, not sure if that makes sense in tempest since our releases are much more to mark a stable branch to check stable branches from other projects (someone corrects me if I'm wrong13:14
*** dims has quit IRC13:17
maurosradalbas: following the bugtriage guide on the wiki, who would be the bug supervisors? the core reviewers?13:17
adalbasmaurosr, yes, i think it makes sense to move it to fix released when we understand the fix is working. But that would require checking the bug again after the commit.13:17
openstackgerritDebasish Chowdhury proposed a change to openstack/tempest: Tempest test for python troveclient  https://review.openstack.org/6172713:17
adalbasmaurosr, the tempest bug team13:17
adalbasmaurosr, https://launchpad.net/~tempest-bug-team . It s an open group13:18
adalbasyou can join if you want to help13:18
*** dims has joined #openstack-qa13:19
*** mriedem has joined #openstack-qa13:19
openstackrecheckopenstack/tempest change: https://review.openstack.org/49588 failed tempest with an unrecognized error13:20
*** SergeyLukjanov has joined #openstack-qa13:23
openstackrecheckopenstack/tempest change: https://review.openstack.org/59029 failed tempest because of: https://bugs.launchpad.net/bugs/125144813:24
openstackrecheckopenstack/nova change: https://review.openstack.org/58138 failed tempest because of: https://bugs.launchpad.net/bugs/124906513:28
openstackgerritZhi Kun Liu proposed a change to openstack/tempest: port admin/test_servers* into Nova V3 tests part2  https://review.openstack.org/6083113:30
openstackgerritZhi Kun Liu proposed a change to openstack/tempest: port admin/test_servers* into Nova V3 tests part1  https://review.openstack.org/6077613:30
sdagueadalbas: do you have the fun bug triage graph up?13:33
sdaguethere is a url for that somewhere13:33
adalbassdague, yes13:33
maurosrhttp://status.openstack.org/bugday/tempest.html13:33
adalbasthere' s a link to it in the etherpad (see the topic)13:33
maurosrsdague: ^I guess is this13:33
openstackrecheckopenstack/neutron change: https://review.openstack.org/53821 failed tempest with an unrecognized error13:34
sdaguecool13:34
adalbassdague, talking to afazekas , he mentioned 'Fix committed' was automatically changed to 'Fix Released' before. do you know why this changed?13:35
sdagueok, I'm going through the bugs from top to bottom to invalidate high bugs that aren't real issue13:35
sdagueFix Released takes it off our list13:35
dkranzadalbas: Some one changed it and then we decided it was a mistake and changed it back13:36
dkranzShould be automatic now13:36
adalbasdkranz, there are 42 fix committed now13:36
sdagueadalbas: so a bug should only be confirmed in Tempest if it's actually a tempest test bug13:36
sdaguesomethign that has to change in tempest13:37
openstackrecheckopenstack/glance change: https://review.openstack.org/60333 failed tempest because of: https://bugs.launchpad.net/bugs/125389613:37
adalbasdkranz, so i guess those should be manually converted to fix released13:37
dkranzadalbas: There was a window, yes they should13:37
openstackrecheckopenstack/python-neutronclient change: https://review.openstack.org/61561 failed tempest with an unrecognized error13:37
adalbassdague, right! And how do you differentiate triaged and confirmed?13:37
adalbasit seems to be quite random now13:38
sdagueadalbas: the bug triage page has instructions13:38
*** dkranz is now known as dkranz-in-transi13:38
sdaguehttps://wiki.openstack.org/wiki/BugTriage13:38
afazekaswhat should be the priority of this bug: https://bugs.launchpad.net/tempest/+bug/125694513:38
sdagueadalbas: so this bug - https://bugs.launchpad.net/tempest/+bug/1132879 I'd actually mark as invalid for tempest13:39
sdagueafazekas: medium13:39
*** prekarat has quit IRC13:41
*** dkranz-in-transi has quit IRC13:41
*** prekarat has joined #openstack-qa13:41
adalbassdague, ok.13:41
afazekaspriority of running tempest with tox on OS X  https://bugs.launchpad.net/tempest/+bug/1256924 ?13:41
afazekasDo we support anything else than Linux 2.6?13:42
maurosrjust guessing, but it's wish list imho13:42
adalbassdague, afazekas , maurosr : i'm adding the bugs i could not make a decision in a list here : https://etherpad.openstack.org/p/tempest-bug-triage . Those may require other expert opinions.13:44
maurosrfrom the wiki: If the bug contains the solution, or a patch, set the bug status to Triaged13:45
maurosrshouldn't it be in progress?13:45
maurosroh forget it13:45
maurosrok, I'm confused hehe13:46
adalbasmaurosr, if someone is assigned to it, it should be In Progress. If the person is not working on it13:46
adalbasmaurosr, it should be unassigned and moved back to confirmed, triaged.13:47
maurosrright13:47
adalbasmaurosr, so imho, it s ok to be confirmed triaged, as long as it is unassigned and prioritized.13:48
adalbasIs this still hitting on tempest: https://bugs.launchpad.net/tempest/+bug/1251920?13:50
openstackrecheckopenstack/heat change: https://review.openstack.org/61212 failed tempest because of: https://bugs.launchpad.net/bugs/125389613:51
sdagueso any bug that's > 1 year old with no activity, I'm just going to close out as not useful13:53
openstackgerritSean Dague proposed a change to openstack/tempest: unskip multibyte test  https://review.openstack.org/6174713:56
openstackgerritKen'ichi Ohmichi proposed a change to openstack/tempest: Add pkey info to SSHTimeout exception  https://review.openstack.org/6174813:57
openstackrecheckopenstack/nova change: https://review.openstack.org/58199 failed tempest because of: https://bugs.launchpad.net/bugs/125389613:59
adalbassdague, yup14:00
sdaguealso, please feel free to fix the bug titles to something more meaningful14:00
adalbassdague, this is also an old bug, but i could not edit it to fix released. Could you try it https://bugs.launchpad.net/tempest/+bug/1179008 ?14:00
openstackgerritIvan-Zhu proposed a change to openstack/tempest: port some flavor tests into nova v3 part2  https://review.openstack.org/5993914:01
*** adalbas is now known as adalbafk14:03
sdagueoh, that's because launchpad is terrible14:04
openstackrecheckopenstack/python-novaclient change: https://review.openstack.org/61367 failed tempest because of: https://bugs.launchpad.net/bugs/125389614:04
sdaguebugs that are cross listed that much just time out14:04
sdague100% of the time14:04
openstackgerritMatt Riedemann proposed a change to openstack-infra/elastic-recheck: Add e-r query for bug 1230354  https://review.openstack.org/6174914:05
openstackgerritVadim Rovachev proposed a change to openstack/tempest: Create client, tests and config for Ceilometer API  https://review.openstack.org/5527614:05
sdagueafazekas: https://bugs.launchpad.net/tempest/+bug/1052747 is fixed now, right?14:08
afazekashttps://review.openstack.org/#/c/50337/ this will be just for the ssh instance validation14:09
afazekasas I remember the floating ip usage is optional in several scenario test14:09
afazekassdague: not fixed, several scenario still assumes floating ips are in use14:11
afazekasBTW ssh instance validation, looks like the rebuild become buggy :(14:12
sdaguemtreinish: https://bugs.launchpad.net/tempest/+bug/1214774 - that get done14:19
openstackrecheckopenstack/nova change: https://review.openstack.org/61712 failed tempest with an unrecognized error14:24
sdagueafazekas: https://bugs.launchpad.net/tempest/+bug/1218279 - so that bug is so confusing that I don't even really understand it - also it's 3 months old no comments.14:24
openstackgerritIvan-Zhu proposed a change to openstack/tempest: port some flavor tests into nova v3 part2  https://review.openstack.org/5993914:24
*** dkranz-in-transi has joined #openstack-qa14:27
*** dkranz-in-transi is now known as dkranz14:28
rahmusdague: afazekas: I'm seeing conflicting decisions on https://bugs.launchpad.net/tempest/+bug/1256924. Is it confirmed or not? Can you tell me if we support dev tools on macosx?14:28
*** jasondotstar has joined #openstack-qa14:30
openstackrecheckopenstack/neutron change: https://review.openstack.org/61721 failed tempest with an unrecognized error14:32
*** sthaha has quit IRC14:32
*** ken1ohmichi has joined #openstack-qa14:33
openstackrecheckopenstack/tempest change: https://review.openstack.org/60831 failed tempest with an unrecognized error14:34
*** SushilKM has quit IRC14:35
sdagueandreaf: https://bugs.launchpad.net/tempest/+bug/1218475 - that still an issue14:36
sdaguerahmu: if you have a patch, that's fine. It's not something that the team is going to spend time on, which is why I put it in won't fix14:37
openstackgerritandrea-frittoli proposed a change to openstack/tempest: Input scenario capability for tempest  https://review.openstack.org/6043414:38
rahmusdague: fair enough14:38
afazekashttps://bugs.launchpad.net/tempest/+bug/1253828 is it fixed now ?14:43
afazekasduplicate of https://bugs.launchpad.net/nova/+bug/125192014:45
ken1ohmichiafazekas: I think so.14:46
afazekasken1ohmichi: I checked the code in the master it LGTM14:47
openstackrecheckopenstack/neutron change: https://review.openstack.org/60825 failed tempest because of: https://bugs.launchpad.net/bugs/125389614:47
openstackrecheckopenstack/tempest change: https://review.openstack.org/60776 failed tempest because of: https://bugs.launchpad.net/bugs/125389614:48
sdaguedkranz: https://bugs.launchpad.net/tempest/+bug/1258601 you collecting errors some where?14:48
*** prekarat has quit IRC14:49
openstackrecheckopenstack/swift change: https://review.openstack.org/61650 failed tempest with an unrecognized error14:49
dimsjog0, sdague -  i wanted to try logstash-cli, does anyone know if elasticsearch.openstack.org:9200 is correct url to use? (param in CLI shows "[--esurl=ESURL]  # URL to connect to elasticsearch")14:49
dkranzsdague: No14:49
dkranzsdague: The whitelist is the set of errors14:50
dkranzsdague: Not sure what you mean exactly14:50
sdaguedkranz: so open bugs are only useful if someone is doing something with them14:50
sdagueso if you were tracking error lists as bugs, we should tag them14:50
sdagueotherwise we should mark invalid and move on14:51
mriedemsdague: i think https://bugs.launchpad.net/tempest/+bug/1258601 is a dupe14:51
mriedemlooking14:51
*** psharma has quit IRC14:51
dkranzsdague: That ticket is incomplete because it does not have a pointer to the log14:52
dkranzsdague: It would be a nova bug, not tempest14:52
dkranzsdague: It would be resolved by stopping the message or updating the whitelist14:52
dkranzsdague: But I don't think we should track updating the whitelist through tempest bugs because they are not tempest bugs14:53
dkranzsdague: I will edit the ticket14:53
sdaguedkranz: great14:54
afazekashttps://bugs.launchpad.net/tempest/+bug/125259414:54
afazekasI saw multiple issues when tempest sends the requests,  it reaches the n-cpu but nothing happens..14:55
sdagueafazekas: so honestly any bug that is just a stack trace dump with no context I am closing as invalid with "not useful enough to be a bug"14:55
afazekassdague: ok, we have multiple similar action send --> nothing happened bugs anyways14:56
*** malini has joined #openstack-qa14:56
*** jecarey has joined #openstack-qa14:58
*** bill_az has joined #openstack-qa14:59
mriedemdkranz: i marked that nova vif doen't exist but as a duplicate15:04
mriedemi'm finding a lot of duplicate bugs lately15:04
mriedemnot sure if people are having a hard time using the search box in launchpad or what15:04
openstackrecheckopenstack/glance change: https://review.openstack.org/60333 failed tempest because of: https://bugs.launchpad.net/bugs/125389615:04
ken1ohmichihi, I'm trying https://bugs.launchpad.net/tempest/+bug/125389615:06
dkranzmriedem: ok, thanks. Given that the ticket didn't even have a pointer to the log I would say it is a desire to move on as quickly as possible15:06
dkranzmriedem: Which is unfortunate15:06
ken1ohmichican we know this bug in TestVolumeBootPattern or not?15:06
mriedemis today qa bug squashing day or something?15:07
ken1ohmichimeaning this bug happens in test TestVolumeBootPattern or not?15:08
afazekashttps://bugs.launchpad.net/tempest/+bug/1253896 can may be related to some metadata query issue, may be we should log the vm's console output on every ssh failure15:09
openstackrecheckopenstack/neutron change: https://review.openstack.org/53821 failed tempest because of: https://bugs.launchpad.net/bugs/125389615:10
openstackrecheckopenstack/nova change: https://review.openstack.org/56420 failed tempest with an unrecognized error15:12
*** abramley has joined #openstack-qa15:12
openstackrecheckopenstack/python-glanceclient change: https://review.openstack.org/61109 failed tempest with an unrecognized error15:13
openstackgerritMatt Riedemann proposed a change to openstack/tempest: Wait for backup images to be ACTIVE in test_create_backup  https://review.openstack.org/6164715:17
openstackrecheckopenstack/horizon change: https://review.openstack.org/59617 failed tempest with an unrecognized error15:17
openstackrecheckopenstack/tempest change: https://review.openstack.org/59907 failed tempest with an unrecognized error15:17
openstackrecheckopenstack/tempest change: https://review.openstack.org/61625 failed tempest with an unrecognized error15:18
*** ken1ohmichi has quit IRC15:18
mtreinishsdague: I don't know I can't remember, let me check15:18
openstackrecheckopenstack/tempest change: https://review.openstack.org/61748 failed tempest because of: https://bugs.launchpad.net/bugs/125389615:19
openstackrecheckopenstack/heat change: https://review.openstack.org/61447 failed tempest because of: https://bugs.launchpad.net/bugs/1257626 and https://bugs.launchpad.net/bugs/125389615:19
afazekaswhat is the recommended priority for this bug  https://bugs.launchpad.net/tempest/+bug/1231152 ?15:21
mtreinishsdague: no it looks like I never did fix it, I'll take care of that now15:24
openstackrecheckopenstack/horizon change: https://review.openstack.org/59580 failed tempest because of: https://bugs.launchpad.net/bugs/125389615:24
sdagueafazekas: I'd say low15:24
sdagueis that really a tempest issue though?15:24
sdagueit seems like it's just config setup15:24
openstackgerritIvan-Zhu proposed a change to openstack/tempest: port some flavor tests into nova v3 part2  https://review.openstack.org/5993915:25
*** jgrimm has joined #openstack-qa15:25
dkranzJust started getting these "The handshake operation timed out" but flaky15:25
afazekassdague: I guess with several network device it is solved in a different way15:25
dkranzLike in both failures here https://review.openstack.org/#/c/61625/115:25
sdaguedkranz: getting it with what?15:26
dkranzsdague: 2 out of the 3 tempest runs for that patch15:26
maurosrsdague: I don't think this should be confirmed https://bugs.launchpad.net/tempest/+bug/1215886 take a look in  http://paste.openstack.org/show/54900/15:26
sdaguedkranz: please register as a critical openstack-ci bug15:26
maurosrcan I change it to invalid?15:27
dkranzsdague: yes, just making sure it was not known15:27
sdaguemaurosr: yep, sounds good15:27
sdaguemaurosr: thanks for diving in15:27
maurosrnp15:27
maurosrwas doing it before lunch and forgot to submit15:27
afazekaspriolity? https://bugs.launchpad.net/tempest/+bug/125069615:29
openstackrecheckopenstack/tempest change: https://review.openstack.org/55276 failed tempest with an unrecognized error15:32
*** BobBall has joined #openstack-qa15:35
openstackrecheckopenstack/horizon change: https://review.openstack.org/59624 failed tempest because of: https://bugs.launchpad.net/bugs/125389615:38
openstackgerritSean Dague proposed a change to openstack/tempest: unskip bug #1240694  https://review.openstack.org/6177815:40
sdagueafazekas: I just set it to low15:42
openstackgerritSean Dague proposed a change to openstack/tempest: unskip bug #1240694  https://review.openstack.org/6177815:44
openstackgerritSean Dague proposed a change to openstack/tempest: unskip multibyte test  https://review.openstack.org/6174715:45
openstackrecheckopenstack/python-neutronclient change: https://review.openstack.org/61508 failed tempest because of: https://bugs.launchpad.net/bugs/125762615:45
openstackgerritSean Dague proposed a change to openstack/tempest: unskip bug #1240694  https://review.openstack.org/6177815:46
openstackrecheckopenstack/keystone change: https://review.openstack.org/60244 failed tempest because of: https://bugs.launchpad.net/bugs/125389615:50
*** Flying_Bond has joined #openstack-qa15:52
openstackgerritSean Dague proposed a change to openstack/tempest: unskip multibyte test  https://review.openstack.org/6174715:52
*** Flying_Bond has joined #openstack-qa15:53
*** Flying_Bond has joined #openstack-qa15:54
*** Flying_Bond has quit IRC15:54
andreafsdague: yes I think so15:58
sdagueandreaf: can you take some time today to do some confirms on your bugs during triage? there are a bunch filed from over the summer some of which I think are addressed in current code base15:59
*** SushilKM has joined #openstack-qa15:59
openstackrecheckopenstack/glance change: https://review.openstack.org/52409 failed tempest because of: https://bugs.launchpad.net/bugs/125389616:02
openstackrecheckopenstack/horizon change: https://review.openstack.org/61754 failed tempest because of: https://bugs.launchpad.net/bugs/125389616:02
openstackrecheckopenstack/cinder change: https://review.openstack.org/60715 failed tempest because of: https://bugs.launchpad.net/bugs/125389616:02
*** adalbas has joined #openstack-qa16:04
openstackrecheckopenstack/heat change: https://review.openstack.org/61035 failed tempest because of: https://bugs.launchpad.net/bugs/125389616:05
openstackrecheckopenstack/heat change: https://review.openstack.org/61036 failed tempest because of: https://bugs.launchpad.net/bugs/125389616:05
openstackrecheckopenstack/swift change: https://review.openstack.org/61714 failed tempest with an unrecognized error16:06
openstackrecheckopenstack/cinder change: https://review.openstack.org/58344 failed tempest with an unrecognized error16:06
jeblairsdague, dtroyer_zz: do you know if anyone is using the mysql query log?16:08
jeblairsdague, dtroyer_zz: because devstack is set to configure mysql to log every query16:08
openstackgerritMauro S. M. Rodrigues proposed a change to openstack-dev/grenade: Add heat-upgrade file  https://review.openstack.org/6079416:09
andreafsdague: ok16:09
*** mlavalle has joined #openstack-qa16:09
sdaguejeblair: we were told people wanted it16:09
jeblairsdague, dtroyer_zz: currently a full tempest run generates 608M of _compressed_ log files; 324M of that is the mysql query log16:09
openstackrecheckopenstack/nova change: https://review.openstack.org/47788 failed tempest because of: https://bugs.launchpad.net/bugs/125762616:09
sdagueI supose we could turn it off for now16:10
jeblairsdague: at least as a first step, we could stop collecting it on logs.o.o and see if anyone yells.16:11
jeblairbut i also mention it because i'm not sure of the performance impact of logging every query.  it's probably not a lot, but i don't know.  :)16:11
*** BobBall has left #openstack-qa16:12
jeblairmordred: ^ maybe you know?16:12
openstackrecheckopenstack/nova change: https://review.openstack.org/61028 failed tempest because of: https://bugs.launchpad.net/bugs/125016816:12
sdaguejeblair: I expect not much16:14
mtreinishjeblair: I know markwash and some of the glance devs like logging every query. I get pushback everytime I try to change the config settings around sqlalchemy debug logging.16:15
*** markmcclain has joined #openstack-qa16:16
andreafsdague: I have  a fix for some of them - for 1187737 and 1250809 what I do is to monkey patch the official client and do retries in case of rate limiting - would you be interested in that? It's not something for gate, as we do have tenant isolation on there, but still it is a good feature to have I think16:16
openstackrecheckopenstack/tempest change: https://review.openstack.org/59029 failed tempest because of: https://bugs.launchpad.net/bugs/125144816:17
*** Flying_Bond has joined #openstack-qa16:18
openstackrecheckopenstack/glance change: https://review.openstack.org/59227 failed tempest because of: https://bugs.launchpad.net/bugs/125389616:18
openstackrecheckopenstack/nova change: https://review.openstack.org/55749 failed tempest because of: https://bugs.launchpad.net/bugs/125389616:19
maurosrsdague: why this become invalid on grenade? https://bugs.launchpad.net/bugs/1023131 (run tempest scenarios instead of exercices)16:20
Flying_BondI did a new check in tempest and 3 tests failed..unable to debug by seeing the logs..can someone help how to see the logs pf the tests16:20
*** BobBall has joined #openstack-qa16:21
*** SergeyLukjanov has quit IRC16:21
mtreinishsdague: on that same bug as maurosr pointed out, we still don't have exquiv. scenarios as the exercises, we're almost there16:21
mtreinishso I'm reopening it16:22
*** mrodden has joined #openstack-qa16:22
* mtreinish wonders what exquiv. is an abbreviation for16:22
openstackgerritIvan-Zhu proposed a change to openstack/tempest: add both v2 and v3 tests for get specified extension  https://review.openstack.org/5688016:23
sdaguemtreinish: so if you are reopenning it, you need to specify exactly what is needed16:23
sdagueto make it closable16:23
sdaguebecause that ones been hanging out for a long time with "oh, we need to do more"16:23
sdaguewhich doesn't make it a useful artifact16:23
maurosrsdague, mtreinish I can submit what we're missing (swift and aggregates) today16:23
mtreinishmaurosr: it was just the swift and aggregates right?16:23
sdagueok, still write it down into the bug :)16:24
*** yfried has quit IRC16:24
maurosrmtreinish: ^ I do it16:24
mtreinishsdague: I am right now16:24
sdaguedkranz: so you finding this useful for tracking - https://bugs.launchpad.net/tempest/+bug/1229949 or now that we're in the white list we close those?16:24
*** SushilKM has quit IRC16:25
openstackrecheckopenstack/swift change: https://review.openstack.org/61722 failed tempest because of: https://bugs.launchpad.net/bugs/125389616:25
*** SushilKM has joined #openstack-qa16:26
dkranzsdague: Let me check16:26
dkranzsdague: Actually that bug refers to the tempest log which is completely different.16:28
sdaguedkranz: so unless a bug is actionable, I'm not convinced it's useful.16:28
sdagueespecially when it's something that's testable with grep16:29
dkranzsdague: It is actionable. We need to fix tempest. I'll check if it is still there.16:29
*** adalbafk has quit IRC16:29
mtreinishdkranz, sdague: that's been bugging me for a while now16:29
mtreinishdkranz: it is16:29
mordredjeblair: the general query log can have a performance impact16:29
mordredjeblair: the slow query log usually not16:29
*** acfleury has joined #openstack-qa16:30
dkranzmtreinish: I think this is a legitimate, Confirmed, tempest bug16:30
dkranzmtreinish: Maybe afazekas can look at it since he did the boto stuff16:30
mtreinishdkranz: yeah I was just going to confirm it and assign it to him :)16:31
dkranzmtreinish: :)16:31
jeblairmordred: the way this is set up is that the slow query log is set to 0s16:31
sdaguedkranz: so for things like that in the future, please only add if you also have: 1) a volunteer to assign to. 2) enough details that it could be marked low-hanging-fruit16:32
*** acfleury has quit IRC16:32
*** adalbas has quit IRC16:32
dkranzsdague: I'm not sure what you mean16:32
sdagueI think the tempest core team is as guilty as anyone else of just registering drive by bugs which then make everyone loath to go in there16:32
*** adalbas has joined #openstack-qa16:32
dkranzsdague: How is this a drive-by bug?16:33
dkranzsdague: Are you saying we should not file bugs unless we assign some one?16:33
sdagueregistered 90 days ago, no one looked at it, not enough details for a new person to pick it up16:33
*** markmcclain has quit IRC16:33
dkranzsdague: That was a bad bug report by me with insufficient detail16:33
andreafsdague: I went through all the bugs I filed, and they seem all still valid16:34
afazekasdkranz: ok, I will try figure out how to work 72h / day :)16:34
sdaguedkranz: right, which is why I said either #1 and #216:34
*** Flying_Bond has quit IRC16:34
sdagueit can be short if it has an assignee that is running at it and understands it16:34
sdaguebut if not, it needs to be triaged to the point where someone could pick it up off the low-hanging-fruit tag16:35
sdaguebecause otherwise it's not ever going to move forward16:35
dkranzsdague: That would mean putting higher priority on bug investigation and less on code submission and reviews16:35
dkranzsdague: Which I guess is ok but not something we have been doing. Obviously.16:36
sdaguesure. But otherwise it's just generating more overhead for down the road.16:36
sdagueregistering bad bugs is adding debt16:36
dkranzsdague: That bug report is bad, mea culpa.16:37
sdagueso we, as the core team, shouldn't be adding debt :)16:37
*** rdekel has quit IRC16:37
dkranzsdague: But in general, IMO, we should have tickets for bugs even if we don't know how to fix them right now16:37
sdagueyep, just trying to come up with thoughts on how we make the bug list useful in the future, and that pattern seems to have come up16:37
sdaguedkranz: I'm not always convinced16:38
sdaguebecause then we end up in this situation where the bug wasn't clear enough, not assigned, someone else fixed it and didn't ever see the bug16:38
sdaguethen it's debt to clean it up16:38
dkranzsdague: At a minimum it prevents new duplicate bugs from showing up16:38
sdaguedkranz: it really doesn't16:38
dkranzsdague: I think what we need is to be more aggressive about handling new bugs16:39
sdagueit only does if the bug list is < 10016:39
sdagueso yuo can keep it in your head16:39
sdaguewith a large bug list, filing bugs without enough details only spirals us out16:39
dkranzsdague: No, when I file a bug it tells me if there is another one like it. Regardless of how many there are.16:39
sdagueonly if it matches well16:39
dkranzsdague: I will fix that ticket.16:40
openstackrecheckopenstack/cinder change: https://review.openstack.org/59967 failed tempest with an unrecognized error16:40
*** Flying_Bond has joined #openstack-qa16:41
sdagueafazekas: https://bugs.launchpad.net/tempest/+bug/1224518 can you actually file an er patch on that and remove it from tempest? I don't think it's actually a tempest bug.16:42
afazekas' er patch' ?  skip ?16:44
mtreinishafazekas: elastic recheck16:44
afazekas:)16:44
afazekasok16:45
openstackgerritRossella Sblendido proposed a change to openstack/tempest: Serialize plurals correctly in neutron xml client  https://review.openstack.org/5902916:45
sdaguedkranz: the fact that I'm merging 8 duplicate bugs for the rescue test case means "finding duplicates" is apparently not really useful16:47
openstackrecheckopenstack/nova change: https://review.openstack.org/61544 failed tempest because of: https://bugs.launchpad.net/bugs/125389616:49
openstackgerritafazekas proposed a change to openstack-infra/elastic-recheck: Machine remins in HARD_REBOOT status  https://review.openstack.org/6181516:49
*** ekarlso has quit IRC16:50
dkranzsdague: Nova has more than 1100 bugs16:50
dkranzsdague: I am just saying we should not close real bugs just because no is investigating them16:51
dkranzsdague: At least that is not how any thing I have worked on has managed bugs16:51
dkranzsdague: If more info is needed the bug should be Incomplete and ignored until it is otherwise16:51
dkranzsdague: IMO16:51
*** ekarlso has joined #openstack-qa16:51
sdaguewell that's easy, because they are all being ignored :)16:51
dkranzsdague: Yes, and I think it would be better to discuss that, which is the real issue here16:52
sdagueright that's fair, let's put it on the agenda for today16:52
dkranzsdague: Good meeting topic16:52
dkranzsdague: :)16:52
sdagueI come down on the extra pragmatic side of this. If the tracker isn't being used, it's not useful to have stuff in it16:53
dkranzsdague: I'll add it16:53
sdagueso first purge like mad to make it so everything in it is useful16:53
mtreinishsdague: why do you think I don't submit many tempest bugs :)16:53
sdagueget people using it16:53
sdaguemtreinish: I found plenty of your bugs in there :)16:53
sdagueeven recent ones16:53
dkranzsdague: I don't disagree with that as a transient16:53
sdaguethat were just hanging out16:53
mtreinishsdague: submitted by me? really?16:53
dkranzsdague: Our current methodology is "doesn't break gate" == "not important"16:54
sdaguemtreinish: yep16:55
sdaguedkranz: so this bug is a good example - https://bugs.launchpad.net/tempest/+bug/124291616:55
sdaguewhy did yuo make it a tempest bug?16:55
mtreinishsdague: ok, because I only counted 316:56
sdaguemtreinish: maybe I kept hitting them :)16:56
giulivosdague, dkranz sorry for stopping you on the "ignored" bugs thing but I feel we need to think about how to track new tests, blueprints aren't good for the purpose I think, but neither are bugs16:56
sdaguedkranz: well until we can get that under control, we need to not be boiling the ocean with everything else. Big backlogs are dept16:56
sdaguegiulivo: 100% agree16:57
sdaguehonestly, I think we're hanging our hopes on storyboard16:57
sdaguebut that means no good answer this cycle16:57
giulivo we maybe can start by just asking people not to open blueprints nor bugs for new tests ... and close accordignly16:57
openstackrecheckopenstack/tempest change: https://review.openstack.org/61647 failed tempest because of: https://bugs.launchpad.net/bugs/125389616:58
dkranzsdague: Re 1242916, that was a mistake as I was filing bugs like crazy trying to shut down the whitelist.16:58
sdagueok16:58
dkranzhaste makes waste BUT time is of the essence16:58
malinigiulivo: are you suggesting a freeze for new tests for tempest?16:58
sdagueafazekas: https://bugs.launchpad.net/tempest/+bug/1181947 that get fixed16:58
sdaguedkranz: well, it makes debt16:59
sdagueand it's not clear for what gane :)16:59
giulivomalini, no not at all, just not to use bugs or bps to track new tests16:59
sdaguemalini: right, this is just a tracking question16:59
malinithanks giulivo, sdague..I am working on marconi tests & tempest integration is one of our grad reqs..So got me concerned17:00
afazekassdague: AFAIK yes17:00
openstackgerritJames E. Blair proposed a change to openstack-infra/devstack-gate: Don't save mysql logs  https://review.openstack.org/6182017:00
dkranzFlying_Bond: Your question doesn't have enough info. Where it the patch/log to which you are referring?17:00
sdagueafazekas: can you confirm17:00
giulivomalini, so for new components you have to add the service client and maybe make changes to devstack so a blueprint would work... but not when on the point of adding more tests to the existing marconi suite17:01
afazekassdague: actually a default quota set is in the config file, and we do not change it at the api17:02
afazekasI set it to invalid17:03
malinigiulivo: I added a new bp y'day for adding marconi to tempest. So I am going to just keep it there17:03
sdagueafazekas: great17:03
giulivomalini, yes I think that would make sense17:03
*** safchain has quit IRC17:03
afazekasToday I cannot attend the meeting, and I have to leave now..17:05
afazekasLive long and prosper17:05
openstackrecheckopenstack/heat change: https://review.openstack.org/58043 failed tempest with an unrecognized error17:06
*** jhenner has quit IRC17:06
*** klrmn has left #openstack-qa17:07
openstackrecheckopenstack/neutron change: https://review.openstack.org/61694 failed tempest because of: https://bugs.launchpad.net/bugs/1253896 and https://bugs.launchpad.net/bugs/122400117:09
adalbassdague, dkranz : i think one thing to help with new bugs is try to quickly for them. In this case, focus can also be set on the ones we believe it has a higher priority.17:09
openstackrecheckopenstack/heat change: https://review.openstack.org/61074 failed tempest because of: https://bugs.launchpad.net/bugs/125389617:09
openstackrecheckopenstack/tempest change: https://review.openstack.org/59939 failed tempest with an unrecognized error17:09
adalbasanother suggestion is to get the owners more responsible about the bugs they open17:09
*** afazekas has quit IRC17:10
openstackrecheckopenstack/tempest change: https://review.openstack.org/61747 failed tempest with an unrecognized error17:10
sdagueadalbas: right, we need to get the bug list small enough that we can manage the inflow17:10
Flying_Bonddkranz: could you have look at this https://review.openstack.org/#/c/61727/17:10
dkranzsdague: agreed17:10
openstackrecheckopenstack/horizon change: https://review.openstack.org/61208 failed tempest because of: https://bugs.launchpad.net/bugs/125389617:10
sdagueportante: so I've been going through yuor bugs, you file a lot of things against tempest which aren't tempest bugs. Like https://bugs.launchpad.net/tempest/+bug/1258330. Please stop. :)17:11
dtroyer_zzsdague: s/tempest/devtack/g also...17:11
roaetis there a way to find out if anyone else is having an issue with devstack? I checked launchpad's bugs, and zuul, and jenkins for : sqlalchemy.exc.ProgrammingError: (ProgrammingError) (1146, "Table 'neutron_ml2.agents' doesn't exist") 'ALTER TABLE agents ADD CONSTRAINT uniq_agents0agent_type0host UNIQUE (agent_type, host)' () during migration17:12
*** mkollaro has quit IRC17:12
*** amotoki has joined #openstack-qa17:13
dkranzFlying_Bond: This seems like some infrastructure problem but I am doing bug triage and don't have time to look more.17:14
openstackgerritMatt Riedemann proposed a change to openstack-infra/elastic-recheck: Add e-r query for bug 1259907  https://review.openstack.org/6182617:14
*** SergeyLukjanov has joined #openstack-qa17:14
dkranzFlying_Bond: If no one can help you do "recheck no bug" as a last resort17:14
dkranzFlying_Bond: But please don't do that unless you have exhuasted other options17:15
*** yfried has joined #openstack-qa17:16
Flying_Bonddkranz: Thank you17:18
Flying_Bonddkranz: could you also look into the blueprint https://blueprints.launchpad.net/tempest/+spec/add-python-troveclient-tests and approve it17:18
mriedemFlying_Bond: import errors\'tempest.cli.simple_read_only.test_trove [M\xea', stderr=None17:19
openstackrecheckopenstack/heat change: https://review.openstack.org/61786 failed tempest because of: https://bugs.launchpad.net/bugs/125389617:19
mriedemFlying_Bond: go to the console.html and search for 'trove' and work backwards, note the last occurrence is hte fail17:19
mriedemlooks like code issues17:19
openstackrecheckopenstack/nova change: https://review.openstack.org/60286 failed tempest with an unrecognized error17:21
Flying_Bondmriedem: Thanks for helping... I am gonna have a look in to it17:21
*** srao has joined #openstack-qa17:25
*** Flying_Bond has quit IRC17:28
*** jaypipes has quit IRC17:28
openstackrecheckopenstack/heat change: https://review.openstack.org/61793 failed tempest because of: https://bugs.launchpad.net/bugs/125389617:30
adalbasmaurosr, is this still a valid bug: https://bugs.launchpad.net/tempest/+bug/1089579 ?17:33
maurosradalbas: don't know, need to check server actions tests17:34
*** Flying_Bond has joined #openstack-qa17:34
maurosrI will take care of it anyway17:34
adalbasmaurosr, if you think you should still work with it, i ll change it to in progress.17:35
mriedemdoes anyone else think it might be time to move this into it's own child page?17:37
mriedemhttps://wiki.openstack.org/wiki/GerritJenkinsGit#Test_Failures17:37
mriedemi'd like to start documenting some notes on the process that jog0 touched on for when gate fails happen17:37
maurosri will look into it later, busy with another test right now17:37
mriedemi.e. identify if there is a bug, write an e-r query, etc etc17:37
mriedemi don't think most people know how to use logstash or write the e-r queries, which is pretty easy once you know how17:38
mriedemmtreinish: jog0: sdague: ^?17:38
*** aveiga has joined #openstack-qa17:39
adalbasdkranz, do you think this bug could be marked in progress https://bugs.launchpad.net/tempest/+bug/1229949 ?17:40
dkranzadalbas: Not unless some one is actively working on it.17:41
giulivoso the meeting today is at 22 UTC next at 17 UTC, correct?17:41
*** hemnafk is now known as hemna17:41
adalbasdkranz, i'm asking because i see afazekas is assigned to it.17:41
dkranzadalbas: Usually In Progress is set by some one trying to fix it, either manually changing the ticket, or proposing a patch that references the bug.17:41
*** klrmn has joined #openstack-qa17:42
dkranzadalbas: I would expect bug assignees to set In Progress when they start working on it.17:42
adalbasdkranz, ok, so it s ok to leave it confirmed and with someone assigned to it, is that it?17:42
dkranzadalbas: I don't know if we have a policy on that or have ever discussed it.17:42
*** amotoki has quit IRC17:42
Flying_Bonddkranz: could you pls approve the blueprint https://blueprints.launchpad.net/tempest/+spec/add-python-troveclient-tests17:43
adalbasdkranz, and about this one, https://bugs.launchpad.net/tempest/+bug/1250976, any ideas on the importance for it?17:43
dkranzadalbas: I just marked it as Invalid because the logs are gone and there it not enough info.17:46
adalbastks dkranz!17:46
dkranzFlying_Bond: ok17:47
*** dkranz is now known as dkranz_at_lunch17:48
Flying_Bonddkranz: Thanks17:48
*** yfried has quit IRC17:51
malinisdague: I would like to get this bp approved https://blueprints.launchpad.net/tempest/+spec/add-basic-marconi-tests17:52
openstackgerritJakub Libosvar proposed a change to openstack-dev/grenade: Support for upgrading neutron  https://review.openstack.org/5869517:52
*** rossella_s has quit IRC17:52
*** jpich has quit IRC17:54
adalbassdague, this looks like invalid (and old) now: https://bugs.launchpad.net/tempest/+bug/117138317:57
openstackgerritandrea-frittoli proposed a change to openstack/tempest: Input scenario capability for tempest  https://review.openstack.org/6043417:57
*** yassine has quit IRC17:58
mriedemstarted a page here: https://wiki.openstack.org/wiki/ElasticRecheck17:58
openstackrecheckopenstack/heat change: https://review.openstack.org/61813 failed tempest because of: https://bugs.launchpad.net/bugs/125389618:01
openstackgerritEvgeny Fedoruk proposed a change to openstack/tempest: Extending quota support for neutron LBaaS entities  https://review.openstack.org/6000818:04
openstackrecheckopenstack/heat change: https://review.openstack.org/61816 failed tempest with an unrecognized error18:04
openstackrecheckopenstack/nova change: https://review.openstack.org/37907 failed tempest because of: https://bugs.launchpad.net/bugs/125389618:06
openstackrecheckopenstack/tempest change: https://review.openstack.org/59029 failed tempest because of: https://bugs.launchpad.net/bugs/125389618:06
openstackrecheckopenstack/neutron change: https://review.openstack.org/59858 failed tempest because of: https://bugs.launchpad.net/bugs/125389618:06
adalbasbugs moved to bp should be marked invalid? (see as an example: https://bugs.launchpad.net/tempest/+bug/1178200 )18:12
openstackrecheckopenstack/heat change: https://review.openstack.org/61818 failed tempest because of: https://bugs.launchpad.net/bugs/125389618:12
openstackrecheckopenstack/tempest change: https://review.openstack.org/61647 failed tempest because of: https://bugs.launchpad.net/bugs/125389618:14
openstackgerritandrea-frittoli proposed a change to openstack/tempest: Input scenario capability for tempest  https://review.openstack.org/6043418:14
*** andreaf has quit IRC18:19
*** salv-orlando has joined #openstack-qa18:27
*** dkranz_at_lunch is now known as dkranz18:30
*** bdperkin is now known as bdperkin_gone18:35
openstackrecheckopenstack/cinder change: https://review.openstack.org/60760 failed tempest because of: https://bugs.launchpad.net/bugs/125389618:36
*** bdperkin_gone has quit IRC18:40
*** Flying_Bond has quit IRC18:43
openstackrecheckopenstack-infra/devstack-gate change: https://review.openstack.org/55829 failed tempest because of: https://bugs.launchpad.net/bugs/125389618:45
*** Flying_Bond has joined #openstack-qa18:45
openstackrecheckopenstack/heat change: https://review.openstack.org/58043 failed tempest because of: https://bugs.launchpad.net/bugs/125389618:45
sdaguemalini: what's your milestone target?18:46
openstackrecheckopenstack/python-novaclient change: https://review.openstack.org/61648 failed tempest because of: https://bugs.launchpad.net/bugs/125389618:46
openstackgerritSean Dague proposed a change to openstack/tempest: unskip bug neutron cli skipped tests for metering  https://review.openstack.org/6177818:48
dkranzsdague: Trying to figure out what to do with these bug tickets with just a backtrace drives home the importance of not having bogus ERRORs in logs...18:48
dkranzsdague: Do you have advice with what to do with them?18:48
dkranzsdague: Like https://bugs.launchpad.net/tempest/+bug/125487518:49
adalbassalv-orlando, is this bug fixed: https://bugs.launchpad.net/tempest/+bug/1226158 ?18:49
dkranzsdague: logstash says it is still happening a lot but I have no clue. I could make it a nova bug but it would probably get ignored too18:49
dkranzsdague: I'll ask Russell18:50
sdaguedkranz: honestly, bugs with just backtraces I'm closing as invalid18:50
sdagueas there is nothing useful about them18:50
dkranzsdague: I was too, as you might have seem, but feel bad about it.18:50
salv-orlandoadalbas: one of yfried patches now addresses it18:51
sdaguewe have much better ways of tracking stack traces than laundpad18:51
salv-orlandowill add the link to the appropriate patch on the bug report, but it's still under review18:51
dkranzsdague: I suppose that once "reverify no bug" is prohibited they will come back anyway which may be a problem18:51
adalbassalv-orlando, tks!18:51
dkranzsdague: That is a real issue we need to deal with even if we think bugs are not the best way to track.18:51
sdaguedkranz: a recheck bug needs to have first level of debug in it18:52
clarkbdkranz: reverify no bug is prohibited now18:52
sdagueotherwise it's just debt18:52
openstackrecheckopenstack/cinder change: https://review.openstack.org/59967 failed tempest because of: https://bugs.launchpad.net/bugs/125389618:52
dkranzclarkb: ok. I'm just saying that this will force people to create bugs with just backtraces in response to reverify failure18:52
dkranzclarkb: Exactly the kinds of bugs we are closing now because they are of no help18:53
dkranzclarkb: And it is made worse because you can't scan the logs for ERRORs because there are all those whitelisted bogus ones18:54
clarkbdkranz: I understand. Just pointing out that the reverify no bug killing has happened18:54
dkranzclarkb: I think maybe we should change the log checker to dump bogus errors to the console when the job fails as well18:55
openstackgerritSean Dague proposed a change to openstack/tempest: unskip multibyte test  https://review.openstack.org/6174718:55
dkranzsdague: ^^^18:55
sdaguedkranz: I think dumping all the whitelisted ones is a good idea as well18:55
clarkbsdague: re 1253896 could the increase in occurence of that with neutron tests be related to metadata server vs config drive?18:56
sdagueclarkb: yes, it could18:56
dkranzsdague: The point was to make is so you could have not just a backtrace but any log errors.18:56
sdaguethough it happens on config drive versions as well18:56
dkranzsdague: But I could dump them all with a "****" or something around the non-whitelisted ones.18:56
dkranzsdague: I think I will do that.18:56
clarkbsdague: right and it started before we added metadata server back into the gate18:57
sdagueclarkb: yes18:57
sdagueit's mostly on neutron jobs, so I'd also look at other neutron changes18:57
sdagueor dig into the logs further18:57
openstackgerritMauro S. M. Rodrigues proposed a change to openstack/tempest: Add swift scenario tests  https://review.openstack.org/6184519:02
openstackgerritSean Dague proposed a change to openstack/tempest: unskip multibyte test  https://review.openstack.org/6174719:03
*** jgrimm has quit IRC19:03
malinisdague: sorry ..had stepped away19:05
maliniwe are tagetting marconi-tempest integration for icehouse19:05
*** Flying_Bond has quit IRC19:05
openstackgerritMatthew Treinish proposed a change to openstack/tempest: Only initialize the glance_http if service is enabled  https://review.openstack.org/6184619:07
sdaguemalini: which icehouse milestone?19:08
jog0sdague: how did your config drive change things, aka whats the patch #19:08
sdaguejog0: it's a d-g patch19:08
malinisdague: I know we have to be done with this by Feb 10th..But I dont know which milestone tht wud be :-$19:08
mtreinishsdague, dkranz: can I get a quick look at this: https://review.openstack.org/#/c/60619/ right now we're passing jobs that have import failures. :(19:08
jog0sdague: this is what I found https://review.openstack.org/#/c/59303/ but that doesn't show which is wich19:10
jog0which job uses what19:10
mtreinishmalini: after i-2 before i-3:  https://wiki.openstack.org/wiki/Icehouse_Release_Schedule19:11
malinithanks mtreinish..So that puts in i-3 . sdague^19:12
mtreinishjog0: http://git.openstack.org/cgit/openstack-infra/config/tree/modules/openstack_project/files/jenkins_job_builder/config/devstack-gate.yaml19:12
jog0mtreinish: thanks19:13
sdaguemalini: ok, please target it19:14
mriedemjog0: i didn't realize that fixing gate failure bugs is part of the process :)19:14
jog0mriedem: its the part we don't stress enough19:15
jog0turns out a lot of these bugs are strange19:15
mriedemjog0: yeah, figurd it was implied19:15
*** mlavalle has quit IRC19:15
mriedemand if they are marked critical than ttx will get on the PTLs about them19:15
jog0mriedem: thats another thing19:15
malinisdague: done..thank you!19:16
openstackrecheckopenstack/heat change: https://review.openstack.org/61834 failed tempest because of: https://bugs.launchpad.net/bugs/125389619:16
jog0we sould doc when t mark as critical19:16
mriedemjog0: do we have rules for when that is?19:17
jog0mtreinish sdague: I looked through openstack/openstack repo to see if anything popped out about the ssh bug19:17
jog0didn't see anything19:17
jog0mriedem: there was an email thread19:17
jog0with me markmc lifeless and others19:17
sdaguedoes that test have the "dump the world" network call on fail?19:17
jog0in short if its not in e-r don't make critical19:17
jog0sdague: ?19:18
adalbasmtreinish, i wont be able to attend the qa mtg today(night), but this link has enough info about what we accomplish today: https://etherpad.openstack.org/p/tempest-bug-triage19:19
openstackgerritDavid Kranz proposed a change to openstack-infra/devstack-gate: Always dump errors to console  https://review.openstack.org/6185019:19
mtreinishadalbas: ok19:19
adalbasmtreinish, i would say we got a very good progress. tks to all19:19
mtreinishjog0: which bug?19:23
lifelessjog0: you called?19:23
mriedemlifeless: not really, just talking about the ML thread on when to mark gate fail bugs as critical19:24
lifelessoh right19:24
mriedemi dug up the thread19:24
openstackrecheckopenstack/heat change: https://review.openstack.org/61828 failed tempest because of: https://bugs.launchpad.net/bugs/125389619:24
jog0mtreinish: 125389619:25
*** openstackrecheck has quit IRC19:26
*** openstackrecheck has joined #openstack-qa19:26
*** bdperkin_gone has joined #openstack-qa19:26
openstackgerritA change was merged to openstack-dev/devstack: Fix the amount of workers spawned for non proxies  https://review.openstack.org/6112219:29
mtreinishjog0: I remember a similar bug to that and I think marun suspected that the port wasn't get assigned to the right server.(or something like that) So when it tried to use the pubkey it wasn't the right key.19:30
jog0mtreinish: so many stacktraces in neutron19:31
*** bdperkin_gone has quit IRC19:32
*** dims has quit IRC19:33
openstackrecheckopenstack/tempest change: https://review.openstack.org/60008 failed tempest because of: https://bugs.launchpad.net/bugs/125389619:33
openstackrecheckopenstack/glance change: https://review.openstack.org/59689 failed tempest because of: https://bugs.launchpad.net/bugs/125389619:33
maurosrwhat to do with such kind of bug: https://bugs.launchpad.net/tempest/+bug/1236647 a trace, which kind of seems to be relevant, but the logs were deleted19:34
*** dims has joined #openstack-qa19:34
sdaguejog0: opinions here - https://review.openstack.org/#/c/56242/1 ?19:35
maurosrincomplete? invalid? people should at least point to the review in which it happened =S19:35
mtreinishmalini: the logs are still there, the path is just incomplete19:35
mtreinishmaurosr: ^^^19:35
mtreinishmalini: sorry19:35
mtreinishdrop the filename from the link19:35
mtreinishand you'll get the dir19:35
maurosrmtreinish: nice, didn't know about it hehe19:36
*** salv-orlando has quit IRC19:36
*** salv-orlando has joined #openstack-qa19:36
openstackrecheckopenstack/heat change: https://review.openstack.org/60607 failed tempest because of: https://bugs.launchpad.net/bugs/125389619:36
openstackgerritSean Dague proposed a change to openstack/tempest: Large Ops scenario: ensure proper timeout validation  https://review.openstack.org/5624219:36
sdaguemaurosr: if it's just a stack trace, close as invalid19:37
maurosrok sdague19:37
sdaguea stack trace with no context is completely useless19:37
sdagueand we have much better ways of tracking those19:38
maurosryup, in fact I do look at the logs to see what I can find there19:38
sdaguerealistically, that's a dupe of the critical bug19:38
sdaguemaurosr: https://bugs.launchpad.net/tempest/+bug/125389619:39
sdagueI just marked it as dupe19:39
maurosrsdague: great, thanks19:39
openstackrecheckopenstack/neutron change: https://review.openstack.org/58720 failed tempest because of: https://bugs.launchpad.net/bugs/125389619:39
openstackrecheckopenstack/heat change: https://review.openstack.org/61218 failed tempest because of: https://bugs.launchpad.net/bugs/125389619:39
openstackgerritBen Nemec proposed a change to openstack-dev/devstack: Ensure hostname resolves for rabbitmq  https://review.openstack.org/6185419:41
*** SushilKM__ has joined #openstack-qa19:44
*** SushilKM has quit IRC19:46
*** SergeyLukjanov has quit IRC19:46
clarkbsdague: for 1253896, do you think it might help if I told nodepool to hold a bunch of slaves in order to capture nodes where that is failing?19:47
clarkbwould need volunteers to go digging around on the slaves, but I would be happy to hold the nodes for that19:47
*** SergeyLukjanov_ has joined #openstack-qa19:47
*** SergeyLukjanov_ has quit IRC19:48
*** SergeyLukjanov has joined #openstack-qa19:48
openstackgerritDavanum Srinivas (dims) proposed a change to openstack-infra/elastic-recheck: Elastic Recheck should be a separate tab  https://review.openstack.org/6185719:48
openstackrecheckopenstack/cinder change: https://review.openstack.org/58344 failed tempest with an unrecognized error19:49
sdagueclarkb: if we had volunteers, sure19:51
clarkbif anyone wants to volunteer let me know :)19:52
mriedemjog0: clarkb: sdague: you guys ok with this? https://review.openstack.org/#/c/61826/19:54
openstackrecheckopenstack/python-ceilometerclient change: https://review.openstack.org/59089 failed tempest because of: https://bugs.launchpad.net/bugs/125389619:55
jog0mriedem: I would prefer notto use console.html if possible19:55
mriedemjog0: there weren't good alternatives19:55
mriedembut i know19:55
mriedemjog0: from what i could tell, the errors in the logs were also current whitelist errors and querying on those produced hits on successful biulds19:56
mriedem*builds19:56
sdaguemriedem: yes19:56
jog0mriedem: how does white listing change it19:56
mriedemso maybe i don't understand the whole white list concept then, but i thought that meant those are known errors in the logs that we basically ignore because they can show up on successful runs?19:57
jog0mriedem: derp yeah19:57
dkranzmriedem: yes19:57
mriedemcool19:57
jog0anyway it looks good19:57
mriedemi usually assume that any time i'm questioned about anything it means i don't know/understand :(19:58
dkranzmriedem: I just posted a patch to dump non-white-listed errors on failure to make it easier to find possible sources of failure19:58
mriedemdkranz: ok, cool19:58
mriedemdkranz: link?19:58
dkranzmriedem: https://review.openstack.org/#/c/61850/19:59
*** mlavalle has joined #openstack-qa19:59
mriedemdkranz: sweet, that's nice19:59
openstackrecheckopenstack/nova change: https://review.openstack.org/56287 failed tempest because of: https://bugs.launchpad.net/bugs/1258848 and https://bugs.launchpad.net/bugs/125389619:59
*** jlibosva has quit IRC19:59
mriedemnot to mention the ungodly load times on some of the logs, like n-cpu19:59
dimsjog0, do we have a chart for gate resets?19:59
openstackrecheckopenstack/nova change: https://review.openstack.org/37907 failed tempest because of: https://bugs.launchpad.net/bugs/125389619:59
jog0dims: no but I think notmyname may20:00
dkranzsdague, mtreinish : Appreciate eyes on https://review.openstack.org/#/c/61850/ when it gets the +1 from jenkins. I think this will be helpful.20:00
openstackrecheckopenstack/neutron change: https://review.openstack.org/59858 failed tempest with an unrecognized error20:00
openstackrecheckopenstack/nova change: https://review.openstack.org/58398 failed tempest because of: https://bugs.launchpad.net/bugs/125389620:00
jog0dims: jeblair may nw too20:02
openstackrecheckopenstack/heat change: https://review.openstack.org/61818 failed tempest because of: https://bugs.launchpad.net/bugs/125389620:03
sdaguejog0: is this now the master bug for the large_ops fails? - https://bugs.launchpad.net/tempest/+bug/1254890 or are you working on another one somewhere20:03
sdaguethat seems to have not much useful info in it20:04
jog0sdague: yeah that bug is very skimpy20:04
sdaguejog0: do you have a more favorite one?20:05
sdaguethere are a ton of dups on that20:05
jog0no20:05
sdagueok, well I declare that to be your favorite one now :)20:05
jog0I thought that one was on its way out20:05
jog0ohh dups not dumps20:06
jog0I think thats a sign I should be done for the day20:06
*** markmcclain has joined #openstack-qa20:07
openstackrecheckopenstack/oslo.messaging change: https://review.openstack.org/59713 failed tempest with an unrecognized error20:08
jog0btw clarkb +1 to keeping a node that hits 896 around to poke on it after20:10
openstackrecheckopenstack/neutron change: https://review.openstack.org/61761 failed tempest because of: https://bugs.launchpad.net/bugs/125389620:10
clarkbjog0: will you have time to look at the slave?20:10
jog0clarkb: nope!20:10
sdaguemriedem: can you build an e-r fingerprint for this - https://bugs.launchpad.net/tempest/+bug/124875720:10
jog0I just liked the idea20:10
sdagueas it's your bug20:10
openstackgerritJeremy Stanley proposed a change to openstack-infra/devstack-gate: Use a global pip.conf for tempest tox calls  https://review.openstack.org/6186120:10
clarkbjog0: ha, ok20:10
jog0also a neutron person needs to look at it i think20:10
sdaguethat's actually an interesting one because thats a new ssh error than I've seen20:11
*** dkorn has joined #openstack-qa20:11
sdaguewhere it gets to the server, then has it's link killed20:11
sdaguealso.... I don't think it's a tempest bug :)20:11
mriedemsdague: sure, will take a look20:11
openstackrecheckopenstack/python-novaclient change: https://review.openstack.org/61648 failed tempest with an unrecognized error20:11
mriedemsdague: it has to be tempest or infra, there is no possible way the actual project code could cause problems :)20:11
openstackrecheckopenstack/heat change: https://review.openstack.org/58043 failed tempest with an unrecognized error20:11
openstackrecheckopenstack/tempest change: https://review.openstack.org/61778 failed tempest with an unrecognized error20:11
*** rfolco has quit IRC20:12
mriedemwill look once i can figure out why sqlalchemy-migrate can't create check constraints with db2...20:12
openstackrecheckopenstack/neutron change: https://review.openstack.org/37893 failed tempest because of: https://bugs.launchpad.net/bugs/125389620:12
openstackgerritA change was merged to openstack-infra/elastic-recheck: Add e-r query for bug 1259907  https://review.openstack.org/6182620:14
openstackrecheckopenstack/oslo.messaging change: https://review.openstack.org/59714 failed tempest with an unrecognized error20:15
*** gszasz has quit IRC20:16
openstackrecheckopenstack/oslo.messaging change: https://review.openstack.org/61674 failed tempest because of: https://bugs.launchpad.net/bugs/121048320:16
*** bdperkin_gone has joined #openstack-qa20:17
*** openstackrecheck has quit IRC20:17
*** openstackrecheck has joined #openstack-qa20:18
*** bdperkin_gone is now known as bdperkin20:18
*** bdperkin has quit IRC20:18
*** bdperkin has joined #openstack-qa20:18
*** yfried has joined #openstack-qa20:20
openstackgerritJeremy Stanley proposed a change to openstack-infra/devstack-gate: Use a global pip.conf for tempest tox calls  https://review.openstack.org/6186120:29
clarkbmriedem: https://review.openstack.org/#/c/61298/3 btw20:32
*** krtaylor has quit IRC20:32
clarkbmriedem: trying to beef up the documentation in e-r and jog0 would prefer it to be in tree (I wrote that several days ago, going to address the -1 and hopefully we can merge that and start adding to it)20:32
mriedemclarkb: yeah, jog0 corrected me in the ML20:32
mriedemi blame him for not being in here earlier when i was asking about documentation for e-r :)20:32
openstackrecheckopenstack/python-neutronclient change: https://review.openstack.org/61561 failed tempest with an unrecognized error20:33
clarkb:020:33
clarkber :)20:33
*** SushilKM__ has quit IRC20:33
openstackgerritClark Boylan proposed a change to openstack-infra/elastic-recheck: Document adding bug signatures to e-r.  https://review.openstack.org/6129820:34
clarkbmriedem: jog0 ^20:34
openstackrecheckopenstack/ceilometer change: https://review.openstack.org/61847 failed tempest with an unrecognized error20:36
mtreinishclarkb: +2 I was fine with the typo too though :)20:36
portantesdague: regarding filing bugs against tempest, how do I know where they should be filed?20:37
openstackgerritSean Dague proposed a change to openstack-infra/elastic-recheck: add bug for pypi timeout hitting infra  https://review.openstack.org/6186620:37
portantea check or gate job fails, so instead of recheck no bug, I try to record what happened and recheck against a filed bug (checking of course to see if it has already occurred and a bug is on file)20:38
portanteas a developer, how do we know what to file it against?20:38
openstackrecheckopenstack/tempest change: https://review.openstack.org/61846 failed tempest because of: https://bugs.launchpad.net/bugs/125389620:38
openstackrecheckopenstack/heat change: https://review.openstack.org/61793 failed tempest with an unrecognized error20:39
sdagueportante: you should try to file against the component where the bug is20:39
portantebut how do I know that? is there an easy way to tell?20:40
sdagueso unless you have good evidence that it's a bug in tempest, i.e. tempest is wrong20:40
sdaguethen file it against the component that failed during the test20:40
portanteagain, how do I know what component failed during test?20:40
portanteis it always inthe test name or something?20:40
openstackgerritA change was merged to openstack-infra/elastic-recheck: add bug for pypi timeout hitting infra  https://review.openstack.org/6186620:41
sdagueportante: if you are having a hard time identifying it, come in here, and people will help20:41
*** malini is now known as malini_afk20:41
portantesdague: that is really time consuming20:41
portantemost developers are not going to do that20:41
openstackrecheckopenstack/nova change: https://review.openstack.org/61794 failed tempest because of: https://bugs.launchpad.net/bugs/125389620:41
portantethey'll just recheck no bug20:41
portantewhich is a real shame20:41
portantehaving clarity for the component that failed seems kinda important20:42
sdagueportante: so is having to go through and figure out that your bugs are in no way related to tempest20:42
portantesorry, if we had clarity on the component that probably would not happen20:43
openstackrecheckopenstack/heat change: https://review.openstack.org/61813 failed tempest because of: https://bugs.launchpad.net/bugs/125389620:43
dkranzsdague: Do you have +2 on devstack-gate? https://review.openstack.org/#/c/61543/20:43
openstackrecheckopenstack/heat change: https://review.openstack.org/61783 failed tempest because of: https://bugs.launchpad.net/bugs/125389620:43
sdaguedkranz: I do not20:43
dkranzsdague: ok, I'll try in infra20:43
mriedemportante: the tempest tests that fail are broken down by project20:44
mriedeme.g. tempest.api.compute20:44
mriedemtempest.api.volume20:44
portanteso compute means nova/+filebug20:44
portantevolume means cinder/+filebug?20:44
portanteis there a direct mapping that is simple?20:44
mriedemyes20:44
portantehow will new people come into contribute to openstack find that mapping?20:44
mriedemthe scenario ones are a bit trickier since they cover multiple projects20:44
mtreinishmriedem: they have service tags to help with that20:45
mriedemportante: it's in the test path that fails20:45
mtreinisheach test specifies which service it hits20:45
mtreinishand it's put at the end of the test id20:45
portantebut is it easy to map that stuff to an actual link to file bugs?20:45
portanteor do I have to "know" something more to report it?20:45
mriedemportante: e.g. FAIL: tempest.scenario.test_snapshot_pattern.TestSnapshotPattern.test_snapshot_pattern[compute,image,network]20:46
mriedemhttp://logs.openstack.org/55/55455/1/check/check-tempest-devstack-vm-neutron/28d1ed7/console.html.gz20:46
mriedemso that would affect nova, glance and neutron20:46
mriedemmtreinish: good point20:46
portantebut compute image network don't help someone know where to file a bug20:46
mtreinishmriedem: it's by design: https://blueprints.launchpad.net/tempest/+spec/add-service-tags :)20:46
portantethose names don't translate to a luanchpad url, do they?20:47
portantecan i use bugs.launchpad.net/compute/+filebug?20:47
portanteif yes, great I"ll dot hat20:47
portantethat20:47
portanteif no, let's get that setup20:47
portantewe need to make this dead simple for folks to file bugs, accurately, so that they don't fall back to recheck no bug20:47
sdagueportante: I don't think you can go claim all the generic namespaces20:48
mriedemif the scenario test touches multiple projects, then i guess you just pick one to report the bug and mark it as also affecting other projects20:48
*** openstackrecheck has quit IRC20:48
*** openstackrecheck has joined #openstack-qa20:48
portantesdague: so then can we get a url to help folks map them?20:48
mtreinishmriedem: I think launchpad will link the namespace for multiple projects so they all go the same place20:49
mtreinishso if you use a link with nova or cinder for the same bug it goes to the same place20:49
mriedemmtreinish: yeah, it does20:49
mriedemi just tested that20:49
mriedemhttps://bugs.launchpad.net/nova/+bug/124875720:49
mriedemhttps://bugs.launchpad.net/neutron/+bug/124875720:49
mriedemthose are the same20:49
portantethat is good to know20:49
portantewhy can't we use the project names for those tags instead of image volume etc.20:50
portante?20:50
openstackrecheckopenstack/heat change: https://review.openstack.org/60607 failed tempest because of: https://bugs.launchpad.net/bugs/125389620:50
sdagueportante: because we want to use stable service names20:50
openstackrecheckopenstack-infra/devstack-gate change: https://review.openstack.org/61850 failed tempest because of: https://bugs.launchpad.net/bugs/126037120:50
sdaguenot code names20:50
mriedemif you're working with openstack, you should probably know that compute == nova20:50
mriedemright?20:50
openstackrecheckopenstack/tempest change: https://review.openstack.org/56242 failed tempest because of: https://bugs.launchpad.net/bugs/125389620:51
portantewhy?20:51
sdagueportante: seriously?20:51
portantethat might be easy20:51
portantebut what is marconi?20:51
portantewhat is proton?20:51
mriedemthey aren't in tempest...but trove is trying to be20:51
portantewhat is trove?20:51
portantewhy do I have to know all the naming parlance just to file a bug?20:52
sdagueportante: honestly, I do expect a certain level of actually understanding the project to be a useful contributor20:52
mriedemhttps://review.openstack.org/#/c/61727/20:52
mriedemhttps://wiki.openstack.org/wiki/Trove20:52
openstackrecheckopenstack-dev/devstack change: https://review.openstack.org/61854 failed tempest because of: https://bugs.launchpad.net/bugs/125389620:52
portantesdague: thanks for your honesty20:53
sdagueif yuo think there is a better summary document to take people through that than what's on openstack.org, I think that would be a useful contribution20:53
sdaguebut drive by bugs aren't actually useful contributions in 98% of their cases, they are just debt. As we've been seeing in clearing out a bunch of them today20:54
portantethanks sdague, when I have a chance, I'll read openstack.org on filing bugs20:54
sdagueI'm sure we could have a better bug flow chart somewhere. Contributions welcomed.20:55
openstackgerritA change was merged to openstack-dev/devstack: Define Q_L3_ENABLED=True for MidoNet plugin  https://review.openstack.org/5645920:55
openstackrecheckopenstack/python-novaclient change: https://review.openstack.org/61645 failed tempest because of: https://bugs.launchpad.net/bugs/125389620:56
openstackrecheckopenstack/heat change: https://review.openstack.org/61855 failed tempest because of: https://bugs.launchpad.net/bugs/125762620:56
openstackrecheckopenstack/heat change: https://review.openstack.org/58357 failed tempest because of: https://bugs.launchpad.net/bugs/125389620:58
dkranzsdague: See https://bugs.launchpad.net/tempest/+bug/1255627 for how much easier this will be when my recent patch goes in.20:59
sdaguedkranz: nice21:03
openstackrecheckopenstack/heat change: https://review.openstack.org/61786 failed tempest because of: https://bugs.launchpad.net/bugs/125389621:04
dtroyer_zzsdague: what sort of threshhold would you look for to add a bug to e-r?  I've got 5 logstash hits for https://bugs.launchpad.net/devstack/+bug/1256970 but it appears to be in n-obj which we don't collect logs for...21:05
*** rwsu has quit IRC21:05
sdaguedtroyer_zz: we don't collect logs for it?21:05
sdaguedtroyer_zz: honestly, anything that shows up in more than one run is fair game21:06
dtroyer_zzOK.  I'll add screen-n-obj to the collection too…just as jeblair is trying to shrink it… ;)21:06
*** yassine has joined #openstack-qa21:07
*** jasondotstar has quit IRC21:07
openstackrecheckopenstack/ceilometer change: https://review.openstack.org/60154 failed tempest because of: https://bugs.launchpad.net/bugs/125389621:09
dtroyer_zzsdague: to add a bug to e-r it's just adding a query yaml file?21:09
sdaguedtroyer_zz: yep21:11
sdaguesee format in examples21:11
sdaguejust bunum.yaml21:11
sdaguebugnum21:11
sdaguedkranz / mtreinish: any idea why we are doing this wait - https://github.com/openstack/tempest/blob/master/tempest/api/compute/images/test_images_oneserver_negative.py#L125 ?21:11
clarkbI have a change up to add docs for this21:11
clarkbdtroyer_zz: https://review.openstack.org/#/c/61298/21:12
clarkbI am probably going to self approve if no one else reviews it21:12
clarkbalso forgive me for channeling RMS in that change21:12
sdagueclarkb: aproved21:12
sdagueheh21:12
dkranzmtreinish: I think this was a recent change.21:13
clarkbpretty sure apache doesn't count as "free" :)21:13
mtreinishsdague: my guess is a hold over from when there might have been a bug in the one server rebuild code in setUp()21:13
mtreinishbut that's pure speculation21:13
dkranzmtreinish: There was a change to wait_for_image_status so that it waits for the server as well21:13
dkranzmtreinish: I think it is supposed to be waiting for the server21:13
dkranzmtreinish: If so, that method should be renamed to indicate that.21:13
dkranzmtreinish: I can't chase down the patch or bug now, have to go home for the meeting.21:14
*** dkranz is now known as dkranz_in_transi21:14
mtreinishsdague: oh, the other thing is it could be trying to verify that the first snapshot eventually finishes uploading21:15
mtreinishbecause it checks for a conflict when trying to snapshot when a snapshot is in progress21:16
mtreinishbut if it exited there we could end up with the snapshot upload in a bad state21:16
openstackgerritSean Dague proposed a change to openstack/tempest: remove a spurious wait that could get us into trouble  https://review.openstack.org/6187321:16
mtreinishI really don't know why it's there21:16
sdagueI'm going to propose removing it21:17
*** dkranz_in_transi has quit IRC21:19
openstackgerritJoe Hakim Rahme proposed a change to openstack/tempest: Searate negative tests for Swift  https://review.openstack.org/6187421:20
sdagueanyone have the bug which was the swift setup incorrectly in the gates thus generating 503s?21:21
openstackrecheckopenstack/cinder change: https://review.openstack.org/58724 failed tempest with an unrecognized error21:21
*** krtaylor has joined #openstack-qa21:25
*** jhenner has joined #openstack-qa21:26
openstackgerritJoe Hakim Rahme proposed a change to openstack/tempest: Separate negative tests for Swift  https://review.openstack.org/6187421:27
portantesdague: can you say more about the swift failures?21:28
*** jhenner has quit IRC21:29
*** SergeyLukjanov is now known as _SergeyLukjanov21:31
openstackgerritA change was merged to openstack-infra/elastic-recheck: Document adding bug signatures to e-r.  https://review.openstack.org/6129821:32
*** yfried has quit IRC21:38
*** openstackrecheck has quit IRC21:39
*** openstackrecheck has joined #openstack-qa21:39
openstackgerritDean Troyer proposed a change to openstack-infra/elastic-recheck: Add query for bug 1256970  https://review.openstack.org/6187821:40
*** jecarey has quit IRC21:45
*** SergeyLukjanov has joined #openstack-qa21:45
openstackgerritSean Dague proposed a change to openstack/tempest: allow hypervisors to be down but still pass  https://review.openstack.org/6187921:48
*** yfried has joined #openstack-qa21:48
*** marun has quit IRC21:48
openstackrecheckopenstack/nova change: https://review.openstack.org/61470 failed tempest because of: https://bugs.launchpad.net/bugs/125389621:54
openstackrecheckopenstack/heat change: https://review.openstack.org/61793 failed tempest with an unrecognized error21:57
*** dkranz_in_transi has joined #openstack-qa21:57
*** dkranz_in_transi is now known as dkranz21:58
mtreinishsdague: this is the commit I was talking about at lunch: https://review.openstack.org/#/c/60611/22:01
mtreinishI'm still trying to figure out where the import errors are coming from22:01
dkranzmtreinish: Is it meeting time?22:01
mtreinishand the full, postgres and neutron jobs failed. The pipefail patch is needed to show it though22:01
giulivodkranz, mtreinish I'm here for the meeting too22:01
mtreinishdkranz: yep22:02
openstackrecheckopenstack/nova change: https://review.openstack.org/60396 failed tempest because of: https://bugs.launchpad.net/bugs/125389622:02
*** ken1ohmichi has joined #openstack-qa22:04
*** mriedem has quit IRC22:05
*** mriedem has joined #openstack-qa22:05
*** malini_afk has quit IRC22:05
*** markmcclain has quit IRC22:07
*** malini_afk has joined #openstack-qa22:08
*** malini_afk is now known as malini22:08
*** ken1ohmichi has quit IRC22:09
*** abramley has quit IRC22:10
openstackrecheckopenstack/heat change: https://review.openstack.org/61818 failed tempest because of: https://bugs.launchpad.net/bugs/125389622:10
openstackgerritJeremy Stanley proposed a change to openstack-infra/devstack-gate: Cover the tempest user in select_mirror  https://review.openstack.org/6186122:11
*** jasondotstar has joined #openstack-qa22:13
openstackrecheckopenstack/heat change: https://review.openstack.org/60607 failed tempest with an unrecognized error22:16
openstackrecheckopenstack/nova change: https://review.openstack.org/55722 failed tempest because of: https://bugs.launchpad.net/bugs/125389622:16
*** jasondotstar has quit IRC22:16
*** jasondotstar has joined #openstack-qa22:17
*** jasondotstar has quit IRC22:17
openstackrecheckopenstack/nova change: https://review.openstack.org/60592 failed tempest because of: https://bugs.launchpad.net/bugs/125389622:17
openstackgerritJeremy Stanley proposed a change to openstack-infra/devstack-gate: Cover the tempest user in select_mirror  https://review.openstack.org/6186122:23
mriedemsdague: i dug around into this bug a bit looking for e-r query candidates, nothing air tight so far, a few candidates22:25
mriedemhttps://bugs.launchpad.net/neutron/+bug/124875722:25
mriedemthe trick will be separating those fails from bug 125389622:26
sdagueyeh, things I've learned this week, I need to do the multi doc er patches22:26
mriedemsdague: yeah, don't wait for me for that :(22:26
sdagueyep22:28
openstackrecheckopenstack/heat change: https://review.openstack.org/61864 failed tempest because of: https://bugs.launchpad.net/bugs/125389622:28
openstackrecheckopenstack/tempest change: https://review.openstack.org/61778 failed tempest because of: https://bugs.launchpad.net/bugs/125389622:32
*** aveiga has quit IRC22:35
*** krtaylor has quit IRC22:38
*** abramley has joined #openstack-qa22:43
*** mriedem1 has joined #openstack-qa22:54
*** mriedem has quit IRC22:54
openstackrecheckopenstack/python-novaclient change: https://review.openstack.org/59726 failed tempest because of: https://bugs.launchpad.net/bugs/125389622:56
openstackrecheckopenstack/tempest change: https://review.openstack.org/61879 failed tempest with an unrecognized error22:59
openstackgerritSean Dague proposed a change to openstack/tempest: unskip multibyte test  https://review.openstack.org/6174723:00
openstackrecheckopenstack/horizon change: https://review.openstack.org/54364 failed tempest because of: https://bugs.launchpad.net/bugs/125389623:00
*** ken1ohmichi has joined #openstack-qa23:01
openstackgerritSean Dague proposed a change to openstack/tempest: allow hypervisors to be down but still pass  https://review.openstack.org/6187923:01
openstackrecheckopenstack-infra/devstack-gate change: https://review.openstack.org/61850 failed tempest with an unrecognized error23:01
sdagueken1ohmichi: https://github.com/openstack-infra/devstack-gate/blob/master/devstack-vm-gate-wrap.sh#L288 this is the function where log collection happens23:03
openstackgerritDavid Kranz proposed a change to openstack-infra/devstack-gate: Always dump errors to console  https://review.openstack.org/6185023:03
openstackgerritDean Troyer proposed a change to openstack-infra/elastic-recheck: Add query for bug 1256970  https://review.openstack.org/6187823:03
sdagueso if you wanted to add libvirt to that list, yuo would do that there23:03
*** ianw has quit IRC23:04
ken1ohmichisdauge: so fast, thanks! will post the patch for libvirt log23:05
*** ianw has joined #openstack-qa23:05
SergeyLukjanovhey guys23:07
SergeyLukjanovthere was no time to discuss it on the meeting23:07
SergeyLukjanovI'm about savanna api tests in tempest23:07
*** dkranz is now known as dkranz_dinner23:08
SergeyLukjanovheh, one more project/api23:08
giulivoSergeyLukjanov, do you have a blueprint for it?23:08
SergeyLukjanovI've created changes to introduce simple api tests for one of the resources23:09
SergeyLukjanovgiulivo, nope23:09
SergeyLukjanovI'd like to clarify which level of details I need in bp23:09
giulivoSergeyLukjanov, but is it enabled by devstack already?23:09
giulivoor maybe are you on the way to have it enabled by devstack? the thing is we don't merge tests that can't run23:10
SergeyLukjanovgiulivo, yes, we already have work done in devstack, d-g and have d-g jobs23:10
giulivoso pardon the questions but I didn't know :)23:10
SergeyLukjanovhere is a CR to add savanna d-g jobs to the tempest's experimental pipeline https://review.openstack.org/#/c/61125/23:11
SergeyLukjanovto be able to test changes23:11
giulivoSergeyLukjanov, what I would do is create a blueprint, you don't really need to put many details in it but use it for tracking purpose23:12
giulivosee this https://blueprints.launchpad.net/tempest/+spec/add-basic-ceilometer-tests or this https://blueprints.launchpad.net/tempest/+spec/add-basic-marconi-tests23:12
*** yassine has quit IRC23:12
SergeyLukjanovgiulivo, one blueprint for all api tests?23:12
SergeyLukjanovgiulivo, got it, I'll create it soon23:12
giulivoyes its only purpose is to track status of "enablement" not the tests23:13
SergeyLukjanovgiulivo, ok, thx23:13
giulivoso when you're on the point of having a few basic tests merged against a pipeline running, we should close the blueprint23:13
giulivoalso please set you as assignee and a series or milestone23:14
SergeyLukjanovgiulivo, could you, please, take a short look on my changes to check that it's on the right way?23:14
*** jgrimm has joined #openstack-qa23:14
rahmumtreinish: are you available to discuss this patch? https://review.openstack.org/#/c/59759/23:15
openstackgerritA change was merged to openstack-infra/elastic-recheck: Add query for bug 1256970  https://review.openstack.org/6187823:15
openstackrecheckopenstack/nova change: https://review.openstack.org/61470 failed tempest because of: https://bugs.launchpad.net/bugs/125389623:16
mtreinishrahmu: yeah23:18
giulivoSergeyLukjanov, I can try but I'm not core in -infra23:18
SergeyLukjanovgiulivo, I mean patches for tempest23:18
mtreinishrahmu: so the method I added here: https://review.openstack.org/#/c/60925/12/tempest/test.py23:19
SergeyLukjanovgiulivo, that's what I worry about ;)23:19
mtreinishon line 31423:19
mtreinishis doing the skip the correct way for something we need to skip based on a config variable23:19
mtreinishotherwise we have a compile/import time dep on a config file being present23:19
mtreinishwhich we don't want23:20
SergeyLukjanovgiulivo, bp added: https://blueprints.launchpad.net/tempest/+spec/savanna-api-tests23:20
*** openstackrecheck has quit IRC23:20
*** openstackrecheck has joined #openstack-qa23:20
mtreinishrahmu: then this decorator: http://git.openstack.org/cgit/openstack/tempest/tree/tempest/test.py#n126 I'm going to rework to be a method23:20
giulivoSergeyLukjanov, well they currently don't run though23:20
mtreinishsimilar to the one in that review23:20
mtreinishso we can add on to that for swift23:21
mtreinishso we add a new list option to object_store_feature_enabled23:21
mtreinishmiddleware (or something like that)23:21
mtreinishand then you can have the first line of the test method (or the setup class) be self.requires_ext(service='object-storage', extension='foo')23:22
giulivosdague ^^ ideas on the need to add tests that only run in experimental pipelines?23:22
SergeyLukjanovgiulivo, oh, let me explain23:23
*** sthaha has joined #openstack-qa23:23
mtreinishrahmu: is that clear? sorry about the info dump23:23
SergeyLukjanovgiulivo, savanna is not enabled by default now and so to be able to test changes, I'd like to have savanna d-g jobs23:24
SergeyLukjanovgiulivo, we already have them in savanna check/gate pipeline23:24
rahmumtreinish: I think I get it.23:24
rahmumtreinish: I may be off, but wouldn't affect the gate time to do the config check for every test? wouldn't it be better to do it once per class?23:24
mtreinishrahmu: not really, the config file is a singleton class so it only get's loaded once. So it's just adding an if to the methods23:25
mtreinishrahmu: but if all the tests in a class require an extension then it's better to do it setupclass23:25
rahmuyeah, that's how it's usually the case for these swift tests23:26
rahmuokay. Are there a bp I can use to track your progress on this?23:27
rahmucleanup config?23:27
rahmumtreinish: ^23:27
mtreinishrahmu: yeah it's cleanup config23:27
SergeyLukjanovgiulivo, btw sdague confirmed that it's a right approach several days ago23:27
mtreinishrahmu: I'll ping you when the patch is ready23:28
rahmumtreinish: thanks23:28
mtreinishyou can rebase on top of it23:28
rahmushould I mark any dependency for my patch on gerrit?23:28
rahmuis it even possible?23:28
giulivoSergeyLukjanov, ok but I the tests would still run only in the tempest experimental pipeline23:28
mtreinishrahmu: yeah that's what I mean. When I have the patch up just checkout out that commit with git review -d gerrit_change_number23:29
mtreinishthen cherry-pick or make new commits on top of that branch23:29
mtreinishand git review it back23:29
sdaguegiulivo: starting on experimental is probably a good bet for now23:29
rahmumtreinish: okay will do23:29
sdagueonce it gets more stable we can move it to non voting on regular runs23:30
SergeyLukjanovgiulivo, but in this case we'll not need to run several savanna d-g jobs per each new patch in tempest23:30
lifelesswin 4823:30
rahmumtreinish: there's a somewhat related topic I've been thinking about tempest discovering on its own which extensions are enabled before running it23:31
mtreinishsdague: we just want to be careful about it being asymmetrical, we've had issues with that before23:31
mtreinishrahmu: so we explicitly don't do that in tempest23:31
rahmumtreinish: in the case of running tempest against a vendor's implementation I know nothing about23:31
mtreinishrahmu: we want to specifically say what is running in the config beforehand23:31
mtreinishso we no what to expect in our results23:31
mtreinishrahmu: I have another bp: https://blueprints.launchpad.net/tempest/+spec/config-verification23:32
anteayasdague: ssh bug status, salv-orlando did some digging, added comment #25 to https://bugs.launchpad.net/neutron/+bug/1253896 and has handed off to me, going to bed23:32
* rahmu reading the bp23:32
mtreinishthe goal of that one is to make a tool which can verify a config file based on auto discovery of extensions23:32
anteayamestery is looking at it and has pinging a team-mate he thinks has the knowledge base to help23:33
anteayaI am also waiting for marun to arrive, he should be up soon to see if he can help23:33
anteayaEOF23:33
mtreinishrahmu: it won't make a config because then you get a strange chicken an egg problem (how can you talk to an api without knowing where it is or how to talk to it)23:33
mtreinishrahmu: but it'll at least tell you if your config is different then what the server says it can do23:34
mtreinishrahmu: wow sorry I really don't have any details in that bp23:34
rahmumtreinish: well it's all in the title :)23:34
rahmuI was thinking about using these as pre checks before running the tests, but I agree with config verification being better23:35
giulivosdague, thanks, I need guidance over that too23:36
giulivoSergeyLukjanov, ^^23:36
mtreinishrahmu: yeah we used to do that actually. But, then we had some cases where auto discovery went wonky and we ended up skipping things that broke23:36
mtreinishand it took us a while to catch it23:36
mtreinishso we decided it's better to be explicit upfront about what should be running23:36
mtreinishrahmu: anyway it's getting late for me now, I'll be back online tomorrow23:37
rahmumtreinish: same here. Thanks for the help.23:38
openstackgerritKen'ichi Ohmichi proposed a change to openstack-infra/devstack-gate: Copy libvirt log files after tempest run  https://review.openstack.org/6189223:43
sdagueanteaya: cool23:44
*** jerryz_ has joined #openstack-qa23:45
sdagueanteaya: which tz is maru in?23:45
sdagueI'm so confused some times :)23:46
jerryz_sdague: i have a problem about my local grenade test. nova-api nova-conductor are always still running after stop_base23:48
sdaguejerryz_: what version to what version?23:49
jerryz_sdague: could you take a look? http://paste.openstack.org/show/54916/23:50
jerryz_sdague: it is from trunk23:50
jerryz_sdague: synced with trunk this week23:50
sdaguejerryz_: so we landed a bunch of code recently, so when this week? :)23:51
anteayasdague: I'm told marun is in utc+823:52
anteayagoing to eat my dinner, back in a bit23:52
sdaguedansmith: can yuo look at this bug quick - https://bugs.launchpad.net/tempest/+bug/1133622 - you filed it, and it has very little context23:54
sdaguewas hoping you could say if it was resolved or not23:54
dansmithI know I did some work on that after I filed23:55
dansmithhard to say where my head was that long ago, but I'm fine if you close it23:55
sdaguedansmith: ok, I'll close as fix released and assume you did :)23:56
dansmithcool23:56
*** dkranz_dinner is now known as dkranz23:56
*** jerryz__ has joined #openstack-qa23:57
jerryz__sdague: just got disconnected23:57
jerryz__sdague: will an update solve my issue?23:57
*** SergeyLukjanov has quit IRC23:57
sdaguejerryz_: I don't know.23:58
*** jerryz_ has quit IRC23:58
*** salv-orlando has quit IRC23:58
sdaguejerryz__: it's functioning in the gate23:58
sdagueso the trick is figuring out why it's not in your env, i.e. what's different about it23:58
sdaguewhat's the base os, for instance23:58
jerryz__sdague: i know. but i am not sure why it failed in my env23:58
jerryz__sdague: my machine is not as powerful23:59
sdaguewe did split up the calls to shutdown, but that should be fine23:59

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!