Tuesday, 2014-03-25

*** rhsu1 has quit IRC00:06
*** mmaglana has quit IRC00:09
*** Aimon has quit IRC00:10
*** mmaglana has joined #openstack-qa00:10
*** mmaglana has quit IRC00:14
*** openstack has joined #openstack-qa00:19
*** matsuhashi has joined #openstack-qa00:26
*** salv-orlando has joined #openstack-qa00:37
openstackgerritKen'ichi Ohmichi proposed a change to openstack/tempest: Add a common class for Nova v2/v3 API tests  https://review.openstack.org/7813700:38
*** sthaha has joined #openstack-qa00:38
*** zhikunliu has joined #openstack-qa00:46
*** adalbas has quit IRC00:47
openstackgerritJoe Gordon proposed a change to openstack-dev/devstack: Set up cgroups for libvirt  https://review.openstack.org/8263000:49
jogomriedem: if your there was hoping for a quick e-r review https://review.openstack.org/#/c/82245/00:49
mriedemjogo: +A00:51
jogomriedem: thanks00:52
openstackgerritA change was merged to openstack-infra/elastic-recheck: Add fingerprint for bug 1295876  https://review.openstack.org/8224500:53
*** ken1ohmichi has joined #openstack-qa00:54
*** yamahata has joined #openstack-qa00:55
*** yamahata_ has quit IRC00:56
*** yamahata_ has joined #openstack-qa00:56
openstackgerritYuiko Takada proposed a change to openstack/tempest: Verify attributes through Nova os-quota-sets API  https://review.openstack.org/8268100:59
*** weshay has quit IRC00:59
*** openstackrecheck has quit IRC00:59
*** openstackrecheck has joined #openstack-qa01:00
*** Aimon has joined #openstack-qa01:06
*** rhsu has joined #openstack-qa01:07
*** krtaylor has quit IRC01:07
*** bill_az__ has quit IRC01:09
openstackrecheckopenstack/heat change: https://review.openstack.org/81726 failed gate-tempest-dsvm-full in the gate queue with an unrecognized error01:11
*** krtaylor has joined #openstack-qa01:11
openstackgerritKen'ichi Ohmichi proposed a change to openstack/tempest: Add a common class for Nova v2/v3 API tests  https://review.openstack.org/7813701:15
openstackgerritGhanshyam Mann proposed a change to openstack/tempest: Check reserve/unreserve fixed-ips APIs attributes  https://review.openstack.org/8268401:18
*** mlavalle has quit IRC01:18
*** krtaylor has quit IRC01:20
*** mwagner_lap has joined #openstack-qa01:23
*** krtaylor has joined #openstack-qa01:23
*** rwsu has quit IRC01:26
*** nosnos has joined #openstack-qa01:29
*** matsuhashi has quit IRC01:30
*** matsuhashi has joined #openstack-qa01:30
openstackgerritMasayuki Igawa proposed a change to openstack/tempest: Add unit tests for NegativeRestClient class  https://review.openstack.org/8087601:31
*** rhsu has quit IRC01:39
*** rhsu1 has joined #openstack-qa01:39
*** jasondotstar has joined #openstack-qa01:41
*** rwsu has joined #openstack-qa01:42
*** yamahata_ has quit IRC01:48
*** yamahata_ has joined #openstack-qa01:50
*** sthaha has quit IRC01:50
*** malini_afk is now known as malini01:54
*** sthaha has joined #openstack-qa02:03
openstackgerritBrant Knudson proposed a change to openstack-dev/devstack: Provide a keystone.conf for tempest  https://review.openstack.org/8269102:06
openstackgerritBrant Knudson proposed a change to openstack-dev/devstack: Provide a keystone.conf for tempest  https://review.openstack.org/8235802:06
openstackgerritBrant Knudson proposed a change to openstack-dev/devstack: Provide a keystone.conf for tempest  https://review.openstack.org/8235802:07
*** HenryG has joined #openstack-qa02:29
*** jasondotstar has quit IRC02:30
openstackgerritMasayuki Igawa proposed a change to openstack/tempest: Add unit tests for NegativeRestClient class  https://review.openstack.org/8087602:30
*** mmaglana has joined #openstack-qa02:31
*** mestery has joined #openstack-qa02:34
*** Sukhdev has joined #openstack-qa02:40
*** rfolco has quit IRC02:41
*** mestery has quit IRC02:46
*** mestery has joined #openstack-qa02:46
*** mriedem has quit IRC02:48
*** salv-orlando_ has joined #openstack-qa02:49
*** salv-orlando has quit IRC02:50
*** salv-orlando_ is now known as salv-orlando02:50
openstackgerritMasayuki Igawa proposed a change to openstack/tempest: Add unit tests for cli.output_parser  https://review.openstack.org/8270002:53
openstackgerritMasayuki Igawa proposed a change to openstack/tempest: Add a new exception for invalid structure  https://review.openstack.org/8092702:53
openstackgerritKen'ichi Ohmichi proposed a change to openstack/tempest: Add a common class for Nova v2/v3 API tests  https://review.openstack.org/7813702:54
*** malini is now known as malini_afk03:00
*** torandu has joined #openstack-qa03:08
openstackgerritYuiko Takada proposed a change to openstack/tempest: Verify attributes through Nova "list security groups" API  https://review.openstack.org/8145203:08
*** matsuhashi has quit IRC03:12
openstackgerritArmando Migliaccio proposed a change to openstack/tempest: Honor suspend/pause config switches in scenario tests  https://review.openstack.org/8256603:13
openstackgerritAdam Gandelman proposed a change to openstack-infra/devstack-gate: Sets DEFAULT_INSTANCE_TYPE in localrc for Ironic  https://review.openstack.org/8270303:15
*** sweston has joined #openstack-qa03:21
*** torandu has quit IRC03:27
*** torandu has joined #openstack-qa03:28
*** nosnos has quit IRC03:29
*** matsuhashi has joined #openstack-qa03:30
*** chandankumar_ has joined #openstack-qa03:32
*** matsuhashi has quit IRC03:36
*** chandankumar_ has quit IRC03:40
*** mspreitz has joined #openstack-qa03:40
*** Sukhdev has quit IRC03:43
*** mmaglana has quit IRC03:47
*** harlowja_ is now known as harlowja_away03:49
*** GMann has quit IRC03:50
*** torandu has quit IRC03:54
*** chandankumar_ has joined #openstack-qa03:55
*** torandu has joined #openstack-qa03:56
*** GMann has joined #openstack-qa03:57
raiesGMann: Hi04:01
raiesGMann: previously we need to add cp /opt/stack/tempest/etc/tempest.conf etc/tempest.conf04:02
*** Akshik has joined #openstack-qa04:03
raiesGMann: But now now there occurs some identity error because different username/password is changed to None04:03
GMannraies- hi04:03
GMannyes04:03
raiesNow to run tempest separately what extra settings are required04:04
GMannTempest account has been separated from Devstack now04:04
raies??04:04
*** torandu has quit IRC04:04
GMannwhat you need is- pull the latest master devstack04:04
GMannand run the ./stack.sh04:04
GMannit will set the devstack credentials in tempest.04:05
raiesok, I think I am using old devstack04:05
GMannBasically idea is now tempest accounts are seperated and it can be configured with any enviornment other than devstack04:05
raiesthanks GMann san :)04:05
AkshikAre there any Citrix CPBM like tool for OpenStack04:08
*** torandu has joined #openstack-qa04:11
*** nati_ueno has quit IRC04:13
openstackrecheckConsole logs not available after 13:22s for gate-python-novaclient-pypy 82443,2,874e90104:15
openstackrecheckopenstack/heat change: https://review.openstack.org/80868 failed because of: gate-tempest-dsvm-neutron: https://bugs.launchpad.net/bugs/128681804:16
openstackgerritYuiko Takada proposed a change to openstack/tempest: Verify list agents attributes of V2/V3 APIs  https://review.openstack.org/8092304:17
openstackgerritMauro Rodrigues proposed a change to openstack/tempest: Refactors cleanup resource for scenario  https://review.openstack.org/8270904:17
*** torandu has quit IRC04:17
*** torandu has joined #openstack-qa04:18
*** matsuhashi has joined #openstack-qa04:23
*** torandu has quit IRC04:23
*** chandankumar_ has quit IRC04:23
*** torandu has joined #openstack-qa04:25
*** nosnos has joined #openstack-qa04:25
*** Sukhdev has joined #openstack-qa04:32
*** torandu has quit IRC04:35
*** torandu has joined #openstack-qa04:36
*** nati_ueno has joined #openstack-qa04:40
openstackgerritMasayuki Igawa proposed a change to openstack/tempest: Add a test for booting instances at the specified AZs or hosts  https://review.openstack.org/6688204:41
*** torandu has quit IRC04:46
openstackgerritxu-haiwei proposed a change to openstack/tempest: Verify the response attributes of 'get_aggregate'  https://review.openstack.org/8271204:48
openstackgerritMauro Rodrigues proposed a change to openstack/tempest: Refactors cleanup resource for scenario  https://review.openstack.org/8270904:54
*** rhsu has joined #openstack-qa04:54
*** rhsu1 has quit IRC04:54
marunsdague: ping04:54
marunsdague: you're -1ing the wrong patch04:54
marunsdague: oops, you +1'd (confused is me)04:55
*** yamahata has quit IRC04:58
*** yamahata has joined #openstack-qa04:58
*** yamahata has quit IRC04:59
*** yamahata has joined #openstack-qa04:59
*** masayukig has joined #openstack-qa05:04
*** yfried has quit IRC05:10
openstackgerritGhanshyam Mann proposed a change to openstack/tempest: Verify get flavor attributes of Nova V2/V3 APIs  https://review.openstack.org/8054305:12
*** matsuhashi has quit IRC05:14
*** matsuhashi has joined #openstack-qa05:18
*** Madan has joined #openstack-qa05:22
openstackgerritEiichi Aikawa proposed a change to openstack/tempest: Verify certificate API response attributes  https://review.openstack.org/8147705:23
openstackgerritGhanshyam Mann proposed a change to openstack/tempest: Validate for list flavor attributes of V2/V3 APIs  https://review.openstack.org/7852705:23
marunclarkb: around?05:26
clarkbmarun: sort of05:27
clarkbmostly just watching IRC, whats up?05:27
marunclarkb: I'm contemplating what the neutron functional job should be gating...05:27
marunclarkb: It has a dependency on both devstack and tempest.05:28
marunclarkb: oh wait, just devstack05:28
marunclarkb: to install dependencies.05:28
marunclarkb: so should the job run as part of the devstack gate?05:28
marunclarkb: feel free to divert me for now05:28
clarkbideally it would, I'm not sure how sdague would feel about it considering it depends on unstable tempest interfaces05:29
marunclarkb: it doesn't05:29
clarkboh in that case yes definitely05:29
marunclarkb: I commented as much on the review - that's a separate job.05:29
marunclarkb: ok, danke!05:29
clarkbmarun: I would double check to see what the swift functional test does05:29
clarkbas that may offer clues to other things that should be done05:29
marunclarkb: ah, the swift tests also rely on devstack to deploy?05:30
clarkbyup05:30
marunah, gotcha05:30
marunclarkb: I hope to talk at length at summit about how all this stuff works.05:32
marunclarkb: I was talking to someone about how google manages source/ci and I wonder if there isn't room to reduce the amount of duplicative testing in the future.05:33
openstackgerritGhanshyam Mann proposed a change to openstack/tempest: Verify detail_list flavor attributes of V2/V3 APIs  https://review.openstack.org/8054805:33
marunclarkb: but for another time...05:33
clarkbmarun: there should be tons of room05:33
clarkbmarun: I have an etherpad up but I don't have the link to it on this machine05:33
marunclarkb: in neutron alone, we probably do 10x more testing than we need to.05:33
clarkband the tl;dr of it is how do we consolidate and be smarter about this05:33
clarkbmarun: the biggest issue is we don't have any feature parity anywhere05:34
marunclarkb: if a plugin isn't in the gate, changes to its tree shouldn't trigger 10 tempest runs against the default plugin05:34
clarkbso we have to run a bajillion tests to cover a bunch of corner cases05:34
clarkbneutron vs nova network, kvm vs xen vs containers (andor docker), mysql vs postgres (and mongodb in cases), and so on05:35
clarkbits pretty terrible05:35
marunclarkb: well, we could run them against the code under test 10x.  running them for changes that don't affect the gate wouldn't seem to have any value.05:35
marunclarkb: for sure05:35
clarkbmarun: the problem with ^ is you ahve no idea what will affect the gate until its too late05:35
marunclarkb: if I touch a tree that doesn't actually execute in the gate, then it's pointless.05:35
clarkbmarun: but you don't know when devstack will make a change and completely make the previous assumption wrong05:36
marunclarkb: running the tests more for changes that do affect execution would be a better use of duplicative testing05:36
marunclarkb: we do for neutron05:36
clarkb(this is anotehr problem that needs solving and I think it can be done wif we have some clear cut rules about what we test)05:36
marunclarkb: we can pretty easily demarcate when a change to a plugin has zero effect on a given jenkins job.05:36
clarkbmarun: you can't05:36
marunclarkb: yes, you can :)05:36
clarkbbecause devstack could make your claims false05:36
clarkbwithout any of your input05:36
marunclarkb: look, sometimes a change will be ambiguous.05:37
clarkbso you may think the opendaylight driver isn't needed in the gate until it is05:37
marunclarkb: I'm talking about unambiguous changes.05:37
clarkband so on05:37
marunclarkb: it should be possible to detect what changes, compare against devstack config, and abort jobs that are unnecessary05:37
marunclarkb: -> low hanging robot work05:37
openstackgerritanju Tiwari proposed a change to openstack/tempest: Fliter images with container and disk format  https://review.openstack.org/8228105:38
clarkbmarun: right, or we can just come up with "This is what we test" and codify it05:38
clarkbthen we don't even need the robots.05:38
marunclarkb: codifying is lazy, and doesn't scale05:38
clarkbmarun: it would scale just fine05:38
marunwe can do better05:38
marun:)05:38
marun(but we don't have to)05:38
clarkbdeclare X Y and Z as the things (whatever they are, I actually don't care about details much) then do that05:39
clarkbthen if someon breaks the gate because devstack decides to use some new thing thats a bug05:39
clarkbthe biggest problem here is we really have no idea what all of the various variables mean05:39
marunclarkb: the classification would be project-specific.  we know how to configure neutron, better than devstack.05:40
marunclarkb: we can determine when a change absolutely wouldn't be executed based on a given devstack config.05:40
marunclarkb: if it *could* impact execution, then no question, we run the job.05:40
clarkbmarun: right so first step is figuring out what all of the various devstack knobs mean in regards to all the projects05:41
clarkband figuring out where the overlap between config and tests lies05:41
clarkbthis is much much easier if we stop building building into a corner with incompatible interfaces05:41
marunclarkb: right05:41
marunclarkb: cross-project coordination? *gasp*05:41
marunclarkb: so, when is the TC going to have budget to hire some folk to lead this? ;)05:42
clarkbha, I think sdague intends on pushing this05:42
openstackgerritanju Tiwari proposed a change to openstack/tempest: Fliter images with container and disk format  https://review.openstack.org/8228105:42
marunI'd definitely get behind that.05:42
* clarkb is looking for the etherpad in irc logs and failing05:43
clarkbmarun: https://etherpad.openstack.org/p/juno-test-maxtrices yay for the power of google05:44
marunclarkb: I'm assuming the neutron functional job be enabled as gate for devstack and neutron first for a while before being allowed to vote?05:45
marunclarkb: looking05:45
clarkbmarun: if it is non voting it should be in the check queue then we can gate and vote when it is ready05:45
marunclarkb: ok, so add it to devstack's check queue non-voting is the next step?05:46
clarkbmarun: yup05:46
marunclarkb: ah, so we can't move to matrix testing until we have parity :/05:47
marunoy05:47
clarkbmarun: exactly05:47
openstackgerritGhanshyam Mann proposed a change to openstack/tempest: Verify flavor extra specs attributes of Nova APIs  https://review.openstack.org/8271805:47
*** nati_ueno has quit IRC05:47
marunclarkb: I don't think that precludes us pursuing a strategy of not running tempest gate jobs that would not be affected by a given patch.05:47
clarkbmarun: ya there is probably some work taht can be done in parallel in that space05:48
clarkbI just think it becomes much simpler if we can make feature parity a thing05:48
clarkband it may not be complete parity but maybe a this covers 80% of stuff for us list05:48
*** chandan_kumar has quit IRC05:48
marunclarkb: I agree that parity is the first priority.05:49
marun(or should be)05:49
openstackrecheckopenstack/python-keystoneclient change: https://review.openstack.org/77026 failed gate-tempest-dsvm-full in the gate queue with an unrecognized error05:50
*** nati_ueno has joined #openstack-qa05:51
clarkbits definitely a "fun" thing to think about. Ideas welcome. I put that in an etherpad so that others could chime in05:54
marunclarkb: cool :)05:54
*** otherwiseguy has quit IRC05:59
*** Sukhdev has quit IRC06:04
openstackgerritEiichi Aikawa proposed a change to openstack/tempest: Verify tenant usages API response attributes  https://review.openstack.org/8176606:06
*** mmaglana has joined #openstack-qa06:07
openstackrecheckopenstack/cinder change: https://review.openstack.org/81044 failed because of: gate-tempest-dsvm-neutron: https://bugs.launchpad.net/bugs/129587606:12
*** andreaf has joined #openstack-qa06:14
*** psharma has joined #openstack-qa06:17
*** mestery has quit IRC06:18
*** mspreitz has quit IRC06:26
*** yfried has joined #openstack-qa06:31
*** rhsu has quit IRC06:34
*** mmaglana has quit IRC06:38
*** nmagnezi has joined #openstack-qa06:50
openstackgerritnayna-patel proposed a change to openstack/tempest: Adds more verification in list alarms  https://review.openstack.org/7994206:58
openstackgerritEiichi Aikawa proposed a change to openstack/tempest: Verify certificate API response attributes  https://review.openstack.org/8147707:01
openstackrecheckConsole logs not available after 13:24s for check-tempest-dsvm-full 82515,3,88d5ace07:04
*** jlibosva has joined #openstack-qa07:06
*** andreaf has quit IRC07:08
*** Madan has quit IRC07:10
*** Madan has joined #openstack-qa07:10
openstackgerritxu-haiwei proposed a change to openstack/tempest: Verify the response attributes of 'get_aggregate'  https://review.openstack.org/8271207:15
*** devvesa has joined #openstack-qa07:16
openstackgerritEiichi Aikawa proposed a change to openstack/tempest: Verify "get version" API response attributes  https://review.openstack.org/8093607:16
*** devvesa has left #openstack-qa07:16
*** yrabl has joined #openstack-qa07:28
*** saju_m has joined #openstack-qa07:30
*** tkammer has joined #openstack-qa07:33
*** nati_ueno has quit IRC07:37
openstackgerritYuiko Takada proposed a change to openstack/tempest: Verify list extensions attributes of V2/V3 APIs  https://review.openstack.org/8272807:37
*** luqas has joined #openstack-qa07:45
*** dkorn has joined #openstack-qa07:46
openstackgerritKen'ichi Ohmichi proposed a change to openstack/tempest: Add a common class for Nova v2/v3 API tests  https://review.openstack.org/7813708:00
openstackgerritZhi Kun Liu proposed a change to openstack/tempest: stop leaking in network tests  https://review.openstack.org/8273108:02
openstackrecheckConsole logs not available after 13:26s for check-tempest-dsvm-neutron 82721,1,cd3cbd808:06
*** dkorn has quit IRC08:14
openstackrecheckConsole logs not available after 13:25s for check-grenade-dsvm 82435,2,2d7acf608:19
*** dkorn has joined #openstack-qa08:25
*** jasondotstar has joined #openstack-qa08:27
openstackgerritxu-haiwei proposed a change to openstack/tempest: Verify the response attributes of 'get_aggregate'  https://review.openstack.org/8271208:30
openstackrecheckConsole logs not available after 13:38s for gate-neutron-docs 82352,3,670d27f08:33
openstackgerritEiichi Aikawa proposed a change to openstack/tempest: Verify tenant usages API response attributes  https://review.openstack.org/8176608:41
*** giulivo has joined #openstack-qa08:46
openstackrecheckConsole logs not available after 13:47s for gate-nova-pep8 81692,4,bc5b41708:49
*** matsuhashi has quit IRC08:49
*** saju_m has quit IRC08:50
*** yassine has joined #openstack-qa08:52
*** saju_m has joined #openstack-qa08:52
*** andreaf has joined #openstack-qa08:53
*** matsuhashi has joined #openstack-qa08:56
*** jordanP has joined #openstack-qa08:57
*** jpich has joined #openstack-qa09:02
*** nmagnezi has quit IRC09:02
*** afazekas has joined #openstack-qa09:04
*** yfried has quit IRC09:04
openstackrecheckopenstack/cinder change: https://review.openstack.org/81044 failed because of: gate-tempest-dsvm-postgres-full: https://bugs.launchpad.net/bugs/129587609:08
*** chandan_kumar has joined #openstack-qa09:13
*** matsuhashi has quit IRC09:14
openstackgerritNadya Privalova proposed a change to openstack-dev/devstack: Add configuration for Ceilometer middleware to swift  https://review.openstack.org/8213109:14
*** safchain has joined #openstack-qa09:15
*** matsuhashi has joined #openstack-qa09:18
*** nmagnezi has joined #openstack-qa09:18
openstackgerritNadya Privalova proposed a change to openstack-dev/devstack: Add configuration for Ceilometer middleware to swift  https://review.openstack.org/8213109:19
*** mkoderer has joined #openstack-qa09:21
*** yfried has joined #openstack-qa09:21
*** luqas has quit IRC09:25
*** GMann has quit IRC09:27
*** dkorn has quit IRC09:27
*** luqas has joined #openstack-qa09:29
openstackgerritJulien Leloup proposed a change to openstack/tempest: Stress Test for server availability through SSH  https://review.openstack.org/7406709:38
*** saju_m has quit IRC09:38
*** nosnos has quit IRC09:39
openstackgerritAndrea Frittoli  proposed a change to openstack/tempest: Use auth data to fill credentials  https://review.openstack.org/8211109:42
openstackgerritAndrea Frittoli  proposed a change to openstack/tempest: Define V3 Credentials  https://review.openstack.org/8187209:42
openstackgerritAndrea Frittoli  proposed a change to openstack/tempest: Get credential IDs from Credentials class  https://review.openstack.org/8024609:43
openstackgerritAndrea Frittoli  proposed a change to openstack/tempest: Enforces the use of Credentials (part1)  https://review.openstack.org/7759409:43
openstackgerritAndrea Frittoli  proposed a change to openstack/tempest: Enforces the use of Credentials (part2)  https://review.openstack.org/8211209:43
openstackgerritAndrea Frittoli  proposed a change to openstack/tempest: Access credential fields as attributes  https://review.openstack.org/8211309:43
openstackgerritAndrea Frittoli  proposed a change to openstack/tempest: Defines a Credentials class  https://review.openstack.org/7438709:43
andreafafazekas, giulivo: do you have any time for have a look at those ^^^09:44
andreafI rebased them a number of times now, I'd really love get them through and move on with the multi-auth bp09:45
*** andreaf has quit IRC09:49
openstackgerritafazekas proposed a change to openstack-dev/devstack: Use urandom for heat key generation  https://review.openstack.org/8275809:51
*** saju_m has joined #openstack-qa09:57
openstackgerritDmitry Tantsur proposed a change to openstack-dev/devstack: Add workaround for iptables on Fedora  https://review.openstack.org/8276009:59
openstackgerritA change was merged to openstack-dev/devstack: Move from keystoneclient to openstackclient in eucarc  https://review.openstack.org/8047510:00
openstackgerritDmitry Tantsur proposed a change to openstack-dev/devstack: Explicitly open tftpd port in iptables on Fedora  https://review.openstack.org/8276010:01
openstackgerritMh Raies proposed a change to openstack/tempest: Network fwaas API test  https://review.openstack.org/7885710:01
*** morganfainberg is now known as morganfainberg_Z10:05
*** zhikunliu has quit IRC10:05
*** matsuhashi has quit IRC10:08
*** matsuhashi has joined #openstack-qa10:10
*** yfried has quit IRC10:10
*** tosky has joined #openstack-qa10:10
*** salv-orlando has quit IRC10:14
openstackgerritJulien Leloup proposed a change to openstack/tempest: Stress Test for server availability through SSH  https://review.openstack.org/7406710:21
*** yfried has joined #openstack-qa10:24
*** masayukig has quit IRC10:28
akamyshnikovaafazekas, sdague Hello, last week this change https://review.openstack.org/71251 was approved, but it based on https://review.openstack.org/63723 and https://review.openstack.org/80928. Could you find some time to take a look at this two changes?10:33
*** markmcclain has joined #openstack-qa10:39
*** nmagnezi has quit IRC10:40
mkodererakamyshnikova: I will have a look today10:40
akamyshnikovamkoderer, thanks!10:40
openstackgerritafazekas proposed a change to openstack-infra/devstack-gate: Use OVERRIDE_ZUUL_BRANCH in devstack-vm-gate.sh  https://review.openstack.org/8249610:43
*** weshay has joined #openstack-qa10:47
*** jasondotstar has quit IRC10:47
*** andreaf has joined #openstack-qa10:47
openstackgerritA change was merged to openstack/tempest: Remove resize-revert workaround for bug 924371  https://review.openstack.org/8209510:52
*** nmagnezi has joined #openstack-qa10:57
*** saju_m has quit IRC11:07
*** saju_m has joined #openstack-qa11:08
*** saju_m has quit IRC11:09
openstackgerritnayna-patel proposed a change to openstack/tempest: Adds more testcases to test_telemetry_alarming_api  https://review.openstack.org/8249111:09
*** mwagner_lap has quit IRC11:12
*** ken1ohmichi has quit IRC11:14
*** saju_m has joined #openstack-qa11:15
*** malini_afk is now known as malini11:17
openstackgerritAnn Kamyshnikova proposed a change to openstack/tempest: Verify more information in floating ip tests  https://review.openstack.org/6372311:20
*** Madan has quit IRC11:23
*** Madan has joined #openstack-qa11:30
afazekassdague,mkoderer :https://review.openstack.org/#/c/78345/11:37
*** saju_m has quit IRC11:38
*** saju_m has joined #openstack-qa11:38
sdagueafazekas: so I think this is correct - https://review.openstack.org/#/c/82758/1 but I'm curious where you saw the delays, as I expected to see speed ups in the heat slow jobs with this11:44
sdaguewhich I don't see as something obvious11:44
Anju1sdague:  hii, please look in this https://bugs.launchpad.net/tempest/+bug/129716711:44
sdagueAnju1: sure, what should I be looking for11:45
Anju1sdague: I have mentioned all the things there  :)11:46
Anju1please tell me if I am going wrong11:46
Anju1will join you from home :) bye11:46
sdaguesounds reasonable to me11:46
Anju1ohh thanks  :)11:46
sdagueso you propose a test delete?11:46
cyeohwould tempest cores mind having a look at: https://review.openstack.org/#/c/81551/12:02
cyeohthe corresponding nova change has been +2'd https://review.openstack.org/#/c/81356/12:03
cyeoh(though it needs the tempest patch to merge before it can pass jenkins)12:03
*** harlowja_away has quit IRC12:03
cyeohthis is the set of patches which is required to revert the backwards incompatible change made to flavor manage create12:04
*** Akshik has quit IRC12:05
*** Atti_ has joined #openstack-qa12:05
*** Akshik has joined #openstack-qa12:05
*** Akshik has quit IRC12:05
Atti_Hi! Guys is it possible to set in a test method CONF option? My not working code example http://pastebin.com/QK9puEAT12:07
*** malini is now known as malini_afk12:09
afazekassdague: I saw it my VM at devstack setup time12:14
sdagueok12:16
afazekassdague: The vm has the http://en.wikipedia.org/wiki/RdRand instuction, but does not have hw random device. the Linux just uses this instruction partially12:16
sdaguecyeoh: +A12:16
*** matsuhashi has quit IRC12:16
cyeohsdague: thx!12:17
*** dkranz has joined #openstack-qa12:17
*** matsuhashi has joined #openstack-qa12:23
*** markmcclain has quit IRC12:24
*** sthaha has quit IRC12:24
*** markmcclain has joined #openstack-qa12:24
*** sthaha has joined #openstack-qa12:25
*** markmcclain1 has joined #openstack-qa12:25
*** sthaha has quit IRC12:27
*** yamahata has quit IRC12:27
*** sthaha has joined #openstack-qa12:27
*** sthaha has joined #openstack-qa12:27
*** markmcclain2 has joined #openstack-qa12:27
*** markmcclain2 has quit IRC12:27
*** dkranz has quit IRC12:28
*** markmcclain2 has joined #openstack-qa12:28
*** dkranz has joined #openstack-qa12:29
*** markmcclain has quit IRC12:29
*** markmcclain1 has quit IRC12:29
*** markmcclain2 has quit IRC12:30
*** aysyd has joined #openstack-qa12:31
*** markmcclain has joined #openstack-qa12:31
afazekassdague: https://review.openstack.org/#/c/81486/3 The non uec image is problematic as I  said yesterday.  The ec2 image registration test expects uec images, and the uec images can boot faster because sever bios steps are skipped.12:32
sdagueafazekas: I get that the EC2 tests will need a uec image12:33
sdaguehow much time do we lose in booting real images?12:33
sdaguebecause the fact that we don't in the gate I find a little troubling12:33
*** rfolco has joined #openstack-qa12:34
afazekassdague: sever second, the heat tests using real images anyway12:35
sdagueI still think images should be the devstack default, if we want to override it in the gate, that's fine12:36
afazekasThe ami image is raw image12:38
*** jordanP has quit IRC12:38
*** zul has quit IRC12:38
*** jordanP has joined #openstack-qa12:40
*** ken1ohmichi has joined #openstack-qa12:40
*** zul has joined #openstack-qa12:41
*** saju_m has quit IRC12:41
*** mkollaro has joined #openstack-qa12:44
*** psharma has quit IRC12:45
*** mwagner_lap has joined #openstack-qa12:46
*** tosky has quit IRC12:47
*** adalbas has joined #openstack-qa12:48
*** mrodden has quit IRC12:52
*** mrodden has joined #openstack-qa12:52
*** dims_ has quit IRC12:52
*** luqas has quit IRC12:52
*** jasondotstar has joined #openstack-qa12:53
*** saju_m has joined #openstack-qa12:55
*** saju_m has quit IRC12:59
*** dkranz has quit IRC12:59
*** saju_m has joined #openstack-qa13:00
*** dims_ has joined #openstack-qa13:02
*** jhenner1 has joined #openstack-qa13:03
*** mkollaro has quit IRC13:03
*** mkollaro1 has joined #openstack-qa13:03
*** mkollaro1 is now known as mkollaro13:03
*** matsuhashi has quit IRC13:03
*** jhenner has quit IRC13:04
*** saju_m has quit IRC13:04
*** tkammer has quit IRC13:05
*** saju_m has joined #openstack-qa13:05
*** nmagnezi has quit IRC13:06
*** Atti_ has quit IRC13:07
*** saju_m has quit IRC13:09
*** saju_m has joined #openstack-qa13:10
*** nmagnezi has joined #openstack-qa13:19
*** dkranz has joined #openstack-qa13:21
*** ChanServ changes topic to "the gerrit event stream is currently hung, blocking all testing. troubleshooting is in progress (next update at 14:00 utc)"13:21
*** tkammer has joined #openstack-qa13:23
*** GMann has joined #openstack-qa13:24
openstackgerritMauro Rodrigues proposed a change to openstack/tempest: Refactors cleanup resource for scenario  https://review.openstack.org/8270913:26
*** Madan has quit IRC13:26
*** mriedem has joined #openstack-qa13:27
*** mestery has joined #openstack-qa13:28
*** mestery has quit IRC13:28
*** mestery has joined #openstack-qa13:29
*** ChanServ changes topic to "All Things OpenStack QA"13:30
*** markmcclain has quit IRC13:34
*** yamahata has joined #openstack-qa13:38
*** nati_ueno has joined #openstack-qa13:40
*** luqas has joined #openstack-qa13:42
Anju1sdague:  hii, sry  I did not answer at that time13:48
Anju1sdague:  I am proposing a patch to delete that test ..we do not need it13:49
sdagueAnju1: yes, that sounds reasonabl13:49
sdagueis the review up somewhere yet?13:50
*** shwetaap has joined #openstack-qa13:50
Anju1today I found that :) and give that the bug to review it :) will do it as soon as possible13:51
sdagueAnju1: great13:51
openstackgerritMatt Riedemann proposed a change to openstack/tempest: Move pause_available class variable into skip decorators  https://review.openstack.org/8253513:58
openstackgerritMatt Riedemann proposed a change to openstack/tempest: Move suspend_available class variable into skip decorators  https://review.openstack.org/8253413:58
openstackgerritMatt Riedemann proposed a change to openstack/tempest: Disable other suspend/resume tests if not supported  https://review.openstack.org/8241013:58
openstackgerritMatt Riedemann proposed a change to openstack/tempest: Move run_ssh class variable into skip decorators  https://review.openstack.org/8253713:58
openstackgerritMatt Riedemann proposed a change to openstack/tempest: Honor suspend/pause config switches in scenario tests  https://review.openstack.org/8256613:58
openstackgerritMatt Riedemann proposed a change to openstack/tempest: Move resize_available class variable into skip decorators  https://review.openstack.org/8253613:58
mriedemmtreinish: rebased to put armando's fix before all mine ^13:58
*** nati_ueno has quit IRC13:59
openstackgerritSteven Hardy proposed a change to openstack/tempest: orchestration API refactor test_list_resources  https://review.openstack.org/8282814:02
openstackgerritSteven Hardy proposed a change to openstack/tempest: orchestration API add coverage for stack update API  https://review.openstack.org/8282914:02
openstackgerritSteven Hardy proposed a change to openstack/tempest: orchestration remove unused invalid_template_url  https://review.openstack.org/8257514:02
openstackgerritSteven Hardy proposed a change to openstack/tempest: orchestration add API tests for list query arguments  https://review.openstack.org/8257714:02
openstackgerritSteven Hardy proposed a change to openstack/tempest: orchestration add resource limit API test  https://review.openstack.org/8257614:02
*** nmagnezi has quit IRC14:02
*** pafuent has joined #openstack-qa14:06
openstackgerritYaroslav Lobankov proposed a change to openstack/tempest: Sahara: added new api tests  https://review.openstack.org/7159214:06
*** malini_afk is now known as malini14:06
pafuentHi. Can someone take a look at this patch https://review.openstack.org/#/c/81909/?14:07
openstackgerritanju Tiwari proposed a change to openstack/tempest: Removed unnecessary test from account test  https://review.openstack.org/8283014:07
openstackgerritanju Tiwari proposed a change to openstack/tempest: Fliter images with container and disk format  https://review.openstack.org/8228114:07
mtreinishmriedem: it looks like auto-rebase +2'd it for me14:08
*** jhenner1 has quit IRC14:08
*** tosky has joined #openstack-qa14:08
mriedemmtreinish: yeah, except https://review.openstack.org/#/c/82410/ but was just an fyi as to the big rebase14:08
*** akamyshnikova_ has joined #openstack-qa14:09
sdaguemriedem: thank you for super easy to review patches :)14:12
sdaguemtreinish: I do have an issue with armando's base patch though, because it does partial skips of a test14:12
*** ken1ohmichi has quit IRC14:13
sdagueand I think we need to treat tests as attomic, so you can skip the whole thing if you like, but not parts14:13
mtreinishI don't even think I've looked at it yet14:13
sdaguehttps://review.openstack.org/#/c/82566/4/tempest/scenario/test_server_basic_ops.py14:14
sdagueother than that issue, I'm good with the whole series14:14
mtreinishyeah that's wrong14:14
mriedemsdague: i'll take that as a compliment14:15
sdaguemriedem: it was meant as one14:16
mriedemi'm still reeling for low-level sarcasm in nova yesterday :)14:16
sdagueheh14:16
mriedem*from14:16
sdagueI'm getting very tired of reviews that have "Also... " in their commit message14:16
sdaguemake reviews easy to process, and they will get reviewed much more quickly14:17
sdaguehonestly, I think we could almost hacking enforce on if you start a paragraph with Also, fail the review14:18
sdaguebecause they are always doing too much14:18
mtreinishsdague: I normally use "In addition" :)14:19
*** jasondotstar has quit IRC14:21
*** jhenner has joined #openstack-qa14:21
*** sthaha has quit IRC14:22
*** mestery has quit IRC14:24
openstackgerritanju Tiwari proposed a change to openstack/tempest: Removed unnecessary test from account test  https://review.openstack.org/8283514:24
*** mkollaro has quit IRC14:26
*** nmagnezi has joined #openstack-qa14:29
openstackgerritanju Tiwari proposed a change to openstack/tempest: Removed unnecessary test from account test  https://review.openstack.org/8283514:30
*** markmcclain has joined #openstack-qa14:32
*** markmcclain has quit IRC14:32
*** mestery has joined #openstack-qa14:33
*** tkammer has quit IRC14:33
*** markmcclain has joined #openstack-qa14:33
openstackgerritAlexander Bochkarev proposed a change to openstack/tempest: Add compute pollsters tests for ceilometer  https://review.openstack.org/8096514:35
*** otherwiseguy has joined #openstack-qa14:37
*** mkollaro has joined #openstack-qa14:41
*** tkammer has joined #openstack-qa14:46
*** jasondotstar has joined #openstack-qa14:46
*** kgriffs_afk is now known as kgriffs14:59
*** luqas has quit IRC15:03
openstackgerritAnn Kamyshnikova proposed a change to openstack/tempest: Verify more information in floating ip tests  https://review.openstack.org/6372315:05
andreafmtreinish: ping15:07
*** adalbas has quit IRC15:08
jaypipesmtreinish, sdague: core love on https://review.openstack.org/#/c/79942. Looks good to go IMO.15:08
*** cmart has joined #openstack-qa15:09
sdaguejaypipes: +A15:10
jaypipescheerio15:10
sdaguejogo: is https://review.openstack.org/#/c/82630/ something you are comfortable works around the libvirt issue?15:11
*** saju_m has quit IRC15:13
mtreinishandreaf: what's up15:14
mkoderersdague: mtreinish: could we get this approved https://review.openstack.org/#/c/80926/, I would really like to get rid of the dirty hack15:16
andreafmtreinish: about the config fixture again - if I want to change some config in a test, is it right to do cfg.CONF.set_default() ?15:17
andreafmtreinish: in the test itself, that is15:18
openstackgerritYaroslav Lobankov proposed a change to openstack/tempest: Sahara: added tests for job binaries  https://review.openstack.org/7466815:18
andreafmtreinish: the fixture cleanup shall reset the whole config anyways, so I do not need any additional cleanup I think15:19
mtreinishandreaf: yeah that's the right way15:19
mtreinishthe fixture cleanup runs reset() so it will be undone after the test15:19
andreafmtreinish: ok thanks15:20
mtreinishmkoderer: +A15:20
mkoderermtreinish: thanks!15:20
*** mestery has quit IRC15:24
openstackgerritYaroslav Lobankov proposed a change to openstack/tempest: Sahara: added new api tests  https://review.openstack.org/7159215:28
openstackgerritLonggeek proposed a change to openstack-dev/devstack: Increase in the full path to mkfs.xfs(/sbin/mkfs.xfs).  https://review.openstack.org/8245915:28
*** GMann has quit IRC15:29
openstackgerritYaroslav Lobankov proposed a change to openstack/tempest: Sahara: added tests for job binaries  https://review.openstack.org/7466815:30
*** otherwiseguy has quit IRC15:32
openstackgerritA change was merged to openstack/tempest: Renew token before expiry time  https://review.openstack.org/8204615:33
andreafsdague, mkoderer, afazekas, dkranz: lock support for unit test by mtreinish: https://review.openstack.org/#/c/81896/ could you have a look?15:41
*** krtaylor has quit IRC15:42
*** akamyshnikova_ has quit IRC15:43
sdaguemtreinish: is there any cleanup path?15:43
sdaguehonestly, lacking a cleanup path I'd rather make it just TMPDIR15:43
*** rossella_ has quit IRC15:44
mtreinishso it's an external dir being set it's outside of a test cleanup. I tried using a tmpdir at first but the way fake config is used there is a global state issue15:44
mtreinishthe tmpdir would get recreated for each test15:44
mtreinishwhich doesn't work for locking15:44
*** rossella_ has joined #openstack-qa15:45
mtreinishsdague: the locks should clean themselves up after they're used15:45
mtreinishoh nm you meant a bash tmpdir in the testr conf15:46
mtreinishsdague: yeah that should workj15:46
sdaguemtreinish: no I'm concerned about the tempest dir itself15:46
sdagueif it's $TMPDIR as a default15:47
sdaguethat will exist15:47
sdaguethe only reason we don't use that as a default in oslo is because of possible attacks via tempdir15:47
sdaguebut I don't think that applies here15:47
mtreinishyeah I don't think there's a sec issue for tempest unit tests15:48
andreafsdague, mtreinish: so bottom line we could just do os.getenv('TMPDIR') ?15:50
openstackgerritMatthew Treinish proposed a change to openstack/tempest: Add config fixture support to unit tests  https://review.openstack.org/8189615:50
*** krtaylor has joined #openstack-qa15:50
sdagueandreaf: well - probably ${TMPDIR:-/tmp}15:50
sdaguebecause TMPDIR is not required to be defined15:50
openstackrecheckConsole logs not available after 13:47s for gate-tempest-pep8 82535,3,c53428e15:50
*** luqas has joined #openstack-qa15:51
sdaguemtreinish: I think it needs to tweak once more, put in an proposed line15:51
mtreinishok, you can nest it like that?15:51
openstackrecheckopenstack/tempest change: https://review.openstack.org/81551 failed because of: gate-grenade-dsvm: https://bugs.launchpad.net/bugs/126290615:51
sdagueI'm pretty sure15:52
sdaguedtroyer might tell me otherwise15:52
mtreinishok I'll give it a shot15:53
mtreinishshould it default to /tmp or /tmp/tempest-locks like I had originally?15:53
andreafit looks like it works, at least in my version of bash15:53
andreafmtreinish: I'd say /tmp that's likely to exist15:54
andreaf^_^15:54
mtreinishandreaf: well I had the code to create the dir if it didn't exist15:54
*** Aimon has quit IRC15:55
*** amotoki_ has joined #openstack-qa15:56
andreafmtreinsh: right :P15:57
openstackgerritMatthew Treinish proposed a change to openstack/tempest: Add config fixture support to unit tests  https://review.openstack.org/8189615:57
*** yfried has quit IRC15:57
sdaguemtreinish: so my feeling is /tmp15:58
sdaguebecause then you don't leave any crud around15:58
sdaguebecause there is no good way to clean up /tmp/tempest-locks15:59
*** mestery has joined #openstack-qa15:59
mtreinishsdague: ok I assumed that would be your answer. The latest revision uses /tmp with the nested defaults16:01
*** Sukhdev has joined #openstack-qa16:02
*** Sukhdev has quit IRC16:06
*** Aimon has joined #openstack-qa16:07
*** mestery has quit IRC16:09
*** mestery has joined #openstack-qa16:10
*** rhsu has joined #openstack-qa16:11
openstackgerritA change was merged to openstack/tempest: Adds more verification in list alarms  https://review.openstack.org/7994216:15
*** nati_ueno has joined #openstack-qa16:17
psedlakjhenner: ping16:19
jhennerpsedlak: pong16:20
*** atiwari has joined #openstack-qa16:20
jhennerpsedlak: makej, musim letět16:20
psedlakjhenner: v tech zmenach pro workaroundy (vnc port, python-suds) prosim vsude pridej LOG.warning('Woraround ...)16:20
jhennerpsedlak: njn16:21
psedlakjhenner: a idealne python-suds instaluj pres ten install helper metodu z common16:21
jhennerpsedlak: njn16:21
openstackgerritJordan Pittier proposed a change to openstack-dev/devstack: Check setup.cfg exists before calling requirements:update.py  https://review.openstack.org/8285716:21
*** dkranz has quit IRC16:22
*** nmagnezi has quit IRC16:22
*** yrabl has quit IRC16:22
*** tkammer has quit IRC16:25
*** andreaf has quit IRC16:27
*** mmaglana has joined #openstack-qa16:28
*** nati_ueno has quit IRC16:30
*** catohornet__ has joined #openstack-qa16:31
openstackrecheckopenstack/nova change: https://review.openstack.org/67825 failed gate-tempest-dsvm-full in the gate queue with an unrecognized error16:32
*** dkranz has joined #openstack-qa16:35
*** mmaglana_ has joined #openstack-qa16:35
*** mmaglana has quit IRC16:38
*** adalbas has joined #openstack-qa16:38
*** rhsu has quit IRC16:41
*** mmaglana has joined #openstack-qa16:41
*** mmaglana_ has quit IRC16:44
openstackgerritJordan Pittier proposed a change to openstack/tempest: Skip volume snapshot tests if feature is not enabled  https://review.openstack.org/8149816:47
*** IzikPenso has joined #openstack-qa16:54
*** torandu has joined #openstack-qa16:56
*** rossella_s has joined #openstack-qa16:56
*** torandu has quit IRC16:57
IzikPensoHello, anybody knows if there's a tempest test that tries to configure a instance with more then 1 network ?16:57
*** torandu has joined #openstack-qa16:57
*** markmcclain1 has joined #openstack-qa17:01
*** markmcclain1 has quit IRC17:01
*** markmcclain1 has joined #openstack-qa17:02
*** markmcclain has quit IRC17:02
*** nati_ueno has joined #openstack-qa17:02
*** harlowja has joined #openstack-qa17:03
*** rossella_ has quit IRC17:04
*** morganfainberg_Z is now known as morganfainberg17:04
*** mkollaro has quit IRC17:07
openstackgerritRossella Sblendido proposed a change to openstack/tempest: Commit to test Neutron full job  https://review.openstack.org/7790517:08
*** rhsu has joined #openstack-qa17:09
*** kgriffs is now known as kgriffs_afk17:10
*** mkollaro has joined #openstack-qa17:10
*** safchain has quit IRC17:11
openstackgerritA change was merged to openstack/tempest: Remove usage of internal library function in basic generator  https://review.openstack.org/8096317:16
openstackgerritA change was merged to openstack/tempest: Verify the response attributes of 'list_aggregates'  https://review.openstack.org/8148317:16
*** jordanP has quit IRC17:19
openstackgerritA change was merged to openstack/tempest: Validate get keypair attributes of Nova V2/V3 API  https://review.openstack.org/8091917:20
*** mriedem has quit IRC17:20
*** catohornet__ has quit IRC17:24
*** andreaf has joined #openstack-qa17:25
openstackgerritNachi Ueno proposed a change to openstack/tempest: Remove test for obsolated port_filter on Neutron  https://review.openstack.org/8288017:25
*** amotoki_ has quit IRC17:29
*** salv-orlando has joined #openstack-qa17:30
*** cmart has quit IRC17:32
*** mitchm has joined #openstack-qa17:32
openstackgerritA change was merged to openstack/tempest: Introduce load_tests mechanism for negative tests  https://review.openstack.org/8092617:33
openstackrecheckConsole logs not available after 13:27s for gate-keystone-python33 80618,10,5f11cf517:33
openstackgerritA change was merged to openstack-dev/devstack: Improve log level conf for Sahara  https://review.openstack.org/7867717:33
nati_uenoHi folks. Could you review https://review.openstack.org/#/c/82880/ ? This is needed for fixing critical bug in neutron17:35
*** Sukhdev has joined #openstack-qa17:35
mtreinishnati_ueno: I already reviewed I think you pasted the wrong bug number17:35
nati_uenomy bad..17:35
openstackgerritNachi Ueno proposed a change to openstack/tempest: Remove test for obsolated port_filter on Neutron  https://review.openstack.org/8288017:36
*** markmcclain1 has quit IRC17:36
nati_uenomtreinish: Thanks! I fixed17:36
openstackgerritA change was merged to openstack-dev/devstack: VMware: Use multiline for cluster_name opt  https://review.openstack.org/8264817:37
openstackgerritA change was merged to openstack-dev/devstack: Ironic: Use HOST_IP instead of SERVICE_HOST  https://review.openstack.org/8260417:37
sdaguenati_ueno: I continue to not understand the reason for why it's a critical neutron bug17:43
sdaguecan you enhance the commit message to explain it to me?17:43
nati_uenosdague: so currently, neutron security group is broken.17:43
nati_uenosdague: This fix is needed to fix it17:44
sdaguehow and why?17:44
nati_uenosdague: so we can't use iptables with OVS17:44
nati_uenosdague: so we need hybrid vif driver for OVS17:44
nati_uenosdague: We had a hybrid driver before, but it is removed now17:44
nati_uenosdague: we have only generic driver which need input from neutron side17:45
nati_uenosdague: This fix will send a parameter from neturon to nova to decide vif-plug mode17:45
sdagueok, none of that explains how deleting a test fixes neutron17:46
*** mriedem has joined #openstack-qa17:46
nati_uenosdague: sorry, OK so before we have cap_filter which is totally unused anywhere17:46
*** markmcclain has joined #openstack-qa17:46
nati_uenoIn previous discussion, we decided to replace cap_filter to some paramters17:47
nati_uenoIn order to fix that bug, we need new set of paramters17:47
nati_uenoHowever, tempest has a test for cap_filter which will be obsolated17:47
sdagueok, that's more like it. So can you update the commit message with this context, as a couple of paragraphs in there17:48
nati_uenosdague: sure!17:48
sdaguewhen reviewing changes, it's really important to have the context17:48
*** mestery_ has joined #openstack-qa17:48
*** mestery has quit IRC17:48
sdagueotherwise I mostly ignore or -1 the change17:48
*** mestery_ is now known as mestery17:50
openstackgerritA change was merged to openstack/tempest: Fail a test if stack delete failed  https://review.openstack.org/8239217:51
*** torandu_ has joined #openstack-qa17:51
*** torandu_ has quit IRC17:51
*** mlavalle has joined #openstack-qa17:51
openstackgerritNachi Ueno proposed a change to openstack/tempest: Remove test for obsolated port_filter on Neutron  https://review.openstack.org/8288017:52
nati_uenosdague: I got it. How about new commit message?17:52
sdaguenati_ueno: yes, please update with a new commit message with the context, then I'm probably +217:52
nati_uenosdague: I mean i updated the commit message with context https://review.openstack.org/#/c/82880/17:53
*** mitchm has quit IRC17:54
sdaguenati_ueno: also, is there an outstanding neutron change that's related?17:54
sdaguethat this is blocking17:54
*** torandu has quit IRC17:54
nati_uenosdague: let me add that review in the commit message17:55
sdagueif so, that's good to have here, because normally we require dropping tests like this to have a change on the project17:55
sdaguewhich already has a +2 on it17:55
sdagueso we know the project wants to drop that test17:55
openstackgerritNachi Ueno proposed a change to openstack/tempest: Remove test for obsolated port_filter on Neutron  https://review.openstack.org/8288017:56
nati_uenohttps://review.openstack.org/#/c/21946/ is a neutron test17:56
nati_uenosorry neutron patch17:56
nati_uenoWhich will be -1 from Jenkins due to this tempest test17:56
sdaguenati_ueno: yep17:57
sdaguenati_ueno: ok, link that17:57
sdaguebut you also need neutron core +2 on that17:57
nati_uenoI believe this is community decision (please take a look discussion in bug report)17:57
*** markmcclain has quit IRC17:58
sdagueif you have a +2 on the neutron patch, we call that good enough on the tempest side, but we do want that as well.17:58
nati_uenosdague: added https://review.openstack.org/#/c/82880/17:58
*** torandu has joined #openstack-qa17:58
nati_uenosdague: hmm this is a  dead lock, neutron core wan't see Jenkins's +1..17:58
nati_uenosdague: How about let Mark talk with you about this?17:58
nati_uenosdague: Or I can start discussion in the mailing list17:59
sdaguenati_ueno: sure17:59
openstackgerritA change was merged to openstack/tempest: Refactor create_ and update_ methods for floating ips  https://review.openstack.org/8092817:59
sdagueor we can do this in -neutron right now17:59
nati_uenosdague: sure17:59
nati_uenosdague: hmm Mark isn't online now18:00
nati_uenosdague: I'll send a mail for you and mark18:00
*** catohornet__ has joined #openstack-qa18:01
*** kgriffs_afk is now known as kgriffs18:02
*** mitchm has joined #openstack-qa18:04
sdaguenati_ueno: on the mailing list please, I largely ignore private emails on stuff like this18:04
*** dkranz has quit IRC18:05
nati_uenosdague: sure18:05
*** Matt2 has left #openstack-qa18:06
*** torandu has quit IRC18:07
*** torandu has joined #openstack-qa18:07
*** yfried has joined #openstack-qa18:13
*** catohornet__ has quit IRC18:15
*** Matt1 has joined #openstack-qa18:16
*** jasondotstar has quit IRC18:18
*** dkranz has joined #openstack-qa18:19
pafuentHi. Can someone take a look at this patch https://review.openstack.org/#/c/81909/?18:19
*** jasondotstar has joined #openstack-qa18:21
*** catohornet__ has joined #openstack-qa18:27
openstackrecheckopenstack/keystone change: https://review.openstack.org/70816 failed because of: gate-tempest-dsvm-neutron-heat-slow: https://bugs.launchpad.net/bugs/129587618:28
*** yassine has quit IRC18:33
*** IzikPenso has quit IRC18:35
*** mlavalle_ has joined #openstack-qa18:36
*** mlavalle has quit IRC18:37
*** mlavalle_ is now known as mlavalle18:37
*** yassine has joined #openstack-qa18:39
sdaguemtreinish: how do you feel about getting the heat templates out of python and into yaml files?18:39
sdaguepafuent: so 2 things about that review18:41
sdaguewhich are mostly preexisting issues with that test18:41
sdaguetest file18:41
sdaguecould we extract the template into a yaml file properly18:42
pafuentsdague: Ok, no problem.18:42
sdaguethe other issue is, all the real work happens in setupClass ?18:43
sdagueit's hard to get the timing, because all the tests take 0.002s (give or take)18:43
mtreinishsdague: I'm fine with that my concern is 2 things though: is there inhertance with the yaml files so we can abstract out common chunks18:44
sdaguecould we instead remove setupClass, put the call in setup and move the tests into a single test function18:44
pafuentsdague: Yes18:44
mtreinishand hardcoded resource names/types in yaml files18:44
sdaguemtreinish: heat has it's own variable interpolation18:44
sdagueso the answer should be no18:44
pafuentsdague: But all the test will create the same stack18:45
mtreinishsdague: ok yeah if heat will do the variable interpolation then there shouldn't be an issue there18:45
mtreinishbut what about duplication between yaml files18:45
pafuentsdague: (The Yes was for all the work is made in setupClass)18:45
*** yfried has quit IRC18:45
*** yfried has joined #openstack-qa18:45
sdaguepafuent: any idea how long the setupClass takes?18:46
pafuentsdague: No, but takes time18:46
sdaguemtreinish: any idea if we actually get timing results out of setup added to tests ?18:46
mtreinishsdague: I don't think we have separate setup timings18:47
mtreinishwe'd have to do that manually or inject it into the subunit18:48
mtreinishor do you mean something else?18:48
sdaguemtreinish: I'm trying to figure out if work in setup gets added to the test time18:49
*** jpich has quit IRC18:49
sdaguebasically if we did setup + 1 test, vs setupclass + 10 tests, if we would have more accuracy in if things are slow or not18:49
*** kgriffs is now known as kgriffs_afk18:50
mtreinishso I think setup might get counted but not setupclass (but that's just my guess)18:50
sdaguealso, if testr is smart enough to not run setupclass if we regex skip all it's tests18:50
mtreinishlifeless should know the answer though18:50
sdagueyeh, I think it's early for lifeless to be on18:50
openstackrecheckopenstack/neutron change: https://review.openstack.org/82746 failed gate-neutron-python26 in the gate queue with an unrecognized error18:52
clarkbI am pretty sure setupclass is not run if none of the jobs use that class18:53
mtreinishclarkb: yeah I think you're right about that18:54
mtreinishit should be pretty easy to verify too18:54
clarkbthe names encode the module path so it is easy for the test runner to not run things when the class isn't used18:54
*** tosky has quit IRC18:55
sdaguecool18:55
sdagueso in looking at the existing heat tests in tempest, I think we can simplify a lot of them18:55
*** dkorn has joined #openstack-qa18:56
sdaguefolks were doing a lot of copy / paste from some of the other tests that really lean hard on setupClass, and I think we don't want to do that here18:56
openstackgerritSean Dague proposed a change to openstack/tempest: simplify heat test_limits  https://review.openstack.org/8289418:57
*** jlibosva has quit IRC19:00
mtreinishsdague: probably not19:00
lifelesssdague: mtreinish: hi19:01
sdaguelifeless: question on time reporting19:01
sdaguedo we get the time for setup added to the time for the test?19:01
*** rhsu has quit IRC19:04
lifelesssdague: yes, but not class setup19:07
sdagueok19:07
lifelessclass setup is done by the suite that wraps the case, rather than the case itself19:07
sdagueyes, that's what I was hoping19:07
sdaguethat gives me incentive to restructure the heat tests so we do more with setup19:08
sdaguebecause right now it's really hard to evaluate what's slow or not with all the time keeping hidden away19:08
mtreinishclarkb: actually I think setupclass does run even if all the tests are skipped: http://paste.openstack.org/show/74284/19:09
clarkbmtreinish: huh, I wouldn't expect test runners to import the class at all in that case19:09
clarkbI suppose import may happen if colocated with other classes that are run19:10
clarkbbut surely it shouldn't execute the setupClass19:10
*** dkranz has quit IRC19:10
mtreinishclarkb: hmm yeah it's because they're in the same file I think19:11
mtreinishwhen I added a new file with all skips it doesn't run that one19:12
clarkbinteresting19:13
clarkbI bet it is tied to import behavior then19:13
*** yfried has quit IRC19:14
*** malini is now known as malini_afk19:16
*** openstackgerrit has quit IRC19:18
*** openstackgerrit has joined #openstack-qa19:18
*** kgriffs_afk is now known as kgriffs19:21
mtreinishsdague: do you want to push this through?: https://review.openstack.org/#/c/82531/19:22
mtreinishI think we should merge it before we add anything else to the repo19:22
*** dkranz has joined #openstack-qa19:22
openstackgerritA change was merged to openstack/qa-specs: Add sphinx support to qa-specs repo  https://review.openstack.org/8253119:23
sdaguemtreinish: yep, done19:23
*** catohornet__ has quit IRC19:26
*** zul has quit IRC19:26
*** zul has joined #openstack-qa19:30
*** luqas has quit IRC19:32
*** Sukhdev has quit IRC19:35
*** dkorn has quit IRC19:51
*** rhsu has joined #openstack-qa19:57
openstackgerritSean Dague proposed a change to openstack/tempest: factor out templates to yaml files  https://review.openstack.org/8290520:00
sdaguemtreinish: that's not complete yet, however please take a look when you can20:00
mtreinishsdague: sure looking at it now20:01
openstackrecheckopenstack/oslo.messaging change: https://review.openstack.org/81261 failed gate-tempest-dsvm-neutron in the gate queue with an unrecognized error20:04
mtreinishsdague: I really like how it cleans up those test files20:05
sdagueok, I'll worth through the template extract as a single patch then20:06
sdagues/worth/work/20:06
sdaguethere is another issue with class variables being used everywhere20:06
sdaguebut I think that's follow on20:06
mtreinishyeah I noticed that too20:07
*** torandu has quit IRC20:09
*** torandu has joined #openstack-qa20:09
*** yassine has quit IRC20:12
*** torandu has quit IRC20:17
*** jasondotstar has quit IRC20:20
*** yfried has joined #openstack-qa20:23
*** torandu has joined #openstack-qa20:23
*** mkollaro has quit IRC20:23
*** dkorn has joined #openstack-qa20:27
openstackgerritAndrea Frittoli  proposed a change to openstack/tempest: Official client based auth  https://review.openstack.org/8291120:28
openstackgerritAndrea Frittoli  proposed a change to openstack/tempest: Use auth data to fill credentials  https://review.openstack.org/8211120:28
openstackgerritAndrea Frittoli  proposed a change to openstack/tempest: Define V3 Credentials  https://review.openstack.org/8187220:28
openstackgerritAndrea Frittoli  proposed a change to openstack/tempest: Get credential IDs from Credentials class  https://review.openstack.org/8024620:28
openstackgerritAndrea Frittoli  proposed a change to openstack/tempest: Enforces the use of Credentials (part1)  https://review.openstack.org/7759420:28
openstackgerritAndrea Frittoli  proposed a change to openstack/tempest: Enforces the use of Credentials (part2)  https://review.openstack.org/8211220:28
openstackgerritAndrea Frittoli  proposed a change to openstack/tempest: Access credential fields as attributes  https://review.openstack.org/8211320:28
openstackgerritAndrea Frittoli  proposed a change to openstack/tempest: Add config fixture support to unit tests  https://review.openstack.org/8189620:28
openstackgerritAndrea Frittoli  proposed a change to openstack/tempest: Defines a Credentials class  https://review.openstack.org/7438720:28
*** rockyg has joined #openstack-qa20:28
jogosdague: not yet, I'll mark as WIP20:29
andreafmtreinish: I rebased my growing pile of patchsets on top of latest master + your unit test change for locks (https://review.openstack.org/#/c/81896/). Also I fixed unit tests so they pass now even with 4 parallel processes20:30
mtreinishandreaf: nice20:31
mtreinishI'll try to take a look soon20:31
andreafmtreinish: thanks20:31
*** mkollaro has joined #openstack-qa20:32
mtreinishandreaf: what was it you needed to do for the unit tests20:32
andreafmtreinish: I simplified things a bit I just have a single FakeConfig now20:33
andreafmtreinish: plus I had some genuine bugs to fix in the unit tests20:33
andreafmtreinish: one bug at least - you can compare patchset 4 and 5 here https://review.openstack.org/#/c/81872/4..5/tempest/tests/test_credentials.py20:34
andreafafazekas, maurosr: I had to rebase https://review.openstack.org/#/c/74387/ - can I have your review back? thanks!20:37
*** adalbas has quit IRC20:38
*** otherwiseguy has joined #openstack-qa20:39
openstackgerritAdam Gandelman proposed a change to openstack/tempest: Adds Ironic test_ironic_basic_ops scenario test  https://review.openstack.org/8195820:46
maurosrandreaf: sure20:47
openstackrecheckopenstack/heat change: https://review.openstack.org/82716 failed gate-tempest-dsvm-postgres-full in the gate queue with an unrecognized error20:56
openstackgerritSean Dague proposed a change to openstack/tempest: simplify heat test_limits  https://review.openstack.org/8289421:06
openstackgerritSean Dague proposed a change to openstack/tempest: factor out templates to yaml files  https://review.openstack.org/8290521:06
sdaguemtreinish: ok, I think that's a real pass 121:06
sdagueunwinding this stuff is a bit of a mess21:06
sdaguebut given the push to get more in here doing it now should save us a ton of time later21:06
*** aysyd has quit IRC21:07
*** pafuent has quit IRC21:08
*** mlavalle has quit IRC21:09
*** rfolco has quit IRC21:12
mtreinishsdague: how about some unit tests for the template loader...21:12
mtreinishthat should be pretty straightforward21:12
mtreinishsdague: so I'm curious you're doing the yaml.load and json.load in the template reader21:20
mtreinishbut in the tests before it passed the raw string21:20
mtreinishdoesn't the load convert it to a python dict21:20
mtreinishso aren't you changing the test21:20
sdagueoh... right21:20
sdagueyep21:20
sdaguewell, it would blow up in tests21:20
openstackgerritTushar Kalra proposed a change to openstack/tempest: Typo in config.py  https://review.openstack.org/8259921:25
dkranzsdague: I'm seeing a lot of patches for validating json return payloads. Are you thinking reviewers are going to verify that the list is correct. If so, how?21:28
*** beisner is now known as beisner-afk21:29
*** beisner-afk is now known as beisner21:29
mtreinishdkranz: I thought they were just copies of the nova jsonschema21:34
mtreinishbut I haven't looked at one in detail yet21:34
sdaguedkranz: my take is that was locking down existing behavior (especially for the v2 proxy on v3 for nova)21:36
sdagueso execution results and basic sanity checking should be sufficient21:36
*** dkranz has quit IRC21:36
sdaguemtreinish: so the issue with the unit test is we'll have to make that function a lot more complicated to test it21:39
sdaguebecause it's a hard coded path for the heat tests21:39
openstackgerritA change was merged to openstack/tempest: Test current tenant not added to private flavor  https://review.openstack.org/8155121:39
sdagueI feel like the fact that it will explode if it does a bad thing is sufficient testing, as it doesn't have a silent fail path21:39
sdagueespecially in this iteration21:40
openstackgerritSean Dague proposed a change to openstack/tempest: factor out templates to yaml files  https://review.openstack.org/8290521:40
mtreinishsdague: why is hard? just mock the open call21:41
sdagueso what exactly are you going to test then...21:42
sdaguethat string concat works?21:42
mtreinishheh yeah I guess I was thinking the fail path with extensions21:42
mtreinishbut if you're not doing loads anymore it's not really needed21:42
sdagueyeh21:42
*** jeblair_ has joined #openstack-qa21:42
sdagueoh, I need to remove the imports21:43
*** jeblair_ is now known as corvus21:43
openstackgerritSean Dague proposed a change to openstack/tempest: factor out templates to yaml files  https://review.openstack.org/8290521:43
*** jeblair has quit IRC21:45
*** corvus is now known as jeblair21:45
*** StevenK has quit IRC21:47
*** russellb has quit IRC21:47
*** zigo has quit IRC21:47
*** wendar has quit IRC21:47
*** StevenK has joined #openstack-qa21:47
*** russellb has joined #openstack-qa21:48
*** mwagner_lap has quit IRC21:49
*** wendar has joined #openstack-qa21:49
*** zigo has joined #openstack-qa21:49
*** mriedem has quit IRC21:50
*** catohornet__ has joined #openstack-qa21:50
*** malini_afk is now known as malini21:52
*** torandu has quit IRC21:55
openstackrecheckopenstack/keystone change: https://review.openstack.org/70816 failed gate-tempest-dsvm-full in the gate queue with an unrecognized error22:05
*** shwetaap has quit IRC22:09
*** catohornet___ has joined #openstack-qa22:11
*** catohornet__ has quit IRC22:15
openstackgerritMatthew Treinish proposed a change to openstack/qa-specs: Add spec for bp:config-verification  https://review.openstack.org/8293322:17
*** dims_ has quit IRC22:18
*** catohornet____ has joined #openstack-qa22:19
*** catohornet____ is now known as catohornet__22:19
*** catohornet___ has quit IRC22:21
mtreinishsdague: ^^^ run tox -ebuild_specs on that, the html version looks pretty good I think22:21
openstackgerritMatthew Treinish proposed a change to openstack/qa-specs: Add spec for bp:config-verification  https://review.openstack.org/8293322:26
adam_gany pointers on this testr failure? having trouble reproducing locally    http://logs.openstack.org/58/81958/2/check/check-tempest-dsvm-full/723ae7e/console.html22:29
openstackgerritMatthew Treinish proposed a change to openstack/qa-specs: Add a license file  https://review.openstack.org/8293422:29
mtreinishadam_g: well something you add in a base file is causing an exception when the test runner imports the file22:30
mtreinishthat's why all the test files are listed after 'import errors'22:30
mtreinishit could be something as simple as a syntax error22:31
*** catohornet__ has quit IRC22:32
adam_gmtreinish, i figured as much, but having trouble replicating that locally. running the equivalent commands here seem to import and run things fine22:32
*** dims_ has joined #openstack-qa22:34
* adam_g wonders about dependencies22:35
mtreinishadam_g: that might be it, when I ran it locally I got a ironicclient import error because I didn't have it installed22:35
mtreinishI'm assuming devstack took care of that though22:35
clarkbif you install testrepository from latest source the message is much better22:35
adam_gmtreinish, yeah--ironicclient was my first thought22:36
adam_gclarkb, oh, cool22:36
mtreinishadam_g: yeah you'll definitely need to add it to requirements.txt there22:36
adam_gmtreinish, :)22:37
mtreinishbecause I don't think it's there for tempest yet22:37
*** catohornet1 has joined #openstack-qa22:38
mtreinishbut there might be something else too22:38
mtreinishI can look at more tomorrow22:38
*** catohornet1 has quit IRC22:39
*** catohornet1 has joined #openstack-qa22:39
openstackgerritNachi Ueno proposed a change to openstack-dev/devstack: Change NOVA_VIF_DRIVER for ml2 with NeutronFirewallVIFDriver  https://review.openstack.org/8293722:39
*** catohornet1 has quit IRC22:39
*** catohornet1 has joined #openstack-qa22:40
openstackgerritNachi Ueno proposed a change to openstack-dev/devstack: Change NOVA_VIF_DRIVER for ml2 with NeutronFirewallVIFDriver  https://review.openstack.org/8293722:41
openstackgerritAdam Gandelman proposed a change to openstack/tempest: Adds Ironic test_ironic_basic_ops scenario test  https://review.openstack.org/8195822:41
*** catohornet1 has quit IRC22:51
*** sthaha has joined #openstack-qa22:59
openstackgerritA change was merged to openstack/tempest: Verify attributes through Nova "list security groups" API  https://review.openstack.org/8145223:02
*** mwagner_lap has joined #openstack-qa23:02
openstackgerritA change was merged to openstack/tempest: Add a new exception for invalid structure  https://review.openstack.org/8092723:02
*** malini has left #openstack-qa23:04
*** markmcclain has joined #openstack-qa23:10
*** markmcclain1 has joined #openstack-qa23:11
*** otherwiseguy has quit IRC23:13
*** markmcclain has quit IRC23:15
*** rockyg has quit IRC23:16
openstackgerritA change was merged to openstack/tempest: simplify heat test_limits  https://review.openstack.org/8289423:18
*** andreaf has quit IRC23:22
*** krtaylor has quit IRC23:23
openstackrecheckopenstack/tempest change: https://review.openstack.org/78950 failed gate-tempest-dsvm-neutron in the gate queue with an unrecognized error23:24
*** jgrimm has quit IRC23:25
*** giulivo has quit IRC23:28
*** markmcclain1 has quit IRC23:30
*** mkollaro has quit IRC23:30
*** mkollaro has joined #openstack-qa23:31
*** catohornet1 has joined #openstack-qa23:45
openstackgerritChmouel Boudjnah proposed a change to openstack-dev/devstack: Swift3 has been moved to stackforge.  https://review.openstack.org/8294723:45
*** mwagner_ has joined #openstack-qa23:54
*** Aimon has quit IRC23:59

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!