Friday, 2013-07-26

*** mkollaro has quit IRC00:06
*** marun has quit IRC00:10
*** lexinator has quit IRC00:23
*** lexinator has joined #openstack-qa00:27
*** harlowja has quit IRC00:47
*** bclifford has joined #openstack-qa01:18
*** bclifford has left #openstack-qa01:24
*** lexinator has quit IRC01:46
*** anteaya has quit IRC01:56
*** lexinator has joined #openstack-qa02:00
*** sdague has quit IRC02:34
*** sdague has joined #openstack-qa02:44
*** HenryG has joined #openstack-qa02:45
Anjuh03:23
Anjufazekas:good morning03:24
Anjuafazekas_zz :good morning03:24
*** afazekas_zz is now known as afazekas03:29
afazekasAnju: good morning03:29
Anju:)03:29
Anjuafazekas: https://review.openstack.org/#/c/38102/703:30
Anjui correct the comments03:30
Anjugiven03:30
Anjuand it si running in my devstack03:30
Anju resp, server = self.create_server(wait_unti='ACTIVE')03:31
Anjui am doing this03:31
Anjuand remove this self.client.wait_for_server_status(self.server_id, 'ACTIVE')03:31
Anjuis only this  Treinishwants03:33
Anjuafzekas:in all tests the wait call call is after the creation03:36
openstackgerritSreeram Yerrapragada proposed a change to openstack-dev/devstack: Add support for vmdk files as glance images  https://review.openstack.org/3857603:43
*** prekarat has joined #openstack-qa03:43
openstackgerritSreeram Yerrapragada proposed a change to openstack-dev/devstack: Add support for vmdk files as glance images  https://review.openstack.org/3857603:46
openstackgerritanju Tiwari proposed a change to openstack/tempest: Added a server-pause test  https://review.openstack.org/3810203:54
*** lexinator has quit IRC04:19
*** SergeyLukjanov has joined #openstack-qa04:27
*** harlowja has joined #openstack-qa04:46
openstackgerritA change was merged to openstack/tempest: Use nose skip exception conditionally  https://review.openstack.org/3828404:53
Anjuafazekas:ping04:56
Anjusean :ping05:12
Anjusean :please revoiew this  https://review.openstack.org/#/c/38102/705:13
*** afazekas_ has joined #openstack-qa05:15
openstackgerritafazekas proposed a change to openstack/tempest: unskip test_register_get_deregister_ari_image  https://review.openstack.org/3874405:42
*** prekarat has quit IRC05:46
*** SergeyLukjanov has quit IRC05:57
*** mkollaro has joined #openstack-qa05:58
mkodererAnju: pong - I reviewed it.. just some minor findings06:01
Anjumkoderer:06:14
Anjuping06:14
Anjuhii I saw ..06:14
Anjuyesterday the same problme with the blueprint name06:14
Anjumkoderer: i change the name of the blueprint06:15
Anjuand the i commit in the same  branch06:15
mkodererAnju: but it isn't a blueprint for my understanding06:16
Anjumkoderer:https://blueprints.launchpad.net/tempest/+spec/add-negative-test-for-server06:17
mkodererAnju: ok so you change it to be more general06:18
Anjumeans??06:19
mkodererAnju: so pls correct your commit message and add a line "Implements: bp add-negative-test-for-server"06:19
Anjuok ok06:19
mkodererthis will change the topic06:19
Anjuand the commit message is correct?06:19
mkoderermhmh you have still the lowercase issue..06:20
Anjuin "Neagtive"06:20
mkodererso  Negative = negative and Pausing = pausing06:20
Anjuyeah06:20
Anju:P06:20
mkoderer;)06:20
mkodererafazekas: ping06:21
openstackgerritanju Tiwari proposed a change to openstack/tempest: Added a server-pause test  https://review.openstack.org/3810206:24
Anjumkoderer: have a look06:24
Anju:)06:24
Anju11 patches i have committed for a small one06:25
Anju:(06:25
*** mkollaro has quit IRC06:25
mkodererthats typical for the beginning06:31
mkodererdon't worry, it becomes easier with the time :)06:32
Anjuno idea if it is good or bad for me06:32
mkodererAnju: it's good.. since you learn and improve06:34
Anjumkoderer:what is blueprint defination06:34
*** prekarat has joined #openstack-qa06:34
mkodererAnju: you defined a blueprint in launchpad, and usually this must be approved by Sean06:35
Anjuoh god06:35
Anju:)06:35
Anjui dont know what will be his suggestions06:35
mkodererSo it's just that one of the core reviews give a statement about it06:36
mkodererthe patch is good so let's see06:36
Anju:)06:36
Anjuthanks mkoderer06:36
mkodererjust wait until someone awakes ;)06:36
Anjuhe he06:36
Anju:)06:36
Anjuafazekas  is quite busy06:37
openstackgerritnayna-patel proposed a change to openstack/tempest: Added 2 quota related test cases for Neutron API  https://review.openstack.org/3548706:48
afazekas_mkoderer: Pong07:21
afazekas_sorry I left my another machine logged in ..07:21
*** SergeyLukjanov has joined #openstack-qa07:26
mkodererafazekas_: regarding the "skipped" issue07:28
mkodererafazekas_: was there an action item about it?07:28
mkodereris it a blueprint?07:28
mkodererI am just curios of the solution07:29
*** plomakin has quit IRC07:30
afazekas_mkoderer: I have checked several skipped tests,  ec2 ones will be solved (or became easily solvable) after https://wiki.openstack.org/w/index.php?title=Blueprint-ec2-error-codes&mobileaction=toggle_view_desktop  (Looks like the wiki formats the text in different way,  than  at the writing time)07:31
mkodererafazekas_: I mean this solution with the time stamp07:32
*** plomakin has joined #openstack-qa07:32
afazekas_mkoderer: IMHO git blame + git show combination can do it07:33
mkodererok so we could enhance the tool for this07:35
mkodererafazekas_: https://github.com/openstack/tempest/blob/master/tools/skip_tracker.py07:36
mkodererso enhancing it that is show old skips and ignores new ones maybe?07:37
afazekas_git blame tempest/api/compute/images/test_images_oneserver.py | grep testtools.skip\( | cut -f 1 -d' ' | while read a; do  echo -n "$a: "; git show --pretty="%cr" $a| head -1; done07:41
afazekas_770e5a44: 4 months ago07:41
afazekas_Poc07:41
afazekas_we can collect the the age of each line07:41
mkodereryes something like this07:42
afazekas_https://bugs.launchpad.net/nova/+bug/1160749 looks like it became an extension,  so the skip of the quota tests should be a config option07:55
afazekas_Or just the usage of the 'force' ..07:56
afazekas_mkoderer: I think the skip tracker can be anhanced by age and be test case lister. Even an auto unskip patch is possible, but looks like most the skipped issues are real issues and not solved yet07:57
afazekas_One swift related issue is devstack config issue..07:57
afazekas_(or swift default)07:57
mkodererafazekas_: yes I think this would be a good idea - should we call the git commands or should we use a python lib for that?08:00
afazekas_For me both approach is ok08:05
afazekas_AFAIK most people prefers the python libraries in tempest when it is doable08:06
Anjuafazekas:08:08
Anjuhow to parse an json to xml08:08
Anjuhttps://github.com/openstack/tempest/blob/master/tempest/services/volume/xml/volumes_client.py08:10
Anjuin this why the volume_parse function is avialable08:10
Anjuwhat is the functionality of these functions08:11
Anjuin some xml08:11
Anjuonly a xml_to _json function is used08:11
Anjuafazekas_08:12
Anju:ping08:12
afazekas_Long time ago the json client implemented first, and the xml client just came after the json08:16
Anjuafazekas_08:16
afazekas_actually that function  outputs a python dict (or data structure)08:16
afazekas_in this way the test cases can be the same,  just the rest_client needs to be different08:16
Anjui see that in some files08:18
Anjua function exmaple  parse _volume is availble in xml file08:18
*** SergeyLukjanov has quit IRC08:18
afazekas_https://review.openstack.org/#/c/32258/08:19
Anjuhttps://github.com/openstack/tempest/blob/master/tempest/services/compute/json/aggregates_client.py08:19
Anjuhttps://github.com/openstack/tempest/blob/master/tempest/services/compute/xml/aggregates_client.py08:19
Anjusee the difference08:19
afazekas_some cases the automated conversion does not working, in this case they are converted by a dedicated function08:20
Anjuhow one can know that these can not be converted?08:20
afazekas_when it is not working it is clear indicator  :)08:21
Anjunow what is the way08:21
Anjui mean how a list aggreagte funtion is converted08:21
Anjuwhat is basic rule08:21
Anjuas some xml tests are missing08:21
afazekas_you can try to use the xml_to_json at the first time, if you see an issue you need to create a function08:22
Anjuafazekas:08:22
Anjui got a issue08:22
Anjubut o dont know to to coverse it08:22
Anjubut dont know how to covert it08:23
Anjuwhat should i have to maintain08:23
Anjuto convert it08:23
Anjuexample :https://github.com/openstack/tempest/blob/master/tempest/services/compute/xml/aggregates_client.py#L3408:24
Anjuformat aggregate08:24
afazekas_FIXME: the aggregate xml test are working08:26
afazekas_s/test/tests/08:27
Anjumeans?08:28
Anjuafazekas:please dont reply will ask from home08:28
Anjuwill anot able to see your answer08:29
Anjuwiil ask from home08:29
Anjuthanks08:29
Anju:)08:29
afazekas_http://logs.openstack.org/44/38744/1/check/gate-tempest-devstack-vm-full/35785/console.html08:29
afazekas_tempest.api.compute.admin.test_aggregates.AggregatesAdminTestJSON.test_aggregate_create_as_user[gate,negative] ... ok08:29
Anjuwiil  continue in the same08:29
afazekas_ tempest.api.compute.admin.test_aggregates.AggregatesAdminTestXML.test_aggregate_create_as_user[gate,negative] ... ok08:29
Anjuno not in this08:30
Anjuthere are many files in which some test cases for xml08:30
Anjuis not working08:30
Anjuso give you details from home08:30
Anju:)08:30
Anjuthis was just an example08:31
Anjui know that this was working08:31
Anju:)08:31
Anjuthanks08:31
Anju:)08:31
afazekas_bye08:31
afazekas_you are welcome08:31
*** SergeyLukjanov has joined #openstack-qa08:55
*** afazekas has quit IRC09:04
*** afazekas_ is now known as afazekas09:08
afazekasmkoderer: https://review.openstack.org/#/c/36652/4/tempest/stress/actions/volume_attach_delete.py09:12
afazekasWill you change this case to use the nova api ?09:12
afazekashttps://github.com/openstack/tempest/blob/master/tempest/services/compute/json/servers_client.py#L29409:15
afazekashttps://github.com/openstack/tempest/blob/master/tempest/services/compute/json/servers_client.py#L30609:15
*** turul_ has joined #openstack-qa09:18
*** mkollaro has joined #openstack-qa09:36
openstackgerritnayna-patel proposed a change to openstack/tempest: Added 2 quota related test cases for Neutron API  https://review.openstack.org/3548709:40
*** fbo is now known as fbo_away09:49
*** mkollaro1 has joined #openstack-qa09:54
*** mkollaro has quit IRC09:54
openstackgerritafazekas proposed a change to openstack-dev/devstack: Enable Heat and Neutron and Horizon service  https://review.openstack.org/3826309:57
openstackgerritA change was merged to openstack/tempest: add image tests  https://review.openstack.org/3752410:18
*** prekarat has quit IRC10:24
afazekasfungi: ping10:46
afazekashttps://bugs.launchpad.net/tempest/+bug/120297810:47
afazekasWhat kind of steps are necessary to close this bug ?10:48
*** prekarat has joined #openstack-qa10:53
*** mkollaro1 has quit IRC10:59
afazekasmkoderer: ping11:01
*** afazekas is now known as afazekas_zz11:07
mkodererafazekas_zz: sry quite busy .. whats up?11:12
afazekas_zzAre you planning to move to nova volume api this change: https://review.openstack.org/#/c/36652/4/tempest/stress/actions/volume_attach_delete.py ?11:14
mkodererafazekas_zz: yes I will11:14
afazekas_zzmkoderer: Will you have time for improving the skip_tracker ?11:14
mkodererjust lack of time11:14
mkodererafazekas_zz: that's my plan - but still quite busy with other tasks11:15
afazekas_zzI know the issue, I still did not read my e-mails, but I try to do some coding today :)11:15
afazekas_zzthank you11:15
mkodererI think I need to work in the night for upstream... ;)11:16
*** prekarat has quit IRC11:41
*** krtaylor has joined #openstack-qa11:59
openstackgerritA change was merged to openstack-dev/devstack: Use vmware section  https://review.openstack.org/3846012:01
*** fbo_away is now known as fbo12:05
openstackgerritArata Notsu proposed a change to openstack-dev/devstack: Add option to serve PXE for baremetal from nova-network  https://review.openstack.org/3879412:13
openstackgerritA change was merged to openstack/tempest: Added a server-pause test  https://review.openstack.org/3810212:25
openstackgerritA change was merged to openstack/tempest: Basic starter scenario for testing the dashboard  https://review.openstack.org/3849512:25
openstackgerritArata Notsu proposed a change to openstack-dev/devstack: Add option to serve PXE for baremetal from nova-network  https://review.openstack.org/3879412:26
afazekas_zzsdague: It should be approved IMHO https://blueprints.launchpad.net/tempest/+spec/fix-gate-tempest-devstack-vm-quantum-full12:32
*** dkranz has joined #openstack-qa12:33
openstackgerritA change was merged to openstack/tempest: add service tests  https://review.openstack.org/3769612:34
openstackgerritA change was merged to openstack/tempest: Add scenario test of instance/volume snapshot  https://review.openstack.org/3619912:34
afazekas_zzdkranz: https://review.openstack.org/#/c/35302/ can you review it12:36
dkranzafazekas_zz: Done.12:41
*** jasondotstar has joined #openstack-qa12:41
openstackgerritafazekas proposed a change to openstack/tempest: Simplify whitebox/manager  https://review.openstack.org/3530212:53
afazekas_zzdkranz: rebased12:53
*** krtaylor has quit IRC12:54
*** SergeyLukjanov has quit IRC12:57
*** afazekas_zz has quit IRC13:03
*** anteaya has joined #openstack-qa13:06
*** SergeyLukjanov has joined #openstack-qa13:20
*** turul_ is now known as afazekas13:28
fboHello guys, what is the differences between gate and smoke tests in tempest ? or where can I find an explanation ?13:34
openstackgerritafazekas proposed a change to openstack/tempest: Bug 1074904 is fixed  https://review.openstack.org/3880513:44
openstackgerritafazekas proposed a change to openstack/tempest: unskip test_register_get_deregister_ari_image  https://review.openstack.org/3874413:47
afazekasfbo: the smoke is a smaller set of test cases13:49
afazekasSomke one should be selected to be minimal/fast with good coverage, (it can be improved)13:50
fboafazekas, so what is the rule when I create a new test class if it seems those tests can be run pretty fast then i set smoke attr ?13:51
afazekasfbo: IMHO we will remove lot of smoke attr in the future, but  if the test case touches a relatively  big thing and nothing else does it and it is even fast, it may get a smoke attr13:56
afazekasthe test case should get the gate attr anyway, which implies the smoke13:59
afazekassorry13:59
afazekasthe smoke implies the gate :)13:59
fbo afazekas yes that what i saw my tests was set with smoke but gate is also display as attr when running nose14:00
fboafazekas, thx for that clarification14:00
fboafazekas, just another stuff what the meaning of negative attr ?14:02
afazekasthey are usually small simple tests which ends with an expected 4xx error code14:03
afazekasSo they tries an operation which expected to be fail/rejected14:04
fboafazekas, ok that seems clear thx14:05
afazekasthe 'positive' attribute is deprecated14:05
*** anteaya is now known as ant-tree-ya14:05
openstackgerritMatthew Treinish proposed a change to openstack/tempest: Add jsonschema to requirements.txt  https://review.openstack.org/3881014:07
openstackgerritMarc Koderer proposed a change to openstack/tempest: Add stress test to attach volumes to vm's  https://review.openstack.org/3665214:07
*** burt has joined #openstack-qa14:08
mkodererafazekas: I fixed it as weekend present for you ;)14:09
mkodererI am out for today..14:09
afazekasmkoderer: Have a nice evening/weekend14:10
afazekasmkoderer: thx :)14:11
sdagueafazekas: agreed, I approved it14:11
sdaguemkoderer: enjoy the weekend!14:12
openstackgerritMatthew Treinish proposed a change to openstack/tempest: Add jsonschema to requirements.txt  https://review.openstack.org/3881014:12
mkodererthanks! I really need it ;)14:12
*** sdague changes topic to "All things OpenStack QA || QA reviews with no negative feedback - https://review.openstack.org/#/q/status:open+-Verified-1+-CodeReview-1+-CodeReview-2+(project:openstack-dev/grenade+OR+project:openstack/tempest),n,z"14:13
openstackgerritMatthew Treinish proposed a change to openstack/tempest: Add jsonschema to requirements.txt  https://review.openstack.org/3881014:13
afazekassdague: thx14:17
*** mlavalle has joined #openstack-qa14:19
*** krtaylor has joined #openstack-qa14:19
afazekasdkranz: https://bugs.launchpad.net/tempest/+bug/1176151 this is not a tempest only "bug"14:24
afazekasthe devstack first install the dependencies with a "normal" pip-install14:24
dkranzI think setup.py should work without venv but don't know how to do that.14:29
*** matel has joined #openstack-qa14:31
matelHi all14:31
matelHey, I would like to ask about this review: https://review.openstack.org/#/c/38444/14:31
matelSo would it help, if I introduce a variable, like XEN_SETUP_TEXTCONSOLE with a default of "false" - So that by default it's not installed?14:31
openstackgerritafazekas proposed a change to openstack/tempest: Unskip test_register_get_deregister_ari_image  https://review.openstack.org/3874414:33
*** lexinator has joined #openstack-qa14:37
afazekasdkranz: try install the dependencies first; sudo pip-python -r requirements.txt ; sudo pip-python test-requirements.txt14:43
dkranzafazekas: I eventually got it to work but I think the point of the bug ticket is that 'python setup.py develop' should just work.14:44
*** mkollaro has joined #openstack-qa14:45
afazekasdkranz: I see, but I think the not working logic is outside to tempest14:45
dkranzafazekas: What do you mean? Tempest does not assume devstack is running or that tempest is on the same machine as the cloud.14:47
dkranzafazekas: Or at least it should not be assuming that.14:47
afazekasdkranz: I mean the setuptools installs the dependencies with too restrictive permissions14:48
dkranzafazekas: Is this different than if pip is used?14:49
HenryGdtroyer: ping14:50
sdaguematel: ok, so the crontab item isn't idempotent is it? I guess I don't fully understand why the cron job is actually needed (especially one that runs every minute)14:50
dkranzafazekas: I'm just not sure why none of the other projects have an issue like this.14:50
afazekasdkranz: AFAIK yes14:50
afazekasdkranz: they have14:50
sdaguedtroyer: you about? I've got a couple of fixes for default devstack to work that would be nice to get your eyes on14:50
sdaguedtroyer: https://review.openstack.org/#/q/status:open+project:openstack-dev/devstack+branch:master+topic:heatclient,n,z14:51
dkranzafazekas: How did they solve it?14:51
dkranzafazekas: python setup.py develop works on other projects, right?14:51
sdaguedkranz: might be worth asking mordred on that14:51
sdaguehe's the master of setup.py hacking14:52
dkranzsdague: Good idea. I'll point him at the bug ticket.14:52
sdaguewell, I'd ask him more about how it might be fixable14:52
dkranzsdague: I was going to put that question in the bug ticket.14:52
matelsdauge: Yes, it's idempotent, in the sense, that it always sets the crontab, doesn't append it. This cron job is actually doing two things: Sets up xen, so guest consoles are logged, and rotates the log files.14:52
afazekasdkranz: https://github.com/openstack-dev/devstack/blob/master/functions#L113414:52
afazekasthis is the magic14:53
matelsdague: Yes, it's idempotent, in the sense, that it always sets the crontab, doesn't append it. This cron job is actually doing two things: Sets up xen, so guest consoles are logged, and rotates the log files.14:53
dkranzafazekas: So do you know how to fix it now?14:53
* mordred didn't do it14:53
mordredsdague, dkranz what?14:54
dkranzmordred: We're trying to understand why python setup.py develop does not work in tempest14:54
afazekasI'll try it with  sudo pip-python -r requirements.txt ; sudo pip-python test-requirements.txt  ; sudo python setup.py develop14:54
matelsdague: This change is needed to support text console with XenServer - it's the last missing bit to pass full tempest tests.14:54
mordreddkranz: it should definitely work. let me look14:54
dkranzmordred: https://bugs.launchpad.net/tempest/+bug/117615114:55
HenryGSorry to interrupt. Does anyone know of any progress on bug 1199529 ?14:55
sdaguematel: is this running in the guests or the host?14:56
matelsdague: this cronjob will run on dom014:56
sdaguesorry, I haven't fully traced where the tools/xen stuff run14:57
mordreddkranz: couple of things14:57
mordreddevelop will not install test-requirements14:57
matelsdague: I guess that is called host14:57
dkranzafazekas:   ^^^14:57
sdagueyeh, dom0. So in that case what about the unstack case to remove that?14:57
matelsdague: technically it is just a guest :-)14:58
mordreddkranz: I'm tracking down the other things14:58
sdagueyeh, I know, I worked on xen back in the day :)14:58
dkranzmordred: Thanks!14:58
sdaguemy name is still in the man pages14:58
mordredhowever, I _do_ recommend adding "sudo pip -U setuptools" to your recipe right after sudo apt-get -y build-dep python-mysqldb14:58
matelsdague: unstack runs in domU, so it won't remove this.14:58
mordreddkranz: because of the recent setuptools/distribute upgrade saga14:58
afazekasdkranz: the tempest is running without test requires14:58
sdagueoh, right, because you guys only have py24 in dom014:58
sdagueso you do the split management thing14:59
mordredthe permission denied is very weird - I'm looking in to that right now14:59
afazekasdkranz:  test-requirements are for tools like flake814:59
sdagueso that means this cron job is forever running in dom0 after that14:59
matelsdague: Yes, devstack sits in a vm.14:59
dkranzafazekas: But we want that, don't we?14:59
matelsdague: yes14:59
sdaguethat's the part that seems odd to me14:59
dkranzafazekas: IMO the distinction between test and non-test requirements in tempest is not worthwhile15:00
sdaguebut I guess if that's the way you want it, I'm fine with it now15:00
afazekasdkranz:  sudo pip-python install -r test-requirements.txt  and you get it15:00
sdaguedkranz: to pass the docs job we need the distinction15:01
sdaguebecause the docs job only installs test-requirements, not requirements15:01
dkranzsdague: Oh, OK.15:01
matelsdague: Ok, it's pretty harmless stuff, it's like adding a feature to your hypervisor, like xenapi plugins.15:01
sdaguematel: ok, I just +2ed it15:02
*** krtaylor has quit IRC15:02
matelsdague: Thanks.15:02
*** lexinator has quit IRC15:04
afazekasdkranz: I am not sure why to move tempest to the sys.path, just installing the dependencies  is  usually good for me15:06
afazekasdkranz: http://fpaste.org/28126/13748513/ this is working15:10
sdaguemtreinish: so my testr stuff stalled last night, I think because I had 12 abandoned guests hanging out15:10
sdaguererunning now15:10
mtreinishsdague: ok yeah that might do it15:11
sdaguethough why it stalled on that... is interesting15:11
sdaguequota limit?15:11
sdagueI would have thought we'd explode instead15:11
sdaguemtreinish: is there an easy way to pass testr args through tox?15:14
*** lexinator has joined #openstack-qa15:16
clarkbif tox is configured propery `tox -epy27 -- testr args here` should work15:16
clarkbdoesn't look like tempest tox is setup that way15:17
mtreinishclarkb: no it's not I forgot to add posargs15:18
mtreinishI'll push out a change to add it15:18
mtreinishsdague: I've just been running testr run --parallel manually15:19
dkranzafazekas: Great. So we just have to put that in the README.15:20
dkranzafazekas: What OS were you using?15:20
afazekasdkranz: without the setup.py develop your cwd must be the tempest dir , it is implicitly added to the sys.path in addition15:20
openstackgerritFabien Boucher proposed a change to openstack/tempest: Add test for swift ACLs  https://review.openstack.org/3882315:21
afazekascustom F19 image with pre-installed C/C++ headers and dependencies15:21
dkranzafazekas: I guess this needs to work on Ubuntu and vanilla Fedora and RHEL15:22
afazekasdkranz: yes, on ubuntu the pip install command is different15:23
afazekasjust 'pip' instead of 'pip-python'15:23
dtroyerHIPpwd0115:24
afazekasdkranz: https://github.com/openstack-dev/devstack/blob/master/functions#L148015:25
dkranzafazekas: So why can't this stuff go in setup.py and you do 'sudo python setup.py develop' ?15:26
afazekasdkranz: https://bugs.launchpad.net/tempest/+bug/1188932  just the xsltlib-dev / xsltlib-devel is missing now15:27
dtroyersdague: +215:27
afazekasdkranz: IMHO it is setuptools bug/feature , may be the mainual can say something smart about the permission issue15:28
afazekasdkranz: As I remember you can extend it to use two requirements.txt15:29
afazekasdkranz: You can check the git history as well, long time ago it was solved in a different way ..15:30
*** fbo is now known as fbo_away15:31
*** fbo_away is now known as fbo15:31
*** fbo is now known as fbo_away15:31
*** Anju_ has joined #openstack-qa15:31
*** krtaylor has joined #openstack-qa15:33
*** lexinator has quit IRC15:37
afazekasdkranz: https://github.com/openstack-dev/pbr and the https://pypi.python.org/pypi/d2to1 are new here15:38
sdaguedtroyer: cool, if you could +A it in, it's blocking a few folks15:42
sdagueI know it would make dansmith happy15:42
dtroyeroh, well, fine...15:42
sdague:)15:43
sdagueI don't know who else would +2 besides us anyway :)15:43
dtroyerI'm trying to book a hotel in CA and nothing is available…1 week in advance?  go figure...15:43
sdaguewow, bummer15:47
sdagueis there some big event?15:48
openstackgerritMatthew Treinish proposed a change to openstack/tempest: Add posargs to testr-full tox job.  https://review.openstack.org/3882715:48
openstackgerritMatthew Treinish proposed a change to openstack/tempest: Add environmental variables to test.conf  https://review.openstack.org/3882815:48
sdagueseems odd that everything would be sold out15:48
dtroyermaybe, but I'm just going to the Mother Ship for a visit15:48
openstackgerritsaurabh proposed a change to openstack/tempest: Add Neutron CLI tests to tempest  https://review.openstack.org/3882915:48
afazekasmtreinish: https://review.openstack.org/#/c/38828/1 can it work without an additional tempest change ?15:51
mtreinishafazekas: yeah, it doesn't have any requirements. I just got lazy and pushed it as a series with the tox update15:52
mtreinishthose are options for testr15:52
afazekasmtreinish: in nova they processed by the test.py15:53
mtreinishafazekas: they are, hmm the STDOUT stuff worked for me when I tested it15:54
mtreinishlet me take a look15:54
sdagueafazekas: is julie on irc?15:54
sdaguethe timestamp scenario test looks like it has a race - https://bugs.launchpad.net/tempest/+bug/120534415:54
mtreinishafazekas: yep you're right let me port that over to tempest15:55
*** marun has joined #openstack-qa15:56
afazekassdague: at least the ssh connection was successful15:57
sdagueafazekas: yep15:58
sdagueit's a good test, just curious why it failed15:58
sdaguebut someone should look at it soon, otherwise we'll need to skip, as it's already failed twice this morning15:59
*** SergeyLukjanov has quit IRC15:59
afazekasthe boto test waiting in this way https://github.com/openstack/tempest/blob/master/tempest/thirdparty/boto/test_ec2_instance_run.py#L27216:01
afazekassdague: I can add hard coded /dev/vdb wait or something like used in the boto test16:07
afazekasWhich one do you prefer ?16:07
*** bclifford has joined #openstack-qa16:15
*** Anju_ has quit IRC16:21
*** hemnafk is now known as hemna16:29
*** mkollaro has quit IRC16:33
afazekasI do it in the fast way..16:42
*** anju_ has joined #openstack-qa16:43
anju_afazekas:ping16:43
anju_afazekas:please tell me how to  make the parsing functions16:44
*** krtaylor has quit IRC16:52
* afazekas is trying to add something to a sloooow test case in order to fix a critical bug16:53
*** lexinator has joined #openstack-qa17:06
openstackgerritafazekas proposed a change to openstack/tempest: Fix attachment visibility wait/race issue  https://review.openstack.org/3884117:06
openstackgerritMatthew Treinish proposed a change to openstack/tempest: Add posargs to testr-full tox job  https://review.openstack.org/3882717:11
sdaguemtreinish: so the timeouts are hooked in with fixtures in nova17:13
*** mlavalle has quit IRC17:13
mtreinishsdague: yeah that's what it looks like17:14
*** krtaylor has joined #openstack-qa17:44
fungiafazekas: sorry, at a conference and mostly afk... did you still need me on something?17:46
openstackgerritafazekas proposed a change to openstack/tempest: Fix attachment visibility wait/race issue  https://review.openstack.org/3884117:48
afazekasfungi: What needs to be done in order to close this bug https://bugs.launchpad.net/tempest/+bug/1202978 ?17:50
afazekassdague: ^^^17:51
afazekasanju_: can you be more specific ?17:52
anju_afazekas:i gave you an example17:52
anju_wait17:52
fungiafazekas: the tarballs can be generated with just a few lines changed to openstack-infra/config in modules/openstack_project/zuul/layout.yaml and maybe an additional line to the project jobs definition for tempest under modules/openstack_project/files/jenkins_jobs/config/17:54
anju_https://github.com/openstack/tempest/blob/master/tempest/services/compute/json/aggregates_client.py17:54
anju_https://github.com/openstack/tempest/blob/master/tempest/services/compute/xml/aggregates_client.py17:54
fungiafazekas: i'm happy to draft up the change to add them, but first we need to know whether that's counter to the desires of the tempest team17:54
anju_afazekas:17:55
anju_in theses two17:55
anju_first one is json and the other is for xml17:55
anju_the function is implemented17:56
anju_in xml file17:56
anju_to format aggregate in xml17:56
anju_what is the fundamental to do ths17:56
*** marun has quit IRC17:57
afazekasfungi: Would it be a daily  job or on every commit ?17:58
afazekasanju_: imho first you should capture an xml and json response to compare them18:00
anju_then18:01
*** bclifford has quit IRC18:02
*** bclifford has joined #openstack-qa18:02
afazekasetree.fromstring(body)  creates  more python friendly type from the xml string http://lxml.de/tutorial.html18:06
afazekasyou need to manipulate this structure to be the same as it came as a json18:07
anju_ohhhhhhhhhhhhh18:08
anju_its very hard18:08
fungiafazekas: tempest-master.tar.gz would be regenerated and replaced each time a new commit merges to that branch18:08
anju_to do18:08
anju_https://github.com/openstack/tempest/blob/master/tempest/services/compute/xml/aggregates_client.py18:08
afazekassdague, dkranz, mtreinish, cyeoh, jaypipes: Do you have any objection against generating tarballs ?18:10
*** matel has quit IRC18:10
mtreinishafazekas: none from me18:11
dkranzafazekas: Need to read back...18:11
sdagueafazekas: so we don't really do releases, so it seems a little weird18:11
mtreinishsdague: yeah but there's no real harm is there. Especially if some packagers prefer a tarball for whatever dumb reason they come up with.18:12
sdaguesure, I guess the versioning might be odd18:13
dkranzafazekas: I have no objection.18:13
jaypipesafazekas: no objections at all.18:13
dkranzsdague: I think a lot of use cases are coming that will make tempest more like a package to be delivered.18:13
sdaguedkranz: sure18:14
dkranzsdague: I think we should treat it like any other openstack thing.18:14
dkranzsdague: Including making 'python setup.py develop' work :)18:14
sdaguedkranz: well patches welcomed :)18:14
mtreinishsdague: it'll be something like: 2013.2.a1435.g3d3f87c18:14
dkranzsdague: We're working on it.18:14
sdaguepresumably setup.py might need some tweaks to make it a sane tarball18:14
afazekasdkranz: are you sure it is working with other opestack project ?18:15
dkranzafazekas: Not sure. But I think so. At least some of them.18:15
dkranzsdague: First I have to fix devstack so it can be deployed on an openstack vm and tempest run on a machine on a different network.18:17
*** prekarat has joined #openstack-qa18:18
sdaguemtreinish: are you trying to tackle the fixtures timeout thing, or should I give it a shot?18:18
mtreinishsdague: right now I'm down the locking and logging rabbit hole with oslo in tempest if you want to take that over go for it18:18
sdagueok will do18:19
afazekassdague: dev snapshot :)18:22
afazekasfungi: looks like we are ok with that, I hope it will not cause verify issues18:23
fungiafazekas: not at all. it would run from the post pipeline, so it doesn't even start running until a commit has merged to the branch18:24
afazekasfungi: cool18:24
afazekasdkranz: I have doubts this egg issue is real issue to any packaging system, normally you have the dependent packages installed  before packaging the new one. If there is another system what I do not know, all know system can workaround it.18:26
fungiafazekas: i'll try to get the change proposed to add that job some time today18:26
dkranzafazekas: This is beyond my knowledge18:27
afazekasdkranz: I played with 4 different kind of packaging stuff long time ago, I hope it is not changed nowadays :) , not just Linux ..18:28
* afazekas may be more ..18:29
*** prekarat has quit IRC18:36
*** bclifford has quit IRC18:37
*** bclifford has joined #openstack-qa18:37
*** mkollaro has joined #openstack-qa18:40
afazekassdague,dkranz,mtrienish : can you review this before jenkins says anything https://review.openstack.org/#/c/38841/ Hopefully it will fix the issue, and will be more verbose if not18:41
afazekasanju_: you can try create a small python program for practice18:43
anju_afazekas:yeah i tried18:44
anju_will diccuss with you when i will in trobule18:45
openstackgerritA change was merged to openstack-dev/devstack: Add ceilometer to the sys.path before the nova starts  https://review.openstack.org/3870218:48
* afazekas is entering to power state S3 soon18:52
*** anju_ has quit IRC18:54
*** mlavalle has joined #openstack-qa19:07
openstackgerritMatthew Treinish proposed a change to openstack/tempest: Sync lockutils from oslo.  https://review.openstack.org/3885619:12
openstackgerritMatthew Treinish proposed a change to openstack/tempest: Add locking to test_aggregates  https://review.openstack.org/3885719:12
mtreinishsdague: about https://review.openstack.org/#/c/38857/1/etc/tempest.conf.sample will devstack pull that in because it's in the sample or do I need to add an iniset for it?19:13
openstackgerritSean Dague proposed a change to openstack/tempest: fix race condition in service list compares  https://review.openstack.org/3885919:13
sdaguemtreinish: I think it comes in from the sample. However you should initset it to the TMPDIR variable that devstack sets up19:14
mtreinishsdague: ok I'll write up a devstack patch for that then19:14
*** bclifford has quit IRC19:18
*** bclifford has joined #openstack-qa19:18
*** mlavalle has left #openstack-qa19:20
afazekasmtreinish: the values from the sample is used unless it is over-written by an iniset19:20
mtreinishafazekas: yeah I'm going to push out a change to devstack to iniset it to devstack's tmpdir19:22
*** harlowja has quit IRC19:23
*** bclifford has quit IRC19:24
*** afazekas is now known as afazekas_zz19:24
*** mlavalle has joined #openstack-qa19:25
openstackgerritMatthew Treinish proposed a change to openstack-dev/devstack: Set lock_path for Tempest to TMPDIR  https://review.openstack.org/3886119:28
*** SergeyLukjanov has joined #openstack-qa19:35
*** marun has joined #openstack-qa19:55
*** bclifford has joined #openstack-qa20:19
dkranzmtreinish: ping20:28
mtreinishdkranz: pong20:29
dkranzmtreinish: Where does the tempest log file go?20:29
dkranzmtreinish: I can't seem to find it. Is more configuration needed to prevent messages from just getting eaten?20:30
mtreinishdkranz: I'm actually looking at that right now because I'm going to convert to oslo logging. From what I can tell nowhere by default.20:31
mtreinishThere are 2 environ variables, TEMPEST_LOG_CONFIG_DIR and TEMPEST_LOG_CONFIG to set an output dir20:31
mtreinishby my testing with those didn't work20:31
dkranzmtreinish: :(20:31
mtreinishwhat we seem to do by default is let nose grab it, and nose will print it on errors and fails20:32
mtreinishbut that won't work with testr20:32
dkranzmtreinish: Unfortunately I need to debug a hang that I have to ^c and nothing comes out.20:32
dkranzmtreinish: Is there an easy way to run a test without nose?20:32
mtreinishdkranz: well you can try the variables (maybe you'll have more luck)20:33
dkranzmtreinish: Actually without any test runner?20:33
dkranzmtreinish: OK, I'll try that.20:33
mtreinishdkranz: you'll need to use a test runner20:33
mtreinishit doesn't have to be nose though20:34
dkranzmtreinish: I'll let you know if the variable works20:34
mtreinishIn these kind of scenarios I normally force a fail with something like self.assertTrue(False) to trigger output20:35
dkranzmtreinish: That's a good idea.20:36
dkranzmtreinish: Supplying a log variable gives  ConfigFileParseError: Failed to parse /tmp/tempest.log: No section: 'formatters'20:37
dkranzmtreinish: I think that variable is for a log formatting file, not the name of the file to log to.20:37
dkranzmtreinish: Blah.20:37
mtreinishdkranz: they're definitely for specifying the output: http://paste.openstack.org/show/42043/20:42
mtreinishbut you might be hitting some other configuration20:42
mtreinishactually I just figured out why it wasn't working for me I was using them wrong let me give it a try20:43
dkranzmtreinish: ok20:43
mtreinishdkranz: oh nm I'm being silly that's to point it to the logging config file20:44
openstackgerritMonty Taylor proposed a change to openstack-infra/devstack-gate: Build a devstack-gate image with diskimage-builder  https://review.openstack.org/3887120:44
mtreinishdoh20:44
dkranzmtreinish: Yeah, that's what I found out.20:44
dkranzmtreinish: Obvious, isn't it?20:45
mtreinishdkranz: do TEMPEST_LOG_CONFIG_DIR=/opt/stack/tempest/etc TEMPEST_LOG_CONFIG=logging.conf.sample and it'll dump it into tempest.log in /opt/stack/tempest20:46
mtreinishassuming you're using devstack20:46
dkranzmtreinish: I'm running tempest on a different machine than the cluster (which happens to be devstack) but that's probably enough info.20:47
mtreinishdkranz: yeah I know, this is super obvious. Hopefully when I get the move to oslo logging finished it'll be a bit better20:47
dkranzmtreinish: :)20:47
*** harlowja has joined #openstack-qa20:50
openstackgerritMatthew Treinish proposed a change to openstack/tempest: Add environmental variables to test.conf  https://review.openstack.org/3882820:52
mtreinishsdague: ^^^ that should fix the timeout for you20:52
sdaguemtreinish: did you try it?20:55
sdaguebecause my code was very much like that20:55
sdagueand it didn't time out20:55
mtreinishsdague: I tested that by changing the testr.conf timeout to 1 and most of the tests failed with TimeoutException20:56
mtreinishalso all the fails had _StringException: Empty attachments: stderr stdout20:56
mtreinishwhich means it was trying to capture those too20:56
*** burt has quit IRC20:57
sdaguehmmmm... I wonder what I messed up20:58
*** stevebaker has joined #openstack-qa20:59
stevebakerHi all, feel free to ping me for anything heat related21:01
*** jasondotstar has quit IRC21:03
*** bclifford has quit IRC21:03
dkranzstevebaker: Welcome :)21:03
dkranzstevebaker: I think the plan is to move the slow test to scenario and mark it with a slow tag.21:04
dkranzstevebaker: Then we will change the main tempest run to exclude slow tests.21:04
dkranzstevebaker: Then we create a separate gate job for heat that runs the tests we choose.21:04
stevebakeryep, that all sounds good21:04
dkranzstevebaker: Obviously the second has to be committed before the first.21:05
dkranzstevebaker: I hope to submit that soon but am having loads of trouble trying to run tempest on my laptop and talk to a devstack running on an openstack vm.21:06
dkranzstevebaker: But I just found the last problem :)21:06
stevebakeralso, no slow tests will be run until there is an image for them to run against21:06
stevebakermy first attempt will be to invoke diskimage-builder from devstack when heat and tempest are enabled21:07
openstackgerritMonty Taylor proposed a change to openstack-infra/devstack-gate: Build a devstack-gate image with diskimage-builder  https://review.openstack.org/3887121:10
*** openstack has joined #openstack-qa21:14
dkranzmtreinish: Do we know how to exclude a test tagged as 'slow' when using testr?21:15
*** HenryG has quit IRC21:16
mtreinishdkranz: that may be a problem. Right now I believe testr only filters on regex matches21:16
*** woodspa has quit IRC21:16
mtreinishso we'd probably need to add an exclude option or something similar21:16
mtreinishlifeless: ^^^ is that right?21:17
*** woodspa has joined #openstack-qa21:17
*** bclifford has joined #openstack-qa21:17
mtreinishclarkb: ^^^ do you know?21:18
clarkbmtreinish: dkranz: regexes are sufficient21:18
clarkbyou can do negative lookahead21:18
mtreinishclarkb: yeah that'll work, but it's ugly21:18
clarkbeg https://github.com/openstack/nova/blob/master/tox.ini#L3821:18
clarkbits not ugly21:18
*** HenryG has joined #openstack-qa21:18
dkranzmtreinish: Well I don't think I can check in the slow skip until that is possible, right?21:18
dkranzmtreinish: It is easy with nose.21:18
clarkbI mean I don't know how it appliesto tags but you can exlcude tests today21:19
mtreinishclarkb: ok that's not as bad as I thought it was. I googled it at one point and it didn't look that simple.21:19
dkranzclarkb: Does that apply to a tag using attr like we do in tempest?21:20
clarkbI have no idea. the whole tag business is foreign to me21:20
clarkbbut if you can regex on the tags it should21:20
mtreinishit shouldn't be that different because the tags are at the end of the test id in []21:21
dkranzclarkb: I have not tried to use testr yet.21:21
dkranzmtreinish: Ah, then it will be easy.21:21
*** zigo has quit IRC21:21
*** zigo has joined #openstack-qa21:21
mtreinishdkranz: for example: tempest.api.image.v1.test_images.CreateRegisterImagesTest.test_register_image_with_min_ram[gate]21:22
dkranzmtreinish: Yeah, I got it.21:22
mtreinishand multiple tags: tempest.api.compute.flavors.test_flavors.FlavorsTestXML.test_invalid_minRam_filter[gate,negative]21:22
clarkbyeah in that case ^(?!.*\[slow\]).*$21:23
clarkbI think that is the correct regex unless you need to account for [slow,negative]21:23
dkranzclarkb: We don't do no stinking slow negative tests21:23
dkranzclarkb: Well, we'll figure it out if we do :)21:24
mtreinishyeah I don't think such a thing could exist the negative tests are almost instantaneous.21:24
mtreinishyou could just do it so slow with any characters in front and after slow inside []21:25
mtreinishI think that would work as long as we don't have any tags that have slow as part of them21:25
clarkband if you do you can get more exact with the regex21:25
clarkbwrap with some \bs21:25
mtreinishdkranz: when we start adding service tags that will be a concern21:26
clarkb\[\bslow\b\]21:26
*** SergeyLukjanov has quit IRC21:30
mtreinishdkranz: so you turned on logging for this channel?21:35
mtreinishyou should've probably announced that on the ML. Because I had no idea21:35
mtreinishnow I have to watch what I say21:35
sdaguemtreinish: well there were 50 people in here anyway, most of them probably had local logs :)21:38
mtreinishsdague: fair enough :)21:39
lifelessmtreinish: regex can exclude21:41
mtreinishlifeless: thanks21:43
openstackgerritMatthew Treinish proposed a change to openstack/tempest: Switch to using oslo logging.  https://review.openstack.org/3887921:43
openstackgerritMatthew Treinish proposed a change to openstack/tempest: Sync lockutils and log from oslo  https://review.openstack.org/3885621:43
openstackgerritMatthew Treinish proposed a change to openstack/tempest: Add locking to test_aggregates  https://review.openstack.org/3885721:43
openstackgerritMatthew Treinish proposed a change to openstack/tempest: Add locking to test_aggregates  https://review.openstack.org/3885721:47
openstackgerritMatthew Treinish proposed a change to openstack/tempest: Switch to using oslo logging  https://review.openstack.org/3887921:47
lifelessmtreinish: (?!foo) - negatice lookahead on foo, from memory21:55
openstackgerritMatthew Treinish proposed a change to openstack/tempest: Add locking to test_aggregates  https://review.openstack.org/3885722:03
openstackgerritMatthew Treinish proposed a change to openstack/tempest: Switch to using oslo logging  https://review.openstack.org/3887922:03
clarkbsdague: mtreinish http://logs.openstack.org/71/22471/14/gate/gate-tempest-devstack-vm-postgres-full/35820/console.html is that a known problem?22:17
clarkbit just reset the gate, and it looks like something that would be simple to fix in theory22:18
*** mkollaro has quit IRC22:19
*** mlavalle has quit IRC22:31
*** mlavalle has joined #openstack-qa22:32
*** harlowja has quit IRC22:35
*** mlavalle has quit IRC23:00
mtreinishclarkb: it's probably this right? https://bugs.launchpad.net/tempest/+bug/120534423:00
mtreinishif so afazekas_zz has a fix pending the gate: https://review.openstack.org/#/c/38841/23:00
clarkbmtreinish: ya Alex_Gaynor pointed it out to me23:01
clarkbthanks23:01
openstackgerritA change was merged to openstack-dev/devstack: Set service_available config options in tempest  https://review.openstack.org/3837923:04
openstackgerritMonty Taylor proposed a change to openstack-infra/devstack-gate: Proof of concept of kexec/takeovernode  https://review.openstack.org/3888723:09
*** mlavalle has joined #openstack-qa23:16
*** mlavalle has quit IRC23:19
*** mlavalle has joined #openstack-qa23:19
*** marun has quit IRC23:25
*** marun has joined #openstack-qa23:59

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!