openstackgerrit | Joe Gordon proposed a change to openstack-dev/grenade: Add comment explaining where javelin logs are found https://review.openstack.org/119587 | 00:04 |
---|---|---|
openstackgerrit | Adolfo Duarte proposed a change to openstack/tempest: Test Suite for DVR (Distributed Virtual Routing) scenarios https://review.openstack.org/131606 | 00:06 |
*** achanda has quit IRC | 00:15 | |
*** achanda has joined #openstack-qa | 00:15 | |
*** dimtruck is now known as zz_dimtruck | 00:16 | |
*** zz_dimtruck is now known as dimtruck | 00:16 | |
*** achanda has quit IRC | 00:19 | |
*** rushiagr is now known as rushiagr_away | 00:20 | |
*** dimtruck is now known as zz_dimtruck | 00:25 | |
*** dmorita has joined #openstack-qa | 00:29 | |
*** patrickeast has quit IRC | 00:36 | |
*** bknudson has joined #openstack-qa | 00:38 | |
*** Longgeek has joined #openstack-qa | 00:47 | |
*** Longgeek has quit IRC | 00:48 | |
*** Longgeek has joined #openstack-qa | 00:48 | |
*** Yogi has quit IRC | 00:51 | |
*** JayJ has joined #openstack-qa | 00:53 | |
*** bknudson has left #openstack-qa | 00:56 | |
*** e0ne has quit IRC | 00:59 | |
*** catohornet has quit IRC | 01:01 | |
*** yamahata has joined #openstack-qa | 01:03 | |
*** Yogi has joined #openstack-qa | 01:10 | |
*** e0ne has joined #openstack-qa | 01:13 | |
*** Yogi has quit IRC | 01:19 | |
*** Longgeek has quit IRC | 01:19 | |
*** yamamoto_ has joined #openstack-qa | 01:20 | |
*** Yogi has joined #openstack-qa | 01:22 | |
*** yamahata has quit IRC | 01:22 | |
*** yamahata has joined #openstack-qa | 01:22 | |
*** marun has quit IRC | 01:29 | |
*** e0ne has quit IRC | 01:33 | |
*** catohornet has joined #openstack-qa | 01:35 | |
*** rbak has joined #openstack-qa | 01:42 | |
*** weshay has quit IRC | 01:49 | |
*** amotoki has joined #openstack-qa | 01:59 | |
*** nosnos has joined #openstack-qa | 02:06 | |
*** dims__ has quit IRC | 02:14 | |
*** dims__ has joined #openstack-qa | 02:15 | |
*** dims__ has quit IRC | 02:17 | |
*** morganfainberg is now known as only_zuul | 02:18 | |
*** only_zuul is now known as morganfainberg | 02:18 | |
openstackgerrit | A change was merged to openstack/tempest: Fix and re-enable test_disassociate_not_associated_floating_ip https://review.openstack.org/124323 | 02:20 |
openstackgerrit | YAMAMOTO Takashi proposed a change to openstack-dev/devstack: Stop setting deprecated OVS.enable_tunneling option https://review.openstack.org/131327 | 02:27 |
*** Poornima has joined #openstack-qa | 02:31 | |
*** mriedem has quit IRC | 02:40 | |
*** dims__ has joined #openstack-qa | 02:47 | |
*** dims__ has quit IRC | 02:52 | |
*** chandankumar has joined #openstack-qa | 02:57 | |
*** chandankumar has quit IRC | 02:58 | |
*** JayJ has quit IRC | 03:12 | |
*** Yogi has quit IRC | 03:17 | |
*** yamahata has quit IRC | 03:22 | |
*** vikas has joined #openstack-qa | 03:26 | |
*** vikas has quit IRC | 03:27 | |
openstackrecheck | Console logs not available after 13:27s for check-tempest-dsvm-postgres-full-juno 131364,1,daa1db9 | 03:27 |
*** rbak has quit IRC | 03:28 | |
*** rbak has joined #openstack-qa | 03:29 | |
*** nosnos has quit IRC | 03:46 | |
*** nosnos has joined #openstack-qa | 03:46 | |
*** nosnos has quit IRC | 03:51 | |
*** catohornet has left #openstack-qa | 03:56 | |
*** yamahata has joined #openstack-qa | 04:05 | |
*** chandankumar has joined #openstack-qa | 04:05 | |
*** harlowja is now known as harlowja_away | 04:21 | |
*** nosnos has joined #openstack-qa | 04:27 | |
*** chandankumar has quit IRC | 04:32 | |
*** Poornima has quit IRC | 04:34 | |
*** pcrews has quit IRC | 04:37 | |
openstackgerrit | Eli Qiao proposed a change to openstack/tempest: Add BadRequest exception in test_floating_ips_actions case https://review.openstack.org/131364 | 04:39 |
*** yfried has joined #openstack-qa | 04:40 | |
*** pcrews has joined #openstack-qa | 04:41 | |
openstackrecheck | openstack/nova change: https://review.openstack.org/122633 failed because of: gate-tempest-dsvm-full: https://bugs.launchpad.net/bugs/1373513 | 04:45 |
*** achanda has joined #openstack-qa | 04:49 | |
*** morganfainberg is now known as mightbestevemar | 04:55 | |
*** pcrews has quit IRC | 04:57 | |
*** mightbestevemar is now known as morganfainberg | 05:04 | |
*** Poornima has joined #openstack-qa | 05:05 | |
openstackgerrit | Ken'ichi Ohmichi proposed a change to openstack/tempest: Fix the flavor ram string value https://review.openstack.org/131637 | 05:17 |
*** yfried has quit IRC | 05:25 | |
*** pcrews has joined #openstack-qa | 05:26 | |
*** rushiagr_away is now known as rushiagr | 05:29 | |
*** jecarey_ has quit IRC | 05:32 | |
*** pcrews has quit IRC | 05:32 | |
openstackgerrit | Ken'ichi Ohmichi proposed a change to openstack/tempest: Do not merge: Test v2.1 API on the gate https://review.openstack.org/131639 | 05:34 |
openstackgerrit | Clark Boylan proposed a change to openstack-infra/devstack-gate: Enable nova multi host on aiopcpu tests https://review.openstack.org/131604 | 05:36 |
openstackrecheck | openstack/horizon change: https://review.openstack.org/129379 failed because of: gate-tempest-dsvm-full: https://bugs.launchpad.net/bugs/1373513 | 05:42 |
*** chandankumar has joined #openstack-qa | 05:44 | |
openstackrecheck | openstack/horizon change: https://review.openstack.org/121935 failed gate-horizon-pep8 in the gate queue with an unrecognized error | 05:46 |
*** Madan has joined #openstack-qa | 05:56 | |
openstackgerrit | Clark Boylan proposed a change to openstack-infra/devstack-gate: Enable nova multi host on aiopcpu tests https://review.openstack.org/131604 | 06:06 |
*** afazekas is now known as __afazekas | 06:11 | |
*** achanda has quit IRC | 06:12 | |
*** achanda has joined #openstack-qa | 06:14 | |
*** achanda has quit IRC | 06:20 | |
*** achanda has joined #openstack-qa | 06:25 | |
openstackrecheck | openstack/nova change: https://review.openstack.org/121965 failed gate-tempest-dsvm-full in the gate queue with an unrecognized error | 06:27 |
*** yfried has joined #openstack-qa | 06:37 | |
openstackgerrit | Abhishek G M proposed a change to openstack/tempest: Test to verify shared attribute of network https://review.openstack.org/124998 | 06:37 |
*** achanda has quit IRC | 06:39 | |
yfried | masayukig: ping | 06:53 |
yfried | gmann: ping | 06:54 |
gmann | yfried: pong | 06:54 |
yfried | gmann: remember this https://review.openstack.org/#/c/120070/ ? | 06:54 |
gmann | yfried: ah yes | 06:55 |
yfried | gmann: so I think this is finally ready. the bug is fixed and the test passed on my machine with 100 vms | 06:56 |
yfried | gmann: though this requires some tweaks ad | 06:56 |
yfried | at the gate | 06:56 |
*** e0ne has joined #openstack-qa | 06:56 | |
yfried | gmann: ie - build timeout should be extended an some quotas need to be disabled | 06:57 |
yfried | gmann: but I wonder if the existing 100 machines isn't too much for a gate-vm | 06:57 |
yfried | gmann: run-time on my machine is ~700sec per iteration, with 3 iterations so its ~30min test | 06:58 |
*** evgenyf has joined #openstack-qa | 06:58 | |
yfried | gmann: and I'm using a bare-metal server instead of a VM with questionable resources | 06:59 |
yfried | gmann: I wonder if we really need to test 100 vms in the gate. I also wonder why it has to run 3 times | 06:59 |
gmann | yfried: 3 times is fine as test timeout is 500 sec for single tests | 07:00 |
gmann | yfried: but as you mentioned it takes ~700 sec per iteration, can be issue on gate | 07:00 |
gmann | yfried: bug fixed you mean - bug#1372049? | 07:01 |
yfried | gmann: I'm also concerned that 100 vms is overtaxing the single-node setup. not sure that openstack is designed to support that | 07:01 |
yfried | gmann: yep. that's the bug | 07:02 |
yfried | gmann: fixed on the nova side | 07:02 |
yfried | gmann: I think 50 machines is "large-scale" enough | 07:03 |
*** afazekas has joined #openstack-qa | 07:03 | |
yfried | gmann: brb | 07:03 |
gmann | yfried: humm actually I am not in favor of 50 as we should not truncate actual large ops testing | 07:04 |
gmann | yfried: but Nova has fixed the max thread issue in master means for Kilo. are they planning to backport those for J and I also? | 07:06 |
gmann | yfried: bcz for us(tempest), without backport it would not work. | 07:06 |
gmann | yfried: another idea i have that let large ops build 100 VM and you can perform connectivity check for half of them? | 07:07 |
*** cmyster has joined #openstack-qa | 07:11 | |
*** cmyster has quit IRC | 07:11 | |
*** cmyster has joined #openstack-qa | 07:11 | |
*** cmyster has quit IRC | 07:15 | |
*** SridharG has joined #openstack-qa | 07:17 | |
*** yfried is now known as yfried|afk | 07:19 | |
*** yfried|afk is now known as yfried | 07:19 | |
yfried | gmann: well, I don't remember if we've discussed this or not, but the current test doesn't do ANYTHING | 07:21 |
yfried | gmann: it checks that nova can process a request for multiple vms. it could easily be part of the nova tree | 07:22 |
yfried | gmann: I think we can drop that for a meaningful integration test | 07:23 |
yfried | gmann: we aren't loosing anything by reducing the number of VMs because we didn't have anything in the first place. I think I'll try and bring it up at tomorrow's mtg. | 07:24 |
*** nosnos has quit IRC | 07:25 | |
yfried | gmann: or, the "scenario" could move to nova api because it's not exercising any other component ATM | 07:26 |
*** nosnos has joined #openstack-qa | 07:27 | |
yfried | gmann: I'll ask about backporting the patch to K or I | 07:27 |
gmann | yfried: yes, that will be good to discuss in tomorrow meeting. | 07:28 |
*** SridharGaddam has joined #openstack-qa | 07:29 | |
yfried | gmann: assuming there is one? | 07:29 |
gmann | yfried: IMO, we should keep it in scenario and can extend this tests for other component too may be by reducing number of VMs or by having other operation (like connectivity) on limited VMs | 07:30 |
yfried | gmann: if we have network in the tenant, it's a very bad hack to get only 50% of the VMs to connect to it | 07:31 |
yfried | gmann: easier to lower the total num | 07:32 |
gmann | yfried: ahh. if there is no meeting, you can discuss in summit on last day session which is shared with infra team | 07:32 |
gmann | yfried: hoping you will be there :) | 07:33 |
yfried | gmann: too bad I'm leaving Wednesday night... | 07:33 |
gmann | yfried: even I am also not able to make :( | 07:35 |
*** cmyster has joined #openstack-qa | 07:36 | |
yfried | gmann: there was a pad with summit preparations. do you know where it is? | 07:36 |
gmann | yfried: https://etherpad.openstack.org/p/kilo-qa-summit-topics | 07:36 |
yfried | gmann: tnx | 07:36 |
gmann | yfried: np! | 07:37 |
yfried | gmann: does "interested" means "would like to attend" or "would like to speak"? | 07:38 |
gmann | yfried: "would like to attend" | 07:39 |
yfried | gmann: oh. then I'm interested in all of them... :) | 07:39 |
gmann | yfried: :) | 07:39 |
*** yamamoto_ has quit IRC | 07:42 | |
yfried | gmann: you wouldn't happen to know of a similar pad for network/neutron, would you? | 07:42 |
gmann | yfried: sorry, no idea | 07:43 |
*** cmyster has quit IRC | 07:46 | |
*** cmyster has joined #openstack-qa | 07:47 | |
*** cmyster has quit IRC | 07:47 | |
*** cmyster has joined #openstack-qa | 07:47 | |
*** sergsh has joined #openstack-qa | 08:02 | |
*** gfidente has joined #openstack-qa | 08:02 | |
*** qba73 has joined #openstack-qa | 08:03 | |
*** jlibosva has joined #openstack-qa | 08:12 | |
openstackgerrit | Ken'ichi Ohmichi proposed a change to openstack/tempest: Add internal methods for setting compute clients https://review.openstack.org/131664 | 08:14 |
openstackgerrit | Ken'ichi Ohmichi proposed a change to openstack/tempest: Use JSON clients if disabling XML compute support https://review.openstack.org/131665 | 08:14 |
*** e0ne has quit IRC | 08:19 | |
*** yamahata has quit IRC | 08:22 | |
*** rushiagr is now known as rushiagr_away | 08:27 | |
*** k4n0 has joined #openstack-qa | 08:28 | |
*** tkammer_ has joined #openstack-qa | 08:32 | |
*** cmyster has quit IRC | 08:34 | |
*** tkammer has quit IRC | 08:35 | |
*** markus_z has joined #openstack-qa | 08:37 | |
*** neeti has joined #openstack-qa | 08:37 | |
openstackrecheck | openstack/horizon change: https://review.openstack.org/131645 failed because of: gate-tempest-dsvm-full: https://bugs.launchpad.net/bugs/1373513 | 08:38 |
yfried | afazekas: is there a QA mtg this week? wiki says "No meeting next week" but I assume it refers to the summit week | 08:38 |
*** cmyster has joined #openstack-qa | 08:39 | |
*** rushiagr_away is now known as rushiagr | 08:39 | |
*** jordanP has joined #openstack-qa | 08:44 | |
*** X019 has joined #openstack-qa | 08:46 | |
*** e0ne has joined #openstack-qa | 08:48 | |
*** jpich has joined #openstack-qa | 08:50 | |
*** safchain has joined #openstack-qa | 08:50 | |
*** nikesh_vedams_ has joined #openstack-qa | 08:51 | |
openstackgerrit | Dougal Matthews proposed a change to openstack/tempest: Correct docstring indentation https://review.openstack.org/131366 | 08:52 |
*** X019 has quit IRC | 08:52 | |
nikesh_vedams_ | i am trying to deploy devstack on RHEL-6.5 | 08:53 |
nikesh_vedams_ | but i am getting below error | 08:53 |
nikesh_vedams_ | http://paste.openstack.org/show/126342/ | 08:53 |
nikesh_vedams_ | did any-one face this issue | 08:53 |
nikesh_vedams_ | ? | 08:54 |
*** gszasz has joined #openstack-qa | 08:54 | |
*** e0ne has quit IRC | 08:56 | |
*** tkammer_ has quit IRC | 08:57 | |
*** cmyster has quit IRC | 09:01 | |
*** cmyster has joined #openstack-qa | 09:01 | |
*** qba73 has quit IRC | 09:05 | |
*** aix has joined #openstack-qa | 09:11 | |
*** tkammer_ has joined #openstack-qa | 09:12 | |
*** dims__ has joined #openstack-qa | 09:15 | |
*** dims__ has quit IRC | 09:19 | |
yfried | nikesh_vedams_: are you pulling latest master (Kilo)? | 09:29 |
*** cmyster has quit IRC | 09:30 | |
*** zz_johnthetubagu is now known as johnthetubaguy | 09:30 | |
nikesh_vedams_ | yfried: yes | 09:34 |
nikesh_vedams_ | but after that i changed to juno | 09:34 |
nikesh_vedams_ | but still i am getting error | 09:34 |
*** cmyster has joined #openstack-qa | 09:35 | |
*** cmyster has quit IRC | 09:35 | |
*** cmyster has joined #openstack-qa | 09:35 | |
yfried | nikesh_vedams_: don't know if that's your problem, but RHEL6 is using python26 I don't think juno is supported on el6. | 09:36 |
*** ajo_ has joined #openstack-qa | 09:39 | |
nikesh_vedams_ | yfried: i think rhel6 supports devstack | 09:40 |
*** achanda has joined #openstack-qa | 09:40 | |
*** afazekas_beer is now known as psedlak | 09:40 | |
nikesh_vedams_ | yfried: yfried | 09:41 |
nikesh_vedams_ | yfried:http://docs.openstack.org/developer/devstack/ | 09:41 |
yfried | nikesh_vedams_: devstack yes, but not juno. | 09:41 |
nikesh_vedams_ | kkk i am installing devstack with juno on rhel6 | 09:42 |
nikesh_vedams_ | kkk | 09:42 |
yfried | nikesh_vedams_: I know RedHat aren't doing RHEL-OSP-6 on el6. only for el7 | 09:42 |
nikesh_vedams_ | so icehouse will work | 09:42 |
nikesh_vedams_ | am i right | 09:42 |
nikesh_vedams_ | ? | 09:42 |
yfried | nikesh_vedams_: hopefully | 09:42 |
yfried | nikesh_vedams_: let me know how it goes | 09:42 |
yfried | nikesh_vedams_: are you intersted in devstack only? you could go for RDO | 09:43 |
nikesh_vedams_ | kkk i am doing now git checkout stable/icehouse | 09:43 |
nikesh_vedams_ | what is RDO? | 09:44 |
yfried | nikesh_vedams_: https://openstack.redhat.com/Main_Page | 09:44 |
*** achanda has quit IRC | 09:44 | |
yfried | nikesh_vedams_: btw, what's "kkk"? | 09:45 |
nikesh_vedams_ | oh sorry | 09:46 |
nikesh_vedams_ | i mean okk | 09:46 |
yfried | nikesh_vedams_: oh. well good luck | 09:46 |
*** cmyster has quit IRC | 09:58 | |
openstackrecheck | openstack/nova change: https://review.openstack.org/129276 failed because of: gate-tempest-dsvm-full: https://bugs.launchpad.net/bugs/1373513 | 10:00 |
*** bkopilov has quit IRC | 10:00 | |
*** bkopilov has joined #openstack-qa | 10:00 | |
*** ylobankov has joined #openstack-qa | 10:02 | |
*** cmyster has joined #openstack-qa | 10:06 | |
*** yfried is now known as yfried|afk | 10:07 | |
*** marun has joined #openstack-qa | 10:09 | |
*** yamahata has joined #openstack-qa | 10:10 | |
*** yfried|afk is now known as yfried | 10:12 | |
*** jecarey has joined #openstack-qa | 10:12 | |
*** e0ne has joined #openstack-qa | 10:18 | |
*** malini has joined #openstack-qa | 10:18 | |
*** malini has quit IRC | 10:18 | |
*** malini has joined #openstack-qa | 10:19 | |
openstackgerrit | John Davidge proposed a change to openstack-dev/devstack: Add IPv6 support for tenant data network https://review.openstack.org/87987 | 10:21 |
*** aix has quit IRC | 10:21 | |
*** cmyster has quit IRC | 10:24 | |
*** cmyster has joined #openstack-qa | 10:25 | |
*** amotoki has quit IRC | 10:27 | |
*** mpaolino has joined #openstack-qa | 10:28 | |
*** dims__ has joined #openstack-qa | 10:30 | |
openstackgerrit | chandan kumar proposed a change to openstack/tempest: Fixes volume client in volume tests https://review.openstack.org/131693 | 10:33 |
chandankumar | gmann, jordanP Hello | 10:33 |
chandankumar | gmann, jordanP please have a look at this patch: https://review.openstack.org/131693 | 10:34 |
jordanP | chandankumar, i'd rather wait for jenkins :) | 10:34 |
chandankumar | jordanP, :) | 10:35 |
*** yfried is now known as yfried|afk | 10:38 | |
*** rushiagr is now known as rushiagr_away | 10:39 | |
*** evgenyf has quit IRC | 10:44 | |
openstackgerrit | Flavio Percoco proposed a change to openstack-infra/devstack-gate: Set ZAQAR_BACKEND in localrc if present https://review.openstack.org/128224 | 10:50 |
*** cmyster has quit IRC | 10:52 | |
*** aix has joined #openstack-qa | 10:53 | |
*** cdent has joined #openstack-qa | 10:56 | |
*** evgenyf has joined #openstack-qa | 11:05 | |
sdague | ianw: so I don't actually know how to do the bashate release because mrodden worked it out and was doing it. If you figure out instructions, I'm happy to cut it (or figure out how to give you permissions to do it) | 11:06 |
ianw | sdague: ok, i can confer with him. he said something about the PTL doing it | 11:07 |
sdague | yeh, he's the bashate ptl | 11:07 |
sdague | but I'm sure we could open up the permissions to give core release authority | 11:07 |
*** marun has quit IRC | 11:10 | |
*** boris-42 has quit IRC | 11:11 | |
openstackgerrit | Ian Wienand proposed a change to openstack-dev/devstack: Revert "Single quote iniset argument in merge_config_file" https://review.openstack.org/131334 | 11:12 |
*** marun has joined #openstack-qa | 11:13 | |
*** yamahata has quit IRC | 11:17 | |
openstackgerrit | Chris Dent proposed a change to openstack/tempest: Add scenario test for swift-proxy ceilometer middleware https://review.openstack.org/115971 | 11:19 |
vrovachev | sdague: ping | 11:19 |
openstackgerrit | Chris Dent proposed a change to openstack-dev/devstack: Fix up file-matching in bashate tox test https://review.openstack.org/128809 | 11:21 |
*** tosky has joined #openstack-qa | 11:24 | |
*** aysyd has joined #openstack-qa | 11:25 | |
*** rushiagr_away is now known as rushiagr | 11:25 | |
sdague | vrovachev: don't just ping, if you have a question ask it. :P | 11:27 |
sdague | ianw: so... why was E021 added to bashate anyway? | 11:27 |
sdague | because we know it's bash, not posix shell | 11:28 |
jordanP | gmann, hi, I don't get the comment on : https://review.openstack.org/#/c/116452/2/tempest/services/object_storage/account_client.py can you explain plz ? | 11:28 |
cdent | ianw: I trod on your stuff again, I assumed you were sleeping (128809 above). | 11:29 |
*** dmorita has quit IRC | 11:29 | |
vrovachev | sdague: http://th04.deviantart.net/fs70/PRE/f/2011/288/c/2/okay_by_rober_raik-d4cw242.png :) About patch https://review.openstack.org/#/c/67164/ . After amerge patch https://review.openstack.org/#/c/114514/ ceilo works faster, and tests tests don't fails | 11:31 |
cdent | meh, the provided advice did not fix it | 11:31 |
sdague | vrovachev: but it's still an unbounded race condition right? Like there is no way to 100% ensure that it runs in the window | 11:32 |
sdague | we really can't add new tests that have known non deterministic behavior | 11:32 |
*** andreaf_ has joined #openstack-qa | 11:33 | |
cdent | sdague: that's going to be case with anything driven by notifications, not just ceilometer related tests | 11:34 |
cdent | I agree that non-deterministic behavior needs to be shot dead | 11:34 |
cdent | but when so much of the system is, that's problematic... | 11:35 |
sdague | cdent: right, this is why there was a bunch of discussion about getting flush APIs in the right places | 11:35 |
cdent | If we want to get reid of non-determinism, then we should probably not boot instances, because who knows how long that's going to take... | 11:36 |
*** andreaf_ is now known as andreaf | 11:36 | |
cdent | ;) | 11:36 |
sdague | :P | 11:36 |
openstackgerrit | A change was merged to openstack/tempest: Add list-networks test for os-networks API https://review.openstack.org/112944 | 11:36 |
cdent | where is this "flush" discussion happening? Can you point me at some? | 11:36 |
sdague | it's been kind of spread out over IRC, gerrit reviews, I don't remember if it was on the list or not | 11:37 |
*** Poornima has quit IRC | 11:37 | |
DinaBelova | sdague, well, cdent is right.... I'm kind of curious what to do with these tests :) we *need* them to define if ceilometer is working in (let's say in 99% of the cases when testing lab is behaving ok itself), but that needs us to rely on the chain something-queue-something is working | 11:38 |
sdague | so I remain -2 on adding new ceilometer notification test to tempest, because we've actually had to skip every one we've added for high failure rates, which really to me means we need a different approach | 11:38 |
vrovachev | sdague: but we sure, if test falls, it will not be guilty ceilometer | 11:38 |
sdague | DinaBelova: these seem like the sort of thing to pull back into ceilometer functional test, where you could make a white box internal call to trigger notifications flushing | 11:38 |
sdague | vrovachev: that's not been true in the past | 11:39 |
*** beagles is now known as beagles_brb | 11:39 | |
sdague | because this class of tests has been *so* problematic | 11:39 |
vrovachev | sdague: then ceilo was different :) | 11:39 |
cdent | For the sake of fixing my ignorance can someone define the mechanism for "notifications flushing"? How does that work? | 11:40 |
sdague | cdent: so the issue now is the fact that a bunch of what happens only happens when periodic jobs trigger | 11:40 |
sdague | which in a real environment... is some random time in the future that you don't know | 11:40 |
cdent | I think we may have some language difficulties going on here. When a ceilometer person is talking about a "notification" they usually mean something that some other service has put on the message bus: that service is in charge of when that happens. | 11:42 |
cdent | Those notifications are consumed as meters. | 11:42 |
cdent | There are also pollings, which happen on a period | 11:42 |
cdent | ceilometer is in charge of that period | 11:43 |
sdague | yep | 11:43 |
cdent | so I'm a bit confused | 11:43 |
cdent | where is the "flush"? | 11:43 |
cdent | that is: what is responsible for it? | 11:43 |
sdague | the flush would have to be able to trigger the periodic jobs of the servers on demand | 11:43 |
sdague | which, yes, is bigger than ceilometer | 11:43 |
sdague | but is needed for ceilometer verification in a deterministic way | 11:44 |
sdague | at the integration level | 11:44 |
cdent | so you're imagingin that a service which does notifications could be inspired to dump its notificaitons _now_ based on recieving a signal of some kind | 11:44 |
sdague | yep | 11:44 |
cdent | SIGUSR2 to process whateves | 11:44 |
sdague | or a network API call | 11:44 |
sdague | /admin/flush | 11:44 |
cdent | network api call not very deterministic on a non-deterministic network ;) | 11:45 |
sdague | it is if it's synchronous | 11:45 |
sdague | it would be a blocking call | 11:45 |
cdent | What I mean is that sometimes the network simply isn't behaving as expected. | 11:45 |
cdent | so you can't even get to the API | 11:45 |
cdent | it was mostly a joke | 11:46 |
sdague | :) | 11:46 |
cdent | but is an effort to point out: everything is really fragile | 11:46 |
sdague | anyway, there is a lot of history about the unreliability of these tests in the past, so we should really have an overview document about the test plan and approach here and why it's not going to add any new gate failures | 11:46 |
cdent | Do you think the idea of getting services to be flushable has traction | 11:46 |
*** X019 has joined #openstack-qa | 11:47 | |
sdague | honestly, I don't know, but it's been something I brought up at least 6 months ago, and no one has investigated | 11:47 |
*** SridharG1 has joined #openstack-qa | 11:48 | |
cdent | :( | 11:48 |
* cdent needs clones | 11:48 | |
sdague | but it's *really* important that we don't add anything to tempest that has a known non trivial race chance. And because these tests have had giant races in the past, the burden of proof is back on the ceilometer team to prove that. | 11:48 |
*** mwagner_lap has quit IRC | 11:49 | |
sdague | because I've lost too many days of work figuring out that the ceilometer tests were broken by design and need to be turned off. :( | 11:49 |
*** SridharG has quit IRC | 11:49 | |
ianw | cdent: ok, just a rebase? | 11:49 |
cdent | ianw: yeah, but it didn't fix it | 11:49 |
cdent | sdague: I feel your pain. I too see a lot of broken by design. | 11:50 |
sdague | yep, we've got spades of it all over | 11:50 |
sdague | lets try to fix that :) | 11:50 |
ianw | cdent: that change can't merge until a new release of bashate | 11:50 |
cdent | ianw: yeah, I realized that after the fact | 11:50 |
cdent | (and seeing you and sdague talking earlier about releasing) | 11:51 |
*** jhenner has joined #openstack-qa | 11:51 | |
cdent | sdague: yes, onward etc | 11:51 |
openstackgerrit | Abhishek G M proposed a change to openstack/tempest: Test to verify shared attribute of network https://review.openstack.org/124998 | 11:53 |
openstackgerrit | Monty Taylor proposed a change to openstack-infra/devstack-gate: Remove nosetests.xml reference https://review.openstack.org/131714 | 11:53 |
*** Poornima has joined #openstack-qa | 11:54 | |
*** X019 has quit IRC | 11:58 | |
*** yfried|afk is now known as yfried | 11:59 | |
*** X019 has joined #openstack-qa | 12:00 | |
*** SridharG1 has quit IRC | 12:09 | |
*** weshay has joined #openstack-qa | 12:11 | |
*** nosnos has quit IRC | 12:15 | |
*** Yogi has joined #openstack-qa | 12:18 | |
*** qba73 has joined #openstack-qa | 12:18 | |
*** jecarey has quit IRC | 12:20 | |
*** JayJ has joined #openstack-qa | 12:20 | |
*** Madan has quit IRC | 12:21 | |
*** eglynn has joined #openstack-qa | 12:22 | |
*** dims__ has quit IRC | 12:24 | |
*** dims__ has joined #openstack-qa | 12:24 | |
*** JayJ has quit IRC | 12:25 | |
*** Yogi has quit IRC | 12:26 | |
*** JayJ has joined #openstack-qa | 12:26 | |
*** SridharG has joined #openstack-qa | 12:30 | |
*** JayJ has quit IRC | 12:30 | |
eglynn | cdent, sdague: just catching up with the backlog on the notification "flushing" notion | 12:31 |
eglynn | ... surely we're not in general talking about *periodic* notifications here? | 12:31 |
eglynn | (... e.g. the nova instance audit) | 12:31 |
eglynn | ... rather we're talking about resource-lifecycle notification driven by the actual state transitions? | 12:31 |
yfried | nikesh_vedams_: did you solve the problems? | 12:31 |
eglynn | I update an image in glance => I expect an image.updated notification | 12:31 |
sdague | eglynn: my understanding on why this stuff failed in the past was not all resource lifecycle events happen immediately | 12:32 |
eglynn | sdague: that's interesting, because I though the emission of such notifications was in-line in the nova workflow initiated by the API call | 12:33 |
eglynn | sdague: ... so adding a new flush API wouldn't necessarily help, since the notifications are API-triggered already | 12:33 |
sdague | but, again, I think the point is we need test plan overview here that ensures that's not the case. If we are sure we're not adding more non determinism into the mix I'm fine with moving forward, but I don't feel like that's clear | 12:33 |
eglynn | sdague: OK, so if I hearing correctly, a test plan for what we intend to keep in tempest and what we'll move to the new in-tree functional test suite in kilo? | 12:34 |
eglynn | sdague: ... yes, agreed, that could be an output from the related summit discussions | 12:35 |
openstackgerrit | A change was merged to openstack-infra/devstack-gate: yum non interactive https://review.openstack.org/130719 | 12:35 |
sdague | eglynn: well, more specifically, for stuff coming into tempest, any possible race conditions that exist and why they are not likely to show up in test runs. | 12:35 |
sdague | that's the piece which is missing really | 12:35 |
sdague | and what we need to evaluate adding new tests, because those tests depend on a lot of behind the scenes things happening, and a clear analysis of the expected interaction points behind the scenes, where any of them might fail (or how they can't fail) and what that means for the likelihood that the test ends up non-deterministic | 12:36 |
eglynn | sdague: so just to clarify, by "race" here we mean a test assertion that depends on an synchronous event, and how we can reasonably and reliability bound the wait for that event to occur? | 12:37 |
eglynn | sdague: if so, agreed, that analysis of the moving parts and their interactions should be written down | 12:38 |
sdague | eglynn: yes, if you mean "asynchronous" | 12:38 |
eglynn | sdague: haha, yep, Fruedian slip on my part :) | 12:38 |
sdague | :) | 12:38 |
sdague | yeh, I think if we had those interactions written down, and the expecations, I'd feel a lot more comfortable here | 12:39 |
sdague | because in the past we did a lot of whack-a-mole, and I'd like to avoid that going forward | 12:39 |
eglynn | sdague: yep, I think we can commit to doing that for the ceilometer tests that will remain in, or be added to, tempest | 12:39 |
sdague | awesome | 12:39 |
sdague | thanks | 12:39 |
eglynn | sdague: understood, that'll be something I'll aim for immediately post-summit (once the in-tree test approach is clearer) | 12:40 |
sdague | sounds perfect, thank you | 12:40 |
openstackgerrit | Benny Kopilov proposed a change to openstack/tempest: compute-image : create server from saved snapshot image https://review.openstack.org/120899 | 12:40 |
*** Krast has joined #openstack-qa | 12:48 | |
*** jecarey has joined #openstack-qa | 12:49 | |
nikesh_vedams_ | yfried: | 12:51 |
nikesh_vedams_ | i am trying | 12:51 |
nikesh_vedams_ | i will let you know | 12:51 |
*** dkranz has joined #openstack-qa | 12:53 | |
cdent | It occurs to me, sdague, that many of the ceilometer+notifications problems that were happening in the past were probably because this hadn't been fixed: I1c06d0511fbf93050cda56d9d2de0ff00813dfb6 | 12:54 |
*** X019 has quit IRC | 12:54 | |
cdent | oops, sorry: https://review.openstack.org/#/c/113522/ | 12:54 |
sdague | cdent: so, that's possible. But I still think that given history, we should make sure we're not introducing similar kinds of issues. Instead of just hoping that we aren't. | 12:55 |
cdent | Yes, I agree, was just adding a bit more data to the shared mind. | 12:55 |
sdague | yep | 12:55 |
DinaBelova | cdent, thanks for the lnk | 12:55 |
*** tosky has quit IRC | 12:57 | |
eglynn | cdent: I don't think that was the problem in the problem nova notification test | 12:57 |
cdent | the other main factor was that the collectors were too slow | 12:57 |
eglynn | cdent: ... IIUC that test didn't follow closely after a service/rabbitmq restart? | 12:57 |
cdent | I don't think there's any one single cause, its a complex of things, and we have to recognize that each change will push us along | 12:58 |
cdent | That's the trouble with what we're (inaccurately) calling race conditions: they aren't single source. | 12:59 |
eglynn | cdent: sure, there may be multiple causes, nova tardiness in emitting the notification, ceilo slowness in ingesting it etc | 13:00 |
eglynn | cdent: . ... I just don't think amqp restart was a factor in that test failure | 13:00 |
cdent | Okay, but I didn't say it was. | 13:01 |
cdent | " many of the ceilometer+notifications problems" | 13:02 |
*** markus_z has quit IRC | 13:03 | |
*** malini has quit IRC | 13:04 | |
eglynn | cdent: apologies, I assumed relevance to the prior conversation on notification test failures in tempest | 13:04 |
*** Yogi has joined #openstack-qa | 13:05 | |
*** yfried is now known as yfried|afk | 13:05 | |
*** mestery has quit IRC | 13:08 | |
*** yfried|afk is now known as yfried | 13:08 | |
*** yamahata has joined #openstack-qa | 13:08 | |
*** amotoki has joined #openstack-qa | 13:09 | |
*** markmcclain has joined #openstack-qa | 13:09 | |
*** marun_ has joined #openstack-qa | 13:10 | |
*** markus_z has joined #openstack-qa | 13:10 | |
*** dpaterson has joined #openstack-qa | 13:11 | |
*** mestery has joined #openstack-qa | 13:11 | |
*** markus_z has quit IRC | 13:11 | |
*** marun has quit IRC | 13:12 | |
*** mestery has quit IRC | 13:13 | |
*** mestery has joined #openstack-qa | 13:13 | |
openstackrecheck | openstack/nova change: https://review.openstack.org/131461 failed because of: gate-tempest-dsvm-full: https://bugs.launchpad.net/bugs/1373513 https://bugs.launchpad.net/bugs/1352498 | 13:14 |
*** marun_ is now known as marun | 13:15 | |
chandankumar | dkranz, hello | 13:17 |
*** beagles_brb is now known as beagles | 13:17 | |
chandankumar | dkranz, jordanP gmann please have a look https://review.openstack.org/#/c/131693/ , When you are free. Thanks :) | 13:18 |
*** mwagner_lap has joined #openstack-qa | 13:21 | |
*** dustins has joined #openstack-qa | 13:22 | |
*** mriedem has joined #openstack-qa | 13:23 | |
*** bknudson has joined #openstack-qa | 13:24 | |
*** ajo_ has quit IRC | 13:24 | |
*** ajo_ has joined #openstack-qa | 13:25 | |
*** ajo_ has quit IRC | 13:26 | |
*** SridharG1 has joined #openstack-qa | 13:27 | |
*** SridharG has quit IRC | 13:29 | |
*** amotoki has quit IRC | 13:31 | |
openstackgerrit | chandan kumar proposed a change to openstack/tempest: Fixes volume client in volume tests https://review.openstack.org/131693 | 13:32 |
yfried | dkranz: is there a qa mtg tomorrow? | 13:33 |
*** nikesh_vedams_ has quit IRC | 13:33 | |
dkranz | yfried: I am not sure, but I won't be at it if there is. | 13:34 |
yfried | mtreinish: ^^ | 13:34 |
yfried | dkranz: also, I heard you used to have a qa get-together at the beginning of previous summits. is there one next week? I didn't see anything in the ML | 13:35 |
dkranz | yfried: no, it was not at the beginning. It was more spur-of-the-moment. The presence of the mid-cycle like event at the end lessens the need for this. | 13:36 |
yfried | dkranz: too bad I was looking forward to this. and I won't be at the final 2days | 13:37 |
dkranz | yfried: sorry | 13:37 |
yfried | dkranz: you should be. :) | 13:40 |
*** yamahata has quit IRC | 13:41 | |
*** yamahata has joined #openstack-qa | 13:41 | |
*** cdent has quit IRC | 13:43 | |
*** Krast has quit IRC | 13:43 | |
*** ramishra has joined #openstack-qa | 13:45 | |
*** rbak has quit IRC | 13:46 | |
openstackgerrit | David Kranz proposed a change to openstack/qa-specs: Add spec for clients returning one value https://review.openstack.org/126004 | 13:46 |
*** cdent has joined #openstack-qa | 13:47 | |
*** rushiagr is now known as rushiagr_away | 13:47 | |
*** toure has joined #openstack-qa | 13:50 | |
yfried | dkranz: about your spec. I didn't understand your comment re my objection to inheriting dict | 13:50 |
dkranz | yfried: I don't see a problem with inheriting. If we do what you are suggesting, we are relying on knowing what all the code inside unittest thinks this object is. | 13:53 |
dkranz | yfried: The failures were in assertIn | 13:53 |
dkranz | yfried: buried way down in some path | 13:53 |
*** malini has joined #openstack-qa | 13:53 | |
dkranz | yfried: I don't think this is a big deal and am not willing to invest more energy in this. | 13:53 |
yfried | dkranz: I just want to understand this | 13:54 |
dkranz | yfried: I don't understand all the details | 13:54 |
yfried | dkranz: why is unittest a factor? we are replacing a normal dict with our own object | 13:54 |
dkranz | yfried: yes, but we are passing that object to assertIn | 13:55 |
dkranz | yfried: and that works when we "are" a dict, but not when we wrap it | 13:55 |
openstackgerrit | A change was merged to openstack-dev/grenade: Add comment explaining where javelin logs are found https://review.openstack.org/119587 | 13:55 |
yfried | dkranz: oh, I see - assertIn is designed to deal with dict but we'll be sending it the object | 13:55 |
dkranz | yfried: yes | 13:55 |
dkranz | yfried: actually I don't know whether it is designed to deal only with dict but the interface is unadvertised and therefore very fragile for us to depend on | 13:56 |
dkranz | yfried: I agree with you in principal | 13:56 |
dkranz | principle | 13:56 |
yfried | dkranz: ok. so please document that in the bp and the code to explain the choice of inheritance over composition | 13:56 |
dkranz | yfried: I will document it in the bp | 13:57 |
yfried | dkranz: as I assume this question will be raised by others from time to time. | 13:57 |
dkranz | yfried: well, AttributeDict also inherits from dict | 13:57 |
dkranz | yfried: but ok | 13:58 |
yfried | dkranz: AttributeDict is what got me to object to your way in the first place | 13:59 |
yfried | dkranz: please add the reason the the code as well. Too much documentation is not a problem for us ATM | 13:59 |
dkranz | yfried: I am just saying that I don't expect code to be documented with every alternative implementation choice that could have been made. | 13:59 |
yfried | dkranz: me too, but I forsee this would come into question from time to time and havine a one-line about the assertIn as example would help a lot for ppl looking at it who weren't part of the spec discussion | 14:01 |
yfried | dkranz: need to go assemble puzzles. will talk later | 14:01 |
dkranz | yfried: I really don't see what is wrong with inheriting from dict and don't see evidence that your counter-view is widely held. | 14:03 |
*** ramishra has quit IRC | 14:04 | |
*** ramishra has joined #openstack-qa | 14:05 | |
*** zz_dimtruck is now known as dimtruck | 14:08 | |
openstackgerrit | David Kranz proposed a change to openstack/tempest: Add code to enable single-value response for http clients https://review.openstack.org/130645 | 14:09 |
*** ramishra has quit IRC | 14:10 | |
*** gordc has joined #openstack-qa | 14:10 | |
*** andreaf has quit IRC | 14:11 | |
*** andreaf has joined #openstack-qa | 14:12 | |
*** markmcclain has quit IRC | 14:12 | |
openstackgerrit | A change was merged to openstack-dev/devstack: Use updated trove mysql image location https://review.openstack.org/131002 | 14:16 |
*** neeti has quit IRC | 14:17 | |
*** rbak has joined #openstack-qa | 14:17 | |
mrodden | ianw: sdague: just got done with my morning meetings and was going to check those patches from yesterday before doing a release on bashate | 14:18 |
mtreinish | yfried: yes, I was planning to have the regular meeting tomorrow, even if its short | 14:20 |
*** mkollaro has joined #openstack-qa | 14:21 | |
*** yfried is now known as yfried|afk | 14:21 | |
*** zz_jgrimm is now known as jgrimm | 14:22 | |
dkranz | yfried|afk: BTW, I'm not sure where the idea that inheriting from dict is bad comes from. It is even advertised as a feature here: https://docs.python.org/2/library/userdict.html | 14:29 |
mtreinish | dkranz: there's nothing wrong with doing it | 14:30 |
*** SridharG1 has left #openstack-qa | 14:30 | |
mrodden | ianw: sdague: https://pypi.python.org/pypi/bashate/0.3.0 | 14:30 |
dkranz | mtreinish: :) | 14:30 |
sdague | mrodden: great | 14:30 |
*** hop has joined #openstack-qa | 14:30 | |
sdague | mrodden: is there release instructions somewhere? | 14:31 |
mrodden | yeah somewhere... | 14:31 |
mrodden | let me look | 14:31 |
mtreinish | mrodden: https://wiki.openstack.org/wiki/Nova/Client_Release_Process | 14:32 |
mtreinish | it's just create a tag and then git push gerrit tag | 14:32 |
mtreinish | mrodden: or https://wiki.openstack.org/wiki/QA/releases | 14:33 |
*** yfried|afk is now known as yfried | 14:33 | |
mrodden | i usually follow this https://wiki.openstack.org/wiki/GerritJenkinsGit#Tagging_a_Release | 14:37 |
mrodden | its a bit more generic to all projects | 14:37 |
mrodden | except i tagged the wrong thing | 14:40 |
mrodden | derp | 14:40 |
mrodden | 0.3.1 out now :) | 14:43 |
*** neeti has joined #openstack-qa | 14:45 | |
*** yfried is now known as yfried|afk | 14:45 | |
*** mpaolino has quit IRC | 14:45 | |
*** Yogi2 has joined #openstack-qa | 14:53 | |
*** neeti has quit IRC | 14:53 | |
*** Yogi has quit IRC | 14:55 | |
*** yamahata has quit IRC | 14:58 | |
*** yamahata has joined #openstack-qa | 14:58 | |
*** mpaolino has joined #openstack-qa | 14:59 | |
*** jaypipes is now known as jaypipes-afk | 15:00 | |
*** Yogi has joined #openstack-qa | 15:02 | |
*** Yogi2 has quit IRC | 15:02 | |
*** rushiagr_away is now known as rushiagr | 15:08 | |
*** yfried has joined #openstack-qa | 15:09 | |
*** neeti has joined #openstack-qa | 15:10 | |
*** yfried_ has joined #openstack-qa | 15:12 | |
*** yfried|afk has quit IRC | 15:12 | |
*** pcrews has joined #openstack-qa | 15:12 | |
*** yamamoto has joined #openstack-qa | 15:13 | |
*** yfried has quit IRC | 15:15 | |
*** yfried_ has quit IRC | 15:22 | |
openstackgerrit | John Davidge proposed a change to openstack-dev/devstack: Add IPv6 support for tenant data network https://review.openstack.org/87987 | 15:22 |
*** hemna__ is now known as hemna | 15:30 | |
*** atiwari has joined #openstack-qa | 15:36 | |
*** mlavalle has joined #openstack-qa | 15:38 | |
*** Sukhdev has joined #openstack-qa | 15:39 | |
*** oomichi has joined #openstack-qa | 15:41 | |
*** oomichi has quit IRC | 15:42 | |
*** patrickeast has joined #openstack-qa | 15:47 | |
*** mkollaro has quit IRC | 15:57 | |
dkranz | chmouel: when deploying swift, is it required to create the ResellerAdmin role? | 15:57 |
*** sergsh has left #openstack-qa | 15:57 | |
dkranz | chmouel: tempest adds this role in one of its tests and I was wondering if it is the responsibility of a swift deployer to create that role. | 15:58 |
dkranz | notmyname: ^^^ | 15:58 |
*** evgenyf has quit IRC | 16:02 | |
*** neeti has quit IRC | 16:03 | |
*** k4n0 has quit IRC | 16:03 | |
*** chandankumar has quit IRC | 16:03 | |
*** ajo_ has joined #openstack-qa | 16:05 | |
*** Poornima has quit IRC | 16:06 | |
*** mwagner_lap has quit IRC | 16:08 | |
mtreinish | dkranz: IIRC, that test is testing the use of that role which is why it adds the role from config to a user | 16:08 |
*** Yogi has quit IRC | 16:09 | |
mtreinish | dkranz: I think it get's set by default in the swift keystone auth to 'ResellerAdmin' so it should always be set (I'm not 100% though it's been a while since I looked at it) | 16:10 |
*** ajo_ has quit IRC | 16:16 | |
*** Yogi has joined #openstack-qa | 16:18 | |
*** markmcclain has joined #openstack-qa | 16:18 | |
*** marun has quit IRC | 16:24 | |
*** SridharGaddam has quit IRC | 16:27 | |
dkranz | mtreinish: I understand that and it implies that swift is using that role. The question was whether a swift deployment is buggy if it does not create that role in keystone. | 16:35 |
*** zhiyan has quit IRC | 16:36 | |
dkranz | mtreinish: This is part of the project to separate tempest from devstack or any particular installer completely. | 16:36 |
*** tosky has joined #openstack-qa | 16:37 | |
mtreinish | dkranz: no, that's what I was saying I think when you configure to swift to use keystone auth it creates the role | 16:38 |
dkranz | mtreinish: so you are saying the answer is yes, when you install swift you are supposed to do that. So tempest configuration does not need to deal with that. | 16:39 |
dkranz | mtreinish: That is what I thought but wanted confirmation | 16:40 |
mtreinish | dkranz: well assuming you've configured swift to use keystone auth (which is a prereq for tempest) | 16:40 |
mtreinish | if you give me a few mins I can take a look in the code | 16:40 |
dkranz | mtreinish: I can look. Which code? | 16:41 |
mtreinish | the swift keystone auth bits | 16:42 |
dkranz | mtreinish: I checked. There is a reseller_admin_role in conf that defaults to ResellerAdmin. So if you deploy swift/keystone and don't create that role, your install procedure is buggy. That is what I was looking for. | 16:45 |
dkranz | mtreinish: I mean in swift conf file | 16:46 |
mtreinish | yeah, I knew what you meant :) | 16:46 |
openstackgerrit | A change was merged to openstack/tempest: Fix the flavor ram string value https://review.openstack.org/131637 | 16:48 |
openstackrecheck | openstack/glance change: https://review.openstack.org/128928 failed because of: gate-tempest-dsvm-full: https://bugs.launchpad.net/bugs/1373513 | 16:49 |
chmouel | dkranz: yes, we need the ResellerAdmin for some of the tempest tests, | 16:50 |
dkranz | mtreinish: So I just read your email and it represents my thoughts exactly. Do you want to co-lead that cross-project session? | 16:51 |
chmouel | dkranz: not for every use case but to test the access to different projects from the same admin user | 16:51 |
dkranz | chmouel: yes, thanks | 16:51 |
dkranz | mtreinish: BTW, it would be great if we could use changes to the clients in tempest-lib as the way to detect changes. | 16:52 |
dkranz | mtreinish: But I think we will need to get rid of usage of **kwargs as inputs to the rest client functions in order to do that. | 16:53 |
mtreinish | dkranz: I'm fine letting you lead it, the leader just sits in the center :) | 16:53 |
dkranz | mtreinish: else you could change the api but not the code since it would be a pass-through | 16:53 |
dkranz | mtreinish: ok :) | 16:53 |
dkranz | mtreinish: but I am glad to see we are on the same page since that was not clear to me in the past | 16:54 |
mtreinish | dkranz: heh, I'm sure when we get down to the details there will be differences in opinion :) | 16:56 |
*** hop has quit IRC | 16:59 | |
*** suneelb has joined #openstack-qa | 16:59 | |
openstackrecheck | openstack/ceilometer change: https://review.openstack.org/131525 failed because of: gate-tempest-dsvm-neutron-full: https://bugs.launchpad.net/bugs/1370496 | 17:11 |
openstackgerrit | Mate Lakat proposed a change to openstack-dev/devstack: XenAPI: move Neutron plugin install to domU https://review.openstack.org/129208 | 17:12 |
openstackgerrit | Mate Lakat proposed a change to openstack-dev/devstack: XenAPI: Remove non-used functions https://review.openstack.org/129209 | 17:12 |
openstackgerrit | Mate Lakat proposed a change to openstack-dev/devstack: XenAPI: workaround for unsupp. associative arrays https://review.openstack.org/127603 | 17:12 |
*** mwagner_lap has joined #openstack-qa | 17:12 | |
*** yamamoto has quit IRC | 17:15 | |
*** harlowja_away is now known as harlowja | 17:16 | |
*** jpich has quit IRC | 17:16 | |
*** jlibosva has quit IRC | 17:20 | |
*** Poornima has joined #openstack-qa | 17:21 | |
*** harlowja_ has joined #openstack-qa | 17:21 | |
*** harlowja has quit IRC | 17:21 | |
*** achanda has joined #openstack-qa | 17:23 | |
openstackgerrit | Matt Riedemann proposed a change to openstack/tempest: POC: test if unicode server name works on boot https://review.openstack.org/131833 | 17:23 |
*** e0ne has quit IRC | 17:28 | |
*** Sukhdev has quit IRC | 17:28 | |
*** markmcclain has quit IRC | 17:31 | |
*** jaypipes-afk is now known as jaypipes | 17:34 | |
*** achanda has quit IRC | 17:35 | |
*** andreaf has quit IRC | 17:35 | |
*** andreaf has joined #openstack-qa | 17:35 | |
*** qba73 has quit IRC | 17:36 | |
mriedem | mtreinish: grenade testing with neutron is non-voting/experimental right now right? | 17:37 |
*** jamielennox is now known as jamielennox|away | 17:40 | |
mtreinish | mriedem: yes | 17:41 |
mtreinish | it was non-voting check for a bit, but we moved it to the experimental queue | 17:41 |
mriedem | mtreinish: ok, going up on the CI etherpad gap list then :) | 17:42 |
mtreinish | mriedem: link? | 17:43 |
mriedem | it's not ready yet :) | 17:43 |
mriedem | i'll present it in all it's glory soon | 17:44 |
*** beekneemech has joined #openstack-qa | 17:44 | |
mtreinish | heh, ok | 17:44 |
mriedem | i'm letting mastodon at high volumes move my fingeres | 17:44 |
*** bnemec has quit IRC | 17:44 | |
*** achanda has joined #openstack-qa | 17:48 | |
*** skata_ has joined #openstack-qa | 17:49 | |
skata_ | Hello .. I get the follwoing error when gerrit tries to connect to review.openstack.org " Connection error : com.jcraft.jsch.JSchException: ProxyHTTP: java.io.IOException: proxy error: Forbidden" .. Can anyone give me pointers to the debug the issue? Any help is really appreciated! Thanks! | 17:50 |
*** achanda has quit IRC | 17:51 | |
*** aix has quit IRC | 17:52 | |
*** yamahata has quit IRC | 17:53 | |
*** harlowja_ has quit IRC | 17:55 | |
*** tkammer_ has quit IRC | 17:55 | |
*** harlowja has joined #openstack-qa | 17:56 | |
*** afazekas has quit IRC | 17:57 | |
*** zhiyan has joined #openstack-qa | 18:00 | |
openstackgerrit | A change was merged to openstack/tempest: Correct docstring indentation https://review.openstack.org/131366 | 18:01 |
*** pcrews has quit IRC | 18:07 | |
*** safchain has quit IRC | 18:07 | |
* cdent tries devstack on f21 | 18:09 | |
*** jordanP has quit IRC | 18:09 | |
*** tosky has quit IRC | 18:16 | |
*** andreaf has quit IRC | 18:17 | |
*** tosky has joined #openstack-qa | 18:18 | |
*** markmcclain has joined #openstack-qa | 18:25 | |
*** Poornima has quit IRC | 18:28 | |
*** vrovachev has quit IRC | 18:31 | |
*** gszasz has quit IRC | 18:33 | |
*** mpaolino has quit IRC | 18:43 | |
lifeless | random question | 18:45 |
lifeless | is anyone interested in validating the unittest2 changes before I do a 0.7.0 release containing them ? | 18:45 |
*** skata_ has quit IRC | 18:48 | |
mordred | hrm | 18:48 |
* mordred trying to think of a non-insane way to test that | 18:48 | |
lifeless | its only two years of backports of unittest changes in cpython that we're not using anywhere else. | 18:48 |
lifeless | WHAT COULD POSSIBLY GO WRONG | 18:48 |
mordred | lifeless: I can't think of a thing | 18:51 |
*** achanda has joined #openstack-qa | 18:52 | |
*** johnthetubaguy is now known as zz_johnthetubagu | 18:54 | |
*** eglynn has quit IRC | 18:57 | |
*** achanda has quit IRC | 18:57 | |
*** markmcclain1 has joined #openstack-qa | 19:01 | |
openstackgerrit | Clark Boylan proposed a change to openstack-infra/devstack-gate: Enable nova multi host on aiopcpu tests https://review.openstack.org/131604 | 19:01 |
*** markmcclain2 has joined #openstack-qa | 19:02 | |
*** sabeen1 has joined #openstack-qa | 19:02 | |
*** sabeen2 has quit IRC | 19:03 | |
*** markmcclain has quit IRC | 19:03 | |
*** sabeen1 has quit IRC | 19:06 | |
*** markmcclain1 has quit IRC | 19:06 | |
*** sabeen1 has joined #openstack-qa | 19:06 | |
*** pcrews has joined #openstack-qa | 19:07 | |
openstackgerrit | A change was merged to openstack-dev/devstack: allow for soft updating of global-requirements https://review.openstack.org/131198 | 19:08 |
*** rushiagr is now known as rushiagr_away | 19:10 | |
*** Sukhdev has joined #openstack-qa | 19:13 | |
*** tosky has quit IRC | 19:14 | |
openstackgerrit | Clark Boylan proposed a change to openstack-infra/devstack-gate: Enable nova multi host on aiopcpu tests https://review.openstack.org/131604 | 19:19 |
*** __afazekas is now known as afazekas | 19:30 | |
sdague | dtroyer: if you aren't on a plane already - what's valid values for endpoint_type except publicURL? | 19:31 |
sdague | https://review.openstack.org/#/c/129357/4/novaclient/shell.py | 19:31 |
dtroyer | sdague: (between flights) adminURL and internalURL IIRC | 19:32 |
sdague | ok | 19:32 |
sdague | seems odd that we don't have the service catalog set the preference, as it should be aware of what works for the environment, no? | 19:33 |
mtreinish | sdague: I think public, admin, and internal are also valid values too | 19:33 |
sdague | mtreinish: ok, is there an enum somewhere? I did moderate grepping and just found strings being passed around | 19:34 |
*** malini has quit IRC | 19:34 | |
mtreinish | sdague: heh, I just remembered when it was added to tempest and looked at the list of what's allowed there | 19:34 |
mtreinish | I would imagine it's somewhere in keystone? lbragstad ^^^ any ideas? | 19:35 |
*** cdent has quit IRC | 19:35 | |
*** eglynn has joined #openstack-qa | 19:35 | |
openstackgerrit | Clark Boylan proposed a change to openstack-infra/devstack-gate: Enable nova multi host on aiopcpu tests https://review.openstack.org/131604 | 19:36 |
*** sabeen1 has quit IRC | 19:38 | |
dtroyer | sdague: before the auth plugins that was all a mess, I haven't looked at cleaning up the old clients as they get updated, not sure if that's possible without breaking compat | 19:38 |
*** mkollaro has joined #openstack-qa | 19:38 | |
*** sabeen1 has joined #openstack-qa | 19:40 | |
*** dimtruck is now known as zz_dimtruck | 19:46 | |
*** zz_dimtruck is now known as dimtruck | 19:46 | |
*** beekneemech is now known as bnemec | 19:48 | |
*** markmcclain2 has quit IRC | 19:50 | |
*** markmcclain has joined #openstack-qa | 19:51 | |
openstackgerrit | Clark Boylan proposed a change to openstack-infra/devstack-gate: Enable nova multi host on aiopcpu tests https://review.openstack.org/131604 | 19:51 |
openstackgerrit | Sean Dague proposed a change to openstack-dev/devstack: Add pcre devel package for Horizon https://review.openstack.org/128603 | 19:51 |
*** pcrews has quit IRC | 19:53 | |
*** achanda has joined #openstack-qa | 19:59 | |
*** yfried_ has joined #openstack-qa | 20:06 | |
*** yfried_ is now known as yfried|afk | 20:06 | |
*** aysyd has quit IRC | 20:11 | |
*** markmcclain has quit IRC | 20:13 | |
*** yfried has joined #openstack-qa | 20:18 | |
lbragstad | mtreinish: reading back.. | 20:18 |
*** yfried|afk has quit IRC | 20:18 | |
lbragstad | mtreinish: looking for what is allowed as an acceptable value for endpoint['interface']? | 20:19 |
lbragstad | mtreinish: https://github.com/openstack/keystone/blob/f45b3e5e0000f33c3da0349a0f475d5de71ee9de/keystone/catalog/schema.py#L71 | 20:21 |
lbragstad | sdague: ^ | 20:21 |
lbragstad | so, 'admin', 'internal', and 'public' are acceptable values | 20:21 |
sdague | lbragstad: ok, so publicURL ? | 20:21 |
sdague | or are we munging that somewhere along the way | 20:21 |
lbragstad | sdague: amending the above statement for V3 only.. | 20:22 |
lbragstad | sdague: checking V2 | 20:22 |
*** yfried_ has joined #openstack-qa | 20:23 | |
*** yfried_ is now known as yfried|afk | 20:23 | |
*** pcrews has joined #openstack-qa | 20:23 | |
*** yfried has quit IRC | 20:24 | |
lbragstad | sdague: according to the v2 api code, 'publicurl' is mandatory for create endpoint requests. https://github.com/openstack/keystone/blob/f45b3e5e0000f33c3da0349a0f475d5de71ee9de/keystone/catalog/controllers.py#L98 | 20:24 |
*** yfried|afk has quit IRC | 20:25 | |
*** adam_g_gone is now known as adam_g | 20:30 | |
*** atiwari has quit IRC | 20:35 | |
*** afazekas_ has joined #openstack-qa | 20:36 | |
openstackrecheck | openstack/nova change: https://review.openstack.org/114539 failed because of: gate-tempest-dsvm-full: https://bugs.launchpad.net/bugs/1244457 | 20:45 |
*** mkollaro has quit IRC | 20:45 | |
*** achanda has quit IRC | 20:50 | |
*** patrickeast has quit IRC | 20:59 | |
openstackgerrit | Joe Gordon proposed a change to openstack-dev/devstack: Make allow_{resize|migrate}_to_same_host configurable https://review.openstack.org/131557 | 20:59 |
*** patrickeast has joined #openstack-qa | 20:59 | |
sdague | jogo: so why != "False" vs. == "True" | 21:03 |
sdague | double negatives are a little weird to read | 21:03 |
*** patrickeast_ has joined #openstack-qa | 21:03 | |
sdague | if you respin fast I'll give you a +2 :) | 21:03 |
*** patrickeast has quit IRC | 21:03 | |
*** patrickeast_ is now known as patrickeast | 21:03 | |
jogo | sdague: I cut and paste from somewhere else | 21:05 |
*** Sukhdev has quit IRC | 21:05 | |
openstackgerrit | Joe Gordon proposed a change to openstack-dev/devstack: Make allow_{resize|migrate}_to_same_host configurable https://review.openstack.org/131557 | 21:05 |
jogo | sdague: ^ fixed | 21:05 |
sdague | +2 | 21:06 |
*** toure has quit IRC | 21:06 | |
*** dpaterson has quit IRC | 21:06 | |
mtreinish | jogo: I'll +A it when jenkins comes back | 21:06 |
mtreinish | although I prefer double negatives... | 21:06 |
*** Yogi has quit IRC | 21:07 | |
jogo | mtreinish: hehe | 21:09 |
mtreinish | sdague: what to +A the tempest-lib migration patch: https://review.openstack.org/117649 | 21:11 |
*** dimtruck is now known as zz_dimtruck | 21:15 | |
*** weshay has quit IRC | 21:15 | |
sdague | mtreinish: sure, though it did fail again. | 21:15 |
openstackgerrit | Jim Rollenhagen proposed a change to openstack-dev/devstack: Add iptables rule for Ironic VMs -> Swift https://review.openstack.org/131876 | 21:16 |
*** JayJ has joined #openstack-qa | 21:17 | |
*** dkranz has quit IRC | 21:17 | |
mtreinish | sdague: ooh, a 500 on a server get that's ugly: http://logs.openstack.org/49/117649/11/check/check-tempest-dsvm-neutron-full/f59d991/console.html#_2014-10-27_16_16_23_313 | 21:18 |
*** zz_dimtruck is now known as dimtruck | 21:18 | |
jogo | just got a ERROR (InstanceInErrorState): No valid host was found. | 21:19 |
jogo | from HP | 21:19 |
*** marun has joined #openstack-qa | 21:19 | |
mtreinish | jogo: heh, I've seen that from hp cloud before too | 21:19 |
mrodden | ruh roh | 21:19 |
openstackgerrit | Jim Rollenhagen proposed a change to openstack-dev/devstack: Add iptables rule for Ironic VMs -> Swift https://review.openstack.org/131876 | 21:19 |
jogo | moar cloud please | 21:19 |
sdague | ok, time to call it an day. Will chat with folks in the morning | 21:20 |
*** achanda has joined #openstack-qa | 21:24 | |
*** ajo_ has joined #openstack-qa | 21:25 | |
*** patrickeast has quit IRC | 21:25 | |
*** dustins has quit IRC | 21:30 | |
*** patrickeast has joined #openstack-qa | 21:32 | |
*** patrickeast has quit IRC | 21:34 | |
*** patrickeast has joined #openstack-qa | 21:35 | |
*** gordc has quit IRC | 21:41 | |
mtreinish | jogo, mriedem: ugh, a timeout to neutron: http://logs.openstack.org/49/117649/11/check/check-tempest-dsvm-neutron-full/f59d991/logs/screen-n-api.txt.gz#_2014-10-27_16_05_16_239 | 21:42 |
mriedem | mtreinish: i feel like that's not news... | 21:43 |
mtreinish | probably not, I'm sure it's been seen before | 21:43 |
mriedem | i've seen that kind of thing a lot in our internal CI runs | 21:44 |
mriedem | with smaller flavor'ed vm's | 21:44 |
mriedem | 2 cpu | 21:44 |
mriedem | but not running concurrently with testr | 21:45 |
mriedem | we have what now, ncpu / 2 workers in devstack for everything except keystone workers? | 21:45 |
mtreinish | mriedem: yeah I think that's right. jogo ^^^? | 21:47 |
mtreinish | mriedem: but if you're running serially that would be weird because it shouldn't have an issue handling 1 request at a time | 21:47 |
jogo | mtreinish: sounds right | 21:48 |
mtreinish | mriedem: hmm, looking at the neutron log it doesn't crash or anything but there is a 30sec gap where the request fails: http://logs.openstack.org/49/117649/11/check/check-tempest-dsvm-neutron-full/f59d991/logs/screen-q-svc.txt.gz#_2014-10-27_16_05_16_238 | 21:48 |
jogo | mtreinish: check dstat | 21:48 |
mtreinish | jogo: low load avgs ~90% idle | 21:49 |
jogo | that will even show things like failing hard disks (had one recently myself) | 21:49 |
jogo | mtreinish: even around that 30 second gap? | 21:49 |
jogo | look at disk IO | 21:49 |
mtreinish | oops wrong timestamp | 21:49 |
jogo | and amount of CPU waiting for disk | 21:49 |
*** openstackgerrit has quit IRC | 21:50 | |
mriedem | 41 hits in 7 days http://goo.gl/y6AH0r | 21:51 |
mriedem | not sure if we have a bug written | 21:51 |
mtreinish | jogo: http://paste.openstack.org/show/126725/ | 21:51 |
mriedem | why is java running again? | 21:52 |
mtreinish | mriedem: I think that's the jenkins slave stuff | 21:53 |
mriedem | ah | 21:53 |
mtreinish | mriedem: yeah it is: http://logs.openstack.org/49/117649/11/check/check-tempest-dsvm-neutron-full/f59d991/logs/ps.txt.gz | 21:53 |
jogo | mriedem: yeah jenkins | 21:53 |
mtreinish | although I have no idea why that would be the top process | 21:53 |
jogo | 60% WAIT is a lot I think | 21:53 |
mtreinish | clarkb: ^^^ | 21:53 |
jogo | mtreinish: looks like the disk stops responding for a bit | 21:54 |
jogo | mtreinish: we have seen that before | 21:54 |
jogo | mtreinish: I fixed that at home by replacing my HD over the weekend | 21:54 |
mtreinish | jogo: so you just think it's a bad node or something? | 21:54 |
jogo | mtreinish: that is my working theory | 21:55 |
jogo | I wonder what happens if we try using tmfs for some of the more heavily used directories | 21:55 |
jogo | tmpfs* | 21:55 |
mtreinish | jogo: well, don't we only have ~2gb avail during a normal run is that enough space? | 21:57 |
jogo | mtreinish: prob not | 21:57 |
jogo | I think we have a bit more then that but not a lot of space | 21:57 |
mtreinish | oh, but on the hp nodes I think clarkb said we're using a 32gb flavor and just only use 8 | 21:58 |
jogo | we use 6+GB of what appears t obe 8 | 21:58 |
mtreinish | so maybe we could play with it there | 21:58 |
jogo | mtreinish: I don't think it would help | 21:58 |
jogo | its more of a fun bandaid | 21:58 |
jogo | but it sounds like we are disk limited in a lot of runs | 21:58 |
jogo | we should figure out of this is a RAX or HP thing or both | 21:59 |
clarkb | its 8gb of 30gb nodes | 22:00 |
clarkb | to ensure we dont actually need 30gb | 22:00 |
mtreinish | clarkb: is there any way we could turn the unused into a tmpfs? | 22:01 |
clarkb | then we would need 30gb | 22:02 |
clarkb | I would bring it up in infra | 22:02 |
mtreinish | ok | 22:03 |
*** achanda_ has joined #openstack-qa | 22:04 | |
jogo | clarkb: the idea would be, do a lot of disk IO, and this may be a way to speed up tests | 22:08 |
jogo | tmpfs allows swapping etc | 22:08 |
jogo | clarkb: it may not be worth it though | 22:08 |
*** achanda has quit IRC | 22:08 | |
clarkb | ya but then we require 30gb nodes to reproduce the gate | 22:08 |
clarkb | and our nodes are not that big in rax | 22:09 |
jogo | mtreinish: random question | 22:16 |
jogo | mtreinish: is keystone v3 the default for nova tempest tests? | 22:17 |
jogo | mtreinish: if not how do we change that? | 22:17 |
jogo | mtreinish: as it *should* just work at this point | 22:17 |
mtreinish | jogo: it's not, tempest by default will get a token using keystone v2 right now | 22:18 |
*** suneelb has quit IRC | 22:18 | |
mtreinish | there is an experimental job which runs using keystone v3 | 22:18 |
jogo | mtreinish: oh cool, whats the timeline to make that the default? | 22:18 |
jogo | and does it work? | 22:19 |
*** suneelb has joined #openstack-qa | 22:19 | |
mtreinish | jogo: don't know if it works, it was blocked for a while because of the official client story | 22:19 |
jogo | right | 22:19 |
mtreinish | but since we moved to using the tempest clients for scenario that's not a problem anymore | 22:19 |
jogo | mtreinish: any good patch to test it on? | 22:19 |
mtreinish | jogo: it looks like it works: http://logs.openstack.org/55/130655/3/experimental/check-tempest-dsvm-keystonev3-full/39d292d/ | 22:20 |
jogo | oh I'll just use https://review.openstack.org/#/c/117649/ :) | 22:20 |
jogo | is the format to do experimental still 'check experimental'? | 22:21 |
mtreinish | jogo: it is, but those results I posted are from monday | 22:21 |
jogo | mtreinish: cool, assuming we didn't break it since Monday | 22:22 |
jogo | I think we should try to move over to v3 by default in the not to distant future | 22:22 |
mtreinish | I'd hope so :) | 22:22 |
jogo | mtreinish: maybe let morganfainberg push a patch up | 22:23 |
jogo | morganfainberg: ^ | 22:23 |
mtreinish | also the cli tests will still be using v2 because there's nothing else for them | 22:23 |
jogo | mtreinish: right, well that will be fixed in nova soon | 22:23 |
mtreinish | well probably not on the tempest test side | 22:24 |
jogo | mtreinish: yeah ... true | 22:24 |
mtreinish | jogo: but it wouldn't be too hard to do, after 117649 merges I'll push a patch up to make the auth layer for the cli tests more consistent | 22:25 |
mtreinish | but it'll still be v2 on the cli I'm not sure how that works | 22:25 |
*** bknudson has quit IRC | 22:26 | |
*** dims_ has joined #openstack-qa | 22:28 | |
*** dims_ has quit IRC | 22:29 | |
*** dims_ has joined #openstack-qa | 22:30 | |
*** dims__ has quit IRC | 22:31 | |
morganfainberg | jogo: sure will be happy to push a patch. | 22:32 |
morganfainberg | But it won't be till tonight or tomorrow. | 22:33 |
*** achanda_ has quit IRC | 22:34 | |
jogo | mtreinish: ^ read backlog with mtreinish | 22:37 |
mtreinish | jogo: read the backlog with myself? | 22:38 |
jogo | mtreinish: derp | 22:39 |
jogo | morganfainberg: ^ | 22:39 |
*** rbak has quit IRC | 22:55 | |
*** mriedem has quit IRC | 22:55 | |
*** hemna is now known as hemna__ | 22:57 | |
*** achanda has joined #openstack-qa | 22:58 | |
openstackrecheck | openstack/nova change: https://review.openstack.org/129199 failed because of: gate-tempest-dsvm-postgres-full: https://bugs.launchpad.net/bugs/1373513 https://bugs.launchpad.net/bugs/1376941 https://bugs.launchpad.net/bugs/1352498 | 22:58 |
*** Yogi has joined #openstack-qa | 22:59 | |
*** Yogi2 has joined #openstack-qa | 23:02 | |
jogo | mtreinish: ^ 3 | 23:04 |
jogo | good to have openstackrecheck boack | 23:04 |
*** Yogi has quit IRC | 23:04 | |
*** aysyd has joined #openstack-qa | 23:05 | |
*** dims_ has quit IRC | 23:05 | |
*** dims__ has joined #openstack-qa | 23:06 | |
*** gfidente has quit IRC | 23:06 | |
*** ajo_ has quit IRC | 23:22 | |
*** ajo_ has joined #openstack-qa | 23:23 | |
*** JayJ has quit IRC | 23:31 | |
*** dimtruck is now known as zz_dimtruck | 23:41 | |
*** annegentle has quit IRC | 23:42 | |
*** annegentle has joined #openstack-qa | 23:42 | |
*** ajo_ has quit IRC | 23:43 | |
*** ajo_ has joined #openstack-qa | 23:44 | |
*** annegentle has quit IRC | 23:46 | |
*** annegentle has joined #openstack-qa | 23:47 | |
*** annegentle has quit IRC | 23:48 | |
*** annegentle has joined #openstack-qa | 23:48 | |
*** annegentle has quit IRC | 23:49 | |
*** annegentle has joined #openstack-qa | 23:49 | |
*** jecarey has quit IRC | 23:56 | |
*** bknudson has joined #openstack-qa | 23:56 | |
*** asselin has quit IRC | 23:58 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!