| *** tsekiyama has quit IRC | 00:01 | |
| *** shashankhegde has quit IRC | 00:09 | |
| *** shashankhegde has joined #openstack-qa | 00:10 | |
| *** sputnik13 has quit IRC | 00:13 | |
| *** dboik has joined #openstack-qa | 00:14 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/devstack-gate: Add errexit to setup & cleanup functions https://review.openstack.org/177017 | 00:14 |
|---|---|---|
| openstackgerrit | Ian Wienand proposed openstack-infra/devstack-gate: Return command status in tsfilter https://review.openstack.org/178905 | 00:14 |
| *** dboik has quit IRC | 00:18 | |
| *** mlavalle has quit IRC | 00:19 | |
| *** jhenner has quit IRC | 00:26 | |
| *** dmorita has joined #openstack-qa | 00:28 | |
| *** dkranz has joined #openstack-qa | 00:28 | |
| *** dkranz has quit IRC | 00:36 | |
| *** dkranz has joined #openstack-qa | 00:37 | |
| *** dkranz has quit IRC | 00:44 | |
| openstackrecheck | openstack/nova change: https://review.openstack.org/180601 failed because of: gate-tempest-dsvm-nova-v21-full: https://bugs.launchpad.net/bugs/1451506 | 00:48 |
| openstack | Launchpad bug 1451506 in OpenStack Compute (nova) "spawn failed with "libvirtError: internal error: received hangup / error event on socket" in the gate" [Undecided,Confirmed] | 00:48 |
| *** shashankhegde has quit IRC | 00:49 | |
| *** hichihara has joined #openstack-qa | 00:53 | |
| *** shashankhegde has joined #openstack-qa | 00:58 | |
| openstackrecheck | Console logs not available after 13:21s for gate-glance-python27 180797,1,e3a3abe | 01:05 |
| *** dboik has joined #openstack-qa | 01:05 | |
| *** dboik_ has joined #openstack-qa | 01:06 | |
| *** dboik has quit IRC | 01:09 | |
| *** shashankhegde has quit IRC | 01:13 | |
| *** achanda has quit IRC | 01:29 | |
| *** hitalia has quit IRC | 01:34 | |
| *** Yogi has joined #openstack-qa | 01:42 | |
| *** shashankhegde has joined #openstack-qa | 01:47 | |
| openstackrecheck | Console logs not available after 13:24s for check-devstack-dsvm-cells 180809,1,51cd125 | 01:51 |
| samueldmq | mtreinish, do you guys have a list of things to get done in L ? (maybe an etherpad) | 01:51 |
| samueldmq | mtreinish, I'd like to take a look at your plans to L | 01:52 |
| mtreinish | samueldmq: not really, I didn't do anything like that for Kilo, or Juno. But I was thinking about starting to do it for L | 01:54 |
| mtreinish | I'll probably work on something coming out of summit | 01:54 |
| samueldmq | mtreinish, nice, that would contain things you will be discussing at the summit | 01:55 |
| samueldmq | mtreinish, do we have working sessions (or something else) specifc for #qa ? | 01:55 |
| mtreinish | samueldmq: here's our etherpad for brainstorming: https://etherpad.openstack.org/p/liberty-qa-summit-topics | 01:56 |
| mtreinish | I was hoping to lock things down at tomorrow's QA meeting | 01:56 |
| mtreinish | if there's something you were hoping to see, feel free to throw it on there | 01:56 |
| samueldmq | mtreinish, k, I will take a look at that list, and if I have interesting ideas I will propose | 01:57 |
| samueldmq | mtreinish, tomorrow meeting ? what time ? | 01:57 |
| mtreinish | cool, thanks | 01:57 |
| mtreinish | oh, 1700 UTC | 01:57 |
| mtreinish | samueldmq: https://wiki.openstack.org/wiki/Meetings/QATeamMeeting | 01:58 |
| samueldmq | mtreinish, nice, will be there :) | 01:58 |
| mtreinish | samueldmq: cool | 01:58 |
| mtreinish | anyway time for me to call it a night | 01:58 |
| *** patrickeast has quit IRC | 01:59 | |
| samueldmq | mtreinish, k see you thanks | 01:59 |
| *** dboik_ has quit IRC | 02:01 | |
| *** erlon has quit IRC | 02:01 | |
| *** dboik has joined #openstack-qa | 02:01 | |
| *** salv-orlando has quit IRC | 02:03 | |
| openstackgerrit | Merged openstack-infra/elastic-recheck: Add query for libvirt cannot recv data bug 1252947 https://review.openstack.org/180787 | 02:13 |
| openstack | bug 1252947 in OpenStack Compute (nova) "libvirtError: Cannot recv data: Connection reset by peer" [Undecided,Confirmed] https://launchpad.net/bugs/1252947 | 02:13 |
| openstackrecheck | openstack/sahara change: https://review.openstack.org/178745 failed gate-tempest-dsvm-full in the gate queue with an unrecognized error | 02:14 |
| *** mriedem has quit IRC | 02:14 | |
| *** yamahata has joined #openstack-qa | 02:17 | |
| *** yamahata has quit IRC | 02:20 | |
| *** yamahata has joined #openstack-qa | 02:20 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/tempest: Updated from global requirements https://review.openstack.org/176851 | 02:22 |
| *** achanda has joined #openstack-qa | 02:29 | |
| *** mtanino has quit IRC | 02:32 | |
| *** bkopilov has quit IRC | 02:35 | |
| *** Yogi has quit IRC | 02:38 | |
| *** openstackrecheck has quit IRC | 02:39 | |
| *** openstackrecheck has joined #openstack-qa | 02:39 | |
| *** jogo has quit IRC | 02:45 | |
| *** achanda has quit IRC | 02:46 | |
| *** achanda has joined #openstack-qa | 02:48 | |
| openstackgerrit | Merged openstack-dev/devstack: Fix negated services with common prefix https://review.openstack.org/173593 | 02:48 |
| *** dims_ has quit IRC | 02:51 | |
| *** dims has joined #openstack-qa | 02:52 | |
| *** jogo has joined #openstack-qa | 03:02 | |
| *** dims has quit IRC | 03:11 | |
| *** shashankhegde has quit IRC | 03:13 | |
| *** ajmiller_ has quit IRC | 03:19 | |
| *** jyuso1 has quit IRC | 03:23 | |
| *** achanda has quit IRC | 03:28 | |
| *** mmedvede_ has quit IRC | 03:41 | |
| *** pcrews has quit IRC | 03:43 | |
| *** marun has quit IRC | 03:44 | |
| *** mmedvede_ has joined #openstack-qa | 03:48 | |
| openstackrecheck | Console logs not available after 13:23s for gate-cinder-pep8 180691,1,98a4186 | 03:51 |
| *** gamado has joined #openstack-qa | 03:59 | |
| *** bkopilov has joined #openstack-qa | 04:01 | |
| *** achanda has joined #openstack-qa | 04:05 | |
| *** samueldmq has quit IRC | 04:07 | |
| *** yfried has joined #openstack-qa | 04:07 | |
| *** armax has joined #openstack-qa | 04:07 | |
| *** sabeen1 has joined #openstack-qa | 04:13 | |
| *** armax has quit IRC | 04:16 | |
| *** jogo has quit IRC | 04:16 | |
| *** shashankhegde has joined #openstack-qa | 04:17 | |
| *** shashankhegde has quit IRC | 04:19 | |
| *** jogo has joined #openstack-qa | 04:32 | |
| *** oomichi has joined #openstack-qa | 04:33 | |
| *** fedexo has joined #openstack-qa | 04:36 | |
| openstackrecheck | openstack/cinder change: https://review.openstack.org/162722 failed gate-grenade-dsvm in the gate queue with an unrecognized error | 04:38 |
| *** amotoki has joined #openstack-qa | 04:38 | |
| *** pcrews has joined #openstack-qa | 04:41 | |
| *** jog0 has joined #openstack-qa | 04:44 | |
| *** jogo has quit IRC | 04:45 | |
| *** sabeen1 has quit IRC | 04:50 | |
| *** kiran-r has joined #openstack-qa | 04:51 | |
| *** yfried has quit IRC | 04:54 | |
| *** BharatK has quit IRC | 04:56 | |
| openstackrecheck | Console logs not available after 13:21s for gate-cinder-pep8 180400,3,1027a9b | 04:58 |
| *** mmedvede has quit IRC | 05:01 | |
| *** coolsvap|afk is now known as coolsvap | 05:03 | |
| *** ajmiller has joined #openstack-qa | 05:04 | |
| *** ajmiller_ has joined #openstack-qa | 05:07 | |
| *** ajmiller has quit IRC | 05:09 | |
| *** ajmiller__ has joined #openstack-qa | 05:09 | |
| *** ajmiller_ has quit IRC | 05:12 | |
| *** BharatK has joined #openstack-qa | 05:12 | |
| *** shashankhegde has joined #openstack-qa | 05:12 | |
| *** ajmiller__ has quit IRC | 05:15 | |
| openstackgerrit | Imran Hayder Malik proposed openstack/tempest: Fix missing whitespace in conf help There is a missing whitespace between 'the' and 'admin' so in tempest.conf it turns out to be theadmin. Fix applied to config.py. https://review.openstack.org/180865 | 05:17 |
| *** Madan has joined #openstack-qa | 05:17 | |
| *** woodster_ has quit IRC | 05:30 | |
| *** Longgeek has joined #openstack-qa | 05:33 | |
| *** jog0 has quit IRC | 05:42 | |
| *** jogo has joined #openstack-qa | 05:50 | |
| *** jogo has quit IRC | 05:50 | |
| *** jogo has joined #openstack-qa | 05:50 | |
| *** salv-orlando has joined #openstack-qa | 05:50 | |
| *** neeti has joined #openstack-qa | 05:53 | |
| *** fedexo has quit IRC | 05:54 | |
| *** mmedvede_ has quit IRC | 05:55 | |
| *** Kennan has quit IRC | 06:02 | |
| *** Kennan has joined #openstack-qa | 06:03 | |
| *** jyuso1 has joined #openstack-qa | 06:03 | |
| *** neeti has quit IRC | 06:03 | |
| *** neeti has joined #openstack-qa | 06:05 | |
| *** Longgeek has quit IRC | 06:06 | |
| *** pkoniszewski has joined #openstack-qa | 06:07 | |
| openstackrecheck | Console logs not available after 13:23s for check-tempest-dsvm-full 149930,12,a118a40 | 06:11 |
| *** mmedvede has joined #openstack-qa | 06:15 | |
| *** itzikb has joined #openstack-qa | 06:16 | |
| *** anshul has joined #openstack-qa | 06:17 | |
| *** shashankhegde has quit IRC | 06:19 | |
| *** k4n0 has joined #openstack-qa | 06:21 | |
| *** yfried has joined #openstack-qa | 06:25 | |
| *** oomichi has quit IRC | 06:31 | |
| *** Swami has quit IRC | 06:41 | |
| *** safchain has joined #openstack-qa | 06:42 | |
| openstackrecheck | Console logs not available after 13:24s for gate-nova-python27 160202,11,02d8e2a | 06:47 |
| *** yfried is now known as yfried|afk | 07:02 | |
| *** yfried|afk is now known as yfried | 07:03 | |
| *** SridharG has joined #openstack-qa | 07:05 | |
| *** Longgeek has joined #openstack-qa | 07:07 | |
| openstackgerrit | Peter Sabaini proposed openstack/tempest: Fix server creation n test_large_ops https://review.openstack.org/180093 | 07:10 |
| openstackrecheck | Console logs not available after 13:24s for gate-nova-python27 160206,10,b91bb29 | 07:12 |
| *** Longgeek has quit IRC | 07:21 | |
| *** Longgeek has joined #openstack-qa | 07:21 | |
| *** SridharGaddam has joined #openstack-qa | 07:22 | |
| *** jose_lausuch has joined #openstack-qa | 07:22 | |
| *** markus_z has joined #openstack-qa | 07:31 | |
| *** gfidente has joined #openstack-qa | 07:38 | |
| openstackrecheck | Console logs not available after 13:22s for gate-horizon-jshint 179337,9,28d9230 | 07:41 |
| *** jordanP has joined #openstack-qa | 07:41 | |
| *** mmedvede has quit IRC | 07:45 | |
| *** samueldmq has joined #openstack-qa | 07:51 | |
| *** gszasz has joined #openstack-qa | 07:52 | |
| *** mmedvede has joined #openstack-qa | 07:53 | |
| *** samueldmq has quit IRC | 07:54 | |
| *** yog__ has joined #openstack-qa | 07:55 | |
| *** achanda has quit IRC | 07:56 | |
| *** apevec has joined #openstack-qa | 07:57 | |
| *** dmorita has quit IRC | 07:59 | |
| *** jlanoux has joined #openstack-qa | 08:00 | |
| *** ajo has joined #openstack-qa | 08:01 | |
| *** tkammer has joined #openstack-qa | 08:15 | |
| *** apevec has quit IRC | 08:17 | |
| *** sergsh has joined #openstack-qa | 08:22 | |
| *** sergsh_ has joined #openstack-qa | 08:22 | |
| *** e0ne has joined #openstack-qa | 08:23 | |
| *** jlanoux has quit IRC | 08:23 | |
| *** sergsh has quit IRC | 08:25 | |
| *** jlanoux has joined #openstack-qa | 08:26 | |
| *** sergsh_ has quit IRC | 08:26 | |
| *** sergsh has joined #openstack-qa | 08:27 | |
| openstackrecheck | Console logs not available after 13:35s for check-tempest-dsvm-postgres-full 145738,12,c2cebe8 | 08:47 |
| *** shardy has joined #openstack-qa | 08:48 | |
| *** hichihara has quit IRC | 08:53 | |
| *** yamahata has quit IRC | 09:01 | |
| *** e0ne is now known as e0ne_ | 09:03 | |
| openstackrecheck | Console logs not available after 13:22s for check-tempest-dsvm-neutron-full 174313,10,26a2da8 | 09:12 |
| *** aix has joined #openstack-qa | 09:14 | |
| *** yfried is now known as yfried|afk | 09:17 | |
| *** tosky has joined #openstack-qa | 09:25 | |
| openstackrecheck | Console logs not available after 13:23s for gate-horizon-selenium 179752,3,a501854 | 09:25 |
| *** cdent has joined #openstack-qa | 09:30 | |
| *** e0ne_ is now known as e0ne | 09:33 | |
| *** dims has joined #openstack-qa | 09:36 | |
| openstackrecheck | Console logs not available after 13:22s for check-tempest-dsvm-neutron-full 177708,3,61214c3 | 09:39 |
| *** sputnik13 has joined #openstack-qa | 09:39 | |
| *** rdekel has joined #openstack-qa | 09:39 | |
| *** dims has quit IRC | 09:41 | |
| *** yfried|afk is now known as yfried | 09:41 | |
| *** rdekel has quit IRC | 09:44 | |
| *** yfried is now known as yfried|afk | 09:51 | |
| *** dims_ has joined #openstack-qa | 09:59 | |
| *** jhenner has joined #openstack-qa | 10:13 | |
| *** yfried|afk is now known as yfried | 10:16 | |
| *** sputnik13 has quit IRC | 10:20 | |
| *** Madan has quit IRC | 10:30 | |
| *** Madan has joined #openstack-qa | 10:30 | |
| *** BharatK has quit IRC | 10:36 | |
| *** yfried_ has joined #openstack-qa | 10:38 | |
| *** yfried has quit IRC | 10:38 | |
| *** coolsvap is now known as coolsvap|afk | 10:43 | |
| *** BharatK has joined #openstack-qa | 10:49 | |
| *** pc_m has joined #openstack-qa | 10:49 | |
| openstackgerrit | Sean Dague proposed openstack-dev/grenade: wip: debugging worlddump https://review.openstack.org/180666 | 10:50 |
| openstackgerrit | Sean Dague proposed openstack-dev/grenade: DNM: fail to trigger world dump case https://review.openstack.org/180667 | 10:50 |
| openstackgerrit | Sean Dague proposed openstack-dev/grenade: disable errexit when inside EXIT trap https://review.openstack.org/180936 | 10:50 |
| *** weshay has joined #openstack-qa | 10:57 | |
| *** Longgeek has quit IRC | 10:58 | |
| *** Longgeek has joined #openstack-qa | 10:58 | |
| *** achanda has joined #openstack-qa | 11:02 | |
| *** achanda has quit IRC | 11:07 | |
| *** BharatK has quit IRC | 11:08 | |
| *** Madan has quit IRC | 11:13 | |
| *** BharatK has joined #openstack-qa | 11:20 | |
| *** e0ne is now known as e0ne_ | 11:27 | |
| openstackgerrit | Merged openstack-dev/grenade: fix die functions https://review.openstack.org/180664 | 11:37 |
| openstackgerrit | Merged openstack-dev/grenade: don't trace function definitions https://review.openstack.org/180665 | 11:37 |
| *** yfried__ has joined #openstack-qa | 11:44 | |
| *** woodster_ has joined #openstack-qa | 11:46 | |
| *** yfried_ has quit IRC | 11:48 | |
| *** e0ne_ is now known as e0ne | 11:51 | |
| *** openstackgerrit has quit IRC | 11:52 | |
| *** openstackgerrit has joined #openstack-qa | 11:52 | |
| *** itzikb_ has joined #openstack-qa | 11:59 | |
| *** itzikb has quit IRC | 11:59 | |
| *** mmedvede_ has joined #openstack-qa | 11:59 | |
| *** kiran-r has quit IRC | 12:00 | |
| *** dpaterson has joined #openstack-qa | 12:02 | |
| *** hogepodge has quit IRC | 12:02 | |
| *** hogepodge has joined #openstack-qa | 12:05 | |
| *** itzikb_ has quit IRC | 12:05 | |
| *** itzikb has joined #openstack-qa | 12:05 | |
| *** dmellado has quit IRC | 12:09 | |
| *** dmellado has joined #openstack-qa | 12:11 | |
| *** waterkinfe has joined #openstack-qa | 12:13 | |
| *** waterkinfe has quit IRC | 12:15 | |
| *** aysyd has joined #openstack-qa | 12:18 | |
| *** dkranz has joined #openstack-qa | 12:24 | |
| dkranz | boris-42: ping | 12:25 |
| dkranz | boris-42: I was going to submit a qa spec for robust cleanup in tempest. Seems like rally has similar issues and I wanted to see if any work has been done in rally. | 12:25 |
| openstackgerrit | Rohan Kanade proposed openstack/tempest: Adds Database Instance/Actions API Tests https://review.openstack.org/180489 | 12:26 |
| dkranz | yfried__: ^^^ | 12:26 |
| miqui | dtroyer: hi , i contribute to the poppy openstack project, my colleages there gave me your name to consult on a question | 12:26 |
| miqui | i was wondering how would one go about adding a new API to devstack.... | 12:26 |
| yfried__ | dkranz: robust cleanup? | 12:27 |
| yfried__ | dkranz: you mean cleanup resource leakage? | 12:27 |
| dkranz | yfried__: yes, make sure that all resources allocated by tempest can be cleaned up regardless of any tempest failures | 12:27 |
| openstackrecheck | Console logs not available after 13:23s for check-tempest-dsvm-neutron-full 180081,3,ed6bf41 | 12:27 |
| dkranz | yfried__: including tempest crashing | 12:27 |
| yfried__ | dkranz: we have a spec under review for that | 12:27 |
| dkranz | yfried__: can you point? | 12:27 |
| yfried__ | dkranz: it's not covering tempest related resources, though | 12:28 |
| dkranz | yfried__: but rally can run tempest, no? | 12:28 |
| dkranz | yfried__: can you point at the spec? | 12:28 |
| yfried__ | dkranz: sure. but the main idea is - name all resources as "rally_<resource>_XYZ" and hunt for these names instead of track resources like tempest does on addcleanup | 12:29 |
| *** rfolco has joined #openstack-qa | 12:29 | |
| dkranz | yfried__: I don't think that is good enough. My idea is more robust I think. | 12:29 |
| yfried__ | dkranz: it runs tempest but the spec doesn't cover resource created by tempest. we should take a look | 12:29 |
| dkranz | yfried__: url for spec? | 12:29 |
| dtroyer | miqui: by API I'm guessing you mean project, such as poppy? | 12:30 |
| yfried__ | dkranz: https://review.openstack.org/#/c/172967/ | 12:30 |
| dkranz | yfried__: my basic idea is to modify the client so that all allocations/deallocations are recorded in a database | 12:30 |
| miqui | dtroyer: yes | 12:30 |
| boris-42 | dkranz: in meeting let's talk about this in 30 min? | 12:30 |
| miqui | dtroyer: we would like to include poppy rest api in devstack... | 12:30 |
| dkranz | boris-42: sorry, I have a meeting then :) | 12:30 |
| dtroyer | DevStack has support for external plugins where it can call out to another repo to do the setup. | 12:30 |
| dkranz | boris-42: I will make some comments in your spec | 12:30 |
| yfried__ | dkranz: this could work for tempest, but rally uses native clients instead of tempest | 12:31 |
| yfried__ | 's | 12:31 |
| dkranz | yfried__: it does not have to | 12:31 |
| dkranz | yfried__: this was one of the reasons we switched everything in tempest to use the tempest client | 12:31 |
| dkranz | yfried__: there are qa needs that cannot be met with official clients, and they are not going to change | 12:32 |
| dtroyer | miqui: I know manila and gnocchi both do this so there are two working examples. there is basic documentation at http://docs.openstack.org/developer/devstack/plugins.html | 12:32 |
| dkranz | yfried__: if we put this functionality in clients in tempest lib they could be more widely used | 12:32 |
| dtroyer | there are other projects too, the gluster filesystem support uses a stand-alone repo to do the same thing (it is not part of any other project) | 12:32 |
| dkranz | yfried__: but IMO there is no way to really have robust cleanup without control point in the client | 12:32 |
| yfried__ | dkranz: you're gonna have to convince boris-42 | 12:33 |
| dkranz | yfried__: I'm just trying to collaborate | 12:33 |
| yfried__ | dkranz: I understand. | 12:34 |
| miqui | dtroyer: thanks for the tip.. i'll take a look, is this the right channel for devstack question of this type? | 12:34 |
| dkranz | yfried__: but end up with something that is actually robust in the face of failures. If there is a way to do that when using official clients I would love to hear it. | 12:34 |
| yfried__ | dkranz: if tempest takes care of it's own cleanup, then rally doesn't have to... | 12:34 |
| dtroyer | miqui: yes | 12:35 |
| dkranz | yfried__: of course, but rally has exactly the same issue for its own scenarios | 12:35 |
| yfried__ | dkranz: I'm not sure if/why using name-conventions doesn't suit this specific need | 12:35 |
| miqui | dtroyer: cool.. thanks! | 12:35 |
| dkranz | yfried__: because it assumes the missing resources can be obtained by doing a list operation | 12:35 |
| miqui | anybody here installed devstack on fedora 21? | 12:36 |
| *** Yogi has joined #openstack-qa | 12:36 | |
| dkranz | yfried__: My proposal allows you to clean up a resource even if its tenant is gone I believe | 12:36 |
| dkranz | yfried__: but I just started thinking about this yesterday so I might be missing something | 12:37 |
| yfried__ | dkranz: so does naming | 12:37 |
| dkranz | yfried__: let me read the spec now | 12:37 |
| yfried__ | dkranz: neutron net-list will list all networks, regardless of tenants live/dead | 12:37 |
| dkranz | yfried__: the name solution also does not cover the case if there is more than one tempest or rally running in the same cloud | 12:38 |
| *** bkopilov has quit IRC | 12:39 | |
| yfried__ | dkranz: that's a good point | 12:39 |
| dtroyer | miqui: the gate does it every day, and there are a handful of people who use fedora as their primary development platform, but most of us use trusty… | 12:39 |
| yfried__ | dkranz: it can easily be modified to do so | 12:39 |
| dkranz | yfried__: I'm reading spec now | 12:40 |
| dkranz | yfried__: in any event, if just using some name convention works that can be trivially done in tempest as well | 12:40 |
| yfried__ | dkranz: please add your comments as well as your alternate way | 12:41 |
| dkranz | yfried__: will do | 12:41 |
| *** gamado has quit IRC | 12:41 | |
| miqui | dtroyer: hmm, k, cuz it should be straight forward from my searches on the net, but i keep running into problems... | 12:41 |
| miqui | so am wondering if i would have better luck to re-image and try on trusty.... | 12:42 |
| dtroyer | miqui: glancing through the last 5 or so merges to devstack, the f21 job failed in three of them so I'm not surprised | 12:43 |
| miqui | dtroyer: ahhhhhh ...... | 12:43 |
| sdague | that f21 failure has been rather persistent on volume tests | 12:44 |
| yfried__ | dkranz: also - have tempest clients (service library) fully migrated to tempest-lib? | 12:44 |
| openstackgerrit | Sergey Slipushenko proposed openstack/tempest: Tool for generation user accounts from spec https://review.openstack.org/172605 | 12:45 |
| dtroyer | miqui: although looking closer the failures were not in stack.sh but tempest tests, mostly ssh timeouts | 12:45 |
| miqui | ..thanks...well i'll keep trying... | 12:45 |
| sdague | dtroyer: yes, every time I've looked at the fedora runs, it's basically "can't put a vm on the network" failures | 12:46 |
| dkranz | yfried__: no, not yet. But I think it is ready. | 12:46 |
| sdague | so I've stopped paying attention to them, because apparently no one else cares that fedora is massively less reliable at working :) | 12:46 |
| dtroyer | sdague: ditto | 12:47 |
| sdague | honestly, it's probably worth disabling the job soon, as it's not providing any real information. Maybe something to be discussed at summit. | 12:47 |
| *** apevec has joined #openstack-qa | 12:49 | |
| *** dims_ has quit IRC | 12:51 | |
| *** dims has joined #openstack-qa | 12:51 | |
| *** gfidente has quit IRC | 12:55 | |
| *** gfidente has joined #openstack-qa | 12:55 | |
| openstackgerrit | Sean Dague proposed openstack-dev/devstack: dump iptables in the worlddump https://review.openstack.org/180980 | 12:58 |
| sdague | dtroyer: ^^^ would be handy to get to the bottom of some grenade failures that are weird | 12:59 |
| sdague | where a server pings fine then it stops pinging later | 12:59 |
| sdague | and no API changes were made in between | 12:59 |
| *** k4n0 has quit IRC | 12:59 | |
| openstackgerrit | Merged openstack-dev/grenade: disable errexit when inside EXIT trap https://review.openstack.org/180936 | 13:00 |
| *** mriedem has joined #openstack-qa | 13:02 | |
| *** amotoki has quit IRC | 13:08 | |
| *** yog__ has quit IRC | 13:10 | |
| *** kiran-r has joined #openstack-qa | 13:12 | |
| openstackrecheck | Console logs not available after 13:22s for gate-nova-python27 180809,5,312fa73 | 13:14 |
| *** david-lyle has quit IRC | 13:19 | |
| *** yog__ has joined #openstack-qa | 13:22 | |
| *** yog__ has quit IRC | 13:23 | |
| *** dboik has quit IRC | 13:24 | |
| *** openstackstatus has quit IRC | 13:25 | |
| *** openstackstatus has joined #openstack-qa | 13:26 | |
| *** ChanServ sets mode: +v openstackstatus | 13:26 | |
| *** yfried__ has quit IRC | 13:28 | |
| *** sabeen1 has joined #openstack-qa | 13:28 | |
| *** dustins has joined #openstack-qa | 13:28 | |
| *** e0ne is now known as e0ne_ | 13:34 | |
| *** ajmiller has joined #openstack-qa | 13:37 | |
| *** e0ne_ is now known as e0ne | 13:37 | |
| *** yamahata has joined #openstack-qa | 13:37 | |
| openstackgerrit | Davanum Srinivas (dims) proposed openstack-dev/devstack: [WIP] Support for Nova rootwrap-daemon https://review.openstack.org/180992 | 13:38 |
| *** BharatK has quit IRC | 13:38 | |
| *** dboik has joined #openstack-qa | 13:44 | |
| *** dboik has quit IRC | 13:44 | |
| *** dboik has joined #openstack-qa | 13:45 | |
| *** kiran-r has quit IRC | 13:51 | |
| *** jamielennox is now known as jamielennox|away | 13:51 | |
| *** gszasz has quit IRC | 13:54 | |
| dtroyer | sdague: +A | 13:55 |
| *** gszasz has joined #openstack-qa | 13:57 | |
| sdague | dtroyer: thanks | 14:03 |
| openstackgerrit | Matthew Treinish proposed openstack/tempest: Add config option to disable network isolation https://review.openstack.org/177293 | 14:04 |
| sdague | I fast approved a grenade fix this morning, my caller loop was blocking the actual dump on failures because errexit was still on | 14:04 |
| *** pglass has joined #openstack-qa | 14:05 | |
| *** achanda has joined #openstack-qa | 14:06 | |
| *** rbak has joined #openstack-qa | 14:07 | |
| *** achanda has quit IRC | 14:11 | |
| *** mattt has joined #openstack-qa | 14:12 | |
| mattt | jlanoux: ping | 14:12 |
| *** rossella_s has quit IRC | 14:13 | |
| jlanoux | mattt: hi | 14:13 |
| *** rossella_s has joined #openstack-qa | 14:13 | |
| *** Yogi has quit IRC | 14:14 | |
| mattt | jlanoux: i spoke to you a while back regarding some failures i'm getting when i have run_ssh enabled in tempest.conf, you said you were working on a bp to address that | 14:15 |
| mattt | jlanoux: can you point me at the blueprint again if it has not been addressed? | 14:15 |
| jlanoux | mattt: https://blueprints.launchpad.net/tempest/+spec/ssh-auth-strategy | 14:16 |
| mattt | jlanoux: it looks like a subset of tests do not properly associate instances w/ a floating IP, so it's never possible to ssh into them | 14:16 |
| jlanoux | mattt: still WIP | 14:16 |
| *** gamado has joined #openstack-qa | 14:17 | |
| *** neeti has quit IRC | 14:17 | |
| *** bkopilov has joined #openstack-qa | 14:20 | |
| openstackgerrit | Davanum Srinivas (dims) proposed openstack-dev/devstack: [WIP] Support for Nova rootwrap-daemon https://review.openstack.org/180992 | 14:23 |
| *** achanda has joined #openstack-qa | 14:29 | |
| openstackrecheck | Console logs not available after 13:26s for gate-cinder-pylint 178573,4,24b13f6 | 14:30 |
| *** achanda has quit IRC | 14:31 | |
| mattt | jlanoux: ok, thanks ! | 14:32 |
| *** BharatK has joined #openstack-qa | 14:44 | |
| openstackgerrit | Dmitry Ratushnyy proposed openstack/tempest: Implementation of Scenario tests for port-security ML2 extension https://review.openstack.org/178137 | 14:51 |
| openstackgerrit | Merged openstack-dev/devstack: dump iptables in the worlddump https://review.openstack.org/180980 | 14:52 |
| *** hemnafk is now known as hemna | 14:52 | |
| *** achanda has joined #openstack-qa | 14:56 | |
| *** anshul has quit IRC | 14:57 | |
| *** mlavalle has joined #openstack-qa | 14:58 | |
| *** yamahata has quit IRC | 14:59 | |
| *** yamahata has joined #openstack-qa | 14:59 | |
| *** dboik_ has joined #openstack-qa | 15:01 | |
| *** achanda has quit IRC | 15:03 | |
| *** itzikb has quit IRC | 15:04 | |
| *** dboik has quit IRC | 15:05 | |
| *** gszasz has quit IRC | 15:05 | |
| *** gamado has quit IRC | 15:05 | |
| openstackrecheck | Console logs not available after 13:22s for check-tempest-dsvm-neutron-full 176805,7,c018f47 | 15:08 |
| *** salv-orlando has quit IRC | 15:08 | |
| *** sabeen1 has quit IRC | 15:08 | |
| *** mwagner_lap has quit IRC | 15:10 | |
| *** Swami has joined #openstack-qa | 15:17 | |
| *** JayJ_ has joined #openstack-qa | 15:21 | |
| *** shashankhegde has joined #openstack-qa | 15:23 | |
| chrome0 | mtreinish: heya, please excuse the noob Q -- what do you mean with "check experimental" in https://review.openstack.org/#/c/180093/ ? | 15:27 |
| mtreinish | chrome0: oh, there is a separate experimental queue of jobs which have to be manually triggered | 15:28 |
| chrome0 | mtreinish, ah ic, ta | 15:28 |
| mtreinish | I thought that the patch might effect some of the conditions which are only tested on some of those jobs | 15:28 |
| chrome0 | heh, cheers | 15:28 |
| mtreinish | although looking at it again I'm not sure | 15:28 |
| openstackgerrit | Dmitry Ratushnyy proposed openstack/tempest: Implementation of Scenario tests for port-security ML2 extension https://review.openstack.org/178137 | 15:29 |
| chrome0 | well, never hurts to check | 15:29 |
| mtreinish | yep | 15:29 |
| mtreinish | chrome0: if you're curious the list of jobs is here: http://git.openstack.org/cgit/openstack-infra/project-config/tree/zuul/layout.yaml#n3165 | 15:29 |
| chrome0 | nice! | 15:30 |
| *** sputnik13 has joined #openstack-qa | 15:31 | |
| *** cody-somerville has joined #openstack-qa | 15:34 | |
| *** cody-somerville has joined #openstack-qa | 15:34 | |
| *** marun has joined #openstack-qa | 15:35 | |
| *** samueldmq has joined #openstack-qa | 15:35 | |
| *** sergsh has quit IRC | 15:37 | |
| *** SridharG has left #openstack-qa | 15:41 | |
| openstackrecheck | Console logs not available after 13:26s for gate-horizon-selenium 165595,7,dca202b | 15:43 |
| *** SridharGaddam has quit IRC | 15:47 | |
| *** artom has joined #openstack-qa | 15:49 | |
| *** markus_z has quit IRC | 15:49 | |
| *** mtanino has joined #openstack-qa | 15:50 | |
| *** artom has quit IRC | 15:51 | |
| *** artom has joined #openstack-qa | 15:51 | |
| *** mtanino_ has joined #openstack-qa | 15:52 | |
| openstackgerrit | Davanum Srinivas (dims) proposed openstack-dev/devstack: [WIP] Support for Nova rootwrap-daemon https://review.openstack.org/180992 | 15:54 |
| *** mtanino has quit IRC | 15:55 | |
| openstackrecheck | Console logs not available after 13:23s for gate-nova-python27 180695,11,15c3202 | 15:57 |
| *** jose_lausuch has quit IRC | 15:58 | |
| *** ajmiller has quit IRC | 15:58 | |
| *** mtanino_ has quit IRC | 15:59 | |
| *** mwagner_lap has joined #openstack-qa | 16:00 | |
| *** jlanoux has quit IRC | 16:02 | |
| *** Yogi has joined #openstack-qa | 16:03 | |
| *** dboik_ has quit IRC | 16:04 | |
| *** bkopilov has quit IRC | 16:04 | |
| *** dboik has joined #openstack-qa | 16:04 | |
| *** e0ne is now known as e0ne_ | 16:08 | |
| *** bkopilov has joined #openstack-qa | 16:09 | |
| *** salv-orlando has joined #openstack-qa | 16:09 | |
| openstackrecheck | Console logs not available after 13:31s for check-tempest-dsvm-full 133767,81,40bc598 | 16:11 |
| *** safchain has quit IRC | 16:12 | |
| *** salv-orlando has quit IRC | 16:12 | |
| *** jhenner has quit IRC | 16:12 | |
| openstackgerrit | Merged openstack-infra/elastic-recheck: Add context "libvirt" back into query for bug 1451506 https://review.openstack.org/180793 | 16:15 |
| openstack | bug 1451506 in OpenStack Compute (nova) "spawn failed with "libvirtError: internal error: received hangup / error event on socket" in the gate" [Undecided,Confirmed] https://launchpad.net/bugs/1451506 | 16:15 |
| *** e0ne_ is now known as e0ne | 16:17 | |
| openstackgerrit | Merged openstack-infra/elastic-recheck: Upgrade to hacking 0.10.x https://review.openstack.org/179299 | 16:20 |
| *** mtanino has joined #openstack-qa | 16:25 | |
| openstackgerrit | Sean M. Collins proposed openstack-dev/devstack: Documentation for single interface Neutron networking with OVS https://review.openstack.org/166314 | 16:25 |
| openstackrecheck | Console logs not available after 13:24s for gate-nova-python27 145528,9,ed6942a | 16:26 |
| *** openstackrecheck has quit IRC | 16:27 | |
| *** openstackrecheck has joined #openstack-qa | 16:27 | |
| openstackgerrit | Waldemar Znoinski proposed openstack-dev/devstack: Set datapath to $OVS_DATAPATH_TYPE for bridges https://review.openstack.org/159885 | 16:28 |
| sdague | mriedem: http://status.openstack.org//elastic-recheck/#1376941 is not looking promissing | 16:31 |
| mriedem | sdague: you know what is? | 16:34 |
| mriedem | e-r links to bugs | 16:34 |
| mriedem | way2go :) | 16:34 |
| sdague | heh | 16:34 |
| sdague | mtreinish: did something in tempest merge regarding volumes? or did everything just get horrible? | 16:35 |
| mtreinish | sdague: I don't think I saw anything big volume related land in tempest recently | 16:36 |
| mtreinish | let me check the log | 16:36 |
| sdague | so it's just being dangerously close to quota, then a reshuffle? | 16:36 |
| *** gfidente has quit IRC | 16:36 | |
| mtreinish | sdague: nope, nothing corresponding to that spike has landed | 16:36 |
| *** gfidente has joined #openstack-qa | 16:36 | |
| mtreinish | sdague: maybe, although I thought we had a pretty large margin. Isn't it like a 20gb vg for cinder and we use 1gb volumes for everything in tempest | 16:39 |
| clarkb | 32GB iirc | 16:39 |
| mtreinish | clarkb: in the middle :) http://git.openstack.org/cgit/openstack-infra/devstack-gate/tree/devstack-vm-gate.sh#n304 | 16:40 |
| *** rushiagr_away is now known as rushiagr | 16:40 | |
| *** Nic has joined #openstack-qa | 16:43 | |
| *** gszasz has joined #openstack-qa | 16:43 | |
| sdague | mtreinish: so that test is failing all around as well - http://logs.openstack.org/95/180695/11/check/check-tempest-dsvm-neutron-full/f68a0e9/console.html#_2015-05-07_15_39_17_893 | 16:43 |
| *** tsekiyama has joined #openstack-qa | 16:44 | |
| sdague | oh, never mind, that's dim's rootwrap daemon patch ... which fails on everything | 16:44 |
| *** patrickeast has joined #openstack-qa | 16:46 | |
| *** pkoniszewski has quit IRC | 16:54 | |
| sslypushenko | mtreinish Hi!, Can I ask you for review https://review.openstack.org/#/c/172605/ ? | 16:55 |
| dtroyer | mtreinish: I'm playing 'chicken' with a thunderstorm, power has been on and off and my router's ups is about dead…so I may not make the meeting by the time you get to devstack…noting much to report, sdague probably has more than I do about the wheel fun… | 16:59 |
| *** Yogi2 has joined #openstack-qa | 16:59 | |
| dtroyer | s/probably/certainly/ | 16:59 |
| mtreinish | dtroyer: hehe ok, no worries | 16:59 |
| sdague | ok | 17:00 |
| mtreinish | sslypushenko: I'll try to take another look later today | 17:00 |
| sslypushenko | Thx | 17:01 |
| *** Yogi3 has joined #openstack-qa | 17:01 | |
| *** Yogi has quit IRC | 17:02 | |
| *** jordanP has quit IRC | 17:02 | |
| *** Yogi2 has quit IRC | 17:04 | |
| *** BharatK has quit IRC | 17:11 | |
| *** e0ne has quit IRC | 17:11 | |
| *** shashankhegde has quit IRC | 17:12 | |
| *** yamahata has quit IRC | 17:14 | |
| thingee | mtreinish, sdague, jogo this gets rid of those annoying version discovery warnings with cinderclient https://review.openstack.org/#/c/181083/1 | 17:16 |
| jogo | thingee: excellent | 17:16 |
| jogo | sdague: btw https://review.openstack.org/#/c/170608/ the patch that dropped heat, landed 27 hours ago not *2 days* ago | 17:16 |
| jogo | thingee: will that version get rolled out to stable/kilo as well? | 17:17 |
| sdague | jogo: heh | 17:17 |
| thingee | jogo: not making that call, but fine to do so :) | 17:17 |
| thingee | I'll leave that up to sdague | 17:17 |
| jogo | thingee: I think its worth getting in stable/kilo to make the logs less insane | 17:18 |
| mtreinish | jogo: heh, just a loose rounding | 17:18 |
| jogo | mtreinish: looks like it | 17:20 |
| *** daniel3_ has joined #openstack-qa | 17:20 | |
| *** yfried__ has joined #openstack-qa | 17:21 | |
| *** gszasz has quit IRC | 17:23 | |
| *** armax has joined #openstack-qa | 17:25 | |
| openstackgerrit | Davanum Srinivas (dims) proposed openstack-dev/devstack: [WIP] Support for Nova rootwrap-daemon https://review.openstack.org/180992 | 17:28 |
| *** sputnik1_ has joined #openstack-qa | 17:32 | |
| *** sputnik13 has quit IRC | 17:33 | |
| *** yfried__ has quit IRC | 17:34 | |
| *** yfried__ has joined #openstack-qa | 17:35 | |
| openstackgerrit | Imran Hayder Malik proposed openstack/tempest: Fix missing whitespace in conf help There is a missing whitespace between 'the' and 'admin' so in tempest.conf it turns out to be theadmin. Fix applied to config.py. https://review.openstack.org/180865 | 17:35 |
| *** shashankhegde has joined #openstack-qa | 17:38 | |
| *** yamahata has joined #openstack-qa | 17:40 | |
| *** alan_ has joined #openstack-qa | 17:43 | |
| *** erlon has joined #openstack-qa | 17:43 | |
| *** achanda has joined #openstack-qa | 17:43 | |
| *** alan_ has left #openstack-qa | 17:43 | |
| boris-42 | dkranz: hey hey | 17:44 |
| boris-42 | dkranz: around? | 17:44 |
| dkranz | boris-42: yeah, in the qa meeting now | 17:44 |
| dkranz | boris-42: irc, that is | 17:45 |
| *** anteaya has quit IRC | 17:45 | |
| dkranz | boris-42: over in 15min | 17:45 |
| boris-42 | dkranz: okay | 17:45 |
| *** sabeen1 has joined #openstack-qa | 17:45 | |
| dkranz | boris-42: THe rally spec has same requirements as I was thinking. | 17:45 |
| *** apevec has quit IRC | 17:46 | |
| dkranz | boris-42: I was just not sure it could be 100% robust with just name matching from list calls as admin | 17:46 |
| dkranz | boris-42: for every resource type | 17:46 |
| dkranz | boris-42: but I could be wrong | 17:46 |
| mtreinish | dkranz: https://review.openstack.org/171586 seems related to that | 17:47 |
| mtreinish | although I really don't have any context on what you're discussing so feel free to ignore | 17:47 |
| boris-42 | dkranz: so we have some various criterias | 17:47 |
| dkranz | mtreinish: no, you are right but I was trying to be in the qa meeting :) | 17:48 |
| *** apevec has joined #openstack-qa | 17:48 | |
| *** apevec has quit IRC | 17:48 | |
| *** apevec has joined #openstack-qa | 17:48 | |
| boris-42 | dkranz: first of all cleanups should work in various keys | 17:48 |
| boris-42 | there is admin cleanup (that is used for admin only operations and it's based only on checking name pattern) | 17:49 |
| boris-42 | there is users cleanup (where we are listing users resource + name pattern (to not delete non created by Rally resources)) | 17:49 |
| boris-42 | and we have one more thing, we should be able to run from the same set of users in parallel 2 tasks | 17:49 |
| boris-42 | and they should be isolated | 17:50 |
| boris-42 | so we will pass part of task_uuid to the name of resources and check this as well | 17:50 |
| dkranz | boris-42: yes, but since tempest can be called by rally, tempest needs to follow the same convention, right? | 17:50 |
| boris-42 | + we have current mechanism in rally that cotnrols speed of deletion and adds retires | 17:50 |
| boris-42 | dkranz: so there are 2 ways how Rally works with tempest | 17:51 |
| boris-42 | 1) rally verify command (that just manages tempest) and run it as users are doing | 17:51 |
| boris-42 | in such cases we believe that after tests everything will be clean* | 17:51 |
| openstackgerrit | Sean Dague proposed openstack-dev/grenade: clean up upgrade scripts https://review.openstack.org/177334 | 17:51 |
| boris-42 | 2) rally task and sepcial benchmark scenario that runs multple times set of tempest tests | 17:51 |
| boris-42 | ^ we marked it as not safe for production | 17:52 |
| boris-42 | dkranz: ^ | 17:52 |
| boris-42 | dkranz: so what Rally team would like is to have 2 disaster cleanup command/script in tempest | 17:52 |
| boris-42 | that we can run if something went wrong | 17:52 |
| boris-42 | and if everything is OK that we know that 100% of created resources were deleted | 17:53 |
| boris-42 | that's all* | 17:53 |
| dkranz | boris-42: yes, I agree. But in your first case, if tempest fails, there might be something left behind. | 17:53 |
| boris-42 | dkranz: yep so it will be nice if tempest use name patterns | 17:53 |
| boris-42 | dkranz: and we will be able to run disaster cleanup script | 17:53 |
| dkranz | boris-42: that was my point. We should collaborate on this. | 17:53 |
| boris-42 | dkranz: that will list all resources and do this | 17:54 |
| boris-42 | dkranz: agree | 17:54 |
| boris-42 | dkranz: actually we can share this script somehow* | 17:54 |
| boris-42 | dkranz: because disaster cleanup for both projects is the same | 17:54 |
| boris-42 | dkranz: just different name pattern | 17:54 |
| dkranz | boris-42: exactly | 17:54 |
| dkranz | boris-42: I was about to start a similar spec but checked with you guys first | 17:55 |
| boris-42 | dkranz: so it's great that summit is soon | 17:55 |
| *** sputnik1_ has quit IRC | 17:55 | |
| dkranz | boris-42: I suggest we use your spec, but decide if any implementation tasks should be on the tempest side, and/or what convention tempest should follow | 17:56 |
| dkranz | boris-42: it might be nice to put the cleanup code itself in tempest-lib so others could use it as well? | 17:56 |
| boris-42 | dkranz: I can't provide the fast reply on this. What I know it should be available in both projects | 17:58 |
| dkranz | boris-42: +1 | 17:59 |
| boris-42 | dkranz: After detailed designed it will be clear what is the best strategy | 17:59 |
| boris-42 | dkranz: as I said before disaster cleanup is just one case that we have in Rally | 17:59 |
| boris-42 | dkranz: I don't see a full picture yet | 18:00 |
| *** rushiagr is now known as rushiagr_away | 18:00 | |
| dkranz | boris-42: sure, but the most important IMO is that multiple people/processes can be running tempest and rally against a real cloud without disturbing it. | 18:00 |
| dkranz | boris-42: well, rally might disturb it, but resources should not be left behind. | 18:01 |
| openstackgerrit | Waldemar Znoinski proposed openstack-dev/devstack: Set datapath to $OVS_DATAPATH_TYPE for bridges https://review.openstack.org/159885 | 18:01 |
| boris-42 | dkranz: yep | 18:02 |
| boris-42 | dkranz: it's Rally essential task in road map | 18:02 |
| boris-42 | dkranz: https://docs.google.com/spreadsheets/d/16DXpfbqvlzMFaqaXAcJsBzzpowb_XpymaK2aFY2gA2g/edit#gid=0 | 18:02 |
| *** sabeen1 has quit IRC | 18:03 | |
| boris-42 | dkranz: let's pick some time during summit to dicuss this IRL | 18:03 |
| dkranz | boris-42: sure, I"ll be there all week. Are you having any rally session to discuss this? | 18:04 |
| boris-42 | dkranz: yep | 18:04 |
| boris-42 | dkranz: part of one of 2 sessions will be related to this question | 18:05 |
| dkranz | boris-42: ok, I am going to try to attend the rally sessions | 18:05 |
| dkranz | boris-42: I hope they do not conflict with qa/infra sessions | 18:05 |
| *** samueldmq has quit IRC | 18:06 | |
| *** e0ne has joined #openstack-qa | 18:06 | |
| sdague | mtreinish: also, landing this - https://review.openstack.org/#/c/180964/ to see if it helps on some of the grenade jobs now that we synced the real service stop patch in kilo | 18:07 |
| mtreinish | sdague: done | 18:08 |
| *** hitalia has joined #openstack-qa | 18:09 | |
| dkranz | mtreinish: I am fine with the cli removal but noticed two things were added to requirements.txt. What is that about? | 18:11 |
| dkranz | mtreinish: https://review.openstack.org/#/c/178757/5/requirements.txt | 18:11 |
| *** jordanP has joined #openstack-qa | 18:12 | |
| *** jordanP has quit IRC | 18:13 | |
| mtreinish | dkranz: oh, those were missing deps we had in tempest | 18:14 |
| mtreinish | they were getting pulled in by the clients | 18:14 |
| mtreinish | so we never noticed we didn't have them in the requirements list | 18:14 |
| dkranz | mtreinish: ok | 18:15 |
| mtreinish | did I forget to put that in the commit msg? | 18:15 |
| mtreinish | if so I should respin it to mention that | 18:15 |
| dkranz | mtreinish: yes, else I would not have asked :) | 18:15 |
| dkranz | mtreinish: up to you | 18:15 |
| *** gema has quit IRC | 18:16 | |
| dkranz | mtreinish: might as well since it needs a recheck anyway | 18:16 |
| mtreinish | dkranz: yep, one sec I'll add it right now | 18:17 |
| *** anteaya has joined #openstack-qa | 18:17 | |
| openstackgerrit | Matthew Treinish proposed openstack/tempest: Remove CLI testing once and for all https://review.openstack.org/178757 | 18:20 |
| mtreinish | dkranz: ^^^ | 18:20 |
| dkranz | mtreinish: ok, I'm ready to +2 | 18:20 |
| dkranz | mtreinish: good riddance | 18:20 |
| *** salv-orlando has joined #openstack-qa | 18:23 | |
| *** gema_ has joined #openstack-qa | 18:25 | |
| *** sputnik13 has joined #openstack-qa | 18:25 | |
| *** salv-orlando has quit IRC | 18:27 | |
| *** jogo has quit IRC | 18:27 | |
| *** sputnik13 has quit IRC | 18:28 | |
| dansmith | sdague: so, in grenade right now we set the upgrade levels to $(basename devstack) | 18:43 |
| *** jogo has joined #openstack-qa | 18:43 | |
| sdague | dansmith: in the base code, yes | 18:44 |
| sdague | dansmith: is there a question? | 18:45 |
| dansmith | sdague: yeah, sorry, trying to figure out the question :D | 18:45 |
| dansmith | got ahead of myself | 18:45 |
| sdague | no problem, your statement is correct :) | 18:45 |
| dansmith | hehe | 18:45 |
| dansmith | okay, so what I need to do, is make grenade set it not to kilo but kilo-compat when we're upgrading from kilo, | 18:46 |
| dansmith | so I can do that in the from-kilo script? | 18:46 |
| dansmith | even though it will override what we have already done, yes? | 18:47 |
| sdague | dansmith: sorry... what are you trying to do? | 18:47 |
| dansmith | sdague: when we bump an rpc version, as we did in kilo, | 18:47 |
| dansmith | we need to set the upgrade_levels.compute to something slightly different | 18:47 |
| *** JayJ_ has quit IRC | 18:47 | |
| sdague | oh, for the partial job? | 18:48 |
| dansmith | not kilo, but (actually) liberty-compat | 18:48 |
| dansmith | yes | 18:48 |
| sdague | yeh, that sounds right | 18:48 |
| dansmith | okay | 18:48 |
| sdague | it should be in the from-kilo script ... conditionally on the cpu still running. How did we do the transition before? | 18:48 |
| sdague | we've rolled this across a release boundary in the past | 18:49 |
| dansmith | it's so confusing, I need to figure out what exactly I need to set and on which side | 18:49 |
| dansmith | the last time we did a bump was havana | 18:49 |
| dansmith | presumably grenade looked quite different then | 18:49 |
| sdague | well, the scripts sat at the top level | 18:50 |
| dansmith | let me get food so I can actually think this through | 18:50 |
| sdague | oh... you know what | 18:50 |
| dansmith | what | 18:50 |
| sdague | I bet this is set in devstack gate | 18:50 |
| dansmith | eh? | 18:51 |
| dansmith | we set it in grenade, but you think the old version is set by d-g? | 18:51 |
| dansmith | ./projects/60_nova/upgrade.sh: iniset $NOVA_CONF upgrade_levels compute $(basename $BASE_DEVSTACK_BRANCH) | 18:51 |
| dansmith | that's us setting it to kilo when we're upgrading from kilo to master right now, right? | 18:52 |
| dansmith | setting it for the new code | 18:52 |
| sdague | yes | 18:52 |
| sdague | so the names have changed now? | 18:52 |
| sdague | kilo-compat instead of kilo ? | 18:52 |
| dansmith | I would expect that means that d-g doesn't set it at all | 18:52 |
| sdague | yeh, it doesn't | 18:52 |
| dansmith | sdague: it's different when we do a major bump | 18:52 |
| dansmith | the -compat only happens on a major bump | 18:53 |
| sdague | ok... but is kilo not still a thing? | 18:53 |
| dansmith | and last time we did that was havana->icehouse | 18:53 |
| dansmith | kilo is, but it's not the thing we want | 18:53 |
| sdague | because? | 18:53 |
| sdague | this just seems kind of complicated to explain to ops. | 18:53 |
| dansmith | well, I should say: it's not how we did it last time | 18:53 |
| dansmith | it's very complicated | 18:53 |
| dansmith | which is why I'm not even sure which way to do this | 18:53 |
| *** sputnik13 has joined #openstack-qa | 18:54 | |
| dansmith | I wonder if it's that way for h->i because we did that one late and backported | 18:54 |
| sdague | "oh, so I know you all got used to using the release name for the rpc bit, but this time, you should use this different thing instead" | 18:54 |
| dansmith | well, | 18:54 |
| dansmith | heh | 18:54 |
| dansmith | it's not always the release name either | 18:54 |
| dansmith | sometimes it's actually a version | 18:54 |
| sdague | o_O | 18:54 |
| dansmith | just let me get food | 18:55 |
| dansmith | go do something else and I'll come back with coherent arguments | 18:55 |
| sdague | :) | 18:55 |
| dansmith | or a bigger stick | 18:55 |
| dansmith | :) | 18:55 |
| *** Sukhdev has joined #openstack-qa | 18:58 | |
| openstackgerrit | Davanum Srinivas (dims) proposed openstack-dev/devstack: Support for running Nova with oslo.rootwrap daemon https://review.openstack.org/180992 | 18:58 |
| *** samueldmq has joined #openstack-qa | 18:59 | |
| *** sputnik1_ has joined #openstack-qa | 19:00 | |
| openstackrecheck | openstack-dev/devstack change: https://review.openstack.org/180549 failed because of: gate-tempest-dsvm-postgres-full: https://bugs.launchpad.net/bugs/1451506 | 19:00 |
| openstack | Launchpad bug 1451506 in OpenStack Compute (nova) "spawn failed with "libvirtError: internal error: received hangup / error event on socket" in the gate" [Undecided,Confirmed] | 19:00 |
| *** sputnik13 has quit IRC | 19:02 | |
| *** sputnik13 has joined #openstack-qa | 19:03 | |
| *** sputnik1_ has quit IRC | 19:05 | |
| sdague | lifeless: ok, moving cffi discussion here because there is a different meeting going on there | 19:08 |
| lifeless | yah sure | 19:09 |
| sdague | so the cffi maintainers completely don't understand the fail story that currently exists? | 19:09 |
| lifeless | https://bitbucket.org/cffi/cffi/issue/190/cffi-assumes-write-access-to-installed | 19:09 |
| lifeless | weep | 19:09 |
| clarkb | computers are hard | 19:13 |
| *** hitalia has quit IRC | 19:14 | |
| lifeless | so at the risk of being bitter | 19:14 |
| lifeless | author who has bad idea doesn't fully comprehend badness and knock-on badness | 19:15 |
| sdague | right, so this enforces my feeling that cffi is fundamentally crazy pants :) | 19:15 |
| mtreinish | sigh, did they really suggest we should just monkey patch to fix it | 19:16 |
| *** sputnik1_ has joined #openstack-qa | 19:19 | |
| lifeless | mtreinish: they did | 19:19 |
| lifeless | htf you monkeypatch setup_requires triggered code in a release of a third party library I have NFI. | 19:20 |
| lifeless | but they did | 19:20 |
| *** ryansb has left #openstack-qa | 19:20 | |
| sdague | lifeless: do you know anyone that has pull with this maintainer? | 19:20 |
| clarkb | lifeless: you monkey patch pip to monkey patch setup.py before invoking setup() | 19:21 |
| clarkb | lifeless: monkeys the whole way down | 19:21 |
| sdague | because this seems like with this view of the world, cffi is basically going to always be a train wreck for us | 19:21 |
| sdague | because the author has completely not anticipated the idea of installing software not in a venv | 19:21 |
| *** sputnik13 has quit IRC | 19:22 | |
| clarkb | fwiw even in a venv this is a problem if you share venvs across users | 19:22 |
| clarkb | infra does this for many things like zuul-cloner | 19:22 |
| sdague | clarkb: sure, it could be | 19:22 |
| lifeless | sdague: I don't know, no. | 19:22 |
| *** tkammer has quit IRC | 19:22 | |
| lifeless | sdague: its worse than that I think; the python cache is defined as being a cache, graceful degradation. There's a huge semantic mismatch there. | 19:23 |
| sdague | does dstuft? | 19:23 |
| sdague | maybe, I'll jump this to a channel he's in | 19:23 |
| *** mpopow has joined #openstack-qa | 19:31 | |
| *** bkopilov has quit IRC | 19:33 | |
| mriedem | mtreinish: melwitt started noticing these recently, have you seen them? http://logs.openstack.org/27/178827/6/check/check-tempest-dsvm-neutron-full/73dd93c/console.html#_2015-05-07_18_57_17_794 | 19:35 |
| mriedem | mestery: ^ | 19:35 |
| mriedem | melwitt: it goes back further than 5/4 | 19:36 |
| mriedem | at least 4/28 | 19:36 |
| mestery | mriedem: That looks bad, we saw a spike in the full job yesterday but it settled down overnight. | 19:36 |
| mtreinish | mriedem: I don't think I have seen that particular failure before | 19:37 |
| mriedem | http://goo.gl/sgKnRw | 19:38 |
| mriedem | excluding periodic and experimental quesus | 19:38 |
| mriedem | *queues | 19:38 |
| mtreinish | mriedem: man tracing through that code talk about some weird indents | 19:39 |
| melwitt | mriedem: is that just the "all time" cutoff or? | 19:40 |
| mriedem | 10 days | 19:40 |
| mriedem | so probably | 19:40 |
| mtreinish | mriedem: there's not much to go on though, just that tempest couldn't ping the guest after 2 min of trying 1 ping per sec | 19:41 |
| mtreinish | which feels like it would be mestery's fault :) | 19:41 |
| melwitt | on the surface it looks like this has happened before https://bugs.launchpad.net/neutron/+bug/1403291 | 19:41 |
| openstack | Launchpad bug 1403291 in neutron "VM's fail to receive DHCPOFFER messages" [Critical,Fix released] - Assigned to Kevin Benton (kevinbenton) | 19:41 |
| *** bkopilov has joined #openstack-qa | 19:43 | |
| mtreinish | melwitt: hmm, interesting. Unfortunately not that surprising though | 19:43 |
| mtreinish | although it was definitely more severe before | 19:43 |
| melwitt | yeah | 19:44 |
| melwitt | though it does mention the e-r query for that old bug was too broad, so it's probably something different | 19:45 |
| mriedem | melwitt: mtreinish: there is still an e-r query up for https://bugs.launchpad.net/neutron/+bug/1403291 | 19:45 |
| openstack | Launchpad bug 1403291 in neutron "VM's fail to receive DHCPOFFER messages" [Critical,Fix released] - Assigned to Kevin Benton (kevinbenton) | 19:45 |
| mriedem | but the signature is slightly different | 19:45 |
| mriedem | we should just update that | 19:45 |
| mtreinish | melwitt: yeah, but this error, like the failed to ssh one is going to be one of those catch alls | 19:45 |
| mriedem | (check_public_network_connectivity OR check_vm_connectivity) | 19:45 |
| mtreinish | because it's basically the first indication that things fell on their face | 19:46 |
| melwitt | mtreinish: ah, okay | 19:46 |
| dansmith | sdague: https://review.openstack.org/#/c/181127/ | 19:46 |
| dansmith | sdague: I think that's going to be right | 19:46 |
| dansmith | sdague: I think we did it differently before because we backported the bump after the release, which means 'havana' already meant something other than 3.0 and we didn't want to change it | 19:46 |
| mtreinish | not saying that's how it should be, but when a guest fails to get an ip properly from neutron until we try to do something with it we'll have no idea | 19:47 |
| sdague | yeh, that make sense | 19:47 |
| melwitt | mriedem: okay, I can update that query then | 19:47 |
| sdague | dansmith: so if we are going to the trouble of making a SpawnFixture, can we put a test on? And it should probably be called SpawnNoopFixture or something to be extra clear what it does | 19:49 |
| dansmith | sdague: meaning test the fixture? | 19:49 |
| *** yamahata has quit IRC | 19:50 | |
| dansmith | SynchronousSpawnFixture would be appropriate I think | 19:50 |
| openstackgerrit | Adolfo Duarte proposed openstack/tempest: Tests covering FIP in dvr multinode This is a collection of tests which validate floating ip functionality in a multinode dvr devstack environment https://review.openstack.org/177345 | 19:51 |
| sdague | dansmith: yeh the test fixture, the bottom of your stack that this is in | 19:51 |
| dansmith | sdague: right, I knew what you were referencing.. just wanted to make sure "put a test on it" meant "write a test for it" | 19:52 |
| sdague | dansmith: yes, sorry :) | 19:52 |
| dansmith | I didn't know we had tests for things like this, | 19:53 |
| dansmith | and also, | 19:53 |
| sdague | test_fixtures.py | 19:53 |
| *** bkopilov has quit IRC | 19:53 | |
| dansmith | I live in portlandia, so when I first read that, I read it as "put a bird on it" | 19:53 |
| sdague | heh | 19:53 |
| sdague | we'll have to send you to a tiny house | 19:53 |
| *** bkopilov has joined #openstack-qa | 19:53 | |
| dansmith | heh | 19:53 |
| sdague | https://www.youtube.com/watch?v=P6pj3jVgeh8 | 19:53 |
| dansmith | yeah, 'cause that's a thing I'd like | 19:54 |
| sdague | heh | 19:54 |
| *** ajmiller has joined #openstack-qa | 19:54 | |
| dansmith | sdague: you know those are real things right? | 19:54 |
| sdague | yes, I do | 19:54 |
| sdague | we have those folks out here as well | 19:54 |
| openstackgerrit | Matt Riedemann proposed openstack-dev/devstack: Set live_migrate_paused_instances=True in tempest.conf https://review.openstack.org/172326 | 19:54 |
| mriedem | mtreinish: sdague: want to re-ack that ^ | 19:54 |
| melwitt | put a bird on it | 19:54 |
| mriedem | i had to remove the depends-on | 19:54 |
| sdague | +2 | 19:55 |
| mtreinish | mriedem: +A | 19:55 |
| *** heyongli has quit IRC | 19:55 | |
| *** marun has quit IRC | 19:56 | |
| mriedem | so there is some kind of child psychology issue in these tiny house people yes? | 19:56 |
| *** bkopilov has quit IRC | 19:59 | |
| *** bkopilov has joined #openstack-qa | 19:59 | |
| *** sputnik1_ is now known as sputnik13 | 20:00 | |
| *** heyongli has joined #openstack-qa | 20:01 | |
| *** salv-orlando has joined #openstack-qa | 20:01 | |
| *** achanda has quit IRC | 20:04 | |
| *** achanda has joined #openstack-qa | 20:04 | |
| *** heyongli has quit IRC | 20:05 | |
| *** sputnik1_ has joined #openstack-qa | 20:08 | |
| *** achanda has quit IRC | 20:08 | |
| *** bknudson has joined #openstack-qa | 20:09 | |
| *** ajmiller_ has joined #openstack-qa | 20:10 | |
| *** heyongli has joined #openstack-qa | 20:10 | |
| *** toure_ has joined #openstack-qa | 20:10 | |
| *** toure_ has quit IRC | 20:11 | |
| *** sputnik13 has quit IRC | 20:11 | |
| *** ajmiller has quit IRC | 20:13 | |
| *** salv-orlando has quit IRC | 20:16 | |
| *** Longgeek has quit IRC | 20:18 | |
| *** ajmiller_ has quit IRC | 20:27 | |
| dansmith | mriedem: just issues in general | 20:28 |
| dansmith | mriedem: I have family members that live like this, except they can't afford the actual tiny house part | 20:28 |
| dansmith | so I know. | 20:28 |
| *** ajmiller has joined #openstack-qa | 20:29 | |
| mriedem | so it's like, poor irony? | 20:29 |
| mriedem | i was living in a box before it was cool | 20:29 |
| dansmith | heh | 20:29 |
| dansmith | yeah | 20:29 |
| mriedem | gd portland | 20:29 |
| dansmith | but they want to live in the smallest possible space, | 20:29 |
| dansmith | they just can't afford the nice tiny space | 20:29 |
| mriedem | that's just unamerican | 20:29 |
| dansmith | yep | 20:29 |
| clarkb | have you been to portland? | 20:31 |
| clarkb | also its nice today I should be unamerican outside | 20:31 |
| daniel3_ | Only thing good about Poland is the sausage. | 20:32 |
| mriedem | yeah remember we all jammed into that thai place? | 20:32 |
| daniel3_ | ;) | 20:32 |
| mriedem | w/ no AC | 20:32 |
| daniel3_ | That really came out wrong, not intended. Food wise! | 20:32 |
| mriedem | technically beaverton... | 20:33 |
| dansmith | mriedem: hillsboro actually | 20:33 |
| mriedem | oh yeah | 20:33 |
| *** Swami has quit IRC | 20:33 | |
| mriedem | intelton | 20:34 |
| dansmith | to be fair, | 20:34 |
| dansmith | you guys were here at like the hottest possible time | 20:34 |
| dansmith | that place doesn't need AC every other time of year except that one week | 20:34 |
| clarkb | dansmith you should drive downtown today just to see how nice it is to work from home during presidential visits | 20:34 |
| dansmith | clarkb: I think I'll sit here and imagine, but thanks | 20:34 |
| mriedem | i prefer to eat spicy thai shoulder-to-shoulder with 20 other sweaty dudes | 20:35 |
| dansmith | heh | 20:35 |
| dansmith | all the folks that got spicy stuff that day were crazy | 20:35 |
| *** bnemec has quit IRC | 20:36 | |
| openstackrecheck | openstack/nova change: https://review.openstack.org/176395 failed because of: gate-tempest-dsvm-neutron-full: https://bugs.launchpad.net/bugs/1283522 | 20:36 |
| openstack | Launchpad bug 1283522 in neutron "DB lock timeout errors with parallel operations" [Critical,Fix released] - Assigned to Kevin Benton (kevinbenton) | 20:36 |
| mriedem | dansmith: you can't go to a thai place and not get spicy | 20:38 |
| mriedem | tha'ts the point | 20:38 |
| dansmith | mriedem: when it's 100F outside and there's no AC, you sure as hell can | 20:38 |
| mriedem | we should have gone to the snow cone restaurant | 20:38 |
| mriedem | cold stone | 20:39 |
| dansmith | heh | 20:39 |
| *** ibiris is now known as ibiris_away | 20:40 | |
| *** achanda has joined #openstack-qa | 20:44 | |
| *** marun has joined #openstack-qa | 20:44 | |
| mriedem | speak of the devil, http://logs.openstack.org/95/176395/1/gate/gate-tempest-dsvm-neutron-full/37e1139/console.html#_2015-05-07_20_01_52_498 | 20:44 |
| sdague | oh, mriedem you missed out on crazy liquid n2 icecream in palo alto | 20:46 |
| mriedem | sounds like witchcraft | 20:46 |
| sdague | http://smittenicecream.com/ | 20:47 |
| sdague | it's kind of exactly the opposite of witchcraft | 20:47 |
| mriedem | what science? | 20:47 |
| openstackgerrit | Merged openstack-dev/grenade: clean up upgrade scripts https://review.openstack.org/177334 | 20:49 |
| *** e0ne has quit IRC | 20:51 | |
| dansmith | sdague: like this? https://www.flickr.com/photos/107555202@N02/10767618966/in/dateposted-public/ | 20:51 |
| *** bnemec has joined #openstack-qa | 20:51 | |
| dansmith | https://www.flickr.com/photos/107555202@N02/10767826383/in/dateposted-public/ | 20:52 |
| sdague | dansmith: yep, more or less | 20:53 |
| mriedem | what does taylor's shirt say there? | 20:53 |
| mtreinish | dansmith: oh, that place in hk | 20:54 |
| dansmith | mriedem: superdry | 20:54 |
| dansmith | mriedem: it's some hipster thing | 20:54 |
| dansmith | mriedem: what did you think it said? | 20:54 |
| mriedem | oh neutron logs, i wish you meant something | 20:55 |
| mtreinish | heh, I just realized I had that liquid n2 ice cream at both of the places. | 20:58 |
| *** Sukhdev has quit IRC | 20:58 | |
| mtreinish | I'm really slow today | 20:58 |
| mriedem | sc68cal: mestery: http://goo.gl/e527Wn | 20:58 |
| melwitt | mriedem: in the newer failures I don't see the error in tempest.log, it's only in console | 20:58 |
| mriedem | melwitt: me too | 20:58 |
| mriedem | sc68cal: mestery: note the spike in that keyerror | 20:58 |
| mriedem | not directly causing failed tests, but spikey is bad | 20:59 |
| dansmith | mtreinish: sorry, I should have spelled it out for you I guess :) | 20:59 |
| mtreinish | melwitt, mriedem: yeah, I think something changed with the exception logging and the capture fixture. It definitely used to log all the exceptions | 20:59 |
| mtreinish | but for some reason it doesn't seem to anymore | 20:59 |
| mtreinish | I haven't had a chance to dig into it | 20:59 |
| mtreinish | dims, dhellmann: was there an oslo logging change around that? | 21:00 |
| *** hitalia has joined #openstack-qa | 21:00 | |
| sc68cal | mriedem: looking | 21:00 |
| mtreinish | dhellmann: oh, you switched tempest over from the incubator logging to oslo.log right? Do you think the default on unhandled exceptions could have changed during that? | 21:02 |
| sc68cal | odd though, that does look like a legit error - the agent should have a local vlan map set up, so it knows what vlan to use for that neutron network | 21:03 |
| *** hitalia has quit IRC | 21:04 | |
| *** aysyd has quit IRC | 21:04 | |
| mriedem | sc68cal: https://bugs.launchpad.net/neutron/+bug/1452903 | 21:05 |
| openstack | Launchpad bug 1452903 in neutron "KeyError in ovs_neutron_agent._bind_devices" [Undecided,New] | 21:05 |
| mriedem | sc68cal: maybe it's on tear down or something? | 21:05 |
| mriedem | looks like a polling task? | 21:05 |
| sc68cal | yeah it's in part of a polling task, to update ports | 21:07 |
| sc68cal | Also seeing ovs-vsctl barf on a missing port | 21:07 |
| sc68cal | http://logs.openstack.org/97/157097/12/check/check-neutron-dsvm-api/eea86b7/logs/screen-q-agt.txt.gz?level=TRACE | 21:07 |
| sc68cal | mriedem: should I add that to that bug or a new one? | 21:08 |
| *** Swami has joined #openstack-qa | 21:08 | |
| mriedem | sc68cal: i have no idea if those are related | 21:08 |
| * mriedem isn't a neutron guy | 21:08 | |
| mriedem | sc68cal: i would *love* if the neutron logs were not terrible | 21:09 |
| mriedem | so whatever makes that happen | 21:09 |
| *** jog0 has joined #openstack-qa | 21:09 | |
| *** jog0 has quit IRC | 21:09 | |
| *** jog0 has joined #openstack-qa | 21:09 | |
| sc68cal | mriedem: I'll do a little digging on it and report back | 21:10 |
| *** jogo has quit IRC | 21:11 | |
| mriedem | thanks | 21:11 |
| mriedem | i could put up a patch to handle the keyerror, that's easy enough | 21:11 |
| sc68cal | yeah but that just masks the issue | 21:12 |
| sc68cal | it'll just blow up somewhere else | 21:13 |
| openstackgerrit | Matt Riedemann proposed openstack-infra/elastic-recheck: Update query for bug 1403291 https://review.openstack.org/181150 | 21:14 |
| openstack | bug 1403291 in neutron "VM's fail to receive DHCPOFFER messages" [Critical,Fix released] https://launchpad.net/bugs/1403291 - Assigned to Kevin Benton (kevinbenton) | 21:14 |
| mriedem | melwitt: ^ | 21:14 |
| mriedem | sc68cal: well, like i said, this is 93% success in jobs when it hits | 21:15 |
| mriedem | so this isn't directly causing failures | 21:15 |
| mriedem | it's spiking though | 21:15 |
| melwitt | mriedem: cool, I was fumbling around trying to make parens and OR work | 21:15 |
| mriedem | there are db errors in the dhcp agent logs and server logs, not sure if any of those are related or matter | 21:15 |
| mriedem | there are errors everywhere | 21:15 |
| mriedem | melwitt: the OR wasn't working for me | 21:15 |
| mriedem | so f it | 21:15 |
| sc68cal | mriedem: I do see a recent patch related to agent restarts that merged recently | 21:16 |
| melwitt | mriedem: good it wasn't just me haha | 21:16 |
| *** EmilienM is now known as EmilienM|afk | 21:16 | |
| dims | mtreinish: sorry, what's up? | 21:17 |
| mriedem | sc68cal: hmm v | 21:18 |
| mriedem | https://github.com/openstack/neutron/commit/bd5373b670cdd7f21f8a1ece98fde6be9fda71ab | 21:18 |
| mriedem | we're seeing the spike in security group related tests | 21:18 |
| sc68cal | mriedem: yeah this commit actually futzes with the local_vlan_map, and it was merged right around when these spikes happened - https://github.com/openstack/neutron/commit/48c336e4507d153b8f76e53589305b7dd5c45534 | 21:18 |
| mriedem | heh, yup | 21:18 |
| sc68cal | heh | 21:18 |
| mtreinish | dims: nothing dire, mriedem just pointed out that exceptions that cause a test failure are no longer ending up in tempest's log file | 21:18 |
| mtreinish | they used to be there | 21:18 |
| dims | mtreinish: i dont remember anything that would affect that from the top of my head. have a link handy? i can look in a bit | 21:19 |
| *** hitalia has joined #openstack-qa | 21:20 | |
| *** cdent has quit IRC | 21:21 | |
| *** dkranz has quit IRC | 21:21 | |
| mtreinish | dims: sure I can dig a link up, one sec | 21:21 |
| mtreinish | dims: but tempest also was on incubator logging for a long time until dhellmann switched to the lib a couple months ago | 21:22 |
| mtreinish | so it might not have been a recent change | 21:22 |
| dims | mtreinish: ack | 21:23 |
| *** weshay has quit IRC | 21:23 | |
| *** bnemec has quit IRC | 21:25 | |
| mtreinish | dims: so the one that melwitt and mriedem pointed it out to me on was: http://logs.openstack.org/95/176395/1/gate/gate-tempest-dsvm-neutron-full/37e1139/console.html#_2015-05-07_20_01_52_498 | 21:25 |
| mtreinish | the tempest log doesn't have the traceback: http://logs.openstack.org/95/176395/1/gate/gate-tempest-dsvm-neutron-full/37e1139/logs/tempest.txt.gz?level=TRACE | 21:26 |
| *** Yogi3 has quit IRC | 21:27 | |
| *** jhenner has joined #openstack-qa | 21:28 | |
| *** Sukhdev has joined #openstack-qa | 21:32 | |
| *** rossella_s has quit IRC | 21:34 | |
| *** sabeen1 has joined #openstack-qa | 21:36 | |
| *** jog0 is now known as jogo | 21:41 | |
| openstackgerrit | Merged openstack-dev/devstack: Set live_migrate_paused_instances=True in tempest.conf https://review.openstack.org/172326 | 21:41 |
| *** jogo has quit IRC | 21:41 | |
| *** jogo has joined #openstack-qa | 21:43 | |
| *** rfolco has quit IRC | 21:45 | |
| *** mwagner_lap has quit IRC | 21:45 | |
| *** gfidente has quit IRC | 21:47 | |
| *** apevec has quit IRC | 21:48 | |
| *** dustins has quit IRC | 21:49 | |
| *** dustins has joined #openstack-qa | 21:50 | |
| openstackgerrit | Doug Hellmann proposed openstack-dev/devstack: Enable optional Python 3 support https://review.openstack.org/181165 | 21:55 |
| *** david-lyle has joined #openstack-qa | 21:56 | |
| *** shardy has quit IRC | 22:00 | |
| *** pc_m has quit IRC | 22:03 | |
| *** artom has quit IRC | 22:04 | |
| *** Nic has quit IRC | 22:10 | |
| openstackrecheck | openstack/sahara change: https://review.openstack.org/178640 failed gate-tempest-dsvm-neutron-full in the gate queue with an unrecognized error | 22:10 |
| *** dboik_ has joined #openstack-qa | 22:12 | |
| *** dboik has quit IRC | 22:16 | |
| *** dboik_ has quit IRC | 22:17 | |
| *** rossella_s has joined #openstack-qa | 22:21 | |
| *** mpopow has quit IRC | 22:24 | |
| *** salv-orlando has joined #openstack-qa | 22:25 | |
| *** daniel3_ has quit IRC | 22:30 | |
| *** salv-orlando has quit IRC | 22:31 | |
| *** mlavalle has quit IRC | 22:34 | |
| *** pglass has quit IRC | 22:38 | |
| *** mpopow has joined #openstack-qa | 22:38 | |
| *** david-lyle has quit IRC | 22:38 | |
| *** tosky has quit IRC | 22:40 | |
| *** sputnik1_ has quit IRC | 22:41 | |
| *** rbak has quit IRC | 22:49 | |
| *** nikita09 has joined #openstack-qa | 22:54 | |
| *** BadCub is now known as BadCub_Hiding | 22:55 | |
| nikita09 | mtreinish: hello matt...just an update on the issue of running tempest tests against keystone v3 only... so it turns out that we were able to hit the tests , based on the workarounds on tempest.conf.. | 23:00 |
| nikita09 | the gotchas were: i) should not specify any admin_tenant param or user tenant parameter whatsoever ....if only using v3, we should NEVER specify tenant params in tempest.conf ii) secndly, as samuel pointed out, having a value of "uri" is required, even though u set auth_version to v3 , api_v2 to false , still required...so we just equate uri = keystone v3 url but replaced v3 with v2 ( facepalm :/ ) | 23:03 |
| mtreinish | nikita09: ok, yeah that's broken | 23:04 |
| mtreinish | can you add all these details to the bug | 23:04 |
| mtreinish | because we should fix them all | 23:04 |
| mtreinish | so it becomes clear on how to do this | 23:04 |
| nikita09 | mtreinish: the above two things worked for us.... as far as the errors for initialization you and i saw for running against keystone v3 , i.e. you are not authorized etc etc ... that all depends on how you policy.json for keystone | 23:04 |
| nikita09 | mtreinish: | 23:04 |
| nikita09 | mtreinish: sure i will add all details to the bug :) | 23:05 |
| nikita09 | mtreinish: so for errors like this http://fpaste.org/218706/84713714/ , it should be specified in tempest docs in details how to work with keystone v3...as policy.json is bottleneck of v3 to work properly ..and these errors are only solved on tempest side if you lax the policy.json | 23:06 |
| mtreinish | nikita09: well tbh that's always an issue with tempest, for a lot of things tempest assumes the default policy.json | 23:07 |
| mtreinish | it's honestly a wider issue with openstack interop, because that stuff really isn't discoverable up front | 23:08 |
| nikita09 | mtreinish: yep..but our team literally had one guy change something in policy.json, and other guy would run corresponding tempest v3 test :p and thats how we fig out that policy.json is game needs to change ) i also sem to notice number of smoke tests are very low as comprated to tag 3 ...any reason why its getting less with latest tempest?? | 23:10 |
| mtreinish | nikita09: yeah it was never meant to be big, there was ml post about: http://lists.openstack.org/pipermail/openstack-dev/2015-April/062775.html | 23:11 |
| nikita09 | mtreinish: and for cli tests, these will be moved to respective service cli libs or tempest-lib?? i saw a review today in which all cli tests are removed | 23:11 |
| mtreinish | nikita09: yeah that was something we were pushing for in kilo, most of the clients have already made the migration. The final removal should land tomorrow | 23:12 |
| nikita09 | mtreinish: thanks :)good to know tempest is getting a little lightweight :) | 23:16 |
| *** hemna is now known as hemnafk | 23:17 | |
| *** dboik has joined #openstack-qa | 23:23 | |
| *** dboik_ has joined #openstack-qa | 23:25 | |
| *** dboik has quit IRC | 23:28 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack-dev/hacking: Updated from global requirements https://review.openstack.org/181196 | 23:29 |
| *** tochi has joined #openstack-qa | 23:31 | |
| *** Sukhdev has quit IRC | 23:32 | |
| *** hichihara has joined #openstack-qa | 23:33 | |
| *** samueldmq has quit IRC | 23:36 | |
| *** samueldmq has joined #openstack-qa | 23:37 | |
| *** ajmiller has quit IRC | 23:40 | |
| *** rossella_s has quit IRC | 23:42 | |
| *** mpopow has quit IRC | 23:46 | |
| *** dims_ has joined #openstack-qa | 23:50 | |
| *** dims has quit IRC | 23:52 | |
| *** mriedem is now known as mriedem_away | 23:54 | |
| *** dustins has quit IRC | 23:56 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!