*** FallenPegasus has joined #openstack-defcore | 00:00 | |
*** FallenPegasus has quit IRC | 00:43 | |
*** FallenPegasus has joined #openstack-defcore | 01:06 | |
*** markvoelker has quit IRC | 02:46 | |
*** markvoelker has joined #openstack-defcore | 03:46 | |
*** markvoelker has quit IRC | 03:51 | |
openstackgerrit | Merged openstack/defcore: Add script to tabulate scores https://review.openstack.org/210674 | 04:35 |
---|---|---|
*** FallenPegasus has quit IRC | 05:05 | |
*** vernhart is now known as vern | 05:52 | |
*** markvoelker has joined #openstack-defcore | 07:48 | |
*** markvoelker has quit IRC | 07:53 | |
*** markvoelker has joined #openstack-defcore | 09:49 | |
*** markvoelker has quit IRC | 09:54 | |
*** alex_klimov has joined #openstack-defcore | 11:04 | |
*** markvoelker has joined #openstack-defcore | 11:35 | |
*** markvoelker has quit IRC | 11:40 | |
*** jmckind has quit IRC | 12:12 | |
*** markvoelker has joined #openstack-defcore | 12:39 | |
*** FallenPegasus has joined #openstack-defcore | 14:33 | |
*** alex_klimov has quit IRC | 15:01 | |
*** FallenPegasus has quit IRC | 15:24 | |
*** hogepodge has quit IRC | 15:53 | |
*** dfisher has joined #openstack-defcore | 15:58 | |
dfisher | good morning! I've got a question about DefCore 2015.07 and one of the required tests | 15:59 |
dfisher | According to http://refstack.net/#/capabilities, in compute-servers-change, there's tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_change_server_password | 16:00 |
dfisher | which, obviously, is used to change the root/admin password in an instance. | 16:00 |
dfisher | i'm curious to find out why that test is included when only one hypervisor (Xen) supports that operation | 16:01 |
dfisher | according to: | 16:01 |
dfisher | http://docs.openstack.org/developer/nova/support-matrix.html#operation_set_admin_password | 16:01 |
*** hogepodge has joined #openstack-defcore | 16:23 | |
markvoelker | dfisher: that test was flagged in 2015.05 and probably just hasn't been re-flagged in 2015.07 yet. I'm sure it will be, and will probably be dropped completely in 2016.01. | 17:30 |
markvoelker | dfisher: for reference: https://review.openstack.org/#/c/196153/ | 17:35 |
markvoelker | In fact, I should probably just go ahead and submit a patch for it while I've got a moment.... | 17:47 |
openstackgerrit | Mark T. Voelker proposed openstack/defcore: Flag change pwd test in 2015.07 & remove in .next https://review.openstack.org/215263 | 17:48 |
markvoelker | dfisher: ^^ | 17:52 |
openstackgerrit | Mark T. Voelker proposed openstack/defcore: Flag change pwd test in 2015.07 & remove in .next https://review.openstack.org/215263 | 18:21 |
dfisher | markvoelker: thanks! | 18:48 |
dfisher | one more question that I've never been too clear on. Are SKIPs passes or fails WRT defcore? | 18:50 |
*** GheRivero has quit IRC | 19:27 | |
*** GheRivero has joined #openstack-defcore | 19:27 | |
*** vern has quit IRC | 19:39 | |
*** vern has joined #openstack-defcore | 19:40 | |
hogepodge | dfisher: skips and fails are the same wrt defcore | 19:44 |
dfisher | ok. | 19:44 |
dfisher | good to know. | 19:44 |
dfisher | thank you | 19:44 |
hogepodge | A capability not being tested is the same as it not working or not existing. | 19:44 |
hogepodge | dfisher: no problem | 19:44 |
*** FallenPegasus has joined #openstack-defcore | 19:47 | |
openstackgerrit | Mark T. Voelker proposed openstack/defcore: Fix flagged blocks in 2015.07 spec https://review.openstack.org/215312 | 19:58 |
dfisher | what do 'flagged' tests mean? | 19:58 |
dfisher | for removal? closer examination? | 19:59 |
markvoelker | dfisher: in a nutshell, it means that it's not required. That could happen for a couple of reasons: | 20:00 |
markvoelker | the test was a bad choice to begin with (like the one you were asking about) | 20:00 |
dfisher | well, i just checked your latest proposal | 20:00 |
markvoelker | there's a bug in tempest that prevents it from testing properly | 20:00 |
dfisher | we're working on resize() too :) | 20:00 |
dfisher | which is why I asked | 20:00 |
markvoelker | there's a bug in the openstack component which means the test can't pass | 20:00 |
markvoelker | etc etc | 20:00 |
dfisher | getting defcore working on Solaris has been all kinds of fun. | 20:01 |
markvoelker | More info here: https://github.com/openstack/defcore/blob/master/HACKING.rst#defcore-test-flagging-guidelines | 20:01 |
markvoelker | dfisher: yeah, so if a test is flagged, you don't have to worry about it for certification purposes | 20:03 |
* dfisher nods | 20:03 | |
markvoelker | In the case of the resize tests, there are some uptstream bugs. Once those get fixed, those tests may get unflagged in a future Guideline. | 20:03 |
markvoelker | But for now they're not required. | 20:04 |
* dfisher nods | 20:04 | |
hogepodge | dfisher: once a test is flagged in a guideline it will stay flagged | 20:31 |
hogepodge | we un-flag in next as bugs are fixed or tests are removed | 20:31 |
dfisher | what's the process for determining eligibility of a specific test's inclusion in DefCore? | 20:32 |
*** alex_klimov has joined #openstack-defcore | 20:39 | |
*** FallenPegasus has quit IRC | 20:44 | |
*** FallenPegasus has joined #openstack-defcore | 21:05 | |
*** FallenPegasus has quit IRC | 21:22 | |
*** FallenPegasus has joined #openstack-defcore | 21:48 | |
hogepodge | dfisher: it needs to be non-admin, and fall under a capability | 22:07 |
*** alex_klimov has quit IRC | 22:28 | |
*** dfisher has quit IRC | 23:02 | |
*** FallenPegasus has quit IRC | 23:08 | |
*** FallenPegasus has joined #openstack-defcore | 23:10 | |
*** FallenPegasus has quit IRC | 23:56 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!