16:00:59 #startmeeting fuel 16:01:00 #chair xarses 16:01:00 Todays Agenda: 16:01:00 #link https://etherpad.openstack.org/p/fuel-weekly-meeting-agenda 16:01:00 Who's here? 16:01:01 hi 16:01:01 Meeting started Thu Oct 15 16:00:59 2015 UTC and is due to finish in 60 minutes. The chair is xarses. Information about MeetBot at http://wiki.debian.org/MeetBot. 16:01:03 Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. 16:01:03 hi 16:01:05 The meeting name has been set to 'fuel' 16:01:07 Current chairs: xarses 16:01:08 hi 16:01:10 o/ 16:01:11 Hi guys 16:01:14 hi 16:01:17 hi 16:01:19 hi 16:01:21 hi! 16:01:23 \~/ 16:01:26 hey 16:01:32 hi 16:01:33 hi 16:01:34 hi 16:01:37 hi 16:01:45 #topic Action Items from last meeting 16:01:55 hi 16:01:58 kozhukalov will update ML with plan to separate each sub-project in fuel-web (notes on this https://etherpad.openstack.org/p/fuel-move-repos) 16:02:25 hi 16:02:59 kozhukalov: added notes regarding this on the etherpad above 16:03:02 angdraug will update fuel-specs reviews to assign SME's to review https://etherpad.openstack.org/p/fuel-blueprints-8.0 16:03:29 I've reviewed and categorized stuck specs: 16:03:29 #link https://etherpad.openstack.org/p/fuel-blueprints-8.0 16:03:29 didn't have time to prod reviewers and committers yet 16:03:29 please check the etherpad and let me know if you disagree with the categorization 16:03:47 angdraug: so another action for next week? 16:03:53 yes please 16:03:56 k 16:04:00 maximov will look over stale review queue and ensure that cores are assigned to them 16:04:15 ok, yes I checked all our review queues and followed up all relevant people, 16:04:18 still did not write ML thread, will send probably tomorrow, when the majority of patches will be on review 16:04:21 hi 16:04:30 hi 16:04:33 in result we have healthy status for all product related review queues: 0 stalled reviews. 16:04:44 the only problem is in qa repositories: 16:04:53 fuel-devops has 1 stalled review but core reviewers assigned to it, 16:05:04 #link http://bit.ly/1G4Xsn9 16:05:04 fuel-ostf has 2 stalled reviews 16:05:07 thanks maximov 16:05:47 fuel-specs has 9 stalled reviews, but I ensured that in every review we have at least 1 core reviewer. 16:05:57 so I consider my action item as done 16:06:03 maximov: how many days it takes for review to became stalled? 16:06:11 5 days 16:06:14 thanks 16:06:27 we need to monitor on weekly basis until we implement automation to escalate.. 16:06:46 xarses: moving on? 16:06:46 #action angdraug will update fuel-specs reviews to assign SME's to review https://etherpad.openstack.org/p/fuel-blueprints-8.0 16:06:59 #topic Enhancements Team Status (ashtokolov) 16:07:13 hi folks 16:07:18 Enhancements status briefly: 16:07:28 Inbox - 66(was 62), In progress - 15(was 12), On review - 19(was 20), QA - 17(was 17), Done - 6(was 2) 16:07:36 and 8(was 12) to be sorted with Product Management 16:07:41 Total: 131 (was 125) 16:08:00 Any questions? 16:08:12 yep 16:08:22 we have 6 bugs that has need-bp tag 16:08:36 we need to address them somehow 16:08:54 As I see we don't have an owner for this activity 16:09:02 Product Management? 16:09:36 somebody should create blueprints and prioritise them 16:09:43 dpyzhov: may be ashtokolov should take it with dnovakovsky.. ? 16:09:56 Let's thirst of all check our blueprints 16:10:20 I'm working on simple script 16:10:39 and also I can do a trello board with unsorted bps 16:11:18 angdraug mihgen I think it means that I will do it 16:11:30 o/ 16:11:31 thanks, let me know if I can help 16:11:32 please don't forget about bugs with 'need-bp' tag in your activity, thats all =) 16:11:37 we need some preliminary analysis and scoping 16:11:53 dpyzhov it's not my activity) 16:11:57 not necessarily taking it in this release timeframe 16:12:06 need-bp it means big stories 16:12:16 not small enhancements 16:12:29 and big stories covers the rought scoping part 16:12:41 so all we really need is capture requirements and prioritize 16:12:48 so PM 16:13:16 angdraug: PM will walk through all need-bp bugs and create blueprints? ok for me 16:13:48 ashtokolov: can you generate raw input for PM to go through? 16:14:08 at the level of detail like list of bugs with titles 16:14:16 angdraug Yes I'll do 16:14:31 action for me please 16:14:57 ok, moving on? 16:15:05 yes please, and action for ashtokolov 16:15:06 moving on 16:15:07 #topic UI Team Status (vkramskikh) 16:15:11 hi! 16:15:14 Hi, this week we fixed 11 bugs, the number of remaining bugs is 42. Currently we have only one high bug, all other are mediums and lower. I think during the next week we'll be able to fix about 10-15 bugs and then we'll mostly switch to implementation of new features. 16:15:29 #topic ashtokolov will generate raw inpunt from need-bp bugs for PM to review 16:15:32 oops 16:15:34 #topic UI Team Status (vkramskikh) 16:15:53 #action ashtokolov will generate raw inpunt from need-bp bugs for PM to review 16:15:54 (so when we switch to features, there still will be 1 person responsible for bugfixing) 16:15:56 thanks vkramskikh, you are making our bugfix graphs ) 16:16:14 vkramskikh: thanks, really great progress 16:16:35 vkramskikh: have you seen my comment on https://review.openstack.org/#/c/231538/ ? 16:16:45 angdraug: yep 16:17:02 I wonder if it will impact asilenkov's design for https://launchpad.net/bugs/1503278 16:17:02 angdraug: Error: malone bug 1503278 not found 16:17:03 but it is for Artem, isn't it? 16:17:21 i doubt so 16:17:40 I mentioned artem's activity in Expected OSCI impact section 16:17:41 ok, then we just need Artem to confirm that 16:17:59 no such thing as OSCI anymore, I think your spec template is old :) 16:18:13 ok, will check this 16:18:37 hm, no. OUR spec template is old :( 16:18:45 https://github.com/stackforge/fuel-specs/blob/master/specs/template.rst#expected-osci-impact 16:18:47 yep 16:19:08 why it should have osci at all, it already has infra impact 16:19:15 exactly 16:19:20 nm, I'll fix that 16:19:30 action angdraug ? 16:19:30 moving on? 16:19:33 sure 16:19:34 #topic Upgrade team status (ogelbukh) 16:20:09 #action angdraug will update spec template to remove osci impact as its duplicate of infra 16:20:54 we're in bugfix phase for fuel-octane 6.1 to 7.0 version 16:21:52 we have some 10 inprogress bugs and got about 6 new ones from telco team recently 16:22:04 2 of them are critical 16:22:30 eta? 16:22:38 our plan is to finish them by the next tuesday and release stable/7.0 on thursday 16:22:57 which is effectively the last day of current iteration, afaict 16:23:16 Wednesday is last day, Thursday is first day of next iteration 16:23:23 OK 16:23:33 moving ? 16:23:39 even more strictly speaking Tuesday is last day and Wednesday is retro 16:23:42 yes, lets move 16:23:46 #topic Liberty versions schema (2015.1.0-7.0 vs liberty-8.0) 16:24:03 this is relatively small question 16:24:17 there's no coordinated version number anymore 16:24:30 so we need to decide how we number openstack version in fuel 16:24:43 I think liberty-8.0 is going to be confusing vs liberty-1 milestones 16:24:50 absolutely 16:24:59 8.0-liberty maybe? 16:25:04 I'm 100% against using symbolic versions :) 16:25:17 I'd go with just 8.0 fwiw 16:25:24 mos8.0-liberty? 16:25:40 full-blown definition should "Fuel 8.0 for OpenStack Liberty" 16:25:46 we have Liberty mentioned in UI and elsewhere 16:26:04 8.0 is useless 16:26:07 liberty 16:26:09 but I'm not sure if we need it at all in fuel version itself 16:26:16 xarses: why so? 16:26:18 and a point version 16:26:28 xarses: what about nova 12.0.0 ? ^) 16:26:32 because it's not supposed to be tied to fuel version 16:26:34 is it useful? 16:26:41 well 16:26:55 manifests and release data is for that openstack version 16:26:56 good point about 8.0 16:26:59 I'm not talking about versioning of openstack 16:27:07 less places with hardcoded fuel version would be nice 16:27:27 it's about version of openstack included in version of fuel 16:27:33 eventually we will really support multiple openstack versions 16:27:34 I'd suggest to get rid of it 16:27:40 right 16:28:04 ok, lets raise it on the ML, but I think droping it will be best 16:28:06 what do we use this version field for? 16:28:18 path to puppet modules 16:28:23 primarily 16:28:37 for uploading task graph into appropriate realease via CLI 16:28:38 maybe something else, not sure 16:28:43 that's dependent of Fuel version 16:28:57 alex_didenko: it's fuel version, not openstack 16:28:59 is it 1:1 mapped to fuel version? 16:29:05 puppet modules are openstack version dependent 16:29:32 right now any given version of fuel has exactly 1 version of puppet modules 16:29:44 it's interesting question btw, how openstack-puppet is going to version their modules 16:29:58 they don't support 1:many either 16:29:59 angdraug: right 16:30:09 angdraug: it could change if we support multiple versions 16:30:10 :) 16:30:28 last time xarses proposed to allow support for multiple openstack versions in the same release of puppet-openstack it was met with resistance 16:30:31 we could ignore it for now, of course 16:30:33 don't we already support multiple versions? 16:30:35 but 'liberty' will be enough to know this 16:30:43 if you upgrade fuel from 5.0 to 6.1 16:30:54 time folks 16:30:59 angdraug: we will have to switch modules path for another release version and use module from another version 16:31:06 alex_didenko: you won't be able to deploy 5.0 anymore 16:31:10 lets take it to ML, looks like not that small of a question 16:31:14 like I said, lets move to the ML 16:31:21 #topic OpenStack Infra gate jobs for Fuel enabled by https://review.openstack.org/228204 are failing (angdraug, ashtokolov) 16:31:53 #action ogelbukh will raise with libery version schema and how to change that in fuel to ML 16:32:05 xarses: already done :) 16:32:12 most of the gate jobs created by mihgen are currently failing 16:32:33 Folks, we are working on our integration with OpenStack Infra and especially with OpenStack-CI. 16:32:39 not having gates on openstack-infra is the last hurdle on the way to big tent, we should prioritize it 16:33:28 And we are working on fixing issues with repos structure. Like paths to tox.ini 16:33:30 angdraug: so what do we need to do? assign cores to get the tests passing so we can move them to voting? 16:33:33 one way to track this would be to treat absense or failure of a gate job in a fuel repo as a critical bug 16:33:47 xarses: we don't need cores for that 16:33:50 I called for help yesterday.. ashtokolov - do we have any assignments / additional analysis 16:34:09 Please take a look on this document https://goo.gl/Xh66NZ 16:34:18 #link https://goo.gl/Xh66NZ 16:34:31 So I have a list of questions about this integration: 16:34:42 1. Should we turn off python34 check for all repos? 16:35:08 ashtokolov: 1. we can, but only where we have to 16:35:24 python34 is ok if it continues to be non-voting 16:35:33 I saw only 2 or 3 repos which are ready for python34 16:35:47 #link http://governance.openstack.org/reference/project-testing-interface.html 16:35:56 I think we'd need to leave python34 in non-voting 16:36:00 "Projects which are compatible with Python 3 must also be able to do: Unit tests for python3.4" 16:36:02 and gradually get our code ready for it 16:36:14 did anyone looked how to run nailgun and ui tests on openstack infra? 16:36:28 let's make sure that we understand, it is 2nd priority now 16:36:30 not first 16:36:30 so leave it on and voting for repos where it already passes, and leave non-voting where it doesn't 16:36:43 first one is to enable in voting python27 16:36:50 ok, I got 16:36:59 2. Which of these repos we are going to deprecate after the migration from stackforge? 16:37:16 #link https://wiki.openstack.org/wiki/Stackforge_Namespace_Retirement 16:37:29 ^ contains a list of fuel repos that we're deprecating 16:38:12 3. We have a long list of repos with checks but w/o gates. We can fix checks but should we activate gates for it too? Or it’s an overhead? 16:38:34 3. having gates for all repos is a requirement of PTI 16:38:39 +1 16:38:43 ok 16:38:50 that being said, we should focus on most active repos first 16:38:55 4. Looks like there is no openstack gates for ruby. We have to ways: Use our jobs on Fuel-CI or try to add ruby job to OpenStack-CI 16:39:03 fuel-library and fuel-web should be top priority 16:39:15 try to use openstack infra where possible 16:39:19 let's go from simpler things 16:39:26 puppet-openstack runs rspec tests on openstack-infra 16:39:36 afaik no ruby checks 16:39:36 can't we just do the same? 16:39:50 angdraug: why do you think that we need to do fuel-web & fuel-library as 1st priority? 16:40:01 I'd say we should target those which are easier at 1st 16:40:14 keep kozhukalov working on fuel-web though 16:40:22 About Fuel-Library. First of all the biggest part of our modules are from upstream and were checked by openstack-gates before. So I think double check is useless. But we also have a short list of our own modules. And it looks like we have to create a special jenkins job in openstack-infra to cover it. mwhahaha aglarendil holser are you here? 16:40:26 but have other folks doing low hanging fruits first 16:40:50 we'll need to write some puppet jobs for fuel-library to run on infra 16:41:05 we might be able to reuse our fuel-ci syntax and noop tests 16:41:11 yep, for library tests we need only bundler. And puppet-openstack already has similar jobs 16:41:23 if we have gates for 90% of our repos where there's only 5% of our activity, I don't think it will go well with TC 16:41:43 folks 16:41:44 do 16:41:44 we 16:41:45 need 16:41:47 to 16:41:51 mihgen, just to clarify, I'm working on splitting fuel-web, but to make Openstack CI jobs green we need to do more 16:41:59 add real gates for Fuel Library right now ? 16:42:11 I mean, there are no similar jobs in openstack infra 16:42:23 we cannot simply pick some of them and attach to fuel library 16:42:27 aglarendil: where we can't now, we can't now 16:42:49 mihgen: I am sorry, my English grammar is lame and I did not get that 16:42:52 aglarendil: so we will continue Fuel CI where openstack infra has haps 16:43:15 ashtokolov: http://logs.openstack.org/48/229548/3/check/gate-puppet-nova-puppet-unit-3.3-dsvm-centos7/55f4dfc/console.html.gz 16:43:17 okay, but openstack infra actually has zero jobs we can reuse right now 16:43:19 we need to move along to get through the agenda, can we take this back to the ML? 16:43:21 ashtokolov: we need to assign people per repos... your doc is great 16:43:36 aglarendil: simple rspec? noop? 16:43:46 mihgen: For python checks we have to make changes in all our repos. It’s iterative process and unfortunately a lot of monkey work. Can we ask Maintainers to check for their repos? 16:43:47 noop we will need to merge 16:43:51 into openstack infra 16:44:00 rspec is already done by upstream modules 16:44:05 ashtokolov: we should 16:44:09 aglarendil: see the link I've just posted ^ 16:44:18 that's an example of rspec test in puppet-nova 16:44:22 our current fuel library gates on fuel-ci are package based, right? 16:44:22 puppet unit is already run in nova 16:44:26 ashtokolov: please organize it and get back with estimates.. 16:44:29 exactly what we need for our own modules in library 16:44:31 why do we need to rerun it? 16:44:39 time, we need to move on 16:44:44 I agree that we don't need to re-run for modules we integrate via librarian 16:44:52 +1 16:45:08 +1 16:45:11 let's not try to decide everything now.. ashtokolov please organize it, and get back with questions if there are any in email 16:45:12 +1 16:45:33 xarses: let's move .. 16:45:35 #topic Bugfix team status (dpyzhov) 16:45:40 wow 16:45:44 at least 16:45:48 Here is our current stats. I’ll again show it in format “total (UI / python / library)" 16:45:48 Critical and high bugs: 46 (1/23/22). Last week it was 49 (1/26/22) 16:45:48 Medium, low and wishlist bugs: 193 (47/104/42). Last week it was 252 (64/125/63) 16:45:48 Features tracked as bug reports: 136. 105 are marked with ‘feature’ tag and 31 covered by blueprints. Last week it was 134 in total. 16:45:49 Technical debt bugs: 101 (1/77/23). Last week it was 88 in total. Kinda huge and growing number. We’ve marked some of tech-debt bugs as High because we think them pretty important. There are 9 (0/6/3) 16:45:49 bug 193 in Launchpad itself "Unable to get back to the bug list after editing a bug" [Medium,Fix released] https://launchpad.net/bugs/193 16:46:04 So we big progress in medium/low/wishlist bugs. I can’t tell which effort made major contribution here. I was pushing hanged bugs, I was removing incorrectly assigned bugs, guys from several teams were fighting with bugs. We’ve merged at least 20 library+python bugfixes this week, actually. 16:46:11 #action ashtokolov angdraug will update ML about status and direction of openstack infra gate jobs 16:46:21 Let me speak little bit more about Critical/High bugs. Numbers are pretty the same. There are 0 critical bugs. There are 5 incompete bugs. There are 20 bugs in progress and 4 assigned bugs. I’m not ready to share information about bugs income this week right now. Our Launchpad reporter tells about 15 high priority bugs fixed in last 7 days. But I’m not 16:46:21 sure it the number is correct. It shows 19 bugs created during the same period. Something is definitely wrong here. But for me it looks like we have huge income of new high priority bugs and it is not going to go any lower. I’ll try to analyse our bugs income and share results. 16:46:40 I'm typing damn fast 16:47:51 =) 16:47:55 thanks 16:47:57 dpyzhov: thank you. Looks like we are doing a great job in squashing medium 16:48:07 yep 16:48:08 for high, we need to investigate a source of them, I agree 16:48:21 thank you for driving this and detailed reports 16:48:25 I hope that our new taxonomy help us to have better control over bugs 16:48:25 may i bring a bug to team's attention? 16:48:34 sure 16:48:39 https://bugs.launchpad.net/fuel/+bug/1495466 16:48:39 Launchpad bug 1495466 in Fuel for OpenStack "VNC console via horizon directs to wrong URL" [Medium,Confirmed] - Assigned to Fuel Documentation Team (fuel-docs) 16:49:03 enikanorov_: what about it? 16:49:10 this is an axample of very confusing UX that will cost us a number of support-hours 16:49:13 enikanorov_: it's on the agenda 16:49:40 I saw this bug 16:49:43 moving ? 16:49:50 yes let's move 16:49:53 #topic Multirack status (alex_didenko) 16:49:53 but for this bug 16:50:00 we need a discussion or start a ML thread 16:50:03 I agree with enikanorov_ 16:50:12 I don't like how we treat such UX bugs at the moment 16:50:22 We've finished scoping of multirack with static routes for 8.0. Some rough numbers in man weeks: software engineers 13, deployment engineers 5, UI 8, QA 15-17. 16:50:31 As you can see we need to do a lot of work in nailgun, UI and tests. 16:50:43 As for cross-multirack HA (controllers in different racks) we'll investigate the possibility of providing this by using external load-balancer. 16:50:51 It should be doable in 8.0 without additional changes in Fuel, already designed and scoped features should cover this use case. We just need to do some research and provide documentation on how to set it up. 16:51:19 alex_didenko: +1 on the approach, thank you 16:51:40 I thought that it's gonna take less though to complete baseline with static routes... 16:52:14 moving on? 16:52:19 #topic Network config modularization status (rmoe) 16:52:31 As part of the Fuel modularization effort I implemented a PoC of a separate network configuration service using Flask-SQLAlchemy. 16:52:31 Recently I've converted it to Pecan. My upcoming plans are to expand the Pecan API service, finish implementing the client library and write a spec for this. aglarendil is also working on serializing the data out of this service for test purposes 16:52:40 * yottatsa is watching on cross-multirack HA 16:52:51 there is also some other modularization work going on right now, but others would need to speak to that 16:53:22 rmoe: thanks. did you start a design spec for this work.. ? 16:53:35 today I will 16:53:47 action for rmoe? 16:53:49 anyone works on serializers refactoring? 16:54:28 I'm not sure, aglarendil is working on network serialization as part of this change 16:54:37 aglarendil: will you provide a possible approaches on it in etherpad and share with everyone.. ? 16:54:43 evgenyl can probably speak to those plans as well 16:54:47 from architecture standpoint 16:54:51 other serializer work I mean 16:55:04 time 16:55:16 Nobody is working on refactoring of current serializers. 16:55:22 thanks rmoe, let's move on 16:55:24 4 minutes, 2 more topics 16:55:28 #topic default FQDN for ssl https://bugs.launchpad.net/fuel/+bug/1495466 (sbog, xarses) 16:55:28 I'll poke aglarendil 16:55:29 But as it was said aglarendil is working on networking part. 16:55:29 Launchpad bug 1495466 in Fuel for OpenStack "VNC console via horizon directs to wrong URL" [Medium,Confirmed] - Assigned to Fuel Documentation Team (fuel-docs) 16:55:31 Let's have some public docs on it 16:55:44 public docs on what.. ? 16:55:56 akasatkin: serializers refactoring.. ? 16:55:59 so, etherpad as you mentionewd 16:56:10 We speak about it a little bit with Vitaly. We think that move public fqdn to wizard is rather bad idea. Have a blank field for fqdn by default also isn't so good. Seems that there is no really good solution. We can or disable TLS by default and have a blank field for public fqdn then or we can show a warning to user that also doesn't looks good. 16:56:13 yep, aglarendil promised to share in private conversation 16:56:49 So in order to allow TLS/SSL configuration to be on by default we generate a default hostname of public.fuel.local . however this value is not correct for any end user because they will receive responses from services like keystone catalog, and in turn they get url's that they cant access because they where not aware that they needed to configure this value. The bug refrences nova vnc proxy but it impacts any service that returns the 16:56:50 endpoint URI such as heat and murano 16:56:50 so my though is that we have to change it so the user must set this value. my thought is to make the default blank but require a valid fqdn, this way the user must update the field 16:56:52 why is public fqdn in wizard a bad idea? 16:56:58 this issue is 100% consequence of having ssl enabled by default 16:57:29 xarses: +1 16:57:35 let's require a user to ENTER fqdn 16:57:35 vkramskikh: yes, but it doesn't make ssl enabled by default any less of a must-have 16:57:46 BUT user may not have DNS configured still 16:57:49 I think this is too low-level entry for a wizard. and in 8.0 we plan to move wizard config from UI description to components description, and this setting won't fit it 16:58:04 they should be forced to either enter fqdn or disable TLS 16:58:19 angdraug: +1 16:58:28 this would mean settings are invalid by default 16:58:33 yes 16:58:44 It's bad UX 16:58:51 why invalid by default? 16:58:55 why bad UX? 16:58:55 honestly if ssl is enabled by default this impacts 100% of users. there for FQDN and ssl enabled needs to be in the wizard 16:59:01 Because you can't have blank fqdn 16:59:09 xarses: +1 16:59:12 time 16:59:18 we have one more topic and we can't skip it 16:59:25 Last second announcement: migration from stackforge/ to openstack/ namespace is scheduled for this Saturday 17 October. This will cause disruption in CI and CI team will work over weekend to fix all the issues. Please don't plan any merges and active development for this weekend :) 16:59:26 let's have another topic 16:59:31 #topic stackforge/ to openstack/ rename this weekend (bookwar) 16:59:52 thanks bookwar_ 16:59:57 bookwar_: thanks a lot for helping and making it over weekend.. 16:59:57 #endmeeting