21:00:19 #startmeeting swift 21:00:20 Meeting started Wed Apr 5 21:00:19 2017 UTC and is due to finish in 60 minutes. The chair is notmyname. Information about MeetBot at http://wiki.debian.org/MeetBot. 21:00:21 Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. 21:00:24 The meeting name has been set to 'swift' 21:00:26 who's here for the swift team meeting? 21:00:31 I'm here for the meeting! 21:00:41 o/ 21:00:44 o/ 21:00:49 o/ 21:00:51 hi 21:00:53 hi o/ 21:01:00 o/ 21:01:12 * SotK lurks 21:01:18 I fixed patchbot, so it can join us in meetings again 21:01:23 has patchbot grown a sense of humor? 21:01:41 * patchbot is alive! 21:02:20 what it attempts to be humour 21:02:21 clayg: acoles: jrichli: here? 21:02:21 hi 21:02:29 mattoliverau: no kidding 21:02:58 no 21:03:06 yes sir :-) 21:03:09 o/ 21:03:11 . 21:03:13 a few things to go over this week 21:03:16 #link https://wiki.openstack.org/wiki/Meetings/Swift 21:03:23 #topic follow-up from last week 21:03:41 mattoliverau: anything new on stable branch test failures? anything else to do there? 21:04:03 I've landed all the backport patches, including yours 21:04:16 I haven't been as productive as I'd liked there this week. got sidetracked on one tho 21:04:22 mattoliverau: I think we're good on this, but did you find anythign else? 21:04:40 FAIL: test_GET (test.unit.proxy.test_server.TestAccountController) 21:05:12 that's not the same one you had a patch for, right? 21:05:32 fails every 100ish time, but also on master. It seems to be FakeConn or GETorHeadHandler loosing a request when trying to find qouum. 21:05:34 nope. 21:05:40 ok 21:05:45 but just kept showing up 21:05:47 mattoliverau: do you have a bug filed for it in launchpad? 21:05:53 so went ot test master 21:06:10 no, found it yesterday arvo, so wanted to see if it was a problem elsewhere. 21:06:23 ok 21:06:28 I'll put one up today.. I'm part way through investigating it tho 21:06:29 please file that when you get some info on it 21:06:32 thanks 21:06:48 next up... 21:07:07 patch 451524 has landed. approved by the tc yesterday 21:07:08 https://review.openstack.org/#/c/451524/ - governance - Use case analysis for Golang addition to Openstack (MERGED) 21:07:14 thank you tdasilva for writing that up 21:07:27 yeah nice work tdasilva 21:07:30 yay! 21:07:33 what this means is that the tc has formally approved swift using golang 21:07:35 nice! 21:08:01 there's a lot of work to be done, of course, some of which is figuring out the logistics for -infra 21:08:07 umm.. *is* that what i means? 21:08:18 was asking the same question 21:09:26 according to the tc process (https://governance.openstack.org/tc/reference/new-language-requirements.html) yes 21:09:48 step one, approval of the need for a new language, has been done 21:09:50 After reviewing and agreeing on the need for a new language, the team driving this effort should start working on the second phase. The needs of a new language should not be questioned during the evaluation of the second phase, unless the team working on it decides the language is not needed anymore. 21:10:37 as a reminder to everyone, we don't want golang because it will be fun. we need it as part of solving some bigger problems facing every swift cluster 21:10:47 the high-level outline of that is at https://wiki.openstack.org/wiki/Swift/Fixing-rebalance-and-golang 21:11:30 so far, clayg has been digging into that work (the general rebalance problem) 21:11:42 but there is a *lot* to do 21:11:57 it is a great area for people to help out in 21:12:10 and one of the two main priorities for stuff to get done (the other being container sharding) 21:12:39 I'm happy the first step of the new TC process is over 21:12:47 any questions on that before we move on? 21:12:54 notmyname: but now that swift has outlined our use-case - does that mean that openstack-client can start to merge golang patches as soon as common infrastructure and/or shared modules are developed? 21:13:22 clayg: my understanding is that it's been approved for swift. I don't know if that's a general approval or not 21:14:34 clayg: IIUC, yes 21:15:51 but note that we are expected to help out with building that common infrastructure as part of getting golang into our codebase 21:16:03 next follow-up... 21:16:06 https://bugs.launchpad.net/swift/+bug/1675500 21:16:06 Launchpad bug 1675500 in OpenStack Object Storage (swift) "Container/account disk drive fault results replication on all rest drives" [High,In progress] - Assigned to Pavel Kvasnička (pavel-kvasnicka) 21:16:06 there's a second resolution needed before projects can release golang https://governance.openstack.org/tc/reference/new-language-requirements.html#guarantee-compatible-functionality-for-the-base-common-libraries 21:16:37 notmyname: ok awesome! 21:16:53 mattoliverau: rledisez: acoles: last week the three of you said you'd look into that bug 21:16:55 any news? 21:17:19 kota_: you commented too :-) 21:17:21 Yeah, it's deinfitely a bug, and happens on all modes 21:17:35 no matter the number of replicas I mean 21:17:39 yup 21:17:48 https://review.openstack.org/#/c/448480/ is proposed, and clayg has -1 for text failure(?) 21:17:49 patch 448480 - swift - Container drive error results double space usage o... 21:18:11 I wrote some probe tests and linked them in the patch for those who want to see. 21:18:13 notmyname: sorry, I didn't yet, got distracted by reconstructor bugs 21:18:29 acoles: no worries. looks like kota_ mattoliverau and clayg have looked at it 21:19:04 clayg: oh sorry, not a test failure. needs more work to clean up the over-replicated data 21:19:04 Both clayg and I put some sample patches in the bug to stop the bleeding, the patch goes further. and I think that's where its stalled 21:19:10 good 21:19:15 what's the next step then? 21:19:32 what do we need to give to pavel? what do we need to get from him? 21:19:42 what... should the fix be. should we behave like object replication, and things sit on handoffs until its ready. 21:19:46 onovy: ^ FYI 21:19:46 *fixed 21:19:58 (too early for me to make sentences) 21:20:00 :P 21:20:02 heh 21:20:30 should handoffs only push to primaries. 21:21:50 mattoliverau: kota_: can you keep working with pavel this week on getting a viable patch? 21:21:51 mattoliverau: are you sure "handoffs only push to primaries" is a thing object replication does? Maybe it is... but even when they see a 507? seems unlikely 21:22:31 clayg: I'm just going on comments in the patch, because I haven't coffeed :P 21:22:38 notmyname: i'm available in this week but idk if pavel is 21:22:48 ok 21:23:13 also, don't be shy to push changes over what's proposed 21:23:17 that's ok 21:23:28 as mattoliverau described, to fix the bug with minimum code, i think clayg's patch can be good 21:23:43 I think claygs question in patch was, there is a high prioriy bug, should we stop the bleeding then fix the rest when we have more time it iterate. 21:23:45 and i'm waiting pavel's opinion at the patch now. 21:23:52 ok 21:24:21 anything more to talk about on that patch? 21:24:45 ok, moving on 21:24:51 to new things 21:24:56 #topic tc vision document 21:25:07 #link https://review.openstack.org/#/c/453262/ 21:25:08 patch 453262 - governance - Draft technical committee vision for public feedback 21:25:12 pay attention to this 21:25:30 it was just proposed and is an attempt to frame the next few years of openstack 21:25:38 the tc is looking for comments 21:25:47 please read over it and leave comments 21:26:04 #topic migrating to storyboard 21:26:13 remember when we talked about storyboard? 21:26:20 yup 21:26:30 and we were surprised it was still a thing 21:26:44 what was that? I know at the PTG. maybe also Austin? Barca? 21:26:52 it's been talked about a few times 21:26:57 and it's come up again 21:27:07 is there someone here from the storyboard team? 21:27:10 Yep 21:27:15 diablo_rojo: hi! welcome 21:27:22 o/ 21:27:23 I think SotK is creeping too 21:27:34 diablo_rojo: so tell us more. you've talked about swift using storyboard. we've been interested in the past 21:27:42 but we don't know anything about it or how that works 21:28:03 welcome SotK 21:28:05 So basically we have migrated a few projects- Monasca, refstack, and the interop wg- and they joined infra. 21:28:29 Its a pretty simple process, we have scripts to migrate open items in lp over so you dont need to recreate everything from scratch. 21:28:57 it's a complete replacement of launchpad right? 21:28:59 We were just wondering if you were interested/ if there was anything you may have noticed sb doesn't have that you would need to be able to use it. 21:29:04 notmyname, correct 21:29:22 I am actually working on making it a Queens release goal to have all projects migrated by the end of the release 21:29:36 * diablo_rojo was working on drafting that before this meeting :) 21:29:44 last we talked about it, we're interested, but we don't know much about storyboard. and therefore we also don't really understand what a migration means 21:29:57 diablo_rojo: are any not projects that don't host code on git.openstack.org *using* storyboard today? 21:30:00 but it sounds like it will be a thing everyone does, so getting on the storyboard train early is good ;-) 21:30:21 s/are any not projects/are any projects/g - ssory 21:30:23 heh 21:30:32 How can we look at it and have a play with its features, is there a rest env, or should we go raise a bunch of feautures in refstack or something? :P 21:30:43 clayg, Craton isn't an official project and they want to be part of the next wave of migrations- is that what you are talking about? 21:30:55 mattoliverau: there is storyboard-dev.openstack.org for playing around with 21:31:01 nice :) 21:31:12 mattoliverau, I have sent a few things out to the ml with blog posts and a bunch of links, let me get the archive link 21:31:23 diablo_rojo: ta 21:31:23 what does it do with existing links in existing commit messages? 21:31:30 do bug numbers stay the same? 21:32:01 * notmyname is sure you've already thought about and handled all this 21:32:12 yeah, story IDs are the same as the bug number in LP 21:32:25 mattoliverau, here's the ml thread: http://lists.openstack.org/pipermail/openstack-dev/2017-February/112282.html 21:32:39 diablo_rojo: nope, I'm just curious to what extend OpenStack is building an island - sounds like to begin with it's standard "Open 21:32:42 #link http://lists.openstack.org/pipermail/openstack-dev/2017-February/112282.html 21:33:10 ok, so if you ran migration scripts today, what do we do tomorrow? how does it "work" from a day-to-day perspective? we jsut go there instead of LP and that's it? 21:33:22 ... well just that launchpad isn't anyone's favorite - but utlimately it's going to do things other FOSS projects currently get done with launchpad 21:33:27 ... or github issues 21:33:43 clayg: it == storyboard? 21:33:52 yeah 21:33:55 notmyname, yep, you just stop using lp and file things in sb instead- also probably want to tell vendors about it too. 21:33:57 I don't know what the plan is for existing commit messages, probably before all projects are merged it'd require manually fixing them to use the Story: #### syntax 21:34:45 * notmyname needs to go re read the linked storyboard docs 21:35:19 SotK: has any project that does vuln management migrated to it yet? 21:35:20 mattoliverau: thanks for the link 21:35:21 clayg, maybe fungi can shed some light on that 21:35:31 notmyname: good question! 21:35:42 lol, it was diablo_rojo's :) 21:36:51 notmyname: not yet afaik 21:37:11 but there's functionality for that already? private bugs with private code reviews? 21:37:26 notmyname, that is in progress work actually. 21:37:29 has the vuln management team given feedback? 21:37:31 SotK, its about half done? 21:37:32 ah ok 21:37:38 diablo_rojo: is there a mechanism to prevent new items going to launchpad after a migration? a redirect? 21:37:41 so it might be wise to wait for that? 21:37:46 clayg: I know of other storyboards that are deployed and used to varying extents 21:38:01 SotK: that's *awesome* 21:38:04 notmyname, yeah if that is something you need, we would wait to move you till after thats done. 21:38:18 diablo_rojo: yeah, definitely 21:38:40 notmyname: our needs there aren't complex - the half they've implemented might be fine 21:38:45 notmyname: what do you mean, we don't have bugs, esp embargo ones :P 21:38:50 notmyname, we will write you down on the list of projects that need that before they can move. 21:38:56 what about using it for other things like trello board? 21:38:57 notmyname: indeed, there are private stories (where the story and all related things like tasks + comments + history) 21:39:20 the missing functionality is in automatically making vulnerabilities visible to the vmt 21:39:24 last question (for now, I think), is the migration story written up somewhere? is it in that email? like, we do #1, then you do #2, then next is #3... 21:39:47 there is also the fact that our migration script currently doesn't migrate private bugs 21:39:50 SotK: hmm.. ok 21:40:31 notmyname, No, its really just an agreement on a date and then we get an infra friend (usually fungi) to run the scripts and then its done. Not much you need to do but spread the word. 21:40:37 SotK: one would hope that the number of private bugs would be small enough that they could be moved by hand :-) 21:40:47 notmyname: indeed :) 21:41:08 so what acoles asked... do we "turn off" LP after a migration? 21:41:12 is that possible? 21:41:24 we need it to become readonly right? 21:41:29 right 21:41:32 (I think) 21:41:33 correct I believe 21:41:39 or does its entire history get migrated? 21:41:50 (at least, I'm pretty sure that's what infra did to theirs way back when) 21:42:01 acoles, not the history, just open items 21:42:01 which one? 21:42:04 ok 21:42:29 history stays in LP, LP becomes read-only, open things get migrated, and new stuff goes to storyboard 21:42:34 so we'd want launchpad to stay there in readonly mode, somehow 21:42:47 which also solves the existing links problem 21:43:03 looks just "gone" to me? https://bugs.launchpad.net/openstack-ci 21:43:23 notmyname: how does it solve links? closes-bug to an open bug in launchpad woul dneed to be changed? 21:43:41 acoles: meaning that existing links to LP would still work 21:43:50 ...but I'm not sure about what clayg just said 21:44:14 clayg: I may be misremembering, I'm sure fungi can clarify at some point 21:44:29 notmyname: i mean, it'd be nice to have an exmple of a project that used launchpad and now uses story board 21:44:39 if so such project exists we could just "do it" 21:44:47 yeah 21:44:48 clayg, Monasca is one you could talk to :) 21:44:49 SotK: diablo_rojo: this has been very helpful. thanks. what do we as a team need to consider next or do next? 21:45:07 talk to Monasca, it sounds like 21:45:10 what else? 21:45:26 notmyname, I would say figure out if there is anything else you need as a project besides VMT things or if what is there currently works for you guys. 21:45:27 so monasca still has bugs -> https://bugs.launchpad.net/monasca 21:45:41 i can report a new one -> https://bugs.launchpad.net/monasca/+filebug 21:45:44 would it make sense to use for other functionality like "trello board" type of functionality...just to get our feet wet with sb??? 21:45:53 notmyname: play around with storyboard and see if there is anything that jumps out as being likely to block your use of it 21:45:56 before using it for bugs 21:46:05 We can run a test migration to our sandbox to see if there are any other issues. 21:46:20 new open high prio bugs still seems active on lp -> https://bugs.launchpad.net/monasca/+bug/1636508 21:46:20 Launchpad bug 1636508 in Monasca "Smoke test fails and is not under ci or within openstack review process" [High,New] 21:46:31 notmyname: yep, merged commit links ought to still link to something on launchpad, future patches use Story tags, and pending patches....we need to remember to update commit messages...manually? 21:46:35 last bugs in LP for monasca have been updated in the past few days 21:46:56 acoles, yes that's accurate I believe 21:46:57 acoles: yes? 21:47:50 ok, I'd like to move on in this meeting, but thank you for the info 21:48:02 notmyname: I thought I was agreeing with you...at least on a requirement if not a feature :) 21:48:02 notmyname, thanks for your time :) 21:48:03 we'll look at it 21:48:11 indeed, thanks :) 21:48:21 #topic forum topics 21:48:24 diablo_rojo: SotK: thanks! 21:48:30 #link http://forumtopics.openstack.org 21:48:40 those are the proposals for the forum in atlanta 21:48:54 this morning I was asked to provide some more commentary on the swift talks 21:48:54 boston? 21:49:00 boston 21:49:02 thanks kota_ 21:49:47 my understanding is that the forum topics are things that couldn't be discussed elsewhere because of who's attending (ie ops) 21:50:09 and I was asked to provide that justification for the swift sessions 21:50:34 in that, those who are building the schedule and selecting the talks aren't familiar with swift so need some more context 21:50:43 please help me out on this 21:50:54 I think everyone should have the ability to leave comments on the topics 21:51:46 I'll be going through them as well, but if we all help out, we'll get through the swift ones faster 21:52:00 kk 21:52:04 the swift ones should all say "swift", but you can also just look for the ones I submitted 21:52:22 tdasilva: I think monasca basically started using storyboard and they curently have some bugs tracked on lp and some tracked on storyboard - it's not an unreasonable "let's try this out pattern" 21:52:56 we submitted a lot of stuff that would have been sessions if the ptg/forum split would not have happened. and of course we look for a lot of ops feedback for a lot of these 21:53:22 so need to give them a ops spin ;) 21:53:47 but adding more context and more justification for being included will help make our boston summit more productive overall 21:54:04 any questions on that? 21:54:40 ok. here's a pre- "thank you for your help" :-) 21:54:44 not yet, will take a look at them and see if I have comments :) 21:54:51 #topic open discussion 21:54:55 next week's meeting 21:55:10 next week I'll be at the openstack leadership training thing in Ann Arbor 21:55:24 (you may have seen it mentioned on the ML) 21:55:32 so I won't be here to chair 21:55:47 is there another volunteer or shall we skip next week's meeting? 21:56:21 lets just assume to skip the next one, if something comes up we need to talk about, someone can volunteer :) 21:56:34 heh 21:56:48 So everyone check the adjenda to see if its on, but lets assume it's not 21:56:50 matt just wants to sleep late! 21:57:11 patchbot: you can read my mind, what kind of updates have they done to you :P 21:57:16 patchbot? 21:57:17 lol 21:57:20 * jrichli thinks patchbot has gained a sense of humor 21:57:42 or notmyname has gained an alter ego :) 21:58:05 all this time, there was no bot, it's just notmyname 21:58:16 heh 21:58:18 lol 21:58:18 anything else to bring up this week? 2 min left 21:58:18 mattoliverau: lol 21:58:54 ok, /fin 21:59:05 thank you for coming and for your work on swift, both code and community 21:59:13 you are what makes swift awesome 21:59:17 #endmeeting