11:01:11 #startmeeting scientific-wg 11:01:12 Meeting started Wed Aug 30 11:01:11 2017 UTC and is due to finish in 60 minutes. The chair is oneswig. Information about MeetBot at http://wiki.debian.org/MeetBot. 11:01:14 Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. 11:01:16 The meeting name has been set to 'scientific_wg' 11:01:21 Hello all 11:01:32 Hi 11:01:34 Afternoon, oneswig 11:01:37 #link Agenda for today https://wiki.openstack.org/wiki/Scientific_working_group#IRC_Meeting_August_30th_2017 11:01:49 Top of the afternoon to you all :-) 11:02:00 #chair martial 11:02:01 Current chairs: martial oneswig 11:02:07 #chair b1airo 11:02:08 Current chairs: b1airo martial oneswig 11:02:11 o/ 11:02:27 The three horsemen of the apocalypse, reunited at last... 11:02:44 Hi b1airo 11:02:49 In other words 11:03:03 how's things? feeling refreshed oneswig, one week wouldn't cut it for me! 11:03:32 honestly still fantasizing about being on the beach 11:03:32 I was fully recharged for at least a day... 11:03:36 glad you gents had "hopefully relaxing" vacations :) 11:03:43 hah 11:04:02 It's almost back to school time, alas 11:04:17 OK lets get going - just the second edition to discuss on the agenda today 11:04:30 #topic second edition of the Scientific OpenStack book 11:04:48 OK, I read most of the first edition again, a real page turner 11:05:03 oneswig: maybe oenstack days london if that is still something to finalize? 11:05:07 it was certainly gripping stuff 11:05:49 Kathy Cacciatore and Chris Hoge from the Foundation are keen to produce a revised edition, as you'll probably know by now 11:06:28 Enol has stepped up to lead the creation of a sixth chapter on federation - correct enolfc? 11:06:55 martial: OS days London - good point 11:07:32 There are three major tasks to cover in the second edition: 11:07:37 oneswig: yes ,starting to work on this 11:07:41 1) refresh the good bits 11:07:50 2) cut out and replace the bits that have 'gone off' 11:07:58 3) add the federation chapter 11:08:17 enolfc: that's great to hear. 11:08:54 I will contact the contributors to the original book and ask for updates 11:09:13 I hope the Chameleon chapter is considered one of the good bits, as I have started to refresh it ;-) 11:09:46 The book was assembled in a set of google docs, and then transcribed to markdown (in one direction) and something more graphic-design oriented (for print) 11:09:48 hi priteau! 11:10:02 Thanks priteau, that's one less email to send :-) 11:10:12 oneswig: We'll work directly on the scientific-wg repo this time? 11:10:36 priteau: that's something I wanted to ask people about. 11:10:41 oneswig: on Github, it says it's in RST 11:10:58 Yes, it's RST 11:11:14 verdurin: markdown/rst, whatever, I get them mixed up, apologies 11:11:32 Markup format overflow 11:12:44 oneswig: I am used to gerrit so it's not a problem for me. Maybe more complex for newcomers? 11:12:45 The question I had was, do people prefer to use the gerrit process, or suggestion mode on a google doc? 11:12:51 i am yet to see a Turing complete markdown... 11:12:53 Especially with the strict deadline 11:13:18 I'm fine with sending reviews to gerrit also 11:13:29 likewise 11:14:11 OK, that sounds fine by me. 11:14:17 haven't used gerrit but happy to learn (assuming it's like github pull request?) 11:14:23 if it will ultimately be typeset and published from there then it makes sense to stay there 11:14:59 I'm rusty with Gerrit, happy to go with the consensus 11:15:03 but perhaps if it suits anyone in particular we could let them edit in Docs and do the reviews for them (rather than miss out on content) 11:15:43 We have the advantage that all changes are disjoint from one another. 11:15:59 Only one person is responsible for each section of text. 11:16:34 oneswig: Does it mean that all authors need to sign the Contributor License Agreement, and potentially their employer need to sign the Corporate Contributor License Agreement too? 11:16:36 So we can do either - but the final handover to Kathy is a google doc. I can transfer patchsets from gerrit. 11:17:33 priteau: I don't know about that. Is that applied to all OpenStack repos? 11:17:57 It didn't come up last time because it was done in Google doc - outside of the OpenStack repos. The document is creative commons licensed. 11:18:32 hmm, sounds like a question for governance peeps 11:18:58 Do we have a case where that might be contentious? 11:19:08 i recall some changes happening around this recently so that it was less of a blanket requirement, but i wouldn't be surprised if gerrit access relied on it 11:19:13 oneswig: I had a collegue start contributing to an OpenStack project recently, and he couldn't push to Gerrit until he had signed the CLA 11:19:29 b1airo: I believe the change is that you don't need to join the OpenStack foundation anymore 11:19:52 The simple way around this is to migrate editing to google docs. 11:19:52 ah yep, thanks priteau 11:20:27 (for anyone not willing or able to sign?) 11:20:29 oneswig: Not sure if it can be contentious, but potentially lengthy if one has to deal with their legal department 11:20:50 priteau: right - I once worked in such a place. 11:21:18 UChicago was quite efficient, I was impressed :-) 11:21:47 OK, it's not insurmountable. I will provide both options. 11:22:06 depends very much on the objectives of the org.! 11:22:07 enolfc: are you working on the RST in git? 11:23:01 oneswig: yes, but don't mind moving to google doc 11:23:10 b1airo: as much as people are willing to sign, sometimes their organization make it hard for them 11:24:02 enolfc: entirely up to you. Whichever way is simpler for managing and combining contributions. 11:24:24 yep, that's what i meant - some legal departments are all about protecting company IP at all costs and no matter how measly 11:24:52 enolfc: the final output should be a google doc, that's all we require. The process is not important 11:25:11 So should we leave it to each author to choose between gerrit and GDocs? 11:26:01 sounded like that was the outcome 11:26:20 priteau: either works for me, once editing is complete it's easy to combine into the final doc 11:26:56 so oneswig, will you ping everyone with those details and a drop-dead date on edits, with links to the current/last version of the docs? 11:27:12 b1airo: I will do that 11:27:25 how are we organizing the editor/reviewer jobs? 11:27:39 martial: my offer to be a reviewer stands 11:27:52 verdurin: thank you 11:27:57 likewise i am happy to review one or two others 11:28:23 verdurin: can you (and anyone else able to review) add yourself to https://etherpad.openstack.org/p/scientific-computing-book-update-2017 11:28:48 if we are going to use Google docs, we can ask people to male "suggestions" and "comments" on the individual documents 11:29:15 martial: agreed 11:29:20 I would keep each article separate until it is time to merge, because people editing at the same time create chaos ;) 11:29:33 My availability for September will be patchy, so I can't commit to review, but if available I will try to look at what's been proposed 11:29:47 martial: +1 11:30:13 priteau: if you can refresh the chameleon case study, that would be a great help. Reviewing elsewhere is a bonus 11:30:43 daveholland: Are you and James still able / interested in contributing a case study on Lustre at Sanger? 11:30:46 The Chameleon case study should be no problem 11:30:57 I probably will not have time to participate into this, but I think google docs is much better for this kind of review/edits. We are not really reviewing code here, where Gerrit is perfect. To work on text documents Google Docs works just fine. 11:31:15 oneswig: yes, we spoke about it this morning. Do you have any guidance on e.g. number of words, audience knowledge level...? 11:31:57 zioproto: I tend to agree, but we can offer both options 11:31:59 daveholland + oneswig: I agree, we ought to place a number of pages limit and style 11:32:42 what we know: Selected 8"H x 10"W. 11:32:51 daveholland: only the first edition as a guide. Roughly, it works out as a page, including a picture and a quotation. So about half a page of text, including some particular details 11:33:12 daveholland, it's mostly digital so length is not a big deal but take a look at the existing book - the sections are relatively short 11:33:32 oneswig: OK that's less than we expected (depending how much explanation of Lustre routers we need to put it) 11:33:34 oneswig: 10 pages limit, single column 11:34:40 daveholland: in terms of the level of technical detail, assume you're writing for somebody attending Supercomputing who knows about OpenStack. Technical architect types 11:34:54 should we review the list of V2 suggestions that Kathy provided? 11:35:25 martial: thanks - that's for a chapter, IIRC? And the pages are google doc pages 11:35:43 b1airo: mostly they were typos etc? 11:37:52 We should look at case studies for federation - enolfc have you thoughts on how to get diverse coverage of case studies? 11:38:43 And we also need a new case study for bare metal infrastructure management 11:39:29 enolfc: are you working with Khalil on content as well? 11:39:53 oneswig: not yet 11:40:28 I need to contact Tim for the possible CERN input 11:40:31 stig: do we have a directory in google drive for people to populate 11:40:43 I'd suggest we include three, chosen to take different approaches and (ideally) be geographically spread 11:41:03 with their content and then we can act as editors as well as writers to integrate content once it is vouched for? 11:41:05 martial: There was one, I'll check 11:41:21 enolfc, i would imagine Wilfred could pull together some content about how the Nectar federation works (and how we see it evolving) 11:41:22 if there was one, it needs to be linked into the etherpad 11:41:50 blairo, oneswig: so we can have Nectar, CERN, and EGI 11:42:07 enolfc: that would work - provided they don't all use the same solution! 11:42:13 make it "v2" or something, we let people put new content there and we integrate when we are ready 11:42:24 martial: good point, will do 11:42:33 something from the US would be nice 11:42:37 thanks Stig 11:42:48 along the lines of oneswig's question re. the same solution - is CERN's cloud federated heavily in any particular dimension? 11:43:01 enolfc: agreed. 11:43:12 enolfc: Mike Lowe, Robert Budden and Time Randles were talking about adding content 11:43:20 they are big users of Cell's, but I am not sure if that is Cell's across multiple orgs? 11:43:32 b1airo: they use federated authentication for access to CERN tier-0 resources IIRC 11:43:46 so not multi-site so much for the infras 11:44:16 apart from Hungary I guess, but it's still logically the same 'site' 11:44:33 oneswig, but i presume much like our Australian Access Federation that the Federation part is actually a separate and previously established service? 11:45:17 perhaps it is more deeply integrated into the cloud access? 11:45:31 e.g. SSO? 11:46:09 I don't think the federated auth pre-dates OpenStack, I am not sure. I have notes from a workshop I attended (with zioproto - perhaps he remembers better...) 11:46:24 and enolfc - weren't you atteding remotely? 11:46:58 no sign of of noggin or belmiro unfortunately 11:47:15 anyway, we shall see i guess - i am certainly curious 11:47:15 oneswig: in the NREN context federated out came much earlier than Openstack and it is used for many other services 11:47:32 s/federated out/federated auth/ 11:47:33 EduGAIN? 11:47:45 oneswig: yes 11:48:02 Shibboleth has been around quite a while now, for example 11:48:03 I understand we have two more topics to cover in the next few minutes (OpenStack Days London + SC17 notes), so I am going to see if we can move on to the next topic at 50 11:49:27 OK - thanks martial. enolfc - I'm sure you can find diversity in the case studies? There are others that might also work - SNIC in Sweden, the Finnish one, for example 11:49:49 We just like to see good coverage. 11:50:13 OK, final comments? 11:50:20 lets move on 11:50:21 if you have more comments on the book chapter, please refer to the ehterpad at 11:50:23 #link https://etherpad.openstack.org/p/scientific-computing-book-update-2017 11:50:35 #topic AOB 11:50:43 London OpenStack 11:51:17 coming up on the September 26th and we have a WG session, arranged to be lightning talks 11:51:58 For those that will be going - lets have a short talk from you on something interesting going on where you are! 11:52:17 had a network glitch... not sure my last message was sent, but I will contact people and let you know 11:52:27 OK, thanks enolfc_ 11:53:04 I will ask around for an "incentive" for good talks 11:53:20 oneswig: I could talk about what I plan to do where I will be next? Still sketchy, though... 11:54:09 verdurin: Your last talk was largely in the past tense, why not? 11:55:11 Hopefully there will be others talking in a more stable situation 11:55:23 The other item was SC - martial would you like to update on last week? 11:55:33 stig:sure 11:56:03 ooh goodie - i haven't read last week's logs yet 11:56:08 basically Mike Lowe mentioned that " I have the green light for a round of lightning talks in the IU booth just like last year" 11:56:32 " I'll have 1 to 1.5 hours, so divide by volunteers and..." 11:56:46 ah dang, i think i knew that already *deflated* :-) 11:57:08 #link https://etherpad.openstack.org/p/SWG-SC17 11:57:34 that is the working document, we will need to coordinate with Mike next week, but is gauging interest 11:57:55 b1airo: are you going? Given you're barely travelling the week before... 11:58:00 maybe by then i will have a talk on "what workloads not to virtualise" :-) 11:58:17 b1airo: ooh, interesting, based on what? 11:58:19 yes i'll be there oneswig 11:58:45 Reasonable chance I'll be there 11:58:56 based on when we see THP defrag going mental 11:59:20 b1airo: ah, that 11:59:30 Final comments anyone? 11:59:48 b1airo: does it do that for CryoEM? 11:59:54 it is the same dates as Sydney ? 11:59:59 week after 12:00:07 yeah, my analysis of that stalled, but also the incidence of *known* occurrences has dropped off sharply since we started aggressively dropping caches 12:00:21 Nov 12-17 I think 12:00:26 Yes 12:00:37 #link http://sc17.supercomputing.org/ 12:00:38 but i will go back and get more data 12:00:44 OK, we are out of time, alas. 12:00:56 really want to know why having used page cache makes the VMM stupid 12:01:09 Thanks everyone, got to close 12:01:11 Bye 12:01:13 #endmeeting