21:01:13 #startmeeting scientific_wg 21:01:14 Meeting started Tue Mar 21 21:01:13 2017 UTC and is due to finish in 60 minutes. The chair is oneswig. Information about MeetBot at http://wiki.debian.org/MeetBot. 21:01:15 Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. 21:01:18 The meeting name has been set to 'scientific_wg' 21:01:26 Alas, all this talk of currywurst has made me hungry 21:01:40 #chair martial_ 21:01:41 Current chairs: martial_ oneswig 21:01:46 hello stig 21:01:50 yeah...mid-afternoon doldrums have taken hold and currywurst isn't helping 21:01:51 Greetings 21:02:03 hi tim 21:02:05 hello everyone 21:02:10 hell 21:02:14 +o 21:02:14 #link OK here's an agenda https://wiki.openstack.org/wiki/Scientific_working_group#IRC_Meeting_March_21st_2017 21:02:15 oops 21:02:30 Good afternoon America :-) 21:03:06 #topic WG round-up from Milan 21:03:17 Was anybody else present or was it just me? 21:03:52 oneswig: nope sorry, not me 21:03:53 ... in which case I'll do my best to share what I'd learned from a WG perspective 21:04:02 Spill the goss ;) 21:04:08 Hi there 21:04:16 First up, our hosts in Milan were excellent, just great 21:04:17 o/ 21:04:23 hi y'all 21:04:56 There was one discussion which may require a little follow up 21:05:14 The team at OSIC were looking for test case workloads for testing live migration 21:05:24 And they didn't have anything representative for science. 21:05:47 Do you have more details? 21:06:06 I am not sure of the finer details. Unfortunately the guy I spoke to is on vacation this week. 21:06:18 hello! 21:06:38 I believe what they want is a heat stack (or equivalent) that deploys some busy busy workload that runs for long enough for them to experiment with migrating 21:06:45 And at the end, a yes/no pass fail 21:06:48 Hi b1airo! 21:06:52 #chair b1airo 21:06:53 Current chairs: b1airo martial_ oneswig 21:07:28 #link might be further details here (but I don't recall it) https://etherpad.openstack.org/p/MIL-ops-live-migration 21:07:30 oneswig: any use of ansible in that model? 21:08:03 martial_: I'd have thought that's a good fit. Create a long-ish running workload - easy thing to initiate the infrastructure for that with ansible 21:08:37 So... how are we all doing with our cloud-native deployment of science workloads ... ? 21:08:45 yes it's on my list too 21:09:56 oneswig, if i wanted cloud native i'd go to azure 21:10:23 oneswig: related to ansible, they just posted their videos from their recent meet in DC, see: https://www.ansible.com/videos-ansible-automates-2017 21:10:28 Interesting you'd say that. From what I've heard recently Oracle bare metal's the new king of the hill 21:11:06 i took "cloud-native" to be more about application architecture... 21:11:16 oneswig izaak can speak more to the workload when he gets back 21:11:33 in particular the framework 21:11:35 Hi mrhillsman, thanks for dropping in! 21:12:00 mrhillsman: can you give examples of other test cases you're working with? 21:12:44 Oneswig: are you planning a dinner event like in Barcelona? 21:12:45 b1airo: I was thinking of the packaged deployment, cluster-as-a-service creation etc. 21:12:45 we defined the workloads ourselves to get the framework to a "v1" status 21:13:18 details can be found here - https://github.com/osic/ops-workload-framework 21:13:28 Guest81586: would very much like to - Boston coming up on the agenda 21:13:45 izaakk has more detail than me however 21:14:10 hopefully the readme sheds some light for you in prep for that meeting when he gets back 21:15:24 mrhillsman: how would you like people to contribute - pull requests? 21:16:56 i'm confused by the VM types described in that readme 21:17:43 "Large VM ( CPU: 6, RAM: 4g, Disk: 6g)" - doesn't seem particularly large? 21:18:21 b1airo: I wonder if it's large for something that can be live-migrated? 21:18:34 hmm not in our experience 21:18:50 Maybe it's european 21:18:58 lol 21:19:09 Are you doing live migration with NUMA passthrough - does that work? 21:19:57 Guest81586: European VMs, compact and bijoux... 21:20:13 oneswig, no we're not, though i believe it is supposed to work if the destination can meet the topology requirements, however in our case we are also doing SRIOV VF passthrough so live-migration is out due to that 21:20:45 also this sounds odd: "Spans 60 disk workers that fills up the disk by creating 1 gb blocks of data." 21:21:01 in the context of a VM with on 6G of disk how is that supposed to work...? 21:21:08 s/on/only/ 21:21:13 (looking at the agenda, I think we will need to move to the next topic soon, even if we come back to this one later if time permits) 21:21:25 mrhillsman, i must be misunderstanding something? ^^^ 21:21:50 i think there will be a discussion with izaakk about the ask 21:22:11 martial_: thanks, good prompt. I think we'll need to follow up with izaakk and mrhillsman 21:22:33 i do not have detail unfortunately but hopefully looking at the repo gives you some context rather than having to wait a week to get the same info 21:22:40 it is a good starting point 21:22:50 mrhillsman: thanks :) 21:23:16 stepped away, apologies 21:23:23 the sizes are related to the defaults 21:23:50 #topic Boston Summit Forum - contribution to discussion 21:23:59 hope in discussion with different stakeholders is that things will change based on need 21:24:23 #link https://etherpad.openstack.org/p/BOS-UC-brainstorming-scientific-wg 21:24:39 so the link for the brainstorming etherpad is above 21:24:57 Thanks martial_ - so the activity on the list indicates it's time to collect these diverse thoughts together 21:25:18 #link http://lists.openstack.org/pipermail/user-committee/2017-March/001856.html 21:25:32 yes, I wanted to try to go from the etherpad to a list of topic to be discussed and a list of people assigned to those topics 21:25:47 I could not find the 1-to-1 match from the etherpad history 21:26:43 I figure we ought to have a person working on each topic present this discussion 21:27:08 what do you think? 21:27:29 (in a way that was my question to flanders_ yesterday) 21:27:30 Seems like a good idea to find advocates for each 21:27:56 recall the original instructions were to include a leader for each 21:28:38 +1 21:28:52 "Please add contact information next to your topic, so we can contact you for formal "forum" session posting. Thank you" 21:29:25 flanders_: Can people participate in this stage who will not be present at the forum? 21:29:43 And have that leader identify which upstream contributors to invite, who can act as advocates for actions arising from forum sessions. 21:29:49 trandles: yes, I added this earlier today 21:30:14 oneswig: not sure, would post that Q publucally on UC ML 21:30:28 oneswig, can't see why not - at least half the effort is just in getting it organised 21:30:36 looking at the history, I think "Supporting Pre-emptible instances" is "Adam Huffman" 21:30:37 OK I can take a couple of these up provisionally 21:31:11 b1airo: +1 but would be great for other WGs to understand this. 21:31:26 martial_: equally likely that aloga_ would advocate it 21:31:59 Can we pick up tasks using #action? 21:32:10 I got to go now but I'll check the meeting log for details on any Boston event 21:32:22 OK thanks Guest81586 21:32:29 i am guessing Tim is still happy to take "Quota management pain points, workarounds, cross-project needs" 21:33:17 Maybe we ought to email the SWG ML with the link to the etherpad to try to determine our "champions" 21:33:46 because reading the pad/history I am not sure who to contact directly mostly 21:34:41 martial_: agreed, it's not a reliable method 21:35:42 okay, I will send an email to the scientific wg with this request post our meeting 21:36:02 this ought to help us concretize a list of topics 21:36:02 Thanks martial_ 21:36:10 April 2nd is coming fast after all :) 21:37:52 I have not seen must additional discussion on the Cloud Declaration 21:37:58 (must -> much) 21:38:21 #topic Other Boston Summit planning 21:39:01 In general the lightning talks format of the BoF seemed popular. 21:39:05 Any thoughts on that? 21:40:09 oneswig: seems feasible, although if the foundation is taking care of hte schedule it might be good to ask people how long they expect to discuss a topic for? 21:40:20 (sure there are the after summit hours :) ) 21:41:08 martial_: the guillotine on overrunning talks? 21:41:34 oneswig: my worry exactly :) 21:41:52 flanders_: any opinion on this topic? 21:42:21 Surely easy enough to enforce 21:42:49 oneswig: the question is are those going to be during the SWG discussions? 21:43:28 I haven't had confirmation but my understanding is we have a meeting session and a BoF session. 21:43:32 #link https://www.openstack.org/summit/boston-2017/call-for-presentations/preview/17698 Scientific Working Group planning meeting 21:43:34 This would be the Bof 21:43:46 i think judging from feedback on how we ran things in barcelona people wanted more time for discussion 21:44:02 #link https://www.openstack.org/summit/boston-2017/call-for-presentations/preview/17699 Scientific OpenStack BoF 21:44:12 they liked the lightening talks, but there was a general feeling we need more time in the planning session 21:44:32 b1airo: and a bigger room :) 21:44:49 that also 21:45:20 my bad - thought a 100-person meeting was best avoided! :-) 21:45:49 oneswig: many scientists :) 21:46:01 actually i didn't mind, makes it easier to hear people and others are more likely to shutup and listen :-) 21:47:06 okay, so no consensus on this at this point 21:47:25 we can open this for question to the champions 21:47:29 martial_: no I think a bigger room for the WG meeting makes more sense 21:47:49 I can add it to the email (format + time needed) 21:48:38 I think there was also a question about a dinner for the SWG? any plans at this point? 21:48:58 "Martial Michel: To be extended." 21:49:06 trandles: you were involved in this discussion, I remember 21:49:06 I'm looking for a volunteer on the ground for the evening social 21:49:26 martial_: which discussion? dinner? 21:49:33 do we have a boston local? 21:49:44 trandles: yes, was I incorrect? 21:49:51 I passed along info that a Boston-local friend provided me 21:50:08 I remember, thanks Tim 21:50:10 though you won't actually be there trandles ? 21:50:17 yeah, I'll be there 21:50:31 I get the feeling that I'm being volunteered :P 21:50:31 ah ok great 21:50:45 it is feeling that way isn't it... weird 21:50:48 Volontold ;p 21:50:49 lol 21:50:53 yeah 21:50:55 trandles: not really, just asking politely :) 21:50:57 I'll submit 21:51:20 awesome! i love it when oneswig doesn't have to do everything 21:51:42 b1airo: stig is not going to be there either sadly 21:51:46 I'm pretty pleased with that - great work all 21:51:48 :-) 21:52:03 oneswig: if you have any likely sponsors for me to hit up... 21:52:08 look at that, one topic, 10 minutes :) 21:52:23 trandles: I am sure, we can work that. 21:52:31 no, some nonsense about a child's birthday - my own family are guilting me about being away for my birthday 21:52:55 it was my birthday in Barca ... 21:52:58 didn't keep me from the Austin summit 21:52:58 With time running out, can I have the floor for the last topic? 21:53:12 take it away hogepodge 21:53:14 please hogepodge..? 21:53:17 oneswig: mine as well :) 21:53:20 #topic Future Online Analysis Platform Workshop 21:53:35 In a couple of weeks I'm going to a workshop to talk about OpenStack and scientific computing 21:53:58 I have a 30 minute talk, and I'm hoping to incorporate examples from existing systems. 21:54:05 is that the future platform thing Kate Keahey was looking for someone to attend? 21:54:13 Yes. 21:54:28 I have a quick question, any chance anybody will be at the HPC Advisory council meeting in Lugano next month? 21:54:29 cool, looking for slideware etc? 21:54:38 jmlowe: see you there/ 21:54:41 I was hoping that members of the WG could forward me some talks or slides they've given that I could incorporate into my talk 21:54:43 yes :-D 21:54:54 oneswig: excellent 21:54:57 you can send it to chris at openstack.org 21:55:15 hogepodge: we have a pile of stuff for our roadshow 21:55:20 hogepodge: I'll see what I've got that might help. 21:55:30 should we crowdsource the ML as well ? 21:55:31 some background on the event: "developing capabilities that would help us transform HPC resources to be more usable to experimental communities running analytics rather than simulation codes " 21:55:36 hogepodge, sure will share a deck or two and you can just ping me any questions 21:55:40 hogepodge: i can deliver some slides as well 21:55:46 " those researchers need more on-demand access and more data management capabilities than the traditional data centers allow. The attendees will be primarily people designing various elements of these solutions — plus a panel of application scientists." 21:55:50 fantastic, thank you everyone! 21:56:19 I'm going to be in Berlin the week before the event, so I'm trying to get the slides put together this week. 21:56:20 Tough crowd hogepodge 21:56:21 hogepodge, so basically sounds like they are saying, "we want IOPS oriented filesystems now please" ...? 21:56:38 :) 21:56:48 b1airo: is that on our etherpad yet? 21:56:55 hogepodge: going to pitch openstack extras for scientific clouds at Lugano a few days later 21:56:57 Serverless compute and frictionless data for everyone! 21:57:00 oneswig, which? 21:57:08 oneswig: b1airo: et. al. I'm also interested in any advice on how to communicate to the audience 21:57:16 b1airo: forum topics... 21:57:32 That's it for me. thanks everyone! 21:57:34 jmlowe: me too - don't steal the show :-) 21:57:41 #link https://etherpad.openstack.org/p/BOS-UC-brainstorming-scientific-wg 21:57:42 oneswig, are you referring to my IOPS comment or the general topic? 21:58:07 anyone planning to attend ISC ? 21:58:17 oneswig: no worries, I barely get by on my public speaking abilities 21:58:21 b1airo: iops. I made a comparison between bare metal RBD and virtualised Cinder a couple of weeks ago. ouch 21:58:27 (I'll be taking copies of the book too, so that work will also be represented) 21:58:34 hogepodge: great thanks 21:58:40 b1airo: no plans as yet for ISC. 21:58:48 hogepodge: I owe you this conversation for DockerCon as well 21:58:56 or the HPC Knowledge Meeting (http://www.hpckp.org/) ? 21:59:14 hogepodge: you have more copies? Can I get ~50? 21:59:40 oneswig, sounds fun - what was the virtualised backend ? 21:59:44 I ordered for dockercon 21:59:47 ceph 21:59:58 hogepodge: see you there then 22:00:18 so basically, baremetal ceph versus virtual ceph? 22:00:20 100 copies 22:00:25 hogepodge: let me know if you have more - conference is iirc 10-12 april 22:00:46 b1airo: correct - quite different (as you might expect) 22:00:55 Ah, times up 22:01:00 interesting thing to figure out tuning for though 22:01:02 oneswig: yeah, we'll have 100 copies available 22:01:11 hogepodge: seems reasonable. Dcon will be big, so we just have to make sure not everybody walks away with a copy right away, otherwise you will be done in minutes 22:01:32 going... going... 22:01:36 #endmeeting