*** ijw_ has joined #openstack-meeting | 00:13 | |
*** ijw has quit IRC | 00:17 | |
*** ijw_ has quit IRC | 00:18 | |
*** bbowen has quit IRC | 00:29 | |
*** gyee has quit IRC | 00:43 | |
*** zhangchi has joined #openstack-meeting | 00:44 | |
*** markvoelker has quit IRC | 00:57 | |
zhangchi | #startmeeting tricircle | 00:59 |
---|---|---|
openstack | Meeting started Wed Aug 28 00:59:51 2019 UTC and is due to finish in 60 minutes. The chair is zhangchi. Information about MeetBot at http://wiki.debian.org/MeetBot. | 00:59 |
openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 00:59 |
*** openstack changes topic to " (Meeting topic: tricircle)" | 00:59 | |
openstack | The meeting name has been set to 'tricircle' | 00:59 |
zhangchi | Good Moring, everyone | 01:00 |
zhangchi | Time's up for tircircle meeting | 01:00 |
*** larainema has joined #openstack-meeting | 01:00 | |
*** tetsuro has joined #openstack-meeting | 01:12 | |
*** tetsuro has quit IRC | 01:13 | |
*** ekcs has quit IRC | 01:14 | |
zhangchi | I think there only these things to discuss today: add multi-region name in kuryr has been promoted and patch has been submitted | 01:17 |
*** jamesmcarthur has joined #openstack-meeting | 01:22 | |
*** enriquetaso has quit IRC | 01:22 | |
zhangchi | Mmh , We'll start up the specs reunifying Tricircle and trio2o in test | 01:29 |
zhangchi | I think I am alone today, That's ok, I will endmeeting rightnow and hope to see you at Sep 11th | 01:30 |
zhangchi | bye | 01:31 |
zhangchi | #endmeeting | 01:31 |
*** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/" | 01:31 | |
openstack | Meeting ended Wed Aug 28 01:31:04 2019 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 01:31 |
openstack | Minutes: http://eavesdrop.openstack.org/meetings/tricircle/2019/tricircle.2019-08-28-00.59.html | 01:31 |
openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/tricircle/2019/tricircle.2019-08-28-00.59.txt | 01:31 |
openstack | Log: http://eavesdrop.openstack.org/meetings/tricircle/2019/tricircle.2019-08-28-00.59.log.html | 01:31 |
*** zhangchi has quit IRC | 01:35 | |
*** hyunsikyang has quit IRC | 01:46 | |
*** markvoelker has joined #openstack-meeting | 01:52 | |
*** jamesmcarthur has quit IRC | 01:54 | |
*** markvoelker has quit IRC | 02:02 | |
*** markvoelker has joined #openstack-meeting | 02:03 | |
*** nicolasbock has quit IRC | 02:09 | |
*** apetrich has quit IRC | 02:09 | |
*** eharney has quit IRC | 02:10 | |
*** joxyuki has quit IRC | 02:13 | |
*** markvoelker has quit IRC | 02:13 | |
*** markvoelker has joined #openstack-meeting | 02:14 | |
*** markvoelker has quit IRC | 02:24 | |
*** ricolin has joined #openstack-meeting | 02:25 | |
*** kunlunwan_ has joined #openstack-meeting | 02:28 | |
*** kunlunwan_ has quit IRC | 02:31 | |
*** kunlunwan has joined #openstack-meeting | 02:32 | |
*** kunlunwan has quit IRC | 02:41 | |
*** bbowen has joined #openstack-meeting | 02:44 | |
*** psachin has joined #openstack-meeting | 03:10 | |
*** ianychoi has quit IRC | 03:29 | |
*** ianychoi has joined #openstack-meeting | 03:30 | |
*** rfolco has quit IRC | 03:32 | |
*** brinzhang has quit IRC | 03:49 | |
*** brinzhang has joined #openstack-meeting | 03:50 | |
*** brinzhang has quit IRC | 03:51 | |
*** brinzhang has joined #openstack-meeting | 03:51 | |
*** markvoelker has joined #openstack-meeting | 04:05 | |
*** markvoelker has quit IRC | 04:10 | |
*** njohnston has quit IRC | 04:35 | |
*** darvon has quit IRC | 04:40 | |
*** darvon has joined #openstack-meeting | 04:41 | |
*** brault has joined #openstack-meeting | 04:50 | |
*** brault has quit IRC | 04:54 | |
*** zhubx has joined #openstack-meeting | 05:09 | |
*** boxiang has quit IRC | 05:10 | |
*** markvoelker has joined #openstack-meeting | 05:20 | |
*** markvoelker has quit IRC | 05:25 | |
*** jhesketh has quit IRC | 05:34 | |
*** yaawang has quit IRC | 05:39 | |
*** yaawang has joined #openstack-meeting | 05:40 | |
*** jhesketh has joined #openstack-meeting | 05:42 | |
*** Luzi has joined #openstack-meeting | 05:46 | |
*** links has joined #openstack-meeting | 05:46 | |
*** lpetrut has joined #openstack-meeting | 06:00 | |
*** zhubx has quit IRC | 06:18 | |
*** zhubx has joined #openstack-meeting | 06:18 | |
*** slaweq has joined #openstack-meeting | 06:27 | |
*** zhubx has quit IRC | 06:28 | |
*** zhubx has joined #openstack-meeting | 06:28 | |
*** yaawang has quit IRC | 06:31 | |
*** slaweq has quit IRC | 06:32 | |
*** yaawang has joined #openstack-meeting | 06:33 | |
*** slaweq has joined #openstack-meeting | 06:48 | |
*** macz has joined #openstack-meeting | 06:52 | |
*** macz has quit IRC | 06:56 | |
*** zhubx has quit IRC | 07:01 | |
*** zhubx has joined #openstack-meeting | 07:01 | |
*** trident has quit IRC | 07:08 | |
*** zhubx has quit IRC | 07:11 | |
*** zhubx has joined #openstack-meeting | 07:11 | |
*** rcernin has quit IRC | 07:12 | |
*** ykatabam has quit IRC | 07:14 | |
*** trident has joined #openstack-meeting | 07:17 | |
*** ykatabam has joined #openstack-meeting | 07:19 | |
*** zhubx has quit IRC | 07:20 | |
*** zhubx has joined #openstack-meeting | 07:20 | |
*** zhubx has quit IRC | 07:30 | |
*** zhubx has joined #openstack-meeting | 07:30 | |
*** baojg has quit IRC | 08:07 | |
*** apetrich has joined #openstack-meeting | 08:11 | |
*** ralonsoh has joined #openstack-meeting | 08:24 | |
*** zhubx has quit IRC | 08:26 | |
*** zhubx has joined #openstack-meeting | 08:27 | |
*** zhubx has quit IRC | 08:27 | |
*** boxiang has joined #openstack-meeting | 08:29 | |
*** boxiang has quit IRC | 08:33 | |
*** boxiang has joined #openstack-meeting | 08:34 | |
*** jraju__ has joined #openstack-meeting | 08:56 | |
*** links has quit IRC | 08:57 | |
*** cschwede has joined #openstack-meeting | 08:59 | |
*** mtreinish has quit IRC | 09:13 | |
*** mtreinish has joined #openstack-meeting | 09:15 | |
*** brault has joined #openstack-meeting | 09:17 | |
*** links has joined #openstack-meeting | 09:51 | |
*** jraju__ has quit IRC | 09:52 | |
*** zhubx has joined #openstack-meeting | 10:00 | |
*** zhubx has quit IRC | 10:03 | |
*** zhubx has joined #openstack-meeting | 10:03 | |
*** boxiang has quit IRC | 10:03 | |
*** zhubx has quit IRC | 10:04 | |
*** zhubx has joined #openstack-meeting | 10:04 | |
*** macz has joined #openstack-meeting | 10:05 | |
*** zhubx has quit IRC | 10:06 | |
*** zhubx has joined #openstack-meeting | 10:07 | |
*** heikkine has joined #openstack-meeting | 10:07 | |
*** zhubx has quit IRC | 10:08 | |
*** zhubx has joined #openstack-meeting | 10:09 | |
*** macz has quit IRC | 10:09 | |
*** zhubx has quit IRC | 10:09 | |
*** zhubx has joined #openstack-meeting | 10:10 | |
*** ykatabam has joined #openstack-meeting | 10:10 | |
*** ricolin has quit IRC | 10:25 | |
*** HPCJohn has joined #openstack-meeting | 10:40 | |
*** oneswig has joined #openstack-meeting | 10:58 | |
oneswig | #startmeeting scientific-sig | 11:00 |
openstack | Meeting started Wed Aug 28 11:00:14 2019 UTC and is due to finish in 60 minutes. The chair is oneswig. Information about MeetBot at http://wiki.debian.org/MeetBot. | 11:00 |
openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 11:00 |
*** openstack changes topic to " (Meeting topic: scientific-sig)" | 11:00 | |
openstack | The meeting name has been set to 'scientific_sig' | 11:00 |
oneswig | ahoy | 11:00 |
oneswig | #link Agenda for today https://wiki.openstack.org/wiki/Scientific_SIG#IRC_Meeting_August_28th_2019 | 11:00 |
*** janders has joined #openstack-meeting | 11:01 | |
oneswig | back to school... | 11:01 |
janders | too cool for school! | 11:01 |
janders | g'day all | 11:01 |
oneswig | hey janders, how's things? | 11:02 |
janders | not too bad... just got the boot media for our GPFS cluster | 11:02 |
janders | was overlooked in the bill of materials somehow | 11:02 |
janders | build starting next week | 11:02 |
verdurin | Afternoon | 11:02 |
oneswig | sounds good - how big? | 11:03 |
oneswig | hi verdurin, trust you've had a good summer | 11:03 |
janders | small but should be punching above it's weight | 11:03 |
janders | six nodes | 11:03 |
janders | 12x8TB NVMe each | 11:03 |
oneswig | 2x 100G IB as well? | 11:03 |
verdurin | oneswig: I like to think it's not quite over yet, but we'll see... | 11:03 |
janders | 50GE+HDR | 11:03 |
oneswig | verdurin: indeed | 11:03 |
oneswig | janders: nice! does the HDR work? | 11:04 |
janders | I'm quietly hoping to reach the 100GB/s mark | 11:04 |
janders | well.. it doesn't.. yet | 11:04 |
janders | but hopefully soon | 11:04 |
janders | if we wanted pure IB we could probably make it work today, but we're waiting for the VPI stuff to work | 11:05 |
janders | it's still few weeks from GA | 11:05 |
oneswig | dual port hdr? | 11:06 |
janders | correct | 11:06 |
oneswig | phewee. | 11:06 |
janders | this is actually a nice intro to the HPC-ceph discussion | 11:06 |
oneswig | We only have one item for the agenda - let's move on to it... | 11:07 |
janders | the idea behind this cluster is ceph-like self healing with the goodness of RDMA transport | 11:07 |
oneswig | #topic Scientific Ceph SIG | 11:07 |
*** openstack changes topic to "Scientific Ceph SIG (Meeting topic: scientific-sig)" | 11:07 | |
*** carloss has joined #openstack-meeting | 11:07 | |
janders | so - speaking of Ceph & HPC - how's RDMA support in Ceph going? | 11:07 |
oneswig | #link Ceph meeting later today http://lists.ceph.com/pipermail/ceph-users-ceph.com/2019-August/036705.html | 11:07 |
oneswig | janders: my experience of it wasn't compelling | 11:07 |
*** nicolasbock has joined #openstack-meeting | 11:08 | |
oneswig | but it was ~9 months ago | 11:08 |
janders | what were the issues? | 11:08 |
verdurin | Yes, saw someone ask you about that on the mailing list oneswig | 11:08 |
oneswig | And I'd love to spend some quality time with it in the absence of distraction... | 11:08 |
oneswig | the issues were various. It worked OK for RoCE but didn't work reliably in other fabrics | 11:09 |
verdurin | I'm trying to squeeze an update on this from Mellanox | 11:09 |
oneswig | at the time I had EDR IB and OPA to compare with | 11:09 |
oneswig | OPA I think was a first | 11:09 |
janders | wow | 11:09 |
janders | this might be the first time I hear something works with RoCE but not IB | 11:09 |
janders | usually it's the other way round isn't it? :) | 11:09 |
oneswig | On the RoCE side, performance was inconclusive. I had a 25GE network and the performance saturated that. The devices I had were SATA SSDs and networking was not the bottleneck. | 11:10 |
oneswig | So it was hard to show substantial benefit on the hardware available. | 11:10 |
oneswig | It actually underperformed TCP for large messages | 11:10 |
janders | riiight | 11:10 |
oneswig | The IB, I forget what the issue was but I think there were stability problems. Lost transactions in the msgr protocol, that kind of thing. | 11:12 |
janders | yeah sounds a bit rough around the edges every time I look at it | 11:12 |
*** tesseract has joined #openstack-meeting | 11:12 | |
janders | it would be awesome to have it relatively stable | 11:12 |
oneswig | One neat thing was that Intel had contributed some work for iWARP that appeared to have nothing to do with iWARP per se, but did introduce rdmacm, which was needed for all these weird and wonderful fabric variants | 11:12 |
*** ykatabam has quit IRC | 11:13 | |
oneswig | janders: +1 on that, would love to see it work (and be worth the trouble) | 11:13 |
janders | Intel... I have some harsh words to say there in the AOB | 11:13 |
janders | keyword: VROC | 11:13 |
janders | later! | 11:13 |
oneswig | ooh, won't be long to wait, we only have a short agenda for today. | 11:14 |
oneswig | verdurin: how is Ceph performing for your workloads? | 11:14 |
verdurin | No complaints so far, oneswig: though I know there is much heavier work to come | 11:15 |
oneswig | #link Ceph day for Research and Scientific Computing at CERN https://indico.cern.ch/event/765214/ | 11:15 |
oneswig | verdurin: sounds intriguing - new projects coming on board? | 11:15 |
verdurin | Yes, and we're also looking at Ceph now for a different storage requirement. | 11:16 |
oneswig | Will you be at the CERN event? | 11:16 |
verdurin | I will. | 11:16 |
oneswig | super, see you there :-) | 11:17 |
verdurin | Curious how it relates to the other Ceph Day that's scheduled for London in October. | 11:17 |
janders | I envy you guys... Geneva - sure, 2hrs flight if even that... | 11:17 |
verdurin | Sadly my CERN User Pass has expired, so I have to visit as a civilian, like everyone else. | 11:17 |
oneswig | janders: we don't get to go to LCA, in return | 11:18 |
janders | if I were to pick one I don't think it'd be LCA | 11:18 |
oneswig | verdurin: I'm sure they'll remember you... | 11:18 |
janders | will be a while till we get the Summit again | 11:18 |
verdurin | This is the other Ceph Day I mentioned: https://ceph.com/cephdays/ceph-day-london-2019/ | 11:18 |
janders | you guys heading to Shanghai? | 11:19 |
verdurin | Obviously you have to filter out the CloudStack parts. | 11:19 |
oneswig | I'm planning to be there janders | 11:19 |
janders | nice! | 11:19 |
janders | not sure what I'll do | 11:19 |
verdurin | No plans to go so far. | 11:20 |
janders | I wouldn't expect much support given rather tense AUS-CN relations these days | 11:20 |
oneswig | verdurin: last time I went to Ceph London it was in a venue somewhere in Docklands. Good to see they've relocated it. | 11:20 |
janders | would be fun though! | 11:20 |
janders | do you guys know if it's possible to remote into the PTG? | 11:20 |
oneswig | janders: you're not the first to entangle openstack with geo politics. | 11:20 |
verdurin | oneswig: Canada Water, yes. | 11:21 |
oneswig | verdurin: ah I remember seeing you there. Wasn't it around the time of your move out west? | 11:21 |
verdurin | oneswig: A few months afterwards. | 11:22 |
HPCJohn | Canada Water Printworks? 5 minute walk from where I live. But I Agree - not a great conference venue. | 11:22 |
verdurin | oneswig: lots of good user talks at the CERN day. Do you know whether upstream people will be there? | 11:22 |
oneswig | verdurin: don't know I'm afraid | 11:23 |
oneswig | Hi HPCJohn, good to see you | 11:23 |
oneswig | It was a small venue that doubled as a daycare centre. Don't remember the name... | 11:23 |
oneswig | If I have the chance I'll join the Scientific Ceph meeting later | 11:24 |
oneswig | Might be interesting to run the RDMA flag up the pole there. | 11:24 |
janders | +1 | 11:24 |
verdurin | Yes, I'm hoping to do the same. | 11:24 |
janders | what time is it? is it back to back with our meeting, or much later? | 11:24 |
oneswig | I think any serious effort on making it zing is deferred until the scylladb-derived messenger is introduced (forget the name) | 11:24 |
HPCJohn | May I ask what time British Summer time? I think 16:30 as that is European time also | 11:25 |
oneswig | Time was 10:30am us eastern/4:30pm eu central time and I think that means 3:30pm BST | 11:25 |
oneswig | In Canberra, it's the middle of the night :-( | 11:26 |
verdurin | HPCJohn: Yes, in my calendar as 15:30 | 11:26 |
verdurin | BST | 11:26 |
janders | yeah... makes me realise how lucky I am with the timing of this meetup! | 11:26 |
janders | I should move to Perth | 11:26 |
verdurin | janders: they're going to be discussing the timings, so it's quite possible they'll alternate like this one | 11:27 |
janders | that would be very cool | 11:27 |
oneswig | OK shall we move on? | 11:27 |
oneswig | #topic AOB | 11:27 |
*** openstack changes topic to "AOB (Meeting topic: scientific-sig)" | 11:27 | |
oneswig | janders: ? | 11:27 |
janders | ok... bit of Intel bashing as promised | 11:27 |
janders | have you guys played with VROC much? | 11:27 |
oneswig | To my shame I admit to never having heard of it | 11:28 |
janders | CPU-assisted hybrid RAID | 11:28 |
oneswig | Ah, I think I've heard of that. | 11:28 |
janders | we originally wanted to run our BeeGFS nodes in RAID6 | 11:28 |
janders | but as RAID6 sucks on NVMes, we ended up with smaller RAID0s | 11:28 |
janders | but because of these limitations we thought we'll try VROC on our Cyber kit | 11:29 |
janders | so we did | 11:29 |
janders | catch? | 11:29 |
janders | Supported on RHEL7 | 11:29 |
janders | ...unless you use Ironic | 11:29 |
oneswig | aha. | 11:29 |
janders | Ironic is too cut down to understand it | 11:29 |
janders | s/ironic/IPA image | 11:29 |
oneswig | That's not surprising | 11:30 |
janders | so we have dual NVMes but so far can only run off a single one, no RAID protection | 11:30 |
oneswig | Can you boot from sw-assisted raid? | 11:30 |
janders | it's work in progress, we're thinking of retro-fitting RAID after the fact in an automated way | 11:30 |
HPCJohn | Looking forward to CEPH later on. Lunch calls! | 11:30 |
*** HPCJohn has quit IRC | 11:30 | |
janders | oneswig: yes, we can | 11:30 |
janders | just can't mark the VROC array as root_hint | 11:30 |
janders | bit of a bummer really | 11:31 |
janders | we're working on the retrofit script in the meantime | 11:31 |
oneswig | Sounds like a DIB element for your IPA image might help with building in the support | 11:31 |
janders | we've got an RFE/BZ with RHAT | 11:31 |
janders | but all in all I have a sneaking suspicion we'll just leverage newly added SW-RAID support | 11:31 |
janders | as with RAID0/1 VROC doesn't bring much benefit AFAIK | 11:32 |
oneswig | With root hints don't you get a broad range of options, even device size? | 11:32 |
janders | RAID5/6 - different story | 11:32 |
janders | trouble is - IPA just can't see the array | 11:32 |
janders | full RHEL can but not IPA | 11:32 |
janders | we had RHAT support look at it, we tweaked IPA initrd but no luck | 11:32 |
janders | sounds like unnecessary complexity if you ask me | 11:32 |
oneswig | It's a fiddly environment to debug, for sure. | 11:33 |
*** Lucas_Gray has joined #openstack-meeting | 11:33 | |
janders | so I'd say if you're looking for VROC for RAID0/1 scenarios, probably steer away from it | 11:33 |
janders | for sure! | 11:33 |
verdurin | janders: not "Cost-efftice and simple" then? | 11:33 |
janders | for RAID5/6, especially if there's an alternative root drive, sure | 11:33 |
verdurin | effective | 11:33 |
janders | not at all | 11:33 |
janders | not at all | 11:33 |
janders | it did cost us way too much time to troubleshoot this already | 11:33 |
janders | so I thought I will share | 11:34 |
janders | good idea but so far pretty troublesome | 11:34 |
verdurin | Thanks for suffering on all our behalf | 11:34 |
oneswig | I look forward to the sequel... | 11:35 |
janders | hopefully SW-RAID support will fix this once and for all | 11:35 |
janders | VROC->disable; done! | 11:35 |
janders | on a good news front I played around with NVMe based iSCSI cinter | 11:35 |
janders | just for a small POC | 11:35 |
janders | s/cinter/cinder | 11:35 |
janders | 3/2GB per sec read/write | 11:36 |
janders | 70k IOPS on a single client | 11:36 |
janders | 200k IOPS across four | 11:36 |
janders | not a bit fan of iSCSI so was quite impressed | 11:36 |
oneswig | have you tried it with iSER? That works well | 11:36 |
janders | it's just a placeholder for the GPFS when it's ready - so I did not | 11:36 |
janders | but I was expecting maybe 10% of that | 11:37 |
janders | nice surprise | 11:37 |
janders | ( unlike VROC ;) | 11:37 |
verdurin | janders: do keep us informed about your GPFS work | 11:38 |
janders | will do! | 11:38 |
oneswig | Thanks janders! | 11:38 |
janders | happy to give a lightning talk about it in Shanghai if it's ready (and if I am there) | 11:39 |
janders | (or remote in if that's an option) | 11:39 |
oneswig | I'll pencil you in... | 11:39 |
janders | it's EC-GPFS so if it all works as designed it will be a very interesting little system | 11:39 |
janders | bit of ceph-like design | 11:40 |
janders | 12x drives a node and self healing | 11:40 |
janders | PLUS all the GPFS features and stable RDMA transport | 11:40 |
oneswig | janders: what's the condition of the OpenStack drivers for it? | 11:40 |
janders | not ideal, not too bad | 11:41 |
oneswig | I'm guessing this is bare metal so infrastructure storage requirement is limited | 11:41 |
janders | they claim they discontinued support for it few months back | 11:41 |
janders | but we tested it also few months back and it worked reasonably well | 11:41 |
oneswig | good to hear. | 11:41 |
janders | we'll probably use it across the board (glance & cinder for VMs, native for BM) | 11:42 |
oneswig | Did IBM add Manila? | 11:42 |
janders | I don't think so but not 100% sure | 11:43 |
janders | the promise is that they cut down development effort for OpenStack to ramp up development effort for k8s | 11:43 |
*** markvoelker has joined #openstack-meeting | 11:43 | |
janders | so when we get to that part, there might be more interesting options | 11:43 |
janders | not sure where that's at right now though | 11:44 |
verdurin | janders: no restricted-data concerns for this system? | 11:44 |
janders | long story | 11:44 |
janders | short answer - not yet | 11:44 |
verdurin | It's always a long story... | 11:44 |
janders | long answer - we're still working out some of the cybersecurity research workflows | 11:44 |
janders | actually... | 11:44 |
janders | given we're in AOB and we've got 15 mins to go | 11:45 |
janders | do you guys have any experience with malware research related workflows on OpenStack | 11:45 |
janders | as in: | 11:45 |
janders | 1) building up the environment in an airgapped system | 11:45 |
janders | 2) getting the malware into the airgapped perimiter | 11:46 |
janders | 3) storing it | 11:46 |
janders | 4) injecting it | 11:46 |
janders | that sort of stuff | 11:46 |
janders | we're getting more and more interest in that and it feels a bit like we're trailblazing... but are we? | 11:46 |
verdurin | janders: we have an air-gapped system, though not for malware research. | 11:47 |
janders | how do you balance security with giving users reasonable flexibility to built up their environment? | 11:47 |
oneswig | It's a very interesting use case. Hope your Ironic node cleaning steps are good. | 11:47 |
janders | right now we're in between the easy way (just importing CentOS/RHEL point releases) and the more flexible way (regularly updating repo mirrors inside the airgap, including EPEL) | 11:48 |
janders | and this is even before we think about the malware bits | 11:48 |
janders | right now (and this is only a few days old concept) I'm thinking: | 11:49 |
janders | 1) build the environment in a less restricted environment (repo access, ssh in via floating IP) | 11:49 |
verdurin | janders: we're more like the latter, though in fact our users have very little ability to customise beyond requesting changes for us to implement | 11:49 |
janders | 2) move the environment to a restricted area (isolated network, no floats, VNC access only) | 11:50 |
janders | 3) inject malware by attaching volumes (with encrypted malware inside) | 11:50 |
janders | yeah the longer we thing about it the more convinced we are we'll end up playing a significant role in setting up user environments... :( | 11:51 |
janders | s/thing/think | 11:51 |
janders | it really feels like something that either hasn't been fully solved - or has been solved by people who tend not to talk about their work.. | 11:51 |
verdurin | janders: we did take an approach similar to your 1) and 2) steps, in order to make it more bearable/efficient at the preparation stage | 11:52 |
janders | so do you run 1) in non-airgap, take snapshots and import into airgapped for 2)? | 11:52 |
verdurin | exactly, yes | 11:53 |
janders | ok! might be a way forward, too | 11:53 |
janders | what worries me is maintaining relatively up-to-date CentOS/RHEL/Ubuntu/... | 11:53 |
janders | if we go with what we described, that's an non-issue | 11:53 |
verdurin | Yes. | 11:54 |
janders | fun times! | 11:54 |
verdurin | You're always up to something interesting... | 11:54 |
oneswig | indeed. Great use case | 11:54 |
janders | my life these days is figuring this out, while getting HDR/VROC to work - and writing paperwork to keep funding going! :) | 11:54 |
janders | argh | 11:55 |
janders | frustrating at times | 11:55 |
janders | hopefully we're past the worst | 11:55 |
*** ykatabam has joined #openstack-meeting | 11:55 | |
janders | I will see where we end up with all this - and if I am still allowed to talk about it at that stage I'm happy to share the story with you guys | 11:55 |
oneswig | thanks janders, would be a great topic for discussion. | 11:56 |
janders | thanks guys! | 11:56 |
oneswig | OK, shall we wrap up? | 11:56 |
janders | I think so | 11:57 |
*** brinzhang has quit IRC | 11:57 | |
janders | thanks for a great chat | 11:57 |
janders | please do wave the RDMA flag at the Ceph meeting! | 11:57 |
*** brinzhang has joined #openstack-meeting | 11:57 | |
oneswig | I'll try... | 11:57 |
oneswig | #endmeeting | 11:57 |
*** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/" | 11:57 | |
openstack | Meeting ended Wed Aug 28 11:57:42 2019 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 11:57 |
openstack | Minutes: http://eavesdrop.openstack.org/meetings/scientific_sig/2019/scientific_sig.2019-08-28-11.00.html | 11:57 |
openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/scientific_sig/2019/scientific_sig.2019-08-28-11.00.txt | 11:57 |
oneswig | thanks all | 11:57 |
openstack | Log: http://eavesdrop.openstack.org/meetings/scientific_sig/2019/scientific_sig.2019-08-28-11.00.log.html | 11:57 |
verdurin | Bye | 11:57 |
janders | see ya | 11:57 |
*** janders has quit IRC | 12:08 | |
*** rfolco has joined #openstack-meeting | 12:15 | |
*** jamesmcarthur has joined #openstack-meeting | 12:22 | |
*** njohnston_ has joined #openstack-meeting | 12:23 | |
*** ykatabam has quit IRC | 12:25 | |
*** jamesmcarthur has quit IRC | 12:29 | |
*** larainema has quit IRC | 12:30 | |
*** enriquetaso has joined #openstack-meeting | 12:34 | |
*** brinzhang has quit IRC | 12:39 | |
*** ttsiouts has joined #openstack-meeting | 12:43 | |
*** jamesmcarthur has joined #openstack-meeting | 12:48 | |
*** ricolin has joined #openstack-meeting | 12:50 | |
*** dkehn has quit IRC | 12:53 | |
*** ykatabam has joined #openstack-meeting | 13:01 | |
*** oneswig has quit IRC | 13:02 | |
*** mriedem has joined #openstack-meeting | 13:09 | |
*** _pewp_ has quit IRC | 13:10 | |
*** _pewp_ has joined #openstack-meeting | 13:11 | |
*** baojg has joined #openstack-meeting | 13:19 | |
*** ttsiouts has quit IRC | 13:48 | |
*** ttsiouts has joined #openstack-meeting | 13:48 | |
*** eharney has joined #openstack-meeting | 13:50 | |
*** ttsiouts has quit IRC | 13:53 | |
*** priteau has joined #openstack-meeting | 13:55 | |
*** liuyulong has joined #openstack-meeting | 14:00 | |
*** eharney has quit IRC | 14:00 | |
liuyulong | test | 14:00 |
liuyulong | #startmeeting neutron_l3 | 14:00 |
openstack | Meeting started Wed Aug 28 14:00:35 2019 UTC and is due to finish in 60 minutes. The chair is liuyulong. Information about MeetBot at http://wiki.debian.org/MeetBot. | 14:00 |
openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 14:00 |
*** openstack changes topic to " (Meeting topic: neutron_l3)" | 14:00 | |
openstack | The meeting name has been set to 'neutron_l3' | 14:00 |
haleyb | hi | 14:01 |
*** liuyulong_ has joined #openstack-meeting | 14:01 | |
liuyulong_ | #startmeeting neutron_l3 | 14:01 |
openstack | liuyulong_: Error: Can't start another meeting, one is in progress. Use #endmeeting first. | 14:01 |
haleyb | nested meeting? :) | 14:01 |
slaweq | o/ | 14:01 |
liuyulong_ | bad connection.... | 14:01 |
liuyulong | #chair haleyb | 14:02 |
openstack | Current chairs: haleyb liuyulong | 14:02 |
ralonsoh | hi | 14:02 |
liuyulong | #chair liuyulong_ | 14:02 |
openstack | Current chairs: haleyb liuyulong liuyulong_ | 14:02 |
liuyulong | OK, let's start | 14:02 |
liuyulong | #topic Announcements | 14:02 |
*** openstack changes topic to "Announcements (Meeting topic: neutron_l3)" | 14:02 | |
liuyulong | #link https://etherpad.openstack.org/p/Shanghai-Neutron-Planning | 14:03 |
liuyulong | I added some topics last night, hope you guys are interested in that. | 14:03 |
haleyb | liuyulong: instead of centralized DNAT scale-out, why not DVR? but maybe that's a discussion for the ptg | 14:06 |
liuyulong | The number of PTG participants seems to be very small. | 14:06 |
liuyulong | haleyb, for some deployment, they just do not want all nodes have the public network NICs. | 14:08 |
liuyulong | haleyb, a centralized NAT cluster looks easy to manage and maintain. | 14:09 |
liuyulong | So please add your name and topic there. | 14:10 |
liuyulong | Let's move on. | 14:10 |
liuyulong | #topic Bugs | 14:10 |
*** openstack changes topic to "Bugs (Meeting topic: neutron_l3)" | 14:10 | |
liuyulong | We have no bug deputy email this week. | 14:11 |
haleyb | there was a google doc i believe | 14:12 |
liuyulong | #link https://wiki.openstack.org/wiki/Network/Meetings#Bug_deputy | 14:12 |
liuyulong | August-19-2019Swaminathan Vasudevan (Swami) | 14:12 |
liuyulong | August-26-2019Akihiro Motoki (amotoki)replaced by lajoskatona for Aug 26 | 14:12 |
liuyulong | So last week should be Swaminathan, and this week lajoskatona | 14:13 |
liuyulong | #link https://bugs.launchpad.net/neutron/+bugs?field.searchtext=&orderby=-datecreated&search=Search&field.status%3Alist=NEW&field.status%3Alist=OPINION&field.status%3Alist=INVALID&field.status%3Alist=WONTFIX&field.status%3Alist=EXPIRED&field.status%3Alist=CONFIRMED&field.status%3Alist=TRIAGED&field.status%3Alist=INPROGRESS&field.status%3Alist=FIXCOMMITTED&field.status%3Alist=FIXRELEASED&field.status%3Alist=INCOMPLETE_WITH_RESPONSE&field.sta | 14:14 |
liuyulong | tus%3Alist=INCOMPLETE_WITHOUT_RESPONSE&assignee_option=any&field.assignee=&field.bug_reporter=&field.bug_commenter=&field.subscriber=&field.structural_subscriber=&field.tag=&field.tags_combinator=ANY&field.has_cve.used=&field.omit_dupes.used=&field.omit_dupes=on&field.affects_me.used=&field.has_patch.used=&field.has_branches.used=&field.has_branches=on&field.has_no_branches.used=&field.has_no_branches=on&field.has_blueprints.used=&field.has | 14:14 |
liuyulong | _blueprints=on&field.has_no_blueprints.used=&field.has_no_blueprints=on | 14:14 |
*** boxiang has joined #openstack-meeting | 14:14 | |
slaweq | liuyulong: can You maybe use some url shortener and give short url here? :) | 14:14 |
haleyb | https://docs.google.com/spreadsheets/d/1JjcSHL6hFYsAvlrcgK7_Eje1S4vvJdvm363_Mmy557I/edit?usp=sharing | 14:15 |
liuyulong | Let's scan the list by "newest first". | 14:15 |
haleyb | that is the bug report for last week | 14:15 |
liuyulong | I can not open that link right now... | 14:15 |
liuyulong | #link https://bugs.launchpad.net/neutron/+bug/1841753 | 14:16 |
openstack | Launchpad bug 1841753 in neutron "Pyroute2 netns.ns_pids() will fail if during the function loop, one namespace is deleted" [Undecided,New] - Assigned to Rodolfo Alonso (rodolfo-alonso-hernandez) | 14:16 |
liuyulong | ralonsoh is working on this | 14:16 |
ralonsoh | I have a patch uploaded | 14:16 |
ralonsoh | https://review.opendev.org/#/c/679026/ | 14:16 |
*** zhubx has quit IRC | 14:17 | |
ralonsoh | there is an issue in pyroute2 | 14:17 |
ralonsoh | so this is a workaround | 14:17 |
liuyulong | So the fix is a workaround. | 14:17 |
ralonsoh | that's why I set related-bug in the comment | 14:17 |
ralonsoh | this patch is not a fix for neutron | 14:18 |
ralonsoh | the fix should be in pyroute2 | 14:18 |
ralonsoh | (I'll propose a patch this week) | 14:18 |
liuyulong | Make sense, current approach can help solve the problem, we can merge it soon if it break CI too much. | 14:19 |
liuyulong | Next | 14:19 |
liuyulong | #link https://bugs.launchpad.net/neutron/+bug/1841682 | 14:19 |
openstack | Launchpad bug 1841682 in neutron "rootwrap sudo process goes into defunct state" [Undecided,New] | 14:19 |
*** tosky has joined #openstack-meeting | 14:19 | |
ralonsoh | that was filled yesterday | 14:19 |
liuyulong | zombie process right? | 14:20 |
ralonsoh | this should not be related to the last three patches submitted to neutron-keepalived | 14:20 |
ralonsoh | yes zoombie processes | 14:20 |
*** boxiang has quit IRC | 14:20 | |
ralonsoh | this bug is reported for an environment using rocky | 14:20 |
*** boxiang has joined #openstack-meeting | 14:21 | |
ralonsoh | so I would like to know if this is happening now (I'll check the logs in the functional and fullstack tests) | 14:21 |
liuyulong | So I wonder what's the real command after that "[sudo]" ? | 14:21 |
ralonsoh | that's the point: we can't know | 14:21 |
ralonsoh | this happens if you spawn a process using "Ip netns" | 14:22 |
ralonsoh | and you kill the process inside the namespace | 14:22 |
ralonsoh | the kernel process will remain in this state | 14:22 |
ralonsoh | I'll take a look at the current logs in the CI | 14:23 |
liuyulong | Great, thank you, may I assign this bug to you? | 14:23 |
ralonsoh | sure | 14:23 |
liuyulong | Rodolfo Alonso (rodolfo-alonso-hernandez) right? | 14:24 |
ralonsoh | yes | 14:24 |
liuyulong | Done | 14:24 |
liuyulong | OK, let's move on | 14:24 |
liuyulong | Next... | 14:25 |
*** boxiang has quit IRC | 14:25 | |
*** boxiang has joined #openstack-meeting | 14:26 | |
liuyulong | #link https://bugs.launchpad.net/neutron/+bug/1839004 | 14:26 |
openstack | Launchpad bug 1839004 in neutron "Rocky DVR-SNAT seems missing entries for conntrack marking" [Undecided,Incomplete] | 14:26 |
*** markvoelker has quit IRC | 14:26 | |
liuyulong | Something related to BGP | 14:27 |
haleyb | right, looked like subnet pool issue at first | 14:28 |
liuyulong | Ryan said it is not reproducable. | 14:28 |
*** jamesmcarthur has quit IRC | 14:29 | |
*** jamesmcarthur has joined #openstack-meeting | 14:29 | |
*** eharney has joined #openstack-meeting | 14:29 | |
*** markvoelker has joined #openstack-meeting | 14:29 | |
liuyulong | Bad connection... | 14:31 |
haleyb | can probably close then | 14:31 |
liuyulong | Let's keep an eye on that bug. | 14:31 |
*** xubozhang has joined #openstack-meeting | 14:32 | |
liuyulong | Most of other bugs related to L3 are marked as fixed or invalid. | 14:32 |
liuyulong | So if you guys have others, go ahead~ | 14:33 |
haleyb | https://bugs.launchpad.net/neutron/+bug/1812118 | 14:34 |
openstack | Launchpad bug 1812118 in neutron "Neutron doesn't allow to update router external subnets" [Medium,In progress] - Assigned to Brian Haley (brian-haley) | 14:34 |
haleyb | https://review.opendev.org/#/c/670177/ | 14:34 |
*** amotoki_ has quit IRC | 14:34 | |
*** tosky_ has joined #openstack-meeting | 14:34 | |
*** tosky has quit IRC | 14:34 | |
haleyb | while i can't seem to get the test to pass, let's discuss the one-line change | 14:34 |
*** tosky_ is now known as tosky | 14:35 | |
*** amotoki has joined #openstack-meeting | 14:35 | |
haleyb | basically the bug is you can't change the external subnet/IP of a router, you have to remove then re-add | 14:35 |
haleyb | but i think it should be allowed if the network is not changing | 14:36 |
*** markvoelker has quit IRC | 14:37 | |
*** markvoelker has joined #openstack-meeting | 14:38 | |
liuyulong | Change external subnet may have some issues of the public network connection. Any why users need to change the external subnet? | 14:38 |
*** Luzi has quit IRC | 14:40 | |
haleyb | i didn't see any issues in testing, and it's possible to do, just have to be admin | 14:40 |
haleyb | if i can delete and add to do the same thing, why not update? | 14:40 |
haleyb | it doesn't seem much different than having multiple external subnets, and your router is on one, but floating IPs are on another | 14:42 |
haleyb | it should still work | 14:42 |
liuyulong | So the original request is whay this command does not work for normal user? "openstack router set --external-gateway 30e25ece-439b-4d9f-a3f7-816d0167d2cd --fixed-ip subnet=72808793-445e-4fe5-b653-097d720304e8 test" | 14:42 |
*** jamesmcarthur has quit IRC | 14:42 | |
haleyb | right, because of the missing admin context | 14:43 |
liuyulong | OK, looks like I was overthinking of this. | 14:45 |
haleyb | it's the darn test that is killing me, if anyone has a thought on that i'd appreciate it, seems simple from a high level | 14:46 |
*** jamesmcarthur has joined #openstack-meeting | 14:49 | |
liuyulong | Should call update_router for the test? | 14:50 |
liuyulong | https://review.opendev.org/#/c/670177/7/neutron/tests/fullstack/test_l3_agent.py@139, you call the "update_port" now. | 14:50 |
*** Lucas_Gray has quit IRC | 14:51 | |
haleyb | hmm, maybe that's it, i was thinking that test was very similar, i'll take a look, thanks liuyulong | 14:52 |
*** lpetrut has quit IRC | 14:52 | |
haleyb | or i just remove the test :) | 14:53 |
liuyulong | Test cases are always needed. : ) | 14:53 |
slaweq | liuyulong: nah, tests are only slowing us down :P | 14:54 |
haleyb | it seemed like fullstack was the right way though | 14:54 |
liuyulong | OK, let's stop here today. | 14:55 |
liuyulong | Thank you guys for attending. | 14:56 |
ralonsoh | bye | 14:56 |
slaweq | bye | 14:56 |
liuyulong | #endmeeting | 14:56 |
*** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/" | 14:56 | |
openstack | Meeting ended Wed Aug 28 14:56:30 2019 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 14:56 |
openstack | Minutes: http://eavesdrop.openstack.org/meetings/neutron_l3/2019/neutron_l3.2019-08-28-14.00.html | 14:56 |
openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/neutron_l3/2019/neutron_l3.2019-08-28-14.00.txt | 14:56 |
openstack | Log: http://eavesdrop.openstack.org/meetings/neutron_l3/2019/neutron_l3.2019-08-28-14.00.log.html | 14:56 |
*** liuyulong has quit IRC | 14:57 | |
*** liuyulong_ has quit IRC | 14:57 | |
*** igordc has joined #openstack-meeting | 14:57 | |
*** links has quit IRC | 15:01 | |
*** jamesmcarthur has quit IRC | 15:02 | |
*** xubozhang has quit IRC | 15:02 | |
*** tidwellr has joined #openstack-meeting | 15:06 | |
*** jamesmcarthur has joined #openstack-meeting | 15:13 | |
*** lpetrut has joined #openstack-meeting | 15:15 | |
*** jungleboyj has joined #openstack-meeting | 15:17 | |
*** jamesmcarthur has quit IRC | 15:18 | |
*** markvoelker has quit IRC | 15:18 | |
*** donnyd has quit IRC | 15:19 | |
*** donnyd has joined #openstack-meeting | 15:20 | |
*** donnyd has quit IRC | 15:20 | |
*** markvoelker has joined #openstack-meeting | 15:21 | |
*** donnyd has joined #openstack-meeting | 15:21 | |
*** hemna has joined #openstack-meeting | 15:22 | |
*** gyee has joined #openstack-meeting | 15:26 | |
*** niceplace_ has joined #openstack-meeting | 15:39 | |
*** hemna has quit IRC | 15:40 | |
*** hemna has joined #openstack-meeting | 15:41 | |
*** panda is now known as panda|rover | 15:47 | |
*** zhengMa has joined #openstack-meeting | 15:49 | |
*** rosmaita has joined #openstack-meeting | 15:50 | |
*** woojay has joined #openstack-meeting | 15:51 | |
*** davidsha has joined #openstack-meeting | 16:00 | |
jungleboyj | #startmeeting Cinder | 16:00 |
openstack | Meeting started Wed Aug 28 16:00:58 2019 UTC and is due to finish in 60 minutes. The chair is jungleboyj. Information about MeetBot at http://wiki.debian.org/MeetBot. | 16:00 |
openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 16:01 |
*** openstack changes topic to " (Meeting topic: Cinder)" | 16:01 | |
openstack | The meeting name has been set to 'cinder' | 16:01 |
smcginnis | o/ | 16:01 |
woojay | \o | 16:01 |
enriquetaso | o/ | 16:01 |
jungleboyj | courtesy ping: jungleboyj whoami-rajat rajinir lseki carloss pots woojay erlon geguileo eharney rosmaita enriquetaso e0ne smcginnis davidsha walshh_ xyang hemna _hemna tosky | 16:01 |
geguileo | hi! o/ | 16:01 |
*** thgcorrea has joined #openstack-meeting | 16:01 | |
jungleboyj | @! | 16:01 |
_pewp_ | jungleboyj ヾ(-_-;) | 16:01 |
*** whoami-rajat has joined #openstack-meeting | 16:01 | |
rosmaita | o/ | 16:01 |
davidsha | o/ | 16:01 |
eharney | hi | 16:01 |
whoami-rajat | Hi | 16:02 |
xyang | hi | 16:02 |
jungleboyj | Happy Wednesday! | 16:02 |
jungleboyj | Hope everyone is well. Will give people another minute to assemble. | 16:03 |
*** tidwellr has quit IRC | 16:03 | |
jungleboyj | Ok. Lets get started. | 16:03 |
davee_ | o/ | 16:04 |
jungleboyj | #topic announcements | 16:04 |
*** openstack changes topic to "announcements (Meeting topic: Cinder)" | 16:04 | |
*** ricolin has quit IRC | 16:04 | |
jungleboyj | #link https://wiki.openstack.org/wiki/CinderTrainMidCycleSummary | 16:04 |
jungleboyj | I have gotten the summary of last week's mid-cycle posted. | 16:04 |
tosky | o/ | 16:04 |
*** ricolin has joined #openstack-meeting | 16:04 | |
jungleboyj | It includes links to videos of the sessions. | 16:04 |
eharney | thanks for putting that together | 16:04 |
davidsha | Thanks! | 16:04 |
rosmaita | yeah, nicely done | 16:05 |
jungleboyj | Had some really good discussion together and appreciate all those that attended remotely. Even timezones made it challenging. | 16:05 |
jungleboyj | Thank you all. :-) | 16:05 |
jungleboyj | Please look at the Action Items and address those that are assigned to you. | 16:05 |
jungleboyj | Also check the list for the HELP NEEDED items. | 16:05 |
jungleboyj | Those are things that are free to be taken on. | 16:05 |
enriquetaso | ++ | 16:06 |
jungleboyj | Also, I think that rosmaita is planning to send out a survey on what we want to do for future mid-cycles. Please watch for that. | 16:06 |
rosmaita | will try to get that out before the weekend | 16:07 |
jungleboyj | rosmaita: Thank you. | 16:07 |
jungleboyj | Not a huge hurry, but obviously the earlier we start, the better. | 16:07 |
jungleboyj | That was all I had for announcements. | 16:07 |
jungleboyj | #topic releases update | 16:07 |
*** openstack changes topic to "releases update (Meeting topic: Cinder)" | 16:07 | |
jungleboyj | rosmaita: All your's. | 16:08 |
*** tesseract has quit IRC | 16:08 | |
rosmaita | ok, the Train release of os-brick has to happen next week | 16:08 |
rosmaita | #link https://review.opendev.org/#/q/status:open+project:openstack/os-brick+branch:master | 16:08 |
rosmaita | bunch of recent stuff that looks ok, some older items with no reviews, and some older items with problems | 16:08 |
whoami-rajat | jungleboyj: may i have the etherpad link ? | 16:08 |
jungleboyj | #link https://etherpad.openstack.org/p/cinder-train-meetings | 16:08 |
rosmaita | would probably be a good idea to use the Review Priority to put +2RP on stuff we absolutely want to get in | 16:08 |
whoami-rajat | jungleboyj: thanks | 16:09 |
jungleboyj | rosmaita: ++ | 16:09 |
eharney | i set +RP on the cryptsetup deprecation, should really get that in for this cycle | 16:09 |
rosmaita | ok, great | 16:09 |
rosmaita | btw, cinderlib is on a different release schedule, so Train release doesn't have to happen until after the cinder Train release | 16:09 |
jungleboyj | Good. Thank you for verifying that. | 16:09 |
rosmaita | the Train release of python-cinderclient has to happen the week after (week of Sept 9) | 16:10 |
rosmaita | #link https://review.opendev.org/#/q/status:open+project:openstack/python-cinderclient+branch:master | 16:10 |
rosmaita | this is going to include bumping the client from 4.3.0->5.0.0 | 16:10 |
rosmaita | so we certainly need to get all the version change stuff merged (for example, v1 support removal) | 16:10 |
jungleboyj | ++ | 16:10 |
whoami-rajat | I think the pdf generator is also a goal for train, not much important but good to get in. | 16:10 |
rosmaita | right, i think hemna said he has that working for the client | 16:11 |
*** bobh has joined #openstack-meeting | 16:11 | |
jungleboyj | rosmaita: He did. | 16:11 |
rosmaita | cool | 16:11 |
rosmaita | so basically, we need all cores to pay attention to brick and the client over the next 2 weeks | 16:11 |
jungleboyj | rosmaita: ++ | 16:11 |
rosmaita | that's all from me | 16:11 |
*** ricolin has quit IRC | 16:12 | |
jungleboyj | rosmaita: Cool. Thank you! | 16:12 |
jungleboyj | Appreciate you continuing to watch the releases. | 16:12 |
jungleboyj | #topic Replication. | 16:13 |
*** openstack changes topic to "Replication. (Meeting topic: Cinder)" | 16:13 | |
jungleboyj | This was an item of discussion from the mid-cycle. | 16:13 |
jungleboyj | Is anyone really making use of this? | 16:13 |
jungleboyj | Have customers used it? | 16:13 |
jungleboyj | Reaching out to the vendors here to see what you all know? | 16:13 |
* jungleboyj hopes everyone is typing busily but guessing that isn't the case. | 16:14 | |
jungleboyj | Has anyone even tested the functionality recently? | 16:15 |
eharney | a good amount of work went into getting it working with Ceph not too long ago | 16:15 |
smcginnis | Might be good to post this to -discuss and -ops too. | 16:15 |
*** bobh has quit IRC | 16:15 | |
jungleboyj | eharney: ++ That is good. So we have some confidence that it at lest works for one driver. :-) | 16:15 |
jungleboyj | smcginnis: Yeah, thinking that might be the next step. | 16:16 |
*** bobh has joined #openstack-meeting | 16:16 | |
smcginnis | I've seen some vendors interested in making sure it is working, but I have not actually heard of any end users using it. | 16:16 |
jungleboyj | smcginnis: Yeah, that was what I was afraid of. | 16:17 |
jungleboyj | Ok. So I am guessing there is no more discussion to have right now then. | 16:18 |
jungleboyj | I can send an e-mail to -discuss and -ops to see if we get a response there. | 16:18 |
smcginnis | Might get more of a response than you've gotten here. :D | 16:18 |
jungleboyj | One can hope. | 16:19 |
jungleboyj | Ok. That was all that I had for topics today then. | 16:19 |
jungleboyj | #topic Open Discussion | 16:20 |
*** openstack changes topic to "Open Discussion (Meeting topic: Cinder)" | 16:20 | |
jungleboyj | Anyone have anything else to discuss today? | 16:20 |
enriquetaso | hey, I'm still looking for reviews in the bACKUP Incremental patch | 16:20 |
*** bobh has quit IRC | 16:20 | |
enriquetaso | #link https://review.opendev.org/#/c/627941/ | 16:20 |
enriquetaso | :P | 16:20 |
enriquetaso | I've fixed all the comments | 16:21 |
whoami-rajat | So as per geguileo 's review, my patch is ready to merge in cinderlib [1] but hasn't received any functionality reviews on the main cinder patch[2] | 16:21 |
whoami-rajat | [1] https://review.opendev.org/#/c/674826/ | 16:21 |
whoami-rajat | [2] https://review.opendev.org/#/c/639180/ | 16:21 |
jungleboyj | Ok. I can look at that again. | 16:21 |
eharney | the rbd incr patch seemed like it was about there last time i looked at it, can take another look | 16:21 |
enriquetaso | thanks eharney | 16:21 |
jungleboyj | eharney: Good. Want to get that in but definitely want you and geguileo to weigh in. | 16:22 |
geguileo | jungleboyj: I'll try to get another grumpy look at the patch | 16:23 |
enriquetaso | geguileo++ | 16:23 |
jungleboyj | geguileo: Don't be grumpy, be happy. :-) | 16:23 |
geguileo | XD | 16:23 |
jungleboyj | https://gph.is/1tN18rB | 16:25 |
jungleboyj | So, can take a look at the requested reviews. Any other topics? | 16:25 |
zhengMa | Hi team, we have solved the 'merge' problem, I think our patch is ready for reviewing. https://review.opendev.org/#/c/668825 | 16:26 |
jungleboyj | Ok. Taking silence as a no. | 16:26 |
zhengMa | Thanks! | 16:26 |
*** brault has quit IRC | 16:27 | |
jungleboyj | On that note it appears we could all use 30 minutes to go do code reviews. | 16:27 |
rosmaita | yes! | 16:28 |
jungleboyj | :-) Ok. Go forth and review. | 16:28 |
smcginnis | Thanks! | 16:28 |
jungleboyj | Thanks all for attending. | 16:28 |
jungleboyj | #endmeeting | 16:28 |
*** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/" | 16:28 | |
openstack | Meeting ended Wed Aug 28 16:28:38 2019 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 16:28 |
openstack | Minutes: http://eavesdrop.openstack.org/meetings/cinder/2019/cinder.2019-08-28-16.00.html | 16:28 |
openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/cinder/2019/cinder.2019-08-28-16.00.txt | 16:28 |
openstack | Log: http://eavesdrop.openstack.org/meetings/cinder/2019/cinder.2019-08-28-16.00.log.html | 16:28 |
*** zhengMa has quit IRC | 16:29 | |
*** tosky has left #openstack-meeting | 16:30 | |
*** davidsha has quit IRC | 16:32 | |
*** macz has joined #openstack-meeting | 16:33 | |
*** woojay has left #openstack-meeting | 16:35 | |
*** mriedem is now known as mriedem_away | 16:49 | |
*** ekcs has joined #openstack-meeting | 16:54 | |
*** artom has quit IRC | 16:56 | |
*** jamesmcarthur has joined #openstack-meeting | 17:00 | |
*** zhengMa has joined #openstack-meeting | 17:13 | |
*** ijw has joined #openstack-meeting | 17:14 | |
*** ijw has quit IRC | 17:16 | |
*** ijw has joined #openstack-meeting | 17:16 | |
*** ijw has quit IRC | 17:17 | |
*** ijw has joined #openstack-meeting | 17:18 | |
*** zhengMa has quit IRC | 17:18 | |
*** mlavalle has joined #openstack-meeting | 17:19 | |
*** panda|rover is now known as panda|rover|off | 17:23 | |
*** brault has joined #openstack-meeting | 17:30 | |
*** brault has quit IRC | 17:34 | |
*** eharney_ has joined #openstack-meeting | 17:43 | |
*** njohnston_ has left #openstack-meeting | 17:43 | |
*** eharney has quit IRC | 17:44 | |
*** brault has joined #openstack-meeting | 17:44 | |
*** brault has quit IRC | 17:45 | |
*** eharney_ is now known as eharney | 17:46 | |
*** mlavalle has left #openstack-meeting | 17:52 | |
*** mmethot has quit IRC | 17:58 | |
*** zbitter has joined #openstack-meeting | 17:58 | |
*** mmethot has joined #openstack-meeting | 17:58 | |
*** zaneb has quit IRC | 17:58 | |
*** priteau has quit IRC | 18:12 | |
*** ociuhandu has joined #openstack-meeting | 18:12 | |
*** psachin has quit IRC | 18:13 | |
*** mriedem_away is now known as mriedem | 18:21 | |
*** enriquetaso has quit IRC | 18:22 | |
*** igordc has quit IRC | 18:23 | |
*** enriquetaso has joined #openstack-meeting | 18:28 | |
*** thgcorrea has quit IRC | 18:41 | |
*** jamesmcarthur has quit IRC | 18:43 | |
*** bbowen has quit IRC | 18:51 | |
*** lpetrut has quit IRC | 19:02 | |
*** ociuhandu has quit IRC | 19:14 | |
*** nicolasbock has quit IRC | 19:34 | |
*** eharney has quit IRC | 19:36 | |
fungi | no storyboard meeting this week (obviously), find us in #storyboard if you have something you wanted to bring up | 19:37 |
*** rosmaita has left #openstack-meeting | 19:37 | |
*** ralonsoh has quit IRC | 19:42 | |
*** gyee has quit IRC | 20:05 | |
*** slaweq has quit IRC | 20:09 | |
*** zhubx has joined #openstack-meeting | 20:20 | |
*** gyee has joined #openstack-meeting | 20:23 | |
*** boxiang has quit IRC | 20:24 | |
*** brault has joined #openstack-meeting | 20:32 | |
*** brault has quit IRC | 20:37 | |
*** jamesmcarthur has joined #openstack-meeting | 20:44 | |
*** enriquetaso has quit IRC | 20:51 | |
*** bbowen has joined #openstack-meeting | 20:53 | |
*** eharney has joined #openstack-meeting | 20:55 | |
*** markvoelker has quit IRC | 20:58 | |
*** markvoelker has joined #openstack-meeting | 20:58 | |
*** belmoreira has joined #openstack-meeting | 20:59 | |
*** jamesmcarthur has quit IRC | 20:59 | |
timburke | #startmeeting swift | 21:00 |
openstack | Meeting started Wed Aug 28 21:00:17 2019 UTC and is due to finish in 60 minutes. The chair is timburke. Information about MeetBot at http://wiki.debian.org/MeetBot. | 21:00 |
openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 21:00 |
*** openstack changes topic to " (Meeting topic: swift)" | 21:00 | |
openstack | The meeting name has been set to 'swift' | 21:00 |
*** patchbot has joined #openstack-meeting | 21:00 | |
timburke | who's here for the swift meeting? | 21:00 |
mattoliverau | o/ | 21:00 |
rledisez | hi o/ | 21:00 |
tdasilva | o/ | 21:01 |
kota_ | hi | 21:01 |
* notmyname lurks | 21:01 | |
* timburke will have to avoid bad-mouthing the previous PTL now | 21:02 | |
*** alecuyer has joined #openstack-meeting | 21:02 | |
timburke | all right, let's get started. agenda's at | 21:03 |
timburke | #link https://wiki.openstack.org/wiki/Meetings/Swift | 21:03 |
*** zaitcev_ has joined #openstack-meeting | 21:03 | |
clayg | Heh | 21:03 |
timburke | first, a couple house-keeping items | 21:03 |
timburke | #topic elections | 21:03 |
*** openstack changes topic to "elections (Meeting topic: swift)" | 21:03 | |
timburke | it's election season! | 21:03 |
timburke | #link http://lists.openstack.org/pipermail/openstack-discuss/2019-August/008832.html | 21:03 |
timburke | fwiw, it looks like 4 of the current TC members will not be seeking re-election | 21:03 |
timburke | (that's out of 6 seats up for election this cycle) | 21:03 |
timburke | ...so if you've ever wanted to be on the comittee, your odds might be improved this cycle ;-) | 21:03 |
timburke | as for swift, i'd be happy and honored to continue serving as PTL | 21:04 |
timburke | i feel like there's still room for me to grow in this role :-) | 21:04 |
timburke | though if anyone would like to serve instead (or otherwise has misgivings), feel free to speak up. now or later; here, in -swift, or in private | 21:04 |
kota_ | that's great news! | 21:04 |
timburke | i serve at y'all's pleasure ;-) | 21:04 |
timburke | kota_, oh i'm glad :-) i remember you and mattoliverau talking about maybe wanting to run -- and i really would hate to get in the way of that | 21:05 |
kota_ | my point is if no one else wants to run. so I'm happy with you continue to run the PTL. | 21:06 |
kota_ | ;-) | 21:06 |
timburke | any questions/comments/concerns? on either part of the elections | 21:06 |
mattoliverau | timburke: thanks, your doing a great job. notmyname has large shoes to fill, but your doing good. Keep it up! | 21:07 |
tdasilva | timburke: you are doing a great job, thanks for your efforts in leading the project! | 21:07 |
timburke | i'll work on writing up my candidacy email and plan on sending it out tonight or tomorrow | 21:07 |
notmyname | timburke: you're doing a great job :-) | 21:07 |
timburke | notmyname, oh how would *you* know, lurker!? :P | 21:08 |
timburke | #topic shrinking the TC | 21:08 |
*** openstack changes topic to "shrinking the TC (Meeting topic: swift)" | 21:08 | |
timburke | #link http://lists.openstack.org/pipermail/openstack-discuss/2019-August/008791.html | 21:08 |
timburke | mostly just a heads-up, keeping people in the loop if you haven't been keeping up on the mailing list | 21:08 |
timburke | apparently the TC is going to shrink over the next year and a half or so from 13 members to 11 or 9 | 21:08 |
timburke | (details still being ironed out) | 21:08 |
timburke | i don't think it'll really have much direct impact on us, just an fyi | 21:08 |
timburke | on to updates! | 21:09 |
notmyname | that's interesting | 21:09 |
timburke | good news is, if we have to argue about golang for losf, we'll have fewer people we have to convince, right? ;-) | 21:10 |
timburke | #topic py3 | 21:10 |
*** openstack changes topic to "py3 (Meeting topic: swift)" | 21:10 | |
*** markvoelker has quit IRC | 21:10 | |
timburke | all func tests have merged! probe tests are mostly ported and have one +2 already! | 21:10 |
timburke | \o/ | 21:10 |
*** markvoelker has joined #openstack-meeting | 21:10 | |
timburke | #link https://review.opendev.org/#/c/671333/ | 21:10 |
patchbot | patch 671333 - swift - py3: (mostly) port probe tests - 3 patch sets | 21:10 |
mattoliverau | nice | 21:11 |
alecuyer | wow :) | 21:11 |
timburke | i still need to work on getting a gate job going for it | 21:11 |
timburke | it's been a long journey, thank you all for helping | 21:11 |
timburke | i was looking back at what we had under test when, and wanted to share a little | 21:11 |
*** slaweq has joined #openstack-meeting | 21:11 | |
timburke | our first openstack release with at least one test module getting exercised was mitaka, just testing exceptions | 21:11 |
timburke | by ocata, we'd gotten up to 4 modules... but then we stalled out and were still there for queens | 21:11 |
timburke | rocky, we were up to 30 | 21:11 |
timburke | then 90 in stein | 21:11 |
timburke | now we're at all 128! that seems amazingly fast for the size and scope of the work | 21:11 |
timburke | congrats everybody, and again, thank you all | 21:12 |
timburke | (particularly zaitcev_ and mattoliverau :-) | 21:12 |
mattoliverau | Especially timburke and zaitcev_, I rode on their coat tails :) | 21:13 |
timburke | heh. now we just need to test it enough to really feel comfortable with it | 21:13 |
timburke | #topic versioning | 21:14 |
*** openstack changes topic to "versioning (Meeting topic: swift)" | 21:14 | |
timburke | clayg, how's it going? | 21:14 |
timburke | ok, so that may have been rhetorical so i didn't feel like i was talking too much | 21:15 |
*** zaitcev_ has quit IRC | 21:16 | |
timburke | we've got concerns about symlink versioning actually doing all the things we want it to do | 21:16 |
timburke | #link https://review.opendev.org/#/c/633857/ | 21:16 |
patchbot | patch 633857 - swift - symlink-backed versioned_writes - 19 patch sets | 21:16 |
*** slaweq has quit IRC | 21:16 | |
*** zaitcev has joined #openstack-meeting | 21:16 | |
*** belmoreira has quit IRC | 21:16 | |
timburke | remember, in particular we want to get to the point that we can pretty faithfully mimic S3's notion of versioning | 21:17 |
timburke | so i started playing around with adding *another* mode, like history mode but with a naming convention for the versions that would be more useful there | 21:17 |
timburke | #link https://review.opendev.org/#/c/678962/ | 21:17 |
patchbot | patch 678962 - swift - WIP: Add another versioning mode with a new naming... - 1 patch set | 21:17 |
timburke | it needs lots of tests and i ought to start actually trying to wire in the s3api changes to see how well it works | 21:18 |
timburke | ...but i think it might work? biggest downside is that there isn't a good way to transition from using x-versions-location *or* x-history-location to the new mode :-( | 21:19 |
*** artom has joined #openstack-meeting | 21:20 | |
mattoliverau | moar symlinking! | 21:20 |
timburke | if anybody has thoughts on versioning and/or s3api, it might be worth taking a look | 21:20 |
mattoliverau | :P | 21:20 |
kota_ | hmm | 21:21 |
clayg | timburke: sorry, i'm back | 21:21 |
timburke | mattoliverau, yeah, i was about to say "(or really, *any* way)" but then i remembered that i'd thought about symlinking the new-style to the existing old name :-) | 21:21 |
*** ircuser-1 has quit IRC | 21:22 | |
clayg | timburke: if we're going this route can we make the third mode always use symlinks? | 21:22 |
clayg | i'm excited about the new ?versions=v params | 21:22 |
*** zaitcev has quit IRC | 21:23 | |
clayg | I'd love to see if we could get that work with a copy/restore | 21:23 |
timburke | clayg, probably? it'll still need to be able to splice the listings though -- in case you turned it off then back on | 21:23 |
notmyname | clayg: what's the status of your investigation? learned enough to compare to timburke's 3rd mode? | 21:23 |
*** zaitcev_ has joined #openstack-meeting | 21:23 | |
timburke | i *think* it'll mostly Just Work with COPY? | 21:23 |
timburke | oh yeah, and to fill out the context some more... | 21:24 |
timburke | #link https://review.opendev.org/#/c/673682/ | 21:24 |
patchbot | patch 673682 - swift - s3api: Implement versioning status API - 2 patch sets | 21:24 |
*** zaitcev_ has quit IRC | 21:24 | |
timburke | clayg, anything else i'd forgotten to mention? | 21:24 |
*** belmoreira has joined #openstack-meeting | 21:25 | |
clayg | notmyname: well, I think the symlink-versioned writes code is going to port over pretty well - there's some differences because s3request objects aren't exactly the same as plain swob requests but mostly I can fork lift just the bits I need | 21:25 |
*** zaitcev has joined #openstack-meeting | 21:25 | |
clayg | the diff is going to be much different - instead of versioned_writes accrete a bunch of new conditional branches based on which mode you're using there's just going to be some new code paths that do symlink writes and other version'd operations in s3api mode | 21:26 |
clayg | it'll be using it's own sysmeta so it's compleatly orthogonal to versioned_writes | 21:26 |
clayg | it'll be interesting to see what looks like the best path forward in the short term - or long term depending on the bits we do/don't like | 21:27 |
timburke | completely orthogonal -- so it won't be respected for bimodal access, yeah? | 21:28 |
clayg | instead of reviewing a change to versoined writes and a new s3api feature for translation - it'll just be a change to s3api | 21:28 |
clayg | timburke: exactly - it's a s3api feature only available through the s3api - at least that's the experiment i'm running - i'm not advocating for anything other than we should take the time to understand what an implementation like that would look like | 21:29 |
timburke | 👍 | 21:29 |
timburke | good to go into these things with our eyes as open as we can have them :-) | 21:29 |
kota_ | :-) | 21:30 |
clayg | timburke: but related to that I would like to pull back on the forced use_symlinks migration for existing versioned writes containers | 21:30 |
timburke | i'm torn -- that race condition is the commit message is still very much a thing :-/ | 21:31 |
clayg | and it has been for a long time | 21:31 |
timburke | *in the commit message | 21:31 |
timburke | true enough | 21:31 |
timburke | anyone else have questions, comments, or other feedback? | 21:33 |
timburke | #topic lots of small files | 21:35 |
*** openstack changes topic to "lots of small files (Meeting topic: swift)" | 21:35 | |
timburke | alecuyer, i saw the RPC-ove-HTTP patch go by | 21:35 |
timburke | #link https://review.opendev.org/#/c/679022/ | 21:35 |
patchbot | patch 679022 - swift (feature/losf) - WIP - Support RPC over plain HTTP (vs gRPC) - 1 patch set | 21:35 |
alecuyer | yes, | 21:35 |
alecuyer | it removes the grpc dependency, | 21:35 |
kota_ | cool | 21:36 |
alecuyer | or almost : python still wants to find grpc to compile the protobuf definitions, I have to figure that one out | 21:36 |
alecuyer | and I need to fix tests related to that change. | 21:36 |
timburke | i was just noticing the "ImportError: cannot import name rpc_grpc" in logs :-) | 21:37 |
alecuyer | so I pushed that a little quick today so you could have a look, but its not finished :) It should not take too long though to clean it up and fix the tests | 21:37 |
timburke | nice! anything else we should be looking at for losf? | 21:38 |
alecuyer | (cherry picked it from our branch which is still a little different from master) | 21:38 |
alecuyer | well it's great to have your tests feedback | 21:38 |
alecuyer | that's it for me for this week | 21:39 |
*** markvoelker has quit IRC | 21:39 | |
*** markvoelker has joined #openstack-meeting | 21:40 | |
timburke | #topic sharding | 21:40 |
*** openstack changes topic to "sharding (Meeting topic: swift)" | 21:40 | |
timburke | mattoliverau, how's it going? | 21:41 |
timburke | i know there was a bit of back-and-forth on https://review.opendev.org/#/c/675820/ | 21:41 |
patchbot | patch 675820 - swift - sharder: Keep cleaving on empty shard ranges - 2 patch sets | 21:41 |
mattoliverau | I've marked it as WIP as I have a go at reworking the cleave code | 21:42 |
mattoliverau | clayg and timburke made some good points about code flow and we should avoid using exception handling to do so. Esp in py3. It was a way to not touch too much of the cleaving code. | 21:44 |
mattoliverau | But will have a play and rework cleaving to better fit skipping empty shards ranges in. | 21:44 |
*** markvoelker has quit IRC | 21:45 | |
timburke | thanks -- and i didn't mean to be discouraging -- i know i prefer not to fiddle too much with working code, too ;-) | 21:45 |
mattoliverau | :) | 21:45 |
mattoliverau | yeah and cleaving is already a little.. interesting. But to do it properly is the right way forward :) | 21:46 |
timburke | #topic open discussion | 21:47 |
*** openstack changes topic to "open discussion (Meeting topic: swift)" | 21:47 | |
timburke | anybody have anything else to bring up? | 21:47 |
zaitcev | I was disconnecting too much and missed any replies if you testd py2-py3 migrations. | 21:49 |
timburke | zaitcev, no, not yet :-( | 21:49 |
timburke | fwiw, i re-organized the priority reviews page a bit to better capture some of the work in flight. sorry for hogging it for py3 stuff so much lately | 21:50 |
timburke | #link https://wiki.openstack.org/wiki/Swift/PriorityReviews | 21:50 |
*** eharney has quit IRC | 21:50 | |
timburke | as always, if there's anything else you'd like to see on there, feel free to add it | 21:51 |
*** jbadiapa has quit IRC | 21:52 | |
timburke | all right, i'm calling it | 21:53 |
timburke | thank you all for coming, and thank you for working on swift! | 21:53 |
timburke | #endmeeting | 21:53 |
*** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/" | 21:53 | |
openstack | Meeting ended Wed Aug 28 21:53:18 2019 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 21:53 |
openstack | Minutes: http://eavesdrop.openstack.org/meetings/swift/2019/swift.2019-08-28-21.00.html | 21:53 |
openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/swift/2019/swift.2019-08-28-21.00.txt | 21:53 |
openstack | Log: http://eavesdrop.openstack.org/meetings/swift/2019/swift.2019-08-28-21.00.log.html | 21:53 |
*** alecuyer has left #openstack-meeting | 21:54 | |
*** mriedem has quit IRC | 21:54 | |
*** zaitcev has left #openstack-meeting | 21:55 | |
*** eharney has joined #openstack-meeting | 21:55 | |
*** markvoelker has joined #openstack-meeting | 22:05 | |
*** dviroel has quit IRC | 22:10 | |
*** markvoelker has quit IRC | 22:11 | |
*** slaweq has joined #openstack-meeting | 22:11 | |
*** belmoreira has quit IRC | 22:11 | |
*** enriquetaso has joined #openstack-meeting | 22:14 | |
*** ircuser-1 has joined #openstack-meeting | 22:15 | |
*** slaweq has quit IRC | 22:17 | |
*** carloss has quit IRC | 22:29 | |
*** patchbot has quit IRC | 22:38 | |
*** notmyname has quit IRC | 22:38 | |
*** notmyname has joined #openstack-meeting | 22:48 | |
*** macz has quit IRC | 22:57 | |
*** slaweq has joined #openstack-meeting | 23:11 | |
*** slaweq has quit IRC | 23:15 | |
*** rcernin has joined #openstack-meeting | 23:21 | |
*** ykatabam has joined #openstack-meeting | 23:21 | |
*** ykatabam has quit IRC | 23:26 | |
*** rfolco has quit IRC | 23:29 | |
*** ykatabam has joined #openstack-meeting | 23:37 | |
*** tetsuro has joined #openstack-meeting | 23:44 | |
*** Swami has joined #openstack-meeting | 23:44 | |
*** Swami has quit IRC | 23:45 | |
*** lseki has quit IRC | 23:48 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!