Wednesday, 2019-07-03

*** yamamoto has joined #openstack-meeting00:04
*** enriquetaso has joined #openstack-meeting00:07
*** joxyuki has joined #openstack-meeting00:08
*** jamesmcarthur has joined #openstack-meeting00:08
*** enriquetaso has quit IRC00:14
*** joxyuki has quit IRC00:15
*** slaweq has joined #openstack-meeting00:16
*** jamesmcarthur has quit IRC00:19
*** slaweq has quit IRC00:21
*** ijw has joined #openstack-meeting00:26
*** gyee has quit IRC00:28
*** enriquetaso has joined #openstack-meeting00:41
*** enriquetaso has quit IRC00:41
*** Lucas_Gray has quit IRC00:44
*** brinzhang has joined #openstack-meeting00:47
*** ijw has quit IRC00:47
*** ijw has joined #openstack-meeting00:49
*** ricolin_ has joined #openstack-meeting00:51
*** ricolin_ is now known as ricolin00:52
*** yamamoto has quit IRC00:59
*** yamamoto has joined #openstack-meeting00:59
*** XSM_HUST has joined #openstack-meeting01:02
*** panda has quit IRC01:03
*** panda has joined #openstack-meeting01:05
*** zhangchi has joined #openstack-meeting01:05
zhangchi#startmeeting tricircle01:06
openstackMeeting started Wed Jul  3 01:06:32 2019 UTC and is due to finish in 60 minutes.  The chair is zhangchi. Information about MeetBot at
openstackUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.01:06
*** openstack changes topic to " (Meeting topic: tricircle)"01:06
openstackThe meeting name has been set to 'tricircle'01:06
zhangchiMorning all01:08
zhangchiWelcome back to join. Time's up for tricircle meeting01:08
zhangchiHi XSM_HUSt01:09
*** baojg has quit IRC01:09
XSM_HUSThi zhangchi01:10
zhangchiI saw community has released and fixed the problem that zun add region name01:12
zhangchiwhile kuryr keep still01:13
*** zbitter has joined #openstack-meeting01:14
zhangchiso can the job test container running in tricirlce enviroment move on01:15
*** zaneb has quit IRC01:16
XSM_HUSTYes, it can .01:17
zhangchiTricircle tempest ci has get recovered01:23
zhangchiThe problem is neutron master introduced the patch
zhangchithis resolution inject admin context by force01:24
zhangchiWe should update the security rule tempest test case01:28
*** yamamoto has quit IRC01:30
zhangchiMeanwhile the spec join tricircle and trio2o together has submitted to github01:35
*** baojg has joined #openstack-meeting01:36
zhangchiThis is a huge project and will take a lot of work01:38
*** yamamoto has joined #openstack-meeting01:40
zhangchiwe will divide the job shown in etherpad. anyone interested in this can claim the jobs01:41
zhangchiAny other problems or topics?01:45
zhangchiWelcome and please feel free to join this01:46
*** yamahata has quit IRC01:46
*** iyamahat has quit IRC01:50
*** yamamoto has quit IRC01:51
zhangchiYou are welcome to make suggestions01:52
zhangchiIf not we will endmeeting now. Wecome to join.01:53
zhangchiNext session is July 17th01:53
*** bobh has joined #openstack-meeting01:53
zhangchiThanks XSM_HUST01:54
*** openstack changes topic to "OpenStack Meetings ||"01:54
openstackMeeting ended Wed Jul  3 01:54:23 2019 UTC.  Information about MeetBot at . (v 0.1.4)01:54
openstackMinutes (text):
*** XSM_HUST has quit IRC01:56
*** apetrich has quit IRC01:57
*** cheng1 has quit IRC02:01
*** cheng1 has joined #openstack-meeting02:01
*** lbragstad has quit IRC02:04
*** ijw_ has joined #openstack-meeting02:14
*** yamamoto has joined #openstack-meeting02:15
*** ijw has quit IRC02:17
*** ijw_ has quit IRC02:24
*** ijw has joined #openstack-meeting02:24
*** ijw has quit IRC02:29
*** yamamoto has quit IRC02:36
*** dasp has quit IRC02:46
*** bobh has quit IRC02:47
*** rfolco has quit IRC02:47
*** ykatabam has quit IRC02:53
*** ykatabam has joined #openstack-meeting02:58
*** dasp has joined #openstack-meeting03:03
*** yamamoto has joined #openstack-meeting03:15
*** yamamoto has quit IRC03:25
*** psachin has joined #openstack-meeting03:34
*** yamahata has joined #openstack-meeting03:43
*** ricolin_ has joined #openstack-meeting03:54
*** ricolin has quit IRC03:57
*** imsurit has joined #openstack-meeting03:58
*** jamesmcarthur has joined #openstack-meeting04:08
*** jamesmcarthur has quit IRC04:24
*** _alastor_ has quit IRC04:25
*** toabctl has quit IRC04:31
*** whoami-rajat has joined #openstack-meeting04:34
*** shilpasd has joined #openstack-meeting04:34
*** brinzhang_ has joined #openstack-meeting04:47
*** brinzhang has quit IRC04:50
*** ekcs has joined #openstack-meeting05:01
*** zbitter has quit IRC05:01
*** zbitter has joined #openstack-meeting05:01
*** brinzhang_ has quit IRC05:05
*** vishalmanchanda has joined #openstack-meeting05:05
*** brinzhang_ has joined #openstack-meeting05:05
*** pcaruana has joined #openstack-meeting05:06
*** e0ne has joined #openstack-meeting05:20
*** zhangchi has quit IRC05:26
*** shilpasd has quit IRC05:36
*** ricolin_ is now known as ricolin05:37
*** ijw has joined #openstack-meeting05:37
*** ijw_ has joined #openstack-meeting05:38
*** igordc has quit IRC05:41
*** artom has joined #openstack-meeting05:41
*** artom is now known as artom|gmtplus305:41
*** ijw has quit IRC05:42
*** shilpasd has joined #openstack-meeting05:44
*** Luzi has joined #openstack-meeting05:54
*** zhangchi has joined #openstack-meeting06:05
*** imsurit_ofc has joined #openstack-meeting06:10
*** imsurit has quit IRC06:12
*** imsurit_ofc is now known as imsurit06:12
*** e0ne has quit IRC06:12
*** shilpasd has quit IRC06:38
*** belmoreira has joined #openstack-meeting06:39
*** apetrich has joined #openstack-meeting06:42
*** slaweq has joined #openstack-meeting06:46
gmannslaweq: i will setup the ipv6 goal things soon and let you know06:46
*** ricolin_ has joined #openstack-meeting06:51
*** ijw_ has quit IRC06:52
*** ricolin has quit IRC06:53
slaweqgmann: thx for info, I wanted to ask You about it06:57
slaweqplease let me know if I will be able to help with this somehow06:57
slaweqbtw. which TZ are You now? I though You are somewhere in Canada :)06:58
*** ttsiouts has joined #openstack-meeting06:58
gmannslaweq: thanks, surly i will tell you.07:00
gmannslaweq: i am in Tokyo for few months.07:01
slaweqahh, ok07:01
slaweqgmann: that explains why You are now online :)07:01
slaweqgmann: btw. can You take a look at patch if You will have few minutes?07:02
*** iyamahat has joined #openstack-meeting07:03
gmannslaweq: :)07:05
gmannslaweq: sure. i will check that07:05
slaweqgmann: thx a lot07:05
*** tssurya has joined #openstack-meeting07:10
*** tesseract has joined #openstack-meeting07:21
*** ttsiouts has quit IRC07:26
*** zbitter has quit IRC07:27
*** ttsiouts has joined #openstack-meeting07:27
*** toabctl has joined #openstack-meeting07:30
*** ttsiouts has quit IRC07:31
*** ttsiouts has joined #openstack-meeting07:51
*** ralonsoh has joined #openstack-meeting07:59
*** jamesmcarthur has joined #openstack-meeting08:00
*** iyamahat has quit IRC08:01
*** ociuhandu has joined #openstack-meeting08:05
*** jamesmcarthur has quit IRC08:06
*** ociuhandu has joined #openstack-meeting08:06
*** trident has quit IRC08:08
*** trident has joined #openstack-meeting08:09
*** sridharg has joined #openstack-meeting08:18
*** priteau has joined #openstack-meeting08:26
*** ricolin__ has joined #openstack-meeting08:44
*** ricolin_ has quit IRC08:47
*** cheng1 has quit IRC08:48
*** cheng1 has joined #openstack-meeting08:49
*** ricolin__ is now known as ricolin08:55
*** Liang__ has joined #openstack-meeting08:56
*** tesseract-RH has joined #openstack-meeting08:57
*** tesseract has quit IRC08:58
*** cheng1 has quit IRC09:01
*** cheng1 has joined #openstack-meeting09:02
*** Lucas_Gray has joined #openstack-meeting09:04
*** imsurit has quit IRC09:07
*** ykatabam has quit IRC09:17
*** zaneb has joined #openstack-meeting09:27
*** tesseract-RH has quit IRC09:29
*** tesseract has joined #openstack-meeting09:29
*** donghao has joined #openstack-meeting09:33
*** tesseract has quit IRC09:33
*** donghao has quit IRC09:33
*** tesseract has joined #openstack-meeting09:33
*** e0ne has joined #openstack-meeting09:37
*** tesseract has quit IRC09:38
*** tesseract has joined #openstack-meeting09:39
*** Liang__ has quit IRC09:44
*** Lucas_Gray has quit IRC10:07
*** dmsimard9 has joined #openstack-meeting10:08
*** dmsimard has quit IRC10:08
*** Lucas_Gray has joined #openstack-meeting10:09
*** ttsiouts has quit IRC10:16
*** ttsiouts has joined #openstack-meeting10:16
*** ttsiouts has quit IRC10:21
*** zhangchi has quit IRC10:22
*** brinzhang_ has quit IRC10:35
*** janders has joined #openstack-meeting10:39
*** b1airo has joined #openstack-meeting10:59
*** ttsiouts has joined #openstack-meeting11:01
*** oneswig has joined #openstack-meeting11:01
oneswigApologies, no Scientific SIG IRC meeting today - no chairs available11:01
b1airohi oneswig11:02
oneswigAh, no sooner had I said it.11:02
oneswighi b1airo11:02
jandershi guys11:03
jandershow is it going?11:03
jandersso meeting or no meeting?11:03
oneswigI don't think an agenda has been created, unfortunately.  I'm in a 2-day meeting now...11:03
oneswigWe could just catch up briefly I guess?11:04
oneswignow that we are here...11:04
jandersdo you guys have any experience with Intel branded servers?11:04
oneswig#startmeeting scientific-sig11:04
openstackMeeting started Wed Jul  3 11:04:27 2019 UTC and is due to finish in 60 minutes.  The chair is oneswig. Information about MeetBot at
openstackUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.11:04
*** openstack changes topic to " (Meeting topic: scientific-sig)"11:04
openstackThe meeting name has been set to 'scientific_sig'11:04
oneswig#chair b1airo11:04
openstackCurrent chairs: b1airo oneswig11:04
oneswigjanders: used the 2600TP white box servers11:04
b1airosorry, laptop just froze at a very inopportune moment11:04
jandersoneswig: yes, those ones11:04
jandersdo you have any experience with automating BIOS configuration?11:05
oneswigWould prefer not to, bmc and bios firmware was not good.11:05
jandersoops then we might be a little screwed11:05
oneswigjanders: I don't think it is possible.  I recall we had to upgrade NIC firmware on them and it was painful at the time.11:05
oneswig(this was 2 years ago, things may have improved).11:05
jandersthey have partial redfish support but it seems very read-only especially if done via ansible11:05
jandersthere are some new tools my guys are testing11:06
oneswigsounds like things have evolved a bit then.11:06
b1airowere they cheap enough to warrant it...?11:06
jandersbut I'm in discussion with their devs, they seem to be keen to make things better11:06
*** psachin has quit IRC11:06
jandersallright.. it's good to know we're not alone11:07
jandersthese seem pretty cool piece of kit other than this "little11:07
janders" detail11:07
jandersI will try to work out something with Intel and happy to report back if anyone is interested11:07
oneswigalways like a discussion on things like that...11:08
oneswigbelmoreira: I have John and Mark here, are you available to discuss next week?11:08
belmoreirashould be fine. Send me your availability (day, hour) and I will check with the other guys11:09
oneswigwill do, thanks (and apologies for the thrash)11:09
belmoreiraoneswig no worries11:10
oneswigHow's the new control plane rollout going?11:10
b1airohow's your control-plane k8s-ing going belmoreira ?11:10
belmoreirawe have production request going to the k8s cluster with glance11:11
belmoreiranext step is nova-api (maybe next week)11:12
belmoreiraand then have a full cell control plane11:12
belmoreirathe main motivation is to gain ops experience and see if it's makes sense to move the control plane to k8s11:12
jandersbelmoreira: when complete, will you run a "small/internal" k8s to run OpenStack control plane that will then run "large/user-facing" k8s on top?11:13
belmoreirajanders not clear. What I would like is to have the k8s cluster deployed with magnum in the same infrastructure. Like the inception that we have today for the control plane VMs11:14
jandersinception... is the OpenStack running itself, essentially?11:15
b1airoif i've understood belmoreira's current cell-level control-plane architecture correctly then each control-plane k8s cluster will itself be running across some subset of his production cloud! it's turtles, or dogfood - hopefully those things aren't equivalent - all the way down/round11:15
belmoreirab1airo: that's it11:16
b1airomemory can't be too rusty yet then, despite being part of a "fleshy von neumann machine" (referencing a conversation earlier this evening)11:17
b1airoanyone played with Singularity 3.3 yet?11:18
b1airofakeroot builds and such?11:18
b1airo(it's still in rc for the moment i think, so won't be surprised if not)11:18
oneswigbelmoreira: got any tips for ceph mds performance?  We've got a deployment with CephFS as a cluster filesystem and it's apparently pegged in directory operations11:21
b1airoyeesh, is telling them not to do that an option oneswig ?11:23
oneswigbelmoreira: back on the self-hosted control plane, what have you looked at in terms of disaster recovery scenarios?  How to fix a broken control plane from within?11:24
oneswigb1airo: It was my idea ...11:25
oneswigI have to head off11:25
oneswigb1airo: can you take the reins? Got to head out now11:26
b1airooh, well in that case it's a fine idea :-P. i guess that means it's not a prod deployment that you're trying to fix though?11:26
b1airosure oneswig11:26
oneswigsee you janders belmoreira b1airo, nice to briefly catch up11:26
oneswigb1airo: no, a bit of scientific experimentation11:26
oneswigcheers all11:27
*** oneswig has quit IRC11:27
jandersoneswig: thank you, till next time11:27
belmoreirasorry, was away for few moments11:27
b1airoi'm assuming oneswig must have already looked at directory fragmentation/sharding across multiple MSD's, but perhaps worth mentioning anyway11:28
belmoreiraoneswig "ceph mds performance" I don't have great tips. Maybe Dan can help11:28
belmoreiraoneswig "disaster recovery scenarios" in case of catastrophe... we always keep few physical nodes to bootstrap the cloud. But that would be very unlikely11:30
b1airoalso, vul at unimelb might have some tips - they are running a HTC/HPC system against CephFS, so have probably seen some of these things11:31
*** bbowen has joined #openstack-meeting11:31
*** priteau has quit IRC11:32
b1airook, i think we can probably call it quits for now. late here anyway11:32
jandersthanks guys!11:32
janderstill next time11:32
*** openstack changes topic to "OpenStack Meetings ||"11:34
openstackMeeting ended Wed Jul  3 11:34:06 2019 UTC.  Information about MeetBot at . (v 0.1.4)11:34
openstackMinutes (text):
*** tssurya has quit IRC11:34
*** janders has quit IRC11:36
*** tssurya has joined #openstack-meeting11:37
*** raildo has joined #openstack-meeting11:38
*** shilpasd has joined #openstack-meeting11:59
*** carloss has joined #openstack-meeting12:14
*** priteau has joined #openstack-meeting12:17
*** _erlon_ has joined #openstack-meeting12:33
*** eharney has joined #openstack-meeting12:37
*** haleyb is now known as haleyb|away12:40
*** psachin has joined #openstack-meeting12:43
*** dmsimard9 is now known as dmsimard12:43
*** baojg has quit IRC13:01
*** enriquetaso has joined #openstack-meeting13:14
*** ijw has joined #openstack-meeting13:15
*** priteau has quit IRC13:15
*** ijw has quit IRC13:15
*** ijw has joined #openstack-meeting13:16
*** lseki has joined #openstack-meeting13:17
*** priteau has joined #openstack-meeting13:18
*** ijw has quit IRC13:21
*** brinzhang has joined #openstack-meeting13:24
*** hyunsikyang__ has quit IRC13:24
*** baojg has joined #openstack-meeting13:25
*** ttsiouts has quit IRC13:27
*** vishalmanchanda has quit IRC13:32
*** wwriverrat has joined #openstack-meeting13:33
*** lpetrut has joined #openstack-meeting13:34
*** b1airo has quit IRC13:38
*** _alastor_ has joined #openstack-meeting13:42
*** ttsiouts has joined #openstack-meeting13:44
*** psachin has quit IRC13:47
*** ijw has joined #openstack-meeting13:48
*** nicolasbock has joined #openstack-meeting13:50
*** zaneb has quit IRC13:53
*** ayoung has quit IRC13:57
*** mriedem has joined #openstack-meeting13:59
*** rfolco has joined #openstack-meeting14:01
*** ayoung has joined #openstack-meeting14:10
*** ijw has quit IRC14:11
*** ijw has joined #openstack-meeting14:11
*** ricolin has quit IRC14:16
*** munimeha1 has joined #openstack-meeting14:18
*** igordc has joined #openstack-meeting14:50
*** bnemec has quit IRC14:50
*** brinzhang has quit IRC14:55
*** deiter has joined #openstack-meeting14:57
*** Luzi has quit IRC14:58
*** vishalmanchanda has joined #openstack-meeting14:58
*** brinzhang has joined #openstack-meeting15:00
*** bobh has joined #openstack-meeting15:05
*** mattw4 has joined #openstack-meeting15:06
*** davidsha has joined #openstack-meeting15:09
*** mattw4 has quit IRC15:09
*** mattw4 has joined #openstack-meeting15:09
*** tssurya has quit IRC15:11
*** mattw4 has quit IRC15:11
*** mattw4 has joined #openstack-meeting15:12
*** Lucas_Gray has quit IRC15:13
*** Wryhder has joined #openstack-meeting15:13
*** priteau has quit IRC15:14
*** Wryhder is now known as Lucas_Gray15:14
*** deiter has quit IRC15:17
*** brinzhang has quit IRC15:21
*** jamesmcarthur has joined #openstack-meeting15:21
*** jamesmcarthur has quit IRC15:21
*** jamesmcarthur has joined #openstack-meeting15:22
*** liuyulong has joined #openstack-meeting15:22
*** zaneb has joined #openstack-meeting15:23
*** priteau has joined #openstack-meeting15:28
*** bnemec has joined #openstack-meeting15:29
*** sridharg has quit IRC15:29
*** liuyulong has quit IRC15:30
*** ttsiouts has quit IRC15:30
*** ttsiouts has joined #openstack-meeting15:31
*** gyee has joined #openstack-meeting15:31
*** ttsiouts has quit IRC15:36
*** enriquetaso has quit IRC15:46
*** rfolco has quit IRC15:47
*** rosmaita has joined #openstack-meeting15:54
*** apetrich has quit IRC15:55
*** pramchan89 has joined #openstack-meeting15:58
*** bobh has quit IRC15:58
jungleboyj#startmeeting Cinder16:01
openstackMeeting started Wed Jul  3 16:01:12 2019 UTC and is due to finish in 60 minutes.  The chair is jungleboyj. Information about MeetBot at
openstackUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.16:01
*** openstack changes topic to " (Meeting topic: Cinder)"16:01
openstackThe meeting name has been set to 'cinder'16:01
jungleboyjCourtesy ping:  jungleboyj whoami-rajat rajinir lseki carloss pots woojay erlon geguileo eharney rosmaita enriquetaso e0ne smcginnis davidsha walshh_ xyang hemna _hemna16:01
*** Lucas_Gray has quit IRC16:02
_pewp_jungleboyj (;-_-)ノ16:02
*** davee_ has joined #openstack-meeting16:03
jungleboyjGive people one mor eminute to join.16:03
jungleboyjOk, guessing that may be all that we get given that it is a holiday week in the US.16:04
jungleboyj#topic announcements16:04
*** openstack changes topic to "announcements (Meeting topic: Cinder)"16:04
jungleboyjWe have Milestone 2 coming up in just a couple of weeks.16:04
jungleboyjJuly 22nd.16:04
jungleboyjThat is our Spec and New Driver freeze.16:05
jungleboyjSo, just a reminder in this case.16:06
*** apetrich has joined #openstack-meeting16:06
jungleboyjAlso, a reminder that we will start looking to see if the 3rd Party CIs are running Py3.16:07
*** wwriverrat has quit IRC16:07
jungleboyjIf not around MS2, right after and then patches to unsupport drivers that aren't in compliance will happen soon.16:07
jungleboyjAny questions around those two announcements?16:08
*** hemna has quit IRC16:08
eharneywell, the volume-rekey spec has been up for weeks with 0 feedback... is someone going to review it? :)16:09
*** hemna has joined #openstack-meeting16:09
jungleboyjeharney:  Great, that leads into my next topic.  :-)16:09
jungleboyj#topic reviews for MS 216:09
*** openstack changes topic to "reviews for MS 2 (Meeting topic: Cinder)"16:09
jungleboyjSo, I went through the open spec reviews and listed the ones that I remembered  being discussed at the PTG.16:10
jungleboyjA few of the specs are waiting on user feedback.  If they are yours, please address.16:10
jungleboyjeharney: I can removed the Backend Capabilities one.16:11
jungleboyjeharney:  Did you mean to have a -2 on the Image Encryption one?16:11
e0nejungleboyj: I'll add few minor changes to my spec this week16:11
eharneyuntil some questions got sorted out, yes16:11
e0nejungleboyj: btw, thanks for your changes! I appreciate it16:11
jungleboyjOk.  Doesn't look like luzi is here.  I will ping her in the review.16:12
eharneythey may have been answered already16:12
eharneyi'm still fairly concerned about that whole feature, but i seem to be the only one, so... i dunno16:12
*** njohnston is now known as njohnston|lunch16:13
*** deiter has joined #openstack-meeting16:13
jungleboyjeharney:  Looks like they have responded if you can take a look.16:13
jungleboyjI will look at the Volume Rekey spec and catch up on the other ones in there.  Would appreciate help from the rest of the team to do the same.16:14
jungleboyjThere is also the Tengling driver to look at.16:15
jungleboyjThey haven't responded since may though.16:16
smcginnisDid they respond to comments yet?16:16
smcginnisGreat if someone can go through and list more of the issues on that one, but probably not worth spending much time on, IMO.16:16
smcginnisThe chances of that being anywhere ready by the deadline are extremely low with the lack of repsonse there.16:17
jungleboyjsmcginnis:  Agreed.16:17
*** woojay has joined #openstack-meeting16:17
jungleboyjSo, if there is no more on the specs.16:18
jungleboyjThat was all I had for today's agenda.16:18
jungleboyj#topic Open Discussion16:19
*** openstack changes topic to "Open Discussion (Meeting topic: Cinder)"16:19
jungleboyjIs there anything else that people wanted to talk about today?16:20
rosmaitai have a quick question about a backport16:20
jungleboyjOkie dokie.16:21
rosmaitathis is proposed for queens:
rosmaitait fixes a py37 tests problem16:21
rosmaitai guess it's harmless, but do we care about py37 that far back?16:21
jungleboyjAh, Didn't realize that was for py3716:21
clarkbNot sure if you've seen my email to openstack-discuss about tempest jobs swapping but cinder-backup seems to be at least part of the problem16:22
rosmaitajust asking because maybe there's a stable gate problem i'm not aware of16:22
jungleboyjNot really.  But it is harmless.16:22
clarkbIt appears that there are plans to remove cinder-backup from default test jobs (which is probably fine) but you may want to invenstigate why cinder-backup might be using more memory than expected anyway16:22
*** apetrich has quit IRC16:22
jungleboyjclarkb:  Interesting.16:23
jungleboyjHas anyone on the team looked into this?16:23
rosmaitanot me ... clarkb do you mean this email:
clarkbyes that one16:24
rosmaita(just to get it into the log)16:24
jungleboyjrosmaita:  Thank you.16:24
jungleboyjrosmaita:  You said geguileo is on vacation?16:25
rosmaitayes, though he is on a geguileo "vacation" (i.e., might show up randomly)16:26
jungleboyjOk.  Just thinking he was the one to touch backup most recently.  :-)16:26
smcginnisWould be interesting to see if the change in threading changed that.16:26
jungleboyjsmcginnis:  ++16:27
smcginnisI wonder if each thread gets a full copy of everything loaded into memory or something?16:27
eharneythe threading changes in backup have been there for a while...16:27
clarkbfwiw I'm not sure when this started16:27
clarkbits been a while since I had to run tempest locally16:27
jungleboyjI could see backup causing a lot of caching into memory happening.16:27
jungleboyjBut that shouldn't force things into swapping.16:27
*** priteau has quit IRC16:28
clarkbalso the two different memory tracker tools we have disagree on memory useage16:28
clarkbso I think the big value may be virtual and the smaller number resident16:28
clarkbBut that may indicate we use a lot of memory when cinder-backup is active then it goes virtual afterwards16:28
clarkb(not sure, needs investigating)16:28
*** ekcs has quit IRC16:29
jungleboyjDo we know that we are covering the backup tests in another test run?16:29
e0neneed to check it16:30
jungleboyje0ne:  Oh, that is right, you have been working on backup as well.16:30
e0neI suppose it's only issue with swift and maybe nfs drivers16:30
e0neceph driver should not have this issue but I didn't check16:30
e0ne#action e0ne to check memory usage by backup drivers16:31
*** munimeha1 has quit IRC16:31
jungleboyje0ne:  Thank you!16:31
e0nejungleboyj: np16:31
jungleboyjOk.  So ... Any other topics for this week?16:33
*** bobh has joined #openstack-meeting16:33
eharney could use some review too16:34
eharneycinderclient shell version negotiation16:34
jungleboyjOk.  Yeah, that would be good to get reviewed.16:35
eharneyit needs some tweaking in tests, but, making sure the direction is right would be useful16:35
jungleboyjLast call.16:36
jungleboyjOk.  If no one has topics I will wrap things up so that you can all go review specs.16:37
jungleboyjHope everyone in the US has a safe and happy 4th of July.16:37
jungleboyjTalk to everyone next week!16:38
rosmaitaand enjoy the parades :P16:38
whoami-rajatThanks jungleboyj16:38
_pewp_jungleboyj (ه’́⌣’̀ه )/16:38
*** openstack changes topic to "OpenStack Meetings ||"16:38
openstackMeeting ended Wed Jul  3 16:38:31 2019 UTC.  Information about MeetBot at . (v 0.1.4)16:38
openstackMinutes (text):
*** bobh has quit IRC16:38
*** woojay has left #openstack-meeting16:39
*** e0ne has quit IRC16:39
*** deiter has quit IRC16:43
*** bnemec has quit IRC16:45
*** jamesmcarthur has quit IRC16:56
*** jamesmcarthur has joined #openstack-meeting16:57
*** davidsha has quit IRC17:02
*** jamesmcarthur has quit IRC17:02
*** markvoelker has joined #openstack-meeting17:02
*** ekcs has joined #openstack-meeting17:06
*** bnemec has joined #openstack-meeting17:14
*** munimeha1 has joined #openstack-meeting17:15
*** lpetrut has quit IRC17:16
*** ociuhandu has quit IRC17:26
*** jamesmcarthur has joined #openstack-meeting17:28
*** e0ne has joined #openstack-meeting17:44
*** jamesmcarthur has quit IRC17:44
*** igordc has quit IRC17:45
*** ijw_ has joined #openstack-meeting17:45
*** ijw has quit IRC17:49
*** rfolco has joined #openstack-meeting17:56
*** vishalmanchanda has quit IRC18:02
*** e0ne has quit IRC18:06
*** enriquetaso has joined #openstack-meeting18:09
*** e0ne has joined #openstack-meeting18:09
*** zaneb has quit IRC18:20
*** ijw_ has quit IRC18:20
*** mattw4 has quit IRC18:21
*** ijw has joined #openstack-meeting18:21
*** e0ne has quit IRC18:22
*** ijw has quit IRC18:24
*** ijw has joined #openstack-meeting18:24
*** _erlon_ has quit IRC18:28
*** shilpasd has quit IRC18:32
*** pramchan89 has quit IRC18:34
*** artom|gmtplus3 has quit IRC18:35
*** ralonsoh has quit IRC18:35
*** tesseract has quit IRC18:44
*** mattw4 has joined #openstack-meeting18:54
*** iyamahat has joined #openstack-meeting18:57
*** yamahata has quit IRC18:57
*** yamahata has joined #openstack-meeting18:59
*** igordc has joined #openstack-meeting19:05
*** whoami-rajat has quit IRC19:12
*** markvoelker has quit IRC19:19
*** markvoelker has joined #openstack-meeting19:19
*** eharney has quit IRC19:27
*** whoami-rajat has joined #openstack-meeting19:29
*** mattw4 has quit IRC19:30
*** igordc has quit IRC19:31
*** ijw has quit IRC19:37
*** ijw has joined #openstack-meeting19:37
*** e0ne has joined #openstack-meeting19:39
*** mattw4 has joined #openstack-meeting19:41
*** ijw has quit IRC19:42
*** e0ne has quit IRC19:55
*** mattw4 has quit IRC19:57
*** mattw4 has joined #openstack-meeting19:57
*** zaneb has joined #openstack-meeting20:03
*** eharney has joined #openstack-meeting20:04
*** e0ne has joined #openstack-meeting20:20
*** hemna has quit IRC20:27
*** munimeha1 has quit IRC20:27
*** hemna has joined #openstack-meeting20:27
*** jaypipes has quit IRC20:34
*** Lucas_Gray has joined #openstack-meeting20:42
*** trident has quit IRC20:43
*** trident has joined #openstack-meeting20:45
*** tdasilva has joined #openstack-meeting20:51
*** _alastor_ has quit IRC20:59
timburke#startmeeting swift21:00
openstackMeeting started Wed Jul  3 21:00:01 2019 UTC and is due to finish in 60 minutes.  The chair is timburke. Information about MeetBot at
openstackUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.21:00
*** openstack changes topic to " (Meeting topic: swift)"21:00
openstackThe meeting name has been set to 'swift'21:00
*** patchbot has joined #openstack-meeting21:00
timburkewho's here for the swift meeting?21:00
claygmore like 🥳 time!!!21:01
timburkeagenda's at21:02
timburke#topic py321:02
*** openstack changes topic to "py3 (Meeting topic: swift)"21:02
*** zaitcev has joined #openstack-meeting21:02
timburkewe're soooo clooose!21:02
kota_sounds awesome.21:02
timburkemattoliverau's started looking at already21:03
patchbotpatch 662546 - swift - py3: Be able to read and write non-ASCII headers - 5 patch sets21:03
timburkewhich is good, as it's the one i'm more nervous about21:03
timburke can be looked at in parallel21:03
patchbotpatch 653548 - swift - py3: add swift-dsvm-functional-py3 job - 14 patch sets21:03
*** alecuyer85 has joined #openstack-meeting21:03
timburkebetween those two, you can get py2 tests running against py3 services21:04
timburkewhich we start gating on in
patchbotpatch 666942 - swift - Run all func tests under py2 against services runn... - 1 patch set21:04
timburkei've already put py3 in my release notes - - so let's get those last few landed!21:05
patchbotpatch 668990 - swift - Authors/changelog for 2.22.0 - 1 patch set21:05
timburkewho can commit to reviewing patches?21:05
*** njohnston|lunch has left #openstack-meeting21:06
claygi review stuff sometimes21:07
kota_1 patch, I might be able to review in the next week21:07
*** zaneb has quit IRC21:07
timburkeclayg or kota_, want to take on ?21:07
patchbotpatch 653548 - swift - py3: add swift-dsvm-functional-py3 job - 14 patch sets21:07
timburkei'm guessing mattoliverau will keep working on ;-)21:08
patchbotpatch 662546 - swift - py3: Be able to read and write non-ASCII headers - 5 patch sets21:08
timburkei think i'm ok with moving forward on the release after *just those two*21:09
timburkethat's about it for py321:09
timburke#topic losf21:10
*** openstack changes topic to "losf (Meeting topic: swift)"21:10
alecuyer85I wrote more tests,21:10
patchbotpatch 666378 - swift (feature/losf) - Add tests for - 3 patch sets21:10
kota_alecuyer85: nice!!!21:10
alecuyer85I think there are a few corner cases I want to handle or test better (a few comments about it in the test code)21:11
*** slaweq has quit IRC21:11
timburkealso, i think our dsvm job isn't happy on the branch any more :-(21:11
timburkei've been trying to sort out why21:11
kota_+1414, -373 :D21:11
timburkethose RETRY_LIMITs seem pretty consistent21:12
alecuyer85Ill look at it also21:12
timburkebumped into it while trying to get and in21:12
patchbotpatch 664424 - swift (feature/losf) - Get new unit tests running under py3 - 2 patch sets21:12
patchbotpatch 668007 - swift (feature/losf) - Merge remote-tracking branch 'gerrit/master' into ... - 1 patch set21:12
kota_i see. did we change something on dsvm?21:12
kota_i see21:13
timburkei think it's something external to us, but i'm not sure what. that first patch was happy Jun 17, but failed Jun 2621:13
*** igordc has joined #openstack-meeting21:14
kota_ok. let's clarify what causes the problem.21:14
*** pcaruana has quit IRC21:16
timburke seems to be the cause21:16
kota_looks like distribution error on urllib3 which is from... requests module maybe?21:17
timburkebut the version of requests (which i *think* is the only thing that would bring in urllib3) that gets installed doesn't have that version constraint:
kota_i saw the problem recently on requests... but not sure.21:18
timburkeif anyone has ideas on how to further diagnose that, i'd love to hear them... but maybe after the meeting, in #openstack-swift21:19
timburkealecuyer85, is there anything else we should be aware of or helping with?21:20
clarkb ?21:20
*** ijw has joined #openstack-meeting21:20
alecuyer85timburke, taking a look at the patch would be great, see if that's going OK even if I know I still need a few changes21:20
timburkeclarkb, yeah, but requests ( should be happy with that21:21
clarkbtimburke: ya looks like both versions are fine21:21
clarkbor rather they don't conflict with each other21:21
timburkealecuyer85, can do21:22
timburke#topic autosharding21:22
*** openstack changes topic to "autosharding (Meeting topic: swift)"21:22
*** rfolco has quit IRC21:22
timburkemattoliverau, looks like you've been busy :-)21:22
mattoliverauSo last week was hackweek at SUSE, so I spent some time playing with a new implementation of auto sharding21:23
mattoliverauIt's still a WIP but have even written a rambly doc on it (and it's on the ideas page)21:23
mattoliverauJust wanted to bring it to peoples attention.21:24
mattoliverauIf your interested take a look at the current iplementation. It's just a first parse at the version + index 0 attempt21:24
alecuyer85nice doc! thanks21:24
mattoliverauThere is a possible edge case ( 1of many I'm sure) I talk about at the end, and possible ways to eliviate it.21:25
*** raildo has quit IRC21:25
mattoliveraunot 100% it is a problem, that just comes from a white board session I had had trying to brain storm issues.21:26
mattoliverauI need to go and refamilarise myself with the sharding replication changes to really confirm, or better make a probe test :)21:26
*** slaweq has joined #openstack-meeting21:27
mattoliverauAnyway, if your interest take a look. I made some interesting asumptions and moves in the patch, which may or may not be right (like adding an ELECT verb to the container-server so they can vote and keep the code simple21:27
mattoliverauThat's all I got for now :)21:28
timburkei like new verbs for new behaviors21:28
*** e0ne has quit IRC21:28
timburkebut then, you may have noticed that from ;-)21:28
patchbotpatch 659162 - swift - Add operator tool to async-delete some or all obje... (MERGED) - 7 patch sets21:28
*** e0ne has joined #openstack-meeting21:29
mattoliverauI did ;)21:29
timburkei'll at least read through the doc by next meeting, try to form some opinions21:30
mattoliverauta, can't ask for any more then that ;)21:30
timburkemattoliverau, anything else we should know or do?21:30
mattoliveraunope, the doc points to the bottom of the patch set (currently of 2 patches)21:31
mattoliverauif it interests you in reviewing.. but also feel free to leave comments in the doc.21:31
timburkeall right21:32
timburke#topic open discussion21:32
*** openstack changes topic to "open discussion (Meeting topic: swift)"21:32
timburkeanything else to bring up?21:32
*** slaweq has quit IRC21:32
timburkeso has anyone else ever seen container replicator lockups since we did sharding?21:34
timburkei noticed a missing timeout that prompted last night/this morning...21:34
patchbotpatch 668963 - swift - container-replicator: Add a timeout for get_shard_... - 1 patch set21:34
timburkehuh. just us, i guess... seems suspicious :-/21:37
*** slaweq has joined #openstack-meeting21:38
timburkehow does everyone feel about the py3 support? do we think this is going to go well, or terribly, or somewhere in between?21:38
mattoliverauin between :P21:38
*** ijw has quit IRC21:38
alecuyer85+1 :)21:38
mattoliveraubut experimental label for a release would make be feel better.21:39
*** ijw has joined #openstack-meeting21:39
kota_going to go well, maybe?21:39
*** ijw has quit IRC21:39
timburkei hope it genuinely results in better outcomes :-) i kinda worry that people will see experimental, not really use it yet, and then we won't have the extra testing we wanted21:40
kota_the py3 gate prevent me to push incompatible patch. it may make slow down but the compatibility will be required anyway?21:40
*** ijw has joined #openstack-meeting21:40
timburkeyeah, then there's that aspect. and it's going to be a bit until we can drop py221:41
claygDrop it!!!21:42
timburkeclayg, not *yet*! we have to *at least* have py3 support first!21:42
mattoliverauwell I hope when we have it running we all could run in SAIO or at least 1 SAIO and iron out any obivous shortcomings :)21:42
alecuyer85I think clayg wanted to use tauthon21:42
claygOr that yes.21:43
*** slaweq has quit IRC21:43
claygThis is fine. When we merge LOSF we’ll have 3 languages.21:43
alecuyer85I think we can switch some test clusters to use py3 and hopefully catch some things (if there is anything to catch!)21:43
timburkehmm... i should look at dropping the devstack exclusion to make sure swift runs on py2 even when everything else is on py3...21:44
timburkealecuyer85, that'll be great! thanks21:44
*** ijw has quit IRC21:44
claygI think we’re going to have a pretty big lift to get py3 going. We might do it on NEW distros only e.g. rhel821:44
timburkei'm sure there's some bugs lurking in the non-client-path21:45
claygBut we’ll probably be importing Swift code in py3 as ecosystem stuff starts to add more py3 support. I’ll probably default vsaio to py321:46
*** e0ne has quit IRC21:46
claygThis’ll be great.21:46
timburkeall right, does anyone have anything else to bring up?21:47
timburkei think i'm going to call it then21:48
timburkethank you all for coming, and thank you for working on swift!21:48
*** openstack changes topic to "OpenStack Meetings ||"21:48
openstackMeeting ended Wed Jul  3 21:48:31 2019 UTC.  Information about MeetBot at . (v 0.1.4)21:48
openstackMinutes (text):
*** patchbot has left #openstack-meeting21:48
*** alecuyer85 has quit IRC21:50
*** tdasilva has quit IRC21:50
*** slaweq has joined #openstack-meeting21:59
*** rcernin has quit IRC22:04
*** slaweq has quit IRC22:04
*** ijw has joined #openstack-meeting22:04
*** ijw has quit IRC22:04
*** ijw has joined #openstack-meeting22:05
*** Wryhder has joined #openstack-meeting22:09
*** Lucas_Gray has quit IRC22:09
*** Wryhder is now known as Lucas_Gray22:10
*** bbowen has quit IRC22:15
*** _alastor_ has joined #openstack-meeting22:17
*** zaitcev has left #openstack-meeting22:21
*** carloss has quit IRC22:23
*** enriquetaso has quit IRC22:24
*** bobh has joined #openstack-meeting22:31
*** whoami-rajat has quit IRC22:42
*** yamamoto has joined #openstack-meeting22:45
*** ayoung has quit IRC22:59
*** ykatabam has joined #openstack-meeting22:59
*** rcernin has joined #openstack-meeting23:09
*** slaweq has joined #openstack-meeting23:14
*** Lucas_Gray has quit IRC23:14
*** ykatabam has quit IRC23:15
*** ykatabam has joined #openstack-meeting23:18
*** slaweq has quit IRC23:19
*** mattw4 has quit IRC23:21
*** bobh has quit IRC23:32
*** bobh has joined #openstack-meeting23:33
*** bobh has quit IRC23:37
*** gyee has quit IRC23:39
*** nicolasbock has quit IRC23:41
*** bobh has joined #openstack-meeting23:48
*** yamamoto has quit IRC23:48
*** gyee has joined #openstack-meeting23:54
*** bobh has quit IRC23:57

Generated by 2.15.3 by Marius Gedminas - find it at!