Thursday, 2016-12-01

*** haleyb_ has joined #openstack-meeting-300:00
*** bpokorny has quit IRC00:02
*** matjazp has quit IRC00:04
*** absubram has joined #openstack-meeting-300:04
*** haleyb_ has quit IRC00:04
*** gugl has quit IRC00:07
*** Swami has quit IRC00:12
*** kenji-i has joined #openstack-meeting-300:21
*** hoangcx has joined #openstack-meeting-300:28
*** spzala has quit IRC00:29
*** spzala has joined #openstack-meeting-300:29
*** yingjun has joined #openstack-meeting-300:30
*** spzala has quit IRC00:30
*** spzala has joined #openstack-meeting-300:30
*** yingjun has joined #openstack-meeting-300:30
*** spzala has quit IRC00:36
*** spzala has joined #openstack-meeting-300:36
*** numans has quit IRC00:39
*** spzala has quit IRC00:40
*** Marcellin__ has quit IRC00:48
*** tovin07_ has joined #openstack-meeting-300:52
*** s3wong has joined #openstack-meeting-300:58
*** baoli_ has quit IRC01:01
*** pvaneck has quit IRC01:04
*** baoli has joined #openstack-meeting-301:05
*** mtanino has quit IRC01:10
*** zhurong has joined #openstack-meeting-301:11
*** piet_ has quit IRC01:12
*** rajinir has quit IRC01:16
*** Patifa has quit IRC01:26
*** spzala has joined #openstack-meeting-301:30
*** huanxuan has joined #openstack-meeting-301:33
*** stanzgy has joined #openstack-meeting-301:33
*** liangy has quit IRC01:54
*** gugl has joined #openstack-meeting-301:59
*** haleyb_ has joined #openstack-meeting-302:02
*** haleyb_ has quit IRC02:07
*** stanzgy_ has joined #openstack-meeting-302:11
*** stanzgy has quit IRC02:13
*** stevemar__ has quit IRC02:13
*** stevemar__ has joined #openstack-meeting-302:13
*** stevemar__ has quit IRC02:17
*** srobert has quit IRC02:26
*** yamahata has quit IRC02:37
*** clu_ has quit IRC02:38
*** iyamahat has quit IRC02:40
*** s3wong has quit IRC02:42
*** srobert has joined #openstack-meeting-302:43
*** srobert has quit IRC02:44
*** srobert has joined #openstack-meeting-302:44
*** topol has joined #openstack-meeting-302:47
*** zz_dimtruck is now known as dimtruck02:48
*** srobert has quit IRC02:58
*** haleyb_ has joined #openstack-meeting-303:03
*** haleyb_ has quit IRC03:07
*** topol has quit IRC03:11
*** stevemar__ has joined #openstack-meeting-303:11
*** absubram has quit IRC03:21
*** gugl has quit IRC03:22
*** Rockyg has quit IRC03:28
*** tovin07 has quit IRC03:31
*** tovin07 has joined #openstack-meeting-303:35
*** psachin has joined #openstack-meeting-303:47
*** prateek has joined #openstack-meeting-303:55
*** haleyb_ has joined #openstack-meeting-304:04
*** tuanluong has joined #openstack-meeting-304:06
*** haleyb_ has quit IRC04:09
*** yamamot__ has joined #openstack-meeting-304:16
*** dimtruck is now known as zz_dimtruck04:19
*** absubram has joined #openstack-meeting-304:21
*** armax has quit IRC04:21
*** armax has joined #openstack-meeting-304:24
*** stevemar__ has quit IRC04:25
*** absubram_ has joined #openstack-meeting-304:25
*** stevemar__ has joined #openstack-meeting-304:25
*** absubram has quit IRC04:26
*** absubram_ is now known as absubram04:26
*** stevemar__ has quit IRC04:30
*** mickeys has quit IRC04:44
*** watanabe_isao has joined #openstack-meeting-304:46
*** kzaitsev_mb has joined #openstack-meeting-304:52
*** iyamahat has joined #openstack-meeting-304:53
*** iyamahat has quit IRC05:00
*** mickeys has joined #openstack-meeting-305:00
*** haleyb_ has joined #openstack-meeting-305:05
*** haleyb_ has quit IRC05:10
*** prateek_ has joined #openstack-meeting-305:11
*** prateek has quit IRC05:14
*** parora has joined #openstack-meeting-305:15
*** yamahata has joined #openstack-meeting-305:15
*** kzaitsev_mb has quit IRC05:15
*** VW has joined #openstack-meeting-305:16
*** prateek_ has quit IRC05:17
*** spzala has quit IRC05:21
*** spzala has joined #openstack-meeting-305:21
*** spzala has quit IRC05:22
*** spzala has joined #openstack-meeting-305:22
*** spzala has quit IRC05:22
*** armax has quit IRC05:22
*** spzala has joined #openstack-meeting-305:23
*** spzala has quit IRC05:23
*** spzala has joined #openstack-meeting-305:23
*** spzala has quit IRC05:23
*** spzala has joined #openstack-meeting-305:24
*** spzala has quit IRC05:24
*** spzala has joined #openstack-meeting-305:25
*** spzala has quit IRC05:25
*** spzala has joined #openstack-meeting-305:26
*** spzala has quit IRC05:26
*** spzala has joined #openstack-meeting-305:27
*** spzala has quit IRC05:27
*** spzala has joined #openstack-meeting-305:27
*** spzala has quit IRC05:28
*** spzala has joined #openstack-meeting-305:28
*** spzala has quit IRC05:28
*** spzala has joined #openstack-meeting-305:29
*** spzala has quit IRC05:29
*** VW has quit IRC05:29
*** spzala has joined #openstack-meeting-305:30
*** spzala has quit IRC05:30
*** lpetrut has joined #openstack-meeting-305:30
*** spzala has joined #openstack-meeting-305:30
*** spzala has quit IRC05:31
*** spzala has joined #openstack-meeting-305:31
*** spzala has quit IRC05:32
*** spzala has joined #openstack-meeting-305:32
*** spzala has quit IRC05:32
*** gouthamr has joined #openstack-meeting-305:33
*** spzala has joined #openstack-meeting-305:33
*** spzala has quit IRC05:33
*** spzala has joined #openstack-meeting-305:34
*** spzala has quit IRC05:34
*** spzala has joined #openstack-meeting-305:35
*** spzala has quit IRC05:35
*** spzala has joined #openstack-meeting-305:35
*** spzala has quit IRC05:35
*** spzala has joined #openstack-meeting-305:36
*** spzala has quit IRC05:36
*** yamamot__ has quit IRC05:37
*** spzala has joined #openstack-meeting-305:37
*** spzala has quit IRC05:37
*** yamamot__ has joined #openstack-meeting-305:37
*** spzala has joined #openstack-meeting-305:37
*** spzala has quit IRC05:38
*** spzala has joined #openstack-meeting-305:38
*** spzala has quit IRC05:38
*** spzala has joined #openstack-meeting-305:39
*** VW has joined #openstack-meeting-305:39
*** spzala has quit IRC05:39
*** spzala has joined #openstack-meeting-305:40
*** spzala has quit IRC05:40
*** numans has joined #openstack-meeting-305:40
*** spzala has joined #openstack-meeting-305:40
*** spzala has quit IRC05:41
*** spzala has joined #openstack-meeting-305:41
*** spzala has quit IRC05:41
*** spzala has joined #openstack-meeting-305:42
*** spzala has quit IRC05:42
*** spzala has joined #openstack-meeting-305:43
*** spzala has quit IRC05:43
*** spzala has joined #openstack-meeting-305:44
*** spzala has quit IRC05:44
*** spzala has joined #openstack-meeting-305:45
*** spzala has quit IRC05:45
*** spzala has joined #openstack-meeting-305:46
*** spzala has quit IRC05:46
*** spzala has joined #openstack-meeting-305:47
*** spzala has quit IRC05:47
*** spzala has joined #openstack-meeting-305:47
*** spzala has quit IRC05:48
*** spzala has joined #openstack-meeting-305:48
*** spzala has quit IRC05:48
*** spzala has joined #openstack-meeting-305:49
*** spzala has quit IRC05:49
*** spzala has joined #openstack-meeting-305:50
*** spzala has quit IRC05:50
*** spzala has joined #openstack-meeting-305:51
*** spzala has quit IRC05:51
*** spzala has joined #openstack-meeting-305:51
*** spzala has quit IRC05:51
*** spzala has joined #openstack-meeting-305:52
*** spzala has quit IRC05:52
*** spzala has joined #openstack-meeting-305:53
*** spzala has quit IRC05:53
*** spzala has joined #openstack-meeting-305:53
*** spzala has quit IRC05:54
*** spzala has joined #openstack-meeting-305:54
*** spzala has quit IRC05:54
*** spzala has joined #openstack-meeting-305:55
*** spzala has quit IRC05:55
*** spzala has joined #openstack-meeting-305:56
*** spzala has quit IRC05:56
*** spzala has joined #openstack-meeting-305:56
*** spzala has quit IRC05:57
*** spzala has joined #openstack-meeting-305:57
*** spzala has quit IRC05:57
*** spzala has joined #openstack-meeting-305:58
*** spzala has quit IRC05:58
*** spzala has joined #openstack-meeting-305:59
*** spzala has quit IRC05:59
*** spzala has joined #openstack-meeting-305:59
*** spzala has quit IRC06:00
*** mickeys has quit IRC06:00
*** spzala has joined #openstack-meeting-306:00
*** spzala has quit IRC06:00
*** spzala has joined #openstack-meeting-306:01
*** spzala has quit IRC06:01
*** spzala has joined #openstack-meeting-306:02
*** spzala has quit IRC06:02
*** lpetrut has quit IRC06:02
*** spzala has joined #openstack-meeting-306:03
*** spzala has quit IRC06:03
*** spzala has joined #openstack-meeting-306:03
*** spzala has quit IRC06:03
*** VW has quit IRC06:04
*** spzala has joined #openstack-meeting-306:04
*** spzala has quit IRC06:04
*** spzala has joined #openstack-meeting-306:05
*** spzala has quit IRC06:05
*** spzala has joined #openstack-meeting-306:06
*** spzala has quit IRC06:06
*** haleyb_ has joined #openstack-meeting-306:06
*** spzala has joined #openstack-meeting-306:06
*** spzala has quit IRC06:06
*** spzala has joined #openstack-meeting-306:07
*** spzala has quit IRC06:07
*** lpetrut has joined #openstack-meeting-306:10
*** baoli has quit IRC06:11
*** haleyb_ has quit IRC06:11
*** VW has joined #openstack-meeting-306:11
*** parora has quit IRC06:13
*** prateek has joined #openstack-meeting-306:13
*** mickeys has joined #openstack-meeting-306:15
*** hurgleburgler has quit IRC06:16
*** lpetrut has quit IRC06:17
*** VW has quit IRC06:33
*** watanabe_isao has quit IRC06:33
*** acabot has quit IRC06:43
*** stevemar__ has joined #openstack-meeting-306:56
*** stevemar__ has quit IRC07:01
*** pgadiya has joined #openstack-meeting-307:02
*** zhurong__ has joined #openstack-meeting-307:07
*** spzala has joined #openstack-meeting-307:08
*** tuanluong_ has joined #openstack-meeting-307:08
*** zhurong has quit IRC07:10
*** tuanluong has quit IRC07:11
*** spzala has quit IRC07:12
*** mickeys has quit IRC07:16
*** mickeys has joined #openstack-meeting-307:17
*** mickeys has quit IRC07:21
*** andreas_s has joined #openstack-meeting-307:33
*** hichihara has joined #openstack-meeting-307:37
*** ibmko has quit IRC07:51
*** rarcea_ has joined #openstack-meeting-307:53
*** ccamacho|afk is now known as ccamacho07:58
*** matjazp has joined #openstack-meeting-308:02
*** ibmko has joined #openstack-meeting-308:06
*** matrohon has joined #openstack-meeting-308:07
*** tuanluong has joined #openstack-meeting-308:08
*** haleyb_ has joined #openstack-meeting-308:08
*** spzala has joined #openstack-meeting-308:08
*** tuanluong_ has quit IRC08:10
*** mickeys has joined #openstack-meeting-308:10
*** haleyb_ has quit IRC08:13
*** spzala has quit IRC08:13
*** ralonsoh has joined #openstack-meeting-308:13
*** numans has quit IRC08:20
*** ianychoi has quit IRC08:24
*** dobson has quit IRC08:24
*** dobson has joined #openstack-meeting-308:25
*** ativelkov has quit IRC08:25
*** ativelkov has joined #openstack-meeting-308:25
*** MarkBaker has quit IRC08:26
*** wznoinsk has quit IRC08:26
*** marios has quit IRC08:26
*** rossella_s has joined #openstack-meeting-308:26
*** marios has joined #openstack-meeting-308:28
*** ccamacho has quit IRC08:28
*** jcook has quit IRC08:28
*** mfranc213 has quit IRC08:28
*** wznoinsk has joined #openstack-meeting-308:30
*** ccamacho has joined #openstack-meeting-308:30
*** mfranc213 has joined #openstack-meeting-308:31
*** megm has quit IRC08:33
*** egallen has quit IRC08:33
*** jcook has joined #openstack-meeting-308:34
*** megm has joined #openstack-meeting-308:35
*** andreas_s has quit IRC08:36
*** andreas_s has joined #openstack-meeting-308:36
*** numan_ has joined #openstack-meeting-308:36
*** Guest66666 has quit IRC08:36
*** Guest66666 has joined #openstack-meeting-308:38
*** matrohon has quit IRC08:39
*** yamahata has quit IRC08:41
*** ibmko has quit IRC08:47
*** yamahata has joined #openstack-meeting-308:48
*** stevemar__ has joined #openstack-meeting-308:57
*** stevemar__ has quit IRC09:02
*** ibmko has joined #openstack-meeting-309:02
*** stevejims has joined #openstack-meeting-309:03
*** acabot has joined #openstack-meeting-309:05
*** prateek has quit IRC09:07
*** haleyb_ has joined #openstack-meeting-309:09
*** stevejims has left #openstack-meeting-309:09
*** spzala has joined #openstack-meeting-309:10
*** hogepodge has quit IRC09:11
*** hogepodge has joined #openstack-meeting-309:12
*** matrohon has joined #openstack-meeting-309:12
*** haleyb_ has quit IRC09:13
*** mickeys has quit IRC09:14
*** spzala has quit IRC09:15
*** woodster_ has quit IRC09:16
*** mickeys has joined #openstack-meeting-309:18
*** igordcard has quit IRC09:21
*** mickeys has quit IRC09:22
*** sambetts|afk has quit IRC09:22
*** igordcard has joined #openstack-meeting-309:23
*** hichihara has quit IRC09:25
*** iyamahat has joined #openstack-meeting-309:27
*** sambetts_ has joined #openstack-meeting-309:27
*** yingjun has quit IRC09:29
*** paul-carlton2 has joined #openstack-meeting-309:30
*** hogepodge has quit IRC09:31
*** danpawlik has joined #openstack-meeting-309:31
*** hogepodge has joined #openstack-meeting-309:32
*** iyamahat has quit IRC09:32
*** MarkBaker has joined #openstack-meeting-309:47
*** openstack has joined #openstack-meeting-310:05
*** ChanServ sets mode: +o openstack10:05
*** yamahata has quit IRC10:06
*** haleyb_ has joined #openstack-meeting-310:10
*** matrohon has quit IRC10:11
*** hoangcx has quit IRC10:11
*** kzaitsev_mb has joined #openstack-meeting-310:14
*** haleyb_ has quit IRC10:15
*** ianychoi has joined #openstack-meeting-310:22
*** psachin has quit IRC10:22
*** mickeys has joined #openstack-meeting-310:23
*** matrohon has joined #openstack-meeting-310:23
*** mickeys has quit IRC10:28
*** sdague_ has joined #openstack-meeting-310:34
*** psachin has joined #openstack-meeting-310:35
*** sambetts_ is now known as sambetts10:38
*** MarkBaker has quit IRC10:39
*** bswartz has quit IRC10:39
*** luzC has quit IRC10:39
*** rhagarty_ has quit IRC10:39
*** MarkAtwood has quit IRC10:39
*** tonyb has quit IRC10:39
*** dansmith has quit IRC10:39
*** fnordahl has quit IRC10:39
*** MarkBaker has joined #openstack-meeting-310:43
*** bswartz has joined #openstack-meeting-310:43
*** luzC has joined #openstack-meeting-310:43
*** rhagarty_ has joined #openstack-meeting-310:43
*** MarkAtwood has joined #openstack-meeting-310:43
*** tonyb has joined #openstack-meeting-310:43
*** dansmith has joined #openstack-meeting-310:43
*** fnordahl has joined #openstack-meeting-310:43
*** MarkBaker has quit IRC10:47
*** yingjun has joined #openstack-meeting-310:52
*** matrohon has quit IRC10:54
*** stanzgy_ has quit IRC11:00
*** yingjun has quit IRC11:00
*** yingjun has joined #openstack-meeting-311:00
*** yingjun has quit IRC11:04
*** matrohon has joined #openstack-meeting-311:06
*** bapalm has quit IRC11:10
*** haleyb_ has joined #openstack-meeting-311:11
*** spzala has joined #openstack-meeting-311:12
*** haleyb_ has quit IRC11:15
*** bapalm has joined #openstack-meeting-311:15
*** spzala has quit IRC11:16
*** mickeys has joined #openstack-meeting-311:25
*** vgridnev has quit IRC11:26
*** mickeys has quit IRC11:29
*** pgadiya has quit IRC11:35
*** gouthamr has quit IRC11:35
*** rossella_s has quit IRC11:37
*** topol has joined #openstack-meeting-311:39
*** claudiub|2 has joined #openstack-meeting-311:44
*** MarkBaker has joined #openstack-meeting-311:50
*** yingjun has joined #openstack-meeting-311:51
*** yingjun has quit IRC11:54
*** yingjun has joined #openstack-meeting-311:54
*** igordcard has quit IRC11:55
*** topol has quit IRC11:56
*** yingjun has quit IRC11:59
*** topol has joined #openstack-meeting-312:05
*** topol has quit IRC12:05
*** huanxuan has quit IRC12:10
*** haleyb_ has joined #openstack-meeting-312:12
*** spzala has joined #openstack-meeting-312:13
*** haleyb_ has quit IRC12:17
*** spzala has quit IRC12:18
*** sdague_ is now known as sdague12:20
*** rtheis has joined #openstack-meeting-312:21
*** mickeys has joined #openstack-meeting-312:25
*** alexismonville has joined #openstack-meeting-312:26
*** mickeys has quit IRC12:30
*** huanxuan has joined #openstack-meeting-312:34
*** topol has joined #openstack-meeting-312:41
*** topol has quit IRC12:41
*** stevemar__ has joined #openstack-meeting-312:46
*** stevemar__ has quit IRC12:50
*** alexismonville has quit IRC12:51
*** srobert has joined #openstack-meeting-312:55
*** srobert has quit IRC12:59
*** srobert has joined #openstack-meeting-312:59
*** ccamacho is now known as ccamacho|lunch13:09
*** haleyb_ has joined #openstack-meeting-313:13
*** spzala has joined #openstack-meeting-313:13
*** egallen has joined #openstack-meeting-313:13
*** haleyb_ has quit IRC13:18
*** spzala has quit IRC13:19
*** jrist has quit IRC13:25
*** mickeys has joined #openstack-meeting-313:26
*** jtomasek has joined #openstack-meeting-313:27
*** tuanluong has quit IRC13:29
*** mickeys has quit IRC13:31
*** jtomasek has quit IRC13:33
*** stevejims has joined #openstack-meeting-313:36
*** stevemar__ has joined #openstack-meeting-313:36
*** tellesnobrega has quit IRC13:36
*** lblanchard has joined #openstack-meeting-313:39
*** yingjun has joined #openstack-meeting-313:43
*** tosky has joined #openstack-meeting-313:45
*** yingjun has quit IRC13:46
*** yingjun has joined #openstack-meeting-313:46
*** spzala has joined #openstack-meeting-313:48
*** vgridnev has joined #openstack-meeting-313:50
*** shuyingya has joined #openstack-meeting-313:51
*** yingjun has quit IRC13:52
*** yingjun has joined #openstack-meeting-313:52
*** stevejims has quit IRC13:56
*** yingjun has quit IRC13:56
*** stevejims has joined #openstack-meeting-313:57
*** esikachev has joined #openstack-meeting-313:58
*** zemuvier has joined #openstack-meeting-313:58
vgridnev#startmeeting sahara14:00
openstackMeeting started Thu Dec  1 14:00:28 2016 UTC and is due to finish in 60 minutes.  The chair is vgridnev. Information about MeetBot at http://wiki.debian.org/MeetBot.14:00
openstackUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.14:00
*** openstack changes topic to " (Meeting topic: sahara)"14:00
openstackThe meeting name has been set to 'sahara'14:00
toskyo/14:00
vgridnevo/14:00
zemuvierhi14:00
vgridnev#link https://wiki.openstack.org/wiki/Meetings/SaharaAgenda14:00
esikachevhi14:01
shuyingyao/14:01
NikitaKonovalovo/14:01
esikachevo/(it will be better)14:02
*** raissa has joined #openstack-meeting-314:02
raissao/14:02
vgridnevanyone else is going to join?14:04
vgridnevegafford, maybe?14:04
*** julim has joined #openstack-meeting-314:04
vgridnev#topic News / updates14:05
*** openstack changes topic to "News / updates (Meeting topic: sahara)"14:05
*** julim has quit IRC14:05
esikachevworking on python3 jobs14:05
*** claudiub|2 has quit IRC14:05
vgridnevokay, what is new folks? seems like we finished transitioning of jobs on xenial, right?14:06
zemuviercontinue working on negative tests for cli14:06
esikachevvgridnev: yep14:06
shuyingyaworking on cleaning  up before and after14:06
toskythe transition seems complete, yes; there is an issue maybe related with it: https://review.openstack.org/#/c/405394/14:07
toskybut let's talk about it later14:07
*** hurgleburgler has joined #openstack-meeting-314:07
toskyon my side, still more on internal work, but I'm keeping more than one eye on reviews and code (like the issue on the stable branches spotted few days ago)14:07
vgridnevI was actually working on squashing several bugs in sahara, helping people to get right direction with working sahara; + was involved a little bit in python3 activities14:08
*** julim has joined #openstack-meeting-314:08
vgridnevtosky, what issue in stable?14:08
*** ccamacho|lunch is now known as ccamacho14:08
*** egafford has joined #openstack-meeting-314:09
egaffordo/14:09
vgridnev\o/14:09
egafford:)14:09
vgridnevegafford, we've just started, sharing updates14:09
toskyvgridnev: https://review.openstack.org/#/q/ca7d2ea213ffb4031f43b95b42275eb03b76c206,n,z , and the changes to force Ubuntu Trusty for older versions on s-i-e for few images14:09
egaffordStatus: Downstream release secure; back upstream like the 6-month-cycle salmon I am. :)14:10
vgridnevtosky, uh, remember that14:10
vgridnevegafford, any progress with publishing first templates for image gen? I remember from summit that Ambari was almost ready14:11
*** tellesnobrega has joined #openstack-meeting-314:12
*** yingjun has joined #openstack-meeting-314:12
egaffordvgridnev: Yup; it's a few patches; need to separate them out to push over the next few days.14:13
vgridnevtellesnobrega, any updates to share?14:13
tellesnobregao/ sorry I`m late14:13
egaffordo/ tellesnobrega. On status now.14:13
vgridnevegafford, cool!14:13
tellesnobreganot much, I wrote the patch on the name check, but will try to get working with regex_search as suggested14:13
*** haleyb_ has joined #openstack-meeting-314:14
tellesnobregaon the storm integration I'm still fight maven build, probably going to take a step back, start a pseud-distributed hadoop and see if works, and move on to a real sahara cluster14:14
tellesnobreganothing else from me on this front14:15
vgridnevuh, forgot. there is a spec on review from me, looks like a pretty straightforward agreement on discussions we did at summit14:16
vgridnev#link https://review.openstack.org/#/c/397242/14:16
egaffordvgridnev: Reviewing right now. :)14:17
tellesnobregaI wasn't at the summit, but it does make sense14:17
*** gouthamr has joined #openstack-meeting-314:17
vgridnev#topic Open discussion14:18
*** openstack changes topic to "Open discussion (Meeting topic: sahara)"14:18
*** srobert has quit IRC14:19
*** haleyb_ has quit IRC14:19
toskyas mentioned before, this review: https://review.openstack.org/#/c/405394/ if passes, should fix the gates (pending investigation why cinder gets crazy)14:19
toskyand also please review the backports for the stable branches; maybe we should release new versions of s-i-e for those versions afterwards14:20
vgridnevso, if someone willing to apply for travel support on PTG, you still have around 1 week to do so.14:20
*** stevejims has quit IRC14:20
vgridnevtosky, ok, I'll take a look stable reviews, about 405394, do we need to back port that as well?14:21
*** jrist has joined #openstack-meeting-314:21
*** gouthamr_ has joined #openstack-meeting-314:22
vgridnevI guess at least for newton, if it's related to xenial14:22
*** huanxuan_ has joined #openstack-meeting-314:22
*** gouthamr has quit IRC14:22
toskyvgridnev: yeah, but I think we would notice it for newton reviews14:23
*** yingjun_ has joined #openstack-meeting-314:23
toskylet's see if it works14:23
*** jtomasek has joined #openstack-meeting-314:23
vgridnevtosky, it fails scenario tests, right?14:23
vgridnevhttps://review.openstack.org/#/c/398951/114:24
toskyyes, it fails when volumes are accessed14:24
vgridnevpassed 3 hours ago14:24
toskyhttp://logs.openstack.org/28/397128/15/check/gate-sahara-tests-dsvm-scenario-neutron-ubuntu-xenial/b128666/logs/screen-c-vol.txt.gz#_2016-12-01_12_52_33_00114:24
toskyuhm14:24
*** huanxuan has quit IRC14:25
vgridnevso, probably there is some change in cinder... that breaks stuff14:25
*** yingjun has quit IRC14:26
*** mickeys has joined #openstack-meeting-314:27
*** huanxuan_ has quit IRC14:27
toskyI don't see changes in cinder that could affect that14:27
*** spzala has quit IRC14:28
*** spzala has joined #openstack-meeting-314:29
vgridnevlet's welcome shuyingya one more time. shuyingya interested in contributing to sahara and I recommended to participate in our meetings.  Let's help to get involved in our project!14:29
NikitaKonovalovshuyingya, welcome14:30
tellesnobregahi shuyingya, welcome14:30
tellesnobregaif you need any help, let us know14:30
shuyingyathanks all14:31
*** mickeys has quit IRC14:32
shuyingyaI am not sure what I can do for sahara, If there are some tasks I can take, that would be great.14:32
*** yingjun has joined #openstack-meeting-314:32
shuyingyaBut the domain knowledge about openstack is limited I think.14:33
toskyoh, shuyingya!14:33
vgridnevshuyingya, if you are interested in some task to complete in sahara, you always can pick up bug without assignee; saying about features, I guess that we can find ongoing activity14:33
*** spzala has quit IRC14:33
vgridnevfor example, I saw, that you was working with cdh plugin, you may probably can help us to support CDH 5.9 which was already released.14:34
*** VW has joined #openstack-meeting-314:34
*** VW has quit IRC14:34
*** gouthamr has joined #openstack-meeting-314:34
tellesnobregaI got matched to mentor someone on the sahara project. Her name is Shaifali Agrawal, and I just got an email confirming that she will be able to participate, so we will probably get more hands to work on Sahara now14:34
*** psachin has quit IRC14:34
vgridnevthat would be a great  contribution14:34
*** VW has joined #openstack-meeting-314:35
vgridnevegafford  has intern as well, right?14:35
*** yingjun_ has quit IRC14:35
tellesnobregayes14:36
egaffordvgridnev: Yup, Marianne is starting in on the task.14:36
tellesnobregamarianne, but she isn't here right now14:36
*** gouthamr_ has quit IRC14:36
tellesnobregaprobably good to let her know of our meeting schedules, so she be a part of it as well14:36
shuyingyanice, I will try to support this issue ^^14:36
egaffordtellesnobrega: I have, but I'll ping her again about them.14:37
*** yingjun has quit IRC14:37
*** ralonsoh_ has joined #openstack-meeting-314:37
*** yingjun has joined #openstack-meeting-314:37
tellesnobregaegafford, cool :) i know you would've already done that14:37
*** ralonsoh has quit IRC14:37
egaffordEh, I sometimes don't do things. See image generation still needing posting. :)14:38
tellesnobregalol14:38
*** ralonsoh_ has quit IRC14:39
*** ralonsoh_ has joined #openstack-meeting-314:39
*** yingjun_ has joined #openstack-meeting-314:40
vgridnevshuyingya, so, if you are willing to contribute cdh 5.9, let me know. Also, it would be helpful if file blueprint to sahara14:40
*** jed56 has joined #openstack-meeting-314:40
vgridnev#link https://blueprints.launchpad.net/sahara14:41
*** yingjun has quit IRC14:41
vgridnevthat will help us to track progress of implementation14:42
vgridnevanything else we can cover today on meeting?14:42
shuyingyaYes, vgridnev. I want to do this. And I will settle down to do it tomorrow^^14:43
vgridnevcool14:43
vgridnevok, seems like we've done. thanks everyone!14:45
vgridnev#endmeeting14:45
*** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings"14:45
openstackMeeting ended Thu Dec  1 14:45:21 2016 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)14:45
openstackMinutes:        http://eavesdrop.openstack.org/meetings/sahara/2016/sahara.2016-12-01-14.00.html14:45
openstackMinutes (text): http://eavesdrop.openstack.org/meetings/sahara/2016/sahara.2016-12-01-14.00.txt14:45
openstackLog:            http://eavesdrop.openstack.org/meetings/sahara/2016/sahara.2016-12-01-14.00.log.html14:45
tellesnobregathanks all14:45
shuyingyathanks14:45
*** esikachev has quit IRC14:47
*** srobert has joined #openstack-meeting-314:47
*** mlavalle has joined #openstack-meeting-314:48
*** xhku_ has quit IRC14:49
*** xhku has joined #openstack-meeting-314:49
*** makowals has quit IRC14:53
*** Dinesh_Bhor has joined #openstack-meeting-314:56
*** tidwellr has joined #openstack-meeting-314:57
*** john-davidge has joined #openstack-meeting-314:59
*** janzian has joined #openstack-meeting-314:59
*** Marcellin__ has joined #openstack-meeting-315:00
mlavalle#startmeeting neutron_l315:00
openstackMeeting started Thu Dec  1 15:00:07 2016 UTC and is due to finish in 60 minutes.  The chair is mlavalle. Information about MeetBot at http://wiki.debian.org/MeetBot.15:00
openstackUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.15:00
*** openstack changes topic to " (Meeting topic: neutron_l3)"15:00
openstackThe meeting name has been set to 'neutron_l3'15:00
*** yingjun_ has left #openstack-meeting-315:00
mlavalleGood morning?15:00
mlavallewho is here for the L3 sub-team meeting?15:00
john-davidgeo/15:00
john-davidgemlavalle: Good morning :)15:01
* tidwellr raises his hand15:01
*** shuyingya has quit IRC15:01
mlavalle#topic Announcements15:01
*** openstack changes topic to "Announcements (Meeting topic: neutron_l3)"15:01
*** baoli has joined #openstack-meeting-315:01
*** matjazp has quit IRC15:02
mlavalleFirst of, Ocata-2 is about 2 weeks away15:02
mlavalle#link https://releases.openstack.org/ocata/schedule.html15:02
* haleyb wanders in late15:03
*** vkmc has left #openstack-meeting-315:03
mlavallePlease note that this cycle is shorter than usual15:03
* mlavalle waves at haleyb15:03
*** rbak has joined #openstack-meeting-315:03
mlavalleSo Ocata-3 will take place on January 23-2715:03
*** makowals has joined #openstack-meeting-315:04
mlavallePlease take this into consideration for your planned deliverables15:04
john-davidgeThese cycles just get shorter and shorter...15:04
mlavalleWell, we are adjusting to the new community gatherings format....15:05
mlavalleso the next annoucement is to remind the team about the Atlanta PTG:15:05
mlavalle#link https://www.openstack.org/ptg/15:05
mlavalleFebruary 20 - 2415:05
mlavalleI understand there is a limit of 500 people for this event15:06
mlavalleAs of last Monday, it was mentioned there was a litle more tan 300 spaces available15:07
mlavalleAnd everybody pays $100 to register15:07
mlavalle336 reamining as of 30 seconds ago :-)15:07
*** stevejims has joined #openstack-meeting-315:08
mlavalleAny other annoucements from the team?15:08
* john-davidge wonders how many people will recieve PTG tickets for Christmas15:08
*** vgridnev has left #openstack-meeting-315:09
mlavalleAll I want for Christmas is a PTG ticket....15:09
haleybI will not be attending, had already planned a vacation the same week, but will help with planning15:09
mlavalle;-(15:09
mlavalleok, let's move on15:09
mlavalle#topic Bugs15:09
*** openstack changes topic to "Bugs (Meeting topic: neutron_l3)"15:09
*** stevejims has quit IRC15:10
mlavalleFirst one is https://bugs.launchpad.net/neutron/+bug/154098315:10
openstackLaunchpad bug 1540983 in OpenStack-Gate "Gate failures for neutron in test_dualnet_multi_prefix_slaac" [Undecided,Expired]15:10
*** tonytan4ever has joined #openstack-meeting-315:11
mlavalleI sepent a good amount of time with this one yesterday15:11
mlavallespent^^^15:11
mlavalleThere were 24 hits over the past 7 days15:11
*** robcresswell has left #openstack-meeting-315:12
*** absubram has quit IRC15:12
mlavalleI went through them. All of them were patches that were failing a lot of other tests, or....15:12
*** zz_dimtruck is now known as dimtruck15:12
*** stevemar__ has quit IRC15:12
mlavallewere failing gate-tempest-dsvm-neutron-linuxbridge-ubuntu-xenial with another 27 tests15:13
mlavalleI have noticed that this job has been problematic over the past few days15:13
haleybmlavalle: probably due to the devstack issue, think it should be fixed but i also saw it fail today15:14
mlavalleIn fact I see that haleyb has been wrestling with it over with this patchset: https://review.openstack.org/#/c/39801615:14
*** esikachev has joined #openstack-meeting-315:14
haleybyes, i was surprised to see the failure, but it was keystone timeout in the logs15:15
mlavalleI have seen it with several other patches over the past few days15:15
mlavallethe same 28 tests failing15:15
*** haleyb_ has joined #openstack-meeting-315:15
haleyblinuxbridge was definitely broken monday and tuesday15:15
mlavalleok, in that case I am going to remove our bug15:16
mlavalleany other comments?15:16
*** egafford has left #openstack-meeting-315:16
mlavallehaleyb: do you know if soeone filed a bug related to that job's failure?15:16
mlavallesomeone^^^^15:16
haleybmlavalle: yes, the change was reverted, armando had sent an email to the list15:17
mlavallehaleyb: do you have it handy?15:17
*** spzala has joined #openstack-meeting-315:18
mlavalleok, let's move on....15:18
haleybi'll look15:18
mlavallehaleyb: I'll look for it, don't worry :-)15:18
mlavalleI asked just in case you had it handy15:19
*** tosky has left #openstack-meeting-315:19
mlavalleNext one is https://bugs.launchpad.net/neutron/+bug/161048315:19
openstackLaunchpad bug 1610483 in neutron "Pluggable IPAM rollback mechanism is not robust" [High,In progress] - Assigned to Aliaksandr Dziarkach (aliaksandr-dziarkach)15:19
mlavalleThere is a fix proposed for this one:15:19
mlavalle#link https://review.openstack.org/#/c/39059415:20
*** haleyb_ has quit IRC15:20
mlavalleI also spent a good chunk of time yesterday reviewing this patchset15:20
mlavallePretty interesting. It uses sqlalchemy events to notify the ipan driver is the port creation failed15:21
mlavalleso ips don't get forgotten15:21
mlavalleGetting up to speed with sqlalchemy events. I intend to finish my review today or tomorrow15:21
*** stevemar has joined #openstack-meeting-315:21
tidwellrI remember that approach being discussed...15:21
tidwellrI'll have a look as well15:22
mlavalletidwellr: I recommend reading through Carl's comments in the bug15:22
mlavalleHe points to an irc conversation that is very enlightening15:22
tidwellrmlavalle: ack15:22
mlavalletidwellr: place special attention to the irc chat15:23
tidwellrwill do15:23
haleybmlavalle: archive pointer for linuxbridge breakage at http://lists.openstack.org/pipermail/openstack-dev/2016-November/108164.html15:23
mlavallehaleyb: I appreciate it!15:24
mlavalleany other comments on this bug15:24
mlavalle?15:24
mlavalleok, next one is:15:25
mlavallehttps://bugs.launchpad.net/neutron/+bug/157012215:25
openstackLaunchpad bug 1570122 in neutron "ipv6 prefix delegated subnets are not accessable external of the router they are attached." [High,Confirmed] - Assigned to John Davidge (john-davidge)15:25
mlavallejohn-davidge: last meeting you asked to be poked about this one :-)15:25
john-davidgemlavalle: I've cleared my calendar to work on this tomorrow and Monday. It *will* get my attention!15:26
mlavallejohn-davidge: thanks!15:26
mlavalleNext one is https://bugs.launchpad.net/neutron/+bug/163696315:27
openstackLaunchpad bug 1636963 in neutron "Service Subnets - DHCP port creation fails" [High,In progress] - Assigned to John Davidge (john-davidge)15:27
*** rajinir has joined #openstack-meeting-315:27
mlavalleI spent sometime on Tuesday pondering this one15:27
john-davidgemlavalle: Updated the patch with a release note as we discussed last time, no reviews since.15:27
mlavallejohn-davidge: yeah I saw that. Thanks for posting the realese notes15:28
*** mickeys has joined #openstack-meeting-315:28
mlavalle#link https://review.openstack.org/#/c/392183/15:28
haleybjohn-davidge: sorry, i need to look15:28
john-davidgehaleyb: No worries, feedback either way appreciated15:28
john-davidgehaleyb: A minus one is just as helpful as a +1 in this case, at least then I have a reason to change the approach15:29
mlavallejohn-davidge: i'll take a look again today and leave my comments15:29
*** stevemar_znc has joined #openstack-meeting-315:29
john-davidgemlavalle: Thanks15:29
*** claudiub|2 has joined #openstack-meeting-315:29
mlavalleTo tell you the truth, at this point I don't see anything wrong with dhcp being an exception15:30
mlavalleany other comments?15:30
*** dimtruck is now known as zz_dimtruck15:31
*** mickeys has quit IRC15:32
mlavalleThe last 2 bugs today are the next in my list after I close the one we discussed at the beginning15:32
mlavalleIf someone is interested in helping with those, please ping me15:33
mlavalleFirst one is https://bugs.launchpad.net/neutron/+bug/162742415:33
openstackLaunchpad bug 1627424 in neutron "FlushError on IPAllocation" [High,Confirmed]15:33
*** mtanino has joined #openstack-meeting-315:33
mlavalleand the other one is https://bugs.launchpad.net/neutron/+bug/162748015:34
openstackLaunchpad bug 1627480 in neutron "create_port can succeed without returning fixed_ips on all requested subnets" [High,Confirmed]15:34
mlavalleI'll tackel them sequentially unless someone wants to help15:34
*** spotz_zzz is now known as spotz15:35
mlavalleany other bugs from the team?15:35
haleybmlavalle: there was a new one, let me find it15:36
haleybhttps://bugs.launchpad.net/bugs/164531715:37
openstackLaunchpad bug 1645317 in neutron "FIP and router iptables are not updated when associated port ip address is changed" [Undecided,Incomplete]15:37
* mlavalle looking15:38
haleybi have not confirmed by testing yet15:38
*** johnbelamaric has joined #openstack-meeting-315:38
mlavallehaleyb: are you going to finish triaging it?15:38
haleybmlavalle: i was going to try, yes15:38
mlavallehaleyb: thanks. If you confirm it, please tag with l3-ipam-dhcp so we can track it :-)15:39
haleybmlavalle: alreay tagged :)15:39
mlavallethanks :-)15:40
mlavalleany other bugs?15:40
*** zz_dimtruck is now known as dimtruck15:40
johnbelamaricdropped in late, did you talk about hte IPAM one?15:40
johnbelamaricmlavalle: oh, i see it in the log15:40
haleybhttps://bugs.launchpad.net/bugs/1645547 is new too, i'll make sure it's tagged15:40
openstackLaunchpad bug 1645547 in neutron "The qrouter namespace can't be removed when l3-agent rebooting." [Undecided,Incomplete] - Assigned to siyingchun (wintersi)15:40
*** singlethink has joined #openstack-meeting-315:41
johnbelamaricyes, we have a proposed fix that's been out there for a while (https://review.openstack.org/#/c/390594/)15:41
mlavallejohnbelamaric: yes, I am slowly reviewing it15:41
johnbelamaricmlavalle: ok, thanks.15:41
mlavalleThanks for posting it. It's just that we are a bit short of hands for now15:41
mlavalleand I had to get up to speed with the sqlalchemy events approach15:42
mlavallejohnbelamaric: tidwellr is also going to take a look at it15:42
mlavallehaleyb: Thanks!15:43
johnbelamaricperfect, thanks. no problem, just wanted to make sure folks knew the review was up15:43
*** esikachev has quit IRC15:43
mlavallejohnbelamaric: it show in Neutron global priorities:15:44
mlavallehttps://review.openstack.org/#/dashboard/?foreach=%28project%3Aopenstack%2Fnetworking%2Dofagent+OR+project%3Aopenstack%2Fnetworking%2Dbgpvpn+OR+project%3Aopenstack%2Fnetworking%2Dovn+OR+project%3Aopenstack%2Fnetworking%2Dmidonet+OR+project%3Aopenstack%2Fnetworking%2Dbagpipe+OR+project%3Aopenstack%2Fneutron%2Dlib+OR+project%3Aopenstack%2Fnetworking%2Dsfc+OR+project%3Aopenstack%2Fpython%2Dneutroncl15:44
mlavalleient+OR+project%3Aopenstack%2Fneutron%2Dspecs+OR+project%3Aopenstack%2Fnetworking%2Dodl+OR+project%3Aopenstack%2Fneutron%2Dfwaas+OR+project%3Aopenstack%2Fneutron+OR+project%3Aopenstack%2Fneutron%2Ddynamic%2Drouting%29+status%3Aopen+NOT+owner%3Aself+NOT+label%3AWorkflow%3C%3D%2D1+NOT+label%3ACode%2DReview%3E%3D%2D2%2Cself+branch%3Amaster&title=Neutron+ocata%2D2+Review+Inbox&Approved+RFE+neutron=%215:44
mlavalle8message%3A1457556+OR+message%3A1458890+OR+message%3A1463784+OR+message%3A1468366+OR+message%3A1492714+OR+message%3A1498987+OR+message%3A1504039+OR+message%3A1507499+OR+message%3A1512666+OR+message%3A1516195+OR+message%3A1520719+OR+message%3A1521291+OR+message%3A1522102+OR+message%3A1523219+OR+message%3A1525059+OR+message%3A1539717+OR+message%3A1541579+OR+message%3A1558812+OR+message%3A1560961+OR15:44
mlavalle+message%3A1561824+OR+message%3A1563967+OR+message%3A1566520+OR+message%3A1577488+OR+message%3A1578989+OR+message%3A1579068+OR+message%3A1580327+OR+message%3A1583184+OR+message%3A1585770+OR+message%3A1586056%29&High+Bugs+neutron=%28message%3A1365461+OR+message%3A1375625+OR+message%3A1403455+OR+message%3A1506567+OR+message%3A1552960+OR+message%3A1555356+OR+message%3A1599936+OR+message%3A1610483+OR15:44
mlavalle+message%3A1614866+OR+message%3A1626010+OR+message%3A1630748+OR+message%3A1634123+OR+message%3A1636963+OR+message%3A1641535+OR+message%3A1644415%29&Blueprints+neutron=%28topic%3Abp%2Fadopt%2Doslo%2Dversioned%2Dobjects%2Dfor%2Ddb+OR+topic%3Abp%2Fneutron%2Dlib+OR+topic%3Abp%2Fonline%2Dupgrades+OR+topic%3Abp%2Fpush%2Dnotifications+OR+topic%3Abp%2Frouted%2Dnetworks+OR+topic%3Abp%2Fenginefacade%2Dswit15:44
mlavallech+OR+topic%3Abp%2Ffwaas%2Dapi%2D2.0+OR+topic%3Abp%2Fl2%2Dapi%2Dextensions+OR+topic%3Abp%2Fneutron%2Din%2Dtree%2Dapi%2Dref+OR+topic%3Abp%2Fsecurity%2Dgroup%2Dlogging+OR+topic%3Abp%2Ftroubleshooting%29&Approved+RFE+python%2Dneutronclient=%28message%3A1457556%29&High+Bugs+python%2Dneutronclient=%28message%3A1549876+OR+message%3A1643849%2915:44
*** raissa has left #openstack-meeting-315:44
mlavallemlavalle: oops sorrey about that15:44
tidwellr:)15:44
johnbelamaricwhew :)15:44
mlavallejohnbelamaric: click on Neutron here and you will see this bug there, so it is definitely not lost: http://status.openstack.org/reviews/15:45
mlavalleany other bugs?15:46
mlavalleok, moving on15:46
*** dims has quit IRC15:46
mlavalle#topic Prefix delegation15:46
*** openstack changes topic to "Prefix delegation (Meeting topic: neutron_l3)"15:46
mlavallebaoli: do you want to give a quick update?15:46
baolimlavalle: I have a patch up and got some comments. Last week I got bogged down by something else, and hasn't been able to address the comments. But I'm I got some time working on it.15:48
mlavallebaoli: any help you need?15:48
baolimalvalle: https://review.openstack.org/#/c/399662/15:48
baolimlavalle: not right now.15:48
mlavallethanks for the update15:48
mlavalle#topic BGP Dynamic Routing15:48
*** openstack changes topic to "BGP Dynamic Routing (Meeting topic: neutron_l3)"15:49
mlavallewelcome back tidwellr .... yaay!15:49
tidwellrgood to be here15:49
tidwellrreal quick, we could use some eyes on https://review.openstack.org/#/c/357722/15:49
tidwellras well as https://review.openstack.org/#/c/372310/15:50
mlavalletidwellr: will take a look. anything else?15:51
tidwellrthat's it today, still re-orienting myself15:51
mlavalleok, glad to see you here. Thanks!15:51
mlavalle#topic Service Subnets15:52
*** openstack changes topic to "Service Subnets (Meeting topic: neutron_l3)"15:52
john-davidgemlavalle: Didn't we take this off the agenda last time?15:52
mlavallejohn-davidge, haleyb: no, we decided to keep it in the agenda for a missing doc15:52
john-davidgeAh, I see15:53
mlavalledo we want to discuss that. If you tell me it is not needed, I'm fine removing it from the agenda15:53
* haleyb picks up rug, sweeps doc under it :)15:53
mlavallehaleyb: LOL15:54
john-davidgeI have nothing to add, if anybody else has something to discuss I'm happy to keep it15:54
john-davidgehaleyb: :D15:54
mlavalleok, let's move on15:54
haleybjohn-davidge: i can copy/paste the slide from the presentation, just need to find the doc15:54
*** elmiko has joined #openstack-meeting-315:55
mlavallehaleyb: yeah, that was the comment last time15:55
john-davidgehaleyb: great15:55
john-davidge:)15:55
mlavalleand after that we close it15:55
haleybmlavalle: yes, i do tend to repeat myself15:55
mlavallehaleyb: I didn't mean that. I was just glad that we have a clear next step :-)15:55
*** MarkBaker has quit IRC15:55
mlavallelet's move one15:56
mlavalle#topic Conversion to Pluggable IPAM15:56
*** openstack changes topic to "Conversion to Pluggable IPAM (Meeting topic: neutron_l3)"15:56
mlavallejohnbelamaric: we have a pending point about an update to the doc15:56
mlavalledo you still plan to do it?15:56
johnbelamaricmlavalle: there is a bug on that for me, right? let me look at it.15:57
*** cdent has joined #openstack-meeting-315:58
mlavallejohnbelamaric: thanks!15:58
mlavalleok, we are at time15:58
mlavalleI am glad I got to review the loose ends15:59
*** numan_ has quit IRC15:59
johnbelamaricmlavalle: I did make some updates to it but it needs another revision probably. I will take care of it or ask someone else here too if I don't have time15:59
mlavallejohnbelamaric: Thanks!15:59
mlavalleHave a nice rest of your day team15:59
mlavalle#endmeeting15:59
*** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings"15:59
openstackMeeting ended Thu Dec  1 15:59:52 2016 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)15:59
openstackMinutes:        http://eavesdrop.openstack.org/meetings/neutron_l3/2016/neutron_l3.2016-12-01-15.00.html15:59
openstackMinutes (text): http://eavesdrop.openstack.org/meetings/neutron_l3/2016/neutron_l3.2016-12-01-15.00.txt15:59
openstackLog:            http://eavesdrop.openstack.org/meetings/neutron_l3/2016/neutron_l3.2016-12-01-15.00.log.html15:59
* cdent waves at mlavalle 16:00
cdent#startmeeting api-wg16:00
openstackMeeting started Thu Dec  1 16:00:14 2016 UTC and is due to finish in 60 minutes.  The chair is cdent. Information about MeetBot at http://wiki.debian.org/MeetBot.16:00
openstackUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.16:00
*** openstack changes topic to " (Meeting topic: api-wg)"16:00
*** john-davidge has quit IRC16:00
openstackThe meeting name has been set to 'api_wg'16:00
mlavallecdent: LOL, you beat me to it16:00
cdent#chair etoews elmiko16:00
openstackCurrent chairs: cdent elmiko etoews16:00
* mlavalle waves at cdent16:00
*** janzian has left #openstack-meeting-316:00
cdent:)16:00
etoewso/16:00
*** dims has joined #openstack-meeting-316:00
*** johnbelamaric has left #openstack-meeting-316:00
elmikohi16:00
cdenthas elmiko returned from16:00
cdentwell there ya go16:01
elmikoi has =)16:01
gouthamrhi o/16:01
cdentedleafe: you about?16:01
*** makowals has quit IRC16:01
*** armax has joined #openstack-meeting-316:01
cdent#link agenda: https://wiki.openstack.org/wiki/Meetings/API-WG#Agenda16:01
edleafeyup16:01
cdent#topic previous meeting action items16:01
*** openstack changes topic to "previous meeting action items (Meeting topic: api-wg)"16:01
cdent#link previous meeting: http://eavesdrop.openstack.org/meetings/api_wg/2016/api_wg.2016-11-17-16.00.html16:01
cdentone agenda item was on edleafe, he did it, made it happen, guideline for nin now under review16:02
cdents/agenda/action/16:02
cdent#topic open mic16:02
*** makowals has joined #openstack-meeting-316:02
*** openstack changes topic to "open mic (Meeting topic: api-wg)"16:02
cdentthere's one listed there, but before we get to that anyone have anything?16:02
*** VW_ has joined #openstack-meeting-316:03
edleafethere are two16:03
edleafeI added one ~30 min ago16:03
*** tidwellr has left #openstack-meeting-316:03
cdentah, awesome16:03
cdentwell let's do your then:16:03
cdent#topic Clarifying use of 400 vs. 40416:04
*** openstack changes topic to "Clarifying use of 400 vs. 404 (Meeting topic: api-wg)"16:04
*** topol has joined #openstack-meeting-316:04
*** VW_ has quit IRC16:04
cdent#link review with conflicting 400 vs 404: https://review.openstack.org/#/c/401941/16:04
*** VW_ has joined #openstack-meeting-316:04
edleafeok, the guideline at https://github.com/openstack/api-wg/blob/master/guidelines/http.rst#id7 is what I'm concerned with16:04
edleafeIt states that if a resource passed in the body of a request isn't found, to return 400, not 404, because 404 means just the URI16:05
edleafeMy concern is that 400 means that the request is malformed or otherwise has bad syntax16:05
*** VW_ has quit IRC16:05
*** VW_ has joined #openstack-meeting-316:06
*** VW has quit IRC16:06
cdent400 is also the "something is wrong and nothing else fits, but you might be able to fix it on your side"16:06
*** VW_ has quit IRC16:06
edleafeI don't agree that a perfectly-formed request that references a resource that doesn't exist should be a 40016:06
*** VW has joined #openstack-meeting-316:06
*** spzala_ has joined #openstack-meeting-316:07
cdentI think I probably wrote the bit you are objecting to (I can't remember for sure). Can you point to the part of the rfc that makes you think otherwise?16:07
*** esikachev has joined #openstack-meeting-316:07
edleafehttps://tools.ietf.org/html/rfc7231#section-6.5.116:07
*** MarkBaker has joined #openstack-meeting-316:08
edleafethe only thing that suggests being a catch-all is "perceived to be"16:08
cdentyeah, that's not the thing, the reason to use 404 is in 6.5.4: "that the origin server did not find a current representation for the target resource"16:08
cdentso 404 is wrong16:08
cdent400 may also be wrong, but it definitely should not be 40416:08
elmiko409 stands out as a possible likely candidate with 40016:09
elmikoalthough, also not perfect16:09
*** yamamoto has joined #openstack-meeting-316:09
*** spzala has quit IRC16:09
etoewsi don't think it's a 40916:09
cdentno, 409 wouldn't be very good oeither16:09
cdentwhich is why we fall back to 400...16:10
elmikoright16:10
edleafeyeah, 409 seems as poor a fit as 40016:10
*** VW has quit IRC16:10
edleafeSo are we stuck with 400, but with a honking good error message?16:11
*** VW has joined #openstack-meeting-316:11
etoewsi think 400 would be okay with a good error message16:11
cdentyeah, pretty much16:11
edleafeDinesh_Bhor: how does that sound to you?16:11
Dinesh_BhorAgree16:11
etoewshas cinder adopted the error message guideline?16:11
*** absubram has joined #openstack-meeting-316:12
edleafeok, I'll re-review with an eye on the error messages16:12
elmikoi like honking good error messages, in general XD16:12
etoewsbeep beep16:12
cdentare honking and stonking the same?16:12
elmikodoesn't seem like it, at the least there are 3 character different16:12
*** yamamot__ has quit IRC16:12
*** stevemar_znc is now known as topol_16:12
* cdent thinks maybe we should send elmiko back16:12
edleafecdent: kindred spirits16:13
elmikooh please do, i fell in love with al Andaluz16:13
cdent:)16:13
cdentSo, is that resolved then?16:13
edleafetopol_: you and stevemar are one and the same??16:14
edleafe:)16:14
* cdent moves on16:14
edleafecdent: Yes, I don't see a better solution16:14
cdent#topic Let's discuss dropping APIImpact as a thing, not only do we not do it, but what it means in commit messages is not the same as how we intended to make use of it?16:14
*** openstack changes topic to "Let's discuss dropping APIImpact as a thing, not only do we not do it, but what it means in commit messages is not the same as how we intended to make use of it? (Meeting topic: api-wg)"16:14
edleafecdent: I'll propose some extra wording to the guideline to clarify16:14
cdentedleafe++16:14
Dinesh_BhorCould someone please comment on the patch so that it will be easy for me to convience cinder community to accept it?16:15
cdentmy reasoning on this is that having something we intend to do but never do and we have a more workable solution anyway just seems like bad form, so we may as well dump it, if we can16:15
cdentThe "if we can" is wondering if we have some kind or charter or otherwise that requires it?16:15
elmikocdent: that is sound reasoning16:15
edleafeDinesh_Bhor: yes, I'll do that16:15
elmikoit's a great aspiration, but we have sadly fallen short16:16
Dinesh_Bhoredleafe: ok, thank you16:16
etoewscdent: do you mean dump it from our meeting or dump it from all of openstack everywhere?16:16
cdentmost of the time human interaction seems to work the best (as today)16:16
*** haleyb_ has joined #openstack-meeting-316:16
cdentetoews: I mean dump it from our meeting, our newsletter, and any other documents we have16:16
edleafeDinesh_Bhor: the question is always "is it worth it", and that you'll have to work out amongst yourselves16:16
Dinesh_Bhoredleafe: yes, I will16:17
cdentas far as I can tell it operates as a signal within each project independent of whatever it means to us16:17
edleafecdent: would there be a way for a patch submitter to indicate that they would like it reviewed by the API WG?16:17
edleafecdent: or do they have to do that with this meeting, or the ML?16:17
cdentright now it seems the ML is the defacto way, with followups here, and that seems to be working?16:18
etoewsafaik and as far as our docs are concerned, i think it's only in https://wiki.openstack.org/wiki/API_Working_Group16:18
cdentthe [api] tag is visible and meaningful16:18
cdentIf we choose to make the change I can take the action to cleanup wiki and anything else16:19
etoewsi agree that [api] on ml and bringing folks into this meeting seems to be working well enough16:19
edleafeetoews: that's the doc I had in mind16:20
*** topol has quit IRC16:20
cdentshould we poll the world or is it okay to decide unilaterally?16:20
*** topol_ is now known as topol16:20
etoewsi don't think we need to poll the world16:20
cdent(me neither)16:20
* cdent looks at elmiko 16:21
edleafebut... what if we accidentally offend someone???16:21
* cdent gives edleafe a cookie16:21
etoewsi don't think we should tell people to stop using it though16:21
cdentwell done16:21
cdentoh yeah, I wasn't suggesting that16:21
*** haleyb_ has quit IRC16:21
etoewskk16:21
elmikohmm16:21
edleafeetoews: we should tell them that it is no longer a bat signal16:21
elmikomaybe follow our normal proceedure, and signal that we will deprecate APIImpact and see if there is a huge backlash?16:22
edleafeIOW, that we are largely ignoring it16:22
cdentthat's already obvious from several months of saying that in the newsletter (every single time)16:22
edleafeAPIImpact has other uses16:22
cdentyes, which is why we're not telling people not to use it, just that it won't mean anything to the api-wg16:23
edleafewe use it in Nova for indicating a need for microversions, release notes, etc.16:23
edleafecdent: exactly. Not the API WG bat signal16:23
* cdent nods16:23
elmikocdent: +116:24
cdentcool, whoever gets the newsletter can say something about that, and also remove that chunk from the newsletter etherpad, I'll do the wiki etc16:24
cdent#action cdent to clean up persistent docs to indicate that APIImpact is no longer an api-wg bat signal, [api] ml tag and agenda are.16:25
cdent#agreed APIImpact is no longer the api-wg bat signal16:26
cdentany other opens?16:26
etoewsi don't think we want to say "deprecate APIImpact"16:26
etoewsthat will give the impression that people should stop using it16:26
cdentyeah, good point etoews16:26
elmikofair16:27
cdentI think "bat signal" is about right, but is too colloquial?16:27
etoewssimply say that we're not actively reviewing apiimpact anymore and to hit us up on the ml with [api]16:27
elmikoshould we change the language in the newsletter to direct folks towards making an email with [api]?16:27
*** stevejims has joined #openstack-meeting-316:27
* cdent buys the jinxers a coke16:27
elmikolol16:27
cdent#topic guidelines16:29
*** openstack changes topic to "guidelines (Meeting topic: api-wg)"16:29
*** tonytan_brb has joined #openstack-meeting-316:29
*** mickeys has joined #openstack-meeting-316:29
cdent#link pending guidelines https://review.openstack.org/#/q/status:open+project:openstack/api-wg,n,z16:29
*** stevejims has left #openstack-meeting-316:29
cdentnin is freezable? https://review.openstack.org/#/c/399131/16:29
cdent(other two not)16:30
edleafenot a lot of controversy, eh?16:30
elmikoseems like it is16:30
cdentedleafe: politics fatigue :)16:30
*** tonytan4ever has quit IRC16:31
cdent"wanna fight about it?" "nah"16:31
elmikohehe16:31
cdentetoews: you wanna freeze that one?16:32
edleafebig whoop16:32
etoewscdent: sure16:32
*** mickeys has quit IRC16:33
cdentnothing is ready to merge16:34
cdent#topic bug review16:34
*** openstack changes topic to "bug review (Meeting topic: api-wg)"16:34
cdentthere are no new bugs16:34
cdentsince elmiko has been away for a while that means he has to do 20 penalty bugs16:35
elmikowow16:35
elmikoso harsh16:35
elmiko=)16:36
edleafeelmiko: yeah, cdent doesn't mess around16:36
elmikoseriously16:36
*** iyamahat has joined #openstack-meeting-316:36
cdentYeah, I'm all about amassing and abusing power.16:37
elmikohahaha16:37
*** MarkBaker has quit IRC16:37
edleafe"You will all bow down before me!!!"16:38
cdent#topic weekly newsletter16:38
*** openstack changes topic to "weekly newsletter (Meeting topic: api-wg)"16:38
*** MarkBaker has joined #openstack-meeting-316:38
cdentis anyone aching to be the newletter editor this week? or shall we work on it together in the next 20 mins?16:38
cdent#link newsletter etherpad: https://etherpad.openstack.org/p/api-wg-newsletter16:39
*** paul-carlton2 has quit IRC16:39
elmikoi'm all for collaboration16:39
cdentsweet, i mean suite16:40
elmikolol16:40
*** mlavalle has left #openstack-meeting-316:42
*** danpawlik has quit IRC16:43
*** numans has joined #openstack-meeting-316:44
*** mickeys has joined #openstack-meeting-316:46
*** aarefiev is now known as aarefiev_afk16:46
edleafePushed the change for the 400v404 thing: https://review.openstack.org/#/c/405515/16:47
*** esikachev has quit IRC16:50
*** yamamoto has quit IRC16:52
*** yamamoto has joined #openstack-meeting-316:52
*** andreas_s has quit IRC16:54
cdenthow's the etherpad seem?16:56
elmikolooking tight on my end16:56
etoews+116:56
cdentI'm having a spelling and grammar brainfart. Is this correct: " led to a proposed" ?16:58
*** VW has quit IRC16:58
elmikothat seems correct to me16:58
etoewssound fine16:58
cdentetoews: did you do the cpl thingie on the frozen guideline?16:59
*** scsnow has quit IRC16:59
etoewsyep.16:59
cdent\o/16:59
cdentperfect timing16:59
cdentthanks everyone16:59
etoewsbefore freezing so they see the frozen comment16:59
cdent#endmeeting17:00
*** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings"17:00
openstackMeeting ended Thu Dec  1 17:00:35 2016 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)17:00
openstackMinutes:        http://eavesdrop.openstack.org/meetings/api_wg/2016/api_wg.2016-12-01-16.00.html17:00
openstackMinutes (text): http://eavesdrop.openstack.org/meetings/api_wg/2016/api_wg.2016-12-01-16.00.txt17:00
openstackLog:            http://eavesdrop.openstack.org/meetings/api_wg/2016/api_wg.2016-12-01-16.00.log.html17:00
*** yamamoto has quit IRC17:00
elmikothanks all!17:00
*** cdent has left #openstack-meeting-317:01
*** elmiko has left #openstack-meeting-317:02
*** matrohon has quit IRC17:02
*** igordcard has joined #openstack-meeting-317:03
*** VW has joined #openstack-meeting-317:05
*** galstrom_zzz is now known as galstrom17:05
*** s3wong has joined #openstack-meeting-317:10
*** Swami has joined #openstack-meeting-317:10
*** MarkBaker has quit IRC17:11
*** slaweq_ has quit IRC17:12
*** iyamahat has quit IRC17:15
*** esikachev has joined #openstack-meeting-317:16
*** haleyb_ has joined #openstack-meeting-317:17
*** gabriel-bezerra has quit IRC17:19
*** gabriel-bezerra has joined #openstack-meeting-317:21
*** haleyb_ has quit IRC17:23
*** slaweq_ has joined #openstack-meeting-317:24
*** VW has quit IRC17:25
*** VW has joined #openstack-meeting-317:25
*** ibmko has quit IRC17:27
*** s3wong has quit IRC17:28
*** kzaitsev_mb has quit IRC17:29
*** spzala_ has quit IRC17:33
*** s3wong has joined #openstack-meeting-317:37
*** piet has joined #openstack-meeting-317:40
*** paul-carlton2 has joined #openstack-meeting-317:42
*** slaweq_ has quit IRC17:48
*** bpokorny has joined #openstack-meeting-317:50
*** tbachman has joined #openstack-meeting-317:50
*** iyamahat has joined #openstack-meeting-317:51
*** esikachev has quit IRC17:51
*** bpokorny has quit IRC17:52
*** SumitNaiksatam has joined #openstack-meeting-317:52
*** bpokorny has joined #openstack-meeting-317:53
*** paul-carlton2 has quit IRC17:55
*** claudiub|2 has quit IRC17:56
*** paul-carlton2 has joined #openstack-meeting-317:57
*** bpokorny has quit IRC17:57
*** bpokorny has joined #openstack-meeting-317:58
SumitNaiksatamtbachman: hi18:00
tbachmanSumitNaiksatam: hi!18:00
*** rkukura has joined #openstack-meeting-318:00
*** gugl has joined #openstack-meeting-318:01
rkukurahi  - sorry I’m late18:01
SumitNaiksatamrkukura: np, not started yet :-)18:01
SumitNaiksatam#startmeeting networking_policy18:02
openstackMeeting started Thu Dec  1 18:02:04 2016 UTC and is due to finish in 60 minutes.  The chair is SumitNaiksatam. Information about MeetBot at http://wiki.debian.org/MeetBot.18:02
openstackUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.18:02
*** openstack changes topic to " (Meeting topic: networking_policy)"18:02
openstackThe meeting name has been set to 'networking_policy'18:02
*** VW_ has joined #openstack-meeting-318:02
*** bpokorny has quit IRC18:02
SumitNaiksatam#topic Remove expunge_all calls18:02
*** openstack changes topic to "Remove expunge_all calls (Meeting topic: networking_policy)"18:02
*** s3wong has quit IRC18:02
SumitNaiksatam#link https://review.openstack.org/#/c/399772/18:03
SumitNaiksatamas discussed before, tbachman had been working on this18:03
SumitNaiksatamthanks tbachman!18:03
tbachmanSumitNaiksatam: np!18:03
tbachmanjust wish I’d had a bit more time on it18:03
SumitNaiksatamwe noticed consistent gate failures in the integration tests18:03
SumitNaiksatamthese were in the nfp-nv job18:03
SumitNaiksatamand we have been trying to see if the failures are on account of the changes in this patch or if they are not related18:04
SumitNaiksatamwe had reached out to osm and his team18:04
SumitNaiksatamto get their take on this18:04
SumitNaiksatamosm -> songole18:04
SumitNaiksatami just pinged him in case he can join18:04
*** baoli has quit IRC18:05
SumitNaiksatami am just trying to pull the email which had their analysis on this18:05
*** baoli has joined #openstack-meeting-318:05
*** VW has quit IRC18:05
SumitNaiksatamthey have pointed to this particular log: #link http://logs.openstack.org/72/399772/2/check/gate-group-based-policy-dsvm-nfp-nv/f3cb8b0/logs/q-svc.txt.gz?level=ERROR18:06
*** VW_ has quit IRC18:07
*** bpokorny has joined #openstack-meeting-318:07
*** songole has joined #openstack-meeting-318:07
SumitNaiksatamthe above log is slightly different from the ones that we were observing earlier18:07
*** rarcea_ has quit IRC18:07
SumitNaiksatamslightly -> the error is completely different18:07
SumitNaiksatamsongole: hi, thanks for joining18:08
songolehi SumitNaiksatam18:08
SumitNaiksatamsongole: thanks to you and your team for investigating the issue with the “removal of expunge_all” patch18:08
SumitNaiksatamwe are just discussing how we should process from where we are at18:08
SumitNaiksatamsongole: this error which KCS pointed to: #link http://logs.openstack.org/72/399772/2/check/gate-group-based-policy-dsvm-nfp-nv/f3cb8b0/logs/q-svc.txt.gz?level=ERROR18:09
*** yamahata has joined #openstack-meeting-318:09
SumitNaiksatamare you seeing it only in the “expunge_all” patch or are you seeing it anywhere else?18:09
SumitNaiksatameven if sporadic18:10
songolewe are not seeing it anywhere else18:10
SumitNaiksatamsongole: ah bummer18:10
SumitNaiksatami think we all agree that we should get rid of the “expunge_all” calls (let me know if anyone disagrees)18:11
* tbachman wonders if ivar_lazarro is around18:11
SumitNaiksatamhowever we have not had a single clean run in the jobs after removing the calls18:11
SumitNaiksatamso i would like check in the team if anyone has ideas on how we can make progress here18:12
tbachmanSumitNaiksatam: it feels to me like there is more than one context (thread kind of context) using the same session18:12
SumitNaiksatamat this point its the nfp-nv gate job which is consistently failing18:12
SumitNaiksatamnot others18:12
songolenfp tests are failing. but they are failing in resource-mapping driver. is that right?18:12
tbachmanwhich I don’t think is how the sessions are meant to be used18:12
tbachman(i.e. they are supposed to be used as a session per thread)18:13
tbachmanI unfortunately haven’t managed to find the time to look into this more of late18:13
SumitNaiksatamsongole: yes, but my observation has been that has been more than one error that has been noticed18:13
SumitNaiksatamtbachman: thats my understanding too18:13
*** ralonsoh_ has quit IRC18:13
SumitNaiksatamtbachman: since you mention that, there is some new thread creation in the nfp code18:14
songoletbachman: nfp uses multiple threads and processes.18:14
SumitNaiksatamwonder if that has something to do with this, and was not getting triggered earlier since we were doing this expunge_all18:14
*** Patifa has joined #openstack-meeting-318:14
tbachmansongole: as long as they don’t reuse session objects between threads, they should be okay18:14
songoletbachman: I will check how it is being used.18:15
SumitNaiksatamtbachman: i dont think that is being intentionally done, but...18:15
SumitNaiksatami mean its difficult to figure out18:15
tbachmanJust some background on this18:15
SumitNaiksatamwhere a session might be getting leaked in that way18:15
rkukuratbachman: passing DB model objects between threads would also be sharing the session they came from, right?18:15
tbachmanDuring our integration with a different L3 plugin, we started seeing some failures18:15
*** matjazp has joined #openstack-meeting-318:15
tbachmanrkukura: I’d have to check how SQLAlchemy ties DB objects to sessions18:16
tbachmanbut very possibly yes18:16
tbachmancontinuing the explanation of the failures — we started seeing DetatchedInstanceError exceptions18:16
SumitNaiksatamrkukura: hmmm, i think you would have to explicitly get a reference to the session from those objects18:17
tbachmandue to DB objects used outside of sessions accessing backrefs to other objects in the DB18:17
SumitNaiksatamrkukura: and i am not sure that is being done18:17
tbachmanThe weird thing was that we didn’t see these errors before18:17
SumitNaiksatamtbachman: right18:17
tbachmanImplying that something changed18:17
SumitNaiksatamtbachman: and it being used in many places in neutron18:17
tbachmanAnd the thought is that change was in some transitive dependency18:18
SumitNaiksatamand it doesnt seem to fail anywhere else18:18
tbachmanSumitNaiksatam: ack18:18
SumitNaiksatami believe we are the only ones doing these expunge_all calls, and hence its likely to break that neutron usage pattern even in the future18:18
tbachmanDuring the process of debugging this failure, I found that the exceptions went away if I removed the cll to expunge18:19
* tbachman nods18:19
tbachmanIn any case, rkukura brought up the valid question as to why the expunges were needed in the first place18:19
rkukuraSumitNaiksatam: I think any attempt to update or delete a DB object, or to follow an association, can involve the session it game from18:19
tbachmanAnd the expunges have been in there for over a year (I think something like August of 2015?)18:20
rkukuras/game/came/18:20
*** krtaylor has quit IRC18:20
SumitNaiksatamrkukura: i am not sure about that (in the way its being used in the places where tbachman describes it)18:20
tbachmanSo, when I got back to this, my plan was to try to understand why we needed the expunges18:20
*** gugl has quit IRC18:21
*** gugl has joined #openstack-meeting-318:21
*** gugl has quit IRC18:21
tbachmanMy hope is that if we can find the reason for the expunges, we may be able to address the original issue (provided it still exists)18:21
*** gugl has joined #openstack-meeting-318:21
SumitNaiksatamrkukura: clarification, i dont think the places which tbachman is looking at, does not do an update/delete (tbachman correct me if i am wrong), it merely access a property of that db object18:21
SumitNaiksatam*accesses18:21
tbachmanSumitNaiksatam: ack18:22
tbachmanthough I’d have to check18:22
SumitNaiksatamsorry, two negatives in that sentence18:22
tbachmanthis “pattern” is used in that L3 plugin pretty pervasively18:22
songoletbachman: we seem to share db session across threads. Are you saying each thread should have its own session?18:22
* tbachman followed what SumitNaiksatam was saying ;)18:22
tbachmansongole: ack18:22
SumitNaiksatamtbachman: :-)18:22
tbachmanlet me pull up the SQLAlchemy ref18:22
rkukuraWe’d also want to check the multithreaded NFP code18:22
tbachman#info http://docs.sqlalchemy.org/en/latest/orm/session_basics.html18:23
tbachman#link http://docs.sqlalchemy.org/en/latest/orm/session_basics.html18:23
tbachmansongole: ^^^18:23
tbachmanlook for the section that says “Is the session thread-safe?”18:23
tbachman“The Session is very much intended to be used in a non-concurrent fashion, which usually means in only one thread at a time."18:23
*** yamahata has quit IRC18:24
songolegot it.18:24
SumitNaiksatamtbachman: thanks for pulling that up, very helpful!18:24
tbachmansongole: that said, Im not sure it’s just an issue for NFP :(18:24
tbachmanSumitNaiksatam: np!18:24
tbachmanI need to spend some time understanding the overall threading models in GBP18:25
SumitNaiksatami do think how its shared between the thread matters18:25
SumitNaiksatamthe -> it18:25
*** VW has joined #openstack-meeting-318:26
SumitNaiksatamat the simplest level, if same session is used for servicing two different API calls concurrently, its definitely not a good thing18:26
SumitNaiksatamright?18:26
tbachmanSumitNaiksatam: ack, but we don’t have any way of ensuring this isn’t used incorrectly (other than some form of policy/best practices)18:26
tbachmanSumitNaiksatam: ack18:26
tbachman(or at least according to the text)18:26
songoletbachman: now that we got some clues, we will investigate further18:26
SumitNaiksatamtbachman: very true, its going to be really difficult to find that out18:26
tbachmansongole: cool. Thanks!18:26
SumitNaiksatamsongole: ah cool18:26
*** yamahata has joined #openstack-meeting-318:26
SumitNaiksatamsongole:  thanks for offerint to do that, i was going to ask18:26
SumitNaiksatami do think that if we have to include this change in the upcoming releases we have to be able to get it in fairly soon18:27
SumitNaiksatamsince, we need to do be able to run through several QA cycles (outside of the upstream gate)18:28
SumitNaiksatamso this becomes time sensitive and critical in that sense18:28
SumitNaiksatami am inclined to merge this patch, if we see three gate runs on this patch without any failures18:29
rkukuraOne question on the details of the patch…18:29
SumitNaiksatamperhaps that is not going to happen without some more code changes (and we might get a better idea after songole’s investigation)18:29
SumitNaiksatamrkukura: sure18:29
rkukuraIt basically turns clean_session into a no-op contextmanaget. Should the patch remove all uses of clean_session, or should that be done later?18:30
rkukuras/contextmanaget/contextmanager/18:30
*** VW has quit IRC18:30
tbachmanrkukura: that would be more comprehensive, and be best going forward.18:30
SumitNaiksatamrkukura: yes18:31
tbachmanI can rework it for that, but I need some time to get back to it18:31
songolecould someone help me understand what this expunge is all about.. :)18:31
SumitNaiksatamrkukura: it does not necessarily have to be this patch18:31
tbachmansongole: I can help there18:31
SumitNaiksatamrkukura: the bigger change would be more mechanical once we know that removing the calls works18:31
rkukuraSumitNaiksatam: I agree phasing this might make sense, especially if we are not 100% certain we can live without the expunging18:31
SumitNaiksatamrkukura: right18:31
SumitNaiksatamotherwise we can put it back18:32
SumitNaiksatamjust one line :-)18:32
tbachmanobjects that have representation in the DB can have different states18:32
tbachmanthere is a session, which sort of acts like a cache of DB objects18:32
tbachmanso, if you’ve read a DB object, it keeps track of it in the session18:32
tbachmanif you do an expunge, you disassociate the object with the session18:33
tbachmanyou can continue to use the object, but if you need any additional DB lookups (e.g. if the object has a backref to another DB object), then you’ll get an exception18:33
tbachmanb/c the object is no longer associated with a session18:33
tbachmanthe expunge basically removes all DB object state associated with a given session18:34
tbachmanmaking it a “clean” session18:34
tbachmanto get new dB objects and their state18:34
songoletbachman: thanks18:34
tbachmansongole: np!18:34
SumitNaiksatamtbachman: yes, very nice summary18:34
SumitNaiksatamalso to keep in context, we did this since there was a UT which kept failing consistently18:35
SumitNaiksatamand no one could figure out how to fix this18:35
songoleto access object it again, do i need to get a new session?18:35
SumitNaiksatamivar tried this approach and it worked18:35
rkukuraOnce the session is expunged, the DB objects still exist in memory, but trying to use them in ways that involve the DB will cause exceptions, such as ObjectDeletedError: Instance '<ServicePolicyPTGIpAddressMapping at 0x7f5d9e726dd0>' has been deleted, or its row is otherwise not present.18:35
tbachmansongole: once you’ve expunged it, yes you need a new session18:35
SumitNaiksatamits been with us since18:35
songoleok. thanks18:36
SumitNaiksatamthere is also some eventlet related interplay here18:36
tbachmanhere’s the original bug ID:18:36
tbachman#link https://bugs.launchpad.net/group-based-policy/+bug/140441218:36
openstackLaunchpad bug 1404412 in Group Based Policy "Session's persistent objects across transactions create inconsistency" [High,Fix released] - Assigned to Ivar Lazzaro (mmaleckk)18:36
tbachmanand here’s hte original patch:18:37
tbachman#link https://github.com/openstack/group-based-policy/commit/2c8b401b8e0432bba4f7ae089883b36d760f733c18:37
SumitNaiksatami was pointing thomas (and songole) to a comment in the oslo db code, which recommended putting things always inside a transaction18:37
SumitNaiksatamtbachman: thanks18:37
SumitNaiksatami dont think we would have the luxury to make that kind of a change in other projects18:38
tbachmanHere’s that same one in gerrit18:38
SumitNaiksatambut if needed we can do that in our project?18:38
tbachman#link https://review.openstack.org/#/c/213362/18:38
SumitNaiksatamfor instance in the places where its currently failing (the one which rkukura mentioned above)18:38
* tbachman realizes he should put some context in the chat line when he uses a link18:39
songoleif a different node updates the object, would there be a problem with this caching mechanism?18:40
rkukuraActually, the ObjectDeletedError above (from the log earlier this meeting) may not be directly due to the object having been expunged. I’ve seen other errors that clearly do mention the object being expunged, such as when trying to follow an association.18:40
tbachmansongole: you mean if a different context updates an object read from the DB?18:40
songoleyes18:41
tbachmansongole: in the expunged case18:41
tbachman?18:41
rkukuraIn my mind, the only safe pattern is to start a transaction using a session, do everything inside that transaction, and do not access the DB objects after the transaction is committed or rolled back.18:41
tbachmanrkukura: ack18:41
songoleok18:42
tbachmanit seems like that’s the intent. You *can* use it outside of a transaction, but that seems to open you up to other issues (e.g. like the kind we’re seeing)18:42
tbachmanthat said — there’s *a lot* of code to change in that L3 plugin, if that’s the case :(18:42
tbachmannot saying that shouldn’t be the solution18:42
tbachmanjust pointing it out ;)18:42
songoleeven nfp as well18:43
rkukuraIf there is a real need to use a DB object after the transaction ends, I think there is a way to disassociate the DB object from the session, making it just lake a new model class instance for which add() was never called.18:43
tbachmannote that using it inside of a transaction still doesn’t solve a threading issue with sessions18:43
tbachmanso, it seems like 2 things need fixing18:43
*** ccamacho has quit IRC18:44
*** VW has joined #openstack-meeting-318:45
SumitNaiksatamtbachman: right18:45
SumitNaiksatamrkukura: wrapping in a transaction is the change i was earlier referring, but which do not have the luxury of changing outside our project18:45
tbachman<cough, cough> monkey-patch <cough, cough>18:46
tbachmanwhat?18:46
SumitNaiksatamand like tbachman pointed out, there are several places across neutron and its sub-projects where that pattern is used18:46
SumitNaiksatamand breakage in those places is likely to unexpectedly manifest until we have these expunge_all calls18:47
SumitNaiksatamsongole had earlier run into the same issue with lbaas code18:48
tbachmanSumitNaiksatam: I think we just need to spend some time first investigating this some more18:48
tbachmanto get more info about the problem18:48
tbachmanI hope to be able to do that in the near-ish future18:48
tbachmanand if songole or others are able to have a look as well, hopefully we can discover the root-cause18:48
tbachman(together)18:49
SumitNaiksatamtbachman: the predicament is that we are sitting on a time-bomb while we have this expunge-all call in place18:49
tbachmanSumitNaiksatam: ack18:49
SumitNaiksatamand if we agree that is the case, then removing it asap would make sense, so that we can test well after we remove it (repeating myself)18:49
SumitNaiksatamand we dont have enought time left for that18:50
SumitNaiksatamassuming we dont do this soon18:50
SumitNaiksatamtbachman: your plan is reasonable and the only option we have i guess18:51
SumitNaiksatamtbachman, songole: in terms of time frame, how should we budget this?18:51
tbachmanSumitNaiksatam: a week (i.e. next week’s meeting)?18:51
SumitNaiksatamtbachman: right, that seems like the earliest18:52
songoleack18:52
songolelooks like I was wrong on the sharing observation.. but, i will check more18:52
SumitNaiksatamsongole: is it possible to get any additional data points outside of the upstream gate tests by removing the expunge_all calls?18:52
songoleSumitNaiksatam: we will test the patch locally..18:53
SumitNaiksatamsongole: okay thanks18:53
*** paul-carlton2 has quit IRC18:53
SumitNaiksatamanother way to look at this is assume that the expunge_all call never existed18:54
SumitNaiksatamand any error we run into (in our code) without it being present is an issue we need to fix18:54
*** baoli has quit IRC18:54
SumitNaiksatamthe first thing that can be attempted in such places is to wrap things in a subtranscation (once the appropriate place is identified)18:54
SumitNaiksatamif sharing session between threads is an issue, that would be much more difficult to diagnose, but i am hoping thats not the case18:55
SumitNaiksatamtbachman: songole: rkukura: thanks for the input and discussion on this18:56
tbachmanSumitNaiksatam: np!18:56
SumitNaiksatamtbachman definitely deserves a big pat of the bag for the several days he has put into this18:56
SumitNaiksatammore than a pat on the back18:56
* tbachman likes pat on the bags18:56
tbachman:-o18:56
tbachman#redact18:57
SumitNaiksatamand its kind of a coincidence that songole hit the issue with the lbaas code just about at the same time that tbachman ran into this (a little before)18:57
*** s3wong has joined #openstack-meeting-318:57
SumitNaiksatambag -> back (typo, my bad)18:57
tbachmanlol18:57
SumitNaiksatam#topic Open Discussion18:58
*** openstack changes topic to "Open Discussion (Meeting topic: networking_policy)"18:58
tbachmanSumitNaiksatam: glad to work on this. Just sorry I didn’t resolve it yet18:58
SumitNaiksatamtbachman: no need to apologixe :-)18:58
SumitNaiksatamwe have still not been able to merge igordcard’s patch:18:58
SumitNaiksatam#link https://review.openstack.org/#/c/30170118:59
SumitNaiksatamits failing the nfp gate but i am not sure its relevant18:59
SumitNaiksatamon that branch18:59
SumitNaiksatamrkukura: shall we merge this patch now?18:59
SumitNaiksatamoh we are out of time19:00
SumitNaiksatamwill take this off this channel19:00
SumitNaiksatamthanks all, bye!19:00
SumitNaiksatam#endmeeting19:00
*** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings"19:00
openstackMeeting ended Thu Dec  1 19:00:20 2016 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)19:00
openstackMinutes:        http://eavesdrop.openstack.org/meetings/networking_policy/2016/networking_policy.2016-12-01-18.02.html19:00
openstackMinutes (text): http://eavesdrop.openstack.org/meetings/networking_policy/2016/networking_policy.2016-12-01-18.02.txt19:00
rkukurabye19:00
openstackLog:            http://eavesdrop.openstack.org/meetings/networking_policy/2016/networking_policy.2016-12-01-18.02.log.html19:00
songolebye19:00
tbachmanSumitNaiksatam: thx!19:01
*** tbachman has left #openstack-meeting-319:01
*** caboucha has joined #openstack-meeting-319:02
*** esikachev has joined #openstack-meeting-319:03
*** rkukura has left #openstack-meeting-319:03
*** baoli has joined #openstack-meeting-319:09
*** singleth_ has joined #openstack-meeting-319:10
*** sambetts is now known as sambetts|afk19:10
*** singlethink has quit IRC19:13
*** tellesnobrega has quit IRC19:22
*** spzala has joined #openstack-meeting-319:23
*** matrohon has joined #openstack-meeting-319:26
*** spzala has quit IRC19:26
*** Rockyg has joined #openstack-meeting-319:26
*** Rocky_g has joined #openstack-meeting-319:27
*** spzala has joined #openstack-meeting-319:27
*** spotz is now known as spotz_zzz19:28
*** david-lyle_ has joined #openstack-meeting-319:28
*** gugl has quit IRC19:29
*** Rocky_g has quit IRC19:30
*** david-lyle has quit IRC19:31
*** krtaylor has joined #openstack-meeting-319:40
*** bknudson has left #openstack-meeting-319:46
*** jed56 has quit IRC19:47
*** spzala has quit IRC19:50
*** VW has quit IRC19:54
*** baoli has quit IRC19:54
*** caboucha_ has joined #openstack-meeting-319:56
*** spzala has joined #openstack-meeting-319:56
*** bpokorny has quit IRC19:56
*** bpokorny has joined #openstack-meeting-319:57
*** caboucha has quit IRC19:59
*** baoli has joined #openstack-meeting-320:00
*** spzala has quit IRC20:01
*** david-lyle_ is now known as david-lyle20:01
*** bpokorny has quit IRC20:01
*** spzala has joined #openstack-meeting-320:08
*** kzaitsev_mb has joined #openstack-meeting-320:10
*** SumitNaiksatam has left #openstack-meeting-320:11
*** bknudson has joined #openstack-meeting-320:12
*** egallen_ has joined #openstack-meeting-320:12
*** spzala has quit IRC20:12
*** egallen has quit IRC20:12
*** egallen_ is now known as egallen20:12
*** spzala has joined #openstack-meeting-320:14
*** spzala has quit IRC20:18
*** mickeys has quit IRC20:21
*** spzala has joined #openstack-meeting-320:31
*** songole has quit IRC20:34
*** matrohon has quit IRC20:34
*** MarkBaker has joined #openstack-meeting-320:35
*** spzala has quit IRC20:35
*** kzaitsev1mb has joined #openstack-meeting-320:37
*** kzaitsev_mb has quit IRC20:37
*** openstack has joined #openstack-meeting-320:45
*** ChanServ sets mode: +o openstack20:45
*** spzala has quit IRC20:47
*** spzala has joined #openstack-meeting-320:49
*** kzaitsev1mb has quit IRC20:51
*** lpetrut has joined #openstack-meeting-320:52
*** ibmko has joined #openstack-meeting-320:52
*** loquacities has left #openstack-meeting-320:53
*** spzala has quit IRC20:53
*** spzala has joined #openstack-meeting-320:55
*** spotz_zzz is now known as spotz20:55
*** lblanchard has quit IRC20:57
*** bpokorny has joined #openstack-meeting-320:58
*** lpetrut has quit IRC20:58
*** esikachev has quit IRC20:59
*** spzala has quit IRC20:59
*** matjazp has quit IRC21:00
*** rtheis has quit IRC21:09
*** bpokorny has quit IRC21:09
*** bpokorny has joined #openstack-meeting-321:10
*** spzala has joined #openstack-meeting-321:10
*** bpokorny has quit IRC21:12
*** bpokorny has joined #openstack-meeting-321:13
*** mickeys has joined #openstack-meeting-321:16
*** tonytan4ever has joined #openstack-meeting-321:27
*** bpokorny has quit IRC21:28
*** bpokorny has joined #openstack-meeting-321:28
*** tonytan_brb has quit IRC21:29
*** VW has joined #openstack-meeting-321:31
*** galstrom is now known as galstrom_zzz21:32
*** bpokorny has quit IRC21:32
*** galstrom_zzz is now known as galstrom21:33
*** bpokorny has joined #openstack-meeting-321:35
*** loquacities has joined #openstack-meeting-321:41
*** dimtruck is now known as zz_dimtruck21:41
*** MarkBaker has quit IRC21:47
*** jtomasek has quit IRC21:48
*** jrist has quit IRC21:49
*** spzala has quit IRC21:52
*** baoli has quit IRC21:53
*** tonytan4ever has quit IRC21:55
*** matjazp has joined #openstack-meeting-321:55
*** tonytan4ever has joined #openstack-meeting-321:56
*** krtaylor has quit IRC21:56
*** julim has quit IRC22:03
*** kzaitsev_mb has joined #openstack-meeting-322:07
*** galstrom is now known as galstrom_zzz22:10
*** claudiub|2 has joined #openstack-meeting-322:15
*** gouthamr has quit IRC22:17
*** MarkBaker has joined #openstack-meeting-322:17
*** liangy has joined #openstack-meeting-322:21
*** haleyb_ has joined #openstack-meeting-322:27
*** caboucha_ has quit IRC22:30
*** spotz is now known as spotz_zzz22:35
*** MarkBaker has quit IRC22:39
*** liangy has quit IRC22:40
*** baoli has joined #openstack-meeting-322:40
*** bpokorny has quit IRC22:40
*** bpokorny has joined #openstack-meeting-322:41
*** baoli has quit IRC22:42
*** krtaylor has joined #openstack-meeting-322:42
*** srobert_ has joined #openstack-meeting-322:42
*** baoli has joined #openstack-meeting-322:42
*** liangy has joined #openstack-meeting-322:43
*** loquacities has left #openstack-meeting-322:43
*** bpokorny has quit IRC22:44
*** bpokorny has joined #openstack-meeting-322:44
*** srobert has quit IRC22:46
*** rajinir has quit IRC22:46
*** srobert_ has quit IRC22:46
*** mickeys has quit IRC22:59
*** Swami has quit IRC23:00
*** haleyb_ has quit IRC23:00
*** VW has quit IRC23:00
*** tonytan4ever has quit IRC23:11
*** iyamahat_ has joined #openstack-meeting-323:17
*** iyamahat has quit IRC23:17
*** VW has joined #openstack-meeting-323:18
*** absubram has quit IRC23:22
*** emagana has joined #openstack-meeting-323:22
*** VW has quit IRC23:22
*** egallen has quit IRC23:34
*** VW has joined #openstack-meeting-323:35
*** piet has quit IRC23:38
*** singleth_ has quit IRC23:41
*** Swami has joined #openstack-meeting-323:43
*** rbak has quit IRC23:44
*** VW has quit IRC23:45
*** bpokorny has quit IRC23:49
*** bpokorny has joined #openstack-meeting-323:50
*** bpokorny has quit IRC23:54
*** bpokorny has joined #openstack-meeting-323:54

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!