Tuesday, 2017-09-19

*** lakerzhou has quit IRC00:04
*** oanson has quit IRC00:08
*** oanson has joined #openstack-meeting00:09
*** csomerville has quit IRC00:13
*** edmondsw has quit IRC00:22
*** thorst has joined #openstack-meeting00:26
*** Nel1x has joined #openstack-meeting00:29
*** sshank has quit IRC00:29
*** rossella_s has quit IRC00:29
*** gcb has joined #openstack-meeting00:30
*** Swami has quit IRC00:30
*** beekhof has joined #openstack-meeting00:32
*** rossella_s has joined #openstack-meeting00:32
*** rossella_s has quit IRC00:37
*** rossella_s has joined #openstack-meeting00:39
*** tovin07_ has joined #openstack-meeting00:41
*** litao__ has joined #openstack-meeting00:44
*** wanghao_ has quit IRC00:44
*** wanghao has joined #openstack-meeting00:45
*** edmondsw has joined #openstack-meeting00:46
*** dmacpher has quit IRC00:47
*** wanghao_ has joined #openstack-meeting00:48
*** wanghao has quit IRC00:49
*** edmondsw has quit IRC00:50
*** caowei has joined #openstack-meeting00:53
*** julim has joined #openstack-meeting00:53
*** YanXing_an has joined #openstack-meeting00:55
*** hoangcx has left #openstack-meeting00:58
*** lakerzhou has joined #openstack-meeting00:58
*** lakerzhou1 has joined #openstack-meeting01:01
*** lakerzhou has quit IRC01:04
*** kiennt has joined #openstack-meeting01:08
*** aeng_ has joined #openstack-meeting01:08
*** aeng has quit IRC01:08
*** lhx__ has quit IRC01:08
*** Sukhdev has quit IRC01:12
*** JudeC has quit IRC01:15
*** Apoorva_ has joined #openstack-meeting01:17
*** Apoorva has quit IRC01:20
*** rtjure has quit IRC01:21
*** Apoorva_ has quit IRC01:21
*** apetrich has quit IRC01:23
*** apetrich has joined #openstack-meeting01:25
*** rtjure has joined #openstack-meeting01:26
*** thorst has quit IRC01:27
*** yamahata has quit IRC01:29
*** donghao has joined #openstack-meeting01:29
*** yangyapeng has joined #openstack-meeting01:31
*** dmacpher has joined #openstack-meeting01:37
*** liyi has joined #openstack-meeting01:41
liyi:senlin01:41
*** liyi has left #openstack-meeting01:41
*** chyka_ has joined #openstack-meeting01:43
*** chyka has quit IRC01:43
*** YanXing_an has quit IRC01:47
*** longkb has joined #openstack-meeting01:51
*** ijw has quit IRC01:51
*** YanXing_an has joined #openstack-meeting01:52
*** cloudrancher has quit IRC01:54
*** cloudrancher has joined #openstack-meeting01:55
*** hongbin has joined #openstack-meeting01:56
*** e0ne has joined #openstack-meeting01:58
*** kevzha01 has joined #openstack-meeting01:59
*** kevzha01 is now known as kevinz02:00
*** e0ne has quit IRC02:02
*** aeng_ is now known as aeng02:03
*** lennyb has quit IRC02:04
*** yangyapeng has quit IRC02:04
*** baoli has joined #openstack-meeting02:05
*** lennyb has joined #openstack-meeting02:06
*** unicell has quit IRC02:08
*** yangyapeng has joined #openstack-meeting02:09
*** cody-somerville has joined #openstack-meeting02:14
*** ricolin has joined #openstack-meeting02:16
*** song has joined #openstack-meeting02:27
*** song has quit IRC02:31
*** chyka_ has quit IRC02:40
*** hongbin has quit IRC02:43
*** mwarad has joined #openstack-meeting02:46
*** hongbin has joined #openstack-meeting02:49
*** baoli has quit IRC02:51
*** Namrata has joined #openstack-meeting02:51
*** Namrata_ has joined #openstack-meeting02:55
*** Nel1x has quit IRC02:58
hongbin#startmeeting zun03:00
openstackMeeting started Tue Sep 19 03:00:02 2017 UTC and is due to finish in 60 minutes.  The chair is hongbin. Information about MeetBot at http://wiki.debian.org/MeetBot.03:00
openstackUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.03:00
*** openstack changes topic to " (Meeting topic: zun)"03:00
openstackThe meeting name has been set to 'zun'03:00
hongbin#link https://wiki.openstack.org/wiki/Zun#Agenda_for_2017-09-19_0300_UTC Today's agenda03:00
hongbin#topic Roll Call03:00
*** openstack changes topic to "Roll Call (Meeting topic: zun)"03:00
lakerzhou1lakerzhou03:00
Namrata_Namrata03:00
spno/03:00
kevinzo/03:00
kiennto/03:00
mkraio/03:00
hongbinthanks for joining the meeting lakerzhou1 Namrata_ spn kevinz kiennt mkrai03:00
hongbin#topic Announcements03:01
*** openstack changes topic to "Announcements (Meeting topic: zun)"03:01
hongbin1. Propose change of the core team03:01
hongbin#link http://lists.openstack.org/pipermail/openstack-dev/2017-September/122155.html03:01
hongbini will close the voting in a few days03:01
hongbinassume everyone agree, kiennt will join the core team03:01
*** Shunli has joined #openstack-meeting03:01
Shunlio/03:01
hongbinhi Shunli03:02
hongbinall, any other announcement?03:02
mkraiCongratulations kiennt03:02
lakerzhou1at PTG, there is a new SIG of K8ts meeting. Here is the etherpad: https://etherpad.openstack.org/p/queens-ptg-sig-k8s03:02
lakerzhou1congratulations Kiennt03:02
Shunlicongratulations Kiennt03:02
Namratacongratulations Kiennt03:02
hongbinlakerzhou1: yes, unfortunately, i was not there03:02
kevinzcongratulations Kiennt03:03
hongbini will see how we can work with that sig if there is a chance to collaborate03:03
kienntThank you everyone! :D I'm so happy03:03
lakerzhou1People interested in K8ts related project are encouraged to join the SIG email list03:03
hongbinlakerzhou1: ack03:04
spnthx for link lakerzhou103:04
hongbinok, advance topic03:04
hongbin#topic Cinder integration (hongbin)03:04
*** openstack changes topic to "Cinder integration (hongbin) (Meeting topic: zun)"03:04
hongbin#link https://blueprints.launchpad.net/zun/+spec/direct-cinder-integration Direct Cinder integration03:04
hongbin#link https://review.openstack.org/#/q/project:openstack/zun+branch:master+topic:bp/direct-cinder-integration03:05
hongbinfor this bp, i submitted all the important implementation03:06
hongbinnow, it is waiting for reviews03:06
hongbinthe db and objects are merged, the cinder attach workflow and API implementation are under reviews03:06
hongbinthese patches are large, it might take some times to merge03:07
mkraiThank you hongbin . I will try out the patches and review03:07
*** fnaval has joined #openstack-meeting03:07
hongbinmkrai: thx03:07
mkraiBdw is there any doc that explains how to attach cinder volume to container?03:07
*** Namrata_ has quit IRC03:08
hongbin#link https://docs.openstack.org/cinder/pike/contributor/attach_detach_conventions.html03:08
kiennthongbin: Thank you. I will test another case (multiple attach), single attach works well.03:08
spnmkrai: am trying the same03:08
hongbinmkrai: ^^03:08
hongbinkiennt: ack, thanks for testing03:09
mkraihongbin: I meant with zun03:09
mkraiOk never mind I will figure out while reviewing03:09
hongbinmkrai: no, so far...03:09
mkraihongbin: Ok03:10
hongbini don't mind to write a doc for that03:10
mkraihongbin: That will be great. Thanks03:11
hongbinnp03:11
hongbinany other question about this topic?03:11
*** Tom has joined #openstack-meeting03:11
hongbinok, next topic03:11
hongbin#topic Introduce container composition (kevinz)03:12
*** openstack changes topic to "Introduce container composition (kevinz) (Meeting topic: zun)"03:12
hongbin#link https://blueprints.launchpad.net/zun/+spec/introduce-compose03:12
kevinzHi all03:12
kevinzLast week went to PTG, so no more update of this BP. I have add a document about Capsule.03:12
kevinzWill finish all the patches and doc before next meeting03:13
hongbinkevinz: thanks kevin03:13
kevinzSome patches need rebase to newest commit, will implement it this week03:13
kevinzhongbin: Yw03:13
hongbinok, next topic03:14
hongbin#topic Add support for clear container (mkrai)03:14
*** openstack changes topic to "Add support for clear container (mkrai) (Meeting topic: zun)"03:14
hongbin#link https://blueprints.launchpad.net/zun/+spec/support-secure-container03:14
mkraiHi03:14
mkraiI submitted a patch to devstack-container-plugin for setting up Clear COntainer03:14
hongbin#link https://review.openstack.org/#/c/499534/03:15
mkraiGot feedback from Hongbin on checking the virtualization flag before installing03:15
mkraiSince CC can't run inside VM03:15
mkraii didn't do much last week. I will update the patch this week03:15
mkraithat's all from me. Any questions?03:16
hongbinmkrai: no from me, thanks for the patch to devstack-plugin-container03:16
mkraihongbin: I have one question about gate03:16
hongbinmkrai: go ahead03:16
mkraiwe can't setup a gate for CC if we want because infra sets up devstack inside VM. Right?03:17
hongbinyes, as far as i know, infra CI are all in VM03:17
mkraiOk thanks03:18
hongbinthe only way to setup CC in CI is third-party CI03:18
mkraiwhich is difficult to get I assume03:18
hongbinthat means a spornor needs to contribute the resource for that03:18
spni have the setup to try out03:18
mkraispn: dedicate those hardwares to infra team. do you mean?03:19
mkraiOr just for testing now?03:19
spntesti g as of now. we  can discuss offline03:19
mkraispn: Thank you for the help. sure03:19
hongbinmkrai: thanks madhuri03:20
hongbinany other question before advancing topic?03:20
hongbinseems no03:21
hongbin#topic NFV use cases (lakerzhou)03:21
*** openstack changes topic to "NFV use cases (lakerzhou) (Meeting topic: zun)"03:21
hongbin#link https://etherpad.openstack.org/p/zun-nfv-use-cases03:21
hongbinlakerzhou1: Shunli ^^03:21
Shunlihi03:21
Shunlilast week work on how to collect pci info.03:22
ShunliJust investigate how nova to collect pci info.03:22
lakerzhou1Hongbin, I have devstack SRIOV setup ready03:22
lakerzhou1I should start testing tomorrow03:23
hongbinlakerzhou1: ack03:23
hongbinShunli: any finding about the way to collect pci info?03:24
Shunliseems no better way03:24
Shunlijust call 'lspci' for many times to get different info.03:25
hongbinShunli: i see, it should be fine03:25
Shunliand check the pci info sysfs03:25
Shunlicombine these info together maybe can get all pci info03:26
hongbinShunli: like what the Nova xenapi driver does?03:26
Shunliyes.03:26
hongbinShunli: ack03:26
spndid u try discover pkg?03:26
Shunlispn: no, do not know what is discoer pkg03:27
spndiscover --vendor-id --model-id pci03:27
*** thorst has joined #openstack-meeting03:28
Shunlispn: thx, i will try later. can not connect to my machine now.03:28
spncool03:28
hongbinspn: thanks for hte advice03:29
hongbinlakerzhou1: it is cool to have the SRIOV setup ready03:29
Shunlii will investigate the whole pci flow in nova.03:30
hongbinlakerzhou1: i assume you get the nova working with a VF nic ?03:30
Shunlistill need to add the pci stats, pci pool obejcts from nova to zun.03:30
hongbinShunli: ack03:31
Shunlithen maybe can start port the pci tracker.03:31
Shunlithat's all update for me.03:31
hongbinShunli: cool, thanks for working on that, Shunli03:31
Shunlimy pleasure.03:32
hongbin#topic Open Discussion03:32
*** openstack changes topic to "Open Discussion (Meeting topic: zun)"03:32
hongbinanyone has a topic to discuss?03:32
*** lakerzhou1 has quit IRC03:33
kienntnone from me.03:33
*** thorst has quit IRC03:33
mkraino03:33
spnno03:33
hongbinok, everyone, thanks for joining hte meeting03:34
hongbinsee you next time03:34
spnbye all03:34
hongbin#endmeeting03:34
*** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings"03:34
openstackMeeting ended Tue Sep 19 03:34:23 2017 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)03:34
openstackMinutes:        http://eavesdrop.openstack.org/meetings/zun/2017/zun.2017-09-19-03.00.html03:34
openstackMinutes (text): http://eavesdrop.openstack.org/meetings/zun/2017/zun.2017-09-19-03.00.txt03:34
openstackLog:            http://eavesdrop.openstack.org/meetings/zun/2017/zun.2017-09-19-03.00.log.html03:34
*** epico has joined #openstack-meeting03:43
*** fnaval has quit IRC03:48
*** hongbin has quit IRC03:51
*** coolsvap has joined #openstack-meeting03:51
*** gcb has quit IRC03:53
*** kiennt has quit IRC03:53
*** dbecker has quit IRC03:54
*** tpatil has joined #openstack-meeting03:59
*** e0ne has joined #openstack-meeting04:00
*** aeng has quit IRC04:03
*** e0ne has quit IRC04:04
*** ykatabam has quit IRC04:05
*** dbecker has joined #openstack-meeting04:07
*** tpsilva has quit IRC04:09
*** abhishekk has joined #openstack-meeting04:12
*** claudiub has joined #openstack-meeting04:20
*** aeng has joined #openstack-meeting04:21
*** anilvenkata has joined #openstack-meeting04:24
*** ykatabam has joined #openstack-meeting04:26
*** ykatabam has quit IRC04:26
*** ykatabam has joined #openstack-meeting04:27
*** thorst has joined #openstack-meeting04:29
*** janki has joined #openstack-meeting04:32
*** unicell has joined #openstack-meeting04:33
*** thorst has quit IRC04:34
*** benj_ has quit IRC04:34
*** dmacpher has quit IRC04:35
*** Tom has quit IRC04:37
*** unicell has quit IRC04:37
*** unicell has joined #openstack-meeting04:38
*** caowei has quit IRC04:44
*** aeng has quit IRC04:50
*** aeng has joined #openstack-meeting04:51
*** benj_ has joined #openstack-meeting04:55
*** Tom has joined #openstack-meeting04:56
*** yamamoto has quit IRC04:57
*** gyee has quit IRC04:58
*** Namrata has quit IRC04:59
*** marios has joined #openstack-meeting05:00
*** Tom has quit IRC05:00
*** Shunli has quit IRC05:02
*** yamamoto has joined #openstack-meeting05:07
*** caowei has joined #openstack-meeting05:10
*** cody-somerville has quit IRC05:22
*** yangyapeng has quit IRC05:23
*** zhurong has joined #openstack-meeting05:24
*** ijw has joined #openstack-meeting05:25
*** ijw has quit IRC05:30
*** thorst has joined #openstack-meeting05:30
*** mohankumar has joined #openstack-meeting05:32
*** thorst has quit IRC05:34
*** markstur has quit IRC05:34
*** hichihara has quit IRC05:35
*** amotoki_ has joined #openstack-meeting05:39
*** lbragstad has quit IRC05:44
*** sridharg has joined #openstack-meeting05:45
*** Tom has joined #openstack-meeting05:46
*** amotoki__ has joined #openstack-meeting05:52
*** amotoki_ has quit IRC05:52
*** Tom has quit IRC05:53
*** aeng has quit IRC05:53
*** Tom has joined #openstack-meeting05:54
*** Tom has quit IRC05:55
*** markstur has joined #openstack-meeting05:55
*** Tom has joined #openstack-meeting05:55
*** amotoki__ has quit IRC05:56
*** lbrune has joined #openstack-meeting05:57
*** amotoki_ has joined #openstack-meeting05:57
*** markstur has quit IRC06:00
*** tpatil has quit IRC06:03
*** Tom has quit IRC06:05
*** mriedem has quit IRC06:05
*** aloga has quit IRC06:05
*** afazekas has quit IRC06:05
*** brault has quit IRC06:05
*** numans has quit IRC06:05
*** alpha_sh has quit IRC06:05
*** arnewiebalck has quit IRC06:05
*** dhellmann has quit IRC06:05
*** harlowja has quit IRC06:05
*** sankarsh` has quit IRC06:05
*** _d34dh0r53_ has quit IRC06:05
*** leifz has quit IRC06:05
*** jamespage has quit IRC06:05
*** fmccrthy has quit IRC06:05
*** rmk has quit IRC06:05
*** tdasilva has quit IRC06:05
*** guyr-infinidat has quit IRC06:05
*** nakul_d has quit IRC06:05
*** Dmitrii-Sh has quit IRC06:05
*** diablo_rojo_phon has quit IRC06:05
*** cmurphy has quit IRC06:05
*** melwitt has quit IRC06:05
*** sballe_ has quit IRC06:05
*** rajinir has quit IRC06:05
*** jpmaxman has quit IRC06:05
*** melwitt has joined #openstack-meeting06:05
*** d34dh0r53 has joined #openstack-meeting06:05
*** dhellmann has joined #openstack-meeting06:05
*** afazekas has joined #openstack-meeting06:05
*** cmurphy has joined #openstack-meeting06:05
*** aloga has joined #openstack-meeting06:05
*** melwitt is now known as Guest3664106:06
*** numans has joined #openstack-meeting06:06
*** guyr-infinidat has joined #openstack-meeting06:06
*** diablo_rojo_phon has joined #openstack-meeting06:06
*** sballe_ has joined #openstack-meeting06:06
*** fmccrthy has joined #openstack-meeting06:06
*** jamespage has joined #openstack-meeting06:06
*** nakul_d has joined #openstack-meeting06:06
*** Dmitrii-Sh has joined #openstack-meeting06:07
*** mrunge has quit IRC06:08
*** mrunge has joined #openstack-meeting06:09
*** masayukig[m] has quit IRC06:09
*** mkrai has quit IRC06:09
*** Tom has joined #openstack-meeting06:10
*** mriedem has joined #openstack-meeting06:10
*** brault has joined #openstack-meeting06:10
*** alpha_sh has joined #openstack-meeting06:10
*** arnewiebalck has joined #openstack-meeting06:10
*** leifz has joined #openstack-meeting06:10
*** sankarsh` has joined #openstack-meeting06:10
*** rmk has joined #openstack-meeting06:10
*** tdasilva has joined #openstack-meeting06:10
*** rajinir has joined #openstack-meeting06:10
*** jpmaxman has joined #openstack-meeting06:10
*** bzhao has joined #openstack-meeting06:16
*** c00281451_ has quit IRC06:16
*** rbartal has joined #openstack-meeting06:18
*** guoshan has joined #openstack-meeting06:18
*** jprovazn has joined #openstack-meeting06:19
*** jchhatbar has joined #openstack-meeting06:22
*** jchhatbar has quit IRC06:23
*** jchhatbar has joined #openstack-meeting06:23
*** janki has quit IRC06:24
*** mriedem has quit IRC06:25
*** lbrune has quit IRC06:25
*** Tom has quit IRC06:25
*** Tom has joined #openstack-meeting06:27
*** janki has joined #openstack-meeting06:28
*** jchhatbar has quit IRC06:31
*** thorst has joined #openstack-meeting06:31
*** Tom has quit IRC06:33
*** thorst has quit IRC06:35
*** Tom has joined #openstack-meeting06:36
*** markstur has joined #openstack-meeting06:37
*** lbrune has joined #openstack-meeting06:39
*** markstur has quit IRC06:41
*** Tom has quit IRC06:43
*** chyka has joined #openstack-meeting06:44
*** martinkopec has joined #openstack-meeting06:44
*** Tom has joined #openstack-meeting06:45
*** chyka has quit IRC06:48
*** kiennt has joined #openstack-meeting06:48
*** zhurong has quit IRC06:54
*** Tom has quit IRC07:04
*** ykatabam has quit IRC07:04
*** jprovazn has quit IRC07:06
*** Tom has joined #openstack-meeting07:11
*** mwarad has quit IRC07:14
*** _mwarad_ has joined #openstack-meeting07:14
*** ad_rien_ has joined #openstack-meeting07:17
*** hashar has joined #openstack-meeting07:18
*** masayukig[m] has joined #openstack-meeting07:18
*** rcernin has joined #openstack-meeting07:18
*** markstur has joined #openstack-meeting07:19
*** zhurong has joined #openstack-meeting07:19
*** pcaruana has joined #openstack-meeting07:22
*** markstur has quit IRC07:23
*** tesseract has joined #openstack-meeting07:24
*** armax has quit IRC07:24
*** thorst has joined #openstack-meeting07:32
*** bbzhao has joined #openstack-meeting07:32
*** _mwarad_ has quit IRC07:32
*** cschwede has joined #openstack-meeting07:34
*** bzhao has quit IRC07:35
*** thorst has quit IRC07:36
*** mkrai has joined #openstack-meeting07:37
*** phil_ has joined #openstack-meeting07:43
*** phil_ is now known as Guest4729207:44
*** alexchadin has joined #openstack-meeting07:44
*** janki is now known as janki|lunch07:45
*** aarefiev_ptg is now known as aarefiev07:47
*** fzdarsky has joined #openstack-meeting07:53
*** ralonsoh has joined #openstack-meeting07:53
*** xiaofandh12 has joined #openstack-meeting07:54
*** mrunge has quit IRC07:54
*** _mwarad_ has joined #openstack-meeting07:55
*** yangyapeng has joined #openstack-meeting07:55
*** donghao has quit IRC07:56
*** mrunge has joined #openstack-meeting07:57
*** d0ugal has quit IRC08:01
*** ociuhandu has quit IRC08:03
*** Tom__ has joined #openstack-meeting08:07
*** d0ugal has joined #openstack-meeting08:09
*** janki|lunch is now known as janki08:09
*** Tom has quit IRC08:10
*** ykatabam has joined #openstack-meeting08:16
*** efoley has joined #openstack-meeting08:20
*** priteau has joined #openstack-meeting08:21
*** krenczewski has joined #openstack-meeting08:22
*** kiennt has quit IRC08:23
*** zhurong has quit IRC08:24
*** mrunge has quit IRC08:26
*** mrunge has joined #openstack-meeting08:26
*** krenczewski has quit IRC08:32
*** thorst has joined #openstack-meeting08:33
*** YanXing_an has quit IRC08:33
*** chyka has joined #openstack-meeting08:34
*** hashar has quit IRC08:36
*** thorst has quit IRC08:37
*** YanXing_an has joined #openstack-meeting08:37
*** hashar has joined #openstack-meeting08:37
*** chyka has quit IRC08:38
*** electrofelix has joined #openstack-meeting08:45
*** yangyapeng has quit IRC08:47
*** yanxingan has joined #openstack-meeting08:51
*** YanXing_an has quit IRC08:53
*** yangyapeng has joined #openstack-meeting08:54
*** ijw has joined #openstack-meeting08:54
*** yangyapeng has quit IRC08:59
*** ijw has quit IRC09:00
*** alexchadin has quit IRC09:04
*** slaweq has quit IRC09:04
*** alexchadin has joined #openstack-meeting09:05
*** zhurong has joined #openstack-meeting09:06
*** slaweq has joined #openstack-meeting09:07
*** yamamoto has quit IRC09:07
*** ad_rien_ has quit IRC09:09
*** yanxingan has quit IRC09:12
*** markstur has joined #openstack-meeting09:13
*** yanxingan has joined #openstack-meeting09:13
*** markstur has quit IRC09:17
*** e0ne has joined #openstack-meeting09:24
*** yamamoto has joined #openstack-meeting09:32
*** toscalix has joined #openstack-meeting09:32
*** thorst has joined #openstack-meeting09:33
*** markstur has joined #openstack-meeting09:34
*** thorst has quit IRC09:38
*** markstur has quit IRC09:39
*** ad_rien_ has joined #openstack-meeting09:45
*** ociuhandu has joined #openstack-meeting09:55
*** kevinz has quit IRC09:58
*** ociuhandu has quit IRC10:01
*** yanxingan has quit IRC10:02
*** tovin07_ has quit IRC10:09
*** markstur has joined #openstack-meeting10:11
*** sambetts|afk is now known as sambetts10:13
*** alexchadin has quit IRC10:13
*** reedip has joined #openstack-meeting10:13
*** markstur has quit IRC10:15
*** thorst has joined #openstack-meeting10:18
*** thorst has quit IRC10:19
*** mrunge has quit IRC10:23
*** mrunge has joined #openstack-meeting10:25
*** _mwarad_ has quit IRC10:26
*** alexchadin has joined #openstack-meeting10:31
*** yamamoto has quit IRC10:34
*** toscalix has quit IRC10:35
*** toscalix_ has joined #openstack-meeting10:35
*** alexchadin has quit IRC10:36
*** guoshan has quit IRC10:37
*** yamamoto has joined #openstack-meeting10:38
*** Tom__ has quit IRC10:40
*** jkilpatr has quit IRC10:42
*** ad_rien_ has quit IRC10:42
*** toscalix_ has quit IRC10:46
*** oidgar has joined #openstack-meeting10:47
*** markstur has joined #openstack-meeting10:47
*** yamamoto has quit IRC10:47
*** timothyb89 has quit IRC10:48
*** caowei has quit IRC10:50
*** markstur has quit IRC10:52
*** marios has quit IRC10:53
*** alexchadin has joined #openstack-meeting10:55
*** toscalix has joined #openstack-meeting11:01
*** haint has joined #openstack-meeting11:10
*** sdague has joined #openstack-meeting11:12
*** baoli has joined #openstack-meeting11:14
*** jkilpatr has joined #openstack-meeting11:16
*** thorst has joined #openstack-meeting11:19
*** yamamoto has joined #openstack-meeting11:23
*** markstur has joined #openstack-meeting11:24
*** Alex_Staf has joined #openstack-meeting11:25
*** thorst has quit IRC11:26
*** baoli has quit IRC11:28
*** markstur has quit IRC11:29
*** tpsilva has joined #openstack-meeting11:29
*** philly has joined #openstack-meeting11:32
*** lpetrut has joined #openstack-meeting11:33
*** alexchadin has quit IRC11:33
*** martinkopec has quit IRC11:33
*** lpetrut has quit IRC11:33
*** alexchadin has joined #openstack-meeting11:34
*** alexchadin has quit IRC11:35
*** alexchadin has joined #openstack-meeting11:36
*** lpetrut has joined #openstack-meeting11:36
*** yangyapeng has joined #openstack-meeting11:38
*** Tom__ has joined #openstack-meeting11:41
*** epico has quit IRC11:43
*** Alex_Staf has quit IRC11:44
*** Tom__ has quit IRC11:45
*** rbowen has joined #openstack-meeting11:47
*** ociuhandu has joined #openstack-meeting11:48
*** zhurong has quit IRC11:49
*** litao__ has quit IRC11:54
*** alexchadin has quit IRC11:56
*** marios has joined #openstack-meeting11:57
*** alexchadin has joined #openstack-meeting11:57
*** kylek3h_ has joined #openstack-meeting12:00
*** philly has left #openstack-meeting12:00
*** markstur has joined #openstack-meeting12:01
*** kylek3h has quit IRC12:03
*** efoley has quit IRC12:03
*** efoley_ has joined #openstack-meeting12:03
*** kylek3h_ has quit IRC12:04
*** thorst has joined #openstack-meeting12:04
*** markstur has quit IRC12:06
*** alexpilotti has joined #openstack-meeting12:07
*** edmondsw has joined #openstack-meeting12:09
*** alexpilo_ has quit IRC12:10
*** alexpilo_ has joined #openstack-meeting12:11
*** raildo has joined #openstack-meeting12:13
*** alexchadin has quit IRC12:13
*** alexchadin has joined #openstack-meeting12:13
*** alexpilotti has quit IRC12:13
*** Tom__ has joined #openstack-meeting12:13
*** dprince has joined #openstack-meeting12:16
*** martinkopec has joined #openstack-meeting12:17
*** beekhof_mb has joined #openstack-meeting12:17
*** longkb_ has joined #openstack-meeting12:20
*** pchavva has joined #openstack-meeting12:20
*** kylek3h has joined #openstack-meeting12:25
*** rbudden has joined #openstack-meeting12:28
*** efoley has joined #openstack-meeting12:32
*** efoley_ has quit IRC12:32
*** VW has joined #openstack-meeting12:32
*** VW has quit IRC12:33
*** abhishekk has quit IRC12:33
*** VW has joined #openstack-meeting12:33
*** alexpilotti has joined #openstack-meeting12:38
*** markstur has joined #openstack-meeting12:38
*** yangyapeng has quit IRC12:38
*** alexpilo_ has quit IRC12:39
*** markstur has quit IRC12:42
*** bbzhao has quit IRC12:47
*** bbzhao has joined #openstack-meeting12:47
*** esberglu has joined #openstack-meeting12:52
*** mriedem has joined #openstack-meeting12:57
*** lakerzhou has joined #openstack-meeting13:00
*** ruijie_ has joined #openstack-meeting13:00
ruijie_#start-meeting senlin13:00
Qimingno dash13:01
ruijie_#start meeting senlin13:01
ruijie_:<13:01
Qimingno space13:01
ruijie_#startmeeting senlin13:02
openstackMeeting started Tue Sep 19 13:02:00 2017 UTC and is due to finish in 60 minutes.  The chair is ruijie_. Information about MeetBot at http://wiki.debian.org/MeetBot.13:02
openstackUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.13:02
*** openstack changes topic to " (Meeting topic: senlin)"13:02
openstackThe meeting name has been set to 'senlin'13:02
ruijie_here we go ..13:02
Qiming:)13:02
ruijie_sorry13:02
ruijie_https://wiki.openstack.org/wiki/Meetings/SenlinAgenda13:02
longkb_Hi everyone! It nice to meet you guys13:02
ruijie_please feel free to add items to the agenda13:02
ruijie_hi longkb_13:02
ruijie_let's wait for a while :)13:03
*** chenyb4_ has joined #openstack-meeting13:03
ruijie_hi chenyb4_13:03
*** s3wong has joined #openstack-meeting13:04
ruijie_okay, let's get started13:04
ruijie_https://etherpad.openstack.org/p/senlin-queens-workitems13:04
ruijie_hi Qiming, we discussed about the extra field/policy to add hook to scaling process13:05
*** hashar_ has joined #openstack-meeting13:06
Qimingyes13:06
*** bobh has joined #openstack-meeting13:07
ruijie_so, that policy could contains how to get approved or how to send notifications?13:07
Qimingthere are two sub-topics here13:08
*** hashar has quit IRC13:08
Qimingone is about how to inject something into an API request to indicate whether a request is an "original" one13:08
*** amotoki_ has quit IRC13:09
Qimingthe other one is about how to add hooks (possibly a general policy) that examines this 'something' and decide whether a hook will be triggered13:09
*** toscalix has quit IRC13:09
Qimingwe are supposed to be following the global api-wg guidelines, for api requests and responses13:10
ruijie_by the "original" request, you mean we will send a request or notification to someone, and they will call back?13:10
Qimingyes13:11
ruijie_once the "original" comes in, we need to record it somewhere to wait for callback, after that the process could pass to next step?13:13
*** gouthamr has joined #openstack-meeting13:13
*** StefanPaetowJisc has joined #openstack-meeting13:14
Qimingwe don't wait13:15
*** toscalix has joined #openstack-meeting13:15
Qimingthat request has been "processed" and "redirected"13:15
Qimingthese kind of info are have to be either sent in the body or embedded in the header13:17
Qimingif we carry these info in header, it would be something like this: https://developer.mozilla.org/en-US/docs/Web/HTTP/Access_control_CORS13:18
ruijie_request(with special field) --> create action with special status --> return/call/notify ; callback to trigger that action --> scale in/out13:18
Qimingthe original request doesn't have to be changed13:20
Qimingmost of the time, requests should be processed as usual13:21
Qimingit is only those requests mutated by a third party software that need a special tag13:21
ruijie_okay, Qiming, may need to look forward to it :) thought it a little bit simple13:23
Qimingto get it done in a disciplined way is not straightforward13:24
Qimingalthough get it done in an adhoc way is simple enough13:24
Qimingreference: http://specs.openstack.org/openstack/api-wg/guidelines/headers.html#avoid-proliferating-headers13:25
ruijie_yes Qiming13:25
Qimingalso this: http://specs.openstack.org/openstack/api-wg/guidelines/http.html13:26
Qimingwe are supposed to return a proper status code for this13:26
QimingI don't think we should add an 'extra' field to each and every API request ...13:28
*** alexchadin has quit IRC13:28
Qimingit is gonna be dirty13:28
*** felipemonteiro_ has joined #openstack-meeting13:28
*** felipemonteiro__ has joined #openstack-meeting13:29
*** markvoelker has joined #openstack-meeting13:30
ruijie_thanks Qiming, let's talk about it a little bit later :)13:30
Qimingalright13:30
ruijie_another one is about this patch https://review.openstack.org/#/c/504830/13:30
ruijie_to revisit the documentation of event dispatcher13:31
*** ykatabam has quit IRC13:31
ruijie_the developer part of the event dispatcher looks good now?13:31
Qimingyes I think so13:32
*** felipemonteiro_ has quit IRC13:33
Qiminghowever, I think we are supposed to split that rst file into two13:33
ruijie_http://git.openstack.org/cgit/openstack/senlin/tree/doc/source/contributor/event_dispatcher.rst13:33
Qimingone for user, one for developer13:33
ruijie_this one is about how to extend the event plugin13:34
ruijie_Qiming, you mean we may need to divid the user reference to 2 parts?13:34
Qimingthe contents under 'contributor' subdir are there for developers13:34
Qimingthe one in your patch is targeting users13:35
ruijie_yes Qiming13:35
QimingI see, we already have guide for developers13:35
ruijie_yes Qiming :)13:36
ruijie_next one. the tempest-plugin13:36
ruijie_https://review.openstack.org/#/c/504870/13:37
ruijie_the patch is already there, will keep checking it13:37
ruijie_that's all from my side :)13:38
Qimingcool13:38
ruijie_I noticed longkb_ is here :)13:39
Qimingwe will need to revise some gate jobs later when the github project is migrated13:39
ruijie_yes Qiming, after that, will move the gate jobs from senlin to the plugin step by step13:39
Qimingto be honest, I'm not sure13:40
Qimingthe gate jobs are there to ensure changes to senlin repo won't break anything, they are not there to protect the tempest plugin13:41
Qimingso maybe the jobs are supposed to be revised to invoke tempest plugin project, and they still vote for senlin patches13:41
*** coolsvap has quit IRC13:42
Qimingalso speaking of your event doc improvement13:43
Qimingwhen reading this: https://docs.openstack.org/senlin/latest/user/events.html13:43
QimingI felt that we may need a subsection for the dispatcher configuration so that users will easily find the info13:43
ruijie_one for the database and another for the messaging13:44
Qimingwe need a subsection in that article13:44
Qimingfor readability's purpose13:45
Qimingjust a quick thought13:45
ruijie_okay, that makes sense13:45
*** hoangcx_ has joined #openstack-meeting13:45
ruijie_next one is about the meetup13:46
*** ijw has joined #openstack-meeting13:46
ruijie_we can organize the meetup in Beijing in the 2nd/3rd week of Oct13:47
Qimingany suggestion on the date/location ?13:47
ruijie_how about 15th Oct13:48
ruijie_Queens-1 milestone :)13:49
Qimingit is okay for me13:49
QimingI may have a conflicting schedule but not yet fixed13:49
*** ijw has quit IRC13:50
*** cleong has joined #openstack-meeting13:50
ruijie_the date could be discussed, will send an email to mailing list. I think the location could be Beijing :)13:50
*** annp has joined #openstack-meeting13:50
*** hongbin has joined #openstack-meeting13:51
*** awaugama has joined #openstack-meeting13:52
ruijie_:< >: that's all from me13:52
Qimingno topic from me13:54
ruijie_okay, we can end it a little bit early13:54
ruijie_thanks for joining :)13:54
ruijie_#endmeeting13:55
*** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings"13:55
openstackMeeting ended Tue Sep 19 13:55:04 2017 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)13:55
openstackMinutes:        http://eavesdrop.openstack.org/meetings/senlin/2017/senlin.2017-09-19-13.02.html13:55
openstackMinutes (text): http://eavesdrop.openstack.org/meetings/senlin/2017/senlin.2017-09-19-13.02.txt13:55
openstackLog:            http://eavesdrop.openstack.org/meetings/senlin/2017/senlin.2017-09-19-13.02.log.html13:55
*** longkb_ has quit IRC13:57
*** reedip_ has joined #openstack-meeting14:00
*** shintaro has joined #openstack-meeting14:00
*** chyka has joined #openstack-meeting14:00
*** efoley has quit IRC14:01
*** efoley has joined #openstack-meeting14:01
*** bkennel has joined #openstack-meeting14:02
*** Guest36641 is now known as melwitt14:03
*** chyka has quit IRC14:04
*** yangyapeng has joined #openstack-meeting14:04
*** rbartal has quit IRC14:05
*** erlon has joined #openstack-meeting14:05
*** esberglu has quit IRC14:06
*** esberglu has joined #openstack-meeting14:07
*** lbrune has quit IRC14:08
*** lbrune has joined #openstack-meeting14:08
*** armax has joined #openstack-meeting14:09
*** esberglu has quit IRC14:11
*** caboucha has joined #openstack-meeting14:12
*** caboucha has quit IRC14:12
*** yangyapeng has quit IRC14:13
*** yangyapeng has joined #openstack-meeting14:14
*** yangyapeng has quit IRC14:18
*** yushiro has joined #openstack-meeting14:19
*** bkennel has quit IRC14:20
*** yamamoto has quit IRC14:20
*** esberglu has joined #openstack-meeting14:20
*** baoli has joined #openstack-meeting14:21
*** yangyapeng has joined #openstack-meeting14:23
*** bobh has quit IRC14:26
*** efoley has quit IRC14:26
*** yangyapeng has quit IRC14:30
*** yangyapeng has joined #openstack-meeting14:30
*** s3wong has quit IRC14:31
*** sdague has quit IRC14:32
*** yangyapeng has quit IRC14:36
*** efoley has joined #openstack-meeting14:36
*** janki has quit IRC14:36
*** unicell has quit IRC14:37
*** unicell has joined #openstack-meeting14:37
*** esberglu has quit IRC14:39
*** esberglu has joined #openstack-meeting14:40
*** sdague has joined #openstack-meeting14:40
*** jrist has quit IRC14:41
*** esberglu has quit IRC14:41
*** esberglu has joined #openstack-meeting14:41
*** baoli has quit IRC14:42
*** rossella_s has quit IRC14:43
*** baoli has joined #openstack-meeting14:43
*** baoli has quit IRC14:44
*** raildo has quit IRC14:44
*** baoli has joined #openstack-meeting14:44
*** zjt has joined #openstack-meeting14:44
*** zjt has left #openstack-meeting14:46
*** martinkopec has quit IRC14:46
*** sdague has quit IRC14:46
*** rossella_s has joined #openstack-meeting14:46
*** jprovazn has joined #openstack-meeting14:50
*** yangyapeng has joined #openstack-meeting14:52
*** StefanPaetowJisc has quit IRC14:52
*** VW_ has joined #openstack-meeting14:53
*** david-lyle has joined #openstack-meeting14:53
*** beekneemech is now known as bnemec14:56
*** StefanPaetowJisc has joined #openstack-meeting14:56
*** VW has quit IRC14:57
*** VW_ has quit IRC14:57
*** lbragstad has joined #openstack-meeting14:59
*** cody-somerville has joined #openstack-meeting15:00
*** VW has joined #openstack-meeting15:01
*** shintaro has quit IRC15:02
*** ssathaye has joined #openstack-meeting15:03
*** baoli has quit IRC15:03
*** chyka has joined #openstack-meeting15:04
*** baoli has joined #openstack-meeting15:04
*** chyka has quit IRC15:04
*** VW_ has joined #openstack-meeting15:05
*** gyee has joined #openstack-meeting15:05
*** StefanPaetowJisc has quit IRC15:05
*** chyka has joined #openstack-meeting15:05
*** chenyb4_ has quit IRC15:07
*** VW has quit IRC15:07
*** rbowen has quit IRC15:07
*** hoangcx_ has quit IRC15:08
*** StefanPaetowJisc has joined #openstack-meeting15:08
*** rossella_s has quit IRC15:08
*** mohankumar has quit IRC15:09
*** yangyapeng has quit IRC15:09
*** rbowen has joined #openstack-meeting15:09
*** rossella_s has joined #openstack-meeting15:10
*** cloudrancher has quit IRC15:10
*** cloudrancher has joined #openstack-meeting15:11
*** lbragstad has quit IRC15:11
*** markstur_ has joined #openstack-meeting15:12
*** slaweq has quit IRC15:16
*** makowals has quit IRC15:16
*** yangyapeng has joined #openstack-meeting15:18
*** yamamoto has joined #openstack-meeting15:20
*** raildo has joined #openstack-meeting15:24
*** ad_rien_ has joined #openstack-meeting15:24
*** yamamoto has quit IRC15:25
*** dimak has quit IRC15:25
*** dimak has joined #openstack-meeting15:26
*** bobh has joined #openstack-meeting15:26
*** Tom__ has quit IRC15:27
*** slaweq_ has quit IRC15:27
*** slaweq has joined #openstack-meeting15:28
*** ad_rien_ has quit IRC15:28
*** csomerville has joined #openstack-meeting15:29
*** bobh has quit IRC15:31
*** Guest47292 has quit IRC15:31
*** cody-somerville has quit IRC15:32
*** ad_rien_ has joined #openstack-meeting15:33
*** Swami has joined #openstack-meeting15:33
*** abalutoiu has joined #openstack-meeting15:33
*** julim has quit IRC15:35
*** e0ne has quit IRC15:37
*** raildo has quit IRC15:39
*** cloudrancher has quit IRC15:42
*** cloudrancher has joined #openstack-meeting15:43
*** sdague has joined #openstack-meeting15:46
*** ruijie_ has quit IRC15:48
*** annp has quit IRC15:49
*** baoli has quit IRC15:50
*** yamamoto has joined #openstack-meeting15:52
*** DrBacchus has joined #openstack-meeting15:53
*** lbrune has quit IRC15:53
*** rbowen has quit IRC15:54
*** raildo has joined #openstack-meeting15:55
*** jlibosva has joined #openstack-meeting15:57
*** haleyb has quit IRC15:59
*** DrBacchus has quit IRC16:00
*** ihrachys has joined #openstack-meeting16:00
ihrachys#startmeeting neutron_ci16:00
openstackMeeting started Tue Sep 19 16:00:58 2017 UTC and is due to finish in 60 minutes.  The chair is ihrachys. Information about MeetBot at http://wiki.debian.org/MeetBot.16:00
openstackUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.16:01
jlibosvao/16:01
ihrachyshello my friends16:01
*** openstack changes topic to " (Meeting topic: neutron_ci)"16:01
openstackThe meeting name has been set to 'neutron_ci'16:01
ihrachysjlibosva, o/16:01
*** rbowen has joined #openstack-meeting16:01
ihrachysok, that's a tight meeting company we have here ;)16:01
ihrachyshaleyb seems to be offline16:01
jlibosvahe just disconnected16:02
jlibosvaI hope he'll be back16:02
*** haleyb has joined #openstack-meeting16:02
jlibosvathere he is16:02
ihrachyshere he is16:02
ihrachys:)16:02
*** dprince has quit IRC16:02
ihrachyshaleyb, o/16:02
ihrachys#topic Actions from prev week16:02
*** openstack changes topic to "Actions from prev week (Meeting topic: neutron_ci)"16:02
ihrachys"jlibosva to talk to armax about enabling test_convert_default_subnetpool_to_non_default in gate"16:02
jlibosvaI didn't because I forgot16:03
*** yamamoto has quit IRC16:03
*** oidgar has quit IRC16:03
jlibosvaI'll do this week16:03
ihrachys#action jlibosva to talk to armax about enabling test_convert_default_subnetpool_to_non_default in gate16:03
haleybhi there, irc-proxy was having problems16:03
ihrachys"haleyb to figure out the way forward for grenade/dvr gate"16:03
ihrachysI believe the grenade job is largely back to normal now?16:03
ihrachysthe bug being https://bugs.launchpad.net/neutron/+bug/171392716:04
openstackLaunchpad bug 1713927 in neutron "gate-grenade-dsvm-neutron-dvr-multinode-ubuntu-xenial fails constantly" [High,In progress] - Assigned to Swaminathan Vasudevan (swaminathan-vasudevan)16:04
haleybi just rebooted, but remember it ~20%16:04
ihrachyshaleyb, you mentioned in the bug there is still a fix to land16:04
ihrachyson server side16:04
ihrachyscan you post it in LP?16:04
*** dprince has joined #openstack-meeting16:04
haleybyes, it needs a quick re-spin to address a comment16:04
ihrachysI am at loss with all those dvr fixes you have with Swami :)16:04
ihrachyshaleyb, is it required to fix the gate failure?16:05
ihrachysor it's just nice to have?16:05
*** sridharg has quit IRC16:05
haleybit's required to fix the server side, we only worked around it in the agent16:05
ihrachysok. I remember we make the job non-voting. I assume we will get it back after the server side fix?16:06
*** rbowen has quit IRC16:06
haleybi hope so, if the failure rate is still good16:07
ihrachysI recollect we had a revert for that somewhere.16:07
ihrachysbut now I fail to find it16:07
*** rbowen has joined #openstack-meeting16:07
jlibosvaI don't think we do16:07
haleybactually the dvr-multinode job is 0%, it's the regular multinode job that's at 20% failure16:07
*** hashar_ is now known as hashar16:08
jlibosvathis is the original - https://review.openstack.org/#/c/500567/16:08
ihrachysok, I created a revert for tracking purposes16:08
*** Apoorva has joined #openstack-meeting16:08
jlibosvahaleyb: which could also mean we're not collecting data correctly, 0% failure is always suspicious to me as we have infra issues or catching regression failures etc.16:09
ihrachyshaleyb, hm... should we break it back so that we are on the same failure rate? :p16:09
haleybwhat, you don't believe DVR is better? :-p16:09
ihrachysit is. it's just that the base line we compare with was always rather low. :p16:09
*** toscalix has quit IRC16:09
ihrachysanyhow...16:10
ihrachysthese were all AIs we had16:10
ihrachys#topic Grafana16:10
*** openstack changes topic to "Grafana (Meeting topic: neutron_ci)"16:10
ihrachyshttp://grafana.openstack.org/dashboard/db/neutron-failure-rate16:10
ihrachysapi job is at 20% failure rate on 7days sliding window chart16:11
ihrachysnot sure what causes that16:11
ihrachyscould it be the skip_checks issue?16:11
ihrachysI mean this: https://review.openstack.org/#/q/I1c0902e3c06886812029fae0e4435bb6674f57df16:11
ihrachysI believe charts collect data from all branches so we may still see those failures there if they happen in stable16:11
*** oidgar has joined #openstack-meeting16:11
*** xiaofandh12 has quit IRC16:11
ihrachysapart from that, it's usual suspects - fullstack and scenarios - that we still have at 100%. let's deal with them one by one.16:12
ihrachys#topic Fullstack failures16:12
*** openstack changes topic to "Fullstack failures (Meeting topic: neutron_ci)"16:12
*** yushiro has quit IRC16:12
ihrachysI believe we made some significant progress lately with fixing and triaging failures16:13
ihrachysI believe the main issue that is causing 100% failure rate right now is the one where test_trunk_lifecycle fails because ovs agents clean up ports that don't belong to them16:13
ihrachyshttps://bugs.launchpad.net/neutron/+bug/168770916:13
openstackLaunchpad bug 1687709 in neutron "fullstack: ovs-agents remove trunk bridges that don't belong to them" [High,In progress] - Assigned to Armando Migliaccio (armando-migliaccio)16:13
ihrachysand armax had a WIP patch for that16:14
ihrachyshttps://review.openstack.org/#/c/504186/16:14
ihrachysthe idea there is to introduce a test only option that will set a prefix for agent ports16:15
ihrachysthen configure each fullstack test case with a unique prefix16:15
ihrachysthen ovs agent would filter those ports with the prefix16:15
ihrachysnot ideal, but should be an easy fix16:15
*** dmacpher has joined #openstack-meeting16:15
ihrachysand then we can follow up with filtering them on ovsdb level, or something else16:15
ihrachysjlibosva, with that patch, do we still want to follow up?16:16
jlibosvaI just don't like that we're having "monkey patch hack" at one agent and "config hack" in other agents. I'd rather have it unified16:16
jlibosvaand moving towards removing those hacks longterm but the goal of the idea is neat16:17
ihrachysjlibosva, that's not ideal. but do you agree testing the actual production code is better than monkey patching the agent?16:17
*** dmacpher has quit IRC16:17
jlibosvaimho it's moot16:17
ihrachysmoot point?16:17
ihrachysas in - longterm both are bad?16:18
*** donghao has joined #openstack-meeting16:18
jlibosvano, I mean if you have a code that's parametrized and never used in production - or you patch the code. It's still the same16:18
jlibosvajust written differently16:18
jlibosvabut if we get rid of monkey patching and replacing it with no-prod config values, I'm good. But in my opinion it's the same as monkey patching16:19
*** ad_rien_1 has joined #openstack-meeting16:19
*** ad_rien_ has quit IRC16:20
ihrachysjlibosva, I remember I had complications with monkey patched agents when switching to rootwrap because I needed to configure rootwrap to allow those dirs for exec_dirs16:20
ihrachysof course now it's solved somewhat16:21
ihrachysbut it left bitter taste in my mouth16:21
ihrachys:)16:21
ihrachysok16:21
*** lbrune has joined #openstack-meeting16:21
ihrachysso to the question of follow up - is it smth we want to still track?16:21
ihrachysor we will pretend we can live with the hacks?16:21
jlibosvais it the last issue? I thought we still have some l3 east-west failing IIRC16:21
ihrachysthere are some issues that show once in a while16:22
jlibosvaor you mean to track the isolation stuff that I was working on?16:22
ihrachysI was hoping that we tackle this one to finally have a reasonable chart that is not 100% always16:22
*** donghao has quit IRC16:22
ihrachysand then can meaningfully assess progress16:22
ihrachysbut yes, there are others16:22
jlibosvasounds good16:22
jlibosvabtw the trunk failure shouldn't be 100%, it's a race condition16:22
ihrachysre follow up, I meant the isolation and/or the filtering of ports on ovsdb query level16:22
ihrachyssome decent fix that would allow us to kill the test option16:23
ihrachysjlibosva, sometimes the job rate falls to 95%, yes :p16:23
jlibosvaI'll keep it in my backlog16:23
jlibosvaah, nice :) I like progress16:23
ihrachysok, good. it's a nice thing to have, but I believe not a critical thing right now, especially considering all the other priorities we tend to have16:24
ihrachysanother bug that affected the job was https://bugs.launchpad.net/neutron/+bug/171758216:24
openstackLaunchpad bug 1717582 in neutron "fullstack job failing to create namespace because it's already exists" [Undecided,In progress] - Assigned to Slawek Kaplonski (slaweq)16:24
jlibosvaagreed16:24
ihrachysand slaweq has a fix: https://review.openstack.org/#/c/503890/16:24
ihrachysas we learned, netlink is async and hence doesn't provide guarantee that after netns add the namespace is present16:25
ihrachysso we need to spin16:25
*** lbrune has quit IRC16:26
ihrachysI need to get back to the patch, seems like slaweq has reasonable replies to my concerns16:26
jlibosvathomas has ideas how to avoid the race16:27
jlibosvait's in PS616:27
*** bobh has joined #openstack-meeting16:27
*** StefanPaetowJisc has quit IRC16:27
ihrachysok, will check16:27
ihrachys(looking through the list of fullstack bugs) one other thing I had for the suite is switching to using SIGTERM instead of SIGKILL for all services: https://bugs.launchpad.net/neutron/+bug/148754816:28
openstackLaunchpad bug 1487548 in neutron "fullstack infrastructure tears down processes via kill -9" [Low,In progress] - Assigned to Ihar Hrachyshka (ihar-hrachyshka)16:28
*** rwsu has quit IRC16:28
ihrachysI have https://review.openstack.org/#/c/499803/16:28
ihrachysbut I need to rework it so that if SIGTERM doesn't kill in a minute, we SIGKILL16:28
ihrachysanything else on fullstack?16:29
*** StefanPaetowJisc has joined #openstack-meeting16:29
*** rwsu has joined #openstack-meeting16:30
*** rwsu has quit IRC16:30
*** rwsu has joined #openstack-meeting16:30
jlibosvanope16:31
ihrachys#topic Scenarios16:31
*** openstack changes topic to "Scenarios (Meeting topic: neutron_ci)"16:31
ihrachysjlibosva, I think we were making some progress there too?16:32
*** julim has joined #openstack-meeting16:32
*** bobh has quit IRC16:32
*** VW_ has quit IRC16:32
ihrachysafaik there were two fronts - one dvr fixes from haleyb and Swami and another router migrations from anilvenkata16:32
jlibosvaI think only Anil has some patches for router migrations16:32
ihrachyswould be nice to have a list of things we believe are related16:32
*** lbrune has joined #openstack-meeting16:32
ihrachysjlibosva, afaiu some dvr fixes for grenade were effectively also helping scenarios16:33
*** StefanPaetowJisc has quit IRC16:33
*** VW has joined #openstack-meeting16:33
*** ralonsoh has quit IRC16:33
jlibosvacool, two birds with one stone16:33
haleybSwami just sent out https://review.openstack.org/#/c/505324 as well as he noticed there are some edge cases still broken16:33
haleybi think he had opened a new bug for that, will check16:34
ihrachysthe flow of dvr fixes both encourages and scares16:35
ihrachysit's encouraging that we fix that16:35
ihrachysbut... it's like... broken since ever?16:35
*** sshank has joined #openstack-meeting16:35
*** sdague has quit IRC16:35
haleybrouter migrations are complicated.  this is new since the dvr_snat_bound code merged in pike16:35
*** dprince has quit IRC16:35
ihrachysjlibosva, haleyb you think it would make sense to have a list of scenario related fixes somewhere so that we can prioritize them somehow?16:36
jlibosvaI can take an AI to do16:36
*** sdague has joined #openstack-meeting16:36
ihrachys#action jlibosva to prepare a list of scenario related fixes16:36
ihrachysjlibosva, thanks!16:36
haleybyes, either a single bug and/or topic i guess16:36
ihrachyshaleyb, ^ please help Jakub with that, I believe you have a good grasp of dvr side of things16:37
haleybwill do16:37
*** mikal has quit IRC16:37
jlibosvamaybe we could create a short-term LP tag to get the list quickly16:37
ihrachysjlibosva, apart from it, are we aware of any other fixes? how close would the fixes we have in pipeline get us in terms of failure rate?16:37
ihrachysjlibosva, good idea. we can create a new tag, no need to have a permanent one16:38
*** pcaruana has quit IRC16:38
jlibosvathere is a fix for remote security groups that iwamoto is working on16:38
ihrachyshttps://review.openstack.org/#/c/492404/ ?16:39
jlibosvahttps://review.openstack.org/#/c/492404/16:39
jlibosvayep16:39
jlibosvathis should also bring some peace16:39
ihrachysI thought it's just perf optimization?16:39
ihrachysok I see in the commit message: "that filtering16:40
ihrachysare correctly performed"16:40
ihrachysso I guess it's functional too16:40
jlibosvano, it's a new regression caused by conjunctions16:40
*** unicell has quit IRC16:40
jlibosvaalso slaweq has a patch for qos for better logging in the test: https://review.openstack.org/#/c/491244/16:40
ihrachysjlibosva, it affects pike+?16:40
ihrachysI mean the conjunctions16:41
jlibosvayes16:41
jlibosvait's been merged to pike16:41
ihrachysanother regression, good16:42
ihrachys:)16:42
ihrachysbut it seems like we are not close to complete there?16:42
ihrachysso I guess I will need to release .1 without it16:42
ihrachysjlibosva, re the qos test patch, my concern was that it hides the issue. is it correct?16:43
ihrachysit retries over and over. shouldn't we expect it to work correctly?16:43
ihrachysinstead it hangs in the middle16:43
jlibosvayep, we could have some mechanism to retry few times16:44
jlibosvabut importantly, it adds some logging messages that could reveal more information about the issue16:44
*** Qiming has quit IRC16:45
ihrachysjlibosva, but can't we raise after logging?16:46
jlibosvawe can :)16:46
ihrachysotherwise it seems like the test will pass if it works after e.g. 5th attempt16:46
jlibosvaor make a loop16:46
jlibosvaaah16:46
jlibosvaI see16:46
ihrachysit can also loop now indefinitely16:47
ihrachysbefore, the timeout would bubble up to test runner16:47
ihrachysnow it's swallowed16:47
jlibosvaI was thinking about trying several times but you're right, that failing the test would make more sense16:47
jlibosvaand we should log the exception too16:47
*** mikal has joined #openstack-meeting16:47
ihrachysok, let's follow up with comments there then16:48
ihrachyslogging is a good idea, it's just execution that scared me16:48
*** Qiming has joined #openstack-meeting16:49
ihrachys#topic Open discussion16:49
*** openstack changes topic to "Open discussion (Meeting topic: neutron_ci)"16:49
ihrachyswe hit https://launchpad.net/bugs/1717046 the last week16:49
openstackLaunchpad bug 1717046 in neutron "L3HARouterVRIdAllocationDbObjectTestCase.test_delete_objects fails because of duplicate record" [Medium,In progress] - Assigned to Ihar Hrachyshka (ihar-hrachyshka)16:50
ihrachysI worked it around with a fix for now16:50
*** cloudrancher has quit IRC16:50
ihrachysbut the root issue in the test framework is still there16:50
ihrachysI have this attempt: https://review.openstack.org/#/c/503854/16:50
ihrachysbut it will require some more work16:50
ihrachysalso, Genadi Ch sent a new scenario for sec groups here: https://review.openstack.org/#/c/504021/16:50
*** cloudrancher has joined #openstack-meeting16:51
ihrachysand seems like he was able to trigger a sqlalchemy error and error 500 with it16:51
ihrachyshe reported a bug here: https://bugzilla.redhat.com/show_bug.cgi?id=1493175 (it's rhbz, not lp)16:51
openstackbugzilla.redhat.com bug 1493175 in openstack-neutron "Update of VM port to have different number of security groups fails with Error 500" [High,New] - Assigned to amuller16:51
ihrachyswe will need to have a look, may be a reason of some scenario failures16:51
ihrachysand it's in db layer.16:51
ihrachysfails on refresh(port_db) call somewhere16:51
ihrachysso probably affects everyone, not specific to backend16:52
*** rcernin has quit IRC16:52
*** tesseract has quit IRC16:52
ihrachysalso, to recap the ptg discussions, dvr folks were planning to adopt fullstack suite for testing different agent deployment modes16:52
ihrachysI assume haleyb will follow up with Swami on that one16:53
*** baoli has joined #openstack-meeting16:53
ihrachysthat's all I have16:53
ihrachysanything else to discuss?16:53
ihrachyshaleyb, jlibosva16:53
jlibosvanot from me16:53
haleybnothing here16:53
ihrachysgood. thanks for joining. we should have progress next time we meet. green gate future ahead.16:54
ihrachyso/16:54
ihrachys#endmeeting16:54
*** JudeC has joined #openstack-meeting16:54
*** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings"16:54
openstackMeeting ended Tue Sep 19 16:54:18 2017 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)16:54
openstackMinutes:        http://eavesdrop.openstack.org/meetings/neutron_ci/2017/neutron_ci.2017-09-19-16.00.html16:54
openstackMinutes (text): http://eavesdrop.openstack.org/meetings/neutron_ci/2017/neutron_ci.2017-09-19-16.00.txt16:54
* jlibosva likes green16:54
openstackLog:            http://eavesdrop.openstack.org/meetings/neutron_ci/2017/neutron_ci.2017-09-19-16.00.log.html16:54
jlibosvathanks, bye16:54
*** jlibosva has quit IRC16:54
*** yamahata has joined #openstack-meeting16:56
*** dprince has joined #openstack-meeting16:56
*** baoli has quit IRC16:56
*** gouthamr has quit IRC17:01
*** gouthamr has joined #openstack-meeting17:02
*** baoli has joined #openstack-meeting17:04
*** dalvarez has quit IRC17:06
*** Swami has quit IRC17:07
*** lpetrut has quit IRC17:09
*** radez has quit IRC17:09
*** xyang1 has joined #openstack-meeting17:13
*** fnaval has joined #openstack-meeting17:14
*** sambetts is now known as sambetts|afk17:14
*** fzdarsky is now known as fzdarsky|afk17:17
*** unicell has joined #openstack-meeting17:20
*** Swami has joined #openstack-meeting17:24
*** efoley has quit IRC17:28
*** bobh has joined #openstack-meeting17:29
*** reedip_ has quit IRC17:30
*** dalvarez has joined #openstack-meeting17:30
*** ijw has joined #openstack-meeting17:30
*** marios has quit IRC17:32
*** bobh has quit IRC17:33
*** ad_rien_ has joined #openstack-meeting17:37
*** ad_rien_1 has quit IRC17:37
*** rtjure has quit IRC17:38
*** rbak has joined #openstack-meeting17:40
*** rtjure has joined #openstack-meeting17:42
*** abalutoiu_ has joined #openstack-meeting17:45
*** martinkopec has joined #openstack-meeting17:45
*** StefanPaetowJisc has joined #openstack-meeting17:46
*** rbak has quit IRC17:46
*** gagehugo has joined #openstack-meeting17:47
*** electrofelix has quit IRC17:48
*** abalutoiu has quit IRC17:48
*** harlowja has joined #openstack-meeting17:49
*** haleyb has quit IRC17:50
*** haleyb has joined #openstack-meeting17:55
*** spilla has joined #openstack-meeting17:55
*** ssathaye has quit IRC17:57
*** ociuhandu has quit IRC17:58
*** ociuhandu has joined #openstack-meeting17:58
*** baoli has quit IRC17:58
*** baoli has joined #openstack-meeting17:59
*** julim_ has joined #openstack-meeting18:01
samueldmqping ayoung, breton, cmurphy, dstanek, edmondsw, gagehugo, henrynash, hrybacki, knikolla, lamt, lbragstad, lwanderley, notmorgan, rderose, rodrigods, samueldmq, spilla, aselius, dpar18:01
gagehugoo/18:02
hrybackio/18:02
samueldmq#startmeeting keystone18:02
openstackMeeting started Tue Sep 19 18:02:04 2017 UTC and is due to finish in 60 minutes.  The chair is samueldmq. Information about MeetBot at http://wiki.debian.org/MeetBot.18:02
openstackUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.18:02
rodrigodso/18:02
*** openstack changes topic to " (Meeting topic: keystone)"18:02
lamto/18:02
gagehugoo/18:02
openstackThe meeting name has been set to 'keystone'18:02
hrybackio/18:02
knikollao/18:02
raildo_o_18:02
gagehugo\o18:02
samueldmqhi all18:02
*** julim has quit IRC18:02
samueldmq#link https://etherpad.openstack.org/p/keystone-weekly-meeting18:02
*** rbak has joined #openstack-meeting18:02
gagehugokeystone has an ansible gate now?18:02
samueldmqhere is our agenda for today, nothing long or special18:02
samueldmqI hope you all have had a great time at the PTG. it felt very productive18:03
* hrybacki agrees18:03
gagehugoagreed18:03
samueldmq#topic api-ref reorganization18:03
*** openstack changes topic to "api-ref reorganization (Meeting topic: keystone)"18:03
samueldmqso, we did talked about it a bit in our documentation discussion at the PTG18:04
samueldmq#link https://etherpad.openstack.org/p/queens-ptg-keystone-doc-cleanup18:04
samueldmqwe've come to a format we'd like to keep the api-ref docs in, but I came with another approach when looking at the actual docs18:04
hrybackistarting on line 54?18:05
samueldmqthe general idea is to have 3 main sections only: header with description and relationship links18:05
samueldmqhrybacki: yes18:05
samueldmqanother for request, and the last for response18:05
samueldmqavoiding request params, response, status codes, example request, example response18:05
samueldmqin different places18:05
samueldmqI've made 2 patches as example so you may have a feeling of what it looks like18:06
samueldmq#link https://review.openstack.org/#/q/status:open+project:openstack/keystone+branch:master+topic:api-ref-reorganization18:06
samueldmqreviews appreciated :)18:06
hrybackiLooks good at a cursory glance!18:06
gagehugosamueldmq will do18:07
samueldmqhrybacki: yes, that's my feeling too. if we share that view we can go ahead and change everything18:07
knikollai don't have any particular preferences as long as we're consistent18:07
samueldmqwe have a potential outreachy intern willing to do some of that work18:07
*** lpetrut has joined #openstack-meeting18:07
samueldmq#link https://review.openstack.org/#/c/505135/18:07
hrybackisamueldmq: for the win18:08
samueldmqSuramya did this ^18:08
samueldmqhrybacki: ++18:08
samueldmqcool, I guess we can quickly move to open discussion as there isn't much on this topic anymore18:08
samueldmq#topic open discussion18:08
*** openstack changes topic to "open discussion (Meeting topic: keystone)"18:08
hrybackio/18:08
*** AJaeger has joined #openstack-meeting18:08
samueldmqdid it set the topic?18:09
hrybackiit did18:09
* samueldmq nods18:09
hrybackiJust another ask: If you haven't already, please take a look at the policy roadmap please do. I'll be creating Trello stuff to track items18:09
hrybacki#link Just another ask: If you haven't already, please take a look at the policy roadmap18:09
hrybackiwhoops18:09
hrybacki#undo18:09
hrybacki#link https://etherpad.openstack.org/p/queens-ptg-keystone-doc-cleanup18:09
hrybackido I need rights for ^^ ?18:09
hrybackigrr and I'm really bad with copy/paste today18:10
gagehugothe link will be in the log so it's probably good18:10
samueldmqI don't think so. I guess you wanted a different link though18:10
hrybacki#link https://etherpad.openstack.org/p/queens-PTG-keystone-policy-roadmap18:10
hrybackiTHAT is what I meant to paste.18:10
hrybackithat's all I have18:10
hrybackiand thanks for those that have already helped revise it!18:10
*** spilla has quit IRC18:11
samueldmqhrybacki: great, thanks for that.18:11
edmondswo/18:12
* edmondsw starts reading back18:12
samueldmqgagehugo: you had a question on keystone having an ansible gate at the beginning of the meeting?18:12
gagehugoyeah I just noticed it on your api-ref change18:13
gagehugoseems like it's a new thing?18:13
gagehugomaybe from the upgrade18:13
samueldmqyes seems new to me too, I don;t have details on it though18:13
gagehugook18:14
samueldmqdoes anybody have anything else to discuss?18:14
edmondswjust saw that lbragstad has posted a PTG recap everyone should probably read: https://www.lbragstad.com/blog/keystone-queens-ptg-summary18:15
samueldmqedmondsw: that's awesome, thanks for the link18:15
hrybackiedmondsw++18:15
samueldmq#link https://www.lbragstad.com/blog/keystone-queens-ptg-summary18:15
samueldmqit's great for those who were there to recap18:15
*** pvaneck has joined #openstack-meeting18:15
samueldmqand for those who were not able to attend so they can catch up18:15
edmondswyep18:15
*** markstur has joined #openstack-meeting18:15
hrybackishould we push this out to openstack-dev ?18:16
hrybackiI see other projects sending out recaps from PTG18:16
samueldmqhrybacki: that wouldn't hurt anyone18:16
edmondswhrybacki probably, but I would let lbragstad do that18:16
hrybackiack18:16
samueldmqlast call, anything else?18:17
*** diablo_rojo has joined #openstack-meeting18:17
samueldmqlet's keep up the great work keystoners18:17
samueldmqthank you all for coming18:18
hrybackithanks for running the mtg samueldmq!18:18
samueldmqit was a pleasure18:18
samueldmq#endmeeting18:18
*** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings"18:18
openstackMeeting ended Tue Sep 19 18:18:20 2017 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)18:18
openstackMinutes:        http://eavesdrop.openstack.org/meetings/keystone/2017/keystone.2017-09-19-18.02.html18:18
openstackMinutes (text): http://eavesdrop.openstack.org/meetings/keystone/2017/keystone.2017-09-19-18.02.txt18:18
openstackLog:            http://eavesdrop.openstack.org/meetings/keystone/2017/keystone.2017-09-19-18.02.log.html18:18
*** markstur_ has quit IRC18:19
*** StefanPaetowJisc has quit IRC18:22
*** rtjure has quit IRC18:24
*** bobh has joined #openstack-meeting18:27
*** ayoung has joined #openstack-meeting18:28
*** ad_rien_ has quit IRC18:31
*** StefanPaetowJisc has joined #openstack-meeting18:32
*** felipemonteiro__ has quit IRC18:34
*** ociuhandu has quit IRC18:34
*** felipemonteiro__ has joined #openstack-meeting18:35
*** rbowen has quit IRC18:40
*** Shrews has joined #openstack-meeting18:40
*** lpetrut has quit IRC18:40
*** rbowen has joined #openstack-meeting18:41
*** felipemonteiro has joined #openstack-meeting18:44
*** sshank has quit IRC18:45
*** StefanPaetowJisc has quit IRC18:46
*** felipemonteiro__ has quit IRC18:46
*** ijw has quit IRC18:46
*** ricolin has quit IRC18:46
*** galstrom_zzz is now known as galstrom18:51
*** cschwede has quit IRC18:55
clarkbhello infraers18:59
fungihowdy18:59
AJaeger\o/18:59
jeblairhi19:00
clarkbits going to be a full meeting I think so going t oget the ball rolling early19:00
clarkb#startmeeting infra19:00
openstackMeeting started Tue Sep 19 19:00:09 2017 UTC and is due to finish in 60 minutes.  The chair is clarkb. Information about MeetBot at http://wiki.debian.org/MeetBot.19:00
openstackUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.19:00
*** openstack changes topic to " (Meeting topic: infra)"19:00
openstackThe meeting name has been set to 'infra'19:00
clarkb#link https://wiki.openstack.org/wiki/Meetings/InfraTeamMeeting#Agenda_for_next_meeting19:00
clarkb#topic Announcements19:00
*** openstack changes topic to "Announcements (Meeting topic: infra)"19:00
clarkbreally quickly going to remind everyone to sign the queens release key. I Haven't done it yet and feel very guilty over this19:00
ianwo/19:01
clarkbAlso if you haven't noticed we just upgraded gerrit and while a bumpy start I think we are starting to get a handle on things? more on that later19:01
clarkb#topic Actions from last meeting19:01
*** openstack changes topic to "Actions from last meeting (Meeting topic: infra)"19:01
clarkbWe had a couple but I think we agreed to put them on the back burner for now. Particularly the infracloud one (also more on that later :) )19:01
pabelangero/19:01
*** rbak has quit IRC19:01
clarkb#topic Specs approval19:02
*** openstack changes topic to "Specs approval (Meeting topic: infra)"19:02
clarkbI havne't really had a chance to look at these since the last meeting. I don't think there is anything outstanding right now. Please do ping me if there is something urgent19:02
mordredo/19:02
*** VW_ has joined #openstack-meeting19:02
*** baoli has quit IRC19:02
clarkband with that we can move on to the portion of the meeting that everyone is waiting for19:02
clarkb#topic Priority Efforts19:02
*** openstack changes topic to "Priority Efforts (Meeting topic: infra)"19:02
clarkb#topic Zuul v319:03
*** openstack changes topic to "Zuul v3 (Meeting topic: infra)"19:03
clarkbLots of things related to Zuulv3 happened last week at hte PTG19:03
clarkblots of on zuulv3 things happened too which we'll get to after the priority specs19:03
*** baoli has joined #openstack-meeting19:03
*** VW_ has quit IRC19:03
fungilots19:03
jeblairmy memory is that we worked on jobs + migration script a lot19:04
AJaeger;)19:04
*** VW_ has joined #openstack-meeting19:04
clarkbI know the zuul meeting was cancelled yesterday in favor of getting gerrit upgraded so now is the chance ot catch up on all that goodness19:04
*** tobiash has joined #openstack-meeting19:04
AJaegerlots of open changes in the queue to review...19:04
jeblairmordred is continuing to work on migration script19:04
jeblairmordred: i think it emits actual job output now?19:04
jeblairmordred: do you think we can, say, run some nova check jobs tomorrow or something?19:04
*** felipemonteiro has quit IRC19:05
jeblairandreaf wrote a basic native v3 tempest job that builds on the basic native v3 devstack job19:05
jeblairi haven't reviewed that yet, but hope to soon19:05
*** felipemonteiro has joined #openstack-meeting19:05
jeblairthat's in devstack-gate repo (for now; we'll move it to tempest soon)19:05
clarkbis that the first job addition from outside of zuul development?19:05
*** VW has quit IRC19:06
jeblairclarkb: i don't want to figure out who's "inside" or "outside" enough to answer that question :)19:06
*** StefanPaetowJisc has joined #openstack-meeting19:06
*** felipemonteiro__ has joined #openstack-meeting19:06
jeblairbut having andreaf self-bootstrap into writing a v3 job is awesome :)19:06
clarkb++19:06
* fungi cheers19:06
AJaegerYeah!19:07
jeblairtristanC showed us his in-progress dashboard work which will be important once we finish the cutover19:07
jeblair(hopefully we're not far away from having a job history dashboard)19:07
jeblairwe have some ideas of how it and openstack-health can be complementary19:07
jeblairtobias has patches in progress to nodepool to improve quota support19:08
jeblairthat will allow us to use smaller flavors for, say, pep8 jobs19:08
mordredjeblair: yes - there is a giant stack of patches I'll bug people about tomorrow when this migration is done19:08
jeblair(and therefore increase our apparent capacity)19:08
jeblairmordred: awesome!19:08
clarkbfor us to make use of that we may need some quota changes (as we have instance quotas that line up with ram use in most cases)19:09
jeblairclarkb: yeah, but it'll be a good problem to have :)19:09
clarkbindeed19:09
dmsimardI have a series of patches that should be mostly ready to land as far as multi node in v3 in concerned19:09
*** felipemonteiro has quit IRC19:09
dmsimardhttps://review.openstack.org/#/q/topic:zuulv3-multinode19:09
*** cloudrancher has quit IRC19:10
jeblairwe also did a roadmap exercise at the end of the week.  we were exhausted, so it's only in rough etherpad form at this point.  some time this week or next, i'll write it up for further discussion, so we can all get on the same page for what we do between the openstack cutover and v3 release, and what comes after.19:10
dmsimardzuul-jobs has the role bits while the jobs/integration testing is in openstack-zuul-jobs19:10
jeblairdmsimard: great!19:10
dmsimardpabelanger and I discussed that it's worth thinking about when and where we'll want to trigger the base-integration and multinode-integration jobs (filtering on files?)19:10
*** cloudrancher has joined #openstack-meeting19:11
jeblairi need to track down problems with logstash job submission.  that's the only transition blocker (aside from migration script) that i'm aware of19:11
mordredstack of patches related to migration script from me ends with: https://review.openstack.org/#/c/50496819:11
clarkb#link https://review.openstack.org/#/c/504968 Zuulv3 job migration scripting19:11
clarkb#link https://review.openstack.org/#/q/topic:zuulv3-multinode Native zuulv3 multinode jobs19:12
dmsimardOnce the zuulv3-multinode stack has landed, I'll try and see how hard it would be to bring up a native devstack multinode19:12
jeblair#link https://etherpad.openstack.org/p/zuulv3-roadmap rough draft post-cutover roadmap19:12
mordredhrm - I'm going to re-topic migration patches to zuulv3-migration19:12
fungirather than just zuulv3?19:13
clarkb#link https://review.openstack.org/#/q/topic:zuulv3-migration Also for migration scripting19:13
fungioh, right, they're on the feature/zuulv3 branch already19:13
fungiso show up in queries that way19:14
*** slaweq has quit IRC19:14
*** slaweq has joined #openstack-meeting19:14
dmsimardit's probably trivial to filter on topic:^zuulv3.* or something regardless19:14
dmsimardbecause those patches are not necessarily on the zuul repo with feature/v3 branch19:14
dmsimardi.e, project config, zuul jobs, etc19:15
fungii guess i should update my query19:15
jeblairif folks could use 'zuulv3' as the topic for any patch not on a feature/zuulv3 branch, that would be great19:15
jeblairon feature/zuulv3, a topic *other than* zuulv3 is helpful.  :)19:15
clarkb#action everyone use 'zuulv3' as the topic for any patch not on a feature/zuulv3 branch, that would be great. on feature/zuulv3, a topic *other than* zuulv3 is helpful.19:16
dmsimardhmm, at first glance it doesn't seem like it's possible to put a regex for the topic field search :/19:16
jeblair(so mordred's zuulv3-migration here is great)19:16
*** pchavva has quit IRC19:17
mordredjeblair: WELL - except that zuulv3-migration has a bunch of patches on project-config too - it's a tricky little devil19:17
dmsimardoh, gerrit has an 'intopic' search parameter so https://review.openstack.org/#/q/intopic:zuulv3 works19:17
*** Sukhdev has joined #openstack-meeting19:17
jeblairmordred: those are the most important to have 'zuulv3' as the topic19:17
*** felipemonteiro has joined #openstack-meeting19:18
clarkb#link https://review.openstack.org/#/q/intopic:zuulv3 for everything zuulv3 related19:18
clarkbjeblair: mordred would probably be good to have a summary of the currnet plan going forward as well19:18
clarkb(once through general status updates)19:18
jeblairmordred: did you send out that email?19:19
clarkbhe did19:19
dmsimardhe did :)19:19
*** felipemonteiro__ has quit IRC19:19
jeblairthat probably covers the current plan afaik19:20
mordredk. I've updated the zuulv3-migration topic on project-config patches to just be zuulv319:20
*** felipemonteiro__ has joined #openstack-meeting19:20
clarkbok let me dig up a link for it19:20
*** jlk has joined #openstack-meeting19:20
mordredwell - that plan is "planning on doing a rollout on Monday" - we probably want to have a slightly more detailed infra-team plan19:21
clarkb#link http://lists.openstack.org/pipermail/openstack-dev/2017-September/122241.html Zuulv3 rollout plans email19:21
*** m-greene_ has quit IRC19:21
clarkbanything else we want to go over on Zuulv3 related items?19:23
mordredwell - lemme say one more quick thing about migration script19:23
*** felipemonteiro has quit IRC19:24
mordredonce the patches from me in zuul, project-config, openstack-zuul-jobs are landed ...19:24
mordredto my knowledge the migration script is good to go19:24
*** felipemonteiro has joined #openstack-meeting19:24
dmsimardmordred: I'd like to test drive some sanity checks against what I feel is most vulnerable -- deployment projects (openstack-ansible, puppet-openstack, kolla, tripleo, etc)19:24
mordredso it's important to start combing through the generated content for bugs19:24
dmsimardCan I go ahead and "whitelist" those projects in main.yaml and submit what would be their "migrated" jobs as zuul.yaml in their repos ?19:25
Shrewsi second mordred's suggestion. there WILL be bugs. some of that script is... complicated19:25
jeblairdmsimard: let's not submit any auto-generated content to project repos19:25
mordreddmsimard: I'd prefer we didn't, as we won't have any way of knowing which things we've submitted to project repos19:25
mordredgah. jeblair said that with less words19:25
jeblairdmsimard: let's put that in project-config and/or openstack-zuul-jobs19:26
dmsimardjeblair, mordred: I'm not planning on merging anything, it will be -W19:26
*** m-greene_ has joined #openstack-meeting19:26
*** felipemonteiro__ has quit IRC19:26
*** jrist has joined #openstack-meeting19:26
dmsimardif we want test drives to be in project-config and openstack-zuul-jobs, that requires merging and reverting things19:26
jeblairdmsimard: i'm fine with that.19:27
dmsimardok, sure.19:27
jeblairi'd rather do that than have people get the mistaken idea that we might want to merge the auto-generated stuff in their repos19:27
Shrewsmordred: perhaps we should outline what to expect for migration script output? like expanded templates, job name changes, etc. might help others review19:27
jeblairthis is a PR issue, not a technical one.  :)19:27
mordredShrews: ++19:27
clarkbShrews: I think that would be helpful19:27
*** StefanPaetowJisc has quit IRC19:28
dmsimardmordred: did that zuul-sphinx zuul.d fix land so we could at least put the tests in a separate file ?19:28
mordredalso - it's worth pointing out that several of the migration script 'fixes' I've made over the weekend were actually fixes or changes to old jobs or just making a new v3 version19:28
jeblairmordred: do you think we need to add anything to the infra-manual migration doc?19:28
AJaegerdmsimard: https://review.openstack.org/#/c/504797/ did not merge yet19:28
mordredoh - right ... jeblair ^^19:28
dmsimardAJaeger: thanks, just added zuulv3 topic19:29
mordredjeblair: zuul-sphinx no support zuul.d19:29
jeblair++19:29
mordredso I think a doc (and/or update to infra-manual) about expected outcome from migration script - as well as a few notes about where these things expect to go ...19:30
mordredlike, migrated project-pipeline stuff goes into project-config zuul.yaml but jobs and project-templates go into openstack-zuul-jobs19:30
mordredand playbooks19:30
jeblairthat sounds helpful19:31
*** tinwood has quit IRC19:31
jeblair("i heard you migrated stuff, where the cloud is it?")19:31
mordredbut - just spot-checking things randomly often finds things with the eyeballs19:31
mordredfor instance, I now notice this:19:31
mordredhttp://logs.openstack.org/79/505379/1/check/zuul-migrate/06587d2/playbooks/legacy/manila-tempest-minimal-dsvm-lvm-centos-7/run.yaml19:31
mordredecho "Detailed logs: http://logs.openstack.org/$LOG_PATH/"19:31
mordredshould likely do something about that :)19:32
jeblairwho wants to write the infra-manual changes?19:32
*** tinwood has joined #openstack-meeting19:32
*** rbak has joined #openstack-meeting19:32
mordredI can take that on19:33
mordredunless someone else wants to :)19:33
*** slaweq_ has joined #openstack-meeting19:33
*** martinkopec has quit IRC19:33
clarkblets say mordred tag you are it and if anyone else finds time or wants to help they can ping mordred?19:34
Shrewsmordred: i'll email you a section on "matchers" that you can include19:34
clarkb#action mordred update infra-manual documentation on what to do with migrated zuulv3 jobs19:34
clarkbThat look right?19:34
*** rbowen has quit IRC19:35
*** StefanPaetowJisc has joined #openstack-meeting19:35
clarkbready to move on to the other priority spec relevant to yesterday and today?19:36
jeblair+19:36
fungiindeed!19:36
*** slaweq has quit IRC19:37
clarkb#topic Gerrit 2.13 Upgrade19:37
*** openstack changes topic to "Gerrit 2.13 Upgrade (Meeting topic: infra)"19:37
clarkbThis mostly happened yesterday19:37
clarkbamazingly we fit it into the allocated outage time even though database migrations took 5 hours19:37
clarkbThank you everyone for helping make that happen19:37
fungithat was nuts19:37
clarkbUnfortunately we've turned over some new and exciting behavior around stream events and gerrit email and memory usage and so on that we are trying to address19:38
jeblairand special thanks to zaro for doing work a year ago to cause us to finish within our window :)19:38
clarkb++19:38
clarkbCurrent issues are being tracked at https://etherpad.openstack.org/p/gerrit-2.13-issues19:38
clarkb#link https://etherpad.openstack.org/p/gerrit-2.13-issues19:38
clarkbFor the most part I think we have a handle on the problems and a good chunk of fixes or attempts at fixes19:38
fungiabsolutely. i don't know for sure that the reindex ordering optimization sped it up, but i'm happy to believe that was it19:39
*** rbowen has joined #openstack-meeting19:39
clarkbMy biggest concerns right now are the memory use and email slowness. I think the memory use is actually likely to be ok based on utilization today. Jeblairs change to bump max memory seemed to get us to a happy place and gerrit isn't leaking memory all over the floor (it decreases even)19:39
*** felipemonteiro__ has joined #openstack-meeting19:40
fungithough the weirdness around edits via api/webui are troubling19:40
clarkbThat all said does anyone think we need to be considering a rollback? For me I think that was on the table before the memory stuff got sorted but am feeling much more comfortable with moving forward and fixing things19:40
*** simon-AS5591 has joined #openstack-meeting19:40
clarkbnow19:40
fungii'm still good with rolling forward at this point19:41
jeblairyeah, the problems yesterday may have been caused by some anomolous event (there was a 500mbps outbound spike when it got bad).  or we may have needed more jvm ram.  it's not clear.19:41
jeblairyeah, if we've managed to get this far without a memory catastrophe, i think forward is the way to go19:41
ianwagree ... it's not out of bounds from what we saw with previous release that went mad occasionally too19:42
clarkbok good, I didn't want to put a bunch of effort into fixing problems if we were feeling like a revert is warranted. Glad to know no one is ready to go down that route yet :)19:42
clarkbAfter the meeting we will be applying fixes for a bunch of the problems on that list, hopefully we see improvements.19:43
clarkbOnce again thank you everyone for helping19:43
*** felipemonteiro has quit IRC19:43
clarkbProbably the other big item related to this is that we are not merging new project creation changes19:44
clarkbwant to get everything working and happy before doing that as we have had some puppet related issues around project creation and nodepool image builds19:44
mordred++19:44
clarkbanything else I've missed here? I guess see everyone after the meeting to do the great service restart of Tuesday September 1919:45
clarkb#topic PTG recap19:46
*** openstack changes topic to "PTG recap (Meeting topic: infra)"19:46
clarkb#topic Infracloud19:46
*** openstack changes topic to "Infracloud (Meeting topic: infra)"19:46
clarkbWe talked about things that weren't zuulv3 at the PTG too. I think one of the more important items was the future of infracloud19:47
clarkbI've summarized the plans around that at http://lists.openstack.org/pipermail/openstack-infra/2017-September/005585.html if you have an interest in infracloud and haven't read that email please do. Feedback is very welcome19:47
*** rbak has quit IRC19:48
clarkbTL;DR is that it probably isn't viable to move existing hardware due to cost and logistcal problems (we need rails..). As a result we likely don't want to put effort into upgrading the current cloud regions and instead let them die on the vine19:48
clarkb#topic PTG recap19:48
*** openstack changes topic to "PTG recap (Meeting topic: infra)"19:48
clarkbOther items that came up were the future of puppet testing. I think we've got a plan where we can replace beaker jobs with something a bit more test suite agnostic and even config management tool independent. This fits into zuulv3 and potentially allows for individuals to write ansible replacements of puppet things and have them be tested in similar manners19:49
clarkbWe also talked about replacing puppetboard with ara. I think dmsimard said there will be a spec up for that19:50
jeblairooh that would be nice19:50
jeblairthat would be nice too19:50
jeblair(my oohs and aahs are lagging)19:50
clarkb:)19:50
clarkbThe other big item on my list was talkin about monitoring of control plane srevices19:50
clarkbThere was general agreement this would be ok as long as any alerting was purely opt in by roots and if someone or group would be responsible for tuning things19:50
*** radez has joined #openstack-meeting19:51
clarkbI expect that that will be an interesting spec with probably lots of alternatives weighing the pros and cons of a variety of monitoring tools out there19:51
clarkbdmsimard: ^ you still up to writing those?19:51
ianwclarkb: will you be issuing pagers :)19:52
clarkb(I know everyone is currently busy with zuul and gerrit things so no rush, but expect tosee that in infra-specs at some point if interested or maybe you can even help write the specs)19:52
clarkbianw: please no :) and in fact that was basically that jeblair said. No pager duty19:52
clarkbwe can collect the info and use it but we aren't oncall and shouldn't have our sleep interrupted19:52
clarkbOk I think I managed to get through the entire agenda I had. Sorry if it felt rushed.19:53
clarkb#topic Open Discussion19:53
*** openstack changes topic to "Open Discussion (Meeting topic: infra)"19:53
clarkbanything else for the last ~5 minutes or so of the alotted time?19:53
jlkmonitoring and metrics can help inform future development and such, but shouldn't be waking volunteers up :D19:53
fungigood work on the agenda!19:53
* AJaeger put one item on the agenda:19:54
*** qwebirc62919 has joined #openstack-meeting19:54
AJaegerThere's a discussion about <= mitaka EOL branches at http://lists.openstack.org/pipermail/openstack-dev/2017-August/121432.html19:54
*** galstrom is now known as galstrom_zzz19:54
clarkboh the mitaka eol. Sorry that didn't make it to my local text file19:54
*** qwebirc62919 has quit IRC19:54
AJaegerand mordred has a change up at https://review.openstack.org/#/c/50496419:54
AJaegerDo we want to remove all the regexes etc like in 504964 - or first retire all <= mitaka branches?19:54
fungithere was also something on the agenda about dropping cached git clones (or not) but i think that was from the meeting prior to the ptg?19:55
AJaegeror are those not related?19:55
clarkbfungi: ya I think that is leftovers from last meeting when infra cohosted zuul19:55
clarkbAJaeger: I think we can likely do them independently especially if plan is to remove those branches anyways19:55
clarkbAJaeger: but we can sync up with tonyb later today to make sure that works for him19:55
*** StefanPaetowJisc has quit IRC19:56
AJaegerclarkb: yeah, syncing with tonyb sounds best next step...19:56
ianwAJaeger / tonyb: i can also help with branch removal in our tz if needs be ... i figured it out :)19:57
clarkbAJaeger: I know your timezones don't overlap much. I can try pinging him once not swamped with gerrit related items19:57
clarkboh ++ to ianw19:57
fungion a related note, we're slowly getting feedback on projects okay with us deleting their date-based releases from pypi19:57
*** raildo has quit IRC19:57
fungii did a batch of them right before the ptg where the release team was able to make the call19:57
AJaegerianw: will you take care of it and discuss with tonyb ? Would be best IMHO19:57
fungibut now the ones which aren't under release management are slowly trickling in19:58
mordredAJaeger, ianw: we could also just remove those right before the migration19:58
*** StefanPaetowJisc has joined #openstack-meeting19:58
AJaegerclarkb: want to give ianw an #action?19:58
mordredthe main thing is tht they cause a bunch of projects to not actually use the project-template in v319:58
clarkbas long as ianw is ok with it19:58
AJaegermordred: I don't care about timing, just that it gets done if needed19:58
ianwyes, ok19:58
clarkb#action ianw Work with tonyb to coordinate old stable branch removal from projects19:58
mordredand in v3 we can, should we want, add a branch exclusion to the project-tempalte itself19:58
mordredAJaeger: cool19:58
clarkband we are out of time19:59
clarkbThanks everyone!19:59
clarkb#endmeeting19:59
*** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings"19:59
openstackMeeting ended Tue Sep 19 19:59:18 2017 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)19:59
AJaegerthanks, clarkb19:59
openstackMinutes:        http://eavesdrop.openstack.org/meetings/infra/2017/infra.2017-09-19-19.00.html19:59
openstackMinutes (text): http://eavesdrop.openstack.org/meetings/infra/2017/infra.2017-09-19-19.00.txt19:59
openstackLog:            http://eavesdrop.openstack.org/meetings/infra/2017/infra.2017-09-19-19.00.log.html19:59
*** jlk has left #openstack-meeting19:59
mordredAJaeger: just don't want to rush anyone to land it while v2 is live if it's a problem - since we can solve the same thing better post migration19:59
fungithanks clarkb!19:59
mordredAJaeger: but expressing that specific thign in the migration script itself is ... extra hard :)19:59
AJaeger;/19:59
*** AJaeger has left #openstack-meeting20:00
fungireminder: no tc meeting today, but feel free to join the next tc office hours in #openstack-tc at 01:00 utc!20:00
*** VW_ has quit IRC20:00
*** VW has joined #openstack-meeting20:02
*** StefanPaetowJisc has quit IRC20:02
*** VW has quit IRC20:02
*** VW has joined #openstack-meeting20:03
*** gouthamr has quit IRC20:03
*** tobiash has left #openstack-meeting20:06
*** StefanPaetowJisc has joined #openstack-meeting20:06
*** sgrasley1 has quit IRC20:06
*** jesusaur has quit IRC20:08
*** Shrews has left #openstack-meeting20:08
*** powerd has joined #openstack-meeting20:09
*** sshank has joined #openstack-meeting20:10
*** jesusaur has joined #openstack-meeting20:11
*** rajulk has joined #openstack-meeting20:11
*** ricolin has joined #openstack-meeting20:11
*** baoli has quit IRC20:12
*** galstrom_zzz is now known as galstrom20:13
*** sshank has quit IRC20:13
*** baoli has joined #openstack-meeting20:13
*** StefanPaetowJisc has quit IRC20:13
*** rcernin has joined #openstack-meeting20:14
*** raildo has joined #openstack-meeting20:17
*** sshank has joined #openstack-meeting20:17
*** jkilpatr has quit IRC20:18
*** baoli has quit IRC20:18
*** baoli has joined #openstack-meeting20:19
*** julim_ has quit IRC20:21
*** dtrainor has quit IRC20:22
*** e0ne has joined #openstack-meeting20:22
*** dtrainor has joined #openstack-meeting20:23
*** ssathaye has joined #openstack-meeting20:28
*** e0ne has quit IRC20:28
*** ssathaye has quit IRC20:30
*** jprovazn has quit IRC20:30
*** gagehugo has left #openstack-meeting20:33
*** ijw has joined #openstack-meeting20:37
*** powerd has quit IRC20:37
*** Sukhdev has quit IRC20:41
*** jkilpatr has joined #openstack-meeting20:42
*** jrist has quit IRC20:43
*** cleong has quit IRC20:44
*** lbrune has quit IRC20:45
*** xyang1 has quit IRC20:46
*** oneswig has joined #openstack-meeting20:51
*** citrus has joined #openstack-meeting20:52
*** citrus has left #openstack-meeting20:54
*** martial has joined #openstack-meeting20:58
*** sshank has quit IRC20:58
oneswighowdy21:00
oneswig#startmeeting scientific-wg21:00
openstackMeeting started Tue Sep 19 21:00:44 2017 UTC and is due to finish in 60 minutes.  The chair is oneswig. Information about MeetBot at http://wiki.debian.org/MeetBot.21:00
openstackUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.21:00
*** openstack changes topic to " (Meeting topic: scientific-wg)"21:00
openstackThe meeting name has been set to 'scientific_wg'21:00
*** esberglu has quit IRC21:00
oneswig#chair martial21:00
openstackCurrent chairs: martial oneswig21:00
oneswig#link Agenda for today https://wiki.openstack.org/wiki/Scientific_working_group#IRC_Meeting_September_19th_201721:01
*** esberglu has joined #openstack-meeting21:01
rajulkhi martial21:01
martialHi Stig21:01
oneswigHello martial rajulk, good evening21:01
oneswiggood afternoon, etc.21:01
rajulkhi oneswig21:01
rajulkgood evening21:02
martialI see Mr Kumar is already with us, wonderful :)21:02
priteauHello21:02
oneswigHey priteau, how are you?21:02
rajulk:)21:02
hogepodgehi21:02
simon-AS5591Hello all21:02
*** b1airo has joined #openstack-meeting21:02
oneswig#chair b1airo21:02
openstackCurrent chairs: b1airo martial oneswig21:02
oneswigmorning Blair21:03
b1airoMorning21:03
*** sshank has joined #openstack-meeting21:03
oneswigOK, lets roll?21:03
oneswig#topic Scientific Hackathon21:03
*** openstack changes topic to "Scientific Hackathon (Meeting topic: scientific-wg)"21:03
b1airoYep, sounds good. I'm just feeding the animals here so will keep one eye on this.21:03
oneswigFlanders mentioned the scientific hackathon is looking for mentors21:04
oneswig#link http://hackathon.openstack.org.au/mentors/21:04
oneswigWhat else would you do in a dump like Sydney while the jetlag wears off :-)21:04
rbuddenhello21:05
oneswigNot that we are a mercenary bunch, I did see mention of summit tickets in return...21:05
oneswigHi rbudden21:05
*** esberglu has quit IRC21:05
oneswigThe hackathon starts Friday afternoon before the summit if anyone is around and interested in taking part21:06
*** StefanPaetowJisc has joined #openstack-meeting21:06
martialblairo oneswig: I apologize, I need to sign off for a few minutes, will be back as soon as I can21:06
oneswig#item OpenStack London21:06
oneswigmartial: np21:06
*** martial has quit IRC21:06
oneswigIs next Tuesday!21:06
oneswigWe have a WG session for those attending.21:06
oneswigProbably not a big win in this time zone...21:07
b1airoGreat to hear oneswig21:07
oneswigI wanted to mention though, we are looking for lightning talks for the BoF, and in customary fashion there is now a small prize for best talk21:07
b1airoHopefully drum up some new members21:08
oneswigI think so too.  Many of the presentations of the main schedule are scientifically oriented.21:08
oneswigAm hoping to meet some new faces.21:08
*** e0ne has joined #openstack-meeting21:08
oneswig(and some old ones, of course)!21:09
priteauoneswig: Do you know if talks will be recorded?21:09
oneswigThey were last year.  They usually are.21:09
oneswigOK, that's all to add there I think.21:10
*** StefanPaetowJisc has quit IRC21:10
oneswig#topic Opportunistic utilisation for HTC/HPC21:10
*** openstack changes topic to "Opportunistic utilisation for HTC/HPC (Meeting topic: scientific-wg)"21:10
oneswigWe have Rajul Kumar with us today from Northeastern Uni in Boston MA21:11
oneswig#link Rajul's presentation made in Boston https://www.openstack.org/videos/boston-2017/hpchtc-and-cloud-making-them-work-together-efficiently21:11
*** Alex_Staf has joined #openstack-meeting21:11
rajulkhello everyone21:11
oneswig#link Slides for the presentation are here: https://drive.google.com/file/d/0B6_MvTMovwvFcVppSy1xVmFVbDQ/view?usp=sharing21:11
oneswigHi rajulk, thanks for coming along21:11
rajulkoneswig: thanks for inviting me21:12
oneswigThank martial, but he's missing the fun :-)21:12
*** esberglu has joined #openstack-meeting21:12
oneswigCan you describe the context for your work?21:12
oneswigIs this something used in MOC?21:13
*** powerd has joined #openstack-meeting21:13
rajulksure21:13
rajulkwell we are still working on it and is not ready for use yet21:13
rajulkbut hopefully will soon be in shape21:13
*** thorst has quit IRC21:14
rajulkSo the idea is it use the idle/underutilized resources in OpenStack cloud to be offered as an HTC service21:14
rajulkThis will be a Slurm cluster comprising of virtual machines on OpenStack21:15
oneswigIs it a separate partition in slurm, or a separate instance of slurm altogether?21:15
*** Alex_Staf has quit IRC21:16
rajulkthese VMs will be added/removed from the cluster based on the resource availability driven by the resource utilization of the OpenStack cluster21:16
*** StefanPaetowJisc has joined #openstack-meeting21:16
*** thorst has joined #openstack-meeting21:16
rajulkIt's a seperate instance of slurm -  one that provides HTC service on OS21:16
b1airoHow is the OpenStack resource utilisation monitored?21:17
rajulkwe will be using watcher that will pull metrics from monasca21:17
rajulkand watcher will drive the VM provisioning21:18
oneswigrajulk: you don't have that piece in place yet, or is it currently getting developed?21:18
*** awaugama has quit IRC21:18
rajulkwe have developed an inital watcher strategy that does the job21:19
rajulkbut is yet to be tested21:19
*** thorst has quit IRC21:20
priteauAre the Slurm instances pre-emptible?21:20
rajulkyes21:21
rajulkso the way it works is21:21
b1airorajulk: so do you rely on Nova scheduling or force21:21
*** StefanPaetowJisc has quit IRC21:21
rajulkwhenever the utilization goes beyond a certain threshold, the job and node is supended on slurm and then then VM on OS21:21
rajulkwe use nova scheduling21:22
oneswigWhat do you do about re-creating the hpc cluster environment in OpenStack?  What about filesystems etc?21:22
*** abalutoiu__ has joined #openstack-meeting21:23
rajulkwe have used Salt as the config management tool that drives the provisioning and configuration of a new node for Slurm21:23
rajulkthe controller remains static21:23
*** ad_rien_ has joined #openstack-meeting21:24
rajulkWe'll be using an NFS file system mounted on top of swift storage21:25
oneswigsounds interesting.21:26
oneswigIt's an internal filesystem to OpenStack then?21:26
*** abalutoiu_ has quit IRC21:26
rajulkyes. initally that's the plan21:27
rajulkhowever wwe may extend it as required down the line21:27
b1airoHave you looked at any Keystone integration or would this service be seperate from OpenStack from the user's perspective?21:27
*** lakerzhou has quit IRC21:27
rajulkSo at MOC we have developed an UI that deals with these scientific tools21:28
rajulkthat is integrated with keystone21:28
rajulkand whenver a user comes on to use slurm he has to use it via that UI21:28
rajulkas of now, there will be no direct interaction between slurm and a user21:29
b1airoAh ok, so you have a science gateway of some kind21:30
rajulkexactly21:30
*** martial has joined #openstack-meeting21:30
*** tinwood has quit IRC21:30
oneswigIf you ever get to the point of allowing users to login, I've previously used this to have them authenticated against keystone in PAM: https://github.com/stackhpc/pam-keystone21:31
rajulkit's still in development phase though21:31
martial(back, sorry)21:31
*** armstrong has joined #openstack-meeting21:31
*** noslzzp has quit IRC21:31
b1airoOk, so presumably the OpenStack SLURM is just one computational resource behind that gateway, which would also include traditional HPC systems?21:31
oneswigwelcome back martial :-)21:31
martial(will check the logs for the presentation)21:31
*** tinwood has joined #openstack-meeting21:31
b1airorajulk: what gateway software do you use there?21:32
rajulkAs of now yes, slurm is running behind the gateway for the user21:32
priteaurajulk: when you say utilization goes beyond a threshold, is that looking at per-node utilization (CPU, mem, etc.) or number of instances across the whole cluster?21:33
rajulkthere is a different team working on that but as I know it's built on top of troposphere and atmosphere from cyverse21:33
*** gouthamr has joined #openstack-meeting21:35
rajulkpriteau: it's the utilization across the cluster on CPU and memory for a certain period of time21:35
*** noslzzp has joined #openstack-meeting21:35
priteauAnd how do you decide which VM to kill?21:35
b1airoInteresting possibilities to look for idle VMs in SLURM there...21:36
rajulkpriteau: well there's not logic behind that yet. just pick the first one in the list and we dont kill a VM but just suspend it21:36
oneswigrajulk: your presentation mentions multi-node jobs are future work, what's stopping that?21:37
*** e0ne has quit IRC21:37
*** galstrom is now known as galstrom_zzz21:38
*** e0ne has joined #openstack-meeting21:38
*** e0ne has quit IRC21:38
*** ykatabam has joined #openstack-meeting21:38
rajulkoneswig: theortically nothing.we haven't tried that yet. the only concern that was there initially that should we stop all the nodes in the cluster or just a portion of it21:39
rajulkand if a portion that how to figure that and work around it21:39
rajulkso began with a simpler case of single node jobs21:40
*** raildo has quit IRC21:40
oneswigmakes sense21:40
*** galstrom_zzz is now known as galstrom21:41
*** noslzzp has quit IRC21:41
oneswigOK - did we have any final questions for Rajul?21:42
b1airoJust a thanks for joining!21:42
oneswigseconded - thanks again Rajul21:42
armstrongI joined so I can't see his presentation21:43
armstrongany link to that please?21:43
*** bobh has quit IRC21:43
oneswigarmstrong: https://drive.google.com/file/d/0B6_MvTMovwvFcVppSy1xVmFVbDQ/view?usp=sharing21:43
b1airoI'm still wanting a generic OpenStack level preemptible instance, but we could use this approach for a lot of stuff too21:43
armstrongOk thanks21:43
oneswigno worries21:43
oneswig#topic Scientific OpenStack book21:44
*** openstack changes topic to "Scientific OpenStack book (Meeting topic: scientific-wg)"21:44
rajulkThanks for the discussion. really helpful for me as well.21:44
*** noslzzp has joined #openstack-meeting21:44
rajulkb1airo: totally agree21:44
martialthank you Mr Kumar21:44
oneswigFinal week for rabid hacking on the text everyone!21:44
rajulkmartial: thanks a lot :)21:44
martialoneswig: well we are adding a chapter about "Research in Production" :)21:45
oneswigToday I received a great study on Lustre on OpenStack from the Sanger Institute team21:45
b1airoWhat's our drop dead date again oneswig ?21:45
martialrajulk: thank you for giving us the opportunity to learn from your expertise21:45
rbuddenb1airo: 22nd I believe21:45
oneswigKathy wants final copy end of next week, edits close end of this week21:46
b1airooneswig: excellent, was hoping for that!21:46
martialoneswig: started reviewing ... I saw you spot me :)21:46
*** ricolin has quit IRC21:46
oneswigIt's coming together - apologies to anyone who has commented and I've not responded for a couple of days.  Quite a bit going on at once.21:46
oneswigmartial: not sure that was me... I've been largely elsewhere today.21:47
rbuddenmight have been me21:48
oneswigI'm working on an SKA infrastructure study to replace the Cray one, should have that in review tomorrow21:48
rbuddeni was making lots of edits before this meeting ;)21:48
rbuddeni sent oneswig an email for review, but any feedback is welcome21:48
oneswigrbudden: looking for the prize for the most up-to-date entry, huh? :-)21:48
martialoneswig: interesting, that person had your face icon ... you are being identity theft-ed on book reviews of your own chapter ... sneaky21:48
hogepodgeSept 29 is the hard deadline21:48
hogepodgeAbsolutely no edits after that. If it's not ready we won't have time to produce the book.21:49
oneswigThanks hogepodge21:49
rbuddenoh nice, i have a few more days ;)21:49
oneswigWe can propose cover images for this edition.21:49
hogepodge(Kathy has entrusted me to remind everyone of that as often as possible... I don't want to let Kathy down) :-D21:49
*** Sukhdev has joined #openstack-meeting21:49
oneswigI need URLs of images that are creative commons licensed21:50
oneswigIf we get options, I'll set up a vote21:50
oneswigSo - impressive images please everyone from your cloudy science workloads!21:51
rbuddeni know someone mentioned last year that they liked the Bridges OPA layout image21:51
*** ihrachys has quit IRC21:51
rbuddenit’s already in the previous book though, so maybe something fresh21:51
rbuddenbut figured it’s up for grabs if needed21:51
*** armax has quit IRC21:51
oneswigrbudden: I used a screen shot from the vrml widget.  Any way of getting something better resolution?21:52
rbuddenyes21:52
rbuddenI can ask and get the original21:52
oneswigsounds good.21:52
oneswigOK - any more on the book work?21:53
oneswig#topic SC1721:53
*** openstack changes topic to "SC17 (Meeting topic: scientific-wg)"21:53
oneswighogepodge: was this your item?21:53
hogepodgeYes, we need point people to receive book and sticker shipments21:53
hogepodgeDenise got stickers approved, so I just need to know who to mail them to for the conference.21:54
rbuddeni can volunteer for that21:54
oneswigIU or PSC booths might be good places to deliver to - rbudden?21:54
oneswigah, great21:54
rbuddenyes, i’ll be at SC Sun-Fri21:54
oneswigb1airo: what's the latest on the BoF?21:54
rbuddenthey can likely be shipped straight to the PSC booth or split between us and IU21:54
hogepodgeGreat! Just send an email to me and I'll connect you with Denise to set it up.21:54
*** kylek3h has quit IRC21:54
rbuddenhogepodge: will do, thx21:54
b1airooneswig: BoF is on21:55
oneswigDid the merge happen or is it just us?21:55
rbudden#action rbudden to get in touch with hogepodge about SC book and sticker shipments21:55
hogepodgechris@openstack.org21:55
*** simon-AS5591 has quit IRC21:55
b1airoFinal participant list and format TBA21:55
b1airoI believe merge is happening, but I still haven't heard anymore from Meredith on the other side21:56
*** esberglu has quit IRC21:57
oneswigAny more on SC?21:57
b1airoNot from me21:58
rbuddendo we have a list of presenters for booth talks?21:58
rbuddenor still TBA?21:58
rbuddenerrr TBD21:58
b1airoOther thing I wanted to raise is feedback (if any) on becoming a SIG??21:58
*** ad_rien_ has quit IRC21:58
oneswigrbudden: I think Mike Lowe was tracking that.21:58
*** hashar has quit IRC21:59
b1airoPlus! Forum topics for Sydney - we have not thrown anything into the brainstorming pile yet I think21:59
oneswig#topic AOB - SIG etc.21:59
*** openstack changes topic to "AOB - SIG etc. (Meeting topic: scientific-wg)"21:59
rbuddenoneswig: thanks, i’ll sync up with Mike21:59
oneswigSIG, still seems fine to me.  The mailing list split (ideally involving less cross-posting) is the only question for me.21:59
martialb1airo: our usual BoF / Lightning Talks22:00
oneswigWe upgraded to Pike today, it worked!22:00
b1airomartial: those are already in, I mean the main Forum22:00
oneswigb1airo: might be a good thread for openstack-sigs[scientific]?22:00
martial(I am still confused about this Forum thing then)22:01
martialoneswig: might be especially since we are out of time22:01
priteauoneswig: Anything to look out for before moving to Pike? I keep cherry-picking bug fixes from it into our Ocata deployment22:01
oneswigpriteau: Mark and johnthetubaguy in our team did a fair bit of prep.  We use Kolla.  There were issues with docker_py -> docker.  Also, we had problems with RabbitMQ hosts mangling /etc/hosts with repeated entries.  Finally, a racy problem with updating haproxy which was fixed by a cherry-pick from master22:03
oneswigAnd I forgot to merge a PR I'd left dangling, doh.22:03
oneswigKolla worked really well for us though.22:03
oneswigAh, we are way over time.22:03
rbuddenoneswig: I would be very interested in thoughts/war storries of Kolla22:03
rbuddenfor another time then!22:04
oneswigBetter wrap up.22:04
oneswigrbudden: will try to write something up!22:04
oneswigcheers all22:04
oneswig#endmeeting22:04
*** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings"22:04
openstackMeeting ended Tue Sep 19 22:04:20 2017 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)22:04
rbuddenoneswig: always thanks!22:04
openstackMinutes:        http://eavesdrop.openstack.org/meetings/scientific_wg/2017/scientific_wg.2017-09-19-21.00.html22:04
openstackMinutes (text): http://eavesdrop.openstack.org/meetings/scientific_wg/2017/scientific_wg.2017-09-19-21.00.txt22:04
openstackLog:            http://eavesdrop.openstack.org/meetings/scientific_wg/2017/scientific_wg.2017-09-19-21.00.log.html22:04
priteauThanks everyone22:04
*** abalutoiu_ has joined #openstack-meeting22:04
rbuddenthanks!22:04
armstrongThanks22:05
*** martial has quit IRC22:05
*** aeng has joined #openstack-meeting22:07
*** noslzzp has quit IRC22:07
*** ijw has quit IRC22:07
*** abalutoiu__ has quit IRC22:08
*** noslzzp has joined #openstack-meeting22:09
*** dprince has quit IRC22:09
*** rajulk has left #openstack-meeting22:11
*** Sukhdev has quit IRC22:12
*** noslzzp has quit IRC22:13
*** VW_ has joined #openstack-meeting22:13
*** rbudden has quit IRC22:13
*** priteau has quit IRC22:14
*** noslzzp has joined #openstack-meeting22:15
*** VW has quit IRC22:16
*** oneswig has quit IRC22:16
*** galstrom is now known as galstrom_zzz22:17
*** VW_ has quit IRC22:18
*** sgrasley1 has joined #openstack-meeting22:18
*** noslzzp has quit IRC22:18
*** yamamoto_ has joined #openstack-meeting22:19
*** gouthamr has quit IRC22:21
*** noslzzp has joined #openstack-meeting22:21
*** sshank has quit IRC22:21
*** tpsilva has quit IRC22:23
*** noslzzp has quit IRC22:25
*** sshank has joined #openstack-meeting22:26
*** sdague has quit IRC22:27
*** noslzzp has joined #openstack-meeting22:28
*** noslzzp has quit IRC22:33
*** noslzzp has joined #openstack-meeting22:35
*** ijw has joined #openstack-meeting22:35
*** noslzzp has quit IRC22:35
*** slaweq_ has quit IRC22:36
*** noslzzp has joined #openstack-meeting22:36
*** baoli has quit IRC22:41
*** noslzzp has quit IRC22:41
*** noslzzp has joined #openstack-meeting22:43
*** ijw has quit IRC22:48
*** edmondsw has quit IRC22:50
*** noslzzp has quit IRC22:51
*** noslzzp has joined #openstack-meeting22:54
*** sshank has quit IRC22:55
*** edmondsw has joined #openstack-meeting22:55
*** noslzzp has quit IRC22:59
*** edmondsw has quit IRC22:59
*** noslzzp has joined #openstack-meeting23:00
*** gouthamr has joined #openstack-meeting23:01
*** sgrasley1 has quit IRC23:05
*** sgrasley1 has joined #openstack-meeting23:06
*** slaweq has joined #openstack-meeting23:06
*** chyka has quit IRC23:07
*** noslzzp has quit IRC23:07
*** ijw has joined #openstack-meeting23:07
*** armax has joined #openstack-meeting23:07
*** ijw has quit IRC23:10
*** noslzzp has joined #openstack-meeting23:10
*** rcernin has quit IRC23:11
*** slaweq has quit IRC23:12
*** bobh has joined #openstack-meeting23:12
*** noslzzp has quit IRC23:13
*** jlk has joined #openstack-meeting23:14
*** noslzzp has joined #openstack-meeting23:15
*** cloudrancher has quit IRC23:18
*** cloudrancher has joined #openstack-meeting23:19
*** noslzzp has quit IRC23:22
*** edmondsw has joined #openstack-meeting23:23
*** noslzzp has joined #openstack-meeting23:25
*** edmondsw has quit IRC23:27
*** cloudrancher has quit IRC23:27
*** cloudrancher has joined #openstack-meeting23:28
*** noslzzp has quit IRC23:31
*** noslzzp has joined #openstack-meeting23:34
*** JudeC has quit IRC23:38
*** noslzzp has quit IRC23:40
*** gouthamr has quit IRC23:40
*** noslzzp has joined #openstack-meeting23:41
*** felipemonteiro has joined #openstack-meeting23:44
*** felipemonteiro__ has quit IRC23:44
*** abalutoiu_ has quit IRC23:45
*** Sukhdev has joined #openstack-meeting23:46
*** noslzzp has quit IRC23:47
*** felipemonteiro has quit IRC23:49
*** martial has joined #openstack-meeting23:51
*** noslzzp has joined #openstack-meeting23:51
*** chyka has joined #openstack-meeting23:54
*** gouthamr has joined #openstack-meeting23:55
*** lakerzhou has joined #openstack-meeting23:56
*** ricolin has joined #openstack-meeting23:56
*** noslzzp has quit IRC23:57
*** bobh has quit IRC23:57
*** lakerzhou1 has joined #openstack-meeting23:58

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!