| *** markvoelker has joined #openstack-meeting | 00:03 | |
| *** a-pugachev has joined #openstack-meeting | 00:05 | |
| *** lseki has quit IRC | 00:07 | |
| *** markvoelker has quit IRC | 00:07 | |
| *** tetsuro has joined #openstack-meeting | 00:14 | |
| *** gyee has quit IRC | 00:15 | |
| *** a-pugachev has quit IRC | 00:15 | |
| *** jamesmcarthur has joined #openstack-meeting | 00:20 | |
| *** armax has quit IRC | 00:25 | |
| *** markvoelker has joined #openstack-meeting | 00:35 | |
| *** armax has joined #openstack-meeting | 00:38 | |
| *** markvoelker has quit IRC | 00:49 | |
| *** slaweq has quit IRC | 00:58 | |
| *** mattw4 has quit IRC | 01:06 | |
| *** slaweq has joined #openstack-meeting | 01:10 | |
| *** jamesmcarthur has quit IRC | 01:11 | |
| *** hongbin has joined #openstack-meeting | 01:12 | |
| *** armax has quit IRC | 01:21 | |
| *** iyamahat has quit IRC | 01:22 | |
| *** yamahata has quit IRC | 01:22 | |
| *** slaweq has quit IRC | 01:24 | |
| *** whoami-rajat has joined #openstack-meeting | 01:25 | |
| *** absubram has quit IRC | 01:33 | |
| *** cheng1 has joined #openstack-meeting | 01:36 | |
| *** eharney_ has quit IRC | 01:40 | |
| *** rodrigods has joined #openstack-meeting | 01:42 | |
| *** lbragstad has quit IRC | 01:56 | |
| *** lbragstad has joined #openstack-meeting | 02:09 | |
| *** jamesmcarthur has joined #openstack-meeting | 02:20 | |
| *** jamesmcarthur has quit IRC | 02:25 | |
| *** jamesmcarthur has joined #openstack-meeting | 02:38 | |
| *** jamesmcarthur has quit IRC | 02:43 | |
| *** jamesmcarthur has joined #openstack-meeting | 03:14 | |
| *** apetrich has quit IRC | 03:14 | |
| *** armax has joined #openstack-meeting | 03:30 | |
| *** jamesmcarthur has quit IRC | 03:31 | |
| *** jamesmcarthur has joined #openstack-meeting | 03:31 | |
| *** igordc has quit IRC | 03:32 | |
| *** shilpasd has joined #openstack-meeting | 03:33 | |
| *** janki has joined #openstack-meeting | 03:44 | |
| *** tpatil has joined #openstack-meeting | 03:52 | |
| samP | Hi all for masakari | 03:59 |
|---|---|---|
| *** imsurit_ofc has joined #openstack-meeting | 04:00 | |
| tpatil | Hi | 04:00 |
| samP | #startmeeting masakari | 04:00 |
| openstack | Meeting started Tue Mar 19 04:00:24 2019 UTC and is due to finish in 60 minutes. The chair is samP. Information about MeetBot at http://wiki.debian.org/MeetBot. | 04:00 |
| openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 04:00 |
| *** openstack changes topic to " (Meeting topic: masakari)" | 04:00 | |
| openstack | The meeting name has been set to 'masakari' | 04:00 |
| samP | tpatil: Hi | 04:00 |
| *** sagara has joined #openstack-meeting | 04:00 | |
| samP | #topic Critical Bugs and Patches | 04:00 |
| *** openstack changes topic to "Critical Bugs and Patches (Meeting topic: masakari)" | 04:00 | |
| tpatil | #link : https://bugs.launchpad.net/masakari/+bug/1819578 | 04:01 |
| openstack | Launchpad bug 1819578 in masakari "HOST failure recovery fails with reserved host " [Critical,New] - Assigned to Shilpa Devharakar (shilpasd) | 04:01 |
| tpatil | Work is in progress | 04:01 |
| tpatil | Will upload patch by e.o.d Wednesday | 04:01 |
| samP | tpatil: Thanks | 04:02 |
| *** tashiromt has joined #openstack-meeting | 04:02 | |
| sagara | tpatil: Do you know which releases are affected with this bug? | 04:04 |
| tpatil | Current one i.e Stein | 04:04 |
| sagara | tpatil: Thanks | 04:05 |
| samP | Please bring up any issues related to this any time in this meeting. | 04:06 |
| samP | #topic Stein Work Items | 04:06 |
| *** openstack changes topic to "Stein Work Items (Meeting topic: masakari)" | 04:06 | |
| samP | Please share any updates on Stein work items | 04:07 |
| tpatil | 1) Add devstack support for masakari-monitors | 04:07 |
| tpatil | The gate job is passing now | 04:07 |
| tpatil | Neha will fix some minor review comments and then I will vote +2 on this patch | 04:07 |
| tpatil | #link :https://review.openstack.org/#/c/638577/ | 04:08 |
| tpatil | in the instance monitor log, I have noticed some warning. But this issue in present in the functional tests | 04:08 |
| tpatil | #l link : http://logs.openstack.org/77/638577/21/check/masakari-functional-devstack-multinode/2d55c52/compute1/logs/screen-masakari-instancemonitor.txt.gz | 04:09 |
| tpatil | 2) Functional tests | 04:10 |
| tpatil | #link : https://review.openstack.org/#/c/642223/ | 04:10 |
| tpatil | Please review this patch | 04:10 |
| tpatil | once this patch is merged, it then we have covered segment, host and notification (VM, PROCESS) functional tests | 04:11 |
| tpatil | for compute host, we have one dependency on openstacksdk | 04:11 |
| tpatil | in openstacksdk, it support to force_down a service but they don't have API to set it back to False | 04:11 |
| tpatil | We are planning to add this API in openstacksdk but I think it's too late for this Stein cycle | 04:12 |
| samP | tpatil: sure, I will review this | 04:12 |
| *** hongbin has quit IRC | 04:12 | |
| tpatil | samP: Thanks | 04:13 |
| samP | tpatil: This issue is not critical for masakari, but for functional tests. | 04:13 |
| *** cheng1 has quit IRC | 04:13 | |
| samP | Let's try it on next release | 04:13 |
| tpatil | samP: Sure | 04:13 |
| tpatil | Improve logging error messages | 04:14 |
| tpatil | #link : https://review.openstack.org/#/c/641611 | 04:14 |
| tpatil | Need one more +2 and/or workflow +1 | 04:14 |
| samP | sagara: please review ^^ if you have time. | 04:14 |
| *** diablo_rojo has quit IRC | 04:15 | |
| samP | Otherwise, I will WF+1 for this, since changes are clear and simple | 04:16 |
| sagara | samP: OK, I will review it. | 04:16 |
| samP | sagara: thank you! | 04:16 |
| tpatil | That's all about Stein work items from my end | 04:18 |
| samP | tpatil: thanks | 04:18 |
| samP | no update from my end | 04:18 |
| samP | #topic Stein release | 04:19 |
| *** openstack changes topic to "Stein release (Meeting topic: masakari)" | 04:19 | |
| samP | I am planning to cut the stable/stain branch on 3/21 | 04:19 |
| samP | same point will be the RC1 for Stein | 04:20 |
| tpatil | samP: OK, before that we will fix and merge the critical issue | 04:20 |
| samP | tpatil: sure, thanks | 04:20 |
| samP | if patches not going to make can still merge into master and backport to stable/stein | 04:21 |
| tpatil | samP: Yes, Sure | 04:22 |
| samP | I will release new version for masakari-dashboard, once we create RC1 for masakari | 04:23 |
| samP | that's all from my side | 04:23 |
| tpatil | samP: OK | 04:23 |
| samP | if no other topics, we can end today's meeting here | 04:23 |
| tpatil | samP: No other topics to be discussed from my end | 04:24 |
| samP | Please use #openstack-masakari IRC@freenode or openstack-discuss@lists.openstack.org for further discussion | 04:24 |
| shilpasd | samP: hi, need review for dashboard patch https://review.openstack.org/#/c/642981/ | 04:25 |
| *** sridharg has joined #openstack-meeting | 04:25 | |
| shilpasd | its for real time data for notification recovery workflow details. | 04:26 |
| samP | shilpasd: sure, I will | 04:26 |
| shilpasd | samP: Thank you | 04:26 |
| samP | thanks for adding this | 04:26 |
| samP | Thank you all! | 04:27 |
| samP | #endmeeting | 04:27 |
| *** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/" | 04:27 | |
| openstack | Meeting ended Tue Mar 19 04:27:11 2019 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 04:27 |
| openstack | Minutes: http://eavesdrop.openstack.org/meetings/masakari/2019/masakari.2019-03-19-04.00.html | 04:27 |
| openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/masakari/2019/masakari.2019-03-19-04.00.txt | 04:27 |
| openstack | Log: http://eavesdrop.openstack.org/meetings/masakari/2019/masakari.2019-03-19-04.00.log.html | 04:27 |
| *** sagara has quit IRC | 04:29 | |
| *** tetsuro has quit IRC | 04:33 | |
| *** jamesmcarthur has quit IRC | 04:40 | |
| *** tpatil has quit IRC | 04:40 | |
| *** dklyle has quit IRC | 04:44 | |
| *** dklyle has joined #openstack-meeting | 04:45 | |
| *** cheng1 has joined #openstack-meeting | 04:52 | |
| *** vishalmanchanda has joined #openstack-meeting | 04:59 | |
| *** cheng1 has quit IRC | 05:11 | |
| *** cheng1 has joined #openstack-meeting | 05:26 | |
| *** liuyulong has quit IRC | 06:01 | |
| *** markvoelker has joined #openstack-meeting | 06:20 | |
| *** markvoelker has quit IRC | 06:25 | |
| *** njohnston_ has quit IRC | 06:28 | |
| *** lbragstad has quit IRC | 06:38 | |
| *** markvoelker has joined #openstack-meeting | 06:51 | |
| *** Luzi has joined #openstack-meeting | 06:59 | |
| *** SergeyLukjanov has quit IRC | 06:59 | |
| *** SergeyLukjanov has joined #openstack-meeting | 07:01 | |
| *** pcaruana has joined #openstack-meeting | 07:14 | |
| *** apetrich has joined #openstack-meeting | 07:26 | |
| *** dkushwaha has joined #openstack-meeting | 07:31 | |
| *** iyamahat has joined #openstack-meeting | 07:32 | |
| *** pcaruana has quit IRC | 07:33 | |
| *** pcaruana has joined #openstack-meeting | 07:34 | |
| *** kopecmartin|off is now known as kopecmartin | 07:36 | |
| *** slaweq has joined #openstack-meeting | 07:38 | |
| *** tetsuro has joined #openstack-meeting | 07:58 | |
| *** hadai has joined #openstack-meeting | 08:01 | |
| dkushwaha | #startmeeting tacker | 08:03 |
| openstack | Meeting started Tue Mar 19 08:03:13 2019 UTC and is due to finish in 60 minutes. The chair is dkushwaha. Information about MeetBot at http://wiki.debian.org/MeetBot. | 08:03 |
| openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 08:03 |
| *** openstack changes topic to " (Meeting topic: tacker)" | 08:03 | |
| openstack | The meeting name has been set to 'tacker' | 08:03 |
| dkushwaha | #topic Roll Call | 08:03 |
| *** openstack changes topic to "Roll Call (Meeting topic: tacker)" | 08:03 | |
| dkushwaha | who is here for Tacker weekly meeting? | 08:03 |
| hyunsikyang | hi | 08:04 |
| hyunsikyang | dkushwaha | 08:04 |
| hyunsikyang | I am here | 08:04 |
| dkushwaha | hello hyunsik | 08:04 |
| dkushwaha | seems no other members. | 08:07 |
| hyunsikyang | Humm.. I think so. | 08:07 |
| *** ttsiouts has joined #openstack-meeting | 08:08 | |
| *** hjwon has joined #openstack-meeting | 08:09 | |
| dkushwaha | i have some updates, so will keep it quick | 08:09 |
| dkushwaha | lets start.. | 08:09 |
| *** hokeeeeun has joined #openstack-meeting | 08:09 | |
| hyunsikyang | OK:D | 08:09 |
| dkushwaha | #topic Announcement | 08:09 |
| *** openstack changes topic to "Announcement (Meeting topic: tacker)" | 08:09 | |
| *** jaewook_oh has joined #openstack-meeting | 08:09 | |
| dkushwaha | Tackerclient 0.15.0 is released | 08:10 |
| dkushwaha | #link https://releases.openstack.org/stein/#python-tackerclient | 08:10 |
| jaewook_oh | congratulation! | 08:10 |
| hyunsikyang | My lab members has joined here. | 08:10 |
| dkushwaha | who? | 08:10 |
| dkushwaha | Dear new member, please introduce yourself | 08:11 |
| jaewook_oh | Hello, this is Jaewook from IISTRC with Hyunsik | 08:12 |
| dkushwaha | jaewook_oh, Welcome in Tacker team | 08:12 |
| jaewook_oh | Thank you for greeting me :) | 08:13 |
| dkushwaha | jaewook_oh, you are also doing research with hyunsik? | 08:13 |
| jaewook_oh | yes exactly, | 08:13 |
| dkushwaha | great | 08:13 |
| dkushwaha | jaewook_oh, what is your area of scope ? | 08:14 |
| jaewook_oh | Currently, I'm working with the containerized vim, especially kubernetes one | 08:14 |
| dkushwaha | cool | 08:14 |
| hokeeeeun | hi | 08:16 |
| hokeeeeun | Hello, this is Hokeun from IISTRC with Hyunsik | 08:16 |
| hyunsikyang | So I suggested he deal with monitoring part of Containerized VIM. | 08:16 |
| dkushwaha | jaewook_oh, we have lots of stuffs to do in container area, your support will be great help. :) | 08:16 |
| dkushwaha | hokeeeeun, Welcome to Tacker team :) | 08:17 |
| jaewook_oh | Thanks again, and I hope I can contribute to tacker :D | 08:17 |
| *** cheng1_ has joined #openstack-meeting | 08:17 | |
| dkushwaha | Feels great to see new members from IISTRC :) | 08:18 |
| dkushwaha | moving next.. | 08:18 |
| hyunsikyang | OK:) | 08:19 |
| hjwon | Hello, this is HoJoon from IISTRC with Hyunsik :) | 08:19 |
| *** tssurya has joined #openstack-meeting | 08:19 | |
| dkushwaha | welcome hjwon in Tacker team :) | 08:19 |
| dkushwaha | #topic Stein-items | 08:20 |
| *** dmacpher has quit IRC | 08:20 | |
| *** openstack changes topic to "Stein-items (Meeting topic: tacker)" | 08:20 | |
| *** cheng1 has quit IRC | 08:20 | |
| dkushwaha | I have some pending items for stein | 08:20 |
| dkushwaha | and still working on that | 08:20 |
| dkushwaha | i.e. VNF-force-delete | 08:21 |
| hyunsikyang | Could you mention the list for Stein? | 08:21 |
| dkushwaha | and hope to land it soon | 08:21 |
| dkushwaha | hyunsikyang, https://blueprints.launchpad.net/tacker/stein | 08:22 |
| hyunsikyang | Thanks:) | 08:22 |
| dkushwaha | Team, I have already fixed https://blueprints.launchpad.net/tacker/+spec/improve-return-message | 08:23 |
| dkushwaha | but it will be great if somebody can work on that for more improvements | 08:23 |
| dkushwaha | i.e. to handle more cases. | 08:24 |
| *** brault has joined #openstack-meeting | 08:24 | |
| dkushwaha | #topic force-delete | 08:24 |
| *** openstack changes topic to "force-delete (Meeting topic: tacker)" | 08:24 | |
| dkushwaha | #link https://review.openstack.org/#/c/620385/ | 08:25 |
| hyunsikyang | OK we will check it together. | 08:25 |
| *** ttsiouts has quit IRC | 08:25 | |
| dkushwaha | I will update this patch soon. Request you folks to please review it | 08:25 |
| dkushwaha | hyunsikyang, thanks | 08:25 |
| hyunsikyang | OK:) | 08:25 |
| *** e0ne has joined #openstack-meeting | 08:25 | |
| dkushwaha | moving next.. | 08:26 |
| dkushwaha | #topic Train Grooming | 08:27 |
| *** openstack changes topic to "Train Grooming (Meeting topic: tacker)" | 08:27 | |
| dkushwaha | #link https://etherpad.openstack.org/p/tacker-train-grooming | 08:27 |
| dkushwaha | I have created etherpad for train-cycle working items | 08:27 |
| dkushwaha | So please Put your stuffs here | 08:28 |
| jaewook_oh | Ok :) | 08:28 |
| hyunsikyang | You added my blueprint. Thanks. | 08:28 |
| dkushwaha | we will use this etherpad for reference and further discussions | 08:29 |
| hyunsikyang | ok. | 08:29 |
| dkushwaha | nothing else from my side for today | 08:29 |
| dkushwaha | #topic OpenDiscussion | 08:29 |
| *** openstack changes topic to "OpenDiscussion (Meeting topic: tacker)" | 08:29 | |
| hyunsikyang | I have a question for Summit presentation. | 08:29 |
| dkushwaha | hyunsikyang, yes please | 08:30 |
| hyunsikyang | I just asking about contents for presentation. | 08:31 |
| hyunsikyang | we only have 10 min right? | 08:31 |
| dkushwaha | hyunsikyang, yes | 08:32 |
| hyunsikyang | When you prepare it, please let me know. we can discuss it and make material together. | 08:33 |
| dkushwaha | our topic is big enough, but as it got selected in for 10 minuts tolks, So we have to cover multiple points, but needs to keep all brief | 08:33 |
| hyunsikyang | yes. I think so. | 08:33 |
| dkushwaha | hyunsikyang, yes, I will suggest to use google docs, where we both can view and update. | 08:34 |
| hyunsikyang | Ok. I will tell you in a personal channel later. | 08:35 |
| dkushwaha | hyunsikyang, nice | 08:35 |
| hyunsikyang | I am done. | 08:36 |
| dkushwaha | Thanks all | 08:37 |
| *** priteau has joined #openstack-meeting | 08:38 | |
| dkushwaha | Looking for yours great support in Tacker, to make it more and more stable, popular and usable | 08:39 |
| dkushwaha | Thanks Folks | 08:39 |
| dkushwaha | closinf it for now | 08:39 |
| dkushwaha | In India there will be a long holiday due to Holi Festival, So I will less active on IRC during this week | 08:41 |
| dkushwaha | #endmeeting | 08:41 |
| *** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/" | 08:41 | |
| openstack | Meeting ended Tue Mar 19 08:41:24 2019 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 08:41 |
| openstack | Minutes: http://eavesdrop.openstack.org/meetings/tacker/2019/tacker.2019-03-19-08.03.html | 08:41 |
| openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/tacker/2019/tacker.2019-03-19-08.03.txt | 08:41 |
| openstack | Log: http://eavesdrop.openstack.org/meetings/tacker/2019/tacker.2019-03-19-08.03.log.html | 08:41 |
| *** hokeeeeun has quit IRC | 08:42 | |
| *** rossella_s has quit IRC | 08:46 | |
| *** ttsiouts has joined #openstack-meeting | 08:49 | |
| *** hadai has quit IRC | 08:54 | |
| *** Luzi has quit IRC | 08:59 | |
| *** dklyle has quit IRC | 09:08 | |
| *** dklyle has joined #openstack-meeting | 09:09 | |
| *** kukacz has quit IRC | 09:11 | |
| *** jbadiapa has joined #openstack-meeting | 09:13 | |
| *** kukacz has joined #openstack-meeting | 09:28 | |
| *** cheng1_ has quit IRC | 09:28 | |
| *** kukacz has quit IRC | 09:29 | |
| *** kukacz has joined #openstack-meeting | 09:30 | |
| *** ttsiouts has quit IRC | 09:31 | |
| *** ttsiouts has joined #openstack-meeting | 09:32 | |
| *** Lucas_Gray has joined #openstack-meeting | 09:33 | |
| *** rossella_s has joined #openstack-meeting | 09:33 | |
| *** Wryhder has joined #openstack-meeting | 09:37 | |
| *** kukacz has quit IRC | 09:39 | |
| *** Lucas_Gray has quit IRC | 09:39 | |
| *** Wryhder is now known as Lucas_Gray | 09:39 | |
| *** kukacz has joined #openstack-meeting | 09:39 | |
| *** electrofelix has joined #openstack-meeting | 09:47 | |
| *** dkushwaha has left #openstack-meeting | 09:52 | |
| *** cheng1_ has joined #openstack-meeting | 09:56 | |
| *** e0ne has quit IRC | 09:56 | |
| *** jbadiapa has quit IRC | 09:59 | |
| *** Lucas_Gray has quit IRC | 10:04 | |
| *** Lucas_Gray has joined #openstack-meeting | 10:09 | |
| *** jbadiapa has joined #openstack-meeting | 10:12 | |
| *** jbadiapa has quit IRC | 10:29 | |
| *** hjwon has quit IRC | 10:40 | |
| *** jbadiapa has joined #openstack-meeting | 10:43 | |
| *** bbowen has quit IRC | 10:44 | |
| *** janki has quit IRC | 10:45 | |
| *** yamamoto has quit IRC | 10:50 | |
| *** e0ne has joined #openstack-meeting | 10:50 | |
| *** yamamoto has joined #openstack-meeting | 10:56 | |
| *** carlos_silva has joined #openstack-meeting | 10:58 | |
| *** yamamoto has quit IRC | 11:00 | |
| *** jrbalderrama has joined #openstack-meeting | 11:04 | |
| *** yamamoto has joined #openstack-meeting | 11:05 | |
| *** yamamoto has quit IRC | 11:05 | |
| *** njohnston has joined #openstack-meeting | 11:06 | |
| *** yamamoto has joined #openstack-meeting | 11:06 | |
| *** psachin has joined #openstack-meeting | 11:06 | |
| *** priteau has quit IRC | 11:08 | |
| *** ttsiouts has quit IRC | 11:09 | |
| *** tetsuro has quit IRC | 11:21 | |
| *** rcernin has quit IRC | 11:24 | |
| *** Wryhder has joined #openstack-meeting | 11:34 | |
| *** Lucas_Gray has quit IRC | 11:34 | |
| *** Wryhder is now known as Lucas_Gray | 11:35 | |
| *** hyunsikyang__ has joined #openstack-meeting | 11:37 | |
| *** adrianc has quit IRC | 11:41 | |
| *** hyunsikyang has quit IRC | 11:41 | |
| *** hyunsikyang__ has quit IRC | 11:42 | |
| *** hyunsikyang has joined #openstack-meeting | 11:43 | |
| *** janki has joined #openstack-meeting | 11:49 | |
| *** klindgren_ has quit IRC | 11:51 | |
| *** imsurit_ofc has quit IRC | 11:52 | |
| *** psachin has quit IRC | 11:54 | |
| *** klindgren has joined #openstack-meeting | 12:03 | |
| *** bbowen has joined #openstack-meeting | 12:04 | |
| *** finucannot is now known as stephenfin | 12:05 | |
| *** bbowen_ has joined #openstack-meeting | 12:06 | |
| *** raildo has joined #openstack-meeting | 12:08 | |
| *** bbowen has quit IRC | 12:08 | |
| *** adrianc has joined #openstack-meeting | 12:10 | |
| *** ttsiouts has joined #openstack-meeting | 12:10 | |
| *** jbadiapa has quit IRC | 12:11 | |
| *** adrianc has quit IRC | 12:24 | |
| *** markvoelker has quit IRC | 12:24 | |
| *** rbudden has joined #openstack-meeting | 12:32 | |
| *** adrianc has joined #openstack-meeting | 12:36 | |
| *** rfolco has joined #openstack-meeting | 12:37 | |
| *** enriquetaso has joined #openstack-meeting | 12:49 | |
| *** adrianc has quit IRC | 12:51 | |
| *** mriedem has joined #openstack-meeting | 12:54 | |
| *** adrianc has joined #openstack-meeting | 12:59 | |
| *** jaewook_oh has quit IRC | 13:00 | |
| *** liuyulong has joined #openstack-meeting | 13:00 | |
| *** eharney has joined #openstack-meeting | 13:03 | |
| *** yamamoto has quit IRC | 13:09 | |
| *** hyunsikyang__ has joined #openstack-meeting | 13:15 | |
| *** hyunsikyang has quit IRC | 13:17 | |
| *** jbadiapa has joined #openstack-meeting | 13:18 | |
| *** tssurya has quit IRC | 13:18 | |
| *** cheng1_ has quit IRC | 13:26 | |
| *** yamamoto has joined #openstack-meeting | 13:28 | |
| *** tashiromt has quit IRC | 13:33 | |
| *** lbragstad has joined #openstack-meeting | 13:34 | |
| *** Luzi has joined #openstack-meeting | 13:54 | |
| *** whoami-rajat has quit IRC | 13:55 | |
| *** mjturek has joined #openstack-meeting | 14:07 | |
| *** needscoffee is now known as kmalloc | 14:09 | |
| *** bbowen_ is now known as brbowen | 14:18 | |
| *** hongbin has joined #openstack-meeting | 14:29 | |
| *** adrianc has quit IRC | 14:36 | |
| *** jamesmcarthur has joined #openstack-meeting | 14:39 | |
| *** adrianc has joined #openstack-meeting | 14:39 | |
| *** factor has quit IRC | 14:48 | |
| *** igordc has joined #openstack-meeting | 14:49 | |
| *** yamamoto has quit IRC | 14:49 | |
| *** mattw4 has joined #openstack-meeting | 14:50 | |
| *** yamamoto has joined #openstack-meeting | 14:55 | |
| *** yamamoto has quit IRC | 14:55 | |
| *** yamamoto has joined #openstack-meeting | 14:56 | |
| *** yamamoto has quit IRC | 14:58 | |
| *** yamamoto has joined #openstack-meeting | 14:58 | |
| *** yamamoto has quit IRC | 14:58 | |
| *** cheng1 has joined #openstack-meeting | 14:58 | |
| *** yamamoto has joined #openstack-meeting | 14:59 | |
| *** diablo_rojo has joined #openstack-meeting | 15:02 | |
| *** adrianc has quit IRC | 15:02 | |
| *** evgenyl has joined #openstack-meeting | 15:02 | |
| *** yamamoto has quit IRC | 15:03 | |
| *** vishalmanchanda has quit IRC | 15:05 | |
| *** artom has joined #openstack-meeting | 15:06 | |
| *** adrianc has joined #openstack-meeting | 15:08 | |
| *** cheng1 has quit IRC | 15:09 | |
| *** cheng1 has joined #openstack-meeting | 15:10 | |
| *** Luzi has quit IRC | 15:12 | |
| *** eharney has quit IRC | 15:14 | |
| *** whoami-rajat has joined #openstack-meeting | 15:22 | |
| *** adrianc has quit IRC | 15:24 | |
| *** adrianc has joined #openstack-meeting | 15:27 | |
| *** dmsimard has joined #openstack-meeting | 15:30 | |
| *** jrbalderrama has quit IRC | 15:34 | |
| *** ttsiouts has quit IRC | 15:38 | |
| *** yamamoto has joined #openstack-meeting | 15:39 | |
| *** ttsiouts has joined #openstack-meeting | 15:40 | |
| *** yamamoto has quit IRC | 15:45 | |
| *** anteaya has joined #openstack-meeting | 15:50 | |
| *** raildo has quit IRC | 15:51 | |
| *** raildo has joined #openstack-meeting | 15:51 | |
| *** ttsiouts has quit IRC | 15:54 | |
| *** mlavalle has joined #openstack-meeting | 15:57 | |
| *** igordc has quit IRC | 15:58 | |
| *** cheng1 has quit IRC | 15:59 | |
| *** njohnston is now known as njohnston_ | 16:00 | |
| *** njohnston_ is now known as 07EAA60LH | 16:00 | |
| slaweq | #startmeeting neutron_ci | 16:00 |
| *** njohnston_ has joined #openstack-meeting | 16:00 | |
| openstack | Meeting started Tue Mar 19 16:00:24 2019 UTC and is due to finish in 60 minutes. The chair is slaweq. Information about MeetBot at http://wiki.debian.org/MeetBot. | 16:00 |
| openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 16:00 |
| *** openstack changes topic to " (Meeting topic: neutron_ci)" | 16:00 | |
| openstack | The meeting name has been set to 'neutron_ci' | 16:00 |
| mlavalle | o/ | 16:00 |
| slaweq | hello | 16:00 |
| *** njohnston_ is now known as njohnston | 16:00 | |
| bcafarel | o/ | 16:00 |
| njohnston | o/ | 16:00 |
| slaweq | ok, lets start | 16:01 |
| slaweq | first of all Grafana dashboard: http://grafana.openstack.org/dashboard/db/neutron-failure-rate | 16:01 |
| slaweq | Please open now :) | 16:01 |
| mlavalle | LOL | 16:01 |
| slaweq | #topic Actions from previous meetings | 16:02 |
| *** ttsiouts has joined #openstack-meeting | 16:02 | |
| *** openstack changes topic to "Actions from previous meetings (Meeting topic: neutron_ci)" | 16:02 | |
| slaweq | first action: | 16:02 |
| slaweq | ralonsoh to take a look at fullstack dhcp rescheduling issue https://bugs.launchpad.net/neutron/+bug/1799555 | 16:02 |
| openstack | Launchpad bug 1799555 in neutron "Fullstack test neutron.tests.fullstack.test_dhcp_agent.TestDhcpAgentHA.test_reschedule_network_on_new_agent timeout" [High,Confirmed] - Assigned to Rodolfo Alonso (rodolfo-alonso-hernandez) | 16:02 |
| slaweq | I know that ralonsoh was looking into this one | 16:03 |
| slaweq | but there was no data why network wasn't rescheduled to new dhcp agent after one agent was down | 16:03 |
| slaweq | so he send some dnm patch https://review.openstack.org/#/c/643079/ to get some more logs | 16:03 |
| * mlavalle has to leave 45 minutes after the hour | 16:03 | |
| slaweq | so he will probably continue this work as he is assigned to the bug | 16:04 |
| slaweq | next one was: | 16:04 |
| slaweq | slaweq to talk with tmorin about networking-bagpipe | 16:04 |
| *** armax has quit IRC | 16:04 | |
| *** jamesmcarthur has quit IRC | 16:04 | |
| mlavalle | you sent an email, didn't you? | 16:04 |
| slaweq | I sent email to Thomas today because I couldn't catch him on irc | 16:04 |
| *** jamesmcarthur has joined #openstack-meeting | 16:05 | |
| slaweq | if he will not respond, I will probably start this work for bagpipe project - it shouldn't be a lot of work to do | 16:05 |
| slaweq | ok, and the last one from last week was: | 16:06 |
| slaweq | ralonsoh to take a look at update_revises unit test failures | 16:06 |
| slaweq | IIRC this patch should address this issue https://review.openstack.org/#/c/642869/ | 16:06 |
| slaweq | so thx ralonsoh we should be good with this :) | 16:06 |
| mlavalle | yeap, it looks like it | 16:07 |
| slaweq | and that was all actions from previous week | 16:07 |
| slaweq | any questions/comments? | 16:07 |
| mlavalle | not rom me | 16:08 |
| mlavalle | from^^^ | 16:08 |
| *** cheng1 has joined #openstack-meeting | 16:08 | |
| slaweq | ok, lets go then to the next topic | 16:08 |
| slaweq | #topic Python 3 | 16:08 |
| *** openstack changes topic to "Python 3 (Meeting topic: neutron_ci)" | 16:08 | |
| slaweq | Stadium projects etherpad: https://etherpad.openstack.org/p/neutron_stadium_python3_status | 16:08 |
| slaweq | njohnston: any updates? | 16:08 |
| njohnston | no updates on this for this week. | 16:08 |
| slaweq | ok | 16:09 |
| njohnston | I hope to spend more time with it later this week | 16:09 |
| slaweq | sure, that is not urgent for now | 16:09 |
| mlavalle | so I volunteered last time | 16:09 |
| slaweq | we have more important things currently IMO :) | 16:09 |
| mlavalle | for one of them | 16:09 |
| mlavalle | but the etherpad seems changed | 16:09 |
| njohnston | mlavalle: wasn’t that the tempest plugin work? | 16:10 |
| slaweq | mlavalle: I think You voluntereed for something else, trust me ;) | 16:10 |
| bcafarel | :) | 16:10 |
| mlavalle | yeah, you are right | 16:10 |
| slaweq | mlavalle: You should tell that to my wife :P | 16:10 |
| mlavalle | LOL | 16:10 |
| njohnston | LOL | 16:10 |
| slaweq | ok, lets move on to the next topic | 16:11 |
| slaweq | #topic Ubuntu Bionic in CI jobs | 16:11 |
| *** openstack changes topic to "Ubuntu Bionic in CI jobs (Meeting topic: neutron_ci)" | 16:11 | |
| slaweq | last week I think patch which switched all legacy jobs to be run on Bionic was merged | 16:11 |
| slaweq | yep, it's here: https://review.openstack.org/#/c/641886/ | 16:12 |
| slaweq | in Neutron we are good with it | 16:12 |
| slaweq | as for stadium projects, we need https://review.openstack.org/#/c/642456/ for fullstack job in networking-bagpipe | 16:13 |
| bcafarel | slaweq: I still see ubuntu-xenial-2-node in .zuul.yaml ? | 16:13 |
| slaweq | but this job is there non-voting, and even with this patch it's failing because of some other reason | 16:13 |
| slaweq | bcafarel: where? | 16:13 |
| bcafarel | https://github.com/openstack/neutron/blob/master/.zuul.yaml#L234 | 16:14 |
| slaweq | ahh, right bcafarel | 16:14 |
| slaweq | so we need to switch our grenade jobs to be run on bionic too | 16:14 |
| slaweq | it's like that because we have specified nodeset in our .zuul.yaml file for them | 16:14 |
| slaweq | any volunteer to switch that to bionic? | 16:15 |
| slaweq | if no, I can do that | 16:15 |
| bcafarel | since I raised it I can try to fix it :) | 16:15 |
| slaweq | thx bcafarel | 16:15 |
| *** cheng1 has quit IRC | 16:15 | |
| slaweq | #action bcafarel to switch neutron-grenade multinode jobs to bionic nodes | 16:16 |
| slaweq | from other stadium projects there is also issue with networking-midonet | 16:16 |
| mlavalle | should we ask yamamoto? | 16:17 |
| slaweq | but they are aware of it: https://midonet.atlassian.net/browse/MNA-1344 so I don't think we should bother a lot with that | 16:17 |
| mlavalle | cool | 16:17 |
| slaweq | mlavalle: yamamoto know about this issues, I already mailed him some time ago | 16:17 |
| njohnston | yes there was an ML thread | 16:17 |
| *** jbadiapa has quit IRC | 16:17 | |
| slaweq | and that's basically all about switch to bionic | 16:18 |
| slaweq | questions/comments? | 16:18 |
| mlavalle | not from me | 16:18 |
| njohnston | nope | 16:18 |
| *** eharney has joined #openstack-meeting | 16:18 | |
| slaweq | ok, next topic then | 16:18 |
| slaweq | #topic tempest-plugins migration | 16:18 |
| *** openstack changes topic to "tempest-plugins migration (Meeting topic: neutron_ci)" | 16:18 | |
| slaweq | Etherpad: https://etherpad.openstack.org/p/neutron_stadium_move_to_tempest_plugin_repo | 16:18 |
| slaweq | mlavalle: here You volunteered :) | 16:19 |
| slaweq | any updates about that? | 16:19 |
| mlavalle | I intend to work on this towards the end of the week | 16:19 |
| njohnston | I pushed a couple of changes for fwaas | 16:19 |
| bcafarel | I think njohnston is the most ahead there | 16:19 |
| njohnston | I need to work on the zuul job definitions | 16:20 |
| slaweq | yep, I saw today Your "super-WIP" patch :) | 16:20 |
| slaweq | it's pretty red | 16:20 |
| njohnston | yeah | 16:20 |
| njohnston | I’ll fiddle with it later in the week | 16:21 |
| slaweq | but great that You started this work already :) | 16:21 |
| slaweq | thx njohnston | 16:21 |
| slaweq | ok, so lets move on to the next topic then | 16:22 |
| slaweq | #topic Grafana | 16:22 |
| *** openstack changes topic to "Grafana (Meeting topic: neutron_ci)" | 16:22 | |
| slaweq | #link http://grafana.openstack.org/dashboard/db/neutron-failure-rate | 16:22 |
| slaweq | You have it already :) | 16:22 |
| *** Lucas_Gray has quit IRC | 16:22 | |
| slaweq | worst thing is IMO fullstack job in check queue | 16:23 |
| slaweq | which is on quite high numbers again | 16:24 |
| slaweq | but today there is also some spike on neutron-tempest-dvr-ha-multinode-full job | 16:24 |
| mlavalle | yeah, fullstack is where the action / problem is | 16:25 |
| slaweq | mlavalle: yes | 16:25 |
| slaweq | according to this neutron-tempest-dvr-ha-multinode-full I would say - lets wait and see how it will be | 16:25 |
| *** ttsiouts has quit IRC | 16:25 | |
| slaweq | there wasn't many jobs run today so this spike may be just because of some bad coincidence | 16:27 |
| slaweq | from good things: functinal jobs looks good currently finally :) | 16:27 |
| slaweq | any other comments on that? | 16:28 |
| mlavalle | is it not from me | 16:28 |
| slaweq | or can we move on to talk about fullstack? | 16:28 |
| mlavalle | I menat not from me | 16:28 |
| slaweq | ok, lets move on then | 16:28 |
| mlavalle | let's move on | 16:28 |
| slaweq | #topic fullstack/functional | 16:28 |
| *** openstack changes topic to "fullstack/functional (Meeting topic: neutron_ci)" | 16:28 | |
| slaweq | I was looking into some fullstack failures today | 16:28 |
| slaweq | and I identified basically 2 new (for me at least) issues | 16:29 |
| slaweq | https://bugs.launchpad.net/neutron/+bug/1820865 | 16:29 |
| openstack | Launchpad bug 1820865 in neutron "Fullstack tests are failing because of "OSError: [Errno 22] failed to open netns"" [Critical,Confirmed] | 16:29 |
| slaweq | this one is problem with open netns | 16:29 |
| slaweq | and second is https://bugs.launchpad.net/neutron/+bug/1820870 | 16:29 |
| openstack | Launchpad bug 1820870 in neutron "Fullstack tests are failing with error connection to rabbitmq" [High,Confirmed] | 16:29 |
| slaweq | that one is related to some issues with connectivity from agents to rabbitmq | 16:30 |
| slaweq | both are quite often now so I set them as Critical and High priority for now | 16:30 |
| slaweq | but I think we need some volunteers for them as I will not have cycles for both during this week | 16:30 |
| mlavalle | do we need manpower for them? | 16:31 |
| slaweq | mlavalle: yes, definitely | 16:31 |
| mlavalle | assigne me one | 16:31 |
| mlavalle | the one you think is more important | 16:31 |
| mlavalle | please | 16:31 |
| slaweq | I marked bug/1820865 as Critical because I think it happens more often | 16:32 |
| mlavalle | ok, I take it | 16:32 |
| slaweq | great, thx mlavalle | 16:32 |
| *** e0ne has quit IRC | 16:32 | |
| * mlavalle assigned it to himself | 16:32 | |
| slaweq | if I will have some time, I will try to take a look at second one but I can't promise that | 16:32 |
| slaweq | so I will not assign it to myself yet | 16:33 |
| mlavalle | if I have time I will also try to get to the second one | 16:33 |
| mlavalle | I'll ping you if I get there | 16:33 |
| *** lseki has joined #openstack-meeting | 16:33 | |
| slaweq | #action mlavalle to check https://bugs.launchpad.net/neutron/+bug/1820870 | 16:33 |
| openstack | Launchpad bug 1820870 in neutron "Fullstack tests are failing with error connection to rabbitmq" [High,Confirmed] | 16:33 |
| slaweq | #undo | 16:33 |
| openstack | Removing item from minutes: #action mlavalle to check https://bugs.launchpad.net/neutron/+bug/1820870 | 16:33 |
| mlavalle | yeap, it's the other one | 16:34 |
| slaweq | #action mlavalle to check https://bugs.launchpad.net/neutron/+bug/1820865 | 16:34 |
| openstack | Launchpad bug 1820865 in neutron "Fullstack tests are failing because of "OSError: [Errno 22] failed to open netns"" [Critical,Confirmed] - Assigned to Miguel Lavalle (minsel) | 16:34 |
| slaweq | #action slaweq/mlavalle to check https://bugs.launchpad.net/neutron/+bug/1820870 | 16:34 |
| slaweq | now it's good :) | 16:34 |
| mlavalle | yes | 16:34 |
| slaweq | thx mlavalle for help | 16:34 |
| slaweq | I hope that when those 2 will be fixed, we will be in better shape with fullstack too | 16:35 |
| slaweq | any questions/comments? | 16:35 |
| mlavalle | nope | 16:35 |
| slaweq | ok, lets move to the next topic then | 16:35 |
| slaweq | #topic Tempest/Scenario | 16:36 |
| *** openstack changes topic to "Tempest/Scenario (Meeting topic: neutron_ci)" | 16:36 | |
| slaweq | mlavalle: as https://review.openstack.org/#/c/636710/ is merged, did You send patch to unmark tests from https://bugs.launchpad.net/neutron/+bug/1789434 as unstable? | 16:36 |
| openstack | Launchpad bug 1789434 in neutron "neutron_tempest_plugin.scenario.test_migration.NetworkMigrationFromHA failing 100% times" [High,In progress] - Assigned to Miguel Lavalle (minsel) | 16:36 |
| mlavalle | slaweq: I'll do it today | 16:36 |
| *** ttsiouts has joined #openstack-meeting | 16:36 | |
| slaweq | mlavalle: thx | 16:37 |
| slaweq | other thing related to this is that still neutron-tempest-plugin-dvr-multinode-scenario is failing almost always. | 16:37 |
| slaweq | I was checking couple of results of such failed jobs today | 16:38 |
| slaweq | and there is no one single reason. We probably need someone who will go through some failed tests and report bugs for them. | 16:38 |
| slaweq | any volunteers? | 16:38 |
| mlavalle | I want to do that | 16:38 |
| slaweq | thx mlavalle :) | 16:38 |
| mlavalle | as long as I'm allowed to do it slowly | 16:38 |
| slaweq | maybe You will be able to identify some groups of failures and report them as bugs that we can track them later | 16:39 |
| mlavalle | my goal is a little broader | 16:39 |
| mlavalle | I want to make that job stable generally | 16:39 |
| slaweq | :) | 16:39 |
| *** jbadiapa has joined #openstack-meeting | 16:39 | |
| slaweq | that would be great definitelly | 16:39 |
| slaweq | #action mlavalle to debug reasons of neutron-tempest-plugin-dvr-multinode-scenario failures | 16:40 |
| slaweq | ok, and that's all from me regarding scenario jobs | 16:41 |
| slaweq | questions/comments? | 16:41 |
| bcafarel | none here | 16:41 |
| slaweq | ok | 16:42 |
| *** kopecmartin has quit IRC | 16:42 | |
| slaweq | so one last thing we I wanted mention is | 16:42 |
| slaweq | thx njohnston we have fixed our first os-ken bug: https://storyboard.openstack.org/#!/story/2005142 - thx a lot njohnston :) | 16:42 |
| mlavalle | ++ | 16:42 |
| slaweq | and with this optimistic accent I think we can finish our meeting a bit earlier today :) | 16:43 |
| mlavalle | Thanks everybody | 16:43 |
| slaweq | and let mlavalle to go where he need to go | 16:43 |
| njohnston | :) | 16:43 |
| mlavalle | o/ | 16:43 |
| slaweq | thanks for attending | 16:43 |
| slaweq | #endmeeting | 16:43 |
| njohnston | thanks! | 16:43 |
| *** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/" | 16:43 | |
| openstack | Meeting ended Tue Mar 19 16:43:26 2019 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 16:43 |
| slaweq | o/ | 16:43 |
| openstack | Minutes: http://eavesdrop.openstack.org/meetings/neutron_ci/2019/neutron_ci.2019-03-19-16.00.html | 16:43 |
| openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/neutron_ci/2019/neutron_ci.2019-03-19-16.00.txt | 16:43 |
| openstack | Log: http://eavesdrop.openstack.org/meetings/neutron_ci/2019/neutron_ci.2019-03-19-16.00.log.html | 16:43 |
| bcafarel | o/ | 16:43 |
| *** mattw4 has quit IRC | 16:45 | |
| *** mlavalle has left #openstack-meeting | 16:46 | |
| *** njohnston is now known as n8johnston | 16:47 | |
| *** 07EAA60LH is now known as njohnston | 16:47 | |
| *** cheng1 has joined #openstack-meeting | 16:49 | |
| *** n8johnston has quit IRC | 16:57 | |
| *** cheng1 has quit IRC | 17:04 | |
| *** mattw4 has joined #openstack-meeting | 17:06 | |
| *** rsimai is now known as rsimai_away | 17:08 | |
| *** iyamahat has quit IRC | 17:11 | |
| *** jaypipes has joined #openstack-meeting | 17:16 | |
| *** igordc has joined #openstack-meeting | 17:16 | |
| *** zhubx has quit IRC | 17:19 | |
| *** zhubx has joined #openstack-meeting | 17:19 | |
| *** gyee has joined #openstack-meeting | 17:24 | |
| *** priteau has joined #openstack-meeting | 17:25 | |
| *** iyamahat has joined #openstack-meeting | 17:26 | |
| *** enriquetaso has quit IRC | 17:26 | |
| *** janki has quit IRC | 17:29 | |
| *** iyamahat_ has joined #openstack-meeting | 17:29 | |
| *** iyamahat has quit IRC | 17:32 | |
| *** jamesmcarthur has quit IRC | 17:39 | |
| *** ttsiouts has quit IRC | 17:40 | |
| *** yamahata has joined #openstack-meeting | 17:43 | |
| *** jamesmcarthur has joined #openstack-meeting | 17:54 | |
| *** ivy has joined #openstack-meeting | 18:05 | |
| *** priteau has quit IRC | 18:07 | |
| *** jamesmcarthur has quit IRC | 18:12 | |
| *** jamesmcarthur has joined #openstack-meeting | 18:14 | |
| *** jamesmcarthur has quit IRC | 18:14 | |
| *** jamesmcarthur has joined #openstack-meeting | 18:14 | |
| *** enriquetaso has joined #openstack-meeting | 18:19 | |
| *** cloudrancher has quit IRC | 18:23 | |
| *** cloudrancher has joined #openstack-meeting | 18:23 | |
| *** cloudrancher has quit IRC | 18:24 | |
| *** tobiash has joined #openstack-meeting | 18:25 | |
| *** cloudrancher has joined #openstack-meeting | 18:25 | |
| *** senrique_ has joined #openstack-meeting | 18:32 | |
| *** kopecmartin has joined #openstack-meeting | 18:34 | |
| *** enriquetaso has quit IRC | 18:34 | |
| *** rbudden has quit IRC | 18:37 | |
| *** ivy has quit IRC | 18:44 | |
| *** ivy has joined #openstack-meeting | 18:45 | |
| *** sridharg has quit IRC | 18:46 | |
| *** ivy has quit IRC | 18:49 | |
| *** ivy has joined #openstack-meeting | 18:49 | |
| *** jbadiapa has quit IRC | 18:50 | |
| *** Shrews has joined #openstack-meeting | 18:59 | |
| clarkb | Anyone here for the infra meeting? | 18:59 |
| fungi | aloha | 18:59 |
| clarkb | mahalo | 18:59 |
| corvus | howdy | 19:00 |
| clarkb | #startmeeting infra | 19:01 |
| openstack | Meeting started Tue Mar 19 19:01:02 2019 UTC and is due to finish in 60 minutes. The chair is clarkb. Information about MeetBot at http://wiki.debian.org/MeetBot. | 19:01 |
| openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 19:01 |
| *** openstack changes topic to " (Meeting topic: infra)" | 19:01 | |
| openstack | The meeting name has been set to 'infra' | 19:01 |
| clarkb | #link http://lists.openstack.org/pipermail/openstack-infra/2019-March/006296.html | 19:01 |
| clarkb | #topic Announcements | 19:01 |
| *** openstack changes topic to "Announcements (Meeting topic: infra)" | 19:01 | |
| dmsimard | \o | 19:01 |
| clarkb | I'll be AFK next week from the 25-28th | 19:01 |
| ianw | o/ | 19:01 |
| clarkb | Also doesn't look like anyone wanted to run against me for PTL so I get to do that again | 19:02 |
| corvus | clarkb: congratulations! | 19:02 |
| clarkb | If you want to volunteer to chair the meeting next week let me know as I won't be able to do it | 19:02 |
| clarkb | #topic Actions from last meeting | 19:02 |
| *** openstack changes topic to "Actions from last meeting (Meeting topic: infra)" | 19:02 | |
| clarkb | #link http://eavesdrop.openstack.org/meetings/infra/2019/infra.2019-03-12-19.01.txt minutes from last meeting | 19:03 |
| clarkb | ianw: I htink you rotated those backups? | 19:03 |
| clarkb | anything interesting to say about that? | 19:03 |
| ianw | yes, please review | 19:03 |
| ianw | #link https://review.openstack.org/644457 | 19:03 |
| *** diablo_rojo has quit IRC | 19:03 | |
| ianw | that's all :) | 19:04 |
| clarkb | the other item was project renames | 19:04 |
| * jroll lurks | 19:04 | |
| clarkb | do we want to talk about that now or during the opendev topic? | 19:04 |
| * dtroyer sneaks in | 19:05 | |
| diablo_rojo_phon | Dedicated PTL https://usercontent.irccloud-cdn.com/file/87xmHZDF/IMG_20190319_120415.jpg | 19:05 |
| clarkb | we can pick it up during the opendev topic | 19:05 |
| clarkb | #topic Specs Approval | 19:05 |
| *** openstack changes topic to "Specs Approval (Meeting topic: infra)" | 19:05 | |
| clarkb | There are no specs to review | 19:06 |
| clarkb | #topic Priority Efforts | 19:06 |
| *** openstack changes topic to "Priority Efforts (Meeting topic: infra)" | 19:06 | |
| clarkb | We've updated more servers to puppet 4 in the last week. So far the only real gotcha has been that the pip provider doesn't like the warnings that pip prints on stderr | 19:06 |
| clarkb | so if pip is emitting warnings we have to fix those (last time was via upgrade of cyptography and pyopenssl | 19:07 |
| clarkb | corvus: anything new on the image building front? I guess that its actually in production now? | 19:07 |
| clarkb | with documentation and everything? | 19:07 |
| corvus | yep, nothing substantial new there; just cleaning up a few bugs | 19:08 |
| clarkb | great. | 19:09 |
| clarkb | #topic Opendev | 19:09 |
| *** openstack changes topic to "Opendev (Meeting topic: infra)" | 19:09 | |
| clarkb | I managed to fixup the bug tracker situation in gitea | 19:09 |
| clarkb | that should be all done now | 19:09 |
| corvus | yay! thanks! | 19:10 |
| clarkb | Want to talk about project renames now? | 19:10 |
| fungi | i've had the initial redirects change up for review for a while, looking for feedback | 19:10 |
| fungi | #link https://review.openstack.org/642173 Set up legacy git redirect sites | 19:10 |
| jroll | everybody wants to, judging by the ML | 19:10 |
| corvus | #link mailing list thread about openstack namespaces: http://lists.openstack.org/pipermail/openstack-discuss/2019-March/003943.html | 19:12 |
| corvus | jroll: that thread? | 19:12 |
| jroll | sorry, yes, that one | 19:12 |
| jroll | it seems we have some traction, assuming it's died down I'll do a governance change to get the general ack | 19:13 |
| clarkb | ya so far I have only heard positive things | 19:13 |
| jroll | when are we looking to try and get renames done? | 19:13 |
| fungi | i haven't really seen any overt objections on that thread, agreed. mostly just questions | 19:13 |
| clarkb | jroll: April 19 is the day we pencilled in last week | 19:14 |
| fungi | same time as the switch in domain names, ideally | 19:14 |
| clarkb | and we havne't run into any major issues since so that seems to still be on track | 19:14 |
| jroll | cool, that seems doable | 19:14 |
| corvus | jroll: what's your tl;dr read on that thread? | 19:14 |
| jroll | (assuming nobody comes and splatters random colors on the shed) | 19:14 |
| corvus | was it leaning toward one of your 3 options? | 19:15 |
| fungi | i think it was some of option 3 and some of ttx's option 4 | 19:15 |
| jroll | corvus: I have to re-read to get a count, sounds like either (2) or ttx's option is the winner | 19:15 |
| * jroll finds that link | 19:15 | |
| jroll | #link http://lists.openstack.org/pipermail/openstack-discuss/2019-March/003971.html | 19:15 |
| corvus | got it, thanks! | 19:15 |
| corvus | i'll be sure to read the whole thread after the meeting; i somehow missed that. sorry. | 19:16 |
| *** mattw4 has quit IRC | 19:16 | |
| jroll | now that I think about it, both of those have some nebulous naming activities to do, but I think we can meet april 17 | 19:16 |
| jroll | no worries :) | 19:16 |
| * jroll s/17/19/ | 19:16 | |
| fungi | there's still some question as to whether team-oriented namespaces make more sense, and also what to do about projects with no representation on the openstack map diagram thingie | 19:16 |
| corvus | cool, those both sound great, and i agree, that sounds plausible | 19:17 |
| clarkb | dtroyer: things look good your side? | 19:17 |
| *** senrique_ has quit IRC | 19:18 | |
| dtroyer | clarkb: really quiet so far, at this point it looks like we'll just be moving to a starlingx namespace and retiring 3 or so repos | 19:18 |
| fungi | and dropping the stx-prefixes, or have you decided? | 19:18 |
| dtroyer | yes, dropping stx- too | 19:18 |
| clarkb | I expect zuul will be ready | 19:19 |
| clarkb | ready to talk about the git:// to https:// transition again? | 19:20 |
| corvus | ++ | 19:20 |
| clarkb | I wanted to make sure that we don't get stuck in limbo on that topic | 19:20 |
| corvus | yeah, i think ianw wanted a decision on that at this meeting, and i agree we should do that :) | 19:20 |
| *** ttsiouts has joined #openstack-meeting | 19:20 | |
| ianw | i did post about it as mentioned in the last meeting, but didn't generate as much discussion | 19:20 |
| ianw | #link http://lists.openstack.org/pipermail/openstack-discuss/2019-March/003825.html | 19:20 |
| clarkb | ah it went to that list not the infra list which is probably why i missed it (I'm not great at keeping up there) | 19:21 |
| ianw | sorry i figured everyone would want to have an opinion since it might touch their repos, but it was maybe a little obscure | 19:21 |
| fungi | yeah, and it has a bit of a devstack-focus anyway | 19:22 |
| clarkb | fwiw your proposal seems reasonable to me | 19:22 |
| corvus | i think i'm with ianw and on board option 1 | 19:22 |
| fungi | same, option 1 for me | 19:22 |
| *** enriquetaso has joined #openstack-meeting | 19:22 | |
| clarkb | in that case it sounds like we can go ahead with 1) as proposed | 19:23 |
| corvus | when should we actually upload the changes? do we want to try to do that at the start of a weekend or something? | 19:23 |
| ianw | given that it looks like from the prior discussion we might be doing some fairly complex namespace swizzles, i think that avoids us having to synchronize | 19:24 |
| fungi | projects are sure to be putting through a ton of other changes after the transition to update domain names and project names and namespaces and stuff in their readmes and contributor docs anyway | 19:24 |
| clarkb | corvus: maybe ianw can do it during his monday morning which is sunday for most of us | 19:24 |
| ianw | sure, i can make it drizzle in over 24 hours | 19:25 |
| corvus | ianw: i think if you do it then, you can do it all at once | 19:25 |
| *** jgriffith has quit IRC | 19:26 | |
| corvus | zuul is pretty idle over the "weekend" | 19:26 |
| corvus | and hopefully that will reduce the window for copycat patches | 19:26 |
| clarkb | sounds like a plan | 19:26 |
| corvus | (i still can't believe that's a thing we have to consider) | 19:27 |
| ianw | ok, i will set it all up in a screen on bridge.o.o and we can check it over | 19:27 |
| corvus | (i mean, i believe it, i'm just... you know, wow.) | 19:27 |
| *** electrofelix has quit IRC | 19:27 | |
| clarkb | anything else opendev related? | 19:28 |
| *** e0ne has joined #openstack-meeting | 19:28 | |
| clarkb | sounds like now. Onward! | 19:28 |
| corvus | oh | 19:29 |
| clarkb | #topic Storyboard | 19:29 |
| *** openstack changes topic to "Storyboard (Meeting topic: infra)" | 19:29 | |
| clarkb | should I undo? | 19:29 |
| corvus | yeah, sorry one more quick thing | 19:29 |
| ianw | oh, yeah, one more thing | 19:29 |
| clarkb | #undo | 19:29 |
| openstack | Removing item from minutes: #topic Storyboard | 19:29 |
| corvus | should i send out an email announcing the date now? | 19:29 |
| clarkb | corvus: ++ I don't think we have anything coming up that will prevent it at this point | 19:29 |
| ianw | (for me) we agree to force merge outstanding git://->https:// changes too? what date should we do that? | 19:30 |
| fungi | yes, should reduce some further confusion over the anticipated timeframe for things | 19:30 |
| fungi | the announcement i mean | 19:30 |
| corvus | ianw: i'm ambivalent about that -- since i don't expect *functional* breakage, i'm less inclined to force-merge, but i don't object if folks think it's worthwhile. | 19:31 |
| corvus | so, consider me a weak -1 on force-merge but happy to support it if there are other +1s | 19:31 |
| clarkb | I think a deadline helps get eyeballs on it | 19:31 |
| *** jgriffith has joined #openstack-meeting | 19:31 | |
| clarkb | the 12th gives people a couple weeks if we want it done ahead of time | 19:32 |
| fungi | yeah, i'm honestly more concerned about the .gitreview and {.,}zuul{.d/*,}.yaml edits not lingering | 19:32 |
| *** gouthamr_ has joined #openstack-meeting | 19:34 | |
| ianw | ok, ummm i like the idea of a deadline being a call to action -- i'll draft something in the review commit log as part of the change; i'll request comments on in a gerrit review of the scripts | 19:35 |
| clarkb | ianw: sounds good | 19:35 |
| clarkb | #topic Storyboard | 19:35 |
| *** openstack changes topic to "Storyboard (Meeting topic: infra)" | 19:35 | |
| clarkb | ok anything storyboard to talk about? | 19:35 |
| clarkb | diablo_rojo_phon says no | 19:35 |
| clarkb | there are changes to review | 19:35 |
| clarkb | mordred isn't around today but any idea how his patches for swift things are going? | 19:35 |
| fungi | yeah, lots and lots of sb changes to review | 19:36 |
| clarkb | sounds like they are still outstanding due to changes needed in the sdk | 19:37 |
| clarkb | Lets move on since diablo_rojo_phon is eating lunch | 19:38 |
| fungi | SotK just pushed up a couple of testing-related improvements as well | 19:38 |
| *** gouthamr_ has quit IRC | 19:38 | |
| diablo_rojo_phon | Yes please lol | 19:38 |
| *** pabelanger has joined #openstack-meeting | 19:38 | |
| * fungi lets diablo_rojo_phon get back to her lunch. clarkb doesn't actually get to eat though | 19:38 | |
| clarkb | #topic General Topics | 19:38 |
| *** openstack changes topic to "General Topics (Meeting topic: infra)" | 19:38 | |
| clarkb | #link https://etherpad.openstack.org/p/201808-infra-server-upgrades-and-cleanup | 19:39 |
| clarkb | Server upgrades continue | 19:39 |
| clarkb | AFS is completely done now which is nice to get behind us | 19:39 |
| clarkb | fungi: how are wiki things? | 19:39 |
| fungi | #link https://review.openstack.org/643476 Switch from PHP5 to default PHP (PHP7 on Xenial) | 19:39 |
| fungi | that's needed to progress further on the wiki-dev02.openstack.org deployment | 19:40 |
| fungi | if any infra-puppet-core is available to review, it's a one-character removal | 19:40 |
| clarkb | I can take a look today | 19:40 |
| clarkb | The last item on my list is PTG planning | 19:41 |
| clarkb | #link https://etherpad.openstack.org/2019-denver-ptg-infra-planning | 19:41 |
| *** jamesmcarthur has quit IRC | 19:41 | |
| clarkb | #link https://www.openstack.org/ptg#tab_schedule Draft schedule. We have Friday and Saturday in a shared room with the QA team. | 19:41 |
| dmsimard | I added an item after PTG planning, needs refresh :D | 19:41 |
| clarkb | The draft schedule has us in a room friday and saturday with the qa team | 19:41 |
| corvus | clarkb: is there any chance we could shift that to thurs-friday? | 19:41 |
| *** jamesmcarthur has joined #openstack-meeting | 19:42 | |
| clarkb | corvus: we can ask, I don't actually know | 19:42 |
| clarkb | I think the saturday is a conflict for fungi too | 19:42 |
| clarkb | I'll investigate that | 19:42 |
| fungi | yeah, the tc also wants a full day on saturday | 19:43 |
| corvus | in addition to that, i would be largely idle on thursday | 19:43 |
| corvus | so if we can do something on thursday and possibly friday, it's a better use of time and we dodge fungi's conflict | 19:43 |
| clarkb | #action clarkb ask about infra ptg days being thursday friday | 19:43 |
| corvus | if it doesn't work out, maybe we can just find a nice spot on thursday and hack on server container stuff anyway? | 19:44 |
| clarkb | ++ | 19:44 |
| clarkb | Ok next up is dmsimard's ara github replication item | 19:44 |
| dmsimard | o/ | 19:45 |
| clarkb | I think this is serving as a template for replication to git remotes via zuul? | 19:45 |
| dmsimard | indeed, I've written a role with a job to test it: https://review.openstack.org/#/q/topic:upload-git-mirror | 19:45 |
| *** jamesmcarthur has quit IRC | 19:45 | |
| *** jamesmcarthur_ has joined #openstack-meeting | 19:45 | |
| dmsimard | It should hopefully be flexible enough to push from anywhere to anywhere over SSH | 19:46 |
| corvus | dmsimard: great, thanks! are those ready for review now? | 19:46 |
| dmsimard | corvus: they are | 19:46 |
| corvus | i will (re-)review them asap | 19:46 |
| dmsimard | So once we set that up, should we remove ara from the gerrit github replication ? | 19:47 |
| corvus | right now our replication is openstack* | 19:47 |
| corvus | so it might be tricky to pull one out... | 19:47 |
| dmsimard | Yeah I looked at the replication config: configuration | 19:48 |
| dmsimard | er | 19:48 |
| dmsimard | https://opendev.org/openstack-infra/system-config/src/branch/master/modules/openstack_project/manifests/review.pp#L238 | 19:48 |
| corvus | dmsimard: but.... | 19:48 |
| corvus | dmsimard: you could *additionally* replicate to another repo pretty easily | 19:48 |
| corvus | dmsimard: like, you could replicate openstack/ara to dmsimard/just-testing-git-pushes | 19:49 |
| dmsimard | right | 19:49 |
| corvus | i think that would be a sufficient "production test" before we tell everyone to start using that | 19:49 |
| fungi | sounds great to me | 19:49 |
| dmsimard | The thing is I'd like the ability to *move* that github repo and then once it's moved, keep replicating to the new repo | 19:49 |
| dmsimard | The reason for the move would be to carry stuff like watchers/stars/forks/pull requests/etc around | 19:50 |
| fungi | basically asking that the namespace moves in gitea also be reflected with org transfers in github? | 19:50 |
| fungi | the tricky bit (perhaps less so for you though) is that last i looked you need a common admin account in both the source and target orgs to make that work | 19:51 |
| dmsimard | fungi: I don't mind where ara ends up being replicated in gitea | 19:51 |
| *** e0ne has quit IRC | 19:51 | |
| clarkb | fungi: ya we might have to bootstrap that | 19:51 |
| clarkb | fungi: but once its done we should be able to remove ourselves from all the orgs | 19:51 |
| dmsimard | I'm admin in the destination org, I'm not sure I have admin in the openstack org | 19:51 |
| corvus | do we have an automated way to do that transfer? | 19:52 |
| dmsimard | not to my knowledge, it's a manual transfer in the github ui | 19:52 |
| fungi | that's the other problem... last i looked, org transfers weren't exposed in the gh api | 19:52 |
| corvus | so if we did this, we may need to perform 1500+ transfers manually through the gh web ui? | 19:52 |
| corvus | i don't think that's something i can commit to. | 19:53 |
| *** iyamahat__ has joined #openstack-meeting | 19:53 | |
| clarkb | we should double check that | 19:53 |
| clarkb | because ya that will be painful | 19:53 |
| dmsimard | corvus: where would those 1500+ projects be moved to ? | 19:54 |
| corvus | well, it would if we did it. but i don't think we have said that we would. | 19:54 |
| corvus | it hasn't been in any of the project planning so far | 19:54 |
| fungi | we've made a big point of saying we'll make sure the git urls we've been hosting continue to work and get redirected to the new domain/orgs/repos but nobody's actually asked if the same will be true of repos we're replicating to github. i know a lot of people have remotes and bookmarks to github against our recommendation, and may not realize this is going to impact them as well | 19:55 |
| clarkb | its definitely something we should do if feasible | 19:55 |
| corvus | dmsimard: i don't know where they will be moved to; presumably wherever their owners wish? | 19:55 |
| corvus | fungi: we've said that if you aren't in the openstack* namespace, automatic replication will cease. | 19:55 |
| dmsimard | corvus: fair, I went with the assumption that there was not going to be many projects in a situation similar to ara | 19:56 |
| fungi | corvus: right. most projects are *currently* in the openstack namespace though | 19:56 |
| corvus | dmsimard: you may have missed the opendev topic earlier | 19:56 |
| fungi | ~most of the plans supported so far in the openstack-discuss ml thread will involve evicting a majority of the repositories currently in that namespace | 19:56 |
| *** rbudden has joined #openstack-meeting | 19:56 | |
| *** iyamahat_ has quit IRC | 19:56 | |
| fungi | including official openstack projects | 19:56 |
| corvus | yeah that ^ | 19:57 |
| clarkb | time check we have ~3 minutes left | 19:57 |
| fungi | what would be left in the openstack namespace would either be just the ~60 service repos, or possibly nothing whatsoever | 19:57 |
| corvus | dmsimard: can you look into whether there's a way to automate that? | 19:57 |
| dmsimard | fungi: what does eviction imply in practice ? no more replication ? deletion of the project ? moving it elsewhere ? | 19:57 |
| fungi | dmsimard: that hasn't been covered yet exactly | 19:58 |
| corvus | dmsimard: it means a rename in gerrit, and whatever the project wants to do on github. | 19:58 |
| dmsimard | fungi: ok so github.com/openstack will remain but only with the official official things | 19:58 |
| fungi | likely a very small subset of the official official things | 19:58 |
| corvus | dmsimard: that hasn't been decided yet, but that's the gist of the most likely options. | 19:58 |
| fungi | and perhaps not even those | 19:58 |
| dmsimard | ack | 19:58 |
| dmsimard | I'll explore if there is an easy way to automate the transfer | 19:59 |
| corvus | dmsimard: thanks! | 19:59 |
| clarkb | And we are basically at time | 19:59 |
| clarkb | thank you everyone | 19:59 |
| clarkb | and yes I somehow managed to eat lunch too :) | 19:59 |
| fungi | thanks clarkb! | 19:59 |
| fungi | now, dessert | 19:59 |
| clarkb | Find us on IRC (#openstack-infra) or on the openstack-infra@lists.openstack.org mailing list if there are things to followup on | 20:00 |
| clarkb | #endmeeting | 20:00 |
| *** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/" | 20:00 | |
| openstack | Meeting ended Tue Mar 19 20:00:15 2019 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 20:00 |
| openstack | Minutes: http://eavesdrop.openstack.org/meetings/infra/2019/infra.2019-03-19-19.01.html | 20:00 |
| openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/infra/2019/infra.2019-03-19-19.01.txt | 20:00 |
| openstack | Log: http://eavesdrop.openstack.org/meetings/infra/2019/infra.2019-03-19-19.01.log.html | 20:00 |
| *** ttsiouts has quit IRC | 20:01 | |
| *** jamesmcarthur_ has quit IRC | 20:02 | |
| *** jamesmcarthur has joined #openstack-meeting | 20:03 | |
| *** Shrews has left #openstack-meeting | 20:04 | |
| *** mattw4 has joined #openstack-meeting | 20:06 | |
| *** jamesmcarthur has quit IRC | 20:08 | |
| *** jamesmcarthur has joined #openstack-meeting | 20:08 | |
| *** brbowen has quit IRC | 20:10 | |
| *** Lucas_Gray has joined #openstack-meeting | 20:15 | |
| *** yamamoto has joined #openstack-meeting | 20:18 | |
| *** artom has quit IRC | 20:20 | |
| *** yamamoto has quit IRC | 20:22 | |
| *** diablo_rojo has joined #openstack-meeting | 20:25 | |
| *** iyamahat_ has joined #openstack-meeting | 20:26 | |
| *** iyamahat__ has quit IRC | 20:29 | |
| *** senrique_ has joined #openstack-meeting | 20:33 | |
| *** enriquetaso has quit IRC | 20:35 | |
| *** e0ne has joined #openstack-meeting | 20:41 | |
| *** senrique_ has quit IRC | 20:43 | |
| *** mjturek has quit IRC | 20:45 | |
| *** e0ne has quit IRC | 20:46 | |
| *** b1airo has joined #openstack-meeting | 20:53 | |
| *** ttsiouts has joined #openstack-meeting | 20:54 | |
| *** oneswig has joined #openstack-meeting | 20:56 | |
| *** martial has joined #openstack-meeting | 20:59 | |
| martial | Good day | 20:59 |
| b1airo | morning | 20:59 |
| *** jtopjian has joined #openstack-meeting | 21:00 | |
| *** jmlowe has joined #openstack-meeting | 21:00 | |
| oneswig | Greetings guys | 21:00 |
| jmlowe | Hey | 21:00 |
| b1airo | #startmeeting scientific-sig | 21:00 |
| openstack | Meeting started Tue Mar 19 21:00:45 2019 UTC and is due to finish in 60 minutes. The chair is b1airo. Information about MeetBot at http://wiki.debian.org/MeetBot. | 21:00 |
| openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 21:00 |
| *** openstack changes topic to " (Meeting topic: scientific-sig)" | 21:00 | |
| openstack | The meeting name has been set to 'scientific_sig' | 21:00 |
| jmlowe | I expect rbudden to make an appearance today | 21:00 |
| rbudden | hello | 21:00 |
| rbudden | :) | 21:00 |
| b1airo | o/ | 21:00 |
| b1airo | #chair oneswig | 21:01 |
| openstack | Current chairs: b1airo oneswig | 21:01 |
| oneswig | jmlowe: so quickly proven correct | 21:01 |
| b1airo | #chair martial | 21:01 |
| openstack | Current chairs: b1airo martial oneswig | 21:01 |
| oneswig | greetings all | 21:01 |
| b1airo | hopefully joe manages to get on soon | 21:01 |
| jmlowe | I may have cheated and compared calendars with him within the past 45 min | 21:01 |
| rbudden | heh | 21:01 |
| rbudden | been far too long | 21:02 |
| *** janders has joined #openstack-meeting | 21:02 | |
| janders | g'day | 21:03 |
| b1airo | morning janders | 21:03 |
| martial | I invited Maxime and Alex to join this session to see how we run those sessions, they are proposing to discuss their work with us next week :) | 21:03 |
| oneswig | cool | 21:04 |
| oneswig | Although I am going to Texas next week to see our friends at Dell | 21:04 |
| martial | I will help start the meeting | 21:05 |
| oneswig | I expect I'll be jet-lagged so still in about the right time zone! | 21:05 |
| martial | was just about to email you about it | 21:05 |
| janders | texan bbq! :) | 21:05 |
| jtopjian | I'm here! sorry | 21:06 |
| oneswig | janders: damn right | 21:06 |
| oneswig | hi jtopjian, welcome | 21:06 |
| jtopjian | Hello | 21:07 |
| *** priteau has joined #openstack-meeting | 21:07 | |
| janders | have you guys heard the news about NVIDIA's Mellanox acquisition? | 21:07 |
| rbudden | yep | 21:07 |
| rbudden | should be interesting | 21:07 |
| *** eharney has quit IRC | 21:07 | |
| oneswig | Mixes things up a little! | 21:07 |
| janders | I sense this should push the HPC side of things more | 21:08 |
| janders | (unlike with some other potential buyers who were on the table) | 21:08 |
| martial | yep, outbid Intel by a lot too | 21:08 |
| oneswig | There's a good deal of talk about the high performance data centre | 21:08 |
| oneswig | which sounds good to me | 21:08 |
| janders | any thoughts on how this would affect Mellanox'es OpenStack work? | 21:09 |
| janders | s/would/will | 21:09 |
| oneswig | neutral-to-positive, I'd guess | 21:10 |
| b1airo | i doubt it will have any immediate impact janders | 21:10 |
| janders | same feelings here | 21:10 |
| jmlowe | I'm kind of banking on Mellanox continuing to do good things for both ceph and openstack | 21:10 |
| *** simon-AS559 has joined #openstack-meeting | 21:10 | |
| janders | I came across this yesterday: https://www.nextplatform.com/2019/03/18/intel-to-take-on-openpower-for-exascale-dominance-with-aurora/ | 21:10 |
| oneswig | b1airo: increased interest in virtualised gpu direct, perhaps? | 21:10 |
| b1airo | though a general HPC-datacentre trend might make NVIDIA more interested in e.g. Cyborg | 21:10 |
| b1airo | possibly oneswig | 21:11 |
| b1airo | or some new version thereof (more likely) | 21:11 |
| jmlowe | Which I find astounding, "We've delivered nothing, but double our money an we'll deliver something even better, we priomise" | 21:11 |
| janders | yeah.. and the interconnect bit is "interesting" | 21:11 |
| janders | as much as I am a fan of competitive landscape, no one except Mellanox seems to have the right answers to the right questions about advanced fabric features | 21:12 |
| oneswig | That's more than a ripple in the pond, janders, if it's true it's a huge splash | 21:12 |
| b1airo | they are also guilty of claiming to have the answers 2 years before they have a product containing any of them, but i guess everyone knows that now | 21:13 |
| jmlowe | Who exactly signed off on 1/2 billion to a company that just completely botched your 1/4 billion dollar acquisition? | 21:13 |
| b1airo | NVIDIA's acquisition history is not great mind you, would have been interesting to have a front row seat to Mellanox boardroom talks when that topic came up | 21:14 |
| jmlowe | I'm still waiting on my sriov live migration from Mellanox | 21:14 |
| b1airo | lols, good luck | 21:14 |
| b1airo | there is some upstream kvm work that looks promising - vfio migrations | 21:14 |
| *** tobiash has left #openstack-meeting | 21:15 | |
| b1airo | ok, we should move along and pass the baton to jtopjian | 21:15 |
| jmlowe | I might get live migration with vgpus from nvidia though | 21:15 |
| jmlowe | yes | 21:15 |
| janders | jmlowe: are you thinking eth or ib for live migration? | 21:15 |
| jtopjian | sure. I shouldn't take long, but happy to answer questions, too. | 21:16 |
| janders | I think SRIOV is tricky, but the RDMA/QP part is even trickier | 21:16 |
| b1airo | #topic Nomad for GPU container workload management | 21:16 |
| *** openstack changes topic to "Nomad for GPU container workload management (Meeting topic: scientific-sig)" | 21:16 | |
| jmlowe | janders: We wound up pitching mellanox eth | 21:16 |
| b1airo | stow it for the wrap-up lads :-) | 21:16 |
| janders | ok! | 21:16 |
| martial | jtopjian: and link for slides or external material? | 21:16 |
| jtopjian | none :) | 21:16 |
| b1airo | give us the pitch jtopjian | 21:16 |
| jtopjian | There's a group we're working with who have a stack of nine servers, each with four GPUs. Currently, users log into each server directly and perform whatever GPU processing there. | 21:17 |
| b1airo | was i correct that they are doing exploratory data-science and ML stuff jtopjian ? | 21:17 |
| jtopjian | That's correct | 21:17 |
| jtopjian | The group has a wide range of knowledge and skill as well as a wide range of what they're working on. | 21:18 |
| jtopjian | They asked us if we could do anything to help automate job submission. We figured we'd try a bit of an experiment and do something totally different. | 21:18 |
| oneswig | I guess these are all single node workloads, right? | 21:18 |
| jtopjian | Possibly. I don't think there was ever enough parallel work for a node to be running more than one job :) | 21:19 |
| jtopjian | Unfortunately we were not able to get direct access to the hardware, due to a myriad of non-technical reasons, so we set up a PoC cluster in our OpenStack cloud: 5 instances, one control node and 4 worker nodes with 1 GPU each | 21:20 |
| martial | for a second I though it was 4 GPUs per node | 21:20 |
| jtopjian | The existing cluster is. We could not get physical access to it. | 21:21 |
| jtopjian | So we build a virtual PoC instead. | 21:21 |
| jtopjian | We had a nomad master on the control node and a worker on each one. The only Nomad driver we used was "raw_exec" which basically just runs a shell command on the root filesystem. The reason we went with this route was because the group had a second request about Singularity support. | 21:21 |
| jtopjian | Nomad 0.9-dev (master branch) has support for GPU polling. It'll poll the amount of memory the GPU cards are using and schedule jobs that way. So I had to compile Nomad from source, but that's not terribly hard at all. | 21:22 |
| *** maxhub_ has joined #openstack-meeting | 21:22 | |
| jtopjian | With all of that in place, I set up some sample jobs and shared it out | 21:23 |
| jtopjian | And then waited for feedback | 21:23 |
| jtopjian | out of six people who used the cluster, I received feedback from 2. | 21:23 |
| b1airo | #link https://www.hashicorp.com/products/nomad | 21:23 |
| jtopjian | Right, some quick background: Nomad is a very basic scheduler. It supports various execution styles (batch, service) and drivers (docker, exec, qemu). | 21:24 |
| jtopjian | Jobs are declared using an HCL-type syntax. If you've worked with Terraform, Packer, etc - it's the same. | 21:24 |
| b1airo | #link https://github.com/hashicorp/hcl | 21:25 |
| jtopjian | One person "got it" and one person did not. | 21:25 |
| jtopjian | I'm quite new to working with data analysis, ML etc and learned that there are a number of different ways users work on data. I assumed we'd just give them a bunch of GPUs with a scheduler and they'd have a field day | 21:26 |
| b1airo | heh, users are the hardest part of this world | 21:26 |
| jtopjian | The person with positive feedback was at this phase of their work: they had some code they wanted to run repeatedly with different arguments and Nomad did this quite well (you can crate "parameterized jobs" which repeat jobs with new input) | 21:27 |
| jtopjian | The person with negative feedback had no code written and wanted to be as close to the GPU as possible. | 21:27 |
| *** woeifwoegihwoghw has joined #openstack-meeting | 21:27 | |
| jtopjian | So they wondered why they couldn't get shell access to the GPU and thought it was a bother to have to commit or copy their code somewhere each time they ran a job | 21:28 |
| jtopjian | So it was a learning experience. | 21:28 |
| oneswig | jtopjian: what is the execution environment nomad creates for a job that might get in the way for this user? | 21:28 |
| *** woeifwoegihwoghw is now known as alexandre_b | 21:28 | |
| martial | any into into nvidia-docker (v2) to try to give people access to the bare metal resources through an abstraction layer (seems to be very "core" OpenStack so far or am I missing something?) | 21:29 |
| jtopjian | We used "raw_exec" which just ran a command on the root filesystem. So whatever you have installed on the OS is what you have access to. | 21:29 |
| jtopjian | But Nomad also allows for chroot execution, docker execution, etc | 21:29 |
| jtopjian | I would have used Docker, but a few users wanted to use Singularity instead. | 21:29 |
| jtopjian | So "raw_exec" basically just exec'd the singularity command with an image the user made available | 21:30 |
| martial | (the HPC ... we need root squash issue ... re: Docker) | 21:31 |
| *** igordc has quit IRC | 21:31 | |
| b1airo | dunno about jtopjian , but i can't parse that question (was it a question?) martial ... | 21:31 |
| jtopjian | So that's the summary of the PoC. As for next steps, I've learned that having job submission access is just a small part of what these users want, so I'm going to be looking at something like Kubeflow to see if that can provide better features for them. | 21:31 |
| oneswig | Does it assume a network filesystem - or how is data and code copied if not? | 21:32 |
| jtopjian | Nomad can download "artifacts". Unfortunately it only supports a few methods such as http and git at the moment. | 21:32 |
| jtopjian | In your job spec, you declare different artifacts you want the worker to download and it'll pull them. The artifacts can also be interpolated so you can have an input variable of a version to download a certain version of something | 21:33 |
| b1airo | jtopjian: do they need to turn these things into services with jobs that will be spun up in the cluster? | 21:33 |
| oneswig | And I guess outputs need something too? | 21:33 |
| jtopjian | @b1 | 21:33 |
| jtopjian | @b1airo we used the "batch" scheduler which ran jobs once | 21:33 |
| jtopjian | @oneswig Nomad will save the stdout for review. For saving data somewhere else, that's something I didn't explore. | 21:34 |
| oneswig | I guess there's many ways that can be approached. | 21:34 |
| b1airo | it sort of sounds like the primary use-case is interactive exploration/design-iteration style work | 21:34 |
| jtopjian | However, one thing I was not a fan of was that Nomad does not keep logs around long. It expects you to send logs to a more robust logging system. While I understand the intention of the design, it felt lame | 21:35 |
| b1airo | if that's true i wonder whether container orchestration is really buying them anything? | 21:35 |
| jtopjian | @b1airo actually, no. This was more for a something along the lines of "I have a large dataset that I want to run a known good piece of code on for a few hours" | 21:36 |
| jtopjian | And so one piece of learning on my part was that most users are actually in the exploratory phase which made this cluster harder to work with. | 21:36 |
| jtopjian | They really just need easy access to, say, Jupyter with GPU | 21:36 |
| oneswig | The world needs that :-) | 21:37 |
| jtopjian | right? | 21:37 |
| b1airo | how had some of them come to Singularity already jtopjian ? | 21:38 |
| jtopjian | That's a good question. There were 3-4 users who were very keen on it, but others in the group who had not heard of it. | 21:40 |
| jtopjian | I'm not sure how the one group came across it | 21:40 |
| b1airo | had those 3-4 already been exposed to HPC in some way? | 21:40 |
| jtopjian | Yes and I believe they wanted Singularity for this PoC because they were unable to use it in their institution's existing clusters | 21:40 |
| martial | (b1airo not a question) | 21:41 |
| oneswig | What was Singularity gaining for them, specifically? | 21:42 |
| b1airo | which leads me to the next question, why not Slurm/PBS (plus Singularity or whatever) etc instead of these higher level programming interfaces ? | 21:42 |
| jtopjian | @oneswig: Again, good question and I'm not sure. Personally, I didn't mind using Singularity for this (I had to learn it to implement it) but I wasn't able to figure out what the big difference between it and Docker was. | 21:43 |
| oneswig | Were they wanting to use images from Singularity hub? | 21:43 |
| b1airo | i suspect you'd have to sit down with the users for a few hours to see how they were actually using it. i guess they maybe just learned how to create Singularity images and didn't know Docker images are very similar and compatible ? | 21:44 |
| jtopjian | @b1airo Slurm was mentioned in the first meeting and we chose not to implement it for two reasons: 1) it's been done and we wanted to take a chance and 2) part of our interaction with users is to... how do I want to say... work with them outside of an academic context. Being a little facetious: I don't see too many Medium articles on Slurm :) | 21:44 |
| jtopjian | @oneswig They had their own images to use | 21:45 |
| b1airo | Singularity Hub... what are people's thoughts? i went looking for an Intel optimised tensorflow container the other day and it felt like a mess | 21:45 |
| oneswig | Not tried using it b1airo | 21:45 |
| *** senrique_ has joined #openstack-meeting | 21:46 | |
| jtopjian | And "sit down" - yes, this is something we plan to do. We feel there's a big gap between students/researchers/users and infrastructure teams like my group. We want to bridge that | 21:46 |
| oneswig | Sometimes people call that bridge you're making "ResOps" - is that familiar? | 21:48 |
| *** goldenfri has joined #openstack-meeting | 21:48 | |
| jtopjian | It's not! That's new to me :) | 21:49 |
| martial | what were the advantages of Nomad for this setup? | 21:49 |
| oneswig | kind of derivative but fits the bill | 21:49 |
| *** senrique__ has joined #openstack-meeting | 21:50 | |
| b1airo | jtopjian: sure, it's great you're getting to do some exploration. though i'd challenge you on the "academic" context - HPC is a much bigger industry than just universities. anyway, i think yours is the first real-world example i've seen of attempting to push the status quo of workload management in this space. convergence of container orchestration and hpc workload management was raised in a couple different forums | 21:50 |
| b1airo | at SC last year, so you're on trend :-) | 21:50 |
| jtopjian | Exactly: from the specs which were discussed, it checked off all the boxes. Nomad, being a single binary, made deployment really quick and simple (ignoring I had to compile it, but I'm familiar with Go so that was fine). In practice, it helped us uncover a lot of missing knowledge we had about data processing. | 21:51 |
| jtopjian | To be clear: I was (and am not) not trying to challenge status quo or indoctrinate people. Part of my job is to do experiments like this. | 21:52 |
| *** whoami-rajat has quit IRC | 21:52 | |
| *** senrique_ has quit IRC | 21:52 | |
| jtopjian | If it was requested, I'd have no problems deploying something like Slurm for this group. But if I have the opportunity to explore different approaches, I'll take it. | 21:53 |
| *** senrique_ has joined #openstack-meeting | 21:53 | |
| martial | still it sounds pretty fun, and a good setup | 21:53 |
| martial | Thanks for sharing | 21:53 |
| b1airo | some other interesting examples floating around like what CERN is doing on top of Magnum, but that seems to be more about using a dynamic k8s cluster on a per-workload basis | 21:53 |
| oneswig | In a similar vein, I'd be very interested to hear about anyone's experiences with Univa NavOps - https://kubernetes.io/blog/2017/08/kubernetes-meets-high-performance/ | 21:54 |
| jtopjian | Indeed. It was a great learning experience. Nomad itself works great as a very foundational scheduler. But it's truly foundational. You'll need to add things on top of it to make it more user-friendly. | 21:54 |
| jtopjian | In another similar vein, (I can't remember if I mentioned Kubeflow earlier in this meeting), Kubeflow is on my list to look at. | 21:54 |
| *** senrique__ has quit IRC | 21:55 | |
| *** senrique__ has joined #openstack-meeting | 21:56 | |
| b1airo | yeah that sounds interesting too, suspect it might have a broader potential audience | 21:56 |
| oneswig | Thanks jtopjian - very interesting to hear about your work | 21:56 |
| b1airo | you got Magnum in any of your clouds jtopjian ? | 21:56 |
| jtopjian | @oneswig very welcome! | 21:57 |
| *** diablo_rojo has quit IRC | 21:57 | |
| jtopjian | @b1airo Yes, we support both Swarm and Kubernetes | 21:57 |
| b1airo | yes +1, thanks jtopjian , interesting stuff | 21:57 |
| rbudden | indeed, thanks for sharing | 21:57 |
| b1airo | would make a good lightning talk if you're in Denver :-) | 21:57 |
| janders | +1 thank you | 21:57 |
| janders | great idea! | 21:58 |
| jtopjian | Unfortunately I won't make it to Denver :/ | 21:58 |
| oneswig | going back to the NextPlatform article janders shared - see the reference to "Intel OneAPI" at the top of this - http://3s81si1s5ygj3mzby34dq6qf-wpengine.netdna-ssl.com/wp-content/uploads/2019/03/argonne-aurora-tech.jpg - I wondered if that was an IaaS API but it seems not... | 21:58 |
| *** senrique_ has quit IRC | 21:58 | |
| janders | regarding jmlowe's live migration concenrs, I found this: | 21:59 |
| janders | https://ieeexplore.ieee.org/stamp/stamp.jsp?arnumber=8401692 | 21:59 |
| janders | copying hardware state for bm migration sounds like a nightmare. But.. if an identical image were to be spun up on identical hardware, maybe copying the delta it wouldnt actually be that bad.. | 22:00 |
| janders | interesting idea :) | 22:00 |
| oneswig | Live migration of bare metal? "1) power off server, 2) move server to new rack, 3) power on server again?" | 22:00 |
| jmlowe | I used to use openvz and was able to live migrate with that | 22:00 |
| jmlowe | effectively live migration of containers | 22:01 |
| janders | a friend used to leverage dual PSUs and LACP to move servers between racks without powering off..we used to make jokes that's the bm livemigration | 22:01 |
| *** iyamahat__ has joined #openstack-meeting | 22:01 | |
| janders | true.. container could be that shim layer they are referring to | 22:01 |
| b1airo | the vfio migration work that is being discussed upstream at the moment sounds like it is allowing for vendor-specific state capture and transfer | 22:01 |
| b1airo | ooh, we're overtime! | 22:02 |
| janders | thanks guys! great chat | 22:02 |
| b1airo | thanks all, good turnout! | 22:02 |
| oneswig | Thanks all | 22:02 |
| janders | see you next week | 22:02 |
| rbudden | catch ya later | 22:02 |
| b1airo | sounds good! | 22:02 |
| b1airo | #endmeeting | 22:02 |
| *** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/" | 22:02 | |
| openstack | Meeting ended Tue Mar 19 22:02:39 2019 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 22:02 |
| *** jtopjian has quit IRC | 22:02 | |
| openstack | Minutes: http://eavesdrop.openstack.org/meetings/scientific_sig/2019/scientific_sig.2019-03-19-21.00.html | 22:02 |
| openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/scientific_sig/2019/scientific_sig.2019-03-19-21.00.txt | 22:02 |
| openstack | Log: http://eavesdrop.openstack.org/meetings/scientific_sig/2019/scientific_sig.2019-03-19-21.00.log.html | 22:02 |
| *** oneswig has quit IRC | 22:03 | |
| *** iyamahat_ has quit IRC | 22:04 | |
| *** iyamahat__ has quit IRC | 22:04 | |
| *** iyamahat__ has joined #openstack-meeting | 22:04 | |
| *** pcaruana has quit IRC | 22:08 | |
| *** jamesmcarthur has quit IRC | 22:08 | |
| *** Lucas_Gray has quit IRC | 22:12 | |
| *** senrique__ has quit IRC | 22:13 | |
| *** yamahata__ has joined #openstack-meeting | 22:13 | |
| *** isq_ has quit IRC | 22:14 | |
| *** rcernin has joined #openstack-meeting | 22:16 | |
| *** ivy has quit IRC | 22:21 | |
| *** rbudden has quit IRC | 22:27 | |
| *** diablo_rojo has joined #openstack-meeting | 22:30 | |
| *** jamesmcarthur has joined #openstack-meeting | 22:30 | |
| *** slaweq has quit IRC | 22:32 | |
| *** raildo has quit IRC | 22:35 | |
| *** igordc has joined #openstack-meeting | 22:42 | |
| *** jamesmcarthur has quit IRC | 22:45 | |
| *** jamesmcarthur has joined #openstack-meeting | 22:46 | |
| *** ttsiouts has quit IRC | 22:51 | |
| *** jamesmcarthur has quit IRC | 22:52 | |
| *** priteau has quit IRC | 22:54 | |
| *** brbowen has joined #openstack-meeting | 22:59 | |
| *** simon-AS559 has quit IRC | 23:00 | |
| *** janders has quit IRC | 23:00 | |
| *** iyamahat__ has quit IRC | 23:04 | |
| *** iyamahat__ has joined #openstack-meeting | 23:04 | |
| *** mriedem is now known as mriedem_away | 23:07 | |
| *** iyamahat__ has quit IRC | 23:10 | |
| *** iyamahat has joined #openstack-meeting | 23:11 | |
| *** iyamahat_ has joined #openstack-meeting | 23:14 | |
| *** jamesmcarthur has joined #openstack-meeting | 23:14 | |
| *** yaawang has quit IRC | 23:17 | |
| *** iyamahat has quit IRC | 23:17 | |
| *** yaawang has joined #openstack-meeting | 23:18 | |
| *** carlos_silva has quit IRC | 23:24 | |
| *** hongbin has quit IRC | 23:25 | |
| *** jamesmcarthur has quit IRC | 23:30 | |
| *** mattw4 has quit IRC | 23:38 | |
| *** diablo_rojo has quit IRC | 23:46 | |
| *** jamesmcarthur has joined #openstack-meeting | 23:51 | |
| *** diablo_rojo has joined #openstack-meeting | 23:56 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!
