| *** gyee has quit IRC | 00:00 | |
| *** ykatabam has quit IRC | 00:01 | |
| *** longkb has joined #openstack-meeting | 00:05 | |
| *** jessegler has quit IRC | 00:05 | |
| *** hongbin has joined #openstack-meeting | 00:26 | |
| *** macza has quit IRC | 00:41 | |
| *** erlon has quit IRC | 00:41 | |
| *** imacdonn has quit IRC | 00:49 | |
| *** imacdonn has joined #openstack-meeting | 00:49 | |
| *** njohnston has quit IRC | 01:03 | |
| *** felipemonteiro has joined #openstack-meeting | 01:04 | |
| *** ykatabam has joined #openstack-meeting | 01:08 | |
| *** bzhao__ has joined #openstack-meeting | 01:10 | |
| *** yamahata has quit IRC | 01:22 | |
| *** felipemonteiro has quit IRC | 01:27 | |
| *** janki has joined #openstack-meeting | 01:28 | |
| *** yamahata has joined #openstack-meeting | 01:33 | |
| *** ricolin has joined #openstack-meeting | 01:33 | |
| *** cloudrancher has quit IRC | 01:34 | |
| *** cloudrancher has joined #openstack-meeting | 01:35 | |
| *** isq has quit IRC | 01:54 | |
| *** Bhujay has joined #openstack-meeting | 02:00 | |
| *** felipemonteiro has joined #openstack-meeting | 02:00 | |
| *** isq has joined #openstack-meeting | 02:02 | |
| *** gcb_ has joined #openstack-meeting | 02:07 | |
| *** yamahata has quit IRC | 02:15 | |
| *** apetrich has quit IRC | 02:27 | |
| *** markstur has joined #openstack-meeting | 02:28 | |
| *** felipemonteiro has quit IRC | 02:43 | |
| *** tpatil has joined #openstack-meeting | 02:44 | |
| *** markvoelker has joined #openstack-meeting | 03:01 | |
| *** psachin has joined #openstack-meeting | 03:06 | |
| *** janki has quit IRC | 03:06 | |
| *** jamesmcarthur has joined #openstack-meeting | 03:15 | |
| *** tpatil has quit IRC | 03:17 | |
| *** jamesmcarthur has quit IRC | 03:19 | |
| *** larainema has joined #openstack-meeting | 03:21 | |
| *** diablo_rojo has quit IRC | 03:21 | |
| *** Bhujay has quit IRC | 03:24 | |
| *** tpatil has joined #openstack-meeting | 03:33 | |
| *** Nel1x has quit IRC | 03:34 | |
| *** markstur has quit IRC | 03:38 | |
| *** samP has joined #openstack-meeting | 03:56 | |
| *** ykatabam has quit IRC | 03:59 | |
| samP | hi all for masakari | 04:01 |
|---|---|---|
| tpatil | Hi | 04:01 |
| samP | #startmeeting masakari | 04:01 |
| openstack | Meeting started Tue Aug 21 04:01:26 2018 UTC and is due to finish in 60 minutes. The chair is samP. Information about MeetBot at http://wiki.debian.org/MeetBot. | 04:01 |
| openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 04:01 |
| *** openstack changes topic to " (Meeting topic: masakari)" | 04:01 | |
| openstack | The meeting name has been set to 'masakari' | 04:01 |
| samP | tpatil: hi | 04:01 |
| samP | Let's start the meeting | 04:01 |
| samP | #topic bugs&patches | 04:02 |
| *** openstack changes topic to "bugs&patches (Meeting topic: masakari)" | 04:02 | |
| samP | Any bugs or patches to discuss? | 04:02 |
| tpatil | https://bugs.launchpad.net/masakari/+bug/1779752 | 04:02 |
| openstack | Launchpad bug 1779752 in masakari-monitors "masakari segment-list returns error (openstack queens)" [Critical,Confirmed] - Assigned to Shilpa Devharakar (shilpasd) | 04:02 |
| tpatil | in the last meeting, we have discussed about patches that needs attention | 04:02 |
| tpatil | https://review.openstack.org/#/c/591557/ | 04:03 |
| tpatil | ^^ Pass region_name and interface parameters during connection initialization | 04:03 |
| tpatil | This patch is pushed against master branch | 04:03 |
| samP | tpatil: yep, sorry. I will review asap | 04:03 |
| tpatil | after it's merged, we need to take the decision to back port it to stable/rocky branch | 04:04 |
| tpatil | To resolve above LP bug, we have proposed fix in patch : https://review.openstack.org/#/c/590735/ | 04:04 |
| tpatil | this is proposed for stable/queens | 04:05 |
| samP | tpatil: got it. | 04:05 |
| tpatil | same issue also needs to be fixed in masakariclient in stable/queens branch, this is that patch : https://review.openstack.org/#/c/588157/ | 04:05 |
| tpatil | Request you to please take a look at these 3 patches | 04:06 |
| samP | tpatil: sure, I will and sorry for the delay. | 04:06 |
| tpatil | samP: NP | 04:07 |
| samP | There are some patches to run python 3 by default, which we need to review and merge | 04:08 |
| tpatil | ok, will take a look at it | 04:09 |
| samP | most of them are LGTM, I will put my review comments. | 04:09 |
| tpatil | is it a community goal to use python3 by default? | 04:09 |
| samP | tpatil: yes | 04:10 |
| *** hongbin has quit IRC | 04:10 | |
| tpatil | Targeted for rocky or stein release? | 04:10 |
| samP | I think Stein, let me ckeck | 04:10 |
| samP | #link https://governance.openstack.org/tc/goals/stein/python3-first.html | 04:11 |
| samP | It is for Stein | 04:11 |
| tpatil | Got it | 04:11 |
| *** markstur has joined #openstack-meeting | 04:11 | |
| samP | Thanks Nguyễn for those patches !! | 04:12 |
| samP | Any other patches need to discuss? | 04:13 |
| *** ijw has joined #openstack-meeting | 04:13 | |
| tpatil | No | 04:13 |
| samP | Otherwise, let move to next topic | 04:13 |
| samP | #topic PTG and Stein Dev items | 04:14 |
| *** openstack changes topic to "PTG and Stein Dev items (Meeting topic: masakari)" | 04:14 | |
| samP | Really sorry that I could not complete the etherpad. Shall we discuss this in next week meeting? | 04:15 |
| samP | #link https://etherpad.openstack.org/p/masakari-ptg-stein | 04:15 |
| samP | ^^ still empty ;) | 04:15 |
| tpatil | OK, by that time, I will also add topic from my end that I want to see in stein release | 04:15 |
| samP | tpatil: Thanks | 04:16 |
| samP | #topic Rocky Release | 04:17 |
| *** openstack changes topic to "Rocky Release (Meeting topic: masakari)" | 04:17 | |
| samP | already have RC1 and stable/rocky cut off | 04:17 |
| samP | Since masakari release job failed, I will discuss with release team and cut RC2 tag. | 04:18 |
| samP | Other than that we are fine for Final Rocky release | 04:18 |
| tpatil | ok | 04:19 |
| samP | That's all from my side. | 04:19 |
| samP | Any other item to discuss today? | 04:19 |
| tpatil | No | 04:20 |
| samP | OK then. Let's finish today's meeting | 04:20 |
| samP | Thank you. | 04:20 |
| samP | Please use openstack-dev ML with [masakari] or #openstack-masakari on IRC for further discussion. | 04:21 |
| samP | #endmeeting | 04:21 |
| *** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/" | 04:21 | |
| openstack | Meeting ended Tue Aug 21 04:21:22 2018 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 04:21 |
| openstack | Minutes: http://eavesdrop.openstack.org/meetings/masakari/2018/masakari.2018-08-21-04.01.html | 04:21 |
| openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/masakari/2018/masakari.2018-08-21-04.01.txt | 04:21 |
| openstack | Log: http://eavesdrop.openstack.org/meetings/masakari/2018/masakari.2018-08-21-04.01.log.html | 04:21 |
| samP | tpatil: thanks | 04:21 |
| tpatil | samP: Thank you | 04:21 |
| *** ykatabam has joined #openstack-meeting | 04:22 | |
| *** felipemonteiro has joined #openstack-meeting | 04:25 | |
| *** tpatil has left #openstack-meeting | 04:26 | |
| *** janki has joined #openstack-meeting | 04:27 | |
| *** psachin has quit IRC | 04:27 | |
| *** markvoelker has quit IRC | 04:32 | |
| *** markvoelker has joined #openstack-meeting | 04:43 | |
| *** Bhujay has joined #openstack-meeting | 04:45 | |
| *** Bhujay has quit IRC | 04:51 | |
| *** markstur has quit IRC | 04:51 | |
| *** markvoelker has quit IRC | 04:52 | |
| *** markstur has joined #openstack-meeting | 04:52 | |
| *** Bhujay has joined #openstack-meeting | 04:53 | |
| *** markstur has quit IRC | 04:57 | |
| *** psachin has joined #openstack-meeting | 05:14 | |
| *** ekcs has quit IRC | 05:16 | |
| *** ekcs has joined #openstack-meeting | 05:17 | |
| *** ekcs has quit IRC | 05:23 | |
| *** ekcs has joined #openstack-meeting | 05:24 | |
| *** ijw has quit IRC | 05:35 | |
| *** janki has quit IRC | 06:06 | |
| *** yamahata has joined #openstack-meeting | 06:07 | |
| *** hyunsikyang has joined #openstack-meeting | 06:26 | |
| *** alexchadin has joined #openstack-meeting | 06:27 | |
| *** rcernin has quit IRC | 06:38 | |
| *** rcernin has joined #openstack-meeting | 06:41 | |
| *** pcaruana has joined #openstack-meeting | 06:42 | |
| *** rcernin has quit IRC | 06:51 | |
| *** ykatabam has quit IRC | 06:51 | |
| *** tssurya has joined #openstack-meeting | 06:52 | |
| *** qwebirc21340 has quit IRC | 07:08 | |
| *** jamesmcarthur has joined #openstack-meeting | 07:15 | |
| *** joxyuki has joined #openstack-meeting | 07:20 | |
| *** jamesmcarthur has quit IRC | 07:20 | |
| *** alexchadin has quit IRC | 07:21 | |
| *** alexchadin has joined #openstack-meeting | 07:32 | |
| *** tetsuro has quit IRC | 07:36 | |
| *** li_jia_le has joined #openstack-meeting | 07:46 | |
| *** dkushwaha_ has joined #openstack-meeting | 07:55 | |
| *** felipemonteiro has quit IRC | 07:57 | |
| *** hadai has joined #openstack-meeting | 08:00 | |
| dkushwaha_ | #startmeeting tacker | 08:06 |
| openstack | Meeting started Tue Aug 21 08:06:26 2018 UTC and is due to finish in 60 minutes. The chair is dkushwaha_. Information about MeetBot at http://wiki.debian.org/MeetBot. | 08:06 |
| openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 08:06 |
| *** openstack changes topic to " (Meeting topic: tacker)" | 08:06 | |
| openstack | The meeting name has been set to 'tacker' | 08:06 |
| *** macza has joined #openstack-meeting | 08:06 | |
| dkushwaha_ | #topic Roll Call | 08:07 |
| *** openstack changes topic to "Roll Call (Meeting topic: tacker)" | 08:07 | |
| dkushwaha_ | who is here for Tacker meeting | 08:07 |
| li_jia_le | hi , | 08:07 |
| joxyuki | hi | 08:07 |
| dkushwaha_ | li_jia_le, hi | 08:08 |
| dkushwaha_ | joxyuki, hi | 08:08 |
| *** tetsuro has joined #openstack-meeting | 08:08 | |
| *** YanXing_an has joined #openstack-meeting | 08:08 | |
| YanXing_an | hi | 08:09 |
| dkushwaha_ | YanXing_an, hi | 08:09 |
| dkushwaha_ | ok let´s start.. | 08:10 |
| *** e0ne has joined #openstack-meeting | 08:10 | |
| dkushwaha_ | #chair YanXing_an | 08:10 |
| openstack | Current chairs: YanXing_an dkushwaha_ | 08:10 |
| dkushwaha_ | #topic Announcements | 08:10 |
| *** openstack changes topic to "Announcements (Meeting topic: tacker)" | 08:10 | |
| *** macza has quit IRC | 08:11 | |
| dkushwaha_ | Stable/Rocky released for Tacker | 08:11 |
| dkushwaha_ | Stable brach cut for Tacker-horion, Tacker server and client | 08:12 |
| dkushwaha_ | #topic Rocky Blueprint Status | 08:12 |
| *** openstack changes topic to "Rocky Blueprint Status (Meeting topic: tacker)" | 08:12 | |
| YanXing_an | nice, it's time to commit more patches and features | 08:13 |
| dkushwaha_ | One of long pending BP could not be completed in Rocky https://review.openstack.org/#/c/486924/ | 08:13 |
| dkushwaha_ | I will plan it on priority. | 08:14 |
| dkushwaha_ | YanXing_an, yes we can commit now in master branch | 08:15 |
| YanXing_an | dkushwaha_, when will we have a vPTG? | 08:15 |
| dkushwaha_ | YanXing_an, not planned yet | 08:16 |
| dkushwaha_ | i have just created etherpad link | 08:16 |
| dkushwaha_ | https://etherpad.openstack.org/p/Tacker-PTG-Stein | 08:16 |
| dkushwaha_ | Dear all, please start putting your ideas, topic on link | 08:17 |
| YanXing_an | you can use #info | 08:17 |
| dkushwaha_ | YanXing_an, ok | 08:17 |
| joxyuki | dkushwaha_, thanks for the link | 08:18 |
| dkushwaha_ | #info created etherpad link for Stein vPTG | 08:18 |
| dkushwaha_ | #link https://etherpad.openstack.org/p/Tacker-PTG-Stein | 08:18 |
| dkushwaha_ | joxyuki, do you have something to talk about reservation BP ? | 08:20 |
| joxyuki | dkushwaha_, yea, I am planning to retry the BP during Stein cycle. | 08:20 |
| dkushwaha_ | joxyuki, great. | 08:21 |
| dkushwaha_ | if required i also can join that | 08:21 |
| dkushwaha_ | #topic open discussion | 08:22 |
| *** openstack changes topic to "open discussion (Meeting topic: tacker)" | 08:22 | |
| YanXing_an | li_jia_le, you can consider some BPs that can be realized in Stein | 08:22 |
| dkushwaha_ | it will be great for me if somebody can help me to re-spin this bp https://review.openstack.org/#/c/486924/ | 08:24 |
| li_jia_le | YanXing_an: OK | 08:25 |
| li_jia_le | https://review.openstack.org/#/c/486924/ I can work on it. dkushwaha_ | 08:25 |
| dkushwaha_ | li_jia_le, Thanks | 08:26 |
| dkushwaha_ | joxyuki, YanXing_an li_jia_le Do you have something to talk? | 08:27 |
| joxyuki | no | 08:28 |
| dkushwaha_ | ok | 08:28 |
| dkushwaha_ | Thanks Folks , closing this meeting | 08:29 |
| *** joxyuki has left #openstack-meeting | 08:29 | |
| dkushwaha_ | #endmeeting | 08:29 |
| *** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/" | 08:29 | |
| openstack | Meeting ended Tue Aug 21 08:29:41 2018 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 08:29 |
| openstack | Minutes: http://eavesdrop.openstack.org/meetings/tacker/2018/tacker.2018-08-21-08.06.html | 08:29 |
| openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/tacker/2018/tacker.2018-08-21-08.06.txt | 08:29 |
| openstack | Log: http://eavesdrop.openstack.org/meetings/tacker/2018/tacker.2018-08-21-08.06.log.html | 08:29 |
| *** hadai has quit IRC | 08:30 | |
| *** electrofelix has joined #openstack-meeting | 08:33 | |
| *** dbecker has quit IRC | 08:34 | |
| *** li_jia_le has quit IRC | 08:36 | |
| *** li_jia_le has joined #openstack-meeting | 08:41 | |
| *** macza has joined #openstack-meeting | 08:48 | |
| *** alexchadin has quit IRC | 08:53 | |
| *** macza has quit IRC | 08:53 | |
| *** macza has joined #openstack-meeting | 09:09 | |
| *** macza has quit IRC | 09:14 | |
| *** alexchadin has joined #openstack-meeting | 09:14 | |
| *** apetrich has joined #openstack-meeting | 09:23 | |
| *** macza has joined #openstack-meeting | 09:30 | |
| *** dkushwaha_ has left #openstack-meeting | 09:31 | |
| *** macza has quit IRC | 09:35 | |
| *** YanXing_an has quit IRC | 09:40 | |
| *** mriedem has joined #openstack-meeting | 09:42 | |
| *** li_jia_le has quit IRC | 10:03 | |
| *** macza has joined #openstack-meeting | 10:12 | |
| *** jamesmcarthur has joined #openstack-meeting | 10:15 | |
| *** macza has quit IRC | 10:16 | |
| *** jamesmcarthur has quit IRC | 10:20 | |
| *** alexchadin has quit IRC | 10:25 | |
| *** Bhujay has quit IRC | 10:26 | |
| *** macza has joined #openstack-meeting | 10:33 | |
| *** alexchadin has joined #openstack-meeting | 10:36 | |
| *** dbecker has joined #openstack-meeting | 10:37 | |
| *** macza has quit IRC | 10:38 | |
| *** macza has joined #openstack-meeting | 10:54 | |
| *** macza has quit IRC | 10:59 | |
| *** Bhujay has joined #openstack-meeting | 11:13 | |
| *** macza has joined #openstack-meeting | 11:35 | |
| *** e0ne has quit IRC | 11:36 | |
| *** macza has quit IRC | 11:40 | |
| *** tpsilva has joined #openstack-meeting | 11:44 | |
| *** longkb has quit IRC | 11:50 | |
| *** larainema has quit IRC | 11:54 | |
| *** macza has joined #openstack-meeting | 12:04 | |
| *** numans_ has joined #openstack-meeting | 12:07 | |
| *** macza has quit IRC | 12:08 | |
| *** numans has quit IRC | 12:10 | |
| *** macza has joined #openstack-meeting | 12:11 | |
| *** macza has quit IRC | 12:12 | |
| *** raildo has joined #openstack-meeting | 12:17 | |
| *** macza has joined #openstack-meeting | 12:35 | |
| *** ssbarnea is now known as ssbarnea|ruck | 12:35 | |
| *** macza has quit IRC | 12:40 | |
| *** jamesmcarthur has joined #openstack-meeting | 12:47 | |
| *** efried is now known as efried_goatin | 13:03 | |
| *** jamesmcarthur has quit IRC | 13:04 | |
| *** r-mibu has joined #openstack-meeting | 13:15 | |
| *** psachin has quit IRC | 13:17 | |
| *** arne_wiebalck has quit IRC | 13:17 | |
| *** arne_wiebalck has joined #openstack-meeting | 13:19 | |
| *** rossella_s has joined #openstack-meeting | 13:19 | |
| *** dustins has joined #openstack-meeting | 13:22 | |
| *** eharney has quit IRC | 13:26 | |
| *** erlon has joined #openstack-meeting | 13:28 | |
| *** apetrich has quit IRC | 13:33 | |
| *** efried_goatin is now known as efried | 13:37 | |
| *** e0ne has joined #openstack-meeting | 13:40 | |
| *** jamesmcarthur has joined #openstack-meeting | 13:44 | |
| *** awaugama has joined #openstack-meeting | 13:49 | |
| *** alexchadin has quit IRC | 13:55 | |
| *** longkb has joined #openstack-meeting | 13:57 | |
| *** alexchadin has joined #openstack-meeting | 13:58 | |
| *** felipemonteiro has joined #openstack-meeting | 13:59 | |
| *** felipemonteiro has quit IRC | 14:07 | |
| *** jbadiapa has joined #openstack-meeting | 14:11 | |
| *** alexchadin has quit IRC | 14:13 | |
| *** alexchadin has joined #openstack-meeting | 14:13 | |
| *** annabelleB has joined #openstack-meeting | 14:23 | |
| *** eharney has joined #openstack-meeting | 14:23 | |
| *** felipemonteiro has joined #openstack-meeting | 14:26 | |
| *** munimeha1 has joined #openstack-meeting | 14:26 | |
| *** felipemonteiro has quit IRC | 14:32 | |
| *** annabelleB has quit IRC | 14:33 | |
| *** annabelleB has joined #openstack-meeting | 14:41 | |
| *** Leo_m has joined #openstack-meeting | 14:54 | |
| *** felipemonteiro has joined #openstack-meeting | 14:56 | |
| *** alexchadin has quit IRC | 14:56 | |
| *** hongbin has joined #openstack-meeting | 14:56 | |
| *** yamahata has quit IRC | 14:57 | |
| *** jamesmcarthur has quit IRC | 14:57 | |
| *** alexchadin has joined #openstack-meeting | 14:57 | |
| *** felipemonteiro has quit IRC | 15:02 | |
| *** felipemonteiro has joined #openstack-meeting | 15:03 | |
| *** alexchadin has quit IRC | 15:03 | |
| *** felipemonteiro has quit IRC | 15:05 | |
| *** jamesmcarthur has joined #openstack-meeting | 15:07 | |
| *** pcaruana has quit IRC | 15:09 | |
| *** priteau has joined #openstack-meeting | 15:13 | |
| *** sambetts|afk is now known as sambetts | 15:16 | |
| *** markstur has joined #openstack-meeting | 15:23 | |
| *** Bhujay has quit IRC | 15:27 | |
| *** felipemonteiro has joined #openstack-meeting | 15:30 | |
| *** felipemonteiro has quit IRC | 15:32 | |
| *** jbadiapa has quit IRC | 15:33 | |
| *** electrofelix has quit IRC | 15:37 | |
| *** electrofelix has joined #openstack-meeting | 15:37 | |
| *** yamahata has joined #openstack-meeting | 15:38 | |
| *** dklyle has quit IRC | 15:41 | |
| *** armax has joined #openstack-meeting | 15:42 | |
| *** dklyle has joined #openstack-meeting | 15:44 | |
| *** e0ne has quit IRC | 15:44 | |
| *** strigazi has quit IRC | 15:46 | |
| *** strigazi has joined #openstack-meeting | 15:46 | |
| *** longkb has quit IRC | 15:49 | |
| *** gyee has joined #openstack-meeting | 15:56 | |
| *** mlavalle has joined #openstack-meeting | 15:59 | |
| slaweq | #startmeeting neutron_ci | 16:00 |
| openstack | Meeting started Tue Aug 21 16:00:18 2018 UTC and is due to finish in 60 minutes. The chair is slaweq. Information about MeetBot at http://wiki.debian.org/MeetBot. | 16:00 |
| openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 16:00 |
| slaweq | hi | 16:00 |
| *** openstack changes topic to " (Meeting topic: neutron_ci)" | 16:00 | |
| openstack | The meeting name has been set to 'neutron_ci' | 16:00 |
| mlavalle | o/ | 16:00 |
| *** macza has joined #openstack-meeting | 16:00 | |
| * mlavalle has to leave in 40 minutes for an appointement | 16:00 | |
| slaweq | ok, mlavalle so we will try to do it fast :) | 16:01 |
| slaweq | lets start then | 16:01 |
| slaweq | #topic Actions from previous meetings | 16:01 |
| *** openstack changes topic to "Actions from previous meetings (Meeting topic: neutron_ci)" | 16:01 | |
| slaweq | njohnston to tweak stable branches dashboards | 16:01 |
| slaweq | I don't know if he did something about that but I don't think so | 16:02 |
| slaweq | I pinged njohnston on neutron channel, maybe he will join | 16:03 |
| mlavalle | ok | 16:03 |
| *** njohnston has joined #openstack-meeting | 16:03 | |
| njohnston | o/ | 16:03 |
| slaweq | hi njohnston | 16:03 |
| slaweq | we are talking about actions from previous meeting | 16:03 |
| mlavalle | he always shows up | 16:03 |
| njohnston | sorry I'm late, was engrossed in code :-) | 16:04 |
| slaweq | and we have: | 16:04 |
| slaweq | njohnston to tweak stable branches dashboards | 16:04 |
| slaweq | no problem :) | 16:04 |
| njohnston | Gah, I forgot all about that. My apologies. I'll do it today. | 16:04 |
| *** r-mibu has quit IRC | 16:04 | |
| slaweq | sure, fine | 16:04 |
| slaweq | I will add it for next week then | 16:04 |
| slaweq | #action njohnston to tweak stable branches dashboards | 16:04 |
| slaweq | next action was: | 16:05 |
| slaweq | slaweq add data about slow API to etherpad for PTG | 16:05 |
| slaweq | I added it to etherpad but I still need to add some data about what tests and what API calls are slowest | 16:05 |
| *** markstur has quit IRC | 16:05 | |
| slaweq | there are also patches to improve that in progress so I will also point to them there | 16:06 |
| mlavalle | that's good, thanks | 16:06 |
| *** ricolin has quit IRC | 16:06 | |
| slaweq | ok, next one was: | 16:06 |
| slaweq | slaweq will add number of failures to graphana | 16:06 |
| slaweq | I added such graphs to grafana | 16:06 |
| *** markstur has joined #openstack-meeting | 16:06 | |
| slaweq | it shows summarize of jobs from last 24h | 16:06 |
| slaweq | lets use it for a while and tweak if that will be necessary | 16:07 |
| mlavalle | yeah, we need to give it some time | 16:07 |
| slaweq | exactly | 16:08 |
| slaweq | I also did small reorganization of graphs there | 16:08 |
| slaweq | and moved integration tests to one graph and scenario jobs to separate graph | 16:08 |
| slaweq | I wanted to make same graphs for "check" and "gate" queue and I think that now it is like that | 16:09 |
| mlavalle | yes, good that you are tweaking it | 16:09 |
| slaweq | maybe would be better to move gate queue to separate dashboard even because there is a lot of graphs on it now | 16:09 |
| slaweq | but lets see how it will work like that for few weeks | 16:09 |
| njohnston | it definitely looks nicer +1 | 16:10 |
| mlavalle | I have always found the dasboard and some panels too loaded with data | 16:10 |
| mlavalle | I'm not that smart | 16:10 |
| slaweq | :) | 16:10 |
| mlavalle | so I like that you are simplifying it | 16:10 |
| slaweq | I'm trying but I'm not the best person for tweaking UX :P | 16:11 |
| mlavalle | well, as long as we get something we all understand easily, don't worry about UX orthodoxies | 16:11 |
| slaweq | ok, thx :) | 16:11 |
| slaweq | I will remember that | 16:11 |
| *** markstur has quit IRC | 16:11 | |
| slaweq | ok, last action from last week was: | 16:12 |
| slaweq | slaweq to report new bug about fullstack test_securitygroup(linuxbridge-iptables) issue and investigate this | 16:12 |
| slaweq | Bug reported already: https://bugs.launchpad.net/neutron/+bug/1779328 I just updated it | 16:12 |
| openstack | Launchpad bug 1779328 in neutron "Fullstack tests neutron.tests.fullstack.test_securitygroup.TestSecurityGroupsSameNetwork fails" [High,Confirmed] | 16:12 |
| slaweq | I also did small patch to enable debug_iptables_rules in L2 agent config | 16:12 |
| slaweq | it was merged today or yesterday | 16:12 |
| slaweq | so if it will fail again, I hope that this debug option will help me to figure out what is wrong there | 16:13 |
| mlavalle | so are you planning to work on it? | 16:13 |
| slaweq | yes, I have an eye on that for now | 16:13 |
| mlavalle | ok, I'll assign you to it and mark it as in progress | 16:13 |
| slaweq | ok, thx | 16:13 |
| slaweq | I forgot about that | 16:13 |
| slaweq | it's always iptables driver which is failing, never openvswitch firewall driver | 16:14 |
| slaweq | I suppose that it's some race condition again but have no idea what exactly | 16:14 |
| slaweq | ok, lets talk about grafana now | 16:15 |
| slaweq | #topic Grafana | 16:15 |
| *** openstack changes topic to "Grafana (Meeting topic: neutron_ci)" | 16:15 | |
| mlavalle | yaay, the new and improved | 16:15 |
| slaweq | As I said, I reorganized it a bit recently | 16:15 |
| slaweq | and I wanted to ask about one thing also | 16:15 |
| slaweq | I found that in available metrics are also metrics like jobs TIMED_OUT and POST_FAILURE | 16:16 |
| slaweq | should we include them in our graphs? | 16:16 |
| slaweq | for now we have it calculated as (SUCCESS / (FAILURE+SUCCESS)) | 16:16 |
| mlavalle | well the danger there is that we overload the panels with data | 16:16 |
| slaweq | so in graphs we don't see jobs which had TIMEOUT or POST_FAILURE | 16:16 |
| njohnston | Can we use wildcards in the selection of metric names? If so we could use a mid-string wildcard to count all fo the TIMED_OUT and POST_FAILURE for all the jobs and just count the number of them occurring as a sort of "healthcheck on zuul" graph | 16:17 |
| mlavalle | now, timed out and port failures are infra issues, aren't they? | 16:17 |
| mlavalle | post failures ^^^^ | 16:17 |
| slaweq | but I was thinking about somethink like ((FAILURE + TIME_OUT + POST_FAILURE) / (FAILURE + TIME_OUT + POST_FAILURE + SUCCESS)) | 16:17 |
| mlavalle | mhhhh | 16:18 |
| mlavalle | failures are our problem | 16:18 |
| slaweq | post failure is infra issue usually | 16:18 |
| mlavalle | TIME_OUT + POST_FAILURE are infra's, or am I wrong? | 16:18 |
| slaweq | but timeout is mostly our issue (slow api for example) | 16:18 |
| mlavalle | ok, I buy that | 16:18 |
| slaweq | and time_out is what we hit more often | 16:19 |
| njohnston | we should still have the tests get killed by the internal timer and register as a normal FAILURE instead of a TIMED_OUT | 16:19 |
| mlavalle | so if we can organize this in such a way that we can easily discriminate what we need to worry about and what we need to communicate to infra, I am all for it | 16:19 |
| slaweq | njohnston: yes, but if job is taking long time it reaches some kind of "global" timeout and job is killed | 16:19 |
| slaweq | so updating to something like ((FAILURE + TIME_OUT) / (FAILURE + TIME_OUT + SUCCESS)) [in %] | 16:20 |
| slaweq | right? | 16:20 |
| njohnston | ok | 16:21 |
| mlavalle | that formula seems right to indicate "what we need to worryt about" | 16:21 |
| slaweq | we will then have percentage of failures and timeouts for all our jobs which isn't post_failure (so percentage of our issues) | 16:21 |
| slaweq | ok, so I will update it in grafana | 16:21 |
| slaweq | #action slaweq to update grafana dashboard to ((FAILURE + TIME_OUT) / (FAILURE + TIME_OUT + SUCCESS)) | 16:21 |
| mlavalle | njohnston: you agree with that formula? | 16:21 |
| mlavalle | well, let's move on | 16:23 |
| slaweq | I think we lost njohnston :/ | 16:23 |
| slaweq | ok | 16:23 |
| njohnston | yes that is good | 16:23 |
| mlavalle | ++ | 16:24 |
| slaweq | speaking about grafana there is no new "big" issues IMO | 16:24 |
| slaweq | so let's talk about some specific jobs now | 16:24 |
| slaweq | #topic functional | 16:24 |
| *** openstack changes topic to "functional (Meeting topic: neutron_ci)" | 16:24 | |
| slaweq | I want to start with functional because there is one urgent issue with it | 16:24 |
| slaweq | in stable/queens it looks it's failing 100% times since few days | 16:25 |
| mlavalle | ok | 16:25 |
| slaweq | bug reported https://bugs.launchpad.net/neutron/+bug/1788185 | 16:25 |
| openstack | Launchpad bug 1788185 in neutron "[Stable/Queens] Functional tests neutron.tests.functional.agent.l3.test_ha_router failing 100% times " [Critical,Confirmed] | 16:25 |
| slaweq | example of failure: http://logs.openstack.org/78/593078/1/check/neutron-functional/28fe681/logs/testr_results.html.gz | 16:25 |
| slaweq | last patch merged to queens branch was https://review.openstack.org/#/c/584276/ | 16:27 |
| slaweq | which IMO can be potential culprit | 16:28 |
| slaweq | but it has to be checked | 16:28 |
| mlavalle | nobody working on it? | 16:29 |
| mlavalle | the bug I mean | 16:29 |
| mlavalle | it has no assignee | 16:29 |
| slaweq | I reported it today, few hours ago | 16:30 |
| slaweq | and I hadn't got time to work on it yet | 16:30 |
| mlavalle | do you have bandwidth? I can help if you don't | 16:30 |
| slaweq | would be great if You could check that | 16:31 |
| mlavalle | ok, I'll take a stab at it | 16:31 |
| slaweq | thx | 16:31 |
| mlavalle | just assigned it to me | 16:31 |
| mlavalle | I'll yell for help if I get myself in trouble | 16:31 |
| slaweq | sure | 16:33 |
| slaweq | ok, let's quickly move for other issues | 16:33 |
| *** annabelleB has quit IRC | 16:33 | |
| slaweq | I recently found few times issues in neutron.tests.functional.agent.l3.test_metadata_proxy.UnprivilegedUserGroupMetadataL3AgentTestCase | 16:34 |
| slaweq | but this should be "fixed" by patch https://review.openstack.org/#/c/586341/4 :) | 16:34 |
| slaweq | so please review it | 16:34 |
| mlavalle | added it to my pile | 16:35 |
| slaweq | thx | 16:35 |
| mlavalle | will look at it when I come back after my appointment | 16:35 |
| njohnston | I've been seeing issues with neutron_tempest_plugin.scenario.test_dns_integration.DNSIntegrationTests.test_server_with_fip but I haven't been able to track it to a source | 16:35 |
| njohnston | It's happened about 40 times in the last week; I added an elastic-recheck change to look for it https://review.openstack.org/593722 | 16:36 |
| slaweq | njohnston: I know, it's even reported on https://bugs.launchpad.net/bugs/1788006 :) | 16:36 |
| openstack | Launchpad bug 1788006 in neutron "neutron_tempest_plugin DNS integration tests fail with "Server [UUID] failed to reach ACTIVE status and task state "None" within the required time ([INTEGER] s). Current status: BUILD. Current task state: spawning."" [Undecided,New] | 16:36 |
| njohnston | yeah, I dropped that bug when I exceeded my timebox on tracking down the source of the issue | 16:36 |
| mlavalle | mhhh the description sound like a nova issue | 16:36 |
| mlavalle | not saying it is not our issue | 16:37 |
| mlavalle | but seems odd | 16:37 |
| slaweq | yep, it looks so at first glance | 16:37 |
| slaweq | but we should check it | 16:37 |
| slaweq | anyone has bandwidth for it? | 16:37 |
| mlavalle | don't have much, but I'll try to take a look | 16:38 |
| njohnston | I could ping the nova-neutron liaison | 16:38 |
| njohnston | I believe that is sean-k-mooney | 16:38 |
| mlavalle | I'll takle a quick look before pinging sean-k-mooney | 16:38 |
| njohnston | thanks much | 16:38 |
| slaweq | thx mlavalle | 16:38 |
| slaweq | and thx njohnston :) | 16:38 |
| mlavalle | ok, I have to leave guys | 16:39 |
| slaweq | #action mlavalle to check neutron_tempest_plugin.scenario.test_dns_integration.DNSIntegrationTests.test_server_with_fip issue | 16:39 |
| slaweq | ok, thx mlavalle | 16:39 |
| mlavalle | o/ | 16:39 |
| slaweq | it's basically all what I had for today from important things | 16:39 |
| slaweq | so njohnston if You don't have anything to talk about I think we can finish earlier today | 16:40 |
| slaweq | :) | 16:40 |
| njohnston | nothing from me, it just seems like we have a lot of timeouts of late | 16:40 |
| njohnston | anyhow, have a good evening slaweq, and thanks as always! | 16:41 |
| slaweq | ok, thx njohnston | 16:41 |
| slaweq | and have a nice day :) | 16:41 |
| slaweq | #endmeeting | 16:42 |
| *** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/" | 16:42 | |
| openstack | Meeting ended Tue Aug 21 16:42:04 2018 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 16:42 |
| openstack | Minutes: http://eavesdrop.openstack.org/meetings/neutron_ci/2018/neutron_ci.2018-08-21-16.00.html | 16:42 |
| openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/neutron_ci/2018/neutron_ci.2018-08-21-16.00.txt | 16:42 |
| openstack | Log: http://eavesdrop.openstack.org/meetings/neutron_ci/2018/neutron_ci.2018-08-21-16.00.log.html | 16:42 |
| slaweq | see You | 16:42 |
| *** annabelleB has joined #openstack-meeting | 16:43 | |
| *** felipemonteiro has joined #openstack-meeting | 16:48 | |
| *** markvoelker has joined #openstack-meeting | 16:50 | |
| *** sambetts is now known as sambetts|afk | 16:52 | |
| *** felipemonteiro has quit IRC | 16:52 | |
| *** jamesmcarthur has quit IRC | 17:14 | |
| *** yamahata has quit IRC | 17:17 | |
| *** Namrata has joined #openstack-meeting | 17:39 | |
| *** Namrata has quit IRC | 17:39 | |
| *** electrofelix has quit IRC | 17:39 | |
| *** e0ne has joined #openstack-meeting | 17:42 | |
| *** cloudrancher has quit IRC | 17:48 | |
| *** jamesmcarthur has joined #openstack-meeting | 17:49 | |
| *** cloudrancher has joined #openstack-meeting | 17:49 | |
| *** cloudrancher has quit IRC | 17:50 | |
| *** tssurya has quit IRC | 17:50 | |
| *** cloudrancher has joined #openstack-meeting | 17:51 | |
| *** cloudrancher has quit IRC | 17:52 | |
| *** cloudrancher has joined #openstack-meeting | 17:53 | |
| *** cloudrancher has quit IRC | 17:53 | |
| *** cloudrancher has joined #openstack-meeting | 17:53 | |
| *** cloudrancher has quit IRC | 17:54 | |
| *** portdirect has quit IRC | 17:54 | |
| *** numans_ has quit IRC | 17:54 | |
| *** cloudrancher has joined #openstack-meeting | 17:54 | |
| *** cloudrancher has quit IRC | 17:55 | |
| *** diablo_rojo has joined #openstack-meeting | 17:56 | |
| *** cloudrancher has joined #openstack-meeting | 17:56 | |
| *** cloudrancher has quit IRC | 17:56 | |
| *** yamahata has joined #openstack-meeting | 17:58 | |
| *** apetrich has joined #openstack-meeting | 18:02 | |
| *** markstur has joined #openstack-meeting | 18:07 | |
| *** jamesmcarthur has quit IRC | 18:08 | |
| *** jbadiapa has joined #openstack-meeting | 18:09 | |
| *** mjturek has joined #openstack-meeting | 18:10 | |
| *** markstur has quit IRC | 18:12 | |
| *** Shrews has joined #openstack-meeting | 18:26 | |
| *** rledisez has quit IRC | 18:37 | |
| *** lamt has quit IRC | 18:37 | |
| *** Adri2000 has quit IRC | 18:37 | |
| *** leifz has quit IRC | 18:37 | |
| *** vkmc has quit IRC | 18:37 | |
| *** ttx has quit IRC | 18:37 | |
| *** kencjohnston has quit IRC | 18:37 | |
| *** fungi has quit IRC | 18:37 | |
| *** kencjohnston_ has joined #openstack-meeting | 18:38 | |
| *** rledisez has joined #openstack-meeting | 18:38 | |
| *** vkmc has joined #openstack-meeting | 18:40 | |
| *** kota_ has quit IRC | 18:42 | |
| *** TheJulia has quit IRC | 18:42 | |
| *** tobberydberg has quit IRC | 18:42 | |
| *** hrybacki has quit IRC | 18:42 | |
| *** lsell__ has quit IRC | 18:42 | |
| *** mnaser has quit IRC | 18:42 | |
| *** AJaeger has joined #openstack-meeting | 18:42 | |
| *** kota_ has joined #openstack-meeting | 18:46 | |
| *** fungi has joined #openstack-meeting | 18:48 | |
| *** eharney has quit IRC | 18:52 | |
| *** isq_ has joined #openstack-meeting | 18:54 | |
| *** e0ne has quit IRC | 18:57 | |
| *** isq has quit IRC | 18:57 | |
| *** sdatko has joined #openstack-meeting | 18:57 | |
| *** isq_ has quit IRC | 18:58 | |
| *** isq has joined #openstack-meeting | 18:58 | |
| *** eharney has joined #openstack-meeting | 18:59 | |
| *** priteau has quit IRC | 19:00 | |
| fungi | infra team, assemble! | 19:00 |
| AJaeger | o/ | 19:00 |
| fungi | since it looks like nobody volunteered to chair, i'm falling on that grenade. bear with me as i'm wholly unprepared | 19:01 |
| fungi | looks like i'm also the only one to propose a topic this week (one which i added just now) | 19:01 |
| ianw | oh sorry, could have done it :/ thought no news was good news :) | 19:01 |
| fungi | np | 19:01 |
| cmurphy | o/ | 19:01 |
| *** TheJulia has joined #openstack-meeting | 19:01 | |
| corvus | o/ | 19:01 |
| fungi | as i'm the only one with a general topic, i suppose it's only fair that i chair | 19:02 |
| sdatko | hello o/ | 19:02 |
| fungi | hi sdatko! | 19:02 |
| fungi | #startmeeting infra | 19:02 |
| openstack | Meeting started Tue Aug 21 19:02:25 2018 UTC and is due to finish in 60 minutes. The chair is fungi. Information about MeetBot at http://wiki.debian.org/MeetBot. | 19:02 |
| openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 19:02 |
| *** openstack changes topic to " (Meeting topic: infra)" | 19:02 | |
| openstack | The meeting name has been set to 'infra' | 19:02 |
| fungi | #link https://wiki.openstack.org/wiki/Meetings/InfraTeamMeeting#Agenda_for_next_meeting | 19:02 |
| fungi | #topic Announcements | 19:02 |
| *** openstack changes topic to "Announcements (Meeting topic: infra)" | 19:02 | |
| fungi | #info clarkb (our peerless feeder, i mean fearless leader) is on vacation August 20-24, this week | 19:03 |
| fungi | which is why you get to deal with your illustrious substitute meeting chair | 19:03 |
| * mordred waves | 19:03 | |
| fungi | #topic Actions from last meeting | 19:04 |
| *** openstack changes topic to "Actions from last meeting (Meeting topic: infra)" | 19:04 | |
| fungi | #link http://eavesdrop.openstack.org/meetings/infra/2018/infra.2018-08-14-19.01.html Minutes from last meeting | 19:04 |
| fungi | 1. (none) | 19:05 |
| fungi | well, that's exciting. i guess we did all those ;) | 19:05 |
| fungi | #topic Specs approval | 19:05 |
| *** openstack changes topic to "Specs approval (Meeting topic: infra)" | 19:05 | |
| fungi | we don't seem to have any specs up this week on the agenda for infra council rollcall, though there are a couple active under review at present | 19:06 |
| fungi | #link https://review.openstack.org/563849 Direction setting for 3rd Party CI (ianw) | 19:06 |
| fungi | #link https://review.openstack.org/587283 A spec for exploring the specifics of letsencrypt support (ianw) | 19:07 |
| ianw | i haven't received any particular comments on the section about the goals of 3rd party ci | 19:07 |
| fungi | ianw: i know i still owe you a rough implementation writeup of my alternative for that second one | 19:07 |
| fungi | in the process of drafting it as a review comment so as not to get in the way of you addressing the other comments on that most recent patchset | 19:08 |
| ianw | fungi: ok, i can update and am happy for you to upload directly | 19:08 |
| fungi | that's fine too. if you want to address the other comments in there however and then i'll do a patchset on top of that with the alternative as a cohesive bit under the alternatives section (which is now remarkably sparse anyway) | 19:09 |
| *** mnaser has joined #openstack-meeting | 19:09 | |
| ianw | ++ | 19:10 |
| fungi | anyway, unless anyone wants to bring up anything specs related right now, i'll move on since i think the priority efforts discussion is likely to take up some time | 19:10 |
| fungi | #topic Priority Efforts - A Task Tracker for OpenStack | 19:11 |
| *** openstack changes topic to "Priority Efforts - A Task Tracker for OpenStack (Meeting topic: infra)" | 19:11 | |
| fungi | #link http://specs.openstack.org/openstack-infra/infra-specs/specs/task-tracker.html | 19:11 |
| *** jamesmcarthur has joined #openstack-meeting | 19:11 | |
| diablo_rojo | Today on the ML I suggested that now since everything else is in flux for Searchlight and Trove, might be a good time to migrate. | 19:12 |
| mordred | ++ | 19:13 |
| fungi | the fix for 404 errors from the "Jump to..." box landed last week in the webclient | 19:13 |
| diablo_rojo | Yes! That is exciting too | 19:13 |
| fungi | as did one for non-array team_id and user_id parameters and something about disabling closing modals when you click the backdrop | 19:13 |
| fungi | i think the fontawesome update is also close to landing | 19:13 |
| mordred | woot | 19:14 |
| diablo_rojo | Will be wonderful to have all that landed. | 19:14 |
| fungi | which is the bottom of a fairly large stack SotK has up for review to improve the webclient | 19:14 |
| *** dmsimard has joined #openstack-meeting | 19:14 | |
| diablo_rojo | Looks like Fatema has two patches ready for review too- she also said that she would try to stick around as much as she can through school- she doesn't plan on disappearing now that her internship is over. | 19:15 |
| fungi | that's excellent news | 19:15 |
| diablo_rojo | I think she likes our community or something ;) | 19:15 |
| fungi | usually interns can't wait to get away from us (just kidding, usually they simply get really busy with their studies, which is entirely understandable) | 19:15 |
| *** jamesmcarthur has quit IRC | 19:15 | |
| diablo_rojo | Yeah she has till like the end of Sept before school starts | 19:16 |
| diablo_rojo | and she will try to stick around past then too but time will tell | 19:16 |
| fungi | pressure is also mounting to implement some swift integration or something like that to handle story attachments | 19:16 |
| diablo_rojo | Yeah I think that is the next big target. We can talk about that at the PTG. | 19:17 |
| fungi | so if anybody's interested, reviewing open changes and maybe hacking on attachments support would be great places to contribute to the effort | 19:17 |
| diablo_rojo | +2000 | 19:17 |
| fungi | (start with writing a spec for attachments, please) | 19:17 |
| fungi | we good on sb updates for the week? | 19:17 |
| diablo_rojo | Yeah I think so | 19:18 |
| * diablo_rojo sits down at the back of the room | 19:18 | |
| fungi | stay standing, we're almost sure to volunteer you for things! ;) | 19:18 |
| *** mlavalle has left #openstack-meeting | 19:18 | |
| fungi | #topic Priority Efforts - Update Config Management | 19:18 |
| *** openstack changes topic to "Priority Efforts - Update Config Management (Meeting topic: infra)" | 19:18 | |
| fungi | #link http://specs.openstack.org/openstack-infra/infra-specs/specs/update-config-management.html | 19:18 |
| * diablo_rojo sinks lower in her seat | 19:18 | |
| fungi | here's where i expect we'll spend a good portion of our hour today | 19:19 |
| mordred | fungi: it's done! | 19:19 |
| fungi | there has been a continued flurry of activity on this | 19:19 |
| cmurphy | o/ | 19:19 |
| mordred | we're completely migrated and everything is perfect | 19:19 |
| corvus | it's done depending on exactly how you dereference "it" | 19:19 |
| cmurphy | oh that's good news | 19:19 |
| * fungi waits for the other shoe to drop | 19:19 | |
| * cmurphy goes on vacation | 19:19 | |
| mordred | corvus: I think life is easier with vague antecedents to our pronouns | 19:19 |
| AJaeger | so, anything we should not merge currently? Any caveats for reviewers? | 19:19 |
| mordred | ok - seriously ... | 19:20 |
| *** bnemec has quit IRC | 19:20 | |
| mordred | the cronjob on bridge.openstack.org isn't live yet - but I think we're mostly good and should be able to land it post-meeting | 19:20 |
| *** bnemec has joined #openstack-meeting | 19:20 | |
| fungi | yeah, i was +2 on it but didn't want to single-core merge that one particularly | 19:21 |
| mordred | AJaeger: I'd still wait until the cron patch has gone live for new projects - but otherwise, no | 19:21 |
| mordred | fungi: ++ | 19:21 |
| mordred | if people want to review a GIANT patch related to iptables rules ... | 19:21 |
| cmurphy | that sounds very fun and not at all terrible | 19:22 |
| fungi | i've unfortunately had to save looking at that one until my evening. today has gotten away from me rather quickly | 19:22 |
| mordred | https://review.openstack.org/#/c/593973 and https://review.openstack.org/#/c/594340 and https://review.openstack.org/#/c/594437 and https://review.openstack.org/#/c/594438 are fun | 19:22 |
| AJaeger | mordred: ok, just tell once ready... | 19:22 |
| mordred | cmurphy: ^^ there you go - all the fun you've ever wanted | 19:22 |
| cmurphy | ;) | 19:22 |
| mordred | AJaeger: will do | 19:22 |
| cmurphy | re puppet there are a few lingering topic:puppet-4 patches (the ones verified+1 and without workflow-1) that are just adding tests that should be easy reviews | 19:23 |
| corvus | mordred: after snmpd and iptables, are there any other base puppet things to move to ansible? | 19:23 |
| cmurphy | and if anyone is brave there is a series to turn on the future parser on several more nodes | 19:23 |
| mordred | also - the groups.yaml file is starting to become a bit unwieldy - so we might need to make a new inventory plugin to let us express some groups more easier | 19:23 |
| ianw | mordred: is there any reason why that can't be tested? | 19:24 |
| mordred | ianw: nope - and in fact, at least some of it is being tested | 19:24 |
| ianw | I have a moderately large stack starting https://review.openstack.org/#/c/593487/ that uses roles out of system-config | 19:24 |
| mordred | corvus: afs (which ianw's work should do for us) | 19:25 |
| mordred | corvus: and unbound | 19:25 |
| ianw | there are a few things that need doing to get the roles documented and usable | 19:25 |
| corvus | mordred: afs isn't used on every server | 19:25 |
| corvus | but unbound is | 19:25 |
| mordred | yah- oh - and unattended-upgrades | 19:25 |
| fungi | bup might be nice to do early on as well? | 19:26 |
| corvus | i think my question is this -- the next milestone we should be working toward is "bridge configured as a standard host and everything on bridge configured by ansible", yeah? | 19:26 |
| mordred | so unbound/unattended-upgrades/timezone/ntp are the last every-server things - afs isn't on every server but is curently plumbed through openstack_project::server so getting it transitioned will get us off of openstack_project::server | 19:26 |
| fungi | or did bup get done already (is bridge being backed up)? | 19:26 |
| mordred | fungi: no - I don't think bup has been done- and I don't see it in openstack_project::server - so yeah, we should put that up on the list | 19:27 |
| mordred | corvus: I like your milestone | 19:27 |
| fungi | fwiw, backing up puppetmaster had been a very-long-standing todo anyway | 19:27 |
| mordred | I think 'bridge configured as standard host' is one milestone and 'everything on bridge configured by ansible' is a good followup | 19:28 |
| fungi | mostly because we wanted to avoid backing up cleartext sensitive file content (passwords, keys...) | 19:28 |
| corvus | mordred: oh are we running puppet on bridge? | 19:28 |
| mordred | since there are some things that bridge+others all need, like ntp or unbound - and there are things thare are specific to bridge that got done by hand | 19:28 |
| mordred | corvus: nope - there is no puppet on bridge - there are just some things that got copied over from puppetmaster - like the clouds.yaml file | 19:29 |
| corvus | mordred: oh, i thought all the stuff that was done by hand was captured. | 19:29 |
| corvus | i see | 19:29 |
| ianw | mordred: sorry, crossing streams ... if the iptables rule was in a top level role/ directory i feel like it could be tested with our usual integration jobs (like what i've proposed for afs+kerberos) | 19:29 |
| fungi | #agreed next milestone is bridge configured as standard host, with everything on bridge configured by ansible (including anything which was initially configured manually) | 19:29 |
| fungi | i can #undo that if we don't actually agree | 19:29 |
| mordred | ianw: yup. I agree - I think we can land the move-roles-dir patch pretty much any time | 19:29 |
| corvus | mordred: what's "timezone"? | 19:30 |
| ianw | mordred: well, see everything i've stacked ontop of it first, having actually used it :) | 19:30 |
| mordred | :) | 19:30 |
| mordred | corvus: setting the system timezone to utc | 19:30 |
| corvus | wow we really have a puppet-timezone module | 19:30 |
| corvus | i didn't know/remember that | 19:30 |
| mordred | class { 'timezone': timezone => 'Etc/UTC', } ... yeah | 19:30 |
| corvus | #info fundamental modules remaining to port to ansible: iptables (in progress), snmp (in progress), unbound, unattended-upgrades, timezone, ntp | 19:31 |
| fungi | that does indeed seem like overkill | 19:31 |
| corvus | that look right ^? | 19:31 |
| fungi | wfm, unless we also want bup in there on principle | 19:31 |
| mordred | yes | 19:31 |
| *** armax has quit IRC | 19:31 | |
| corvus | fungi: i'd like to draw the line before bup since it's not strictly required for every server | 19:31 |
| fungi | but i also am good with considering backups of bridge.o.o as a separate milestone, since we need to be careful about _what_ we back up from there | 19:32 |
| corvus | (i'm mostly trying to come up with work units for the proposed milestone) | 19:32 |
| fungi | yeah, i think that's perfectly fine | 19:32 |
| *** armax has joined #openstack-meeting | 19:33 | |
| corvus | i think getting this work done gets us to the point where the tree can branch and we can do more interesting things at the PTG | 19:33 |
| mordred | totally agre | 19:33 |
| fungi | that will be awesome | 19:33 |
| *** melwitt has quit IRC | 19:33 | |
| *** sdake has quit IRC | 19:33 | |
| mordred | once the base stuff is done, hacking on migrating individual services is much more parallelizable | 19:34 |
| *** melwitt has joined #openstack-meeting | 19:34 | |
| *** sdake has joined #openstack-meeting | 19:34 | |
| fungi | any specific items on that set of work units we want to dive into in the meeting? | 19:35 |
| fungi | anything we should be on the lookout for? | 19:36 |
| corvus | i'll finish working on snmp/iptables; i think the others are up for grabs | 19:36 |
| fungi | ianw: were your testing concerns addressed above? | 19:36 |
| corvus | i'd like to talk more about testing | 19:36 |
| fungi | great! | 19:36 |
| fungi | please do | 19:36 |
| ianw | IMO we should start out moving these to top level roles/ and test them from zuul as much as possible, and also have things like the readme written with an eye to them being generic-ish. I know we can race ahead and leave all that for later | 19:37 |
| corvus | well, actually i'd like to listen more about testing :) | 19:37 |
| ianw | but later is a thing that tends to never come | 19:37 |
| pabelanger | I've been testing with molecule for ansible recently, works well. same idea as beaker testing for puppet | 19:37 |
| corvus | ianw: yeah, i think we've got exim and (at the end of the series) iptables and snmp all done generically and with a readme | 19:37 |
| ianw | corvus: right; i've got patches up to actually make the documentation too, which fixes at least one issue in the exim readme | 19:38 |
| fungi | pabelanger: bending beaker to our model of already-provisioned test environments ended up being sort of a challenge, if my memory isn't failing me. does molecule present similar base assumptions we have to work around? | 19:38 |
| corvus | does anything exercise these roles for real? | 19:38 |
| mordred | the roles are being run in our current puppet tests | 19:38 |
| corvus | mordred: the apply test? | 19:39 |
| corvus | or the beaker test? | 19:39 |
| *** ahale has quit IRC | 19:39 | |
| *** evrardjp has quit IRC | 19:39 | |
| *** pcarver has quit IRC | 19:39 | |
| *** timothyb89 has quit IRC | 19:39 | |
| *** aarents has quit IRC | 19:39 | |
| *** Neptu has quit IRC | 19:39 | |
| *** rodrigods has quit IRC | 19:39 | |
| *** scas has quit IRC | 19:39 | |
| corvus | oh it's the beaker tests | 19:39 |
| mordred | at least the beaker test | 19:39 |
| mordred | yeah | 19:39 |
| corvus | my snmp role failed beaker but passed apply | 19:39 |
| mordred | we run base.yaml as a setup step in the beaker test | 19:39 |
| pabelanger | fungi: yea, molecule has a delegated backend, where you can say the node has already been provisioned. Then either use localhost or loopback ssh | 19:39 |
| *** mriedem is now known as mriedem_afk | 19:39 | |
| ianw | pabelanger: link for molecule? | 19:40 |
| pabelanger | fungi: the main bonus for molecule, would be to say allow local iteration against docker / vagrant, then when in zuul just assume node is already setup and skip the provision | 19:40 |
| corvus | the spec says we should start using testinfra | 19:40 |
| pabelanger | https://molecule.readthedocs.io/en/latest/ | 19:40 |
| mordred | yah - testinfra is a way to express the actual tests | 19:40 |
| mordred | my understanding is that molecule is a test runner and can use testinfra tests | 19:40 |
| corvus | okay, so are we at a place where we should start using testinfra? | 19:41 |
| mordred | so kind of like beaker and serverspec | 19:41 |
| mordred | corvus: I think we're definitely at a place where we should figure out the molecule/testinfra situation and come up with a testing pattern | 19:41 |
| pabelanger | Yah, I've also switched some roles to testinfra recently too: http://git.openstack.org/cgit/openstack/ansible-role-nodepool/tree/tests/test_role.py | 19:41 |
| pabelanger | default is pytest, but does support python unittests | 19:41 |
| pabelanger | but haven't tested | 19:41 |
| *** sambetts|afk has quit IRC | 19:42 | |
| corvus | well, the other thing we can do is, and this is maybe what ianw was getting at, is have zuul run the ansible for the tests | 19:43 |
| fungi | rather than an indirection layer | 19:43 |
| *** Neptu has joined #openstack-meeting | 19:43 | |
| corvus | so, basically, run the base.yaml playbook from zuul, with zuul's own inventory | 19:43 |
| mordred | yes. the main issue with that is that zuul is using 2.5 and were using 2.6 on bridge - it's PROBABLY not a problem - but it's a thing to be aware of | 19:43 |
| pabelanger | if we don't expect people to use sytem-config roles, that sounds like a good start | 19:43 |
| corvus | then validate with testinfra | 19:43 |
| fungi | like a dry-run of what we might do in the future to configure servers directly from zuul jobs? | 19:43 |
| mordred | also - we have some plugins | 19:44 |
| mordred | that zuul will disallow us from using | 19:44 |
| corvus | mordred: what plugins? | 19:44 |
| pabelanger | zuul ansible, run tox ansible still is valid for testing too | 19:44 |
| mordred | the iptables patch adds a jinja filter_plugin | 19:44 |
| ianw | mordred/corvus: hrm, yeah i hit that with https://review.openstack.org/#/c/593998/ | 19:45 |
| mordred | we also have an edited copy of module_utils for the zypper/apt detection | 19:45 |
| corvus | mordred: oh, so does exim | 19:45 |
| mordred | yeah | 19:45 |
| *** sambetts_ has joined #openstack-meeting | 19:45 | |
| ianw | if that's not ok, system-config may need to be a trusted project? | 19:45 |
| mordred | and I think it's correct for us to have those - so I think running ansible with ansible is maybe a better bet | 19:45 |
| corvus | ianw: oh you're right, we don't need true anymore | 19:46 |
| pabelanger | ianw: if trusted, then we get no per merge testing | 19:46 |
| mordred | also - we're going to run ansible with ansible for CD - so testing that way would be closer to producciton | 19:46 |
| pabelanger | pre-merge* | 19:46 |
| ianw | pabelanger: yes, which is why I didn't want that! :) | 19:46 |
| pabelanger | +1 | 19:46 |
| *** samueldmq has quit IRC | 19:46 | |
| fungi | could this be our first use case for a post-review pipeline? | 19:46 |
| *** _hemna has joined #openstack-meeting | 19:47 | |
| pabelanger | I still think having ansible-playbook from zuul, run tox jobs, which then does ansible-playbook is a good way to testing too | 19:47 |
| mordred | zuul's ansible running a shell task called "ansible-playbook" on a node called "bridge" with an inventory consisting of the other nodes created by zuul would be closer to testing production than having zuul's ansible run directly against nodes | 19:47 |
| *** ahale has joined #openstack-meeting | 19:47 | |
| corvus | okay, so it sounds like ansible->ansible is what we need for this. kind of a bummer; i'd prefer to use this as a test case for how much we can push into zuul directly, but that's going to be slow and it doesn't sound like we have much appetite for that. | 19:47 |
| *** onovy has quit IRC | 19:48 | |
| mordred | corvus: maybe we can also do direct-zuul for some of the roles | 19:48 |
| corvus | and yeah, if we've crossed the bridge of adding the indirection for production, it probably doesn't make too much sense to stretch the paradigm for test. | 19:48 |
| mordred | corvus: yah | 19:49 |
| *** samueldmq has joined #openstack-meeting | 19:49 | |
| mordred | I'm pondering writing an ansible ansible module | 19:49 |
| mordred | similar to the ansible puppet module | 19:49 |
| ianw | mordred: the problem i hit with 593998 was that if anything has plugins, zuul stops? | 19:49 |
| * fungi sees it's ansibles all the way down | 19:50 | |
| mordred | ianw: yes, that's right | 19:50 |
| corvus | ianw: yes. so two things: 1) we can proceed with 998 because it's removing dead code. but 2) the general solution is that we should not use these roles directly in zuul. we should use them indirectly with zuul-ansible running a separate ansible as part of the test process. | 19:50 |
| corvus | pabelanger: what does molecule add to this? | 19:51 |
| mordred | so, I've been arguing that some of them might be useful to use directly in zuul | 19:51 |
| ianw | right, just saying "maybe we can also do direct-zuul for some of the roles" doesn't really work unless we start splitting things into two repos? | 19:51 |
| mordred | (like ianw's afs and krb roles) | 19:51 |
| pabelanger | corvus: just saying if you wanted to iterate on local infra, you could use molecule | 19:51 |
| pabelanger | via docker or vagrant | 19:51 |
| ianw | mordred: more that might be useful, that's really the point of them, to be used in the wheel jobs | 19:52 |
| mordred | maybe we need a more nuanced story then - we could have a roles/ and also a playbooks/roles/ and put things that are generally useful in both jobs and production into roles/ and things that are not useful directly from jobs into playbooks/roles ? | 19:53 |
| mordred | or is that too convoluted? | 19:53 |
| corvus | i can follow that | 19:53 |
| ianw | mordred: that can work, and with a small update https://review.openstack.org/#/c/593477/ you can even have them documented | 19:54 |
| *** onovy has joined #openstack-meeting | 19:54 | |
| mordred | neat. I'll update the move-roles patch to only move _some_ of the roles | 19:54 |
| ianw | at least until we have the complete ansible-turtles-all-the-way-down testing story | 19:55 |
| *** njohnston has left #openstack-meeting | 19:55 | |
| corvus | so what does that look like? | 19:56 |
| corvus | i'd like to get that running asap | 19:56 |
| corvus | but i don't have enough context to write it myself from scratch | 19:56 |
| ianw | the only theoretical problem might be if people start relying on the roles, and then we have to go, say, adding a plugin and have to essentially move it to a "private" role | 19:56 |
| corvus | i don't think anyone should rely on anything in the system-config repository :) | 19:57 |
| fungi | we've been saying that for a very long time | 19:57 |
| corvus | fungi: well, actually we haven't | 19:57 |
| mordred | well - except for other zuul jobs | 19:57 |
| corvus | we've said that the system-config repository is in fact suitable for anyone to use | 19:57 |
| fungi | i thought we'd long said system-config was full of openstackisms and that was why we extracted the reusable bits out to other modules | 19:58 |
| mordred | like with the afs-client role | 19:58 |
| corvus | i would like to revert back to what we used to say, which is that it is *merely* for operating the actual systems we run for openstack | 19:58 |
| fungi | ahh, i thought we'd been saying that all along | 19:58 |
| pabelanger | I think if a role is system-config, it is limited to system-config. if we want others to use said role, we should create the role under openstack-infra, like we did with puppet-foo | 19:59 |
| corvus | fungi: there's an extra level of abstraction in the sytem-config puppet designed to allow other people to "run an etherpad the way we run an etherpad" | 19:59 |
| *** eharney has quit IRC | 19:59 | |
| mordred | pabelanger: eventually I tihn that's appropriate for some of them | 19:59 |
| pabelanger | mordred: yup, some for sure | 19:59 |
| pabelanger | don't think we want all | 19:59 |
| ianw | pabelanger: yeah, i mean ... do you think puppet-timezone etc has really worked that well? i think collecting them makes it much more discoverable and maintainble | 19:59 |
| mordred | but it's a lot of extra churn and effort here at the beginning while we're sorting thigns out and reorganizing as we learn new things | 19:59 |
| corvus | ianw: to be honest, puppet-timezone has worked perfectly for me :) | 20:00 |
| ianw | corvus: but as a community building and reusable component | 20:00 |
| corvus | (i didn't even remember it existed) | 20:00 |
| mordred | I think there are three types of roles here ... roles that are very infra specific, roles that we want to use in infra but also want to use in jobs, and roles that are at the level of wanting to be legit standalone | 20:00 |
| fungi | okay, we're a minute over time. we should probably take this to the #openstack-infra channel. my general topic isn't super urgent anyway | 20:01 |
| corvus | ianw: yep, it has failed to accrue a community to support it, but i'm not certain that was (or should be) a goal :) | 20:01 |
| pabelanger | if the roles are small, and compact, and say timezone only modifies timezone. I think it works, the grey aready is when a role does things with apache, then package repos, then etc. Much harder to suppport for other users | 20:01 |
| corvus | ftr, i do not know how to proceed in setting up a real deployment test | 20:01 |
| mordred | (also, to be clear - we did not write puppet-timezone - it's a puppet community module we're consuming) | 20:01 |
| mordred | https://github.com/saz/puppet-timezone | 20:02 |
| corvus | perhaps we can continue to discuss how to set up that test, either here or in infra? | 20:02 |
| corvus | if this channel isn't reserved, can we just continue? | 20:02 |
| ianw | if nobody is kicking us out, would be good to be logged here | 20:02 |
| mordred | I have no issues with either choice | 20:02 |
| corvus | okay, so let me sketch out a strawman | 20:03 |
| fungi | i'm fine continuing, though i may need to #chair someone else if it goes on much longer (need to start cooking dinner shortly) | 20:03 |
| corvus | fungi: at this point we can all endmeeting anyway :) | 20:03 |
| fungi | yup, i don't suppose the topic needs to change again ;) | 20:03 |
| fungi | just to be clear, if anyone is in here waiting for another meeting to start, please let us know and we'll scram | 20:04 |
| corvus | a job which requests a xenial node and runs ansible-playbook with the supplied nodepool inventory and the base playbook. then it runs testinfra to validate that things were set up correctly? | 20:05 |
| *** yankcrime has joined #openstack-meeting | 20:05 | |
| pabelanger | seems reasonable to me | 20:06 |
| mordred | corvus: yes. or perhaps a 2-node job, with a bionic 'bridge' node on which ansible-playbook is run and a second node to run against? | 20:06 |
| corvus | mordred: do we bootstrap the bridge node by running the base playbook on it? | 20:07 |
| mordred | corvus: I don't think we need the base playbook for that - there is a smaller bridge playbook that should get the bridge things installed | 20:08 |
| mordred | and which is probably much more suitable for running directly from zuul | 20:08 |
| mordred | although even that isn't quite right - since it's going to install the openstack inventory plugin | 20:09 |
| corvus | okay, so zuul uses its own ansible to run the bridge playbook against the bridge node, then zuul copies the inventory over, and runs ansible-playbook base.yaml on bridge. | 20:10 |
| mordred | so we might want to construct a playbook specifically for that purpose | 20:10 |
| ianw | are there any secrets that need to be set for the playbooks to work? | 20:10 |
| pabelanger | as an example: http://git.openstack.org/cgit/openstack/windmill/tree/tests/playbooks/run.yaml is a crud want to run ansible->ansible on a single node. But it is currently not using the inventory file from nodepool. | 20:10 |
| mordred | corvus: yes, that sounds correct | 20:10 |
| pabelanger | but could be a something to work from | 20:10 |
| *** yankcrime has left #openstack-meeting | 20:10 | |
| corvus | https://etherpad.openstack.org/p/CJUWmx62al | 20:10 |
| *** geguileo has quit IRC | 20:11 | |
| corvus | okay, is that correct up to that point in the job? | 20:11 |
| mordred | yes. I think so | 20:12 |
| corvus | so how's this testinfra thing work? :) | 20:12 |
| *** beisner_ has joined #openstack-meeting | 20:12 | |
| *** gmann_ has joined #openstack-meeting | 20:13 | |
| pabelanger | could be a tox entry, testinfra will use the ansible inventory file for the remote nodes | 20:13 |
| corvus | something like: zuul runs tox which runs testinfra using zuul's inventory | 20:14 |
| pabelanger | yah, that is possible | 20:14 |
| corvus | mordred: is that like what you were thinking? | 20:14 |
| *** jgriffit1 has joined #openstack-meeting | 20:14 | |
| mordred | yes - I think so | 20:15 |
| corvus | ianw: i can't think of any secrets needed for the base playbooks right now | 20:15 |
| mordred | we should also ponder what per-service playbooks looks like -I'm guessing they each want a specific zuul job | 20:15 |
| corvus | yeah, i'll continue the etherpad sketch | 20:15 |
| sdatko | fungi: just FYI, i am not sure how github.com/openstack-infra/irc-meetings is accurate, but it seems like for today there is only one more meeting left: scientific-sig-meeting (grep -nri 'Tuesday' --before-context 1 *.yaml | grep -i 'time' | sort -k 4 | column -t) | 20:16 |
| fungi | sdatko: yes, there's also a calendar file linked from http://eavesdrop.openstack.org/ | 20:17 |
| corvus | sdatko: yes, my calendar has that starting in 43 mins | 20:17 |
| *** samP_ has joined #openstack-meeting | 20:18 | |
| sdatko | ach, ok :-D | 20:18 |
| *** edmondsw_ has joined #openstack-meeting | 20:18 | |
| corvus | ianw: can you type something in the etherpad? | 20:18 |
| corvus | ianw: preferably your name | 20:18 |
| *** samP has quit IRC | 20:19 | |
| *** edmondsw has quit IRC | 20:19 | |
| *** beisner has quit IRC | 20:19 | |
| *** AJaeger has quit IRC | 20:19 | |
| *** jgriffith has quit IRC | 20:19 | |
| *** gmann has quit IRC | 20:19 | |
| *** hugokuo has quit IRC | 20:19 | |
| *** edmondsw_ is now known as edmondsw | 20:19 | |
| *** samP_ is now known as samP | 20:19 | |
| *** gmann_ is now known as gmann | 20:19 | |
| *** beisner_ is now known as beisner | 20:19 | |
| corvus | okay. weird. i clicked the thing to set my name, and it was pre-filled with ianw | 20:19 |
| mordred | corvus: maybe you are actually the same person as ianw | 20:19 |
| corvus | other than that, things seem to be working. | 20:19 |
| corvus | okay, this makes sense to me, and seems like something we should be able to get going pretty quickly | 20:20 |
| pabelanger | are we planning in running ansible-playbook in virtualenv or use distro version | 20:20 |
| corvus | #link etherpad sketching out system-config ansible testing https://etherpad.openstack.org/p/CJUWmx62al | 20:21 |
| corvus | pabelanger: whatever bridge.yaml installs; currently i think it's pip installed globally? or something? | 20:21 |
| mordred | pip installed globally | 20:21 |
| mordred | using the python3.6 that came with bionic | 20:22 |
| *** jamesmcarthur has joined #openstack-meeting | 20:22 | |
| pabelanger | ack | 20:22 |
| corvus | mordred: is it the case that we do not want the openstack inventory plugin installed? if there's no clouds.yaml file, will it no-op or break? | 20:23 |
| mordred | corvus: it doesn't matter - what will matter is the ansible.cfg we install | 20:23 |
| *** AJaeger has joined #openstack-meeting | 20:24 | |
| corvus | mordred: ok, so we might be able to run the bridge playbook directly, then a second playbook which modifies the config | 20:24 |
| mordred | corvus: yah | 20:24 |
| mordred | that's probably the cleanest thing to do | 20:24 |
| mordred | and gets us coverage of the bridge playbook | 20:25 |
| mordred | we're going to need to think about host_vars/group_vars and how they interact with this - someof them are essential qualities of a given host, so we'd want them to get pulled in | 20:25 |
| mordred | but some of them are deployment specific - like the IP address of a remote host to enable in iptables | 20:25 |
| mordred | I don't have a solution for that to propose yet - just a thing to keep in mind while we keep working on this | 20:25 |
| corvus | mordred: yeah. maybe we can overlay test values on top of the normal values | 20:25 |
| mordred | ++ | 20:26 |
| *** jamesmcarthur has quit IRC | 20:26 | |
| corvus | mordred: if our jobs are based on functional units, we might be able to use inventory values for that. eg, a multinode job with all the zuul components as hosts | 20:27 |
| corvus | anyway, i think i have a good enough idea of what this should look like for us to get started; anyone have anything else? | 20:28 |
| mordred | I think that's great! | 20:29 |
| fungi | sounds like a solid start on a plan | 20:29 |
| corvus | fungi: since you're around, i'll leave the endmeeting honors to you :) | 20:29 |
| fungi | awesome, i'll cover my general topic real fast since we have the channel anyway... | 20:29 |
| fungi | #topic Continued discussion of Winterscale naming (fungi) | 20:30 |
| *** openstack changes topic to "Continued discussion of Winterscale naming (fungi) (Meeting topic: infra)" | 20:30 | |
| fungi | #link http://lists.openstack.org/pipermail/openstack-infra/2018-August/006075.html | 20:30 |
| fungi | for those of you who aren't following the infra ml, hoping we can find some consensus on a name for the winterscale effort, ideally before the ptg | 20:30 |
| fungi | that's all | 20:30 |
| corvus | what should we do if we like that name and want to move forward with it? :) | 20:30 |
| fungi | silence or thumbs up or have a beer | 20:30 |
| corvus | (the email was clear on what to do if we *don't* like it, less clear on how to express support) | 20:30 |
| corvus | i don't know how to do the first 2 things so i'll do the last | 20:31 |
| fungi | if there are additional items added to the short list, we can discuss them. of there aren't, then i guess we have one to move forward on | 20:31 |
| fungi | any other quick questions? i'll leave it on the agenda for next week when clarkb's back too | 20:32 |
| fungi | thanks everyone! find us in #openstack-infra for further discussion | 20:33 |
| fungi | #endmeeting | 20:33 |
| *** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/" | 20:33 | |
| openstack | Meeting ended Tue Aug 21 20:33:19 2018 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 20:33 |
| openstack | Minutes: http://eavesdrop.openstack.org/meetings/infra/2018/infra.2018-08-21-19.02.html | 20:33 |
| openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/infra/2018/infra.2018-08-21-19.02.txt | 20:33 |
| openstack | Log: http://eavesdrop.openstack.org/meetings/infra/2018/infra.2018-08-21-19.02.log.html | 20:33 |
| *** Shrews has left #openstack-meeting | 20:33 | |
| *** sdatko has quit IRC | 20:35 | |
| *** erlon has quit IRC | 20:39 | |
| *** annabelleB has quit IRC | 20:41 | |
| *** raildo has quit IRC | 20:46 | |
| *** awaugama has quit IRC | 20:51 | |
| *** annabelleB has joined #openstack-meeting | 20:55 | |
| *** rbudden has joined #openstack-meeting | 20:56 | |
| *** oneswig has joined #openstack-meeting | 20:56 | |
| *** jamesmcarthur has joined #openstack-meeting | 20:58 | |
| oneswig | #startmeeting scientific-sig | 21:00 |
| openstack | Meeting started Tue Aug 21 21:00:15 2018 UTC and is due to finish in 60 minutes. The chair is oneswig. Information about MeetBot at http://wiki.debian.org/MeetBot. | 21:00 |
| openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 21:00 |
| *** openstack changes topic to " (Meeting topic: scientific-sig)" | 21:00 | |
| openstack | The meeting name has been set to 'scientific_sig' | 21:00 |
| oneswig | Hi | 21:00 |
| oneswig | #link agenda for today https://wiki.openstack.org/wiki/Scientific_SIG#IRC_Meeting_August_21st_2018 | 21:00 |
| oneswig | Martial sends his apologies as he is travelling | 21:01 |
| rbudden | hello everyone | 21:01 |
| oneswig | Blair's hoping to join us later - overlapping meeting | 21:01 |
| oneswig | Hey rbudden! :-) | 21:01 |
| rbudden | hello hello :) | 21:01 |
| *** ildikov has joined #openstack-meeting | 21:01 | |
| oneswig | How's BRIDGES? | 21:01 |
| rbudden | it’s doing well | 21:02 |
| *** harlowja has joined #openstack-meeting | 21:02 | |
| rbudden | Our Queens HA setup is about to get some friendly users/staff for testing :) | 21:02 |
| oneswig | I've been having almost too much fun working with these guys on a Queens system: https://www.euclid-ec.org | 21:02 |
| oneswig | Mapping the dark matter of OpenStack... | 21:03 |
| rbudden | Nice | 21:03 |
| oneswig | It boils down to a bunch of heat stacks and 453 nodes in a Slurm partition with some whistles and bells attached | 21:03 |
| *** mriedem_afk is now known as mriedem | 21:04 | |
| rbudden | Sounds interesting | 21:04 |
| oneswig | Found the scaling limits of Heat on our system surprisingly quickly! | 21:04 |
| rbudden | Hehe, I haven’t used Heat much | 21:05 |
| oneswig | rbudden: did you ever get your work on Slurm into the public domain? | 21:05 |
| rbudden | I took the lazy programmer approach and wrote it all in bash originally, then converted it mostly to Ansible | 21:05 |
| rbudden | Actually, I did not | 21:05 |
| rbudden | I have piles that need to be pushed to our public GitHub | 21:05 |
| oneswig | There's some interest from various places in common Ansible for OpenHPC+Slurm | 21:06 |
| rbudden | It’s on my never ending todo list somewhere in there | 21:06 |
| rbudden | ;) | 21:06 |
| oneswig | Right, somewhere beyond the event horizon... | 21:06 |
| oneswig | Are you going to the PTG rbudden? It's merged with the Ops meetup too this time | 21:07 |
| *** mjturek has quit IRC | 21:08 | |
| rbudden | I am not | 21:08 |
| rbudden | Unfortunately I don’t have much funding for travel right now | 21:08 |
| oneswig | No, me neither - Martial's leading a session there | 21:08 |
| rbudden | I’d have loved to get more involved with the PTG and Ops, but time and funding have always kept me away unfortunately! | 21:09 |
| oneswig | Some of our team will be there but I'm of limited use being less hands-on than I'd like to be nowadays | 21:09 |
| oneswig | What's new on BRIDGES, what have you been working on? | 21:10 |
| rbudden | As long as we have someone there that’s good | 21:10 |
| rbudden | Largely the Queens HA and looking into scaling Ironic better | 21:10 |
| rbudden | We’ve also had a large influx of requests for Windows VMs from up on CMU campus | 21:10 |
| oneswig | bare metal windows? | 21:11 |
| rbudden | so we’ve been trying to patch together some infra to make those easier | 21:11 |
| rbudden | no, virtual ATM | 21:11 |
| oneswig | figures. | 21:11 |
| rbudden | I’m starting to plan for our next major upgrade as well | 21:11 |
| oneswig | what are you fighting with Ironic scaling? | 21:11 |
| rbudden | so getting some multiconductor testing and attempting boot over OPA are high on the list | 21:12 |
| oneswig | IPoIB interface on OPA? | 21:12 |
| rbudden | yes | 21:12 |
| rbudden | i had read the 7.4 centos kernel has stock drivers that could be used for the deploy | 21:13 |
| rbudden | I’m not sure if anyone has tried it though | 21:13 |
| oneswig | The OPA system I've been working on has the Intel HFI driver packages | 21:13 |
| rbudden | i’d love to deploy nodes via IPoIB vs our lonely GigE private network ;) | 21:13 |
| oneswig | I'd be surprised if the in-box driver is new enough. | 21:13 |
| rbudden | our last upgrade to 7.4 took longer than expect pushing out updates via puppet/scripts | 21:14 |
| oneswig | Last time I looked was end of last year though | 21:14 |
| rbudden | so we’d like to attempt to reimage all 900+ nodes as fast as possible via Ironic this time | 21:14 |
| rbudden | yeah, I admit I haven’t done much looking other than finding the pieces are there | 21:14 |
| rbudden | i.e. PXE boot via OPA has been done | 21:14 |
| oneswig | This might interest you - proposal for Ironic native RBD boot from Ceph volume - https://storyboard.openstack.org/#!/story/2003515 | 21:15 |
| rbudden | generic OPA IPoIB drivers should be in the mainline kernel now (whether they work is anotehr story) | 21:15 |
| rbudden | cool, thx, i’ll check it out | 21:15 |
| oneswig | Just a framework for an idea right now but one we've already tried to explore ourselves, because it's a natural fit | 21:16 |
| rbudden | we’ve only had a limited experience with Ceph | 21:16 |
| rbudden | and so far we’ve seen incredibly bad performance | 21:16 |
| rbudden | I’ve been meaning to solicit some advice/stats from the group | 21:16 |
| rbudden | on setups/performance numbers | 21:17 |
| oneswig | Ceph's single-node performance is lame in comparison but the scaling's excellent, particularly for object and block. File is still a little doubtful. | 21:17 |
| oneswig | by single-node I mean single-client | 21:17 |
| rbudden | ok, interesting | 21:18 |
| rbudden | that’s what we were curious about | 21:18 |
| rbudden | especially given this: | 21:18 |
| rbudden | https://docs.openstack.org/performance-docs/latest/test_results/ceph_testing/index.html#ceph-rbd-performance-results-50-osd | 21:18 |
| oneswig | Our team has recently been working on BeeGFS deployed via ansible | 21:18 |
| rbudden | it looks like single client peformance is a small fraction of what the hardware is capable of | 21:18 |
| rbudden | but i was curious if that was due to scaling/sustaining those numbers in parallel to a large portion of clients | 21:19 |
| oneswig | That matches my experience, but 20 clients will get 75% of the raw performance of the hardware | 21:19 |
| rbudden | we have a very small amount of hardware to dedicate | 21:19 |
| oneswig | I bet I have less :-) | 21:19 |
| rbudden | say 3-4 servers for Ceph | 21:19 |
| oneswig | yup, won hands down :-) | 21:19 |
| rbudden | so far the best we’ve seen was 15 MB/s writes, though reads were maybe between 50-100 MB/s | 21:20 |
| rbudden | pretty attrocious | 21:20 |
| oneswig | The EUCLID deploy's home dir is CephFS, served from 2 OSDs. It's a bit ad-hoc, all we had available at the time. | 21:20 |
| oneswig | rbudden: wow, that's not good! | 21:20 |
| oneswig | by any measure | 21:20 |
| rbudden | there must be some configuration issues | 21:20 |
| rbudden | yeah, not sure what’s wrong just yet | 21:21 |
| *** munimeha1 has quit IRC | 21:21 | |
| rbudden | we pulled in Mike from IU try and spot something obvious ;) | 21:21 |
| oneswig | On performance, one of the team at Cambridge has been benchmarking BeeGFS vs Lustre on the same OPA hardware. | 21:21 |
| rbudden | oh yeah? | 21:22 |
| rbudden | we have both at PSC as well | 21:22 |
| oneswig | Mike's a great call :-)! | 21:22 |
| oneswig | Write performance was equivalent. | 21:22 |
| rbudden | our Olympus cluster has both Lustre and BeeGFS | 21:22 |
| oneswig | BeeGFS ~20% faster for reads | 21:22 |
| rbudden | very interesting | 21:22 |
| oneswig | Quite a surprise | 21:22 |
| rbudden | we’ve been toying with using BeeGFS on Bridges | 21:22 |
| rbudden | since we already mount Olympus filesystems on both | 21:23 |
| oneswig | There seems to be good momentum behind it currently. It's pretty easy to set up and use | 21:23 |
| rbudden | I’ll have to relay the performance numbers to ppl here | 21:23 |
| oneswig | Olympus? | 21:23 |
| rbudden | it’s a small cluster from our Public Health group | 21:23 |
| oneswig | I'll see if I can get graphs for you. | 21:23 |
| rbudden | exact hardware as Bridges | 21:24 |
| rbudden | just a separate Slurm scheduler to manage them | 21:24 |
| rbudden | we’ve even folded their cluster under Ironic now | 21:24 |
| oneswig | Nice work. Hopefully not twice the effort for you now! | 21:25 |
| rbudden | I think that might put us over 1000 nodes on single conductor :P | 21:25 |
| rbudden | not that i’d normally advise that… but we only image a few nodes a week at this point | 21:25 |
| oneswig | Any additional concerns taken into account for public health data on that system? | 21:25 |
| rbudden | not to my knowledge. we don’t do any classified work, etc. | 21:26 |
| rbudden | for nothing fancy with network isolation or anything of that nature | 21:26 |
| rbudden | s/for/so/ | 21:26 |
| oneswig | Got it. | 21:26 |
| oneswig | It's a requirement that is proliferating though | 21:27 |
| rbudden | indeed | 21:27 |
| rbudden | we’ve done some small projects that required HIPPA with local medical community | 21:27 |
| oneswig | on Bridges? | 21:28 |
| rbudden | i’m not sure if it was Bridges or a small subproject on our DXC hardware | 21:28 |
| rbudden | i’d have to check and make sure i’m not mixing things up ;) | 21:28 |
| rbudden | I know being compliant for securing big data is on our radar | 21:28 |
| oneswig | hipaa compliance? | 21:29 |
| rbudden | that’s one, but i believe there are others | 21:29 |
| rbudden | familiar with HIPPA? | 21:29 |
| oneswig | faintly at best.. | 21:30 |
| rbudden | it’s a health care act to help protect sensitive patient data | 21:30 |
| rbudden | or should i say regulation ;) | 21:30 |
| *** dustins has quit IRC | 21:31 | |
| rbudden | oneswig: sorry to jet, but i need to step offline for daycare pickup! | 21:31 |
| rbudden | we should follow up offline, it’s been awhile since we chatted in Vancouver | 21:31 |
| oneswig | NP, good to talk | 21:31 |
| oneswig | I'll mail re: cambridge data | 21:31 |
| rbudden | i’ve been meaning to reach out | 21:31 |
| rbudden | sounds good | 21:32 |
| oneswig | rbudden: always a pleasure | 21:32 |
| rbudden | indeed | 21:32 |
| rbudden | tty soon | 21:32 |
| *** b1air has joined #openstack-meeting | 21:38 | |
| b1air | am i too late? | 21:38 |
| oneswig | b1air: howzit? | 21:39 |
| b1air | a'ight, you? | 21:39 |
| oneswig | Was just chatting with rbudden, he's dropped off | 21:39 |
| oneswig | Good thanks. How's the new role going? | 21:39 |
| b1air | i'm in the thick of having my head exploded by all the context i'm trying to soak up | 21:40 |
| b1air | but otherwise good | 21:40 |
| oneswig | Are you going to be hands-on with the Cray? | 21:40 |
| b1air | at least i now have a vague idea of what preconceptions the organisation has about my role, i honestly didn't know what i was really signing up for to start off with, just that it would probably be quite different from what i was doing at Monash | 21:41 |
| b1air | i will be unlikely to have root access there anytime soon | 21:41 |
| b1air | NIWA seem to like to keep systems stuff pretty closely guarded | 21:42 |
| b1air | how was your holiday? | 21:43 |
| oneswig | Very good indeed. We hiked in the Pyrenees and it was ruddy hot | 21:43 |
| b1air | nice | 21:44 |
| oneswig | Perhaps we should close the meeting, and then I'll reply to your email :-) | 21:45 |
| b1air | i need to come up with a hiking/biking/sailing itinerary for summer here! | 21:45 |
| oneswig | b1air: in NZ, it's not hard, surely mate | 21:45 |
| b1air | the poor boat needs a bit of love first | 21:46 |
| oneswig | sandpaper = tough love ? | 21:46 |
| b1air | lol, water blaster might be enough i hope! anyway, sure, let's continue to be penpals :-) | 21:46 |
| oneswig | ok bud, have a good day down there | 21:47 |
| b1air | cheers, over and out | 21:47 |
| oneswig | until next time | 21:47 |
| oneswig | #endmeeting | 21:47 |
| *** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/" | 21:47 | |
| openstack | Meeting ended Tue Aug 21 21:47:30 2018 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 21:47 |
| openstack | Minutes: http://eavesdrop.openstack.org/meetings/scientific_sig/2018/scientific_sig.2018-08-21-21.00.html | 21:47 |
| openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/scientific_sig/2018/scientific_sig.2018-08-21-21.00.txt | 21:47 |
| openstack | Log: http://eavesdrop.openstack.org/meetings/scientific_sig/2018/scientific_sig.2018-08-21-21.00.log.html | 21:47 |
| *** jamesmcarthur has quit IRC | 21:48 | |
| *** oneswig has quit IRC | 21:49 | |
| *** jamesmcarthur has joined #openstack-meeting | 21:50 | |
| *** jamesmcarthur_ has joined #openstack-meeting | 21:52 | |
| *** jamesmcarthur_ has quit IRC | 21:55 | |
| *** jamesmcarthur has quit IRC | 21:55 | |
| *** jamesmcarthur has joined #openstack-meeting | 21:56 | |
| *** cloudrancher has joined #openstack-meeting | 21:57 | |
| *** jamesmcarthur has quit IRC | 22:01 | |
| *** jamesmcarthur has joined #openstack-meeting | 22:04 | |
| *** jamesmcarthur has quit IRC | 22:08 | |
| *** rcernin has joined #openstack-meeting | 22:10 | |
| *** ykatabam has joined #openstack-meeting | 22:12 | |
| *** annabelleB has quit IRC | 22:21 | |
| *** mriedem is now known as mriedem_away | 22:22 | |
| *** annabelleB has joined #openstack-meeting | 22:27 | |
| *** rbudden has quit IRC | 22:32 | |
| *** Leo_m has quit IRC | 22:44 | |
| *** diablo_rojo has quit IRC | 22:44 | |
| *** hongbin has quit IRC | 22:44 | |
| *** diablo_rojo has joined #openstack-meeting | 22:48 | |
| *** tpsilva has quit IRC | 22:58 | |
| *** erlon has joined #openstack-meeting | 23:06 | |
| *** erlon has quit IRC | 23:22 | |
| *** macza has quit IRC | 23:37 | |
| *** jamesmcarthur has joined #openstack-meeting | 23:39 | |
| *** jamesmcarthur has quit IRC | 23:44 | |
| *** annabelleB has quit IRC | 23:51 | |
| *** annabelleB has joined #openstack-meeting | 23:52 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!