| *** mattw4 has quit IRC | 00:00 | |
| *** _hemna has joined #openstack-meeting | 00:05 | |
| *** jamesmcarthur has joined #openstack-meeting | 00:05 | |
| *** gyee has quit IRC | 00:07 | |
| *** iyamahat has quit IRC | 00:14 | |
| *** jamesmcarthur has quit IRC | 00:15 | |
| *** Liang__ has joined #openstack-meeting | 00:50 | |
| *** hongbin has joined #openstack-meeting | 00:55 | |
| *** igordc has quit IRC | 00:55 | |
| *** _hemna has quit IRC | 00:55 | |
| *** lhinds has quit IRC | 00:57 | |
| *** eharney has quit IRC | 00:57 | |
| *** lhinds has joined #openstack-meeting | 00:58 | |
| *** TxGirlGeek has joined #openstack-meeting | 00:58 | |
| *** bbowen has quit IRC | 01:02 | |
| *** bbowen has joined #openstack-meeting | 01:02 | |
| *** ayoung has quit IRC | 01:11 | |
| *** enriquetaso has quit IRC | 01:17 | |
| *** ricolin has joined #openstack-meeting | 01:19 | |
| *** jamesmcarthur has joined #openstack-meeting | 01:24 | |
| *** TxGirlGeek has quit IRC | 01:32 | |
| *** jamesmcarthur_ has joined #openstack-meeting | 01:32 | |
| *** jamesmcarthur has quit IRC | 01:34 | |
| *** yamamoto has quit IRC | 01:34 | |
| *** mhen has quit IRC | 01:41 | |
| *** rbudden has joined #openstack-meeting | 01:42 | |
| *** whoami-rajat has joined #openstack-meeting | 01:43 | |
| *** baojg has joined #openstack-meeting | 01:45 | |
| *** _erlon_ has quit IRC | 01:46 | |
| *** TxGirlGeek has joined #openstack-meeting | 01:50 | |
| *** TxGirlGeek has quit IRC | 01:54 | |
| *** tetsuro has joined #openstack-meeting | 01:58 | |
| *** yamamoto has joined #openstack-meeting | 01:58 | |
| *** rbudden has quit IRC | 01:59 | |
| *** tetsuro has quit IRC | 02:17 | |
| *** yamamoto has quit IRC | 02:17 | |
| *** tetsuro has joined #openstack-meeting | 02:18 | |
| *** yamamoto has joined #openstack-meeting | 02:21 | |
| *** jamesmcarthur_ has quit IRC | 02:35 | |
| *** ayoung has joined #openstack-meeting | 03:14 | |
| *** artom has quit IRC | 03:15 | |
| *** psachin has joined #openstack-meeting | 03:28 | |
| *** artom has joined #openstack-meeting | 03:32 | |
| *** iyamahat has joined #openstack-meeting | 03:44 | |
| *** hongbin has quit IRC | 03:45 | |
| *** hongbin has joined #openstack-meeting | 03:50 | |
| *** hongbin has quit IRC | 03:50 | |
| *** dviroel has quit IRC | 03:52 | |
| *** nitinuikey has joined #openstack-meeting | 03:59 | |
| *** imsurit has joined #openstack-meeting | 04:08 | |
| *** tetsuro has quit IRC | 04:09 | |
| *** rcernin has quit IRC | 04:13 | |
| *** rcernin has joined #openstack-meeting | 04:14 | |
| *** rcernin has quit IRC | 04:20 | |
| *** pcaruana has joined #openstack-meeting | 04:43 | |
| *** nitinuikey has quit IRC | 04:58 | |
| *** links has joined #openstack-meeting | 05:04 | |
| *** tetsuro has joined #openstack-meeting | 05:05 | |
| *** Luzi has joined #openstack-meeting | 05:05 | |
| *** jraju__ has joined #openstack-meeting | 05:08 | |
| *** tetsuro has quit IRC | 05:08 | |
| *** links has quit IRC | 05:09 | |
| *** jraju__ has quit IRC | 05:10 | |
| *** TxGirlGeek has joined #openstack-meeting | 05:16 | |
| *** Lucas_Gray has joined #openstack-meeting | 05:31 | |
| *** armax has quit IRC | 05:34 | |
| *** notmyname has quit IRC | 05:41 | |
| *** notmyname has joined #openstack-meeting | 05:42 | |
| *** TxGirlGeek has quit IRC | 05:43 | |
| *** jamesmcarthur has joined #openstack-meeting | 05:55 | |
| *** jamesmcarthur has quit IRC | 05:56 | |
| *** igordc has joined #openstack-meeting | 06:08 | |
| *** dkushwaha has joined #openstack-meeting | 06:09 | |
| *** Lucas_Gray has quit IRC | 06:09 | |
| *** jamesmcarthur has joined #openstack-meeting | 06:09 | |
| *** Lucas_Gray has joined #openstack-meeting | 06:10 | |
| *** jhesketh has quit IRC | 06:11 | |
| *** jhesketh has joined #openstack-meeting | 06:11 | |
| *** jamesmcarthur has quit IRC | 06:13 | |
| *** igordc has quit IRC | 06:15 | |
| *** jamesmcarthur has joined #openstack-meeting | 06:16 | |
| *** apetrich has quit IRC | 06:20 | |
| *** hyunsik_m has quit IRC | 06:27 | |
| *** diablo_rojo has joined #openstack-meeting | 06:27 | |
| *** jamesmcarthur_ has joined #openstack-meeting | 06:28 | |
| *** jamesmca_ has joined #openstack-meeting | 06:31 | |
| *** diablo_rojo has quit IRC | 06:32 | |
| *** jamesmcarthur has quit IRC | 06:32 | |
| *** jamesmcarthur_ has quit IRC | 06:35 | |
| *** jamesmca_ has quit IRC | 06:38 | |
| *** Lucas_Gray has quit IRC | 06:39 | |
| *** e0ne has joined #openstack-meeting | 06:40 | |
| *** e0ne has quit IRC | 06:41 | |
| *** Lucas_Gray has joined #openstack-meeting | 06:43 | |
| *** jamesmcarthur has joined #openstack-meeting | 06:43 | |
| *** ttsiouts has joined #openstack-meeting | 06:48 | |
| *** jamesmcarthur has quit IRC | 06:51 | |
| *** jamesmcarthur has joined #openstack-meeting | 06:53 | |
| *** dkushwaha has quit IRC | 06:54 | |
| *** dmacpher has joined #openstack-meeting | 06:58 | |
| *** yamamoto has quit IRC | 07:05 | |
| *** yamamoto has joined #openstack-meeting | 07:06 | |
| *** Nobuhiko0723 has joined #openstack-meeting | 07:07 | |
| *** slaweq has joined #openstack-meeting | 07:07 | |
| *** tesseract has joined #openstack-meeting | 07:09 | |
| *** imsurit_ofc has joined #openstack-meeting | 07:10 | |
| *** imsurit has quit IRC | 07:12 | |
| *** imsurit_ofc is now known as imsurit | 07:12 | |
| *** hyunsikyang__ has joined #openstack-meeting | 07:19 | |
| *** zbr_ has joined #openstack-meeting | 07:20 | |
| *** irclogbot_0 has quit IRC | 07:20 | |
| *** kaisers has quit IRC | 07:20 | |
| *** kaisers has joined #openstack-meeting | 07:21 | |
| *** irclogbot_2 has joined #openstack-meeting | 07:21 | |
| *** dansmith has quit IRC | 07:23 | |
| *** zbr has quit IRC | 07:23 | |
| *** hyunsikyang has quit IRC | 07:23 | |
| *** dansmith has joined #openstack-meeting | 07:24 | |
| *** jamesmcarthur has quit IRC | 07:24 | |
| *** beagles has quit IRC | 07:26 | |
| *** dkushwaha has joined #openstack-meeting | 07:28 | |
| *** ttsiouts has quit IRC | 07:42 | |
| *** ttsiouts has joined #openstack-meeting | 07:43 | |
| *** ttsiouts has quit IRC | 07:48 | |
| *** bhagyashris has joined #openstack-meeting | 07:54 | |
| *** tpatil has joined #openstack-meeting | 07:55 | |
| *** apetrich has joined #openstack-meeting | 07:57 | |
| *** priteau has joined #openstack-meeting | 08:00 | |
| *** nitinuikey has joined #openstack-meeting | 08:01 | |
| *** joxyuki has joined #openstack-meeting | 08:03 | |
| dkushwaha | #startmeeting tacker | 08:04 |
|---|---|---|
| openstack | Meeting started Tue Jul 23 08:04:22 2019 UTC and is due to finish in 60 minutes. The chair is dkushwaha. Information about MeetBot at http://wiki.debian.org/MeetBot. | 08:04 |
| openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 08:04 |
| *** openstack changes topic to " (Meeting topic: tacker)" | 08:04 | |
| openstack | The meeting name has been set to 'tacker' | 08:04 |
| *** nnsingh has joined #openstack-meeting | 08:04 | |
| dkushwaha | #topic Roll Call | 08:05 |
| *** openstack changes topic to "Roll Call (Meeting topic: tacker)" | 08:05 | |
| dkushwaha | who is here for Tacker weekly meeting ? | 08:05 |
| tpatil | Hi | 08:05 |
| nitinuikey | Hi | 08:05 |
| *** shubham_potale has joined #openstack-meeting | 08:05 | |
| nnsingh | Hi Dharmendra | 08:05 |
| shubham_potale | Hi | 08:06 |
| joxyuki | hello | 08:06 |
| dkushwaha | hello all | 08:06 |
| dkushwaha | lets start.. | 08:07 |
| dkushwaha | #chair joxyuki | 08:08 |
| openstack | Current chairs: dkushwaha joxyuki | 08:08 |
| dkushwaha | #topic BP | 08:08 |
| *** openstack changes topic to "BP (Meeting topic: tacker)" | 08:08 | |
| dkushwaha | I have done on force delete BP from my side | 08:10 |
| dkushwaha | #link https://review.opendev.org/#/c/626854/ | 08:10 |
| dkushwaha | #link https://review.opendev.org/#/c/666496/ | 08:10 |
| dkushwaha | please help on review | 08:11 |
| dkushwaha | I have started another BP i.e Connection points auto heal | 08:12 |
| dkushwaha | #link https://blueprints.launchpad.net/tacker/+spec/cp-auto-heal | 08:12 |
| dkushwaha | hope to come with initial patch in this week | 08:12 |
| joxyuki | Is scope of this BP respawn action or auto-heal action? | 08:13 |
| dkushwaha | joxyuki, we needs to auto-heal connection point | 08:14 |
| joxyuki | yea, the title mentions auto-heal but in its description you mentions re-spawn. which is target? | 08:15 |
| tpatil | In VDU auto healing, connection points are recreated | 08:16 |
| *** takahashi-tsc has joined #openstack-meeting | 08:17 | |
| *** imsurit has quit IRC | 08:18 | |
| tpatil | #link : https://github.com/openstack/tacker/blob/master/tacker/vnfm/policy_actions/vdu_autoheal/vdu_autoheal.py#L51 | 08:18 |
| dkushwaha | joxyuki, once VNF re-spawned, existing CP couldn't be cleaned, so a new interface get attached, here my approach is to clean existing interface and attached new one with same ip | 08:18 |
| joxyuki | got it, that's nice :) | 08:19 |
| *** yamamoto has quit IRC | 08:20 | |
| dkushwaha | tpatil, how it restore existing one ? | 08:20 |
| tpatil | dkushwaha: based on Mac address | 08:20 |
| tpatil | in the above code, you will see that heat will delete those hot resources and create a new ones. | 08:21 |
| dkushwaha | tpatil, with the same ip. right? | 08:21 |
| tpatil | Yes | 08:21 |
| *** ttsiouts has joined #openstack-meeting | 08:22 | |
| dkushwaha | tpatil, aah, then I needs to recheck/re-define the scope of my BP. | 08:23 |
| dkushwaha | tpatil, thanks for input. | 08:23 |
| dkushwaha | other than this, I target to fix this bug, in this week. https://bugs.launchpad.net/tacker/+bug/1833505 | 08:25 |
| openstack | Launchpad bug 1833505 in tacker "VNF scale failed for non-admin tenants" [Critical,New] - Assigned to dharmendra (dharmendra-kushwaha) | 08:25 |
| *** ralonsoh has joined #openstack-meeting | 08:26 | |
| dkushwaha | this is all in my TODO for this week. | 08:27 |
| tpatil | # link : https://review.opendev.org/#/c/626854/3/tackerclient/osc/v1/nfvo/ns.py, python-tackerclient is deprecated so is it ok to add new options to the existing commands? | 08:27 |
| *** asmita_s has joined #openstack-meeting | 08:28 | |
| *** tssurya has joined #openstack-meeting | 08:28 | |
| dkushwaha | tpatil, I thinks yes, and it it was what we agreed in spec too https://review.opendev.org/#/c/602528/ | 08:29 |
| *** tpatil has quit IRC | 08:34 | |
| *** asmita_s has quit IRC | 08:34 | |
| *** asmita_s has joined #openstack-meeting | 08:35 | |
| *** tpatil has joined #openstack-meeting | 08:35 | |
| tpatil | VNF packages support for VNF onboarding | 08:35 |
| tpatil | #link : https://review.opendev.org/#/c/582930/ | 08:36 |
| tpatil | To implement this spec, we need to make several changes to Tosca-parser library to implement tosca definition 1.2 version validation code as a new extension | 08:36 |
| tpatil | we are planning to propose tosca-parser patch by early next week | 08:36 |
| tpatil | Also, we will start pushing patches in tacker in first week of August | 08:37 |
| *** panda has quit IRC | 08:38 | |
| dkushwaha | tpatil, sounds good | 08:38 |
| *** panda has joined #openstack-meeting | 08:38 | |
| tpatil | That's all update from my side | 08:38 |
| dkushwaha | Once we will have some initial code patches, I will merge the spec | 08:39 |
| tpatil | dkushwaha: Ok, Thanks | 08:40 |
| dkushwaha | moving next.. | 08:41 |
| dkushwaha | #topic Open Discussion | 08:41 |
| *** openstack changes topic to "Open Discussion (Meeting topic: tacker)" | 08:41 | |
| joxyuki | I push a new spec and WIP code patch. | 08:43 |
| joxyuki | https://review.opendev.org/#/c/672214/ | 08:43 |
| joxyuki | https://review.opendev.org/#/c/672199/ | 08:43 |
| joxyuki | this is remaining work of reservation-vnfm | 08:43 |
| joxyuki | kindly request you to review them from the spec. | 08:44 |
| *** asmita_s has quit IRC | 08:44 | |
| *** e0ne has joined #openstack-meeting | 08:46 | |
| dkushwaha | joxyuki is this update param_values for reservation part only? | 08:47 |
| joxyuki | dkushwaha: no, this feature can be used for more general use cases. | 08:47 |
| joxyuki | all parameterized values can be updated, not only reservation-metadata. | 08:48 |
| dkushwaha | joxyuki, I see. | 08:49 |
| dkushwaha | I will review the spec, don't have any question for now | 08:50 |
| *** yamamoto has joined #openstack-meeting | 08:50 | |
| joxyuki | thanks | 08:51 |
| dkushwaha | Do we have something to talk now? otherwise we can close this meeting. | 08:53 |
| takahashi-tsc | Sorry for late... and I have a request. | 08:53 |
| takahashi-tsc | My team member said that manual scaling using CLI is failed... Would someone review following bug and patch? | 08:54 |
| takahashi-tsc | https://bugs.launchpad.net/python-tackerclient/+bug/1834548 | 08:54 |
| openstack | Launchpad bug 1834548 in python-tackerclient "osc command's scale is failed" [Undecided,New] - Assigned to Hiroya Nakaya (nakkay) | 08:54 |
| takahashi-tsc | https://review.opendev.org/#/c/668379/ | 08:55 |
| dkushwaha | takahashi-tsc, I missed this patch, will review it | 08:56 |
| takahashi-tsc | Oops, the patch's topic branch is wrong... | 08:56 |
| takahashi-tsc | Thank you! And I will review patches. Sorry for not doing activities. | 08:58 |
| dkushwaha | takahashi-tsc, np. That will be great if you help on review | 09:00 |
| *** priteau has quit IRC | 09:00 | |
| dkushwaha | time up | 09:00 |
| joxyuki | my presentation at Shanghai. please check it and vote to it if you want. | 09:00 |
| joxyuki | https://www.openstack.org/summit/shanghai-2019/vote-for-speakers/#/23901 | 09:00 |
| dkushwaha | joxyuki, already voted from my side | 09:01 |
| joxyuki | thanks! | 09:01 |
| dkushwaha | time up folks, Closing this meeting | 09:01 |
| *** Lucas_Gray has quit IRC | 09:01 | |
| dkushwaha | thanks all for joining | 09:01 |
| dkushwaha | #endmeeting | 09:02 |
| *** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/" | 09:02 | |
| openstack | Meeting ended Tue Jul 23 09:02:05 2019 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 09:02 |
| openstack | Minutes: http://eavesdrop.openstack.org/meetings/tacker/2019/tacker.2019-07-23-08.04.html | 09:02 |
| openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/tacker/2019/tacker.2019-07-23-08.04.txt | 09:02 |
| openstack | Log: http://eavesdrop.openstack.org/meetings/tacker/2019/tacker.2019-07-23-08.04.log.html | 09:02 |
| *** nitinuikey has quit IRC | 09:02 | |
| *** priteau has joined #openstack-meeting | 09:02 | |
| *** yamamoto has quit IRC | 09:02 | |
| *** joxyuki has left #openstack-meeting | 09:03 | |
| *** takahashi-tsc has quit IRC | 09:05 | |
| *** tpatil has quit IRC | 09:08 | |
| *** _hemna has joined #openstack-meeting | 09:12 | |
| *** Lucas_Gray has joined #openstack-meeting | 09:12 | |
| *** _hemna has quit IRC | 09:16 | |
| *** Lucas_Gray has quit IRC | 09:18 | |
| *** Liang__ has quit IRC | 09:19 | |
| *** Lucas_Gray has joined #openstack-meeting | 09:19 | |
| *** psachin has quit IRC | 09:20 | |
| *** dkushwaha has quit IRC | 09:31 | |
| *** ociuhandu has joined #openstack-meeting | 09:31 | |
| *** psachin has joined #openstack-meeting | 09:35 | |
| *** apetrich has quit IRC | 09:36 | |
| *** Nobuhiko0723 has quit IRC | 09:42 | |
| *** ociuhandu has quit IRC | 09:48 | |
| *** ociuhandu has joined #openstack-meeting | 09:50 | |
| *** bhagyashris has quit IRC | 09:54 | |
| *** iyamahat has quit IRC | 10:04 | |
| *** ttsiouts has quit IRC | 10:11 | |
| *** ttsiouts has joined #openstack-meeting | 10:12 | |
| *** kopecmartin|off is now known as kopecmartin | 10:12 | |
| *** ttsiouts has quit IRC | 10:16 | |
| *** lpetrut has joined #openstack-meeting | 10:21 | |
| *** brinzhang_ has joined #openstack-meeting | 10:26 | |
| *** yamamoto has joined #openstack-meeting | 10:27 | |
| *** yamamoto has quit IRC | 10:28 | |
| *** yamamoto has joined #openstack-meeting | 10:28 | |
| *** brinzhang has quit IRC | 10:30 | |
| *** ricolin_ has joined #openstack-meeting | 10:34 | |
| *** bbowen has quit IRC | 10:37 | |
| *** ricolin has quit IRC | 10:37 | |
| *** yamamoto has quit IRC | 10:48 | |
| *** apetrich has joined #openstack-meeting | 10:53 | |
| *** Lucas_Gray has quit IRC | 10:54 | |
| *** yamamoto has joined #openstack-meeting | 10:57 | |
| *** yamamoto has quit IRC | 11:02 | |
| *** yamamoto has joined #openstack-meeting | 11:05 | |
| *** jaypipes has joined #openstack-meeting | 11:14 | |
| *** ttsiouts has joined #openstack-meeting | 11:30 | |
| *** raildo has joined #openstack-meeting | 11:35 | |
| *** b3nt_pin has joined #openstack-meeting | 11:35 | |
| *** carloss has joined #openstack-meeting | 11:47 | |
| *** bbowen has joined #openstack-meeting | 11:55 | |
| *** markvoelker has quit IRC | 11:58 | |
| *** eharney has joined #openstack-meeting | 12:01 | |
| *** yamamoto has quit IRC | 12:03 | |
| *** ricolin_ is now known as ricolin | 12:05 | |
| *** yamamoto has joined #openstack-meeting | 12:08 | |
| *** pfallenop has joined #openstack-meeting | 12:12 | |
| *** dviroel has joined #openstack-meeting | 12:14 | |
| *** markvoelker has joined #openstack-meeting | 12:16 | |
| *** ttsiouts has quit IRC | 12:17 | |
| *** ttsiouts has joined #openstack-meeting | 12:17 | |
| *** pfallenop has quit IRC | 12:20 | |
| *** ttsiouts has quit IRC | 12:22 | |
| *** electrofelix has joined #openstack-meeting | 12:36 | |
| *** mriedem has joined #openstack-meeting | 12:38 | |
| *** enriquetaso has joined #openstack-meeting | 12:57 | |
| *** njohnston has joined #openstack-meeting | 12:59 | |
| *** apetrich has quit IRC | 13:07 | |
| *** jamesmcarthur has joined #openstack-meeting | 13:08 | |
| *** ttsiouts has joined #openstack-meeting | 13:17 | |
| *** jamesmcarthur has quit IRC | 13:18 | |
| *** mriedem has quit IRC | 13:38 | |
| *** jamesmcarthur has joined #openstack-meeting | 13:39 | |
| *** Luzi has quit IRC | 13:51 | |
| *** yamamoto has quit IRC | 13:53 | |
| *** ttsiouts has quit IRC | 13:53 | |
| *** yamamoto has joined #openstack-meeting | 13:54 | |
| *** ttsiouts has joined #openstack-meeting | 13:54 | |
| *** lajoskatona has joined #openstack-meeting | 13:56 | |
| *** yamamoto has quit IRC | 13:58 | |
| *** jamesmcarthur has quit IRC | 13:58 | |
| *** ttsiouts has quit IRC | 13:58 | |
| *** ttsiouts has joined #openstack-meeting | 13:58 | |
| *** lbragstad has joined #openstack-meeting | 14:00 | |
| *** tssurya has quit IRC | 14:13 | |
| *** belmoreira has joined #openstack-meeting | 14:14 | |
| *** baojg has quit IRC | 14:18 | |
| *** baojg has joined #openstack-meeting | 14:19 | |
| *** gyee has joined #openstack-meeting | 14:23 | |
| *** apetrich has joined #openstack-meeting | 14:26 | |
| *** mriedem has joined #openstack-meeting | 14:36 | |
| *** yamamoto has joined #openstack-meeting | 14:37 | |
| *** lbragstad has quit IRC | 14:40 | |
| *** dosaboy has joined #openstack-meeting | 14:41 | |
| *** lbragstad has joined #openstack-meeting | 14:43 | |
| *** yamamoto has quit IRC | 14:43 | |
| *** _hemna has joined #openstack-meeting | 14:47 | |
| *** _hemna has quit IRC | 14:52 | |
| *** TxGirlGeek has joined #openstack-meeting | 14:52 | |
| *** armax has joined #openstack-meeting | 15:05 | |
| *** lseki has joined #openstack-meeting | 15:06 | |
| *** lajoskatona has left #openstack-meeting | 15:08 | |
| *** pfallenop has joined #openstack-meeting | 15:09 | |
| *** enriquetaso has quit IRC | 15:09 | |
| *** enriquetaso has joined #openstack-meeting | 15:09 | |
| *** enriquetaso has quit IRC | 15:14 | |
| *** pfallenop has quit IRC | 15:16 | |
| *** trident has quit IRC | 15:18 | |
| *** belmoreira has quit IRC | 15:18 | |
| *** _hemna has joined #openstack-meeting | 15:18 | |
| *** trident has joined #openstack-meeting | 15:20 | |
| *** dmacpher has quit IRC | 15:23 | |
| *** e0ne has quit IRC | 15:39 | |
| *** david-lyle is now known as dklyle | 15:40 | |
| *** zaneb has quit IRC | 15:43 | |
| *** trident has quit IRC | 15:52 | |
| *** _hemna has quit IRC | 15:53 | |
| *** ttsiouts has quit IRC | 15:54 | |
| *** ttsiouts has joined #openstack-meeting | 15:55 | |
| *** trident has joined #openstack-meeting | 15:55 | |
| *** ttsiouts_ has joined #openstack-meeting | 15:57 | |
| *** ttsiouts has quit IRC | 15:57 | |
| *** mlavalle has joined #openstack-meeting | 15:59 | |
| *** ttsiouts_ has quit IRC | 15:59 | |
| slaweq | #startmeeting neutron_ci | 16:00 |
| openstack | Meeting started Tue Jul 23 16:00:26 2019 UTC and is due to finish in 60 minutes. The chair is slaweq. Information about MeetBot at http://wiki.debian.org/MeetBot. | 16:00 |
| openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 16:00 |
| slaweq | hi | 16:00 |
| *** openstack changes topic to " (Meeting topic: neutron_ci)" | 16:00 | |
| openstack | The meeting name has been set to 'neutron_ci' | 16:00 |
| ralonsoh | hi | 16:00 |
| mlavalle | o/ | 16:00 |
| *** e0ne has joined #openstack-meeting | 16:01 | |
| slaweq | I know that njohnston is quite busy with internal stuff now, haleyb and bcafarel are on PTO | 16:02 |
| slaweq | so lets start | 16:02 |
| slaweq | first of all: | 16:02 |
| slaweq | #link http://grafana.openstack.org/dashboard/db/neutron-failure-rate | 16:02 |
| slaweq | and now lets go | 16:02 |
| slaweq | #topic Actions from previous meetings | 16:02 |
| *** openstack changes topic to "Actions from previous meetings (Meeting topic: neutron_ci)" | 16:02 | |
| slaweq | first one: | 16:02 |
| slaweq | mlavalle to continue debugging neutron-tempest-plugin-dvr-multinode-scenario issues | 16:02 |
| mlavalle | I did, although I changed my approach | 16:03 |
| njohnston | o/ | 16:03 |
| mlavalle | since the merging of https://review.opendev.org/#/c/667547/, the frequency of test_connectivity_through_2_routers has decreased significantly | 16:03 |
| mlavalle | it still fails sometimes but many of those failures may be due to the slowness in metadata / nova we discussed yesterday | 16:04 |
| *** cheng1 has quit IRC | 16:04 | |
| mlavalle | so I did an analysis of the failures over the past 7 days of all the tests | 16:04 |
| mlavalle | and came up with a ranking | 16:05 |
| mlavalle | Please see note #5 in | 16:05 |
| mlavalle | https://bugs.launchpad.net/neutron/+bug/1830763 | 16:05 |
| openstack | Launchpad bug 1830763 in neutron "Debug neutron-tempest-plugin-dvr-multinode-scenario failures" [High,Confirmed] - Assigned to Miguel Lavalle (minsel) | 16:05 |
| mlavalle | As you can see, the biggest offenders are test_qos_basic_and_update and the routers migrations | 16:06 |
| *** mattw4 has joined #openstack-meeting | 16:06 | |
| mlavalle | digging into test_qos_basic_and_update, please read note #6 | 16:07 |
| mlavalle | most of the failures happen after updating the QoS policy / rule | 16:07 |
| *** enriquetaso has joined #openstack-meeting | 16:07 | |
| *** tesseract has quit IRC | 16:07 | |
| mlavalle | in other words, at that point we already have connectivity and the routers / dvr seem to be working fine | 16:08 |
| slaweq | ok, so we have couple of different issues there | 16:08 |
| *** cheng1 has joined #openstack-meeting | 16:08 | |
| slaweq | because issue with failing to get instance-id from metadata also happens quite often in various tests | 16:08 |
| *** pfallenop has joined #openstack-meeting | 16:10 | |
| * mlavalle waiting for the rest of the comment | 16:10 | |
| slaweq | mlavalle: that's all from my side | 16:11 |
| mlavalle | oh | 16:11 |
| ralonsoh | mlavalle, I would like to see why the qos_check os failing | 16:11 |
| slaweq | I just wanted to say that we have few different issues | 16:11 |
| ralonsoh | is failing | 16:11 |
| ralonsoh | I'll review the logs | 16:11 |
| slaweq | can we than report it as 3 different bugs: | 16:11 |
| slaweq | 1. already created bug - left it related to ssh and metadata issues, | 16:12 |
| mlavalle | yeah, I wanted someone (really thinking ralonsoh) to check the failures in QoS | 16:12 |
| slaweq | 2. qos test issue | 16:12 |
| slaweq | 3. router migrations problems | 16:12 |
| mlavalle | I don't think this QoS failure is purely due to dvr | 16:12 |
| mlavalle | it must be the combination | 16:12 |
| mlavalle | so if ralonsoh takes care of that one | 16:12 |
| ralonsoh | I can take QoS (2) | 16:12 |
| mlavalle | I will take care of bug 3 as described by slaweq | 16:12 |
| openstack | bug 3 in mono (Ubuntu) "Custom information for each translation team" [Undecided,Fix committed] https://launchpad.net/bugs/3 | 16:12 |
| slaweq | LOL | 16:13 |
| mlavalle | ralonsoh: would you file bug 2? | 16:13 |
| ralonsoh | sure | 16:13 |
| slaweq | thx guys | 16:13 |
| slaweq | I can take a look once again on the issue with metadata | 16:14 |
| mlavalle | if you do, I'll post there the Kibana search that you need to see all the occurrences | 16:14 |
| slaweq | this one is IMO clearly related to dvr as I didn't saw it on any other jobs | 16:14 |
| mlavalle | ralonsoh: ^^^^ | 16:14 |
| ralonsoh | ok | 16:15 |
| mlavalle | ok, I achieved what I wanted with my report today | 16:15 |
| slaweq | thx mlavalle for update and for working on this | 16:15 |
| slaweq | mlavalle: will You also report bug 2 as new one? | 16:16 |
| mlavalle | yes | 16:16 |
| mlavalle | I will | 16:16 |
| slaweq | thx a lot | 16:16 |
| slaweq | #action mlavalle to report bug with router migrations | 16:16 |
| mlavalle | and assign to me | 16:16 |
| slaweq | #action ralonsoh to report bug with qos scenario test failures | 16:16 |
| slaweq | #action slaweq to take a look at issue with dvr and metadata: https://bugs.launchpad.net/neutron/+bug/1830763 | 16:17 |
| openstack | Launchpad bug 1830763 in neutron "Debug neutron-tempest-plugin-dvr-multinode-scenario failures" [High,Confirmed] - Assigned to Miguel Lavalle (minsel) | 16:17 |
| slaweq | ok, I think we are good here and can move on | 16:17 |
| slaweq | ralonsoh to try a patch to resuce the number of workers in FT | 16:17 |
| ralonsoh | slaweq, and I didn't have time, sorry | 16:18 |
| * mlavalle will have to drop off at 30 minutes after the hour | 16:18 | |
| ralonsoh | my bad, I'll do this tomorrow morning | 16:18 |
| ralonsoh | but I'll need help, because I really don't know where to modify this | 16:18 |
| slaweq | ralonsoh: sure, no problem | 16:18 |
| ralonsoh | in the neutron/tox.ini file? | 16:18 |
| ralonsoh | in the zuul FT definition? | 16:19 |
| *** lpetrut has quit IRC | 16:19 | |
| *** iyamahat has joined #openstack-meeting | 16:19 | |
| slaweq | ralonsoh: I think that it should be defined in tox.ini | 16:19 |
| slaweq | but I'm not 100% sure now | 16:19 |
| ralonsoh | slaweq, that was my initial though | 16:19 |
| *** enriquetaso has quit IRC | 16:19 | |
| ralonsoh | I'll try it tomorrow | 16:19 |
| slaweq | ok, thx | 16:20 |
| slaweq | #action ralonsoh to try a patch to resuce the number of workers in FT | 16:20 |
| slaweq | so, next one | 16:20 |
| slaweq | ralonsoh to report a bug and investigate failed test neutron.tests.fullstack.test_qos.TestMinBwQoSOvs.test_bw_limit_qos_port_removed | 16:20 |
| ralonsoh | in my list too, and no time | 16:20 |
| ralonsoh | sorry again | 16:20 |
| ralonsoh | really, I dind't have time last week | 16:21 |
| slaweq | ralonsoh: no problem at all :) | 16:22 |
| slaweq | it's not very urgent | 16:22 |
| slaweq | #action ralonsoh to report a bug and investigate failed test neutron.tests.fullstack.test_qos.TestMinBwQoSOvs.test_bw_limit_qos_port_removed | 16:22 |
| slaweq | but please at least report a bug, that we have it tracked | 16:22 |
| ralonsoh | sure | 16:22 |
| slaweq | maybe someone else will take a look | 16:23 |
| slaweq | :) | 16:23 |
| slaweq | thx | 16:23 |
| slaweq | ok, and last one | 16:23 |
| slaweq | slaweq to open bug about slow neutron-tempest-with-uwsgi job | 16:23 |
| slaweq | I opened bug https://bugs.launchpad.net/neutron/+bug/1837552 | 16:23 |
| openstack | Launchpad bug 1837552 in neutron "neutron-tempest-with-uwsgi job finish with timeout very often" [Medium,Confirmed] | 16:23 |
| slaweq | and I wrote there my initial findings | 16:23 |
| slaweq | basically there is some issue with neutron API IMO but I'm not sure what's going on there exactly | 16:24 |
| ralonsoh | slaweq, I saw that most of the time the test failing is the vrrp one | 16:25 |
| ralonsoh | let me find the name | 16:25 |
| slaweq | ralonsoh: but in which job? | 16:25 |
| ralonsoh | hmmm, not in tempest.... osrry | 16:26 |
| ralonsoh | sorry | 16:26 |
| *** baojg has quit IRC | 16:26 | |
| slaweq | sure | 16:26 |
| slaweq | in this tempest job, it is like at some point all tests are failing due to timeouts connecting to neutron API | 16:27 |
| slaweq | in apache logs I see HTTP 500 for each request related to neutron | 16:27 |
| slaweq | but in neutron logs I didn't saw any error | 16:27 |
| slaweq | so I'm a bit confused with that | 16:27 |
| slaweq | if I will have some time, I will try to investigate it | 16:27 |
| slaweq | but I didn't assign myself to this bug for now, maybe there will be someone else who will wants to look into this | 16:28 |
| * mlavalle drops off for another meeting o/ | 16:29 | |
| slaweq | see You mlavalle | 16:29 |
| slaweq | ok, I think we can move on | 16:29 |
| slaweq | next topic | 16:29 |
| slaweq | #topic Stadium projects | 16:29 |
| *** openstack changes topic to "Stadium projects (Meeting topic: neutron_ci)" | 16:29 | |
| slaweq | Python 3 migration | 16:29 |
| slaweq | Stadium projects etherpad: https://etherpad.openstack.org/p/neutron_stadium_python3_status | 16:29 |
| slaweq | I have only short update about this one | 16:29 |
| slaweq | last job in fwaas repo is switched to zuulv3 and python3 | 16:29 |
| slaweq | so we are good with this one | 16:29 |
| slaweq | we still have some work to do in | 16:30 |
| slaweq | networking-bagpipe, networking-midonet, networking-odl and python-neutronclient | 16:30 |
| slaweq | and that would be all | 16:30 |
| slaweq | we have patches or at least volunteers for all of them except midonet | 16:31 |
| slaweq | so I think we are quite good with this | 16:31 |
| slaweq | next part is: | 16:31 |
| slaweq | tempest-plugins migration | 16:31 |
| ralonsoh | slaweq, cool, we still support neutron-client | 16:31 |
| slaweq | and I don't have any updates here | 16:31 |
| slaweq | ralonsoh: sure, we are still supporting neutronclient | 16:31 |
| slaweq | it's deprecated but supported | 16:31 |
| slaweq | and amotoki is taking care of switching it to py3 | 16:32 |
| *** mlavalle has left #openstack-meeting | 16:32 | |
| *** rsimai has quit IRC | 16:32 | |
| slaweq | any questions/other updates about stadium projects? | 16:33 |
| ralonsoh | no | 16:33 |
| slaweq | ok, lets move on quickly | 16:33 |
| slaweq | #topic Grafana | 16:33 |
| *** openstack changes topic to "Grafana (Meeting topic: neutron_ci)" | 16:33 | |
| slaweq | #link http://grafana.openstack.org/dashboard/db/neutron-failure-rate | 16:33 |
| *** ricolin has quit IRC | 16:34 | |
| slaweq | looking at integrated tempest jobs, I think we are a bit better now, since we switched some jobs to only run neutron and nova related tests | 16:34 |
| slaweq | even last week most of those jobs were in quite good shape | 16:35 |
| slaweq | fullstack is also quite good now | 16:35 |
| slaweq | functiona test are failing a bit | 16:36 |
| slaweq | but I think it's mostly related to the issues which we talked about earlier today | 16:36 |
| slaweq | anything else regarding grafana? | 16:37 |
| slaweq | ok, lets move on | 16:38 |
| slaweq | #topic fullstack/functional | 16:38 |
| *** openstack changes topic to "fullstack/functional (Meeting topic: neutron_ci)" | 16:38 | |
| slaweq | I have only 2 things related to fullstack tests today | 16:38 |
| slaweq | 1. I recently found one "new" issue and reported a bug: https://bugs.launchpad.net/neutron/+bug/1837380 | 16:39 |
| openstack | Launchpad bug 1837380 in neutron "Timeout while getting bridge datapath id crashes ova agent" [High,In progress] - Assigned to Slawek Kaplonski (slaweq) | 16:39 |
| slaweq | basically if some physical bridge is recreated and there will be timeout while getting datapath id, neutron-ovs-agent will crash completly | 16:40 |
| ralonsoh | ?? | 16:40 |
| ralonsoh | that means the bridge is created again? | 16:40 |
| slaweq | correct ralonsoh | 16:40 |
| ralonsoh | hmmm | 16:40 |
| ralonsoh | maybe the default datapath_is is not correct | 16:40 |
| ralonsoh | this must be different from the other bridges | 16:40 |
| ralonsoh | and should be "something" not null | 16:41 |
| slaweq | ralonsoh: please check logs: http://logs.openstack.org/81/671881/1/check/neutron-fullstack/c6b2e08/controller/logs/dsvm-fullstack-logs/TestLegacyL3Agent.test_north_south_traffic/neutron-openvswitch-agent--2019-07-22--07-48-17-892074_log.txt.gz#_2019-07-22_07_49_28_698 | 16:41 |
| slaweq | it was timeout while getting datapath_id | 16:41 |
| ralonsoh | I see, yes | 16:41 |
| ralonsoh | 10 secs to retrieve the datapath | 16:41 |
| slaweq | in fullstack/functional jobs we have seen from time to time e.g. ovsdbapp timeouts and things like that | 16:41 |
| slaweq | so my assumption is that similar issue happend here | 16:42 |
| slaweq | but this shouldn't cause crash of agent IMO | 16:42 |
| slaweq | but, as You can see at http://logs.openstack.org/81/671881/1/check/neutron-fullstack/c6b2e08/controller/logs/dsvm-fullstack-logs/TestLegacyL3Agent.test_north_south_traffic/neutron-openvswitch-agent--2019-07-22--07-48-17-892074_log.txt.gz#_2019-07-22_07_49_28_756 it crashes | 16:42 |
| ralonsoh | no, of course | 16:42 |
| slaweq | I proposed some patch for that but will need to add some UT for that probably: https://review.opendev.org/672018 | 16:42 |
| ralonsoh | actually I was talking more about the second error | 16:43 |
| *** yamamoto has joined #openstack-meeting | 16:43 | |
| slaweq | which one? | 16:43 |
| ralonsoh | the one related to https://review.opendev.org/#/c/672018 | 16:44 |
| ralonsoh | I'll review your patch | 16:44 |
| slaweq | yes, this one is related to this crash while getting datapath_id of bridge | 16:44 |
| slaweq | it's one issue | 16:44 |
| slaweq | ok, and the other thing which I have for today is | 16:45 |
| slaweq | http://logs.openstack.org/77/670177/4/check/neutron-fullstack/56c8bb0/testr_results.html.gz | 16:45 |
| slaweq | but I found this failure only once so far and IMO it may be related to the patch on which it was running | 16:46 |
| slaweq | so I would just keep an eye on those tests :) | 16:46 |
| slaweq | and that's all from my for today | 16:46 |
| slaweq | I think we already talked about all other "hot" issues with tempest and functional tests | 16:47 |
| slaweq | anything else You want to talk about today? | 16:47 |
| ralonsoh | no | 16:47 |
| slaweq | ok, so lets finish a bit earlier today | 16:48 |
| slaweq | thx for attending | 16:48 |
| slaweq | o/ | 16:48 |
| ralonsoh | bye! | 16:48 |
| slaweq | #endmeeting | 16:48 |
| *** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/" | 16:48 | |
| openstack | Meeting ended Tue Jul 23 16:48:19 2019 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 16:48 |
| *** yamamoto has quit IRC | 16:48 | |
| openstack | Minutes: http://eavesdrop.openstack.org/meetings/neutron_ci/2019/neutron_ci.2019-07-23-16.00.html | 16:48 |
| openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/neutron_ci/2019/neutron_ci.2019-07-23-16.00.txt | 16:48 |
| openstack | Log: http://eavesdrop.openstack.org/meetings/neutron_ci/2019/neutron_ci.2019-07-23-16.00.log.html | 16:48 |
| *** yamamoto has joined #openstack-meeting | 16:49 | |
| *** armax has quit IRC | 16:50 | |
| *** jaypipes has quit IRC | 16:54 | |
| *** enriquetaso has joined #openstack-meeting | 16:54 | |
| *** trident has quit IRC | 17:07 | |
| *** trident has joined #openstack-meeting | 17:10 | |
| *** yamamoto has quit IRC | 17:11 | |
| *** priteau has quit IRC | 17:11 | |
| *** yamamoto has joined #openstack-meeting | 17:13 | |
| *** ociuhandu has quit IRC | 17:13 | |
| *** lseki has quit IRC | 17:16 | |
| *** yamamoto has quit IRC | 17:18 | |
| *** enriquetaso has quit IRC | 17:23 | |
| *** _erlon_ has joined #openstack-meeting | 17:25 | |
| *** enriquetaso has joined #openstack-meeting | 17:31 | |
| *** armax has joined #openstack-meeting | 17:32 | |
| *** e0ne has quit IRC | 17:33 | |
| *** senrique_ has joined #openstack-meeting | 17:35 | |
| *** ralonsoh has quit IRC | 17:36 | |
| *** enriquetaso has quit IRC | 17:37 | |
| *** iyamahat has quit IRC | 17:43 | |
| *** panda is now known as panda|off | 17:45 | |
| *** _hemna has joined #openstack-meeting | 17:49 | |
| *** Lucas_Gray has joined #openstack-meeting | 17:58 | |
| *** armax has quit IRC | 18:01 | |
| *** Lucas_Gray has quit IRC | 18:03 | |
| *** armax has joined #openstack-meeting | 18:03 | |
| *** Lucas_Gray has joined #openstack-meeting | 18:05 | |
| *** Shrews has joined #openstack-meeting | 18:14 | |
| *** ociuhandu has joined #openstack-meeting | 18:16 | |
| *** psachin has quit IRC | 18:19 | |
| *** Lucas_Gray has quit IRC | 18:20 | |
| *** Lucas_Gray has joined #openstack-meeting | 18:22 | |
| *** _hemna has quit IRC | 18:22 | |
| *** igordc has joined #openstack-meeting | 18:27 | |
| *** ociuhandu has quit IRC | 18:34 | |
| *** senrique__ has joined #openstack-meeting | 18:34 | |
| *** senrique__ is now known as enriquetaso | 18:34 | |
| *** Lucas_Gray has quit IRC | 18:36 | |
| *** Lucas_Gray has joined #openstack-meeting | 18:36 | |
| *** senrique_ has quit IRC | 18:38 | |
| *** e0ne has joined #openstack-meeting | 18:42 | |
| *** mriedem has quit IRC | 18:42 | |
| *** enriquetaso has quit IRC | 18:49 | |
| clarkb | anyone else here for the infra meeting? | 19:00 |
| clarkb | we will get started momentarily | 19:00 |
| *** igordc has quit IRC | 19:00 | |
| ianw | o/ | 19:00 |
| mordred | o/ | 19:01 |
| clarkb | #startmeeting infra | 19:01 |
| openstack | Meeting started Tue Jul 23 19:01:37 2019 UTC and is due to finish in 60 minutes. The chair is clarkb. Information about MeetBot at http://wiki.debian.org/MeetBot. | 19:01 |
| openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 19:01 |
| *** openstack changes topic to " (Meeting topic: infra)" | 19:01 | |
| openstack | The meeting name has been set to 'infra' | 19:01 |
| clarkb | #link http://lists.openstack.org/pipermail/openstack-infra/2019-July/006425.html | 19:01 |
| fungi | aloha | 19:01 |
| clarkb | #topic Announcements | 19:02 |
| *** openstack changes topic to "Announcements (Meeting topic: infra)" | 19:02 | |
| clarkb | There weren't any recorded on the agenda | 19:03 |
| clarkb | #topic Actions from last meeting | 19:03 |
| *** openstack changes topic to "Actions from last meeting (Meeting topic: infra)" | 19:03 | |
| clarkb | #link http://eavesdrop.openstack.org/meetings/infra/2019/infra.2019-07-16-19.01.txt minutes from last meeting | 19:03 |
| clarkb | mordred: any updates on the github cleanup work? | 19:03 |
| *** ociuhandu has joined #openstack-meeting | 19:04 | |
| *** dtrainor has quit IRC | 19:05 | |
| mordred | clarkb: nope. totally been doing gerrit instead. also, I keep hitting github rate limits and then doing something else | 19:05 |
| clarkb | mordred: we need to convert you into a github app then | 19:06 |
| clarkb | #action mordred clean up openstack-infra github org | 19:06 |
| clarkb | #action mordred create opendevadmin account on github | 19:06 |
| clarkb | #topic Priority Efforts | 19:07 |
| *** openstack changes topic to "Priority Efforts (Meeting topic: infra)" | 19:07 | |
| clarkb | #topic OpenDev | 19:07 |
| *** openstack changes topic to "OpenDev (Meeting topic: infra)" | 19:07 | |
| clarkb | Lets start here since a fair bit has gone on with gitea in the last week or so | 19:08 |
| fungi | indeed it has | 19:08 |
| clarkb | We've discovered that gitea services can cause OOMKiller to be invoked. This often targets git processes for killing. If this happens when gerrit is replicating to gitea we can lose that replication event | 19:08 |
| fungi | synopsis: corrupt git repo or missing objects | 19:09 |
| clarkb | I've put 1GB of swap (via swapfile) on gitea01-05,07-08 and 8GB on gitea06. The reason for the difference in size is 06 was rebuilt with a much larger root disk and has space for the swapfile the others are smaller and don't have much room | 19:09 |
| *** ociuhandu_ has joined #openstack-meeting | 19:09 | |
| clarkb | 1GB of swap is not sufficient to avoid these errors | 19:09 |
| *** ociuhandu has quit IRC | 19:09 | |
| clarkb | But 8GB appears to have been sufficient so we are rebuilding gitea01 to be like gitea06 and will likely roll through all the other backends to do the same thing | 19:09 |
| clarkb | In this process we've discovered a few deficiencies with how we deploy gitea and manage haproxy fixes for which are all merged now with exception of how to gracefully restart haproxy when haproxy's image updates | 19:10 |
| fungi | old instance/volume deleted, new bfv instance exists now and needs data copied over | 19:10 |
| clarkb | I don't know how to handle that last case and will need to think about it more (and read up on docker-compose) | 19:10 |
| donnyd | clarkb: Is there an agenda? | 19:12 |
| fungi | yeah, manuals say sigusr1 is for that | 19:12 |
| clarkb | donnyd: ya http://lists.openstack.org/pipermail/openstack-infra/2019-July/006425.html | 19:12 |
| fungi | if i'm reading correctly | 19:12 |
| donnyd | Sorry. I didn't scroll all the way down. | 19:12 |
| clarkb | fungi: ya so will depend on whether or not we can have docker-compose somehow send signals when it restarts stuff | 19:12 |
| clarkb | fungi: we may have to break this out of docker-compose? or accept that iamges don't update often | 19:12 |
| clarkb | (and haproxy restarts are quick) | 19:12 |
| clarkb | need to do more research | 19:13 |
| mordred | I mean - I think we always have ansible running docker-compose things | 19:13 |
| mordred | so it's reasonable for ansible to tell docker-compose to send a signal or whatever | 19:13 |
| mordred | maybe? | 19:14 |
| Shrews | http://cavaliercoder.com/blog/restarting-services-in-docker-compose.html ?? | 19:14 |
| clarkb | mordred: right but the image replacement is all a bit automagic in docker compose | 19:14 |
| * fungi just wrote a handler which does that | 19:14 | |
| mordred | clarkb: ah yes - that's an excellent point | 19:14 |
| clarkb | mordred: so either we can hook into that or we stop relying on it and manually break out the steps | 19:14 |
| mordred | we don't actually want to do this every ansible time- only if the result of pull would cause a restart | 19:14 |
| clarkb | correct | 19:15 |
| fungi | yeah, image updates will require more than just sending a signal to the running daemon | 19:15 |
| corvus | happily, haproxy is generally pretty boring and stable | 19:15 |
| clarkb | corvus: yup (today is an exception and there should be a new image soon but in general that is true) | 19:15 |
| clarkb | I think that is the least urgent item to sort out for impactless updates | 19:16 |
| clarkb | the urgent ones have all been addressed, thank you | 19:16 |
| clarkb | We should keep an eye out for unexpected behavior going forward as digging into the problems today was really helpful | 19:16 |
| *** kopecmartin is now known as kopecmartin|off | 19:16 | |
| clarkb | Are there any other opendev related changes we should be aware of? | 19:17 |
| clarkb | Sounds like no. Onward | 19:18 |
| clarkb | #topic Update Config Management | 19:18 |
| *** openstack changes topic to "Update Config Management (Meeting topic: infra)" | 19:18 | |
| clarkb | mordred has been working on getting gerrit into docker | 19:18 |
| corvus | \o/ | 19:18 |
| clarkb | mordred: anything you want to call out for that activity? | 19:18 |
| mordred | yes. I just pushed up a new rev | 19:18 |
| mordred | uhm - mainly it's definitely ready for review now | 19:19 |
| mordred | and clarkb just found a good pile of gotcha for 2.13 | 19:19 |
| mordred | so review is much appreciated | 19:19 |
| clarkb | #link https://review.opendev.org/671457 Gerrit docker image builds ready for review | 19:19 |
| corvus | i think when that's in place https://review.opendev.org/630406 is going to show us any problems with it | 19:19 |
| mordred | the general idea is making a 2.13 image that works pretty much just like our current 2.13 install | 19:19 |
| corvus | there's currently a problem with the last image we built (6mo ago); i doubt it's fixed, but we'll be able to iterate then | 19:19 |
| mordred | corvus: agree - although there are a few things, like heapSize, that we'll want to thikn about? | 19:20 |
| mordred | corvus: ++ | 19:20 |
| corvus | and by "problem" i mean things like file ownership, paths, etc | 19:20 |
| mordred | yeah | 19:20 |
| mordred | most of the things should pretty immediately break | 19:20 |
| corvus | mordred: heapSize is something we can pass in in an env var, right? | 19:20 |
| mordred | it is now :) | 19:20 |
| corvus | (so we can have a test and prod value) | 19:20 |
| corvus | cool | 19:20 |
| mordred | we WILL be losing the ability to set those things in gerrit.config unless we make things more complex | 19:21 |
| clarkb | mordred: could we run an image that ran the gerrit init script? | 19:21 |
| mordred | not really - it forks gerrit into the background | 19:21 |
| clarkb | right but aren't there docker images that know how to manage that? | 19:22 |
| mordred | I mean - we COULD - but I'd rather fix this to not be wonky like that | 19:22 |
| mordred | and it's not far off | 19:22 |
| clarkb | ok | 19:22 |
| *** Lucas_Gray has quit IRC | 19:22 | |
| *** whoami-rajat has quit IRC | 19:22 | |
| *** Wryhder has joined #openstack-meeting | 19:22 | |
| *** panda|off has quit IRC | 19:23 | |
| clarkb | we should be able to deploy it on review-dev and be pretty happy with the results before we commit to production too | 19:23 |
| mordred | ++ | 19:23 |
| fungi | as long as gerrit upstream also doesn't intend it to be wonky like that | 19:23 |
| fungi | otherwise seems a bit sisyphean | 19:23 |
| *** Wryhder is now known as Lucas_Gray | 19:23 | |
| clarkb | I get the sense that gerrit upstream has sort of ignored these problems with their images? | 19:23 |
| clarkb | (I seem to recall it relying on h2 among other things) | 19:24 |
| fungi | which i expect is fine as long as they don't intentionally make it worse | 19:24 |
| corvus | hrm, i think the upstream images are decently constructed | 19:24 |
| corvus | they have volumes in the right places, so you don't have to use h2 | 19:24 |
| clarkb | ah | 19:24 |
| mordred | yah | 19:24 |
| corvus | they don't work for us because we want to be able to patch :) | 19:24 |
| mordred | most of the stuff going on in the init script is not actually necessary | 19:25 |
| mordred | it elides out pretty quickly once you're making images, because you know where all the things are | 19:25 |
| mordred | (there's a TON of logic for finding where your files might be, for instance) | 19:25 |
| clarkb | it seems like they completely ignore things like java heapsizes though? | 19:25 |
| *** panda has joined #openstack-meeting | 19:25 | |
| clarkb | oh maybe not https://github.com/GerritCodeReview/docker-gerrit/blob/master/ubuntu/18/entrypoint.sh#L16 | 19:26 |
| clarkb | they are running the init script | 19:27 |
| mordred | yeah. I mean - we could do that if people want - I just don't think we need to | 19:27 |
| clarkb | My biggest concern with not doing that is that we might miss important changes to java configs or other settings that happen in the runtime (not gerrit itself) as new versions of gerrit or java come out | 19:28 |
| clarkb | but you are right that that is less ideal for docker | 19:28 |
| fungi | and maybe an opportunity to collaborate | 19:28 |
| mordred | there is currently exactly one setting we are setting that results in a java cli option being pulled out by the init script :) | 19:28 |
| clarkb | mordred: we also set the timeout option but that one doesn't make sense with docker | 19:29 |
| mordred | yah | 19:29 |
| clarkb | not much preexisting cause for worry then | 19:30 |
| clarkb | current approach should be fine | 19:30 |
| clarkb | Sounds like that may be it on this topic then? | 19:33 |
| clarkb | #topic Storyboard | 19:33 |
| *** openstack changes topic to "Storyboard (Meeting topic: infra)" | 19:33 | |
| clarkb | fungi: diablo_rojo_phon how are things? | 19:33 |
| fungi | we had a good session on friday grooming feature requests into our main priorities board | 19:33 |
| *** Lucas_Gray has quit IRC | 19:34 | |
| diablo_rojo_phon | Gonna meet this week | 19:34 |
| fungi | #link https://storyboard.openstack.org/#!/board/115 StoryBoard Team Dashboard | 19:34 |
| diablo_rojo_phon | Talk about ptg forum things | 19:34 |
| *** enriquetaso has joined #openstack-meeting | 19:35 | |
| *** Lucas_Gray has joined #openstack-meeting | 19:35 | |
| diablo_rojo_phon | Onboarding maybe. | 19:35 |
| *** bbowen has quit IRC | 19:35 | |
| fungi | curious to see what interest we can drum up in shanghai | 19:35 |
| diablo_rojo_phon | Same | 19:35 |
| fungi | that's all i can recall | 19:36 |
| diablo_rojo_phon | Yeah that's it for now | 19:36 |
| clarkb | Thanks! | 19:36 |
| clarkb | #topic General Topics | 19:36 |
| *** openstack changes topic to "General Topics (Meeting topic: infra)" | 19:36 | |
| fungi | oh, i've pushed some changes to get python-storyboardclient testable again | 19:36 |
| diablo_rojo_phon | Aside from begging mordred to do some SQL things in hopes of improving search | 19:37 |
| diablo_rojo_phon | Thanks fungi! | 19:37 |
| clarkb | fungi: for the wiki upgrade I think last week the suspicion was git submodules | 19:37 |
| clarkb | have we been able to take that suspicion and make progress with it yet ? (also I know I said I woudl try to help then got sucked into making gitea betterer) | 19:37 |
| fungi | nope, i had weekend guests and so less time on hand than hoped | 19:38 |
| clarkb | ok I'll actually try to take a look this week | 19:38 |
| corvus | i've been working on making progress on the zuul log handling; while we can technically switch to swift log storage at any time, the experience will degrade if we do it now, but could be better if we do it after we add some things to zuul | 19:38 |
| corvus | #link https://zuul-ci.org/docs/zuul/developer/specs/logs.html zuul log handling spec | 19:38 |
| fungi | submodules or similar (git subtree?) theories are possible avenues of investigation for the mediawiki situation | 19:39 |
| clarkb | corvus: is the log manifest bit the piece to reduce degradation? | 19:39 |
| corvus | i've pestered mordred and clarkb for reviews of blokers so far. i think i'm about at the end of that, and with the (yes) zuul-manifest stuff in place, we should be able to see the javascript work in action with the preview builds | 19:39 |
| corvus | yeah, the short version is the manifest lets the web app handle indexes, so we don't have to pre-generate them, and we can also display logs in the web app itself | 19:40 |
| corvus | which means we can have javascript do the OSLA bits (which otherwise we would also have to pre-generate) | 19:40 |
| fungi | that sounds like a great approach | 19:40 |
| clarkb | then we can delete the log server | 19:40 |
| clarkb | and there will be much rejoicing | 19:40 |
| mordred | \o/ | 19:41 |
| fungi | saw some of those changes float by and will try to take a closer look | 19:41 |
| corvus | it'll get interesting once the manifest stuff is in place and i can rebase for it. hopefully today | 19:41 |
| clarkb | exciting progress | 19:41 |
| ianw | the kafs mirror servers are out of rotation for now; there are some changes queued in afs-next branch which it would be good for us to test before they are sent to linus | 19:41 |
| ianw | however the tree currently doesn't build, but when it does it would be good to put into rotation for a while to confirm. the fscache issues are unresolved, however | 19:42 |
| fungi | i find it awesome that we're testing things before they're sent to linus | 19:42 |
| fungi | (just an aside) | 19:42 |
| corvus | fungi: ++ | 19:42 |
| clarkb | ianw: good to know, let us know how we can heklp I suppose (reviewing changes to flip around the mirror that is used?) | 19:43 |
| *** iyamahat has joined #openstack-meeting | 19:43 | |
| corvus | ianw: does afs-next get patches via mailing list? | 19:43 |
| fungi | seems so, yes | 19:44 |
| corvus | (i've been itching to write an imap driver for zuul; wonder if this would be a practical use) | 19:44 |
| ianw | corvus: there is a mailing list, but things also pop in and out as dhowells works on things | 19:44 |
| fungi | i will *so* review an imap/smtp zuul driver | 19:44 |
| fungi | i mean, i guess the smtp reporter is already there? ;) | 19:45 |
| * corvus read "tree currently doesn't build" and got really confused and sad | 19:45 | |
| clarkb | Intel has been doing a bunch of CI for the kernel recently I think | 19:46 |
| clarkb | that might be another avenue for collaboration potentially | 19:46 |
| clarkb | As a timecheck we have ~14 minutes left and a couple more items to get through so lets continue on though | 19:46 |
| clarkb | I did want to do a cloud status check in | 19:46 |
| fungi | an nntp driver would be cool, but convincing lkml to return their focus on usenet might be an uphill battle | 19:46 |
| clarkb | FortNebula cloud is pretty well stabilized at this point. Thank you donnyd | 19:47 |
| fungi | thanks donnyd!!! | 19:47 |
| clarkb | there may be one or two corner cases that need further invenstigating (ipv6 related maybe?) | 19:47 |
| donnyd | yea it seems to be working well atm | 19:47 |
| clarkb | but overall it is doing great | 19:47 |
| donnyd | Yea I am not sure why there seem to be just 3 jobs that timeout | 19:47 |
| fungi | which three jobs? | 19:47 |
| donnyd | Hopeful the right storage gear will *actually* show up tomorrow | 19:48 |
| fungi | i hear there's a generator backup in the works too | 19:48 |
| donnyd | fungi: I will get you the list, but it seems to be fairly consistent | 19:48 |
| donnyd | yea, its been sitting outside for 6 weeks | 19:48 |
| donnyd | just got a pad poured and now I am waiting for the gas to be hooked up to it | 19:49 |
| clarkb | mordred: for MOC is there anything we can be doing or is it still in that weird make accounts and get people to trust us situation :) | 19:49 |
| donnyd | and my UPS have been refreshed, so they should handle the load till the genny takes over | 19:49 |
| clarkb | I have not heard anything new about the new linaro cloud since we last had this meeting | 19:49 |
| *** Lucas_Gray has quit IRC | 19:49 | |
| fungi | hah. i need to get a generator for here. most of my neighbors have them so i'm feeling rather naked (though i need a >=6' platform to support it) | 19:49 |
| clarkb | fungi: is that something you can put on the roof? that should be high enoguh | 19:50 |
| fungi | i'd need to reinforce the roof for that | 19:50 |
| mordred | clarkb: lemme check to see if it's been fixed | 19:50 |
| donnyd | Is there any other fun experiments we can do with FN? | 19:50 |
| donnyd | are | 19:50 |
| fungi | this experiment isn't enough? (just kidding!) | 19:51 |
| clarkb | donnyd: I think if we get a serious group together to start working out nested virt issues (another potential avenue for feedback to the kernel) that would be super helpful | 19:51 |
| donnyd | LOL | 19:51 |
| fungi | yeah, that's been a frequent request | 19:51 |
| clarkb | donnyd: what we've found in the past is taht debugging those issues requires involvement from all layers of the stack and what we've traditionally lacked is insight into the cloud | 19:51 |
| donnyd | yea, I have seen more than one request for it | 19:51 |
| donnyd | clarkb: would ssh access to the hypervisors help? | 19:52 |
| *** Lucas_Gray has joined #openstack-meeting | 19:52 | |
| clarkb | johnsom and kashyap are your workload and kernel people and then if we can get them insight into the hypervisors we may start with balls rolling | 19:52 |
| fungi | if it came with people to ssh in and troubleshoot them ;) | 19:52 |
| mordred | clarkb: MOC still waiting on app credentials to be enabled in their keystone | 19:52 |
| clarkb | donnyd: I'm not sure they need to ssh in as much as just candid data capture | 19:52 |
| * mordred pings knikolla ^^ | 19:52 | |
| clarkb | donnyd: cpu and microcode version and kernel versions and modules loaded and so on | 19:52 |
| clarkb | mordred: k | 19:52 |
| donnyd | sure... this is the only workload this thing is doing... I can make logs public facing without issue | 19:53 |
| clarkb | donnyd: kashyap would be the best person to engage for what needs are | 19:53 |
| fungi | on the cloud providers topic, there's a change posted to switch the main flavor in the lon1 aarch64 cloud to 16 cpus and 16gb ram because of resource demands from kolla arm64 jobs | 19:53 |
| clarkb | fungi: I'm a bit wary of increasing the memory footprint just because but considering it is a different cpu arch incraesing teh cpu count seems reasonable | 19:53 |
| corvus | the arm jobs require more ram? | 19:54 |
| fungi | #link https://review.opendev.org/671445 Linaro London: use new bigger flavour | 19:54 |
| fungi | clarkb: corvus: these are questions i too have asked | 19:54 |
| clarkb | in defense of the request devstack + tempest does swap now | 19:54 |
| fungi | please follow up on that change so i'm not the only one ;) | 19:54 |
| clarkb | and I'm sure that is part of the slowness, but the fixing should involve figuring out why we've used so much more memory than in the past | 19:54 |
| clarkb | fungi: will do | 19:54 |
| clarkb | really quickly before we run out of time | 19:55 |
| clarkb | I submitted PTG survery for the opendev infra team and gitea as separate requests | 19:55 |
| clarkb | That means if you are going to be in shanghai some group of us likely will as well | 19:55 |
| clarkb | #link https://etherpad.openstack.org/p/OpenDev-Shanghai-PTG-2019 Start planning the next PTG | 19:55 |
| clarkb | That has no content yet but it is there for people to start putting ideas up (I know it is early so no pressure) | 19:56 |
| * mordred will be in shanghai | 19:56 | |
| fungi | "TODO" | 19:56 |
| fungi | i'm so scattered i honestly can't recall whether i've filled out the opendev infra survey | 19:57 |
| clarkb | fungi: its for me to fill out and you not to worry about | 19:57 |
| fungi | ahh, got i | 19:57 |
| fungi | y | 19:57 |
| fungi | t | 19:57 |
| clarkb | fungi: basically our request to the foundation that we want space at the PTG | 19:57 |
| * fungi gives up on typing again | 19:57 | |
| clarkb | #topic Open Discussion | 19:57 |
| *** openstack changes topic to "Open Discussion (Meeting topic: infra)" | 19:57 | |
| clarkb | We have a couple minutes for anything else that may have been missed | 19:58 |
| clarkb | Thank you for yout time and we'll see you next week | 19:59 |
| fungi | thanks clarkb! | 19:59 |
| clarkb | my typing is suffering now too :) | 19:59 |
| clarkb | #endmeeting | 20:00 |
| *** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/" | 20:00 | |
| openstack | Meeting ended Tue Jul 23 20:00:05 2019 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 20:00 |
| openstack | Minutes: http://eavesdrop.openstack.org/meetings/infra/2019/infra.2019-07-23-19.01.html | 20:00 |
| openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/infra/2019/infra.2019-07-23-19.01.txt | 20:00 |
| openstack | Log: http://eavesdrop.openstack.org/meetings/infra/2019/infra.2019-07-23-19.01.log.html | 20:00 |
| *** mriedem has joined #openstack-meeting | 20:00 | |
| *** lbragstad has quit IRC | 20:01 | |
| *** e0ne has quit IRC | 20:06 | |
| *** slaweq has quit IRC | 20:08 | |
| *** dtrainor has joined #openstack-meeting | 20:09 | |
| *** Shrews has left #openstack-meeting | 20:15 | |
| *** iyamahat has quit IRC | 20:18 | |
| *** _hemna has joined #openstack-meeting | 20:19 | |
| *** ociuhandu_ has quit IRC | 20:32 | |
| *** ociuhandu has joined #openstack-meeting | 20:33 | |
| *** Lucas_Gray has quit IRC | 20:36 | |
| *** zaneb has joined #openstack-meeting | 20:41 | |
| *** pcaruana has quit IRC | 20:50 | |
| *** _hemna has quit IRC | 20:53 | |
| *** slaweq has joined #openstack-meeting | 20:56 | |
| *** slaweq has quit IRC | 21:01 | |
| *** oneswig has joined #openstack-meeting | 21:02 | |
| *** ociuhandu has quit IRC | 21:02 | |
| oneswig | Apologies - no Scientific SIG meeting today, can't get the staff at this point in the summer. | 21:03 |
| *** bbowen has joined #openstack-meeting | 21:03 | |
| oneswig | We'll endeavour to resume next week. | 21:04 |
| *** oneswig has quit IRC | 21:06 | |
| *** martial_ has joined #openstack-meeting | 21:12 | |
| *** martial_ is now known as martial | 21:12 | |
| *** iyamahat has joined #openstack-meeting | 21:20 | |
| *** lpetrut has joined #openstack-meeting | 21:22 | |
| *** e0ne has joined #openstack-meeting | 21:22 | |
| *** lpetrut has quit IRC | 21:22 | |
| *** lpetrut has joined #openstack-meeting | 21:23 | |
| *** iyamahat has quit IRC | 21:26 | |
| *** b1airo has joined #openstack-meeting | 21:30 | |
| *** lpetrut has quit IRC | 21:30 | |
| b1airo | o/ | 21:30 |
| *** ayoung has quit IRC | 21:31 | |
| *** zaneb has quit IRC | 21:31 | |
| *** irclogbot_2 has quit IRC | 21:32 | |
| *** altlogbot_3 has quit IRC | 21:33 | |
| *** altlogbot_1 has joined #openstack-meeting | 21:34 | |
| *** irclogbot_3 has joined #openstack-meeting | 21:34 | |
| *** enriquetaso has quit IRC | 21:44 | |
| *** yamamoto has joined #openstack-meeting | 21:50 | |
| *** e0ne has quit IRC | 21:50 | |
| *** yamamoto has quit IRC | 21:55 | |
| *** irclogbot_3 has quit IRC | 21:59 | |
| *** altlogbot_1 has quit IRC | 22:01 | |
| *** armax has quit IRC | 22:11 | |
| *** altlogbot_1 has joined #openstack-meeting | 22:22 | |
| *** gyee has quit IRC | 22:23 | |
| *** TxGirlGeek has quit IRC | 22:25 | |
| *** altlogbot_1 has quit IRC | 22:27 | |
| *** raildo has quit IRC | 22:35 | |
| *** diablo_rojo has joined #openstack-meeting | 22:41 | |
| *** _hemna has joined #openstack-meeting | 22:49 | |
| *** ayoung has joined #openstack-meeting | 22:53 | |
| *** mriedem has quit IRC | 22:55 | |
| *** armax has joined #openstack-meeting | 23:04 | |
| *** gyee has joined #openstack-meeting | 23:10 | |
| *** altlogbot_1 has joined #openstack-meeting | 23:14 | |
| *** carloss has quit IRC | 23:16 | |
| *** rcernin has joined #openstack-meeting | 23:16 | |
| *** altlogbot_1 has quit IRC | 23:19 | |
| *** _hemna has quit IRC | 23:24 | |
| *** altlogbot_3 has joined #openstack-meeting | 23:28 | |
| *** irclogbot_2 has joined #openstack-meeting | 23:32 | |
| *** igordc has joined #openstack-meeting | 23:35 | |
| *** jamesmcarthur has joined #openstack-meeting | 23:36 | |
| *** b1airo has quit IRC | 23:39 | |
| *** jamesmcarthur has quit IRC | 23:52 | |
| *** diablo_rojo has quit IRC | 23:54 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!