*** ociuhandu has quit IRC | 00:01 | |
*** epei has joined #openstack-meeting | 00:03 | |
*** rcernin_ has joined #openstack-meeting | 00:04 | |
*** rcernin has quit IRC | 00:07 | |
*** epei has quit IRC | 00:07 | |
*** epei has joined #openstack-meeting | 00:08 | |
*** ociuhandu has joined #openstack-meeting | 00:10 | |
*** epei has quit IRC | 00:12 | |
*** ociuhandu has quit IRC | 00:14 | |
*** artom has joined #openstack-meeting | 00:16 | |
*** artom has quit IRC | 00:17 | |
*** ociuhandu has joined #openstack-meeting | 00:17 | |
*** artom has joined #openstack-meeting | 00:17 | |
*** rcernin_ has quit IRC | 00:19 | |
*** ociuhandu has quit IRC | 00:21 | |
*** ociuhandu has joined #openstack-meeting | 00:23 | |
*** gyee has quit IRC | 00:24 | |
*** epei has joined #openstack-meeting | 00:27 | |
*** rcernin has joined #openstack-meeting | 00:27 | |
*** ociuhandu has quit IRC | 00:28 | |
*** jamesmcarthur has joined #openstack-meeting | 00:28 | |
*** ociuhandu has joined #openstack-meeting | 00:31 | |
*** epei has quit IRC | 00:32 | |
*** epei has joined #openstack-meeting | 00:33 | |
*** ociuhandu has quit IRC | 00:36 | |
*** epei has quit IRC | 00:37 | |
*** ociuhandu has joined #openstack-meeting | 00:41 | |
*** ociuhandu has quit IRC | 00:46 | |
*** epei has joined #openstack-meeting | 00:47 | |
*** yamamoto has quit IRC | 00:49 | |
*** brinzhang has joined #openstack-meeting | 00:50 | |
*** rf0lc0 has joined #openstack-meeting | 00:51 | |
*** epei has quit IRC | 00:51 | |
*** ociuhandu has joined #openstack-meeting | 00:51 | |
*** rfolco has quit IRC | 00:51 | |
*** ricolin has joined #openstack-meeting | 00:56 | |
*** ociuhandu has quit IRC | 00:57 | |
*** epei has joined #openstack-meeting | 00:59 | |
*** yamamoto has joined #openstack-meeting | 01:01 | |
*** ociuhandu has joined #openstack-meeting | 01:02 | |
*** epei has quit IRC | 01:04 | |
*** ociuhandu has quit IRC | 01:06 | |
*** ircuser-1 has joined #openstack-meeting | 01:07 | |
*** jamesmcarthur has quit IRC | 01:07 | |
*** ociuhandu has joined #openstack-meeting | 01:12 | |
*** enriquetaso has quit IRC | 01:12 | |
*** epei has joined #openstack-meeting | 01:14 | |
*** ociuhandu has quit IRC | 01:16 | |
*** epei has quit IRC | 01:18 | |
*** Liang__ has joined #openstack-meeting | 01:18 | |
*** ociuhandu has joined #openstack-meeting | 01:21 | |
*** epei has joined #openstack-meeting | 01:24 | |
*** jamesmcarthur has joined #openstack-meeting | 01:24 | |
*** jamesmcarthur has quit IRC | 01:24 | |
*** jamesmcarthur has joined #openstack-meeting | 01:24 | |
*** ociuhandu has quit IRC | 01:26 | |
*** epei has quit IRC | 01:29 | |
*** ociuhandu has joined #openstack-meeting | 01:29 | |
*** jamesmcarthur has quit IRC | 01:32 | |
*** epei has joined #openstack-meeting | 01:37 | |
*** ociuhandu has quit IRC | 01:37 | |
*** larainema has joined #openstack-meeting | 01:38 | |
*** epei has quit IRC | 01:41 | |
*** ociuhandu has joined #openstack-meeting | 01:42 | |
*** ociuhandu has quit IRC | 01:47 | |
*** ociuhandu has joined #openstack-meeting | 01:49 | |
*** epei has joined #openstack-meeting | 01:51 | |
*** epei has quit IRC | 01:56 | |
*** ociuhandu has quit IRC | 01:57 | |
*** epei has joined #openstack-meeting | 02:01 | |
*** epei has quit IRC | 02:06 | |
*** ociuhandu has joined #openstack-meeting | 02:08 | |
*** nicolasbock has quit IRC | 02:10 | |
*** ociuhandu has quit IRC | 02:13 | |
*** ociuhandu has joined #openstack-meeting | 02:14 | |
*** epei has joined #openstack-meeting | 02:16 | |
*** mhen has quit IRC | 02:16 | |
*** slaweq has joined #openstack-meeting | 02:17 | |
*** epei has quit IRC | 02:21 | |
*** brinzhang_ has joined #openstack-meeting | 02:22 | |
*** slaweq has quit IRC | 02:22 | |
*** ociuhandu has quit IRC | 02:22 | |
*** igordc has quit IRC | 02:24 | |
*** brinzhang has quit IRC | 02:25 | |
*** epei has joined #openstack-meeting | 02:31 | |
*** epei has quit IRC | 02:35 | |
*** epei has joined #openstack-meeting | 02:36 | |
*** ociuhandu has joined #openstack-meeting | 02:38 | |
*** epei has quit IRC | 02:41 | |
*** dmellado has quit IRC | 02:45 | |
*** vesper11 has quit IRC | 02:45 | |
*** tridde has joined #openstack-meeting | 02:45 | |
*** trident has quit IRC | 02:46 | |
*** slaweq has joined #openstack-meeting | 02:46 | |
*** vesper11 has joined #openstack-meeting | 02:46 | |
*** epei has joined #openstack-meeting | 02:46 | |
*** ociuhandu has quit IRC | 02:47 | |
*** dmellado has joined #openstack-meeting | 02:48 | |
*** slaweq has quit IRC | 02:50 | |
*** epei has quit IRC | 02:51 | |
*** diablo_rojo has quit IRC | 02:51 | |
*** yamamoto has quit IRC | 02:55 | |
*** brinzhang has joined #openstack-meeting | 02:56 | |
*** brinzhang_ has quit IRC | 02:59 | |
*** brinzhang_ has joined #openstack-meeting | 03:00 | |
*** epei has joined #openstack-meeting | 03:01 | |
*** yamamoto has joined #openstack-meeting | 03:01 | |
*** brinzhang has quit IRC | 03:03 | |
*** epei has quit IRC | 03:05 | |
*** slaweq has joined #openstack-meeting | 03:06 | |
*** epei has joined #openstack-meeting | 03:10 | |
*** slaweq has quit IRC | 03:10 | |
*** brinzhang has joined #openstack-meeting | 03:12 | |
*** brinzhang_ has quit IRC | 03:15 | |
*** epei has quit IRC | 03:15 | |
*** epei has joined #openstack-meeting | 03:16 | |
*** epei has quit IRC | 03:20 | |
*** slaweq has joined #openstack-meeting | 03:25 | |
*** slaweq has quit IRC | 03:30 | |
*** psachin has joined #openstack-meeting | 03:31 | |
*** jamesmcarthur has joined #openstack-meeting | 03:40 | |
*** brinzhang_ has joined #openstack-meeting | 03:42 | |
*** brinzhang has quit IRC | 03:46 | |
*** ociuhandu has joined #openstack-meeting | 03:47 | |
*** tpatil has joined #openstack-meeting | 03:48 | |
*** diablo_rojo has joined #openstack-meeting | 03:48 | |
*** slaweq has joined #openstack-meeting | 03:50 | |
*** hongbin has joined #openstack-meeting | 03:50 | |
*** ociuhandu has quit IRC | 03:51 | |
*** slaweq has quit IRC | 03:54 | |
samP | #startmeeting masakari | 04:00 |
---|---|---|
openstack | Meeting started Tue Dec 10 04:00:51 2019 UTC and is due to finish in 60 minutes. The chair is samP. Information about MeetBot at http://wiki.debian.org/MeetBot. | 04:00 |
openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 04:00 |
*** openstack changes topic to " (Meeting topic: masakari)" | 04:00 | |
openstack | The meeting name has been set to 'masakari' | 04:00 |
samP | Hi all for masakari | 04:01 |
tpatil | Hi | 04:01 |
samP | tpatil: Hi | 04:01 |
samP | #topic Critical bugs or patches | 04:02 |
*** openstack changes topic to "Critical bugs or patches (Meeting topic: masakari)" | 04:02 | |
*** nicolasbock has joined #openstack-meeting | 04:02 | |
samP | Any critical bugs or patches need to discuss here? | 04:02 |
tpatil | #link : https://bugs.launchpad.net/masakari/+bug/1854323 | 04:02 |
openstack | Launchpad bug 1854323 in masakari "inconsistent output for 'openstack segment host show|update'" [High,New] - Assigned to Shilpa Devharakar (shilpasd) | 04:02 |
*** epei has joined #openstack-meeting | 04:02 | |
tpatil | I have marked this bug as High priority and Shilpa is working on fixing this issue | 04:03 |
tpatil | The patch will be pushed sometime in this week | 04:03 |
samP | tpatil: thanks, this is the one posted by Jan | 04:04 |
tpatil | samP: yes, that's correct | 04:04 |
tpatil | #link : https://review.opendev.org/#/c/675734 | 04:05 |
tpatil | I have posted one comment on this patch and awaiting for author to response on my comment | 04:05 |
tpatil | In there, I have suggested to use host instead of hypervisor_hostname to solve the issue. | 04:06 |
samP | tpatil: OK, I will try to ping Lian Young for this. | 04:07 |
*** shilpasd has joined #openstack-meeting | 04:07 | |
*** epei has quit IRC | 04:07 | |
*** rh-jelabarre has quit IRC | 04:08 | |
tpatil | I think but with that change, it might break compatibility. We will need to discuss on that part | 04:09 |
samP | tpatil: agree. I remove the +2 on this. Let's try to contact author for discussion. | 04:12 |
*** slaweq has joined #openstack-meeting | 04:15 | |
tpatil | #link : https://bugs.launchpad.net/python-masakariclient/+bug/1854903 | 04:16 |
openstack | Launchpad bug 1854903 in python-masakariclient "masakariclient not supporting filter parameters for multiple times" [Undecided,New] - Assigned to Shilpa Devharakar (shilpasd) | 04:16 |
tpatil | basically masakari client allows to specify --filter recovery_method=auto recovery_method=rh_priority, but masakari treats it as a single recovery_method | 04:17 |
*** epei has joined #openstack-meeting | 04:17 | |
tpatil | $openstack segment list --filter recovery_method=auto recovery_method=rh_priority | 04:17 |
tpatil | when it calls REST API, it send url query params something like : instance-ha/v1/segments?recovery_method=%5Bu%27auto%27%2C+u%27rh_priority%27%5D | 04:19 |
tpatil | i.e. segments?recovery_method=auto,rh_priority | 04:19 |
*** slaweq has quit IRC | 04:20 | |
tpatil | but masakari API treats it as a single recovery_method ii.e. "auto,rh_priority" | 04:20 |
samP | got it. the problem is, it neglect the second filter | 04:20 |
tpatil | and it will return empty list in such case | 04:20 |
tpatil | so I think we should fix this issue in masakari client by deprecating --filter | 04:21 |
tpatil | and simply using new options like "openstack segment list --recovery_method auto --host xyz" | 04:21 |
*** epei has quit IRC | 04:22 | |
*** epei_ has joined #openstack-meeting | 04:22 | |
tpatil | or we can also fix this issue in masakari-api, but in that case we will need to consider recovery method as auto or rh_priority | 04:23 |
tpatil | I would like to know how do we want to fix this issue | 04:24 |
tpatil | I would prefer option#1, because in masakari this functionality wasn't available but still added in masakariclient | 04:25 |
shilpasd | tpatil: thanks for discussing this bug | 04:25 |
samP | sicne openstack does not have it, I think deprecating is OK | 04:26 |
*** epei_ has quit IRC | 04:26 | |
samP | what gonna happen if, openstack segment list --recovery_method auto --recovery_method rh_priority --host xyz | 04:27 |
tpatil | in current master? | 04:27 |
samP | yes. | 04:27 |
tpatil | empty list | 04:28 |
samP | that is for --filter right? | 04:28 |
*** slaweq has joined #openstack-meeting | 04:28 | |
samP | if we give two --recovery_method parameters for segment list command | 04:29 |
tpatil | today these options doesn't exist | 04:29 |
tpatil | if passed it will give an error: openstack segment list: error: unrecognized arguments: --recovery_method auto | 04:30 |
samP | OK, my misunderstanding. | 04:30 |
tpatil | option #1 is to deprecate --filter option and add new options recovery_method, host etc.. | 04:31 |
samP | Then what we sould do is, deprecating --filter and enable the new filtering options | 04:31 |
samP | am I right? | 04:31 |
tpatil | yes, that's correct | 04:31 |
*** masahito has joined #openstack-meeting | 04:32 | |
*** jamesmcarthur has quit IRC | 04:32 | |
tpatil | option #2, masakari-api can split the recovery_method=auto,rh_prioirty into two and consider it as auto or rh_prioirty | 04:32 |
tpatil | in URL query parameter, if we get recovery_method=auto,rh_prioirty, then it would return segments matching recovery method auto or rh_priority. | 04:34 |
samP | option #2 about changing the masakari-api? | 04:35 |
tpatil | samP: yes | 04:35 |
samP | IMHO, in option #1 and #2, we have find a way to support multiple values for single parameter, | 04:36 |
samP | such as, | 04:36 |
samP | --recovery_method auto --recovery_method rh_priority | 04:36 |
*** slaweq has quit IRC | 04:36 | |
samP | --filter recovery_method=auto recovery_method=rh_priority | 04:36 |
samP | From client side, we can call masakari-api for multiple times and merge the result | 04:37 |
samP | or change the masakari-api as you proposed. | 04:37 |
*** slaweq has joined #openstack-meeting | 04:38 | |
tpatil | samP: passing recovery_method multiple times is already supported by masakariclient but it doesn't get the expected result from masakari-api, so we should fix this issue in masakari-api. | 04:39 |
tpatil | I think that's what you want to suggest here, is it correct? | 04:39 |
*** epei has joined #openstack-meeting | 04:39 | |
samP | tpatil: thanks, that's what I wanted to say. :) | 04:40 |
samP | Fixing the masakari-api is more appropriate in this case | 04:40 |
tpatil | samP: understood, we will fix this issue in masakari-api | 04:40 |
samP | tpatil: thanks | 04:41 |
samP | Any other issues? | 04:41 |
*** ociuhandu has joined #openstack-meeting | 04:41 | |
*** hongbin has quit IRC | 04:41 | |
tpatil | No | 04:42 |
samP | #topic AOB | 04:42 |
*** openstack changes topic to "AOB (Meeting topic: masakari)" | 04:42 | |
samP | We need to list up Ussuri work itmes. | 04:43 |
*** epei has quit IRC | 04:44 | |
*** slaweq has quit IRC | 04:44 | |
tpatil | just one info before we move on U release items | 04:44 |
samP | tpatil: sure | 04:44 |
*** brinzhang_ has quit IRC | 04:44 | |
*** brinzhang_ has joined #openstack-meeting | 04:45 | |
tpatil | about the above bug, if you call openstack --debug segment list --filter recovery_method=auto --filter recovery_method=rh_priority | 04:45 |
tpatil | the url query parameters passed are: /segments?recovery_method=auto&recovery_method=rh_priority | 04:45 |
*** ociuhandu has quit IRC | 04:46 | |
tpatil | so it only considers recovery_method=rh_priority, as we get query parameters in dict form | 04:46 |
*** nicolasbock has quit IRC | 04:46 | |
*** brinzhang_ has quit IRC | 04:46 | |
tpatil | if you want pass recovery method twice, then we would need change in masakari client to pass recovery_method=auto,rh_priority | 04:47 |
*** brinzhang_ has joined #openstack-meeting | 04:47 | |
samP | tpatil: Got it, Thanks for the update | 04:47 |
tpatil | and in masakari-api side, we will need to split it based on the comma separator. | 04:47 |
samP | correct | 04:47 |
tpatil | so in short, we will need to make changes in both client and api | 04:48 |
*** epei has joined #openstack-meeting | 04:49 | |
tpatil | about Ussuri work items we want to implement blueprint | 04:49 |
tpatil | #link : https://blueprints.launchpad.net/masakari/+spec/evacuate-non-recovery-instances-in-shutoff-status-at-host-failure-except-specified-tenants | 04:49 |
tpatil | We will propose specs for this blueprint soon | 04:50 |
samP | I have just create a etherpad for list up the items. | 04:50 |
samP | https://etherpad.openstack.org/p/masakari-u-workitems | 04:50 |
*** slaweq has joined #openstack-meeting | 04:51 | |
samP | There are some PBs already proposed for U. Let's list them up and discuss on our next IRC meeting | 04:51 |
*** brinzhang has joined #openstack-meeting | 04:52 | |
tpatil | Sure, I have added above blueprint in the etherpad | 04:53 |
samP | tpatil: Thanks | 04:53 |
*** brinzhang has quit IRC | 04:53 | |
samP | Statscowski: posted a question on #openstack-masakari | 04:54 |
*** brinzhang has joined #openstack-meeting | 04:54 | |
*** epei has quit IRC | 04:54 | |
samP | Hello. newb question. We deployed openstack with msakari through kolla. Is the horizon webui enough to configure masakari? if so, │ | 04:54 |
samP | │ | we are having toruble triggering a successful failover | 04:54 |
*** brinzhang_ has quit IRC | 04:55 | |
tpatil | Does kolla supports installation and deployment of masker-hostmonitor? | 04:56 |
samP | Any known issues with horizon webui for configure masakari? | 04:56 |
*** slaweq has quit IRC | 04:56 | |
tpatil | horizon webui means masakari-dashboard? | 04:56 |
samP | tpatil: I think it does not support install and config hostmonitor | 04:56 |
samP | tpatil: yes | 04:56 |
tpatil | masakari-dashboard will only allows you to configure failoversegment and add hosts to it, also you can see the notification details | 04:57 |
tpatil | if hostmonitor support isn't available in kolla, then compute failureover won't work | 04:57 |
tpatil | compute node failure won't work | 04:57 |
samP | I think the answer is, only masakari-dashboard is not enough | 04:58 |
tpatil | samP: Yes | 04:59 |
samP | you have to configure masakari and setup masakari-hostmonitor (if not supported in kolla) | 04:59 |
samP | no time left to give a detail answer. Statscowski: please ask on ML | 04:59 |
samP | we dont have much time left | 04:59 |
samP | let's finish the meeting here | 05:00 |
samP | Thank you all for your time. | 05:00 |
samP | #endmeeting | 05:00 |
*** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/" | 05:00 | |
openstack | Meeting ended Tue Dec 10 05:00:11 2019 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 05:00 |
openstack | Minutes: http://eavesdrop.openstack.org/meetings/masakari/2019/masakari.2019-12-10-04.00.html | 05:00 |
openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/masakari/2019/masakari.2019-12-10-04.00.txt | 05:00 |
openstack | Log: http://eavesdrop.openstack.org/meetings/masakari/2019/masakari.2019-12-10-04.00.log.html | 05:00 |
*** diablo_rojo has quit IRC | 05:00 | |
*** slaweq has joined #openstack-meeting | 05:04 | |
*** slaweq has quit IRC | 05:09 | |
*** brinzhang_ has joined #openstack-meeting | 05:12 | |
*** brinzhang_ has quit IRC | 05:12 | |
*** brinzhang_ has joined #openstack-meeting | 05:13 | |
*** brinzhang has quit IRC | 05:15 | |
*** epei has joined #openstack-meeting | 05:18 | |
*** epei has quit IRC | 05:23 | |
*** epei has joined #openstack-meeting | 05:28 | |
*** slaweq has joined #openstack-meeting | 05:31 | |
*** epei has quit IRC | 05:33 | |
*** epei has joined #openstack-meeting | 05:33 | |
*** ociuhandu has joined #openstack-meeting | 05:35 | |
*** epei has quit IRC | 05:38 | |
*** ociuhandu has quit IRC | 05:40 | |
*** slaweq has quit IRC | 05:40 | |
*** epei has joined #openstack-meeting | 05:43 | |
*** slaweq has joined #openstack-meeting | 05:46 | |
*** epei has quit IRC | 05:48 | |
*** epei has joined #openstack-meeting | 05:48 | |
*** slaweq has quit IRC | 05:50 | |
*** links has joined #openstack-meeting | 05:53 | |
*** epei has quit IRC | 05:53 | |
*** shilpasd has quit IRC | 05:55 | |
*** epei has joined #openstack-meeting | 05:58 | |
*** slaweq has joined #openstack-meeting | 06:00 | |
*** jamesmcarthur has joined #openstack-meeting | 06:01 | |
*** epei has quit IRC | 06:02 | |
*** epei has joined #openstack-meeting | 06:03 | |
*** Luzi has joined #openstack-meeting | 06:04 | |
*** slaweq has quit IRC | 06:05 | |
*** jamesmcarthur has quit IRC | 06:06 | |
*** epei has quit IRC | 06:08 | |
*** e0ne has joined #openstack-meeting | 06:09 | |
*** rubasov has quit IRC | 06:13 | |
*** yamamoto has quit IRC | 06:14 | |
*** slaweq has joined #openstack-meeting | 06:18 | |
*** epei has joined #openstack-meeting | 06:18 | |
*** e0ne has quit IRC | 06:19 | |
*** yamamoto has joined #openstack-meeting | 06:21 | |
*** slaweq has quit IRC | 06:23 | |
*** epei has quit IRC | 06:23 | |
*** masahito has quit IRC | 06:29 | |
*** ociuhandu has joined #openstack-meeting | 06:29 | |
*** epei has joined #openstack-meeting | 06:34 | |
*** slaweq has joined #openstack-meeting | 06:34 | |
*** ociuhandu has quit IRC | 06:34 | |
*** epei has quit IRC | 06:38 | |
*** epei has joined #openstack-meeting | 06:39 | |
*** slaweq has quit IRC | 06:39 | |
*** psachin has quit IRC | 06:42 | |
*** epei has quit IRC | 06:44 | |
*** psachin has joined #openstack-meeting | 06:49 | |
*** epei has joined #openstack-meeting | 06:49 | |
*** brinzhang has joined #openstack-meeting | 06:50 | |
*** brinzhang_ has quit IRC | 06:54 | |
*** epei has quit IRC | 06:54 | |
*** epei has joined #openstack-meeting | 06:55 | |
*** hyunsikyang__ has joined #openstack-meeting | 06:55 | |
*** ayoung has quit IRC | 06:59 | |
*** hyunsikyang has quit IRC | 06:59 | |
*** ayoung has joined #openstack-meeting | 06:59 | |
*** epei has quit IRC | 06:59 | |
*** lpetrut has joined #openstack-meeting | 07:00 | |
*** diablo_rojo has joined #openstack-meeting | 07:01 | |
*** ociuhandu has joined #openstack-meeting | 07:02 | |
*** epei has joined #openstack-meeting | 07:05 | |
*** masahito has joined #openstack-meeting | 07:06 | |
*** ociuhandu has quit IRC | 07:06 | |
*** masahito has quit IRC | 07:07 | |
*** epei has quit IRC | 07:10 | |
*** epei has joined #openstack-meeting | 07:10 | |
*** epei has quit IRC | 07:15 | |
*** epei has joined #openstack-meeting | 07:20 | |
*** epei has quit IRC | 07:24 | |
*** brinzhang_ has joined #openstack-meeting | 07:24 | |
*** epei has joined #openstack-meeting | 07:25 | |
*** brinzhang_ has quit IRC | 07:26 | |
*** ociuhandu has joined #openstack-meeting | 07:26 | |
*** brinzhang_ has joined #openstack-meeting | 07:26 | |
*** brinzhang has quit IRC | 07:27 | |
*** brinzhang_ has quit IRC | 07:28 | |
*** brinzhang_ has joined #openstack-meeting | 07:28 | |
*** epei has quit IRC | 07:30 | |
*** brinzhang_ has quit IRC | 07:30 | |
*** brinzhang_ has joined #openstack-meeting | 07:30 | |
*** brinzhang_ has quit IRC | 07:31 | |
*** tpatil has quit IRC | 07:31 | |
*** ociuhandu has quit IRC | 07:32 | |
*** keiko-k has joined #openstack-meeting | 07:34 | |
*** pcaruana has joined #openstack-meeting | 07:39 | |
*** epei has joined #openstack-meeting | 07:40 | |
*** epei has quit IRC | 07:45 | |
*** ociuhandu has joined #openstack-meeting | 07:46 | |
*** epei has joined #openstack-meeting | 07:50 | |
*** yamamoto has quit IRC | 07:52 | |
*** rcernin has quit IRC | 07:54 | |
*** takahashi-tsc has joined #openstack-meeting | 07:55 | |
*** epei has quit IRC | 07:55 | |
*** epei has joined #openstack-meeting | 07:56 | |
*** nitinuikey has joined #openstack-meeting | 07:57 | |
*** tpatil has joined #openstack-meeting | 08:00 | |
*** epei has quit IRC | 08:00 | |
*** epei has joined #openstack-meeting | 08:01 | |
*** slaweq has joined #openstack-meeting | 08:01 | |
*** epei has quit IRC | 08:05 | |
*** epei has joined #openstack-meeting | 08:06 | |
*** epei has quit IRC | 08:11 | |
*** keiko-k has quit IRC | 08:15 | |
*** apetrich has joined #openstack-meeting | 08:16 | |
*** epei has joined #openstack-meeting | 08:17 | |
*** epei has quit IRC | 08:21 | |
*** epei has joined #openstack-meeting | 08:22 | |
*** rubasov has joined #openstack-meeting | 08:22 | |
*** epei has quit IRC | 08:26 | |
*** tesseract has joined #openstack-meeting | 08:27 | |
*** masahito_ has joined #openstack-meeting | 08:30 | |
*** takahashi-tsc has quit IRC | 08:32 | |
*** epei has joined #openstack-meeting | 08:32 | |
*** epei has quit IRC | 08:37 | |
*** rpittau|afk is now known as rpittau | 08:41 | |
*** epei has joined #openstack-meeting | 08:42 | |
*** epei has quit IRC | 08:46 | |
*** epei has joined #openstack-meeting | 08:48 | |
*** ociuhandu has quit IRC | 08:48 | |
*** ralonsoh has joined #openstack-meeting | 08:48 | |
*** epei has quit IRC | 08:52 | |
*** epei has joined #openstack-meeting | 08:57 | |
*** tpatil has quit IRC | 08:59 | |
*** priteau has joined #openstack-meeting | 09:00 | |
*** epei has quit IRC | 09:02 | |
*** yamamoto has joined #openstack-meeting | 09:06 | |
*** epei has joined #openstack-meeting | 09:08 | |
*** nitinuikey has quit IRC | 09:08 | |
*** yamamoto has quit IRC | 09:10 | |
*** Luzi has quit IRC | 09:11 | |
*** epei has quit IRC | 09:12 | |
*** epei has joined #openstack-meeting | 09:13 | |
*** ociuhandu has joined #openstack-meeting | 09:17 | |
*** epei has quit IRC | 09:17 | |
*** ociuhandu has quit IRC | 09:22 | |
*** Luzi has joined #openstack-meeting | 09:26 | |
*** epei has joined #openstack-meeting | 09:28 | |
*** tssurya has joined #openstack-meeting | 09:30 | |
*** epei has quit IRC | 09:32 | |
*** epei has joined #openstack-meeting | 09:33 | |
*** epei has quit IRC | 09:38 | |
*** ociuhandu has joined #openstack-meeting | 09:42 | |
*** epei has joined #openstack-meeting | 09:44 | |
*** epei has quit IRC | 09:48 | |
*** epei has joined #openstack-meeting | 09:49 | |
*** epei has quit IRC | 09:53 | |
*** epei has joined #openstack-meeting | 09:54 | |
*** e0ne has joined #openstack-meeting | 09:54 | |
*** epei has quit IRC | 09:59 | |
*** epei has joined #openstack-meeting | 10:04 | |
*** priteau has quit IRC | 10:05 | |
*** masahito_ has quit IRC | 10:06 | |
*** epei has quit IRC | 10:09 | |
*** slaweq has quit IRC | 10:17 | |
*** epei has joined #openstack-meeting | 10:19 | |
*** slaweq has joined #openstack-meeting | 10:19 | |
*** epei has quit IRC | 10:23 | |
*** epei has joined #openstack-meeting | 10:24 | |
*** Liang__ has quit IRC | 10:26 | |
*** epei has quit IRC | 10:29 | |
*** epei has joined #openstack-meeting | 10:33 | |
*** epei has quit IRC | 10:38 | |
*** epei has joined #openstack-meeting | 10:38 | |
*** epei has quit IRC | 10:42 | |
*** epei has joined #openstack-meeting | 10:43 | |
*** epei has quit IRC | 10:48 | |
*** epei has joined #openstack-meeting | 10:48 | |
*** epei has quit IRC | 10:53 | |
*** epei has joined #openstack-meeting | 11:03 | |
*** epei has quit IRC | 11:07 | |
*** kambiz has quit IRC | 11:09 | |
*** ociuhandu has quit IRC | 11:13 | |
*** ociuhandu has joined #openstack-meeting | 11:13 | |
*** epei has joined #openstack-meeting | 11:14 | |
*** kambiz has joined #openstack-meeting | 11:14 | |
*** epei has quit IRC | 11:18 | |
*** ociuhandu has quit IRC | 11:28 | |
*** epei has joined #openstack-meeting | 11:29 | |
*** epei has quit IRC | 11:33 | |
*** epei has joined #openstack-meeting | 11:34 | |
*** epei has quit IRC | 11:38 | |
*** rf0lc0 has quit IRC | 11:40 | |
*** raildo has joined #openstack-meeting | 11:42 | |
*** ijw has joined #openstack-meeting | 11:43 | |
*** ijw has quit IRC | 11:47 | |
*** nicolasbock has joined #openstack-meeting | 12:00 | |
*** ociuhandu has joined #openstack-meeting | 12:23 | |
*** ociuhandu has quit IRC | 12:27 | |
*** brault has joined #openstack-meeting | 12:32 | |
*** masahito has joined #openstack-meeting | 12:36 | |
*** ayoung has quit IRC | 12:41 | |
*** ayoung has joined #openstack-meeting | 12:42 | |
*** larainema has quit IRC | 12:44 | |
*** masahito has quit IRC | 12:49 | |
*** masahito has joined #openstack-meeting | 12:49 | |
*** masahito has quit IRC | 12:58 | |
*** enriquetaso has joined #openstack-meeting | 13:04 | |
*** jamesmcarthur has joined #openstack-meeting | 13:15 | |
*** jamesmcarthur has quit IRC | 13:28 | |
*** jgriffith has joined #openstack-meeting | 13:29 | |
*** jamesmcarthur has joined #openstack-meeting | 13:30 | |
*** jamesmcarthur has quit IRC | 13:34 | |
*** yaawang has quit IRC | 13:39 | |
*** yaawang has joined #openstack-meeting | 13:39 | |
*** tssurya has quit IRC | 13:43 | |
*** tssurya has joined #openstack-meeting | 13:45 | |
*** jamesmcarthur has joined #openstack-meeting | 13:46 | |
*** masahito has joined #openstack-meeting | 13:59 | |
*** dtrainor has joined #openstack-meeting | 14:00 | |
*** Liang__ has joined #openstack-meeting | 14:00 | |
*** masahito has quit IRC | 14:01 | |
*** mriedem has joined #openstack-meeting | 14:01 | |
*** liuyulong has joined #openstack-meeting | 14:02 | |
*** moguimar is now known as guimaraes | 14:06 | |
*** guimaraes is now known as moguimar | 14:07 | |
*** eharney has quit IRC | 14:07 | |
*** moguimar is now known as guimaraes | 14:07 | |
*** zaneb has quit IRC | 14:09 | |
*** epei has joined #openstack-meeting | 14:15 | |
*** epei has quit IRC | 14:20 | |
*** Luzi has quit IRC | 14:29 | |
*** liuyulong has quit IRC | 14:32 | |
*** ociuhandu has joined #openstack-meeting | 14:35 | |
*** mmethot has joined #openstack-meeting | 14:35 | |
*** mmethot is now known as mmethot|conferen | 14:35 | |
*** pcaruana has quit IRC | 14:36 | |
*** hyunsikyang__ has quit IRC | 14:38 | |
*** hyunsikyang__ has joined #openstack-meeting | 14:39 | |
*** eharney has joined #openstack-meeting | 14:47 | |
*** links has quit IRC | 14:48 | |
*** zaneb has joined #openstack-meeting | 14:52 | |
*** tssurya has quit IRC | 14:58 | |
*** igordc has joined #openstack-meeting | 14:58 | |
*** lbragsta_ has joined #openstack-meeting | 14:59 | |
*** pcaruana has joined #openstack-meeting | 15:01 | |
*** zaneb has quit IRC | 15:02 | |
*** jamesmcarthur has quit IRC | 15:03 | |
*** senrique_ has joined #openstack-meeting | 15:08 | |
*** enriquetaso has quit IRC | 15:10 | |
*** ijw has joined #openstack-meeting | 15:10 | |
*** jamesmcarthur has joined #openstack-meeting | 15:15 | |
*** jamesmcarthur has quit IRC | 15:15 | |
*** bnemec has quit IRC | 15:15 | |
*** jamesmcarthur_ has joined #openstack-meeting | 15:15 | |
*** munimeha1 has joined #openstack-meeting | 15:17 | |
*** tssurya has joined #openstack-meeting | 15:33 | |
*** lbragsta_ has quit IRC | 15:36 | |
*** lbragsta_ has joined #openstack-meeting | 15:37 | |
*** ijw has quit IRC | 15:40 | |
*** tssurya has quit IRC | 15:54 | |
*** lbragsta_ has quit IRC | 15:55 | |
slaweq | #startmeeting neutron_ci | 16:00 |
openstack | Meeting started Tue Dec 10 16:00:05 2019 UTC and is due to finish in 60 minutes. The chair is slaweq. Information about MeetBot at http://wiki.debian.org/MeetBot. | 16:00 |
openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 16:00 |
slaweq | hi | 16:00 |
*** openstack changes topic to " (Meeting topic: neutron_ci)" | 16:00 | |
openstack | The meeting name has been set to 'neutron_ci' | 16:00 |
bcafarel | o/ | 16:00 |
slaweq | lets wait few more minutes for ralonsoh and others | 16:01 |
ralonsoh | hi | 16:01 |
*** ociuhandu has quit IRC | 16:02 | |
slaweq | ok, lets start | 16:02 |
slaweq | Grafana dashboard: http://grafana.openstack.org/dashboard/db/neutron-failure-rate | 16:02 |
slaweq | please open it now so that it will be ready when needed :) | 16:03 |
slaweq | #topic Actions from previous meetings | 16:03 |
*** openstack changes topic to "Actions from previous meetings (Meeting topic: neutron_ci)" | 16:03 | |
slaweq | first one: | 16:03 |
slaweq | njohnston to check failing NetworkMigrationFromHA in multinode dvr job | 16:03 |
slaweq | I'm not sure if njohnston is around now | 16:04 |
slaweq | #action njohnston to check failing NetworkMigrationFromHA in multinode dvr job | 16:04 |
slaweq | lets keep it for next week than | 16:04 |
njohnston | o/ | 16:05 |
slaweq | hi njohnston :) | 16:05 |
njohnston | yeah, keep it for next week, I am debuigging it right now | 16:05 |
slaweq | ok | 16:05 |
slaweq | thx | 16:05 |
slaweq | and good luck with debugging | 16:05 |
slaweq | :) | 16:05 |
slaweq | ok, next one: | 16:05 |
njohnston | :) | 16:05 |
slaweq | ralonsoh to check functional tests timeouts https://bugs.launchpad.net/neutron/+bug/1854462 | 16:05 |
openstack | Launchpad bug 1854462 in neutron "[Functional tests] Timeout exception in list_namespace_pids" [High,In progress] - Assigned to Rodolfo Alonso (rodolfo-alonso-hernandez) | 16:05 |
ralonsoh | I wrote a small script for this | 16:05 |
ralonsoh | http://paste.openstack.org/show/787322/ | 16:06 |
ralonsoh | and I added log messages in pyroute2 | 16:06 |
*** zaneb has joined #openstack-meeting | 16:06 | |
ralonsoh | I detected that most of the time, the blocking method was https://github.com/svinota/pyroute2/blob/master/pyroute2/netns/__init__.py#L209 | 16:07 |
ralonsoh | so instead of calling it every time we call create/delete namespace | 16:07 |
ralonsoh | I create the object once (in the root context, see patch https://review.opendev.org/#/c/698039/) | 16:07 |
ralonsoh | that's all | 16:07 |
*** ijw has joined #openstack-meeting | 16:09 | |
slaweq | smart :) | 16:09 |
ralonsoh | BTW, _CDLL = ctypes.CDLL(ctypes_util.find_library('c'), use_errno=True) | 16:09 |
ralonsoh | this MUST not change during the execution | 16:09 |
njohnston | maybe put a comment in to that effect? | 16:09 |
ralonsoh | njohnston, I mean: the library can't be modified | 16:10 |
ralonsoh | this is not going to happen | 16:10 |
njohnston | ok | 16:10 |
*** igordc has quit IRC | 16:11 | |
slaweq | ok | 16:11 |
slaweq | thx ralonsoh for working on this | 16:11 |
slaweq | I hope we will get rid of those timeouts with this patch | 16:11 |
slaweq | next one | 16:11 |
slaweq | slaweq to check reason of grenade jobs failures | 16:11 |
bcafarel | looks nice indeed | 16:12 |
slaweq | I checked it | 16:12 |
slaweq | and it seems that all those failures are related to https://bugs.launchpad.net/nova/+bug/1844929 | 16:12 |
openstack | Launchpad bug 1844929 in OpenStack Compute (nova) "grenade jobs failing due to "Timed out waiting for response from cell" in scheduler" [High,Confirmed] | 16:12 |
slaweq | and as I talked with efried and mriedem yesterday, it is probably caused by oversubscribed CI nodes | 16:13 |
slaweq | so we don't have any good solution for that problem now | 16:13 |
slaweq | only 2 possible options imo are: | 16:13 |
slaweq | 1. live with it like it's now | 16:14 |
slaweq | 2. make grenade jobs non-voting and non-gating temporary until this issue will be solved | 16:14 |
slaweq | problem with 2 is that we don't know when it may be possible fixed | 16:14 |
ralonsoh | pfff all grenade jobs? | 16:15 |
ralonsoh | mark them as non-voting? | 16:15 |
slaweq | ralonsoh: we have now only 2 multinode grenade jobs | 16:15 |
njohnston | I wonder if it would be worthwhile to email openstack-discuss and ask if anything can be done about the oversubscription | 16:15 |
slaweq | we removed single node jobs | 16:15 |
*** zaneb has quit IRC | 16:15 | |
ralonsoh | yes, but several tests | 16:16 |
ralonsoh | I mean tests | 16:16 |
slaweq | njohnston: there are such threads started by mriedem here http://lists.openstack.org/pipermail/openstack-discuss/2019-October/thread.html#10484 and continued here http://lists.openstack.org/pipermail/openstack-discuss/2019-November/thread.html#10502 | 16:16 |
clarkb | we areour own noisy neighbors in many cases. One way to address oversubsceiption is to make our software run more efficiently | 16:17 |
clarkb | devstack jobs swap and Ive asked sevral times that openstack address this | 16:17 |
clarkb | I think fixing swapping will likely have a major impact on performance relatedproblems | 16:17 |
slaweq | clarkb: so we should focus on optimizing Neutron's memory usage to make this working better, correct? | 16:19 |
*** ricolin has quit IRC | 16:19 | |
ralonsoh | slaweq, agree with this but we usually optimize the speed, not the memory consumption | 16:21 |
slaweq | yep | 16:21 |
ralonsoh | most of out efforts are in optimizing the DB access, the parallelism, etc | 16:21 |
clarkb | slaweq: and tge rest of openstack/devstack | 16:22 |
clarkb | etcd seems like it isnt used but always run | 16:22 |
clarkb | cinder backup too | 16:22 |
clarkb | byt it all adds up then you start swapping which impacts the current job and all other jobs trying to access those disk resources | 16:22 |
slaweq | clarkb: ok, I will check those jobs and maybe will be able to disable some of those not used services there | 16:23 |
slaweq | thx for this tips | 16:23 |
slaweq | #action slaweq to check and try to optimize neutron-grenade-multinode jobs memory consumption | 16:24 |
slaweq | ok, I think we can move on | 16:24 |
slaweq | next topic | 16:24 |
slaweq | #topic Stadium projects | 16:24 |
*** openstack changes topic to "Stadium projects (Meeting topic: neutron_ci)" | 16:24 | |
slaweq | tempest-plugins migration | 16:24 |
slaweq | Etherpad: https://etherpad.openstack.org/p/neutron_stadium_move_to_tempest_plugin_repo | 16:24 |
slaweq | last 2 patches for neutron-vpnaas are ready for review now | 16:25 |
slaweq | Step 1: https://review.openstack.org/#/c/649373 | 16:25 |
slaweq | Step 2: https://review.opendev.org/#/c/695834 | 16:25 |
slaweq | I just +2'ed Step 1 patch | 16:25 |
slaweq | and in step 2 we will probably need to switch centos based job to be non-voting | 16:25 |
slaweq | as code isn't compatible with py27 anymore | 16:26 |
bcafarel | yes we need centos7+py3, or centos8 (when possible) | 16:26 |
njohnston | agreed | 16:26 |
ralonsoh | (I can't run devstack with centos8) | 16:27 |
ralonsoh | some libraries are missing | 16:27 |
slaweq | maybe we should switch this job to be fedora based? | 16:28 |
slaweq | but that can be IMO done as follow up patch | 16:28 |
ralonsoh | F29 is working, not F30 | 16:28 |
ralonsoh | sure, in another patch | 16:28 |
bcafarel | yes, let's wrap up tempest plugin migration first | 16:29 |
*** lpetrut has quit IRC | 16:29 | |
slaweq | yeah :) | 16:30 |
slaweq | so I hope mlavalle will push one more PS soon and we will be done with this finally | 16:30 |
*** zaneb has joined #openstack-meeting | 16:30 | |
slaweq | I hope next week we will move it out from meeting agenda | 16:30 |
bcafarel | :) | 16:31 |
slaweq | next stadium related topic is | 16:31 |
slaweq | Neutron Train - Drop py27 and standardize on zuul v3 | 16:31 |
slaweq | Etherpad: https://etherpad.openstack.org/p/neutron-train-zuulv3-py27drop | 16:31 |
slaweq | njohnston: any updates on this since yesterday? :) | 16:31 |
njohnston | Nope, I thought I saw bcafarel doing something related though | 16:32 |
bcafarel | yes I sent a few phase 1 patches for review (links in etherpad) | 16:32 |
bcafarel | also I got feedback on openstack-python-jobs-neutron jobs | 16:32 |
bcafarel | these are in fact now legacy set and should not be touched, we should move to openstack-python3-ussuri-jobs-neutron | 16:33 |
*** Liang__ has quit IRC | 16:33 | |
bcafarel | I updated status for some projects too (reviews merged so done for them) | 16:34 |
njohnston | thanks very much bcafarel! | 16:34 |
slaweq | bcafarel++ thx a lot | 16:35 |
* njohnston sees slaweq switching between channels, always in demand! | 16:35 | |
bcafarel | everybody always looking for the PTL | 16:36 |
slaweq | njohnston: yes, I'm trying | 16:36 |
slaweq | but it's hard :) | 16:36 |
slaweq | ok, I think that it is all related to stadium projects for today | 16:37 |
slaweq | or maybe You have anything else what You want to discuss today? | 16:37 |
slaweq | if not, lets move on to the next topic | 16:37 |
*** gyee has joined #openstack-meeting | 16:37 | |
slaweq | ok, lets move on than | 16:38 |
slaweq | #topic Grafana | 16:38 |
*** openstack changes topic to "Grafana (Meeting topic: neutron_ci)" | 16:38 | |
slaweq | #link http://grafana.openstack.org/dashboard/db/neutron-failure-rate | 16:38 |
slaweq | first thing which I want to mention is | 16:39 |
slaweq | that I sent today cleaning patch for grafana dashboard: https://review.opendev.org/698264 | 16:39 |
*** lpetrut has joined #openstack-meeting | 16:39 | |
slaweq | other than that, I don't see any issues on grafana | 16:40 |
slaweq | jobs looks pretty well this week | 16:40 |
njohnston | I see the ironic cogating problem as well as tripleo-standalone, and midonet cogating looks like it is getting better | 16:40 |
slaweq | njohnston: yes, those I noticed too | 16:42 |
slaweq | and I forgot about them now :) | 16:42 |
slaweq | sorry | 16:42 |
njohnston | do we know what is up with tripleo-standalone? | 16:42 |
slaweq | nope | 16:42 |
slaweq | is there any volunteer to check both of those jobs? | 16:43 |
ralonsoh | can we ping yamamoto for midonet? | 16:44 |
ralonsoh | sorry for being lazy | 16:44 |
njohnston | well midonet is fixed now | 16:44 |
ralonsoh | oh yes, sorry | 16:44 |
njohnston | it's the other two that are having issues | 16:44 |
slaweq | ralonsoh: midonet is fixed by skipping one failing test | 16:44 |
ralonsoh | slaweq, give me one to me | 16:45 |
ralonsoh | I'll take a look this week | 16:45 |
slaweq | ralonsoh: ok, pick whichever You want | 16:46 |
ralonsoh | ironic | 16:46 |
slaweq | ralonsoh: ok :) | 16:47 |
slaweq | so I will check tripleo | 16:47 |
slaweq | ralonsoh: please check on neutron-channel, I just spoke with TheJulia about one issue in dhcp agent on ironic job | 16:47 |
ralonsoh | sure | 16:47 |
slaweq | maybe it's the same issue (idk) | 16:47 |
slaweq | thx | 16:48 |
*** mmethot|conferen is now known as mmethot | 16:48 | |
slaweq | #action ralonsoh to check ironic-tempest-ipa-wholedisk-bios-agent_ipmitool-tinyipa job | 16:48 |
slaweq | #action slaweq to check tripleo job | 16:48 |
slaweq | ok, lets move on than | 16:49 |
slaweq | I don't have any new issues with scenario/functiona/fullstack jobs for today | 16:49 |
slaweq | which is very good | 16:49 |
slaweq | \o/ | 16:49 |
slaweq | but I have one issue with periodic jobs | 16:49 |
slaweq | #topic Periodic | 16:49 |
*** openstack changes topic to "Periodic (Meeting topic: neutron_ci)" | 16:49 | |
slaweq | recently we added periodic job which runs on mariadb instead of mysql | 16:50 |
slaweq | and it is failing now: | 16:50 |
slaweq | https://b12f79f00ace923cb903-227be9d6f8442281010ef49b8394f34d.ssl.cf5.rackcdn.com/periodic/opendev.org/openstack/neutron/master/neutron-tempest-mariadb-full/18fecee/job-output.txt | 16:50 |
*** lpetrut has quit IRC | 16:50 | |
ralonsoh | +1 | 16:50 |
slaweq | it seems that our new ovn related code is broken on mariadb | 16:50 |
ralonsoh | uhmmmm ok | 16:50 |
ralonsoh | I'll take a look | 16:50 |
slaweq | ralonsoh: thx | 16:50 |
ralonsoh | (I did the DB migration) | 16:50 |
slaweq | ralonsoh: maybe it's again issue with mariadb 10.1 | 16:51 |
slaweq | and on 10.4 will work fine | 16:51 |
ralonsoh | do you have a link? | 16:51 |
slaweq | as we had already with one other db migration script some time ago | 16:51 |
slaweq | ralonsoh: link to what? | 16:52 |
ralonsoh | the problem in maribadb 10.1 | 16:52 |
slaweq | give me a sec | 16:52 |
ralonsoh | np, we can talk tomorrow | 16:52 |
slaweq | https://bugs.launchpad.net/kolla-ansible/+bug/1841907 | 16:52 |
openstack | Launchpad bug 1841907 in neutron "Neutron bootstrap failing on Ubuntu bionic with Cannot change column 'network_id" [Critical,Confirmed] | 16:52 |
ralonsoh | upsss also mine!! | 16:53 |
slaweq | lol | 16:53 |
ralonsoh | I did this change too | 16:53 |
slaweq | You are doing many patches so some of them may break things ;) | 16:53 |
ralonsoh | the point is in mysql and postgree that was working | 16:53 |
slaweq | yes | 16:53 |
*** ijw_ has joined #openstack-meeting | 16:53 | |
*** senrique__ has joined #openstack-meeting | 16:54 | |
slaweq | that's why I proposed mariadb periodic job | 16:54 |
slaweq | as there are differences between mysql and mariadb now | 16:54 |
slaweq | ok, so ralonsoh You will check that, right? | 16:55 |
ralonsoh | yes | 16:55 |
slaweq | thx | 16:55 |
slaweq | #action ralonsoh to check periodic mariadb job failures | 16:55 |
slaweq | ok | 16:56 |
slaweq | so that's all what I had for today | 16:56 |
slaweq | in overall I think that we are now in really good shape with our CI, many patches were merged recently without dozens of rechecks | 16:56 |
slaweq | so thx for working on CI improvements guys :) | 16:57 |
njohnston | \o/ | 16:57 |
*** senrique_ has quit IRC | 16:57 | |
bcafarel | nice! | 16:57 |
ralonsoh | fantastic | 16:57 |
slaweq | have a great evening and see You online | 16:57 |
slaweq | o/ | 16:57 |
slaweq | #endmeeting | 16:57 |
bcafarel | o/ | 16:57 |
njohnston | o/ | 16:57 |
*** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/" | 16:57 | |
ralonsoh | bye | 16:57 |
openstack | Meeting ended Tue Dec 10 16:57:35 2019 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 16:57 |
openstack | Minutes: http://eavesdrop.openstack.org/meetings/neutron_ci/2019/neutron_ci.2019-12-10-16.00.html | 16:57 |
openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/neutron_ci/2019/neutron_ci.2019-12-10-16.00.txt | 16:57 |
openstack | Log: http://eavesdrop.openstack.org/meetings/neutron_ci/2019/neutron_ci.2019-12-10-16.00.log.html | 16:57 |
*** ijw has quit IRC | 16:58 | |
*** tesseract has quit IRC | 16:58 | |
*** rsimai_away is now known as rsimai | 17:17 | |
*** rsimai is now known as rsimai_away | 17:17 | |
*** ociuhandu has joined #openstack-meeting | 17:25 | |
*** ociuhandu has quit IRC | 17:29 | |
*** rpittau is now known as rpittau|afk | 17:29 | |
*** epei has joined #openstack-meeting | 17:30 | |
*** senrique__ is now known as enriquetaso | 17:50 | |
*** armax has quit IRC | 17:51 | |
*** e0ne has quit IRC | 17:55 | |
*** links has joined #openstack-meeting | 17:58 | |
*** ijw_ has quit IRC | 18:07 | |
*** ijw has joined #openstack-meeting | 18:09 | |
*** rf0lc0 has joined #openstack-meeting | 18:22 | |
*** jamesmcarthur_ has quit IRC | 18:26 | |
*** jamesmcarthur has joined #openstack-meeting | 18:26 | |
*** ijw has quit IRC | 18:26 | |
*** ijw has joined #openstack-meeting | 18:27 | |
*** ijw has quit IRC | 18:27 | |
*** ijw has joined #openstack-meeting | 18:28 | |
*** Shrews has joined #openstack-meeting | 18:30 | |
*** jamesmcarthur has quit IRC | 18:36 | |
*** links has quit IRC | 18:36 | |
*** ociuhandu has joined #openstack-meeting | 18:39 | |
*** kopecmartin is now known as kopecmartin|off | 18:41 | |
*** ociuhandu has quit IRC | 18:44 | |
*** ijw_ has joined #openstack-meeting | 18:45 | |
*** mmethot has quit IRC | 18:46 | |
*** mmethot has joined #openstack-meeting | 18:46 | |
*** ijw has quit IRC | 18:48 | |
clarkb | we will begin the infra meeting shortly | 18:58 |
corvus | o/ | 18:59 |
ianw | o/ | 18:59 |
* frickler is half here | 18:59 | |
zbr | o/ | 19:00 |
clarkb | #startmeeting infra | 19:01 |
openstack | Meeting started Tue Dec 10 19:01:16 2019 UTC and is due to finish in 60 minutes. The chair is clarkb. Information about MeetBot at http://wiki.debian.org/MeetBot. | 19:01 |
openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 19:01 |
*** openstack changes topic to " (Meeting topic: infra)" | 19:01 | |
openstack | The meeting name has been set to 'infra' | 19:01 |
clarkb | #link http://lists.openstack.org/pipermail/openstack-infra/2019-December/006546.html Our Agenda | 19:01 |
clarkb | #topic Announcements | 19:01 |
*** openstack changes topic to "Announcements (Meeting topic: infra)" | 19:01 | |
clarkb | There will be no meeting December 24 or December 31. That means next week will be our last official meeting of the calendar year | 19:01 |
*** psachin has quit IRC | 19:02 | |
clarkb | #topic Actions from last meeting | 19:02 |
*** openstack changes topic to "Actions from last meeting (Meeting topic: infra)" | 19:02 | |
clarkb | #link http://eavesdrop.openstack.org/meetings/infra/2019/infra.2019-12-03-19.01.txt minutes from last meeting | 19:02 |
clarkb | ianw: have we created AFS volumes for static.o.o replacement? | 19:02 |
ianw | yes, mostly ... the docs sites all done | 19:02 |
ianw | mnaser is working on jobs i see, and i'm working on bringing up the roles & server to publish them | 19:03 |
ianw | tarballs and releases are still something we need to think about | 19:03 |
clarkb | that was where we ran into the 50GB fs problem on rax test nodes right? | 19:04 |
clarkb | (the role and server) | 19:04 |
diablo_rojo | o/ | 19:04 |
fungi | what's the complication with the releases site? | 19:04 |
fungi | i thought it was statically-generated content like the other sites | 19:04 |
ianw | fungi: no complication, as such, just need to look at the details of the jobs and how they are going to publish to afs | 19:05 |
fungi | ahh, okay | 19:06 |
*** efried is now known as efried_afk | 19:06 | |
*** e0ne has joined #openstack-meeting | 19:07 | |
clarkb | ok we've got an agenda item to go in depth for this topic in a bit too | 19:07 |
clarkb | #topic Priority Efforts | 19:07 |
*** openstack changes topic to "Priority Efforts (Meeting topic: infra)" | 19:07 | |
clarkb | #topic Update Config Management | 19:07 |
*** openstack changes topic to "Update Config Management (Meeting topic: infra)" | 19:07 | |
clarkb | Mordred reports being unwell and hasn't made much progress here | 19:07 |
clarkb | remember to cook your turkeys to 165F | 19:08 |
*** ayoung has quit IRC | 19:08 | |
clarkb | #topic OpenDev | 19:08 |
*** openstack changes topic to "OpenDev (Meeting topic: infra)" | 19:08 | |
clarkb | #link http://lists.openstack.org/pipermail/openstack-infra/2019-December/006537.html Governance email | 19:08 |
clarkb | The governance email has gone out. Good feedback so far | 19:08 |
clarkb | I've made one revision to the proposal already and will prbably make at least one more to make things a bit clearer | 19:09 |
clarkb | if you've got feedback I'm happy to hear it | 19:09 |
*** ayoung has joined #openstack-meeting | 19:10 | |
clarkb | (sorry distracted by zuul upgrade fallout) | 19:12 |
clarkb | The other opendev item I wanted to call out is that the gitea upgrade does not seem to have fixed tonyb's nova repo fetching problem | 19:13 |
fungi | but at least we were able to rule that out | 19:13 |
clarkb | however the gitea upgrade doesn't seem to have had any other reported issues and looking at cacti graphs gitea 1.10 results in fewer tcp connections | 19:13 |
ianw | on the plus side, nobody else has reported anything? | 19:13 |
clarkb | ianw: not that I have seen | 19:14 |
*** ayoung has quit IRC | 19:14 | |
fungi | yeah, seems to have gone very smoothly | 19:15 |
fungi | thanks to mordred in absentia! | 19:16 |
clarkb | ianw: at this point I think we are probably going to have to dig in with tracing and do our best to see where gitea fails to close those connections? | 19:16 |
*** ayoung has joined #openstack-meeting | 19:16 | |
ianw | clarkb: i think we know that git upload-pack is dying, at the bottom layer | 19:17 |
ianw | but then there's so much ontop of that ... | 19:17 |
clarkb | and we know that gitea doesn't close the tcp connection to the client (whcih is why the command hangs and doesn't do anything) | 19:17 |
clarkb | I guess if the connection was closed the fetch would still fail so we need to fix the dying upload-pack to properly solve the issue | 19:18 |
clarkb | Anything else on Opendev or should we continue? | 19:20 |
clarkb | #topic General Topics | 19:22 |
*** openstack changes topic to "General Topics (Meeting topic: infra)" | 19:22 | |
clarkb | fungi: anything new on the wiki upgrade? | 19:22 |
fungi | negatory | 19:22 |
clarkb | Next is the static.o.o replacement update | 19:23 |
clarkb | we got a short update earlier. ianw anything else causing problems for the replacement server or was that filesystem thing the only problem? | 19:23 |
ianw | i think it's going ok ... https://review.opendev.org/#/c/698128/ is the change in question that was not setting a small cache for all afs clients in the gate tests | 19:24 |
ianw | #link https://review.opendev.org/#/c/697587/ | 19:24 |
ianw | is the static.opendev.org role ... i still want to iterate on that some more, better testinfra | 19:25 |
ianw | but initially, everything should be in place to switch governance.openstack.org to that | 19:25 |
ianw | we should be able to test it before we switch DNS, once the server is up | 19:25 |
clarkb | ++ and since we do dns acme we can even get ssl set up before updating the A/AAAA/CNAME records | 19:27 |
ianw | yep, i will need to setup the acme records before the server goes live | 19:27 |
ianw | with that process proven out, i think the other sites will be easy to switch too | 19:28 |
clarkb | sounds like good progress. Thank you | 19:28 |
clarkb | The nodepool dib item was on the agenda but yseterday ianw said we don't need to go over it in the meeting | 19:30 |
clarkb | ianw: ^ is that still the case? | 19:30 |
ianw | i don't think so ... we have progress merging the changes that build sibling projects with python-builder | 19:30 |
ianw | that is now all working, and the nodepool-builder container can build an image | 19:31 |
ianw | nodepool-launcher hasn't managed boot it in the functional test yet, but so i'd say we're half-way :) | 19:31 |
clarkb | ok | 19:33 |
clarkb | The last thing on the agenda is to point this list of services out again | 19:33 |
clarkb | #link https://etherpad.openstack.org/infra-service-list | 19:33 |
clarkb | as mentioned this isn't urgent but I'd like to pick up on some of that "spring cleaning" in the new year | 19:33 |
clarkb | and that is it for the scheduled agenda | 19:35 |
clarkb | I think others have been distracted by soe of the zuul fallout. | 19:35 |
clarkb | #topic Open Discussion | 19:35 |
*** openstack changes topic to "Open Discussion (Meeting topic: infra)" | 19:35 | |
clarkb | I'll open it up for anything we missed or went past too quickyl | 19:35 |
ianw | i wanted to bring up dib gate testing | 19:35 |
ianw | this only occurred yesterday afternoon | 19:35 |
ianw | #link https://review.opendev.org/#/c/698136/ | 19:36 |
ianw | because devstack has dropped xenial, we're left without anywhere to run functional test for suse-minimal jobs | 19:36 |
ianw | bionic does not have zypper on the host | 19:36 |
ianw | two options here are to pin the suse jobs to devstack train -- this will require work in the install-devstack role the test uses to install branches | 19:37 |
fungi | can an older devstack be used? | 19:37 |
fungi | yeah, that | 19:37 |
fungi | got it | 19:37 |
clarkb | this is where mordred's container bootstrap would help too | 19:37 |
ianw | or, implement some of the other ideas about using containers as minimal images, etc | 19:37 |
clarkb | then we could use a suse container to get zypper and not care what platform we run dib on | 19:37 |
clarkb | I expect that the container bootstrap work will take time and not be a drop in replacement for a while | 19:37 |
clarkb | probably best to use train devstack while we work on the container bootstrapping? | 19:38 |
ianw | right, so yeah, for immediate "gate is broken" purposes, i'm going to have to put it into experimental | 19:38 |
corvus | i reckon a branch option for install-devstack could be generally useful. esp since most public clouds don't run master. | 19:39 |
*** igordc has joined #openstack-meeting | 19:39 | |
ianw | i'm more than happy to expedite review, but i'm not sure how much time i have to focus on fixing it | 19:39 |
corvus | if we have to triage dev/review time, i think that the container bootstrap is the best long-term investment | 19:40 |
*** gmann is now known as gmann_afk | 19:40 | |
corvus | if we have "extra" time, then adding branch support for install-devstack is also a good investment, but not as important as the first | 19:41 |
corvus | (but, obivously, something we can do relatively quickly and can do it first) | 19:41 |
ianw | that's something i'd definitely like to be testing under a nodepool+containers functional test, as we might be looked at nested containers in that case | 19:41 |
corvus | ianw: yep, there be dragons | 19:41 |
ianw | on a somewhat related note, we'll also have to think about when dib can go python3 only | 19:43 |
clarkb | it can probably go ahead and do that today? | 19:43 |
clarkb | at least for nodepool users it is already ypthon3 only | 19:44 |
ianw | the problem is the branchless nature, and so it will basically kill any centos7 users | 19:44 |
ianw | #link https://review.opendev.org/#/c/697211 | 19:44 |
ianw | is an example of the work-around we'll have to do to keep python2 | 19:45 |
clarkb | ianw: maybe put out a warning and then switch in a few months then? | 19:45 |
clarkb | give people time to go to centos 8 or similar | 19:45 |
ianw | yep, i think so, anyway, just a heads-up on that | 19:46 |
clarkb | I wanted to ask if there was any interest in a less formal activity with the team/group? One idea I had was everyone playing a few rounds of geoguessr (though that requires online registration with an email address and use of google maps) | 19:49 |
fungi | i feel like i wandered into a parallel universe now | 19:50 |
fungi | (or missed a transition in the discussion) | 19:51 |
clarkb | fungi: I also compiled mangband but I couldn't get the curses version to build and the sdl version doesn't allow me to move my character :) | 19:51 |
clarkb | sorry the last discussion seemed to have tapered off | 19:51 |
clarkb | and was wondering if anyone was interested in end of year "office party" except we are remote so what do | 19:51 |
fungi | got it | 19:51 |
fungi | i suppose geoguessr won't work with osm | 19:52 |
clarkb | geoguessr came to mind because its a browser game that tests geographical knowledge and a bunch of us travel a bit | 19:52 |
zbr | or maybe a pose on rdr2? | 19:52 |
clarkb | fungi: ya I think gmaps is built into their web app | 19:52 |
clarkb | zbr: I expect we might be the only two with rdr2 :) | 19:52 |
Shrews | I hated rdr2 | 19:53 |
clarkb | I only just started playing it sunday night | 19:53 |
zbr | i loved rdr2 single player, online sucks. | 19:53 |
clarkb | fungi: basically you get a streetview that you can navigate around but have to determine where you are on a world map only from what you see in the streetview | 19:54 |
clarkb | fungi: and osm doesn't do streetview as far as I know | 19:54 |
zbr | as long nobody propose a candycrush competition we should be safe | 19:54 |
fungi | oh, i see. i'd never heard of geoguessr before | 19:54 |
zbr | me neither, i am now looking at geoguessr for the first time | 19:55 |
*** eharney has quit IRC | 19:55 | |
clarkb | well let me know. If a hour of geoguessr interests people I can pay for the pro version so we can share common maps together in challenges | 19:55 |
clarkb | or feel free to suggest alternatives. | 19:56 |
clarkb | I also tried supertuxracer but my gpu isn't good enoguh for it | 19:56 |
ianw | how is your gpu good enough for rdr2 but not tuxracer? | 19:56 |
corvus | i just did an anonymous trial round of geoguessr, and guessed new zealand for tokelau. only 2500km off, but it drew a funny picture | 19:56 |
clarkb | ianw: ps4 for rdr2 | 19:56 |
corvus | https://imgur.com/a/wr0LPP6 | 19:57 |
ianw | ahh! i have it on pc ... though I'd have to kick my kid off :) | 19:57 |
zbr | i am on ps4, posse /dev/null -- id "ssbarnea" | 19:57 |
clarkb | corvus: nice | 19:57 |
clarkb | We'll call that the meeting then | 19:58 |
clarkb | #endmeeting | 19:58 |
*** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/" | 19:58 | |
openstack | Meeting ended Tue Dec 10 19:58:12 2019 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 19:58 |
openstack | Minutes: http://eavesdrop.openstack.org/meetings/infra/2019/infra.2019-12-10-19.01.html | 19:58 |
openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/infra/2019/infra.2019-12-10-19.01.txt | 19:58 |
clarkb | thank you everyone! | 19:58 |
openstack | Log: http://eavesdrop.openstack.org/meetings/infra/2019/infra.2019-12-10-19.01.log.html | 19:58 |
fungi | thanks clarkb! | 19:58 |
zbr | thanks! | 19:58 |
diablo_rojo | thanks clarkb! | 20:00 |
ianw | yes thanks clarkb, a dual lesson in crisis management and meeting technique :) | 20:03 |
*** ralonsoh has quit IRC | 20:10 | |
*** Shrews has left #openstack-meeting | 20:14 | |
*** rcernin has joined #openstack-meeting | 20:16 | |
*** pcaruana has quit IRC | 20:16 | |
*** e0ne has quit IRC | 20:17 | |
*** oneswig has joined #openstack-meeting | 20:55 | |
*** martial has joined #openstack-meeting | 21:00 | |
oneswig | hi martial you there? | 21:00 |
oneswig | #startmeeting scientific-sig | 21:00 |
openstack | Meeting started Tue Dec 10 21:00:38 2019 UTC and is due to finish in 60 minutes. The chair is oneswig. Information about MeetBot at http://wiki.debian.org/MeetBot. | 21:00 |
openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 21:00 |
martial | Hello friends, welcome to the next edition of the Scientific SIG meeting :) | 21:00 |
*** openstack changes topic to " (Meeting topic: scientific-sig)" | 21:00 | |
openstack | The meeting name has been set to 'scientific_sig' | 21:00 |
martial | Hi Stig ;) | 21:00 |
oneswig | greetings | 21:00 |
oneswig | What's new? | 21:00 |
martial | not much, trying to see the rules about sharing a container built with CuDNN | 21:01 |
martial | looks like they finally integrated DNN for OpenCV | 21:01 |
oneswig | Not my wheelhouse. What's the issue? | 21:01 |
*** janders has joined #openstack-meeting | 21:02 | |
*** eharney has joined #openstack-meeting | 21:02 | |
martial | CuDNN is an Nvidia "developper" only download | 21:02 |
martial | but they provide the base container | 21:02 |
oneswig | Ah so it's not something that any dockerfile can pull in? | 21:02 |
martial | https://hub.docker.com/r/nvidia/cuda/ | 21:03 |
martial | it is | 21:03 |
martial | well if you start from the official one | 21:03 |
martial | but pulling means that you are following the license terms set on those pages | 21:03 |
janders | g'day all | 21:04 |
janders | sorry for being late | 21:04 |
oneswig | Hi janders, hardly late | 21:04 |
*** smcginnis has joined #openstack-meeting | 21:05 | |
oneswig | martial: so it's a question of pulling in a license that you don't care for, implicitly? | 21:05 |
martial | something like that | 21:06 |
oneswig | To borrow a little from Sherlock Holmes, that is a two-cheesecake problem :-) | 21:06 |
oneswig | At this end, I've been exploring a bit of mlnx network infrastructure I've not used before - VF LAG - anyone tried it previously? | 21:07 |
martial | not here | 21:07 |
oneswig | The idea is that if your hypervisor has a dual-port Mellanox NIC, if you bond those ports you can create virtual functions that somehow pass traffic that is also bonded (but presented as one virtual function) | 21:08 |
martial | so mirror ? | 21:09 |
oneswig | More the sum of the parts than their reflection, I'd hope. But I'm still piecing it together. | 21:10 |
oneswig | The investigation continues | 21:10 |
janders | I haven't use those yet | 21:10 |
janders | *used | 21:10 |
martial | seems cool that said | 21:11 |
oneswig | I am not convinced how much traffic distribution there is between the underlying physical ports, but I'll report back when I find out. | 21:11 |
janders | agree that the option of having benefits of LAG without having to set up LAG in every instance sounds promising | 21:11 |
oneswig | I hope so. | 21:12 |
oneswig | What's new with you janders? | 21:12 |
oneswig | trandles and jmlowe send their apologies, I think there's a lot of winding up for end-of-year going on | 21:14 |
oneswig | I don't think we have more agenda items to cover - anything from you martial? | 21:17 |
martial | yep people going on vacation and such | 21:17 |
oneswig | OK, shall we close? Your dockerfile awaits :-) | 21:18 |
oneswig | #endmeeting | 21:21 |
*** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/" | 21:21 | |
openstack | Meeting ended Tue Dec 10 21:21:34 2019 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 21:21 |
openstack | Minutes: http://eavesdrop.openstack.org/meetings/scientific_sig/2019/scientific_sig.2019-12-10-21.00.html | 21:21 |
openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/scientific_sig/2019/scientific_sig.2019-12-10-21.00.txt | 21:21 |
openstack | Log: http://eavesdrop.openstack.org/meetings/scientific_sig/2019/scientific_sig.2019-12-10-21.00.log.html | 21:21 |
oneswig | have a good one! | 21:21 |
*** oneswig has quit IRC | 21:22 | |
martial | thanks | 21:27 |
*** raildo has quit IRC | 21:27 | |
*** mriedem has quit IRC | 21:29 | |
*** epei has quit IRC | 21:29 | |
*** epei has joined #openstack-meeting | 21:34 | |
*** epei has quit IRC | 21:40 | |
*** epei has joined #openstack-meeting | 21:40 | |
*** epei has quit IRC | 21:45 | |
*** epei has joined #openstack-meeting | 21:45 | |
*** janders has quit IRC | 21:49 | |
*** epei has quit IRC | 21:49 | |
*** epei has joined #openstack-meeting | 21:51 | |
*** epei has quit IRC | 21:55 | |
*** epei_ has joined #openstack-meeting | 21:55 | |
*** mriedem has joined #openstack-meeting | 22:05 | |
*** epei_ has quit IRC | 22:09 | |
*** slaweq has quit IRC | 22:10 | |
*** nicolasbock has quit IRC | 22:12 | |
*** epei has joined #openstack-meeting | 22:19 | |
*** epei has quit IRC | 22:23 | |
*** efried_afk is now known as efried | 22:25 | |
*** epei has joined #openstack-meeting | 22:29 | |
*** epei has quit IRC | 22:33 | |
*** epei has joined #openstack-meeting | 22:39 | |
*** epei has quit IRC | 22:43 | |
*** ykatabam has joined #openstack-meeting | 22:49 | |
*** apetrich has quit IRC | 22:54 | |
*** gmann_afk is now known as gmann | 23:06 | |
*** slaweq has joined #openstack-meeting | 23:08 | |
*** epei has joined #openstack-meeting | 23:12 | |
*** slaweq has quit IRC | 23:14 | |
*** epei has quit IRC | 23:17 | |
*** mriedem has quit IRC | 23:17 | |
*** epei has joined #openstack-meeting | 23:26 | |
*** enriquetaso has quit IRC | 23:30 | |
*** epei has quit IRC | 23:30 | |
*** martial has quit IRC | 23:39 | |
*** epei has joined #openstack-meeting | 23:41 | |
*** epei has quit IRC | 23:46 | |
*** rf0lc0 has quit IRC | 23:47 | |
*** rf0lc0 has joined #openstack-meeting | 23:49 | |
*** epei has joined #openstack-meeting | 23:56 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!