*** claudiub has quit IRC | 00:00 | |
*** david-lyle has quit IRC | 00:07 | |
*** dklyle has joined #openstack-meeting | 00:07 | |
*** dklyle has quit IRC | 00:07 | |
*** wanghao has quit IRC | 00:15 | |
*** wanghao has joined #openstack-meeting | 00:17 | |
*** wanghao has quit IRC | 00:18 | |
*** wanghao has joined #openstack-meeting | 00:23 | |
*** wanghao has quit IRC | 00:28 | |
*** sdague has quit IRC | 00:29 | |
*** edmondsw has joined #openstack-meeting | 00:36 | |
*** wanghao has joined #openstack-meeting | 00:36 | |
*** esberglu has quit IRC | 00:37 | |
*** chyka_ has quit IRC | 00:38 | |
*** felipemonteiro_ has joined #openstack-meeting | 00:44 | |
*** emagana has joined #openstack-meeting | 00:48 | |
*** tovin07_ has joined #openstack-meeting | 00:52 | |
*** emagana has quit IRC | 00:52 | |
*** TxGirlGeek has quit IRC | 01:01 | |
*** emagana has joined #openstack-meeting | 01:03 | |
*** emagana has quit IRC | 01:07 | |
*** emagana has joined #openstack-meeting | 01:08 | |
*** TxGirlGeek has joined #openstack-meeting | 01:11 | |
*** felipemonteiro_ has quit IRC | 01:12 | |
*** TxGirlGeek has quit IRC | 01:12 | |
*** emagana has quit IRC | 01:13 | |
*** markvoelker has joined #openstack-meeting | 01:17 | |
*** kiennt26 has joined #openstack-meeting | 01:18 | |
*** zhurong has joined #openstack-meeting | 01:21 | |
*** armax has joined #openstack-meeting | 01:25 | |
*** frank_wang has joined #openstack-meeting | 01:27 | |
*** amodi has joined #openstack-meeting | 01:31 | |
*** Dinesh_Bhor has joined #openstack-meeting | 01:34 | |
*** aeng has quit IRC | 01:34 | |
*** mriedem1 has joined #openstack-meeting | 01:40 | |
*** mriedem has quit IRC | 01:42 | |
*** Tom-Tom has quit IRC | 01:43 | |
*** Tom-Tom has joined #openstack-meeting | 01:43 | |
*** gongysh has joined #openstack-meeting | 01:44 | |
*** Dinesh_Bhor has quit IRC | 01:45 | |
*** aeng has joined #openstack-meeting | 01:47 | |
*** markstur_ has joined #openstack-meeting | 01:51 | |
*** zhongjun has joined #openstack-meeting | 01:52 | |
*** Tom-Tom has quit IRC | 01:53 | |
*** markstur has quit IRC | 01:54 | |
*** mriedem has joined #openstack-meeting | 01:56 | |
*** mriedem1 has quit IRC | 01:58 | |
*** felipemonteiro_ has joined #openstack-meeting | 02:02 | |
*** Dinesh_Bhor has joined #openstack-meeting | 02:05 | |
*** Dinesh_Bhor has quit IRC | 02:07 | |
*** jamesmcarthur has joined #openstack-meeting | 02:07 | |
*** Tom-Tom has joined #openstack-meeting | 02:09 | |
*** Tom-Tom has quit IRC | 02:09 | |
*** Tom-Tom has joined #openstack-meeting | 02:09 | |
*** haint has joined #openstack-meeting | 02:20 | |
*** hazmat has quit IRC | 02:22 | |
*** hazmat has joined #openstack-meeting | 02:24 | |
*** nguyentrihai has quit IRC | 02:24 | |
*** Dinesh_Bhor has joined #openstack-meeting | 02:26 | |
*** ekcs has joined #openstack-meeting | 02:29 | |
*** edmondsw has quit IRC | 02:30 | |
*** Apoorva has quit IRC | 02:32 | |
*** harlowja has quit IRC | 02:32 | |
*** Dinesh_Bhor has quit IRC | 02:33 | |
*** simonmcc has quit IRC | 02:36 | |
*** simonmcc has joined #openstack-meeting | 02:37 | |
*** julim has joined #openstack-meeting | 02:46 | |
*** julim has quit IRC | 02:47 | |
*** jamesmcarthur has quit IRC | 02:50 | |
*** jamesmcarthur has joined #openstack-meeting | 02:51 | |
*** hongbin has joined #openstack-meeting | 02:57 | |
hongbin | #startmeeting zun | 03:00 |
---|---|---|
openstack | Meeting started Tue Jan 9 03:00:04 2018 UTC and is due to finish in 60 minutes. The chair is hongbin. Information about MeetBot at http://wiki.debian.org/MeetBot. | 03:00 |
openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 03:00 |
*** openstack changes topic to " (Meeting topic: zun)" | 03:00 | |
openstack | The meeting name has been set to 'zun' | 03:00 |
hongbin | #link https://wiki.openstack.org/wiki/Zun#Agenda_for_2017-01-09_0300_UTC Today's agenda | 03:00 |
hongbin | #topic Roll Call | 03:00 |
*** openstack changes topic to "Roll Call (Meeting topic: zun)" | 03:00 | |
*** julim has joined #openstack-meeting | 03:02 | |
mkrai | Madhuri | 03:02 |
hongbin | hi mkrai | 03:03 |
hongbin | it looks just you and me today | 03:03 |
mkrai | hongbin (IRC): hi | 03:03 |
hongbin | mkrai: btw, thanks for serving the ptl role while i was away | 03:03 |
*** bkopilov has quit IRC | 03:04 | |
mkrai | hongbin (IRC): my pleasure | 03:04 |
mkrai | 😊 | 03:04 |
kiennt26 | hi all o/ | 03:04 |
hongbin | kiennt26: hi kien | 03:04 |
hongbin | mkrai: kiennt26 there are three of us | 03:04 |
hongbin | i guess each of us can give a short update, then end the meeting | 03:04 |
mkrai | kiennt26 (IRC): hi | 03:05 |
hongbin | mkrai: anything to update from your side? | 03:05 |
mkrai | Ok sounds good | 03:05 |
mkrai | hongbin (IRC): I didn’t do much last week | 03:05 |
hongbin | mkrai: ack, that is fine | 03:05 |
mkrai | I will update the Clear container devstack patch today | 03:05 |
mkrai | And then it should be fine to merge | 03:06 |
hongbin | great | 03:06 |
*** markvoelker has quit IRC | 03:06 | |
mkrai | After that we can mark it as complete for now | 03:06 |
hongbin | ok | 03:06 |
mkrai | And later work on Kata containers | 03:06 |
mkrai | That’s all 😊 | 03:06 |
hongbin | yes, i am waiting for kata containers to be ready | 03:06 |
hongbin | thanks mkrai | 03:06 |
hongbin | kiennt26: anything from your side? | 03:07 |
*** adreznec has quit IRC | 03:07 | |
kiennt26 | From my side, this week i'm working on Zuulv3 native jobs | 03:07 |
hongbin | cool | 03:07 |
kiennt26 | but in zuulv3 native, multinode jobs stills failed. Seems that Devstack-multinode job doesn't ready yet | 03:08 |
hongbin | i see | 03:08 |
*** adreznec has joined #openstack-meeting | 03:08 | |
*** anilvenkata has quit IRC | 03:08 | |
kiennt26 | 2nd, I'm investigating with miao in the bellow patch. | 03:09 |
kiennt26 | #link https://review.openstack.org/#/c/531646/ | 03:09 |
*** Tom-Tom has quit IRC | 03:09 | |
*** Tom-Tom has joined #openstack-meeting | 03:09 | |
kiennt26 | All tempest jobs were failed. | 03:09 |
hongbin | he submitted another patch for tempest-plugin | 03:09 |
hongbin | he managed to pass all jobs on that patch | 03:09 |
hongbin | #link https://review.openstack.org/#/c/531655/ | 03:10 |
kiennt26 | hongbin: yeah, zun-tempest-plugin patch depends on zun side patch. It was passes but Zun side was failed. | 03:10 |
hongbin | yes | 03:11 |
hongbin | if these two patches can merge together, i think everything would be fine | 03:11 |
hongbin | however, that is impossible | 03:11 |
hongbin | i think he needs to do it this way: | 03:11 |
hongbin | 1. add 'project' in server | 03:11 |
hongbin | 2. convert 'tenant' to 'project' in tempest plugin | 03:12 |
hongbin | 3. remove 'tenant' in server | 03:12 |
hongbin | then, it should manage to pass the gate | 03:12 |
hongbin | i will comment on his patch about that | 03:12 |
hongbin | kiennt26: anything else from your side? | 03:13 |
kiennt26 | hongbin: thank you. I was about to do it. | 03:13 |
*** iyamahat has quit IRC | 03:13 | |
kiennt26 | hongbin: That's all from me this week | 03:13 |
hongbin | kiennt26: ack, thanks kiennt26 | 03:13 |
hongbin | from my side, i was working with enterprice working group to define a reference architecture for zun | 03:14 |
hongbin | #link https://review.openstack.org/#/c/531613/ | 03:14 |
hongbin | i will continue to work on that in this week | 03:14 |
hongbin | in addition, i am working on a few heat patches to make heat to pick up the latest version of zun | 03:15 |
mkrai | hongbin (IRC): that’s great. I would like to look into it | 03:15 |
hongbin | mkrai: :) | 03:15 |
hongbin | that is all from my side | 03:15 |
*** yamahata has quit IRC | 03:15 | |
hongbin | ok, any question ? | 03:15 |
hongbin | if no, i will end hte meeting soon | 03:15 |
mkrai | None from me | 03:16 |
kiennt26 | hongbin: nothing from me. | 03:16 |
hongbin | ok, all, thanks for joining hte meting, see you next week | 03:16 |
hongbin | #endmeeting | 03:16 |
*** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/" | 03:16 | |
*** adreznec has quit IRC | 03:16 | |
openstack | Meeting ended Tue Jan 9 03:16:33 2018 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 03:16 |
openstack | Minutes: http://eavesdrop.openstack.org/meetings/zun/2018/zun.2018-01-09-03.00.html | 03:16 |
openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/zun/2018/zun.2018-01-09-03.00.txt | 03:16 |
openstack | Log: http://eavesdrop.openstack.org/meetings/zun/2018/zun.2018-01-09-03.00.log.html | 03:16 |
*** adreznec has joined #openstack-meeting | 03:21 | |
*** ijw has quit IRC | 03:21 | |
*** hongbin has quit IRC | 03:24 | |
*** hongbin has joined #openstack-meeting | 03:25 | |
*** amodi has quit IRC | 03:31 | |
*** ricolin has joined #openstack-meeting | 03:37 | |
*** jamesmcarthur has quit IRC | 03:40 | |
*** yamamoto has joined #openstack-meeting | 03:40 | |
*** pengdake has joined #openstack-meeting | 03:41 | |
*** tw0x88 has joined #openstack-meeting | 03:41 | |
*** Tom-Tom has quit IRC | 03:42 | |
*** Tom-Tom has joined #openstack-meeting | 03:42 | |
*** Tom-Tom has quit IRC | 03:47 | |
*** gyee has quit IRC | 03:48 | |
*** abhishekk has joined #openstack-meeting | 03:55 | |
*** zhurong has quit IRC | 03:55 | |
*** tw0x88 has left #openstack-meeting | 03:56 | |
*** frank_wang has quit IRC | 03:56 | |
*** frank_wang has joined #openstack-meeting | 03:56 | |
*** shaohe_feng has quit IRC | 03:58 | |
*** shaohe_feng has joined #openstack-meeting | 03:58 | |
*** sridharg has joined #openstack-meeting | 03:58 | |
*** sagara has joined #openstack-meeting | 03:59 | |
*** rkmrHonjo has joined #openstack-meeting | 03:59 | |
rkmrHonjo | Hello | 04:00 |
sagara | Hi | 04:00 |
*** Dinesh_Bhor has joined #openstack-meeting | 04:01 | |
rkmrHonjo | sagara: hi | 04:01 |
rkmrHonjo | Dinesh_Bhor: hi | 04:01 |
Dinesh_Bhor | rkmrHonjo, sagara: Hi | 04:01 |
rkmrHonjo | Sampath can't attend this meeting at first. So I conduct this meeting. | 04:01 |
sagara | I heard today Tushar has still vacation | 04:02 |
Dinesh_Bhor | sure | 04:02 |
rkmrHonjo | sagara: ok | 04:02 |
Dinesh_Bhor | sagara:yes | 04:02 |
rkmrHonjo | #startmeeting | 04:02 |
openstack | rkmrHonjo: Error: A meeting name is required, e.g., '#startmeeting Marketing Committee' | 04:02 |
rkmrHonjo | oh,sorry | 04:02 |
rkmrHonjo | #startmeeting Masakari | 04:02 |
openstack | Meeting started Tue Jan 9 04:02:43 2018 UTC and is due to finish in 60 minutes. The chair is rkmrHonjo. Information about MeetBot at http://wiki.debian.org/MeetBot. | 04:02 |
openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 04:02 |
*** openstack changes topic to " (Meeting topic: Masakari)" | 04:02 | |
openstack | The meeting name has been set to 'masakari' | 04:02 |
rkmrHonjo | #topic Bugs | 04:03 |
*** openstack changes topic to "Bugs (Meeting topic: Masakari)" | 04:03 | |
rkmrHonjo | Do you have any updates for bugs? | 04:03 |
rkmrHonjo | #link https://bugs.launchpad.net/masakari/+bug/1740111 | 04:03 |
openstack | Launchpad bug 1740111 in oslo.log "masakari-api failed to launch due to setting of watch_log_file and log_file" [Undecided,New] | 04:03 |
rkmrHonjo | This bug was caused by oslo.log. So I sent a mail to devML about this issue. As a result, Doug Hellmann replied to me. | 04:04 |
rkmrHonjo | #link http://lists.openstack.org/pipermail/openstack-dev/2018-January/125966.html | 04:04 |
rkmrHonjo | In short, pyinotify is unmaintained. We should use other libraries or deprecate watch_log_file option. | 04:04 |
rkmrHonjo | I write above information on launchpad after that. | 04:05 |
Dinesh_Bhor | rkmrHonjo: nice. I think we should wait for communities decision and follow the same | 04:06 |
rkmrHonjo | Dinesh_Bhor: Yeah. | 04:06 |
rkmrHonjo | #link https://bugs.launchpad.net/masakari/+bug/1739383 | 04:07 |
openstack | Launchpad bug 1739383 in masakari "'409 Conflict' occurred when adding reserved_host to aggregate" [Undecided,In progress] - Assigned to takahara.kengo (takahara.kengo) | 04:07 |
rkmrHonjo | Takahara pushed a patch for this issue. Please review it if you can. | 04:08 |
rkmrHonjo | #link https://review.openstack.org/#/c/531310/ | 04:08 |
Dinesh_Bhor | rkmrHonjo: Thank you for the patch. I will review it. | 04:09 |
rkmrHonjo | Dinesh_Bhor: thanks a lot! | 04:09 |
rkmrHonjo | Of course, I'll review it, too. | 04:09 |
rkmrHonjo | Any other updates? | 04:10 |
Dinesh_Bhor | I think its time to make py35 job voting | 04:10 |
rkmrHonjo | Dinesh_Bhor: +1. But we should resolve py35 ut issue before that. | 04:12 |
Dinesh_Bhor | rkmrHonjo: yes | 04:13 |
rkmrHonjo | Sorry, my patch(https://review.openstack.org/#/c/486576/) is late. I push a new patch next week. | 04:13 |
rkmrHonjo | I think that I should remove a message attribute from masakari.exception. | 04:13 |
Dinesh_Bhor | Okay, np | 04:13 |
rkmrHonjo | Dinesh_Bhor: sorry. | 04:14 |
*** Apoorva has joined #openstack-meeting | 04:15 | |
*** rbudden has quit IRC | 04:15 | |
*** pengdake has quit IRC | 04:15 | |
rkmrHonjo | If there is not other updates, let's go to next topic. | 04:15 |
Dinesh_Bhor | rkmrHonjo: yes please | 04:15 |
rkmrHonjo | #topic Discussion points | 04:16 |
*** openstack changes topic to "Discussion points (Meeting topic: Masakari)" | 04:16 | |
*** esberglu has joined #openstack-meeting | 04:16 | |
rkmrHonjo | <Horizon Plugin> | 04:16 |
*** esberglu has quit IRC | 04:17 | |
Dinesh_Bhor | This needs one more reviewer: https://review.openstack.org/#/c/528647/ | 04:17 |
*** gongysh has quit IRC | 04:17 | |
rkmrHonjo | Dinesh_Bhor: ok, I'll reivew it. | 04:17 |
Dinesh_Bhor | Niraj will soon submit a patch for adding segments panel. | 04:18 |
rkmrHonjo | Dinesh_Bhor: Is it other patch? or new patch set for the above patch? | 04:18 |
Dinesh_Bhor | No, The Cookiecutter patch is different | 04:19 |
rkmrHonjo | Dinesh_Bhor: OK, I got it. | 04:19 |
rkmrHonjo | #action rkmrHonjo reviews https://review.openstack.org/#/c/528647/ | 04:20 |
rkmrHonjo | Next, <Install guide document> | 04:20 |
rkmrHonjo | I heard that tpatil was checking about how to publish documents. | 04:21 |
rkmrHonjo | Dinesh_Bhor, sagara: Do you know about the status of tpatil's researching? | 04:22 |
Dinesh_Bhor | rkmrHonjo: I think its in progress. I will take update from him | 04:23 |
*** bkopilov has joined #openstack-meeting | 04:23 | |
rkmrHonjo | Dinesh_Bhor: thank you for sharing status. | 04:23 |
*** jamesmcarthur has joined #openstack-meeting | 04:23 | |
*** jamesmcarthur has quit IRC | 04:23 | |
*** jamesmcarthur has joined #openstack-meeting | 04:23 | |
rkmrHonjo | Next, <recovery method customization> | 04:24 |
rkmrHonjo | sampath's review is required for this, isn't it? | 04:25 |
Dinesh_Bhor | yes | 04:26 |
*** zhhuabj has quit IRC | 04:26 | |
*** hongbin has quit IRC | 04:26 | |
rkmrHonjo | ok, let's go to next item because he isn't here today. | 04:26 |
Dinesh_Bhor | okay | 04:26 |
rkmrHonjo | <Ansible support for Masakari> | 04:27 |
Dinesh_Bhor | I am working on this | 04:27 |
rkmrHonjo | Dinesh_Bhor: great. Do you want to talk about it today? | 04:27 |
*** beekhof_mb has joined #openstack-meeting | 04:28 | |
*** epico has joined #openstack-meeting | 04:28 | |
Dinesh_Bhor | So far I don't have much update. If I find any difficulties I will bring them in meeting. | 04:28 |
rkmrHonjo | Dinesh_Bhor: I got it. Let's go to next item. | 04:29 |
rkmrHonjo | <Call Force down API when host-failure will be notified> | 04:29 |
rkmrHonjo | I talked with tpatil about this issue by offline. | 04:29 |
rkmrHonjo | And, I expect that he cancel his -1 on gerrit. | 04:30 |
Dinesh_Bhor | okay | 04:30 |
rkmrHonjo | I wait the end of his vacation. | 04:30 |
Dinesh_Bhor | yes | 04:30 |
*** yangyapeng has quit IRC | 04:31 | |
*** yangyapeng has joined #openstack-meeting | 04:31 | |
rkmrHonjo | Dinesh_Bhor: thanks. If he has other concerns, we discuss about it. | 04:31 |
rkmrHonjo | ok, let's go to next item. | 04:31 |
rkmrHonjo | oh, sorry, this is the last item. | 04:32 |
*** liuyulong has joined #openstack-meeting | 04:32 | |
rkmrHonjo | Next topic is BM-HA, but I think that we can't talk about it without sampath. | 04:32 |
rkmrHonjo | Do you want to talk about it now? | 04:33 |
Dinesh_Bhor | no | 04:33 |
rkmrHonjo | ok. | 04:33 |
rkmrHonjo | #topic AOB | 04:33 |
*** openstack changes topic to "AOB (Meeting topic: Masakari)" | 04:33 | |
*** felipemonteiro_ has quit IRC | 04:34 | |
rkmrHonjo | Do you have any other topics? | 04:34 |
Dinesh_Bhor | Looks like Gregs is facing come issues with masakari-monitors and masakari integration | 04:35 |
Dinesh_Bhor | I am helping over the mail | 04:35 |
Dinesh_Bhor | s/come/some | 04:36 |
rkmrHonjo | Dinesh_Bhor: Thanks. I'd like to help him, too. | 04:36 |
Dinesh_Bhor | Okay, Thats it from my side | 04:37 |
*** zhhuabj has joined #openstack-meeting | 04:38 | |
rkmrHonjo | Dinesh_Bhor: sorry... | 04:38 |
*** frank_wang has quit IRC | 04:38 | |
Dinesh_Bhor | rkmrHonjo: Np, | 04:38 |
rkmrHonjo | By the way, do you know about the preparing status of masakari's IRC channel? | 04:39 |
Dinesh_Bhor | rkmrHonjo: No, | 04:39 |
Dinesh_Bhor | I will figure it out | 04:40 |
rkmrHonjo | Dinesh_Bhor: thanks. | 04:40 |
rkmrHonjo | ok, is there any topics? If it is nothing, we can finish this meeting. | 04:41 |
Dinesh_Bhor | Nothing from my side | 04:42 |
rkmrHonjo | sagara: nothing? | 04:42 |
sagara | nothing | 04:43 |
rkmrHonjo | ok. thank you all. | 04:43 |
*** zhhuabj has quit IRC | 04:43 | |
Dinesh_Bhor | Thank you all | 04:43 |
rkmrHonjo | #endmeeting | 04:44 |
*** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/" | 04:44 | |
openstack | Meeting ended Tue Jan 9 04:44:08 2018 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 04:44 |
openstack | Minutes: http://eavesdrop.openstack.org/meetings/masakari/2018/masakari.2018-01-09-04.02.html | 04:44 |
openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/masakari/2018/masakari.2018-01-09-04.02.txt | 04:44 |
openstack | Log: http://eavesdrop.openstack.org/meetings/masakari/2018/masakari.2018-01-09-04.02.log.html | 04:44 |
rkmrHonjo | bye... | 04:44 |
sagara | thank you, bye | 04:44 |
*** sagara has quit IRC | 04:44 | |
*** mriedem has quit IRC | 04:47 | |
*** janki has joined #openstack-meeting | 04:47 | |
*** rkmrHonjo has quit IRC | 04:48 | |
*** Dinesh_Bhor has quit IRC | 04:50 | |
*** Dinesh_Bhor has joined #openstack-meeting | 04:51 | |
*** Dinesh_Bhor has quit IRC | 04:52 | |
*** Dinesh_Bhor has joined #openstack-meeting | 04:55 | |
*** markvoelker has joined #openstack-meeting | 04:56 | |
*** abhishekk has left #openstack-meeting | 04:57 | |
*** pengdake has joined #openstack-meeting | 05:01 | |
*** zhhuabj has joined #openstack-meeting | 05:01 | |
*** felipemonteiro_ has joined #openstack-meeting | 05:01 | |
*** coolsvap has joined #openstack-meeting | 05:02 | |
*** psachin has joined #openstack-meeting | 05:04 | |
*** links has joined #openstack-meeting | 05:07 | |
*** ijw has joined #openstack-meeting | 05:19 | |
*** anilvenkata has joined #openstack-meeting | 05:22 | |
*** arnewiebalck_ has quit IRC | 05:24 | |
*** Tom-Tom has joined #openstack-meeting | 05:28 | |
*** markstur_ has quit IRC | 05:29 | |
*** markstur has joined #openstack-meeting | 05:29 | |
*** claudiub has joined #openstack-meeting | 05:29 | |
*** markstur has quit IRC | 05:29 | |
*** frank_wang has joined #openstack-meeting | 05:37 | |
*** frank_wang has quit IRC | 05:42 | |
*** frank_wang has joined #openstack-meeting | 05:43 | |
*** caowei has joined #openstack-meeting | 05:44 | |
*** Apoorva has quit IRC | 05:49 | |
*** markstur has joined #openstack-meeting | 05:50 | |
*** emagana has joined #openstack-meeting | 05:51 | |
*** Tom-Tom has quit IRC | 05:53 | |
*** markstur has quit IRC | 05:55 | |
*** iyamahat has joined #openstack-meeting | 05:56 | |
*** Tom-Tom has joined #openstack-meeting | 06:02 | |
*** jamesmcarthur has quit IRC | 06:02 | |
*** jamesmcarthur has joined #openstack-meeting | 06:03 | |
*** sandanar has joined #openstack-meeting | 06:03 | |
*** jamesmcarthur has quit IRC | 06:07 | |
*** Dinesh_Bhor has quit IRC | 06:07 | |
*** felipemonteiro_ has quit IRC | 06:08 | |
*** Dinesh_Bhor has joined #openstack-meeting | 06:10 | |
*** wanghao_ has joined #openstack-meeting | 06:12 | |
*** yamahata has joined #openstack-meeting | 06:13 | |
*** ekcs has quit IRC | 06:14 | |
*** wanghao has quit IRC | 06:15 | |
*** aeng has quit IRC | 06:16 | |
*** gouthamr has quit IRC | 06:17 | |
*** marios has joined #openstack-meeting | 06:18 | |
*** dbecker has quit IRC | 06:31 | |
*** markstur has joined #openstack-meeting | 06:32 | |
*** links has quit IRC | 06:35 | |
*** markstur has quit IRC | 06:37 | |
*** rcernin has quit IRC | 06:38 | |
*** niraj_singh has joined #openstack-meeting | 06:38 | |
*** niraj_singh has left #openstack-meeting | 06:39 | |
*** dbecker has joined #openstack-meeting | 06:45 | |
*** jamesmcarthur has joined #openstack-meeting | 06:46 | |
*** zhurong has joined #openstack-meeting | 06:50 | |
*** jamesmcarthur has quit IRC | 06:51 | |
*** links has joined #openstack-meeting | 06:52 | |
*** ad_rien_ has quit IRC | 06:52 | |
*** ykatabam has quit IRC | 06:52 | |
*** markstur has joined #openstack-meeting | 06:53 | |
*** pcaruana has joined #openstack-meeting | 06:56 | |
*** markstur has quit IRC | 06:57 | |
*** gcb has joined #openstack-meeting | 06:58 | |
*** liuyulong has quit IRC | 07:02 | |
*** links has quit IRC | 07:03 | |
*** Dinesh_Bhor has quit IRC | 07:05 | |
*** egallen has joined #openstack-meeting | 07:05 | |
*** numans has quit IRC | 07:11 | |
*** emagana has quit IRC | 07:11 | |
*** numans has joined #openstack-meeting | 07:13 | |
*** markstur has joined #openstack-meeting | 07:14 | |
*** links has joined #openstack-meeting | 07:14 | |
*** Dinesh_Bhor has joined #openstack-meeting | 07:15 | |
*** markstur has quit IRC | 07:18 | |
*** Dinesh_Bhor has quit IRC | 07:27 | |
*** felipemonteiro_ has joined #openstack-meeting | 07:27 | |
*** links has quit IRC | 07:27 | |
*** liyi has joined #openstack-meeting | 07:32 | |
*** ad_rien_ has joined #openstack-meeting | 07:35 | |
*** egallen has quit IRC | 07:37 | |
*** makowals has joined #openstack-meeting | 07:39 | |
*** felipemonteiro_ has quit IRC | 07:39 | |
*** slaweq has joined #openstack-meeting | 07:41 | |
*** wanghao_ has quit IRC | 07:43 | |
*** slaweq has quit IRC | 07:44 | |
*** wanghao has joined #openstack-meeting | 07:44 | |
*** e0ne has joined #openstack-meeting | 07:44 | |
*** links has joined #openstack-meeting | 07:45 | |
*** slaweq has joined #openstack-meeting | 07:47 | |
*** Dinesh_Bhor has joined #openstack-meeting | 07:48 | |
*** notmyname has quit IRC | 07:49 | |
*** rhagarty has quit IRC | 07:49 | |
*** d0ugal has joined #openstack-meeting | 07:51 | |
*** slaweq has quit IRC | 07:52 | |
*** notmyname has joined #openstack-meeting | 07:52 | |
*** egallen has joined #openstack-meeting | 07:52 | |
*** rhagarty has joined #openstack-meeting | 07:52 | |
*** slaweq has joined #openstack-meeting | 08:00 | |
*** armax has quit IRC | 08:08 | |
*** slaweq has quit IRC | 08:08 | |
*** rbartal has joined #openstack-meeting | 08:08 | |
*** egallen has quit IRC | 08:10 | |
*** oidgar has joined #openstack-meeting | 08:19 | |
*** tesseract has joined #openstack-meeting | 08:20 | |
*** egallen has joined #openstack-meeting | 08:21 | |
*** alexchadin has joined #openstack-meeting | 08:22 | |
*** slaweq has joined #openstack-meeting | 08:23 | |
*** Alex_Staf has joined #openstack-meeting | 08:25 | |
*** markstur has joined #openstack-meeting | 08:26 | |
*** psachin has quit IRC | 08:30 | |
*** markstur has quit IRC | 08:30 | |
*** phil_ has joined #openstack-meeting | 08:32 | |
*** phil_ is now known as Guest24178 | 08:33 | |
*** egallen_ has joined #openstack-meeting | 08:33 | |
*** egallen has quit IRC | 08:34 | |
*** egallen_ is now known as egallen | 08:34 | |
*** yamamoto_ has joined #openstack-meeting | 08:36 | |
*** daidv has quit IRC | 08:38 | |
*** tovin07_ has quit IRC | 08:38 | |
*** kiennt26 has quit IRC | 08:38 | |
*** tovin07_ has joined #openstack-meeting | 08:38 | |
*** kiennt26 has joined #openstack-meeting | 08:39 | |
*** daidv has joined #openstack-meeting | 08:39 | |
*** yamamoto has quit IRC | 08:39 | |
*** psachin has joined #openstack-meeting | 08:40 | |
*** fzdarsky has joined #openstack-meeting | 08:40 | |
*** dmacpher has joined #openstack-meeting | 08:47 | |
*** Dinesh_Bhor has quit IRC | 08:49 | |
*** markstur has joined #openstack-meeting | 08:52 | |
*** Sandeep has joined #openstack-meeting | 08:55 | |
*** Sandeep is now known as Guest17749 | 08:55 | |
*** priteau has joined #openstack-meeting | 08:56 | |
*** chenying_ has joined #openstack-meeting | 08:56 | |
*** markstur has quit IRC | 08:57 | |
chenying_ | #startmeeting karbor | 09:00 |
openstack | Meeting started Tue Jan 9 09:00:32 2018 UTC and is due to finish in 60 minutes. The chair is chenying_. Information about MeetBot at http://wiki.debian.org/MeetBot. | 09:00 |
openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 09:00 |
*** openstack changes topic to " (Meeting topic: karbor)" | 09:00 | |
openstack | The meeting name has been set to 'karbor' | 09:00 |
chenying_ | hi | 09:00 |
chenying_ | hi | 09:02 |
chenying_ | There is no topic today. If there are some topics about karbor, we can discuss them in the karbor's irc meeting. | 09:06 |
*** Dinesh_Bhor has joined #openstack-meeting | 09:08 | |
chenying_ | #endmeeting | 09:12 |
*** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/" | 09:12 | |
openstack | Meeting ended Tue Jan 9 09:12:50 2018 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 09:12 |
openstack | Minutes: http://eavesdrop.openstack.org/meetings/karbor/2018/karbor.2018-01-09-09.00.html | 09:12 |
openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/karbor/2018/karbor.2018-01-09-09.00.txt | 09:12 |
openstack | Log: http://eavesdrop.openstack.org/meetings/karbor/2018/karbor.2018-01-09-09.00.log.html | 09:12 |
*** markstur has joined #openstack-meeting | 09:13 | |
*** iyamahat has quit IRC | 09:14 | |
*** liyi has quit IRC | 09:15 | |
*** markstur has quit IRC | 09:18 | |
*** wanghao has quit IRC | 09:25 | |
*** wanghao has joined #openstack-meeting | 09:26 | |
*** wanghao has quit IRC | 09:26 | |
*** wanghao has joined #openstack-meeting | 09:26 | |
*** wanghao has quit IRC | 09:26 | |
*** wanghao has joined #openstack-meeting | 09:27 | |
*** wanghao has quit IRC | 09:27 | |
*** wanghao has joined #openstack-meeting | 09:27 | |
*** jamesmcarthur has joined #openstack-meeting | 09:28 | |
*** wanghao has quit IRC | 09:28 | |
*** wanghao has joined #openstack-meeting | 09:28 | |
*** wanghao has quit IRC | 09:29 | |
*** wanghao has joined #openstack-meeting | 09:29 | |
*** wanghao has quit IRC | 09:29 | |
*** wanghao has joined #openstack-meeting | 09:30 | |
*** wanghao has quit IRC | 09:30 | |
*** wanghao has joined #openstack-meeting | 09:31 | |
*** wanghao has quit IRC | 09:31 | |
*** wanghao has joined #openstack-meeting | 09:31 | |
*** wanghao has quit IRC | 09:32 | |
*** wanghao has joined #openstack-meeting | 09:32 | |
*** jamesmcarthur has quit IRC | 09:32 | |
*** wanghao has quit IRC | 09:33 | |
*** wanghao has joined #openstack-meeting | 09:33 | |
*** Dinesh_Bhor has quit IRC | 09:38 | |
*** iyamahat has joined #openstack-meeting | 09:42 | |
*** iyamahat has quit IRC | 09:42 | |
*** iyamahat has joined #openstack-meeting | 09:47 | |
*** yamamoto_ has quit IRC | 09:52 | |
*** erlon has joined #openstack-meeting | 09:54 | |
*** iyamahat has quit IRC | 09:56 | |
*** lpetrut has joined #openstack-meeting | 10:01 | |
*** Tom-Tom has quit IRC | 10:07 | |
*** apetrich has quit IRC | 10:09 | |
*** Guest17749 has quit IRC | 10:09 | |
*** epico has quit IRC | 10:14 | |
*** kaliya has quit IRC | 10:14 | |
*** frank_wang has quit IRC | 10:15 | |
*** yamamoto has joined #openstack-meeting | 10:16 | |
*** sambetts|afk is now known as sambetts | 10:16 | |
*** epico has joined #openstack-meeting | 10:16 | |
*** d0ugal has quit IRC | 10:19 | |
*** d0ugal has joined #openstack-meeting | 10:21 | |
*** caowei has quit IRC | 10:32 | |
*** janki has quit IRC | 10:38 | |
*** Tom-Tom has joined #openstack-meeting | 10:38 | |
*** sdague has joined #openstack-meeting | 10:40 | |
*** liyi has joined #openstack-meeting | 10:41 | |
*** Tom-Tom has quit IRC | 10:42 | |
*** priteau has quit IRC | 10:43 | |
*** tovin07_ has quit IRC | 10:43 | |
*** priteau has joined #openstack-meeting | 10:44 | |
*** liyi has quit IRC | 10:46 | |
*** hemna_ has quit IRC | 10:48 | |
*** priteau has quit IRC | 10:48 | |
*** kopecmartin has joined #openstack-meeting | 10:50 | |
*** anilvenkata_ has joined #openstack-meeting | 10:50 | |
*** chyka has joined #openstack-meeting | 10:51 | |
*** janki has joined #openstack-meeting | 10:51 | |
*** yamahata has quit IRC | 10:53 | |
*** alexchadin has quit IRC | 10:53 | |
*** anilvenkata has quit IRC | 10:54 | |
*** chyka has quit IRC | 10:55 | |
*** epico has quit IRC | 10:56 | |
*** alexchadin has joined #openstack-meeting | 10:59 | |
*** anilvenkata_ has quit IRC | 11:03 | |
*** fzdarsky is now known as fzdarsky|afk | 11:08 | |
*** priteau has joined #openstack-meeting | 11:11 | |
*** janki has quit IRC | 11:13 | |
*** janki has joined #openstack-meeting | 11:13 | |
*** priteau has quit IRC | 11:15 | |
*** jchhatbar has joined #openstack-meeting | 11:19 | |
*** janki has quit IRC | 11:22 | |
*** gmann_ has joined #openstack-meeting | 11:22 | |
*** pengdake has quit IRC | 11:35 | |
*** bkopilov has quit IRC | 11:36 | |
*** egallen has quit IRC | 11:37 | |
*** egallen has joined #openstack-meeting | 11:37 | |
*** priteau has joined #openstack-meeting | 11:38 | |
*** egallen has quit IRC | 11:41 | |
*** apetrich has joined #openstack-meeting | 11:41 | |
*** egallen has joined #openstack-meeting | 11:42 | |
*** jamesmcarthur has joined #openstack-meeting | 11:49 | |
*** liyi has joined #openstack-meeting | 11:49 | |
*** jamesmcarthur has quit IRC | 11:53 | |
*** liyi has quit IRC | 11:54 | |
*** apetrich has quit IRC | 12:01 | |
*** yamamoto has quit IRC | 12:06 | |
*** yamamoto has joined #openstack-meeting | 12:06 | |
*** ijw has quit IRC | 12:08 | |
*** alexchadin has quit IRC | 12:14 | |
*** alexchadin has joined #openstack-meeting | 12:14 | |
*** jkilpatr has quit IRC | 12:18 | |
*** raildo has joined #openstack-meeting | 12:19 | |
*** hareesh has joined #openstack-meeting | 12:23 | |
*** tlaxkit has joined #openstack-meeting | 12:24 | |
*** rbartal has quit IRC | 12:29 | |
*** rbartal has joined #openstack-meeting | 12:32 | |
*** hareesh has quit IRC | 12:34 | |
*** ijw has joined #openstack-meeting | 12:40 | |
*** liyi has joined #openstack-meeting | 12:49 | |
*** liyi has quit IRC | 12:53 | |
*** jkilpatr has joined #openstack-meeting | 12:54 | |
*** liyi has joined #openstack-meeting | 12:54 | |
*** zhurong_ has joined #openstack-meeting | 12:56 | |
*** pchavva has joined #openstack-meeting | 12:57 | |
*** bobh has joined #openstack-meeting | 12:58 | |
*** liyi has quit IRC | 12:58 | |
*** makowals has quit IRC | 13:00 | |
*** makowals has joined #openstack-meeting | 13:01 | |
*** chenyb4 has joined #openstack-meeting | 13:03 | |
*** zhurong_ has quit IRC | 13:07 | |
*** zhurong has quit IRC | 13:07 | |
*** liyi has joined #openstack-meeting | 13:08 | |
*** frank_wang has joined #openstack-meeting | 13:11 | |
*** liyi has quit IRC | 13:12 | |
*** frank_wang has quit IRC | 13:15 | |
*** bkopilov has joined #openstack-meeting | 13:17 | |
*** bobh has quit IRC | 13:17 | |
*** edmondsw has joined #openstack-meeting | 13:21 | |
*** alexchadin has quit IRC | 13:23 | |
*** alexchadin has joined #openstack-meeting | 13:24 | |
*** yangyapeng has quit IRC | 13:27 | |
*** gmann_ has quit IRC | 13:31 | |
*** Tom-Tom has joined #openstack-meeting | 13:35 | |
*** jamesmcarthur has joined #openstack-meeting | 13:38 | |
*** chenyb4 has quit IRC | 13:41 | |
*** markstur has joined #openstack-meeting | 13:42 | |
*** anilvenkata_ has joined #openstack-meeting | 13:43 | |
*** davidsha has joined #openstack-meeting | 13:44 | |
*** markstur has quit IRC | 13:47 | |
*** kiennt26_ has joined #openstack-meeting | 13:47 | |
*** esberglu has joined #openstack-meeting | 13:48 | |
*** dprince has joined #openstack-meeting | 13:48 | |
*** apetrich has joined #openstack-meeting | 13:49 | |
*** liyi has joined #openstack-meeting | 13:51 | |
*** coolsvap has quit IRC | 13:52 | |
*** mriedem has joined #openstack-meeting | 13:54 | |
*** jchhatbar has quit IRC | 13:54 | |
*** yangyapeng has joined #openstack-meeting | 13:54 | |
*** lhx_ has joined #openstack-meeting | 13:58 | |
*** shintaro has joined #openstack-meeting | 14:00 | |
*** markstur has joined #openstack-meeting | 14:03 | |
*** liyi has quit IRC | 14:03 | |
*** alexchadin has quit IRC | 14:06 | |
*** markstur has quit IRC | 14:07 | |
*** jamesmcarthur has quit IRC | 14:07 | |
*** alexchadin has joined #openstack-meeting | 14:10 | |
*** amodi has joined #openstack-meeting | 14:13 | |
*** jroll has quit IRC | 14:19 | |
*** jroll has joined #openstack-meeting | 14:19 | |
*** makowals has quit IRC | 14:21 | |
*** VW has joined #openstack-meeting | 14:22 | |
*** makowals has joined #openstack-meeting | 14:22 | |
*** markstur has joined #openstack-meeting | 14:24 | |
*** rbudden has joined #openstack-meeting | 14:24 | |
*** psachin has quit IRC | 14:28 | |
*** markstur has quit IRC | 14:28 | |
*** makowals has quit IRC | 14:29 | |
*** cleong has joined #openstack-meeting | 14:33 | |
*** shintaro has quit IRC | 14:33 | |
*** makowals has joined #openstack-meeting | 14:34 | |
*** felipemonteiro_ has joined #openstack-meeting | 14:36 | |
*** yamamoto_ has joined #openstack-meeting | 14:37 | |
*** jamesmcarthur has joined #openstack-meeting | 14:39 | |
*** yamamoto has quit IRC | 14:40 | |
*** markvoelker has quit IRC | 14:40 | |
*** eharney has joined #openstack-meeting | 14:41 | |
*** jamesmcarthur has quit IRC | 14:43 | |
*** spn has quit IRC | 14:43 | |
*** markstur has joined #openstack-meeting | 14:45 | |
*** kaisers has quit IRC | 14:45 | |
*** markstur has quit IRC | 14:49 | |
*** spn has joined #openstack-meeting | 14:50 | |
*** spn has quit IRC | 14:50 | |
*** spn has joined #openstack-meeting | 14:50 | |
*** kaisers has joined #openstack-meeting | 14:51 | |
*** ttrifonov has quit IRC | 14:55 | |
*** alexchadin has quit IRC | 14:56 | |
*** ttrifonov has joined #openstack-meeting | 14:57 | |
*** awaugama has joined #openstack-meeting | 14:59 | |
*** gouthamr has joined #openstack-meeting | 15:00 | |
*** slaweq has quit IRC | 15:02 | |
*** slaweq has joined #openstack-meeting | 15:04 | |
*** oidgar has quit IRC | 15:05 | |
*** slaweq has quit IRC | 15:09 | |
*** oidgar has joined #openstack-meeting | 15:11 | |
*** bobh has joined #openstack-meeting | 15:12 | |
*** markvoelker has joined #openstack-meeting | 15:13 | |
*** wanghao_ has joined #openstack-meeting | 15:15 | |
*** markvoelker has quit IRC | 15:16 | |
*** wanghao has quit IRC | 15:17 | |
*** armax has joined #openstack-meeting | 15:21 | |
*** egallen has quit IRC | 15:24 | |
*** egallen has joined #openstack-meeting | 15:24 | |
*** markvoelker has joined #openstack-meeting | 15:25 | |
*** longkb1 has left #openstack-meeting | 15:31 | |
*** makowals has quit IRC | 15:32 | |
*** Apoorva has joined #openstack-meeting | 15:33 | |
*** ssathaye has quit IRC | 15:34 | |
*** ssathaye has joined #openstack-meeting | 15:34 | |
*** links has quit IRC | 15:36 | |
*** slaweq has joined #openstack-meeting | 15:38 | |
*** slaweq has quit IRC | 15:42 | |
*** longkb has joined #openstack-meeting | 15:42 | |
*** kiennt26_ has quit IRC | 15:43 | |
*** david-lyle has joined #openstack-meeting | 15:44 | |
*** makowals has joined #openstack-meeting | 15:45 | |
*** felipemonteiro__ has joined #openstack-meeting | 15:45 | |
*** felipemonteiro_ has quit IRC | 15:49 | |
*** jlibosva has joined #openstack-meeting | 15:55 | |
*** markstur has joined #openstack-meeting | 15:55 | |
*** slaweq has joined #openstack-meeting | 15:56 | |
*** mlavalle has joined #openstack-meeting | 15:56 | |
*** fabian_ has joined #openstack-meeting | 15:58 | |
*** jamesmcarthur has joined #openstack-meeting | 15:59 | |
*** SerenaFeng has joined #openstack-meeting | 15:59 | |
*** jamesmcarthur has quit IRC | 15:59 | |
*** jamesmcarthur has joined #openstack-meeting | 15:59 | |
*** ihrachys has joined #openstack-meeting | 16:00 | |
*** apetrich has quit IRC | 16:00 | |
ihrachys | #startmeeting neutron_ci | 16:00 |
openstack | Meeting started Tue Jan 9 16:00:33 2018 UTC and is due to finish in 60 minutes. The chair is ihrachys. Information about MeetBot at http://wiki.debian.org/MeetBot. | 16:00 |
openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 16:00 |
*** openstack changes topic to " (Meeting topic: neutron_ci)" | 16:00 | |
openstack | The meeting name has been set to 'neutron_ci' | 16:00 |
mlavalle | o/ | 16:00 |
slaweq | hi | 16:00 |
ihrachys | heya | 16:00 |
jlibosva | o/ | 16:00 |
ihrachys | I think I happily missed the last time we were supposed to have a meeting. sorry for that. :) | 16:01 |
ihrachys | post-holiday recovery is hard! | 16:01 |
ihrachys | #topic Actions from prev meeting | 16:01 |
*** openstack changes topic to "Actions from prev meeting (Meeting topic: neutron_ci)" | 16:01 | |
ihrachys | first is "mlavalle to send patch(es) removing duplicate jobs from neutron gate" | 16:01 |
mlavalle | I did | 16:01 |
ihrachys | I believe it's https://review.openstack.org/530500 and https://review.openstack.org/531496 | 16:02 |
ihrachys | and of course we should land the last bit adding new jobs to stable: https://review.openstack.org/531070 | 16:02 |
mlavalle | yeap | 16:02 |
*** felipemonteiro__ has quit IRC | 16:03 | |
ihrachys | mlavalle, speaking of your concerns in https://review.openstack.org/#/c/531496/ | 16:03 |
*** felipemonteiro__ has joined #openstack-meeting | 16:03 | |
mlavalle | ok | 16:03 |
ihrachys | mlavalle, I would think that we replace old jobs with in-tree ones for those other projects | 16:03 |
mlavalle | ok | 16:03 |
mlavalle | will work on that | 16:03 |
ihrachys | you are too agreeable today! come on! :) | 16:03 |
*** janki has joined #openstack-meeting | 16:03 | |
*** sandanar has quit IRC | 16:03 | |
*** yamahata has joined #openstack-meeting | 16:04 | |
mlavalle | you speak with reason, so why not :-) | 16:04 |
ihrachys | mlavalle, I am not saying that's the right path; I just *assume* | 16:04 |
ihrachys | still makes sense to check with infra first | 16:04 |
mlavalle | yes I will do that | 16:04 |
mlavalle | but we don't need to rush on that patch | 16:04 |
mlavalle | as long as 530500 lands | 16:04 |
mlavalle | soon | 16:04 |
ihrachys | mlavalle, the project-config one will already remove duplicates from gate for us? | 16:04 |
mlavalle | 530500 will remove the duplication | 16:05 |
ihrachys | ok good. yeah, we can leave the second one for infra take. | 16:05 |
ihrachys | ok next item was "mlavalle to report back about result of drivers discussion on unified tempest plugin for all stadium projects" | 16:05 |
ihrachys | mlavalle, could you please give tl;dr of the discussion? | 16:06 |
mlavalle | we discussed it in the drivers meeting before the Holidays | 16:06 |
mlavalle | we will let the stadium projects join the unified tempest plugin or keep their tests in their repos | 16:06 |
mlavalle | we don't want to stretch them with more work | 16:06 |
mlavalle | sent a message to the ML last week | 16:07 |
mlavalle | and discussed it in the Neutron meeting last week | 16:07 |
mlavalle | was well received | 16:07 |
mlavalle | done | 16:07 |
ihrachys | ok cool. are there candidates who are willing to go through the exercise? | 16:08 |
mlavalle | I haven't heard | 16:08 |
mlavalle | back | 16:08 |
ihrachys | ok, fine by me! | 16:08 |
*** rbartal has quit IRC | 16:08 | |
ihrachys | next is "frickler to post patch updating neutron grafana board to include designate scenario job" | 16:08 |
ihrachys | I believe this was merged https://review.openstack.org/#/c/529822/ | 16:08 |
ihrachys | I just saw the job in grafana before the meeting, so it works | 16:08 |
ihrachys | next one is "jlibosva to close bug 1722644 and open a new one for trunk connectivity failures in dvr and linuxbridge scenario jobs" | 16:09 |
openstack | bug 1722644 in neutron "TrunkTest fails for OVS/DVR scenario job" [High,Confirmed] https://launchpad.net/bugs/1722644 | 16:09 |
*** markvoelker has quit IRC | 16:09 | |
jlibosva | I did | 16:09 |
jlibosva | https://bugs.launchpad.net/neutron/+bug/1740885 | 16:09 |
openstack | Launchpad bug 1740885 in neutron "Security group updates fail when port hasn't been initialized yet" [High,In progress] - Assigned to Jakub Libosvar (libosvar) | 16:09 |
ihrachys | the other bug doesn't seem closed | 16:09 |
jlibosva | fix is here: https://review.openstack.org/#/c/531414/ | 16:09 |
jlibosva | oops, I just wrote a comment I'm gonna close it and I acutally didn't | 16:10 |
jlibosva | closed now | 16:10 |
ihrachys | jlibosva, right. I started looking at the patch yesterday, and was wondering if the fix makes it ignore some updates from the server. can we miss an update and leave a port in old state with the fix? | 16:10 |
jlibosva | I guess so, the update stores e.g. IP in case a new port is added to remote security group. So we should still receive an update but let the implementation of flow rules deferred | 16:11 |
ihrachys | to clarify, you mean there is a potential race now? | 16:12 |
jlibosva | there has been a race and the 531414 fixes it | 16:13 |
jlibosva | it caches the new data and once the port initializes, it already has the correct data in cache | 16:13 |
ihrachys | oh I see, so there is cache involved so we should be good | 16:14 |
jlibosva | BUT | 16:14 |
jlibosva | I saw the ovsfw job failing, reporting the issue, so I still need to investigate why it fails | 16:15 |
jlibosva | I'm not able to reproduce it, I'll need to run tempest in the loop overnight and put a breakpoint once it fails so I'll be able to debug | 16:15 |
jlibosva | it's likely a different issue | 16:15 |
ihrachys | the ovsfw job was never too stable. but yeah, it's good to look into it. | 16:15 |
ihrachys | ok we have way forward here. | 16:16 |
ihrachys | next item was "jlibosva to disable trunk scenario connectivity tests" | 16:16 |
ihrachys | I believe it's https://review.openstack.org/530760 | 16:16 |
ihrachys | and it's merged | 16:16 |
jlibosva | yeah | 16:16 |
jlibosva | so now next step should be to enable it back :) | 16:16 |
jlibosva | perhaps it should be part of 531414 patch | 16:17 |
ihrachys | sure | 16:17 |
*** hongbin has joined #openstack-meeting | 16:17 | |
*** tobiash has joined #openstack-meeting | 16:18 | |
ihrachys | yeah it makes sense to have it incorporated. we can recheck it a bunch before merging. | 16:18 |
*** lpetrut has quit IRC | 16:18 | |
ihrachys | ok next was "ihrachys to report sec group fullstack failure" | 16:18 |
ihrachys | I am ashamed but I forgot about it | 16:18 |
* haleyb wanders in late | 16:19 | |
ihrachys | I will follow up after the meeting | 16:19 |
mlavalle | the Holidays joy I guess | 16:19 |
ihrachys | #action ihrachys to report sec group fullstack failure | 16:19 |
ihrachys | next item was "slaweq to debug qos fullstack failure https://bugs.launchpad.net/neutron/+bug/1737892" | 16:19 |
openstack | Launchpad bug 1737892 in neutron "Fullstack test test_qos.TestBwLimitQoSOvs.test_bw_limit_qos_port_removed failing many times" [High,Confirmed] - Assigned to Slawek Kaplonski (slaweq) | 16:19 |
slaweq | so i was debugging it for some time | 16:20 |
slaweq | and I have no idea why it is failing | 16:20 |
slaweq | I was even able to reproduce it locally once for every 20-30 runs but I don't know what is happening there | 16:20 |
slaweq | I will have to check it more still | 16:21 |
ihrachys | I see. "Also strange thing is that after test is finished, those records are deleted from ovs." <- don't we recycle ovsdb on each run? | 16:21 |
slaweq | but maybe for now I will propose patch to mark this test as unstable | 16:21 |
slaweq | ihrachys: maybe, but I'm not sure about that | 16:21 |
ihrachys | ah wait, we didn't have it isolated properly yet | 16:21 |
slaweq | no, it's same ovsdb for all tests IMO | 16:22 |
ihrachys | so if I read it right, ovsdb command is executed but structures are still in place? | 16:22 |
slaweq | yes | 16:22 |
jlibosva | could it be related to the ovsdb issue we have been hitting? that commands return TRY_AGAIN and never succeed? | 16:23 |
slaweq | and ovsdb commands are finished with success every time as I was checking it locally | 16:23 |
jlibosva | or they timeout? | 16:23 |
jlibosva | ok | 16:23 |
slaweq | no, there wasn't any retry or timeout on it | 16:23 |
jlibosva | it doesn't sound like it then | 16:23 |
slaweq | transactions was finished fine always | 16:24 |
ihrachys | could it be something recreates them after destroy? | 16:24 |
*** jkilpatr_ has joined #openstack-meeting | 16:24 | |
*** SerenaFeng has quit IRC | 16:24 | |
slaweq | ihrachys: I don't think so because I was also locally watching for them with watch command and it didn't flap or something like that | 16:24 |
slaweq | but I will check it once again maybe | 16:25 |
*** jkilpatr has quit IRC | 16:26 | |
ihrachys | ok. I think disabling the test is a good idea while we are looking into it. | 16:26 |
slaweq | ihrachys: ok, so I will do such patch today | 16:26 |
ihrachys | and those were all action items we had | 16:26 |
ihrachys | #topic Tempest plugin | 16:26 |
*** openstack changes topic to "Tempest plugin (Meeting topic: neutron_ci)" | 16:26 | |
ihrachys | I think we are mostly done with tempest plugin per se | 16:26 |
ihrachys | though there are some tempest bits in-tree that required stadium projects to switch to new repo first | 16:27 |
ihrachys | and those were not moving quick enough | 16:27 |
ihrachys | f.e. vpnaas: https://review.openstack.org/#/c/521341/ | 16:27 |
ihrachys | I recollect that mlavalle was going to talk to their representatives about moving those patches forward | 16:28 |
ihrachys | mlavalle, any news on this front? | 16:28 |
mlavalle | well, now it is my turn to say that I forgot about that | 16:28 |
mlavalle | I will follow up this week | 16:28 |
mlavalle | sorry :-( | 16:28 |
ihrachys | #action mlavalle to follow up with stadium projects on switching to new tempest repo | 16:29 |
ihrachys | that's fine it happens :) | 16:29 |
ihrachys | the list was at https://etherpad.openstack.org/p/neutron-tempest-plugin-job-move line 27+ | 16:29 |
mlavalle | ok | 16:29 |
ihrachys | afaiu we should cover vpnaas dynamic-routing and midonet | 16:29 |
*** Guest24178 has quit IRC | 16:30 | |
mlavalle | cool | 16:30 |
*** Tom-Tom has quit IRC | 16:30 | |
ihrachys | afair there were concerns about how to install the new repo, and devstack plugin was added to neutron-tempest-plugin, so stadium projects should consume it | 16:30 |
ihrachys | #topic Grafana | 16:31 |
*** openstack changes topic to "Grafana (Meeting topic: neutron_ci)" | 16:31 | |
ihrachys | http://grafana.openstack.org/dashboard/db/neutron-failure-rate | 16:31 |
ihrachys | we actually have some good news there | 16:31 |
ihrachys | linuxbridge scenario job seems to be in decent shape after recent tests disabled and security group fix | 16:31 |
ihrachys | it's at ~10% right now | 16:31 |
*** ad_rien_ has quit IRC | 16:32 | |
ihrachys | which I would say a regular failure rate one could expect from a tempest job | 16:32 |
mlavalle | ++ | 16:32 |
ihrachys | so that's good. we should monitor and eventually make it voting if it will keep the level. | 16:32 |
slaweq | nice :) | 16:32 |
jlibosva | kudos to those who fixed it :) | 16:33 |
ihrachys | dvr flavor is not as great though also down from 90% level it stayed in for months | 16:33 |
ihrachys | currently at ~40% on my chart | 16:33 |
ihrachys | and fullstack is in same bad shape. so mixed news but definitely progress on scenario side. | 16:34 |
ihrachys | kudos to everyone who was and is pushing those forward | 16:34 |
jlibosva | I see functional is now ~10%, yesterday EMEA morning, it was up to 50% | 16:34 |
*** kopecmartin has quit IRC | 16:34 | |
ihrachys | I saw a lot of weird errors in gate yesterday | 16:35 |
*** lhx_ has quit IRC | 16:35 | |
ihrachys | RETRY_TIMEOUTS and stuff | 16:35 |
ihrachys | could be that the gate was just unstable in general | 16:35 |
*** e0ne has quit IRC | 16:35 | |
*** jamesmcarthur has quit IRC | 16:35 | |
ihrachys | but we'll keep an eye | 16:35 |
ihrachys | f.e. I see a similar spike for unit tests around same time | 16:36 |
ihrachys | #topic Scenarios | 16:36 |
*** openstack changes topic to "Scenarios (Meeting topic: neutron_ci)" | 16:36 | |
ihrachys | so since linuxbridge seems good now, let's have a look at a latest failure for dvr | 16:36 |
*** makowals has quit IRC | 16:37 | |
*** markvoelker has joined #openstack-meeting | 16:37 | |
ihrachys | ok I took http://logs.openstack.org/98/513398/10/check/neutron-tempest-plugin-dvr-multinode-scenario/568c685/job-output.txt.gz | 16:37 |
ihrachys | but it seems like a timeout for the job | 16:37 |
ihrachys | took almost 3h and failed | 16:37 |
ihrachys | here is another one: http://logs.openstack.org/51/529551/4/check/neutron-tempest-plugin-dvr-multinode-scenario/ee927b8/job-output.txt.gz | 16:38 |
ihrachys | same story | 16:38 |
jlibosva | perhaps we should try now to increase the concurrency? let me check the load | 16:39 |
ihrachys | so for what I see, it either times out or it passes | 16:39 |
ihrachys | I suspect it may be related to meltdown | 16:39 |
ihrachys | we were looking yesterday in neutron channel at slowdown for rally scenarios | 16:39 |
haleyb | https://bugs.launchpad.net/neutron/+bug/1717302 still isn't fixed either | 16:39 |
openstack | Launchpad bug 1717302 in neutron "Tempest floatingip scenario tests failing on DVR Multinode setup with HA" [High,Confirmed] - Assigned to Brian Haley (brian-haley) | 16:39 |
ihrachys | x2-x3 slowdown for some scenarios | 16:39 |
ihrachys | and figured it depends on cloud and whether they are patched... | 16:40 |
*** yamamoto_ has quit IRC | 16:40 | |
jlibosva | haleyb: don't we skip the fip test cases? | 16:41 |
jlibosva | I mean that they are tagged as unstable, so skipped if they fail | 16:41 |
haleyb | oh yeah, didn't see a link in the bug | 16:41 |
ihrachys | jlibosva, we do skip them, yes | 16:41 |
*** cdub has quit IRC | 16:41 | |
*** cdub has joined #openstack-meeting | 16:41 | |
ihrachys | jlibosva, you mentioned concurrency. currently we seem to run with =2 | 16:42 |
ihrachys | would the suggestion be to run with eg. number of cpus? | 16:42 |
jlibosva | just remove the concurrency and let the runner decide | 16:42 |
ihrachys | I see most scenarios already taking like 5minutes+ each in good run | 16:42 |
*** markstur_ has joined #openstack-meeting | 16:42 | |
jlibosva | I remember I added the concurrency there because we thought the server gets choked on slow machines | 16:42 |
ihrachys | I suspect there may be hardcoded timeouts in some of scenarios we have, like waiting for a resource to come back | 16:43 |
slaweq | but wouldn't it be problem with e.g. memory consumption if You will have more treads? | 16:43 |
slaweq | (just asking) | 16:43 |
ihrachys | slaweq, there may be. especially where scenarios spin up instances. | 16:43 |
ihrachys | I guess it's easier to post a patch and recheck it to death | 16:44 |
ihrachys | and see how it fares | 16:44 |
ihrachys | I can have a look at it. need to report a bug for timeouts too. | 16:44 |
ihrachys | #action ihrachys to report bug for dvr scenario job timeouts and try concurrency increase | 16:44 |
ihrachys | it's interesting that linuxbridge doesn't seem to trigger it. | 16:45 |
ihrachys | is it because maybe more tests are executed for dvr? | 16:45 |
*** felipemonteiro_ has joined #openstack-meeting | 16:45 | |
*** markstur has quit IRC | 16:46 | |
ihrachys | it's 36 tests in dvr and 28 in linuxbridge | 16:46 |
ihrachys | some of those are dvr migration tests so that's good | 16:47 |
ihrachys | I also noticed that NetworkMtuBaseTest is not executed for linuxbridge because apparently we assume gre type driver enabled and it's not supported by linuxbridge | 16:47 |
ihrachys | we can probably configure the plugin for vxlan and have it executed for linuxbridge too then | 16:47 |
jlibosva | makes sense, let's make linuxbridge suffer too :) | 16:48 |
ihrachys | actually, it's 31 vs 21 tests | 16:48 |
ihrachys | I read the output incorrectly before | 16:48 |
ihrachys | jlibosva, huh. well it shouldn't affect much and would add coverage | 16:48 |
jlibosva | I totally agree :) | 16:49 |
ihrachys | I will report a bug for that at least. it's not critical to fix it right away. | 16:49 |
*** felipemonteiro__ has quit IRC | 16:49 | |
ihrachys | #action ihrachys to report bug for mtu scenario not executed for linuxbridge job | 16:49 |
ihrachys | anyway, the diff in total time spent for tests is ~3k seconds | 16:50 |
ihrachys | which is like 50 minutes? | 16:50 |
ihrachys | that's kinda significant | 16:50 |
jlibosva | that could be it, average test is like 390 seconds? so if you add 10 more, with concurrency two, it adds almost 30 minutes | 16:51 |
ihrachys | yeah. and linuxbridge is already 2h:20m in good run | 16:51 |
jlibosva | with bad luck using some slow cloud, it could start hitting timeouts too. That's why I think it's good to make linuxbridge suffering too, to confirm our theory :) | 16:51 |
ihrachys | add 30-50 on top and you have timeout triggered | 16:51 |
ihrachys | ok anyway, we have way forward. let's switch topics | 16:52 |
*** chyka has joined #openstack-meeting | 16:52 | |
ihrachys | #topic Fullstack | 16:52 |
*** openstack changes topic to "Fullstack (Meeting topic: neutron_ci)" | 16:52 | |
jlibosva | I remember in tempest repo, we have the slow tag so maybe we will need to start using it in the future | 16:52 |
ihrachys | jlibosva, yeah but ideally we still want to have all those executed in some way in gate | 16:52 |
ihrachys | so the best you can do is then split the job into pieces | 16:52 |
ihrachys | ok fullstack. same exercise, looking at latest runs. | 16:53 |
jlibosva | yeah, looking at times of particular tests, they all are slow | 16:53 |
ihrachys | example: http://logs.openstack.org/43/529143/3/check/neutron-fullstack/d031a6b/logs/testr_results.html.gz | 16:53 |
*** StefanPaetowJisc has joined #openstack-meeting | 16:53 | |
ihrachys | this is I believe the failure I should have reported but failed to. | 16:53 |
ihrachys | jlibosva, afaiu we don't have accelerated virtualization in infra clouds. so starting an instance takes ages. | 16:53 |
ihrachys | let's see if other fullstack runs are same | 16:54 |
ihrachys | ok this one is different: http://logs.openstack.org/98/513398/10/check/neutron-fullstack/b62a726/logs/testr_results.html.gz | 16:54 |
ihrachys | our old friend "Commands [...] exceeded timeout 10 seconds" | 16:54 |
*** StefanPaetowJisc has quit IRC | 16:54 | |
haleyb | not a very nice friend | 16:55 |
ihrachys | I recollect jlibosva reported https://bugs.launchpad.net/neutron/+bug/1741889 lately | 16:55 |
openstack | Launchpad bug 1741889 in neutron "functional: DbAddCommand sometimes times out after 10 seconds" [Critical,New] | 16:55 |
mlavalle | nope | 16:55 |
jlibosva | I thought it's more sever as by the time I reported the functional job seemed busted | 16:55 |
jlibosva | so it's not that hot anymore | 16:55 |
jlibosva | severe* | 16:56 |
mlavalle | you mean 1741889? | 16:56 |
jlibosva | yeah | 16:56 |
mlavalle | should we lower the importance then? | 16:56 |
jlibosva | possibly | 16:56 |
ihrachys | jlibosva, do you suggest that may be intermittent and same and we may no longer experience it? | 16:56 |
jlibosva | well, I mean we talked about it before, you said UT had a peak at about that time, so the bug might not be the reason for functional failure rate peak | 16:57 |
jlibosva | although it's not a nice back as it still keeps coming back in weird intervals, like twice a year :) and then it goes away | 16:58 |
ihrachys | ok I lowered to High it for now | 16:58 |
ihrachys | and added details about fullstack | 16:58 |
jlibosva | could be related to slow hw used | 16:58 |
jlibosva | dunno | 16:58 |
mlavalle | thanks | 16:58 |
jlibosva | just thinking out loud | 16:58 |
ihrachys | yeah I think it's ok to just monitor | 16:58 |
ihrachys | that other sec group failure seems more important to have a look. | 16:59 |
ihrachys | and we have some work to do for scenarios anyway till next week | 16:59 |
slaweq | I can check on this failure with SG | 16:59 |
slaweq | *check this failure | 16:59 |
ihrachys | slaweq, if you like, I would be grateful of course. | 16:59 |
slaweq | sure | 16:59 |
ihrachys | have some other pressing things on my plate so I don't insist :) | 16:59 |
ihrachys | cool! | 16:59 |
*** jamesmcarthur has joined #openstack-meeting | 16:59 | |
ihrachys | #action slaweq to take over sec group failure in fullstack (report bug / triage / fix) | 17:00 |
ihrachys | we are out of time | 17:00 |
slaweq | just to be sure, we are talking about issue liek in http://logs.openstack.org/43/529143/3/check/neutron-fullstack/d031a6b/logs/testr_results.html.gz | 17:00 |
slaweq | right? | 17:00 |
ihrachys | slaweq, yes | 17:00 |
slaweq | ok | 17:00 |
slaweq | thx | 17:00 |
*** gyee has joined #openstack-meeting | 17:01 | |
ihrachys | ok. thanks everyone for being so helpful and showing initiative. it's good it's just me slagging here, otherwise we wouldn't achieve all we did. | 17:01 |
ihrachys | #endmeeting | 17:01 |
*** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/" | 17:01 | |
openstack | Meeting ended Tue Jan 9 17:01:11 2018 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 17:01 |
openstack | Minutes: http://eavesdrop.openstack.org/meetings/neutron_ci/2018/neutron_ci.2018-01-09-16.00.html | 17:01 |
openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/neutron_ci/2018/neutron_ci.2018-01-09-16.00.txt | 17:01 |
openstack | Log: http://eavesdrop.openstack.org/meetings/neutron_ci/2018/neutron_ci.2018-01-09-16.00.log.html | 17:01 |
mlavalle | o/ | 17:01 |
jlibosva | \o | 17:01 |
slaweq | bye | 17:01 |
*** slaweq has quit IRC | 17:02 | |
*** dmacpher has quit IRC | 17:03 | |
*** sridharg has quit IRC | 17:03 | |
*** Leo_m has joined #openstack-meeting | 17:04 | |
*** Alex_Staf has quit IRC | 17:04 | |
*** armax has quit IRC | 17:05 | |
*** cdub has quit IRC | 17:05 | |
*** janki has quit IRC | 17:06 | |
*** alex_xu_ has quit IRC | 17:07 | |
*** tlaxkit has quit IRC | 17:07 | |
*** hongbin has quit IRC | 17:08 | |
*** hongbin has joined #openstack-meeting | 17:08 | |
*** cdub has joined #openstack-meeting | 17:08 | |
*** alex_xu has joined #openstack-meeting | 17:08 | |
*** jkilpatr has joined #openstack-meeting | 17:09 | |
*** jkilpatr_ has quit IRC | 17:09 | |
*** rderose has joined #openstack-meeting | 17:10 | |
*** felipemonteiro_ has quit IRC | 17:13 | |
*** fabian_ has quit IRC | 17:15 | |
*** fabian_ has joined #openstack-meeting | 17:16 | |
*** julim has quit IRC | 17:16 | |
*** julim has joined #openstack-meeting | 17:17 | |
*** fabian_ has quit IRC | 17:20 | |
*** julim has quit IRC | 17:22 | |
*** david-lyle has quit IRC | 17:23 | |
*** ricolin has quit IRC | 17:24 | |
*** jlibosva has quit IRC | 17:25 | |
*** david-lyle has joined #openstack-meeting | 17:26 | |
*** rossella_s has quit IRC | 17:27 | |
*** marios has quit IRC | 17:27 | |
*** gagehugo has joined #openstack-meeting | 17:28 | |
*** rossella_s has joined #openstack-meeting | 17:29 | |
*** Apoorva has quit IRC | 17:31 | |
*** makowals has joined #openstack-meeting | 17:33 | |
*** jamesmcarthur has quit IRC | 17:36 | |
*** egallen has quit IRC | 17:36 | |
*** StefanPaetowJisc has joined #openstack-meeting | 17:37 | |
*** yamahata has quit IRC | 17:38 | |
*** sgrasley1 has quit IRC | 17:38 | |
*** sgrasley1 has joined #openstack-meeting | 17:40 | |
*** StefanPaetowJisc has quit IRC | 17:40 | |
*** yamamoto has joined #openstack-meeting | 17:41 | |
*** jdennis has joined #openstack-meeting | 17:45 | |
*** egallen has joined #openstack-meeting | 17:46 | |
*** jamesmcarthur has joined #openstack-meeting | 17:47 | |
*** markvoelker has quit IRC | 17:47 | |
*** yamamoto has quit IRC | 17:49 | |
*** davidsha has quit IRC | 17:52 | |
*** tesseract has quit IRC | 17:57 | |
*** jessegler has joined #openstack-meeting | 17:58 | |
*** edmondsw has quit IRC | 17:58 | |
*** lamt` has joined #openstack-meeting | 17:58 | |
lbragstad | #startmeeting keystone | 18:00 |
openstack | Meeting started Tue Jan 9 18:00:17 2018 UTC and is due to finish in 60 minutes. The chair is lbragstad. Information about MeetBot at http://wiki.debian.org/MeetBot. | 18:00 |
openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 18:00 |
*** openstack changes topic to " (Meeting topic: keystone)" | 18:00 | |
openstack | The meeting name has been set to 'keystone' | 18:00 |
lbragstad | ping ayoung, breton, cmurphy, dstanek, edmondsw, gagehugo, henrynash, hrybacki, knikolla, lamt, lbragstad, lwanderley, kmalloc, rderose, rodrigods, samueldmq, spilla, aselius, dpar, jdennis, ruan_he | 18:00 |
lbragstad | #link https://etherpad.openstack.org/p/keystone-weekly-meeting | 18:00 |
lbragstad | o/ | 18:00 |
rderose | o/ | 18:00 |
kmalloc | man, is it meeting time already? I just finished my coffee... | 18:00 |
kmalloc | i need more. | 18:00 |
kmalloc | moar! | 18:00 |
*** spilla has joined #openstack-meeting | 18:00 | |
kmalloc | ;) | 18:00 |
lbragstad | better refill | 18:00 |
kmalloc | it will take like 6-10m to do so... so, i'll just wait. | 18:01 |
*** edmondsw has joined #openstack-meeting | 18:01 | |
lamt` | o/ | 18:01 |
gagehugo | o/ | 18:01 |
lbragstad | we'll give folks a minute to join | 18:01 |
*** Apoorva has joined #openstack-meeting | 18:02 | |
samueldmq | hi o/ | 18:02 |
spilla | o/ | 18:02 |
*** Apoorva has quit IRC | 18:02 | |
lbragstad | #topic announcements: PTG planning | 18:04 |
*** openstack changes topic to "announcements: PTG planning (Meeting topic: keystone)" | 18:04 | |
kmalloc | oh my ;) | 18:04 |
lbragstad | now that we're past the holidays - i've started prepping for the PTG | 18:04 |
lbragstad | #link https://etherpad.openstack.org/p/keystone-rocky-ptg | 18:04 |
samueldmq | PTG? When and where? | 18:04 |
lbragstad | last week of february | 18:05 |
lbragstad | in dublin | 18:05 |
*** rmcall has joined #openstack-meeting | 18:05 | |
samueldmq | Nice | 18:05 |
lbragstad | #link https://www.openstack.org/ptg | 18:05 |
cmurphy | o/ | 18:05 |
lbragstad | so - per our usual process | 18:05 |
lbragstad | please don't hesitate to throw topics on the etherpad | 18:05 |
lbragstad | i bootstrapped it with some content, but it certainly isn't full | 18:05 |
*** edmondsw has quit IRC | 18:06 | |
jdennis | dublin, sounds like a good venue for someone named Colleen Murphy :-) | 18:06 |
cmurphy | :) | 18:06 |
*** david-lyle has quit IRC | 18:06 | |
lbragstad | once we get closer to the PTG - we'll finalize a schedule | 18:06 |
cmurphy | they get confused by my accent there | 18:06 |
lbragstad | all in favor of cmurphy adopting an irish accent for the week? | 18:07 |
lbragstad | o/ | 18:07 |
cmurphy | >.< | 18:07 |
gagehugo | o/ | 18:07 |
lbragstad | i also have a list of attendance at the top | 18:08 |
lbragstad | if you're planning on being in dublin, please add your name | 18:08 |
lbragstad | I'd like to organize a team dinner of some kind prior to the PTG | 18:08 |
cmurphy | ++ | 18:09 |
lbragstad | no big rush there if you're still waiting on approval | 18:09 |
lbragstad | (also, if there is anything i can do to help you get approval, just DM me!) | 18:09 |
lbragstad | #topic announcement: reviews | 18:10 |
*** openstack changes topic to "announcement: reviews (Meeting topic: keystone)" | 18:10 | |
lbragstad | just a friendly reminder that feature freeze is in 16 days (not factoring in feature freeze exceptions) | 18:10 |
lbragstad | but given the rc window is only a couple week, i expect very little, if any time, for feature freeze exceptions | 18:11 |
lbragstad | we're going to have to be on the ball with feature work before that deadline | 18:11 |
lbragstad | #link https://releases.openstack.org/queens/schedule.html | 18:11 |
*** oidgar has quit IRC | 18:11 | |
lbragstad | we have four big efforts underway | 18:11 |
lbragstad | unified limits | 18:11 |
lbragstad | #link https://review.openstack.org/#/q/topic:bp/unified-limits+status:open | 18:12 |
lbragstad | application credentials #link https://review.openstack.org/#/q/status:open+project:openstack/keystone+branch:master+topic:bp/application-credentials | 18:12 |
lbragstad | tons of work to reorganize our documentation | 18:12 |
lbragstad | #link https://review.openstack.org/#/q/status:open+project:openstack/keystone+branch:master+topic:api-ref-reorganization | 18:12 |
lbragstad | and system scope work | 18:12 |
lbragstad | #link https://review.openstack.org/#/q/status:open+project:openstack/keystone+branch:master+topic:bp/system-scope | 18:12 |
cmurphy | does the docs reorg have the same feature freeze deadline? | 18:12 |
*** ekcs has joined #openstack-meeting | 18:12 | |
lbragstad | it doesn't, we can land that into the RC period | 18:13 |
lbragstad | good point cmurphy | 18:13 |
cmurphy | i guess it's mostly all done/easy reviews anyway | 18:13 |
lbragstad | i did add it to the list because of the volume of patches it generates | 18:13 |
lbragstad | the reorganization is the first box in this epic https://trello.com/c/5WCMxrLg/12-docs-goals-organization | 18:14 |
lbragstad | Suramya has been doing a good job tending to review feedback | 18:14 |
*** jamesmcarthur has quit IRC | 18:14 | |
*** jamesmcarthur has joined #openstack-meeting | 18:14 | |
lbragstad | and thanks to samueldmq for the reorganization template | 18:15 |
samueldmq | glad it helped! | 18:15 |
lbragstad | #topic announcement: office hours bugs | 18:15 |
*** openstack changes topic to "announcement: office hours bugs (Meeting topic: keystone)" | 18:15 | |
lbragstad | i went through a bunch of bugs and reworked the office-hours list | 18:16 |
lbragstad | #link https://goo.gl/PTd8bp | 18:16 |
lbragstad | feel free to check ^ out if you're interested in picking something up for office hours | 18:16 |
lbragstad | #topic questions about scope_types | 18:16 |
*** openstack changes topic to "questions about scope_types (Meeting topic: keystone)" | 18:16 | |
*** yamahata has joined #openstack-meeting | 18:16 | |
*** jkilpatr has quit IRC | 18:17 | |
lbragstad | alright - if you haven't noticed, i've been spamming our review queue with a slew of patches that add scope_types to each keystone resource | 18:17 |
lbragstad | this is essentially the other half of the equation for system-scope | 18:17 |
lbragstad | but as i worked through them, i started coming up with more questions and fixmes | 18:18 |
lbragstad | #link https://review.openstack.org/#/q/status:open+project:openstack/keystone+branch:master+topic:add-scope-types | 18:18 |
lbragstad | ^ reviews | 18:18 |
lbragstad | #link https://review.openstack.org/#/c/526159/3/keystone/common/policies/project.py@32 | 18:18 |
lbragstad | ^ that is an example of a question i have concerning both scopes | 18:18 |
* lbragstad gives folks a minute to read | 18:18 | |
*** jamesmcarthur has quit IRC | 18:19 | |
*** julim has joined #openstack-meeting | 18:19 | |
cmurphy | oof hard questions | 18:20 |
lbragstad | yes... | 18:20 |
lbragstad | which is why i'd like to discuss/get advice from you smart people :) | 18:20 |
lbragstad | ideally - keystone is going to have to start doing "scope" checks of its own | 18:20 |
lbragstad | most likely in code | 18:20 |
cmurphy | what does "relevant to that project's position in the hierarchy" mean? | 18:21 |
lbragstad | cmurphy: for example; if A is a project and has a child B which has a child C | 18:21 |
lbragstad | A -> B -> C | 18:21 |
lbragstad | and you're an administrator on project B | 18:22 |
*** jamesmcarthur has joined #openstack-meeting | 18:22 | |
lbragstad | what should happen when you call identity:list_projects with a token scoped to project B? | 18:22 |
gagehugo | would you just see B and C? | 18:22 |
cmurphy | I don't think you can assume the user has a role assignment on C | 18:22 |
lbragstad | ^ that begs another question, but you'll have to check for role inheritance | 18:23 |
lbragstad | if we don't assume a user who is admin on project B has a role on project C, then does that make identity:list_projects a system-only policy? | 18:24 |
*** jamesmcarthur has quit IRC | 18:25 | |
*** jamesmcarthur has joined #openstack-meeting | 18:25 | |
cmurphy | I think it is | 18:25 |
cmurphy | if you want just your own projects you use /v3/auth/projects | 18:26 |
lbragstad | if you're a member of a project though, should you be able to get a project? | 18:26 |
lbragstad | that's true | 18:26 |
gagehugo | ah | 18:26 |
lbragstad | so - we have a similar relationship elsewhere | 18:26 |
lbragstad | and that is the service catalog | 18:26 |
lbragstad | (the /v3/endpoint API is system-only but users can still get service catalog information via their token or GET /auth/catalog) | 18:27 |
*** Leo_m has quit IRC | 18:27 | |
*** Leo_m has joined #openstack-meeting | 18:28 | |
cmurphy | you can get /v3/projects/{project_id} on your own project | 18:28 |
cmurphy | you just can't get /v3/projects?project_id={project_id} | 18:28 |
lbragstad | so scope_types for GET /v3/projects/{project_id} is going to have to ['system', 'project'] | 18:29 |
gagehugo | that makes sense | 18:29 |
*** jamesmcarthur has quit IRC | 18:30 | |
lbragstad | if we want to refactor scope checks out of the policy definition (or check_str) and into code, then we'll have to encode that check into keystone | 18:30 |
*** esberglu has quit IRC | 18:31 | |
*** esberglu has joined #openstack-meeting | 18:31 | |
gagehugo | so keystone would be responsible for that check then? | 18:32 |
*** Apoorva has joined #openstack-meeting | 18:32 | |
kmalloc | fwiw, back to the would you see b+c bit, we never claimed heirarchy is private info | 18:32 |
kmalloc | don't try and make it so. | 18:32 |
kmalloc | it is a big big big headache to do so | 18:32 |
*** Leo_m has quit IRC | 18:32 | |
kmalloc | in the a->b->c, you'd see a,b,c | 18:33 |
kmalloc | it just has to be the way it works the current implementation and behaviors | 18:33 |
lbragstad | if you're an admin on A? | 18:33 |
kmalloc | if you're an admin on b, you still see it | 18:33 |
kmalloc | if you're and admin on a you see everything below you | 18:33 |
kmalloc | you can't obscure that without breaking api behavior | 18:34 |
gagehugo | so if you're admin on B you'll see A? or am I misreading this | 18:34 |
kmalloc | we at one point planned to implement it, but that was set aside due to the volume of headaches and issues with name being unique within a tree, etc | 18:34 |
kmalloc | gagehugo: the hierarchy above/below you is not priviledged info | 18:34 |
kmalloc | so you would see A. | 18:35 |
gagehugo | ah ok | 18:35 |
kmalloc | and C | 18:35 |
*** Tom-Tom has joined #openstack-meeting | 18:35 | |
lbragstad | hmm | 18:36 |
lbragstad | so - what about identity:get_project | 18:36 |
*** armax has joined #openstack-meeting | 18:36 | |
lbragstad | the policy just above that one | 18:36 |
kmalloc | i think we have a mis-match in behaviors between list and get | 18:36 |
kmalloc | but... | 18:36 |
kmalloc | list has historically been admin | 18:36 |
kmalloc | so.... | 18:36 |
lbragstad | if you call it with a system-scoped token and you're an admin, you can get any project | 18:37 |
lbragstad | which makes sense | 18:37 |
kmalloc | that being said, i'd be ok with anyone in the hierarchy being avble to get any project within it (as a project/domain admin) | 18:37 |
lbragstad | but if you're a member of a project and call it with a project-scoped token, what happens? | 18:37 |
kmalloc | system scope is *anything* | 18:37 |
kmalloc | and everything | 18:37 |
kmalloc | if its in your hierarchy, it should work, there is no reason to treat the project structure as priv data if it's above or directly below you. | 18:38 |
*** jkilpatr has joined #openstack-meeting | 18:38 | |
kmalloc | mostly likely if you're a project admin anything below you is game for you to see anyway | 18:38 |
kmalloc | and the way the heierarchy works for auth etc, it is important for folks to know where in the tree they are | 18:38 |
kmalloc | i'd let get_project fly in those casesd. | 18:38 |
lbragstad | should a user be able to get /v3/projects/{project_id} if they aren't a member of that project? | 18:39 |
lbragstad | or don't have a role assignment on it? | 18:39 |
kmalloc | if it is above/below the project they're in. | 18:39 |
lbragstad | what if we're talking about flat structures | 18:39 |
kmalloc | peers are not covered | 18:40 |
kmalloc | so, flat is no. | 18:40 |
kmalloc | basically a->b a->q | 18:40 |
kmalloc | b can't see q | 18:40 |
kmalloc | q cant get b | 18:40 |
lbragstad | (all of this is going to have to be coded into keystone somewhere) | 18:40 |
kmalloc | but a can get ba and q | 18:40 |
kmalloc | yes. | 18:40 |
lbragstad | so getting back to my original question, where do we want this type of stuff to live | 18:40 |
lbragstad | ? | 18:40 |
kmalloc | so. | 18:41 |
kmalloc | you're going to have to add the logic into the resource manager | 18:41 |
kmalloc | or we'd break behavior(s) | 18:41 |
kmalloc | because mving to systemscope, you still have to support the current mode of operations | 18:41 |
lbragstad | because it's business logic? | 18:41 |
kmalloc | yeah | 18:41 |
kmalloc | and because it's business logic | 18:41 |
lbragstad | ok - that makes sense | 18:41 |
kmalloc | it's not driver and it's not REQ<->SerializedOutput | 18:42 |
lbragstad | so - that means we're going to need some level of request information in the manager | 18:42 |
lbragstad | and the policy operation, too | 18:42 |
kmalloc | which is doable via the threadlocal request data | 18:42 |
lbragstad | so the managers can reason about it, right? | 18:42 |
kmalloc | or should be if we're using oslo.context correctly | 18:42 |
kmalloc | yeah. | 18:42 |
lbragstad | ok | 18:43 |
kmalloc | this is why it's important to break apart the @protected decorator | 18:43 |
lbragstad | and do policy enforcement inline | 18:43 |
kmalloc | because there are more Policy Enforcement Points because of the system scope and added business logic | 18:43 |
kmalloc | yeah, you need to do some of this in-line. the callback system, etc wont cover it | 18:44 |
*** slaweq has joined #openstack-meeting | 18:44 | |
kmalloc | but managers can/should be able to look at thread local data | 18:44 |
lbragstad | right - which either bloats the @protected decorator or creates more business logic in the manager | 18:44 |
kmalloc | noooow. we also need to make sure to handle cases where thread local data isn't populated | 18:44 |
kmalloc | aka, keystone-manage bootstrap | 18:44 |
kmalloc | but in 99% of the cases context should be populated from a request | 18:45 |
kmalloc | 99.9 | 18:45 |
*** dprince has quit IRC | 18:45 | |
lbragstad | hmm | 18:45 |
*** gouthamr has quit IRC | 18:46 | |
*** slaweq has quit IRC | 18:46 | |
kmalloc | it's a simple edge cased, and the thread local could be populated by keystone-manage bootstrap with something like is_bootstrap=True | 18:46 |
lbragstad | yeah | 18:46 |
kmalloc | so we can dodge it w/o breaking the security model by just passing if context isn't populated sanely | 18:46 |
lbragstad | so - i imagine most reviews in the scope_types topic to generate some discussion like this | 18:47 |
lbragstad | (i've highlighted the bits i see with FIXMEs) | 18:47 |
lbragstad | but this is going to be a pretty significant amount of work | 18:47 |
lbragstad | thoughts on how we should track it? | 18:48 |
lbragstad | bug per FIXME? bug per a resource's FIXMEs? | 18:48 |
kmalloc | either works | 18:48 |
*** irenab has quit IRC | 18:48 | |
kmalloc | as long as we're tracking it | 18:48 |
kmalloc | i like fewer bugs, but wouldn't argue for per fixme | 18:48 |
*** oanson has quit IRC | 18:48 | |
*** gouthamr has joined #openstack-meeting | 18:48 | |
lbragstad | ++ | 18:48 |
kmalloc | argue against* | 18:49 |
lbragstad | so something like "correct system scope and project scope for the project resource": | 18:49 |
lbragstad | and the fix for it will correct all FIXMEs in https://review.openstack.org/#/c/526159/3/keystone/common/policies/project.py | 18:49 |
*** rderose has quit IRC | 18:50 | |
*** felipemonteiro has joined #openstack-meeting | 18:51 | |
kmalloc | i like that | 18:52 |
lbragstad | ok - so it sounds like we can discuss the intended behavior of the each resource in review | 18:53 |
lbragstad | document the outcome in FIXMEs | 18:53 |
lbragstad | and then i'll open bugs when they merge pointing to the FIXMEs so that we can track the work | 18:53 |
*** Shrews has joined #openstack-meeting | 18:54 | |
lbragstad | i think this gives me enough to get started | 18:54 |
lbragstad | #topic open discussion | 18:54 |
*** openstack changes topic to "open discussion (Meeting topic: keystone)" | 18:54 | |
lbragstad | floor is open if anyone has anything | 18:55 |
kmalloc | yeah i have a question | 18:56 |
kmalloc | what if you get scared half to death twice? | 18:56 |
kmalloc | *shiftyeyes* | 18:56 |
gagehugo | would you be scared to 3/4th death then total? | 18:56 |
lbragstad | kmalloc: you're not factoring in health regen | 18:56 |
kmalloc | ok ok... | 18:57 |
lbragstad | because gagehugo's factors that in | 18:57 |
lbragstad | :) | 18:57 |
*** amodi has quit IRC | 18:57 | |
kmalloc | if one syncronised swimmer drowns... do they all follow in suit? | 18:57 |
*** sshnaidm has joined #openstack-meeting | 18:57 | |
kmalloc | ok ok i'm done | 18:57 |
lbragstad | alright - time to refill your beverage before office hours! | 18:58 |
lbragstad | thanks for the time folks | 18:58 |
lbragstad | #endmeeting | 18:58 |
*** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/" | 18:58 | |
openstack | Meeting ended Tue Jan 9 18:58:26 2018 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 18:58 |
openstack | Minutes: http://eavesdrop.openstack.org/meetings/keystone/2018/keystone.2018-01-09-18.00.html | 18:58 |
openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/keystone/2018/keystone.2018-01-09-18.00.txt | 18:58 |
openstack | Log: http://eavesdrop.openstack.org/meetings/keystone/2018/keystone.2018-01-09-18.00.log.html | 18:58 |
*** spilla has left #openstack-meeting | 18:58 | |
*** jdennis has left #openstack-meeting | 18:59 | |
clarkb | Hello infra, anyone here for the meeting? | 18:59 |
ianw | yes | 18:59 |
pabelanger | o/ | 19:00 |
clarkb | ianw: good morning! | 19:00 |
clarkb | and welcome back | 19:00 |
corvus | o/ | 19:00 |
Shrews | hola | 19:01 |
clarkb | #startmeeting infra | 19:01 |
openstack | Meeting started Tue Jan 9 19:01:15 2018 UTC and is due to finish in 60 minutes. The chair is clarkb. Information about MeetBot at http://wiki.debian.org/MeetBot. | 19:01 |
openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 19:01 |
*** openstack changes topic to " (Meeting topic: infra)" | 19:01 | |
openstack | The meeting name has been set to 'infra' | 19:01 |
clarkb | #link https://wiki.openstack.org/wiki/Meetings/InfraTeamMeeting#Agenda_for_next_meeting | 19:01 |
clarkb | #topic Announcements | 19:01 |
*** openstack changes topic to "Announcements (Meeting topic: infra)" | 19:01 | |
* mordred waves | 19:01 | |
clarkb | I will be traveling for meetings on January 23rd so will not be able to run or attend the infra meeting | 19:02 |
fungi | i'm back, just in the nick of time | 19:02 |
clarkb | that is the meeting after next | 19:02 |
clarkb | I think fungi is in this same boat too. | 19:02 |
mordred | fungi: I thought you were back in the nick of fungi | 19:02 |
fungi | i'll be on the same trip, so can't volunteer to chair | 19:02 |
clarkb | would be great if someone else was able to run that assumed we aren't all traveling at the same time | 19:02 |
clarkb | let me know if you are interested | 19:02 |
fungi | pabelanger and ianw have chaired meetings in my stead in the past, fwiw | 19:03 |
ianw | happy to if nobody else wants to | 19:03 |
pabelanger | yah, happy to help, unless somebody else wants to try :) | 19:03 |
fungi | who ever _wants_ to chair a meeting? ;) | 19:03 |
clarkb | #topic Actions from last meeting | 19:03 |
*** openstack changes topic to "Actions from last meeting (Meeting topic: infra)" | 19:03 | |
clarkb | #link http://eavesdrop.openstack.org/meetings/infra/2018/infra.2018-01-02-19.06.txt minutes from last meeting | 19:04 |
clarkb | there were none \o/ | 19:04 |
fungi | success! | 19:04 |
clarkb | #topic Specs approval | 19:04 |
*** openstack changes topic to "Specs approval (Meeting topic: infra)" | 19:04 | |
clarkb | I don't think there are any specs up for approval right now. But I do still intend on cleaning up our specs list after fungi's jenkins vote removal bubbled a bunch of old ones to the front of the list | 19:04 |
* fungi is happy to tale the blame for people noticing old changes in review | 19:05 | |
corvus | i didn't put it on the agenda, but i'd like to issue a request for collaboration on https://review.openstack.org/531242 | 19:05 |
clarkb | Also worth mentioning there is an irc bot improvement spec that we should be reviewing which is related to handling the irc spam freenode has been seeing recently | 19:05 |
corvus | clarkb: ya that :) | 19:05 |
fungi | er, s/tale/take/ | 19:05 |
clarkb | it would be helpful if you could rebase your old specs if they are still valid and abandon them otherwise | 19:05 |
clarkb | I will be going through and doing this for specs whose owners are less active now | 19:06 |
clarkb | #link https://review.openstack.org/531242 irc bot improvement spec | 19:06 |
pabelanger | Yah, I have a spec or 2 to rebase | 19:06 |
corvus | please get me feedback on that soon, and i'll put it on the agenda for approval | 19:06 |
fungi | thanks for the reminder on the irc spec | 19:06 |
dmsimard | \o sorry I'm late | 19:07 |
clarkb | #topic Priority Efforts | 19:07 |
*** openstack changes topic to "Priority Efforts (Meeting topic: infra)" | 19:07 | |
clarkb | #topic Storyboard | 19:07 |
*** openstack changes topic to "Storyboard (Meeting topic: infra)" | 19:07 | |
dmsimard | There is also the ARA spec, I was waiting on one more review or two before spinning up a new draft: https://review.openstack.org/#/c/527500/ | 19:07 |
dmsimard | oops | 19:08 |
clarkb | #undo | 19:08 |
openstack | Removing item from minutes: #topic Storyboard | 19:08 |
clarkb | #undo | 19:08 |
openstack | Removing item from minutes: #topic Priority Efforts | 19:08 |
clarkb | #link https://review.openstack.org/#/c/527500/ ARA dashboard spec | 19:08 |
clarkb | dmsimard: you might want to rebase it and push a new patchset anyways as it is merge conflicted which a lot of people filter out | 19:08 |
dmsimard | I can do that. | 19:09 |
clarkb | #topic Priority Efforts | 19:09 |
*** openstack changes topic to "Priority Efforts (Meeting topic: infra)" | 19:09 | |
clarkb | #topic Storyboard | 19:09 |
*** openstack changes topic to "Storyboard (Meeting topic: infra)" | 19:09 | |
clarkb | We don't often have storyboard topics in this meeting but I wanted to mention that I have nominated diablo_rojo as storyboard core | 19:10 |
clarkb | diablo_rojo has been actively reviewing and shepherding storyboard changes recently and want ot encourage more of that. | 19:10 |
*** david-lyle has joined #openstack-meeting | 19:10 | |
clarkb | (this in addition to helping projects work through the migration to storyboard) | 19:10 |
clarkb | there is an email thread on the infra list if you want to chime in | 19:10 |
clarkb | #topic Zuul v3 | 19:11 |
*** openstack changes topic to "Zuul v3 (Meeting topic: infra)" | 19:11 | |
corvus | See my email about mailing lists | 19:11 |
clarkb | I've almost got the zuulv3-issues etherpad cleared out by either tracking down things as fixed, fixing them, or creating bugs. | 19:11 |
corvus | #link zuul mailing list email http://lists.openstack.org/pipermail/openstack-infra/2018-January/005758.html | 19:11 |
fungi | zuul mailing lists double-plus good | 19:12 |
corvus | clarkb: thanks! | 19:12 |
corvus | note that clarkb added two 3.0 release blocking bugs to storyboard | 19:12 |
fungi | mmedvede' | 19:12 |
corvus | so there's work available there | 19:12 |
diablo_rojo | thanks clarkb :) | 19:13 |
fungi | s puppet changes are looking good | 19:13 |
corvus | fungi: oh great! | 19:13 |
clarkb | fungi: is there a topic or other gerrit query we can use to find those? | 19:13 |
* fungi apologizes for having his return key adjacent to his apostrophe) | 19:13 | |
corvus | fungi: i fixed that, it's next to my | 19:13 |
*** markvoelker has joined #openstack-meeting | 19:13 | |
corvus | - | 19:13 |
corvus | key | 19:13 |
clarkb | (they are on my list of things to followup on to make sure we are progressing towards a merged feature branch) | 19:13 |
fungi | hah | 19:13 |
*** markvoelker has quit IRC | 19:13 | |
mordred | fyi for folks, we're working on turning on testing ansible PRs from their github repo - https://review.openstack.org/#/q/topic:turn-on-ansible is the stack ATM | 19:14 |
fungi | clarkb: good question. i simply found them looking in openstack-infra/puppet-openstackci open changes | 19:14 |
corvus | fungi: are they just ready for a +3 or are we going to need to be careful? | 19:14 |
clarkb | fungi: thanks | 19:14 |
corvus | #link puppet-openstack changes https://review.openstack.org/523951 | 19:14 |
fungi | i think they're probably ready for +3 since they default to zuul 2.x code paths, but eatra reviews are of course strongly recommended | 19:14 |
fungi | er, extra | 19:14 |
fungi | not eatra | 19:15 |
fungi | but that should totally be a word | 19:15 |
corvus | mordred: that's so cool. i'm hoping to follow that up shortly with cross-source deps which will be nice to have in place before we make any big announcements (that way we can show people a change in ansible depending on a change in shade!) | 19:15 |
clarkb | mordred: corvus will/are we reporting to github yet? | 19:15 |
clarkb | or is it currently just commenting on gerrit changes? | 19:15 |
mordred | we are not yet reporting to github but will be by the end of that stack | 19:16 |
* fungi wants a change in nodepool depending on a change in ansible depending on a change in shade | 19:16 | |
clarkb | and ansible knows that this is happening and won't hunt us down? | 19:16 |
mordred | currently iterating on the test job to make sure it's actually, you know, testing the right thing | 19:16 |
fungi | i recently had a change in pbr which depended on a change in setuptools | 19:16 |
fungi | but alas, no zuul support for me | 19:16 |
corvus | so we'll start reporting... poke at things a bit, make sure it looks good, add in cross-source deps, test that out, then show people how cool it all is | 19:16 |
mordred | clarkb: yup! | 19:16 |
*** Leo_m has joined #openstack-meeting | 19:16 | |
clarkb | cool | 19:16 |
pabelanger | exciting times | 19:17 |
fungi | and not even in the ancient chinese proverb sense | 19:17 |
mmedvede | o/ | 19:17 |
clarkb | mmedvede: other than reviews is there anything we need to be doing or aware of in updating puppet-openstackci? | 19:17 |
fungi | clarkb: luckily, we have robyn to prevent ansible people from _actually_ hunting us down | 19:18 |
corvus | incidentally, the implementation path i've chosen for cross-source deps should let us leave error messages on changes when there are dependency cycles. that's a long-requested feature. | 19:18 |
mmedvede | clarkb: well, it is more work than I initially thought it would be :) | 19:18 |
fungi | corvus: i missed that tidbit... amazing! | 19:18 |
dmsimard | corvus++ | 19:19 |
corvus | fungi: it's not there yet -- will probably happen in a followup. but i'm laying groundwork. | 19:19 |
mordred | corvus: \o/ | 19:19 |
clarkb | corvus: I filed two bugs related to that that are not marked 3.0 just 3 | 19:19 |
fungi | color me excited | 19:19 |
clarkb | corvus: one is lack of reporting the other is detecting cycles when there isn't a proper cycle | 19:19 |
clarkb | alright any other zuul v3 related items? | 19:20 |
corvus | nak | 19:20 |
mmedvede | clarkb: I am restarting work on puppet-openstackci, would follow up outside of meeting with you if you got a moment | 19:21 |
clarkb | mmedvede: sure | 19:21 |
clarkb | #topic General Topics | 19:21 |
*** openstack changes topic to "General Topics (Meeting topic: infra)" | 19:21 | |
clarkb | Meltdown/Spectre! | 19:21 |
corvus | it's the 9th is ubuntu updated? | 19:21 |
fungi | i've melted down at least a few spectres already | 19:21 |
clarkb | corvus: they have not | 19:21 |
clarkb | corvus: there are kernels in testing though, but they haven't listed one for trusty unless you use the xenial kernel on trusty :/ | 19:22 |
fungi | debian was pretty johnny-on-the-spot, but it's hard to beat openbsd getting patches in more than a decade ago | 19:22 |
clarkb | fungi: debian still doesn't have kernel for jessie for me :/ | 19:22 |
corvus | #link ubuntu meltdown/spectre https://wiki.ubuntu.com/SecurityTeam/KnowledgeBase/SpectreAndMeltdown | 19:22 |
*** jessegler has quit IRC | 19:22 | |
fungi | clarkb: it's called 'apt dist-upgrade' to stretch :/ | 19:22 |
clarkb | fungi: ya I should probably upgrade the entire OS | 19:23 |
fungi | lts security is not handled by the debian security team, alas | 19:23 |
corvus | meanwhile, the meltdown POC was published today... | 19:23 |
*** markvoelker has joined #openstack-meeting | 19:23 | |
dmsimard | In the meantime, I've (for another purpose) made what should be a cross-distro playbook that allows to see what hosts are patched and which aren't | 19:23 |
clarkb | anyways tl;dr for us is this: | 19:23 |
mordred | fungi: so we should be migrating to openbsd, yeah? | 19:23 |
dmsimard | I'll clean it up and we can use it to keep an inventory of which host needs to be patched still | 19:23 |
fungi | mordred: i'm running a bunch of it at home since long ago | 19:23 |
*** sambetts is now known as sambetts|afk | 19:23 | |
clarkb | Our CentOS machines (git*.openstack.org) are all patched and running with page table isolation. We are waiting for ubuntu to publish kernel updates for the rest of our control plane. | 19:23 |
corvus | dmsimard: sounds cool, thx | 19:23 |
fungi | and i gather you can run openbsd virtual machines as long as you don't need pv guests, but i still need to try that myself | 19:24 |
clarkb | The test node VMs will automagically pick up new kernels as part of daily rebuilds | 19:24 |
clarkb | Rackspace as a Xen user is for the most part not affected by meltdown | 19:24 |
clarkb | so I think concern about side channel attacks attacking our control plane is relatively minor | 19:24 |
dmsimard | We don't upload any secrets from the executor to the test nodes, do we ? | 19:24 |
fungi | their hypervisor layer not particularly impacted still doesn't change that we need to upgrade our guest layer kernels though | 19:24 |
dmsimard | (since we don't control the state of each nodepool provider) | 19:25 |
pabelanger | dmsimard: yes, AFS credentials | 19:25 |
clarkb | fungi: correct | 19:25 |
*** timcline has joined #openstack-meeting | 19:25 | |
ianw | clarkb: i'm assuming etherpad/ethercalc are pretty much where we left them before break? | 19:25 |
clarkb | also everyone should use firefox and make sure it is up to date as it has meltdown mitigation built in. Chrom* will get updatedon the 23rd | 19:25 |
clarkb | ianw: ya | 19:25 |
ianw | ok, should get back to that, as part of this too | 19:26 |
corvus | pabelanger: what job uploads afs creds to nodepool nodes? | 19:26 |
dmsimard | pabelanger: we mount the AFS on the test nodes ? | 19:26 |
dmsimard | actually, creds should only be required for writing I would guess ? since read only is unauthenticated | 19:26 |
pabelanger | corvus: dmsimard our wheel builders | 19:26 |
pabelanger | let me get jobs | 19:26 |
dmsimard | pabelanger: the contents aren't recovered by the executor like logs or other artifacts would be ? | 19:27 |
* dmsimard is totally unfamiliar with the wheel build process | 19:27 | |
fungi | the bigger concern is whether we put decrypted secrets on systems where we run untrusted code. to the extent that our (config-core) reviews are thorough, that shouldn't be the case | 19:27 |
clarkb | as soon as Ubuntu does publish kernels (which is supposed to be today), it would be much appreciated if we could have a semi organized patching "sprint" | 19:28 |
corvus | that's not running proposed code though, that's a job we control centrally. however, it may be running code in python packages that build wheels. but that's not a new attact vector. | 19:28 |
dmsimard | yeah, I thought secrets were meant to stay on the executor -- but that tells me there's nothing preventing a project from sending the secret(s) to the test nodes | 19:28 |
pabelanger | publish-wheel-mirror-centos-7 for example will use secrets on nodepool node | 19:28 |
clarkb | maybe we can all hop in the incident channel and start working through it and partition out servers | 19:28 |
corvus | dmsimard: secrets are meant to be used however needed | 19:28 |
clarkb | corvus: +1 | 19:28 |
clarkb | er +1 to not new attack vector | 19:29 |
fungi | agreed, ping infra-root in #-incident as soon as someone notices ubuntu trusty and/or xenial kernel updates addressing meltdown | 19:29 |
fungi | i'm happy to pitch in on upgrading/rebooting if i'm at a computer | 19:29 |
clarkb | I will likely end up making that my priority once we have packages | 19:30 |
corvus | as with anything, each piece of privileged information needs to be thought about and risk evaluated. there's no hard rule we can make about secrets. | 19:30 |
dmsimard | corvus: what I am saying is that if secrets are used in test nodes, then they are vulnerable if the test node is running in an unpatched nodepool cloud provider | 19:30 |
corvus | dmsimard: i agree. | 19:30 |
*** apetrich has joined #openstack-meeting | 19:30 | |
clarkb | yup, but those creds have alway sbeen vulnerable to attacks through the package builds | 19:30 |
fungi | dmsimard: to the extent that the jobs/code running there aren't approved by the same people who know the secret | 19:30 |
clarkb | fungi: no, just running the job opens it to attack | 19:31 |
clarkb | or maybe thats what you mean by approved | 19:31 |
fungi | attack from... | 19:31 |
dmsimard | fungi: meltdown | 19:31 |
dmsimard | in $vulnerablecloud | 19:31 |
clarkb | via other cloud users | 19:31 |
fungi | using secrets in jobs which run proposed patches is already a huge no-no | 19:31 |
clarkb | fungi: the attack vector is ovh customers | 19:31 |
dmsimard | regardless if it's proposed, post, or release | 19:31 |
fungi | ohm, in providers who haven't secured their hypervisor hosts? yes indeed | 19:31 |
clarkb | compeltely unrelated to us | 19:32 |
dmsimard | right | 19:32 |
clarkb | so this increases the risk of exposure of the credentials but I don't think it does so greatly | 19:32 |
corvus | so that job is now vulnerable to evil package maintainers, and other customers on unpatched nodepool cloud providers | 19:32 |
*** priteau has quit IRC | 19:32 | |
corvus | (whereas it used to only be the first -- a risk we deemed acceptable) | 19:32 |
dmsimard | It's probably not that big of a risk, but it's worth keeping in mind and generally try to keep secrets off of test nodes where possible | 19:33 |
clarkb | dmsimard: yup | 19:33 |
*** harlowja has joined #openstack-meeting | 19:33 | |
fungi | agreed | 19:33 |
corvus | dmsimard: i'm not going to agree with we should try to keep secrets off test nodes where possible | 19:33 |
corvus | i'm only going to go as far as we need to keep that risk in mind when we evaluate where we use secrets | 19:34 |
fungi | yep, if a job using a secret doesn't need to run arbitrary code and can leverage the bwrap environment on the executor, that's best | 19:34 |
clarkb | corvus: I think it is part of the risk assessment, and then we decide if we can accept possible insecure_cpu/cloud bugs | 19:34 |
clarkb | corvus: ++ | 19:34 |
dmsimard | Given the choice of using the secret on the executor or on the test node, I'd keep it on the executor if it doesn't mean jumping through 10 hoops | 19:34 |
pabelanger | what about jobs that are using docker credentials, should we post something to warn about exposure? Or hope they understand it | 19:34 |
fungi | but secrets on executors are only actually safe if the other rackspace guests on the same hosts aren't 64-bit pv flavor | 19:34 |
corvus | (and to be really specific, i would like to eventually put a secrets on the test node so that we don't have to route logs through the executor) | 19:34 |
fungi | so, it's still up to the provider to provide proper security | 19:35 |
dmsimard | corvus: an approach we have for RDO is that we have the logserver pull the logs instead of having the test nodes push the logs | 19:35 |
corvus | so i'm not going to climb on board any rule that precludes that. i'm happy to have a discussion about the risks when we do. | 19:35 |
dmsimard | i.e, the log server has a ssh key that grants access to the test nodes | 19:35 |
pabelanger | We talked about that before, but didn't implement it for some reason | 19:35 |
corvus | let's not turn this into a discussion about that. i don't have a proposal. | 19:36 |
clarkb | pabelanger: it may be worth a note, maybe when the dust settles and we can speak with a bit more concrete info (eg find out when $clouds say they are patched, after we are patched and so on) | 19:36 |
corvus | i merely cite it as an example of why i disagree with the blanket statement. | 19:36 |
fungi | yeah, this is not the venue for redesigning test log publishing | 19:36 |
dmsimard | sure | 19:36 |
clarkb | pabelanger: right now I don't think we have enough concrete info other than "please don't panic but be aware of this" | 19:36 |
pabelanger | clarkb: agree | 19:36 |
clarkb | other than the general situation update adn call for help once we have packages I' | 19:37 |
clarkb | m not sure there is much more to talk about here | 19:37 |
clarkb | #topic Project Renames | 19:37 |
*** openstack changes topic to "Project Renames (Meeting topic: infra)" | 19:37 | |
dmsimard | clarkb: you missed a topic | 19:37 |
fungi | or he's reordering them | 19:38 |
clarkb | dmsimard: refresh confirms | 19:38 |
clarkb | no I had missed it | 19:38 |
clarkb | #undo | 19:38 |
openstack | Removing item from minutes: #topic Project Renames | 19:38 |
clarkb | was added late | 19:38 |
dmsimard | added it shortly before meeting, sorry :) | 19:38 |
clarkb | sshnaidm: are you around? | 19:38 |
sshnaidm | clarkb, yep | 19:38 |
clarkb | "Allow jobs to send data to graphite.openstack.org" | 19:39 |
sshnaidm | the question I wanted to ask - is it possible to do in general? | 19:39 |
sshnaidm | I know now it's firewalled | 19:39 |
corvus | i'd like to make sure everyone is aware of and has read this spec: | 19:39 |
corvus | #link qa counter spec https://specs.openstack.org/openstack/qa-specs/specs/devstack/counter-inspection.html | 19:39 |
clarkb | sshnaidm: the spec corvus linked has a specific way to accomplish this despite the firewall | 19:40 |
dmsimard | a target of mitaka-2, nice | 19:40 |
clarkb | I think that approach is still valid | 19:40 |
corvus | it is partially implemented, and probably needs a little bit of updating because it predates zuulv3 and the changes we made to subunit processing, but the approach is still largely viable and is important prior work | 19:40 |
sshnaidm | clarkb, yeah, I ready it briefly | 19:40 |
*** harlowja_ has joined #openstack-meeting | 19:41 | |
dmsimard | from skimming the spec, it's the same approach as openstack-health and logstash-workers ? | 19:41 |
sshnaidm | clarkb, it seems close, but not really what is done in jobs | 19:41 |
clarkb | the appraoch should also be generally applicable to all jobs | 19:41 |
clarkb | sshnaidm: meaning it doesn't meet your usecase? | 19:41 |
sshnaidm | clarkb, maybe I miss something in docs, but what I need actually it's to send some my custom statistics to some statistics server (graphite/influx/whatever) | 19:42 |
clarkb | sshnaidm: yes that is what that spec is for | 19:42 |
sshnaidm | clarkb, during the job run | 19:42 |
fungi | i haven't looked closely at the spec, but is there no sane way to ship the stats back to the executor and let it emit them? | 19:42 |
dmsimard | sshnaidm: why would it be a problem if you send the data after the job is complete ? | 19:42 |
clarkb | sshnaidm: jobs will collect the data then as part of the log publishing and processing we write the info to graphite | 19:42 |
*** markvoelker has quit IRC | 19:42 | |
sshnaidm | clarkb, ok, just maybe confused by subunit, mysql and other stuff there.. | 19:43 |
clarkb | sshnaidm: it is just pointing out that subunit2sql and logstash already use a similar data flow | 19:43 |
sshnaidm | dmsimard, post playbook is ok, of course | 19:43 |
*** markvoelker has joined #openstack-meeting | 19:43 | |
clarkb | sshnaidm: and SpamapS was explicitly interested in mysql stats | 19:43 |
*** harlowja has quit IRC | 19:43 | |
fungi | ahh, so basically what i was asking. i should definitely look over the spec | 19:43 |
sshnaidm | clarkb, ok, so we need just to wait afaiu | 19:43 |
clarkb | Probably the best approach here is to work to implement that spec and update it where it needs to be updated | 19:43 |
dmsimard | sshnaidm: yeah, the approach in how we currently ask logstash and openstack-health to index data involves a post playbook | 19:43 |
clarkb | sshnaidm: I don't think anyone is actively working it. | 19:44 |
corvus | sshnaidm: oh, no. SpamapS is not working on that spec. if you want this to happen, someone will need to work on it. | 19:44 |
fungi | waiting isn't likely to get you much unless there is someone else actively implementing | 19:44 |
ianw | sshnaidm: you might be interested in something like https://review.openstack.org/#/c/434625/ ; that is an example of adding coverage output to the subunit stream | 19:44 |
sshnaidm | corvus, clarkb ok.. it it tracked anywhere? | 19:44 |
SpamapS | hmmm? | 19:44 |
corvus | sshnaidm: i'd recommend talking to SpamapS to find out what's completed and what maybe should be changed. | 19:44 |
clarkb | sshnaidm: you'd have to ask the qa team probably, or SpamapS | 19:44 |
SpamapS | Indeed, I don't, unfortunately, have bandwidth to finish the perf stats spec. :-/ | 19:45 |
*** timcline has quit IRC | 19:45 | |
SpamapS | Happy to advise anyone who wants to pick it up. | 19:45 |
sshnaidm | ok, thanks, will try to poke there | 19:45 |
clarkb | sshnaidm: ^ does that work as a starting point? | 19:45 |
dmsimard | I'm sure a lot of projects could benefit from that spec -- I've seen kolla implement a self-contained collectd recently | 19:45 |
dmsimard | (for the purpose of tracking gate job resource usage and performance data) | 19:45 |
SpamapS | Yeah! | 19:46 |
SpamapS | I wanted to do that too. :) | 19:46 |
*** amodi has joined #openstack-meeting | 19:46 | |
dmsimard | sshnaidm: I can help point you in the right direction | 19:46 |
clarkb | cool sounds like we have a rough starting point/plan | 19:46 |
sshnaidm | dmsimard, great | 19:46 |
corvus | dmsimard: wait -- they implemented it just for kolla? | 19:46 |
clarkb | corvus: I think its more that kolla deployed clouds need that tooling anyways | 19:46 |
clarkb | corvus: so they implemented it for their users (and may also take advantage of it in jobs) | 19:47 |
dmsimard | corvus: it's a collectd implementation that generates a html page at the end and the html page is stored in the logs | 19:47 |
sshnaidm | dmsimard, well, in tripleo we also run dstat that collect data.. just not sending it anywhere | 19:47 |
corvus | dmsimard: oh that makes sense... i thought you were saying they stood up a private collectd | 19:47 |
ianw | sshnaidm: https://review.openstack.org/#/c/436768/5/specs/coverage-tracking.rst also has a bunch of info on subunit streams and how they plug in | 19:47 |
ianw | to openstack-health, etc | 19:47 |
corvus | dmsimard: i agree, that's a great first step that can feed into what sshnaidm wants to accomplish and make things better for everyone | 19:47 |
sshnaidm | ianw, thanks, will look | 19:47 |
clarkb | #topic Project Renames | 19:48 |
*** openstack changes topic to "Project Renames (Meeting topic: infra)" | 19:48 | |
sshnaidm | another question I have is - how can I inject credentials to some 3d-party server in jobs? for example to authenticate with some http api in 3party to send data there | 19:48 |
sshnaidm | oops | 19:48 |
*** markvoelker has quit IRC | 19:48 | |
clarkb | I don't want to derail the previous discussion but we are running out of time and would like to talk about project renames before the meeting ends | 19:48 |
corvus | sshnaidm: why not send the data to a first party server? | 19:48 |
sshnaidm | ok, let's talk later about it | 19:48 |
dmsimard | sshnaidm: it's a question for #openstack-infra, we can help there | 19:48 |
sshnaidm | great, thanks | 19:49 |
fungi | short answer... | 19:49 |
fungi | #link https://docs.openstack.org/infra/zuul/feature/zuulv3/user/encryption.html#encryption Zuul v3 secrets | 19:49 |
clarkb | fungi: mordred ianw I know everyone has been afk and snowed in or under a heat wave, but curious if any progress has been made on sorting out a project rename plan | 19:49 |
fungi | clarkb: AJaeger has been asking that we discuss the plan for pypi registration for new projects. is that still in need of discussion? | 19:49 |
*** jdandrea has joined #openstack-meeting | 19:50 | |
clarkb | fungi: I thought there was rough consensus on the plan there to register empty projects? I may have missed some subtle details that need ironing out | 19:50 |
fungi | i'm not aware of any progress on redesigning the renames process yet, unfortunately | 19:50 |
mordred | clarkb: the project name not needed patch landed to zuul, so that part is good, but we've still got required-projects entries to consider | 19:50 |
clarkb | mordred: oh cool | 19:51 |
corvus | oh, and i guess we've restarted zuul since then | 19:51 |
corvus | i'll start pushing up patches to remove project names | 19:51 |
clarkb | sounds like good progress for everyone being on holiday | 19:51 |
fungi | mordred: clarkb: also we had talked about switching to implicit required jobs where desired, and dropping teh system-required project-template? | 19:51 |
corvus | #action corvus patchbomb project name removals from zuul.yaml | 19:51 |
*** trandles has joined #openstack-meeting | 19:51 | |
mordred | clarkb, fungi: on pypi - I've got patches up to verify that a project either doesn't exist in pypi or exists but has openstackci properly as the owner ... | 19:51 |
fungi | mordred: cool, saw those, still need to find a moment to review, but seems like a solution is in progress anyway | 19:52 |
clarkb | for require-projects maybe we can have project aliases | 19:52 |
clarkb | where we map old to new and zuul will attempt to use both | 19:52 |
clarkb | then after a rename is compelte we can remove the aliases | 19:52 |
corvus | or we could remove the jobs, rename, then readd. | 19:52 |
*** gouthamr has quit IRC | 19:53 | |
corvus | though really, required-projects failures should probably soft-fail -- they should not fail at startup, but should still error on proposed reconfigurations. | 19:54 |
mordred | clarkb, fungi: https://review.openstack.org/#/q/topic:check-pypi ... it does not contain anything to actually auto-register yet (figure let's get verification working solidly first) | 19:54 |
*** hearnsj has joined #openstack-meeting | 19:54 | |
corvus | since we should protect zuul from external renames happening, but still prevent folks from botching a config change | 19:54 |
clarkb | ya external renames would be annoying | 19:54 |
mordred | ++ | 19:54 |
fungi | sounds right | 19:54 |
clarkb | especuially if you couldn't start zuul as a result | 19:54 |
corvus | i think that would cover this case? the job would just be 'broken' till someone updated its' required projects... | 19:54 |
clarkb | corvus: ya I think it would. Job would be broken but zuul would work for everyone else | 19:55 |
*** harlowja_ has quit IRC | 19:55 | |
fungi | last thing we want is for zuul to stop being able to start due to a change in external data | 19:55 |
clarkb | and renames already tend to put projects in a half working state anyways | 19:55 |
corvus | of course, if it's an important job, fallout could be large, but hey. | 19:55 |
*** harlowja has joined #openstack-meeting | 19:55 | |
clarkb | #topic open discussion | 19:56 |
*** openstack changes topic to "open discussion (Meeting topic: infra)" | 19:56 | |
Zara | o/ | 19:56 |
clarkb | we have a few minutes for whatever else we missed :) | 19:56 |
fungi | a wild Zara appears | 19:56 |
Zara | I'm late but congrats diablo_rojo! | 19:56 |
Zara | I arrived *right* after the storyboard topic and have been lurking haha | 19:56 |
corvus | diablo_rojo: ++ :) | 19:56 |
Zara | I'm very happy about the nomination :) | 19:56 |
diablo_rojo | Thanks :) | 19:56 |
diablo_rojo | Happy to share the load ;) | 19:56 |
clarkb | woot | 19:56 |
fungi | hopefully there are more new sb contributors on their way too | 19:57 |
Zara | :D | 19:57 |
fungi | seems like it's gaining visibility | 19:57 |
fungi | and mordred's been hacking on it some again | 19:57 |
Zara | yep! | 19:58 |
* diablo_rojo writes a dozen 'You are eligible for migration' emails | 19:58 | |
clarkb | oh! PTG is coming up | 19:58 |
*** rbudden has quit IRC | 19:58 | |
fungi | krotscheck has even been resurfacing on occasion | 19:58 |
pabelanger | There are a few patches up to add puppetlabs to AFS mirrors, if anybody else wants some hands on XP on AFS changes: https://review.openstack.org/#/q/topic:puppetlabs/mirrors | 19:58 |
clarkb | I'll probably start soliciting rough planning thoughts for PTG once we get past meltdown | 19:58 |
pabelanger | happy to walk people thought it or will likely do it in a day or so | 19:59 |
clarkb | pabelanger: you might want to check with frickler directly as the timezones don't make it easy to see pings | 19:59 |
clarkb | I expect frickler will be interested | 19:59 |
pabelanger | wfm | 19:59 |
clarkb | ok we are out of time. Thank you everyone | 20:00 |
clarkb | #endmeeting | 20:00 |
*** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/" | 20:00 | |
openstack | Meeting ended Tue Jan 9 20:00:08 2018 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 20:00 |
openstack | Minutes: http://eavesdrop.openstack.org/meetings/infra/2018/infra.2018-01-09-19.01.html | 20:00 |
openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/infra/2018/infra.2018-01-09-19.01.txt | 20:00 |
openstack | Log: http://eavesdrop.openstack.org/meetings/infra/2018/infra.2018-01-09-19.01.log.html | 20:00 |
Zara | thanks! :) | 20:00 |
fungi | thanks clarkb! | 20:00 |
*** rbudden has joined #openstack-meeting | 20:00 | |
*** hearnsj has quit IRC | 20:01 | |
*** hearnsj has joined #openstack-meeting | 20:02 | |
*** gouthamr has joined #openstack-meeting | 20:02 | |
*** amodi has quit IRC | 20:03 | |
*** amodi has joined #openstack-meeting | 20:06 | |
*** hearn_ has joined #openstack-meeting | 20:06 | |
*** hearn_ has quit IRC | 20:06 | |
*** hearnsj has quit IRC | 20:06 | |
*** abrito has joined #openstack-meeting | 20:07 | |
*** hearnsj has joined #openstack-meeting | 20:07 | |
hearnsj | #startmeeting scientific_sig | 20:11 |
openstack | Meeting started Tue Jan 9 20:11:38 2018 UTC and is due to finish in 60 minutes. The chair is hearnsj. Information about MeetBot at http://wiki.debian.org/MeetBot. | 20:11 |
openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 20:11 |
*** openstack changes topic to " (Meeting topic: scientific_sig)" | 20:11 | |
openstack | The meeting name has been set to 'scientific_sig' | 20:11 |
*** yamamoto has joined #openstack-meeting | 20:11 | |
hearnsj | exit | 20:12 |
*** markstur_ has quit IRC | 20:13 | |
hearnsj | #endmeeting scientific_sig | 20:14 |
*** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/" | 20:14 | |
openstack | Meeting ended Tue Jan 9 20:14:19 2018 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 20:14 |
openstack | Minutes: http://eavesdrop.openstack.org/meetings/scientific_sig/2018/scientific_sig.2018-01-09-20.11.html | 20:14 |
openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/scientific_sig/2018/scientific_sig.2018-01-09-20.11.txt | 20:14 |
openstack | Log: http://eavesdrop.openstack.org/meetings/scientific_sig/2018/scientific_sig.2018-01-09-20.11.log.html | 20:14 |
*** markstur has joined #openstack-meeting | 20:14 | |
*** Shrews has left #openstack-meeting | 20:14 | |
*** dtrainor has joined #openstack-meeting | 20:15 | |
*** dustins has joined #openstack-meeting | 20:15 | |
*** slaweq has joined #openstack-meeting | 20:17 | |
*** jamesmcarthur has joined #openstack-meeting | 20:18 | |
*** ijw has quit IRC | 20:20 | |
*** VW has quit IRC | 20:21 | |
*** eharney has quit IRC | 20:24 | |
*** hearnsj has quit IRC | 20:25 | |
*** eharney has joined #openstack-meeting | 20:26 | |
*** amodi has quit IRC | 20:26 | |
*** markvoelker has joined #openstack-meeting | 20:33 | |
*** dprince has joined #openstack-meeting | 20:37 | |
*** cleong has quit IRC | 20:38 | |
*** dbecker has quit IRC | 20:45 | |
*** dbecker_ has joined #openstack-meeting | 20:45 | |
*** yamamoto has quit IRC | 20:48 | |
*** yamamoto has joined #openstack-meeting | 20:49 | |
*** armax has quit IRC | 20:53 | |
*** reedip has quit IRC | 20:53 | |
*** yamamoto has quit IRC | 20:54 | |
*** priteau has joined #openstack-meeting | 20:55 | |
*** oneswig has joined #openstack-meeting | 20:55 | |
*** belmoreira has joined #openstack-meeting | 20:57 | |
*** ykatabam has joined #openstack-meeting | 20:58 | |
oneswig | #startmeeting scientific-sig | 21:00 |
openstack | Meeting started Tue Jan 9 21:00:35 2018 UTC and is due to finish in 60 minutes. The chair is oneswig. Information about MeetBot at http://wiki.debian.org/MeetBot. | 21:00 |
*** VW has joined #openstack-meeting | 21:00 | |
openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 21:00 |
*** openstack changes topic to " (Meeting topic: scientific-sig)" | 21:00 | |
openstack | The meeting name has been set to 'scientific_sig' | 21:00 |
oneswig | Hello hello hello | 21:00 |
oneswig | #link Agenda for today https://wiki.openstack.org/wiki/Scientific_SIG#IRC_Meeting_January_9th_2018 | 21:01 |
oneswig | Andrey tells me he's stuck in a taxi somewhere in Delhi, hoping to join us shortly | 21:02 |
*** aembrito has joined #openstack-meeting | 21:02 | |
*** powerd has joined #openstack-meeting | 21:03 | |
oneswig | I had a discussion with some colleagues from Cambridge University earlier. | 21:03 |
*** abrito has quit IRC | 21:03 | |
oneswig | They have been benchmarking the effect of the spectre/meltdown fixes | 21:03 |
oneswig | On a lustre router, apparently there is a 40% hit! | 21:04 |
oneswig | Are there other people testing their platforms? | 21:04 |
trandles | filesystems/IO is bad post-patch | 21:05 |
trandles | too much context switching :( | 21:05 |
oneswig | Hi Tim, so it seems - the worst case | 21:05 |
bollig | we saw 30% IO loss on VMs, 2% cpu loss. one sec and I’ll paste in my query earlier today on #scientific-wg | 21:05 |
trandles | Hello Stig. David Daniel says hello. Had a meeting with him this morning. :) | 21:05 |
oneswig | Please do | 21:05 |
rbudden | hello | 21:05 |
*** reedip has joined #openstack-meeting | 21:05 | |
oneswig | DDD - fantastic! You've made my day | 21:06 |
*** martial_ has joined #openstack-meeting | 21:06 | |
belmoreira | we started testing as well. Our compute workloads don't seem affected in the initial benchmarks. I will have more info next week | 21:06 |
rbudden | we’ve started baremetal testing, but I don’t have any result at the moment | 21:07 |
oneswig | There's been some discussion around whether there is an impact for RDMA, and in which modes of usage | 21:07 |
*** jmlowe has joined #openstack-meeting | 21:07 | |
jmlowe | Hi everybody | 21:08 |
oneswig | #link Here's an intriguing coincidence form a couple of months ago https://www.fool.com/investing/2017/12/19/intels-ceo-just-sold-a-lot-of-stock.aspx | 21:08 |
martial_ | Hi Mike, Bob, Stig | 21:08 |
oneswig | Hi jmlowe rbudden belmoreira et al | 21:08 |
oneswig | Hey martial_ | 21:08 |
oneswig | #chair martial_ | 21:08 |
openstack | Current chairs: martial_ oneswig | 21:08 |
oneswig | So, it does appear that the worst case scenarios can be readily hit. | 21:09 |
belmoreira | humm... not a coincidence :) | 21:09 |
bollig | We have broadwell arch (compute: E5-2680v4, storage: E5-2630v4). Ceph Luminous, Openstack Newton, qemu+kvm virtualization. First, after patching our hypervisors we saw a 2% CPU perf-loss in HPL benchmark running inside an unpatched centos 6.5 VM, plus 30% I/O perf-loss in the FIO benchmark inside the same VM. No further loss from patching VMs. Finally, we patched the storage servers and again saw no further degredation. Better than I expected, | 21:10 |
bollig | I’m curious if it plays out that way for others. We have NVMe in our storage, which might be amortizing the cost of I/O operations at the storage servers. | 21:10 |
bollig | The numbers were very close to redhat’s predictions | 21:11 |
oneswig | bollig: I'd guess, if it's a performance penalty incurred on every context switch, then it'll be more painful for nvme than for other devices simply because they achieve more context switches, but the penalty is constant for each. Perhaps | 21:12 |
*** makowals has quit IRC | 21:12 | |
*** markvoelker has quit IRC | 21:13 | |
*** markvoelker has joined #openstack-meeting | 21:13 | |
oneswig | What was the extent to which an unpatched guest could read data from the hypervisor? | 21:13 |
oneswig | This is one of those rare circumstances where bare metal looks like the security-conscious option | 21:15 |
*** archit has joined #openstack-meeting | 21:15 | |
martial_ | (too used to slack, I want to +1 Stig's last comment) | 21:15 |
oneswig | ha, slack is too easy! | 21:16 |
oneswig | OK, well interesting to hear people's experiences. I'm sure it's just early days. | 21:17 |
jmlowe | I really want to know the definitive answer to that question as well, do I need to make sure my guests are patched or is qemu and hypervisor patching sufficient to ensure guests can't read more than their own memory | 21:17 |
*** markvoelker has quit IRC | 21:17 | |
bollig | that I dont know. We’re rebuilding all of our base images, and looking for that same answer for existing VMs | 21:18 |
jmlowe | I had some linpac numbers from Jonathan Mills at NASA, worst case was %50 best case was %5, seemed to vary linearly with N | 21:18 |
oneswig | jmlowe: if you find out, will you let us know - sure it'll be widely applicable to just about everyone in OpenStack | 21:19 |
jmlowe | we are also patching all of our images as per ususal | 21:19 |
*** egallen_ has joined #openstack-meeting | 21:19 | |
*** egallen has quit IRC | 21:20 | |
*** egallen_ is now known as egallen | 21:20 | |
oneswig | Andrey is ready, or thereabouts. He's sent ahead a presentation to share | 21:20 |
oneswig | #link SGX and OpenStack https://drive.google.com/file/d/1wBXVrd9v8GjyreFLET5nW7IhROaOf7A6/view | 21:20 |
jmlowe | I have a more urgent need to patch, it seems that either my 2.1.26 i40e driver is leaking or it's the rhel/centos 3.10.0-693.5 kernel is leaking about 20GB/month, it's starting to trigger oom killer on my instances | 21:22 |
aembrito | Hi everyone, I was offline on a plane and had much less time than I expected, so please, consider it a first discussion | 21:22 |
aembrito | I will then come back and give more details, including on how we are using it with OpenStack (Ironic, LXD, KVM, and Magnum+Kubernetes) | 21:23 |
*** aembrito is now known as abrito | 21:23 | |
oneswig | Hi Andrey, thanks for joining us today | 21:24 |
oneswig | #topic SGX on OpenStack | 21:24 |
*** openstack changes topic to "SGX on OpenStack (Meeting topic: scientific-sig)" | 21:24 | |
oneswig | Is this specific to Skylake? I've seen previous articles on it that appear to date from 2013 | 21:25 |
abrito | yes, it is to Skylake | 21:26 |
abrito | previous discussion was based on simulations | 21:26 |
oneswig | How much of a limitation is it that the code in the enclave can't make system calls? | 21:27 |
*** egallen_ has joined #openstack-meeting | 21:28 | |
*** egallen has quit IRC | 21:28 | |
*** egallen_ is now known as egallen | 21:28 | |
abrito | there are tools to help circumvent this | 21:30 |
oneswig | abrito: Are there uses for this as protection for bare metal infrastructure from malicious users? | 21:30 |
abrito | for example, SCONE is a tool that places one thread inside the enclave and another outside the enclave, the one outside does the syscalls | 21:30 |
abrito | the one inside takes care that there is no leak (e.g., encrypts data going to the disk operation) | 21:31 |
oneswig | It seems to be targeted as an application-level tool rather than a system-level tool. Is that accurate? | 21:31 |
abrito | one application in baremetal would be to store certificates and other secrets in the enclave | 21:31 |
abrito | exactly | 21:32 |
abrito | Intel has just released an POC for doing that | 21:32 |
oneswig | Oooh, got a link? | 21:32 |
abrito | just a sec | 21:32 |
abrito | this one is from a project partner: https://github.com/lsds/TaLoS | 21:33 |
*** armax has joined #openstack-meeting | 21:34 | |
abrito | https://github.com/cloud-security-research/sgx-ra-tls | 21:34 |
oneswig | Is there a performance penalty for accessing memory within the enclave, or executing code within the enclave? | 21:36 |
*** julim has quit IRC | 21:36 | |
abrito | in the graph in slide 8, you can see something about this | 21:38 |
abrito | if the memory footprint is small | 21:38 |
abrito | you see no penalty | 21:38 |
abrito | this would be the case if you are, for example, streaming the data through the protected application | 21:38 |
*** pcaruana has quit IRC | 21:38 | |
oneswig | Ah, the y axis is relative slowdown of running in an enclave? | 21:39 |
abrito | if you exceed the EPC size (e.g, the 128 mb) then it needs to decrypt and re-encrypt the data | 21:39 |
*** slaweq has quit IRC | 21:39 | |
abrito | adding a huge overhead | 21:39 |
*** david-lyle has quit IRC | 21:40 | |
abrito | yes, the Y axis is the overhead compared to regular C code running outside an enclave | 21:40 |
oneswig | What is the difference in the code generated? | 21:40 |
oneswig | Have you found it easy to work with? | 21:41 |
abrito | it allocated a piece of the "enclave memory" and the secure functions and its data are allocated inside it | 21:41 |
*** eharney has quit IRC | 21:41 | |
oneswig | Just curious, what's a secure process for loading code into the enclave? | 21:42 |
*** egallen_ has joined #openstack-meeting | 21:42 | |
*** gagehugo has left #openstack-meeting | 21:42 | |
abrito | there is some learning curve if your are using intel SDK directly, but if you do not need syscalls for the confidential algorithms/transformations, then it is mostly boilerplate code | 21:42 |
abrito | can you rephrase that last question? | 21:43 |
*** egallen has quit IRC | 21:43 | |
*** egallen_ is now known as egallen | 21:43 | |
oneswig | Just wondering how we trust the code as it is transferred in. I guess there is some code signing or similar? | 21:43 |
abrito | yes | 21:43 |
abrito | Once the code is executed you can do a remote attestation | 21:43 |
abrito | the remote attestation starts by an external participant asking the application to get a "quote" of itself | 21:44 |
abrito | the quote is produced by the processor where the application is running in | 21:44 |
abrito | then the application gives you the signed quote and if you have never trusted that processor before | 21:45 |
abrito | then you go to intel attestation service (IAS) for it to confirm that the quote was emitted from a sgx-supporting processor | 21:45 |
abrito | using the current firmware | 21:45 |
abrito | that has not been blacklisted and that is running in the correct mode (e.g., non-debug or simulated) | 21:46 |
abrito | if you already trusted the processor, you do not need to go to the intel service again | 21:46 |
oneswig | interesting - so if you trust Intel then you can also trust the cpu | 21:47 |
abrito | :-) | 21:47 |
*** pchavva has quit IRC | 21:47 | |
martial_ | did I understand properly: it creates a hardware memory map in the enclave ? | 21:48 |
abrito | yes, for this version of SGX you have to trust intel to tell you that the code is actually running in the correct mode and processor | 21:48 |
abrito | martial_: during boot it separates a piece of memory to be used by the enclaves | 21:48 |
oneswig | I can see it being useful in apps where secrets are held. Do you think it will succeed for future cpu generations? | 21:49 |
abrito | that piece of memory cannot be accessed by code other then the code from the enclave that allocated it on creation | 21:49 |
abrito | oneswig: yes, I am optimistic | 21:49 |
oneswig | good to hear it. | 21:50 |
abrito | one this is that recently, Azure and IBM have mentioned that they are making test services available that use SGX | 21:50 |
oneswig | What will you do next with it? | 21:50 |
abrito | e.g.: SGX capable VMs | 21:50 |
abrito | I answer heard that enclave memory is likely to become larger in the short term | 21:51 |
abrito | my next step is to run kubernetes jobs on it | 21:51 |
abrito | using code in python running inside the enclaves | 21:51 |
oneswig | with the enclave holding something for the containerised app, or something for kubernetes itself? | 21:51 |
abrito | there is not much to be done with kubernetes itself | 21:52 |
abrito | monitoring needs to be done differently | 21:52 |
abrito | so that you consider the EPC usage | 21:52 |
*** rmcall has quit IRC | 21:52 | |
*** yamamoto has joined #openstack-meeting | 21:52 | |
abrito | otherwise you can hit the 128 MB and suffer the performance hit | 21:52 |
abrito | but once you have the code running, it mostly a matter of configuring the right tools | 21:53 |
abrito | you also want, for example, that the tasks in the tasks queues are encrypted | 21:53 |
abrito | and only workers that have been attested hold the keys | 21:53 |
*** armstrong has joined #openstack-meeting | 21:54 | |
abrito | we (not only UFCG, but the securecloud consortium) are also working on monitoring and scheduling tools | 21:54 |
martial_ | so how different is it from a HSM? | 21:55 |
oneswig | I'd be interested to know where you take it | 21:55 |
abrito | it is a HSM, the advantage is that you already have it on your table | 21:55 |
abrito | it is not a separate hardware piece | 21:56 |
abrito | the downside is that not many Xeon have it | 21:56 |
martial_ | thank you, that helps | 21:56 |
oneswig | OK - anything more for Andrey - we are close to time | 21:56 |
abrito | there are people also looking at sgx for barbican | 21:57 |
oneswig | I was wondering about that... | 21:57 |
abrito | exactly because of its easier availability | 21:57 |
oneswig | would be great to use it for holding secrets 'at rest' | 21:57 |
abrito | yes | 21:58 |
martial_ | abrito: I was wondering about this, in 2006 the Barbican team did a Hands on during the Barcelona summit and they had a HSM setup | 21:58 |
*** jamesmcarthur has quit IRC | 21:58 | |
martial_ | (can not remember the hardware now) | 21:58 |
oneswig | OK, we must press on | 21:58 |
oneswig | thank you Andrey - really interesting to hear about your work | 21:58 |
abrito | So, I would like to thank you for the invitation | 21:58 |
*** jamesmcarthur has joined #openstack-meeting | 21:59 | |
abrito | and apologize for the terrible slides | 21:59 |
*** yamamoto has quit IRC | 21:59 | |
martial_ | really cool indeed, thank you for explaining this to us | 21:59 |
abrito | I should had been more pessimistic about the time | 21:59 |
oneswig | #topic AOB | 21:59 |
oneswig | I had one item to raise - PTG | 21:59 |
oneswig | The Scientific SIG have been invited to have a slot at the PTG in Dublin, and I'm planning to go as there'll be at least 5-6 members present | 21:59 |
*** openstack changes topic to "AOB (Meeting topic: scientific-sig)" | 21:59 | |
abrito | I will do a second round, and explain details | 21:59 |
jmlowe | he possibility of using a $200 nuc as a backing store for barbican is really exciting | 21:59 |
trandles | oneswig: thanks for carrying the torch for configurable deployment steps in Ironic at the Dublin PTG | 22:00 |
trandles | if you need anything documenting our use case let me know offline | 22:00 |
martial_ | Mike: yes sounds interesting indeed :) | 22:00 |
oneswig | Anything development-centric on people's wish lists, let's have it before then | 22:01 |
oneswig | Ironic deployment steps - check | 22:01 |
oneswig | We'll also aim to cover some of the CERN/SKA subject areas | 22:01 |
oneswig | but anything else to cover - have a think and do follow up before the PTG, which is late February | 22:01 |
oneswig | we are out of time - anything else to raise? | 22:01 |
martial_ | good for me | 22:02 |
*** yamahata has quit IRC | 22:02 | |
martial_ | thanks Stig | 22:02 |
trandles | thx for the topic today, very interesting | 22:03 |
*** jamesmcarthur has quit IRC | 22:03 | |
rbudden | thanks everyone! | 22:04 |
*** dprince has quit IRC | 22:04 | |
martial_ | #endmeeting | 22:04 |
*** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/" | 22:04 | |
openstack | Meeting ended Tue Jan 9 22:04:43 2018 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 22:04 |
openstack | Minutes: http://eavesdrop.openstack.org/meetings/scientific_sig/2018/scientific_sig.2018-01-09-21.00.html | 22:04 |
openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/scientific_sig/2018/scientific_sig.2018-01-09-21.00.txt | 22:04 |
openstack | Log: http://eavesdrop.openstack.org/meetings/scientific_sig/2018/scientific_sig.2018-01-09-21.00.log.html | 22:04 |
*** oneswig has quit IRC | 22:06 | |
*** rcernin has joined #openstack-meeting | 22:06 | |
*** jmlowe has left #openstack-meeting | 22:06 | |
*** oneswig has joined #openstack-meeting | 22:08 | |
*** belmoreira has quit IRC | 22:10 | |
*** oneswig has quit IRC | 22:11 | |
*** trandles has left #openstack-meeting | 22:12 | |
*** jamesmcarthur has joined #openstack-meeting | 22:13 | |
*** egallen has quit IRC | 22:14 | |
*** egallen_ has joined #openstack-meeting | 22:14 | |
*** egallen_ has quit IRC | 22:14 | |
*** abrito is now known as aembrito | 22:16 | |
*** aeng has joined #openstack-meeting | 22:17 | |
*** aembrito has quit IRC | 22:18 | |
*** jamesmcarthur has quit IRC | 22:18 | |
*** aeng has quit IRC | 22:19 | |
*** dustins has quit IRC | 22:24 | |
*** rfolco has quit IRC | 22:25 | |
*** artom_ has joined #openstack-meeting | 22:26 | |
*** jamesmcarthur has joined #openstack-meeting | 22:28 | |
*** markvoelker has joined #openstack-meeting | 22:29 | |
*** artom has quit IRC | 22:30 | |
*** markvoelker has quit IRC | 22:30 | |
*** jamesmcarthur has quit IRC | 22:33 | |
*** zerick_ has quit IRC | 22:33 | |
*** zerick has joined #openstack-meeting | 22:34 | |
*** powerd has quit IRC | 22:34 | |
*** gouthamr has quit IRC | 22:35 | |
*** priteau has quit IRC | 22:40 | |
*** bobh has quit IRC | 22:41 | |
*** yamahata has joined #openstack-meeting | 22:48 | |
*** aeng has joined #openstack-meeting | 22:48 | |
*** zerick has quit IRC | 22:49 | |
*** archit has quit IRC | 22:52 | |
*** gouthamr has joined #openstack-meeting | 22:53 | |
*** _pewp_ has quit IRC | 22:56 | |
*** aeng has quit IRC | 22:56 | |
*** _pewp_ has joined #openstack-meeting | 22:57 | |
*** hongbin has quit IRC | 22:57 | |
*** e0ne has joined #openstack-meeting | 22:58 | |
*** sdague has quit IRC | 23:04 | |
*** aeng has joined #openstack-meeting | 23:05 | |
*** markvoelker has joined #openstack-meeting | 23:11 | |
*** markvoelker has quit IRC | 23:11 | |
*** aeng has quit IRC | 23:16 | |
*** VW_ has joined #openstack-meeting | 23:27 | |
*** Leo_m has quit IRC | 23:27 | |
*** VW has quit IRC | 23:30 | |
*** gmann_ has joined #openstack-meeting | 23:30 | |
*** aeng has joined #openstack-meeting | 23:31 | |
*** VW_ has quit IRC | 23:31 | |
*** awaugama has quit IRC | 23:33 | |
*** sdague has joined #openstack-meeting | 23:34 | |
*** ykatabam has quit IRC | 23:34 | |
*** ykatabam has joined #openstack-meeting | 23:35 | |
*** julim has joined #openstack-meeting | 23:37 | |
*** gmann has joined #openstack-meeting | 23:37 | |
*** pengdake has joined #openstack-meeting | 23:37 | |
*** markvoelker has joined #openstack-meeting | 23:43 | |
*** markvoelker has quit IRC | 23:43 | |
*** ianw has quit IRC | 23:50 | |
*** pengdake has quit IRC | 23:51 | |
*** ianw has joined #openstack-meeting | 23:51 | |
*** ijw has joined #openstack-meeting | 23:54 | |
*** netapp has quit IRC | 23:54 | |
*** netapp has joined #openstack-meeting | 23:58 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!