Tuesday, 2021-03-02

*** jmasud has joined #openstack-meeting00:03
*** macz_ has quit IRC00:06
*** jmasud has quit IRC00:15
*** osmanlicilegi has joined #openstack-meeting00:16
*** tosky has quit IRC00:17
*** jmasud has joined #openstack-meeting00:18
*** jamesdenton has quit IRC00:26
*** jamesden_ has joined #openstack-meeting00:26
*** jmasud has quit IRC00:32
*** mlavalle has quit IRC01:14
*** jmasud has joined #openstack-meeting02:11
*** jmasud has quit IRC02:16
*** rcernin has quit IRC02:34
*** jmasud has joined #openstack-meeting02:37
*** rcernin has joined #openstack-meeting02:47
*** jmasud has quit IRC02:54
*** jkulik has quit IRC03:03
*** jamesden_ is now known as jamesdenton03:29
*** vishalmanchanda has joined #openstack-meeting03:45
*** jmasud has joined #openstack-meeting03:45
*** psachin has joined #openstack-meeting03:47
*** jmasud has quit IRC04:01
*** yasufum has quit IRC04:08
*** yasufum has joined #openstack-meeting04:18
*** rh-jlabarre has quit IRC04:35
*** psahoo has joined #openstack-meeting04:44
*** jmasud has joined #openstack-meeting04:49
*** jmasud has quit IRC04:50
*** udesale has joined #openstack-meeting05:08
*** takahashi-tsc has joined #openstack-meeting05:08
*** evrardjp has quit IRC05:33
*** evrardjp has joined #openstack-meeting05:33
*** lbragstad_ has joined #openstack-meeting06:03
*** lbragstad has quit IRC06:06
*** dsariel has joined #openstack-meeting06:12
*** gyee has quit IRC06:47
*** ralonsoh has joined #openstack-meeting06:55
*** yamamoto has quit IRC06:55
*** rcernin has quit IRC06:57
*** slaweq has joined #openstack-meeting07:08
*** yishihara has joined #openstack-meeting07:20
*** jawad_axd has joined #openstack-meeting07:25
*** makoto-h has joined #openstack-meeting07:25
*** lpetrut has joined #openstack-meeting07:27
*** dklyle has quit IRC07:47
*** ogaken has joined #openstack-meeting07:50
*** belmoreira has joined #openstack-meeting07:55
*** tsukasasa has joined #openstack-meeting07:58
*** kitamura has joined #openstack-meeting07:58
yasufumhi tacker team08:00
takahashi-tschi08:01
manpreethi08:01
*** yoshito-ito has joined #openstack-meeting08:01
*** LiangLu has joined #openstack-meeting08:01
yoshito-itohi08:01
yasufum#startmeeting tacker08:02
openstackMeeting started Tue Mar  2 08:02:45 2021 UTC and is due to finish in 60 minutes.  The chair is yasufum. Information about MeetBot at http://wiki.debian.org/MeetBot.08:02
openstackUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.08:02
*** openstack changes topic to " (Meeting topic: tacker)"08:02
openstackThe meeting name has been set to 'tacker'08:02
yasufumWe have one topic on etherpad today.08:03
yasufum#link https://etherpad.opendev.org/p/tacker-meeting08:03
LiangLuhi08:04
*** ueha has joined #openstack-meeting08:04
yasufum#topic Add blueprint about supporting for placement constraints in Wallaby08:04
*** openstack changes topic to "Add blueprint about supporting for placement constraints in Wallaby (Meeting topic: tacker)"08:04
*** edagawa_kc has joined #openstack-meeting08:06
yasufumIt seems the porposer does not join yet.08:08
yasufumI have found another topic is added.08:08
yasufumIs it OK to move to this one? “args for MgmtDriver”08:09
yoshito-itoIt's my topic08:09
yasufumThanks, go ahead please.08:09
yasufum#topic args for MgmtDriver08:10
*** openstack changes topic to "args for MgmtDriver (Meeting topic: tacker)"08:10
yoshito-itoI'd like to discuss what args should be used for MgmtDriver.08:10
yoshito-ito#link https://review.opendev.org/c/openstack/tacker/+/76809108:10
yoshito-itoWe have a new MgmtDriver logic for SOL impelementation.08:11
yoshito-itoIn the first patch, the args for MgmtDriver are "vnf_instance" and "additional_params" because it's clearly defined in ETSI NFV-SOL001 v2.6.1.08:12
yoshito-itoHowever, I found it's not enough to support various use case in MgmtDriver.08:13
yoshito-itoMy proposal is to use "vnf_instance", "request (e.g. instantiate_vnf_request)", "grant_request", and "grant".08:14
yoshito-itoI believe these are a full set of objects in ETSI NFV-SOL for VNF Lifecycle Management interface.08:15
yoshito-itoI propose this change because it's better not to change this interface frequently.08:16
yoshito-itoDo you have any comments or poposals for this change?08:18
yasufumUnderstand. It seems good for me.08:18
*** masazumi-ota has joined #openstack-meeting08:19
yoshito-itotakahashi-tsc: How about you?08:20
yoshito-itoThe point here is what args are best to keep the interface stable.08:21
*** rpittau|afk is now known as rpittau08:22
takahashi-tscBasically good. I'll confirm minor point about how to proceed. Do you mean you push a patch which fix management driver code directly? Or share args of all API in advance.08:23
takahashi-tscs/API/method/08:23
yoshito-itoI assumed to push a new patch directly.08:24
yoshito-itoBut it's also possible to put my proposal in the etherpad before the push.08:24
*** NAO_H has joined #openstack-meeting08:26
yasufumtakahashi-tsc: What do you think? Is it enough to discuss on gerrit for his patch?08:27
yoshito-itoNow we have supported MgmtDriver in Instantiate/Scale/Heal/Terminate with "_start" and "_end" for each. All of them will be changed to have the proposed args.08:28
takahashi-tscJust I want to review concrete args before code update. But if it is not difficult to edit patch, push patch to edit code is OK.08:30
yoshito-itoThanks. It's not difficult to change in the patch so let me discuss on the gerrit!08:31
yasufumthanks both08:31
takahashi-tscSure08:31
yasufumany other comment?08:33
yasufumOK08:34
yasufumCan we go back to the first topic?08:35
*** tosky has joined #openstack-meeting08:35
yishiharayes, please.08:36
yasufum#topic Add blueprint about supporting for placement constraints in Wallaby08:36
*** openstack changes topic to "Add blueprint about supporting for placement constraints in Wallaby (Meeting topic: tacker)"08:36
yishiharaOK08:36
yasufumPlease share your suggestion08:37
yishiharaI would like to talk about adding blueprints for placement constraints.08:38
yishiharaGrant interface has already been implemented in Tacker.08:39
yishiharaBut we would like to extend Placement Constraints logic in Wallaby.08:39
*** w_juso has joined #openstack-meeting08:40
yishiharaSo, I would like to issue a blueprint about that.08:40
yishiharaPlease refer to the following URL:08:42
yishiharahttps://blueprints.launchpad.net/tacker/+spec/support-placement-constraints08:42
yishiharaSorry, to make it easier to explain, I posted the blueprints before the IRC discussion. I will revise it if necessary.08:42
*** NAO_H has quit IRC08:43
*** ociuhandu has joined #openstack-meeting08:44
yishiharathank you08:45
yasufumthanks08:46
*** NAO_H has joined #openstack-meeting08:46
yasufumany comment?08:49
takahashi-tscNot from my side.08:50
yasufumI am not sure the details of the change just now, but I think it is OK to proceed.08:51
yasufumThis feature must be helpful for extending usescases of tacker.08:54
yasufumyishihara: I think you do not need to update your blueprint. I would like to review your patch after uploaded.08:55
yishiharasure08:56
*** jamesdenton has quit IRC08:56
*** jamesdenton has joined #openstack-meeting08:57
yasufumthanks08:58
yasufumWe have done all today’s topics.08:59
yasufumIs there any topic, or asking patch review?09:00
yoshito-itoThe coming PTG schedule was announced, right?09:00
yasufumIt was announced on ML. April 19-23, 202109:01
yasufumThanks for sharing09:02
takahashi-tscRegistration is open now. https://www.openstack.org/ptg/09:02
yasufumI would like to setup etherpad for the vPTG later09:03
yoshito-itothanks!09:03
takahashi-tscthanks09:03
yasufumAnd also placeholder for specs for xena09:03
yasufumthanks for joining. bye09:04
takahashi-tscbye09:04
ogakenBYE09:04
yasufum#endmeeting09:04
yishiharabye09:04
*** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/"09:04
openstackMeeting ended Tue Mar  2 09:04:50 2021 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)09:04
openstackMinutes:        http://eavesdrop.openstack.org/meetings/tacker/2021/tacker.2021-03-02-08.02.html09:04
openstackMinutes (text): http://eavesdrop.openstack.org/meetings/tacker/2021/tacker.2021-03-02-08.02.txt09:04
openstackLog:            http://eavesdrop.openstack.org/meetings/tacker/2021/tacker.2021-03-02-08.02.log.html09:04
*** yoshito-ito has quit IRC09:04
*** ogaken has left #openstack-meeting09:05
*** NAO_H has quit IRC09:05
*** kitamura has quit IRC09:05
*** psahoo_ has joined #openstack-meeting09:05
*** tsukasasa has quit IRC09:06
*** edagawa_kc has quit IRC09:09
*** psahoo has quit IRC09:09
*** makoto-h has quit IRC09:16
*** dsariel has quit IRC09:47
*** dsariel has joined #openstack-meeting09:47
*** ociuhandu has quit IRC09:50
*** w_juso has left #openstack-meeting09:53
*** e0ne has joined #openstack-meeting10:02
*** e0ne has quit IRC10:02
*** ociuhandu has joined #openstack-meeting10:06
*** udesale_ has joined #openstack-meeting10:15
*** udesale has quit IRC10:19
*** psachin has quit IRC11:22
*** udesale_ has quit IRC11:40
*** udesale has joined #openstack-meeting11:43
*** yasufum has quit IRC11:44
*** ociuhandu has quit IRC11:48
*** ociuhandu has joined #openstack-meeting11:50
*** ociuhandu has joined #openstack-meeting11:52
*** ociuhandu has quit IRC11:57
*** Luzi has joined #openstack-meeting11:58
*** ueha has quit IRC11:58
*** ociuhandu has joined #openstack-meeting12:12
*** ociuhandu has quit IRC12:17
*** ociuhandu has joined #openstack-meeting12:18
*** ociuhandu has quit IRC12:22
*** bbowen_ has joined #openstack-meeting12:26
*** bbowen has quit IRC12:29
*** ociuhandu has joined #openstack-meeting12:35
*** ociuhandu has quit IRC12:44
*** rh-jlabarre has joined #openstack-meeting13:04
*** masazumi-ota has quit IRC13:16
*** ociuhandu has joined #openstack-meeting13:27
*** lbragstad_ is now known as lbragstad13:41
*** dsariel has quit IRC13:52
*** mlavalle has joined #openstack-meeting13:59
*** paulbisaacs has joined #openstack-meeting14:02
*** dsariel has joined #openstack-meeting14:30
*** jawad_axd has quit IRC14:31
*** jawad_axd has joined #openstack-meeting14:32
*** Luzi has quit IRC14:36
*** jeremyfreudberg has joined #openstack-meeting15:04
*** jawad_axd has quit IRC15:15
*** jawad_axd has joined #openstack-meeting15:16
*** macz_ has joined #openstack-meeting15:19
*** jawad_axd has quit IRC15:24
*** lpetrut has quit IRC15:34
*** dklyle has joined #openstack-meeting16:02
*** psahoo_ has quit IRC16:02
*** dsariel has quit IRC16:15
*** dsariel has joined #openstack-meeting16:35
*** e0ne has joined #openstack-meeting16:37
*** udesale has quit IRC17:04
*** ociuhandu_ has joined #openstack-meeting17:09
*** ociuhandu has quit IRC17:12
*** ociuhandu_ has quit IRC17:13
*** jmasud has joined #openstack-meeting17:17
*** lpetrut has joined #openstack-meeting17:28
*** LiangLu has quit IRC17:30
*** rpittau is now known as rpittau|afk17:42
*** bnemec has quit IRC17:49
*** lpetrut has quit IRC18:07
*** timburke__ has joined #openstack-meeting18:09
*** timburke_ has quit IRC18:12
*** bnemec has joined #openstack-meeting18:16
*** ralonsoh has quit IRC18:29
*** jmasud has quit IRC18:45
*** jmasud has joined #openstack-meeting19:05
*** jmasud has quit IRC20:10
*** julianp has joined #openstack-meeting20:41
*** jmasud has joined #openstack-meeting20:42
*** e0ne has quit IRC20:55
*** oneswig has joined #openstack-meeting20:55
*** martial_ has joined #openstack-meeting20:59
oneswig#startmeeting scientific-sig21:00
openstackMeeting started Tue Mar  2 21:00:21 2021 UTC and is due to finish in 60 minutes.  The chair is oneswig. Information about MeetBot at http://wiki.debian.org/MeetBot.21:00
*** martial_ is now known as martial21:00
openstackUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.21:00
*** openstack changes topic to " (Meeting topic: scientific-sig)"21:00
openstackThe meeting name has been set to 'scientific_sig'21:00
martialHello Stig21:00
oneswigHi martial21:00
oneswig#chair martial21:00
openstackCurrent chairs: martial oneswig21:00
oneswigHow's things?21:00
oneswigP2302 is that the NIST federation work?21:01
martialnot bad, just a little crazy :)21:01
oneswigHopefully crazy in a good way21:02
martialIEEE actually, the NIST work got published in NIST SP500-33221:02
martial#link https://www.nist.gov/publications/nist-cloud-federation-reference-architecture21:02
jandersg'day oneswig martial o/21:03
jandershow is it going?21:03
oneswigHi janders, good thanks21:03
martialdoing well, thanks janders21:03
oneswigBusy :-)21:04
martialbusy good? :)21:05
julianpHi all. Bookmarked that link martial. Time to learn more about cloud federation.21:05
oneswigI'm only 2 years late on this but I saw a really neat talk on large-scale Ceph administration: https://www.youtube.com/watch?v=niFNZN5EKvE21:05
*** abhishekk has quit IRC21:06
oneswigWell worth a look, it presents a very nice way of visualising the spread of utilisation across nodes.21:06
*** abhishekk has joined #openstack-meeting21:06
*** pescobar has quit IRC21:07
*** pescobar has joined #openstack-meeting21:07
*** dsariel has quit IRC21:07
oneswigIt came up after a group we work with were adding larger drives to an existing Ceph cluster which pushed it to hitting hard limits of PGs/OSD.  Sounds quite painful.21:11
oneswigjulianp: you were asking a while back about infrastructure.  I think we are getting much closer now to having guests on the system.21:13
julianpEeeexcellent. Thanks for thinking of me oneswig.21:13
martialI wonder if we can ask Rion to have another Minio conversation21:13
oneswigRion having more fun with MinIO?21:14
oneswigjulianp: will be in touch soon I hope!21:15
martialwell we are heavy with Ceph on SSDs but if you remember we had a small video chat with Rion about why Minio was useful for deployments21:16
julianpMuch obliged oneswig.21:16
julianpmartial do you remember why Minio was considered useful?21:17
martialease of deployment seemed to be a core reason21:18
julianpGotcha.21:18
oneswigmartial: ever compared it to Portworx?21:21
martialI have a very small minio equivalent setup for testing but never tried portworx21:22
*** belmoreira has quit IRC21:24
martialany new setup for you Stig?21:25
oneswigI've been banging my head on a real puzzler for the last few days.  I have a set of hosts that take ~3s to run "time ssh centos@host hostname"21:26
oneswigIt's not DNS before you ask, pretty sure on that now :-)21:26
priteauSomething auth-related, PAM?21:27
janderswhat OS is the ssh connection originating from?21:27
oneswigI'm still uncertain on the root cause.  There's some smoking guns relating to SELinux blocking access to /etc/ld.so.cache that look suspicious.21:27
oneswigCentOS 8.321:27
oneswigHi priteau :-) auth is ssh keys - although there's plenty of pam modules involved in that login.21:28
jandersdoes 'setenforce 0' make any difference?21:28
janderslet me see what my NVMe cleaning lab is on21:28
oneswigjanders: disabling selinux and rebooting the node is not apparently helping...21:28
oneswigIt's bizarre because I have other nodes in the same environment for which the same test takes a more sensible 0.2s21:29
jandersoneswig disabling SEL both client and server side?21:29
martialsame hardware/kernel version?21:29
jandersoneswig melding servers would come in handy :)21:29
oneswigDifferent hardware, same kernel21:29
oneswigmelding?21:29
oneswigjanders: making the client == the server, ie ssh localhost, has the same delay21:30
martialohhhh I have had this happen, it was a network device driver for me21:30
julianpDoes `ssh -vvvv` show you where it gets stuck?21:31
priteaussh localhost shouldn't be slowed down by a NIC issue though21:31
jandersoneswig does the problem seem to stick to either the piece of hardware in question being a client or a server?21:31
janderspriteau good point21:31
martialpierre, agreeing with you but localhost also was slow21:32
oneswigjulianp: a bit.  The ssh debug output isn't timestamped, alas.  There was a message, I'll see if I can dig it out.21:32
julianpI bet it was the butler in the library with a candlestick.21:32
martialnow I can not remember if there was something else related to it21:32
oneswigI've been running strace on client and server to try to spot something, that's my current effort.21:34
oneswigInteresting though!21:34
oneswigbrb21:34
priteauHave you tried changing various other settings in sshd_config? GSSAPI maybe?21:34
martialI was checking in our slack to see if we documented this one21:36
oneswigI removed the GSSAPI auth method and that bought some time, a fraction of a second21:36
martialno luck21:36
*** belmoreira has joined #openstack-meeting21:37
martialsilly question because that was part of our checklist: IPv6 disabled?21:38
oneswiguninstalling cockpit also gained me about 0.1s.  Small things.21:38
oneswigIPV6 I haven't tried - worth a shot!21:38
priteauMTU? (although I've seen it cause hangs, not slowdowns)21:39
priteau(and it would probably not affect ssh localhost)21:40
oneswigmartial: just tried it, no joy alas21:41
martialfiles listed first in your nsswitch.conf? so it uses /etc/hosts ?21:41
jandersoneswig a bit brute-force, but maybe worthwhile copying /etc of a "good" and a "bad" machine and doing a recursive diff?21:41
oneswigpriteau: I don't think it's MTU.21:42
martialsimilar idea as above, you could try "UseDNS no" in your sshd_config21:42
jandersoneswig is console login normal (making sure it's ssh only)?21:43
oneswigIf I run "ssh-keygen" on a dodgy node, there's a long delay before it prompts me for the filename.  That might be connected21:43
*** gyee has joined #openstack-meeting21:43
oneswigmartial: UseDNS no is set - been bitten by that one before :-)21:43
martialokay not DNS, not IPv6 (use -4 :) )21:44
julianpAs for the timestamps not being in the ssh output, you can add it using `ts` found in `moreutils` TIL: ssh -vvvv some-host hostname 2>&1 | ts21:44
oneswigjanders: I'd need to get onto the BMC and it's one of those HPE boxes where you have to buy a license to use the console after the node boots...21:44
oneswigjulianp: that is new to me, neat trick!21:45
priteauThe slow ssh-keygen is very odd, I don't think it should do any I/O21:46
priteauNetwork I/O I mean21:46
priteauSomething related to OpenSSL then?21:46
jandersoneswig that licensing model is ridiculous!21:46
priteauoneswig: what does "cat /proc/sys/kernel/random/entropy_avail" say?21:46
julianpOh that's a good idea priteau. We've run into that.21:47
oneswigentropy_avail = 3443 - is that enough?21:47
priteauShould be21:47
jandersoneswig the two machines I'm currently working on have ~3400 and ~380021:48
janderspriteau nice trick!21:48
oneswigDoesn't look like I can get moreutils on CentOS - perhaps it's in EPEL?21:48
julianpI believe you can replicate the moreutils ts functionality using some awk.21:49
oneswigjulianp: now we are talking :-)21:49
julianpxD21:49
julianpssh -vvvv -C condo hostname 2>&1 | awk '{ print strftime(),$0 }'21:52
oneswigI'm clearly going to have to follow up to the SIG on this if I ever figure it out...21:52
julianpYes please! My curiosity is piqued.21:52
oneswigAnything can be curious, until you *have* to solve it21:53
oneswigfor AOB: couple of small points21:54
martialnice trick julian21:54
oneswigPTG (virtual) dates were announced - 19-23 April - https://www.openstack.org/ptg/21:55
oneswigNext week (Wednesday 1100 UTC) I'm hoping to have a session on Jupyterhub and OpenStack.  I think there's a good deal to cover on how to provide user-friendly integrations21:56
julianpOoh. I'm interested in that.21:57
oneswigjulianp: hopefully not too early a start for you?21:57
jandersoneswig from my side, I completed the initial work on support for NVMe-native disk cleaning in Ironic21:57
jandersif you are interested, I can give a preso on that in a couple weeks21:58
oneswigjanders: That would be great, I'd love to see it.21:58
jandersinitial = works best on an all-NVMe nodes (it doesn't make much of a difference in hybrid HDD-NVMe configs or on SSDs)21:58
oneswigRandom but related question: Do you know, with software RAID in Ironic, can I label the RAID block devices?  They come up in an arbitrary order.21:58
jandersoneswig not sure. Might be worth asking on #openstack-ironic21:59
oneswigjanders: would be good to hear more.21:59
oneswigthanks janders, will do21:59
oneswigOK, nearly time - final comments?21:59
oneswig#endmeeting22:00
*** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/"22:00
openstackMeeting ended Tue Mar  2 22:00:17 2021 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)22:00
openstackMinutes:        http://eavesdrop.openstack.org/meetings/scientific_sig/2021/scientific_sig.2021-03-02-21.00.html22:00
oneswigthanks all!22:00
openstackMinutes (text): http://eavesdrop.openstack.org/meetings/scientific_sig/2021/scientific_sig.2021-03-02-21.00.txt22:00
openstackLog:            http://eavesdrop.openstack.org/meetings/scientific_sig/2021/scientific_sig.2021-03-02-21.00.log.html22:00
jandersthank you all!22:00
martialoneswig: I wonder if you want to have this session with a video feed and recorded (jupyther)22:01
oneswigmartial: it's an option.  Does the Foundation provide something for that?22:01
martialmaybe for the PTG,  but if you are willing to do Google Meet I can record it22:02
*** SWDevAngel has quit IRC22:02
martialfollowing up on slack22:03
julianpRegistered for PTG. Till next time!22:04
*** julianp has left #openstack-meeting22:04
*** oneswig has quit IRC22:07
*** belmoreira has quit IRC22:23
*** rcernin has joined #openstack-meeting22:33
*** vishalmanchanda has quit IRC22:54
*** jmasud has quit IRC23:32
*** jmasud has joined #openstack-meeting23:45
*** takahashi-tsc has quit IRC23:47

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!