Friday, 2021-07-30

kata-irc-bot<samuel.ortiz> @james.o.hunt Good morning!06:27
sameojodh: Hey there08:40
kata-irc-bot<jakob.naucke> @sandeep.gupta re your email "Re: [kata-dev] , "kata-containers-2.2.0-alpha1" with confidential_guest = true (SEV Guest)" :thread:08:45
jodhsameo: morning!08:46
kata-irc-bot<jakob.naucke> this is a shot in the dark and it's probably something with the SEV setup most of us cannot substantially help you with, but are you sure this is correct? > `kernel_params = " root=/dev/vda1...` because with standard Kata, this also prohibits QEMU from booting08:46
sameojodh: I'm trying to enable tracing with kata+CLH. Is that a setup you're familiar with?08:47
jodhsameo: no - we've only tested with QEMU at this point I'm afraid.08:47
jodhit may well work and of course all the hypervisors need to be tested, but so far, we've had very limited offers for help on testing, etc ;(08:48
sameojodh: I understand. I'm seeing really weird behaviour with CLH, I'll see if I can fix it.08:53
jodhsameo: thanks!08:53
sameojodh: Does the runtime decide to upload traces to Jaeger, or it's out of its control?08:54
jodhif runtime tracing is enabled, the traces should be generated automatically for the runtime and sent to the Jaeger collector's UDP socket.08:55
jodhare you trying to get agent traces too?08:55
sameojodh: No, I disabled agent traces.08:55
sameoTo run the collector, I just need to start the all-in jaeger container, right?08:56
jodhyes08:57
sameojodh: Every one second, I'm getting a "failed to upload traces", with a 400 http error from what seems to be the CLH API server.08:57
sameothat runs on a UNIX socket :-/08:57
jodhwtf? ;) yeah, to reiterate, we haven't tested that yet ;)08:58
sameowtf indeed...08:59
sameojodh: in go.opentelemetry.io/otel/exporters/trace/jaeger/uploader.go, do you know how the collectorUploader http client is initialized?09:22
fidenciojodh: may I bother you to rebase https://github.com/kata-containers/kata-containers/pull/2023 atop of main?09:45
sameojodh: Now I'm forcing jaeger to go through UDP, and the shim now tries to use UDP to talk to CLH over a unix socket.09:52
sameojodh: It looks like the http socket is shared...09:52
jodhsameo: I'm afraid I can't dig into this atm, but will chat with cmaf about it later...10:00
fidenciojodh: it blows my mind why on that PR, only on that PR, the static checks are not being triggered10:02
fidenciojodh: oh, I get it!10:03
fidencioforce-skip-ci label forces the static checks to **not** run, then being on that state forever10:04
fidenciowhat we should do, however, is force the static checks to short-circuit and return success on those cases10:04
fidencioas those are (and should be) required tests10:04
sameojodh: No worries.10:21
sameojodh: We're hitting a problem with the go runtime re-using sockets.10:21
sameojodh: One generic tracing question though: Do I have to disable new_netns from the config file for spans to be pushed to jaeger?10:28
jodhsameo: this would be for agent tracing only presumably? no, that isn't required, atleast for qemu. But looking at the comments suggests it might be. we need to review all config options imho.10:38

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!