*** schwicht has quit IRC | 00:25 | |
*** schwicht has joined #openstack-helm | 00:53 | |
*** schwicht has quit IRC | 01:12 | |
*** happyhemant has quit IRC | 01:28 | |
*** schwicht has joined #openstack-helm | 01:33 | |
*** michael-beaver has joined #openstack-helm | 01:38 | |
*** jamesgu has quit IRC | 02:12 | |
*** cheng1 has quit IRC | 02:51 | |
*** cheng1 has joined #openstack-helm | 02:53 | |
*** cfriesen has quit IRC | 03:00 | |
*** KeithMnemonic has quit IRC | 03:08 | |
*** cheng1 has quit IRC | 03:20 | |
*** cheng1 has joined #openstack-helm | 03:25 | |
*** michael-beaver has quit IRC | 03:48 | |
*** jaypipes has quit IRC | 05:47 | |
*** spsurya has joined #openstack-helm | 06:07 | |
*** jaypipes has joined #openstack-helm | 06:11 | |
*** bobmel has joined #openstack-helm | 06:32 | |
*** bobmel has quit IRC | 06:35 | |
*** bobmel has joined #openstack-helm | 06:42 | |
*** pgaxatte has joined #openstack-helm | 06:49 | |
*** JangwonLee has joined #openstack-helm | 06:49 | |
*** ianychoi has joined #openstack-helm | 07:02 | |
*** HagunKim has quit IRC | 07:05 | |
*** rihbb has joined #openstack-helm | 07:39 | |
*** lemko has joined #openstack-helm | 07:58 | |
*** jsuchome has joined #openstack-helm | 08:01 | |
*** rihbb has quit IRC | 08:05 | |
*** bobmel has quit IRC | 08:06 | |
*** gkadam has joined #openstack-helm | 08:16 | |
*** bobmel has joined #openstack-helm | 08:17 | |
*** gkadam has quit IRC | 08:17 | |
*** bobmel has quit IRC | 08:21 | |
*** bobmel has joined #openstack-helm | 08:21 | |
*** dpawlik has joined #openstack-helm | 08:40 | |
*** bobmel has quit IRC | 08:43 | |
lemko | Hi. In prometheus, I've a high number of node_high_network_drop_rcv on nodes with openvswitch label. I don't really feel anything is wrong with my instances in OpenStack. Is it normal? There are packets dropped by the kernel, what could it be? | 09:32 |
---|---|---|
*** gmann has quit IRC | 09:33 | |
openstackgerrit | Rihab Banday proposed openstack/openstack-helm-images master: Add bionic based build jobs to Zuul build configuraton https://review.opendev.org/665102 | 10:09 |
openstackgerrit | varagini karthik proposed openstack/openstack-helm-images master: Added Dockerfile for postgresql-Utility container. https://review.opendev.org/660095 | 10:12 |
openstackgerrit | Rihab Banday proposed openstack/openstack-helm-images master: Add bionic based build jobs to Zuul build configuraton https://review.opendev.org/665102 | 10:34 |
*** sthussey has quit IRC | 10:40 | |
*** gmann has joined #openstack-helm | 11:09 | |
*** nicolasbock has joined #openstack-helm | 11:21 | |
*** schwicht has quit IRC | 11:57 | |
*** arunkant has quit IRC | 11:59 | |
*** arunkant has joined #openstack-helm | 12:00 | |
*** spsurya has quit IRC | 12:18 | |
*** aaronsheffield has joined #openstack-helm | 12:56 | |
*** howell has joined #openstack-helm | 13:10 | |
openstackgerrit | Koffi Nogbe proposed openstack/openstack-helm-infra master: Add enhancement to mariadb backup https://review.opendev.org/661853 | 13:11 |
*** roman_g has joined #openstack-helm | 13:19 | |
*** schwicht has joined #openstack-helm | 13:33 | |
openstackgerrit | Koffi Nogbe proposed openstack/openstack-helm-infra master: Add enhancement to mariadb backup https://review.opendev.org/661853 | 14:16 |
*** sreejithp has joined #openstack-helm | 14:17 | |
*** cfriesen has joined #openstack-helm | 14:55 | |
openstackgerrit | Steve Wilkerson proposed openstack/openstack-helm-infra master: Add openstack-exporter tp openstack-helm-infra-aio-monitoring job https://review.opendev.org/665154 | 14:59 |
openstackgerrit | Steve Wilkerson proposed openstack/openstack-helm-infra master: Add openstack-exporter to openstack-helm-infra-aio-monitoring job https://review.opendev.org/665154 | 14:59 |
*** sthussey has joined #openstack-helm | 15:02 | |
*** dpawlik has quit IRC | 15:35 | |
*** pgaxatte has quit IRC | 15:36 | |
openstackgerrit | Tarshavardhan Somepalli proposed openstack/openstack-helm-infra master: test for changes https://review.opendev.org/665160 | 15:39 |
evrardjp | srwilkers: portdirect: just an FYI. a script I just wrote for the renames and delete of the old images starting with change_<id>_ is currently running. | 15:59 |
srwilkers | evrardjp: oh, that sounds good | 16:07 |
evrardjp | it's in ansible due to manipulation of tokens, and I didn't want to write my own exceptions :p | 16:10 |
evrardjp | but it works. Very serially and slowly, but works. | 16:11 |
evrardjp | it as stripped like 20 tags per loci image we build. keeping only one per date | 16:11 |
evrardjp | per date/branch/etc. | 16:11 |
evrardjp | I will tag all the rest with a date today -- sorry for the spam on this channel, but I rather be explicit in what's going on, and logging it here. | 16:12 |
evrardjp | and now all the opensuse_15 are frozen (with today's date, on top of "latest") | 16:41 |
evrardjp | If you want me to do the same for the xenial ones, i can reuse my script | 16:41 |
evrardjp | but I don't think you have an urgent need for it, am I right? | 16:41 |
*** lemko has quit IRC | 16:47 | |
srwilkers | evrardjp: sorry, just catching up. so it results in having a tag for the current date and still one for latest? | 17:07 |
srwilkers | or am i misunderstanding? (multitasking is bad) | 17:08 |
*** nicolasbock has quit IRC | 17:10 | |
*** rihbb has joined #openstack-helm | 17:33 | |
openstackgerrit | Om Prakash proposed openstack/openstack-helm master: Extending Neutron chart with support for OVS DPDK https://review.opendev.org/643284 | 18:07 |
*** ianychoi has quit IRC | 18:13 | |
*** arunkant has quit IRC | 18:16 | |
openstackgerrit | Steve Wilkerson proposed openstack/openstack-helm-infra master: Add openstack-exporter to aio-monitoring & openstack-support jobs https://review.opendev.org/665154 | 18:20 |
*** kskels has joined #openstack-helm | 18:22 | |
kskels | Hi all, here is an error that appears after cluster reboot for ingress | 18:22 |
kskels | https://www.irccloud.com/pastebin/fa2Ezhgx/ | 18:22 |
kskels | have things changed in the ingress chart? | 18:22 |
kskels | if pod is deleted - it will recover.. | 18:22 |
*** michael-beaver has joined #openstack-helm | 18:23 | |
kskels | portdirect: could it be related to https://opendev.org/openstack/openstack-helm-infra/commit/2abf62ff4dbb2997174a1957172217c1540b9e77 | 18:25 |
kskels | have you guys tested reboot of node/server with this change? | 18:25 |
kskels | and there is also 2nd issue with cluster reboot now | 18:37 |
kskels | https://www.irccloud.com/pastebin/Vg8mRb3a/ | 18:37 |
srwilkers | kskels: at the moment, there are no upstream jobs that exercise/simulate a node reboot for openstack-helm-* | 18:38 |
kskels | yes- seems there are now 2 issues with this | 18:38 |
kskels | let me know if you want me to report these as bugs | 18:39 |
kskels | this is broken compared to 1month old build - that survived a reboot | 18:39 |
portdirect | are you sure the issue is with the ingress chart? | 18:39 |
portdirect | but - yes - that ps could be a candidate for sure | 18:40 |
kskels | yes - as once you delete the ingress pod - it recovers nicely | 18:40 |
kskels | in other words - deployment goes well, then I do full node restart - ingress never recovers | 18:40 |
portdirect | ok - so yeah I'd put my suspicion there | 18:40 |
kskels | (as well as ceph-rgw - all other pods are happy) | 18:41 |
portdirect | can you just add a `rm -f /tmp/prometheus-nginx.socket` to the start script ? | 18:41 |
srwilkers | you can recreate that behavior by force deleting one of the kube-system ingress pods with no grace period -- the replacement pod shows that same behavior, which then can be addressed by deleting that subsequent pod | 18:41 |
srwilkers | portdirect: was going to be my suggestion too | 18:42 |
kskels | let me know if you want any more input on ceph-rgw part - I still have the env up | 18:46 |
kskels | e.g. | 18:46 |
kskels | https://www.irccloud.com/pastebin/EPhjjt81/ | 18:46 |
*** dpawlik has joined #openstack-helm | 18:54 | |
openstackgerrit | Steve Wilkerson proposed openstack/openstack-helm-infra master: Ingress: Remove prometheus-nginx.socket on start https://review.opendev.org/665216 | 19:04 |
srwilkers | portdirect: ^ | 19:04 |
openstackgerrit | Steve Wilkerson proposed openstack/openstack-helm-infra master: Add missing affinity keys to chart pod specs https://review.opendev.org/662802 | 19:15 |
*** rihbb has quit IRC | 19:43 | |
*** spiette has quit IRC | 20:43 | |
*** spiette has joined #openstack-helm | 20:48 | |
*** dpawlik has quit IRC | 21:01 | |
*** jsuchome has quit IRC | 21:19 | |
*** howell has quit IRC | 21:33 | |
*** schwicht has quit IRC | 21:35 | |
*** sreejithp has quit IRC | 21:43 | |
*** schwicht has joined #openstack-helm | 22:39 | |
*** aaronsheffield has quit IRC | 22:45 | |
*** schwicht has quit IRC | 23:00 | |
openstackgerrit | Alexander Noskov proposed openstack/openstack-helm-infra master: Ingress: Fix security context for pod/container https://review.opendev.org/663812 | 23:26 |
*** sthussey has quit IRC | 23:48 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!