portdirect | Cheers dude, same here :) | 00:00 |
---|---|---|
portdirect | I'm off to katoomba today to see where my grandad grew up, need a break from anything nautically themed for a couple of days! | 00:02 |
ianw | sounds fun, look out for jeblair, i think he's gone bush up there too | 00:03 |
*** MarkBaker has joined #openstack-helm | 00:05 | |
*** yamamoto has joined #openstack-helm | 00:08 | |
*** MarkBaker has quit IRC | 00:14 | |
*** huxinhui_ has quit IRC | 01:45 | |
openstackgerrit | Sungil Im proposed openstack/openstack-helm master: Fluent-logging helm chart https://review.openstack.org/514622 | 01:50 |
*** julim has joined #openstack-helm | 02:00 | |
*** jdandrea_ has joined #openstack-helm | 02:49 | |
*** alraddarla has quit IRC | 02:50 | |
*** jdandrea has quit IRC | 02:51 | |
*** jaypipes has quit IRC | 02:51 | |
*** leifmadsen has quit IRC | 02:51 | |
*** leifmadsen has joined #openstack-helm | 02:57 | |
*** jaypipes has joined #openstack-helm | 03:08 | |
*** coolsvap has joined #openstack-helm | 03:23 | |
*** alraddarla has joined #openstack-helm | 03:26 | |
*** lukepatrick has joined #openstack-helm | 03:29 | |
*** pyvpx_ has joined #openstack-helm | 03:55 | |
*** pyvpx has quit IRC | 03:56 | |
*** lukepatrick has quit IRC | 04:20 | |
srwilkers | portdirect: you don’t get to avoid nautical | 04:36 |
srwilkers | + Themed things | 04:36 |
*** hachi_ has joined #openstack-helm | 06:15 | |
*** pyvpx has joined #openstack-helm | 06:20 | |
*** pyvpx_ has quit IRC | 06:22 | |
*** hachi_ has quit IRC | 06:22 | |
*** MarkBaker has joined #openstack-helm | 07:04 | |
*** MarkBaker has quit IRC | 07:14 | |
*** yamamoto has quit IRC | 07:19 | |
*** yamamoto has joined #openstack-helm | 07:21 | |
*** hachi_ has joined #openstack-helm | 07:22 | |
*** yamamoto has quit IRC | 07:26 | |
*** sghosh has quit IRC | 07:33 | |
*** sghosh__ has joined #openstack-helm | 07:33 | |
*** MarkBaker has joined #openstack-helm | 07:53 | |
*** MarkBaker has quit IRC | 08:04 | |
*** yamamoto has joined #openstack-helm | 08:24 | |
*** yamamoto has quit IRC | 08:34 | |
*** jistr is now known as jistr|mtg | 08:48 | |
*** yamamoto has joined #openstack-helm | 09:04 | |
*** yamamoto has quit IRC | 09:13 | |
*** yamamoto has joined #openstack-helm | 09:25 | |
*** jklare has quit IRC | 09:30 | |
*** yamamoto has quit IRC | 09:31 | |
*** jklare has joined #openstack-helm | 09:32 | |
*** yamamoto has joined #openstack-helm | 09:38 | |
*** korzen has quit IRC | 09:38 | |
*** jistr|mtg is now known as jistr | 10:15 | |
*** MarkBaker has joined #openstack-helm | 10:20 | |
*** yamamoto has quit IRC | 10:26 | |
*** yamamoto has joined #openstack-helm | 10:31 | |
*** MarkBaker has quit IRC | 10:44 | |
*** yamamoto has quit IRC | 10:55 | |
*** hachi_ has quit IRC | 10:57 | |
*** hachi_ has joined #openstack-helm | 10:57 | |
*** hachi__ has joined #openstack-helm | 10:59 | |
*** hachi_ has quit IRC | 11:01 | |
jayahn | It was good to see at Sydney. It was a fantastic workshop. | 11:14 |
*** yamamoto has joined #openstack-helm | 11:14 | |
*** korzen has joined #openstack-helm | 11:35 | |
*** yamamoto has quit IRC | 11:38 | |
openstackgerrit | Mateusz Blaszkowski proposed openstack/openstack-helm master: ElastAlert: pushing notifications to Nagios https://review.openstack.org/518711 | 11:38 |
*** krypto has joined #openstack-helm | 12:01 | |
*** yamamoto has joined #openstack-helm | 12:31 | |
*** julim has quit IRC | 12:33 | |
*** krypto has quit IRC | 12:52 | |
*** krypto has joined #openstack-helm | 12:53 | |
*** krypto has quit IRC | 13:19 | |
*** krypto has joined #openstack-helm | 13:20 | |
*** krypto has quit IRC | 13:20 | |
*** krypto has joined #openstack-helm | 13:20 | |
*** coolsvap has quit IRC | 13:21 | |
*** schwicht has joined #openstack-helm | 13:32 | |
*** schwicht has quit IRC | 13:50 | |
*** lukepatrick has joined #openstack-helm | 14:10 | |
*** julim has joined #openstack-helm | 14:18 | |
*** krypto has quit IRC | 14:20 | |
*** hachi_ has joined #openstack-helm | 14:35 | |
*** hachi__ has quit IRC | 14:37 | |
osh-chatbot | <kperr> @v1k0d3n I noticed that even though mariadb pod is in running state `kubectl describe` shows ` Readiness probe failed: ERROR 2002 (HY000): Can't connect to local MySQL server through socket '/var/run/mysqld/mysqld.sock' (2 "No such file or directory") Could not SELECT 1 Warning Unhealthy Readiness probe failed: ERROR 1045 (28000): Access denied for user 'root'@'localhost' (using password: YES) Could not SELECT 1` | 14:38 |
osh-chatbot | <kperr> Is this warning normal? | 14:38 |
osh-chatbot | <kperr> Inside the pod there isn't any directory /var/run/mysqld/mysqld.sock | 14:39 |
*** lukepatrick has quit IRC | 14:43 | |
*** hachi__ has joined #openstack-helm | 15:00 | |
*** hachi_ has quit IRC | 15:02 | |
*** yamamoto has quit IRC | 15:05 | |
*** yamamoto has joined #openstack-helm | 15:07 | |
*** yamamoto has quit IRC | 15:11 | |
*** alraddarla has quit IRC | 15:14 | |
*** alraddarla_ has joined #openstack-helm | 15:17 | |
*** yamamoto has joined #openstack-helm | 15:22 | |
osh-chatbot | <v1k0d3n> hey @kperr…so some errors are expected even in perfectly fine environments. like, you will definitely see errors like `[Warning] Access denied for user 'root'@'localhost' (using password: YES)` while the cluster is coming up. | 15:25 |
osh-chatbot | <v1k0d3n> but you will also see messages that are good, like `Member 1.0 (mariadb-1.mariadb-discovery) requested state transfer from '*any*'. Selected 0.0 (mariadb-0.mariadb-discovery)(SYNCED) as donor.` | 15:26 |
osh-chatbot | <v1k0d3n> and.. | 15:26 |
osh-chatbot | <v1k0d3n> File uploaded https://kubernetes.slack.com/files/U0A333J23/F7YNSAU07/-.txt / https://slack-files.com/T09NY5SBT-F7YNSAU07-cbfc4ddeb3 | 15:26 |
osh-chatbot | <v1k0d3n> do you get these messages? | 15:27 |
osh-chatbot | <kperr> Well I only see `Member 0.0 (mariadb-0.mariadb-discovery) synced with group` but somewhere in the logs above I see | 15:35 |
osh-chatbot | <kperr> File uploaded https://kubernetes.slack.com/files/U1UPJN457/F7XQRB413/-.txt / https://slack-files.com/T09NY5SBT-F7XQRB413-e12c327b6e | 15:35 |
osh-chatbot | <v1k0d3n> how many mariadb members are you trying to deploy? 1 or 3? | 15:36 |
osh-chatbot | <v1k0d3n> also, is this AIO or multi-node? | 15:37 |
osh-chatbot | <kperr> This is a multinode and from the values.yaml file I see three replicas defined | 15:37 |
osh-chatbot | <v1k0d3n> and can you `kubectl get pods -o wide -n openstack` for me? | 15:38 |
osh-chatbot | <kperr> File uploaded https://kubernetes.slack.com/files/U1UPJN457/F7XQTM405/-.txt / https://slack-files.com/T09NY5SBT-F7XQTM405-39249489de | 15:38 |
*** hachi__ has quit IRC | 16:01 | |
*** julim_ has joined #openstack-helm | 16:03 | |
*** julim has quit IRC | 16:04 | |
osh-chatbot | <v1k0d3n> So the resolv.conf changes...you made/verifies those on all the nodes? | 16:07 |
*** lukepatrick has joined #openstack-helm | 16:14 | |
*** yamamoto has joined #openstack-helm | 16:23 | |
openstackgerrit | Steve Wilkerson proposed openstack/openstack-helm-infra master: WIP - Move prometheus to osh-infra https://review.openstack.org/517645 | 16:29 |
*** yamamoto has quit IRC | 16:32 | |
*** lukepatrick has quit IRC | 16:37 | |
*** Guest53223 has joined #openstack-helm | 16:38 | |
*** lukepatrick has joined #openstack-helm | 16:46 | |
*** julim has joined #openstack-helm | 16:51 | |
*** julim_ has quit IRC | 16:51 | |
*** Guest53223 has quit IRC | 16:53 | |
*** yamamoto has joined #openstack-helm | 17:27 | |
*** yamamoto has quit IRC | 17:33 | |
osh-chatbot | <srwilkers> @kperr -- are you using calico? | 17:44 |
*** hachi_ has joined #openstack-helm | 18:33 | |
osh-chatbot | <kperr> @v1k0d3n well I just have the entries mentioned in http://openstack-helm.readthedocs.io/en/latest/install/multinode.html#activating-control-plane-namespace-for-ceph in resol.conf files plus an entry for the ceph-mon svc as discussed yesterday. Do I need to add a new entry? | 18:48 |
osh-chatbot | <kperr> @srwilkers yes calico | 18:49 |
osh-chatbot | <raymaika> @kperr @v1k0d3n was asking to be sure that the /etc/resolv.conf changes you made to ensure that your host could resolve ceph-mon.ceph were also done on node3 (where they mariadb-0 pod is) | 18:50 |
osh-chatbot | <v1k0d3n> ^^ that for sure. | 18:51 |
osh-chatbot | <kperr> yes that host can resolvee ceph-mon.ceph | 18:51 |
osh-chatbot | <v1k0d3n> all of them in your multi-node cluster you mean? | 18:53 |
osh-chatbot | <kperr> yes | 18:53 |
osh-chatbot | <kperr> And as soon as I start deploying new services http://openstack-helm.readthedocs.io/en/latest/install/multinode.html#installation-of-other-services, the mariadb pod goes into crashloopback state with restarts | 19:04 |
*** jaypipes has quit IRC | 19:29 | |
*** jaypipes has joined #openstack-helm | 19:30 | |
*** hachi_ has quit IRC | 19:47 | |
*** jdandrea_ is now known as jdandrea | 20:11 | |
osh-chatbot | <portdirect> Hey @kperr what discs are you using to back the directory ceph is using on your hosts? And what is the spec of those hosts themselves? | 20:51 |
*** julim has quit IRC | 21:56 | |
*** julim has joined #openstack-helm | 21:57 | |
*** dayou has joined #openstack-helm | 21:57 | |
*** julim has quit IRC | 22:00 | |
*** hpl2000 has joined #openstack-helm | 22:04 | |
*** hpl2000 has quit IRC | 22:06 | |
*** HPL has joined #openstack-helm | 22:07 | |
*** HPL has quit IRC | 22:08 | |
*** HPL has joined #openstack-helm | 22:08 | |
*** jdandrea has quit IRC | 22:16 | |
*** jdandrea has joined #openstack-helm | 22:24 | |
*** lukepatrick has quit IRC | 22:51 | |
*** julim has joined #openstack-helm | 23:47 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!