| *** marst has joined #openstack-helm | 00:52 | |
| *** marst has quit IRC | 00:58 | |
| *** marst has joined #openstack-helm | 01:10 | |
| *** felipemonteiro has joined #openstack-helm | 01:33 | |
| *** felipemonteiro_ has joined #openstack-helm | 01:33 | |
| *** felipemonteiro has quit IRC | 01:37 | |
| *** felipemonteiro_ has quit IRC | 01:41 | |
| *** felipemonteiro_ has joined #openstack-helm | 01:41 | |
| *** MarkBaker has joined #openstack-helm | 01:49 | |
| *** felipemonteiro_ has quit IRC | 01:51 | |
| *** lukepatrick has joined #openstack-helm | 01:52 | |
| *** marst has quit IRC | 02:09 | |
| *** MarkBaker has quit IRC | 02:10 | |
| *** lukepatrick has quit IRC | 02:48 | |
| *** gouthamr has joined #openstack-helm | 02:49 | |
| osh-chatbot1 | <alraddarla> If anyone is around, we have the Durango room booked from 9-2 tomorrow https://ethercalc.openstack.org/Queens-PTG-Discussion-Rooms | 03:36 |
|---|---|---|
| v1k0d3n | awesome. thanks for the update @alraddarla. larry and i are planning on being there for sure...possibly luke's who's started contributing recently, but i'll have to find out tomorrow. | 03:40 |
| *** gouthamr has quit IRC | 03:54 | |
| *** gouthamr has joined #openstack-helm | 03:55 | |
| osh-chatbot1 | <alraddarla> Sweet! Excited to see everyone! :slightly_smiling_face: | 04:03 |
| *** marst has joined #openstack-helm | 04:33 | |
| *** marst has quit IRC | 05:39 | |
| *** korzen has joined #openstack-helm | 05:58 | |
| *** akorzeni__ has joined #openstack-helm | 06:09 | |
| *** korzen has quit IRC | 06:09 | |
| *** gouthamr has quit IRC | 07:15 | |
| openstackgerrit | Tin Lam proposed openstack/openstack-helm master: WIP: Provide dogtag plugin support https://review.openstack.org/500876 | 07:22 |
| *** pprokop_ has quit IRC | 08:07 | |
| *** pprokop has joined #openstack-helm | 08:07 | |
| *** mariusv has quit IRC | 08:18 | |
| *** mariusv has joined #openstack-helm | 08:28 | |
| *** MarkBaker has joined #openstack-helm | 12:28 | |
| srwilkers | Morning o/ | 12:52 |
| osh-chatbot1 | <v1k0d3n> Morning. | 12:52 |
| osh-chatbot1 | <v1k0d3n> O/ | 12:52 |
| *** MarkBaker has quit IRC | 12:57 | |
| *** MarkBaker has joined #openstack-helm | 12:58 | |
| *** julim has joined #openstack-helm | 13:16 | |
| *** MarkBaker has quit IRC | 13:23 | |
| zla | hello everyone, I'm trying to follow the latest documentation to set up a multi node cluster. the mariadb pod fails with the following message: https://pastebin.com/fi41jwJm anyone knows what this could be? thank you! | 13:27 |
| *** felipemonteiro_ has joined #openstack-helm | 13:37 | |
| *** MarkBaker has joined #openstack-helm | 13:37 | |
| *** felipemonteiro__ has joined #openstack-helm | 13:39 | |
| *** felipemonteiro_ has quit IRC | 13:42 | |
| *** marst has joined #openstack-helm | 13:57 | |
| *** marst has quit IRC | 13:57 | |
| *** MarkBaker has quit IRC | 13:59 | |
| *** akorzeni__ has quit IRC | 14:06 | |
| portdirect | zla: this error is commonly caused by the ceph keyring not being in the namespace that you are trying to deploy the db into | 14:08 |
| portdirect | Did you run this step: https://github.com/openstack/openstack-helm/blob/master/doc/source/install/multinode.rst#setting-up-rbac | 14:09 |
| portdirect | Before this one: https://github.com/openstack/openstack-helm/blob/master/doc/source/install/multinode.rst#activating-control-plane-namespace-for-ceph | 14:10 |
| zla | yes, I did | 14:11 |
| zla | just checked the bash history and it's there | 14:12 |
| *** MarkBaker has joined #openstack-helm | 14:13 | |
| portdirect | Can you get the logs of the namespace key populator? | 14:14 |
| zla | portdirect -sorry- but do you happen to know which pod in the namespace is acting as the key populator? I'm just a newbie you know :) | 14:18 |
| zla | portdirect these are the pods I have: https://pastebin.com/W3CDX5RB | 14:19 |
| portdirect | Can you run the same command but add --show-all to the end. | 14:23 |
| zla | portdirect of course: https://pastebin.com/6rvXwW3k | 14:27 |
| zla | maybe this is the pod? ceph-namespace-client-key-generator-7n87q | 14:28 |
| osh-chatbot1 | <alraddarla> Apologies for the mix up, we will actually be in "Vail" located on the Atrium floor | 14:37 |
| portdirect | zla: thats the one | 14:41 |
| zla | okay | 14:41 |
| zla | let me get the logs out of it | 14:41 |
| portdirect | if you run `kubectl logs -n openstack ceph-namespace-client-key-generator-7n87q` | 14:41 |
| portdirect | it would be great to see the output :) | 14:42 |
| zla | that is what it says: https://pastebin.com/XZPSQ8AB | 14:42 |
| *** hachi has joined #openstack-helm | 14:43 | |
| portdirect | that looks good | 14:44 |
| portdirect | :/ | 14:44 |
| zla | hmm what could this be then... | 14:44 |
| portdirect | next port of call would be looking through the kubelet logs on the node thats trying to mount the volume | 14:44 |
| portdirect | and being if anything pops out there | 14:44 |
| portdirect | *seeing | 14:44 |
| zla | portdirect I've found this when browsing the logs: https://pastebin.com/fhUnj7ad | 14:51 |
| zla | do you think this bug could be related? https://github.com/ceph/ceph-docker/issues/642 | 14:53 |
| *** felipemonteiro__ has quit IRC | 14:57 | |
| *** felipemonteiro__ has joined #openstack-helm | 14:57 | |
| portdirect | can you cat out your /etc/resolv.conf | 14:59 |
| zla | https://pastebin.com/HFjxgdFm | 15:01 |
| *** lukepatrick has joined #openstack-helm | 15:01 | |
| *** hachi has quit IRC | 15:02 | |
| portdirect | you'll need the etc/resolv.conf on your host to match that | 15:02 |
| portdirect | as otherwise the kubelet will not be able to connect to the cluster | 15:02 |
| *** felipemonteiro_ has joined #openstack-helm | 15:02 | |
| zla | so we have to change the resolv.conf on the actual physical server? | 15:02 |
| portdirect | yup | 15:02 |
| zla | ahh okay | 15:02 |
| portdirect | or in the kubelet if your running it in a container | 15:03 |
| portdirect | I should really get this redone, but it may help: https://review.openstack.org/#/c/491472/5/doc/source/install/multinode.rst | 15:04 |
| *** felipemonteiro has joined #openstack-helm | 15:04 | |
| *** felipemonteiro__ has quit IRC | 15:05 | |
| *** MarkBaker has quit IRC | 15:05 | |
| *** felipemonteiro_ has quit IRC | 15:06 | |
| zla | portdirect changed the resolv.conf and now I get this: https://pastebin.com/GV2j2KyA | 15:07 |
| *** jdandrea has quit IRC | 15:08 | |
| osh-chatbot1 | <portdirect> That's actually pretty normal | 15:11 |
| osh-chatbot1 | <portdirect> It should load the keyring from the secret dynamicly | 15:12 |
| osh-chatbot1 | <portdirect> You have the rbd binary on the host as well? | 15:12 |
| zla | yes I do, I installed ceph-common to each of the hosts | 15:13 |
| *** lukepatr_ has joined #openstack-helm | 15:14 | |
| openstackgerrit | dave kormann proposed openstack/openstack-helm master: Ceph liveness scripts https://review.openstack.org/497417 | 15:15 |
| *** lukepatrick has quit IRC | 15:17 | |
| *** lukepat__ has joined #openstack-helm | 15:17 | |
| *** marst has joined #openstack-helm | 15:18 | |
| *** lukepatr_ has quit IRC | 15:21 | |
| openstackgerrit | Merged openstack/openstack-helm master: Ceph: RGW and MDS deployment fixes https://review.openstack.org/502129 | 15:29 |
| openstackgerrit | Huamin Chen proposed openstack/openstack-helm master: WIP: Ceph: add mgr deployment https://review.openstack.org/502485 | 15:34 |
| *** lrensing has joined #openstack-helm | 15:36 | |
| *** gouthamr has joined #openstack-helm | 15:42 | |
| openstackgerrit | Pete Birley proposed openstack/openstack-helm master: WIP/DNM/RFC: Loci Build chart https://review.openstack.org/502264 | 15:43 |
| *** gouthamr has quit IRC | 15:46 | |
| osh-chatbot1 | <alraddarla> https://etherpad.openstack.org/p/openstack-helm-denver-ptg-topics | 15:47 |
| srwilkers | jayahn: o/ | 15:48 |
| srwilkers | are you in denver? | 15:48 |
| *** gouthamr has joined #openstack-helm | 15:48 | |
| openstackgerrit | Huamin Chen proposed openstack/openstack-helm master: WIP: Ceph: add mgr deployment https://review.openstack.org/502485 | 15:49 |
| *** gouthamr has quit IRC | 15:49 | |
| *** MarkBaker has joined #openstack-helm | 15:50 | |
| *** gouthamr has joined #openstack-helm | 15:52 | |
| jayahn | srwilkers: yes. i was doing some company work at thr room. we meet this morning? | 15:53 |
| jayahn | i can be down there in 10min. | 15:53 |
| srwilkers | yeah, we're in the Vail room on floor A | 15:54 |
| jayahn | okay. will be there soon. | 15:55 |
| alanmeadows | @portdirect: what was the blocker to having openstack-helm charts hosted by infra? e.g. every merge results in an updated tgz to an infra hosted tgz. I have forgotten | 15:55 |
| *** marst has quit IRC | 15:58 | |
| *** marst has joined #openstack-helm | 16:01 | |
| *** marst has quit IRC | 16:07 | |
| portdirect | afaik we just need a publisher | 16:07 |
| portdirect | though getting them indexed into a helm repo would require some work on the infra side I think | 16:08 |
| *** gouthamr has quit IRC | 16:11 | |
| *** marst has joined #openstack-helm | 16:13 | |
| *** felipemonteiro has quit IRC | 16:20 | |
| *** alraddarla has joined #openstack-helm | 16:21 | |
| *** gouthamr has joined #openstack-helm | 16:22 | |
| openstackgerrit | Darla Ahlert proposed openstack/openstack-helm master: [WIP] Add Tempest Chart https://review.openstack.org/498929 | 16:23 |
| *** lrensing has quit IRC | 16:23 | |
| zla | portdirect thanks, got it working. main problem was the missing kubernetes dns server from the resolv.conf on the host. thank you for your help! | 16:25 |
| *** lrensing has joined #openstack-helm | 16:27 | |
| *** alraddarla has quit IRC | 16:27 | |
| *** felipemonteiro has joined #openstack-helm | 16:28 | |
| portdirect | np :) | 16:30 |
| srwilkers | https://etherpad.openstack.org/p/osh-ptg-notes | 16:35 |
| openstackgerrit | Huamin Chen proposed openstack/openstack-helm master: WIP: Ceph: add mgr deployment https://review.openstack.org/502485 | 16:47 |
| openstackgerrit | Darla Ahlert proposed openstack/openstack-helm master: [WIP] Add Tempest Chart https://review.openstack.org/498929 | 16:49 |
| *** lrensing has quit IRC | 17:19 | |
| *** felipemonteiro has quit IRC | 17:22 | |
| *** felipemonteiro_ has joined #openstack-helm | 17:22 | |
| *** felipemonteiro__ has joined #openstack-helm | 17:25 | |
| *** lrensing has joined #openstack-helm | 17:26 | |
| *** felipemonteiro_ has quit IRC | 17:28 | |
| openstackgerrit | Merged openstack/openstack-helm master: Glance: Backend support and auth improvements https://review.openstack.org/501598 | 17:30 |
| *** jdandrea_ has joined #openstack-helm | 17:33 | |
| *** lrensing has quit IRC | 17:53 | |
| *** marst has quit IRC | 17:53 | |
| *** gouthamr has quit IRC | 17:54 | |
| *** MarkBaker has quit IRC | 17:59 | |
| openstackgerrit | Darla Ahlert proposed openstack/openstack-helm master: Add Rally Chart https://review.openstack.org/491015 | 17:59 |
| *** lrensing has joined #openstack-helm | 18:00 | |
| osh-chatbot1 | <alraddarla> We are going on a lunch break....we plan to resume at 1PM and will be in Pikes Peak on the 3rd floor :slightly_smiling_face: | 18:04 |
| *** julim_ has joined #openstack-helm | 18:06 | |
| *** julim has quit IRC | 18:07 | |
| *** lrensing has quit IRC | 18:39 | |
| *** MarkBaker has joined #openstack-helm | 18:55 | |
| *** gouthamr has joined #openstack-helm | 18:59 | |
| openstackgerrit | Darla Ahlert proposed openstack/openstack-helm master: [WIP] Add Tempest Chart https://review.openstack.org/498929 | 19:39 |
| *** alraddarla has joined #openstack-helm | 19:43 | |
| *** felipemonteiro_ has joined #openstack-helm | 19:47 | |
| *** felipemonteiro__ has quit IRC | 19:47 | |
| *** felipemonteiro__ has joined #openstack-helm | 19:48 | |
| *** korzen has joined #openstack-helm | 19:49 | |
| *** felipemonteiro_ has quit IRC | 19:51 | |
| *** StaceyF has joined #openstack-helm | 19:53 | |
| evrardjp | hello guy, meeting in Packaging room for those at the OpenStack PTG :) | 20:00 |
| evrardjp | guys* | 20:00 |
| evrardjp | folks* | 20:00 |
| *** marst has joined #openstack-helm | 20:03 | |
| *** hogepodge_ has joined #openstack-helm | 20:16 | |
| *** wxy_ has joined #openstack-helm | 20:16 | |
| *** alanmeadows_ has joined #openstack-helm | 20:17 | |
| *** ChanServ sets mode: +o alanmeadows_ | 20:17 | |
| *** jayahn_ has joined #openstack-helm | 20:19 | |
| *** jayahn_ has quit IRC | 20:23 | |
| *** jayahn has quit IRC | 20:24 | |
| *** wxy has quit IRC | 20:24 | |
| *** hogepodge has quit IRC | 20:24 | |
| *** larainema has quit IRC | 20:24 | |
| *** portdirect has quit IRC | 20:24 | |
| *** alanmeadows has quit IRC | 20:24 | |
| *** wxy_ is now known as wxy | 20:24 | |
| *** alanmeadows_ is now known as alanmeadows | 20:24 | |
| *** hogepodge_ is now known as hogepodge | 20:24 | |
| *** jayahn has joined #openstack-helm | 20:25 | |
| *** korzen has quit IRC | 20:25 | |
| *** julim has joined #openstack-helm | 20:25 | |
| *** julim has quit IRC | 20:26 | |
| *** julim_ has quit IRC | 20:28 | |
| *** portdirect has joined #openstack-helm | 20:38 | |
| *** ChanServ sets mode: +o portdirect | 20:38 | |
| *** felipemonteiro_ has joined #openstack-helm | 20:38 | |
| *** felipemonteiro__ has quit IRC | 20:38 | |
| openstackgerrit | Darla Ahlert proposed openstack/openstack-helm master: [WIP] Add Tempest Chart https://review.openstack.org/498929 | 20:39 |
| *** felipemonteiro__ has joined #openstack-helm | 20:40 | |
| *** felipemonteiro_ has quit IRC | 20:43 | |
| *** openstackgerrit has quit IRC | 20:48 | |
| *** lrensing has joined #openstack-helm | 20:51 | |
| *** MarkBaker has quit IRC | 20:58 | |
| *** gouthamr has quit IRC | 21:03 | |
| osh-chatbot1 | <alraddarla> FYI - We have Vail (Atrium level) reserved tomorrow from 9-2 | 21:28 |
| *** felipemonteiro_ has joined #openstack-helm | 21:33 | |
| *** felipemonteiro__ has quit IRC | 21:33 | |
| *** alraddarla has quit IRC | 21:33 | |
| *** marst_ has joined #openstack-helm | 21:34 | |
| *** marst has quit IRC | 21:36 | |
| *** marst_ has quit IRC | 21:40 | |
| *** StaceyF has quit IRC | 21:40 | |
| *** gouthamr has joined #openstack-helm | 21:42 | |
| *** felipemonteiro__ has joined #openstack-helm | 21:43 | |
| *** felipemonteiro_ has quit IRC | 21:47 | |
| *** lrensing has quit IRC | 21:47 | |
| *** marst has joined #openstack-helm | 22:02 | |
| *** felipemonteiro__ has quit IRC | 22:05 | |
| *** larainema has joined #openstack-helm | 22:13 | |
| *** Guest45420 has quit IRC | 22:15 | |
| *** bradjones has joined #openstack-helm | 22:19 | |
| *** bradjones has quit IRC | 22:19 | |
| *** bradjones has joined #openstack-helm | 22:19 | |
| *** gouthamr has quit IRC | 22:29 | |
| osh-chatbot1 | <grantmiller1> Hi, I'm not sure if this is the right place, but I'm running into a issue bringing openstack up on helm. I've started all the openstack services and both nova-db-sync and neutron-db-sync are in a crash loop. My container status looks like this: https://pastebin.com/zeVFEUPE | 22:31 |
| osh-chatbot1 | <grantmiller1> My logs for nova-db-sync and neutron-db-sync are here: https://pastebin.com/3fEvTLdy https://pastebin.com/kQCc1q0A | 22:32 |
| osh-chatbot1 | <grantmiller1> I could be wrong, but it looks like I'm hitting this bug: https://bugs.launchpad.net/openstack-helm/+bug/1709524 | 22:33 |
| openstack | Launchpad bug 1709524 in openstack-helm "nova-db-sysnc pod CrashLoopBackOff" [High,Confirmed] - Assigned to Steven Wilkerson (srwilkers) | 22:33 |
| osh-chatbot1 | <portdirect> Sounds like it :( | 22:36 |
| osh-chatbot1 | <portdirect> If you delete the db using mysql commands and then redeploy one at a time you should be ok | 22:37 |
| osh-chatbot1 | <portdirect> We're working to get this resolved asap | 22:37 |
| osh-chatbot1 | <grantmiller1> Ok, I was tempted to blow those tables away, but was afraid of screwing it up even more. | 22:38 |
| osh-chatbot1 | <grantmiller1> Thanks for the workaround, will give it a shot | 22:38 |
| *** lukepat__ has quit IRC | 22:54 | |
| *** MarkBaker has joined #openstack-helm | 23:00 | |
| *** MarkBaker has quit IRC | 23:07 | |
| osh-chatbot1 | <grantmiller1> So, delete the entire nova db or just the instances table that it's complaining about? | 23:11 |
| portdirect | The entire db is easiest | 23:30 |
| portdirect | Just ask yourself, what would Ripley do? | 23:30 |
| portdirect | "Nuke the site from orbit" | 23:30 |
| portdirect | ;) | 23:30 |
| osh-chatbot1 | <grantmiller1> Thanks, now how do I tell helm to stop running nova so that I can run helm install again? helm delete? | 23:43 |
| portdirect | helm delete --purge nova | 23:44 |
| *** marst has quit IRC | 23:51 | |
| osh-chatbot1 | <grantmiller1> Seems to be working, nova stuff is actually running now. Just waiting for nova-compute to run. Thanks! | 23:52 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!