openstackgerrit | dave kormann proposed openstack/openstack-helm master: Ceph OSD disk targeting https://review.openstack.org/457754 | 01:14 |
---|---|---|
portdirect | anticw / gagehugo: looks like something is not right with zuul cloner since the move to v3 | 01:28 |
portdirect | http://logs.openstack.org/54/457754/67/check/legacy-openstack-helm-aio-basic-ovs-radosgw/cd21d38/job-output.txt.gz#_2017-09-29_01_23_05_351583 | 01:28 |
SamYaple | portdirect: it borked loci builds too | 01:31 |
SamYaple | gotta switch to required-projects | 01:31 |
SamYaple | ala https://github.com/openstack-infra/openstack-zuul-jobs/blob/master/zuul.d/zuul-legacy-jobs.yaml#L64 | 01:32 |
*** yamamoto has joined #openstack-helm | 01:36 | |
*** yamamoto has quit IRC | 01:44 | |
portdirect | https://etherpad.openstack.org/p/cvedg2Y74g | 01:44 |
* portdirect gets ready for an evening of writing new gates | 01:45 | |
SamYaple | and drinking | 01:46 |
SamYaple | dont forget drinking | 01:46 |
portdirect | please, I began with drinking - I do live in STL :P | 01:46 |
SamYaple | its either drinking or stabbing | 01:47 |
SamYaple | the occassional car fire to keep warm | 01:47 |
portdirect | lol - The stabbyness of this place is over-rated | 01:47 |
portdirect | but then I hardly ever leave the compound these days | 01:48 |
SamYaple | quite pete you are depressing me | 01:48 |
portdirect | le Quel est le panda triste? | 01:49 |
SamYaple | https://i.imgur.com/hSd0iTC.gif | 01:53 |
portdirect | amateur: http://www.blog.thehoya.com/wp-content/uploads/2015/04/giphy-1.gif | 01:57 |
*** lukepatrick has joined #openstack-helm | 01:58 | |
SamYaple | says the guy that moves to the us.... to STL | 02:02 |
*** kevzha01 has joined #openstack-helm | 02:20 | |
*** lukepatrick has quit IRC | 02:20 | |
*** lukepatrick has joined #openstack-helm | 02:28 | |
*** yamamoto has joined #openstack-helm | 02:36 | |
*** lukepatrick has quit IRC | 02:43 | |
openstackgerrit | Pete Birley proposed openstack/openstack-helm master: Neutron: Move Nova credentials to endpoints in values.yaml https://review.openstack.org/507521 | 02:50 |
openstackgerrit | Pete Birley proposed openstack/openstack-helm master: Nova: Move Neutron credentials to endpoints in values.yaml https://review.openstack.org/507519 | 02:51 |
*** lukepatrick has joined #openstack-helm | 02:55 | |
*** lukepatrick has quit IRC | 03:02 | |
*** lukepatrick has joined #openstack-helm | 03:44 | |
openstackgerrit | Merged openstack/openstack-helm master: Neutron: Move Nova credentials to endpoints in values.yaml https://review.openstack.org/507521 | 04:04 |
openstackgerrit | Merged openstack/openstack-helm master: Nova: Move Neutron credentials to endpoints in values.yaml https://review.openstack.org/507519 | 04:04 |
openstackgerrit | Pete Birley proposed openstack/openstack-helm master: Telemetry: add postgresql chart https://review.openstack.org/508232 | 04:06 |
openstackgerrit | Pete Birley proposed openstack/openstack-helm master: Telemetry: add gnocchi chart https://review.openstack.org/508245 | 04:06 |
openstackgerrit | Pete Birley proposed openstack/openstack-helm master: Telemetry: add mongodb chart https://review.openstack.org/508247 | 04:06 |
openstackgerrit | Pete Birley proposed openstack/openstack-helm master: Telemetry: add ceilometer chart https://review.openstack.org/508250 | 04:06 |
openstackgerrit | Pete Birley proposed openstack/openstack-helm master: Telemetry: enable publishing of events for core OpenStack Components https://review.openstack.org/508257 | 04:07 |
openstackgerrit | Pete Birley proposed openstack/openstack-helm master: Telemetry: add aodh chart https://review.openstack.org/508264 | 04:07 |
*** coolsvap has joined #openstack-helm | 04:42 | |
openstackgerrit | mnayakbomman@juniper.net proposed openstack/openstack-helm master: [WIP] Opencontrail charts for openstack-helm https://review.openstack.org/508403 | 04:50 |
anticw | portdirect: aye, the whole gerrit upgrade thing hasn't gone as well as hoped | 05:20 |
*** julim has quit IRC | 05:26 | |
*** julim_ has joined #openstack-helm | 05:27 | |
*** lukepatrick has quit IRC | 05:36 | |
*** MarkBaker has joined #openstack-helm | 05:45 | |
*** yamamoto_ has joined #openstack-helm | 05:53 | |
*** yamamoto has quit IRC | 05:57 | |
openstackgerrit | Mateusz Blaszkowski proposed openstack/openstack-helm master: RBAC authorization support https://review.openstack.org/464630 | 06:19 |
*** NikoHerEricsson has joined #openstack-helm | 07:14 | |
*** pprokop_ has quit IRC | 07:58 | |
*** MarkBaker has quit IRC | 08:10 | |
*** pprokop has joined #openstack-helm | 08:14 | |
*** kevzha01 has quit IRC | 08:36 | |
*** yamamoto_ has quit IRC | 09:01 | |
*** pprokop has quit IRC | 09:22 | |
*** yamamoto has joined #openstack-helm | 09:29 | |
*** yamamoto has quit IRC | 09:32 | |
*** yamamoto has joined #openstack-helm | 09:40 | |
*** yamamoto has quit IRC | 09:54 | |
*** yamamoto has joined #openstack-helm | 10:01 | |
openstackgerrit | Sungil Im proposed openstack/openstack-helm-addons master: WIP: Fluent-logging helm chart https://review.openstack.org/507023 | 10:18 |
*** RuiChen has quit IRC | 10:42 | |
openstackgerrit | Sungil Im proposed openstack/openstack-helm-addons master: WIP: Fluent-logging helm chart https://review.openstack.org/507023 | 11:15 |
*** MarkBaker has joined #openstack-helm | 11:43 | |
*** NikoHerEricsson has left #openstack-helm | 12:05 | |
*** jaypipes has joined #openstack-helm | 12:48 | |
*** jaypipes is now known as leakypipes | 13:04 | |
openstackgerrit | Sungil Im proposed openstack/openstack-helm-addons master: WIP: Fluent-logging helm chart https://review.openstack.org/507023 | 13:22 |
*** dansmith is now known as superdan | 13:34 | |
openstackgerrit | Jaesuk Ahn proposed openstack/openstack-helm-addons master: Fluent-logging helm chart https://review.openstack.org/507023 | 13:43 |
*** gouthamr has joined #openstack-helm | 13:44 | |
*** coolsvap has quit IRC | 14:10 | |
*** MarkBaker has quit IRC | 14:40 | |
osh-chatbot1 | <v1k0d3n> hey all…are the zuul issues preventing code from being merged in (when wf is +1)? | 14:50 |
osh-chatbot1 | <v1k0d3n> https://review.openstack.org/#/c/507259/ | 14:50 |
openstackgerrit | Pete Birley proposed openstack/openstack-helm master: WIP: Zuulv3 gate https://review.openstack.org/508534 | 14:55 |
portdirect | v1k0d3n: I should have fixed that last night | 14:57 |
portdirect | but a few things will need to be workflowed again | 14:57 |
portdirect | if its not merged would be good to sort anticw's comment in that ps | 14:57 |
osh-chatbot1 | <v1k0d3n> yeah, i just wf’ed on my end…to see if that would help. zuul kicked some emails i noticed, but in the history in gerrit it seems to appear/disappear with a refresh. sort of strange. | 14:58 |
openstackgerrit | Darla Ahlert proposed openstack/openstack-helm master: [WIP] Add Rally Chart https://review.openstack.org/491015 | 14:59 |
portdirect | just fallout from the change to v3 - most things from yesterday will need rechecked/workflowed to kick them back into life | 15:01 |
osh-chatbot1 | <v1k0d3n> make sense. if there are ones you need or want me to kick, let me know. i can try to help push some of them back through if needed. | 15:02 |
portdirect | I'm back to playing with ansible - w00t (I think?) hand hopt to have v3 native gates in review by eod | 15:02 |
osh-chatbot1 | <v1k0d3n> lol | 15:02 |
*** MarkBaker has joined #openstack-helm | 15:03 | |
*** lrensing has joined #openstack-helm | 15:05 | |
openstackgerrit | Merged openstack/openstack-helm master: Adding database drop jobs https://review.openstack.org/507259 | 15:07 |
openstackgerrit | Darla Ahlert proposed openstack/openstack-helm master: [WIP] Add Tempest Chart https://review.openstack.org/498929 | 15:08 |
*** lukepatrick has joined #openstack-helm | 15:09 | |
*** lukepatr_ has joined #openstack-helm | 15:10 | |
*** lukepatrick has quit IRC | 15:13 | |
openstackgerrit | Steve Wilkerson proposed openstack/openstack-helm-addons master: WIP - Prometheus Monitoring Stack https://review.openstack.org/481121 | 15:16 |
*** yamamoto has quit IRC | 15:18 | |
*** v1k0d3n has quit IRC | 15:19 | |
*** v1k0d3n has joined #openstack-helm | 15:20 | |
*** ChanServ sets mode: +o v1k0d3n | 15:20 | |
*** lukepatr_ has quit IRC | 15:31 | |
*** lukepatrick has joined #openstack-helm | 15:31 | |
gagehugo | portdirect https://review.openstack.org/#/c/508511/ | 15:40 |
*** MarkBaker has quit IRC | 15:56 | |
*** yamamoto has joined #openstack-helm | 16:18 | |
*** yamamoto has quit IRC | 16:24 | |
openstackgerrit | Darla Ahlert proposed openstack/openstack-helm master: [WIP] Add Rally Chart https://review.openstack.org/491015 | 16:42 |
osh-chatbot1 | <v1k0d3n> is @rootfs around by chance? | 16:56 |
osh-chatbot1 | <v1k0d3n> have some ceph questions, and some strange issues i can’t seem to track down either. | 16:56 |
osh-chatbot1 | <v1k0d3n> @portdirect, maybe you could help direct me too…joggle my brain a bit? | 16:56 |
osh-chatbot1 | <v1k0d3n> i am using bootkube to stand up kubernetes. | 16:57 |
osh-chatbot1 | <v1k0d3n> and following the multi-docs…however sort of following the path of a genesis host… | 16:57 |
osh-chatbot1 | <v1k0d3n> does the OSD have a hard requirements for number of nodes? | 16:58 |
portdirect | no | 16:58 |
osh-chatbot1 | <v1k0d3n> everything appears fine. but i do get an msg: “Use journal_force_aio to force use of aio anyway” | 16:59 |
osh-chatbot1 | <v1k0d3n> on OSD | 16:59 |
portdirect | though you should have an odd number really for a sucessfull qorum | 16:59 |
portdirect | 2 sec | 16:59 |
portdirect | thats pretty normal afiak: http://logs.openstack.org/57/508257/2/check/legacy-openstack-helm-aio-basic-ovs-swift/e61ab23/logs/k8s/pods/ceph-ceph-osd-tp0xq-osd-pod.txt | 17:00 |
osh-chatbot1 | <v1k0d3n> yeah it’s acting as AIO at the moment. | 17:00 |
portdirect | that line is referring to the journal being aio with the data on that osd afaik | 17:01 |
portdirect | a bit confusing (so many AIO's :) ) but not related to the number of osds | 17:02 |
*** gouthamr has quit IRC | 17:10 | |
openstackgerrit | Luke Philips proposed openstack/openstack-helm master: FQDN Support - add doc and config props https://review.openstack.org/508291 | 17:15 |
osh-chatbot1 | <rootfs> v1k0d3n: yes, that msg is benign | 17:18 |
*** yamamoto has joined #openstack-helm | 17:20 | |
*** yamamoto has quit IRC | 17:25 | |
*** gouthamr has joined #openstack-helm | 17:34 | |
osh-chatbot1 | <luke_> hey @portdirect RE: fqdn understood the `public: null` config is not required. intentionally trying to place it there for awareness. thoughts? against convention? | 17:36 |
portdirect | I'm concerned that having unrequired values in the default config will make auditing etc hard - we really should have only the minimal requirements in them to make the service functional. | 17:37 |
portdirect | the doc you have is a great way to explain/highlight the functionaility i think | 17:38 |
osh-chatbot1 | <luke_> cool. thanks for clarifying. | 17:41 |
osh-chatbot1 | <portdirect> np :slightly_smiling_face: | 17:41 |
openstackgerrit | Luke Philips proposed openstack/openstack-helm master: FQDN Support - add doc and config props https://review.openstack.org/508291 | 17:43 |
openstackgerrit | Chris Wedgwood proposed openstack/openstack-helm master: libvirt: fix operation when ceph is disabled https://review.openstack.org/508197 | 18:00 |
osh-chatbot1 | <v1k0d3n> hey @rootfs getting some a strange and hard to trace condition with ceph. i can send some logs for you. | 18:00 |
osh-chatbot1 | <v1k0d3n> one thing that bothers me is this message from `kubectl describe`… | 18:00 |
osh-chatbot1 | <v1k0d3n> File uploaded https://kubernetes.slack.com/files/U0A333J23/F7AEPD8M6/-.txt / https://slack-files.com/T09NY5SBT-F7AEPD8M6-a884304fc4 | 18:02 |
osh-chatbot1 | <v1k0d3n> everything else…logs in the container, etc…all look ok. the dirs are being cleaned out properly, etc. | 18:02 |
osh-chatbot1 | <v1k0d3n> this is a single node, annotated/labeled to be a worker. | 18:03 |
osh-chatbot1 | <portdirect> what ip is the kubelet reporting as its own? | 18:05 |
osh-chatbot1 | <portdirect> if its diff from the ip that the osd is serving on you'll hit that | 18:06 |
osh-chatbot1 | <portdirect> dave is working on a solultion to this atm | 18:06 |
osh-chatbot1 | <portdirect> but in the meantime if you ensure they align you should be good to go (i Hope) | 18:06 |
*** lrensing has quit IRC | 18:09 | |
*** lukepatrick has quit IRC | 18:21 | |
*** yamamoto has joined #openstack-helm | 18:22 | |
*** yamamoto has quit IRC | 18:26 | |
*** mariusv has quit IRC | 18:56 | |
*** mariusv has joined #openstack-helm | 18:56 | |
openstackgerrit | Darla Ahlert proposed openstack/openstack-helm master: [WIP] Add Rally Chart https://review.openstack.org/491015 | 19:07 |
*** lrensing has joined #openstack-helm | 19:10 | |
*** lukepatrick has joined #openstack-helm | 19:12 | |
*** yamamoto has joined #openstack-helm | 19:23 | |
*** lrensing has quit IRC | 19:23 | |
*** yamamoto has quit IRC | 19:28 | |
*** lrensing has joined #openstack-helm | 19:42 | |
osh-chatbot1 | <v1k0d3n> @portdirect should be fine i believe. i’m overriding the kubelet name to the ip address. | 19:46 |
osh-chatbot1 | <v1k0d3n> File uploaded https://kubernetes.slack.com/files/U0A333J23/F7C2YLM1U/-.txt / https://slack-files.com/T09NY5SBT-F7C2YLM1U-36b8325ecb | 19:47 |
osh-chatbot1 | <v1k0d3n> that’s what i’ve used before…a lot of work has gone into ceph though, even removing some need for previous requirements (which is really awesome to see). that’s the current config for kubelet. ip address on this host is 192.168.4.81. | 19:48 |
*** yamamoto has joined #openstack-helm | 20:24 | |
*** yamamoto has quit IRC | 20:29 | |
osh-chatbot1 | <alraddarla> vc yuhuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuj' | 20:34 |
osh-chatbot1 | <alraddarla> ^^ my cat says hello | 20:34 |
portdirect | hello cat | 20:35 |
lrensing | hi | 20:35 |
osh-chatbot1 | <v1k0d3n> suuuuure | 20:35 |
osh-chatbot1 | <v1k0d3n> :cat: | 20:35 |
osh-chatbot1 | <alraddarla> lololol | 20:36 |
osh-chatbot1 | <luke_> https://i.imgur.com/4dSv0jH.gif | 20:37 |
osh-chatbot1 | <renmak> @v1k0d3n Hey Brandon, how are you doing? Yeah that Liveness probe changes was recently checked in to 457754 by Dave. Code works fine before his changes. | 20:38 |
osh-chatbot1 | <renmak> if you share what's going on may be i can share with Dave. He did mentioned that he tested Liveness changes in his env and it worked fine. | 20:39 |
osh-chatbot1 | <alraddarla> @luke_ that is accurate | 20:40 |
osh-chatbot1 | <alraddarla> have a great weekend everyone! | 20:40 |
osh-chatbot1 | <v1k0d3n> @renmak what’s up man! no complaints really. except for this cold weather out in d-land :slightly_smiling_face: | 20:47 |
osh-chatbot1 | <renmak> :slightly_smiling_face: :+1: | 20:49 |
*** julim_ has quit IRC | 21:07 | |
*** julim has joined #openstack-helm | 21:07 | |
*** julim has quit IRC | 21:12 | |
*** wxy has quit IRC | 21:13 | |
*** lukepatrick has quit IRC | 21:14 | |
openstackgerrit | Pete Birley proposed openstack/openstack-helm master: Telemetry: add postgresql chart https://review.openstack.org/508232 | 21:14 |
openstackgerrit | Pete Birley proposed openstack/openstack-helm master: Telemetry: add mongodb chart https://review.openstack.org/508247 | 21:16 |
openstackgerrit | Pete Birley proposed openstack/openstack-helm master: Telemetry: add gnocchi chart https://review.openstack.org/508245 | 21:17 |
openstackgerrit | Pete Birley proposed openstack/openstack-helm master: WIP: Zuulv3 gate https://review.openstack.org/508534 | 21:21 |
*** yamamoto has joined #openstack-helm | 21:25 | |
osh-chatbot1 | <portdirect> @v1k0d3n that snippet above does not force the kubelet to use `192.168.4.81` as the nodeip | 21:30 |
osh-chatbot1 | <portdirect> you may have more luck with the following: | 21:30 |
osh-chatbot1 | <portdirect> ``` [Unit] Description=Kubernetes Kubelet Documentation=https://kubernetes.io/docs/admin/kubelet/ [Service] ExecStartPre=/bin/mkdir -p /etc/kubernetes/manifests ExecStart=/usr/local/bin/kubelet \ --kubeconfig=/etc/kubernetes/kubeconfig \ --require-kubeconfig \ --cni-conf-dir=/etc/cni/net.d \ --cni-bin-dir=/opt/cni/bin \ --network-plugin=cni \ --lock-file=/var/run/lock/kubelet.lock \ | 21:30 |
osh-chatbot1 | --exit-on-lock-contention \ --pod-manifest-path=/etc/kubernetes/manifests \ --allow-privileged \ --cluster_dns=10.96.0.10,8.8.4.4,8.8.8.8 \ --cluster_domain=cluster.local \ --node-labels= \ --hostname-override=192.168.4.81 \ --v=2 Restart=on-failure RestartSec=5 [Install] WantedBy=multi-user.target ``` | 21:30 |
osh-chatbot1 | <portdirect> lol - 2 sec | 21:31 |
*** yamamoto has quit IRC | 21:31 | |
osh-chatbot1 | <portdirect> ``` [Unit] Description=Kubernetes Kubelet Documentation=https://kubernetes.io/docs/admin/kubelet/ [Service] ExecStartPre=/bin/mkdir -p /etc/kubernetes/manifests ExecStart=/usr/local/bin/kubelet \ --kubeconfig=/etc/kubernetes/kubeconfig \ --require-kubeconfig \ --cni-conf-dir=/etc/cni/net.d \ --cni-bin-dir=/opt/cni/bin \ --network-plugin=cni \ --lock-file=/var/run/lock/kubelet.lock \ | 21:31 |
osh-chatbot1 | --exit-on-lock-contention \ --pod-manifest-path=/etc/kubernetes/manifests \ --allow-privileged \ --cluster_dns=10.96.0.10,8.8.4.4,8.8.8.8 \ --cluster_domain=cluster.local \ --node-labels= \ --node-ip=192.168.4.81 \ --hostname-override=192.168.4.81 \ --v=2 Restart=on-failure RestartSec=5 [Install] WantedBy=multi-user.target ``` | 21:31 |
osh-chatbot1 | <portdirect> note the `--node-ip` flag | 21:32 |
osh-chatbot1 | <portdirect> this has caught out a few other people running multiple nics - though your issue may be different :S | 21:32 |
osh-chatbot1 | <portdirect> all the above is presuming your cidr for ceph things is "192.168.x.y/z" if not you'd need to adjust accordingly until daves ps is in. | 21:34 |
*** lrensing has quit IRC | 21:37 | |
*** yamamoto has joined #openstack-helm | 22:27 | |
osh-chatbot1 | <v1k0d3n> Ahh...total oversight on my part @portdirect! glad you pointed that out...super helpful. Thank you!! | 22:28 |
osh-chatbot1 | <v1k0d3n> Ceph has changed so many times, that it’s hard keeping up, even being fairly close to the project. | 22:29 |
*** gouthamr has quit IRC | 22:29 | |
osh-chatbot1 | <v1k0d3n> May be helpful to change the cidr that the Calico manifest uses for the pod ip range, just so there’s no confusion. | 22:29 |
osh-chatbot1 | <v1k0d3n> Meaning, in the multinode, the pod cidr and the host ranges are set to 192.168.0.0/16. | 22:30 |
osh-chatbot1 | <v1k0d3n> I’m on mobile...may explain later if I’m not explaining this well. | 22:31 |
*** yamamoto has quit IRC | 22:32 | |
osh-chatbot1 | <mattmceuen> Hey, I thought we had a helper script that would do a (one-time, up-front) generation of a project's values.yaml conf based on its corresponding oslo config. I can't find it or its docs -- anyone know? | 23:18 |
srwilkers | Hey matt. The Oslo genconfig tool was removed. We’re handling the config files differently now | 23:20 |
osh-chatbot1 | <mattmceuen> I know yaml->config is all template magic now. Can you point me to the initial config->yaml mapping? | 23:21 |
srwilkers | https://github.com/openstack/openstack-helm/blob/master/keystone/templates/configmap-etc.yaml#L41 | 23:21 |
srwilkers | Gets values from this tree: https://github.com/openstack/openstack-helm/blob/master/keystone/values.yaml#L254 | 23:22 |
osh-chatbot1 | <mattmceuen> My question is -- where does that tree come from | 23:23 |
osh-chatbot1 | <mattmceuen> Used to be a script (iirc!) that would do some kolla things and spit out yamlized config for a project | 23:23 |
srwilkers | It’s just declared in values by hand. the conf.service.whatever entries correspond to the Config sections in the service.conf files | 23:24 |
osh-chatbot1 | <mattmceuen> Ok, I must have made that up then, Thanks Steve! | 23:25 |
srwilkers | Cheers dude | 23:26 |
osh-chatbot1 | <v1k0d3n> Cheers! 8) | 23:27 |
osh-chatbot1 | <mattmceuen> yo @v1k0d3n! | 23:27 |
osh-chatbot1 | <v1k0d3n> :beer:🥂:tropical_drink::wine_glass:🥃<< cheers after the workday! | 23:27 |
portdirect | This may be of use too: http://openstack-helm.readthedocs.io/en/latest/devref/oslo-config.html | 23:27 |
*** yamamoto has joined #openstack-helm | 23:29 | |
srwilkers | The gangs all here | 23:29 |
srwilkers | The bands getting back together! | 23:29 |
osh-chatbot1 | <mattmceuen> Thanks @portdirect. Yep that one I'm aware of. I may just be misremembering a convenience script to generate the service.conf itself | 23:29 |
* srwilkers may be a pitcher of margaritas in | 23:30 | |
osh-chatbot1 | <mattmceuen> :guitar::drum-with-stick::microphone: | 23:30 |
portdirect | It was removed as part of the ps that put that doc in :) | 23:30 |
portdirect | 808 drum machine here | 23:30 |
osh-chatbot1 | <mattmceuen> :robot_face: | 23:31 |
*** yamamoto has quit IRC | 23:35 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!