| *** schwicht has joined #openstack-helm | 00:00 | |
| *** felipemonteiro has joined #openstack-helm | 00:12 | |
| *** schwicht has quit IRC | 00:25 | |
| *** StaceyF has quit IRC | 00:36 | |
| *** schwicht has joined #openstack-helm | 00:56 | |
| *** renmak_ has joined #openstack-helm | 00:57 | |
| *** renmak__ has joined #openstack-helm | 00:57 | |
| openstackgerrit | Pete Birley proposed openstack/openstack-helm master: WIP: Ironic Chart https://review.openstack.org/490271 | 01:02 |
|---|---|---|
| *** gouthamr has quit IRC | 01:02 | |
| *** renmak__ has quit IRC | 01:08 | |
| *** renmak_ has quit IRC | 01:08 | |
| *** schwicht has quit IRC | 01:14 | |
| openstackgerrit | Pete Birley proposed openstack/openstack-helm master: Use RBD external provisioner https://review.openstack.org/490983 | 01:26 |
| *** randomhack has joined #openstack-helm | 01:40 | |
| *** randomhack has quit IRC | 01:45 | |
| openstackgerrit | Siri Kim proposed openstack/openstack-helm master: Neutron: Enable decomposition of chart into descrete manifests. https://review.openstack.org/481225 | 02:05 |
| openstackgerrit | Siri Kim proposed openstack/openstack-helm master: Neutron: Enable decomposition of chart into descrete manifests. https://review.openstack.org/481225 | 02:12 |
| *** schwicht has joined #openstack-helm | 02:42 | |
| openstackgerrit | lidong proposed openstack/openstack-helm master: Fix some typos https://review.openstack.org/491652 | 02:42 |
| openstackgerrit | Siri Kim proposed openstack/openstack-helm master: Neutron: Enable decomposition of chart into descrete manifests. https://review.openstack.org/481225 | 02:50 |
| openstackgerrit | Tin Lam proposed openstack/openstack-helm master: [WIP] Add barbican helm test https://review.openstack.org/491660 | 03:30 |
| openstackgerrit | Pete Birley proposed openstack/openstack-helm master: WIP: Ironic Chart https://review.openstack.org/490271 | 03:31 |
| openstackgerrit | lidong proposed openstack/openstack-helm master: Fix some typos https://review.openstack.org/491652 | 03:39 |
| *** renmak_ has joined #openstack-helm | 04:16 | |
| *** renmak__ has joined #openstack-helm | 04:16 | |
| openstackgerrit | Pete Birley proposed openstack/openstack-helm master: WIP: Ironic Chart https://review.openstack.org/490271 | 04:24 |
| openstackgerrit | Dae Seong Kim proposed openstack/openstack-helm master: Add Tempest script in helm test framework https://review.openstack.org/476733 | 04:26 |
| openstackgerrit | Tin Lam proposed openstack/openstack-helm master: [WIP] Add barbican helm test https://review.openstack.org/491660 | 04:48 |
| *** mariusv has quit IRC | 05:21 | |
| *** mariusv has joined #openstack-helm | 06:23 | |
| *** mariusv has quit IRC | 07:26 | |
| *** renmak__ has quit IRC | 07:39 | |
| *** renmak_ has quit IRC | 07:39 | |
| *** randomhack has joined #openstack-helm | 07:41 | |
| *** randomhack has quit IRC | 07:45 | |
| *** mariusv has joined #openstack-helm | 08:14 | |
| *** mariusv has quit IRC | 09:16 | |
| *** mariusv has joined #openstack-helm | 09:19 | |
| openstackgerrit | Michal Dulko proposed openstack/openstack-helm-addons master: More elaborate fluentd filtering https://review.openstack.org/490036 | 09:56 |
| openstackgerrit | Michal Dulko proposed openstack/openstack-helm master: Fix issues with [trustee] section of heat.conf https://review.openstack.org/471828 | 10:02 |
| *** osh-chatbot3 has quit IRC | 10:09 | |
| *** osh-chatbot has joined #openstack-helm | 10:09 | |
| osh-chatbot | <code-r> anyone uses minikube + openstack helm ? | 10:38 |
| osh-chatbot | <code-r> whenever I restart minikube, my mariadb cluster is going in to error state | 10:39 |
| japestinho | hi portdirect, I have passed the dns issue yesterday, and get all ceph related pod in running state | 10:42 |
| japestinho | when I run pvc-test.yaml I got stuck due to PVC is not bound | 10:43 |
| japestinho | here is the log from kubectl describe pod http://paste.openstack.org/show/617759/ | 10:43 |
| japestinho | I run validation also and this is the log | 10:46 |
| japestinho | https://www.irccloud.com/pastebin/DufgEQ4S/ | 10:46 |
| *** julim has quit IRC | 11:04 | |
| *** julim has joined #openstack-helm | 11:08 | |
| *** schwicht has quit IRC | 11:26 | |
| *** julim has quit IRC | 11:54 | |
| *** julim has joined #openstack-helm | 11:56 | |
| *** alraddarla has joined #openstack-helm | 12:07 | |
| *** julim has quit IRC | 12:12 | |
| *** julim has joined #openstack-helm | 12:16 | |
| *** julim has quit IRC | 12:21 | |
| *** schwicht has joined #openstack-helm | 12:24 | |
| *** schwicht has quit IRC | 12:26 | |
| *** alraddarla has quit IRC | 12:27 | |
| *** alraddarla has joined #openstack-helm | 12:28 | |
| *** schwicht has joined #openstack-helm | 12:35 | |
| *** jaypipes has joined #openstack-helm | 12:35 | |
| openstackgerrit | dave kormann proposed openstack/openstack-helm master: Ceph OSD disk targeting https://review.openstack.org/457754 | 12:42 |
| openstackgerrit | Grzegorz Grasza (xek) proposed openstack/openstack-helm master: Add management port to RabbitMQ service https://review.openstack.org/491788 | 12:53 |
| openstackgerrit | Grzegorz Grasza (xek) proposed openstack/openstack-helm master: Add mq-init.py script [WiP] https://review.openstack.org/491789 | 12:53 |
| *** schwicht has quit IRC | 12:55 | |
| *** felipemonteiro_ has joined #openstack-helm | 12:55 | |
| *** felipemonteiro__ has joined #openstack-helm | 12:57 | |
| *** felipemonteiro_ has quit IRC | 13:01 | |
| *** aric49 has joined #openstack-helm | 13:05 | |
| *** lrensing has joined #openstack-helm | 13:10 | |
| *** schwicht has joined #openstack-helm | 13:12 | |
| *** julim has joined #openstack-helm | 13:15 | |
| portdirect | japestinho: can you get the logs from the kube controller manager pod | 13:23 |
| openstackgerrit | Huamin Chen proposed openstack/openstack-helm master: Ceph OSD disk targeting https://review.openstack.org/457754 | 13:34 |
| *** felipemonteiro__ has quit IRC | 13:48 | |
| srwilkers | morning | 13:50 |
| srwilkers | here's an etherpad for today's meeting: https://etherpad.openstack.org/p/openstack-helm-meeting-2017-08-08 | 13:50 |
| *** gouthamr has joined #openstack-helm | 14:01 | |
| *** marst has joined #openstack-helm | 14:05 | |
| openstackgerrit | Larry Rensing proposed openstack/openstack-helm-addons master: WIP - MaaS chart https://review.openstack.org/472381 | 14:14 |
| openstackgerrit | Steve Wilkerson proposed openstack/openstack-helm master: WIP -- Add proxysql to mariadb https://review.openstack.org/487588 | 14:14 |
| openstackgerrit | Tin Lam proposed openstack/openstack-helm master: [WIP] Add barbican helm test https://review.openstack.org/491660 | 14:21 |
| openstackgerrit | Larry Rensing proposed openstack/openstack-helm-addons master: Gnocchi chart https://review.openstack.org/472348 | 14:21 |
| openstackgerrit | Merged openstack/openstack-helm master: Licence: Remove licence header from rendered files https://review.openstack.org/491614 | 14:25 |
| openstackgerrit | dave kormann proposed openstack/openstack-helm master: Ceph OSD disk targeting https://review.openstack.org/457754 | 14:31 |
| *** felipemonteiro_ has joined #openstack-helm | 14:37 | |
| openstackgerrit | Steve Wilkerson proposed openstack/openstack-helm master: WIP -- Add proxysql to mariadb https://review.openstack.org/487588 | 14:52 |
| openstackgerrit | Steve Wilkerson proposed openstack/openstack-helm master: WIP -- Add proxysql to mariadb https://review.openstack.org/487588 | 14:56 |
| *** renmak_ has joined #openstack-helm | 14:56 | |
| *** renmak__ has joined #openstack-helm | 14:56 | |
| srwilkers | meeting time :D | 15:01 |
| openstackgerrit | Larry Rensing proposed openstack/openstack-helm-addons master: WIP - MaaS chart https://review.openstack.org/472381 | 15:04 |
| *** mattmceuen has joined #openstack-helm | 15:07 | |
| *** mmehan has joined #openstack-helm | 15:25 | |
| *** marst_ has joined #openstack-helm | 15:26 | |
| *** marst has quit IRC | 15:27 | |
| openstackgerrit | Pete Birley proposed openstack/openstack-helm master: Use RBD external provisioner https://review.openstack.org/490983 | 15:27 |
| openstackgerrit | dave kormann proposed openstack/openstack-helm master: Ceph OSD disk targeting https://review.openstack.org/457754 | 15:34 |
| *** alraddarla has quit IRC | 15:38 | |
| *** alraddarla has joined #openstack-helm | 15:49 | |
| openstackgerrit | Pete Birley proposed openstack/openstack-helm master: Use RBD external provisioner https://review.openstack.org/490983 | 15:53 |
| *** renmak_ has quit IRC | 15:54 | |
| *** renmak__ has quit IRC | 15:54 | |
| openstackgerrit | Pete Birley proposed openstack/openstack-helm master: Use RBD external provisioner https://review.openstack.org/490983 | 15:54 |
| *** renmak_ has joined #openstack-helm | 15:55 | |
| *** renmak__ has joined #openstack-helm | 15:55 | |
| *** felipemonteiro__ has joined #openstack-helm | 15:58 | |
| *** felipemonteiro_ has quit IRC | 16:02 | |
| *** alraddarla has quit IRC | 16:09 | |
| openstackgerrit | Pete Birley proposed openstack/openstack-helm master: Use RBD external provisioner https://review.openstack.org/490983 | 16:14 |
| *** alraddarla has joined #openstack-helm | 16:17 | |
| openstackgerrit | Pete Birley proposed openstack/openstack-helm master: Use RBD external provisioner https://review.openstack.org/490983 | 16:17 |
| bryan_att | anyone - still having issues with ceph containers not being able to be pulled for some reason. pleas see the next paste - it seems the containers with issues are the ones in the 192.168/16 internal net - this subnet is not used anywhere in the pod outside OSH | 16:18 |
| bryan_att | any help is appreciated\ https://www.irccloud.com/pastebin/T3Y77t2T/ | 16:19 |
| bryan_att | this is a fresh clone (I rebuild servers and run this several times each day trying to figure out what the heck is going on and always clone in the process) | 16:20 |
| openstackgerrit | Pete Birley proposed openstack/openstack-helm master: Use RBD external provisioner https://review.openstack.org/490983 | 16:32 |
| *** renmak_ has quit IRC | 16:43 | |
| *** renmak_ has joined #openstack-helm | 16:43 | |
| openstackgerrit | Pete Birley proposed openstack/openstack-helm master: Armada OpenStack deployment yaml https://review.openstack.org/481234 | 16:49 |
| osh-chatbot | <raymaika> @bryan_att can you give an output of "kubectl describe po/ceph-osd-keyring-generator-vd2qs -n ceph" may have a bit more info on why image pull is failing | 17:21 |
| bryan_att | raymaika https://www.irccloud.com/pastebin/eb7CbqeR/ | 17:29 |
| osh-chatbot | <raymaika> @bryan_att and does a manual docker give the same error? | 17:37 |
| osh-chatbot | <raymaika> *docker pull of that image | 17:37 |
| bryan_att | raymaike: seems to be related to the changes to resolv.conf - the DNS server that OSH added is not accessible. https://www.irccloud.com/pastebin/igM4qoIr/ | 17:38 |
| bryan_att | https://www.irccloud.com/pastebin/dr4jKkLN/ | 17:40 |
| osh-chatbot | <raymaika> @bryan_att oh, yeah I remember you having that issue now. can you double check your kube-controller-manager to see if it has 8.8.8.8 as a secondary nameserver? would be kubectl exec -n kube-system kube-controller-manager-<PRIMARY_NODE_HOSTNAME> -- cat /etc/resolv.conf | 17:46 |
| bryan_att | where do I run that command? | 17:48 |
| osh-chatbot | <raymaika> on the primary node - need to replace the part in < > with the hostname of the primary node | 17:49 |
| bryan_att | https://www.irccloud.com/pastebin/ljyEF6WL/ | 17:49 |
| bryan_att | the issue is occuring on the worker node though | 17:49 |
| osh-chatbot | <raymaika> yeah - was just making the controller-manager was configured correctly. not really sure why your workers aren't able to reach the dns service, hmm | 17:51 |
| bryan_att | one of the worker nodes can but the other can't | 17:52 |
| bryan_att | I tried to traceroute to the DNS server but that doesn't seem to work | 17:52 |
| osh-chatbot | <raymaika> yeah the dns service doesn't respond to icmp so it's not the easiest thing to debug connection to | 17:53 |
| bryan_att | I'm noticing some delays e.g. in resolving sudo commands on the problematic server. going to clean and try again this time adding hostname entries to /etc/hosts | 18:04 |
| openstackgerrit | Huamin Chen proposed openstack/openstack-helm master: Use RBD external provisioner https://review.openstack.org/490983 | 18:21 |
| osh-chatbot | <rootfs> portdirect: did i mess up with https://review.openstack.org/490983 ? | 18:22 |
| osh-chatbot | <rootfs> ps 12 | 18:23 |
| openstackgerrit | Huamin Chen proposed openstack/openstack-helm master: Use RBD external provisioner https://review.openstack.org/490983 | 18:27 |
| openstackgerrit | Huamin Chen proposed openstack/openstack-helm master: set DNS policy for osd daemonset https://review.openstack.org/491887 | 19:06 |
| openstackgerrit | Huamin Chen proposed openstack/openstack-helm master: set DNS policy for osd daemonset https://review.openstack.org/491887 | 19:25 |
| openstackgerrit | Darla Ahlert proposed openstack/openstack-helm master: [WIP] Add Rally Chart https://review.openstack.org/491015 | 19:26 |
| openstackgerrit | Pete Birley proposed openstack/openstack-helm master: Armada OpenStack deployment yaml https://review.openstack.org/481234 | 19:58 |
| openstackgerrit | Pete Birley proposed openstack/openstack-helm master: Armada OpenStack deployment yaml https://review.openstack.org/481234 | 20:02 |
| openstackgerrit | Stacey Fletcher proposed openstack/openstack-helm master: WIP: Refactor Basic Launch https://review.openstack.org/491903 | 20:05 |
| *** renmak__ has quit IRC | 20:09 | |
| *** renmak_ has quit IRC | 20:09 | |
| *** renmak__ has joined #openstack-helm | 20:12 | |
| *** renmak_ has joined #openstack-helm | 20:12 | |
| *** renmak_ has quit IRC | 20:12 | |
| *** renmak__ has quit IRC | 20:12 | |
| openstackgerrit | Pete Birley proposed openstack/openstack-helm master: Armada OpenStack deployment yaml https://review.openstack.org/481234 | 20:16 |
| *** julim has quit IRC | 20:30 | |
| openstackgerrit | dave kormann proposed openstack/openstack-helm master: Ceph OSD disk targeting https://review.openstack.org/457754 | 20:31 |
| *** renmak_ has joined #openstack-helm | 20:37 | |
| *** renmak__ has joined #openstack-helm | 20:37 | |
| *** felipemonteiro__ has quit IRC | 20:40 | |
| *** marst_ has quit IRC | 20:44 | |
| bryan_att | anyone - can you comment on whether the mariadb root password reject error I am seeing is possibly due to the --skip-name-resolve option being set? From the logs it appears that the root user is not granted access due to that option, given that the user is "root@mariadb-0" : see the log entry : [Warning] 'user' entry 'root@mariadb-0' ignored in --skip-name-resolve mode | 20:53 |
| *** marst has joined #openstack-helm | 20:55 | |
| bryan_att | anyone - here is the mariadb-0 log showing some warnings and the entry noted above about the root user grant not being executed https://www.irccloud.com/pastebin/NBDuGnTw/ | 20:59 |
| bryan_att | trying again: https://pastebin.com/ggqaT8Lp | 21:00 |
| *** schwicht has quit IRC | 21:01 | |
| *** aric49 has quit IRC | 21:16 | |
| *** schwicht has joined #openstack-helm | 21:21 | |
| openstackgerrit | Darla Ahlert proposed openstack/openstack-helm master: [WIP] Add Rally Chart https://review.openstack.org/491015 | 21:22 |
| *** felipemonteiro_ has joined #openstack-helm | 21:33 | |
| openstackgerrit | Scott Hussey proposed openstack/openstack-helm-addons master: [DNM] Reference PS of MaaS chart https://review.openstack.org/491935 | 21:34 |
| *** felipemonteiro__ has joined #openstack-helm | 21:35 | |
| *** lrensing has quit IRC | 21:36 | |
| openstackgerrit | Pete Birley proposed openstack/openstack-helm master: Armada OpenStack deployment yaml https://review.openstack.org/481234 | 21:37 |
| *** felipemonteiro_ has quit IRC | 21:38 | |
| *** alraddarla has quit IRC | 21:44 | |
| openstackgerrit | Pete Birley proposed openstack/openstack-helm master: Armada OpenStack deployment yaml https://review.openstack.org/481234 | 21:53 |
| *** schwicht has quit IRC | 21:57 | |
| *** julim has joined #openstack-helm | 22:27 | |
| *** schwicht has joined #openstack-helm | 22:30 | |
| *** felipemonteiro__ has quit IRC | 22:31 | |
| *** jaypipes has quit IRC | 22:42 | |
| bryan_att | anyone - if you know about ceph for OSH please check these logs and let me know if you see the source of an error. ceph-osd containers are continually crashing. From the container logs they are being terminated over and over: https://pastebin.com/hHZWu9e6 | 22:53 |
| bryan_att | here' https://www.irccloud.com/pastebin/94JRriey/ | 22:55 |
| bryan_att | that was the log file from /var/log/ceph in one of the containers. it shows the container getting a terminate command.\ | 22:56 |
| *** schwicht has quit IRC | 23:05 | |
| *** marst has quit IRC | 23:06 | |
| anticw | bryan_att: sorry, didn't check scroll-back, but do you verify the ceph dirs are empty/deleted before you install? | 23:24 |
| anticw | old state there causes things to get very confused | 23:24 |
| *** mattmceuen has quit IRC | 23:45 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!