openstackgerrit | Merged airship/treasuremap master: Fixes to MAAS HA and follow-up to comments https://review.opendev.org/655607 | 00:01 |
---|---|---|
openstackgerrit | Merged airship/treasuremap master: MAAS rack registration fix https://review.opendev.org/655764 | 00:04 |
openstackgerrit | Merged airship/treasuremap master: Updated OSH-Infra SHA for airskiff https://review.opendev.org/651628 | 00:08 |
*** sthussey has quit IRC | 00:09 | |
*** jemangs has quit IRC | 00:17 | |
*** jemangs has joined #airshipit | 01:24 | |
*** jemangs has quit IRC | 01:28 | |
*** michael-beaver has quit IRC | 01:34 | |
*** aaronsheffield has quit IRC | 01:47 | |
*** jemangs has joined #airshipit | 02:06 | |
*** jemangs has quit IRC | 02:10 | |
*** jemangs has joined #airshipit | 02:14 | |
*** jemangs has quit IRC | 02:20 | |
openstackgerrit | Drew Walters proposed airship/treasuremap master: airskiff: Use global Airship charts https://review.opendev.org/635218 | 02:39 |
openstackgerrit | Drew Walters proposed airship/treasuremap master: airskiff: Use global Airship charts https://review.opendev.org/635218 | 02:39 |
*** jemangs has joined #airshipit | 04:32 | |
*** jemangs has quit IRC | 04:36 | |
*** jemangs has joined #airshipit | 05:34 | |
*** cheng1 has quit IRC | 05:38 | |
*** cheng1 has joined #airshipit | 05:39 | |
*** jemangs has quit IRC | 05:39 | |
*** aojea has joined #airshipit | 06:28 | |
*** kaspars__ has quit IRC | 06:40 | |
*** rihbb has joined #airshipit | 07:00 | |
cheng1 | are you able to download https://dl.k8s.io/v1.10.2/kubernetes-node- | 07:09 |
cheng1 | linux-amd64.tar.gz | 07:09 |
cheng1 | my one-in-a-bottle deployment fails at download the tar.gz file | 07:09 |
*** happyhemant has joined #airshipit | 07:14 | |
*** jemangs has joined #airshipit | 07:18 | |
*** lemko has joined #airshipit | 07:18 | |
*** jemangs has quit IRC | 07:22 | |
*** jemangs has joined #airshipit | 07:52 | |
*** jemangs has quit IRC | 07:56 | |
*** jemangs has joined #airshipit | 08:08 | |
*** jemangs has quit IRC | 08:12 | |
*** jemangs has joined #airshipit | 08:12 | |
*** jemangs has quit IRC | 08:15 | |
*** jemangs has joined #airshipit | 08:15 | |
*** Labedz has joined #airshipit | 08:55 | |
Labedz | hi guys, do you happen to know if Airship has some tutorial how to set up services step by step? | 08:56 |
*** Labedz has quit IRC | 10:23 | |
*** Labedz has joined #airshipit | 10:37 | |
*** cheng1 has quit IRC | 11:25 | |
*** cheng1 has joined #airshipit | 11:26 | |
*** jemangs has quit IRC | 11:27 | |
*** jemangs has joined #airshipit | 11:28 | |
*** jemangs has quit IRC | 11:30 | |
*** jemangs has joined #airshipit | 11:39 | |
*** jemangs has quit IRC | 11:43 | |
mattmceuen | Hey Labedz- I'd suggest taking a look at the guides here: https://airship-treasuremap.readthedocs.io/en/latest/ | 11:55 |
mattmceuen | The site authoring guide has some a deep dive into airship deployment manifests, the airsloop guide helps get a simple lab up and running, and airskiff gets a dev env up in a vm or laptop | 11:57 |
mattmceuen | Let me know if that's not free kind of thing you're looking for though | 11:57 |
*** neith has quit IRC | 12:01 | |
*** evgenyl has quit IRC | 12:01 | |
*** lamt has quit IRC | 12:02 | |
*** evgenyl has joined #airshipit | 12:03 | |
*** neith has joined #airshipit | 12:03 | |
*** jemangs has joined #airshipit | 12:07 | |
*** jemangs has quit IRC | 12:11 | |
*** jemangs has joined #airshipit | 12:12 | |
*** jemangs has quit IRC | 12:22 | |
*** jemangs has joined #airshipit | 12:29 | |
*** garyx has joined #airshipit | 12:32 | |
openstackgerrit | Sangeet Gupta proposed airship/promenade master: [WIP] Apiserver-webhook: Change ingress secret https://review.opendev.org/650090 | 12:34 |
*** jemangs has quit IRC | 12:44 | |
*** jemangs has joined #airshipit | 12:45 | |
*** jemangs has quit IRC | 12:50 | |
*** aaronsheffield has joined #airshipit | 13:00 | |
*** lamt has joined #airshipit | 13:07 | |
*** rihbb has quit IRC | 13:10 | |
*** kranthikirang has joined #airshipit | 13:20 | |
*** kranthikirang1 has joined #airshipit | 13:23 | |
openstackgerrit | kranthi kiran guttikonda proposed airship/treasuremap master: hwe/ga 16.04 kernel install notes https://review.opendev.org/655531 | 13:24 |
*** kranthikirang has quit IRC | 13:26 | |
*** openstackgerrit has quit IRC | 13:27 | |
*** openstackgerrit has joined #airshipit | 13:38 | |
openstackgerrit | Scott Hussey proposed airship/promenade master: (apiserver) support key rotation https://review.opendev.org/631935 | 13:38 |
openstackgerrit | Scott Hussey proposed airship/promenade master: Docs for utilizing etcd encryption https://review.opendev.org/653863 | 13:38 |
openstackgerrit | Sean Eagan proposed airship/armada master: [v2 docs] Overhaul wait API https://review.opendev.org/636440 | 13:39 |
*** sthussey has joined #airshipit | 13:41 | |
*** kaspars__ has joined #airshipit | 13:47 | |
kranthikirang1 | @team, I have a question on kube-state-metrics; I see kube-state-metrics deployment replica set never comes up; ReadinessProbe always fails for this; I see container is becoming healthy always but accessing via service always fails; Any ideas? | 14:04 |
kranthikirang1 | Readiness probe failed: Get http://10.97.87.158:8080/metrics: net/http: request canceled (Client.Timeout exceeded while awaiting headers) | 14:04 |
kranthikirang1 | when I do curl to http://10.97.87.158:8080/metrics I see metrics are being listed; | 14:05 |
kranthikirang1 | but using svc ip/fqdn I can't; kube-state-metrics ClusterIP 10.96.101.85 <none> 8080/TCP 2d | 14:05 |
sthussey | If the pod isn't going to ready, the service won't have any endpoints | 14:08 |
sthussey | Can't speak to why the readiness probe is failing. The message looks like the response time is too slow and the client is resetting the connection | 14:09 |
garyx | I am testing out airshipinabottle, seems to have started ok locally and listed all the dashboards. But the MAAS url seems to be missing the required port and I have scoured the config files and no other ports I test that are listed there seem to be correct or working for the MAAS. It comes out as this address in the dashboard setup missing what seems to need a port. http://192.168.121.239:/MAAS/ | 14:11 |
kranthikirang1 | sthussey: I did try increasing the ReadinessProbe Initialdelay to 60 seconds; I see container starts fine and when I do curl to direct container ip I can see metrics; This is very odd | 14:13 |
kranthikirang1 | kaspars__: I have tried login to grafana using admin password defined in secrets/passphrases/osh_infra_grafana_admin_password.yaml but it didn't allow me to login | 14:25 |
kranthikirang1 | any idea? | 14:25 |
garyx | Hmms, seems that MAAS is there but port forwarding is not enabled. Anyone familiar with airshipinabottle that can tell me if this is a bug or? | 14:27 |
garyx | kubectl get services --all-namespaces |grep maas | 14:27 |
garyx | ucp maas-ingress-error ClusterIP 10.96.89.50 <none> 8080/TCP 2h | 14:27 |
garyx | ucp maas-region ClusterIP 10.96.230.177 <none> 80/TCP,8000/TCP 2h | 14:27 |
kranthikirang1 | karpars__: Also how to get kibana dashboard password? I see no file in site specs | 14:32 |
kranthikirang1 | garyx: I am not fully aware of airshipinbottle, I am also trying currently; I guess in-bottle doesn't use MAAS to provision anything; Since its just a single VM or node | 14:33 |
garyx | @kranthik Probably true, just curious to have a look at it and it is listed as a dashboard when airshipinabottle finishes. I have MAAS running in my production environment so I amd familiar with it in general. Just want to see it here. | 14:36 |
*** kranthikirang1 has quit IRC | 14:38 | |
*** kranthikirang has joined #airshipit | 14:39 | |
*** kranthikirang has quit IRC | 14:39 | |
*** kranthikirang has joined #airshipit | 14:39 | |
*** kranthikirang has quit IRC | 14:40 | |
*** kranthikirang has joined #airshipit | 14:40 | |
*** garyx has quit IRC | 14:47 | |
*** garyx has joined #airshipit | 14:48 | |
*** garyx has quit IRC | 14:50 | |
*** garyx has joined #airshipit | 14:52 | |
*** garyx has quit IRC | 14:53 | |
kaspars__ | kranthikirang1: I am also not able to login to the grafana dashboard - so I would write a defect on that.. likely substitution issue in the manifests | 14:54 |
*** garyx has joined #airshipit | 14:54 | |
kranthikirang | kaspars__: OK | 14:56 |
kranthikirang | Where can I file the defect? | 14:56 |
kranthikirang | kaspars__: Also are you able to login to Kibana? | 14:56 |
*** sgrasley has joined #airshipit | 14:56 | |
*** garyx_ has joined #airshipit | 14:57 | |
kaspars__ | garyx: yeah - AIAB is keeping everything in a single node right now - you need to enable nodePort else you need to do some forwarding for the service IP | 14:57 |
kranthikirang | When I look into grafana pod and do ENV, I see actually password is being sent to grafana config file; but not sure why its not accepting the login | 14:57 |
evgenyl | kranthikirang: Try using a password from `osh_infra_prometheus_admin_password` if you want to access grafana. | 14:58 |
*** garyx has quit IRC | 14:58 | |
kaspars__ | garyx: I would recommend looking at Airsloop for playing around with MAAS and more real environment https://airship-treasuremap.readthedocs.io/en/latest/airsloop.html . It's a 2 server setup with much more relaxed requirements but still having full feature set. | 14:58 |
kranthikirang | evgenyl: OK; Tried that but that also didn't work; | 14:59 |
evgenyl | kranthikirang: oops, sorry, I've just double-checked, you will need to use `secrets/passphrases/osh_infra_grafana_admin_password.yaml` | 15:00 |
kranthikirang | evgenyl: That is actual issue I have reported now to kaspars__ | 15:00 |
*** ianychoi_ has joined #airshipit | 15:00 | |
kranthikirang | its not working with secrets/passphrases/osh_infra_grafana_admin_password.yaml | 15:00 |
kranthikirang | I can't find kibana login as well | 15:01 |
garyx_ | kaspars__: Thanks for the tip, will have a look | 15:01 |
evgenyl | Ok, kranthikirang try using user `grafana` | 15:02 |
kranthikirang | perfect; Worked :) | 15:03 |
Labedz | mattmceuen: thanks! I'll take a look | 15:03 |
openstackgerrit | Merged airship/shipyard master: CI: Add Airskiff check https://review.opendev.org/653035 | 15:03 |
*** ianychoi has quit IRC | 15:03 | |
*** Labedz has quit IRC | 15:04 | |
kranthikirang | I see no metrics for coreDNS and Nginx; | 15:05 |
kranthikirang | evgenyl, kaspars__: I see invalid certificate errors in ingress pod logs in kube-system namespace; any clue? | 15:06 |
kranthikirang | http://paste.openstack.org/show/749826/ | 15:06 |
openstackgerrit | Drew Walters proposed airship/shipyard master: Don't log OS_PASSWORD in auth.log https://review.opendev.org/655248 | 15:12 |
openstackgerrit | Drew Walters proposed airship/shipyard master: Add validation support for deployment-version document https://review.opendev.org/653847 | 15:12 |
openstackgerrit | Merged airship/deckhand master: CI: Add Airskiff check https://review.opendev.org/600771 | 15:13 |
openstackgerrit | Drew Walters proposed airship/deckhand master: substitution: Implement recursive key deletion https://review.opendev.org/593999 | 15:15 |
*** aojea has quit IRC | 15:20 | |
openstackgerrit | Drew Walters proposed airship/treasuremap master: airskiff: Remove CI OSH-infra relative path https://review.opendev.org/655926 | 15:25 |
evgenyl | kranthikirang: if you want to access kibana dashboard, use `elasticsearch` user. I usually use just a few grafana dashboards on some CPU/Mem stats, so I'm not sure what may be wrong with nginx/coredns dashboards. | 15:26 |
kranthikirang | evgenyl: ok | 15:26 |
kranthikirang | and use elastic password for kibana? | 15:27 |
kranthikirang | evgenyl: It worked; Using elasticsearch user and password from osh_infra_elasticsearch_admin_password.yaml | 15:28 |
evgenyl | `secrets/passphrases/osh_infra_elasticsearch_admin_password.yaml` | 15:29 |
*** garyx_ has quit IRC | 15:32 | |
openstackgerrit | Drew Walters proposed airship/treasuremap master: airskiff: Remove CI OSH-infra relative path https://review.opendev.org/655926 | 15:39 |
openstackgerrit | Evgeniy L proposed airship/treasuremap master: Use the latest read the docs theme https://review.opendev.org/655934 | 16:10 |
openstackgerrit | Ian Pittwood proposed airship/spyglass master: [WIP] Manifest undefined data validation https://review.opendev.org/655683 | 16:20 |
openstackgerrit | Evgeniy L proposed airship/treasuremap master: Fix formatting for airsloop guide https://review.opendev.org/655942 | 16:26 |
*** roman_g has quit IRC | 16:34 | |
openstackgerrit | Jenkins Uplifter proposed airship/treasuremap master: Auto chart/image uplift to latest https://review.opendev.org/655949 | 16:35 |
openstackgerrit | Evgeniy L proposed airship/treasuremap master: Use the Airship CLI to lint the sites https://review.opendev.org/655951 | 16:39 |
openstackgerrit | Evgeniy L proposed airship/treasuremap master: Add drydock and maas endpoints in a site authoring guide https://review.opendev.org/655952 | 16:44 |
*** jemangs has joined #airshipit | 16:51 | |
openstackgerrit | Evgeniy L proposed airship/treasuremap master: Use the Airship CLI for lint and Airskiff gates https://review.opendev.org/655951 | 17:24 |
openstackgerrit | Evgeniy L proposed airship/treasuremap master: Use the Airship CLI for lint and Airskiff gates https://review.opendev.org/655951 | 17:31 |
openstackgerrit | Evgeniy L proposed airship/treasuremap master: Use the Airship CLI for lint and Airskiff gates https://review.opendev.org/655951 | 17:36 |
openstackgerrit | Scott Hussey proposed airship/maas master: Provide dependency chain on maas-ingress https://review.opendev.org/655571 | 17:39 |
openstackgerrit | Merged airship/spyglass master: Resolves Bandit 104 errors https://review.opendev.org/651807 | 17:47 |
evgenyl | Hi dwalt, I've updated my patch for using airship cli, but airskiff gate fails https://review.opendev.org/#/c/655951/, do you know what can cause this issue? I didn't touch k8s deployment scripts. | 17:50 |
evgenyl | https://www.irccloud.com/pastebin/cuZcuYht/ | 17:50 |
dwalt | It’s broken :( | 17:52 |
dwalt | It’ll be fixed if this merges! | 17:52 |
dwalt | https://review.opendev.org/#/c/655926/ | 17:52 |
*** michael-beaver has joined #airshipit | 17:54 | |
evgenyl | dwalt: Thanks, just wanted to confirm that this was not a problem with my patch :) | 17:58 |
*** rihbb has joined #airshipit | 17:59 | |
openstackgerrit | Kaspars Skels proposed airship/treasuremap master: Pipeline for Airsloop site https://review.opendev.org/649432 | 17:59 |
*** rihbb has left #airshipit | 17:59 | |
dwalt | evgenyl: Thanks for checking :) | 18:03 |
openstackgerrit | Kaspars Skels proposed airship/treasuremap master: Pipeline for Airsloop site https://review.opendev.org/649432 | 18:14 |
*** happyhemant has quit IRC | 18:21 | |
openstackgerrit | Ian Pittwood proposed airship/spyglass master: Implements PBR for packaging https://review.opendev.org/653480 | 18:28 |
openstackgerrit | Kaspars Skels proposed airship/treasuremap master: Pipeline for Airsloop site https://review.opendev.org/649432 | 18:31 |
*** jemangs has quit IRC | 18:34 | |
*** jemangs has joined #airshipit | 18:35 | |
openstackgerrit | Merged airship/treasuremap master: airskiff: Remove CI OSH-infra relative path https://review.opendev.org/655926 | 18:39 |
openstackgerrit | Drew Walters proposed airship/treasuremap master: airskiff: Use global Airship charts https://review.opendev.org/635218 | 18:45 |
openstackgerrit | Ian Pittwood proposed airship/spyglass master: Enable bandit checks in tox https://review.opendev.org/655995 | 18:46 |
openstackgerrit | Evgeniy L proposed airship/treasuremap master: Use the Airship CLI for lint and Airskiff gates https://review.opendev.org/655951 | 18:50 |
openstackgerrit | Ian Pittwood proposed airship/spyglass master: Manifest undefined data validation https://review.opendev.org/655683 | 18:52 |
openstackgerrit | Evgeniy L proposed airship/treasuremap master: Use the Airship CLI for lint and Airskiff gates https://review.opendev.org/655951 | 18:59 |
openstackgerrit | Ian Pittwood proposed airship/spyglass master: Enable bandit checks in tox https://review.opendev.org/655995 | 19:14 |
*** dims has quit IRC | 19:25 | |
openstackgerrit | Merged airship/treasuremap master: Pipeline for Airsloop site https://review.opendev.org/649432 | 19:25 |
openstackgerrit | Merged airship/treasuremap master: Use the latest read the docs theme https://review.opendev.org/655934 | 19:26 |
openstackgerrit | Merged airship/treasuremap master: Add drydock and maas endpoints in a site authoring guide https://review.opendev.org/655952 | 19:26 |
openstackgerrit | Kaspars Skels proposed airship/treasuremap master: Fix formatting for airsloop guide https://review.opendev.org/655942 | 19:29 |
*** jemangs has quit IRC | 19:37 | |
*** jemangs has joined #airshipit | 19:41 | |
*** jemangs has quit IRC | 19:43 | |
*** jemangs has joined #airshipit | 19:43 | |
*** jemangs has quit IRC | 19:47 | |
*** jemangs has joined #airshipit | 19:55 | |
openstackgerrit | Rajeshwari Dharwadkar proposed airship/shipyard master: Adding opensuse support in image building of airflow and shipyard https://review.opendev.org/636229 | 20:00 |
*** lemko has quit IRC | 20:01 | |
*** jemangs has quit IRC | 20:17 | |
*** jemangs has joined #airshipit | 20:20 | |
openstackgerrit | Matt McEuen proposed airship/promenade master: [DNM] Test https://review.opendev.org/656007 | 20:21 |
openstackgerrit | Rajeshwari Dharwadkar proposed airship/deckhand master: Adding opensuse image build for deckhand https://review.opendev.org/638301 | 20:21 |
*** jemangs has quit IRC | 20:26 | |
openstackgerrit | Drew Walters proposed airship/treasuremap master: airskiff: Use global Airship charts https://review.opendev.org/635218 | 20:34 |
*** dims has joined #airshipit | 20:48 | |
openstackgerrit | Rajeshwari Dharwadkar proposed airship/shipyard master: Adding opensuse support in image building of airflow and shipyard https://review.opendev.org/636229 | 20:55 |
openstackgerrit | Michael Beaver proposed airship/treasuremap master: Add Multinode dev/testing guide https://review.opendev.org/655517 | 21:02 |
openstackgerrit | Michael Beaver proposed airship/treasuremap master: Add new seaworthy-virt site https://review.opendev.org/656015 | 21:02 |
openstackgerrit | Drew Walters proposed airship/armada master: manifest: Add helper methods for parsing data https://review.opendev.org/656017 | 21:07 |
openstackgerrit | Michael Beaver proposed airship/treasuremap master: Add new seaworthy-virt site https://review.opendev.org/656015 | 21:15 |
openstackgerrit | Michael Beaver proposed airship/treasuremap master: Add Multinode dev/testing guide https://review.opendev.org/655517 | 21:15 |
openstackgerrit | Evgeniy L proposed airship/treasuremap master: Use the Airship CLI for lint and Airskiff gates https://review.opendev.org/655951 | 21:20 |
*** kranthikirang has quit IRC | 21:20 | |
openstackgerrit | Evgeniy L proposed airship/treasuremap master: Use the Airship CLI for lint and Airskiff gates https://review.opendev.org/655951 | 21:21 |
*** ian-pittwood has quit IRC | 21:25 | |
openstackgerrit | Evgeniy L proposed airship/treasuremap master: Use the Airship CLI for lint and Airskiff gates https://review.opendev.org/655951 | 21:31 |
openstackgerrit | Evgeniy L proposed airship/treasuremap master: Use the Airship CLI for lint and Airskiff gates https://review.opendev.org/655951 | 21:35 |
openstackgerrit | Matt McEuen proposed airship/treasuremap master: Align treasuremap type docs https://review.opendev.org/656029 | 21:52 |
openstackgerrit | Merged airship/treasuremap master: airskiff: Use global Airship charts https://review.opendev.org/635218 | 22:10 |
openstackgerrit | Merged airship/treasuremap master: Align treasuremap type docs https://review.opendev.org/656029 | 22:10 |
openstackgerrit | Merged airship/treasuremap master: Fix formatting for airsloop guide https://review.opendev.org/655942 | 22:16 |
*** aaronsheffield has quit IRC | 22:17 | |
openstackgerrit | Dan Crank proposed airship/shipyard master: Don't log OS_PASSWORD in auth.log https://review.opendev.org/655248 | 22:17 |
openstackgerrit | Anthony Bellino proposed airship/shipyard master: Update Airflow logrotate logic https://review.opendev.org/656033 | 22:18 |
openstackgerrit | Anthony Bellino proposed airship/shipyard master: Update Airflow logrotate logic https://review.opendev.org/656033 | 22:19 |
openstackgerrit | Anthony Bellino proposed airship/shipyard master: Update Airflow logrotate logic https://review.opendev.org/656033 | 22:21 |
openstackgerrit | Matt McEuen proposed airship/treasuremap master: Airskiff: update packages prior to delete https://review.opendev.org/656035 | 22:48 |
*** jemangs has joined #airshipit | 22:52 | |
*** jemangs has quit IRC | 22:56 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!