*** AOjeaGarcia__ has quit IRC | 02:13 | |
*** jhesketh has joined #airshipit | 02:53 | |
*** anyrude10_ has quit IRC | 03:01 | |
*** aojea has joined #airshipit | 03:19 | |
*** aojea has quit IRC | 03:20 | |
*** AOjeaGarcia has joined #airshipit | 03:20 | |
*** cheng1 has quit IRC | 04:12 | |
*** cheng1 has joined #airshipit | 04:17 | |
*** altlogbot_1 has quit IRC | 04:36 | |
*** altlogbot_1 has joined #airshipit | 04:36 | |
*** jamesgu_ has quit IRC | 05:07 | |
*** jamesgu_ has joined #airshipit | 05:13 | |
*** weystrom has joined #airshipit | 05:35 | |
*** roman_g has joined #airshipit | 06:00 | |
*** nmimi has joined #airshipit | 06:25 | |
*** pgaxatte has joined #airshipit | 06:29 | |
*** weystrom_ has joined #airshipit | 06:30 | |
*** weystrom has quit IRC | 06:33 | |
*** jamesgu_ has quit IRC | 06:57 | |
*** nick_kar has joined #airshipit | 07:06 | |
*** mika1 has joined #airshipit | 07:12 | |
*** mika1 has left #airshipit | 07:13 | |
*** mikkos has joined #airshipit | 07:20 | |
*** nmimi has quit IRC | 07:24 | |
*** kskels has quit IRC | 07:41 | |
*** jbryce has quit IRC | 07:41 | |
*** mnaser has quit IRC | 07:41 | |
*** mattmceuen has quit IRC | 07:41 | |
*** mugsie has quit IRC | 07:41 | |
*** evrardjp has quit IRC | 07:41 | |
*** irclogbot_3 has quit IRC | 07:44 | |
*** irclogbot_2 has joined #airshipit | 07:44 | |
*** anvaad has joined #airshipit | 07:47 | |
*** dasp has quit IRC | 07:47 | |
*** portdirect has quit IRC | 07:47 | |
*** mikkos has left #airshipit | 07:49 | |
*** mikkos has joined #airshipit | 07:50 | |
mikkos | exit | 07:50 |
---|---|---|
*** mikkos has quit IRC | 07:50 | |
*** dasp has joined #airshipit | 07:52 | |
*** portdirect has joined #airshipit | 07:52 | |
*** kskels has joined #airshipit | 07:53 | |
*** jbryce has joined #airshipit | 07:53 | |
*** mnaser has joined #airshipit | 07:53 | |
*** mattmceuen has joined #airshipit | 07:53 | |
*** mugsie has joined #airshipit | 07:53 | |
*** evrardjp has joined #airshipit | 07:53 | |
*** mikkos has joined #airshipit | 07:56 | |
*** jaakko has joined #airshipit | 08:05 | |
*** anvaad has quit IRC | 08:14 | |
*** mikkos has quit IRC | 08:17 | |
*** mikkos has joined #airshipit | 08:30 | |
*** happyhemant has joined #airshipit | 08:31 | |
*** anvaad has joined #airshipit | 08:31 | |
anvaad | Hello, | 08:32 |
anvaad | Is there any channel where I can discuss troublshooting issues with 'Airship in a Bottle' | 08:32 |
*** nmimi has joined #airshipit | 08:38 | |
*** mikkos has quit IRC | 08:57 | |
jaakko | There is http://lists.airshipit.org/pipermail/airship-discuss/ where some issues are discussed | 09:45 |
*** weystrom_ has quit IRC | 09:47 | |
*** mikkos has joined #airshipit | 09:47 | |
*** weystrom has joined #airshipit | 09:57 | |
*** weystrom_ has joined #airshipit | 09:58 | |
*** weystrom has quit IRC | 10:02 | |
roman_g | anvaad: this one | 10:08 |
*** weystrom_ has quit IRC | 10:42 | |
*** mikkos has left #airshipit | 10:46 | |
*** mikkos has joined #airshipit | 10:46 | |
*** arunkant has quit IRC | 10:59 | |
*** arunkant has joined #airshipit | 10:59 | |
anvaad | thanks roman_g | 11:01 |
anvaad | I have encouted two issues while running kubeclt on the vm | 11:01 |
anvaad | 1. kubectl create -f mypod.yaml --> error: the path "mypod.yaml" does not exist | 11:02 |
anvaad | 2. kubectl edit pod somepod_name ----> error: unable to launch the editor "vi" | 11:02 |
anvaad | Tried searching the archives here http://lists.airshipit.org/pipermail/airship-discuss/, to no avail | 11:03 |
anvaad | I was wondering if anybody has encouted this | 11:03 |
*** pkaralis has joined #airshipit | 11:28 | |
*** alexanderhughes has joined #airshipit | 12:02 | |
*** arunkant has quit IRC | 12:32 | |
*** arunkant has joined #airshipit | 12:32 | |
*** jbryce has quit IRC | 12:43 | |
*** portdirect has quit IRC | 12:44 | |
*** jbryce has joined #airshipit | 12:46 | |
*** bh526r has joined #airshipit | 12:46 | |
*** kskels has quit IRC | 12:48 | |
*** kskels has joined #airshipit | 12:49 | |
*** aaronsheffield has joined #airshipit | 12:55 | |
*** portdirect has joined #airshipit | 12:58 | |
*** anvaad has quit IRC | 13:08 | |
*** arunkant has quit IRC | 13:10 | |
*** arunkant has joined #airshipit | 13:11 | |
*** arunkant has quit IRC | 13:13 | |
*** nishantkr has joined #airshipit | 13:13 | |
*** arunkant has joined #airshipit | 13:14 | |
*** kranthikirang has joined #airshipit | 13:16 | |
*** sthussey has joined #airshipit | 13:18 | |
*** howell has joined #airshipit | 13:21 | |
*** arunkant has quit IRC | 13:23 | |
*** arunkant has joined #airshipit | 13:24 | |
*** sreejithp has joined #airshipit | 13:27 | |
roman_g | anvaad, 1. means that file you refer to can not be found in current directory. | 13:30 |
roman_g | anvaad, 2. means that you need to install vi editor, or change EDITOR variable in your shell so that it points to editor installed on your system (e.g. vim or nano) | 13:31 |
*** kguttikonda has joined #airshipit | 13:32 | |
*** happyhemant has quit IRC | 13:33 | |
*** mnaser has quit IRC | 13:34 | |
*** kranthikirang has quit IRC | 13:34 | |
*** happyhemant has joined #airshipit | 13:35 | |
*** arunkant has quit IRC | 13:35 | |
*** arunkant has joined #airshipit | 13:36 | |
*** mnaser has joined #airshipit | 13:37 | |
mikkos | roman_g, 1. mypod.yaml exist and error occurs even with absolute path | 13:40 |
*** arunkant has quit IRC | 14:04 | |
*** arunkant has joined #airshipit | 14:04 | |
*** arunkant has quit IRC | 14:07 | |
kguttikonda | @team, any idea where should we define sr-iov interfaces for neutron ? | 14:07 |
*** arunkant has joined #airshipit | 14:08 | |
kguttikonda | I see openstack-helm does support SR-IOV | 14:08 |
*** michael-beaver has joined #airshipit | 14:17 | |
*** openstackgerrit has joined #airshipit | 14:17 | |
openstackgerrit | Matt McEuen proposed airship/promenade master: Change CoreDNS from Deployment to DaemonSet https://review.opendev.org/662448 | 14:17 |
openstackgerrit | Michael Beaver proposed airship/shipyard master: Remove required-projects from Airskiff gate https://review.opendev.org/662284 | 14:22 |
openstackgerrit | Rahul Khiyani proposed airship/promenade master: ETCD: Add pod/container security context https://review.opendev.org/662334 | 14:25 |
roman_g | mikkos: more background would help. Where is that mypod.yaml from? | 14:29 |
openstackgerrit | Alexander Hughes proposed airship/pegleg master: [WIP] Update tests dir to use yaml.safe_load() https://review.opendev.org/662769 | 14:30 |
roman_g | I can't find anything in Airship what could refer to to mypod.yaml file. | 14:30 |
*** jamesgu_ has joined #airshipit | 14:30 | |
mikkos | roman_g: The content of yaml file does not matter, it fails even with simple deployment yaml example | 14:36 |
*** pgaxatte has quit IRC | 14:40 | |
*** arunkant has quit IRC | 14:43 | |
*** arunkant has joined #airshipit | 14:44 | |
*** mikkos has quit IRC | 14:45 | |
roman_g | mikkos, can you please exlplain why you think this is this a problem in Airship? For me it doesn't seem to be so. | 14:51 |
roman_g | May be I'm missing something. | 14:51 |
*** sreejithp has quit IRC | 14:56 | |
*** AOjeaGarcia has quit IRC | 15:07 | |
*** irclogbot_2 has quit IRC | 15:10 | |
openstackgerrit | Roman Gorshunov proposed airship/treasuremap master: Add cross-verification of Git commit ID'd and image tags https://review.opendev.org/661004 | 15:10 |
*** irclogbot_2 has joined #airshipit | 15:10 | |
*** altlogbot_1 has quit IRC | 15:11 | |
*** altlogbot_0 has joined #airshipit | 15:11 | |
*** arunkant has quit IRC | 15:12 | |
*** arunkant has joined #airshipit | 15:12 | |
*** sgrasley_ has quit IRC | 15:16 | |
openstackgerrit | Alexander Hughes proposed airship/pegleg master: [WIP] Update Pegleg base image to use Ubuntu 18.04 (Bionic Beaver) https://review.opendev.org/661088 | 15:17 |
openstackgerrit | Kudaka Poorna Rajesh proposed airship/promenade master: [WIP] Add deploy promenade gate check https://review.opendev.org/662605 | 15:20 |
openstackgerrit | Ian Pittwood proposed airship/spyglass-plugin-xls master: Adds force option to manifest generation https://review.opendev.org/662034 | 15:22 |
alexanderhughes | did I miss a conversation on renaming airship/in-a-bottle to airship/airship-in-a-bottle ? | 15:31 |
*** dasp has quit IRC | 15:35 | |
evgenyl | alexanderhughes: This has been discussed quite a few times here and on ML. | 15:37 |
openstackgerrit | Alexander Hughes proposed airship/pegleg master: [WIP} Update AIAB repo names https://review.opendev.org/662790 | 15:40 |
openstackgerrit | Alexander Hughes proposed airship/pegleg master: [WIP} Update AIAB repo names https://review.opendev.org/662790 | 15:41 |
*** sreejithp has joined #airshipit | 15:44 | |
*** dasp has joined #airshipit | 15:53 | |
openstackgerrit | Alexander Hughes proposed airship/pegleg master: Update AIAB repo names https://review.opendev.org/662790 | 15:59 |
openstackgerrit | Alexander Hughes proposed airship/pegleg master: [WIP] Update tests dir to use yaml.safe_load() https://review.opendev.org/662769 | 16:02 |
openstackgerrit | Alexander Hughes proposed airship/pegleg master: [WIP] Update Pegleg base image to use Ubuntu 18.04 (Bionic Beaver) https://review.opendev.org/661088 | 16:05 |
openstackgerrit | Alexander Hughes proposed airship/pegleg master: [WIP]Use Promenade enc key in Genesis Bundle https://review.opendev.org/662271 | 16:06 |
*** arunkant has quit IRC | 16:16 | |
openstackgerrit | Alexander Hughes proposed airship/pegleg master: Update tests dir to use yaml.safe_load() https://review.opendev.org/662769 | 16:21 |
openstackgerrit | Merged airship/pegleg master: Update AIAB repo names https://review.opendev.org/662790 | 16:44 |
*** bh526r has quit IRC | 16:46 | |
openstackgerrit | Merged airship/armada master: Add ubuntu_xenial image build to Armada https://review.opendev.org/662565 | 16:52 |
openstackgerrit | Merged airship/spyglass master: Adds Safety dependency vulnerability checks https://review.opendev.org/658854 | 16:54 |
openstackgerrit | Alexander Hughes proposed airship/pegleg master: Added cleartext option to passphrase generation https://review.opendev.org/645017 | 17:12 |
openstackgerrit | Michael Beaver proposed airship/shipyard master: Remove required-projects from Airskiff gate https://review.opendev.org/662284 | 17:14 |
openstackgerrit | Alexander Hughes proposed airship/pegleg master: Added cleartext option to passphrase generation https://review.opendev.org/645017 | 17:17 |
openstackgerrit | Alexander Hughes proposed airship/pegleg master: Added cleartext option to passphrase generation https://review.opendev.org/645017 | 17:40 |
*** AlexNoskov has joined #airshipit | 17:43 | |
evgenyl | AlexNoskov: hey, kskels wanted to help with treasuremap uplift. | 17:46 |
openstackgerrit | Ian Pittwood proposed airship/pegleg master: Adds Safety dependency vulnerability checks https://review.opendev.org/662812 | 17:46 |
*** anvaad has joined #airshipit | 18:17 | |
*** anvaad has quit IRC | 18:18 | |
*** kranthikirang has joined #airshipit | 18:41 | |
*** altlogbot_0 has quit IRC | 18:43 | |
*** altlogbot_0 has joined #airshipit | 18:43 | |
*** kguttikonda has quit IRC | 18:44 | |
*** kranthikirang has quit IRC | 18:50 | |
*** kranthikirang has joined #airshipit | 18:51 | |
openstackgerrit | Evgeniy L proposed airship/treasuremap master: [WIP] Uplift nfs-provisioner https://review.opendev.org/662583 | 18:51 |
openstackgerrit | Kaspars Skels proposed airship/armada master: Correct Armada github sync key https://review.opendev.org/662823 | 18:57 |
*** kranthikirang has quit IRC | 19:00 | |
*** op317q__ has joined #airshipit | 19:03 | |
op317q__ | hii | 19:03 |
op317q__ | I need help with Mass Ingress | 19:03 |
op317q__ | it is failing | 19:03 |
op317q__ | Matt and Kasper suggested me to post my question here | 19:04 |
op317q__ | this ubuntu@mtn15r06o002:~$ sudo kubectl logs --namespace="ucp" maas-ingress-errors-5988bbbdcb-ttj5j + COMMAND=start + [ xstart == xstart ] + [[ -z 8080 ]] + exec /server -port 8080 | 19:04 |
op317q__ | using airsloop for deployment | 19:09 |
openstackgerrit | Kaspars Skels proposed airship/treasuremap master: Uplift all components except Drydock, Armada & Promenade https://review.opendev.org/662085 | 19:11 |
*** altlogbot_0 has quit IRC | 19:21 | |
op317q__ | any body for Airsloop deployment | 19:21 |
op317q__ | any thing that can help to resol | 19:21 |
op317q__ | this issue | 19:21 |
evgenyl | op317q__: How do you determine that ingress-error pod is failing? What is the status of the pod? | 19:22 |
*** altlogbot_0 has joined #airshipit | 19:25 | |
openstackgerrit | Michael Beaver proposed airship/shipyard master: Remove required-projects from Airskiff gate https://review.opendev.org/662284 | 19:32 |
op317q__ | ucp maas-ingress-errors-5988bbbdcb-ttj5j 1/1 Running 0 4h 10.97.139.90 mtn15r06o002 <none> | 19:37 |
op317q__ | ucp maas-rack-0 1/1 Running 0 4h 172.29.131.11 mtn15r06o002 <none> | 19:37 |
op317q__ | ucp maas-region-0 2/2 Running 0 4h 10.97.139.100 mtn15r06o002 <none> | 19:37 |
op317q__ | ucp mariadb-ingress-78987d559c-hdkpj 1/1 Running 0 4h 10.97.139.96 mtn15r06o002 <none> | 19:37 |
op317q__ | ucp mariadb-ingress-error-pages-56ffbf595b-cfgxc 1/1 Running 0 4h 10.97.139.95 mtn15r06o002 <none> | 19:37 |
op317q__ | ucp mariadb-server-0 1/1 Running 0 4h 10.97.139.98 mtn15r06o002 <none> | 19:37 |
op317q__ | the reason is that Drydock is able to boot the server | 19:37 |
op317q__ | but after the boot it is not able to find the node | 19:38 |
op317q__ | I see here is that ipmi session is able to connect the server and rebooted it . this I observed it when I open the terminal for XXXXXXXX but after the boot , it is not able to locate it . | 19:39 |
op317q__ | 19:39 | |
op317q__ | Any thought ? | 19:39 |
op317q__ | 19:39 | |
op317q__ | 2019-06-03 15:32:23,441 - DEBUG - oob.py:70:exec_ipmi_command Initializing IPMI session | 19:39 |
op317q__ | 2019-06-03 15:32:23,441 - DEBUG - oob.py:54:get_ipmi_session Starting IPMI session to XXXXXXXXX with root/A | 19:39 |
op317q__ | 2019-06-03 15:32:23,459 - DEBUG - oob.py:84:exec_ipmi_command Calling IPMI command get_power on XXXXXXXX | 19:39 |
op317q__ | 2019-06-03 15:32:23,462 - DEBUG - oob.py:326:start XXXXXXXXXXXXX reports powerstate of off | 19:39 |
op317q__ | 2019-06-03 15:32:23,463 - DEBUG - oob.py:346:start Sending set_power = on command to XXXXXXXX | 19:39 |
op317q__ | 2019-06-03 15:32:23,463 - DEBUG - oob.py:70:exec_ipmi_command Initializing IPMI session | 19:39 |
op317q__ | 2019-06-03 15:32:23,463 - DEBUG - oob.py:54:get_ipmi_session Starting IPMI session to XXXXXXXX with root/A | 19:39 |
op317q__ | 2019-06-03 15:32:23,500 - DEBUG - oob.py:84:exec_ipmi_command Calling IPMI command set_power on XXXXXXXX | 19:40 |
op317q__ | 2019-06-03 15:32:23,506 - DEBUG - oob.py:70:exec_ipmi_command Initializing IPMI session | 19:40 |
op317q__ | 2019-06-03 15:32:23,506 - DEBUG - oob.py:54:get_ipmi_session Starting IPMI session to XXXXXXXXX with root/A | 19:40 |
evgenyl | I'm trying to understand, how maas-ingress-errors-5988bbbdcb-ttj5j is related to drydock problems? | 19:40 |
evgenyl | op317q__: Can you please use https://paste.ubuntu.com/ or http://paste.openstack.org/ for pasting the logs? | 19:41 |
evgenyl | op317q__: And what do you exactly mean when you say "it is not able to locate it"? How do you determine this? | 19:42 |
op317q__ | @Evgeny below line says it | 19:43 |
op317q__ | 2019-06-03 15:32:34,365 - INFO - machine.py:609:identify_baremetal_node Could not locate node XXXXXXXX in MaaS | 19:43 |
op317q__ | after session Starting IPMI session to XXXXXXXXX , it tries to locate the node and it gets above error | 19:44 |
evgenyl | op317q__: Is this server present in MaaS? | 19:44 |
op317q__ | it should be .. How to verify this | 19:45 |
evgenyl | op317q__: it has INFO logging level, it may be not an error, but a part of normal flow. | 19:45 |
evgenyl | op317q__: I don't know if MaaS UI was removed, try logging it into it, or use MaaS cli. | 19:46 |
op317q__ | I checked the MASS ui from the genesis node , and I don't see the compute node (XXXXXX) in the list | 19:47 |
evgenyl | op317q__: Do you see any other nodes prensent? | 19:48 |
op317q__ | then I am able to login using PXE IP to this compute node | 19:48 |
op317q__ | no | 19:48 |
evgenyl | Have you seen drydock reporting an actual error? Or is it still tries to provision the node? | 19:49 |
op317q__ | tt still tries to provision the node | 19:50 |
op317q__ | do I have to change boot prefe | 19:51 |
op317q__ | boot perference | 19:51 |
evgenyl | op317q__: does it try to reboot the node on every retry? | 19:51 |
op317q__ | no only once | 19:51 |
evgenyl | op317q__: What is the status of the node? Is it powere on/off? | 19:51 |
openstackgerrit | Ian Pittwood proposed airship/spyglass master: [WIP] Implements data object models https://review.opendev.org/662092 | 19:51 |
op317q__ | it is on | 19:51 |
op317q__ | it had previous OS that I installed to find all the nic | 19:52 |
openstackgerrit | Ian Pittwood proposed airship/spyglass master: Pin dependency versions https://review.opendev.org/662453 | 19:53 |
evgenyl | op317q__: Are you sure that it is booted in previous version of the OS? A few things to try, 1. Make sure that you have a higher priority for booting from network in BIOS 2. You can try powering off the node, to see if it is turned on by drydock on the next retry. | 19:54 |
op317q__ | yes | 19:55 |
op317q__ | I was monitoring | 19:55 |
op317q__ | let me try it | 19:55 |
op317q__ | I need connect to VPN for this | 19:55 |
op317q__ | and then come back and update you | 19:55 |
evgenyl | 1st suggestion is the most important, you need to make sure that when node is booted, it tries to boot over the network and not from the disk. | 19:56 |
openstackgerrit | Alexander Hughes proposed airship/pegleg master: [WIP] Site and global secret decrypt. https://review.opendev.org/662847 | 19:59 |
openstackgerrit | Ian Pittwood proposed airship/spyglass master: Manifest undefined data validation https://review.opendev.org/655683 | 20:01 |
*** kranthikirang has joined #airshipit | 20:06 | |
*** mattmceuen__ has joined #airshipit | 20:07 | |
*** mugsie_ has joined #airshipit | 20:09 | |
*** evrardjp_ has joined #airshipit | 20:09 | |
openstackgerrit | Alexander Hughes proposed airship/pegleg master: [WIP] Site and global secret decrypt. https://review.opendev.org/662847 | 20:13 |
op317q__ | Hi Evgeny L | 20:14 |
op317q__ | I power off the machine and put the next boot PXE | 20:14 |
op317q__ | Drydock booted the system | 20:14 |
op317q__ | and the system tried to boot from PXE | 20:14 |
op317q__ | it was not able then It went to normal boot | 20:15 |
*** mattmceuen has quit IRC | 20:15 | |
*** mugsie has quit IRC | 20:15 | |
*** evrardjp has quit IRC | 20:15 | |
*** mattmceuen__ is now known as mattmceuen | 20:15 | |
evgenyl | We still have a problem with hanging maas-import-resource in our AIAB, I looked a bit closer and it mostly related to failing attempts of maas-rack pod to register, here are the failures https://paste.ubuntu.com/p/9r8fYfcPfb/ , the config looks just fine and when I run `maas-rack register --url=http://10.0.2.6:30001/MAAS --secret=<SEC>` in the same container, it finishes without problems, mattmceuen maybe you know some maas | 20:19 |
evgenyl | expert who may have some info on that? | 20:19 |
evgenyl | Is Anthony on irc? I'm wondering if this is somehow related to this change https://review.opendev.org/#/c/662312/ | 20:20 |
op317q__ | Evgeny my issue is related to this issue ? | 20:21 |
op317q__ | or different issue ? | 20:21 |
evgenyl | op317q__: No, it is not related. | 20:21 |
op317q__ | ok | 20:22 |
evgenyl | op317q__: I'm not a MaaS pro, so I myself trying to understand how all this works... | 20:22 |
op317q__ | ok | 20:23 |
evgenyl | op317q__: When your node gets booted by drydock, as far as I know, it should boot over PXE, it's hard to tell why it does not. You can try checking the traffic with tcpdump to make sure that DHCP requests come to your server. | 20:24 |
openstackgerrit | Ian Pittwood proposed airship/spyglass master: Schema validation https://review.opendev.org/659172 | 20:26 |
openstackgerrit | Ian Pittwood proposed airship/spyglass master: Schema validation https://review.opendev.org/659172 | 20:33 |
op317q__ | ok | 20:33 |
openstackgerrit | Alexander Hughes proposed airship/pegleg master: [WIP] Site and global secret decrypt. https://review.opendev.org/662847 | 20:39 |
nishantkr | evgenyl: I am unable to open the link to the failure logs but from your description it sounds like similar issue we have seen in maas and worked upon by Anthony, I am aware of the following PS which were used to address the issue: | 20:40 |
nishantkr | https://review.opendev.org/#/c/662336/ | 20:40 |
nishantkr | https://review.opendev.org/#/c/662312/ | 20:40 |
openstackgerrit | Michael Beaver proposed airship/shipyard master: Remove required-projects from Airskiff gate https://review.opendev.org/662284 | 20:40 |
openstackgerrit | Ian Pittwood proposed airship/spyglass master: Data objects for Spyglass https://review.opendev.org/658917 | 20:42 |
evgenyl | nishantkr: In the logs there is a traceback `OSError: [Errno 22] Invalid argument: '/etc/maas/rackd.conf'` after the execution of `maas-rack register ...` command and it retries it. | 20:42 |
openstackgerrit | Alexander Hughes proposed airship/pegleg master: [WIP] Site and global secret decrypt. https://review.opendev.org/662847 | 20:42 |
evgenyl | nishantkr: Thank you Nishant, I will try to use these patches to see if this helps. | 20:43 |
*** altlogbot_0 has quit IRC | 20:45 | |
nishantkr | evgenyl: Don't think that was the error we saw, from what i remember maas-import-resources job never got completed as sync job failed on one of the nodes and the job was stuck in a loop and specifically that issue was seen in a BF scenario and not GF | 20:47 |
evgenyl | nishantkr: Oh, I see, thanks for letting me know! | 20:48 |
openstackgerrit | Evgeniy L proposed airship/treasuremap master: Uplift MaaS to fix stabilitiy issues https://review.opendev.org/662855 | 20:56 |
openstackgerrit | Stas Egorov proposed airship/airship-in-a-bottle master: Support for new hyperkube source in promenade https://review.opendev.org/657954 | 20:57 |
kskels | evgenyl: me and op317q__ looked at the PXE interface - it looks like VLAN is not correctly configured | 20:58 |
openstackgerrit | Evgeniy L proposed airship/treasuremap master: [WIP] Uplift nfs-provisioner https://review.opendev.org/662583 | 20:58 |
kskels | so I have suggested to check with the lab folks to make sure the network/VLAN is OK for PXE | 20:58 |
evgenyl | kskels: Oh, I see, thanks! | 21:00 |
*** sreejithp has quit IRC | 21:04 | |
kskels | https://www.irccloud.com/pastebin/mI3yAT3H/ | 21:04 |
kskels | swilkers: seeing chart failure for elasticsearch in latest uplift | 21:05 |
kskels | let me know if this seems familiar | 21:05 |
kskels | srwilkers: | 21:06 |
srwilkers | not familiar | 21:08 |
srwilkers | good place to start looking would be here: details = "render error in "elasticsearch/statefulset-data.yaml": template: elasticsearch/statefulset-data.yaml:142:32: executing "elasticsearch/statefulset-data.yaml" at <.Values.conf.elastic...>: can't evaluate field data in type interface {}" | 21:08 |
evgenyl | kskels: can you also check tiller logs, maybe there will be a bit more info? | 21:09 |
srwilkers | id be willing to bet it's due to this: https://github.com/airshipit/treasuremap/blob/master/global/software/charts/osh-infra/osh-infra-logging/elasticsearch.yaml#L304-L305 | 21:10 |
kskels | https://www.irccloud.com/pastebin/jz0UBq1E/ | 21:10 |
srwilkers | not matching this: https://github.com/openstack/openstack-helm-infra/blob/master/elasticsearch/values.yaml#L657-L661 | 21:10 |
*** jaakko has quit IRC | 21:11 | |
kskels | let me update! | 21:11 |
srwilkers | i also expect you to run into issues with the fluent-logging chart if you attempt to uplift it, since it no longer exists | 21:12 |
kskels | do you think best would be to skip uplifting OSH until you can help with fixes? | 21:12 |
kskels | maybe osh-infra team could craft an uplift patchset for this.. | 21:12 |
srwilkers | at some point maybe, but not going to be anytime soon | 21:13 |
srwilkers | since it's effectively just me | 21:13 |
srwilkers | and i've got a massive backlog atm :( | 21:13 |
mattmceuen | or srwilkers, is there a PS to osh-infra that has analogous override changes? | 21:13 |
kskels | exactly.. | 21:13 |
srwilkers | we've always had this in tree: https://github.com/openstack/openstack-helm-infra/blob/master/tools/deployment/armada/manifests/armada-lma.yaml | 21:14 |
srwilkers | that gets updated with the changes we make | 21:14 |
srwilkers | that would be your best bet -- it's a bit difficult for us to maintain multiple manifests spread across multiple repos unfortunately | 21:14 |
kskels | thank you | 21:14 |
srwilkers | you're welcome | 21:15 |
openstackgerrit | Merged airship/armada master: Correct Armada github sync key https://review.opendev.org/662823 | 21:19 |
openstackgerrit | Michael Beaver proposed airship/shipyard master: Remove required-projects from Airskiff gate https://review.opendev.org/662284 | 21:20 |
*** howell has quit IRC | 21:24 | |
openstackgerrit | Kaspars Skels proposed airship/treasuremap master: Uplift most of the Airship components https://review.opendev.org/662860 | 21:30 |
*** kranthikirang has quit IRC | 21:33 | |
*** alexanderhughes has quit IRC | 21:47 | |
*** nishantkr has quit IRC | 21:58 | |
openstackgerrit | Michael Beaver proposed airship/shipyard master: Remove required-projects from Airskiff gate https://review.opendev.org/662284 | 22:16 |
*** aaronsheffield has quit IRC | 22:53 | |
*** sthussey has quit IRC | 23:33 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!