Thursday, 2020-07-23

openstackgerritKostyantyn Kalynovskyi proposed airship/airshipctl master: Allow to use variable substitution for cluster-api components  https://review.opendev.org/73985400:09
openstackgerritRuslan Aliev proposed airship/airshipctl master: [Do not merge] CI test with roles job enabled  https://review.opendev.org/74256300:24
openstackgerritMatt McEuen proposed airship/treasuremap v2: [WIP] Add deployment gate  https://review.opendev.org/74164800:58
*** cheng1 has quit IRC01:08
*** cheng1 has joined #airshipit01:09
openstackgerritMerged airship/election master: Add Drew Walters 2020 WC nomination  https://review.opendev.org/74254201:51
openstackgerritVrushali proposed airship/airshipctl master: Testing docker-gate Added scripts for installing tools for the zuul gate and  scripts for deploying docker cluster using kind, initialized management cluster with capi and capd components, and deployed target cluster in docker.  https://review.opendev.org/73868201:59
openstackgerritVrushali proposed airship/airshipctl master: Testing docker-gate  https://review.opendev.org/73868202:01
*** cheng1 has quit IRC02:08
*** cheng1 has joined #airshipit02:08
*** uzumaki has joined #airshipit02:34
*** cheng1 has quit IRC05:08
*** cheng1 has joined #airshipit05:08
*** uzumaki has quit IRC05:42
openstackgerritSirisha Gopigiri proposed airship/airshipctl master: Testing certificate insertion with Zuul Gates  https://review.opendev.org/73943106:43
*** cheng1 has quit IRC07:02
*** cheng1 has joined #airshipit07:03
openstackgerritSirisha Gopigiri proposed airship/airshipctl master: Testing certificate insertion with Zuul Gates  https://review.opendev.org/73943107:18
openstackgerritSirisha Gopigiri proposed airship/airshipctl master: Testing certificate insertion with Zuul Gates  https://review.opendev.org/73943107:21
openstackgerritSirisha Gopigiri proposed airship/airshipctl master: Testing certificate insertion with Zuul Gates  https://review.opendev.org/73943108:00
*** cheng1 has quit IRC08:08
*** cheng1 has joined #airshipit08:08
openstackgerritVrushali proposed airship/airshipctl master: Testing docker-gate  https://review.opendev.org/73868208:09
*** uzumaki has joined #airshipit08:23
*** uzumaki has quit IRC08:34
*** cheng1 has quit IRC08:47
*** cheng1 has joined #airshipit08:48
*** born2bake has joined #airshipit08:53
*** cheng1 has quit IRC09:00
*** cheng1 has joined #airshipit09:03
openstackgerritVladislav Kuzmin proposed airship/airshipctl master: Introduce executor for clusterctl init phase  https://review.opendev.org/73381009:18
*** cheng1 has quit IRC09:35
*** cheng1 has joined #airshipit09:36
*** cheng1 has quit IRC09:54
*** cheng1 has joined #airshipit09:55
*** cheng1 has quit IRC11:09
*** cheng1 has joined #airshipit11:09
*** cheng1 has quit IRC14:08
*** cheng1 has joined #airshipit14:12
openstackgerritMatt McEuen proposed airship/treasuremap v2: [WIP] Add deployment gate  https://review.opendev.org/74164814:27
*** mfixtex has joined #airshipit14:29
openstackgerritDanny Massa proposed airship/airshipui master: WIP Adding Angular to UI  https://review.opendev.org/74268614:45
openstackgerritSean Eagan proposed airship/airshipctl master: [#177] Add Flux Helm Operator manifests  https://review.opendev.org/72029814:45
openstackgerritDanny Massa proposed airship/airshipui master: WIP Adding Angular to UI  https://review.opendev.org/74268615:37
openstackgerritUday Ruddarraju proposed airship/airshipctl master: DNM: Adding support for airshipctl encryption and decryption using sops  https://review.opendev.org/74269515:53
openstackgerritUday Ruddarraju proposed airship/airshipctl master: DNM: Adding support for airshipctl encryption and decryption using sops  https://review.opendev.org/74269515:57
portdirectwas just running through the gate/check scripts for airship216:35
portdirectand they no longer running for me in my local env16:36
portdirecti think this: https://github.com/airshipit/airshipctl/commit/0324993d609712e84e64be914b84f2c7cd277764#diff-dbd9cd0ce7e9a5628770143f1488ff5916:36
portdirectnow puts the reliance back onto ansble playbooks, meaning that the scripts no longer work stand alone?16:36
portdirectmattmceuen: ^16:36
portdirectlooks like this onwards needs to be push into a bash script to restore functionality? https://github.com/airshipit/airshipctl/commit/0324993d609712e84e64be914b84f2c7cd277764#diff-8f04d7238ae4ca516745dbfbcbb14924R6316:37
*** mfixtex has quit IRC16:44
mattmceuenah, sorry about that portdirect -- yeah, moving that pre-run data munging into scripts seems reasonable to me in any case.  To make sure I understand the issue:17:00
mattmceuenIs the problem that the systemwide-executable script isn't running (i.e. you're pulling the scripts-to-run out of jobs.yaml programmatically), or that the whole set-up isn't working if the pre-run ansible data munging is skipped?17:01
airship-irc-bot1<pb269f> the latter17:01
airship-irc-bot1<pb269f> it breaks on trying to build the ephemeral iso17:01
airship-irc-bot1<pb269f> i think the expection should be17:01
airship-irc-bot1<pb269f> that you can run the scripts in /tools in order ;)17:01
airship-irc-bot1<pb269f> *expectation17:01
airship-irc-bot1<pb269f> no biggie - a revert back to before this unblocks me for now17:02
mattmceuenHmm, I'm not sure why that broke in that way -- the pre-run data munging existed before, it just didn't need the kustomize plugins to be installed till now17:02
airship-irc-bot1<pb269f> hmm - will double check again17:03
mattmceuenI would have thought that running the scripts in order would still be analogous to the way it was before; let me take a look17:03
airship-irc-bot1<pb269f> but deff somthing broke in last week17:03
mattmceuenyeah, I don't doubt it :D17:03
airship-irc-bot1<pb269f> may have attributed it wrong however - if so, muchos appoligies in advance :)17:03
mattmceuenno worries!  the iso building had been working locally for me, but I wasn't starting from a clean environment so may have had some crumbs laying around that made things work17:06
airship-irc-bot1<pb269f> I think thats the delta17:07
airship-irc-bot1<pb269f> i'm working an a 'clean room'17:07
airship-irc-bot1<se6518> we have 21_systemwide... script in playbook, local scripts should work17:07
airship-irc-bot1<se6518> ./tools/gate/00_setup.sh && ./tools/gate/10_build_gate.sh && ./tools/gate/20_run_gate_runner.sh17:07
*** cheng1 has quit IRC17:08
*** cheng1 has joined #airshipit17:11
openstackgerritStacey Fletcher proposed airship/airshipctl master: [WIP][DNM] Virtual Airship in a Pod  https://review.opendev.org/73975317:26
airship-irc-bot1<pb269f> @se6518 to ensure its not lost - the expactaion should be that these scripts can run in order17:33
airship-irc-bot1<pb269f> if 21 is not ment to be called directly anymore, it should not be in the directory at all17:34
airship-irc-bot1<pb269f> *meant17:34
airship-irc-bot1<se6518> It works just fine. I don't see any issues with local deployment. 21... script can be run alone. Maybe I don't understand the scope of the problem. But the link to the change above is about zuul job change and has nothing to do with local scripts.17:57
openstackgerritBijaya Sharma proposed airship/airshipctl master: [#19] Add validate schema command  https://review.opendev.org/73340118:05
openstackgerritStas Egorov proposed airship/airshipctl master: [WIP]: DONT MERGE: local gate  https://review.opendev.org/74272018:08
openstackgerritCraig Anderson proposed airship/images master: WIP: image builder for ubuntu based airship hosts  https://review.opendev.org/73077718:36
*** cheng1 has quit IRC18:41
*** cheng1 has joined #airshipit18:41
openstackgerritBijaya Sharma proposed airship/airshipctl master: [#19] Add validate schema command  https://review.opendev.org/73340118:48
openstackgerritStas Egorov proposed airship/airshipctl master: [WIP]: DONT MERGE: local gate  https://review.opendev.org/74272019:04
openstackgerritRishabh Kumar Jain proposed airship/airshipctl master: Reorganize Docker Target Manifests  https://review.opendev.org/73787119:15
openstackgerritMatt McEuen proposed airship/treasuremap v2: [WIP] Add skeleton of airship-core type  https://review.opendev.org/74171119:26
openstackgerritMatt McEuen proposed airship/treasuremap v2: [WIP] Add deployment gate  https://review.opendev.org/74164819:33
openstackgerritBijaya Sharma proposed airship/airshipctl master: [#19] Add validate schema command  https://review.opendev.org/73340119:38
*** cheng1 has quit IRC20:08
*** cheng1 has joined #airshipit20:09
openstackgerritMatt McEuen proposed airship/treasuremap v2: [WIP] Add skeleton of airship-core type  https://review.opendev.org/74171120:09
openstackgerritMatt McEuen proposed airship/treasuremap v2: [WIP] Add deployment gate  https://review.opendev.org/74164820:12
openstackgerritStas Egorov proposed airship/airshipctl master: [WIP]: DONT MERGE: local gate  https://review.opendev.org/74272020:18
openstackgerritMatt McEuen proposed airship/airshipctl master: Preparation for workers deployment  https://review.opendev.org/73829120:21
openstackgerritAhmad Mahmoudi proposed airship/drydock master: Added some validations for site model  https://review.opendev.org/74226820:44
openstackgerritStas Egorov proposed airship/airshipctl master: [WIP]: DONT MERGE: local gate  https://review.opendev.org/74272021:21
openstackgerritMatt McEuen proposed airship/airshipctl master: Add hardware profile / firmware plumbing  https://review.opendev.org/74013221:24
openstackgerritMatt McEuen proposed airship/treasuremap v2: [WIP] Add deployment gate  https://review.opendev.org/74164821:27
mattmceuenDoes anyone know where we get the cert-manager.io/v1alpha2 CRDs (like Certificate) from in the airshipctl manifest tree?  I don't see them defined in the repo itself (unless I'm missing it); is there some mechanism by which capi is fetching them?21:55
mattmceuenThe manifest validation check is failing in this patchset (https://review.opendev.org/#/c/738291/), with an error coming back from the validating apiserver:  failed to get current provider object: no matches for kind "Certificate" in version "cert-manager.io/v1alpha2"21:57
mattmceuenI'd like to switch the validation check back to a gate, now that the gate (in other cases at least) is working again, so I'd like to find that CRD so we can include it when validating21:59
airship-irc-bot1<se6518> @mattmceuen I worked on this problem22:08
airship-irc-bot1<se6518> we do cluster init and crd delete after that, but it's not enough to fully clean the cluster before next start22:09
mattmceuenweird - what is still left behind after that?22:09
portdirectwebooks?22:10
portdirectWebhook sry22:10
mattmceuenyeah maybe so22:12
openstackgerritCraig Anderson proposed airship/images master: WIP: image builder for ubuntu based airship hosts  https://review.opendev.org/73077722:13
mattmceuenit's not clear to me how exactly that not-clean kind cluster is breaking  validation, though, do you have more insight into that Stas?22:13
airship-irc-bot1<se6518> @mattmceuen we discussed this issue with @kk6740 and he pointed to this PS: https://review.opendev.org/733810 it has validate method which is not implemented, so, need to implement it for each step and get rid of the current validation mechanism22:13
mattmceuenGotcha - that makes sense, built-in validation in airshipctl is ++ .  I'll take a look at that PS, thanks22:14
airship-irc-bot1<se6518> So, currently, we have a loop in bash script which does cluster init and phase apply --dry-run for each cluster. After the first run(for any cluster) when we do CRD delete all we try to run cluster init again. But there is something unknown under the hood in cluster init and it can't initialize full list of CRDs again.22:16
mattmceuenIn the meantime - would tearing down the kind cluster and rebuilding it between ephemeral and target cluster operations do the trick short-term?22:16
mattmceuenI'll try it locally & see22:17
airship-irc-bot1<se6518> fresh kind will help22:17
airship-irc-bot1<se6518> I mean re-create kind for each cluster22:17
airship-irc-bot1<se6518> @mattmceuen by the way, why didn't we start using kind for ephemeral cluster in Airshipctl from the beginning?22:21
mattmceuenOne reason is because, Metal3 running in a local kind cluster couldn't bootstrap nodes on a remote network.  I'm not sure if that's changed/will change at all with recent Ironic redfish enhancements though.22:23
airship-irc-bot1<se6518> thanks22:26
openstackgerritAhmad Mahmoudi proposed airship/drydock master: Added some validations loggs for site model  https://review.opendev.org/74226822:28
mattmceuenIn principle, though, the ephemeral node that we spin up remotely via redfish - that could be kind or minikube or anything, I believe22:29
openstackgerritCraig Anderson proposed airship/images master: WIP: image builder for ubuntu based airship hosts  https://review.opendev.org/73077722:33
portdirectK3s would be perfect for it22:34
portdirectSimply as complex self contained22:34
portdirectLol - completely22:34
mattmceuenso few letter to type too22:34
mattmceuenletters22:34
mattmceuensigh22:34
*** cheng1 has quit IRC22:35
portdirectThis is why we really want to break out the ephemeral cluster to be a container22:36
portdirectIn the simplest case it could just retrieve a kubeconfig22:36
*** cheng1 has joined #airshipit22:36
portdirectBut also allows you to do whatever makes sense, from kind, through to say aks22:37
portdirectin addition to the redfish boot we do today22:37
openstackgerritCraig Anderson proposed airship/images master: WIP: image builder for ubuntu based airship hosts  https://review.opendev.org/73077722:37
mattmceuen++22:37
openstackgerritCraig Anderson proposed airship/images master: WIP: image builder for ubuntu based airship hosts  https://review.opendev.org/73077722:47
*** cheng1 has quit IRC23:08
*** cheng1 has joined #airshipit23:09
openstackgerritMerged airship/airshipui master: Added unit-tests in Makefile  https://review.opendev.org/73868823:22
*** born2bake has quit IRC23:28
openstackgerritCraig Anderson proposed airship/images master: WIP: image builder for ubuntu based airship hosts  https://review.opendev.org/73077723:51

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!