| airship-irc-bot | <sidney.shiba> `$ kubectl get po -A` `NAMESPACE NAME READY STATUS RESTARTS AGE` `capi-kubeadm-bootstrap-system capi-kubeadm-bootstrap-controller-manager-6f669ccd7c-9tzph 0/2 ErrImagePull 0 55 | 00:07 |
|---|---|---|
| airship-irc-bot | 54s` `capi-system capi-controller-manager-5f677d7d65-prltc 0/2 ImagePullBackOff 0 56s` `capi-webhook-system capi-controller-manager-745689557d-vzwhl 0/2 ErrImagePull 0 57s` `capi-webhook-system | 00:07 |
| airship-irc-bot | `capi-webhook-system capi-kubeadm-control-plane-controller-manager-7b6c4bf48d-49wnr 0/2 ImagePullBackOff 0 55s` `capi-webhook-system capz-controller-manager-66f59b5554-ghwq4 0/2 ImagePullBackOff 0 53s` `capz-system capz-controller-man | 00:07 |
| airship-irc-bot | cert-manager-cainjector-fc6c787db-fxwpk 1/1 Running 0 90s` `cert-manager cert-manager-d994d94d7-k9hlg 1/1 Running 0 90s` `cert-manager | 00:07 |
| airship-irc-bot | am on the AT&T's laptop with VPN and proxy enabled: `$ kubectl describe pod capi-controller-manager-5f677d7d65-prltc -n capi-system` `Name:Â Â Â Â Â Â Â Â capi-controller-manager-5f677d7d65-prltc` `Namespace:Â Â Â capi-system` `Priority:Â Â Â Â 0` `Node:Â Â Â Â Â Â Â Â ephemeral-cluster-control-plane/172.17.0.2` `Start Time:Â Â Wed, 31 Mar 2021 18:07:38 -0500` `Containers:` Â `kube-rbac-proxy:` Â Â Â `Container ID:`Â Â Â Â Â `Image:Â Â Â Â Â | 00:07 |
| airship-irc-bot | gcr.io/kubebuilder/kube-rbac-proxy:v0.4.1` `...` `manager:` `Container ID:` `Image: us.gcr.io/k8s-artifacts-prod/cluster-api/cluster-api-controller:v0.3.7` `...` `Events:` `Type Reason Age From Message` `---- ------ ---- ---- -------` `Normal Schedule | 00:07 |
| airship-irc-bot | capi-system/capi-controller-manager-5f677d7d65-prltc to ephemeral-cluster-control-plane` `Warning Failed 41m (x2 over 41m) kubelet Error: ErrImagePull` `Normal BackOff 41m (x2 over 41m) kubelet Back-off pulling image "us.gcr.io/k8s-artifacts-prod/cluster-api/cluster-api-controller:v0.3.7"` `Warning Failed 41m (x2 over 41m) kubelet | 00:07 |
| airship-irc-bot | kubelet Pulling image "gcr.io/kubebuilder/kube-rbac-proxy:v0.4.1"` `Warning Failed 40m (x3 over 41m) kubelet Failed to pull image "gcr.io/kubebuilder/kube-rbac-proxy:v0.4.1": rpc error: code = Unknown desc = failed to pull and unpack image "gcr.io/kubebuilder/kube-rbac-proxy:v0.4.1": failed to copy: httpReaderSeeker: failed open: failed to do request: Get | 00:07 |
| airship-irc-bot | https://storage.googleapis.com/artifacts.kubebuilder.appspot.com/containers/images/sha256:70eeaa7791f218b7387699032654e01a4559a27d061da02c5facb2277f360dbd: x509: certificate signed by unknown authority` `Warning Failed 40m (x3 over 41m) kubelet Error: ErrImagePull` `Normal Pulling 40m (x3 over 41m) kubelet Pulling image "us.gcr.io/k8s-artifacts-prod/cluster-api/cluster | 00:07 |
| airship-irc-bot | 40m (x3 over 41m) kubelet Failed to pull image "us.gcr.io/k8s-artifacts-prod/cluster-api/cluster-api-controller:v0.3.7": rpc error: code = Unknown desc = failed to pull and unpack image "us.gcr.io/k8s-artifacts-prod/cluster-api/cluster-api-controller:v0.3.7": failed to copy: httpReaderSeeker: failed open: failed to do request: Get | 00:07 |
| airship-irc-bot | https://storage.googleapis.com/us.artifacts.k8s-artifacts-prod.appspot.com/containers/images/sha256:b718a621b399440ba473688582745b5dfbc741bc6439ae02e8e59db76b8494a5: x509: certificate signed by unknown authority` `Normal BackOff 16m (x105 over 41m) kubelet Back-off pulling image "gcr.io/kubebuilder/kube-rbac-proxy:v0.4.1"` `Warning Failed 102s (x170 over 41m) kubel` | 00:07 |
| airship-irc-bot | <kk6740> maybe proxy issues? | 00:07 |
| airship-irc-bot | <sidney.shiba> I thought I had the proxy sorted out as I can now access external web sites with VPN on. Will try again tomorrow without VPN and see what happens. Thanks Kostiantyn. | 00:09 |
| *** sreejithp has joined #airshipit | 00:17 | |
| airship-irc-bot | <sidney.shiba> Tried without VPN and then fails as it cannot pull the cert-manager image, which was working with VPN so assuming it is something else. Will try the same on Ericsson's laptop tomorrow. | 00:20 |
| airship-irc-bot | <james.gu> Roman, is the doc build turned off on the master branch? can it be turned it on when we start to merge v2 document into the master? | 00:51 |
| airship-irc-bot | <sreejith.punnapuzha> Zuul is down again. i cant reach the site | 01:01 |
| *** sreejithp has quit IRC | 03:17 | |
| *** happyhemant has joined #airshipit | 06:48 | |
| *** lemko has joined #airshipit | 07:07 | |
| *** muhaha has joined #airshipit | 07:18 | |
| *** muhaha10 has joined #airshipit | 07:33 | |
| *** muhaha10 has quit IRC | 07:33 | |
| *** muhaha has quit IRC | 07:48 | |
| airship-irc-bot | <mattmceuen> gm folks - Sreejith's change to get helm-chart-collator working has merged. I've updated the treasuremap->airshipctl pin to pull that in and then rebased James' dependent script change, reviews appreciated: https://review.opendev.org/c/airship/treasuremap/+/784091 https://review.opendev.org/c/airship/treasuremap/+/783911 | 13:19 |
| airship-irc-bot | <mattmceuen> Those two patchsets are the last two we're trying to get in prior to cutting a v2.0 stabilization branch | 13:20 |
| *** roman_g has joined #airshipit | 13:24 | |
| *** raildo has joined #airshipit | 13:46 | |
| airship-irc-bot | <digambar.patil> @mattmceuen @dwalt @ih616h @kk6740 Please review - https://review.opendev.org/c/airship/treasuremap/+/783223 | 14:17 |
| airship-irc-bot | <digambar.patil> Zuul is passed +1 | 14:17 |
| *** raildo has quit IRC | 14:39 | |
| *** roman_g has quit IRC | 14:45 | |
| airship-irc-bot | <mattmceuen> This v2.0 branching requirements has passed validation and needs another +2, please: https://review.opendev.org/c/airship/treasuremap/+/784091 | 14:51 |
| airship-irc-bot | <mattmceuen> It looks like we're having more zuul problems this morning :( | 14:53 |
| airship-irc-bot | <mf4716> URGENT V2.0 GA Reviews needed: Sean Eagan se136c 784163 https://review.opendev.org/c/airship/hostconfig-operator/+/784163 Sean Eagan se136c 784151 https://review.opendev.org/c/airship/images/+/784151 Sean Eagan se136c 784161 https://review.opendev.org/c/airship/images/+/784161 | 15:27 |
| airship-irc-bot | <mattmceuen> the infra team is aware of the zuul issue; and yes it's affecting jobs, not just the UI | 15:43 |
| *** happyhemant has quit IRC | 16:27 | |
| airship-irc-bot | <sidney.shiba> Hi team, while executing `airshipctl phase run clusterctl-init-target` the cert-manager pods didn't deploy due to tainted controlplane nodes. Do I still have to execute `kubectl taint node <controlplane-node> node-role.kubernetes.io/master-` or is there a mechanism to configure tolerations for this phase? | 16:36 |
| airship-irc-bot | <mattmceuen> Hmm, I thought cert-manager already had a toleration, that's strange | 16:48 |
| airship-irc-bot | <ratnopam.chakrabarti> Hi, can I get some core-reviews please on https://review.opendev.org/c/airship/treasuremap/+/779889. Thanks in advance! | 16:57 |
| airship-irc-bot | <mattmceuen> Gating hasn't kicked off on this: https://review.opendev.org/c/airship/treasuremap/+/784091 I suspect its because it got WF right around the time zuul was having issues. I'll try removing / re-adding WF | 16:58 |
| airship-irc-bot | <mattmceuen> That seemed to unclog the pipes. | 17:03 |
| airship-irc-bot | <jan-erik.mangs> Is the “cloud provider zuul backend” again? | 17:07 |
| airship-irc-bot | <mattmceuen> oh dear. I just noticed that an IRC message didn't get mirrored to Slack (hi jan-erik.mangs), even though Slack messages are getting mirrored to IRC | 17:09 |
| airship-irc-bot | <mattmceuen> This is the first I've logged into IRC for a few weeks, so I'm not sure how long that's been going on :( Sorry IRC friends, we haven't been ignoring you! | 17:09 |
| airship-irc-bot | <mattmceuen> @ashlee is that something you could look into? | 17:09 |
| airship-irc-bot | <ashlee> Uh oh! Yeah let me ask Jonathan | 17:10 |
| mattmceuen | jan-erik.mangs: the issue today was a zuul-wide one, not a backend issue -- zuul itself was unavailable for a few minutes and running jobs got cancelled | 17:11 |
| *** jbryce has joined #airshipit | 17:12 | |
| airship-irc-bot | <ashlee> @mattmceuen can you tell how long it’s been happening? | 17:12 |
| airship-irc-bot | <ashlee> Or, _not_ happening | 17:13 |
| mattmceuen | Unfortunately I've no idea, would need to compare IRC logs and Slack logs side by side | 17:13 |
| jbryce | i think this might have been related to a freenode maintenance activity | 17:14 |
| mattmceuen | think it's the kind of thing a bounce would help with, or has the interface changed somehow? | 17:15 |
| mattmceuen | oh - I see you in slack jbryce :) | 17:15 |
| jbryce | it appears to be working again | 17:16 |
| *** portdirect has joined #airshipit | 17:16 | |
| jbryce | it would have disconnected everyone, including the bot which should have reconnected | 17:16 |
| jbryce | since my client also got disconnected, i can't actually see when the bot left and rejoined so i don't know how log it was down | 17:16 |
| mattmceuen | ahh that makes sense. Did you just need to bounce the bot to re-established? | 17:16 |
| jbryce | i didn't actually do anything | 17:17 |
| mattmceuen | oh funny -- maybe I just got lucky then spotting jan-erik's message, and it was working fine before and after | 17:18 |
| *** muhaha has joined #airshipit | 17:34 | |
| airship-irc-bot | <mf4716> URGENT V2.0 GA Reviews needed: Kostiantyn K. 784436 https://review.opendev.org/c/airship/airshipctl/+/784436 - "Move deployment scripts from test-site to function" | 17:46 |
| airship-irc-bot | <mattmceuen> It's got WF already | 17:46 |
| airship-irc-bot | <mattmceuen> Konstantine gave me a heads up on it -- we're going to need that in 2.0, but we don't really want to push back branching. So we're thinking branch treasuremap after the two remaining patches merge (super super close) | 17:48 |
| airship-irc-bot | <mattmceuen> And then branch airshipctl after the 784436 fix above merges, if we can get it through the pipes quickly | 17:48 |
| airship-irc-bot | <mattmceuen> And then update the airshipctl pin in TM v2.0 branch to incorporate the change | 17:48 |
| airship-irc-bot | <mattmceuen> How's that sound to you @sean.eagan | 17:48 |
| airship-irc-bot | <mattmceuen> The 2 treasuremap changes - last ones from our list yesterday - are merged. I think we're good to branch treasuremap at-will Sean if that plan sounds good to you | 17:58 |
| airship-irc-bot | <sean.eagan> Sounds good to me | 18:00 |
| *** muhaha has quit IRC | 18:38 | |
| airship-irc-bot | <mattmceuen> Hey @sean.eagan, MattF was looking and can't find any ability to rename branches in gerrit. This is consistent with the ability not to delete branches, so not too suprising. You'd said you weren't aware of any tricks, right? | 18:39 |
| airship-irc-bot | <sean.eagan> Updated several projects to do github mirroring on tag push so that release github actions (quay image tagging , release notes gen) will happen without delay, which should make the release process run much smoother. Please review: https://review.opendev.org/q/topic:%22tag-mirroring%22+(status:open%20OR%20status:merged) | 18:55 |
| airship-irc-bot | <mattmceuen> Good catch | 18:57 |
| airship-irc-bot | <sean.eagan> I knew you couldn't delete tags, haven't dealt with branches before | 18:57 |
| airship-irc-bot | <mattmceuen> Yeah | 18:57 |
| airship-irc-bot | <mattmceuen> We should still see if we can use the git CLI -- `-m` for move -- in case that works @mf4192 | 18:58 |
| airship-irc-bot | <mattmceuen> I know it'll work locally :slightly_smiling_face: not sure about pushing the change | 18:58 |
| airship-irc-bot | <mattmceuen> https://stackoverflow.com/questions/46538140/rename-remote-branch-in-gerrit | 18:59 |
| airship-irc-bot | <mf4192> Hmmm… is that referring to the permissions that got added? That makes it sound as if I should be able to see the option to delete a branch from the UI, but I don’t | 19:05 |
| airship-irc-bot | <mattmceuen> yeah. worth a try, but if it's disabled in the UI it may be disabled via the cli | 19:06 |
| *** muhaha has joined #airshipit | 19:11 | |
| airship-irc-bot | <sean.eagan> Created the treasuremap v2.0 branch from tip of v2: https://review.opendev.org/plugins/gitiles/airship/treasuremap/+/refs/heads/v2.0 | 19:13 |
| airship-irc-bot | <kk6740> @mattmceuen the patch i was talking about with TM fix was merged to airshipctl | 19:44 |
| airship-irc-bot | <kk6740> so you can proceed with the pinning | 19:45 |
| airship-irc-bot | <mattmceuen> Perfect - will do in our shiny new v2.0 branch :slightly_smiling_face: Sean that also means you can branch airshipctl at will | 19:46 |
| airship-irc-bot | <mattmceuen> @sean.eagan airshipctl commit: 892bb6a16d53a0f43571284db83901bef53ed440 | 19:50 |
| airship-irc-bot | <mattmceuen> TM pin update: https://review.opendev.org/c/airship/treasuremap/+/784473 | 19:53 |
| airship-irc-bot | <sean.eagan> v2.0 branch of airshipctl created: https://review.opendev.org/plugins/gitiles/airship/airshipctl/+/refs/heads/v2.0 | 20:01 |
| airship-irc-bot | <kk6740> Ive missed some of the calls, but are we using branch or tag for release, or both? | 20:02 |
| airship-irc-bot | <mattmceuen> using vX.Y branch for stabilization (and future critical bug/security fixes if needed), and vX.Y.Z tags | 20:06 |
| airship-irc-bot | <mattmceuen> Only branching proactively for treasuremap and airshipctl | 20:06 |
| airship-irc-bot | <mattmceuen> So if we're lucky, only the v2.0.0 tag will be made off the v2.0 branch, next week; and if needed we'll make a v2.0.1 tag off the v2.0 branch in the future | 20:08 |
| *** lemko9 has joined #airshipit | 21:42 | |
| *** lemko has quit IRC | 21:42 | |
| *** lemko9 is now known as lemko | 21:42 | |
| *** muhaha has quit IRC | 22:43 | |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!