*** sapd1 has joined #openstack-containers | 00:08 | |
*** sapd1 has quit IRC | 00:16 | |
openstackgerrit | Merged openstack/magnum stable/train: heat-agent: Check if scripts exists https://review.opendev.org/690760 | 01:38 |
---|---|---|
openstackgerrit | Merged openstack/magnum master: k8s_fedora: Add use_podman label https://review.opendev.org/690053 | 01:38 |
openstackgerrit | Merged openstack/magnum master: Use v1.15.0 as default octavia_ingress_controller_tag https://review.opendev.org/689722 | 01:38 |
*** spsurya has joined #openstack-containers | 01:59 | |
*** ricolin has joined #openstack-containers | 02:12 | |
*** ykarel has joined #openstack-containers | 03:11 | |
*** mrdoug has joined #openstack-containers | 03:49 | |
*** ykarel has quit IRC | 03:54 | |
*** mrdoug has quit IRC | 03:55 | |
*** mrdoug has joined #openstack-containers | 03:55 | |
*** ykarel has joined #openstack-containers | 04:15 | |
*** jerryz has quit IRC | 04:20 | |
*** udesale has joined #openstack-containers | 04:38 | |
openstackgerrit | caoyuan proposed openstack/magnum master: tox: Keeping going with docs https://review.opendev.org/690803 | 05:35 |
openstackgerrit | caoyuan proposed openstack/magnum-ui master: tox: Keeping going with docs https://review.opendev.org/690808 | 05:49 |
openstackgerrit | caoyuan proposed openstack/magnum-tempest-plugin master: tox: Keeping going with docs https://review.opendev.org/690810 | 05:51 |
*** udesale has quit IRC | 06:01 | |
*** udesale has joined #openstack-containers | 06:10 | |
*** ykarel is now known as ykarel|afk | 06:15 | |
brtknr | https://review.opendev.org/#/c/690764/ This one too flwang1 :) morning btw | 06:23 |
*** pcaruana has joined #openstack-containers | 06:41 | |
*** mrdoug has quit IRC | 07:06 | |
*** mrdoug has joined #openstack-containers | 07:07 | |
*** ttsiouts has joined #openstack-containers | 07:15 | |
openstackgerrit | caoyuan proposed openstack/magnum master: tox: Keeping going with docs https://review.opendev.org/690803 | 07:18 |
*** ttsiouts has quit IRC | 07:26 | |
*** ttsiouts has joined #openstack-containers | 07:26 | |
*** ttsiouts has quit IRC | 07:31 | |
*** ykarel|afk is now known as ykarel | 07:31 | |
*** trident has quit IRC | 07:46 | |
*** mrdoug has quit IRC | 07:48 | |
*** mrdoug has joined #openstack-containers | 07:49 | |
*** trident has joined #openstack-containers | 07:51 | |
*** ttsiouts has joined #openstack-containers | 07:57 | |
openstackgerrit | Merged openstack/magnum master: No new NGs for clusters without an api_address https://review.opendev.org/688400 | 08:29 |
openstackgerrit | Bharat Kunwar proposed openstack/magnum stable/train: No new NGs for clusters without an api_address https://review.opendev.org/690878 | 08:30 |
*** ykarel is now known as ykarel|lunch | 08:31 | |
openstackgerrit | Spyros Trigazis proposed openstack/magnum master: coreos: Use heat params for heat-agent image https://review.opendev.org/690011 | 08:34 |
brtknr | strigazi: we need this https://review.opendev.org/#/c/690760 on train because of the reboot issue | 08:44 |
openstackgerrit | Spyros Trigazis proposed openstack/magnum stable/train: k8s_fedora: Add use_podman label https://review.opendev.org/690882 | 08:46 |
openstackgerrit | Spyros Trigazis proposed openstack/magnum stable/train: [fedora-atomic][k8s] Support operating system upgrade https://review.opendev.org/690883 | 08:47 |
openstackgerrit | Spyros Trigazis proposed openstack/magnum stable/train: k8s_fedora: Add use_podman label https://review.opendev.org/690882 | 08:50 |
*** ykarel|lunch is now known as ykarel | 09:25 | |
openstackgerrit | Merged openstack/magnum stable/train: Failed state was ignored for default ngs https://review.opendev.org/690764 | 09:29 |
*** mrdoug has quit IRC | 09:46 | |
openstackgerrit | Merged openstack/magnum master: Docker volume size from nodegroups https://review.opendev.org/687879 | 10:06 |
*** udesale has quit IRC | 10:19 | |
*** ttsiouts has quit IRC | 10:20 | |
*** ttsiouts has joined #openstack-containers | 10:21 | |
*** ttsiouts has quit IRC | 10:25 | |
openstackgerrit | Merged openstack/magnum master: coreos: Use heat params for heat-agent image https://review.opendev.org/690011 | 10:31 |
*** ykarel_ has joined #openstack-containers | 10:40 | |
*** ykarel has quit IRC | 10:43 | |
openstackgerrit | Merged openstack/magnum stable/train: No new NGs for clusters without an api_address https://review.opendev.org/690878 | 10:44 |
*** udesale has joined #openstack-containers | 10:44 | |
*** ykarel_ is now known as ykarel | 10:45 | |
*** ttsiouts has joined #openstack-containers | 11:06 | |
*** ttsiouts has quit IRC | 11:18 | |
*** ttsiouts has joined #openstack-containers | 11:19 | |
*** ttsiouts_ has joined #openstack-containers | 11:23 | |
*** ttsiouts has quit IRC | 11:23 | |
*** janki has joined #openstack-containers | 11:44 | |
*** dave-mccowan has joined #openstack-containers | 11:55 | |
*** dave-mccowan has quit IRC | 12:00 | |
*** ykarel is now known as ykarel|afk | 12:15 | |
*** iokiwi has quit IRC | 12:51 | |
*** goldyfruit has joined #openstack-containers | 13:00 | |
*** ykarel|afk is now known as ykarel | 13:02 | |
*** ttsiouts_ has quit IRC | 13:11 | |
*** ttsiouts has joined #openstack-containers | 13:12 | |
*** janki has quit IRC | 13:13 | |
*** ttsiouts has quit IRC | 13:16 | |
*** ttsiouts has joined #openstack-containers | 13:18 | |
openstackgerrit | Theodoros Tsioutsias proposed openstack/magnum stable/train: Docker volume size from nodegroups https://review.opendev.org/690973 | 13:19 |
*** ykarel is now known as ykarel|afk | 13:29 | |
*** spsurya has quit IRC | 13:29 | |
*** ykarel|afk is now known as ykarel | 13:48 | |
*** ykarel has quit IRC | 14:18 | |
*** mrdoug has joined #openstack-containers | 14:19 | |
*** pcaruana has quit IRC | 14:19 | |
*** ykarel has joined #openstack-containers | 14:20 | |
*** mrdoug has quit IRC | 14:38 | |
*** mrdoug has joined #openstack-containers | 14:39 | |
*** jmlowe has quit IRC | 14:44 | |
*** mrdoug has quit IRC | 14:48 | |
*** mrdoug has joined #openstack-containers | 14:55 | |
*** mrdoug has quit IRC | 14:58 | |
*** mrdoug has joined #openstack-containers | 15:00 | |
*** jmlowe has joined #openstack-containers | 15:00 | |
*** gouthamr_ is now known as gouthamr | 15:01 | |
*** yolanda has quit IRC | 15:03 | |
*** yolanda has joined #openstack-containers | 15:11 | |
*** mrdoug has quit IRC | 15:14 | |
*** mrdoug has joined #openstack-containers | 15:40 | |
*** mrdoug has quit IRC | 15:40 | |
*** mrdoug has joined #openstack-containers | 15:50 | |
*** ykarel is now known as ykarel|away | 15:53 | |
*** goldyfruit has quit IRC | 15:54 | |
*** ttsiouts has quit IRC | 15:54 | |
*** ttsiouts has joined #openstack-containers | 15:55 | |
*** mrdoug has quit IRC | 15:55 | |
*** goldyfruit has joined #openstack-containers | 15:56 | |
*** ttsiouts has quit IRC | 15:59 | |
brtknr | strigazi: Have you seen this before? Error from server: no preferred addresses found; known addresses: [] | 16:03 |
brtknr | both calico and flannel are doing this... in stein 8.1.0 | 16:09 |
brtknr | I am guessing its a symptom of something else | 16:09 |
*** ianychoi has joined #openstack-containers | 16:21 | |
*** jmlowe has quit IRC | 16:29 | |
*** ykarel|away has quit IRC | 16:33 | |
*** spiette has quit IRC | 16:52 | |
*** spiette has joined #openstack-containers | 16:55 | |
*** udesale has quit IRC | 17:13 | |
*** henriqueof has joined #openstack-containers | 17:25 | |
henriqueof | Just to make sure: If I update the cluster so it have more worker nodes there is no risk of losing data, right? | 17:25 |
brtknr | henriqueof henriqueof henriqueof: not normally | 17:28 |
henriqueof | Well, just got an update failed messag. | 17:35 |
henriqueof | Everything seems to be working but I don't know what to do now. | 17:36 |
henriqueof | I requested more nodes but it failed with not enough memory resources, but I have other servers with tons of free memory. | 17:36 |
henriqueof | Now I can't call update naymore, any sugestions? | 17:38 |
*** jerryz has joined #openstack-containers | 17:48 | |
*** jmlowe has joined #openstack-containers | 17:48 | |
henriqueof | Anyone can help? How can I revert a failed update to a cluster? | 17:53 |
*** ricolin has quit IRC | 17:55 | |
*** jmlowe has quit IRC | 19:41 | |
goldyfruit | henriqueof, update into the database ? | 19:43 |
henriqueof | goldyfruit: Thanks for taking the time to reply! I sent the update command again via CLI, looks like the problem happens just when using Horizon. | 19:44 |
henriqueof | It worked. :) | 19:44 |
goldyfruit | Cool! | 19:52 |
*** jmlowe has joined #openstack-containers | 19:54 | |
*** goldyfruit_ has joined #openstack-containers | 19:57 | |
*** goldyfruit has quit IRC | 19:59 | |
*** iokiwi has joined #openstack-containers | 20:08 | |
*** colby_ has joined #openstack-containers | 20:12 | |
*** KeithMnemonic has quit IRC | 20:41 | |
*** KeithMnemonic has joined #openstack-containers | 20:52 | |
brtknr | flwang: you there? | 21:03 |
flwang | brtknr: yes | 21:04 |
brtknr | i need some help debugging a cluster spawned using 8.1.0 tag | 21:04 |
brtknr | it is probably a more general question | 21:04 |
brtknr | but what are the reasons nodes in a cluster may not have InternalIP or ExternalIP | 21:05 |
brtknr | flwang: ^ | 21:05 |
brtknr | neither* | 21:05 |
flwang | 8.1.0 is stein? | 21:06 |
flwang | then i think it's related to those patches we backport recently | 21:06 |
flwang | we're using stein without trouble so far | 21:06 |
flwang | for example, we have backport patches from 1...N, then swith to N/2 to try to reproduce | 21:07 |
flwang | then N/4 or 3N/4 | 21:07 |
flwang | you will be able to find the patch which is causing problem | 21:08 |
brtknr | flwang: 8.1.0 is working for us in 3 different sites but failed at one site | 21:10 |
brtknr | flwang: the weird thing about the site where its failing is that the when i do kubectl get nodes -o wide, i do not see any InternalIP | 21:11 |
brtknr | this fails for both flannel and calico | 21:11 |
flwang | that sounds familiar for me | 21:12 |
flwang | but if it works for your 3 sites, then the best person to debug it is you :) | 21:13 |
flwang | you may have to figure out the difference between your regions/sites | 21:13 |
brtknr | flwang: yes, thats what im trying to do :) | 21:14 |
brtknr | flwang: just saw this in the heat-container-agent log: raise exceptions.EndpointNotFound(msg)\nkeystoneauth1.exceptions.catalog.EndpointNotFound: publicURL endpoint for orchestration service in None region not found | 21:21 |
flwang | looks like a config issue | 21:22 |
flwang | check your magnum conf and heat conf | 21:22 |
brtknr | flwang: thanks | 21:24 |
flwang | np | 21:25 |
brtknr | flwang: looks like we are almost ready to cut a release | 21:27 |
flwang | brtknr: yes, thank you very much | 21:28 |
flwang | we can't finish this release without you, brtknr | 21:29 |
brtknr | flwang: haha that is not 100% true but thank you :) | 21:30 |
flwang | i'm 100% sure it's true :) | 21:30 |
brtknr | flwang: we need this: https://review.opendev.org/#/c/690973/1 | 21:32 |
brtknr | flwang: i wonder what we are going to do in the next cycle | 21:32 |
openstackgerrit | Merged openstack/magnum stable/train: [fedora-atomic][k8s] Support operating system upgrade https://review.opendev.org/690883 | 21:33 |
flwang | brtknr: one big feature i'd like to support is resizing master and containerized master | 21:33 |
flwang | two features, sorry, haha | 21:33 |
brtknr | resizing number of masters? | 21:34 |
flwang | yes | 21:34 |
flwang | and we do need polish the fedora coreos driver as well | 21:35 |
brtknr | hmm strangely i thought we could already do that! | 21:35 |
flwang | brtknr: we can't at this moment | 21:35 |
brtknr | resize master | 21:35 |
flwang | you can try and i hope i'm wrong | 21:36 |
brtknr | sounds like | 21:36 |
brtknr | a good thing to have anyway | 21:36 |
flwang | containerized master nodes - managed master nodes by a root k8s cluster is the most exciting feature i'd like to introduce in U | 21:36 |
brtknr | flwang: i will need to try and get a better sense for in what way it would be containerised :) | 21:38 |
*** goldyfruit_ has quit IRC | 21:38 | |
brtknr | arent we already running master node services in containers? what do you actually mean? im sure ive misunderstood it | 21:38 |
flwang | running k8s components as pods in another "root" k8s cluster | 21:39 |
flwang | so user don't have to worry about the master nodes, and only pay for the work nodes | 21:39 |
flwang | does that make sense? | 21:39 |
flwang | as you can see on GKE, EKS, etc | 21:39 |
brtknr | ahhh... master node as a service kind of thing? | 21:40 |
flwang | not really | 21:40 |
flwang | that means as a user, you can choose to create a fully managed k8s cluster, or a "full" k8s cluster | 21:41 |
flwang | when it's fully managed, user can't see the master nodes | 21:41 |
brtknr | flwang: that makes sense | 21:41 |
flwang | all etcd, kube-apiserver, kube-scheduler, etc are manged as pod in another "root" k8s cluster, user can't see it | 21:42 |
flwang | because the root k8s cluster is managed by the cloud provider | 21:42 |
flwang | just like the amphor node of octavia lb | 21:42 |
flwang | for a full k8s cluster, you can get what you can get now, both master and worker nodes | 21:43 |
flwang | that's important for public clouds | 21:43 |
brtknr | ok so it would be like having a master node in another project? | 21:43 |
flwang | because we need to lower the cost | 21:43 |
brtknr | or would a single master node manage multiple clusters? | 21:43 |
flwang | brtknr: no | 21:43 |
flwang | for that case, think your master as an app running on another k8s cluster | 21:44 |
openstackgerrit | Merged openstack/magnum stable/train: k8s_fedora: Add use_podman label https://review.opendev.org/690882 | 21:48 |
*** rcernin has quit IRC | 22:03 | |
*** goldyfruit has joined #openstack-containers | 22:03 | |
*** rcernin has joined #openstack-containers | 23:13 | |
*** mrdoug has joined #openstack-containers | 23:13 | |
*** mrdoug has quit IRC | 23:19 | |
*** henriqueof has quit IRC | 23:33 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!