| *** aaronsheffield has quit IRC | 00:10 | |
| *** igordc has joined #openstack-helm | 00:44 | |
| *** stevthedev has joined #openstack-helm | 00:44 | |
| *** kranthikirang has joined #openstack-helm | 00:53 | |
| *** kranthikirang has quit IRC | 00:58 | |
| *** nicolasbock has quit IRC | 01:03 | |
| *** Liang__ has joined #openstack-helm | 01:14 | |
| *** Liang__ has left #openstack-helm | 01:15 | |
| *** roman_g has quit IRC | 02:33 | |
| *** jamesgu_ has quit IRC | 02:38 | |
| *** jamesgu has quit IRC | 02:38 | |
| *** kranthikirang has joined #openstack-helm | 02:42 | |
| *** kranthikirang has quit IRC | 02:46 | |
| *** cfriesen has quit IRC | 02:47 | |
| *** igordc has quit IRC | 03:18 | |
| *** igordc has joined #openstack-helm | 03:18 | |
| *** kranthikirang has joined #openstack-helm | 03:37 | |
| openstackgerrit | Andrii Ostapenko proposed openstack/openstack-helm master: Use service domain for Keystone test https://review.opendev.org/684921 | 03:45 |
|---|---|---|
| *** kranthikirang has quit IRC | 03:52 | |
| *** markvoelker has quit IRC | 04:08 | |
| *** markvoelker has joined #openstack-helm | 05:05 | |
| *** dpawlik has joined #openstack-helm | 05:06 | |
| *** markvoelker has quit IRC | 05:11 | |
| *** kranthikirang has joined #openstack-helm | 05:25 | |
| *** kranthikirang has quit IRC | 05:29 | |
| *** roman_g has joined #openstack-helm | 05:42 | |
| *** roman_g has quit IRC | 06:00 | |
| *** vsaienk0 has joined #openstack-helm | 06:12 | |
| *** kranthikirang has joined #openstack-helm | 06:20 | |
| *** vsaienk0 has quit IRC | 06:22 | |
| *** pgaxatte has joined #openstack-helm | 06:23 | |
| *** kranthikirang has quit IRC | 06:24 | |
| *** vsaienk0 has joined #openstack-helm | 06:31 | |
| *** rchurch has quit IRC | 06:43 | |
| *** dmsimard has quit IRC | 06:44 | |
| *** jsuchome has joined #openstack-helm | 06:45 | |
| *** igordc has quit IRC | 06:53 | |
| *** dmsimard has joined #openstack-helm | 06:58 | |
| *** pgaxatte has quit IRC | 07:14 | |
| *** pgaxatte has joined #openstack-helm | 07:16 | |
| *** witek has joined #openstack-helm | 07:38 | |
| *** kranthikirang has joined #openstack-helm | 07:49 | |
| *** kranthikirang has quit IRC | 07:53 | |
| *** rchurch has joined #openstack-helm | 07:59 | |
| zhipeng[m] | Hi all | 08:03 |
| zhipeng[m] | I have a rabbitmq issue | 08:03 |
| zhipeng[m] | After I upgrade openstack-helm-infra recently. | 08:04 |
| zhipeng[m] | keystone db sync failed due to RROR oslo.messaging._drivers.impl_rabbit [-] Connection failed: failed to resolve broker hostname | 08:04 |
| zhipeng[m] | I saw below code part removed in latest code of rabbitmq/values.yaml | 08:05 |
| * zhipeng[m] sent a long message: < https://matrix.org/_matrix/media/v1/download/matrix.org/sazUaHLzaaEUQsdenXNpCJoM > | 08:05 | |
| * zhipeng[m] sent a long message: < https://matrix.org/_matrix/media/v1/download/matrix.org/OYTvetNNDqfzbsxAZmKEAtuU > | 08:06 | |
| zhipeng[m] | In rabbitmq/templates/statefulset.yaml, dicovery changed to internal in below part | 08:10 |
| * zhipeng[m] sent a long message: < https://matrix.org/_matrix/media/v1/download/matrix.org/jGFrTbJbIHfUWflbnzFlYFlD > | 08:10 | |
| zhipeng[m] | @por | 08:11 |
| zhipeng[m] | * | 08:11 |
| zhipeng[m] | portdirect: can you help? I saw your comments in above code, thanks! | 08:11 |
| itxaka | zhipeng[m]: we also encountered that, we had to resort to setting statefulset to null to keep the old naming, but this is deploying with airship AND with only 1 replica of rabbitmq | 08:17 |
| itxaka | our old hostname was: keystone-rabbitmq.openstack.svc.cluster.local but with this patch it changed to rabbitmq-rabbitmq-0.keystone-rabbitmq.openstack.svc.cluster.local | 08:17 |
| itxaka | you can probably tweak the endpoints.oslo_messaging in values.yaml to fit it to your deployment | 08:18 |
| * zhipeng[m] sent a long message: < https://matrix.org/_matrix/media/v1/download/matrix.org/DWKYYrQzBzolWhqVftXSTeoK > | 08:19 | |
| zhipeng[m] | this is the old one | 08:19 |
| itxaka | the patch that introduced this was https://github.com/openstack/openstack-helm/commit/9bcf0df94c1a8455e17aa79f20efaf2736eed0f4 | 08:19 |
| zhipeng[m] | from my side, and name is rabbit@osh-openstack-rabbitmq-rabbitmq-0.osh-openstac-dsv-e50215.openstack.svc.cluster.loca | 08:19 |
| zhipeng[m] | now, it change to rabbit@osh-openstack-rabbitmq-rabbitmq-0.rabbitmq.openstack.svc.cluster.local | 08:19 |
| itxaka | check what do you have in endpoints.oslo_messaging.statefulset | 08:21 |
| evrardjp | itxaka it seems this change is breaking upgrades, yet there are no release notes ? | 08:21 |
| itxaka | side effct of not having releases I guess | 08:21 |
| itxaka | you dont have 2 nice points to check upgradability | 08:21 |
| itxaka | zhipeng[m]: also check endpoints.oslo_messaging.hosts.default | 08:22 |
| itxaka | between that and endpoints.oslo_messaging.statefulset the hostname is created | 08:22 |
| zhipeng[m] | recently, I'm upgrading both openstack-helm and openstack-helm-infra to latest commit version | 08:23 |
| itxaka | so from endpoints.oslo_messaging.statefulset.name it comes the "rabbitmq-rabbitmq-X" part | 08:23 |
| itxaka | and from endpoints.oslo_messaging.hosts.default the other extra "rabbitmq" | 08:24 |
| zhipeng[m] | I have no this section | 08:24 |
| zhipeng[m] | endpoints.oslo_messaging.statefulset | 08:24 |
| itxaka | that config is done in the components | 08:25 |
| itxaka | not in the rabbitmq chart | 08:25 |
| zhipeng[m] | below is the old one | 08:26 |
| * zhipeng[m] sent a long message: < https://matrix.org/_matrix/media/v1/download/matrix.org/oLlmkjlGAzlbLByHjCVUXjaE > | 08:26 | |
| zhipeng[m] | you mean in rabbitmq code? | 08:26 |
| itxaka | Im well there is 2 things here, one is rabbitmq chart adn its creation of hostnames and one is the components creating thost hostnames to connect to rabbitmq | 08:29 |
| itxaka | which one is failing here? the name creation in rabbit or the componentns not being able to connect to rabbit because they have the wrong hostname? | 08:30 |
| itxaka | I can help you with the second as I encountered that recently, for the first I cant as we are still using an older rabbitmq chart without the latest changes so no idea how that works :) | 08:30 |
| zhipeng[m] | OK, I guess it is second one | 08:32 |
| zhipeng[m] | btw if we want to upgrade openstack-helm, which commit version is prefered | 08:33 |
| zhipeng[m] | As I mentioned above, for our old version, hostname is | 08:35 |
| zhipeng[m] | osh-openstac-dsv-e50215.openstack.svc.cluster.loca | 08:35 |
| zhipeng[m] | now it was created as | 08:36 |
| zhipeng[m] | rabbitmq.openstack.svc.cluster.local | 08:36 |
| zhipeng[m] | then, keystone db sync can not resolve it anymore | 08:37 |
| zhipeng[m] | From log, I can see rabbitmq started normally | 08:40 |
| * zhipeng[m] sent a long message: < https://matrix.org/_matrix/media/v1/download/matrix.org/bRJdWMFngerJmKrfhgpywjCt > | 08:40 | |
| jsuchome | itxaka: once rabbitmq expert, always rabbitmq expert .... | 08:41 |
| zhipeng[m] | In keystone/values.yaml , it is below | 08:53 |
| zhipeng[m] | hosts: | 08:53 |
| zhipeng[m] | default: keystone | 08:53 |
| zhipeng[m] | internal: keystone-api | 08:53 |
| zhipeng[m] | in other component like nova is below | 08:55 |
| * zhipeng[m] sent a long message: < https://matrix.org/_matrix/media/v1/download/matrix.org/FlQMvDQpnXNRobggSqiuRRXd > | 08:55 | |
| zhipeng[m] | why we have no statefulset for keystone? | 08:56 |
| zhipeng[m] | sorry, missing it, keystone has statefulset as well | 09:02 |
| zhipeng[m] | portdirect: Do I need to change rabbitmq-rabbitmq to rabbitmq ? | 09:03 |
| *** markvoelker has joined #openstack-helm | 09:08 | |
| *** markvoelker has quit IRC | 09:13 | |
| itxaka | mmmh Im wondering where that osh-openstac-dsv-e50215 part in the hostname came from | 09:16 |
| itxaka | maybe portdirect has more info on that, sorry zhipeng[m] | 09:16 |
| zhipeng[m] | simply, so how can I change in keystone side to let it get name as | 09:16 |
| zhipeng[m] | rabbit@osh-openstack-rabbitmq-rabbitmq-0.rabbitmq.openstack.svc.cluster.local | 09:16 |
| itxaka | ah, in keystone | 09:17 |
| zhipeng[m] | can you help on the second one :) | 09:17 |
| zhipeng[m] | above name I saw in rabbitmq log | 09:18 |
| itxaka | override the value endpoints.oslo_messaging.statefulset.name to "osh-openstack-rabbitmq-rabbitmq" | 09:18 |
| zhipeng[m] | ok, I will try it, thanks | 09:19 |
| itxaka | that should make keystone try to connect to osh-openstack-rabbitmq-rabbitmq-0.rabbitmq.openstack.svc.cluster.local | 09:19 |
| zhipeng[m] | great!!! | 09:20 |
| itxaka | if that doesnt work let us know so other people can explain that better when they arrive (should be in around 3 hours I think) | 09:22 |
| zhipeng[m] | sure | 09:22 |
| *** Emine has joined #openstack-helm | 09:24 | |
| *** bobmel has joined #openstack-helm | 09:37 | |
| *** kranthikirang has joined #openstack-helm | 09:37 | |
| zhipeng[m] | itxaka: It works! | 09:41 |
| *** roman_g has joined #openstack-helm | 09:41 | |
| itxaka | yay \o/ | 09:41 |
| zhipeng[m] | thanks !!! | 09:41 |
| itxaka | Im glad I could help you :D | 09:41 |
| *** kranthikirang has quit IRC | 09:42 | |
| *** bobmel has quit IRC | 09:49 | |
| pma78 | please review https://review.opendev.org/684197 (Handle neutron ML2 mechanism drivers) | 10:24 |
| pma78 | please review https://review.opendev.org/684254 (Support neutron's baremetal mechanism driver) | 10:24 |
| pma78 | please review https://review.opendev.org/683111 (Support override of ironic agent image) | 10:24 |
| *** rezroo has quit IRC | 11:01 | |
| *** nicolasbock has joined #openstack-helm | 11:03 | |
| *** markvoelker has joined #openstack-helm | 11:17 | |
| *** markvoelker has quit IRC | 11:22 | |
| *** kranthikirang has joined #openstack-helm | 11:25 | |
| *** kranthikirang has quit IRC | 11:30 | |
| *** georgk5 has quit IRC | 11:57 | |
| *** rihabb has quit IRC | 11:57 | |
| *** georgk5 has joined #openstack-helm | 11:58 | |
| *** rihabb has joined #openstack-helm | 11:58 | |
| *** ianychoi has quit IRC | 12:00 | |
| *** ianychoi has joined #openstack-helm | 12:03 | |
| *** markvoelker has joined #openstack-helm | 12:07 | |
| *** Darcidride has joined #openstack-helm | 12:24 | |
| *** jsuchome has quit IRC | 12:29 | |
| *** bh526r has joined #openstack-helm | 12:54 | |
| *** Darcidride has quit IRC | 12:56 | |
| *** Darcidride has joined #openstack-helm | 12:56 | |
| *** vsaienk0 has quit IRC | 12:57 | |
| *** aaronsheffield has joined #openstack-helm | 13:04 | |
| *** dpawlik has quit IRC | 13:10 | |
| *** kranthikirang has joined #openstack-helm | 13:14 | |
| *** sthussey has joined #openstack-helm | 13:15 | |
| *** kranthikirang has quit IRC | 13:18 | |
| *** vsaienk0 has joined #openstack-helm | 13:28 | |
| *** dpawlik has joined #openstack-helm | 13:28 | |
| *** kranthikirang has joined #openstack-helm | 13:46 | |
| *** bobmel has joined #openstack-helm | 13:53 | |
| openstackgerrit | Evgeniy L proposed openstack/openstack-helm-infra master: Add RabbitMQ ingress Network Policy rules https://review.opendev.org/682490 | 13:57 |
| zhipeng[m] | Does latest build support Train? | 13:59 |
| zhipeng[m] | itxaka: However, this workaround is ugly, can we submit a patch to change it in values.yaml | 14:03 |
| itxaka | zhipeng[m]: I think latests should support train, yes, I read that in the airshipit channel, havent tested it myself | 14:05 |
| itxaka | regarding the workaround, lets check with portdirect, as I would expect that in the latest version of osh and osh-infra the name should be automatically generated and would match, otherwise our jobs would fail | 14:06 |
| itxaka | did yoou upgrade an existing environment? Maybe thats the issue | 14:06 |
| zhipeng[m] | For openstack-helm upgrade, we have no release number, right? | 14:06 |
| zhipeng[m] | I just fetch the version according to latest commit id | 14:06 |
| zhipeng[m] | Do you have any proposal, thanks! | 14:06 |
| *** nicolasbock has quit IRC | 14:06 | |
| itxaka | nope, you need to use another tool for that, we use airship with versions.yml to freeze the versions | 14:06 |
| zhipeng[m] | I saw last time, we fetch one openstack-helm according to one commit-id | 14:08 |
| zhipeng[m] | I'm not upgrading a existing env | 14:09 |
| zhipeng[m] | I come from StarlingX project team, like airship | 14:10 |
| openstackgerrit | Merged openstack/openstack-helm master: [neutron] Handle ML2 mechanism drivers https://review.opendev.org/684197 | 14:13 |
| openstackgerrit | Merged openstack/openstack-helm master: [neutron] Support baremetal mechanism driver https://review.opendev.org/684254 | 14:22 |
| *** michael-beaver has joined #openstack-helm | 14:24 | |
| openstackgerrit | Merged openstack/openstack-helm-infra master: Mariadb: Run ingress error page server as nobody user https://review.opendev.org/684806 | 14:34 |
| *** kranthikirang has quit IRC | 14:48 | |
| *** jamesgu has joined #openstack-helm | 15:05 | |
| *** jamesgu_ has joined #openstack-helm | 15:05 | |
| *** roman_g has quit IRC | 15:05 | |
| *** cfriesen has joined #openstack-helm | 15:11 | |
| *** vsaienk0 has quit IRC | 15:13 | |
| *** witek has quit IRC | 15:13 | |
| *** vsaienk0 has joined #openstack-helm | 15:17 | |
| *** vsaienk0 has quit IRC | 15:28 | |
| *** jamesgu has quit IRC | 15:28 | |
| *** jamesgu_ has quit IRC | 15:28 | |
| *** vsaienk0 has joined #openstack-helm | 15:30 | |
| *** dansmith has left #openstack-helm | 15:34 | |
| *** dansmith has joined #openstack-helm | 15:36 | |
| *** kranthikirang has joined #openstack-helm | 15:39 | |
| *** dpawlik has quit IRC | 15:43 | |
| *** dpawlik has joined #openstack-helm | 15:43 | |
| *** kranthikirang has quit IRC | 15:44 | |
| openstackgerrit | Vasyl Saienko proposed openstack/openstack-helm master: [Glance] add job-metadefs-load https://review.opendev.org/679963 | 15:47 |
| openstackgerrit | Vasyl Saienko proposed openstack/openstack-helm master: [Glance] add job-metadefs-load https://review.opendev.org/679963 | 15:48 |
| openstackgerrit | Vasyl Saienko proposed openstack/openstack-helm-infra master: [helm-toolkit] add manifests.job_db_general https://review.opendev.org/681476 | 15:48 |
| openstackgerrit | RADHIKA PAI proposed openstack/openstack-helm-infra master: Prometheus: Relabeling the node-exporter label https://review.opendev.org/685119 | 15:48 |
| *** bh526r has quit IRC | 15:54 | |
| *** nicolasbock has joined #openstack-helm | 16:04 | |
| *** pgaxatte has quit IRC | 16:08 | |
| *** Emine has quit IRC | 16:11 | |
| *** igordc has joined #openstack-helm | 16:14 | |
| *** AlexNoskov has quit IRC | 16:28 | |
| *** kranthikirang has joined #openstack-helm | 16:29 | |
| *** markvoelker has quit IRC | 16:33 | |
| openstackgerrit | Gage Hugo proposed openstack/openstack-helm-infra master: Define default netpol for openstack-exporter https://review.opendev.org/685130 | 16:35 |
| *** markvoelker has joined #openstack-helm | 16:41 | |
| *** igordc has quit IRC | 16:43 | |
| *** Darcidride has quit IRC | 16:49 | |
| *** vsaienk0 has quit IRC | 16:53 | |
| openstackgerrit | Gage Hugo proposed openstack/openstack-helm master: Add network policy nonvoting checks https://review.opendev.org/681539 | 16:57 |
| *** itlinux has quit IRC | 17:04 | |
| *** vsaienk0 has joined #openstack-helm | 17:04 | |
| *** vsaienk0 has quit IRC | 17:14 | |
| openstackgerrit | Phil Sphicas proposed openstack/openstack-helm-infra master: helm-toolkit fix dependency resolver https://review.opendev.org/685136 | 17:23 |
| openstackgerrit | Pete Birley proposed openstack/openstack-helm master: Neutron: Update force purge of test project to be less aggressive https://review.opendev.org/685137 | 17:26 |
| *** igordc has joined #openstack-helm | 17:28 | |
| openstackgerrit | Pete Birley proposed openstack/openstack-helm master: Neutron: Update force purge of test project to be less aggressive https://review.opendev.org/685137 | 17:45 |
| *** vsaienk0 has joined #openstack-helm | 17:54 | |
| *** dpawlik has quit IRC | 17:56 | |
| *** factor has joined #openstack-helm | 18:05 | |
| openstackgerrit | Pete Birley proposed openstack/openstack-helm master: Neutron: Update force purge of test project to be less aggressive https://review.opendev.org/685137 | 18:06 |
| openstackgerrit | chinasubbareddy mallavarapu proposed openstack/openstack-helm-infra master: [ceph-osd] Retry to create crush map for osd while ceph-mon service down for a while. https://review.opendev.org/685147 | 18:12 |
| *** igordc has quit IRC | 18:29 | |
| openstackgerrit | Pete Birley proposed openstack/openstack-helm master: Neutron: Ensure test project purge targets correct project https://review.opendev.org/685150 | 18:31 |
| *** igordc has joined #openstack-helm | 18:32 | |
| *** vsaienk0 has quit IRC | 18:38 | |
| openstackgerrit | Evgeniy L proposed openstack/openstack-helm-infra master: Add RabbitMQ ingress Network Policy rules https://review.opendev.org/682490 | 18:52 |
| openstackgerrit | Evgeniy L proposed openstack/openstack-helm-infra master: Add RabbitMQ ingress Network Policy rules https://review.opendev.org/682490 | 18:58 |
| openstackgerrit | Evgeniy L proposed openstack/openstack-helm-infra master: Add RabbitMQ ingress Network Policy rules https://review.opendev.org/682490 | 19:02 |
| openstackgerrit | chinasubbareddy mallavarapu proposed openstack/openstack-helm-infra master: [ceph-osd] Retry to create crush map for osd while ceph-mon service down for a while. https://review.opendev.org/685147 | 19:08 |
| openstackgerrit | chinasubbareddy mallavarapu proposed openstack/openstack-helm-infra master: [ceph-osd] Retry to create crush map for osd while ceph-mon service down for a while. https://review.opendev.org/685147 | 19:25 |
| openstackgerrit | Evgeniy L proposed openstack/openstack-helm-infra master: Add RabbitMQ ingress Network Policy rules https://review.opendev.org/682490 | 19:30 |
| openstackgerrit | Merged openstack/openstack-helm master: Keystone: allow probes configuration https://review.opendev.org/683220 | 19:30 |
| *** cfriesen has quit IRC | 19:38 | |
| *** vsaienk0 has joined #openstack-helm | 19:41 | |
| openstackgerrit | Merged openstack/openstack-helm master: Neutron: Update force purge of test project to be less aggressive https://review.opendev.org/685137 | 19:55 |
| *** vsaienk0 has quit IRC | 20:01 | |
| openstackgerrit | Steven Fitzpatrick proposed openstack/openstack-helm-infra master: [WIP] Add mountpoints to node-exporter https://review.opendev.org/685172 | 20:09 |
| *** kranthikirang has quit IRC | 20:21 | |
| *** kranthikirang has joined #openstack-helm | 20:22 | |
| *** kranthikirang has quit IRC | 20:27 | |
| openstackgerrit | Steven Fitzpatrick proposed openstack/openstack-helm-infra master: [WIP] Add extensible volume mounts to node-exporter https://review.opendev.org/685172 | 20:29 |
| openstackgerrit | Steven Fitzpatrick proposed openstack/openstack-helm-infra master: [WIP] Add extensible volume mounts to node-exporter https://review.opendev.org/685172 | 20:30 |
| openstackgerrit | Merged openstack/openstack-helm master: Neutron: Ensure test project purge targets correct project https://review.opendev.org/685150 | 20:34 |
| openstackgerrit | Merged openstack/openstack-helm master: Don't use quotes in glance swift configuration https://review.opendev.org/675789 | 20:54 |
| *** markvoelker has quit IRC | 21:34 | |
| *** kranthikirang has joined #openstack-helm | 21:35 | |
| *** rezroo has joined #openstack-helm | 21:38 | |
| *** kranthikirang has quit IRC | 21:40 | |
| *** rezroo has quit IRC | 21:44 | |
| *** michael-beaver has quit IRC | 21:50 | |
| *** markvoelker has joined #openstack-helm | 21:57 | |
| openstackgerrit | Merged openstack/openstack-helm-infra master: Grafana:Updated ES unassigned shards query https://review.opendev.org/683223 | 22:04 |
| *** michael-beaver has joined #openstack-helm | 22:23 | |
| *** markvoelker has quit IRC | 22:27 | |
| *** jamesgu has joined #openstack-helm | 22:53 | |
| openstackgerrit | Stas Egorov proposed openstack/openstack-helm-infra master: Fixed calico chart for hyperkube 1.12 https://review.opendev.org/685186 | 23:11 |
| *** aaronsheffield has quit IRC | 23:21 | |
| *** kranthikirang has joined #openstack-helm | 23:24 | |
| openstackgerrit | Stas Egorov proposed openstack/openstack-helm-infra master: [TMP]: for testing https://review.opendev.org/685187 | 23:24 |
| *** kranthikirang has quit IRC | 23:28 | |
| *** rezroo has joined #openstack-helm | 23:31 | |
| openstackgerrit | Hari proposed openstack/openstack-helm-addons master: Include retry logic for checking status https://review.opendev.org/685188 | 23:38 |
| *** sthussey has quit IRC | 23:43 | |
| openstackgerrit | Stas Egorov proposed openstack/openstack-helm-infra master: Fixed calico chart for hyperkube 1.12 https://review.opendev.org/685186 | 23:50 |
| openstackgerrit | Stas Egorov proposed openstack/openstack-helm-infra master: [TMP]: for testing https://review.opendev.org/685187 | 23:53 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!