*** zhanglong has quit IRC | 00:14 | |
*** zhanglong has joined #openstack-kolla | 00:17 | |
openstackgerrit | James Kirsch proposed openstack/kolla-ansible master: Custom CA certificates deployment https://review.opendev.org/686024 | 00:26 |
---|---|---|
*** goldyfruit has joined #openstack-kolla | 00:39 | |
*** jschlueter has quit IRC | 01:04 | |
*** redrobot has quit IRC | 01:07 | |
*** zhanglong has quit IRC | 01:33 | |
*** goldyfruit has quit IRC | 01:43 | |
*** liujiong has joined #openstack-kolla | 02:00 | |
*** factor has quit IRC | 02:03 | |
*** igordc has quit IRC | 02:21 | |
*** zhanglong has joined #openstack-kolla | 02:25 | |
*** zhanglong has quit IRC | 02:34 | |
*** goldyfruit has joined #openstack-kolla | 02:41 | |
*** hjensas has quit IRC | 02:45 | |
*** jcmdln has joined #openstack-kolla | 02:55 | |
liujiong | Hello community! Anyone know how to prevent process(created inside docker container) being killed when container is stopped? | 03:15 |
cp | mgoddard: have you recently tried that github procedure from "A universe from nothing" ? | 03:22 |
*** goldyfruit has quit IRC | 04:00 | |
*** skramaja has joined #openstack-kolla | 04:08 | |
*** msalo has joined #openstack-kolla | 04:16 | |
*** msalo has quit IRC | 04:20 | |
cp | mgoddard: I get : | 04:38 |
cp | ./config/src/kayobe-config/pull-retag-push-images.sh | 04:38 |
cp | Permission denied (publickey,gssapi-keyex,gssapi-with-mic). | 04:39 |
*** msalo has joined #openstack-kolla | 04:47 | |
*** msalo has quit IRC | 04:51 | |
*** vmixor has quit IRC | 05:15 | |
*** duksoo has joined #openstack-kolla | 05:21 | |
duksoo | hi | 05:21 |
duksoo | i am new member kolla | 05:21 |
duksoo | work for kakao in korea | 05:21 |
duksoo | i have a question about kolla-ansible | 05:22 |
duksoo | can i? | 05:22 |
cp | probably better to just ask your question | 05:23 |
cp | (not that I can answer it) | 05:23 |
duksoo | thx haha | 05:23 |
cp | most people are not in our timezone | 05:23 |
cp | they will answer much later tonight | 05:23 |
duksoo | a ok thx | 05:24 |
*** zhanglong has joined #openstack-kolla | 05:24 | |
duksoo | my question is ‘I want set env at inventory node’ | 05:25 |
duksoo | this kolla passible setting env target node (inventory node) | 05:25 |
duksoo | i need proxy setting in target node :( | 05:26 |
duksoo | this kolla passible setting env target node (inventory node)? | 05:27 |
cp | Shit there is no 'train' release of Kayobe !? | 05:32 |
cp | probably better to use kolla-ansible it seems | 05:33 |
*** sri_ has joined #openstack-kolla | 05:38 | |
duksoo | https://www.openstack.org/videos/summits/berlin-2018/deploying-scientific-openstack | 05:41 |
*** pcaruana has joined #openstack-kolla | 05:43 | |
duksoo | kayobe 라는 컨셉을 처음 알았다. 고맙다. | 05:44 |
duksoo | I first knew the concept of kayobe. Thank you. | 05:44 |
duksoo | I'll study. | 05:45 |
duksoo | Still, it would be nice if there was a way to set up env settings on target nodes in kolla-ansible. | 05:46 |
*** vrdel has joined #openstack-kolla | 05:53 | |
*** lennyb has joined #openstack-kolla | 05:54 | |
cp | I do not speak Korean :) I am in Japan :) | 05:55 |
cp | duksoo: if you study and succeed in using it | 05:56 |
cp | duksoo: let me know and teach me please :) | 05:56 |
cp | I tried to set it up for many days, probably I am too stupid | 05:56 |
*** Luzi has joined #openstack-kolla | 06:00 | |
duksoo | おい! | 06:06 |
*** openstackstatus has joined #openstack-kolla | 06:09 | |
*** ChanServ sets mode: +v openstackstatus | 06:09 | |
openstackgerrit | Michal Nasiadka proposed openstack/kolla-ansible master: CI: Add ansible-lint to tox https://review.opendev.org/694779 | 06:09 |
yoctozepto | Morning | 06:19 |
yoctozepto | cp, duksoo: kayobe follows kolla-ansible, it needs more time to adjust | 06:19 |
mnasiadka | morning | 06:20 |
yoctozepto | hi mnasiadka, early birding today? | 06:20 |
mnasiadka | yeah, women at home woke me up too early ;) | 06:21 |
yoctozepto | Ah :D | 06:21 |
yoctozepto | Bring him the coffee pump before he commits | 06:22 |
mnasiadka | https://zuul.opendev.org/t/openstack/build/791029a53868466089ceaa103dbe6674/log/primary/logs/ansible/deploy#5625 | 06:37 |
mnasiadka | internal server error from docker engine... hmm | 06:37 |
*** dswebb has quit IRC | 06:45 | |
yoctozepto | Yeah, docker showing its ugliest face recently | 06:53 |
mnasiadka | there was something like elastic recheck | 06:54 |
mnasiadka | https://docs.openstack.org/infra/system-config/elastic-recheck.html | 06:54 |
mnasiadka | maybe we should try to use it, to track how many times something happens | 06:55 |
*** pcaruana has quit IRC | 06:56 | |
yoctozepto | yeah, nice idea | 06:56 |
*** dpawlik has joined #openstack-kolla | 07:03 | |
mnasiadka | yoctozepto: maybe nice, but it only searches for tempest errors :) | 07:16 |
yoctozepto | mnasiadka: :-( | 07:19 |
cp | yoctozepto: ok | 07:22 |
cp | yoctozepto: I gave up on Kayobe for now | 07:23 |
cp | yoctozepto: does not work for me | 07:23 |
cp | like at all | 07:23 |
cp | ( I mean following the "A universe from nothing doc" | 07:23 |
mnasiadka | yoctozepto: ok, not only tempest - but our ansible/* logs are not being pushed for logstash to indexing - let me ask infra what is the best place to add those | 07:25 |
yoctozepto | mnasiadka: ah, that makes sense | 07:26 |
yoctozepto | cp: understood, I know kayobe works but I am not engaged in the project too much | 07:27 |
yoctozepto | for me it's kolla and kolla-ansible | 07:27 |
*** cah_link has joined #openstack-kolla | 07:39 | |
openstackgerrit | Radosław Piliszek proposed openstack/kolla-ansible stable/stein: Vitrage: typo in precheck task https://review.opendev.org/694922 | 07:39 |
*** dpawlik has quit IRC | 07:43 | |
*** dpawlik has joined #openstack-kolla | 07:45 | |
openstackgerrit | Merged openstack/kolla-ansible stable/stein: Collect rabbitmq logs by fluentd https://review.opendev.org/693783 | 08:04 |
openstackgerrit | Michal Nasiadka proposed openstack/kolla-ansible master: CI: Add ansible-lint to tox https://review.opendev.org/694779 | 08:06 |
*** vrdel has quit IRC | 08:17 | |
*** ivve has joined #openstack-kolla | 08:17 | |
openstackgerrit | Dincer Celik proposed openstack/kolla master: Update elasticsearch and kibana version to 6.x https://review.opendev.org/647748 | 08:22 |
*** pcaruana has joined #openstack-kolla | 08:36 | |
hrw | yoctozepto: what is this ubuntu thing you mumble about? | 08:36 |
hrw | morning | 08:36 |
yoctozepto | hrw: folks being troubled by kvm permissions | 08:36 |
*** luksky has joined #openstack-kolla | 08:42 | |
openstackgerrit | Merged openstack/kolla-ansible stable/train: Vitrage: typo in precheck task https://review.opendev.org/694830 | 08:50 |
cp | yoctozepto: I am looking at kolla and kolla-ansible, so then you can be of help :) | 08:51 |
openstackgerrit | Merged openstack/kolla-ansible stable/stein: Start Docker after upgrade https://review.opendev.org/694548 | 08:52 |
tumble | is it recommended/okay to regularly (i.e., weekly) pull kolla images of the current release to keep everything up-to-date? I mean, how much attention do such updates need? As much as a release upgrade? | 08:52 |
*** liujiong has quit IRC | 08:53 | |
*** priteau has joined #openstack-kolla | 08:55 | |
cp | yoctozepto: Source builds are proven to be slightly more reliable than binary. <--- is this true still ? | 08:56 |
*** FlorianFa has joined #openstack-kolla | 08:58 | |
*** dougsz has joined #openstack-kolla | 08:59 | |
cp | That means if pip was used to install kolla-ansible, that means it’s latest stable version so openstack_release should be set to rocky <--- is this true ? | 09:02 |
cp | not train ? | 09:02 |
*** Luzi has quit IRC | 09:04 | |
cp | the doc is 'outdated'? | 09:05 |
cp | it is | 09:05 |
cp | man...seriously openstack doc is a drag | 09:05 |
*** rpittau|afk is now known as rpittau | 09:08 | |
hrw | yoctozepto: so as gnocchi is unmaintained then what about deprecate in train, remove in ussuri and go on? | 09:08 |
openstackgerrit | Merged openstack/kolla-ansible stable/train: Start Docker after upgrade https://review.opendev.org/694547 | 09:10 |
openstackgerrit | Merged openstack/kolla-ansible stable/rocky: Start Docker after upgrade https://review.opendev.org/694549 | 09:10 |
*** msalo has joined #openstack-kolla | 09:18 | |
*** Luzi has joined #openstack-kolla | 09:19 | |
*** Luzi has quit IRC | 09:21 | |
*** msalo has quit IRC | 09:23 | |
*** msalo has joined #openstack-kolla | 09:33 | |
openstackgerrit | Michal Nasiadka proposed openstack/kolla-ansible master: Change local_action to delegate_to: localhost https://review.opendev.org/694959 | 09:35 |
yoctozepto | hrw: and ceilometer and cloudkitty? | 09:37 |
yoctozepto | :P | 09:37 |
hrw | yoctozepto: and base - no one is using it. | 09:37 |
cp | yoctozepto: if I want to test drive kolla-ansible | 09:37 |
cp | what is the best best way ? | 09:37 |
openstackgerrit | Michal Nasiadka proposed openstack/kolla-ansible master: CI: Add ansible-lint to tox https://review.opendev.org/694779 | 09:37 |
cp | I have a single machine at the moment for everything | 09:37 |
*** msalo_ has joined #openstack-kolla | 09:38 | |
yoctozepto | hrw: base first yeah | 09:39 |
yoctozepto | cp: you can deploy an aio if your machine is potent enough | 09:39 |
yoctozepto | throw in 8GB of memory, 30GB of disk and a few cores | 09:39 |
yoctozepto | then follow the quickstart | 09:40 |
yoctozepto | for aio | 09:40 |
hrw | cp: x86? lot of ram? do multinode in VMs ;D | 09:40 |
yoctozepto | https://docs.openstack.org/kolla-ansible/latest/user/quickstart.html | 09:40 |
hrw | mnasiadka: two comments sent | 09:41 |
*** msalo has quit IRC | 09:41 | |
cp | AMD 4 cores 32GB RAM | 09:42 |
cp | not exactly potent | 09:42 |
hrw | cp: setup one VM and use it as testbench for aio | 09:42 |
cp | hrw: pointer ? | 09:42 |
mnasiadka | hrw: fixed | 09:43 |
yoctozepto | cp: https://docs.openstack.org/kolla-ansible/latest/user/quickstart.html | 09:43 |
mnasiadka | hmm, we could do content: None, instead of content: '' | 09:43 |
yoctozepto | potent enough, sir | 09:43 |
cp | all in one | 09:43 |
cp | ok | 09:43 |
hrw | mnasiadka: we could | 09:43 |
openstackgerrit | Michal Nasiadka proposed openstack/kolla-ansible master: Change local_action to delegate_to: localhost https://review.opendev.org/694959 | 09:43 |
openstackgerrit | Michal Nasiadka proposed openstack/kolla-ansible master: Change local_action to delegate_to: localhost https://review.opendev.org/694959 | 09:44 |
mnasiadka | we did | 09:44 |
mnasiadka | :) | 09:44 |
hrw | mnasiadka: /home/hrw/devel/linaro/kolla-ansible/ansible/roles/common/tasks/config.yml:67: [E504] Do not use 'local_action', use 'delegate_to: localhost' | 09:44 |
cp | in the end I want to run ironic | 09:45 |
cp | on it | 09:45 |
mnasiadka | hrw: https://review.opendev.org/#/c/694815/2 | 09:47 |
patchbot | patch 694815 - kolla-ansible - Fix local_action and line_length>160 in common role - 2 patch sets | 09:47 |
hrw | mnasiadka: commented linter patch | 09:47 |
mgoddard | cp: sorry to hear you struggled with kayobe. It's a newer project, so will have a few more bumps than kolla ansible still | 09:48 |
mnasiadka | hrw: well, tox -e linters is still easy to run, no? :) | 09:49 |
mgoddard | cp: I haven't tried a universe from nothing for a little while, apart from some work to port it to stein. (It currently deploys rocky) | 09:49 |
hrw | mnasiadka: sure. if you remember that while running tools/ansible-lint.sh ;D | 09:49 |
mnasiadka | hrw: we can check for tox vars existence in env, and if not - direct the user to run tox :D | 09:50 |
hrw | mnasiadka: easier to just set vars ;D | 09:50 |
mgoddard | cp: kolla ansible will release train soon - it is quite stable. Kayobe master branch will deploy train after we merge this patch: https://review.opendev.org/694616 | 09:50 |
patchbot | patch 694616 - kayobe - Use OpenStack Train release - 1 patch set | 09:50 |
mgoddard | cp: then we are on the road to release | 09:50 |
mnasiadka | hrw: might be ;) | 09:51 |
mgoddard | duksoo: hello. thank you for your interest in kayobe. Please let me know if there is anything I can help with about kayobe | 09:52 |
duksoo | thx :) | 09:59 |
*** gfidente has joined #openstack-kolla | 09:59 | |
*** duksoo has quit IRC | 10:01 | |
mgoddard | cp: when you say you want to run ironic, do you mean for the compute instances? i.e. allow users access to bare metal? | 10:03 |
*** zhanglong has quit IRC | 10:03 | |
*** jovial[m] has joined #openstack-kolla | 10:08 | |
openstackgerrit | Merged openstack/kolla-ansible stable/train: Attempt to pull image before stopping and removing container https://review.opendev.org/694812 | 10:16 |
openstackgerrit | Merged openstack/kolla-ansible stable/stein: Attempt to pull image before stopping and removing container https://review.opendev.org/694813 | 10:16 |
openstackgerrit | Merged openstack/kolla-ansible stable/rocky: Attempt to pull image before stopping and removing container https://review.opendev.org/694814 | 10:16 |
*** msalo_ has quit IRC | 10:28 | |
*** msalo has joined #openstack-kolla | 10:28 | |
*** msalo has quit IRC | 10:33 | |
mnasiadka | yoctozepto: najlepszego! | 10:36 |
*** msalo has joined #openstack-kolla | 10:36 | |
*** dpawlik has quit IRC | 10:45 | |
yoctozepto | mnasiadka: dzięki! :D | 10:51 |
hrw | mnasiadka: E204 (>160 chars) are tricky bastards ;D | 10:51 |
hrw | url: "{{ internal_protocol }}://{{ kolla_internal_vip_address | put_address_in_context('url') }}:{{ monasca_grafana_server_port }}/api/orgs/name/{{ monasca_grafana_control_plane_org }}" | 10:51 |
mnasiadka | url: | and go multiline | 10:51 |
hrw | url: | | 10:52 |
hrw | {{ internal_protocol }}://{{ kolla_internal_vip_address | put_address_in_context('url') }}: | 10:52 |
hrw | {{ monasca_grafana_server_port }}/api/orgs/name/{{ monasca_grafana_control_plane_org }} | 10:52 |
hrw | way? | 10:52 |
mgoddard | hrw: url: >- | 11:02 |
hrw | thx | 11:02 |
mgoddard | ignores line breaks and whitespace | 11:02 |
mgoddard | but please verify that these changes work | 11:02 |
mgoddard | otherwise better to leave it | 11:02 |
hrw | mgoddard: sure | 11:03 |
mgoddard | chances of introducing a bug by fixing ansible-lint issues > chances of fixing a bug by making ansible-lint happy | 11:03 |
mgoddard | IMO :) | 11:03 |
hrw | yep | 11:04 |
openstackgerrit | Merged openstack/kolla-ansible master: Fix local_action and line_length>160 in common role https://review.opendev.org/694815 | 11:14 |
openstackgerrit | Merged openstack/kolla-ansible master: Use internal API for heat -> keystone communication https://review.opendev.org/694666 | 11:14 |
openstackgerrit | Radosław Piliszek proposed openstack/kolla-ansible stable/train: Use internal API for heat -> keystone communication https://review.opendev.org/694985 | 11:21 |
openstackgerrit | Radosław Piliszek proposed openstack/kolla-ansible stable/stein: Use internal API for heat -> keystone communication https://review.opendev.org/694986 | 11:21 |
openstackgerrit | Marcin Juszkiewicz proposed openstack/kolla-ansible master: Some ansible-lint fixes https://review.opendev.org/694797 | 11:28 |
*** dpawlik has joined #openstack-kolla | 11:30 | |
*** hjensas has joined #openstack-kolla | 11:31 | |
*** jschlueter has joined #openstack-kolla | 11:35 | |
*** Chaserjim has quit IRC | 12:07 | |
*** Chaserjim has joined #openstack-kolla | 12:07 | |
hrw | mnasiadka: I have a fix for your local_action failure ;d | 12:17 |
mnasiadka | hrw: was busy with something else, feel free to fix :) | 12:17 |
*** goldyfruit has joined #openstack-kolla | 12:18 | |
openstackgerrit | Marcin Juszkiewicz proposed openstack/kolla-ansible master: Change local_action to delegate_to: localhost https://review.opendev.org/694959 | 12:18 |
hrw | mnasiadka: command:\ncmd: broke it | 12:18 |
hrw | mnasiadka: so I added handling of it | 12:19 |
*** kplant has joined #openstack-kolla | 12:25 | |
*** dpawlik has quit IRC | 12:28 | |
*** dpawlik has joined #openstack-kolla | 12:31 | |
hrw | mnasiadka: passed pep8. | 12:35 |
*** dave-mccowan has joined #openstack-kolla | 12:35 | |
hrw | "msg": "unlinking failed: [Errno 1] Operation not permitted: '/tmp/kolla_keepalived_running' ", | 12:41 |
hrw | hm. | 12:41 |
hrw | mnasiadka: file got cleared, created and fails on removing. fun | 12:42 |
openstackgerrit | Pierre Riteau proposed openstack/kayobe master: Add note to docs about overcloud node names being required https://review.opendev.org/693735 | 12:52 |
*** dabukalam has joined #openstack-kolla | 12:53 | |
hrw | [581762.246492] FS-Cache: Duplicate cookie detected | 12:57 |
hrw | ~curse fscache | 12:57 |
mnasiadka | hrw: so maybe we need become :D | 12:57 |
hrw | mnasiadka: ;d | 12:58 |
*** gfidente has quit IRC | 12:59 | |
openstackgerrit | Michal Nasiadka proposed openstack/kolla-ansible master: CI: Add ansible-lint to tox https://review.opendev.org/694779 | 13:05 |
openstackgerrit | Michal Nasiadka proposed openstack/kolla-ansible master: CI: Add ansible-lint to tox https://review.opendev.org/694779 | 13:05 |
openstackgerrit | Merged openstack/kayobe master: Add note to docs about overcloud node names being required https://review.opendev.org/693735 | 13:08 |
*** goldyfruit has quit IRC | 13:08 | |
*** msalo has quit IRC | 13:09 | |
*** msalo has joined #openstack-kolla | 13:09 | |
mnasiadka | mgoddard: come on, it's the beginning of a new cycle, we need to break something :) | 13:13 |
*** msalo has quit IRC | 13:14 | |
*** skramaja has quit IRC | 13:16 | |
*** hamzy has quit IRC | 13:19 | |
kplant | anything i need to do to get https://review.opendev.org/#/c/694294 and https://review.opendev.org/#/c/694293 merged? | 13:24 |
patchbot | patch 694294 - kolla-ansible (stable/stein) - Add support for custom HAProxy service config - 1 patch set | 13:24 |
patchbot | patch 694293 - kolla-ansible (stable/train) - Add support for custom HAProxy service config - 1 patch set | 13:24 |
*** kplant has quit IRC | 13:27 | |
*** kplant has joined #openstack-kolla | 13:32 | |
osmanlicilegi | kplant: backporting features are not allowed but it doesn't have strict rules. let cores decide what to do :] | 13:41 |
osmanlicilegi | kplant: btw, this is a good feature and should be bacpkorted imho. it won't break existing deployments. | 13:41 |
mnasiadka | mgoddard: what the PTL says on ^^ ? :) | 13:42 |
*** msalo has joined #openstack-kolla | 13:42 | |
kplant | yeah i do know that's generally the rule, i thought a few of us agreed this would be okay a week or two ago | 13:43 |
*** sri_ has quit IRC | 13:45 | |
mnasiadka | kplant: I was not part of agreeing, so that's why I'm asking mgoddard | 13:46 |
*** vmixor has joined #openstack-kolla | 13:48 | |
kplant | yeah, totally. i'd rather not break the rules with buy-in :-) | 13:49 |
kplant | without* | 13:49 |
vmixor | Hi | 13:52 |
vmixor | May I ask for reassgniment of custom paste file blueprint (https://blueprints.launchpad.net/kolla-ansible/+spec/custom-paste) to myself? | 13:54 |
openstackgerrit | Marcin Juszkiewicz proposed openstack/kolla-ansible master: Change local_action to delegate_to: localhost https://review.opendev.org/694959 | 13:55 |
hrw | vmixor: give me your launchpad id and reason? | 13:55 |
hrw | mnasiadka: added become | 13:56 |
vmixor | hrw: https://launchpad.net/~viktormichalek and reason is that Ondrej does not work on this anymore | 13:57 |
hrw | vmixor: it is yours now | 13:58 |
vmixor | hrw: thanks! | 13:58 |
hrw | yw | 13:58 |
hrw | vmixor: any core can reassign. just launchpad id and reason is needed | 13:59 |
*** luksky has quit IRC | 14:02 | |
mgoddard | mnasiadka, kplant: on this occasion I'll +2. I don't want us to get into the habit of backporting features though - stable should be stable. | 14:05 |
mnasiadka | mgoddard: well, if kplant would not tell us it was sort of preapproved - I wanted to go -1 :D | 14:09 |
kplant | thanks guys :-) | 14:14 |
*** gfidente has joined #openstack-kolla | 14:14 | |
*** msalo has quit IRC | 14:15 | |
hrw | mnasiadka: looks like haproxy precheck needs rethinking... | 14:17 |
yoctozepto | let's make stable stable but not stabler -wiseman | 14:18 |
hrw | yoctozepto: you are kind. but german kids are kinder ;d (could not resist) | 14:19 |
*** goldyfruit has joined #openstack-kolla | 14:19 | |
kplant | der kinder! | 14:19 |
kplant | (der? das?) i don't know german | 14:20 |
hrw | mnasiadka: probably found ;D | 14:20 |
openstackgerrit | Marcin Juszkiewicz proposed openstack/kolla-ansible master: Change local_action to delegate_to: localhost https://review.opendev.org/694959 | 14:21 |
hrw | mnasiadka: added missing delegate_to ;D | 14:21 |
mnasiadka | yoctozepto: stabler sounds like german horses stable | 14:21 |
mnasiadka | hrw: too many delegate_to :) | 14:21 |
hrw | mnasiadka: too less ;D | 14:21 |
yoctozepto | kplant: it's plural so: die Kinder | 14:22 |
yoctozepto | das Kind i guess | 14:22 |
openstackgerrit | Marcin Juszkiewicz proposed openstack/kolla-ansible master: Change local_action to delegate_to: localhost https://review.opendev.org/694959 | 14:24 |
hrw | mnasiadka: and two more | 14:24 |
*** goldyfruit_ has joined #openstack-kolla | 14:28 | |
*** goldyfruit has quit IRC | 14:30 | |
openstackgerrit | Marcin Juszkiewicz proposed openstack/kolla-ansible master: CI: Switch to Ussuri jobs and drop py27 one https://review.opendev.org/695008 | 14:34 |
*** msalo has joined #openstack-kolla | 14:34 | |
openstackgerrit | Niklas Hagman proposed openstack/kolla-ansible master: OpenStack cloud administration authentication. Used by services to register themself into keystone with system wide permission. https://review.opendev.org/692179 | 14:50 |
hrw | mnasiadka: gets further. now fails at mariadb ;D | 14:52 |
Blinkiz | I have not committed before to opendev.org so I might have done something wrong in my update of 692179 | 14:53 |
Blinkiz | Always a first time :-) | 14:55 |
hrw | Blinkiz: for sure commit message needs work ;D | 15:00 |
*** msalo has quit IRC | 15:02 | |
noxoid | curious if im going crazy. according to https://www.rabbitmq.com/which-erlang.html rabbitmq 3.7.10 (which stein runs) requires a minimum of erlang/otp 20.3.x. the version reported by the cluster is Erlang/OTP 19 | 15:06 |
noxoid | am i missing something? | 15:06 |
*** Chaserjim has quit IRC | 15:08 | |
mgoddard | Blinkiz: well done for navigating gerrit & gitreview :) | 15:10 |
*** dpawlik has quit IRC | 15:11 | |
Blinkiz | mgoddard: Thank you | 15:11 |
osmanlicilegi | cores, please reassign https://blueprints.launchpad.net/kolla/+spec/elasticsearch-kibana-version-upgrade to me. | 15:14 |
openstackgerrit | Merged openstack/kolla-ansible stable/stein: Add support for custom HAProxy service config https://review.opendev.org/694294 | 15:16 |
yoctozepto | noxoid: happens, it works in general, but now we are upgrading it in ussuri | 15:21 |
*** markmcclain has quit IRC | 15:21 | |
openstackgerrit | Merged openstack/kolla-ansible stable/train: Add support for custom HAProxy service config https://review.opendev.org/694293 | 15:21 |
noxoid | hm kk. was hoping to find an explanation for my rabbitmq issues | 15:21 |
noxoid | thanks | 15:21 |
*** markmcclain has joined #openstack-kolla | 15:23 | |
noxoid | weird. replaced erlang with https://bintray.com/rabbitmq-erlang/rpm/erlang and restarted rabbitmq. the health checks started passing. /shrug | 15:31 |
hrw | osmanlicilegi: launchpadid and reason? | 15:36 |
hrw | osmanlicilegi: assigned | 15:36 |
*** ivve has quit IRC | 15:37 | |
*** kplant has quit IRC | 15:43 | |
*** kplant has joined #openstack-kolla | 15:44 | |
*** pcaruana has quit IRC | 15:50 | |
*** pcaruana has joined #openstack-kolla | 15:51 | |
yoctozepto | noxoid: could you share some more details | 15:53 |
yoctozepto | we might want to fix that before train is released | 15:53 |
noxoid | i REALLY wish i could but its somewhat hard to describe/troubleshoot. in short i do rolling restarts of the 3 rabbitmq servers in order to upgrade docker. all of them restart fine and cluster_status reports everything is healthy but if you go to individual nodes and run node_health_check some will sporadically report: Error: operation node_health_check on node rabbit@ash-sys-pro-osctrl3 timed out. Timeout value used: 70000 | 15:55 |
noxoid | maybe_stuck will occasionally report stuck processes | 15:56 |
noxoid | nova reports 2019-11-19 09:59:48.568 6 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on 10.101.0.3:5672 after inf tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'compute.ash-sys-pro-osnode4' in vhost '/' due to timeout | 15:56 |
*** msalo has joined #openstack-kolla | 15:56 | |
kplant | i ran into that when i had to restart docker daemons to update trusted CAs | 15:57 |
yoctozepto | Hmm | 15:57 |
kplant | rabbitmq took a dump until i rebooted nodes | 15:57 |
noxoid | in the past ive managed to get it working again by just restarting rabbitmq/openstack services until it decides to work | 15:57 |
yoctozepto | And does erlang upgrade help? | 15:57 |
noxoid | so thats the thing | 15:57 |
noxoid | in the past restarting rabbitmq once or twice on each node fixed it. this time it didnt | 15:57 |
noxoid | however after upgrading erlang and restarting it did | 15:58 |
noxoid | so it could be the erlang upgrade, or i couldve just gotten unlucky | 15:58 |
yoctozepto | could you link to the min req version info? | 15:58 |
noxoid | side note: happened with both pause_minority and the autoheal method | 15:58 |
noxoid | https://www.rabbitmq.com/which-erlang.html ? | 15:58 |
yoctozepto | maybe they were loose with packages deps up to 3.7.10 | 15:58 |
noxoid | technically the erlang version im running is newer than the max supported for 3.7.10 | 15:59 |
yoctozepto | Hmm | 15:59 |
yoctozepto | So indeed it looks like they forgot to set min req in packafe | 15:59 |
yoctozepto | Package* | 16:00 |
yoctozepto | Ah, might explain infrequent rmq hiccups in ci too | 16:00 |
yoctozepto | noxoid: raise a bug report please | 16:00 |
noxoid | you got it | 16:00 |
noxoid | give me a few | 16:00 |
yoctozepto | for kolla | 16:00 |
kplant | nice find | 16:00 |
yoctozepto | Thx | 16:01 |
yoctozepto | And yeah, nice find | 16:01 |
noxoid | https://bugs.launchpad.net/kolla/+bug/1853167 | 16:13 |
openstack | Launchpad bug 1853167 in kolla "CentOS RabbitMQ Unsupported Erlang Version" [Undecided,New] | 16:13 |
vmixor | May I also ask for abandon of https://review.opendev.org/#/c/678544/ ? | 16:23 |
patchbot | patch 678544 - kolla-ansible - Corrected notifications for auditing. - 14 patch sets | 16:23 |
openstackgerrit | Viktor Michalek proposed openstack/kolla-ansible master: Adds support of CADF notifying for other APIs next to keystone. https://review.opendev.org/674579 | 16:24 |
mnasiadka | hrw: I'll look into that | 16:32 |
*** msalo has quit IRC | 16:40 | |
openstackgerrit | Michal Nasiadka proposed openstack/kolla-ansible master: Change local_action to delegate_to: localhost https://review.opendev.org/694959 | 16:42 |
mnasiadka | hrw: seems content: '' was on purpose ;) | 16:42 |
*** msalo has joined #openstack-kolla | 16:44 | |
*** msalo_ has joined #openstack-kolla | 16:47 | |
*** msalo has quit IRC | 16:47 | |
*** msalo_ has quit IRC | 16:48 | |
*** msalo has joined #openstack-kolla | 16:48 | |
*** msalo has quit IRC | 16:53 | |
*** msalo has joined #openstack-kolla | 16:54 | |
*** msalo has quit IRC | 16:57 | |
*** msalo has joined #openstack-kolla | 16:58 | |
openstackgerrit | Viktor Michalek proposed openstack/kolla-ansible master: Adds support of CADF notifying for other APIs next to keystone. https://review.opendev.org/674579 | 17:00 |
hrw | mnasiadka: ;D | 17:03 |
hrw | mnasiadka: added comment? | 17:03 |
mnasiadka | naah, I want CI to test if that's the case - if yes - we might leave it as is in that change, and do it nicer in a subsequent change | 17:04 |
mnasiadka | but yeah, a comment with TODO makes sense | 17:04 |
*** rpittau is now known as rpittau|afk | 17:06 | |
openstackgerrit | Viktor Michalek proposed openstack/kolla-ansible master: Adds support of CADF notifying for other APIs next to keystone. https://review.opendev.org/674579 | 17:07 |
*** msalo has quit IRC | 17:07 | |
*** msalo has joined #openstack-kolla | 17:12 | |
*** ivve has joined #openstack-kolla | 17:21 | |
hrw | mnasiadka: looks like it was that. | 17:22 |
*** msalo has quit IRC | 17:31 | |
mnasiadka | hrw: yep, seems so | 17:35 |
mnasiadka | hrw: I'll let it pass (Zuul) and then add the TODO comment | 17:36 |
hrw | +2 | 17:36 |
*** gfidente has quit IRC | 17:36 | |
*** msalo has joined #openstack-kolla | 17:37 | |
vmixor | hrw: May I also ask for abandon of https://review.opendev.org/#/c/678544/ ? | 17:44 |
patchbot | patch 678544 - kolla-ansible - Corrected notifications for auditing. - 14 patch sets | 17:44 |
hrw | done | 17:45 |
*** cah_link has quit IRC | 17:46 | |
vmixor | hrw: thanks | 17:46 |
hrw | yw | 17:46 |
*** munimeha1 has joined #openstack-kolla | 17:49 | |
openstackgerrit | Mark Goddard proposed openstack/kolla-ansible stable/rocky: Patch to fix RPC selection problem after upgrade https://review.opendev.org/693505 | 17:50 |
*** igordc has joined #openstack-kolla | 17:52 | |
openstackgerrit | Mark Goddard proposed openstack/kolla-ansible stable/stein: Patch to fix RPC selection problem after upgrade https://review.opendev.org/695049 | 17:54 |
openstackgerrit | Viktor Michalek proposed openstack/kolla-ansible master: Support for custom paste files https://review.opendev.org/695054 | 18:01 |
*** msalo has quit IRC | 18:02 | |
*** jovial[m] has quit IRC | 18:08 | |
*** dougsz has quit IRC | 18:10 | |
yoctozepto | mgoddard: https://bugs.launchpad.net/kolla/+bug/1853167 <- I suggest at least releasing the version for train since we have not released final, not sure about stein, feels abrupt but if it upgrades fine to train then stein->stein should be ok too | 18:13 |
openstack | Launchpad bug 1853167 in kolla ussuri "CentOS RabbitMQ Unsupported Erlang Version" [Medium,Triaged] - Assigned to Radosław Piliszek (yoctozepto) | 18:13 |
yoctozepto | raising* version | 18:13 |
*** msalo has joined #openstack-kolla | 18:16 | |
openstackgerrit | Michal Nasiadka proposed openstack/kolla-ansible master: Change local_action to delegate_to: localhost https://review.opendev.org/694959 | 18:22 |
*** msalo has quit IRC | 18:26 | |
*** msalo has joined #openstack-kolla | 18:28 | |
*** dpawlik has joined #openstack-kolla | 18:30 | |
*** msalo has quit IRC | 18:33 | |
openstackgerrit | Merged openstack/kolla-ansible master: CI: Switch to Ussuri jobs and drop py27 one https://review.opendev.org/695008 | 19:04 |
yoctozepto | ubuntu mirror permabroken, kolla-toolbox cannot build because of libssl vs libssl-dev conflict, argh | 19:06 |
*** dpawlik has quit IRC | 19:41 | |
*** dpawlik has joined #openstack-kolla | 19:48 | |
*** jonaspaulo has joined #openstack-kolla | 19:54 | |
*** goldyfruit___ has joined #openstack-kolla | 19:55 | |
*** gmann is now known as gmann_afk | 19:57 | |
*** goldyfruit_ has quit IRC | 19:57 | |
*** msalo has joined #openstack-kolla | 19:59 | |
*** msalo has quit IRC | 20:07 | |
*** kplant has quit IRC | 20:09 | |
yoctozepto | mgoddard, priteau: ceilosca official now in ussuri: https://review.opendev.org/562400 (learnt from ml) | 20:16 |
patchbot | patch 562400 - ceilometer - publisher: Contribute the Monasca publisher (MERGED) - 24 patch sets | 20:16 |
*** dpawlik has quit IRC | 20:22 | |
*** openstackgerrit has quit IRC | 20:35 | |
*** dpawlik has joined #openstack-kolla | 20:45 | |
*** igordc has quit IRC | 20:50 | |
priteau | yoctozepto: That's good news, especially with Gnocchi being unmaintained | 20:52 |
*** goldyfruit_ has joined #openstack-kolla | 20:58 | |
*** dpawlik has quit IRC | 20:58 | |
*** goldyfruit___ has quit IRC | 21:00 | |
yoctozepto | Indeed, priteau, indeed, I will add this to kolla goals for ussuri, should be easy if it works | 21:01 |
*** gmann_afk is now known as gmann | 21:03 | |
*** igordc has joined #openstack-kolla | 21:15 | |
*** dpawlik has joined #openstack-kolla | 21:18 | |
*** dpawlik has quit IRC | 21:23 | |
*** openstackgerrit has joined #openstack-kolla | 21:40 | |
openstackgerrit | Viktor Michalek proposed openstack/kolla-ansible master: Support for custom paste files https://review.opendev.org/695054 | 21:40 |
openstackgerrit | Viktor Michalek proposed openstack/kolla master: Neutron: apply db migration for BGP dynamic routing agent https://review.opendev.org/689244 | 21:51 |
openstackgerrit | Zhuo Zhen proposed openstack/kolla-ansible master: Allow region setting for ironic-neutron-agent https://review.opendev.org/695093 | 22:02 |
*** vmixor has quit IRC | 22:03 | |
*** priteau has quit IRC | 22:15 | |
*** pcaruana has quit IRC | 22:33 | |
*** msalo has joined #openstack-kolla | 22:47 | |
*** munimeha1 has quit IRC | 22:49 | |
*** msalo has quit IRC | 22:52 | |
*** jonaspaulo has quit IRC | 23:06 | |
*** priteau has joined #openstack-kolla | 23:18 | |
*** calbers has quit IRC | 23:28 | |
*** vmixor has joined #openstack-kolla | 23:33 | |
*** calbers has joined #openstack-kolla | 23:35 | |
*** calbers has quit IRC | 23:45 | |
*** calbers has joined #openstack-kolla | 23:48 | |
*** ivve has quit IRC | 23:54 | |
*** goldyfruit_ has quit IRC | 23:59 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!