*** hamzy has quit IRC | 00:43 | |
*** hamzy has joined #openstack-ansible | 00:44 | |
*** spatel has joined #openstack-ansible | 00:59 | |
*** nicolasbock has quit IRC | 01:35 | |
*** gregoryo has joined #openstack-ansible | 01:52 | |
openstackgerrit | Agate Wang proposed openstack/openstack-ansible-os_aodh master: [Trivial Fix] Replace Chinese punctuation with English punctuation https://review.openstack.org/601140 | 02:14 |
---|---|---|
openstackgerrit | Agate Wang proposed openstack/openstack-ansible-os_ceilometer master: [Trivial Fix] Replace Chinese punctuation with English punctuation https://review.openstack.org/601146 | 02:46 |
openstackgerrit | Agate Wang proposed openstack/openstack-ansible-os_cinder master: [Trivial Fix] Replace Chinese punctuation with English punctuation https://review.openstack.org/601147 | 02:50 |
*** spatel has quit IRC | 03:13 | |
*** spatel has joined #openstack-ansible | 03:13 | |
*** spatel has quit IRC | 03:13 | |
*** dave-mccowan has quit IRC | 03:33 | |
*** udesale has joined #openstack-ansible | 03:58 | |
*** johnny101 has quit IRC | 04:00 | |
*** Bhujay has joined #openstack-ansible | 04:01 | |
*** Bhujay has quit IRC | 04:02 | |
*** johnny101 has joined #openstack-ansible | 04:02 | |
*** Bhujay has joined #openstack-ansible | 04:02 | |
*** radeks has joined #openstack-ansible | 04:36 | |
*** ethfci has joined #openstack-ansible | 04:40 | |
*** ethfci has quit IRC | 04:40 | |
*** radeks has quit IRC | 04:52 | |
*** ethfci has joined #openstack-ansible | 05:07 | |
*** shyamb has joined #openstack-ansible | 05:12 | |
*** shyamb has quit IRC | 05:17 | |
*** liangqi has quit IRC | 05:21 | |
*** threestrands has joined #openstack-ansible | 05:45 | |
*** threestrands has quit IRC | 05:45 | |
*** threestrands has joined #openstack-ansible | 05:45 | |
*** shyamb has joined #openstack-ansible | 05:56 | |
*** shyamb has quit IRC | 06:07 | |
*** shyamb has joined #openstack-ansible | 06:08 | |
*** lvdombrkr has joined #openstack-ansible | 06:20 | |
*** lvdombrkr89 has joined #openstack-ansible | 06:23 | |
*** lvdombrkr has quit IRC | 06:26 | |
*** rgogunskiy has joined #openstack-ansible | 06:31 | |
*** shyamb has quit IRC | 06:34 | |
*** shyamb has joined #openstack-ansible | 06:34 | |
*** chkumar|out is now known as chkumar|ruck | 06:40 | |
*** ppetit has joined #openstack-ansible | 06:52 | |
*** jbadiapa has joined #openstack-ansible | 06:52 | |
*** Bhujay has quit IRC | 06:52 | |
*** ppetit has quit IRC | 07:02 | |
*** olivierb has joined #openstack-ansible | 07:03 | |
*** ppetit has joined #openstack-ansible | 07:19 | |
*** Pradiprwt has joined #openstack-ansible | 07:23 | |
Pradiprwt | Hi Everyone, I am getting this issue while running neutron palybook..I have enabled OVS, http://paste.openstack.org/show/729747/ | 07:24 |
*** threestrands has quit IRC | 07:25 | |
*** pcaruana has joined #openstack-ansible | 07:31 | |
*** Bhujay has joined #openstack-ansible | 07:36 | |
*** mschuppert has joined #openstack-ansible | 07:42 | |
*** hamzaachi has joined #openstack-ansible | 07:43 | |
*** shyamb has quit IRC | 07:48 | |
*** Bhujay has quit IRC | 07:50 | |
*** Bhujay has joined #openstack-ansible | 07:51 | |
*** Bhujay has quit IRC | 07:52 | |
*** Bhujay has joined #openstack-ansible | 07:52 | |
*** lvdombrkr89 has quit IRC | 07:52 | |
*** lvdombrkr has joined #openstack-ansible | 07:53 | |
*** mbuil_ has joined #openstack-ansible | 07:57 | |
*** mbuil is now known as mbuil_ | 07:58 | |
*** DanyC has joined #openstack-ansible | 08:14 | |
*** electrofelix has joined #openstack-ansible | 08:54 | |
*** lvdombrkr89 has joined #openstack-ansible | 08:57 | |
*** lvdombrkr has quit IRC | 09:00 | |
openstackgerrit | Merged openstack/openstack-ansible-os_blazar stable/rocky: Remove blazar_requirements_git_* vars https://review.openstack.org/601070 | 09:03 |
*** gregoryo has quit IRC | 09:06 | |
*** shyamb has joined #openstack-ansible | 09:09 | |
*** noonedeadpunk has joined #openstack-ansible | 09:14 | |
*** radeks has joined #openstack-ansible | 09:28 | |
*** radeks_ has joined #openstack-ansible | 09:29 | |
*** radeks has quit IRC | 09:33 | |
openstackgerrit | Merged openstack/openstack-ansible-os_keystone master: Set default ssl protocols according to used webserver https://review.openstack.org/567746 | 09:34 |
*** radeks__ has joined #openstack-ansible | 09:37 | |
*** radeks_ has quit IRC | 09:39 | |
*** radeks_ has joined #openstack-ansible | 09:41 | |
*** radeks__ has quit IRC | 09:44 | |
*** suggestable has joined #openstack-ansible | 10:03 | |
suggestable | Good morning | 10:04 |
noonedeadpunk | morning | 10:04 |
suggestable | Is anyone able to help with Swift not deploying on stable/queens? | 10:04 |
noonedeadpunk | unfortunatelly, I have no experience with swift, and all cores most likely are on PTG | 10:05 |
suggestable | PTG? | 10:05 |
noonedeadpunk | https://www.openstack.org/ptg/ | 10:05 |
suggestable | Ahh. OK. | 10:06 |
*** hamzaachi_ has joined #openstack-ansible | 10:14 | |
*** hamzaachi has quit IRC | 10:16 | |
andymccr | suggestable, what's the issue? | 10:19 |
suggestable | Hi andymccr. When the playbook reaches os_swift: Copy swift config, it fails. | 10:20 |
andymccr | suggestable, do you have a log available? | 10:20 |
suggestable | Error from the playbook run is: "FAILED! => {"failed": true, "msg": "'None' has no attribute 'index'"}" for every occurrence. | 10:20 |
noonedeadpunk | with what error? Can you paste it? | 10:20 |
noonedeadpunk | looks like problem with some veriable, which is undefined... | 10:21 |
noonedeadpunk | *variable | 10:21 |
andymccr | suggestable, which task is it that fails in the run? it should say like [os_swift] Run this task - at the top of the bit where it fails | 10:22 |
suggestable | OK. Is there a doc somewhere that explains exactly what it's looking for in the swift.yml file? | 10:22 |
andymccr | or if possible, paste a larger portion of the log to like paste.openstack.org or something | 10:22 |
suggestable | TASK [os_swift : Copy swift config] | 10:23 |
andymccr | suggestable, can you paste your swift.yml to paste.openstack.org or a similar paste site? | 10:24 |
suggestable | andymccr: sure. Give me a moment. | 10:26 |
andymccr | suggestable, based on the template files being copied it has to be the storage policies configuraiton - probably just a typo/format issue. we can confirm though. im trying to find a doc on the swift bits for reference | 10:28 |
suggestable | http://paste.openstack.org/show/D9TnM23EfVBRmu8Iw1wm/ | 10:29 |
andymccr | ahh yeah | 10:29 |
andymccr | just indent them slightly | 10:29 |
andymccr | https://github.com/openstack/openstack-ansible/blob/master/etc/openstack_deploy/conf.d/swift.yml.example#L227-L244 | 10:30 |
andymccr | so after policy: add 2 spaces for all the other settings. | 10:30 |
*** shyamb has quit IRC | 10:30 | |
suggestable | Argh! Why is Ansible so fussy with indentation? | 10:30 |
andymccr | yaml - yeah :( but its like a list (the -'s) and then an item in the list which has attributes | 10:31 |
noonedeadpunk | is more about yaml actually) the same thing with python, to be honest | 10:31 |
andymccr | that specifically is probably not the optimum design but changing it at this point would make all existing deploys break | 10:31 |
andymccr | (so probably my bad for doing it that way!) | 10:32 |
*** dave-mccowan has joined #openstack-ansible | 10:32 | |
andymccr | suggestable, but yeah give that a go hopefully it'll work out ok this time! tl;dr for how i debugged it - the error says its missing an atribute called index in one of 3 possible template files, so i checked the template files and fortunately only one bit has a .index which is the storage_policies. | 10:33 |
suggestable | andymccr, phew! OK. I'm trying to make that change now and then we will see if it works. | 10:34 |
suggestable | Thank you! | 10:34 |
andymccr | no problem! | 10:35 |
*** Bhujay has quit IRC | 10:45 | |
*** jamesdenton has quit IRC | 10:52 | |
*** hwoarang has quit IRC | 11:00 | |
*** hwoarang has joined #openstack-ansible | 11:03 | |
*** FuzzyFerric has joined #openstack-ansible | 11:06 | |
*** shyamb has joined #openstack-ansible | 11:18 | |
*** hwoarang has quit IRC | 11:21 | |
*** hwoarang has joined #openstack-ansible | 11:24 | |
*** udesale has quit IRC | 11:26 | |
*** radeks_ has quit IRC | 11:30 | |
kaiokmo | mornings | 11:32 |
noonedeadpunk | morning kaiokmo | 11:33 |
smoke87 | morning | 11:35 |
*** shyamb has quit IRC | 11:36 | |
mnaser | o/ | 11:38 |
suggestable | andymccr, Thank you! That indentation change has allowed Swift to build successfully! | 11:42 |
suggestable | The next issue I'm facing is: | 11:42 |
suggestable | TASK [os_tempest : Gather variables for each operating system] | 11:42 |
suggestable | fatal: [os-controller3_utility_container-267379bf]: FAILED! => {"failed": true, "msg": "No file was found when using with_first_found. Use the 'skip: true' option to allow this task to be skipped if no files are found"} | 11:42 |
andymccr | suggestable, hmm thats odd - that task will find the correct vars file in os_tempst/vars/ that matches your distro - what distro are you using? | 11:43 |
noonedeadpunk | have you ran lxc_destroy of the container before? | 11:44 |
suggestable | Ubuntu 16.04 | 11:44 |
*** shyamb has joined #openstack-ansible | 11:44 | |
suggestable | noonedeadpunk, I've run lxc_destroy multiple times in the past when deployments have failed. | 11:44 |
smoke87 | suggestable. Hey I got this error too one time | 11:45 |
noonedeadpunk | have you added lxc_hosts while containers creation to the --limit list of the hosts? | 11:45 |
smoke87 | Check nyloc messages in irc log: http://eavesdrop.openstack.org/irclogs/%23openstack-ansible/%23openstack-ansible.2017-05-09.log.html | 11:45 |
suggestable | noonedeadpunk, I haven't used --limit. | 11:46 |
suggestable | I'm trying to complete my first osa deployment. | 11:46 |
*** radeks_ has joined #openstack-ansible | 11:47 | |
*** lvdombrkr89 has quit IRC | 11:48 | |
andymccr | suggestable, try running the os-tempest-install.yml and see if that does the trick too. it looks like perhaps the facts arent generated proprely there | 11:48 |
suggestable | Will do. | 11:48 |
*** lvdombrkr has joined #openstack-ansible | 11:48 | |
smoke87 | hey guys, Do you know why when create orchestration's(heat) containers.. the container have no interfaces? | 11:49 |
smoke87 | *containers | 11:49 |
admin0 | smoke87, you have to define it in the yml | 11:51 |
admin0 | sorry .. | 11:51 |
*** ansmith has quit IRC | 11:51 | |
smoke87 | In the openstack_user_config.yml I added: | 11:52 |
smoke87 | # heat | 11:52 |
smoke87 | orchestration_hosts: *infrastructure_hosts | 11:52 |
*** lvdombrkr89 has joined #openstack-ansible | 11:52 | |
*** lvdombrkr has quit IRC | 11:52 | |
*** jamesdenton has joined #openstack-ansible | 11:52 | |
smoke87 | When I run the lxc-containers-create.yml playbook.. the containers are created with no interfaces just lo | 11:53 |
smoke87 | so it fail in "Execute first script" step | 11:53 |
*** ppetit has quit IRC | 11:54 | |
suggestable | andymccr, It seems that running the tempest playbook manually has helped, but now it's failing to upload the Cirros image to Glance. | 11:54 |
suggestable | Glance on this deployment is configured to be backed by Cinder, which is using an EMC Unity SAN as its backend. | 11:55 |
andymccr | suggestable, hmm ok that sounds more legitimate as an issue. | 11:55 |
admin0 | smoke87, .. lxc-attach and then ip link to see if its defined or not | 11:56 |
andymccr | is the cinder backend working properly? i've not really played around with that before | 11:56 |
suggestable | andymccr, Not entirely sure how to verify that. Is it straightforward? | 11:56 |
andymccr | suggestable, you could try an openstack volume create or similar command from the utility host (remember to source /root/openrc). | 11:57 |
admin0 | suggestable, config where you are using glance -> cinder backend ? | 11:57 |
andymccr | i imagine if glance cant create images on the backend then tempest will fail to upload images :) | 11:57 |
suggestable | admin0, in user_variables.yml: glance_default_store: cinder | 11:59 |
admin0 | and when you upload images, what does the glance logs say ? | 11:59 |
*** lvdombrkr has joined #openstack-ansible | 11:59 | |
admin0 | on why they fail | 11:59 |
*** lvdombrkr89 has quit IRC | 12:01 | |
suggestable | admin0, Do you have any pointers for where to actually find the logs? This is my first time using LXC containers. | 12:02 |
*** ppetit has joined #openstack-ansible | 12:03 | |
smoke87 | root@openstack-01_heat_api_container-5a45e124:/# ip link | 12:04 |
smoke87 | 1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN mode DEFAULT group default qlen 1 | 12:04 |
smoke87 | link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 | 12:04 |
smoke87 | suggestable the log path is: /openstack/logs | 12:05 |
smoke87 | sorry /openstack/log | 12:05 |
admin0 | when you upload a glane image, you get a id .. copy that id .. login to your rsyslog container .. cd /var/log/log-storage .. then grep -ri uuid * | 12:06 |
suggestable | If it helps, these are the two errors I received while running the playbook: | 12:08 |
suggestable | failed: [os-controller3_utility_container-267379bf] (item={u'url': u'http://download.cirros-cloud.net/0.3.5/cirros-0.3.5-x86_64-disk.img', u'checksum': u'sha256:e137062a4dfbb4c225971b67781bc52183d14517170e16a3841d16f962ae7470', u'name': u'cirros', u'format': u'qcow2'}) => {"attempts": 5, "changed": false, "extra_data": null, "failed": true, "item": {"checksum": "sha256:e137062a4dfbb4c225971b67781bc521 | 12:08 |
suggestable | 83d14517170e16a3841d16f962ae7470", "format": "qcow2", "name": "cirros", "url": "http://download.cirros-cloud.net/0.3.5/cirros-0.3.5-x86_64-disk.img"}, "msg": "(500) Server Error for url: http://10.10.16.2:9292/v2/images/95eae66f-0556-42bb-865a-c10d2eaf37f2/file Internal Server Error"} | 12:08 |
suggestable | and | 12:08 |
suggestable | failed: [os-controller3_utility_container-267379bf] (item={u'url': u'http://download.cirros-cloud.net/0.3.5/cirros-0.3.5-x86_64-disk.img', u'checksum': u'sha256:e137062a4dfbb4c225971b67781bc52183d14517170e16a3841d16f962ae7470', u'name': u'cirros', u'format': u'qcow2'}) => {"attempts": 5, "changed": false, "extra_data": null, "failed": true, "item": {"checksum": "sha256:e137062a4dfbb4c225971b67781bc521 | 12:08 |
suggestable | 83d14517170e16a3841d16f962ae7470", "format": "qcow2", "name": "cirros", "url": "http://download.cirros-cloud.net/0.3.5/cirros-0.3.5-x86_64-disk.img"}, "msg": "Image creation failed: Unable to establish connection to http://10.10.16.2:9292/v2/images/78dfc459-a649-4fc4-9a09-1360ef92306c/file: ('Connection aborted.', error(32, 'Broken pipe'))"} | 12:08 |
admin0 | don't paste here .. use pastebin | 12:09 |
admin0 | check if you can create volumes from horizon | 12:12 |
admin0 | suggestable, lxc has nothing to do with your errors .. it is just used to keep the apis more managable | 12:13 |
*** lvdombrkr89 has joined #openstack-ansible | 12:16 | |
smoke87 | admin0, the output of ip link: http://paste.openstack.org/show/729760/ | 12:16 |
smoke87 | Thanks for your help! | 12:16 |
*** lvdombrkr has quit IRC | 12:17 | |
suggestable | admin0, cinder-volume is showing as down on all three storage nodes. | 12:18 |
*** hamzaachi_ has quit IRC | 12:21 | |
*** nicolasbock has joined #openstack-ansible | 12:26 | |
admin0 | suggestable, you need to fix that first | 12:26 |
admin0 | get cinder up, and make sure you can create volumes without error5s | 12:27 |
admin0 | errors .. | 12:27 |
admin0 | smoke87, paste your full config somewhere | 12:28 |
admin0 | is this for all containers or just heat | 12:28 |
admin0 | suggestable, and if you have issues or get overwhelmed with logs, shut down 2x cinder containers .. keep only one running .. and then from the log container tail -f *cinder*/* | 12:31 |
admin0 | so see logs | 12:31 |
*** shyamb has quit IRC | 12:34 | |
*** olivierb has quit IRC | 12:46 | |
*** olivierb has joined #openstack-ansible | 12:47 | |
openstackgerrit | Valentin Boucher proposed openstack/openstack-ansible-os_nova master: Compute: Enable vGPU in Nova if exist on the host https://review.openstack.org/597183 | 12:47 |
smoke87 | admin0, just heat | 12:54 |
smoke87 | I'm adding heat to the infrastructure | 12:55 |
*** ansmith has joined #openstack-ansible | 12:59 | |
mgariepy | good morning everyone | 13:00 |
smoke87 | morning | 13:06 |
*** nicolasbock has quit IRC | 13:06 | |
*** radeks_ has quit IRC | 13:12 | |
*** radeks_ has joined #openstack-ansible | 13:14 | |
*** spatel has joined #openstack-ansible | 13:17 | |
*** spatel_ has joined #openstack-ansible | 13:18 | |
*** hamzaachi_ has joined #openstack-ansible | 13:19 | |
*** spatel has quit IRC | 13:22 | |
*** rgogunskiy has quit IRC | 13:34 | |
*** goldenfri has joined #openstack-ansible | 13:37 | |
*** canori01 has joined #openstack-ansible | 13:41 | |
*** hamzaachi_ has quit IRC | 13:44 | |
*** hamzaachi has joined #openstack-ansible | 13:45 | |
*** spatel_ has quit IRC | 13:46 | |
olivierb | Good morning everyone. I have a set of machines which are working perfectly fine until end of OSA queens deployment where some (but not all) of them do not answer to commands like ansible MACH1 -i inventory -m setup | 13:48 |
olivierb | it appears that only the setup module is impacted (tried ping, shell, command, ...) as I can get other commands to succeed | 13:48 |
olivierb | any clue on why this happens and how to fix/investigate this ? | 13:48 |
*** goldenfri has quit IRC | 13:48 | |
olivierb | please also note that I also still have administrative ssh access to the machines | 13:48 |
*** goldenfri has joined #openstack-ansible | 13:53 | |
*** markvoelker has joined #openstack-ansible | 13:54 | |
*** goldenfri has quit IRC | 13:57 | |
*** markvoelker has quit IRC | 13:59 | |
*** spatel has joined #openstack-ansible | 14:02 | |
*** markvoelker has joined #openstack-ansible | 14:06 | |
*** spatel has quit IRC | 14:12 | |
*** markvoelker has quit IRC | 14:21 | |
olivierb | in fact digging a little bit more into this, seems like it finishes to return (after 1 mn or more) which is unusual and number of tap devices on infra nodes keeps growing constanty: ~ 10 new itfs per minute | 14:22 |
*** markvoelker has joined #openstack-ansible | 14:23 | |
mgariepy | olivierb, it is a new deployment or an upgrade? | 14:27 |
olivierb | brand new deployment | 14:27 |
*** Leo_m has joined #openstack-ansible | 14:29 | |
*** goldenfri has joined #openstack-ansible | 14:32 | |
*** radeks_ has quit IRC | 14:40 | |
*** skiedude has joined #openstack-ansible | 14:42 | |
ppetit | Hi there! | 14:42 |
mgariepy | olivierb, do you know what is spawning the interface? | 14:43 |
olivierb | currently trying to dig into this but suspecting one the the centos network script run post veth12 for br-vlan | 14:45 |
*** hamzaachi_ has joined #openstack-ansible | 14:49 | |
*** hamzaachi has quit IRC | 14:50 | |
*** lvdombrkr89 has quit IRC | 14:54 | |
*** priteau has joined #openstack-ansible | 14:54 | |
ppetit | Something strange his happening in my OSA deployment... Several character device files (including /dev/tty[1-4], /dev/ptmx) are modified as regular files or symlinnks to lxc->tty when I run setup-openstack.yaml. | 14:54 |
*** markvoelker has quit IRC | 14:55 | |
*** markvoelker has joined #openstack-ansible | 14:55 | |
ppetit | I couldn't catch the exact task when this happening but it seems it's around TASK [Extra lxc config] | 14:56 |
ppetit | Have guys already seen that behaviour? | 14:57 |
*** markvoelker has quit IRC | 14:58 | |
*** radeks_ has joined #openstack-ansible | 14:58 | |
ppetit | For example, lrwxrwxrwx 1 root root 8 Sep 10 14:45 /dev/tty1 -> lxc/tty1 | 14:59 |
*** radeks__ has joined #openstack-ansible | 15:00 | |
*** macza has joined #openstack-ansible | 15:00 | |
*** markvoelker has joined #openstack-ansible | 15:00 | |
*** lbragstad has joined #openstack-ansible | 15:00 | |
*** radeks_ has quit IRC | 15:03 | |
*** macza has quit IRC | 15:04 | |
openstackgerrit | Merged openstack/openstack-ansible-os_masakari master: Clean up role tests https://review.openstack.org/600784 | 15:05 |
*** macza has joined #openstack-ansible | 15:05 | |
*** hwoarang has quit IRC | 15:09 | |
*** hwoarang has joined #openstack-ansible | 15:12 | |
*** arxcruz has joined #openstack-ansible | 15:34 | |
*** radeks__ has quit IRC | 15:36 | |
*** mschuppert is now known as mschuppert|afk | 15:38 | |
*** radeks__ has joined #openstack-ansible | 15:43 | |
*** gyee has joined #openstack-ansible | 15:44 | |
mnaser | https://pypi.org/project/ansible-merge-vars/ | 15:46 |
*** DanyC has quit IRC | 15:53 | |
cloudnull | good mornings ! | 16:01 |
devx | bonjour | 16:08 |
*** hamzaachi_ has quit IRC | 16:14 | |
*** markvoelker_ has joined #openstack-ansible | 16:14 | |
*** FuzzyFerric has left #openstack-ansible | 16:15 | |
*** markvoel_ has joined #openstack-ansible | 16:17 | |
d34dh0r53 | moin | 16:17 |
*** markvoelker has quit IRC | 16:18 | |
jrosser | o/ | 16:18 |
*** spatel has joined #openstack-ansible | 16:19 | |
*** markvoelker_ has quit IRC | 16:20 | |
*** suggestable has quit IRC | 16:21 | |
jrosser | cloudnull: i tried the wazuh stuff....... can't quite make it work yet | 16:23 |
spatel | jrosser: i think cloudnull is out for openstackPTG right? | 16:24 |
*** olivierb has quit IRC | 16:24 | |
jrosser | spatel: yes | 16:24 |
openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-plugins master: Add retry to execution commands https://review.openstack.org/601301 | 16:24 |
cloudnull | spatel jrosser o/ | 16:24 |
spatel | oh boy!!! | 16:24 |
cloudnull | yup here a the PTG, sitting with d34dh0r53 devx mnaser odyssey4me logan- :) | 16:25 |
spatel | i was watching your twitter feed and thought you won't be here for sometime :) | 16:25 |
spatel | you guys are lucky!!! | 16:25 |
cloudnull | you'll have to make it to the next one spatel | 16:25 |
spatel | anyway have fun... i have few question for cloudnull but i think you guys anyway busy!! will talk when you back.. | 16:25 |
guilhermesp | any chances to provide an online conference to the PTG discussions? :) | 16:25 |
* jrosser says hi to the PTG peeps | 16:25 | |
spatel | Do i need to pay for that? | 16:26 |
kaiokmo | cloudnull: my compliments to you all | 16:26 |
cloudnull | jrosser yea the wazuh stuff isn't 100% quite yet | 16:26 |
jrosser | i got very very close | 16:26 |
cloudnull | i punted it over just before i went off on holiday for the last week | 16:26 |
jrosser | i did engineer out the nodejs "magic install script" though | 16:26 |
cloudnull | kaiokmo o/ | 16:26 |
spatel | cloudnull: i want to build ELB (loadbalancer) for 5 million connection.. so i started reading about octivia... | 16:27 |
cloudnull | spatel there is a ticket for the PTG | 16:27 |
cloudnull | spatel meet xgerman_ | 16:27 |
cloudnull | he's working on octavia a lot | 16:27 |
spatel | i will try next year :) once my cloud will reach to 500 compute nodes. | 16:27 |
spatel | cloudnull: thanks i will contact xgerman_ | 16:28 |
* cloudnull hasn't done much with that at this point | 16:28 | |
spatel | xgerman_: ping me if you free.. wanted to talk about Octivia and how do i fix that with OSA | 16:29 |
spatel | cloudnull: my boss is happy with OSA :) and he is going to buy more compute node to add in cluster :) | 16:30 |
cloudnull | spatel nice! | 16:31 |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-nspawn_container_create master: Correct bionic jobs to run bionic https://review.openstack.org/600944 | 16:32 |
jrosser | cloudnull: wazuh tinkering http://paste.openstack.org/show/729792/ | 16:32 |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-nspawn_container_create master: Use tests repo for common role test requirements https://review.openstack.org/579558 | 16:32 |
jrosser | i think you also got node 6.x <> 8.x mixup possibly | 16:32 |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-nspawn_container_create master: Use the TESTING_BRANCH env var for constraints https://review.openstack.org/592494 | 16:32 |
spatel | cloudnull: & odyssey4me look like horizon developer accept my request and they issued patch https://bugs.launchpad.net/horizon/+bug/1789325 | 16:34 |
openstack | Launchpad bug 1789325 in OpenStack Dashboard (Horizon) "Remove network name from instance > IP address column " [Undecided,In progress] - Assigned to Akihiro Motoki (amotoki) | 16:34 |
*** DanyC has joined #openstack-ansible | 16:37 | |
openstackgerrit | Merged openstack/openstack-ansible-os_monasca-agent master: Clean up role tests https://review.openstack.org/600786 | 16:44 |
*** lbragstad has quit IRC | 16:44 | |
*** lbragstad has joined #openstack-ansible | 16:48 | |
*** ppetit has quit IRC | 16:52 | |
skiedude | if I change a network setting for host_bind_override in the user cfg, do I need to rerun all 3 playbooks? or just specific ones | 16:54 |
logan- | odyssey4me: no file dropped like kvm_intel but nested virt is enabled by default it looks like http://paste.openstack.org/raw/729795/ | 16:58 |
*** mashuser_ has joined #openstack-ansible | 16:58 | |
*** mashuser_ has left #openstack-ansible | 16:58 | |
openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-plugins master: Add retry to execution commands https://review.openstack.org/601301 | 17:00 |
*** strattao has joined #openstack-ansible | 17:00 | |
*** strattao has left #openstack-ansible | 17:01 | |
*** Darcidride has joined #openstack-ansible | 17:02 | |
openstackgerrit | Merged openstack/openstack-ansible-os_neutron stable/rocky: Change install_method by odl_install_method https://review.openstack.org/597003 | 17:03 |
*** mashuser_ has joined #openstack-ansible | 17:07 | |
*** mashuser_ has left #openstack-ansible | 17:08 | |
*** markvoel_ has quit IRC | 17:09 | |
*** markvoelker has joined #openstack-ansible | 17:10 | |
*** strattao_ has joined #openstack-ansible | 17:10 | |
openstackgerrit | Merged openstack/openstack-ansible-os_heat master: Clean up role tests https://review.openstack.org/600778 | 17:10 |
*** strattao_ has quit IRC | 17:11 | |
*** mashuser_ has joined #openstack-ansible | 17:12 | |
*** mashuser_ has left #openstack-ansible | 17:12 | |
*** markvoelker has quit IRC | 17:14 | |
cloudnull | jrosser nice! | 17:17 |
cloudnull | mind just adding that to that PR ? | 17:17 |
cloudnull | feel free to push to that patch or make a dependent one | 17:17 |
* cloudnull never minds if folks add to a given pr | 17:17 | |
jrosser | Cool, np | 17:17 |
jrosser | What do you think about node 6x vs 8x? | 17:18 |
openstackgerrit | Merged openstack/openstack-ansible-os_gnocchi master: Clean up role tests https://review.openstack.org/600774 | 17:18 |
jrosser | As far as I could see the wazuh install instructions wanted 8.x | 17:18 |
cloudnull | yea I think it needs to be node 8x | 17:18 |
jrosser | Ok I can fix that too. | 17:19 |
cloudnull | thanks! | 17:19 |
jrosser | It all installed, though I simultaneously put elk 6.4.0 on too which came with a bit of fun | 17:19 |
cloudnull | ha! | 17:19 |
cloudnull | yea there were a few things that changed in 6.4 but i believe i caught all of the upgrade bits. | 17:20 |
jrosser | I have a PR for logstash only seeming to listen on IPv6 which is like a second view on | 17:20 |
jrosser | I half wonder if I actually had other brok too | 17:20 |
* cloudnull goes to have a look | 17:20 | |
jrosser | cloudnull: ah there’s another thing, I ran out of the sysctl “file watchers” limit on my log nodes and that creates all sorts of weird with systemd | 17:23 |
odyssey4me | d34dh0r53 cloudnull reviews if you have a few mins please? https://review.openstack.org/600818 | 17:24 |
cloudnull | jrosser oh ? | 17:25 |
cloudnull | something you had to raise? | 17:26 |
cloudnull | did you have to increase fs.inotify.max_user_watches ? | 17:26 |
jrosser | Yes | 17:26 |
openstackgerrit | Merged openstack/openstack-ansible-os_horizon master: Clean up role tests https://review.openstack.org/600779 | 17:26 |
cloudnull | maybe something we just need to set | 17:27 |
cloudnull | ? | 17:27 |
jrosser | I think it’s in openstack_hosts (just on my mobile so can’t check) | 17:27 |
jrosser | But really look like it should be in the elk roles too if we want them portable elsewhere | 17:27 |
cloudnull | for elk we could set it the elk roles | 17:27 |
cloudnull | what did you need to set it to ? | 17:28 |
jrosser | I think I set it to 1M then stuff was good | 17:28 |
jrosser | if you run out then systemctl can’t restart services | 17:28 |
cloudnull | fs.epoll.max_user_watches = 1669201 | 17:28 |
cloudnull | fs.inotify.max_user_watches = 36864 | 17:28 |
cloudnull | thats the default | 17:29 |
jrosser | Yes, that’s certainly not enough on the elastic_logstash nodes | 17:29 |
cloudnull | ok | 17:29 |
jrosser | As far as the rest of the wazuh stuff went it’s all gone on, but the registration of the agents is broken | 17:30 |
openstackgerrit | Merged openstack/openstack-ansible-tests master: Resolve E004 File did not end with a newline https://review.openstack.org/600969 | 17:31 |
*** lvdombrkr has joined #openstack-ansible | 17:34 | |
openstackgerrit | Merged openstack/openstack-ansible-ops master: Move bootstrap-ansible and passwords to run_osa tag https://review.openstack.org/600875 | 17:35 |
openstackgerrit | Merged openstack/openstack-ansible-os_barbican master: Clean up role tests https://review.openstack.org/600761 | 17:35 |
openstackgerrit | German Eichberger proposed openstack/openstack-ansible-os_octavia master: Fixes too low security group rules quota https://review.openstack.org/600826 | 17:41 |
openstackgerrit | Victor Palma proposed openstack/openstack-ansible-galera_server master: fix bootstrap of galera 10.2+ clusters https://review.openstack.org/592531 | 17:43 |
openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-ops master: Set the max user watches to 1M https://review.openstack.org/601330 | 17:43 |
cloudnull | jrosser ^ | 17:43 |
jrosser | cloudnull: copy paste gremlins there :) | 17:46 |
openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-plugins master: Add retry to execution commands https://review.openstack.org/601301 | 17:49 |
odyssey4me | https://github.com/openstack/openstack-ansible-plugins/commit/f56d1242c99f68659e575aa610cdefff73e7707a | 17:52 |
odyssey4me | cloudnull logan- ^ | 17:52 |
*** strattao_ has joined #openstack-ansible | 17:52 | |
*** strattao_ has left #openstack-ansible | 17:53 | |
odyssey4me | cloudnull logan- https://review.openstack.org/#/q/project:openstack/openstack-ansible-plugins+status:open | 17:53 |
jrosser | cloudnull: it’s all coming back to me.... :) there’s ELK memory issues too that need looking at | 17:53 |
*** strattao_ has joined #openstack-ansible | 17:54 | |
odyssey4me | logan- wanna review https://review.openstack.org/#/c/601301/3 ? | 17:58 |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-tests stable/rocky: Resolve E004 File did not end with a newline https://review.openstack.org/601337 | 17:58 |
*** poopcat has joined #openstack-ansible | 18:01 | |
openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-ops master: Set the max user watches to 1M https://review.openstack.org/601330 | 18:02 |
openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-plugins stable/ocata: Correct severe performance problem https://review.openstack.org/582204 | 18:04 |
openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-plugins stable/ocata: Correct severe performance problem https://review.openstack.org/582204 | 18:04 |
openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-plugins stable/pike: Correct severe performance problem https://review.openstack.org/601342 | 18:05 |
openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-plugins stable/queens: Correct severe performance problem https://review.openstack.org/601343 | 18:05 |
cloudnull | logan- ^ | 18:06 |
d34dh0r53 | odyssey4me, cloudnull, et al: https://review.openstack.org/#/c/586612/ pretty please | 18:10 |
*** electrofelix has quit IRC | 18:11 | |
openstackgerrit | Merged openstack/openstack-ansible-os_trove master: Clean up role tests https://review.openstack.org/601062 | 18:18 |
*** lbragstad has quit IRC | 18:20 | |
*** radeks__ has quit IRC | 18:21 | |
*** radeks__ has joined #openstack-ansible | 18:22 | |
openstackgerrit | Merged openstack/openstack-ansible-plugins master: Add retry to execution commands https://review.openstack.org/601301 | 18:25 |
*** priteau has quit IRC | 18:29 | |
*** priteau has joined #openstack-ansible | 18:30 | |
*** priteau has quit IRC | 18:30 | |
*** priteau has joined #openstack-ansible | 18:30 | |
*** priteau has quit IRC | 18:32 | |
*** hamzaachi has joined #openstack-ansible | 18:33 | |
*** lvdombrkr has quit IRC | 18:34 | |
*** DanyC has quit IRC | 18:36 | |
*** DanyC has joined #openstack-ansible | 18:36 | |
*** priteau has joined #openstack-ansible | 18:38 | |
*** lbragstad has joined #openstack-ansible | 18:39 | |
*** DanyC has quit IRC | 18:41 | |
*** lbragstad has quit IRC | 18:41 | |
*** radeks__ has quit IRC | 18:42 | |
*** priteau has quit IRC | 18:42 | |
*** spatel has quit IRC | 18:46 | |
*** markvoelker has joined #openstack-ansible | 18:57 | |
*** Leo_m_ has joined #openstack-ansible | 18:59 | |
*** Leo_m has quit IRC | 19:02 | |
strattao_ | Hoping someone can give me a hand with my weird error… I’ve completed a successful deployment and try to log in to the dashboard. When I try logging in with admin credentials (or the demo credentials created with tempest) the login page sits an thinks for a while, then the page just refreshes. | 19:02 |
strattao_ | Checking the horizon error logs, I see: The timeout specified has expired: [client 192.168.215.3:44978] AH01991: SSL input filter read failed. | 19:02 |
strattao_ | My little digging around tells me that I may have an issue with the apache config, but I didn’t immediately see any issues and am not sure what else to check… Any thoughts? | 19:05 |
strattao_ | (This is on a 6 node test cluster, 3 controllers, 2 computes, 1 loghost) | 19:06 |
*** spatel has joined #openstack-ansible | 19:10 | |
strattao_ | hmmmm, well - I was just able to log in, but it hit a different controller this time, so I must have something out of sync in the haproxy config or something… Will do some more digging. Thx. | 19:18 |
*** DanyC has joined #openstack-ansible | 19:23 | |
*** priteau has joined #openstack-ansible | 19:27 | |
*** spatel has quit IRC | 19:28 | |
*** priteau has quit IRC | 19:28 | |
*** lbragstad has joined #openstack-ansible | 19:31 | |
*** hamzaachi has quit IRC | 19:36 | |
*** Darcidride has quit IRC | 19:38 | |
*** priteau has joined #openstack-ansible | 19:43 | |
*** priteau has quit IRC | 19:47 | |
*** priteau has joined #openstack-ansible | 19:48 | |
*** priteau has quit IRC | 19:48 | |
*** strattao_ has quit IRC | 19:49 | |
*** priteau has joined #openstack-ansible | 19:49 | |
*** strattao has joined #openstack-ansible | 19:57 | |
*** spatel has joined #openstack-ansible | 20:04 | |
*** hamzaachi has joined #openstack-ansible | 20:06 | |
*** dw has quit IRC | 20:07 | |
*** pcaruana has quit IRC | 20:08 | |
*** dw has joined #openstack-ansible | 20:09 | |
*** radeks__ has joined #openstack-ansible | 20:12 | |
*** markvoelker has quit IRC | 20:14 | |
*** arxcruz is now known as arxcruz|ptg | 20:23 | |
*** SimAloo has joined #openstack-ansible | 20:30 | |
*** strattao has quit IRC | 20:31 | |
*** hamzaachi has quit IRC | 20:34 | |
*** markvoelker has joined #openstack-ansible | 20:36 | |
*** lbragstad has quit IRC | 20:39 | |
*** ansmith has quit IRC | 20:45 | |
*** radeks__ has quit IRC | 20:45 | |
*** lbragstad has joined #openstack-ansible | 20:46 | |
*** radeks__ has joined #openstack-ansible | 20:47 | |
*** luksky has joined #openstack-ansible | 20:57 | |
*** markvoelker has quit IRC | 21:02 | |
*** savvas has quit IRC | 21:06 | |
*** DanyC has quit IRC | 21:06 | |
*** DanyC has joined #openstack-ansible | 21:06 | |
*** markvoelker has joined #openstack-ansible | 21:07 | |
*** nicolasbock has joined #openstack-ansible | 21:09 | |
*** DanyC has quit IRC | 21:11 | |
openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-ops master: Set the max user watches to 1M https://review.openstack.org/601330 | 21:12 |
*** savvas has joined #openstack-ansible | 21:13 | |
*** spatel has quit IRC | 21:13 | |
openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-ops master: Enforce no_proxy when setting up ELK dashboards and rollups https://review.openstack.org/600008 | 21:14 |
openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-ops master: Ensure logstash listens on ipv4 address https://review.openstack.org/600009 | 21:14 |
nicolasbock | Hi everybody. I just deployed a brand new AIO on Leap 42.3 (I used 17.1.0). It ran great until I decided to reboot it. | 21:17 |
*** luksky has quit IRC | 21:17 | |
nicolasbock | On boot I am getting lots of errors such as: parsing [/etc/haproxy/haproxy.cfg:30] : 'bind 38.108.68.9:8776' : unable to load SSL private key from PEM file '/etc/ssl/private/haproxy.pem'. | 21:17 |
nicolasbock | Has anyone seen this? | 21:17 |
nicolasbock | Does anyone have a suggestion on how to fix it? | 21:17 |
openstackgerrit | Victor Palma proposed openstack/openstack-ansible-galera_server master: fix bootstrap of galera 10.2+ clusters https://review.openstack.org/592531 | 21:18 |
*** savvas has quit IRC | 21:18 | |
cloudnull | nicolasbock maybe the key was removed? | 21:19 |
*** hamzaachi has joined #openstack-ansible | 21:19 | |
jrosser | nicolasbock: look at that pem file and check it is valid, particularly the way that the three parts are concatented together. Lack of carriage returns in the right place can break that | 21:19 |
cloudnull | ^ | 21:20 |
*** spatel has joined #openstack-ansible | 21:21 | |
*** nicolasbock has quit IRC | 21:22 | |
*** savvas has joined #openstack-ansible | 21:23 | |
*** hamzaachi has quit IRC | 21:27 | |
*** savvas has quit IRC | 21:27 | |
*** nicolasbock has joined #openstack-ansible | 21:28 | |
*** savvas has joined #openstack-ansible | 21:32 | |
*** spatel has quit IRC | 21:35 | |
*** ansmith has joined #openstack-ansible | 21:35 | |
*** savvas has quit IRC | 21:36 | |
*** savvas has joined #openstack-ansible | 21:41 | |
*** lbragstad has quit IRC | 21:53 | |
*** SimAloo has quit IRC | 21:54 | |
*** skiedude has quit IRC | 22:01 | |
*** goldenfri has quit IRC | 22:02 | |
openstackgerrit | David Wilde proposed openstack/openstack-ansible-ops master: Deploy ELK in MNAIO https://review.openstack.org/586612 | 22:04 |
openstackgerrit | Merged openstack/openstack-ansible-ops master: Ensure logstash listens on ipv4 address https://review.openstack.org/600009 | 22:10 |
openstackgerrit | Merged openstack/openstack-ansible-plugins stable/ocata: Correct severe performance problem https://review.openstack.org/582204 | 22:10 |
nicolasbock | jrosser, cloudnull, it ended up being apparmor | 22:12 |
*** savvas has quit IRC | 22:14 | |
openstackgerrit | Merged openstack/openstack-ansible-ops master: Enforce no_proxy when setting up ELK dashboards and rollups https://review.openstack.org/600008 | 22:15 |
openstackgerrit | Merged openstack/openstack-ansible-plugins stable/queens: Correct severe performance problem https://review.openstack.org/601343 | 22:17 |
openstackgerrit | Merged openstack/openstack-ansible-plugins stable/pike: Correct severe performance problem https://review.openstack.org/601342 | 22:17 |
*** savvas has joined #openstack-ansible | 22:20 | |
cloudnull | nicolasbock orly1 | 22:21 |
cloudnull | Is it something that we need to update in the profile? | 22:21 |
nicolasbock | Yes, possibly | 22:21 |
nicolasbock | There is an apparmor profile for haproxy | 22:21 |
nicolasbock | When I disable apparmor alltoghether (which is a bit hackish) | 22:22 |
nicolasbock | it works | 22:22 |
nicolasbock | I am running into a new error though :( | 22:22 |
cloudnull | ah. so maybe we just need to tweak it to respect that pem file | 22:22 |
cloudnull | what's the new error ? | 22:22 |
nicolasbock | fatal: [aio1_galera_container-a67c200f]: UNREACHABLE! | 22:23 |
nicolasbock | lxc-ls shows the container though | 22:23 |
cloudnull | no ips ? | 22:23 |
nicolasbock | When I 'lxc-attach' I get: lxc-attach: attach.c: lxc_attach: 755 Failed to get init pid. | 22:23 |
cloudnull | ah is the container running ? | 22:24 |
cloudnull | maybe it needs to be killed and restarted | 22:24 |
nicolasbock | Hmm, and there are hardly network devices now | 22:24 |
cloudnull | something like `lxc-stop -fn $name` | 22:24 |
nicolasbock | I think the networking wasn't set up | 22:24 |
cloudnull | oh! | 22:24 |
nicolasbock | What service is that? | 22:25 |
cloudnull | systemd-networkd | 22:25 |
cloudnull | well, which release? | 22:25 |
nicolasbock | Leap 42.3 | 22:26 |
nicolasbock | 17.1.0 | 22:26 |
cloudnull | ah yea, that should be networkd on the aio | 22:26 |
cloudnull | maybe it needs to be restarted ? | 22:26 |
nicolasbock | Interesting, that service is disabled | 22:26 |
nicolasbock | Is that a wicked conflict? | 22:26 |
cloudnull | it shouldnt conflict at all | 22:27 |
cloudnull | its just creating dummy devices on the aio | 22:27 |
nicolasbock | ok | 22:27 |
cloudnull | I dont think we enable the service in the aio, we just start it and run the networks | 22:27 |
cloudnull | though we could start it to help make the AIO survive a reboot. | 22:27 |
nicolasbock | I just restarted networkd | 22:27 |
nicolasbock | And don't see any additional devices | 22:28 |
nicolasbock | I'll enable the service and reboot | 22:28 |
cloudnull | hum .. | 22:28 |
cloudnull | do you have networkd service files ? | 22:28 |
cloudnull | in /etc/systemd/networkd? | 22:28 |
cloudnull | sorry /etc/systemd/network/ | 22:29 |
nicolasbock | Yes, there are a bunch of files in there | 22:30 |
nicolasbock | Do you have a minute to hack this together? | 22:30 |
cloudnull | sure | 22:34 |
nicolasbock | Where are you? | 22:34 |
nicolasbock | Where I talked to you earlier | 22:35 |
cloudnull | we're in the hall by registration | 22:35 |
nicolasbock | ? | 22:35 |
nicolasbock | Ok, I am walking over | 22:35 |
cloudnull | there's power here :) | 22:35 |
*** lbragstad has joined #openstack-ansible | 22:38 | |
prometheanfire | ish | 22:48 |
*** savvas has quit IRC | 22:53 | |
openstackgerrit | Merged openstack/ansible-role-python_venv_build master: Add option for default pip package install https://review.openstack.org/574544 | 22:56 |
*** savvas has joined #openstack-ansible | 22:59 | |
*** macza has quit IRC | 23:05 | |
*** macza has joined #openstack-ansible | 23:05 | |
openstackgerrit | David Wilde proposed openstack/openstack-ansible-ops master: Deploy ELK in MNAIO https://review.openstack.org/586612 | 23:14 |
*** lbragstad has quit IRC | 23:14 | |
*** pmannidi has joined #openstack-ansible | 23:33 | |
*** savvas has quit IRC | 23:33 | |
*** savvas has joined #openstack-ansible | 23:38 | |
openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-haproxy_server master: Fix haproxy when there's an haproxy apparmor profile https://review.openstack.org/601467 | 23:56 |
*** evrardjp has quit IRC | 23:58 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!