| *** DanyC has quit IRC | 00:03 | |
| *** goldyfruit_ has quit IRC | 00:09 | |
| *** spatel has joined #openstack-ansible | 00:41 | |
| *** macz has joined #openstack-ansible | 00:44 | |
| *** gyee has quit IRC | 00:46 | |
| *** tosky has quit IRC | 00:56 | |
| *** openstackstatus has joined #openstack-ansible | 01:02 | |
| *** ChanServ sets mode: +v openstackstatus | 01:02 | |
| *** macz has quit IRC | 01:23 | |
| *** macz has joined #openstack-ansible | 01:31 | |
| *** openstackgerrit has joined #openstack-ansible | 01:35 | |
| openstackgerrit | Merged openstack/openstack-ansible master: Add ceph-ansible filter plugins path to openstack-ansible.rc https://review.opendev.org/692921 | 01:35 |
|---|---|---|
| *** macz has quit IRC | 02:09 | |
| *** spatel has quit IRC | 02:37 | |
| snadge | TASK [os_keystone : Wait for services to be up] | 03:04 |
| snadge | this makes me just want to cry | 03:04 |
| snadge | "msg": "Status code was -1 and not [300]: Request failed: <urlopen error [Errno 111] Connection refused>", | 03:04 |
| snadge | if i attach to infra1_keystone_container .. i can connect to the url, which happens to be http://172.29.236.100:5000 | 03:05 |
| snadge | so connection refused makes absolutely no sense at all.. is it the python uri method? is it ansible-httpget .. i have no idea | 03:06 |
| snadge | im guessing it has something to do with this stupid proxy environment I have to use.. but, im not seeing a hit in the proxy logs | 03:08 |
| snadge | no.. its running that task on localhost which is the deployment host.. wtf | 03:22 |
| *** macz has joined #openstack-ansible | 03:30 | |
| *** macz has quit IRC | 03:34 | |
| *** udesale has joined #openstack-ansible | 03:41 | |
| snadge | keystone_service_setup_host: "{{ groups['utility_all'][0] }}" | 04:05 |
| snadge | that seems to have fixed that.. but now on TASK [os_keystone : Add service project] .. im getting FAILED! => {"attempts": 5, "changed": false, "msg": "openstacksdk is required for this module"} | 05:30 |
| snadge | it really bothers me being in Australian time zone ;) | 05:48 |
| *** macz has joined #openstack-ansible | 05:53 | |
| *** macz has quit IRC | 05:58 | |
| *** zbr has joined #openstack-ansible | 06:07 | |
| *** zbr|ooo has quit IRC | 06:08 | |
| *** raukadah is now known as chkumar|rover | 06:37 | |
| *** shyamb has joined #openstack-ansible | 07:11 | |
| *** isakgicu has joined #openstack-ansible | 07:13 | |
| isakgicu | hi, any ideas of this error; http://paste.openstack.org/show/786486/ ? | 07:14 |
| *** macz has joined #openstack-ansible | 07:25 | |
| *** macz has quit IRC | 07:29 | |
| jrosser | snadge: there is an openstack_service_setup_host that you should use to make all of that happen on the utility container | 07:30 |
| jrosser | for all the services | 07:31 |
| *** shyamb has quit IRC | 07:38 | |
| jrosser | snadge: the resaon that the service setup host can be delegated is usually if there is not direct tcp connectivity between the deploy host and the cloud environment, for example an ssh bastion in the way | 07:48 |
| jrosser | otherwise you should not need to do that, i suspect that points to something else underlying | 07:49 |
| jrosser | noonedeadpunk: hrrm https://zuul.opendev.org/t/openstack/build/9b8ab08f795b48bf8ab86bc287a55278/log/job-output.txt#3823-3831 | 07:59 |
| jrosser | thats from here https://review.opendev.org/#/c/695563/ | 08:00 |
| *** shyamb has joined #openstack-ansible | 08:09 | |
| openstackgerrit | Merged openstack/openstack-ansible-os_keystone stable/rocky: Remove references to writable LDAP from documentation https://review.opendev.org/695405 | 08:09 |
| *** jawad_axd has joined #openstack-ansible | 08:11 | |
| *** tosky has joined #openstack-ansible | 08:15 | |
| *** pcaruana has joined #openstack-ansible | 08:21 | |
| openstackgerrit | Merged openstack/ansible-hardening stable/rocky: Splits STIG yum add/removes https://review.opendev.org/695410 | 08:34 |
| *** DanyC has joined #openstack-ansible | 08:43 | |
| *** DanyC has quit IRC | 08:45 | |
| *** DanyC has joined #openstack-ansible | 08:47 | |
| *** shyamb has quit IRC | 08:57 | |
| *** DanyC has quit IRC | 08:57 | |
| *** rpittau|afk is now known as rpittau | 08:58 | |
| *** DanyC has joined #openstack-ansible | 08:59 | |
| *** DanyC has quit IRC | 09:00 | |
| *** DanyC has joined #openstack-ansible | 09:01 | |
| isakgicu | guys, one question: where can I find this task in playbooks? | 09:02 |
| isakgicu | TASK [os_nova : Run nova-status upgrade check to validate a healthy configuration] | 09:02 |
| isakgicu | I used grep to find it in openstsack-ansible directory and couldn't find it | 09:02 |
| *** shyamb has joined #openstack-ansible | 09:04 | |
| isakgicu | oh, found it | 09:05 |
| isakgicu | its /etc/ansible/roles/os_nova/tasks/nova_db_post_setup.yml | 09:06 |
| *** cshen has joined #openstack-ansible | 09:06 | |
| isakgicu | so my playbook fails here: "{{ _db_nova_bin }}/nova-manage cell_v2 discover_hosts{{ (debug | bool) | ternary(' --verbose', '') }}{{ (nova_virt_type == 'ironic') | ternary(' --by-service', '') }}" | 09:06 |
| isakgicu | I'm confused, why my environment tries to validate with nova_virt_type == 'ironic' | 09:07 |
| isakgicu | is it default ? | 09:08 |
| isakgicu | strange, in my /etc/openstack_deploy/user_variables.yml - nova_virt_type is set to kvm | 09:12 |
| *** Zheyley_ has joined #openstack-ansible | 09:18 | |
| *** sshnaidm is now known as sshnaidm|off | 09:21 | |
| *** shyamb has quit IRC | 09:39 | |
| *** shyamb has joined #openstack-ansible | 09:44 | |
| *** shyamb has quit IRC | 09:44 | |
| *** shyamb has joined #openstack-ansible | 09:45 | |
| *** macz has joined #openstack-ansible | 09:45 | |
| *** macz has quit IRC | 09:50 | |
| *** shyamb has quit IRC | 09:54 | |
| isakgicu | ok found the problem: http://paste.openstack.org/show/786537/ | 09:58 |
| isakgicu | and this article: https://ask.openstack.org/en/question/122313/on-stein-nova-status-upgrade-check-check-failed/ | 09:59 |
| isakgicu | so its a common problem ? | 09:59 |
| isakgicu | no fixes yet or ? | 09:59 |
| snadge | jrosser: yes.. my deployment environment can only get to the management network.. not any of the others.. this is by design, basicall | 10:02 |
| snadge | but i dont know why os_keystone : Add service project is failing | 10:03 |
| snadge | "openstacksdk is required for this module" doesn't sound like a networking problem | 10:04 |
| *** shyamb has joined #openstack-ansible | 10:14 | |
| jrosser | snadge: ok, well the loadbalancer vip internal and also the container mgmt ip should be directly reachable? | 10:23 |
| jrosser | as far as I know both the deployment host and the utility container should have openstacksdk | 10:24 |
| jrosser | I’m assuming that by management network you mean “br-mgmt”, rather than some other OOB network you have for accessin g the bare metal? | 10:25 |
| jrosser | isakgicu: you are deploying train release candidate? | 10:30 |
| isakgicu | yes | 10:30 |
| jrosser | do you have an AIO to compare against? | 10:31 |
| isakgicu | no.. | 10:31 |
| jrosser | when things go wierd that’s usually my first thing to do, because the AIO is what we use for all testing | 10:32 |
| jrosser | and maybe there’s an error in your environment, or maybe we have an actual bug to address, but it’s hard to pin down without a vm it more info | 10:33 |
| jrosser | *bit | 10:33 |
| jrosser | you are just trying a single controller? | 10:34 |
| isakgicu | yes | 10:34 |
| isakgicu | 1network 1controller 1compute for the beginning | 10:34 |
| jrosser | I think that’s a fairly unusual config, so I’d defiantly be trying to have an AIO alongside that to compare against | 10:35 |
| jrosser | 8G 8cpu 69g disk VM is all you need for that | 10:35 |
| jrosser | *60G | 10:35 |
| * jrosser typing on a phone :) | 10:35 | |
| isakgicu | no problem, thnx anyways | 10:36 |
| jrosser | in your case there won’t be a keepalived, I think | 10:36 |
| jrosser | because of only one controller | 10:36 |
| isakgicu | yep | 10:37 |
| isakgicu | I have an such cloud already running for more than 1 year | 10:37 |
| isakgicu | with rocky release | 10:37 |
| isakgicu | didnt meet such problems with his deployment | 10:37 |
| jrosser | you have a message about placement api not found too? | 10:37 |
| jrosser | because placement changes a lot in train for OSA | 10:38 |
| isakgicu | googling I understood that the problem I have is in placement api | 10:41 |
| isakgicu | are there any major changes in placement API which I should consider deploying OSA | 10:42 |
| isakgicu | are there any major changes in placement API which I should consider deploying OSA? | 10:42 |
| jrosser | isakgicu: osa train release is the one where the extracted placement service was first deployed | 10:47 |
| jrosser | so there are new containers | 10:47 |
| jrosser | new api endpoints on the haproxy | 10:48 |
| isakgicu | hmm .. but i dont see new containers | 10:48 |
| jrosser | this is a fresh deploy, not an upgrade? | 10:49 |
| isakgicu | yes, its fresh | 10:49 |
| isakgicu | these are my containers: http://paste.openstack.org/show/786540/ | 10:49 |
| jrosser | this defines them https://github.com/openstack/openstack-ansible/blob/master/inventory/env.d/placement.yml | 10:50 |
| jrosser | hmm - I have to head out now but this is definitely something to investigate | 10:51 |
| jrosser | tools/inventory-manage is useful here to see what groups and hosts/containers are defined | 10:52 |
| isakgicu | very interesting .... why ansible does not create this container ... | 10:56 |
| isakgicu | maybe I have to define it in openstack_user_config.yml or user_variables.yml ? | 10:57 |
| *** shyamb has quit IRC | 11:02 | |
| isakgicu | yeah .. I had to put it in openstack_user_config.yml .. | 11:04 |
| isakgicu | lets see how now will run playbooks | 11:04 |
| isakgicu | thnx jrosser | 11:04 |
| *** yolanda__ has joined #openstack-ansible | 11:08 | |
| *** yolanda has quit IRC | 11:09 | |
| *** udesale has quit IRC | 11:10 | |
| *** yolanda__ has quit IRC | 11:33 | |
| *** luksky has joined #openstack-ansible | 11:34 | |
| *** yolanda has joined #openstack-ansible | 11:46 | |
| *** yolanda has quit IRC | 11:52 | |
| *** yolanda has joined #openstack-ansible | 12:05 | |
| *** nicolasbock has joined #openstack-ansible | 12:26 | |
| openstackgerrit | Merged openstack/openstack-ansible stable/stein: Adding missing tag for dynamic-address-fact task https://review.opendev.org/695305 | 12:44 |
| noonedeadpunk | jrosser: yeah, it's thing I've said about on meeting as well | 12:51 |
| jrosser | noonedeadpunk: does that mean that we are broken on train branch for merging horizon role patches? | 12:52 |
| jrosser | noonedeadpunk: also did you see the trouble isakgicu had with placement missing, I wonder if we are missing something from the example user config | 12:53 |
| noonedeadpunk | jrosser: right now horizon is broken, yes. Dunno how safe it's to backport https://opendev.org/openstack/openstack-ansible/commit/c5d030ead13963d1917bdfdcef4d6e78a384ae28 into sten... | 12:54 |
| noonedeadpunk | I've missed isakgicu stroy tbh | 12:54 |
| *** macz has joined #openstack-ansible | 12:55 | |
| noonedeadpunk | So he failed as he doesn't have placement deployed (or runned) | 12:57 |
| noonedeadpunk | jrosser: yeah, I guess we should update docs for sure, as I think we're missing not only this part | 12:58 |
| *** macz has quit IRC | 12:59 | |
| openstackgerrit | Merged openstack/openstack-ansible-galera_client master: Fix a type in yml file https://review.opendev.org/694947 | 13:07 |
| mensis | jrosser: I wanted to ask that did u build ELK Stack on container or on the host? | 13:17 |
| *** goldyfruit_ has joined #openstack-ansible | 13:20 | |
| jrosser | in containers, using normal OSA lxc hosts | 13:25 |
| jrosser | log1,2,3 | 13:25 |
| isakgicu | regarding documentation agree, it is really outdated, there are a lot of things to update and others to add | 13:26 |
| jrosser | isakgicu: if you are able to take some notes in an ether pad or somewhere we can fix things up | 13:33 |
| mensis | jrosser: i am trying to install ELK Stack to 3 new nodes (reserved for just ELK Stack). When i run lxc-containers-create, it throws error such as "lxc-ls command not found". Should i add the 3 new nodes to openstack_user_config file and run setup-hosts etc.? | 13:41 |
| *** jawad_axd has quit IRC | 13:42 | |
| *** jawad_axd has joined #openstack-ansible | 13:43 | |
| mensis | I mean do i need to install some packages to the new nodes? | 13:43 |
| *** jawad_axd has quit IRC | 13:48 | |
| jrosser | mensis: yes you should treat them like any other infra node | 14:08 |
| isakgicu | sure jrosser, gonna do it when will get some free time | 14:18 |
| openstackgerrit | Dmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible stable/train: Change rabbitmq_package_state logic https://review.opendev.org/695223 | 14:29 |
| *** jawad_axd has joined #openstack-ansible | 14:36 | |
| openstackgerrit | Dmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-os_horizon stable/train: Set metal upgrade jobs to non-voting https://review.opendev.org/695698 | 14:39 |
| openstackgerrit | Dmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-os_horizon stable/train: Debian mod_wsgi python versions https://review.opendev.org/695563 | 14:39 |
| *** jawad_axd has quit IRC | 14:40 | |
| mensis | jrosser: i added new nodes to openstack_user_config file and then run setup-hosts playbook with limit to "elk_all" group. I get this error; http://paste.openstack.org/show/786573/ Any suggestions? | 14:47 |
| openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible stable/train: Add ceph-ansible filter plugins path to openstack-ansible.rc https://review.opendev.org/695703 | 14:57 |
| jrosser | mensis: there is a quite good log for lxc which may help there | 15:03 |
| jrosser | you need to have the network bridges availble just like an infra node too | 15:03 |
| jrosser | time to go get the kids from school, but we are planning to do an upgrade of our ELK stuff in the lab to 7.4.0 next week to see if we get the same memory issues | 15:04 |
| *** jawad_axd has joined #openstack-ansible | 15:21 | |
| admin0 | hi all .. how to address/solve too many heartbeats missed issue ? | 15:33 |
| jrosser | admin0: is it this? https://opendev.org/openstack/nova/commit/a694952eacfe3a2dac34957cf95d5529eb89d4b2 | 15:41 |
| *** kmadac_ has joined #openstack-ansible | 15:42 | |
| *** kmadac has quit IRC | 15:45 | |
| admin0 | jrosser, mine is on the neutron-dhcp-agent | 15:46 |
| *** cshen has quit IRC | 15:50 | |
| admin0 | i have around 17k messages in Ready state on neutron notificaitons.info -- any ideas why they are not being cleared ( nothin in unack ) .. and what process is supposed to clear them | 15:53 |
| admin0 | as per the neutron guys .. that neutron and nova notificaiton.info is used by designate_sink .. need help from our resident osa designate guru :D | 16:03 |
| *** jbadiapa has joined #openstack-ansible | 16:03 | |
| *** luksky has quit IRC | 16:04 | |
| openstackgerrit | Merged openstack/openstack-ansible-os_nova master: Readd some QEMU distro packages https://review.opendev.org/694807 | 16:07 |
| *** jawad_axd has quit IRC | 16:08 | |
| *** gyee has joined #openstack-ansible | 16:09 | |
| openstackgerrit | Merged openstack/openstack-ansible-os_ironic master: Fix typos in yml files https://review.opendev.org/693281 | 16:17 |
| *** macz has joined #openstack-ansible | 16:28 | |
| openstackgerrit | Merged openstack/openstack-ansible-os_nova master: Disable unused console services https://review.opendev.org/695169 | 16:29 |
| *** chkumar|rover is now known as raukadah | 16:31 | |
| *** yolanda has quit IRC | 16:50 | |
| *** rpittau is now known as rpittau|afk | 17:01 | |
| *** isakgicu has quit IRC | 17:01 | |
| *** Zheyley_ has quit IRC | 17:15 | |
| *** DanyC has quit IRC | 17:20 | |
| *** DanyC has joined #openstack-ansible | 17:23 | |
| *** Guest24639 has joined #openstack-ansible | 17:32 | |
| *** Guest24639 is now known as mgagne_ | 17:34 | |
| *** DanyC has quit IRC | 17:42 | |
| *** mwe1 has quit IRC | 17:52 | |
| *** mgariepy has quit IRC | 18:07 | |
| *** DanyC has joined #openstack-ansible | 18:10 | |
| *** mgariepy has joined #openstack-ansible | 18:10 | |
| *** DanyC has quit IRC | 18:14 | |
| *** nicolasbock has quit IRC | 18:26 | |
| *** irclogbot_1 has quit IRC | 18:27 | |
| *** nicolasbock has joined #openstack-ansible | 18:27 | |
| *** irclogbot_3 has joined #openstack-ansible | 18:30 | |
| *** nyloc has quit IRC | 19:37 | |
| *** yolanda has joined #openstack-ansible | 20:10 | |
| *** jcosmao has joined #openstack-ansible | 20:12 | |
| *** jcosmao has left #openstack-ansible | 20:12 | |
| *** jcosmao has joined #openstack-ansible | 20:13 | |
| *** luksky has joined #openstack-ansible | 20:32 | |
| openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-os_designate stable/train: Remove deprecated packages from centos installs https://review.opendev.org/695227 | 20:42 |
| openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-os_designate master: Replace git.openstack.org with opendev.org https://review.opendev.org/694303 | 20:44 |
| openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-os_tempest master: Add zun service to tempest https://review.opendev.org/692406 | 20:47 |
| openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-os_tempest master: Add zun service to tempest https://review.opendev.org/692406 | 20:47 |
| *** mgagne_ is now known as mgagne | 21:13 | |
| *** DanyC has joined #openstack-ansible | 21:25 | |
| *** DanyC has quit IRC | 21:35 | |
| *** DanyC has joined #openstack-ansible | 21:35 | |
| *** spatel has joined #openstack-ansible | 21:38 | |
| *** spatel has quit IRC | 21:39 | |
| *** spatel has joined #openstack-ansible | 22:08 | |
| *** spatel has quit IRC | 22:13 | |
| *** spatel has joined #openstack-ansible | 22:15 | |
| *** jcosmao has left #openstack-ansible | 22:16 | |
| *** kopecmartin is now known as kopecmartin|off | 22:18 | |
| *** DanyC has quit IRC | 22:26 | |
| *** KeithMnemonic has quit IRC | 22:44 | |
| *** spatel has quit IRC | 22:58 | |
| *** luksky has quit IRC | 23:04 | |
| *** jbadiapa has quit IRC | 23:42 | |
| *** tosky has quit IRC | 23:45 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!