| *** dave-mccowan has joined #openstack-ansible | 00:04 | |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible master: Update ansible to the latest stable release https://review.openstack.org/638528 | 00:08 |
|---|---|---|
| *** sdake_ has quit IRC | 00:08 | |
| *** sdake has joined #openstack-ansible | 00:25 | |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible master: Remove all uses of private in include_role https://review.openstack.org/638531 | 00:25 |
| *** cshen has joined #openstack-ansible | 00:30 | |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-os_heat master: Remove the private option from include_role https://review.openstack.org/638532 | 00:32 |
| *** DanyC has quit IRC | 00:33 | |
| *** cshen has quit IRC | 00:35 | |
| *** lbragstad has quit IRC | 00:35 | |
| *** lbragstad has joined #openstack-ansible | 00:39 | |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-os_blazar master: Remove the private option from include_role https://review.openstack.org/638534 | 00:39 |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-os_cinder master: Remove the private option from include_role https://review.openstack.org/638535 | 00:39 |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-os_designate master: Remove the private option from include_role https://review.openstack.org/638536 | 00:39 |
| *** cmart has quit IRC | 00:39 | |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-os_glance master: Remove the private option from include_role https://review.openstack.org/638537 | 00:39 |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-os_keystone master: Remove the private option from include_role https://review.openstack.org/638538 | 00:39 |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-os_magnum master: Remove the private option from include_role https://review.openstack.org/638539 | 00:39 |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-os_sahara master: Remove the private option from include_role https://review.openstack.org/638540 | 00:40 |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-os_tacker master: Remove the private option from include_role https://review.openstack.org/638541 | 00:40 |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-os_trove master: Remove the private option from include_role https://review.openstack.org/638542 | 00:40 |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-nspawn_container_create master: Remove the private option from include_role https://review.openstack.org/638543 | 00:49 |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-nspawn_hosts master: Remove the private option from include_role https://review.openstack.org/638544 | 00:49 |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-os_aodh master: Remove the private option from include_role https://review.openstack.org/638545 | 00:49 |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-os_barbican master: Remove the private option from include_role https://review.openstack.org/638546 | 00:49 |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-os_ceilometer master: Remove the private option from include_role https://review.openstack.org/638547 | 00:49 |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-os_congress master: Remove the private option from include_role https://review.openstack.org/638548 | 00:49 |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-os_gnocchi master: Remove the private option from include_role https://review.openstack.org/638549 | 00:49 |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-os_horizon master: Remove the private option from include_role https://review.openstack.org/638550 | 00:49 |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-os_ironic master: Remove the private option from include_role https://review.openstack.org/638551 | 00:50 |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-os_neutron master: Remove the private option from include_role https://review.openstack.org/638552 | 00:50 |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-os_nova master: Remove the private option from include_role https://review.openstack.org/638553 | 00:50 |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-os_octavia master: Remove the private option from include_role https://review.openstack.org/638554 | 00:50 |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-os_rally master: Remove the private option from include_role https://review.openstack.org/638555 | 00:50 |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-os_swift master: Remove the private option from include_role https://review.openstack.org/638556 | 00:50 |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-os_tempest master: Remove the private option from include_role https://review.openstack.org/638557 | 00:50 |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/ansible-role-python_venv_build master: Remove the private option from include_role https://review.openstack.org/638558 | 00:50 |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-rabbitmq_server master: Remove the private option from include_role https://review.openstack.org/638559 | 00:50 |
| *** markvoelker has joined #openstack-ansible | 00:53 | |
| *** dave-mccowan has quit IRC | 00:53 | |
| *** gyee has quit IRC | 00:54 | |
| *** macza has quit IRC | 01:04 | |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible master: Convert include to either import_playbook or include_tasks https://review.openstack.org/638562 | 01:09 |
| *** markvoelker has quit IRC | 01:26 | |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible master: Cover the nova playbook to use newer ansible syntax https://review.openstack.org/638565 | 01:28 |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible master: Convert the nova playbook to use newer ansible syntax https://review.openstack.org/638565 | 01:28 |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible master: Convert include to either import_playbook or include_tasks https://review.openstack.org/638562 | 01:29 |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible master: Convert the nova playbook to use newer ansible syntax https://review.openstack.org/638565 | 01:40 |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible master: Convert the nova playbook to use newer ansible syntax https://review.openstack.org/638565 | 01:40 |
| *** sdake has quit IRC | 01:44 | |
| *** sdake has joined #openstack-ansible | 01:46 | |
| errr | Im using a queens AIO. Where all would I be able to find logs for horizon? Im having a problem with it + federation and Im not sure where to find the debug logs. | 01:50 |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible master: Convert the neutron playbook to use newer ansible syntax https://review.openstack.org/638567 | 01:50 |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible master: Convert the glance playbook to use newer ansible syntax https://review.openstack.org/638568 | 01:52 |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible master: Convert the cinder playbook to use newer ansible syntax https://review.openstack.org/638569 | 01:54 |
| cloudnull | errr should be in the apache logs | 01:57 |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-os_keystone master: Set the user argument in the cron module https://review.openstack.org/638573 | 02:08 |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-os_keystone master: Set the user argument in the cron module https://review.openstack.org/638573 | 02:12 |
| *** hamzy has joined #openstack-ansible | 02:15 | |
| *** bgmccollum has quit IRC | 02:15 | |
| *** bgmccollum has joined #openstack-ansible | 02:18 | |
| *** markvoelker has joined #openstack-ansible | 02:23 | |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible master: Remove broken conditions when including playbooks https://review.openstack.org/638575 | 02:28 |
| openstackgerrit | Merged openstack/openstack-ansible-nspawn_container_create master: Remove the private option from include_role https://review.openstack.org/638543 | 02:30 |
| *** cshen has joined #openstack-ansible | 02:31 | |
| *** sdake has quit IRC | 02:32 | |
| *** sdake has joined #openstack-ansible | 02:35 | |
| *** cshen has quit IRC | 02:35 | |
| openstackgerrit | Merged openstack/openstack-ansible-galera_server stable/rocky: Iterate over list of values of PPC packages dict https://review.openstack.org/637825 | 02:36 |
| openstackgerrit | Merged openstack/openstack-ansible-galera_server stable/queens: Iterate over list of values of PPC packages dict https://review.openstack.org/637826 | 02:38 |
| *** sdake has quit IRC | 02:38 | |
| *** sdake_ has joined #openstack-ansible | 02:39 | |
| openstackgerrit | Merged openstack/openstack-ansible-os_rally master: Remove the private option from include_role https://review.openstack.org/638555 | 02:42 |
| openstackgerrit | Merged openstack/openstack-ansible-os_designate master: Remove the private option from include_role https://review.openstack.org/638536 | 02:46 |
| openstackgerrit | Merged openstack/openstack-ansible-nspawn_hosts master: Remove the private option from include_role https://review.openstack.org/638544 | 02:46 |
| *** ArchiFleKs has quit IRC | 02:51 | |
| *** lbragstad_ has joined #openstack-ansible | 02:54 | |
| *** lbragstad has quit IRC | 02:55 | |
| *** markvoelker has quit IRC | 02:57 | |
| *** sdake_ has quit IRC | 03:03 | |
| *** hwoarang has quit IRC | 03:03 | |
| openstackgerrit | Merged openstack/openstack-ansible-os_congress master: Remove the private option from include_role https://review.openstack.org/638548 | 03:04 |
| *** hwoarang has joined #openstack-ansible | 03:07 | |
| *** ArchiFleKs has joined #openstack-ansible | 03:08 | |
| *** sdake has joined #openstack-ansible | 03:09 | |
| openstackgerrit | Merged openstack/openstack-ansible stable/queens: Dynamic inventory backup corruption fix https://review.openstack.org/638291 | 03:16 |
| openstackgerrit | Merged openstack/openstack-ansible-os_cinder master: cinder-volume: rbd driver set backend_host value https://review.openstack.org/623490 | 03:33 |
| *** sdake has quit IRC | 03:33 | |
| *** dxiri has joined #openstack-ansible | 03:33 | |
| *** dxiri has quit IRC | 03:38 | |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible master: Convert the cinder playbook to use newer ansible syntax https://review.openstack.org/638569 | 03:42 |
| *** udesale has joined #openstack-ansible | 03:53 | |
| *** markvoelker has joined #openstack-ansible | 03:54 | |
| partlycloudy | jamesdenton: evening! just a quick update: all ovs bridges got populated after i manually added br-provider. but, something is still wrong as i am unable to reach vm floating ip from outside. qrouter on the compute node does not contain a route to the external network. | 03:57 |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible master: Convert the cinder playbook to use newer ansible syntax https://review.openstack.org/638569 | 04:02 |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible master: Convert the nova playbook to use newer ansible syntax https://review.openstack.org/638565 | 04:04 |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible master: Convert the glance playbook to use newer ansible syntax https://review.openstack.org/638568 | 04:04 |
| *** hwoarang has quit IRC | 04:15 | |
| *** hwoarang has joined #openstack-ansible | 04:17 | |
| *** markvoelker has quit IRC | 04:27 | |
| openstackgerrit | Merged openstack/openstack-ansible-os_trove master: Remove the private option from include_role https://review.openstack.org/638542 | 04:51 |
| openstackgerrit | Merged openstack/openstack-ansible-os_gnocchi master: Remove the private option from include_role https://review.openstack.org/638549 | 05:08 |
| openstackgerrit | Merged openstack/openstack-ansible-os_barbican master: Remove the private option from include_role https://review.openstack.org/638546 | 05:11 |
| *** markvoelker has joined #openstack-ansible | 05:24 | |
| *** hwoarang has quit IRC | 05:46 | |
| *** hwoarang has joined #openstack-ansible | 05:48 | |
| openstackgerrit | Merged openstack/openstack-ansible-os_magnum master: Remove the private option from include_role https://review.openstack.org/638539 | 05:57 |
| *** markvoelker has quit IRC | 05:58 | |
| *** shyamb has joined #openstack-ansible | 05:59 | |
| openstackgerrit | Merged openstack/ansible-role-python_venv_build master: Remove the private option from include_role https://review.openstack.org/638558 | 06:15 |
| *** cmart has joined #openstack-ansible | 06:15 | |
| *** rgogunskiy has joined #openstack-ansible | 06:24 | |
| *** shyamb has quit IRC | 06:26 | |
| *** shyamb has joined #openstack-ansible | 06:27 | |
| *** hwoarang has quit IRC | 06:27 | |
| *** hwoarang has joined #openstack-ansible | 06:28 | |
| *** cmart has quit IRC | 06:40 | |
| *** hwoarang has quit IRC | 06:54 | |
| *** markvoelker has joined #openstack-ansible | 06:55 | |
| *** rgogunskiy has quit IRC | 06:58 | |
| *** sdake has joined #openstack-ansible | 06:59 | |
| *** hwoarang has joined #openstack-ansible | 07:01 | |
| *** DanyC has joined #openstack-ansible | 07:02 | |
| *** kmadac has joined #openstack-ansible | 07:05 | |
| *** DanyC has quit IRC | 07:06 | |
| *** shyamb has quit IRC | 07:09 | |
| *** shyamb has joined #openstack-ansible | 07:09 | |
| *** ivve has joined #openstack-ansible | 07:14 | |
| fnpanic | hi | 07:27 |
| *** markvoelker has quit IRC | 07:28 | |
| *** cshen has joined #openstack-ansible | 07:32 | |
| *** sdake has quit IRC | 07:33 | |
| *** shyamb has quit IRC | 07:41 | |
| *** DanyC has joined #openstack-ansible | 07:47 | |
| *** kopecmartin|off is now known as kopecmartin | 08:00 | |
| *** lbragstad_ has quit IRC | 08:07 | |
| spotz | hey fnpanic | 08:11 |
| *** shyamb has joined #openstack-ansible | 08:17 | |
| *** sdake has joined #openstack-ansible | 08:17 | |
| *** markvoelker has joined #openstack-ansible | 08:25 | |
| *** fghaas has joined #openstack-ansible | 08:36 | |
| *** gshippey has joined #openstack-ansible | 08:58 | |
| *** markvoelker has quit IRC | 08:59 | |
| CeeMac | morning | 09:00 |
| *** sep has quit IRC | 09:00 | |
| CeeMac | hey fnpanic, I've been meaning to ask. Did you get your glance upload and heat dashboard issues resolved? | 09:00 |
| *** DanyC has quit IRC | 09:07 | |
| *** DanyC has joined #openstack-ansible | 09:12 | |
| *** cshen has quit IRC | 09:26 | |
| *** sdake has quit IRC | 09:26 | |
| *** shyamb has quit IRC | 09:27 | |
| *** sep has joined #openstack-ansible | 09:28 | |
| *** hamzaachi has joined #openstack-ansible | 09:30 | |
| *** ivve has quit IRC | 09:34 | |
| *** electrofelix has joined #openstack-ansible | 09:36 | |
| *** ArchiFleKs has quit IRC | 09:37 | |
| openstackgerrit | Erik Berg proposed openstack/openstack-ansible-haproxy_server stable/queens: Add 'absent' service state https://review.openstack.org/638615 | 09:47 |
| *** ArchiFleKs has joined #openstack-ansible | 09:48 | |
| openstackgerrit | Chandan Kumar proposed openstack/openstack-ansible-os_tempest master: Added dependency of os_tempest role https://review.openstack.org/632726 | 09:51 |
| chandankumar | jamesdenton: I have removed venv depends on | 09:52 |
| chandankumar | jamesdenton: due to this change https://review.openstack.org/#/c/638393/ and if we add python_venv_build as a deps to os_tempest then while loading os_tempest role, it will also execute the venv stuff I think | 09:53 |
| *** shyamb has joined #openstack-ansible | 09:54 | |
| chandankumar | jamesdenton: or due to this might happen https://github.com/openstack/ansible-role-python_venv_build/blob/master/tasks/main.yml#L18 | 09:55 |
| chandankumar | odyssey4me: Hello | 09:55 |
| *** markvoelker has joined #openstack-ansible | 09:56 | |
| chandankumar | odyssey4me: is it possible to remove always tag from here https://github.com/openstack/ansible-role-python_venv_build/blob/master/tasks/main.yml#L18 to work only when it is called otherwise or not? | 09:56 |
| *** shyam89 has joined #openstack-ansible | 10:10 | |
| openstackgerrit | Chandan Kumar proposed openstack/ansible-role-python_venv_build master: Remove always tag from preflight checking to use it as role https://review.openstack.org/638393 | 10:11 |
| *** shyamb has quit IRC | 10:12 | |
| openstackgerrit | Chandan Kumar proposed openstack/openstack-ansible-os_tempest master: Added dependency of os_tempest role https://review.openstack.org/632726 | 10:12 |
| *** phasespace has joined #openstack-ansible | 10:17 | |
| ChosSimbaOne | Hi everyone. What is recommended with setting up OpenStack with OSA towards network on Ubuntu 18.04? Is netplan the way to go, or is better to rollback to ifupdown for now? | 10:21 |
| *** markvoelker has quit IRC | 10:28 | |
| *** cshen has joined #openstack-ansible | 10:31 | |
| *** ygk_12345 has joined #openstack-ansible | 10:31 | |
| ygk_12345 | odyssey4me: Hi :) | 10:31 |
| *** shyam89 has quit IRC | 10:32 | |
| *** rgogunskiy has joined #openstack-ansible | 10:36 | |
| *** ppetit has joined #openstack-ansible | 10:45 | |
| *** shyamb has joined #openstack-ansible | 10:47 | |
| CeeMac | ChosSimbaOne, I'm using Netplan, but I'm having some weird issues if systemd is updated. | 10:47 |
| CeeMac | ChosSimbaOne, I don't believe there is an official stance one way or another, as long as the appropriate networks exist then OSA will work | 10:48 |
| ppetit | Hi there | 10:48 |
| ppetit | Just installed vanilla aio with tag 18.1.4 and getting an error when trying to create an instance on a volume. Anybody seeing that? | 10:50 |
| ppetit | The error is in Cinder | 10:51 |
| ppetit | Feb 22 10:36:11 aio1 cinder-volume[937]: 2019-02-22 10:36:11.543 937 ERROR cinder.volume.targets.iscsi [req-1dcd3e97-75a3-44eb-8a03-6b695c8b06e8 19f38998db2a42d1827fbffcc9e24da6 b4b37290ef0149908b8465d228b6d2c8 - default default] The volume driver requires the iSCSI initiator name in the connector. | 10:51 |
| ppetit | Although I can create a volume independently with non problem. I can create an instance with local storage with no problem too. | 10:52 |
| *** shardy has joined #openstack-ansible | 10:54 | |
| ChosSimbaOne | CeeMac, Thank you for the explanation, I will dive into bridgeing with netplan then :-) | 10:57 |
| CeeMac | good luck! | 10:57 |
| CeeMac | its actually pretty straight forward once you understand the formatting :) | 10:58 |
| *** udesale has quit IRC | 10:59 | |
| ChosSimbaOne | cool, otherwise I will come crying to you :-) | 11:02 |
| CeeMac | haha, fair enough :) | 11:04 |
| *** shardy has quit IRC | 11:06 | |
| *** macza has joined #openstack-ansible | 11:09 | |
| *** sdake has joined #openstack-ansible | 11:11 | |
| *** tosky has joined #openstack-ansible | 11:12 | |
| *** macza has quit IRC | 11:14 | |
| *** markvoelker has joined #openstack-ansible | 11:25 | |
| *** shyamb has quit IRC | 11:31 | |
| *** ygk_12345 has quit IRC | 11:33 | |
| *** hamzaachi has quit IRC | 11:37 | |
| *** priteau has joined #openstack-ansible | 11:46 | |
| chandankumar | odyssey4me: around? | 11:52 |
| chandankumar | need some help on using python_venv_build as a os_tempest deps | 11:52 |
| openstackgerrit | Chandan Kumar proposed openstack/openstack-ansible-os_tempest master: Added dependency of os_tempest role https://review.openstack.org/632726 | 11:53 |
| openstackgerrit | Chandan Kumar proposed openstack/openstack-ansible-os_tempest master: use tempest_run_stackviz to generate stackviz report https://review.openstack.org/638360 | 11:57 |
| *** shyamb has joined #openstack-ansible | 11:57 | |
| *** markvoelker has quit IRC | 11:59 | |
| *** cshen has quit IRC | 12:01 | |
| *** flaviosr has quit IRC | 12:03 | |
| *** sdake has quit IRC | 12:03 | |
| *** sum12 has quit IRC | 12:03 | |
| *** sdake_ has joined #openstack-ansible | 12:05 | |
| *** ppetit has quit IRC | 12:07 | |
| *** cshen has joined #openstack-ansible | 12:08 | |
| *** udesale has joined #openstack-ansible | 12:16 | |
| *** sum12 has joined #openstack-ansible | 12:18 | |
| *** shyamb has quit IRC | 12:22 | |
| *** flaviosr has joined #openstack-ansible | 12:22 | |
| *** DanyC has quit IRC | 12:22 | |
| *** phasespace has quit IRC | 12:26 | |
| *** priteau has quit IRC | 12:31 | |
| *** priteau has joined #openstack-ansible | 12:31 | |
| *** shyamb has joined #openstack-ansible | 12:33 | |
| *** ivve has joined #openstack-ansible | 12:35 | |
| *** priteau has quit IRC | 12:36 | |
| *** priteau has joined #openstack-ansible | 12:39 | |
| *** ppetit has joined #openstack-ansible | 12:41 | |
| CeeMac | cloudnull, you around? | 12:53 |
| *** DanyC has joined #openstack-ansible | 12:54 | |
| *** markvoelker has joined #openstack-ansible | 12:56 | |
| *** shyamb has quit IRC | 12:56 | |
| *** hamzaachi has joined #openstack-ansible | 13:09 | |
| *** strattao has joined #openstack-ansible | 13:17 | |
| *** dave-mccowan has joined #openstack-ansible | 13:18 | |
| *** strattao has quit IRC | 13:21 | |
| openstackgerrit | Chandan Kumar proposed openstack/openstack-ansible-os_tempest master: Added dependency of os_tempest role https://review.openstack.org/632726 | 13:22 |
| openstackgerrit | Chandan Kumar proposed openstack/openstack-ansible-os_tempest master: Added dependency of os_tempest role https://review.openstack.org/632726 | 13:23 |
| *** udesale has quit IRC | 13:25 | |
| *** markvoelker has quit IRC | 13:28 | |
| *** hamzy has quit IRC | 13:35 | |
| *** hamzy has joined #openstack-ansible | 13:40 | |
| *** udesale has joined #openstack-ansible | 13:41 | |
| *** dave-mccowan has quit IRC | 13:43 | |
| *** dave-mccowan has joined #openstack-ansible | 13:44 | |
| *** ArchiFleKs has quit IRC | 13:46 | |
| *** strattao has joined #openstack-ansible | 13:49 | |
| *** ArchiFleKs has joined #openstack-ansible | 13:49 | |
| *** sdake_ has quit IRC | 13:51 | |
| *** hamzaachi has quit IRC | 13:59 | |
| *** hamzaachi has joined #openstack-ansible | 14:00 | |
| CeeMac | evrardjp, you around? | 14:04 |
| *** dave-mccowan has quit IRC | 14:05 | |
| *** hamzaachi has quit IRC | 14:05 | |
| *** lbragstad_ has joined #openstack-ansible | 14:05 | |
| *** hamzaachi has joined #openstack-ansible | 14:06 | |
| *** lbragstad_ is now known as lbragstad | 14:07 | |
| *** hamzaachi has quit IRC | 14:07 | |
| *** hamzaachi has joined #openstack-ansible | 14:08 | |
| evrardjp | yes | 14:08 |
| evrardjp | how can I help? | 14:08 |
| *** hamzaachi has quit IRC | 14:09 | |
| *** hamzaachi has joined #openstack-ansible | 14:09 | |
| *** hamzaachi has quit IRC | 14:11 | |
| *** hamzaachi has joined #openstack-ansible | 14:11 | |
| CeeMac | hey | 14:12 |
| CeeMac | was just looking at an old bug youd commited around customizing horizon | 14:13 |
| *** hamzaachi has quit IRC | 14:13 | |
| CeeMac | and wondered if you'd come across a way to override the favicon in a similar way? | 14:13 |
| *** hamzaachi has joined #openstack-ansible | 14:13 | |
| CeeMac | evrardjp, ^ | 14:14 |
| *** hamzaachi has quit IRC | 14:15 | |
| *** hamzaachi has joined #openstack-ansible | 14:15 | |
| *** hamzaachi has quit IRC | 14:17 | |
| *** hamzaachi has joined #openstack-ansible | 14:17 | |
| *** sdake has joined #openstack-ansible | 14:18 | |
| *** hamzaachi has quit IRC | 14:18 | |
| *** hamzaachi has joined #openstack-ansible | 14:19 | |
| jamesdenton | CeeMac Looks sorta relevant: https://chr4.org/blog/2019/01/21/make-keepalived-play-nicely-with-netplan-slash-systemd-network/ | 14:20 |
| *** hamzaachi has quit IRC | 14:20 | |
| CeeMac | hi jamesdenton good find, i'll take a look | 14:20 |
| *** hamzaachi has joined #openstack-ansible | 14:20 | |
| *** hamzaachi has quit IRC | 14:21 | |
| *** hamzaachi has joined #openstack-ansible | 14:22 | |
| *** rgogunskiy has quit IRC | 14:22 | |
| *** hamzaachi has quit IRC | 14:23 | |
| *** hamzaachi has joined #openstack-ansible | 14:24 | |
| *** priteau has quit IRC | 14:25 | |
| *** hamzaachi has quit IRC | 14:25 | |
| *** hamzaachi has joined #openstack-ansible | 14:25 | |
| CeeMac | jamesdenton, looks promising | 14:25 |
| *** markvoelker has joined #openstack-ansible | 14:25 | |
| CeeMac | jamesdenton, how to implement the keepalived config in osa though? | 14:26 |
| CeeMac | i'm guessing there is no config template for keepalives.conf? | 14:26 |
| *** hamzaachi has quit IRC | 14:27 | |
| jamesdenton | There ought to be when multiple haproxy nodes are involved | 14:27 |
| CeeMac | an override? | 14:27 |
| *** hamzaachi has joined #openstack-ansible | 14:27 | |
| CeeMac | oh, this one...... haproxy_keepalived_external_interface: | 14:28 |
| jamesdenton | /etc/ansible/roles/keepalived/templates/keepalived.conf.j2 | 14:28 |
| *** hamzaachi has quit IRC | 14:29 | |
| *** hamzaachi has joined #openstack-ansible | 14:29 | |
| *** dxiri has joined #openstack-ansible | 14:30 | |
| *** hamzaachi has quit IRC | 14:30 | |
| CeeMac | yeah, looks like haproxy_keepalived_external_interface would cover it | 14:31 |
| *** hamzaachi has joined #openstack-ansible | 14:31 | |
| CeeMac | i'll give that a go | 14:31 |
| jamesdenton | k | 14:31 |
| CeeMac | hmm | 14:31 |
| CeeMac | guess i'd need 2? | 14:31 |
| jamesdenton | yeah | 14:31 |
| CeeMac | one for internal. one for external | 14:31 |
| CeeMac | haproxy_keepalived_internal_interface also works then | 14:32 |
| *** hamzaachi has quit IRC | 14:32 | |
| CeeMac | sweet, hopefully that's one issues resolved | 14:32 |
| *** hamzaachi has joined #openstack-ansible | 14:32 | |
| jamesdenton | keep us posted | 14:32 |
| CeeMac | its starting to look like it might be worth migrating to pure systemd-networkd and skip netplan...... maybe.... | 14:33 |
| jamesdenton | that's your best bet, honestly | 14:33 |
| *** hamzaachi has quit IRC | 14:33 | |
| *** hamzaachi has joined #openstack-ansible | 14:34 | |
| *** hamzaachi has quit IRC | 14:36 | |
| *** hamzaachi has joined #openstack-ansible | 14:36 | |
| *** hamzaachi has quit IRC | 14:38 | |
| *** dave-mccowan has joined #openstack-ansible | 14:38 | |
| *** hamzaachi has joined #openstack-ansible | 14:38 | |
| *** priteau has joined #openstack-ansible | 14:39 | |
| *** hamzaachi has quit IRC | 14:40 | |
| *** hamzaachi has joined #openstack-ansible | 14:40 | |
| *** hamzaachi has quit IRC | 14:42 | |
| *** hamzaachi has joined #openstack-ansible | 14:42 | |
| *** sdake has quit IRC | 14:43 | |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-os_keystone master: Remove the private option from include_role https://review.openstack.org/638538 | 14:43 |
| *** hamzaachi has quit IRC | 14:45 | |
| cloudnull | mornings all | 14:45 |
| *** sdake has joined #openstack-ansible | 14:45 | |
| guilhermesp | guten tag cloudnull ! | 14:45 |
| *** hamzaachi has joined #openstack-ansible | 14:45 | |
| spotz | bon joir | 14:47 |
| cloudnull | hows it ? | 14:49 |
| CeeMac | morning | 14:52 |
| CeeMac | jamesdenton, ran into an issue | 14:52 |
| CeeMac | i've created the 2 dummy interfaces, and if I manually add an IP its fine | 14:52 |
| CeeMac | but if I take the IPs off, updated the user_variables and re-run the playbook. the conf file is updated correctly but keepalived "cannot find an ip address to use" for the dummy interface | 14:53 |
| *** strattao has quit IRC | 14:55 | |
| jamesdenton | hum | 14:55 |
| CeeMac | also, if i add the IPs manually, and restart the service, kernel reports the interfaces down and VRRP goes into a fault state | 14:56 |
| *** markvoelker has quit IRC | 14:59 | |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-ops master: Add playbook to link logs into the gate job location https://review.openstack.org/591117 | 14:59 |
| CeeMac | oh, i see | 15:01 |
| jamesdenton | hi cloudnull | 15:01 |
| jamesdenton | CeeMac find something? | 15:01 |
| cloudnull | o/ jamesdenton | 15:01 |
| CeeMac | it looks like in his setup, the main interface is still configured for the physical nic, just the virtual_ipaddress is bound to the dummy | 15:02 |
| CeeMac | the interface override in OSA replace both references | 15:02 |
| CeeMac | thats the logical extrapolation of his blog anyway, nothing concrete to say thats true | 15:03 |
| CeeMac | but he doesn't explicitly change the interface knob so we can assume its still the physical interface | 15:03 |
| *** hamzaachi has quit IRC | 15:03 | |
| *** hamzaachi has joined #openstack-ansible | 15:04 | |
| jamesdenton | yeah, i read it as the master interface was left as-is and only the vip moved to the dummy interface | 15:04 |
| CeeMac | cloudnull, incidentally, i was totally lying yesterday apparently. There was a cinder_cinder_conf_overrides in user_variables :( | 15:04 |
| CeeMac | cloudnull, so i moved that across to openstack_user_config and its all working now :D | 15:04 |
| jamesdenton | CeeMac can you share your keepalived.conf? | 15:04 |
| CeeMac | sure | 15:04 |
| CeeMac | the reverted version or the revised one with dummy? | 15:05 |
| *** hamzaachi has quit IRC | 15:05 | |
| *** hamzaachi has joined #openstack-ansible | 15:06 | |
| jamesdenton | the revised one | 15:06 |
| *** vollman has joined #openstack-ansible | 15:06 | |
| openstackgerrit | Chandan Kumar proposed openstack/openstack-ansible-os_tempest master: use tempest_run_stackviz to generate stackviz report https://review.openstack.org/638360 | 15:07 |
| CeeMac | let me push that back out again real quick | 15:07 |
| *** strattao has joined #openstack-ansible | 15:07 | |
| *** hamzaachi has quit IRC | 15:07 | |
| *** hamzaachi has joined #openstack-ansible | 15:08 | |
| *** shananigans has joined #openstack-ansible | 15:08 | |
| *** hamzaachi has quit IRC | 15:09 | |
| *** ArchiFleKs has quit IRC | 15:09 | |
| *** hamzaachi has joined #openstack-ansible | 15:09 | |
| cloudnull | CeeMac nice! at least it wasn't something I broke with the tooling :) | 15:10 |
| CeeMac | cloudnull, :D | 15:10 |
| *** ArchiFleKs has joined #openstack-ansible | 15:10 | |
| *** hamzaachi has quit IRC | 15:11 | |
| *** hamzaachi has joined #openstack-ansible | 15:11 | |
| fnpanic | hi | 15:11 |
| CeeMac | hey fnpanic | 15:12 |
| fnpanic | how can i modify the local_settings.py of the horizon container? | 15:12 |
| CeeMac | carefully ;) | 15:12 |
| fnpanic | i see in the role a j2 template for the file | 15:12 |
| *** hamzaachi has quit IRC | 15:12 | |
| CeeMac | which bits are you trying to change? | 15:12 |
| fnpanic | but how can i add something which is picked up by osa? | 15:12 |
| fnpanic | mom | 15:12 |
| cloudnull | we seem to be running into quite a few of these recently - http://logs.openstack.org/47/638547/1/gate/openstack-ansible-functional-opensuse-423/7ec16b6/job-output.txt.gz#_2019-02-22_15_04_59_341959 - do we know if the there's something going on with the mirrors? | 15:12 |
| *** hamzaachi has joined #openstack-ansible | 15:13 | |
| cloudnull | fnpanic mpm with apache? | 15:13 |
| CeeMac | thats beyond me, sorry | 15:13 |
| fnpanic | #OPENSTACK_IMAGE_BACKEND = | 15:14 |
| fnpanic | i just want to narrow down the lis to avaiable image formats | 15:14 |
| *** hamzaachi has quit IRC | 15:15 | |
| cloudnull | fnpanic https://github.com/openstack/openstack-ansible-os_horizon/blob/master/templates/horizon_local_settings.py.j2#L353-L371 - sadly it doesn't look like we have a template for that | 15:15 |
| *** hamzaachi has joined #openstack-ansible | 15:15 | |
| cloudnull | you can modify it in your local template. | 15:15 |
| fnpanic | cloudnull: the mpm worker and apache | 15:15 |
| CeeMac | jamesdenton, here is the keepalived.conf http://paste.openstack.org/show/745734/ and the user_variables http://paste.openstack.org/show/745735/ | 15:16 |
| cloudnull | and if that's something that folks would find useful I'd be +2 on getting that upstream | 15:16 |
| *** hamzaachi has quit IRC | 15:16 | |
| *** hamzaachi has joined #openstack-ansible | 15:17 | |
| fnpanic | cloudnull: ok so i will take a look and see if my skill is sufficent to provide a patch for this | 15:17 |
| fnpanic | changing the local template is not fun | 15:17 |
| cloudnull | fnpanic I dont recall having something available that specifically provides for tuning of apache2. | 15:18 |
| CeeMac | fnpanic, did you get the image upload to work the other week? | 15:18 |
| *** hamzaachi has quit IRC | 15:18 | |
| *** udesale has quit IRC | 15:18 | |
| *** hamzaachi has joined #openstack-ansible | 15:18 | |
| cloudnull | I know there has been talk about using external roles for apache installation and setup, though idk if that ever got any traction. | 15:18 |
| fnpanic | ceeMac: Yes! | 15:18 |
| fnpanic | remote solved it :-) | 15:19 |
| openstackgerrit | Merged openstack/openstack-ansible-rabbitmq_server master: Remove the private option from include_role https://review.openstack.org/638559 | 15:19 |
| fnpanic | i am not sure if this is the correct way because i guess it has to do with the default cors config | 15:19 |
| fnpanic | ceemac: but thank you very much! | 15:19 |
| *** hamzaachi has quit IRC | 15:19 | |
| *** hamzaachi has joined #openstack-ansible | 15:20 | |
| CeeMac | fnpanic, if you find a better / more appropriate way let me know :) | 15:20 |
| jamesdenton | CeeMac are 172.17.254.100/24 and 10.1.211.100/24 dedicated VIP addresses? | 15:20 |
| CeeMac | jamesdenton, yep | 15:20 |
| fnpanic | ceemac: will do :-) | 15:20 |
| CeeMac | fnpanic, how about the heat service in dashboard? | 15:20 |
| CeeMac | in system ingo | 15:20 |
| fnpanic | not fixed | 15:20 |
| fnpanic | still missing | 15:20 |
| CeeMac | boo :( | 15:20 |
| fnpanic | :-( | 15:20 |
| CeeMac | have you had any luck finding any logs that might suggest where the issue is? | 15:21 |
| jamesdenton | CeeMac And you're saying that keepalived is not binding the IP to the dummy interface? as his blog suggests? | 15:21 |
| CeeMac | correct | 15:21 |
| *** hamzaachi has quit IRC | 15:21 | |
| *** sdake has quit IRC | 15:21 | |
| *** hamzaachi has joined #openstack-ansible | 15:22 | |
| jamesdenton | are they still currently bound an interface? maybe removing them will help? Or maybe it doesn't like that the interface is in a DOWN state | 15:22 |
| cloudnull | fnpanic for the local horizon template modification I guess we could do something like https://pasted.tech/pastes/a2215756c72f2cb664063359d8a731166efc4ffc that way it'd keep the default and use whatever the user defines as an override. | 15:22 |
| CeeMac | jamesdenton, http://paste.openstack.org/show/745737/ | 15:22 |
| *** sdake has joined #openstack-ansible | 15:22 | |
| CeeMac | i think the problem is in the "interface" knob in keepalived | 15:23 |
| *** hamzaachi has quit IRC | 15:23 | |
| CeeMac | i think if I changed that manually back to the phys it will work | 15:23 |
| chandankumar | cloudnull: Hello | 15:23 |
| *** hamzaachi has joined #openstack-ansible | 15:23 | |
| chandankumar | cloudnull: is there a way to disable this https://github.com/openstack/ansible-role-python_venv_build/blob/master/tasks/python_venv_preflight.yml#L17 | 15:23 |
| jamesdenton | CeeMac can you make them /32s? | 15:23 |
| CeeMac | jamesdenton, IP not bound elsewhere currentl | 15:23 |
| chandankumar | when this role is installed? | 15:23 |
| CeeMac | jamesdenton, tried both ways | 15:24 |
| *** hamzaachi has quit IRC | 15:24 | |
| jamesdenton | how about also set 'ip link set keepalived0 up' | 15:24 |
| *** hamzaachi has joined #openstack-ansible | 15:25 | |
| *** hamzaachi has quit IRC | 15:26 | |
| *** hamzaachi has joined #openstack-ansible | 15:26 | |
| *** priteau has quit IRC | 15:27 | |
| CeeMac | both interfaces now up | 15:27 |
| CeeMac | Keepalived_vrrp[15746]: (internal): Cannot find an IP address to use for interface keepalived0 | 15:27 |
| CeeMac | then it falls over | 15:28 |
| *** hamzaachi has quit IRC | 15:28 | |
| *** hamzaachi has joined #openstack-ansible | 15:28 | |
| CeeMac | dummy interfaces in UNKNOWN state | 15:28 |
| CeeMac | if I set the "interface" knob for the physcial interface, the IP gets set on the dummy, but keepalived errors out with garp problems | 15:29 |
| jamesdenton | try to remove interface | 15:29 |
| CeeMac | I'll try that first, then i'll set it back to phys now that the dummys are up | 15:29 |
| *** hamzaachi has quit IRC | 15:29 | |
| *** hamzaachi has joined #openstack-ansible | 15:30 | |
| CeeMac | Keepalived_vrrp[15802]: VRRP_Instance(internal) Unknown interface ! | 15:30 |
| CeeMac | haha | 15:30 |
| jamesdenton | heh | 15:30 |
| *** dxiri has quit IRC | 15:30 | |
| CeeMac | ooooooo | 15:31 |
| CeeMac | http://paste.openstack.org/show/745738/ | 15:32 |
| CeeMac | so, the interface has to be set as physical, the vip as the dummy, and thedummys need to be not down | 15:32 |
| jamesdenton | k | 15:32 |
| jamesdenton | is it working? | 15:32 |
| CeeMac | look at the paste :) | 15:32 |
| jamesdenton | right, sorry. i meant traffic | 15:32 |
| CeeMac | haha, yeah, sorry, just being cheeky :p | 15:33 |
| jamesdenton | :D | 15:33 |
| CeeMac | yep | 15:33 |
| CeeMac | i'm into the dashboard and can browse around | 15:33 |
| jamesdenton | try pinging the VIP(s) with you restart systemd-networkd and netplan apply | 15:34 |
| *** hamzaachi has quit IRC | 15:34 | |
| jamesdenton | if this is 'fixed' in keepalived 2.0.x, that seems like the better approach | 15:35 |
| openstackgerrit | Merged openstack/openstack-ansible-lxc_hosts master: Allow containers to remount volumes when needed https://review.openstack.org/636755 | 15:35 |
| CeeMac | no pings dropped after restart | 15:36 |
| CeeMac | or netplan apply | 15:36 |
| CeeMac | how to convert that to workable override variables though? | 15:36 |
| CeeMac | so you'd need an interface and monitored interface pair for both internal and external | 15:37 |
| CeeMac | monitored interface being the vip | 15:37 |
| jamesdenton | There really isn't a mechanism for that, afaik | 15:39 |
| jamesdenton | You might start by filing a bug, filling in the details of how you came to find the issue, how you resolved it, and maybe evrardjp can tweak the role to support that. Or keepalived 2.0.x might be the answer | 15:41 |
| cloudnull | chandankumar i dont think so | 15:41 |
| cloudnull | what are you seeing? | 15:41 |
| evrardjp | sorry I was pulled into different things | 15:42 |
| chandankumar | cloudnull: https://review.openstack.org/#/c/638393/ i removed the always tag but it does not worked | 15:42 |
| chandankumar | now I am getting venv_path not defined | 15:43 |
| chandankumar | we need something different there | 15:43 |
| evrardjp | reading the backlog I don't find the issue yet | 15:43 |
| * chandankumar not sure | 15:43 | |
| evrardjp | I mean the original issue I was pinged for :p | 15:44 |
| cloudnull | chandankumar didnt you have a pr to set that path by default ? | 15:44 |
| chandankumar | cloudnull: when we define the path, it will start creating venv https://github.com/openstack/ansible-role-python_venv_build/blob/master/tasks/python_venv_install.yml#L60 | 15:45 |
| *** cmart has joined #openstack-ansible | 15:45 | |
| chandankumar | cloudnull: where it got failed | 15:45 |
| chandankumar | cloudnull: yes, I had the patch, it started failing so worked on removing tag | 15:46 |
| jamesdenton | CeeMac Do you have multiple keepalived/haproxy instances? Or just this one? | 15:46 |
| CeeMac | jamesdenton, I'll fill out a bug for this | 15:46 |
| cloudnull | chandankumar ah | 15:46 |
| CeeMac | just one for now, I'll be putting a second one in next week, been trying to "stablise" the deployment first | 15:46 |
| chandankumar | cloudnull: sorry I pinged as how I can use venv-python-build as a deps for os_tempest https://review.openstack.org/#/c/632726/ | 15:47 |
| chandankumar | evrardjp: ^^ | 15:47 |
| CeeMac | just got second compute node in today, with both connected to our iscsi backend | 15:47 |
| CeeMac | then I'll roll through the rest of the nodes doubling up the hosts | 15:47 |
| CeeMac | inf containers are already HA x3 , just one a single host | 15:47 |
| *** lbragstad is now known as elbragstad | 15:47 | |
| CeeMac | depends when keepalive2 2 gets rolled into the distro i guess? | 15:48 |
| jamesdenton | yeah, it's in 19.04 now | 15:48 |
| CeeMac | ah, ok | 15:49 |
| chandankumar | cloudnull: one more thing regarding heat tests https://review.openstack.org/632021 and https://review.openstack.org/630695 to merge in a single patch as it is blocked on getting the correct endpoint from heat i think jrosser is working on that | 15:50 |
| CeeMac | so its coming then | 15:50 |
| CeeMac | evrardjp, did you have any thoughts around favicon deployment in horizon config overrides? | 15:50 |
| jamesdenton | I would also be interested in seeing the behavior with multiple keepalived nodes | 15:50 |
| cloudnull | chandankumar im not sure about that | 15:51 |
| jrosser | chandankumar: i think that the your patches make the tempest heat tests work properly. i also think they reveal an underlying problem which makes the tests fail | 15:51 |
| chandankumar | jrosser: but if we merge the heat tests and config is not there any way it is going to fail | 15:52 |
| evrardjp | CeeMac: you can upload any file | 15:52 |
| CeeMac | jamesdenton, i'll make haproxy second node my next rollout, which will either be monday or wednesday | 15:52 |
| CeeMac | evrardjp, through the custom theme override variables? | 15:52 |
| chandankumar | jrosser: if you want to debug I will get a system on monday ready with metal heat scenario | 15:53 |
| evrardjp | CeeMac: yeah, or horizon_custom_uploads | 15:53 |
| chandankumar | jrosser: evrardjp https://review.openstack.org/638383 good to go | 15:54 |
| jrosser | chandankumar: so there is this http://lists.openstack.org/pipermail/openstack-discuss/2019-February/002925.html | 15:54 |
| CeeMac | evrardjp, so the 2 examples used for logo and logo-splash can be extended to any file? | 15:55 |
| jrosser | chandankumar: and this really needs to merge ASAP https://review.openstack.org/#/c/638511/ | 15:55 |
| jrosser | becasue that is a big mess right now | 15:55 |
| *** markvoelker has joined #openstack-ansible | 15:56 | |
| openstackgerrit | Chandan Kumar proposed openstack/openstack-ansible-os_heat master: [DNM] heat tempest tests finding https://review.openstack.org/630694 | 15:56 |
| evrardjp | CeeMac: yeah? | 15:56 |
| evrardjp | I mean | 15:57 |
| evrardjp | why wouldn't it? | 15:57 |
| evrardjp | :D | 15:57 |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-tests master: Set opensuse jobs to non-voting https://review.openstack.org/638697 | 15:58 |
| CeeMac | haha | 15:58 |
| CeeMac | guess I just took it be literal in that that was all it was doing | 15:58 |
| CeeMac | but thats pretty neat :D | 15:59 |
| *** kopecmartin is now known as kopecmartin|off | 16:06 | |
| spotz | cloudnull: gates broke again? | 16:09 |
| cloudnull | sadly the suse gates are failing at the moment, seems to be a bad mirror in the mix | 16:09 |
| cloudnull | some work, some fail :'( | 16:09 |
| spotz | evrardjp: https://review.openstack.org/638697 | 16:10 |
| spotz | cloudnull: It conflicts with https://review.openstack.org/#/c/608102/11 | 16:10 |
| cloudnull | that's ok . prometheanfire can rebase :) | 16:10 |
| *** cshen has quit IRC | 16:11 | |
| cloudnull | once all his dependent patches merge :P | 16:11 |
| spotz | hehehe | 16:13 |
| evrardjp | CeeMac: it might have been my first OSA patch | 16:13 |
| evrardjp | history! | 16:14 |
| cloudnull | ancient history :) | 16:14 |
| spotz | hehehe | 16:15 |
| CeeMac | evrardjp, nice :D | 16:15 |
| evrardjp | cloudnull: did you ping nicolasbock about that issue? | 16:16 |
| cloudnull | I've not | 16:16 |
| cloudnull | nicolasbock ping :D | 16:16 |
| cloudnull | 09:12 <cloudnull> we seem to be running into quite a few of these recently - http://logs.openstack.org/47/638547/1/gate/openstack-ansible-functional-opensuse-423/7ec16b6/job-output.txt.gz#_2019-02-22_15_04_59_341959 - do we know if the there's something going on with the mirrors? | 16:17 |
| cloudnull | evrardjp its a very intermittent failure sadly | 16:17 |
| cloudnull | seeing the same kinda thing on both 423 and 150 | 16:17 |
| *** cmart has quit IRC | 16:18 | |
| prometheanfire | wat | 16:19 |
| prometheanfire | cloudnull: ya, I'd like to get some of my stuff merged so I can start publishing binpkgs and get the gate time down enough | 16:20 |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-os_neutron master: Remove the private option from include_role https://review.openstack.org/638552 | 16:20 |
| prometheanfire | so... people need to vote https://review.openstack.org/#/q/topic:add-gentoo-support+status:open | 16:20 |
| *** cmart has joined #openstack-ansible | 16:24 | |
| CeeMac | jamesdenton, https://bugs.launchpad.net/openstack-ansible/+bug/1817343 | 16:24 |
| openstack | Launchpad bug 1817343 in openstack-ansible "keepalived loses VIP on netplan apply or systemd restart/upgrade " [Undecided,New] | 16:24 |
| jamesdenton | bueno | 16:25 |
| cloudnull | ^ death to netplan, networkd for the win! | 16:27 |
| cloudnull | :P | 16:27 |
| cloudnull | long live ifcfg scripts! | 16:28 |
| * cloudnull done making helper comments and goes to get more coffee | 16:28 | |
| evrardjp | cloudnull: wasn't that a repo hwoarang had? | 16:28 |
| bgmccollum | gotta ifup to get ifdown | 16:28 |
| *** markvoelker has quit IRC | 16:28 | |
| evrardjp | or | 16:28 |
| cloudnull | evrardjp maybe ? i dont really remember | 16:29 |
| evrardjp | gotta to ifup ifdown? | 16:29 |
| bgmccollum | gotta get up to get down | 16:29 |
| CeeMac | cloudnull, I may be a convert | 16:29 |
| bgmccollum | bad joke | 16:29 |
| evrardjp | bgmccollum: I smiled anyway! | 16:29 |
| CeeMac | was that a 5ive reference >_> | 16:30 |
| *** macza has joined #openstack-ansible | 16:31 | |
| jamesdenton | bgmccollum I, too, like Genesis | 16:31 |
| cloudnull | https://www.youtube.com/watch?v=qZUn-KtTNmA | 16:31 |
| bgmccollum | jamesdenton i thought it was Coolio haha | 16:31 |
| *** fghaas has quit IRC | 16:31 | |
| cloudnull | you're all welcome :) | 16:31 |
| CeeMac | i thought you were cool :p | 16:32 |
| jamesdenton | lol it could be. For Genesis it's "gotta get in to get out" | 16:32 |
| spotz | heheh | 16:32 |
| *** DanyC has quit IRC | 16:33 | |
| *** DanyC has joined #openstack-ansible | 16:33 | |
| openstackgerrit | Guilherme Steinmuller Pimentel proposed openstack/openstack-ansible-os_magnum master: Add magnum_user_pip_packages variable https://review.openstack.org/638232 | 16:33 |
| openstackgerrit | Guilherme Steinmuller Pimentel proposed openstack/openstack-ansible-os_magnum master: Add magnum_user_pip_packages variable https://review.openstack.org/638232 | 16:34 |
| *** ppetit has quit IRC | 16:38 | |
| CeeMac | i'm out guys. Have a great weekend everyone :D | 16:38 |
| openstackgerrit | Guilherme Steinmuller Pimentel proposed openstack/openstack-ansible-os_glance master: Add glance_user_pip_packages variable https://review.openstack.org/638229 | 16:38 |
| *** gyee has joined #openstack-ansible | 16:40 | |
| cloudnull | take care CeeMac | 16:40 |
| NobodyCam | good morning OSA folks, Happy Friday | 16:42 |
| cloudnull | o/ | 16:42 |
| NobodyCam | hey hey cloudnull Again thank you for the pointers yesterday | 16:42 |
| cloudnull | anytime :) | 16:42 |
| NobodyCam | Would you mind another question? | 16:43 |
| NobodyCam | I seem to be hitting a issue in setup_hosts playbook | 16:44 |
| NobodyCam | I get to `TASK [lxc_container_create : Gather container facts]` | 16:45 |
| NobodyCam | then `fatal: [Openstack01_keystone_container-f6ed4c4c]: UNREACHABLE! => {"changed": false, "msg": "SSH Error: data could not be sent to remote host \"Openstack01_keystone_container-f6ed4c4c\". Make sure this host can be reached over ssh", "unreachable": true}` | 16:45 |
| NobodyCam | for all containers | 16:45 |
| *** dcdamien has joined #openstack-ansible | 16:45 | |
| *** spatel has joined #openstack-ansible | 16:46 | |
| cloudnull | NobodyCam running `openstack-ansible setup-hosts.yml` | 16:47 |
| *** DanyC has quit IRC | 16:47 | |
| NobodyCam | yes | 16:47 |
| cloudnull | are the containers running? | 16:48 |
| cloudnull | if you run lxc-ls -f | 16:48 |
| cloudnull | do you see the containers running and with IP addresses? | 16:48 |
| *** DanyC has joined #openstack-ansible | 16:49 | |
| NobodyCam | they are running but no IP | 16:51 |
| evrardjp | jamesdenton: I thought it was genesis too | 16:51 |
| *** DanyC has quit IRC | 16:51 | |
| evrardjp | sorry peter gabriel | 16:51 |
| evrardjp | but I am learning | 16:52 |
| *** DanyC has joined #openstack-ansible | 16:52 | |
| cloudnull | NobodyCam I'd suspect lxc-dnsmasq isn't running or something is wrong with the bridges | 16:52 |
| nicolasbock | <freenode_clo "nicolasbock ping :D"> Interesting, I'll have a look | 16:52 |
| evrardjp | I am glad to see jamesdenton and I seem to have the same music background :p | 16:52 |
| *** iurygregory has quit IRC | 16:53 | |
| antonym | NobodyCam: i've found sometimes you have to restart lxc-dnsmasq and restart all the containers, especially if you are doing an upgrade | 16:53 |
| evrardjp | nicolasbock: yeah I will have to go soon | 16:53 |
| jrosser | cloudnull: curious message, does that task actually need an ip etc with the connection plugin? | 16:53 |
| *** mgariepy has joined #openstack-ansible | 16:53 | |
| bgmccollum | cloudnull to circle back regarding cinder loop mounting, i could never get it to reliably work. | 16:53 |
| NobodyCam | let me see if I can them going | 16:53 |
| evrardjp | nicolasbock: apparently there is some galera package that's not available for suse -- it would be to dig into the role that fails, see which mirror it is using, and see if that is still okay | 16:53 |
| nicolasbock | Ok | 16:54 |
| cloudnull | jrosser youre right it shouldn't need network connectivity | 16:54 |
| cloudnull | the connection plugin should handle that for us | 16:57 |
| cloudnull | NobodyCam maybe you can't ssh to the physical hosst from where you're executing the playbooks ? | 16:58 |
| cloudnull | bgmccollum :'( | 16:58 |
| jrosser | antonym: if your container networking has got messed up you can try lxc-veth-check which is a bit less intrusive that restarting them all | 16:58 |
| jrosser | it should try to rewire and veth -> bridge connections that have gone AWOL | 16:58 |
| bgmccollum | cloudnull i didnt have much time to troubleshoot it...finally have a bit of time now | 16:58 |
| *** evrardjp is now known as gatersaregonnaga | 16:58 | |
| antonym | jrosser: ah, interesting, good to know, yeah it mainly would manifest when upgrading i think from ocata to pike... whenever it made the transition to lxc-dnsmasq | 16:59 |
| antonym | it would usually manifest as apt being unable to resolv | 16:59 |
| *** vnogin has joined #openstack-ansible | 16:59 | |
| *** gatersaregonnaga is now known as evrardjp | 17:00 | |
| jrosser | antonym: here is where that script comes from https://github.com/openstack/openstack-ansible-lxc_hosts/blob/master/files/lxc-veth-check.sh | 17:01 |
| jrosser | might not help fix a broken dnsmasq, but restarting that, then lxc-veth-check should be good enough most of the time | 17:02 |
| antonym | yeah, if that works it would def be less intrusive | 17:03 |
| jrosser | jamesdenton: did we ever come to a conclusion on this? http://logs.openstack.org/31/632131/2/check/openstack-ansible-functional-ubuntu-xenial/9d50944/job-output.txt.gz#_2019-02-15_19_30_55_387718 | 17:07 |
| jrosser | same error, different role test | 17:07 |
| jrosser | this time it is on xenial (not sure why?) but i'd have expected the container eth0 to forward on the host for that address | 17:08 |
| *** cmart has quit IRC | 17:09 | |
| bgmccollum | cloudnull -- looking at the systemd man page, it says "After=" should contain a space separated list of units...but the systemd-service role write each unit with its own "After=" line...are both syntaxes supported, or are we doing it wrong? | 17:17 |
| cloudnull | bgmccollum both syntaxes should be supported | 17:21 |
| bgmccollum | hrm... | 17:22 |
| bgmccollum | still testing, but i think they need to be in a single After= | 17:22 |
| cloudnull | however if that's the case we should be able to fix that up in the service role | 17:23 |
| bgmccollum | in the loop-cinder.service unit, i was testing with two After=, one of which was the After=openstack.mount. That wasn't working. I just collapsed it to one After= (space separated), rebooted, and the cinder loop was created and cinder-volume was happy... | 17:25 |
| *** markvoelker has joined #openstack-ansible | 17:25 | |
| bgmccollum | yeah its a simple fix...ill see if i can get a patch up | 17:27 |
| bgmccollum | we might have just been getting lucky for the few units that have multiple before / afters | 17:27 |
| *** vnogin has quit IRC | 17:27 | |
| cloudnull | ++ | 17:27 |
| *** tosky has quit IRC | 17:28 | |
| cloudnull | CeeMac jamesdenton: jrosser found this - https://askubuntu.com/questions/1110323/does-apt-upgrade-trigger-netplan-apply-in-18-04 - looks like netplan restarts on package update which will bounce your interfaces which would couple explain some of the network oddness you all have been seeing? | 17:31 |
| cloudnull | a bridge that bounces would break the veth pairs requiring you to rerun the lxc-veth-check to recover the environment. | 17:32 |
| goldenfri | Hi, is there any specific documentation on connecting to an existing ceph cluster in OSA? According to the production example, I need to edit user_variables.yml, I'm not quite sure what is for ceph-ansible and what is for ceph alone. | 17:37 |
| goldenfri | I just want to avoid giving it too much info and having it monkey with my existing ceph cluster | 17:38 |
| openstackgerrit | Merged openstack/openstack-ansible-openstack_hosts master: add gentoo support https://review.openstack.org/608325 | 17:39 |
| jrosser | goldenfri: there is some info here https://docs.openstack.org/openstack-ansible-ceph_client/rocky/configure-ceph.html | 17:40 |
| jrosser | the smallest info you need to give initially is the list of mons | 17:40 |
| jamesdenton | jrosser For os_neutron, an override was added: tempest_network_ping_gateway: False | 17:40 |
| jrosser | for an external ceph cluster i don't believe that ceph-ansible is involved at all | 17:41 |
| goldenfri | ah thank you, yes I want avoid ceph ansible being involved, | 17:41 |
| jamesdenton | cloudnull i have not experienced the loss of veths on 'netplan apply'. But there certainly is a 'blip'. Also, any IP address applied to and interface that is NOT called out in the interface config file will get blown away (e.g. something added with 'ip addr add' or keepalived) | 17:44 |
| cloudnull | that's a bummer. | 17:45 |
| cloudnull | but good to hear the veth's are not in a broken state | 17:46 |
| NobodyCam | well I believe it is my network setup, I defined a container_bridge override as br-mgmt but still ended up with lxcbr0 | 17:50 |
| NobodyCam | if I attach to one of the containers I only see a loopback interface | 17:52 |
| *** sdake has quit IRC | 17:54 | |
| jamesdenton | NobodyCam what are you trying to accomplish? | 17:55 |
| NobodyCam | deploy a simple OpenStack on a flat network, | 17:55 |
| NobodyCam | 1 controller 2 compute | 17:56 |
| jamesdenton | And you only have 1 VLAN to work with? | 17:56 |
| *** sdake has joined #openstack-ansible | 17:57 | |
| NobodyCam | I have two networks, one with public access and a private (no external assess) | 17:57 |
| NobodyCam | eth0 gets DHCP Address , eth1 / br-mgmt is statically assigned | 17:58 |
| jamesdenton | this is eth0/eth1 inside the lxc containers? or on the hosts themselves? | 17:58 |
| *** electrofelix has quit IRC | 17:58 | |
| *** markvoelker has quit IRC | 17:59 | |
| NobodyCam | they are on the host | 18:00 |
| NobodyCam | only `lo` in the containers | 18:00 |
| NobodyCam | I can share my OpenStack_User_conf.yaml if that would provide any insight | 18:01 |
| jamesdenton | sure | 18:01 |
| NobodyCam | http://paste.openstack.org/show/vpVKQiTmsOLaDLOgjUDF/ | 18:01 |
| jamesdenton | k | 18:02 |
| NobodyCam | I just added -all_containers and -host to the group bind section as a test | 18:03 |
| NobodyCam | it failed :p | 18:03 |
| NobodyCam | for missed the cider_network directive in that paste | 18:05 |
| jamesdenton | This *might* work: ip link add veth0 type veth peer name veth1 | 18:06 |
| jamesdenton | wait | 18:06 |
| jamesdenton | http://paste.openstack.org/show/745756/ | 18:06 |
| jamesdenton | the 'flat' network type really represents an 'untagged' network (not 8021q vlan tagging), and not a flat topology | 18:08 |
| jamesdenton | a flat topology isn't something we really entertain | 18:08 |
| spatel | if i want to build new cloud what stable release i should go with in production? | 18:10 |
| NobodyCam | ahh, Thank you jamesdenton, let me try breaking up the -network like you've shown | 18:11 |
| jamesdenton | NobodyCam in that example, I'm trying to create a virtual interface that neutron can use, that in turn is connected to br-mgmt. It's not ideal, but it works in other situations | 18:12 |
| jamesdenton | spatel what are you using now? Pike? | 18:12 |
| spatel | Queens | 18:13 |
| *** dave-mccowan has quit IRC | 18:15 | |
| spatel | jamesdenton: ^^ | 18:22 |
| jamesdenton | right. Well, Rocky is how I would go Queens will soon be N-2 | 18:23 |
| openstackgerrit | Doug Hellmann proposed openstack/openstack-ansible master: add links to readme for release announce script https://review.openstack.org/638738 | 18:24 |
| goldenfri | Is nspoawn production ready in rocky so I won't have to upgrade later? | 18:28 |
| spatel | How about Stein ? | 18:30 |
| jamesdenton | i'm not sure of the timeline there | 18:30 |
| spatel | jamesdenton: i heard it has some cool stuff related SR-IOV | 18:30 |
| jamesdenton | what did you hear? | 18:30 |
| spatel | in Stein developer planning for SR-IOV live migration support... | 18:31 |
| spatel | i looked at ticket somewhere.. i am not 100% sure.. | 18:31 |
| spatel | jamesdenton: my current cloud running in LinuxBridge should i go with OVS in new cloud? | 18:31 |
| spatel | Do you think OVS would be good choice? | 18:32 |
| jamesdenton | eh, i guess that would depend if there were OVS-only features you wanted to use (ie. DVR, FWaaS v2 come to mind) | 18:32 |
| spatel | i may go with DPDK | 18:33 |
| *** Darcidride has joined #openstack-ansible | 18:33 | |
| spatel | OVS will open door for future too, because not many feature support linuxbridge | 18:33 |
| jamesdenton | OSA does not yet have that, though there are patches and it needs a good review (and some work) | 18:34 |
| spatel | :( | 18:34 |
| spatel | i thought we are ready for DPDK | 18:34 |
| jamesdenton | OVS is a fine choice. LinuxBridge is a fine choice, too, if you can do without those features i mentioned. Many do. | 18:34 |
| *** cshen has joined #openstack-ansible | 18:35 | |
| jamesdenton | We are not, but if you have a lab environment and want to kick the tires, you can roll a deployment with the patches | 18:35 |
| *** DanyC has quit IRC | 18:36 | |
| *** macza has quit IRC | 18:38 | |
| *** cshen has quit IRC | 18:39 | |
| *** chandankumar is now known as raukadah | 18:45 | |
| openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-os_zun master: Add ubuntu bionic check and gate jobs https://review.openstack.org/638750 | 18:54 |
| NobodyCam | \o/ Thank you jamesdenton and antonym :) `EXIT NOTICE [Playbook execution success]` | 18:55 |
| NobodyCam | required the network def change and container restart | 18:55 |
| jamesdenton | Do the containers have an eth0 and eth1? | 18:55 |
| NobodyCam | I have not attached but they list two ips | 18:56 |
| NobodyCam | checking | 18:56 |
| jamesdenton | thats a good start | 18:56 |
| *** markvoelker has joined #openstack-ansible | 18:56 | |
| NobodyCam | yep eth0 and eth1 | 18:56 |
| NobodyCam | :) | 18:56 |
| NobodyCam | now to see what we get with `setup-infrastructure.yml` | 18:58 |
| *** DanyC has joined #openstack-ansible | 19:00 | |
| *** DanyC has quit IRC | 19:04 | |
| *** Darcidride has quit IRC | 19:07 | |
| nicolasbock | cloudnull and evrardjp: We are using a proxied (cached) repo from mariadb. I manually checked the repo and didn't see this error. Infra didn't think that we could do much about the up to datedness of the cache except for directly talking to mariadb.org or to sanity check the cached repo by looking at the file timestampts. | 19:08 |
| *** macza has joined #openstack-ansible | 19:10 | |
| *** macza has joined #openstack-ansible | 19:11 | |
| nicolasbock | Does zuul keep some statistics of failure reasons? Or in other words, is there an easy way to see how frequent or wide spread this mirror failure is? | 19:13 |
| openstackgerrit | Merged openstack/openstack-ansible-tests master: Set opensuse jobs to non-voting https://review.openstack.org/638697 | 19:14 |
| antonym | NobodyCam: cool, yeah, i'm thinking we might need to handle something there a bit better, i just haven't had time to track down the exact cause yet, were you doing an upgrade or just a new install? | 19:17 |
| NobodyCam | new install / but it failed several times | 19:18 |
| jrosser | nicolasbock: you should be able to construct a query here for failures http://logstash.openstack.org/ | 19:20 |
| nicolasbock | Ah, cool | 19:20 |
| nicolasbock | Thanks! | 19:20 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/openstack-ansible-openstack_hosts master: Updated from OpenStack Ansible Tests https://review.openstack.org/638755 | 19:22 |
| spatel | I was running playbooks to add compute nodes and got error at some point: ERROR! unexpected Exception, this is probably a bug: [Error 12] Cannot allocate memory | 19:25 |
| spatel | http://paste.openstack.org/show/745764/ | 19:27 |
| spatel | cloudnull: ^^ | 19:27 |
| spatel | when adding new compute node why ansible touching every single nodes ? | 19:28 |
| *** markvoelker has quit IRC | 19:28 | |
| *** sdake has quit IRC | 19:31 | |
| cloudnull | spatel is that on the deployment host ? | 19:34 |
| spatel | yes | 19:35 |
| *** DanyC has joined #openstack-ansible | 19:35 | |
| spatel | my deployment nodes running on VMware ( 4vCPU / 4G memroy ) | 19:35 |
| cloudnull | I'm not sure, though I can confirm ansible does run memory heavy with larger inventories. | 19:39 |
| cloudnull | can you do 8GiB RAM? | 19:39 |
| *** noonedeadpunk has quit IRC | 19:43 | |
| *** dave-mccowan has joined #openstack-ansible | 19:43 | |
| *** cshen has joined #openstack-ansible | 19:45 | |
| openstackgerrit | Matthew Thode proposed openstack/openstack-ansible-lxc_hosts master: add gentoo support https://review.openstack.org/608393 | 19:45 |
| spatel | cloudnull: i am re-running again will see if cause any issue.. | 19:47 |
| cloudnull | ok | 19:47 |
| spatel | cloudnull: second question why ansible touching every single compute nodes? | 19:47 |
| spatel | i thought ansible should deploy code to target machine and not touch any other machine | 19:48 |
| prometheanfire | what was the opensuse patch that I have to deak with now? | 19:48 |
| spatel | openstack-ansible setup-openstack.yml --tags nova-key --skip-tags ceph --limit compute_hosts | 19:48 |
| spatel | that line is what going through every single compute nodes.. I have 250 :) | 19:49 |
| cloudnull | compute_hosts would limit to only the hosts in the compute group but ansible still needs to enumerate all of the items in inventory | 19:49 |
| cloudnull | prometheanfire in tests | 19:49 |
| *** cshen has quit IRC | 19:49 | |
| openstackgerrit | Matthew Thode proposed openstack/openstack-ansible-tests master: add Gentoo jobs as non-voting https://review.openstack.org/608102 | 19:50 |
| prometheanfire | cloudnull: ya, found it | 19:50 |
| prometheanfire | https://review.openstack.org/#/c/638697 | 19:50 |
| spatel | Do i need to run this playbook? - openstack-ansible setup-openstack.yml --tags nova-key --skip-tags ceph --limit compute_hosts | 19:50 |
| cloudnull | no. | 19:50 |
| cloudnull | to add compute nodes. just os-neutron-install and os-nova-install | 19:50 |
| *** DanyC has quit IRC | 19:50 | |
| *** DanyC has joined #openstack-ansible | 19:50 | |
| spatel | I always use this playbooks http://paste.openstack.org/show/745764/ | 19:52 |
| cloudnull | I typically do something like `openstack-ansible setup-hosts.yml os-nova-install.yml os-neutron-install.yml --limit compute_hosts` | 19:52 |
| spatel | do you think i am doing wrong here? | 19:52 |
| cloudnull | no, not doing anything wrong | 19:52 |
| cloudnull | that should work, but may require more memory as itll load all of the setup-openstack playbooks | 19:53 |
| spatel | i am trying to cut down time.. | 19:53 |
| spatel | let me remove line "openstack-ansible setup-openstack.yml --tags nova-key --limit compute_hosts" | 19:54 |
| spatel | that line taking hell of a time... | 19:54 |
| spatel | for single node its taking 20 to 30 min :( | 19:55 |
| spatel | cloudnull: in your command "openstack-ansible setup-hosts.yml os-nova-install.yml os-neutron-install.yml --limit compute_hosts" | 19:56 |
| spatel | compute_hosts is new compute node right? | 19:56 |
| cloudnull | compute_hosts is all the compute hosts, but you can change the limit to just the one node | 19:57 |
| cloudnull | just make sure to resync keys later | 19:57 |
| spatel | is this key for SSH between compute nodes? | 19:58 |
| spatel | for nova | 19:58 |
| cloudnull | yes | 20:00 |
| openstackgerrit | Antony Messerli proposed openstack/openstack-ansible-ops master: Use updated Ubuntu installer kernels on MNAIO https://review.openstack.org/638760 | 20:00 |
| openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-os_zun master: Do not ping neutron router during tempest test https://review.openstack.org/638761 | 20:00 |
| spatel | trying your command to see how much time it takes.. i like that idea | 20:01 |
| cloudnull | i dont typically use the tags when adding compute hosts . I just run the playbooks I need | 20:05 |
| cloudnull | and i generally just limit on the groups I plan on interacting with | 20:06 |
| cloudnull | bgmccollum howd the systemd testing go ? | 20:06 |
| spatel | cloudnull: good idea | 20:06 |
| spatel | cloudnull: did you see this error http://paste.openstack.org/show/745767/ | 20:07 |
| spatel | by mistake i had SELinux enabled on compute node but later i have disabled SELinux and re-running playbook and still getting this error | 20:07 |
| spatel | i don't know how to get ride of this error | 20:07 |
| cloudnull | can you install that package? | 20:07 |
| spatel | installing... | 20:08 |
| spatel | re-running playbook... | 20:08 |
| *** vnogin has joined #openstack-ansible | 20:09 | |
| * cloudnull waiting in anticipation :D | 20:09 | |
| spatel | Error: SELinux is disabled on this host | 20:09 |
| spatel | i always disabled SELinux but by mistake i enabled on this node :( and now i stuck here | 20:10 |
| spatel | look like bug in playbook doesn't understand if its disabled just pass.. | 20:11 |
| spatel | Should i remove /var/lib/nova and try? | 20:13 |
| *** vnogin has quit IRC | 20:13 | |
| spatel | rm -rf /openstack | 20:15 |
| spatel | rm -rf /var/lib/nova | 20:15 |
| spatel | re-running.. | 20:15 |
| spatel | same error damn it | 20:15 |
| cloudnull | spatel maybe that python package needs to be installed in the nova venv? | 20:17 |
| cloudnull | also I'm not 100% what would trigger selinux check? | 20:18 |
| spatel | i had same issue in past and solution was re-install Linux | 20:19 |
| spatel | something trigger which checking for SELinux | 20:19 |
| spatel | http://paste.openstack.org/show/745768/ | 20:20 |
| cloudnull | hum | 20:24 |
| cloudnull | looking in the nova role | 20:24 |
| shananigans | looks like it checks if its checked when pulling ansible facts. Maybe clearing out /etc/openstack_deploy/ansible_facts/* on the deploy host? | 20:25 |
| cloudnull | ^ thats a good idea | 20:25 |
| openstackgerrit | Merged openstack/openstack-ansible master: add links to readme for release announce script https://review.openstack.org/638738 | 20:25 |
| *** markvoelker has joined #openstack-ansible | 20:25 | |
| spatel | let me try that one | 20:33 |
| spatel | re-running playbooks... | 20:36 |
| spatel | cloudnull: new error - http://paste.openstack.org/show/745769/ | 20:39 |
| spatel | let me delete /var/lib/nova | 20:39 |
| spatel | rm -rf /var/cache/nova | 20:40 |
| spatel | cloudnull: look like that works!!! thank you so much!! | 20:43 |
| openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-os_zun master: Do not ping neutron router during tempest test https://review.openstack.org/638761 | 20:50 |
| *** markvoelker has quit IRC | 20:59 | |
| partlycloudy | Hi folks, i too hit this bug (https://bugs.launchpad.net/openstack-ansible/+bug/1815570) while running master against ubuntu bionic, but i don't how to apply the patch/fix mentioned in the thread. any helps will be appreciated! | 21:05 |
| openstack | Launchpad bug 1815570 in openstack-ansible "cinder fails because of trying to downgrade librados2 librbd1" [Undecided,In progress] | 21:05 |
| openstackgerrit | James Denton proposed openstack/openstack-ansible-os_neutron master: [docs] Add Open vSwitch Hardware Offloading (ASAP^2) Deployment Scenario https://review.openstack.org/563547 | 21:06 |
| openstackgerrit | James Denton proposed openstack/openstack-ansible-os_neutron master: [docs] Add Open vSwitch Hardware Offloading (ASAP^2) Deployment Scenario https://review.openstack.org/563547 | 21:09 |
| *** tosky has joined #openstack-ansible | 21:11 | |
| openstackgerrit | Matthew Thode proposed openstack/openstack-ansible-lxc_hosts master: add gentoo support https://review.openstack.org/608393 | 21:17 |
| *** strattao has quit IRC | 21:24 | |
| openstackgerrit | James Denton proposed openstack/openstack-ansible-os_neutron master: [docs] Add Open vSwitch Hardware Offloading (ASAP^2) Deployment Scenario https://review.openstack.org/563547 | 21:26 |
| *** strattao has joined #openstack-ansible | 21:26 | |
| *** DanyC has quit IRC | 21:28 | |
| *** fghaas has joined #openstack-ansible | 21:35 | |
| *** macza has quit IRC | 21:44 | |
| *** macza has joined #openstack-ansible | 21:45 | |
| *** ivve has quit IRC | 21:47 | |
| NobodyCam | humm anyone encountered a issue reaching the repo container | 21:49 |
| NobodyCam | `fatal: [Openstack01_utility_container-6b2a9bad]: FAILED! => {"changed": false, "content": "", "msg": "Status code was -1 and not [200]: Request failed: <urlopen error [Errno 113] No route to host>", "redirected": false, "status": -1, "url": "http://172.29.236.4:8181/os-releases/18.0.0.0rc2.dev370/centos-7.6-x86_64/requirements_absolute_requirements.txt"}` | 21:49 |
| NobodyCam | there is a 8181 ha proxy port on the host | 21:49 |
| NobodyCam | but I can not curl to it | 21:50 |
| NobodyCam | there is a repo container and I can retrieve from inside it with 127.0.0.1:8181 | 21:50 |
| jamesdenton | is 172.29.236.4 configured on the infra node? | 21:54 |
| *** dave-mccowan has quit IRC | 21:55 | |
| openstackgerrit | James Denton proposed openstack/openstack-ansible-os_neutron master: [docs] Add Open vSwitch Hardware Offloading (ASAP^2) Deployment Scenario https://review.openstack.org/563547 | 21:56 |
| *** markvoelker has joined #openstack-ansible | 21:56 | |
| NobodyCam | yes | 21:58 |
| NobodyCam | I can curl from the host and container on the host | 21:58 |
| jamesdenton | can you ping 172.29.236.4 from the utility container? | 21:59 |
| NobodyCam | checking | 22:00 |
| NobodyCam | yes | 22:01 |
| jamesdenton | and curling that URL from the utility container returns...? | 22:01 |
| NobodyCam | Failed connect to 172.29.236.4:8181; No route to host | 22:02 |
| NobodyCam | it like haproxy is not passing the ip | 22:02 |
| jamesdenton | On the infra node, what is returned with 'netstat -an | grep 8181' | 22:03 |
| NobodyCam | tcp 0 0 172.29.236.4:8181 0.0.0.0:* LISTEN | 22:04 |
| NobodyCam | I can not curl the actual container ip except on the info host itself | 22:05 |
| jamesdenton | Well, perhaps there's something unique w/r/t centos or that host config (iptables,selinux,etc). I'm out of ideas at the moment and have to get going | 22:09 |
| *** shananigans has quit IRC | 22:09 | |
| NobodyCam | thank you for all the help jamesdenton ` | 22:11 |
| jamesdenton | sure, keep is posted. | 22:12 |
| NobodyCam | just fyi: http://paste.openstack.org/show/GtVv0tNI2abfCvxFor9V/ | 22:12 |
| spatel | NobodyCam: i am using CentOS and i had lost if issue with LXC networking... | 22:13 |
| spatel | NobodyCam: what method are you using to setup networking bridge for infra nodes? | 22:14 |
| jamesdenton | NobodyCam 'brctl show' output on both of those? | 22:14 |
| jamesdenton | and spatel is the centos pro | 22:14 |
| spatel | If you are using systemd-networkd then please don't use that.. because it will show everything up and running but LXC bridge won't work correctly | 22:15 |
| NobodyCam | looks like brctl shows the interfaces | 22:16 |
| NobodyCam | looks like I have `/usr/lib/systemd/systemd-network` & `/usr/lib/systemd/systemd-resolved` running | 22:17 |
| spatel | try to run tcpdump on host with port 8181 and try to do curl | 22:18 |
| spatel | This is my person experience i had lots of issue with /usr/lib/systemd/systemd-network and later i endup using /etc/sysconfig/network-scripts/ifcfg-* | 22:19 |
| NobodyCam | http://paste.openstack.org/show/ug1nKpny7UOsS38LYxHR/ | 22:22 |
| spatel | look like traffic flowing both direction | 22:26 |
| spatel | run tcpdump on repo container also and see | 22:26 |
| NobodyCam | lol installing now | 22:27 |
| spatel | ? | 22:27 |
| NobodyCam | looks like traffic is working: | 22:29 |
| NobodyCam | http://paste.openstack.org/show/g8lRHlNlnlgEJhETE7oG/ | 22:29 |
| *** markvoelker has quit IRC | 22:30 | |
| NobodyCam | lots of health checks in the Nginx log: 172.29.236.4 - - [22/Feb/2019:21:51:44 +0000] "HEAD / HTTP/1.0" 200 299 "-" "osa-haproxy-healthcheck" "-" | 22:31 |
| NobodyCam | the only request I see in the log is from the one I did from local host | 22:32 |
| NobodyCam | 127.0.0.1 - - [22/Feb/2019:21:43:53 +0000] "GET /os-releases/18.0.0.0rc2.dev370/centos-7.6-x86_64/requirements_absolute_requirements.txt HTTP/1.1" 200 7919 "-" "curl/7.29.0" "-" | 22:32 |
| *** strattao has quit IRC | 22:33 | |
| *** strattao has joined #openstack-ansible | 22:34 | |
| *** sdake has joined #openstack-ansible | 22:37 | |
| NobodyCam | oh I can curl from the lxcbr0 ip | 22:39 |
| *** spatel has quit IRC | 22:45 | |
| *** fghaas has quit IRC | 22:54 | |
| *** strattao has quit IRC | 23:14 | |
| NobodyCam | ahh ha: required "firewall-cmd --zone=public --add-port=8181/tcp --permanent" | 23:20 |
| *** kmadac has quit IRC | 23:25 | |
| *** markvoelker has joined #openstack-ansible | 23:27 | |
| *** markvoelker has quit IRC | 23:59 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!