| *** savvas has joined #openstack-ansible | 00:00 | |
| *** savvas has quit IRC | 00:04 | |
| *** chyka has quit IRC | 00:21 | |
| openstackgerrit | Merged openstack/openstack-ansible-os_nova master: ansible-role-requirements: Add common systemd_service role https://review.openstack.org/552581 | 00:24 |
|---|---|---|
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-os_glance master: Convert systemd mount to use a common role https://review.openstack.org/552185 | 00:33 |
| cloudnull | if folks get a change, https://review.openstack.org/#/c/552047 unblocks master | 00:34 |
| cloudnull | ill be around tonight to update if needed. | 00:35 |
| openstackgerrit | Merged openstack/openstack-ansible-tests stable/pike: Add tests for APTRepositoryCacheUpdateRule https://review.openstack.org/552025 | 00:35 |
| cloudnull | **get a chance | 00:35 |
| *** Leo_m has quit IRC | 00:48 | |
| *** osnaya has joined #openstack-ansible | 00:50 | |
| osnaya | @cloudnull @odyssey4me Just did a dry run with --syntax-check... it shows up one old network range which I don't want. I updated the user_config.yml but the --syntax-check inventory file shows the old entry. How do I clean up and re-run the --syntax-check? so it will update the changes? | 00:52 |
| *** odyssey4me has quit IRC | 00:53 | |
| *** odyssey4me has joined #openstack-ansible | 00:53 | |
| osnaya | @odyssey4me Just did a dry run with --syntax-check... it shows up one old network range which I don't want. I updated the user_config.yml but the --syntax-check inventory file shows the old entry. How do I clean up and re-run the --syntax-check? so it will update the changes? | 00:55 |
| *** jbadiapa_ has quit IRC | 01:00 | |
| *** kstev1 has quit IRC | 01:02 | |
| osnaya | @odyssey4me deploying on Ubuntu Host... openstack_user_config.yml and env.d is set for metal... After the dry run with --syntax-check observed the inventory.json output... all other places it shows up infra1 host (container empty).... But 2 container entries still show up (infra1_galera_container### and infra1_utility_container#### and Ansible is trying to reach these 2 containers..... Any ideas on what config files I sho | 01:04 |
| *** kstev has joined #openstack-ansible | 01:05 | |
| osnaya | @odyssey4me checked openstack_user_config.yml already and shared-infra_hosts shows up infra1 host ip correctly (which I believe is meant for galera, memcached, rabbit and utility.... then why are the 2 container entries for galera and utility still show up... ? | 01:07 |
| *** kstev has quit IRC | 01:11 | |
| *** jbadiapa_ has joined #openstack-ansible | 01:16 | |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible master: Converge distro interfaces to systemd-networkd https://review.openstack.org/552721 | 01:23 |
| *** osnaya has quit IRC | 01:26 | |
| openstackgerrit | Merged openstack/openstack-ansible-os_heat master: ansible-role-requirements: Add common systemd_service role https://review.openstack.org/552594 | 01:50 |
| prometheanfire | mhayden: aa5ro has not switched over to dst | 02:01 |
| openstackgerrit | Jimmy McCrory proposed openstack/openstack-ansible-os_keystone master: Avoid conflicting delegation with authorized_keys https://review.openstack.org/552711 | 02:03 |
| *** nurdie has quit IRC | 02:16 | |
| *** nurdie has joined #openstack-ansible | 02:16 | |
| *** flemingo_ has quit IRC | 02:25 | |
| *** savvas has joined #openstack-ansible | 02:34 | |
| *** savvas has quit IRC | 02:45 | |
| *** savvas has joined #openstack-ansible | 02:45 | |
| *** esberglu has quit IRC | 03:32 | |
| *** savvas has quit IRC | 03:41 | |
| *** vnogin has joined #openstack-ansible | 03:46 | |
| *** savvas has joined #openstack-ansible | 03:50 | |
| *** vnogin has quit IRC | 03:51 | |
| *** savvas has quit IRC | 03:54 | |
| *** gkadam has joined #openstack-ansible | 03:59 | |
| *** coolj has quit IRC | 04:00 | |
| *** coolj has joined #openstack-ansible | 04:02 | |
| *** poopcat has quit IRC | 04:04 | |
| *** esberglu has joined #openstack-ansible | 04:05 | |
| *** udesale has joined #openstack-ansible | 04:05 | |
| *** esberglu has quit IRC | 04:09 | |
| *** ianychoi_ has joined #openstack-ansible | 04:12 | |
| *** ianychoi has quit IRC | 04:15 | |
| *** dave-mccowan has quit IRC | 04:17 | |
| openstackgerrit | Taseer Ahmed proposed openstack/openstack-ansible master: Integrate Congress with OSA. https://review.openstack.org/503971 | 04:26 |
| *** chyka has joined #openstack-ansible | 04:38 | |
| *** karthi has joined #openstack-ansible | 04:39 | |
| *** chyka has quit IRC | 04:43 | |
| *** esberglu has joined #openstack-ansible | 04:59 | |
| *** esberglu has quit IRC | 05:03 | |
| *** karthi has quit IRC | 05:04 | |
| *** karthi has joined #openstack-ansible | 05:05 | |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible master: Converge distro interfaces to systemd-networkd https://review.openstack.org/552721 | 05:05 |
| *** karthi has quit IRC | 05:09 | |
| *** savvas has joined #openstack-ansible | 05:11 | |
| *** savvas has quit IRC | 05:16 | |
| *** karthi has joined #openstack-ansible | 05:22 | |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible master: Converge distro interfaces to systemd-networkd https://review.openstack.org/552721 | 05:27 |
| *** savvas has joined #openstack-ansible | 05:30 | |
| *** OpenStackDude has joined #openstack-ansible | 05:34 | |
| *** esberglu has joined #openstack-ansible | 05:34 | |
| *** savvas has quit IRC | 05:34 | |
| *** esberglu has quit IRC | 05:38 | |
| OpenStackDude | Is it possible to use OVS bridges as the base "br-mgmt" bridge that connects to the LXC containers? OSA is throwing a error when attempting to connect a container interface to the bridge. It is using brctl commands on the OVS bridge which fails: https://ask.openstack.org/en/question/113180/osa-fails-to-add-lxd-container-interfaces-to-ovs-bridge/ | 05:41 |
| openstackgerrit | Merged openstack/openstack-ansible-galera_client master: zuul: Add more SUSE jobs https://review.openstack.org/552511 | 05:48 |
| openstackgerrit | Merged openstack/openstack-ansible-galera_client master: Updated from global requirements https://review.openstack.org/552196 | 05:48 |
| *** masber has quit IRC | 05:53 | |
| *** OpenStackDude has quit IRC | 06:00 | |
| *** karthi has quit IRC | 06:03 | |
| openstackgerrit | Merged openstack/openstack-ansible-galera_server master: tasks: galera_upgrade_pre: Fix conditional for apt sources https://review.openstack.org/552536 | 06:03 |
| *** savvas has joined #openstack-ansible | 06:06 | |
| openstackgerrit | Merged openstack/openstack-ansible-galera_server master: tasks: galera_post_install: Do not secure the DB on upgrades https://review.openstack.org/552639 | 06:07 |
| *** savvas has quit IRC | 06:10 | |
| *** karthi has joined #openstack-ansible | 06:11 | |
| *** karthi has quit IRC | 06:15 | |
| *** karthi has joined #openstack-ansible | 06:18 | |
| openstackgerrit | Taseer Ahmed proposed openstack/openstack-ansible master: Integrate Congress with OSA. https://review.openstack.org/503971 | 06:18 |
| Taseer | evrardjp: please let me know if I am going in the right direction about adding the tempest API ^ | 06:22 |
| *** esberglu has joined #openstack-ansible | 06:28 | |
| *** esberglu has quit IRC | 06:32 | |
| *** jbadiapa_ has quit IRC | 06:33 | |
| *** radeks has joined #openstack-ansible | 06:38 | |
| *** yifei1 has joined #openstack-ansible | 06:43 | |
| *** ianychoi__ has joined #openstack-ansible | 06:43 | |
| *** yifei has quit IRC | 06:45 | |
| *** yifei1 is now known as yifei | 06:45 | |
| *** ianychoi_ has quit IRC | 06:46 | |
| *** jbadiapa_ has joined #openstack-ansible | 06:48 | |
| *** gkadam has quit IRC | 06:50 | |
| *** ianychoi__ is now known as ianychoi | 06:51 | |
| *** savvas has joined #openstack-ansible | 07:01 | |
| *** pcaruana has joined #openstack-ansible | 07:04 | |
| *** vnogin has joined #openstack-ansible | 07:05 | |
| *** Fritzmen has quit IRC | 07:05 | |
| *** savvas has quit IRC | 07:05 | |
| *** DimGR has quit IRC | 07:14 | |
| *** karthi has quit IRC | 07:15 | |
| *** karthi has joined #openstack-ansible | 07:15 | |
| *** sar has joined #openstack-ansible | 07:19 | |
| *** savvas has joined #openstack-ansible | 07:19 | |
| *** DimGR has joined #openstack-ansible | 07:20 | |
| *** savvas has quit IRC | 07:23 | |
| *** Fritzmen has joined #openstack-ansible | 07:24 | |
| *** masber has joined #openstack-ansible | 07:32 | |
| *** armaan has quit IRC | 07:36 | |
| *** armaan has joined #openstack-ansible | 07:36 | |
| *** savvas has joined #openstack-ansible | 07:37 | |
| *** vnogin has quit IRC | 07:38 | |
| *** karthi has quit IRC | 07:38 | |
| *** karthi has joined #openstack-ansible | 07:38 | |
| *** gkadam has joined #openstack-ansible | 07:40 | |
| *** savvas has quit IRC | 07:42 | |
| *** chyka has joined #openstack-ansible | 07:42 | |
| *** vnogin has joined #openstack-ansible | 07:44 | |
| *** chyka has quit IRC | 07:47 | |
| evrardjp | Taseer: that looks great | 07:51 |
| evrardjp | I guess the test basic ops would only work if there is many more components, so I'd keep that commented out for now, and have an extra line to test only the API (if there is such test) | 07:52 |
| *** vnogin has quit IRC | 07:56 | |
| evrardjp | odyssey4me: why was https://review.openstack.org/#/c/552486/ abandonned? | 08:02 |
| Taseer | evrardjp: the api tests are empty | 08:02 |
| evrardjp | Taseer: go go complain on the congress side then | 08:03 |
| *** epalper has joined #openstack-ansible | 08:03 | |
| Taseer | so until api tests are written, this patch would be in the pipeline ? | 08:03 |
| *** shardy has joined #openstack-ansible | 08:03 | |
| *** epalper has joined #openstack-ansible | 08:03 | |
| Taseer | and are all other jobs failing with the same error => http://logs.openstack.org/71/503971/38/check/openstack-ansible-deploy-aio_lxc-ubuntu-xenial/5a961df/job-output.txt.gz#_2018-03-14_07_38_42_704301 | 08:04 |
| Taseer | the keystone container is timing out | 08:04 |
| evrardjp | Let's focus on your thing -- if congress doesn't have API tests, we have no choice than to add functional tests on a more complete system | 08:05 |
| evrardjp | so your overrides are good | 08:05 |
| evrardjp | we just need to add more components | 08:05 |
| evrardjp | for the keystone issue, I am querying what's going on | 08:05 |
| *** ThomasS has joined #openstack-ansible | 08:06 | |
| Taseer | okay | 08:06 |
| *** karthi has quit IRC | 08:10 | |
| openstackgerrit | Merged openstack/openstack-ansible-os_neutron master: Simplify SELinux check https://review.openstack.org/550210 | 08:10 |
| evrardjp | I am very confused what's going on here. hwoarang are you there? | 08:11 |
| hwoarang | evrardjp: depends... | 08:11 |
| fdegir | evrardjp: hwoarang: https://bugs.launchpad.net/openstack-ansible/+bug/1753125 | 08:11 |
| openstack | Launchpad bug 1753125 in openstack-ansible "os_cinder : Ensure cinder api is available timeout" [Undecided,New] | 08:11 |
| fdegir | evrardjp: hwoarang: the original submitter set bug to invalid but we still see it with queens rc2 versions with ha deployment | 08:12 |
| fdegir | sorry for just jumping in... | 08:12 |
| fdegir | evrardjp: hwoarang: just to add that those shas work with no ha deployments | 08:13 |
| *** savvas has joined #openstack-ansible | 08:14 | |
| *** karthi has joined #openstack-ansible | 08:16 | |
| *** vnogin has joined #openstack-ansible | 08:17 | |
| evrardjp | hwoarang: we can update the patch, for sure, but I think this is not a good idea. | 08:18 |
| evrardjp | I think we need to have a proper spec up | 08:18 |
| *** savvas has quit IRC | 08:18 | |
| evrardjp | this replacement of systemd is fine for me, but there is no spec that I am aware of that describes what we want to achieve | 08:18 |
| evrardjp | the systemd_mount and system_service roles become fundamental to our deploy, yet we have no written evidence of why this happened | 08:19 |
| evrardjp | if human mistake of removal of this repo, nothing can deploy anymore. | 08:20 |
| hwoarang | i dont know what's the deal with the new systemd roles to be honest you need cloudnull for that. we can spli tthis patch into two bits again. one that simply fixes the problem in a dirty way and another one that does it properly | 08:20 |
| evrardjp | hwoarang: a patch that does what it says in the current commit message seems reasonable. | 08:21 |
| hwoarang | ok | 08:21 |
| evrardjp | I re-enabled the revert of the keystone patch | 08:21 |
| hwoarang | i think it's best to submit a new patch | 08:21 |
| hwoarang | (for the lxc thing) | 08:21 |
| hwoarang | i will do it | 08:21 |
| evrardjp | there are times we can merge things fast, but changes in the structure of the deploy should be documented. | 08:21 |
| evrardjp | hwoarang: you mean for the disk space thing? | 08:22 |
| hwoarang | yes i agree except this is not my patch | 08:22 |
| hwoarang | yes the disk space thing | 08:22 |
| evrardjp | yeah okay | 08:23 |
| evrardjp | I am fine with a new patch. | 08:23 |
| evrardjp | It is your patch though, it's written owner: Markos :) | 08:23 |
| hwoarang | well that's a mistake i only wrote 3 lines of it | 08:23 |
| evrardjp | haha | 08:23 |
| evrardjp | the usual thing :) | 08:24 |
| evrardjp | I guess we thought doing it good | 08:24 |
| evrardjp | I just don't think it's good enough for merging | 08:24 |
| evrardjp | I am sorry | 08:24 |
| openstackgerrit | Merged openstack/openstack-ansible-os_tempest master: update for changes needed to pass refstack https://review.openstack.org/550207 | 08:26 |
| hwoarang | hmm i noticed that when you pass variables to roles lke foo: "{{ foobar }}" the foobar variable is evaluated when the role is executed and not when you actually call it | 08:27 |
| hwoarang | interesting feature... | 08:27 |
| hwoarang | like | 08:27 |
| hwoarang | roles: | 08:27 |
| hwoarang | - role: bar | 08:27 |
| hwoarang | foo: "{{ foobar }}" | 08:27 |
| hwoarang | foo is being passed as "{{ foobar }}" to role | 08:27 |
| openstackgerrit | Markos Chandras (hwoarang) proposed openstack/openstack-ansible master: playbooks: containers-lxc-host: Set correct disk size limit for containers https://review.openstack.org/552836 | 08:29 |
| *** vnogin has quit IRC | 08:30 | |
| PTO | evrardjp: Regarding bug repport #1750841 (missing /opt) - Im running ubuntu, but the reason for the folder is missing is because the installation screwed up completely and I did a "rm -rf /opt" | 08:32 |
| *** electrofelix has joined #openstack-ansible | 08:33 | |
| *** karthi has quit IRC | 08:33 | |
| evrardjp | PTO: haha | 08:35 |
| evrardjp | that makes sense | 08:35 |
| evrardjp | hwoarang: I am not sure what you mean, yes we are passing the variable to the role ? | 08:35 |
| PTO | evrardjp: When I deleted /opt, then everything failed. It tooke me some time to figure out it was because the /opt folder was missing | 08:36 |
| evrardjp | not sure what you meant by "evaluated when the role is executed" vs "not when you actually call it" | 08:36 |
| hwoarang | evrardjp: i mean assuming fobar=1, then you pass foo="{{ foobar }}" instead of foo=1 | 08:36 |
| evrardjp | because that's the same for me | 08:36 |
| hwoarang | the evalutation of foobar happens in the role itself, not when you call the role from the playbook | 08:36 |
| evrardjp | hwoarang: oh yeah | 08:36 |
| openstackgerrit | Merged openstack/openstack-ansible-os_nova master: Simplify SELinux check https://review.openstack.org/550202 | 08:37 |
| hwoarang | sneaky | 08:37 |
| evrardjp | I guess it all depends on what's foobar in your case | 08:37 |
| evrardjp | but yeah | 08:37 |
| *** ygl has joined #openstack-ansible | 08:37 | |
| ygl | hi all | 08:38 |
| ygl | when I run the playbook openstack-ansible setup-hosts.yml, it is saying no hosts matched | 08:38 |
| evrardjp | hwoarang: do you expect a regression? | 08:38 |
| ygl | what could be the problem ? | 08:38 |
| evrardjp | because the scope itself wouldn't change | 08:38 |
| ygl | can anyone help me please | 08:39 |
| evrardjp | ygl: your inventory is most likely the cause | 08:39 |
| hwoarang | evrardjp: no i was just curious | 08:40 |
| ygl | evrardjp: should I regenerate it ? | 08:40 |
| evrardjp | ygl: you should double check what you wrote. Linting and all that jazz. | 08:40 |
| evrardjp | ygl: forgetting a group maybe | 08:40 |
| evrardjp | or erroneous spaces | 08:40 |
| ygl | evrardjp: I have create a user_config file and listed right ips for this hosts. | 08:41 |
| Taseer | evrardjp: how much more work still needs to be done for congress ? I don't understand when you imply "testing the system as whole" | 08:41 |
| evrardjp | Taseer: well, because congress upstream don't have api testing... | 08:42 |
| evrardjp | Taseer: you have no choice than to do real tempest testing. | 08:42 |
| evrardjp | so you'd need to add all the involved components | 08:42 |
| evrardjp | so I guess neutron, glance, nova? | 08:42 |
| evrardjp | (yes we are returning to what you did earlier, but now we have an explanation for the commit message :p ) | 08:43 |
| Taseer | even cinder ? | 08:43 |
| ygl | evrardjp: the yaml files is ok | 08:43 |
| evrardjp | Taseer: not sure cinder is necessary | 08:43 |
| evrardjp | I guess it all depends on congress | 08:43 |
| *** vnogin has joined #openstack-ansible | 08:44 | |
| Taseer | evrardjp: okay, have you figured out the keystone thingy ? so I can update the patch and trigger zuul ? | 08:44 |
| evrardjp | Taseer: we don't have consensus on the approach :) | 08:46 |
| evrardjp | Either I let a patch pass -- which I don't find great-- and we're unblocked, or we do things the right way | 08:46 |
| evrardjp | I prefer doing it the right way | 08:47 |
| evrardjp | ppl will complain. | 08:47 |
| Taseer | evrardjp: so I will wait... | 08:47 |
| evrardjp | Taseer: don't wait | 08:47 |
| evrardjp | check what's needed, add the necessary bits, modify your commit message | 08:48 |
| *** vnogin has quit IRC | 08:48 | |
| evrardjp | help on the review of the keystone issue | 08:48 |
| evrardjp | that's how we get things done | 08:48 |
| Taseer | sure :) | 08:48 |
| evrardjp | ygl: post them | 08:49 |
| evrardjp | code don't lie | 08:49 |
| evrardjp | :D | 08:49 |
| ygl | evrardjp: my openstack_hostnames_ips.yml file is empty | 08:49 |
| evrardjp | I will have a new tv show about that. | 08:49 |
| evrardjp | :D | 08:49 |
| evrardjp | ygl: my point precisely! | 08:49 |
| ygl | evrardjp: do u want me to post the user_config ? | 08:50 |
| evrardjp | openstack_user_config and conf.d (if any) | 08:50 |
| ygl | evrardjp: ok | 08:50 |
| *** savvas has joined #openstack-ansible | 08:50 | |
| ygl | evrardjp: http://paste.openstack.org/show/700877/ | 08:51 |
| *** savvas has quit IRC | 08:55 | |
| ygl | evrardjp: found anything ? | 08:58 |
| evrardjp | ygl: yes | 08:58 |
| evrardjp | all your hosts are over indented | 08:58 |
| evrardjp | they are in global overrides | 08:58 |
| evrardjp | instead of being their own group definition | 08:58 |
| evrardjp | unindent shared-infra_hosts and all. | 08:58 |
| ygl | evrardjp: oh ok, i will do it and check now | 08:59 |
| evrardjp | when I mean and all, I guess you understand | 08:59 |
| evrardjp | ygl: sure | 08:59 |
| ygl | evrardjp: i have removed spaces for all the hosts. still the same error | 09:01 |
| ygl | evrardjp: this is the new one http://paste.openstack.org/show/700878/ | 09:02 |
| openstackgerrit | Markos Chandras (hwoarang) proposed openstack/openstack-ansible-lxc_hosts master: tasks: Ensure machinectl quota value is reasonable https://review.openstack.org/552842 | 09:03 |
| *** karthi has joined #openstack-ansible | 09:03 | |
| evrardjp | wrong indent again ygl | 09:06 |
| evrardjp | groupname: <NL, 2 spaces> hostname <NL, 2 spaces> ip: | 09:06 |
| evrardjp | odyssey4me: ping me when you're here | 09:07 |
| evrardjp | please:) | 09:07 |
| ygl | evrardjp: oh ok , it is very strict | 09:07 |
| evrardjp | ofc it's yaml | 09:07 |
| evrardjp | :D | 09:08 |
| *** savvas has joined #openstack-ansible | 09:08 | |
| *** holser__ has joined #openstack-ansible | 09:09 | |
| openstackgerrit | Taseer Ahmed proposed openstack/openstack-ansible master: Integrate Congress with OSA. https://review.openstack.org/503971 | 09:10 |
| ygl | evrardjp: ah goodness me. it succeeded now. thanks a lot :) | 09:10 |
| *** savvas has quit IRC | 09:13 | |
| *** admin0 has joined #openstack-ansible | 09:13 | |
| *** karthi has quit IRC | 09:24 | |
| *** vnogin has joined #openstack-ansible | 09:24 | |
| *** karthi has joined #openstack-ansible | 09:24 | |
| *** ygl has quit IRC | 09:26 | |
| *** savvas has joined #openstack-ansible | 09:27 | |
| *** udesale_ has joined #openstack-ansible | 09:27 | |
| *** udesale__ has joined #openstack-ansible | 09:29 | |
| *** udesale has quit IRC | 09:29 | |
| *** savvas has quit IRC | 09:31 | |
| *** udesale_ has quit IRC | 09:32 | |
| *** A1ve5 has quit IRC | 09:35 | |
| openstackgerrit | Jean-Philippe Evrard proposed openstack/openstack-ansible-os_searchlight stable/queens: Point to Queens instead of master https://review.openstack.org/544862 | 09:35 |
| admin0 | morning | 09:39 |
| evrardjp | morning | 09:40 |
| *** holser__ has quit IRC | 09:42 | |
| *** vnogin has quit IRC | 09:43 | |
| *** karthi has quit IRC | 09:43 | |
| *** holser__ has joined #openstack-ansible | 09:43 | |
| admin0 | where do i see how many more days/bugs/tests remaininng before queens get out | 09:44 |
| *** savvas has joined #openstack-ansible | 09:45 | |
| *** savvas has quit IRC | 09:50 | |
| *** Sha0000 has joined #openstack-ansible | 09:56 | |
| *** Sha0000 has quit IRC | 10:00 | |
| *** savvas has joined #openstack-ansible | 10:03 | |
| *** savvas has quit IRC | 10:08 | |
| openstackgerrit | Markos Chandras (hwoarang) proposed openstack/openstack-ansible-galera_server stable/queens: tasks: galera_upgrade_pre: Fix conditional for apt sources https://review.openstack.org/552862 | 10:10 |
| openstackgerrit | Markos Chandras (hwoarang) proposed openstack/openstack-ansible-galera_server stable/queens: tasks: galera_post_install: Do not secure the DB on upgrades https://review.openstack.org/552864 | 10:11 |
| *** fix has joined #openstack-ansible | 10:13 | |
| *** A1ve5 has joined #openstack-ansible | 10:13 | |
| *** karthi has joined #openstack-ansible | 10:14 | |
| *** fix has quit IRC | 10:16 | |
| *** karthi has quit IRC | 10:22 | |
| *** karthi has joined #openstack-ansible | 10:23 | |
| evrardjp | admin0: it should be out soon | 10:24 |
| evrardjp | rc2 was tagged and it will be used for release in the next day or so. | 10:24 |
| evrardjp | we'll ofc still have bugs, all software has. | 10:24 |
| evrardjp | Okk I've put up the patches for the inclusion of systemd roles (mount and service) into OSA. | 10:27 |
| evrardjp | into infra/governance | 10:28 |
| evrardjp | when these will merge we can continue on stuff like that. | 10:28 |
| evrardjp | in the meantime, we should be independant | 10:28 |
| *** karthi has quit IRC | 10:29 | |
| *** karthi has joined #openstack-ansible | 10:32 | |
| *** vnogin has joined #openstack-ansible | 10:33 | |
| admin0 | evrardjp, thanks .. i will have a demo cluster up today to test .. will test with rc2 and report bugs | 10:35 |
| *** vnogin has quit IRC | 10:38 | |
| *** esberglu has joined #openstack-ansible | 10:41 | |
| *** esberglu has quit IRC | 10:45 | |
| *** savvas has joined #openstack-ansible | 10:50 | |
| *** savvas has quit IRC | 10:54 | |
| *** esberglu has joined #openstack-ansible | 10:58 | |
| *** esberglu has quit IRC | 11:03 | |
| *** ianychoi has quit IRC | 11:07 | |
| *** ianychoi has joined #openstack-ansible | 11:13 | |
| *** ansmith has quit IRC | 11:17 | |
| *** armaan has quit IRC | 11:25 | |
| *** karthi has quit IRC | 11:28 | |
| *** chyka has joined #openstack-ansible | 11:30 | |
| odyssey4me | evrardjp I abandoned https://review.openstack.org/552486 because it kept failng on the upgrade test. So I decided to fail forward, rather than back out. | 11:33 |
| *** chyka has quit IRC | 11:34 | |
| evrardjp | odyssey4me: oh | 11:34 |
| evrardjp | why does it fail on upgrade? | 11:35 |
| *** karthi has joined #openstack-ansible | 11:36 | |
| evrardjp | this morning it failed due to a problem in name resolution | 11:36 |
| evrardjp | I submitted the patches for the inclusion. We don't need to revert the change in a-r-r, we'll just adapt them | 11:36 |
| odyssey4me | evrardjp it was failing during the queens deployment of keystone for some reason which I couldn't figure out | 11:37 |
| evrardjp | it seems to have passed | 11:37 |
| evrardjp | check at the restore: https://review.openstack.org/#/c/552486/ | 11:37 |
| odyssey4me | not consistently | 11:37 |
| evrardjp | oh ok | 11:37 |
| evrardjp | good to know | 11:37 |
| evrardjp | I see we haven't triaged stuff yesterday, if there are enough ppl today maybe we can do it today | 11:38 |
| *** karthi has quit IRC | 11:38 | |
| *** Sha000000 has joined #openstack-ansible | 11:41 | |
| odyssey4me | hwoarang evrardjp so the disk space issue comes down to a real disk space issue | 11:41 |
| evrardjp | OSA queens is released! | 11:42 |
| odyssey4me | in our tests, we get a rax performance 1-8 node ~ 2/3 of the time - that flavor has a small root disk and a large ephemeral additional disk | 11:42 |
| evrardjp | #thanks all the OSA community for making Queens happen! | 11:42 |
| openstackstatus | evrardjp: Added your thanks to Thanks page (https://wiki.openstack.org/wiki/Thanks) | 11:42 |
| hwoarang | awesome :) now we need to get more stuff in ;p | 11:43 |
| odyssey4me | in the bootstrap we recognise an extra disk is available, and partition it - but that extra partition isn't used for anything - the btrfs partition is on the root disk | 11:43 |
| evrardjp | hwoarang: ofc :) | 11:43 |
| evrardjp | odyssey4me: that's more like it! | 11:43 |
| odyssey4me | :) well done to all for queens | 11:43 |
| evrardjp | I would have loved having at the same time removing newton and adding queens. | 11:44 |
| evrardjp | But newton is not done yet. | 11:44 |
| *** udesale__ has quit IRC | 11:45 | |
| *** ygl has joined #openstack-ansible | 11:52 | |
| ygl | can anyone tell me where I can find the logs of my ansible playbook execution ? | 11:52 |
| *** Sha000000 has quit IRC | 11:52 | |
| *** armaan has joined #openstack-ansible | 11:53 | |
| ygl | evrardjp: where can I find the logs of my ansible playbook execution | 11:53 |
| *** vnogin has joined #openstack-ansible | 11:53 | |
| odyssey4me | ygl it outputs to your stdout, but also by default to /openstack/log/ansible-logging/ansible.log or whatever you've set ANSIBLE_LOG_PATH to | 11:56 |
| ygl | odyssey4me: thanks for your information | 11:58 |
| openstackgerrit | Markos Chandras (hwoarang) proposed openstack/openstack-ansible-os_cinder master: tasks: Do not configure backends and API at the same time https://review.openstack.org/552889 | 12:01 |
| odyssey4me | evrardjp hwoarang ok, so given the above information - how do you wish to proceed? want me to put together a patch that solves the disk space issue directly, instead of revamping the bootstrap role as done in https://review.openstack.org/#/c/552047/ ? | 12:05 |
| evrardjp | spotz: I like the idea of office hours. Let's discuss this. | 12:05 |
| *** armaan has quit IRC | 12:05 | |
| evrardjp | odyssey4me: I think hwoarang has a patch, or maybe I am wrong? | 12:05 |
| evrardjp | new patch* | 12:05 |
| hwoarang | odyssey4me: i have submitted two patches | 12:05 |
| odyssey4me | that patch doesn't solve anything | 12:05 |
| hwoarang | so it's not a quota thing? | 12:06 |
| *** armaan has joined #openstack-ansible | 12:06 | |
| odyssey4me | nope, it actually is a lack of disk space | 12:06 |
| hwoarang | ok | 12:06 |
| evrardjp | odyssey4me: you can patch then | 12:06 |
| evrardjp | it seems those patches have their own purpose | 12:06 |
| *** ygl has quit IRC | 12:07 | |
| odyssey4me | I'm not saying that the patches to prevent a quota larger than the real disk doesn't have value - if that is actually an issue, we should cater to preventing that. | 12:07 |
| evrardjp | odyssey4me: the minimum required (not bringing the whole world with you) would be nice | 12:07 |
| odyssey4me | In this case though, our failure, is actually due to a disk space issue. | 12:07 |
| evrardjp | odyssey4me: so the partition thing. | 12:07 |
| evrardjp | Ok | 12:07 |
| odyssey4me | lemme fire up an exact same flavor as the gate uses and figure out a minimal patch | 12:08 |
| evrardjp | odyssey4me: I don't mind having a bigger patch, but its scope should be clear, and explicit. | 12:08 |
| evrardjp | no hidden things :) | 12:08 |
| hwoarang | maybe it's just that the commit messages needs to explain things a little bit more because it's too short right now | 12:09 |
| evrardjp | hwoarang: it pulls at the same time the other repos and all that jazz | 12:10 |
| *** armaan has quit IRC | 12:10 | |
| hwoarang | yep | 12:10 |
| evrardjp | I think it's reasonable to say we can fix that without the need of a new role, not that the role isn't useful. | 12:10 |
| evrardjp | more speed less haste | 12:11 |
| evrardjp | logan-: could you ping me when you're there? I'd like to discuss https://bugs.launchpad.net/openstack-ansible/+bug/1752932 | 12:11 |
| openstack | Launchpad bug 1752932 in openstack-ansible "hostvars breaks on Queens" [Undecided,New] - Assigned to Jean-Philippe Evrard (jean-philippe-evrard) | 12:11 |
| *** ygl has joined #openstack-ansible | 12:15 | |
| ygl | evrardjp: when I execute the infrastructure playbook , it failed saying this | 12:16 |
| ygl | evrardjp: msg": "SSH Error: data could not be sent to remote host \"172.29.236.2\". Make sure this host can be reached over ssh | 12:16 |
| ygl | evrardjp: it is reachable however from the deploy host | 12:17 |
| evrardjp | ygl: a log would be necessary. Could you also run healthcheck-hosts playbook (if running master) | 12:18 |
| ygl | evrardjp: what is the exact command to run that ? | 12:20 |
| *** chyka has joined #openstack-ansible | 12:23 | |
| ygl | evrardjp: this is the log http://paste.openstack.org/show/700913/ | 12:23 |
| *** armaan has joined #openstack-ansible | 12:24 | |
| *** armaan has quit IRC | 12:24 | |
| PTO | Is there a clever idea behind the way the /etc/hosts file generation is implemented in: https://github.com/openstack/openstack-ansible-openstack_hosts/blob/master/tasks/openstack_update_hosts_file.yml | 12:24 |
| evrardjp | PTO there are... and ppl can't use dns | 12:25 |
| evrardjp | some ppl* | 12:25 |
| odyssey4me | PTO you can use the unbound service instead if you like by adding the appropriate hosts into a host group where you want the service to run | 12:25 |
| openstackgerrit | Markos Chandras (hwoarang) proposed openstack/openstack-ansible-os_cinder master: tasks: Do not configure backends and API at the same time https://review.openstack.org/552889 | 12:26 |
| *** chyka has quit IRC | 12:27 | |
| openstackgerrit | Merged openstack/openstack-ansible-os_keystone master: Revert "Convert role to use a common systemd init role" https://review.openstack.org/552486 | 12:27 |
| ygl | evrardjp: did u get a chance to view the logs I have pasted | 12:27 |
| PTO | evrardjp: I would suggest that the template script openstack-host-hostfile-setup.sh.j2 would set a marker which outline a part in the host file which is ansible managed. And then replce that part if the script is re-run. Otherwise the hosts file can become inconsistent with duplicate entities - or even inconsistent | 12:28 |
| *** armaan_ has joined #openstack-ansible | 12:29 | |
| *** hw_wutianwei has joined #openstack-ansible | 12:29 | |
| evrardjp | ygl: no I didn't get the chance to look at it | 12:32 |
| ygl | evrardjp: I am running the setuphosts yml again to check if I could see any errors there | 12:32 |
| *** dave-mccowan has joined #openstack-ansible | 12:32 | |
| evrardjp | ygl: looks like a network issue. Double check your ips are correct, and that the deploy node can reach those nodes. | 12:33 |
| *** vnogin has quit IRC | 12:33 | |
| ygl | evrardjp: it is indded reaching those nodes | 12:34 |
| *** sawblade6 has joined #openstack-ansible | 12:36 | |
| *** vnogin has joined #openstack-ansible | 12:38 | |
| *** karthi has joined #openstack-ansible | 12:45 | |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible master: bootstrap-host: Prepare disk for machinectl storage https://review.openstack.org/552893 | 12:45 |
| odyssey4me | evrardjp hwoarang ^ I think that should do it - testing on two profiles of machine now to verify | 12:46 |
| *** odyssey4me has quit IRC | 12:47 | |
| *** odyssey4me has joined #openstack-ansible | 12:47 | |
| ygl | evrardjp: it is failing at this point again | 12:47 |
| ygl | evrardjp: is it a problem of pip packages or python version issue ? | 12:47 |
| ygl | evrardjp: this is the latest log http://paste.openstack.org/show/700915/ | 12:48 |
| ygl | evrardjp: this is happening when I run openstack-ansible setup-hosts.yml | 12:49 |
| openstackgerrit | Markos Chandras (hwoarang) proposed openstack/openstack-ansible-os_cinder master: tasks: Do not configure backends and API at the same time https://review.openstack.org/552889 | 12:50 |
| *** armaan_ has quit IRC | 12:53 | |
| *** armaan has joined #openstack-ansible | 12:53 | |
| ygl | odyssey4me: hi, I need your help eith my issue please | 12:54 |
| hwoarang | odyssey4me: thanks it looks quite clean | 12:55 |
| odyssey4me | ygl it would seem that the issue is lack of ssh connection, as the error says quite clearly | 12:56 |
| hwoarang | but the loopback thing also happens in lxc_hosts role. i wonder if we duplicate stuff there | 12:56 |
| ygl | odyssey4me: but the nodes are perfectly reachable form the deployment node | 12:56 |
| *** ansmith has joined #openstack-ansible | 12:56 | |
| openstackgerrit | Merged openstack/openstack-ansible-os_nova master: Rearrange cell mapping tasks https://review.openstack.org/547072 | 12:57 |
| ygl | odyssey4me: what else could be the issue ? | 12:58 |
| ygl | odyssey4me: it is able to reach the nodes as root user | 12:58 |
| odyssey4me | ygl I don't know, and am not in a position to dig into it for you at this time. | 12:59 |
| *** SerenaFeng has joined #openstack-ansible | 12:59 | |
| ygl | evrardjp: can you help me if you dont mind | 12:59 |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_nova stable/queens: Rearrange cell mapping tasks https://review.openstack.org/552898 | 13:01 |
| logan- | ygl: run osa with -vvvvv and you can see the exact ssh command that ansible is using. that command is failing. from your osa playbooks directory you could 'ansible -vvvvv hosts -m ping' and debug from there | 13:02 |
| logan- | evrardjp: o/ | 13:02 |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_nova stable/pike: Rearrange cell mapping tasks https://review.openstack.org/552899 | 13:04 |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_nova stable/ocata: Rearrange cell mapping tasks https://review.openstack.org/552900 | 13:04 |
| openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-os_keystone master: Only try to stop services that exist https://review.openstack.org/551010 | 13:05 |
| ygl | logan-: how to execute this exactly | 13:05 |
| evrardjp | logan-: finishing something quick then I can have a look at our host vars thingy | 13:06 |
| ygl | logan-: i can excute this command successfully | 13:06 |
| ygl | logan-: ssh -vvv -C -o ControlMaster=auto -o ControlPersist=60s -o StrictHostKeyChecking=no -o KbdInteractiveAuthentication=no -o PreferredAuthentications=gssapi-with-mic,gssapi-keyex,hostbased,publickey -o PasswordAuthentication=no -o User=root -o ConnectTimeout=5 -o UserKnownHostsFile=/dev/null -o StrictHostKeyChecking=no -o ServerAliveInterval=64 -o ServerAliveCountMax=1024 -o Compression=no -o TCPKeepAlive=yes -o VerifyHo | 13:06 |
| ygl | logan-: it is connecting, but the playbook setup-hosts is failing after this line | 13:07 |
| logan- | ygl: can you pastebin the full setup-hosts output while running with -vvvvv | 13:07 |
| logan- | evrardjp: sure np, going to get coffee | 13:08 |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible master: bootstrap-host: Prepare disk for machinectl storage https://review.openstack.org/552893 | 13:08 |
| ygl | logan-: this is the log http://paste.openstack.org/show/700917/ | 13:10 |
| ygl | logan-: r u able to see my log in the pastebin ? | 13:12 |
| logan- | ygl: yes but it is not really helpful... none of the connection debugging is there that would get outputted to the console with -vvvvv | 13:15 |
| ygl | logan-: just a sec I can get that | 13:16 |
| ygl | logan-: you can check this http://paste.openstack.org/show/700918/ | 13:16 |
| logan- | how are you executing the playbook? what is the exact command string? are you running with sudo? | 13:17 |
| *** savvas has joined #openstack-ansible | 13:19 | |
| ygl | logan-: I am using this "root@demo-deploy:/opt/openstack-ansible/playbooks# openstack-ansible -vvvv setup-hosts.yml" | 13:19 |
| *** vnogin has quit IRC | 13:20 | |
| logan- | what's the output of http://paste.openstack.org/show/700919/ ? | 13:21 |
| openstackgerrit | Markos Chandras (hwoarang) proposed openstack/openstack-ansible-os_cinder master: tasks: Do not check the load balancer uri for API status https://review.openstack.org/552889 | 13:22 |
| ygl | logan-: http://paste.openstack.org/show/700921/ | 13:22 |
| *** savvas has quit IRC | 13:24 | |
| evrardjp | no keys? | 13:24 |
| evrardjp | ygl: make sure your connection is fine with keys. | 13:24 |
| ygl | evrardjp: yes it is fine | 13:24 |
| evrardjp | I haven't looked in details | 13:25 |
| logan- | looks like it succeeds there, very strange | 13:25 |
| ygl | logan-: found anything ? | 13:25 |
| ygl | logan-: yes | 13:25 |
| ygl | logan-: does it have to do with any pip packages or version mismatches as such | 13:26 |
| evrardjp | and ansible connection doesn't work ? | 13:26 |
| evrardjp | ansible -m ping ? | 13:26 |
| logan- | instead of 'echo TESTING' try 'python --version' | 13:26 |
| ygl | evrardjp: what is the exact ping command to use ? | 13:26 |
| evrardjp | ansible -m ping <youransibleinventoryhostname> | 13:26 |
| evrardjp | you need: ssh + python-json on the host to work | 13:27 |
| evrardjp | should be explicit if that doesnt work and ssh work, then you know the issue. | 13:27 |
| odyssey4me | ygl not sure I understand why you think it has to do with python packages. Have you done something out of the ordinary to make you think that? | 13:27 |
| ygl | evrardjp: i see no output for "ansible -m ping 172.29.236.1" . it is showing warnings thats all | 13:27 |
| evrardjp | ygl: not the IP | 13:27 |
| ygl | odyssey4me:not so | 13:27 |
| evrardjp | the ansible inventory hostname | 13:28 |
| evrardjp | I guess for your case it would infra1 | 13:28 |
| evrardjp | or compute1 or compute2 or log1 | 13:28 |
| ygl | evrardjp: in that case also it is showing warnings but no output | 13:28 |
| evrardjp | that's not possible | 13:29 |
| evrardjp | it should show failure or ok | 13:29 |
| ygl | evrardjp: so we have to resolve hostnames for those ips ? | 13:29 |
| evrardjp | and maybe extra warnings | 13:29 |
| evrardjp | no | 13:29 |
| evrardjp | but it wouldn't hurt | 13:29 |
| ygl | evrardjp: it si showing only warnings | 13:29 |
| evrardjp | it looks like http://paste.openstack.org/show/700915/ you have failure on gathering facts | 13:29 |
| ygl | evrardjp: yes | 13:30 |
| evrardjp | check you have python installed on hosts. | 13:30 |
| ygl | yers it is | 13:30 |
| ygl | python 2.7 | 13:30 |
| evrardjp | please paste the output of logan- 's command | 13:30 |
| ygl | evrardjp: u mean python version ? | 13:31 |
| evrardjp | AHAHAHAH | 13:31 |
| evrardjp | I think I know. | 13:31 |
| evrardjp | could you show your inventory again? | 13:31 |
| ygl | evrardjp: how to do it ? | 13:31 |
| evrardjp | I think you wrapped your ip with double quotes. | 13:31 |
| *** karthi has quit IRC | 13:31 | |
| evrardjp | well | 13:31 |
| evrardjp | maybe | 13:31 |
| evrardjp | I don't know | 13:31 |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_keystone master: Add memcache setup to shibboleth2.xml https://review.openstack.org/550427 | 13:31 |
| evrardjp | ygl: first execute logan- 's command :) | 13:32 |
| ygl | evrardjp: which command ? | 13:32 |
| evrardjp | the one with echo TESTING, replace echo TESTING with python --version | 13:32 |
| logan- | ie http://paste.openstack.org/show/700923/ | 13:33 |
| ygl | evrardjp: http://paste.openstack.org/show/700922/ | 13:33 |
| odyssey4me | hmm, this looks like a good idea to me, but I'm not trusting my thought process - evrardjp can you look ? https://review.openstack.org/552711 | 13:33 |
| ygl | logan-: http://paste.openstack.org/show/700922/ | 13:33 |
| ygl | evrardjp: logan- I am testing this on vms hosted on openstack. I enabled all tcp ports in the security groups. any more ports to open ? | 13:35 |
| ygl | evrardjp: logan- since it is saying it failed to transfer ssh data in particular | 13:36 |
| ygl | evrardjp: logan- but I enable port 22 however | 13:36 |
| ygl | evrardjp: logan- any thoughts | 13:37 |
| logan- | everything seems fine w/ connection path. could you pastebin your openstack_user_config file | 13:39 |
| ygl | logan-: http://paste.openstack.org/show/700924/ | 13:39 |
| evrardjp | odyssey4me: will have a look right away | 13:40 |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible master: bootstrap-host: Prepare disk for machinectl storage https://review.openstack.org/552893 | 13:41 |
| *** SerenaFeng has quit IRC | 13:41 | |
| ygl | logan-: do I have generate inventory before executing the playbooks ? | 13:42 |
| *** vnogin has joined #openstack-ansible | 13:44 | |
| ygl | logan-: found anything ? | 13:44 |
| logan- | no ansible will execute osa's dynamic inventory automatically to generate the inventory. | 13:46 |
| logan- | dont see any obvious issues in there | 13:46 |
| ygl | logan-: no | 13:46 |
| *** vnogin has quit IRC | 13:48 | |
| ygl | logan-: any luck ? | 13:52 |
| ygl | logan-: one more thing. will ansible fail if I execute playbboks from a screen ? | 13:53 |
| *** savvas has joined #openstack-ansible | 13:53 | |
| ygl | logan-: i dont think so | 13:54 |
| openstackgerrit | Matthew Thode proposed openstack/openstack-ansible-os_tempest stable/queens: update for changes needed to pass refstack https://review.openstack.org/552905 | 13:55 |
| evrardjp | jmccrory: commented on https://review.openstack.org/#/c/552711/2 | 13:55 |
| openstackgerrit | Matthew Thode proposed openstack/openstack-ansible-os_tempest stable/pike: update for changes needed to pass refstack https://review.openstack.org/552906 | 13:55 |
| logan- | only if your screen breaks your control path to the nodes.... but since you appear to be running the ansible commands alongside the ssh commands where you verified a valid control path that probably isn't the issue | 13:55 |
| prometheanfire | ^ since that was originally tested on pike | 13:55 |
| ygl | logan-: hmm | 13:55 |
| *** savvas has quit IRC | 13:58 | |
| ygl | logan-: still it is failing | 14:00 |
| *** esberglu has joined #openstack-ansible | 14:00 | |
| openstackgerrit | Logan V proposed openstack/openstack-ansible master: Stop running get-ansible-role-requirements with -vvv https://review.openstack.org/552908 | 14:03 |
| *** Sha000000 has joined #openstack-ansible | 14:03 | |
| cloudnull | mornings | 14:04 |
| ygl | cloudnull: Hi | 14:04 |
| evrardjp | logan-: it's time for my hot beverage now, then I guess we are good to go :) | 14:05 |
| *** Sha000000 has quit IRC | 14:05 | |
| evrardjp | morning cloudnull | 14:05 |
| evrardjp | cloudnull: https://review.openstack.org/#/c/552861/ | 14:05 |
| ygl | logan-: what does it do exactly at gathering facts stage ? | 14:06 |
| cloudnull | evrardjp: want to pull in https://github.com/cloudnull/ansible-systemd_networkd too ? | 14:07 |
| *** savvas has joined #openstack-ansible | 14:07 | |
| odyssey4me | good call | 14:08 |
| mnaser | can i get a lil bit of love for https://review.openstack.org/#/c/551718/ :( | 14:08 |
| mnaser | i need to backport all the way to stable/pike | 14:08 |
| evrardjp | cloudnull: oh yes why not | 14:08 |
| evrardjp | we have three patches to edit then it should be quick | 14:09 |
| mnaser | is the linters job fixed btw? | 14:09 |
| evrardjp | mnaser: right away | 14:09 |
| cloudnull | mnaser: looks like -% is all that changed? | 14:09 |
| *** gokhan_ has joined #openstack-ansible | 14:09 | |
| evrardjp | mnaser: we should probably add a test in config_template to be more lenient | 14:10 |
| mnaser | cloudnull: yes, but without that, if neutron_lbaasv2 is True, there is 2 more spaces added | 14:10 |
| evrardjp | that's probably due to the change we added to allow comments | 14:10 |
| mnaser | cloudnull: and then the first line of config becomes ' # General, applies to all host groups' rather than '# General, applies to all host groups' | 14:10 |
| odyssey4me | mnaser so if there are blank line breaks before [DEFAULT] then something falls apart? | 14:10 |
| cloudnull | ah. mnaser lgtm :) | 14:11 |
| mnaser | i think the issue is the fact there are two spaces before the comment before the firs tsection | 14:11 |
| evrardjp | in the commit message it's said spaces and # | 14:11 |
| cloudnull | and everyone else it seems :) | 14:11 |
| mnaser | also, it isnt breaking in config_template also | 14:11 |
| odyssey4me | oh, so it's not the line breaks - it's that there are spaces before the comment # | 14:11 |
| mnaser | when i hacked around it manually, neutron wouldnt start because ConfigParser fails to parse it | 14:11 |
| mnaser | so its more of a configparser issue | 14:11 |
| evrardjp | mnaser: because empty line with comments? | 14:11 |
| mnaser | evrardjp: empty line with leading space with comment, before the first section | 14:12 |
| evrardjp | mnaser: it's worth adding as a test | 14:12 |
| odyssey4me | yeah, sounds like something better solved in config_template | 14:12 |
| evrardjp | but we should probably have the same thing as template: a validate clause | 14:12 |
| evrardjp | which we do not, because we leverage copy module, not template, behind the scenes. | 14:13 |
| *** SerenaFeng has joined #openstack-ansible | 14:13 | |
| mnaser | but even then i guess config_template would have to be smart enough not to render things with leading spaces too | 14:13 |
| mnaser | it should be fairly easy to replicate.. just use a config_template with ' # foo\n[DEFAULT]' with overrides and itll fail | 14:13 |
| evrardjp | mnaser: at least having something that allows that | 14:13 |
| *** karthi has joined #openstack-ansible | 14:14 | |
| evrardjp | like if you allow comments, allow empty lines with comments, and be smart with it | 14:14 |
| evrardjp | mnaser: yes indeed | 14:14 |
| evrardjp | could you at least file a bug this way we won't forget? | 14:14 |
| evrardjp | I can tackle it in the future when config_template is in its own repo | 14:14 |
| mnaser | sounds good | 14:15 |
| *** savvas has quit IRC | 14:15 | |
| evrardjp | there is no urgency right now I'd say, with that fix included | 14:15 |
| mnaser | all bugs go under osa? | 14:15 |
| evrardjp | yeah | 14:15 |
| *** electrofelix has quit IRC | 14:16 | |
| gokhan_ | hi folks, in my environment my internet connection has been down about 8 hours. after that I tried to create an instance with self service network. but I didn't reach the instance with floating ip. I also tried create new network and router and then create instance with new network. I see that I can reach instance which is created with new network. the problem seem about routing/router. What is your thoughts about this problem and how can I solv | 14:17 |
| gokhan_ | e this ? | 14:17 |
| odyssey4me | cloudnull evrardjp I have a suggestion for https://review.openstack.org/552047 - given that it was entirely rewritten, abandon that and cloudnull recreate it, but focus it on switching the bootstrap to use the new roles. Base it on https://review.openstack.org/552893 which, if we get it merged, we can backport all the way to pike - whereas the new roles really should not be used in the stable branches. | 14:17 |
| mnaser | https://bugs.launchpad.net/openstack-ansible/+bug/1755821 | 14:17 |
| openstack | Launchpad bug 1755821 in openstack-ansible "config_template fails to parse template if it contains a comment with leading spaces" [Undecided,New] | 14:17 |
| mnaser | voila | 14:17 |
| ygl | logan-: found any thing ? | 14:18 |
| evrardjp | mnaser: thanks! | 14:19 |
| evrardjp | odyssey4me: completely agreed. | 14:19 |
| logan- | ygl: nope.. im not sure what the issue is sorry. | 14:19 |
| logan- | evrardjp: need to go afk but i posted tons of additional output on https://bugs.launchpad.net/openstack-ansible/+bug/1752932 | 14:20 |
| openstack | Launchpad bug 1752932 in openstack-ansible "hostvars breaks on Queens" [Undecided,New] - Assigned to Jean-Philippe Evrard (jean-philippe-evrard) | 14:20 |
| *** ygl has quit IRC | 14:20 | |
| logan- | evrardjp: the last 2 pastes allow you to completely recreate the environment in either py2/py3 with just a few commands and a few minutes to sit through bootstrap-ansible | 14:20 |
| odyssey4me | jmccrory please validate that https://review.openstack.org/#/q/I4f7328e1aff79eb94f278999b97fbad8f44c6a3e are all right - they're backports of your patch to master | 14:21 |
| evrardjp | odyssey4me: cloudnull you can deal with the co-author if need be, but I think this is cleaner approach. | 14:21 |
| logan- | dang just noticed paste.openstack.org truncated the output | 14:22 |
| evrardjp | logan-: thanks. | 14:23 |
| evrardjp | cloudnull: we shouldn't add a new deliverable into stable branches, that's a nightmare later. We can now though. | 14:23 |
| odyssey4me | evrardjp with thanks to jrosser we save just a little time for new builds with https://review.openstack.org/551010 | 14:24 |
| evrardjp | I'd just prefer if we keep the two separate | 14:24 |
| cloudnull | odyssey4me: ++ | 14:25 |
| evrardjp | odyssey4me: that is nice | 14:26 |
| evrardjp | let me check if that interface is stable on the ansible side | 14:26 |
| odyssey4me | cloudnull happened upon the same and pushed up a similar patch yesterday, but jrosser got there first ;) | 14:26 |
| * cloudnull abandoned mine | 14:27 | |
| * jrosser waves o/ | 14:27 | |
| cloudnull | anyone want to give this a nudge forward https://review.openstack.org/#/c/552643/1 | 14:28 |
| evrardjp | jrosser: you love your systemd do you? | 14:28 |
| evrardjp | :) | 14:28 |
| odyssey4me | cloudnull that's not necessary any more - the systemd role inclusion was reverted | 14:29 |
| evrardjp | wow we are depending on systemd being stable for this to not fail. | 14:29 |
| odyssey4me | evrardjp We are depending on systemd, whether we like it or not. | 14:30 |
| cloudnull | we've been depending on systemd whether we like it or not :) | 14:30 |
| evrardjp | odyssey4me: yeah, I am fine with depending on systemd. Depending on a systemd stable interface with is relatively not user related is more tricky | 14:31 |
| evrardjp | depending on a systemd interface (that's not user related) being stable* is another thing. | 14:31 |
| evrardjp | I think we are good | 14:31 |
| evrardjp | we'll see | 14:31 |
| evrardjp | chances are high it will stay as is. | 14:31 |
| Bico_Fino | Morning. | 14:32 |
| cloudnull | o/ Bico_Fino | 14:32 |
| Bico_Fino | What's the best way to inject an entry on /etc/hosts for every container? | 14:32 |
| evrardjp | morning Bico_Fino | 14:32 |
| cloudnull | odyssey4me: so do i revert the revert w/ those changes? | 14:33 |
| cloudnull | or just abandon that effort for now | 14:34 |
| evrardjp | cloudnull: I planned to revert the revert | 14:35 |
| evrardjp | just take your time, and use the new repo | 14:35 |
| evrardjp | cloudnull: why did you abandon this? https://review.openstack.org/#/c/552643/1 | 14:37 |
| evrardjp | oh it all gonna be in your role maybe? | 14:37 |
| cloudnull | no. | 14:37 |
| cloudnull | it was a dependent patch | 14:37 |
| *** savvas has joined #openstack-ansible | 14:37 | |
| cloudnull | and in merge conflict after the revert | 14:38 |
| cloudnull | so i'll just incorporate those changes into the main one | 14:38 |
| cloudnull | it was an unforseen issue when using py3 in the integrated gate. | 14:39 |
| evrardjp | it's a good patch | 14:40 |
| evrardjp | needs to be backported to Q I guess | 14:40 |
| cloudnull | only if we backport the systemd things | 14:41 |
| cloudnull | ** systemd_role things | 14:41 |
| evrardjp | oh. | 14:41 |
| evrardjp | Ok. | 14:41 |
| evrardjp | then it won't be possible :( | 14:42 |
| *** savvas has quit IRC | 14:42 | |
| evrardjp | Manual stuff I guess. | 14:42 |
| *** sar has quit IRC | 14:43 | |
| *** marwel has joined #openstack-ansible | 14:43 | |
| odyssey4me | evrardjp the revert of the revert will have to include that patch, otherwise it won't work - so perhaps better to propose a whole new combined patch | 14:44 |
| openstackgerrit | Merged openstack/openstack-ansible-galera_server master: Updated from global requirements https://review.openstack.org/552197 | 14:45 |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-os_keystone master: Convert role to use a common systemd init role https://review.openstack.org/552914 | 14:48 |
| cloudnull | there's the new patch. I'll update it and the other ones I had in flight when the roles are imported | 14:48 |
| odyssey4me | cloudnull perhaps mark them all -w then while you continue working through the roles? | 14:49 |
| cloudnull | done. | 14:56 |
| cloudnull | should we revert all of the service role inclusions too ? | 14:58 |
| cloudnull | or will we just make a new set of prs once the roles are in the os namespace ? | 14:58 |
| *** chyka has joined #openstack-ansible | 14:59 | |
| evrardjp | odyssey4me: yes you're right. | 14:59 |
| evrardjp | cloudnull just a new set of PRs, it's not hurting to just download stuff | 15:00 |
| *** Sha000000 has joined #openstack-ansible | 15:00 | |
| odyssey4me | cloudnull once the roles are imported I can revise them - I don't think they're doing any harm right now | 15:00 |
| evrardjp | for role tests | 15:00 |
| evrardjp | yeah no harm right now on each of the repos' tests. | 15:00 |
| *** Sha000000 has quit IRC | 15:01 | |
| *** vnogin has joined #openstack-ansible | 15:03 | |
| cloudnull | to that end, will we need to pull in the following roles into the OS namesapce http://paste.openstack.org/show/700951 - I assume this comment applies to all of our non-os namespace roles http://eavesdrop.openstack.org/irclogs/%23openstack-ansible/latest.log.html#t2018-03-14T08:20:18 ? | 15:05 |
| *** bitshifter has joined #openstack-ansible | 15:05 | |
| *** SerenaFeng has quit IRC | 15:06 | |
| bitshifter | @odyssey4me Do you know where i might be able to find out what variables are required to be defined in user_variables.yml for the desginate install? I assume i can scrap most of them aside from things i want to specify | 15:11 |
| openstackgerrit | Merged openstack/openstack-ansible-os_searchlight stable/queens: Point to Queens instead of master https://review.openstack.org/544862 | 15:11 |
| bitshifter | is it purely just the 4 entries listed here? https://docs.openstack.org/openstack-ansible-os_designate/latest/ | 15:11 |
| evrardjp | cloudnull: the idea was to: re-use what we can for infra. We can re-use systemd things, but it's a dependency to all openstack components, so the question is asked: How will you do releasing if we depend on your thing? | 15:19 |
| evrardjp | on your paste, there is only one that I think should be included | 15:19 |
| evrardjp | https://github.com/logan2211/ansible-haproxy-endpoints | 15:19 |
| evrardjp | that one is used in all our roles as a mandatory patch | 15:19 |
| evrardjp | path* | 15:19 |
| evrardjp | the rest is skippable | 15:19 |
| evrardjp | cloudnull: what's your point though? How do you plan to use this in your namespace, if we don't include it? | 15:20 |
| evrardjp | Do you want us to rely on this, and you'll tag appropriately? | 15:20 |
| evrardjp | You see all this discussion should not have happened on the channel, but in a spec instead | 15:21 |
| evrardjp | to keep an easy record | 15:21 |
| odyssey4me | bitshifter it shouldn't need anything if you're using the integrated build - the passwords are already in user_secrets.yml - you'll only need to populate the config entries to inform designate where your dns service is | 15:23 |
| evrardjp | cloudnull: should I write the spec for you? | 15:24 |
| openstackgerrit | Merged openstack/openstack-ansible-tests stable/queens: Use OpenStack-Infra mirrors for tests https://review.openstack.org/548216 | 15:26 |
| bitshifter | @odyssey4me - You're talking about pools.yml right? | 15:29 |
| openstackgerrit | Merged openstack/openstack-ansible-os_keystone master: Only try to stop services that exist https://review.openstack.org/551010 | 15:29 |
| odyssey4me | bitshifter it's been a very long time since I've looked at it - and I'm in a conf call right now... my advice is not to over think it :) try, fail, fix, repeat ;) | 15:30 |
| bitshifter | all good. Thanks for the advice thus far :) | 15:31 |
| *** Sha000000 has joined #openstack-ansible | 15:32 | |
| *** esberglu has quit IRC | 15:33 | |
| openstackgerrit | Merged openstack/openstack-ansible-galera_server stable/queens: tasks: galera_post_install: Do not secure the DB on upgrades https://review.openstack.org/552864 | 15:34 |
| openstackgerrit | Merged openstack/openstack-ansible-galera_server stable/queens: tasks: galera_upgrade_pre: Fix conditional for apt sources https://review.openstack.org/552862 | 15:34 |
| openstackgerrit | Merged openstack/openstack-ansible-tests stable/queens: test-prepare-host: Switch package state to 'present' on openSUSE https://review.openstack.org/551923 | 15:38 |
| openstackgerrit | Merged openstack/openstack-ansible-specs master: Add spec for centralized nginx https://review.openstack.org/524812 | 15:41 |
| *** joseg has joined #openstack-ansible | 15:42 | |
| *** joseg has left #openstack-ansible | 15:42 | |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_nova stable/queens: Rearrange cell mapping tasks https://review.openstack.org/552898 | 15:42 |
| odyssey4me | evrardjp updated per your request | 15:43 |
| *** joseg has joined #openstack-ansible | 15:43 | |
| evrardjp | thanks | 15:43 |
| evrardjp | cloudnull: I'd like we discuss this with everyone | 15:44 |
| *** throwsb1 has joined #openstack-ansible | 15:46 | |
| *** esberglu has joined #openstack-ansible | 15:48 | |
| odyssey4me | jmccrory PS2 uses include ;) | 15:48 |
| jmccrory | hah yeah saw the update right after i commented of course | 15:48 |
| jmccrory | think it's just weird 2.5 behavior, should be fine with queens and back | 15:49 |
| evrardjp | jmccrory: mmm what do you mean there? | 15:50 |
| *** ThomasS has quit IRC | 15:50 | |
| cloudnull | evrardjp: in this mornings scroll back it was said that we have to stop work on the systemd include role work because the roles were not in the OS namespace and is risky. However IMHO these roles are no more risky than the other external roles we're carrying all of which have the same risk, should they be deleted or messed with all deployments would stop dead in their tracks. | 15:50 |
| cloudnull | I'm fine with them being in the OS namespace, in fact I'd prefer that. | 15:51 |
| evrardjp | ok | 15:51 |
| evrardjp | cloudnull: you have to remember we talked about including many of those roles into OSA in the past :) | 15:51 |
| cloudnull | but the various blocks, workarounds, and reverts seem like we're not applying the same logic everywhere | 15:51 |
| evrardjp | we are not applying the same logic everywhere, that's true | 15:52 |
| evrardjp | inputs are different | 15:52 |
| cloudnull | they are not | 15:52 |
| cloudnull | the inputs are the same . | 15:52 |
| evrardjp | that's where we disagree :) | 15:53 |
| evrardjp | for deploying nova you don't care about keepalived. | 15:53 |
| *** Sha000000 has quit IRC | 15:53 | |
| cloudnull | if you were to delete that role all deployments of osa would break | 15:53 |
| evrardjp | for deploy a complete AIO you don't care about keepalived, resolvconf role | 15:53 |
| cloudnull | regardless if keepalived was even used | 15:54 |
| evrardjp | cloudnull: that's true. But an empty repo as a replacement would still "pass" | 15:54 |
| cloudnull | or haproxy for that matter | 15:54 |
| evrardjp | it wouldn't do the same thing. | 15:54 |
| evrardjp | haproxy-endpoints-management is, as I said, the only one that's very risky | 15:54 |
| evrardjp | I'd like to see what we can do there | 15:55 |
| cloudnull | ansible-sshd | 15:55 |
| cloudnull | no aio would build | 15:55 |
| evrardjp | that's only for aio | 15:55 |
| jmccrory | evrardjp with 2.5, using an include or include_tasks there wasn't delegating correctly. some combination of assigning the delegated host through a variable and using a loop maybe? | 15:55 |
| evrardjp | and we can probably skip it too | 15:55 |
| evrardjp | jmccrory: I guess that doesn't matter for queens? | 15:56 |
| jmccrory | don't think so | 15:56 |
| evrardjp | ok | 15:56 |
| evrardjp | we need to care about what's happening there in 2.5 | 15:56 |
| evrardjp | in master I meant | 15:56 |
| admin0 | out of curiosity, what is a 2.5 ? | 15:57 |
| evrardjp | admin0: it's ansible 2.5 we are talking about | 15:57 |
| evrardjp | out soon | 15:57 |
| admin0 | i thought 3 was the latest :) | 15:57 |
| evrardjp | no | 15:58 |
| evrardjp | nice try! | 15:58 |
| evrardjp | cloudnull: what are the repos we need to bring? did you name them all systemd- on your github? | 16:00 |
| *** SerenaFeng has joined #openstack-ansible | 16:01 | |
| cloudnull | yup | 16:02 |
| cloudnull | ansible-systemd_* | 16:02 |
| hwoarang | jmccrory: could you please have a look on https://review.openstack.org/552889 ? | 16:03 |
| *** PTO has quit IRC | 16:03 | |
| *** flemingo has joined #openstack-ansible | 16:04 | |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-memcached_server stable/newton: Add handler when systemd is used https://review.openstack.org/552942 | 16:04 |
| jmccrory | hwoarang lgtm | 16:05 |
| evrardjp | cloudnull: ok next question: for me we should add that into our deliverable, but I'd like this to be re-used by other ppl. | 16:07 |
| hwoarang | thank you jmccrory | 16:07 |
| evrardjp | cloudnull: Do you think this should follow openstack branching? | 16:07 |
| evrardjp | or not? | 16:07 |
| cloudnull | no, it should not follow openstack branching . | 16:07 |
| openstackgerrit | Markos Chandras (hwoarang) proposed openstack/openstack-ansible master: inventory: all: Switch package state to 'present' on openSUSE https://review.openstack.org/552944 | 16:07 |
| evrardjp | ok | 16:08 |
| evrardjp | so independant releasing? | 16:08 |
| evrardjp | sounds good | 16:08 |
| cloudnull | ++ | 16:08 |
| *** masber has quit IRC | 16:10 | |
| evrardjp | I suppose in the future you can even include your library into that, if you want to use more modules for managing these things. | 16:12 |
| evrardjp | if we want* | 16:12 |
| evrardjp | logan-: cloudnull has raised a valid concern here, what about the haproxy-endpoints-manage? | 16:14 |
| cloudnull | I really am OK with those roles being in a separate place. they're no different than any project dependency, like pip | 16:15 |
| cloudnull | my frustration is that external by someone else seems to be ok, external by me is cause for a work stopage | 16:16 |
| evrardjp | cloudnull: I will not stand you being a victim of my brain! I will defend your honor! | 16:17 |
| *** radeks has quit IRC | 16:18 | |
| *** flemingo_ has joined #openstack-ansible | 16:18 | |
| evrardjp | cloudnull: don't worry if I am like that, I just think that commit wasn't good enough for merging -- It might be only the commit message, it might be the inclusion in the same patch, but anyway, reading the patch commit message and what it did was two different things | 16:19 |
| evrardjp | that's not normal | 16:19 |
| evrardjp | now the inclusion is more inclusion into common roles, outside OSA namespacing, and that's a good opportunity to share. If we leave it into a separate github thing, it will never have the visibility this can have | 16:20 |
| *** udesale has joined #openstack-ansible | 16:20 | |
| *** flemingo has quit IRC | 16:21 | |
| cloudnull | Totally agree. however the import of those roles into the os namespace could happen in parallel no in serial. | 16:21 |
| *** exodusftw has quit IRC | 16:22 | |
| evrardjp | I guess all I needed to know is "what's going on, where are we headed with that" | 16:22 |
| evrardjp | it's now clearer | 16:23 |
| evrardjp | I am confused about the order too | 16:23 |
| evrardjp | I was confused about the order | 16:23 |
| evrardjp | I'd have thought PoC > spec > import role > modify roles to use the imported roles | 16:24 |
| odyssey4me | personally, my only hassle was that it merged in keystone and broke everything else - given that we're early in the cycle, and the intent to import the role into the namespace was clear, I had no objections to it going ahead as-is | 16:25 |
| *** exodusftw has joined #openstack-ansible | 16:25 | |
| evrardjp | I didn't see the value of adding more patches to now move to a new location and stuff | 16:25 |
| *** udesale has quit IRC | 16:26 | |
| evrardjp | also adding the role into the namespace sooner rather than later brings more visibility into the process, respecting the idea of the 4 opens. | 16:26 |
| *** karthi has quit IRC | 16:27 | |
| evrardjp | I guess it's all done now | 16:27 |
| cloudnull | its done now. I'll wait for the roles to hit the os namespace and continue marching on | 16:27 |
| *** masber has joined #openstack-ansible | 16:29 | |
| *** exodusftw has quit IRC | 16:30 | |
| *** SerenaFe_ has joined #openstack-ansible | 16:33 | |
| *** exodusftw has joined #openstack-ansible | 16:33 | |
| spotz | evrardjp: I'm debugging something but around if you need me | 16:34 |
| *** karthi has joined #openstack-ansible | 16:35 | |
| *** SerenaFeng has quit IRC | 16:35 | |
| evrardjp | just wanted to discuss office hours | 16:38 |
| *** vnogin has quit IRC | 16:40 | |
| *** vnogin has joined #openstack-ansible | 16:42 | |
| *** vnogin has quit IRC | 16:43 | |
| *** karthi has quit IRC | 16:44 | |
| *** masber has quit IRC | 16:44 | |
| spotz | evrardjp: okie | 16:47 |
| evrardjp | spotz: so what are the responsibilities/duties/organizational aspects of this? | 16:47 |
| evrardjp | Pros/cons | 16:47 |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-memcached_server stable/newton: Add handler when systemd is used https://review.openstack.org/552942 | 16:49 |
| openstackgerrit | Markos Chandras (hwoarang) proposed openstack/openstack-ansible master: zuul: Make openSUSE a voting job https://review.openstack.org/552977 | 16:49 |
| spotz | evrardjp: It seems the origin of it was to help squash bugs faster by having folks available to answer questions and help new contributers. Now we're actually really good at helping folks, so in our case it might just be hey folks are available between these hours as we have atleast 3-5 folks who work on OSA full time? | 16:50 |
| *** masber has joined #openstack-ansible | 16:51 | |
| odyssey4me | spotz evrardjp most who join us in channel find that we're available to help most times :) | 16:52 |
| odyssey4me | I guess instituting office hours would have value in designating a time where we try to not be busy with other things and try to be ready to help anyone with any questions | 16:52 |
| *** SerenaFe_ has quit IRC | 16:52 | |
| spotz | odyssey4me evrardjp Yeah I think except for during the holidays and maybe late night we have folks about | 16:53 |
| odyssey4me | it all depends on how well we're sleeping ;) | 16:53 |
| spotz | And maybe its just during holidays we communicate folks will be out but you can find someone between 4-5 or something | 16:53 |
| Taseer | evrardjp: the congress tempest test failed. Do I need to make it pass ? | 16:54 |
| *** radeks has joined #openstack-ansible | 16:54 | |
| *** armaan has quit IRC | 16:59 | |
| evrardjp | Taseer: what's the cause? | 17:02 |
| evrardjp | spotz: odyssey4me so my understanding is that it's not really needed ? | 17:02 |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_glance master: [WIP] Use a common python build role for source builds https://review.openstack.org/551344 | 17:03 |
| spotz | evrardjp odyssey4me - Or needed during holidays? | 17:03 |
| *** jamesdenton has joined #openstack-ansible | 17:04 | |
| Taseer | evrardjp: https://hastebin.com/ajilabawag.tex | 17:04 |
| *** gkadam has quit IRC | 17:05 | |
| openstackgerrit | Merged openstack/openstack-ansible-os_keystone master: Avoid conflicting delegation with authorized_keys https://review.openstack.org/552711 | 17:05 |
| *** flemingo has joined #openstack-ansible | 17:06 | |
| *** radeks has quit IRC | 17:06 | |
| *** radeks has joined #openstack-ansible | 17:07 | |
| evrardjp | spotz: not sure to understand the message | 17:07 |
| odyssey4me | evrardjp spotz If it is instituted, then it should be done with the explicit purpose of ensuring that newcomers and other projects are aware that this is a good time to interact. It will need to be a time when the PTL and some supporting contributors are always ready and able to help. We would, during that time, set aside whatever we're busy with and specifically be ready to answer questions. | 17:08 |
| spotz | evrardjp: Basically if everyone or most everyone is going to be out communicate to the lists | 17:08 |
| *** radeks has quit IRC | 17:08 | |
| odyssey4me | Confident contributors, and even some newcomers come into the channel and ask any time - but in this case it would be a specific time where we make ourselves available and are not distracted. | 17:08 |
| *** radek_ has joined #openstack-ansible | 17:09 | |
| *** radek_ has quit IRC | 17:10 | |
| *** flemingo has quit IRC | 17:10 | |
| *** flemingo_ has quit IRC | 17:10 | |
| *** radeks has joined #openstack-ansible | 17:10 | |
| odyssey4me | I'm not advocating that we do it - I'm just suggesting that if we do, we should scope it properly. | 17:10 |
| evrardjp | odyssey4me: understood. It's all about setting expectations. We don't want to set office hours and have no one in it. | 17:13 |
| spotz | evrardjp odyssey4me correct | 17:13 |
| odyssey4me | yep, we also don't want it to be like any other time in the channel | 17:13 |
| *** armaan has joined #openstack-ansible | 17:13 | |
| openstackgerrit | Jimmy McCrory proposed openstack/openstack-ansible-os_keystone stable/queens: Avoid conflicting delegation with authorized_keys https://review.openstack.org/552983 | 17:13 |
| evrardjp | it could change the face of our channel too, here it's very welcoming. If we say: Could you come back when it's office hours, it kinda creates a frozen barrier between people | 17:13 |
| spotz | It'd be interesting to see if some folks show up during bug triage because they think that'ss the only time to find us | 17:13 |
| spotz | evrardjp: I think if folks are here we should ever do that unless it's just me and I can't answer:) | 17:14 |
| spotz | ever=never | 17:14 |
| odyssey4me | evrardjp spotz yeah, quite honestly I think we're welcoming already, and very available - I'm not sure setting office hours adds much value | 17:14 |
| evrardjp | spotz: no what we see the most is ppl asking question, anytime, and during bug triage, we just ask to delay the question a little... And we generally answer even during triage :) | 17:14 |
| odyssey4me | if anything, I would think that perhaps ML notification of decisions taken or things to be communicated might be something worthwhile... | 17:15 |
| evrardjp | yeah basically throwing a list of discussions and decisions would be nice. I am planning to do this manually but it could even be a bot doing it. | 17:17 |
| *** pcaruana has quit IRC | 17:18 | |
| evrardjp | or we are just very open with the startmeeting. | 17:18 |
| evrardjp | :) | 17:18 |
| odyssey4me | well now, using a bot with a wiki page to record things could be something to do... like infra has a bot to record events/actions | 17:20 |
| odyssey4me | that said, I'm not sure we have all that many of those things going on | 17:20 |
| odyssey4me | at this point I'd far rather see some sort of tooling for bug trends | 17:21 |
| evrardjp | yeah that's better indeed. | 17:21 |
| evrardjp | well I can summarize this for you. Up to the right! | 17:21 |
| evrardjp | (open bugs) | 17:21 |
| odyssey4me | it'd be super-nice to be able to see the flow of bugs - incoming, throughput, etc | 17:21 |
| hwoarang | yep^ +1 | 17:22 |
| evrardjp | yup I had asked bernardo to have that. So basically we can use something Ian did in the past. | 17:22 |
| *** epalper has quit IRC | 17:22 | |
| evrardjp | I haven't the code yet, but I can maybe ask | 17:22 |
| odyssey4me | I found this, but it's likely dated and unmaintained: https://github.com/Mirantis/launchpad-reports-summary | 17:23 |
| admin0 | i think bugs should be addressed in revere date order in the triage :) the one who reported first has to keep waiting because the time is up till it reaches his part | 17:23 |
| evrardjp | admin0: the triage is checking newest bugs | 17:24 |
| evrardjp | it's not about addressing them | 17:24 |
| evrardjp | fixing bugs is another story, and is probably why we have the triage in the first place | 17:25 |
| * odyssey4me goes to infra to discuss :) | 17:25 | |
| evrardjp | but I agree, we sometimes lack time to triage everything | 17:25 |
| evrardjp | odyssey4me: great :) | 17:25 |
| admin0 | yes what i have seen is we do this weekly .. so the triage of the bug reported 1 hour after the triage never gets his day because next week in the next triage, we address it from the latest one | 17:25 |
| odyssey4me | admin0 yep, all we can do generally is try to help triage the bug... fixing it is up to the one who is pained the most by the bug | 17:26 |
| admin0 | so if you have to address something, open it like 1 hr before the triage and it gets the first attention :D | 17:26 |
| admin0 | pro tip of the day :D | 17:26 |
| evrardjp | admin0: haha, you can also be part of the triage and tell you'd like to discuss a bug | 17:27 |
| evrardjp | we are open | 17:27 |
| admin0 | i do that, but wait in line :) | 17:27 |
| evrardjp | :) | 17:28 |
| admin0 | well, general remark .. sometimes i feel if we should ( when we have time ) pre-triage the triage and give some importance .. when the list is big.. something does not get addressed | 17:28 |
| evrardjp | admin0: I 100% agree there. | 17:28 |
| evrardjp | we shouldn't wait for the triage to triage | 17:28 |
| spotz | Unless it's one of the cores though folks shouldn't self-triage cause you know all my stuff is #1:) | 17:29 |
| evrardjp | it's not like a patch to merge code I guess, I'd be enclined for ppl to self-triage, but it would be weird to self-triage to high/critical and not fix it yourself | 17:30 |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-memcached_server stable/newton: Add handler when systemd is used https://review.openstack.org/552942 | 17:31 |
| evrardjp | cloudnull: on the nick of time, there is a EOL request that was sent yesterday. | 17:31 |
| evrardjp | let's merge this real quick :) | 17:32 |
| cloudnull | if its possible | 17:32 |
| cloudnull | I told my org that it might not be | 17:32 |
| evrardjp | well it makes sense to merge it | 17:32 |
| evrardjp | let's just see how it goes with EOLing | 17:32 |
| cloudnull | so if we can make it go, great! else meg. | 17:32 |
| cloudnull | **meh | 17:32 |
| evrardjp | I have to speak with tonyb tomorrow | 17:33 |
| evrardjp | thanks for the insights spotz admin0 odyssey4me | 17:34 |
| spotz | That's what I'm here for:) | 17:34 |
| odyssey4me | cloudnull evrardjp if it merges, the sha will always exist - even if it's not at the eol tag :p | 17:36 |
| jrosser | where does container_networks get built? https://github.com/openstack/openstack-ansible-lxc_container_create/blob/stable/pike/tasks/lxc_container_config.yml#L126 | 17:36 |
| cloudnull | odyssey4me: ++ :) | 17:37 |
| cloudnull | jrosser: that happens within the dynamic inventory | 17:37 |
| cloudnull | if you crack open the openstack-inventory.json file the entry "container_networks" is under the hostname | 17:38 |
| *** hamza21 has joined #openstack-ansible | 17:41 | |
| jrosser | cloudnull: ah ok i see that. if ive adjusted container_mtu in my openstack_user_config.yml, how should a propagate that change through? | 17:42 |
| cloudnull | in the json you should see the mtu value. | 17:42 |
| cloudnull | once you run the dynamic-inventory.py script, or any playbook run | 17:43 |
| odyssey4me | jrosser I'm guessing you need https://review.openstack.org/528357 merged? | 17:43 |
| jrosser | odyssey4me: oh right! that might explain a thing or two | 17:44 |
| odyssey4me | that looks like it fixes the issue you're seeing | 17:44 |
| jrosser | yeah i've tried to bump my network node container_mtu up from 1500 and it's not making it beyong provider_networks | 17:45 |
| evrardjp | jrosser: oh good catch on this patch | 17:47 |
| evrardjp | I always forget it | 17:47 |
| openstackgerrit | Jimmy McCrory proposed openstack/openstack-ansible master: [TEST] Update Ansible to 2.5.0rc2 https://review.openstack.org/501814 | 17:48 |
| evrardjp | and it's an important one for upgrades :'( | 17:48 |
| jrosser | feels like i'm on a bit of a roll tripping over these atm | 17:49 |
| *** bitshifter has quit IRC | 17:49 | |
| openstackgerrit | Merged openstack/openstack-ansible stable/queens: scripts: scripts-library.sh: Fix dstat background process command https://review.openstack.org/552000 | 17:51 |
| *** sar has joined #openstack-ansible | 17:52 | |
| jrosser | also, if i delete a container, blow away its facts, rebuilt it with --limit then the rebuild fails | 17:53 |
| jrosser | without the --limit it is ok and runs through | 17:53 |
| odyssey4me | jrosser include lxc_hosts in the limit | 17:54 |
| odyssey4me | the container build needs facts from its host | 17:54 |
| jrosser | is it ok to just include the actual host for that container? | 17:54 |
| jrosser | if i know which it is | 17:54 |
| odyssey4me | sure | 17:55 |
| armaan | logan-: Hello! We are upgrading ocata to pike and the ceph client role tried to install ceph-mon, ceph-mgr in the compute node? | 17:56 |
| openstackgerrit | Andy McCrae proposed openstack/openstack-ansible-memcached_server stable/newton: Add handler when systemd is used https://review.openstack.org/552942 | 18:02 |
| openstackgerrit | Merged openstack/openstack-ansible-os_nova stable/pike: Rearrange cell mapping tasks https://review.openstack.org/552899 | 18:03 |
| *** poopcat has joined #openstack-ansible | 18:04 | |
| openstackgerrit | Merged openstack/openstack-ansible master: bootstrap-host: Prepare disk for machinectl storage https://review.openstack.org/552893 | 18:09 |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible stable/queens: bootstrap-host: Prepare disk for machinectl storage https://review.openstack.org/553010 | 18:15 |
| evrardjp | andymccr_: listen doesn't work in 2.2? | 18:16 |
| andymccr_ | nope :( | 18:16 |
| odyssey4me | newton is 2.1, listen was introduced in 2.2 IIRC | 18:16 |
| andymccr_ | ^ this | 18:16 |
| andymccr_ | it basically just errors out saying you cant do it, but the other solution is fine. since the tasks are mutually exclusive | 18:17 |
| odyssey4me | evrardjp cloudnull pike uses overlayfs, so no need to port https://review.openstack.org/#/q/Icadbcfd420bbe7c14a04606790cab09a1dce03ce back to it - it's master/queens only | 18:17 |
| odyssey4me | for master, next step is to evolve to using the systemd/networkd roles - we leave queens alone | 18:18 |
| evrardjp | odyssey4me: andymccr_ haha my bad | 18:19 |
| andymccr_ | meh nah i thought it would work. keeping track of all the changes in ansible going back to newton is not something id write down as a strength of mine :D | 18:20 |
| odyssey4me | something else I learned is that 2.2 didn't use action plugins as much as 2.3 - so working on ocata sucks a bit too | 18:20 |
| odyssey4me | so yeah, trying to track many ansible minors is quite a pain | 18:21 |
| *** radeks has quit IRC | 18:24 | |
| odyssey4me | I'm out for the night - cheerio all! | 18:25 |
| *** holser__ has quit IRC | 18:27 | |
| *** flemingo_ has joined #openstack-ansible | 18:28 | |
| evrardjp | odyssey4me: have a good night | 18:29 |
| *** Sha0000 has joined #openstack-ansible | 18:30 | |
| *** yifei has quit IRC | 18:36 | |
| *** yifei has joined #openstack-ansible | 18:36 | |
| *** shardy has quit IRC | 18:48 | |
| openstackgerrit | Merged openstack/openstack-ansible-memcached_server stable/newton: Add handler when systemd is used https://review.openstack.org/552942 | 18:49 |
| *** idlemind has joined #openstack-ansible | 19:14 | |
| idlemind | http://pimpmylog.com/ ... would it be silly to add that to the stack (optionally) to make rsyslog viewing a little more pleasurable (at least in development clouds) | 19:15 |
| idlemind | or what that be something we'd be responsible to do outside of osa | 19:15 |
| *** esberglu has quit IRC | 19:20 | |
| *** esberglu has joined #openstack-ansible | 19:23 | |
| *** savvas_ has joined #openstack-ansible | 19:25 | |
| openstackgerrit | Merged openstack/openstack-ansible-os_keystone stable/queens: Avoid conflicting delegation with authorized_keys https://review.openstack.org/552983 | 19:26 |
| *** savvas_ has quit IRC | 19:29 | |
| *** savvas_ has joined #openstack-ansible | 19:39 | |
| *** flemingo_ has quit IRC | 19:42 | |
| *** savvas_ has quit IRC | 19:43 | |
| *** savvas_ has joined #openstack-ansible | 19:48 | |
| *** savvas_ has quit IRC | 19:56 | |
| *** savvas_ has joined #openstack-ansible | 20:04 | |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible master: Add container journal linking https://review.openstack.org/544518 | 20:10 |
| *** savvas_ has quit IRC | 20:14 | |
| *** hw_wutianwei has quit IRC | 20:31 | |
| *** hw_wutianwei has joined #openstack-ansible | 20:32 | |
| *** ansmith has quit IRC | 20:36 | |
| *** hamza21 has quit IRC | 20:37 | |
| *** d3n14l has joined #openstack-ansible | 20:39 | |
| openstackgerrit | Merged openstack/openstack-ansible-os_nova stable/ocata: Rearrange cell mapping tasks https://review.openstack.org/552900 | 20:41 |
| *** idlemind_ has joined #openstack-ansible | 20:44 | |
| *** idlemind_ has quit IRC | 20:44 | |
| *** idlemind has quit IRC | 20:44 | |
| *** esberglu has quit IRC | 20:52 | |
| *** flemingo has joined #openstack-ansible | 20:53 | |
| *** _jbadiapa has joined #openstack-ansible | 20:54 | |
| *** esberglu_ has joined #openstack-ansible | 20:55 | |
| *** esberglu_ has quit IRC | 20:56 | |
| *** esberglu_ has joined #openstack-ansible | 20:56 | |
| *** jbadiapa_ has quit IRC | 20:57 | |
| *** throwsb1 has quit IRC | 21:00 | |
| *** savvas_ has joined #openstack-ansible | 21:01 | |
| *** TxGirlGeek has joined #openstack-ansible | 21:02 | |
| *** TxGirlGeek has quit IRC | 21:05 | |
| *** savvas_ has quit IRC | 21:06 | |
| *** TxGirlGeek has joined #openstack-ansible | 21:07 | |
| *** TxGirlGeek has quit IRC | 21:09 | |
| *** sar has quit IRC | 21:09 | |
| *** jra has joined #openstack-ansible | 21:14 | |
| jra | So we've built a dev deployment on pike from OSA, and things mostly work - except: API requests will intermittently time out to the requestor, causing widespread "slowness" and sometimes outright failures in the clients (Horizon and CLI). | 21:17 |
| jra | What's odd here is that in the logs from the OpenStack API components, the requests are seen, and successfully returned within sub-second time | 21:17 |
| *** geb has quit IRC | 21:17 | |
| jra | But the client never seems to get the response | 21:18 |
| jra | The only notable item in the logs is a recurring "SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected)" message that the failed requests seem to trigger | 21:18 |
| *** TxGirlGeek has joined #openstack-ansible | 21:19 | |
| jra | Which I take to mean that the API service tried to return data, but its connection to its client (which in the OSA-deployed case is HAproxy) went away | 21:19 |
| jra | I fully acknowledge this may not necessarily be in any way related to OSA, but I'm just fresh out of ideas at this point. Anybody have any suggestions? | 21:20 |
| *** geb has joined #openstack-ansible | 21:21 | |
| admin0 | jra | 21:22 |
| admin0 | disable 2 haproxy/keepalive | 21:22 |
| admin0 | keep only 1 running | 21:22 |
| admin0 | see if the issue still comes | 21:22 |
| admin0 | if its multi node | 21:22 |
| jra | admin0: it is multinode; I'll give that a try | 21:22 |
| *** TxGirlGeek has quit IRC | 21:25 | |
| *** TxGirlGeek has joined #openstack-ansible | 21:25 | |
| *** dave-mccowan has quit IRC | 21:26 | |
| jra | admin0 Well, with only one of the two nodes up the problem persists; with only the other of the two nodes up, the logs are flooded with "can't connect to DB" and "connection refused" messages | 21:30 |
| jra | so it sure seems like something's not well in HAproxy land | 21:30 |
| *** savvas has joined #openstack-ansible | 21:31 | |
| *** dave-mccowan has joined #openstack-ansible | 21:31 | |
| admin0 | did the keepalive ip shifted properly to the one funcitonal ? | 21:33 |
| *** ansmith has joined #openstack-ansible | 21:33 | |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible master: Convert role to use a common systemd role(s) https://review.openstack.org/552047 | 21:34 |
| *** savvas has quit IRC | 21:35 | |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible master: Convert role to use a common systemd role(s) https://review.openstack.org/552047 | 21:37 |
| evrardjp | cloudnull: is this in? | 21:38 |
| evrardjp | the newton thing | 21:38 |
| *** esberglu_ has quit IRC | 21:38 | |
| evrardjp | tony sent ayay | 21:39 |
| evrardjp | woops | 21:39 |
| evrardjp | yay it's included | 21:39 |
| evrardjp | let's phase out those things! | 21:39 |
| cloudnull | ++ | 21:39 |
| cloudnull | tag it all eol | 21:39 |
| cloudnull | evrardjp: no the roles are not in quite yet | 21:40 |
| cloudnull | at least not that I've seen | 21:40 |
| cloudnull | however I'm just marching along with the changes and will rebase on the integrated roles when possible | 21:40 |
| evrardjp | yeah fine for me | 21:40 |
| jra | admin0 it looks like it, yes | 21:44 |
| jra | admin0 the connection refused errors only lasted a few seconds, so I guess that was just failover? | 21:45 |
| admin0 | yep | 21:45 |
| jra | unfortunately the SIGPIPE issue persists, regardless of node | 21:45 |
| admin0 | can u do the operation from the util node and stil get this error ? | 21:45 |
| evrardjp | or I think it's fine | 21:46 |
| evrardjp | I'm off to bed now | 21:46 |
| evrardjp | ttyl everyone! | 21:46 |
| cloudnull | late evrardjp | 21:46 |
| cloudnull | **later | 21:46 |
| admin0 | see ya | 21:47 |
| d3n14l | Having a hard time debugging neutron plugins. Is there any known issue with loading neutron plugin drivers? Getting stevedore.named: Coudl not load … for lbaas and vpnaas on a fresh pike install. | 21:47 |
| admin0 | d3n14l, how is it named ? | 21:48 |
| admin0 | the driver names ? | 21:48 |
| cloudnull | d3n14l: is that something you're setting ? or from a stock install ? | 21:48 |
| admin0 | i have lbaas as: neutron_lbaas.services.loadbalancer.plugin.LoadBalancerPluginv2 | 21:49 |
| d3n14l | vpn_device_driver = neutron_vpnaas.services.vpn.device_drivers.strongswan_ipsec.StrongSwanDriver | 21:49 |
| admin0 | firewall_v2 does not work .. not sure what the correct thing is for firewall | 21:49 |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible master: Converge distro interfaces to systemd-networkd https://review.openstack.org/552721 | 21:49 |
| d3n14l | For lbaas i have neutron_lbaas.drivers.haproxy.namespace_driver.HaproxyNSDriver | 21:50 |
| jrosser | cloudnull: do you have a moment for a question about provider_networks? | 21:51 |
| cloudnull | d3n14l: I think that would be "neutron_lbaas.services.loadbalancer.plugin.LoadBalancerPluginv2" | 21:52 |
| cloudnull | i thought neutron removed the NSDriver in pike ? | 21:52 |
| *** esberglu has joined #openstack-ansible | 21:52 | |
| cloudnull | jrosser: sure | 21:52 |
| *** savvas has joined #openstack-ansible | 21:53 | |
| jrosser | cool, i was looking at this https://docs.openstack.org/project-deploy-guide/openstack-ansible/queens/app-config-pod.html | 21:53 |
| jrosser | its reasonably similar to my deployment. the provider_networks section of the user config is very verbose | 21:54 |
| jrosser | i was wondering if more sections are needed if you added further pods that only consisted of compute nodes, i.e there are no container hosts in them | 21:54 |
| cloudnull | yes. that config (https://github.com/openstack/openstack-ansible/blob/master/etc/openstack_deploy/openstack_user_config.yml.pod.example) provided by jmccrory | 21:54 |
| cloudnull | jrosser: I wouldn't think so | 21:55 |
| cloudnull | the compute hosts are just a name and IP which have little, if anything to do with the provider_networks | 21:55 |
| jrosser | clearly some of it is very much related to wiring the containers, but i was concerned that there might be ml2 driver bits and pieces there | 21:55 |
| jrosser | i.e which is the provider networks mappings | 21:56 |
| cloudnull | I guess you'd have to have something that plumbed the neutron agent into the relevent network on the host | 21:56 |
| cloudnull | typically done via host_bind override | 21:56 |
| *** Matias has quit IRC | 21:57 | |
| cloudnull | but even that, i'd imagine, would be relatively uniform across the pods | 21:57 |
| *** savvas has quit IRC | 21:57 | |
| cloudnull | https://github.com/openstack/openstack-ansible/blob/master/etc/openstack_deploy/openstack_user_config.yml.pod.example#L182-L190 | 21:58 |
| jrosser | yes indeed. perhaps all the compute nodes can be targetted with reference_group and just the host bind set | 21:58 |
| d3n14l | cloudnull: sorry - i was meaning the device_driver setting in lbaas_agent.ini | 21:58 |
| d3n14l | Thats triggering the stevedore.named error. | 21:59 |
| *** Matias has joined #openstack-ansible | 21:59 | |
| cloudnull | jrosser: that might make some sense | 22:00 |
| jrosser | cloudnull: yeah, for me its potentially very simple as the pods are compute only | 22:00 |
| jrosser | the container hosts all have their own little world which is seperate | 22:01 |
| jrosser | and are done that way becasue the networking to the container hosts is done more resiliently than to the compute hosts | 22:02 |
| cloudnull | that makes a lot sense in this case. | 22:02 |
| cloudnull | maybe there should be a general purpose compute network group? | 22:02 |
| cloudnull | maybe a child to the neutron_lxb/ovs agent groups ? | 22:03 |
| *** chyka has quit IRC | 22:03 | |
| *** Matias has quit IRC | 22:04 | |
| jrosser | i've got 3 groups to consider, all the computes, all the network nodes, all the various infra | 22:05 |
| jrosser | and they're all uniform within each group, but vary between the groups | 22:05 |
| cloudnull | d3n14l: looking at https://docs.openstack.org/ocata/config-reference/networking/lbaas.html | 22:10 |
| cloudnull | it looks like the device driver is set correctly | 22:10 |
| cloudnull | sadly it looks like the lbaasv2 agent is no longer documented in pike + | 22:11 |
| cloudnull | they only reference octavia | 22:11 |
| cloudnull | jrosser: seems the most sensible approach is to get the env.d files in the right spot for your pod config | 22:13 |
| cloudnull | im not quite sure how best to attack this otherwise | 22:14 |
| jra | admin0 Yes, my Rally instance that's flagging these issues is in the utility container | 22:14 |
| jrosser | cloudnull: i'll take a dig at this tomorrow | 22:17 |
| cloudnull | sorry i dont have a good trick up my sleeve for that at the moment | 22:18 |
| cloudnull | however i can see this as being something we should generally just have / document | 22:18 |
| jrosser | what am i missing with reference_group? why can't that do it? | 22:18 |
| cloudnull | reference_group ? | 22:19 |
| cloudnull | I could just be confused too | 22:19 |
| jrosser | like here https://github.com/openstack/openstack-ansible/blob/master/etc/openstack_deploy/openstack_user_config.yml.pod.example#L52 | 22:19 |
| jrosser | so long as i organise the lower part of user_config right then the grouping might just fall out there | 22:21 |
| *** TxGirlGeek has quit IRC | 22:21 | |
| cloudnull | yea. it would seem so | 22:23 |
| cloudnull | https://github.com/openstack/openstack-ansible/blob/master/osa_toolkit/generate.py#L554 | 22:23 |
| cloudnull | looks like that just creates pseudo groups but keeps the core mapping the same. | 22:23 |
| cloudnull | TIL | 22:23 |
| jrosser | that seems to support a hierarchy out of the box https://github.com/openstack/openstack-ansible/blob/master/etc/openstack_deploy/openstack_user_config.yml.pod.example#L472 | 22:23 |
| *** TxGirlGeek has joined #openstack-ansible | 22:32 | |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible master: Converge distro interfaces to systemd-networkd https://review.openstack.org/552721 | 22:37 |
| *** dave-mccowan has quit IRC | 22:47 | |
| *** Sha0000 has quit IRC | 22:48 | |
| *** masber has quit IRC | 22:57 | |
| DimGR | hi | 22:59 |
| *** masber has joined #openstack-ansible | 23:00 | |
| *** sawblade6 has quit IRC | 23:01 | |
| *** d3n14l has quit IRC | 23:02 | |
| cloudnull | o/ DimGR | 23:03 |
| jra | okay, so I tracked down the root of my timing-out Rally tests, but it's only opened up a new mystery to solve | 23:08 |
| jra | The tests that succeed are made against API targets referencing the internal LB address, which makes sense since they're being run from inside a container | 23:09 |
| jra | but the tests that fail are made against API targets referencing the external LB address, and they all time out horrifically | 23:09 |
| jra | Am I wrong in thinking that they should all target the internal LB address? | 23:10 |
| jra | And if I'm not wrong, does that mean I've misconfigured something at the user yml file level? | 23:11 |
| cloudnull | jra: I would suspect that the rally tests _should_ use the internal address of the cluster instead of the external | 23:11 |
| *** armaan has quit IRC | 23:11 | |
| cloudnull | i've little knowledge of the internals of rally | 23:12 |
| jra | cloudnull: I get the sense from the tempest debug log that it's using the information it obtains from successful requests to canonicalize further requests | 23:12 |
| cloudnull | but I would suspect that there's something in config that can repoint it to use only the internal | 23:12 |
| jra | IE, it asks the API where its targets are, sees the external address in the response, and uses it | 23:12 |
| cloudnull | if it's using the keystone service catalog it should be able to see internal, admin, public | 23:13 |
| cloudnull | and then go from there | 23:13 |
| jra | so Rally can address multiple deployments, and it stores what it knows about them in the DB | 23:16 |
| jra | doing 'rally deployment show <id>' shows that it is targeting the internal address on :5000 for auth, and it has an endpoint_type attribute set to "internal" | 23:17 |
| jra | seems like the application is well aware of the internal/external split | 23:18 |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible master: common-tasks: Container Start/Stop conditions https://review.openstack.org/553094 | 23:22 |
| jmccrory | cloudnull is this not needed anymore? https://review.openstack.org/#/c/552643/ | 23:24 |
| *** hw_wutianwei has quit IRC | 23:24 | |
| *** hw_wutianwei has joined #openstack-ansible | 23:24 | |
| cloudnull | jmccrory: nope, the change it relied on was reverted | 23:24 |
| cloudnull | I put that change in https://review.openstack.org/#/c/552914 | 23:25 |
| cloudnull | which is waiting on the infra importing the systemd roles we're trying to use | 23:25 |
| jmccrory | ah ok | 23:25 |
| cloudnull | jra: are you cable to capture the auth request and a single test run to see it's respecting that setting ? | 23:25 |
| cloudnull | maybe it's simply using public no matter the setting? | 23:26 |
| jra | I've got it running just a single test right now, the setup and teardown steps seem to work, but the actual test (getting the details of a flavor) fails with this timeout | 23:26 |
| jra | I can pastebin the tempest logs if you'd like to see 'em? | 23:28 |
| *** TxGirlGeek has quit IRC | 23:37 | |
| *** TxGirlGeek has joined #openstack-ansible | 23:41 | |
| cloudnull | jrs so im not sure | 23:42 |
| cloudnull | looking around i dont see anything that stands out saying internal urls are broken | 23:42 |
| cloudnull | and there's not much on the bug tracker | 23:42 |
| cloudnull | https://bugs.launchpad.net/rally | 23:42 |
| *** savvas has joined #openstack-ansible | 23:42 | |
| cloudnull | a long time ago there was this https://bugs.launchpad.net/rally/+bug/1416760 | 23:43 |
| openstack | Launchpad bug 1416760 in Rally "Rally does not work for "internal" endpoint types" [Medium,Invalid] | 23:43 |
| *** Matias has joined #openstack-ansible | 23:43 | |
| cloudnull | but that was fixed here https://review.openstack.org/#/c/157988/ | 23:43 |
| *** TxGirlGeek has quit IRC | 23:43 | |
| cloudnull | so IDK . | 23:43 |
| *** TxGirlGeek has joined #openstack-ansible | 23:44 | |
| cloudnull | if you could paste some logs I'd be happy to look at them | 23:44 |
| jra | cloudnull: okay, I actually think I've got the answer | 23:46 |
| jra | So Rally dynamically configures Tempest when you create it as a verifier | 23:46 |
| jra | and it uses a default config which specifies "publicURL" for all services except identity | 23:47 |
| *** savvas has quit IRC | 23:47 | |
| jra | if I override that when reconfiguring Tempest, I should be able to specify internal | 23:47 |
| *** esberglu has quit IRC | 23:50 | |
| *** hamzy has quit IRC | 23:56 | |
| *** hamzy has joined #openstack-ansible | 23:58 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!