Thursday, 2018-02-15

cloudnullanyone around want to give this a nudge https://review.openstack.org/#/c/54471900:00
*** acormier has quit IRC00:02
*** acormier has joined #openstack-ansible00:05
cloudnullthanks jmccrory!00:11
jmccrorynp00:11
*** acormier has quit IRC00:17
*** acormier has joined #openstack-ansible00:18
*** pbandark has quit IRC00:32
*** chyka has quit IRC00:35
openstackgerritMerged openstack/openstack-ansible-rabbitmq_server stable/pike: tests: Remove duplicated container creation  https://review.openstack.org/54425100:46
cloudnullgeekinutah: you're likely gone, and have likely killed the cloud, but i looked into a couple things and wanted to know if you happen to have systemd-hostnamed running00:47
cloudnullif so, nevermind. if not, can you start it within one of your containers ?00:47
cloudnull`systemctl start systemd-hostnamed`00:48
*** acormier has quit IRC00:50
*** dave-mccowan has joined #openstack-ansible00:54
*** acormier has joined #openstack-ansible01:08
*** acormier has quit IRC01:12
*** acormier has joined #openstack-ansible01:13
*** pedja has quit IRC01:19
*** acormier has quit IRC01:20
*** acormier has joined #openstack-ansible01:27
*** acormier has quit IRC01:30
*** acormier has joined #openstack-ansible01:30
*** lbragstad has quit IRC01:45
*** chyka has joined #openstack-ansible01:57
*** chyka has quit IRC02:01
*** woodard_ has joined #openstack-ansible02:07
*** woodard has quit IRC02:08
*** acormier has quit IRC02:15
*** acormier has joined #openstack-ansible02:35
*** gkadam_ has quit IRC02:43
*** acormier has quit IRC02:47
*** acormier has joined #openstack-ansible02:47
*** bhujay has joined #openstack-ansible02:50
*** acormier has quit IRC02:51
*** pbandark has joined #openstack-ansible03:00
*** bhujay has quit IRC03:09
*** chyka has joined #openstack-ansible03:12
*** chyka has quit IRC03:17
*** pbandark has quit IRC03:49
*** vnogin has joined #openstack-ansible03:58
*** vnogin has quit IRC04:03
*** bhujay has joined #openstack-ansible04:08
*** udesale has joined #openstack-ansible04:13
*** agrebennikov has quit IRC04:13
*** exodusftw has quit IRC04:15
*** exodusftw has joined #openstack-ansible04:21
*** dave-mccowan has quit IRC04:25
*** gkadam_ has joined #openstack-ansible04:26
*** masber has joined #openstack-ansible04:33
*** gkadam_ has quit IRC04:36
openstackgerritTaseer Ahmed proposed openstack/openstack-ansible master: Integrate Congress with OSA.  https://review.openstack.org/50397104:36
*** gkadam has joined #openstack-ansible04:38
*** jwitko__ has joined #openstack-ansible04:42
*** jwitko has quit IRC04:46
*** threestrands_ has joined #openstack-ansible05:09
*** threestrands_ has quit IRC05:09
*** threestrands_ has joined #openstack-ansible05:09
*** threestrands has quit IRC05:09
*** threestrands_ has quit IRC05:10
*** threestrands_ has joined #openstack-ansible05:11
*** poopcat has quit IRC05:13
*** threestrands has joined #openstack-ansible05:15
*** threestrands_ has quit IRC05:18
*** dariko has joined #openstack-ansible05:25
*** armaan has quit IRC05:26
*** armaan has joined #openstack-ansible05:27
*** threestrands has quit IRC05:28
*** armaan has quit IRC05:32
*** armaan has joined #openstack-ansible05:32
*** hybridpollo has quit IRC05:33
*** taseer1 has joined #openstack-ansible05:38
*** Taseer has quit IRC05:38
*** udesale has quit IRC05:48
*** udesale has joined #openstack-ansible05:48
*** armaan has quit IRC05:50
*** nikm has joined #openstack-ansible06:40
nikmhi06:40
nikmi am following this document https://docs.openstack.org/openstack-ansible/ocata/06:41
evrardjphi06:44
nikm"Configure at least one network interface to access the Internet or suitable local repositories" :  our installation is done but now if we are taking out internet from br-mgmt06:44
nikmloadbalancer ip is not accessible06:45
nikmwhich is a virtual IP06:45
evrardjpI don't know what you mean, where is it in this document? Why not deploying pike too?06:45
evrardjpmhayden: I think the ansible-hardening should not branch like osa, but should branch with ansible versions.06:48
*** jbadiapa has joined #openstack-ansible06:48
evrardjpAnd move it as indenpendant deliverable.06:48
*** sar has quit IRC06:49
nikmevrardjp : https://docs.openstack.org/project-deploy-guide/openstack-ansible/ocata/verify-operation.html   , Verifying the Dashboard (horizon)06:49
evrardjpodyssey4me: cloudnull for the on_metal changes, it all depends on how we change the inventory in the future. For me adding more variables is silly. Re-using a variable is okay, but I think we could even improve further by not having a variable at all.06:50
nikmexternal_lb_vip_address  is not accessible if we remove internet from br-mgmt06:50
evrardjpI'd like to see a spec if you want to work on that.06:50
evrardjpnikm: that's all your configuration, that's not an OSA limitation06:50
evrardjpnikm: external_lb_vip_address is supposed to be on a different nic than internal_lb_vip_address06:51
evrardjpif not, at least to a different IP06:51
evrardjpnikm: to understand better what your issue is, it would be nice if you could file a bug with:06:51
evrardjp- The version of OSA you're using (branch + sha)06:52
evrardjp- Your openstack_user_config + user_variables.yml06:52
evrardjp- Your haproxy nodes network interfaces' configuration.06:52
evrardjpWith that I can help you better.06:52
evrardjpI'd understand your environment better at least.06:53
evrardjpAnd I'd probably understand the issue more clearly06:53
evrardjpTo file a bug, please go to: https://bugs.launchpad.net/openstack-ansible06:53
nikmevrardjp : I am using 15.1.13 tag as per official documentation for ocata, here is the configuration files openstack_user_config >> http://paste.openstack.org/show/673027/   user_variables.yml>> http://paste.openstack.org/show/673026/07:01
nikmI am using management port for HA proxy07:02
*** olivierbourdon38 has quit IRC07:06
*** udesale_ has joined #openstack-ansible07:07
*** udesale has quit IRC07:09
*** threestrands has joined #openstack-ansible07:09
*** Sha000000 has joined #openstack-ansible07:09
*** jamesdenton has quit IRC07:10
*** sar has joined #openstack-ansible07:18
*** udesale__ has joined #openstack-ansible07:23
*** udesale_ has quit IRC07:26
hwoaranggood mornign07:26
hwoarangevrardjp: re https://review.openstack.org/#/c/543888/ could you please tell me where did you find this info about the xtrabackup requirements?07:26
*** chyka has joined #openstack-ansible07:29
*** Sha000000 has quit IRC07:31
evrardjphwoarang: good morning. Oh I am sorry I didn't gave a link.07:31
evrardjplet me find that once again07:31
*** chyka has quit IRC07:33
evrardjphwoarang: https://mariadb.com/kb/en/library/percona-xtrabackup/07:35
evrardjp"Note that XtraBackup (at least as of 2.4.7) will not work with MariaDB 10.1 encryption or compression, or when innodb_page_size is set to some value other than 16K."07:35
evrardjp"If you want to use XtraBackup with uncompressed and unencrypted MariaDB data, use Percona XtraBackup 2.3 for MariaDB Server versions through 10.1 and use XtraBackup 2.4 for MariaDB Server versions beginning with 10.2."07:35
evrardjpit looks to me we should stick with non 2.407:36
evrardjpwell I don't know how I should read that sentence after re-reading it.07:37
evrardjpnikm: I read your files07:38
evrardjpyes if you remove br-mgmt, that would break things.07:38
nikmevrardjp: we are not removing br-mgmt07:38
evrardjpyou're removing internet access07:39
nikmjust removing internet from that network07:39
nikmyes07:39
evrardjpyeah. So change your external part.07:39
evrardjpwell07:39
evrardjphow do you plan to use your cloud ?07:39
hwoarangevrardjp: oh ok thanks :( couldn't find it myself07:39
evrardjphwoarang: like I said, after re-reading it, it doesn't fully make sense to me.07:40
*** pcaruana has joined #openstack-ansible07:40
evrardjpnikm: what I'd do is migrate your external network to something that's external07:41
evrardjpthis way you can reach it from outside your cloud servers.07:41
evrardjpthe problem is double:07:41
evrardjpyou didn't use a fqdn for external_lb_vip_address. So it means you wouldn't be able to change it easily07:42
evrardjpbut like I said, I am not sure how you plan to use your cloud07:42
evrardjpnikm: do you need to access it from 192.168.20.5 ?07:42
evrardjpor is that what you want to change ?07:42
nikmevrardjp: Is the problem happening from keepalived, becouse it's using public IP for ping07:43
evrardjpwhat do you mean by "removing internet"07:43
evrardjpnikm: OH!07:43
evrardjpI see07:43
evrardjpI understand the issue07:43
evrardjpyou can change that :)07:43
nikmif we will change ip to our local IP , is it fine ?07:44
nikmI am just wondering that can be problem07:44
nikmkeepalived is not able to reach that public IP07:45
evrardjpyou have this right: https://github.com/openstack/openstack-ansible/blob/stable/ocata/playbooks/vars/configs/keepalived_haproxy.yml#L16 ?07:45
evrardjpchange this IP to monitor your next router for example.07:45
evrardjpor override the check scripts07:46
evrardjphttps://github.com/openstack/openstack-ansible/blob/stable/ocata/playbooks/vars/configs/keepalived_haproxy.yml#L3207:46
evrardjpkeepalived_scripts: {}07:46
evrardjpit's all possible07:46
nikmevrardjp: yeah, It is using default IP, sure I will provide my router gateway IP07:46
evrardjphttps://github.com/openstack/openstack-ansible/blob/stable/ocata/playbooks/vars/configs/keepalived_haproxy.yml basically is all the you configure keepalived. It's quite simple and flexible, just make it do what's relevant for you.07:47
openstackgerritMarkos Chandras (hwoarang) proposed openstack/openstack-ansible-galera_server master: vars: Install qpress only when galera_xtrabackup_compression is true  https://review.openstack.org/54388807:47
openstackgerritMarkos Chandras (hwoarang) proposed openstack/openstack-ansible-galera_server master: tasks: Fix use_percona_upstream variable usage  https://review.openstack.org/53525207:47
evrardjpTo re-deploy, just re-run your haproxy playbook, it would automatically catch that changes.07:47
nikmsure, i am going to test it, I will let you know if any issue occur.07:48
*** abelur has quit IRC07:53
*** peri has joined #openstack-ansible07:53
jafeha__good morning everybody07:57
openstackgerritMerged openstack/openstack-ansible-ops master: Updated from OpenStack Ansible Tests  https://review.openstack.org/54463807:59
*** vnogin has joined #openstack-ansible07:59
openstackgerritMerged openstack/openstack-ansible-memcached_server master: Updated from OpenStack Ansible Tests  https://review.openstack.org/54463508:01
*** vnogin has quit IRC08:03
openstackgerritMerged openstack/openstack-ansible-os_molteniron master: Updated from OpenStack Ansible Tests  https://review.openstack.org/54465208:03
openstackgerritMerged openstack/openstack-ansible-openstack_openrc master: Updated from OpenStack Ansible Tests  https://review.openstack.org/54463708:03
openstackgerritMerged openstack/openstack-ansible-haproxy_server master: Updated from OpenStack Ansible Tests  https://review.openstack.org/54463208:03
*** eumel8 has joined #openstack-ansible08:03
openstackgerritMerged openstack/openstack-ansible-lxc_hosts master: Updated from OpenStack Ansible Tests  https://review.openstack.org/54463408:06
openstackgerritMerged openstack/openstack-ansible-apt_package_pinning master: Updated from OpenStack Ansible Tests  https://review.openstack.org/54462708:06
openstackgerritMerged openstack/openstack-ansible-rsyslog_client master: Updated from OpenStack Ansible Tests  https://review.openstack.org/54467208:07
openstackgerritMerged openstack/openstack-ansible-openstack_hosts master: Updated from OpenStack Ansible Tests  https://review.openstack.org/54463608:07
openstackgerritMerged openstack/openstack-ansible-ceph_client master: Updated from OpenStack Ansible Tests  https://review.openstack.org/54462808:08
*** mbuil has joined #openstack-ansible08:10
openstackgerritMerged openstack/openstack-ansible-pip_install master: Updated from OpenStack Ansible Tests  https://review.openstack.org/54466708:10
openstackgerritMerged openstack/openstack-ansible-os_monasca-agent master: Updated from OpenStack Ansible Tests  https://review.openstack.org/54465408:11
openstackgerritMerged openstack/openstack-ansible-rsyslog_server master: Updated from OpenStack Ansible Tests  https://review.openstack.org/54467308:11
mbuilgood morning08:12
openstackgerritMerged openstack/openstack-ansible-galera_client master: Updated from OpenStack Ansible Tests  https://review.openstack.org/54463008:13
openstackgerritMerged openstack/openstack-ansible-repo_server master: Updated from OpenStack Ansible Tests  https://review.openstack.org/54467108:14
openstackgerritMerged openstack/openstack-ansible-os_almanach master: Updated from OpenStack Ansible Tests  https://review.openstack.org/54463908:17
openstackgerritMerged openstack/openstack-ansible-lxc_container_create master: Updated from OpenStack Ansible Tests  https://review.openstack.org/54463308:17
openstackgerritMerged openstack/openstack-ansible-plugins master: Updated from OpenStack Ansible Tests  https://review.openstack.org/54466808:17
*** olivierbourdon38 has joined #openstack-ansible08:19
*** pmannidi has quit IRC08:22
openstackgerritMerged openstack/openstack-ansible-os_watcher master: Updated from OpenStack Ansible Tests  https://review.openstack.org/54466508:22
openstackgerritMerged openstack/openstack-ansible-os_tacker master: Updated from OpenStack Ansible Tests  https://review.openstack.org/54466208:22
openstackgerritMerged openstack/openstack-ansible-os_cloudkitty master: Updated from OpenStack Ansible Tests  https://review.openstack.org/54464408:23
openstackgerritMerged openstack/openstack-ansible-os_zaqar master: Updated from OpenStack Ansible Tests  https://review.openstack.org/54466608:23
openstackgerritMerged openstack/openstack-ansible-os_rally master: Updated from OpenStack Ansible Tests  https://review.openstack.org/54465808:23
openstackgerritMerged openstack/openstack-ansible-os_congress master: Updated from OpenStack Ansible Tests  https://review.openstack.org/54437708:23
openstackgerritMerged openstack/ansible-hardening master: Updated from OpenStack Ansible Tests  https://review.openstack.org/54467408:24
openstackgerritMerged openstack/openstack-ansible-rabbitmq_server master: Updated from OpenStack Ansible Tests  https://review.openstack.org/54466908:24
openstackgerritMerged openstack/openstack-ansible-galera_server master: Updated from OpenStack Ansible Tests  https://review.openstack.org/54463108:25
openstackgerritMarkos Chandras (hwoarang) proposed openstack/openstack-ansible-galera_server master: vars: Install qpress only when galera_xtrabackup_compression is true  https://review.openstack.org/54388808:26
openstackgerritMarkos Chandras (hwoarang) proposed openstack/openstack-ansible-galera_server master: tasks: Fix use_percona_upstream variable usage  https://review.openstack.org/53525208:26
openstackgerritMerged openstack/openstack-ansible-repo_build master: Updated from OpenStack Ansible Tests  https://review.openstack.org/54467008:27
openstackgerritMerged openstack/openstack-ansible-os_ceilometer master: Updated from OpenStack Ansible Tests  https://review.openstack.org/54464208:28
*** taseer1 is now known as Taseer08:29
openstackgerritMerged openstack/openstack-ansible-os_gnocchi master: Zuul: Remove project name  https://review.openstack.org/54124308:29
openstackgerritMerged openstack/openstack-ansible-os_trove master: Updated from OpenStack Ansible Tests  https://review.openstack.org/54466408:34
Taseerevrardjp: can you please point out as to where I need to add the congress_all thing => http://logs.openstack.org/71/503971/22/check/openstack-ansible-linters/63a8767/job-output.txt.gz#_2018-02-15_04_45_39_80166708:35
*** gkadam_ has joined #openstack-ansible08:37
*** hamza21 has joined #openstack-ansible08:37
*** gkadam is now known as Guest820708:37
*** gkadam_ is now known as gkadam08:37
openstackgerritMerged openstack/openstack-ansible-os_gnocchi master: Updated from OpenStack Ansible Tests  https://review.openstack.org/54464708:38
openstackgerritMerged openstack/openstack-ansible-os_barbican master: Updated from OpenStack Ansible Tests  https://review.openstack.org/54464108:42
*** Sha000000 has joined #openstack-ansible08:45
openstackgerritMerged openstack/openstack-ansible-os_designate master: Updated from OpenStack Ansible Tests  https://review.openstack.org/54464508:45
openstackgerritMerged openstack/openstack-ansible-os_sahara master: Updated from OpenStack Ansible Tests  https://review.openstack.org/54465908:46
openstackgerritMerged openstack/openstack-ansible-os_horizon master: Updated from OpenStack Ansible Tests  https://review.openstack.org/54464908:47
*** nikm has quit IRC08:50
openstackgerritMerged openstack/openstack-ansible-os_aodh master: Updated from OpenStack Ansible Tests  https://review.openstack.org/54464008:54
*** nikm has joined #openstack-ansible08:57
openstackgerritMerged openstack/openstack-ansible-os_cinder master: Updated from OpenStack Ansible Tests  https://review.openstack.org/54464308:57
*** sar has quit IRC08:58
*** pbandark has joined #openstack-ansible09:03
*** shardy has joined #openstack-ansible09:04
nikmevrardjp: Thanks, After changing IP of keepalived ping my cluster is working fine, one more help I need. As per my openstack_user_config.yml http://paste.openstack.org/show/673041/ configuration the compute node is getting this value for linuxbridge "physical_interface_mappings = flat:eth12,vlan:br-vlan" , because of this VM creation is throwing an error. After changing to this value "physical_interface_mappings = flat:br-vlan"09:04
nikmevrardjp: Can you please tell me what changes I need to do in openstack_user_config.yml file09:05
evrardjpnikm: you can remove the second br-vlan definition in your provider networks if you don't use it09:06
evrardjpdepends on your use case09:06
nikmevrardjp: i want to use only flat network which is "flat:br-vlan"09:09
evrardjpnikm: remove the other one than09:09
evrardjpthen*09:09
evrardjpyou'd have to run the neutron playbooks though.09:09
evrardjpwhich would be disruptive09:09
evrardjpbut if it's not prod you're fine.09:10
evrardjpit looks like you're doing operations on a deployment, so I guess you are in a maintenance window :)09:12
nikmevrardjp: I am using test environment now preparing for production09:12
evrardjpok go then :)09:12
nikmevrardjp: Is this configuration will work ? http://paste.openstack.org/show/673045/09:16
*** chyka has joined #openstack-ansible09:18
TESCRAcloudnull bhujay evrardjp hi, as the host names were missing in inventory.json also there was inconsistency in the number of containers for galera i.e infra 1 had onl1 inra 2 had 2 n no container for galera in infra 3 at all so I had formatted the 3 infra's and restarted09:19
TESCRAbut now despite of sucessful execution of setuphost.yml the op of lxc-ls in infra nodes is too short most of the containers seems to be not bilt ...09:21
*** threestrands_ has joined #openstack-ansible09:21
TESCRAcan't figure out what went wrong.../09:21
*** threestrands has quit IRC09:21
*** chyka has quit IRC09:23
evrardjpTESCRA: I suggest you to start clean, including the deploy node.09:23
TESCRAThursday 15 February 2018  01:06:38 -0800 (0:00:47.580)       0:49:01.040 ***** ================ lxc_hosts : Ensure that the LXC cache has been prepared --------------- 725.69s09:23
TESCRAformat deploy ?09:24
TESCRAhad already removed everything from /etc/open09:24
TESCRAdepl09:24
TESCRAbefore starting09:24
*** SmearedBeard has joined #openstack-ansible09:24
TESCRAhad bootstraped and created new psswords too!09:25
evrardjpok09:26
evrardjpso you started fresh09:26
evrardjpfrom /etc/openstack_deploy I guess .09:27
TESCRAyes but setup host09:27
TESCRAym l was executed sucessfullt too09:27
evrardjp?09:27
evrardjpI don't understand this.09:27
TESCRAEXIT NOTICE [Playbook execution success]09:27
evrardjpwhat executed successfully?09:28
TESCRAfor setuphost09:28
evrardjpok09:28
evrardjpso you're good now09:28
evrardjpand what's your issue?09:28
TESCRAbut the o/p of lxc-ls is way too short..09:28
TESCRAi.e containers for only few services were built09:29
TESCRA lxc-ls | grep galera gives no op09:30
TESCRAi assume the container is upposed to be built...09:31
TESCRAas the setup host play was sucessful?09:32
TESCRAshall i rerun the setup host .yml ?09:33
TESCRAas only 19 containers are built09:36
evrardjpplease paste your openstack_inventory.json somewhere.09:36
TESCRAsure..09:36
evrardjpand your openstack_user_config.09:36
TESCRAok09:36
openstackgerritTaseer Ahmed proposed openstack/openstack-ansible master: Integrate Congress with OSA.  https://review.openstack.org/50397109:43
hwoarangevrardjp: If62b8a6f11700fb3bb7151f012b043bc43baf09a in openstack-ansible-tests re-introduced the problem with the playbook inclusion09:47
hwoarangthat's because now ansible-2.4 is used in previous roles too09:47
hwoarangiirc...09:47
hwoarangso the previous role now includes playbooks from the current role09:47
*** acormier has joined #openstack-ansible09:48
evrardjphwoarang: what? You mean Q->R upgrades have a new issue?09:49
*** bhujay has quit IRC09:49
TESCRAevrarjp pls have a look at the gist https://gist.github.com/ankita-anil-verma/57d372d231c5b910d4a7c07ede94e41209:49
evrardjpwait loading09:49
hwoarangevrardjp: yes because previous_role from Q uses ansible 2.4 which suffers from https://github.com/ansible/ansible/pull/3479009:49
hwoarangso when previous role is being tested as part of an upgrade, and there is an include statement, the included playbook is coming from the current role instead of the previous_role09:50
hwoarangdoes it make sense?09:50
*** bhujay has joined #openstack-ansible09:50
evrardjpyes, but this time for a different reason09:50
evrardjpI guess it's because our structure from 2.4 to 2.409:50
hwoaranghmm09:51
evrardjpdo you have a log?09:51
evrardjpI am changing the roles in stable/queens real quick then I can take a look at it.09:51
*** acormier has quit IRC09:53
hwoarangevrardjp: http://logs.openstack.org/52/535252/9/check/openstack-ansible-upgrade-ubuntu-xenial/91fa149/job-output.txt.gz#_2018-02-15_08_42_51_90254709:53
hwoarangsee that  task from previous role includes playbook from current role09:53
*** ankita has joined #openstack-ansible09:55
evrardjphwoarang: the plus side, is that we are doing the right thing.09:57
evrardjp:D09:57
hwoarang;p09:57
evrardjpI think we are good for changing our includes, to be more explicit of their path.09:58
evrardjpDarn.09:58
evrardjpthanks ansible!09:58
evrardjpI'll finish my series of patches first, then I will see what needs backporting then I can tackle that issue.09:58
TESCRA?09:58
evrardjpdo you know if master is fixed now?09:58
hwoarangi have no clue09:58
hwoarangi also dont understand how we are suppose to workaround an ansible problem09:59
hwoarangin our tests09:59
evrardjpeither we refactor09:59
hwoarangthere might be a variable to make the inclusion more specific09:59
hwoarangat least the precedence09:59
evrardjpyeah I think using roledir09:59
evrardjpor something like that09:59
evrardjpI can't remember though.09:59
hwoarangi will look at it09:59
* hwoarang kicks ansible09:59
evrardjpTESCRA: I think there is a group missing in your inventory10:01
evrardjpif you want there is a meta group that says "ALL infra"10:01
TESCRAyes how may i edit the meta grp?10:01
evrardjpyour inventory is very clean, very nice :)10:01
TESCRAi have all grp10:02
evrardjpyou can add your nodes into it10:02
evrardjpnah not all!10:02
evrardjp:D10:02
TESCRAyes i know only infra as compute wont need contailers10:02
evrardjpWOW10:02
TESCRAbut why is it not populating properly?10:03
evrardjphwoarang: do you know why the hell is nspawn in our production examples? :p10:03
evrardjpTESCRA: you are missing the shared-infra_hosts: group10:03
TESCRAhost ids are missing have10:03
TESCRAok10:03
evrardjpwell it's there but it's not well indented10:03
TESCRA?10:04
evrardjpthat's the reason10:04
evrardjpsearch on your file :p10:04
TESCRAlet me check10:04
TESCRAsure10:04
TESCRAthanks10:04
hwoarangi wonder if i clicked the wrong button...10:04
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible master: Nspawn should not be advised in production yet  https://review.openstack.org/54482210:07
evrardjphwoarang: haha no it's not you.10:07
evrardjp:)10:07
evrardjpyou were just there :D10:08
evrardjpI was just wondering if I was the only one to find it weird :D10:08
evrardjpsuggested a patch.10:08
evrardjpso let's get back rolling on queens!10:08
taccois there a reason why i see all Stacks from all project as admin but not instances. example if i have a test and admin project i select test project and see only test instances but all stacks even admin stacks10:08
taccoin the horizon frontend. :D10:09
evrardjpnever use admin .10:10
evrardjp:)10:10
evrardjptacco: probably worth asking in horizon10:11
taccook thx10:11
taccoevrardjp: ah and i'm not the "admin" user i just have admin rights10:12
evrardjpwell I guess it's all about RBAC, but I cannot debug that with you rn10:12
taccoyes it's not a big issue just anoying if you have multiple stacks with the same name in different projects and you see all10:14
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible-os_almanach master: Point to Queens instead of master  https://review.openstack.org/54482810:15
evrardjptacco: if you think that's a usability issue, that's definitely for horizon team :D10:15
taccoevrardjp: yeah i drop this issue there. thanks a lot10:16
evrardjpyw10:19
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible-os_cloudkitty master: Point to Queens instead of master  https://review.openstack.org/54483410:21
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible-os_congress master: Point to Queens instead of master  https://review.openstack.org/54483510:22
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible stable/pike: Stable keepalived priorities  https://review.openstack.org/53223010:24
evrardjpoh for the priorities I have a better solution .10:26
evrardjpI need to push it into osa10:26
evrardjpscales to hundreds of keepaliveds!10:26
Sha000000Hi I have trouble when setuping the infrastructure, the galera cluster is not starting ... I was thinking this was related to mtu first (I set the mtu for br-mgmt to 9000 but change it back to 1500) ; but nothing changed, galena cluster is not starting. Can you point some way to investigate why it is not working when running openstack-ansible setup-infrastructure.yml on a fresh install ?10:27
evrardjpSha000000: we'd need more details. Branch/sha, etc.10:27
odyssey4meSha000000 I'm guessing that you're using the last Pike tag? The issue related to the version of MariaDB being installed.10:27
Sha000000Oops sorry forgot to mention : stable/pike (used the version in the documentation) 16.0.710:28
odyssey4meSha000000 See https://docs.openstack.org/releasenotes/openstack-ansible/pike.html#known-issues10:28
Sha000000Arrgghhh didn't find the issue sorry10:28
Sha000000Sorry for the noob question :)10:30
*** udesale_ has joined #openstack-ansible10:30
Sha000000Other point, I read somewhere that galera cluster was not working with mtu like 9000 do you confirm ?10:30
evrardjpno I don't confirm.10:32
evrardjpI don't think it's smart to use it with large mtu, but I don't think it's problematic either.10:33
*** udesale__ has quit IRC10:33
evrardjpI notice than all my stable/queens patches are not logged on irc10:37
evrardjpodyssey4me: do you know if I should do something?10:37
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible-os_monasca master: Point to Queens instead of master  https://review.openstack.org/54485010:41
*** admin0 has joined #openstack-ansible10:43
TESCRAevrardjp by d way how many containers are supposed to exist for rabitmq /galera service on each infra node?10:43
evrardjp110:47
evrardjp1 rabbit, 1 galera10:47
evrardjp1 utility10:47
odyssey4meevrardjp the irc notifier might be a bit flaky this morning, meh10:48
TESCRAok then everything is all good thanks....10:49
*** SmearedBeard has quit IRC10:50
*** gillesMo has joined #openstack-ansible10:55
*** vnogin has joined #openstack-ansible10:59
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible-os_searchlight master: Point to Queens instead of master  https://review.openstack.org/54485811:00
*** pedja has joined #openstack-ansible11:03
*** vnogin has quit IRC11:03
*** chyka has joined #openstack-ansible11:04
evrardjplunch!11:05
evrardjpwoops11:05
*** chyka has quit IRC11:09
*** udesale__ has joined #openstack-ansible11:14
*** udesale_ has quit IRC11:16
evrardjpit's flaky only for stable/queens which makes me wonder if there is something to do :D11:19
*** gandem has joined #openstack-ansible11:27
*** udesale__ has quit IRC11:30
gandemHey guys ! I am getting a weird error on all lxc containers on controllers (in logs and when running systemd) : "Failed to connect to bus: No such file or directory". Anyone has a clue about what could be the issue ?11:30
odyssey4megandem interesting - is dbus installed on the hosts?11:35
*** acormier has joined #openstack-ansible11:36
gandemyep, installed on hosts and running. tried rebooting the controllers but it didn't do much11:37
openstackgerritMerged openstack/openstack-ansible-os_tacker master: Update reno for stable/queens  https://review.openstack.org/54448511:42
openstackgerritMerged openstack/openstack-ansible-os_keystone master: Update reno for stable/queens  https://review.openstack.org/54442511:46
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_designate master: Remove v1 API configuration  https://review.openstack.org/54453311:47
gandemthe issue looks very similar to https://bugs.launchpad.net/openstack-ansible/+bug/1669125 except I have the correct env var set (HOSTNAME)11:49
openstackLaunchpad bug 1669125 in openstack-ansible "rabbitmq-server fails so start with ubuntu16.04" [Undecided,Fix released] - Assigned to Alexandra Settle (alexandra-settle)11:49
openstackgerritMerged openstack/openstack-ansible-os_rally master: Update reno for stable/queens  https://review.openstack.org/54447611:49
openstackgerritMerged openstack/openstack-ansible-os_cinder master: Update reno for stable/queens  https://review.openstack.org/54444011:50
*** kstev has joined #openstack-ansible11:51
*** ankita has quit IRC11:54
*** kstev has quit IRC11:55
openstackgerritMerged openstack/openstack-ansible-os_ceilometer master: Update reno for stable/queens  https://review.openstack.org/54443711:55
*** armaan has joined #openstack-ansible12:00
*** acormier has quit IRC12:03
evrardjpodyssey4me: I think the tempest plugins don't need pinning, because they are supposed to work all the time, but I might be wrong.12:06
odyssey4mehistory tells me that it's best for us to pin in the stable branches, otherwise we have to try and fix things in the role as the plugins change12:07
openstackgerritMerged openstack/openstack-ansible-lxc_hosts master: Add RPM warm cache plugin  https://review.openstack.org/54398612:07
openstackgerritMerged openstack/openstack-ansible-lxc_hosts master: Update reno for stable/queens  https://review.openstack.org/54441612:07
odyssey4meand yes, they are supposed to continue working... as is tempest.... but things change, and for a stable branch it's better if they do not12:08
evrardjpwell we should probably do that in all our stable branches then...12:09
evrardjpthat is consistent with pike12:09
*** bhujay has quit IRC12:09
*** dave-mccowan has joined #openstack-ansible12:10
*** bhujay has joined #openstack-ansible12:10
evrardjpfinishing the series of patches first12:11
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible-os_watcher master: Point to Queens instead of master  https://review.openstack.org/54488112:12
hughsaundersevrardjp: I'm not nice enough to actually fix https://bugs.launchpad.net/openstack-ansible/+bug/1749680 so I proposed https://github.com/willthames/ansible-lint/pull/324 instead ;-)12:15
openstackLaunchpad bug 1749680 in openstack-ansible "Ensure apt operations have retries" [Undecided,New]12:15
evrardjphughsaunders: we do ship our own rules if need be.12:18
evrardjpat least IIRC.12:18
hughsaundersevrardjp: good to know, incase it gets rejected12:19
hughsaunderswhich I think is reasonably likely12:19
evrardjpindeedy12:20
openstackgerritTaseer Ahmed proposed openstack/openstack-ansible master: Integrate Congress with OSA.  https://review.openstack.org/50397112:22
openstackgerritMerged openstack/openstack-ansible-ops master: Update mnaio to allow deployers to use nspawn  https://review.openstack.org/54471912:24
openstackgerritMerged openstack/openstack-ansible-os_ceilometer master: Adds ceilometer-upgrade task  https://review.openstack.org/52665512:26
openstackgerritMerged openstack/openstack-ansible-memcached_server stable/pike: Fix memcached_server linting issues  https://review.openstack.org/54437212:26
openstackgerritMerged openstack/openstack-ansible-os_monasca-ui master: Updated from OpenStack Ansible Tests  https://review.openstack.org/51469712:27
openstackgerritMerged openstack/openstack-ansible-memcached_server stable/pike: Zuul: Remove project name  https://review.openstack.org/54284212:28
*** Sha000000 has quit IRC12:29
*** abelur has joined #openstack-ansible12:31
openstackgerritMerged openstack/openstack-ansible-rsyslog_client master: Update reno for stable/queens  https://review.openstack.org/54450612:33
*** shardy has quit IRC12:35
*** niraj_singh has joined #openstack-ansible12:36
openstackgerritMerged openstack/openstack-ansible-os_trove master: Update reno for stable/queens  https://review.openstack.org/54449112:36
openstackgerritMerged openstack/openstack-ansible-galera_server master: Update reno for stable/queens  https://review.openstack.org/54440312:36
niraj_singhwhile running openstack-ansible setup-openstack.yml i am getting error " "Failed to find required executable rabbitmqctl in paths: /usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"}"12:37
*** chyka has joined #openstack-ansible12:37
openstackgerritMerged openstack/openstack-ansible-os_molteniron master: Update reno for stable/queens  https://review.openstack.org/54446412:37
niraj_singhany idea?12:37
openstackgerritMerged openstack/openstack-ansible-os_heat master: Update reno for stable/queens  https://review.openstack.org/54445212:37
openstackgerritMerged openstack/openstack-ansible-rsyslog_server master: Update reno for stable/queens  https://review.openstack.org/54450912:37
openstackgerritMerged openstack/openstack-ansible-os_ironic master: Update reno for stable/queens  https://review.openstack.org/54445812:37
openstackgerritMerged openstack/openstack-ansible-os_barbican master: Update reno for stable/queens  https://review.openstack.org/54443412:37
openstackgerritMerged openstack/openstack-ansible-os_sahara master: Update reno for stable/queens  https://review.openstack.org/54447912:37
openstackgerritMerged openstack/openstack-ansible-repo_server master: Update reno for stable/queens  https://review.openstack.org/54450312:38
openstackgerritMerged openstack/openstack-ansible-plugins master: Update reno for stable/queens  https://review.openstack.org/54449412:38
openstackgerritMerged openstack/openstack-ansible-memcached_server master: Update reno for stable/queens  https://review.openstack.org/54441912:38
openstackgerritMerged openstack/openstack-ansible-pip_install master: Update reno for stable/queens  https://review.openstack.org/54439712:38
openstackgerritMerged openstack/openstack-ansible-os_aodh master: Update reno for stable/queens  https://review.openstack.org/54443112:38
openstackgerritMerged openstack/openstack-ansible-os_gnocchi master: Update reno for stable/queens  https://review.openstack.org/54444912:38
openstackgerritMerged openstack/openstack-ansible-ceph_client master: Update reno for stable/queens  https://review.openstack.org/54440612:38
openstackgerritMerged openstack/openstack-ansible-galera_client master: Update reno for stable/queens  https://review.openstack.org/54440012:38
openstackgerritMerged openstack/openstack-ansible-os_tempest master: Update reno for stable/queens  https://review.openstack.org/54448812:38
openstackgerritMerged openstack/openstack-ansible-os_magnum master: Update reno for stable/queens  https://review.openstack.org/54446112:39
openstackgerritMerged openstack/openstack-ansible-openstack_openrc master: Update reno for stable/queens  https://review.openstack.org/54442812:39
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible-os_keystone master: Update upgrade script to use queens  https://review.openstack.org/54471012:39
openstackgerritMerged openstack/openstack-ansible-rabbitmq_server master: Update reno for stable/queens  https://review.openstack.org/54449712:39
openstackgerritMerged openstack/openstack-ansible-apt_package_pinning master: Update reno for stable/queens  https://review.openstack.org/54439412:40
openstackgerritMerged openstack/openstack-ansible-haproxy_server master: Update reno for stable/queens  https://review.openstack.org/54440912:40
openstackgerritMerged openstack/openstack-ansible-os_neutron master: Update reno for stable/queens  https://review.openstack.org/54446712:40
openstackgerritMerged openstack/ansible-hardening master: Update reno for stable/queens  https://review.openstack.org/54439112:40
openstackgerritMerged openstack/openstack-ansible-os_swift master: Update reno for stable/queens  https://review.openstack.org/54448212:40
openstackgerritMerged openstack/openstack-ansible-openstack_hosts master: Update reno for stable/queens  https://review.openstack.org/54442212:40
openstackgerritMerged openstack/openstack-ansible-repo_build master: Update reno for stable/queens  https://review.openstack.org/54450012:40
openstackgerritMerged openstack/openstack-ansible-os_horizon master: Update reno for stable/queens  https://review.openstack.org/54445512:41
*** chyka has quit IRC12:41
*** SmearedBeard has joined #openstack-ansible12:46
TESCRAIs it ok to proceed if the TASK [rabbitmq_server : Check cluster status]  had failed for infra 2&3 but the subsequent tasks  Stop join and start rabbitmq app]were sucessfull also the play recap is success?12:48
*** gkadam has quit IRC12:48
openstackgerritMerged openstack/openstack-ansible-lxc_container_create master: Generate a unique machine-id  https://review.openstack.org/54437512:49
openstackgerritMerged openstack/openstack-ansible-lxc_container_create master: Update reno for stable/queens  https://review.openstack.org/54441312:49
evrardjpTESCRA: it's ok.12:49
evrardjpas long as the play doesn't fail you're good.12:49
openstackgerritMerged openstack/openstack-ansible-os_monasca-agent master: [DOCS] Add new section to configure-monasca-agent.rst  https://review.openstack.org/53814112:51
TESCRAthanks evrardjp12:52
*** hamza21 has quit IRC12:53
openstackgerritMerged openstack/openstack-ansible-openstack_hosts master: Install yum utilities in openstack_hosts  https://review.openstack.org/54398312:54
*** SmearedBeard has quit IRC12:55
openstackgerritMerged openstack/openstack-ansible-os_glance master: Run openrc role ahead of rolling test script  https://review.openstack.org/54461712:56
*** hamza21 has joined #openstack-ansible13:01
openstackgerritMerged openstack/openstack-ansible-os_glance master: Remove registry options from scrubber config  https://review.openstack.org/54402913:02
openstackgerritMerged openstack/openstack-ansible-os_glance master: Update reno for stable/queens  https://review.openstack.org/54444613:02
openstackgerritMerged openstack/openstack-ansible-galera_server master: vars: Install qpress only when galera_xtrabackup_compression is true  https://review.openstack.org/54388813:05
openstackgerritMerged openstack/openstack-ansible-os_nova master: Update reno for stable/queens  https://review.openstack.org/54447013:06
odyssey4meniraj_singh was setup-infrastructure completeed successfully before that?13:06
niraj_singhyes13:07
odyssey4mesetup-openstack delegates the rabbitmq queue creation to the rabbit containers, but if they aren't working then it will all go wrong13:07
niraj_singhi again install rabbitmq-install.yml and the problem solved. But now i am getting another one.13:08
niraj_singhodyssey4me:fatal: [aio1_keystone_container-bff31d32 -> 172.29.236.85]: FAILED! => {"changed": false, "msg": "The MySQL-python module is required."}13:08
openstackgerritMarkos Chandras (hwoarang) proposed openstack/openstack-ansible-galera_server master: tests: test-galera-upgrades.sh: Workaround Ansible 2.4+ precedence bug  https://review.openstack.org/54495013:09
openstackgerritMarkos Chandras (hwoarang) proposed openstack/openstack-ansible-galera_server master: tasks: Replace deprecated 'include' statements  https://review.openstack.org/54495113:09
odyssey4meniraj_singh that's telling me that perhaps the galera_client role did not complete, because that's what installs it13:10
odyssey4meor galera_server, I forget off-hand13:10
niraj_singhok how can i confirm it?13:12
niraj_singhodyssey4me:or should i install it again13:12
evrardjpodyssey4me: I think you need coffee.13:20
odyssey4meevrardjp ?13:20
evrardjpthe tox.ini ... They have merged already.13:21
evrardjpor did I miss something?13:21
odyssey4meniraj_singh sounds like your infrastructure setup didn't go very well, so it may be worth double-checking13:21
odyssey4meevrardjp nope, we have extras13:21
odyssey4mehttps://github.com/openstack/openstack-ansible-os_glance/blob/stable/queens/tox.ini#L10 is done automatically by the releases bot, but for anything where we created the branch, we have to do that ourselves13:22
evrardjpoh.13:22
openstackgerritMerged openstack/openstack-ansible-os_cinder master: Stop running non-voting jobs in gate  https://review.openstack.org/54351713:22
odyssey4mehttps://github.com/openstack/openstack-ansible-os_glance/blob/stable/queens/tox.ini#L78-L79 has to be changed by us13:22
odyssey4meI ask myself every release whether we could try to implement something in the proposal bot to do all this for us... either that or we need to simplify how we do things.13:23
evrardjpok good catch.13:23
evrardjpwe need to simplify things, or at least put ?h=master13:23
odyssey4meif we ditch using tox then I think we could probably simplify quite a bit13:23
evrardjpthis way it's caught on a grep.13:23
odyssey4meyeah, I was thinking that too13:23
evrardjpbecause that line is not on a git clone either.13:24
odyssey4mebut that can't be done for the u-c one, as it'd break the release bot I think13:24
evrardjpSo very hidden thing.13:24
evrardjpwhat do you mean? The top one or the u-c on L78?13:24
odyssey4meL1013:24
evrardjpoh yeah, we can leave this one as is.13:24
openstackgerritMerged openstack/openstack-ansible-tests master: Set a fact for handling yum's fastestmirror plugin  https://review.openstack.org/54404813:25
evrardjpBut I think we're good for refactoring anyway.13:25
odyssey4mebut we still have to remember it for the repositories where we create the branch :/13:25
evrardjpI will propose a series of changes to simplify.13:25
*** udesale has joined #openstack-ansible13:25
odyssey4meawesome, thanks13:25
evrardjpbut this small changes will be nothing compared to getting rid of tox completely13:25
openstackgerritMerged openstack/openstack-ansible-os_cinder master: Update upgrade script to use queens  https://review.openstack.org/54470013:26
odyssey4meyup, agreed13:26
odyssey4methat's a good band-aid13:26
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_neutron master: Updated from OpenStack Ansible Tests  https://review.openstack.org/54465513:28
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_nova master: Updated from OpenStack Ansible Tests  https://review.openstack.org/54465613:28
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible master: [WIP] Fix ARA data collection and reporting  https://review.openstack.org/54435413:32
*** acormier has joined #openstack-ansible13:32
berendtmhayden: in theory it is possible for me to use ansible 2.4, but i am not sure if it is a good idea to only support one ansible version. i think there are a lot of environments on ansible < 2.4 at the moment13:32
*** acormier has quit IRC13:34
*** acormier has joined #openstack-ansible13:34
*** sar has joined #openstack-ansible13:35
*** acormier has quit IRC13:38
*** armaan has quit IRC13:39
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible-ops master: Point to Queens instead of master  https://review.openstack.org/54496113:40
*** vercetty92 has joined #openstack-ansible13:44
mhaydenberendt: i can see some merit to that13:48
mhaydenevrardjp: also not opposed to making it an independent deliverable now that development has settled down some13:49
mhaydenodyssey4me: if you have a moment, could you gander at this small patch? https://review.openstack.org/54404813:50
openstackgerritMajor Hayden proposed openstack/openstack-ansible-openstack_hosts master: Change include: to include_tasks:  https://review.openstack.org/54473913:52
openstackgerritMajor Hayden proposed openstack/openstack-ansible-lxc_container_create master: Change include: to include_tasks:  https://review.openstack.org/54474113:55
openstackgerritMerged openstack/openstack-ansible master: Remove pycrypto from requirements.txt  https://review.openstack.org/54451613:57
openstackgerritMerged openstack/openstack-ansible master: Update reno for stable/queens  https://review.openstack.org/54438813:57
openstackgerritMerged openstack/openstack-ansible master: [Docs] Remove duplicate hardening content  https://review.openstack.org/54435013:57
openstackgerritMajor Hayden proposed openstack/openstack-ansible-pip_install master: Change include: to include_tasks:  https://review.openstack.org/54497013:57
*** woodard_ has quit IRC13:57
*** woodard has joined #openstack-ansible13:58
*** esberglu has joined #openstack-ansible13:58
openstackgerritMajor Hayden proposed openstack/openstack-ansible-pip_install master: Change include: to include_tasks:  https://review.openstack.org/54497013:58
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible master: [WIP] Fix ARA data collection and reporting  https://review.openstack.org/54435413:59
mhaydenlogan-: i put a +2 on the ansible-hardening revert for now until we figure out a better way to version the role https://review.openstack.org/#/c/544693/14:00
*** sar has quit IRC14:00
odyssey4memhayden I thought I had seen, some time ago, a way of doing the includes differently based on ansible version... but can't seem to find it again14:02
odyssey4meit's a bit of a messy pattern IIRC, but sometimes necessary as in the ansible-hardening case14:03
mhaydenthey're just warnings at least -- not sure when that functionality will be removed14:03
mhaydeni'm seeing some strange pip mirror shenanigans in the gates14:04
mhaydenhappens randomly14:04
*** hachi has joined #openstack-ansible14:07
*** hamza21 has quit IRC14:08
openstackgerritMajor Hayden proposed openstack/openstack-ansible-rabbitmq_server master: Remove systemd conditionals  https://review.openstack.org/54497314:09
openstackgerritMajor Hayden proposed openstack/openstack-ansible-os_keystone master: Remove jinja delimiters in when  https://review.openstack.org/54473414:09
openstackgerritMajor Hayden proposed openstack/openstack-ansible-lxc_hosts master: Skip warning about running mount via shell  https://review.openstack.org/54497714:16
*** electrofelix has joined #openstack-ansible14:19
*** bhujay has quit IRC14:19
*** bhujay has joined #openstack-ansible14:19
*** acormier has joined #openstack-ansible14:22
*** dave-mccowan has quit IRC14:23
openstackgerritMajor Hayden proposed openstack/openstack-ansible-os_keystone master: Change include: to include_tasks:  https://review.openstack.org/54498214:25
openstackgerritMajor Hayden proposed openstack/openstack-ansible-os_keystone master: Change include: to include_tasks:  https://review.openstack.org/54498214:25
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible-tests master: Point to Queens instead of master  https://review.openstack.org/54498314:26
*** lbragstad has joined #openstack-ansible14:29
openstackgerritMerged openstack/openstack-ansible-pip_install master: Change include: to include_tasks:  https://review.openstack.org/54497014:29
openstackgerritMajor Hayden proposed openstack/openstack-ansible-os_glance master: Change include: to include_tasks:  https://review.openstack.org/54498414:30
*** acormier has quit IRC14:31
evrardjpodyssey4me: yes, ansible includes behave differently depending on the versions14:31
evrardjpmhayden: ^14:31
openstackgerritMajor Hayden proposed openstack/openstack-ansible-os_nova master: Change include: to include_tasks:  https://review.openstack.org/54498614:33
*** esberglu has quit IRC14:34
Taseerodyssey4me: thank you so much for helping !14:35
openstackgerritMajor Hayden proposed openstack/openstack-ansible-os_nova master: Remove systemd conditionals  https://review.openstack.org/54498714:35
Taseerevrardjp: it just needs your approval => https://review.openstack.org/#/c/503971/14:35
*** SmearedBeard has joined #openstack-ansible14:35
*** fghaas has joined #openstack-ansible14:37
openstackgerritMajor Hayden proposed openstack/openstack-ansible-os_neutron master: Update upgrade script to use queens  https://review.openstack.org/54469914:38
openstackgerritMajor Hayden proposed openstack/openstack-ansible-os_neutron master: Change include: to include_tasks:  https://review.openstack.org/54498814:38
*** threestrands_ has quit IRC14:39
openstackgerritMajor Hayden proposed openstack/openstack-ansible-os_neutron master: Remove systemd conditionals  https://review.openstack.org/54498914:40
openstackgerritMerged openstack/openstack-ansible-os_keystone master: Update upgrade script to use queens  https://review.openstack.org/54471014:43
openstackgerritMajor Hayden proposed openstack/openstack-ansible-os_swift master: Change include: to include_tasks:  https://review.openstack.org/54499114:44
openstackgerritMerged openstack/openstack-ansible-galera_server master: tests: test-galera-upgrades.sh: Workaround Ansible 2.4+ precedence bug  https://review.openstack.org/54495014:44
openstackgerritMerged openstack/openstack-ansible-galera_server master: tasks: Replace deprecated 'include' statements  https://review.openstack.org/54495114:44
openstackgerritMajor Hayden proposed openstack/openstack-ansible-os_swift master: Remove systemd conditionals  https://review.openstack.org/54499214:45
openstackgerritMerged openstack/ansible-hardening stable/pike: Move aide db when needed  https://review.openstack.org/54472514:46
fghaasHi everyone. I have a question about Magnum in the stable/ocata branch — more precisely, I think I understand the problem, but I'm curious about the proper way to fix it. Here's a LP bug for Magnum: https://bugs.launchpad.net/magnum/+bug/1749654 — this is on a fresh OSA stable/ocata install.14:48
openstackLaunchpad bug 1749654 in Magnum "magnum-db-manage fails with "ValueError: invalid literal for int() with base 10: 'magnum.sqlite'" (incorrect use of oslo_db.options)" [Undecided,New]14:48
fghaasTL;DR: repo_build creates a Magnum venv that pip installs oslo.db 4.33, when it should be installing 4.17.1 or at least anything earlier than 4.19.0. This then breaks magnum-db-manage because of a method whose signature changed in 4.19.0.14:48
fghaasNow, after I understood that this was a dependency issue, I figured I could simply propose a patch to Magnum's requirements.txt that mandated an oslo.db version prior to 4.19.0, but that's a non-starter (if I understand correctly) because of https://docs.openstack.org/requirements/latest/.14:48
fghaasSo my question is, what is the "proper" way to fix this, i.e. how do I ensure that repo_build builds a Magnum venv with oslo.db < 4.19.0?14:48
openstackgerritMarkos Chandras (hwoarang) proposed openstack/openstack-ansible-galera_server master: tasks: Fix use_percona_upstream variable usage  https://review.openstack.org/53525214:53
*** hachi has quit IRC14:55
openstackgerritMerged openstack/openstack-ansible-os_tacker master: Remove jinja delimiters in when  https://review.openstack.org/54473614:56
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible-tests master: Hide long useless log of gathered files  https://review.openstack.org/54499814:56
evrardjphwoarang: if you're there, I'd be super happy  if you could review this ^14:57
openstackgerritMerged openstack/openstack-ansible-rabbitmq_server master: Avoid warning when running yum  https://review.openstack.org/54473214:58
hwoarangyeah ok looks sensible14:59
Taseerevrardjp: what tests ?15:00
evrardjpTaseer: you have no scenario to test your change. But I won't prevent it from merging.15:01
evrardjpwe'll see how it evolves in the future15:01
evrardjpI will be waiting for your patches.15:02
odyssey4mefghaas if magnum's requirements are broken and not complying with the global requirements, then it can get hairy... it might be better to upgrade from ocata to pike instead of trying to muck with the requirements which will be a game of whack-a-mole15:02
openstackgerritMerged openstack/openstack-ansible-lxc_container_create master: Change include: to include_tasks:  https://review.openstack.org/54474115:02
Taseerevrardjp: ok...15:03
fghaasodyssey4me: No, Magnum's requirements are not broken. Global requirements say >=4.15.0 and Magnum's say >=4.15.0. Now for stable/ocata, that would need to be fixed to >=4.15.0,<4.19.0, which in my understanding still complies with the global requirement, but the Zuul requirements check thinks otherwise (see >=4.15.0).15:04
fghaasGah. I meant "see http://logs.openstack.org/07/544807/2/check/requirements-check/d4b1ea6/job-output.txt.gz".15:05
*** Sha000000 has joined #openstack-ansible15:05
fghaasOr are you saying it's the requirements check that's broken for Ocata, and *that* needs to be fixed?15:06
fghaasBy the way, unfortunately in Pike Magnum is brokener (is that a word?) than in Ocata, at least for my use case (kubernetes with dashboard).15:08
*** hamzy_ has quit IRC15:10
*** mrch has joined #openstack-ansible15:11
*** dave-mccowan has joined #openstack-ansible15:13
openstackgerritMajor Hayden proposed openstack/openstack-ansible-os_neutron master: Add SELinux contexts for neutron log directory  https://review.openstack.org/54358815:14
openstackgerritMerged openstack/openstack-ansible-tests master: Remove jinja delimiters in when  https://review.openstack.org/54473515:14
openstackgerritMajor Hayden proposed openstack/openstack-ansible-os_neutron master: Remove Pike task that is labeled for removal  https://review.openstack.org/54470715:15
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_tacker master: Update installation mechanism  https://review.openstack.org/54500415:15
*** kstev has joined #openstack-ansible15:16
*** bhujay has quit IRC15:19
vercetty92Hi everyone, first time here, can I expose here an issue I have on a openstack-ansible deployment?15:21
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_tacker master: Update installation mechanism  https://review.openstack.org/54500415:21
fghaasodyssey4me: It's entirely possible that I'm missing something basic and important about how repo_build is supposed to work. Because if I just build magnum locally with tox, it is indeed oslo.db 4.17.1 that gets pulled in. In that case, please feel free to rtfm me. :)15:22
*** Sha000000 has quit IRC15:22
odyssey4mefghaas ok, let's take a step back here a minute - the actual version installed does not use the requirements file at all, it uses the constraint value - for ocata that's https://github.com/openstack/requirements/blob/stable/ocata/upper-constraints.txt#L23915:24
fghaasok... this is insightful but very puzzling. :) How would repo_build end up with 4.33 then?15:26
odyssey4mewhen pip install executes with -r <requirements.txt and -c constraints.txt, it find the files to install in requirements.txt, but uses the versions from constraints.txt... unless the constraints fie has no reference, then it will fall back to the requirements15:26
odyssey4mefghaas fghaas that's a good question, as our overrides for the upper constraints provided by openstack do not have an oslo.db reference: https://github.com/openstack/openstack-ansible/blob/stable/ocata/global-requirement-pins.txt15:27
odyssey4mefghaas which release are you using? perhaps it used to15:27
*** fghaas has quit IRC15:28
openstackgerritMerged openstack/openstack-ansible-lxc_hosts master: Change include: to include_tasks:  https://review.openstack.org/54474015:29
vercetty92Hi Guys, is it the place to expose some issue we can have on an openstack-ansible deployment?15:29
odyssey4mevercetty92 typical convention is not to ask if you can ask a question, but simply ask a question ;)15:30
odyssey4meall questions are welcome - we all learn together in the channel, from each other's mistakes and each other's victories15:31
vercetty92lol I understand, it's just my first time here I don't want to spam you if it's not the good place15:31
odyssey4mevercetty92 we just ask that any logs showing problems use pastebin or some similar service, rather than being pasted in the channel15:31
vercetty92ok so, I try to deploy an openstack cluster. I have 3 nodes, and all the nodes will have all the roles (to have real HA). one of them is the deployment host.  During the deployment of setup-hosts.yml playbook, there is an error at the last step "Run container veth wiring script"  Errors are here : https://pastebin.com/Y74D9nfi openstack_user_config.yml is here : https://pastebin.com/5Crms6kD  I tried to manually launch15:32
vercetty92I have no logs , if you know a place where there are generated on the deployment host, I can take a look15:32
*** fghaas has joined #openstack-ansible15:32
fghaasFine time for my DSL to die on me — sorry about the interruption, odyssey4me :/15:33
*** eumel8 has quit IRC15:33
vercetty92I tried to manually launch the lxc-veth-wiring script, example with the first error in the list : /usr/local/bin/lxc-veth-wiring openstack-1_keystone_container-9726163a 9726163a_eth0 eth0 br-mgmt  First execution of the command return 3, and second return 0, then if I launch agian the playbook I don't have the error anymore.  Do you know what is the issue?15:34
fghaasSo you're saying, odyssey4me, that if repo_build works as designed then oslo.db 4.33 should never be pulled in, but that it should build the venv with 4.17.1?15:34
openstackgerritMajor Hayden proposed openstack/openstack-ansible-haproxy_server master: Cleanup role  https://review.openstack.org/54501215:36
*** hamzy_ has joined #openstack-ansible15:37
openstackgerritMerged openstack/openstack-ansible-os_designate master: Remove v1 API configuration  https://review.openstack.org/54453315:39
*** hamzy_ has quit IRC15:41
*** dave-mccowan has quit IRC15:43
*** olivierbourdon38 has quit IRC15:44
*** acormier has joined #openstack-ansible15:45
*** gkadam has joined #openstack-ansible15:47
mhaydenohai fghaas15:48
fghaaso/ mhayden15:48
*** kstev has quit IRC15:49
openstackgerritMajor Hayden proposed openstack/openstack-ansible-galera_client master: Change include: to include_tasks:  https://review.openstack.org/54501415:49
*** hamzy has joined #openstack-ansible15:50
*** kstev has joined #openstack-ansible15:51
openstackgerritMajor Hayden proposed openstack/openstack-ansible-tests master: Reduce console output in CI jobs  https://review.openstack.org/54501515:54
mhaydenso it seems that the openstack mirrors might be missing 'tinyrpc'15:55
mhaydenCould not find a version that satisfies the requirement tinyrpc===0.715:55
*** agrebennikov has joined #openstack-ansible15:56
mhaydenso the mirrors have a tinytinyrpc 0.0.1, but no tinyrpc15:59
*** woodard_ has joined #openstack-ansible16:00
evrardjpthat's very small16:00
*** woodard has quit IRC16:00
*** Leo_m has quit IRC16:01
odyssey4mefghaas yep, it should only build the versions in upper-constraints for the requirements SHA for the release... which release tag are you building from?16:01
odyssey4meevrardjp :p I see what you did there.16:02
* mhayden is asking in infra16:02
mhaydenabout tinyrpc16:02
odyssey4mejust a small question then?16:02
*** Leo_m has joined #openstack-ansible16:03
*** fghaas has quit IRC16:03
evrardjpodyssey4me: hahaha16:09
*** Leo_m has quit IRC16:09
*** pcaruana has quit IRC16:09
*** Leo_m has joined #openstack-ansible16:10
mhaydenhttps://bugs.launchpad.net/openstack-requirements/+bug/174965116:12
openstackLaunchpad bug 1749651 in OpenStack Global Requirements "tinyrpc version issue" [Undecided,New]16:12
mhaydenauthor deleted 0.7 from mirrors16:12
mhaydenAND THERE WAS MUCH REJOICING16:12
mhaydenkudos to prometheanfire for educating them https://github.com/mbr/tinyrpc/issues/4516:12
openstackgerritGerman Eichberger proposed openstack/openstack-ansible-os_octavia master: Fixes Lint errors and improbe tests  https://review.openstack.org/54411716:13
*** Leo_m has quit IRC16:14
openstackgerritMerged openstack/openstack-ansible-tests master: Hide long useless log of gathered files  https://review.openstack.org/54499816:17
mnaserodyssey4me: fyi https://review.openstack.org/#/c/543627/ the finishing touches happen in the next patch because there is a weird loop in _common so the next one finishes it up involving magnum_services16:18
mnaser(which i have to push up fixes for now)16:18
jmccrorymhayden shouldn't these also bump the metadata min_ansible_version to 2.4? https://review.openstack.org/#/q/topic:include-to-include-tasks16:19
openstackgerritGerman Eichberger proposed openstack/openstack-ansible master: Moves Octavia gate from experiemntal to required  https://review.openstack.org/54502016:19
openstackgerritGerman Eichberger proposed openstack/openstack-ansible master: Moves Octavia gate from experimental to required  https://review.openstack.org/54502016:19
mhaydenjmccrory: oh, good point16:20
mhaydenglad you caught that before i had to do a rollback16:21
mhayden(sorry)16:21
*** fghaas has joined #openstack-ansible16:21
*** olivierbourdon38 has joined #openstack-ansible16:21
mhaydenhwoarang: should leap 42.1 come out of meta since it's EOLd?16:21
mhaydenor close to EOL?16:21
openstackgerritMajor Hayden proposed openstack/openstack-ansible-lxc_hosts master: Update minimum Ansible version  https://review.openstack.org/54502216:22
openstackgerritMajor Hayden proposed openstack/openstack-ansible-lxc_container_create master: Update minimum Ansible version  https://review.openstack.org/54502316:23
openstackgerritMajor Hayden proposed openstack/openstack-ansible-pip_install master: Update minimum Ansible version  https://review.openstack.org/54502416:23
openstackgerritMerged openstack/openstack-ansible-os_keystone master: Remove jinja delimiters in when  https://review.openstack.org/54473416:23
openstackgerritMajor Hayden proposed openstack/openstack-ansible-openstack_hosts master: Change include: to include_tasks:  https://review.openstack.org/54473916:24
openstackgerritMajor Hayden proposed openstack/openstack-ansible-os_keystone master: Change include: to include_tasks:  https://review.openstack.org/54498216:24
openstackgerritMajor Hayden proposed openstack/openstack-ansible-os_glance master: Change include: to include_tasks:  https://review.openstack.org/54498416:25
openstackgerritMajor Hayden proposed openstack/openstack-ansible-os_nova master: Change include: to include_tasks:  https://review.openstack.org/54498616:25
openstackgerritMajor Hayden proposed openstack/openstack-ansible-os_swift master: Change include: to include_tasks:  https://review.openstack.org/54499116:26
openstackgerritMajor Hayden proposed openstack/openstack-ansible-galera_client master: Change include: to include_tasks:  https://review.openstack.org/54501416:26
*** fghaas has quit IRC16:26
*** chyka has joined #openstack-ansible16:27
cloudnullmornings16:35
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible-os_swift master: Lay out a clouds.yaml file before upgrading  https://review.openstack.org/54502816:36
cloudnullevrardjp: ping16:37
cloudnullmind having another look at https://review.openstack.org/#/c/544685/16:38
cloudnullnow that the race condition gate issues have passed.16:38
evrardjpoh great. I didn't know it was a race condition, I didn't dig into it.16:38
evrardjpToday I was very busy with the whole series of changes for queens/master16:38
cloudnullit wasnt our race condition16:39
evrardjpso I didn't got the chance to import your rpeo16:39
cloudnullit was in zuul16:39
evrardjpoh16:39
evrardjpwierd16:39
cloudnullyea it was reporting issues with the tripleo gate16:39
cloudnullon everyone's gates16:39
cloudnullwhich was due to the maas branching of queens16:39
cloudnulls/maas/mass/g16:40
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible master: [WIP] Fix ARA data collection and reporting  https://review.openstack.org/54435416:40
cloudnullhwoarang: you around16:41
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible master: [WIP] Fix ARA data collection and reporting  https://review.openstack.org/54435416:41
*** adcpdk has joined #openstack-ansible16:43
cloudnullgeekinutah: ping16:43
cloudnullfollowing up, did you get it all running ?16:43
*** fghaas has joined #openstack-ansible16:43
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible master: [WIP] Fix ARA data collection and reporting  https://review.openstack.org/54435416:44
*** udesale has quit IRC16:44
*** mrch has quit IRC16:45
adcpdkHey guys! Hopefully a quick question:16:45
adcpdkWhen I upload a new image using Horizon I don't specify any Metadata, just File, Format of the disk and Architecture (e.g. x86_64). When I create an Instance using the Heat template it works fine, however If I try to run an instance from that Image it will run the instance, but without the image, so it will say "Image: -"16:45
adcpdkany ideas?16:45
adcpdkIt's not the case for cirros image, as Metadata is already there16:46
cloudnulladcpdk: are you builing the image using a cinder volume ?16:47
cloudnull\i've seen it where the image name is not reported when using a block volume as the root16:48
Taseerdoes it need require changes to the patch ? => http://logs.openstack.org/71/503971/24/gate/openstack-ansible-deploy-aio_lxc-ubuntu-xenial/a9c39f2/job-output.txt.gz#_2018-02-15_16_21_26_62831316:48
odyssey4megood to see mhayden our janitor cleaning up some mess ;)16:49
* mhayden gets out the broom16:49
mhaydenodyssey4me: it's my penance for breaking so many things16:49
adcpdkI think so16:50
adcpdkyes16:50
fghaasodyssey4me: just reconfirmed. If I run a Magnum venv build from current OSA stable/ocata (which wants to install 7af6b6c924357c2e2d4360c6b17d640e1202f212), then it breaks immediately with this: http://paste.openstack.org/show/673107/16:50
fghaasIf I set magnum_git_install_branch: "stable/ocata", forcing it to git clone what's currently in that branch for Magnum, then the build completes, but I get oslo.db 4.33, and then I see immediate breakage with magnum-db-manage.16:50
adcpdkI just want it to use LVM I set up on storage node16:50
* fghaas reminds mhayden to do a Schwarzenegger impersonation and shout "bwing me de bwoom!" over an assembled crowd16:51
*** admin0 has quit IRC16:51
odyssey4mefghaas ok, if you update the sha used for one service you'll have to update them all or at least update the requirements repo too16:52
odyssey4mefghaas could you take a look at the venv build log for each to see where the change in oslo.db is coming from?16:53
odyssey4meThe repo container's /var/log/repo/ folder should have a per-venv output from the build16:54
fghaasI can certainly try, never done that before... give me a few16:54
mhaydenperhaps it's because we're missing drbd16:54
odyssey4meevrardjp heh, I forgot about that one (https://review.openstack.org/545032)16:54
*** electrofelix has quit IRC16:55
adcpdkcloudnull what should I do with this?16:55
*** Sha000000 has joined #openstack-ansible16:56
*** olivierbourdon38 has quit IRC16:56
fghaasodyssey4me: I don't quite know what to look for, does a paste of "grep oslo.db *.log" in that directory help?16:56
*** Leo_m has joined #openstack-ansible16:56
odyssey4mefghaas we're only interested in the magnum venv log - it'll be a bit big, but if you can pastebin/gist it somewhere then it'll be helpful16:57
odyssey4meI happen to have an ocata test env setup - will add magnum now to replicate the issue you're seeing16:57
evrardjpodyssey4me: ahah it's alright, we are a team :)16:57
odyssey4meevrardjp we should probably add some bits to the release checklist in the contributor docs16:58
*** woodard_ has quit IRC16:59
fghaashere you go odyssey4me: http://paste.openstack.org/show/673109/ (thanks lodgeit.py)17:00
odyssey4mefghaas I suspect that what's happened is that we pinned sha's in between a requirement being updated and it being merged into the magnum repo - this happens from time to time17:01
adcpdkHey guys, will anyone be able to assist me with AIO Image creation? I have tried to upload an image to it, however when I run the instance it wont' specify it and will run the instance without the image17:01
odyssey4meThis is from your paste: No matching distribution found for pyasn1-modules>=0.2.1 (from google-auth>=1.0.1->kubernetes>=1.0.0b1->magnum)17:01
adcpdkWith HEAT it works fine17:02
fghaasodyssey4me: yes, like I said, that was the first attempt with the sha that is currently in defaults/repo_packages/openstack_services.yml17:03
fghaasSo that breaks immediately.17:04
fghaasThen with "magnum_git_install_branch: stable/ocata", I do get a working venv, albeit with the wrong oslo.db17:04
fghaasBy the way, don't you also want repo_builder.log ?17:05
odyssey4mefghaas it kinda depends whether your build has https://github.com/openstack/openstack-ansible-repo_build/commit/5def50077bbf6541a25b12744819f8f728a5711d included yet? ;)17:06
*** Matias_ has joined #openstack-ansible17:06
odyssey4meI've got a test build up, so no need to pastebin the log :)17:06
evrardjpodyssey4me: we are adding regexp matching in infra17:07
evrardjpso we'll be good forever17:07
*** Matias_ is now known as Matias17:07
odyssey4meevrardjp w00t!17:07
mhaydenyay i have a new outlet for my terrible regexes17:08
fghaasodyssey4me: and yes I do have that line from 5def50077bbf6541a25b12744819f8f728a5711d in my environment17:09
*** SmearedBeard has quit IRC17:09
fghaasHowever what I do not have is that file (/var/log/repo/repo_venv_builder.log) in my repo container, which is another source of befuddlement for me right now :)17:11
odyssey4mefghaas ok, I now have a replication of the same issue17:11
fghaaswhich one now, the pyasn1-modules problem? Or have you retraced my steps beyond that?17:12
odyssey4mefghaas you should no longer have that file, but instead will have venv_build_magnum-15.1.16-x86_64.log17:12
fghaasAh, perfect.17:12
fghaasI'll be afk for a bit tucking little ones in, but will be back later and catch up on the scrollback — hope that's OK with you17:13
odyssey4mesure thing, I need a little time to trace it :)17:13
*** sxc731 has joined #openstack-ansible17:14
*** sar has joined #openstack-ansible17:18
openstackgerritMajor Hayden proposed openstack/openstack-ansible-os_keystone stable/pike: Remove jinja delimiters in when  https://review.openstack.org/54504417:19
openstackgerritMajor Hayden proposed openstack/openstack-ansible-tests stable/pike: Remove jinja delimiters in when  https://review.openstack.org/54504617:19
openstackgerritMajor Hayden proposed openstack/openstack-ansible-rabbitmq_server stable/pike: Avoid warning when running yum  https://review.openstack.org/54504817:20
*** pcaruana has joined #openstack-ansible17:20
openstackgerritMajor Hayden proposed openstack/openstack-ansible-os_tacker stable/pike: Remove jinja delimiters in when  https://review.openstack.org/54505017:21
gandemhey guys, quick question again after a day of investigation. I was getting: "Failed to connect to bus: No such file or directory" in rabbitmq logs on lxc. Installing dbus on the container seems to have fixed the issue. Should dbus be installed by default on rabbitmq containers ?17:30
gandemHere is the full log of rabbitmq on launch : https://pastebin.com/sMbQED3L17:34
odyssey4mefghaas alright, I see where the trouble is coming in at the current constraints... the problem is that magnum is not adhering to the global requirements management process properly... cc prometheanfire17:34
odyssey4memagnum requires kubernetes, kubernetes requires google-auth - neither of those are constrained in any way by openstack upper-constraints, so they're open ended17:34
geekinutahcloudnull: yeah, environment recreated, still the same underscores in hostname thing17:35
odyssey4megoogle-auth at the current release requires pyasn1-modules >= 0.2.1, but upper constraints constrains it under 0.0.8: https://github.com/openstack/requirements/blob/stable/ocata/upper-constraints.txt#L28117:36
*** Leo_m has quit IRC17:36
geekinutahcloudnull: where would be a good place for me to start chasing this down? Inventory generator? lxc_container_create stuff?17:36
odyssey4meso for ocata, we'd need to pin these extra packages ourselves given that u-c doesn't do so... I'll find a working set, then push up a patch for ocata and do the same for pike onwards17:37
*** woodard has joined #openstack-ansible17:38
*** mbuil has quit IRC17:39
evrardjpgeekinutah: could you paste your openstack_user_config please ?17:40
evrardjpand your openstack_inventory.17:40
evrardjpand if you could put all on that in a bug, that would be even better, for the record :D17:41
geekinutahsure :-), creating bug now17:43
evrardjpthanks!17:43
evrardjpyou have the link?17:44
evrardjphttps://bugs.launchpad.net/openstack-ansible17:44
geekinutahyeah, thanks, just reading the bug report guidelines17:44
evrardjpwow!17:46
evrardjpI didn't even remember we had those :D17:46
evrardjpwhat you did / what you expected / which code you have + config that's a good baseset :D17:46
*** gillesMo has quit IRC17:47
odyssey4meas a project grows, it becomes quite hard to remember everything that's already been done ;)17:48
cloudnullevrardjp: odyssey4me: do either of you have a recently deployed pike cloud?17:55
*** gkadam has quit IRC17:56
odyssey4mecloudnull I have an AIO I built yesterday.17:56
cloudnullfrom pike?17:56
odyssey4meyup, from the head of stable/pike17:56
cloudnullmind looking to see if the container host names are using the "_" instead of the "-"17:56
cloudnullthat's the issue geekinutah was seeing the other, if im not mistaken17:57
cloudnulljust want to see if we can reproduce it locally17:57
odyssey4methe inventory names still use _, will check host names now17:57
* cloudnull hasn't had time to spin one up17:57
odyssey4meoh bother, I just realised I deleted in half an hour ago17:57
* odyssey4me just tried to log into someone else's cloud server Oo17:58
odyssey4meI can fire one up - it'll take 60-90 mins to build though.17:59
cloudnullok .17:59
cloudnullno worries, was going to do the same17:59
mhaydenodyssey4me: stop logging into my secret cloud server17:59
odyssey4meubuntu, right?17:59
geekinutahevrardjp: https://bugs.launchpad.net/openstack-ansible/+bug/174976417:59
cloudnullgeekinutah: ^17:59
openstackLaunchpad bug 1749764 in openstack-ansible "Container hostnames contain underscores which breaks deployment" [Undecided,New]17:59
geekinutahthere's a start17:59
geekinutahI'll paste a few more tidbits in there18:00
geekinutahlemme know if you need more info18:00
cloudnullgeekinutah: on ubuntu ?18:00
odyssey4mecloudnull to be honest I had forgotten a niggling feeling in the back of my mind that after a container reboot it might reset the host name back... I just never got around to verifying if that was the case18:00
evrardjpcloudnull: I do it quite regularily on ubuntu18:00
geekinutahcloudnull: yeah18:00
geekinutah16.0418:00
cloudnullok.18:00
logan-i have a pike deploye dfrom 3f211f640b1febcfe6e71d36c31838dad9374cc4 (2/9)18:00
logan-both container name and hostname are '-' not '_'18:00
odyssey4memhayden I'm just checking if you're actually reading those auth logs. ;)18:00
mhaydentrolololol18:01
cloudnullevrardjp: do you have one sitting around that you can login and check ?18:01
evrardjpwhat should I check?18:01
openstackgerritPeriyasamy Palanisamy proposed openstack/openstack-ansible master: Make Opendaylight as the BGP speaker using Quagga  https://review.openstack.org/52390718:01
evrardjpthe hostnames?18:01
cloudnulllogan-: that looks like it was from Feb 9, 201818:02
cloudnullevrardjp: yup18:02
evrardjplxc-ls shows the _18:02
cloudnullthat's normal18:02
odyssey4mecheck the hostname inside the container18:02
cloudnulllooking to see if the container hostname is using "-"18:02
odyssey4mecloudnull you know, we have this *really old* bug to fix that up ;) https://bugs.launchpad.net/openstack-ansible/+bug/164368018:03
openstackLaunchpad bug 1643680 in openstack-ansible "Shift to using dashes instead of underscores for container names" [Wishlist,In progress] - Assigned to Nolan Brubaker (nolan-brubaker)18:03
cloudnulllogan-: which is good as a baseline to know that if it is broken it hasn't been broken for all that long18:03
evrardjpI was thinking ... it's been YEARS we are like that.18:03
evrardjpodyssey4me: it's more likely to use a static inventory BEFORE this gets fixed.18:04
odyssey4menot quite years ;) we switched it in mitaka IIRC18:04
cloudnullthe container names have always had the "_". however the hsotname set within the containers should all have that converted to a "-"18:04
evrardjpyeah inside it's ok, I've fixed that :D18:05
evrardjpI remember that upgrade time!18:05
cloudnull?18:05
evrardjpI was working with mattt , and I was definitely getting on his nerves.18:06
evrardjpGood old times.18:06
cloudnulldid you have to manually fix that for this deployment ?18:06
cloudnullor in the past18:06
evrardjpoh nothing done on this deploy, it works fine OOTB18:06
cloudnullok18:06
evrardjpI meant the move from _ to - in deploy/upgrades in M18:06
cloudnullah yea.18:07
cloudnull:) memories18:07
evrardjpgood and bad ones!18:07
evrardjpanyway, no issue on my side.18:07
matttevrardjp: wait wut!18:07
evrardjpgeekinutah: not so sure about something: you said mitaka, but you say pike/stable... what happened?18:08
geekinutahmitaka is the host cloud18:08
geekinutahsorry, bit confusing18:08
*** hamza21 has joined #openstack-ansible18:08
geekinutahI am deploying openstack on openstack18:08
evrardjpare you doing triple O? :D18:08
evrardjpOMG18:08
geekinutah;-)18:08
evrardjpplease continue.18:09
adcpdkcloudnull do you have any suggestions for my glance image upload issue?18:09
geekinutahI'll throw my heat template up there for good measure18:09
evrardjpyour instance inside your undercloud is a proper vm where you deploy osa?18:09
evrardjpoh no no no18:09
adcpdkI can see you busy, sorry18:09
geekinutahevrardjp: correct18:09
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_magnum stable/ocata: Properly constrain magnum dependencies  https://review.openstack.org/54507318:09
evrardjpplease allow me to forget what I heard before, and just focus on this deploy :D18:10
cloudnulladcpdk: is this an issue with the glance images or something to do with the instances you create from them ?18:10
evrardjpgeekinutah: your instance might have cloud-init18:10
evrardjpwhich can set the hostname or thing like that?18:10
evrardjpbut even that, it shouldn't impact containers inside your instance.18:11
geekinutahI disable cloud init... but yeah, shouldn't affect containers18:11
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_magnum stable/ocata: Properly constrain magnum dependencies  https://review.openstack.org/54507318:12
evrardjpI have to go for today, I have a nice headache.18:12
adcpdkcloudnull images looks correct and work fine if I use HEAT template to deploy those instances, it's just it down't work if you click n Images -- > Create Instance18:12
evrardjpgeekinutah: I am sure someone here will be able to help you.18:13
adcpdkit's not attaching the image to the instance like18:13
geekinutahevrardjp: :-P thanks!18:13
*** peri has quit IRC18:13
*** kukacz has quit IRC18:15
fghaasodyssey4me: I'm back, and I must confess I don't quite follow. Like I said, for me *that* dependency problem goes away if I simply deploy magnum from stable/ocata, so I took that to mean they had taken care of that issue upstream... no?18:18
fghaasalso, when you make these changes, which version of oslo.db goes into your venv build... and if it's the correct one, how exactly does your change effect that? (Trying to wrap my head around this)18:19
*** kukacz_ has joined #openstack-ansible18:20
odyssey4mefghaas the root cause of the issue has nothing to do with oslo.db, but instead has everything to do with magnum requiring libraries which have no constraint18:21
odyssey4mein other words if you build the venv today, then build it next week, it will very likely have different content18:21
fghaasright, I noticed as much :)18:21
odyssey4mefor example, the magnum repo has kubernetes>=x... but has no constraint to cap it at a particular version18:22
odyssey4meso today you might get kubernetes 1, tomorrow you get kubernetes 218:22
odyssey4methis isn't exactly what we hope for our deployers - we're ideally aiming for a tagged deployment to be fully repeatable18:22
odyssey4meI've discovered that while ocata was unconstrained, pike is properly constrained... so I'm applying the pike version limits to ocata and verifying that it builds now18:23
fghaasI completely agree with you on that, but — I realize I'm surely sounding dense here — my monkey brain is still failing to make the connection why too-new kubernetes and google-auth libraries would make oslo.db bust _its_ constraints. ELI5, please?18:24
fghaas(if you can, feel free to blow me off if you have more pressing things to do)18:24
odyssey4meok, so the build at the head of our stable/ocata produced this error: No matching distribution found for pyasn1-modules>=0.2.1 (from google-auth>=1.0.1->kubernetes>=1.0.0b1->magnum)18:26
odyssey4methat's the error I've focused on, rather than the one produced from your hack ;)18:26
odyssey4meonce I've confirmed this to be working, I'll try what you did and see what can be seen18:26
*** sxc731 has quit IRC18:27
fghaasgotcha. Much appreciated. :)18:27
odyssey4methe issue from that error is that pyasn1-modules>=0.2.1, which came from google-auth, which came from kubernetes... is an incompatible library to the rest of openstack18:28
odyssey4meincompatible because it's constrained as such: https://github.com/openstack/requirements/blob/stable/ocata/upper-constraints.txt#L28118:28
fghaasRight, and I presume you found a google-auth version that played nicely with pyasn1-modules 0.0.818:29
fghaasOr at least is expected to.18:29
*** kstev has quit IRC18:29
odyssey4meour repo build process builds using the common constraints - it does not currently allow each project to specify different constraints - everything has to reduce down to a single compatible set18:29
*** hamza21 has quit IRC18:29
fghaasWhich is the whole point of the OpenStack-wide global requirements exercise, if I understand correctly?18:30
odyssey4mefghaas yep, for the purpose of distribution packaging the global requirements process ensures that all requirements are co-installable18:30
fghaasMakes perfect sense.18:31
odyssey4methe distributions do not use venvs, so everything *must* be co-installable18:31
odyssey4mefor us, we technically could allow each venv to use their own constraints... but it's work that we've not gotten to18:31
geekinutahI think I'm going to have to stick an inotify watch on the hostname and hosts files18:32
odyssey4methis is work I'm hoping to achieve in rocky which will come as a side-effect to radically simplifying the way we build/install the python things: https://github.com/openstack/openstack-ansible-specs/blob/master/specs/queens/python-build-install-simplification.rst18:32
geekinutahbecause according to the lxc-create-container playbook there should be no way that I get underscores ....18:32
geekinutahstep by step playbook execution, hooray :-)18:33
*** hamza21 has joined #openstack-ansible18:33
fghaasFor what it's worth odyssey4me, I'm now super curious if those extra deps earn you a working magnum-db-manage :)18:34
*** persia has quit IRC18:39
odyssey4mefghaas hah! lemme just finish writing up a known issue for our release notes, then I can try and complete the rest of the deployment to see if all that works right18:41
fghaasTotally, no rush at all — I hugely appreciate you spending your time on this.18:42
*** ricardoas has joined #openstack-ansible18:43
*** jamesdenton has joined #openstack-ansible18:43
*** kstev has joined #openstack-ansible18:45
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_magnum stable/ocata: Properly constrain magnum dependencies  https://review.openstack.org/54507318:54
fghaasodyssey4me: whoa rockin'... I just applied your change locally to my /etc/ansible/roles, and lo and behold it does pip install oslo.db 4.17.118:55
*** admin0 has joined #openstack-ansible18:55
fghaas(the first one, that is... I'll do the other one now too, and try that also)18:56
ricardoashey, folks! I´m trying to launch an AIO with 17.0.0.0rc1 and ironic enabled (copied etc/openstack_deploy/conf.d/ironic.yml.aio to /etc/openstack_deploy/conf.d/ironic.yml) but openstack-ansible setup-openstack.yml does not finish successfully (error message here http://paste.openstack.org/show/673120/ ). I´ve changed /etc/openstack_deploy/env.d/ironic.yml to bring back ironic_conductor_container because I need it to be metal,18:56
ricardoas but I´m not sure if this is the cause... any thoughts?18:56
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_magnum stable/ocata: Properly constrain magnum dependencies  https://review.openstack.org/54507318:56
odyssey4mefghaas was that these changes? https://review.openstack.org/#/c/545073/4/defaults/main.yml or these changes? https://review.openstack.org/#/c/545073/1/defaults/main.yml ? ;)18:57
fghaasI tried the latter first, and am now trying the former.18:57
fghaasDid I word that confusingly enough? ;)18:57
odyssey4methe former will build, but you'll end up with a nasty surprise when you upgrade to pike and get a downgraded kubernetes :/18:58
odyssey4meoh dear, I mean the latter...18:58
fghaasSee? Off-scale high on the confuseorama18:58
odyssey4mekube 4 works fine, but given that kube 2 is the pike constraint I figured it better to leave it there18:58
fghaasyeah, +∞18:59
*** Sha000000 has quit IRC19:00
odyssey4meif you want to run kube 4 then feel free to copy magnum_pip_packages to your user_variables.yml file in /etc/openstack_deploy and use https://review.openstack.org/#/c/545073/1/defaults/main.yml as an override of the pacage list... but then you'll need to maintain that set from then on19:00
*** poopcat has joined #openstack-ansible19:01
fghaasnananananah, I'm perfectly fine with having one less override in user_variables.yml :)19:02
odyssey4meyep, the fewer the better :)19:02
fghaasSo assuming this venv build works and gets me a sane oslo.db, I'll run setup-everything and will report back on whether or not Magnum behaves after that19:03
fghaasOK, venv still looks good. Excellastic. Kicking off setup-everything, will review that gerrit change once that's complete19:05
odyssey4mefghaas ok, awesome - if you've got a working build, then please comment on the review and vote +1 so everyone else know that it fixed things for you19:05
fghaasI have every intention to do exactly that. :)19:06
odyssey4meI've kicked off a build including magnum, but to be honest I have no idea how it works so I can't really test it properly.19:06
fghaasWell my hack broke immediately on magnum-db-manage, making os-magnum-install HCF.19:07
odyssey4mewell, I can bump the sha's in my test and see what the repo build does... but I feel like that may be a problem for another day given it's 7pm :)19:08
fghaasagree, 8pm here :)19:10
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible master: [WIP] Fix ARA data collection and reporting  https://review.openstack.org/54435419:15
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible master: [WIP] Fix ARA data collection and reporting  https://review.openstack.org/54435419:34
*** fghaas has quit IRC19:41
*** Leo_m has joined #openstack-ansible19:42
*** sxc731 has joined #openstack-ansible19:42
xgerman_prob. late to the party but I have some weird “No matching distribution found for tinyrpc===0.7” in the logs…19:45
xgerman_(and scroll back is not one of my superpowers)19:46
ricardoasxgerman_: tinyrpc 0.7 was deleted from pypi... somebody already fixed on requirements: https://review.openstack.org/#/c/545025/19:49
xgerman_ok, thanks19:49
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible master: Fix ARA/log data collection and reporting  https://review.openstack.org/54435419:50
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible master: Fix ARA/log data collection and reporting  https://review.openstack.org/54435419:51
*** Leo_m has quit IRC19:53
openstackgerritGerman Eichberger proposed openstack/openstack-ansible-os_octavia master: Fixes Lint errors and improve tests  https://review.openstack.org/54411719:54
*** Sha000000 has joined #openstack-ansible19:54
*** fghaas has joined #openstack-ansible19:56
*** Leo_m has joined #openstack-ansible19:57
*** pcaruana has quit IRC20:03
geekinutahFYI, worked this time :-)20:15
*** kukacz_ has quit IRC20:17
*** fghaas has quit IRC20:20
cloudnullgeekinutah: so it's all good now ?20:30
cloudnullsorry i've been bouncing back and fourth all day20:31
geekinutahyeah, that part at least20:31
*** fghaas has joined #openstack-ansible20:36
*** Leo_m has quit IRC20:41
*** Leo_m has joined #openstack-ansible20:42
SamYaplecloudnull: started converting those horrible bash scripts into a single go binary yesterday for galera autoclustering stuff20:48
SamYapleoncethats done it would basically be calling that binary instead of mysqld_safe (so systemctl service override) and hooking in etcd320:49
*** Sha000000 has quit IRC20:55
*** hamza21 has quit IRC21:06
*** sxc731 has quit IRC21:15
*** pcaruana has joined #openstack-ansible21:31
*** sar has quit IRC21:34
*** fghaas has quit IRC21:38
*** vnogin has joined #openstack-ansible21:40
*** openstack has joined #openstack-ansible21:47
*** ChanServ sets mode: +o openstack21:47
*** pcaruana has quit IRC21:48
*** woodard has quit IRC21:58
*** gillesMo has joined #openstack-ansible22:00
*** admin0 has quit IRC22:03
*** vnogin has quit IRC22:19
*** armaan has joined #openstack-ansible22:39
*** threestrands has joined #openstack-ansible22:43
*** threestrands has quit IRC22:43
*** threestrands has joined #openstack-ansible22:43
*** jwitko__ has quit IRC22:44
*** armaan has quit IRC22:46
*** pmannidi has joined #openstack-ansible22:47
*** dariko has quit IRC22:48
*** woodard has joined #openstack-ansible22:55
*** acormier has quit IRC23:18
*** acormier has joined #openstack-ansible23:19
*** acormier has quit IRC23:23
*** vnogin has joined #openstack-ansible23:36
*** vercetty92 has quit IRC23:46
*** abelur has quit IRC23:54
*** abelur has joined #openstack-ansible23:54
*** abelur has quit IRC23:57

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!