Saturday, 2017-09-30

*** yifei has joined #openstack-ansible00:14
*** yifei has quit IRC00:18
*** thorst has quit IRC00:25
*** thorst has joined #openstack-ansible00:25
*** thorst has quit IRC00:27
*** yifei has joined #openstack-ansible00:27
*** markvoelker has quit IRC00:31
*** esberglu has joined #openstack-ansible00:33
*** chas has joined #openstack-ansible00:35
*** esberglu has quit IRC00:38
*** chas has quit IRC00:40
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible master: Updated repo cloner for zuulv3  https://review.openstack.org/50850900:44
*** huanxie has joined #openstack-ansible00:47
*** thorst has joined #openstack-ansible00:47
*** gouthamr_ has joined #openstack-ansible00:48
*** woodard_ has joined #openstack-ansible00:52
*** woodard has quit IRC00:52
*** thorst has quit IRC00:52
*** huanxie has quit IRC00:53
*** lbragstad has joined #openstack-ansible00:54
*** dxiri has quit IRC01:06
*** dxiri has joined #openstack-ansible01:06
*** huanxie has joined #openstack-ansible01:08
*** dxiri has quit IRC01:11
*** gouthamr_ has quit IRC01:22
*** esberglu has joined #openstack-ansible01:27
*** lbragstad has quit IRC01:28
*** esberglu has quit IRC01:32
*** dave-mccowan has joined #openstack-ansible02:00
*** dave-mccowan has quit IRC02:12
*** esberglu has joined #openstack-ansible02:21
*** esberglu has quit IRC02:26
*** markvoelker has joined #openstack-ansible02:32
*** thorst has joined #openstack-ansible02:33
*** thorst has quit IRC02:40
*** thorst has joined #openstack-ansible02:40
*** thorst has quit IRC02:40
*** jwitko_ has quit IRC02:58
*** dxiri has joined #openstack-ansible03:04
*** markvoelker has quit IRC03:06
*** esberglu has joined #openstack-ansible03:16
*** esberglu has quit IRC03:20
*** thorst has joined #openstack-ansible03:33
*** thorst has quit IRC03:38
*** thorst has joined #openstack-ansible03:54
*** thorst has quit IRC03:58
*** lbragstad has joined #openstack-ansible03:59
*** markvoelker has joined #openstack-ansible04:03
*** chyka has joined #openstack-ansible04:05
*** esberglu has joined #openstack-ansible04:10
*** chyka has quit IRC04:10
*** germs1 has quit IRC04:12
*** esberglu has quit IRC04:14
*** huanxie has quit IRC04:16
*** lbragstad has quit IRC04:30
*** chas has joined #openstack-ansible04:36
*** markvoelker has quit IRC04:36
*** chas has quit IRC04:40
*** woodard_ has quit IRC04:41
*** woodard has joined #openstack-ansible04:42
*** woodard has quit IRC04:46
*** thorst has joined #openstack-ansible04:55
*** germs has joined #openstack-ansible04:58
*** germs has quit IRC05:00
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible master: Updated repo cloner for zuulv3  https://review.openstack.org/50850905:01
*** dxiri has quit IRC05:01
*** dxiri has joined #openstack-ansible05:02
*** germs has joined #openstack-ansible05:05
*** gouthamr has joined #openstack-ansible05:17
*** germs has quit IRC05:24
*** gouthamr has quit IRC05:32
*** markvoelker has joined #openstack-ansible05:33
*** perniciouscaffei has quit IRC05:52
*** esberglu has joined #openstack-ansible05:58
*** esberglu has quit IRC06:02
*** markvoelker has quit IRC06:06
*** thorst has quit IRC06:08
*** dxiri has quit IRC06:15
*** dxiri has joined #openstack-ansible06:15
*** dxiri has quit IRC06:34
*** gmonteiro has quit IRC06:34
*** dxiri has joined #openstack-ansible06:34
*** ricardoas has quit IRC06:34
*** gmonteiro has joined #openstack-ansible06:36
*** ricardoas has joined #openstack-ansible06:36
*** esberglu has joined #openstack-ansible06:52
*** esberglu has quit IRC06:57
*** thorst has joined #openstack-ansible07:05
*** esberglu has joined #openstack-ansible07:13
*** esberglu has quit IRC07:17
*** pcaruana has joined #openstack-ansible07:30
*** chas has joined #openstack-ansible07:36
*** chas has quit IRC07:38
*** ivve has joined #openstack-ansible07:39
*** esberglu has joined #openstack-ansible07:48
*** esberglu has quit IRC07:53
*** markvoelker has joined #openstack-ansible08:03
*** thorst has quit IRC08:03
*** thorst has joined #openstack-ansible08:08
*** shardy has quit IRC08:11
*** thorst has quit IRC08:13
*** markvoelker has quit IRC08:36
*** esberglu has joined #openstack-ansible08:42
*** esberglu has quit IRC08:47
*** thorst has joined #openstack-ansible09:09
*** markvoelker has joined #openstack-ansible09:34
*** yifei has quit IRC09:34
*** esberglu has joined #openstack-ansible09:37
*** esberglu has quit IRC09:41
*** sc68cal has quit IRC10:03
*** pbandark has joined #openstack-ansible10:04
*** markvoelker has quit IRC10:07
*** thorst has quit IRC10:08
admin0morning \o10:12
*** chyka has joined #openstack-ansible10:13
*** chyka has quit IRC10:18
*** pcaruana has quit IRC10:41
*** thorst has joined #openstack-ansible11:05
*** asb47 has joined #openstack-ansible11:10
asb47Hi all, I'm having some issues installing openstack-ansible, and wondered if you could help, or point me in the right direction11:12
asb47Specifically, when trying to install 16.0.0.0rc2 from git, the "Perform a Keystone DB sync expand" task in setup-openstack.yml is failing silently.  keystone.log in the appropriate container has the error: oslo_db.sqlalchemy.exc_filters InternalError: (1050, u"Table 'credential' already exists")11:13
asb47apologies if this is the wrong place to ask for help, but I've been banging my head against this for a while!11:14
asb47this is a clean install in a clean VM11:15
*** esberglu has joined #openstack-ansible11:25
*** thorst has quit IRC11:25
*** thorst has joined #openstack-ansible11:26
*** esberglu has quit IRC11:29
*** thorst has quit IRC11:31
*** pbandark has quit IRC11:36
*** pbandark has joined #openstack-ansible11:48
*** thorst has joined #openstack-ansible11:52
*** thorst has quit IRC11:57
*** markvoelker has joined #openstack-ansible12:04
*** ivve has quit IRC12:11
*** dxiri has quit IRC12:12
*** dxiri has joined #openstack-ansible12:12
*** thorst has joined #openstack-ansible12:13
*** dxiri has quit IRC12:16
*** dxiri has joined #openstack-ansible12:17
*** thorst has quit IRC12:18
*** esberglu has joined #openstack-ansible12:19
*** dxiri has quit IRC12:20
*** dxiri has joined #openstack-ansible12:21
*** dxiri has quit IRC12:21
*** dxiri has joined #openstack-ansible12:21
*** ivve has joined #openstack-ansible12:21
*** esberglu has quit IRC12:23
*** ivve has quit IRC12:26
*** dxiri has quit IRC12:31
*** dxiri has joined #openstack-ansible12:32
*** dxiri has quit IRC12:36
*** markvoelker has quit IRC12:38
*** ivve has joined #openstack-ansible12:38
*** dxiri has joined #openstack-ansible12:49
*** esberglu has joined #openstack-ansible13:13
*** thorst has joined #openstack-ansible13:15
*** esberglu has quit IRC13:17
logan-asb47: check which mariadb server version is installed in your galera containers13:31
logan-10.1.27 was released this week and was revoked because it crashes when galera clustering is enabled, but some mirrors still have it cached13:32
logan-during an OSA deployment that exhibits during the keystone db_sync because that's the first time we hit the cluster with traffic13:32
*** markvoelker has joined #openstack-ansible13:35
*** pbandark1 has joined #openstack-ansible13:46
*** pbandark has quit IRC13:47
*** pbandark1 is now known as pbandark13:47
*** woodard has joined #openstack-ansible14:05
*** thorst has quit IRC14:05
*** esberglu has joined #openstack-ansible14:08
*** markvoelker has quit IRC14:08
*** esberglu has quit IRC14:12
*** captaindave has joined #openstack-ansible14:28
ejb1123https://www.irccloud.com/pastebin/yX9jtQVW/14:36
ejb1123can anyone help me with this issue https://pastebin.com/Gg4zPPKj14:37
*** jamesdenton has quit IRC14:51
*** sc68cal has joined #openstack-ansible15:00
*** esberglu has joined #openstack-ansible15:01
*** thorst has joined #openstack-ansible15:02
*** pbandark has quit IRC15:03
*** pbandark1 has joined #openstack-ansible15:03
*** pbandark1 is now known as pbandark15:05
*** markvoelker has joined #openstack-ansible15:05
*** esberglu has quit IRC15:06
*** thorst has quit IRC15:10
*** thorst has joined #openstack-ansible15:10
*** idlemind has joined #openstack-ansible15:10
idlemindis br-storage required if storage is deployed (swift / cinder) or does it fall back to use br-mgmt for those services if br-storage is not present?15:12
*** lbragstad has joined #openstack-ansible15:15
*** germs has joined #openstack-ansible15:20
cloudnullmornings15:22
*** thorst has quit IRC15:23
ejb1123Can anyone help me with my issue? https://pastebin.com/Gg4zPPKj15:25
cloudnullejb1123: is 172.29.236.9 your vip ?15:31
cloudnullif so, is the load balancer running (haproxy) ?15:31
ejb1123https://www.irccloud.com/pastebin/LxbHL44e/15:32
ejb1123external_lb_vip_address: 172.29.236.5615:32
ejb1123internal_lb_vip_address: 172.29.236.1115:33
*** gkadam_ has quit IRC15:34
ejb1123i'm going to run install-haproxy then retry/15:36
cloudnullejb1123: based on  -- raise ConnectionError(e, request=request)\nConnectionError: HTTPConnectionPool(host='172.29.236.9', port=8181): Max retries exceeded with url: /os-releases/16.0.0/centos-7.4-x86_64/requirements_absolute_requirements.txt (Caused by NewConnectionError('<pip._vendor.requests.packages.urllib3.connection.HTTPConnectionobject at 0x2123950>: Failed to establish a new connection: [Errno 113] No route to15:37
cloudnullhost',))\n"}15:37
cloudnullit looks like its trying to connect to the 172.29.236.9 ip15:37
cloudnullwhat is that address?15:37
ejb1123let me check15:38
*** markvoelker has quit IRC15:39
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible master: Updated repo cloner for zuulv3  https://review.openstack.org/50850915:40
*** pbandark has quit IRC15:44
ejb1123cloudnull: I have no clue what 172.29.236.9 is, I greped through all my configs and it does not exist in any of them.15:50
ejb1123opps I lie15:51
ejb1123it found a match in Binary file /etc/openstack_deploy/backup_openstack_inventory.tar matches15:52
ejb1123[root@ejb1123-dev playbooks]# strings /etc/openstack_deploy/backup_openstack_inventory.tar | strings | grep 172.29.236.915:52
ejb1123            "internal_lb_vip_address": "172.29.236.9",15:52
ejb1123            "internal_lb_vip_address": "172.29.236.9",15:52
ejb1123            "internal_lb_vip_address": "172.29.236.9",15:52
ejb1123            "internal_lb_vip_address": "172.29.236.9",15:52
ejb1123            "internal_lb_vip_address": "172.29.236.9",15:52
ejb1123            "internal_lb_vip_address": "172.29.236.9",15:52
ejb1123            "internal_lb_vip_address": "172.29.236.9",15:52
ejb1123            "internal_lb_vip_address": "172.29.236.9",15:52
ejb1123            "internal_lb_vip_address": "172.29.236.9",15:52
ejb1123            "internal_lb_vip_address": "172.29.236.9",15:52
ejb1123            "internal_lb_vip_address": "172.29.236.9",15:52
ejb1123            "internal_lb_vip_address": "172.29.236.9",15:52
ejb1123            "internal_lb_vip_address": "172.29.236.9",15:52
*** germs has quit IRC15:54
*** esberglu has joined #openstack-ansible15:56
ejb1123so I cleared of the host of old containers and stuff, cleaned out the /etc/openstack_deploy directory of cache files, hopefully now it will work15:57
*** esberglu has quit IRC16:00
asb47logan-: thanks very much, I'll take a look16:04
*** germs has joined #openstack-ansible16:11
cloudnullejb1123: cool!16:17
*** germs1 has joined #openstack-ansible16:19
*** germs1 has joined #openstack-ansible16:20
*** germs has quit IRC16:22
*** thorst has joined #openstack-ansible16:24
*** SerenaFeng has joined #openstack-ansible16:33
*** markvoelker has joined #openstack-ansible16:36
ejb1123cloudnil: still not working https://pastebin.com/5f28kTwc16:52
idleminddumb question probably, firewalld needs to be disabled on all nodes not just the deployment host right? the documentation reads like it only needs to be done on the deployment host (unless ansible does this as part of the playbooks)16:54
ejb1123idk16:57
idlemindthx17:00
idlemindill try it verbatim from the instructions first. if i have a problem i'll know where to start looking17:00
ejb1123@cloudnull here is my openstack_user_config.yml https://pastebin.com/BQFjwkK717:04
*** thorst has quit IRC17:05
*** galstrom_zzz is now known as galstrom17:07
*** markvoelker has quit IRC17:09
*** thorst has joined #openstack-ansible17:18
*** galstrom is now known as galstrom_zzz17:21
ejb1123so I found that I setup the external haproxy ip improperly, so I fixed the interface and running the deploy again.17:21
*** thorst has quit IRC17:22
ejb1123ha proxy is running but containers still can't connect to it17:31
*** markvoelker has joined #openstack-ansible18:06
*** SerenaFeng has quit IRC18:07
*** thorst has joined #openstack-ansible18:18
*** esberglu has joined #openstack-ansible18:37
*** markvoelker has quit IRC18:39
*** esberglu has quit IRC18:42
cloudnullidlemind: yes, I believe it has to be disabled everywhere.19:00
ejb1123So I got past the last issue, but now it cant get past Install PIP https://pastebin.com/q5mNDK5M19:01
cloudnulllast I recall it adds a basic rule set which will conflict with openstack19:01
cloudnullejb1123: 172.29.236.11 is the lb right?19:01
cloudnullcan you make sure that the vip for the repo servers is up ?19:02
cloudnullon port 818119:02
cloudnulllogan-: https://review.openstack.org/#/c/508509 is now passing19:04
ejb1123haproxy is listing on 8181. I checked with netstat19:04
cloudnullbased on convos in infra it would seem once we have the required projects in place we don't need the zuul cloner shim if we just link to the repos in the workspace.19:04
cloudnullejb1123: but are the backends up19:05
cloudnullhatop -s /var/run/haproxy.sock19:05
cloudnulland look for the repo servers on port 818119:05
cloudnulllogan-: https://review.openstack.org/#/c/508509  now gates.19:05
cloudnullbut idk if its the right way.19:06
cloudnullhowever it would seem we need something?19:06
*** dave-mccowan has joined #openstack-ansible19:06
ejb1123>>> repo_all-back19:10
ejb1123..ntainer-5d1b6b4c            1 DOWN19:10
ejb1123BACKEND                       0 DOWN19:10
ejb1123idk if it is down or not base on the above19:10
ejb1123repo_all-back BACKEND got 356 HTTP 5xx errors19:12
*** dave-mccowan has quit IRC19:16
logan-cool cloudnull19:27
logan-i see you got it to where you don't have to add the remotes back now?19:28
logan-oh i see, you're not updating the refs after linking -- this gets us part way there but we'll probably just end up with HEAD of master shas for every role instead of pinning right?19:31
*** esberglu has joined #openstack-ansible19:32
logan-i think we should not use required-projects19:32
logan-it is pointless, zuul just clones the roles the same as we do19:33
logan-we should just consume the repos that it clones when you do Depends-On and then the rest we can just clone like normal from git.openstack.org19:33
logan-then we can ditch that long spin up time that zuul does in cloning a big required-projects list19:34
*** esberglu has quit IRC19:36
*** markvoelker has joined #openstack-ansible19:36
logan-having a local git cache in the nodepool instances was nice before but the way required-projects works doesnt seem to add anything for us19:38
*** dave-mccowan has joined #openstack-ansible19:49
cloudnulllogan-: +120:02
cloudnullejb1123: if the backend is down check the repo containers and see if nginx is running20:03
cloudnullif its not, start it20:03
cloudnulllogan-:  makes total sense to me, and it looks like the required projects setup time counts against us in the gate time'20:04
cloudnullso its not a lot of benifit20:04
*** dave-mcc_ has joined #openstack-ansible20:07
*** dave-mccowan has quit IRC20:10
*** markvoelker has quit IRC20:10
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible master: Updated repo cloner for zuulv3  https://review.openstack.org/50850920:24
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible master: Updated repo cloner for zuulv3  https://review.openstack.org/50850920:24
cloudnulllogan-: ^ i think that's right?20:24
*** esberglu has joined #openstack-ansible20:26
*** esberglu has quit IRC20:30
*** dave-mcc_ has quit IRC20:32
logan-Afk a bit I’ll look in a few hrs21:15
logan-Thx21:15
*** pbandark has joined #openstack-ansible21:18
*** weezS has joined #openstack-ansible21:59
*** markvoelker has joined #openstack-ansible22:07
captaindaveHey all. My repo_container is running out of space during the 'Execute the venv build scripts asynchonously22:10
captaindave' task. How does one increase the LV allotted to the container?22:10
captaindaveOr, for that matter, is there something else I should be doing?22:11
*** esberglu has joined #openstack-ansible22:14
*** esberglu has quit IRC22:19
*** pbandark has quit IRC22:34
ejb1123cloudnull: how do I connect to the container?22:35
*** jamesdenton has joined #openstack-ansible22:38
*** markvoelker has quit IRC22:40
*** weezS has quit IRC22:45
*** weezS has joined #openstack-ansible22:45
*** weezS has quit IRC22:46
*** esberglu has joined #openstack-ansible23:08
captaindaveejb1123: what do you mean by "connect"? In what way?23:12
*** esberglu has quit IRC23:13
ejb1123should I ssh or connect through lxc. and where would I find the creds to login?23:18
captaindaveyou should ssh to the container's host and use lxc-attach -n <name> where <name> is from the output of lxc-ls.23:20
*** thorst has quit IRC23:25
*** thorst has joined #openstack-ansible23:25
*** thorst has quit IRC23:26
ejb1123well my networking config is messed up! while in the container it can't ping the mgmt ips23:31
*** markvoelker has joined #openstack-ansible23:37
ejb1123The docs suck for networking!23:39
ejb1123I am totaly lost on how the network should be setup.23:40
ejb1123should I use vlans or should I not?23:40
ejb1123can I manually make the bridge interfaces?23:42
ejb1123and if I do what should they bond to!23:42
ejb1123should the bridges get their own ips or should they not.23:42
ejb1123should the the physical interface the bridge connects get a ip address assigned23:42
*** thorst has joined #openstack-ansible23:46
*** vishwan__ has quit IRC23:47
*** vishwanathj has joined #openstack-ansible23:47
*** thorst has quit IRC23:51
captaindaveRead the example interfaces files from the prod and test examples in appendices A and B from the docs.23:52
ejb1123I did. I don't understand the architecture for the setup.23:53
captaindaveI don't think you actually need anything other than the necessary bridges and the IPs required in those examples.23:53
captaindavei.e. bonding and vlans shouldn't be necessary (though I'm a bit uncertain about that insofar as the tunnel bridges are concerned).23:54
captaindaveBridges don't bond.23:56
captaindaveOnly interfaces do.23:56
captaindaveLikewise, bridged interfaces don't have IPs, but their bridges do.23:56
captaindaveOr can, at least.23:56
captaindaveThink of interfaces as L2 and bridges as L3.23:57
captaindaveAt least for your current problem.23:59

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!