Sunday, 2018-02-18

*** niraj_singh has joined #openstack-ansible00:14
*** acormier has joined #openstack-ansible00:25
*** acormier has quit IRC00:30
*** acormier has joined #openstack-ansible01:05
*** acormier has quit IRC01:17
*** jafeha has joined #openstack-ansible01:18
*** acormier has joined #openstack-ansible01:18
*** jafeha__ has quit IRC01:19
*** acormier has quit IRC01:19
*** acormier has joined #openstack-ansible01:20
*** acormier has quit IRC01:25
*** dave-mcc_ has quit IRC01:37
*** dave-mccowan has joined #openstack-ansible02:00
ANKITAhi my understanding is that the connection is terminating before d pkgs are downloded and processed...........https://gist.github.com/ankita-anil-verma/0aa18a6d73de0c05ccb8778a18c0e13d   despite of all my efforts was not able to resolve d issue would appreciate if anyone can spare a moment and guide me on the error comprehension for logs in gist02:29
ANKITAand recommend a feasible solution...02:29
JohnnyOSAankita: can you add the ansible log output showing the error?  Also, can you just destroy and re-create the infra glance container and re-run the os-glance-install playbook after that?02:54
*** bhujay has joined #openstack-ansible03:15
*** woodard_ has quit IRC03:24
*** woodard has joined #openstack-ansible03:25
ANKITAJohnnyOSA Thanks for suggestion, but am unable to locate ansible.log file neither in infra nodes nor in d containers also the cmd03:33
ANKITAroot@infra1:~# lxc delete infra1-glance-container-10e964db Generating a client certificate. This may take a minute... If this is your first time using LXD, you should also run: sudo lxd init To start your first container, try: lxc launch ubuntu:16.04  error: not found03:33
ANKITAthough i can still uselxc-attach03:33
ANKITAn access d container03:34
JohnnyOSAankita: the openstack ansible playbook should be output on the console from the deployment node if you are following the Openstack ansible deployment guide and running plays from the /openstack-ansible/playbook dir on the deployment server.  There is also playbooks in that directory for deleting and re-creating containers03:39
ANKITAok shall use lxcdestroy.yml03:40
ANKITAJonnyOSA is this the o/p u mentioned as ansible log :TASK [os_glance : Glance mount nfs] *************************************************************************************************** Saturday 17 February 2018  03:27:23 -0800 (0:00:00.951)       0:01:19.755 ***** failed: [infra1_glance_container-10e964db] (item={u'local_path': u'/var/lib/glance/images', u'type': u'nfs', u'options': u'_netdev,auto', u'remote_path': u'/03:42
ANKITAfailed": true, "item": {"local_path": "/var/lib/glance/images", "options": "_netdev,auto", "remote_path": "/images", "server": "10.40.244.10", "type": "nfs"}, "msg": "Error mounting /var/lib/glance/images: mount.nfs: Connection timed out\n"}03:43
JohnnyOSAYeah, that's it.  Looks like there is a communication problem with your NFS server.  You could try and see if you can reproduce that by hand to help you figure out what's going on.  Have to step away from the keyboard for awhile...03:47
JohnnyOSA(typo above: /opt/openstack-ansible/playbook dir)03:53
*** dave-mccowan has quit IRC03:55
*** bhujay has quit IRC04:22
*** bhujay has joined #openstack-ansible04:23
*** lbragstad has joined #openstack-ansible04:44
*** dariko has joined #openstack-ansible06:10
*** dariko has quit IRC06:22
*** dariko has joined #openstack-ansible06:22
*** lbragstad has quit IRC06:27
*** masber has joined #openstack-ansible07:06
*** armaan has joined #openstack-ansible07:39
*** jafeha__ has joined #openstack-ansible07:56
*** jafeha has quit IRC07:59
*** Sha000000 has joined #openstack-ansible08:08
*** sxc731 has joined #openstack-ansible08:26
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible master: [Docs] Move upgrade guides into ops  https://review.openstack.org/54566408:46
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible-os_rally stable/newton: Fix for lookup and get_url occuring in different places  https://review.openstack.org/54541109:03
*** madorn has quit IRC09:08
*** masber has quit IRC09:09
*** madorn has joined #openstack-ansible09:10
ANKITAhad a doubt if due to some reason my env fails to download pks 4m repos can there be any other alternatives than changing global overrides?09:13
*** acormier has joined #openstack-ansible09:15
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible stable/ocata: Update all SHAs for 15.1.17  https://review.openstack.org/54566609:18
evrardjpANKITA: I don't understand your question. But I'd say if you have network issue, you should fix it first.09:20
evrardjpJohnnyOSA: is everything alright?09:20
evrardjpomegapoint: which version of OSA are you running? Maybe it didn't get some backport.09:21
*** acormier has quit IRC09:22
evrardjpjmccrory: odyssey4me if one of you is there, I'd love getting feedback on https://review.openstack.org/#/c/545411/09:30
evrardjpthis way I can merge it and already bump the a-r-r before doing the release. The point of doing this is to prevent yet another cycle before EOL.09:30
evrardjp("cycle" means here two week release train stop)09:31
ANKITAevrardjp am neither having the authority nor can i check the physical layout as it's in US and am working at India....but d core issue from my side is that whenever the OSA is supposed to create or replicate any image(lxc base image), pkg (ubuntu upgrades)  or service;etc the network terminates and even if i try to install those services/images/pakgs manually OSA is unaware of the changes and Tasks keep failing at d same p09:33
ANKITAhope am able to cope up by bypassing d tasks or changing some parameters; but am not sure @ it hence need guidance09:34
openstackgerritMerged openstack/openstack-ansible-os_tempest stable/newton: Fix for lookup and get_url occuring in different places  https://review.openstack.org/54542709:46
*** Adri2000 has quit IRC09:55
openstackgerritMerged openstack/openstack-ansible-tests stable/ocata: Only show errors when copying logs  https://review.openstack.org/54532610:09
*** armaan has quit IRC10:10
*** armaan has joined #openstack-ansible10:17
*** armaan has quit IRC10:18
*** armaan has joined #openstack-ansible10:48
odyssey4meevrardjp https://review.openstack.org/545411 is right, thanks for adding the pin which was necessary. The pin won't take effect on the integrated build as it provides overrides for those pins anyway, and rally is built without u-c there.11:02
odyssey4meThat's only necessary for the role test.11:02
odyssey4meANKITA as previously discussed, if there's a comms issue between the container and the nfs server you'll need to figure out what the issue is and resolve it11:12
odyssey4meANKITA if you destroy the container and recreate it, it will get recreated with the same IP and MAC address - if you want it to have a new set, then you need to destroy it, then remove it from your inventory with inventory-manage.py, then recreate it11:13
*** acormier has joined #openstack-ansible11:23
*** acormier has quit IRC11:27
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_swift master: Updated from global requirements  https://review.openstack.org/53847611:35
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_glance stable/queens: Updated from OpenStack Ansible Tests  https://review.openstack.org/54491911:36
*** sxc731 has quit IRC11:47
openstackgerritMerged openstack/openstack-ansible-os_aodh stable/queens: Point to Queens instead of master  https://review.openstack.org/54482911:54
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_aodh stable/queens: Updated from global requirements  https://review.openstack.org/54455611:57
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_aodh stable/queens: Updated from OpenStack Ansible Tests  https://review.openstack.org/54491211:58
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_aodh master: Zuul: Remove project name  https://review.openstack.org/54117211:58
*** ivve has quit IRC12:11
*** ivve has joined #openstack-ansible12:23
ANKITAodyssey4me thanks for the lead....shall do it ....12:29
ANKITAbut is it dynamic_inventory.py or inventory-manage.py?12:32
ANKITAsrry found it in /opt/openstack-ansible/scripts#12:34
*** Adri2000 has joined #openstack-ansible12:45
*** Adri2000 has quit IRC12:45
*** Adri2000 has joined #openstack-ansible12:45
openstackgerritMerged openstack/openstack-ansible-os_aodh stable/queens: Updated from global requirements  https://review.openstack.org/54455612:47
*** masber has joined #openstack-ansible12:47
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_aodh stable/queens: Updated from global requirements  https://review.openstack.org/54511612:50
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_glance master: Updated from OpenStack Ansible Tests  https://review.openstack.org/54464612:54
*** dave-mccowan has joined #openstack-ansible12:58
evrardjpodyssey4me: if you could review it, this way I can merge it13:00
evrardjpand bump the thing before end of day, so we can request a release for newton13:01
evrardjpit's a little unorthodox13:01
odyssey4meevrardjp given +1 seeing as I'm the author13:01
evrardjpyeah. I am not sure who can we get today.13:02
odyssey4meI'd suggest just do it13:02
evrardjpok13:02
evrardjpyup.13:02
*** sxc731 has joined #openstack-ansible13:03
*** jafeha has joined #openstack-ansible13:09
*** jafeha__ has quit IRC13:10
openstackgerritMerged openstack/openstack-ansible-os_rally stable/newton: Fix for lookup and get_url occuring in different places  https://review.openstack.org/54541113:33
openstackgerritMerged openstack/openstack-ansible-os_gnocchi master: Switch to Keystone extra  https://review.openstack.org/54290013:44
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible master: Ensure that constraints are used for AIO boostrap  https://review.openstack.org/54569013:46
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible master: Ensure that constraints are used for AIO bootstrap  https://review.openstack.org/54569013:48
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible stable/newton: Bump shas before next tag  https://review.openstack.org/54569113:51
ivveevrardjp: i submitted that ceilometer/aodh/gnocchi thing we talked about a few days ago #175023613:51
openstackgerritMerged openstack/openstack-ansible-os_aodh master: Zuul: Remove project name  https://review.openstack.org/54117213:55
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_aodh stable/queens: Zuul: Remove project name  https://review.openstack.org/54569313:56
*** acormier has joined #openstack-ansible14:11
*** acormier has quit IRC14:20
*** masber has quit IRC14:28
openstackgerritMerged openstack/openstack-ansible-os_glance master: Updated from OpenStack Ansible Tests  https://review.openstack.org/54464614:30
*** pbandark has joined #openstack-ansible14:39
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-repo_build master: [WIP] Make the git clone and wheel build optional  https://review.openstack.org/53701514:50
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-repo_build master: [WIP] Make the git clone and wheel build optional  https://review.openstack.org/53701515:21
*** woodard has quit IRC15:25
*** woodard has joined #openstack-ansible15:25
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible master: Replace host_need_pip with standard override mechanism  https://review.openstack.org/54569715:29
*** acormier has joined #openstack-ansible15:31
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-openstack_hosts master: Remove host_need_pip  https://review.openstack.org/54569815:32
*** acormier has quit IRC15:36
*** pbandark has quit IRC15:46
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible master: Remove pip_lock_to_internal_repo variable  https://review.openstack.org/54569915:46
*** _jbadiapa has joined #openstack-ansible15:47
*** dariko has quit IRC15:49
*** jbadiapa_ has quit IRC15:50
*** acormier has joined #openstack-ansible15:53
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-pip_install master: Remove pip_lock_to_internal_repo variable  https://review.openstack.org/54570015:53
-openstackstatus- NOTICE: Zuul has been restarted and queues were saved. However, patches uploaded after 14:40UTC may have been missed. Please recheck your patchsets where needed.15:54
*** acormier has quit IRC15:55
*** jbadiapa_ has joined #openstack-ansible16:00
*** _jbadiapa has quit IRC16:03
*** _jbadiapa has joined #openstack-ansible16:10
*** dariko has joined #openstack-ansible16:11
*** jbadiapa_ has quit IRC16:13
*** dariko has quit IRC16:13
*** dariko has joined #openstack-ansible16:13
*** jbadiapa_ has joined #openstack-ansible16:16
*** _jbadiapa has quit IRC16:19
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible master: Use requirements_constraints for pip installs  https://review.openstack.org/53744616:22
evrardjpivve: thank you16:23
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible stable/queens: Add nspawn container driver  https://review.openstack.org/54468516:24
ivveevrardjp: just wondering, those three services should work out of the box without additional parameters during deployment?16:26
ivvemeaning, ceilometer,aodh,gnocchi16:26
evrardjpivve: They got no real support from many deployers. I think mnaser worked on it recently, but except that, it's kinda not well used. So depending on the branch, you might run into issues or not.16:27
ivvei've never used them before but i wanted to do a dive into them when i stumbled across this "problem"16:27
ivvei see16:27
ivvethats too bad16:28
evrardjpwell16:28
evrardjppatches are welcomed.16:28
mnaserI’ve worked on patches fixing the gate but I haven’t got around testing a full deployment16:28
evrardjpIf you see anything that's wrong and not working out of the box, we'll welcome those changes to make it work.16:28
evrardjpmnaser: hello!16:28
odyssey4meivve you were the last one at around newton IIRC who got them into a good working state - after that a few have popped up with new bugs and some have been fixed, but they're not regularly tested/maintained.... mnaser has picked up a bunch of work to get them better, and I'm sure he'd welcome some help16:28
evrardjpreally thank you for the work done16:28
mnaser:) np!16:29
mnaserRight now all gates are passing for telemetry but it’s kinda the bare minimum16:29
mnaserIt would be nice to add the auto scaling scenario to the tests too16:29
odyssey4meit always comes down to those who spend the time actually working with the services - the rest of us can fix obvious stuff, but some fixes require knowledge of how the service should work, what's changed upstream, etc16:29
mnaserFYI reading devstack plugins is a great reference point to fixing things16:30
ivvemnaser: thats what i've been "testing"16:30
mnaserI think you can try adding the auto scaling scenario to the whitelist of tests and see what the gate tells you. If that works, you’re pretty much good16:31
ivveor been trying to test i guess, i wanted to learn the services more indepth but got stuck when client wasn't working towards them16:31
mnaserCause that does test all aspects of both alarming, metering etc16:31
ivveaye16:31
mnaserI’m on mobile but I can propose that patch when I’ll be near a computer16:32
mnaserIf that passes I can confidently tell you that the metering stack works16:33
*** bhujay has quit IRC16:33
mnaserIn puppet OpenStack world we use the autoscaling test to test the entire stack as somewhat of a smoke test, it’s worked great16:33
ivvemnaser: i've been testing pike only atm. in centos & pike16:34
ivveuhm centos & ubuntu16:35
mnaserI think I backported some stuff to fix pike, because master is working prior to queens branch off16:35
*** mislukking has joined #openstack-ansible16:35
mnaserLet me know if you run into any issues, if we can replicate them in gate I can help fix16:35
ivvejust the bug i posted, #175023616:36
ivvebut as i said, it might be a deployment problem.. i've never deploy with any telemetry specific overrides or settings whatsoever16:37
ivveim guessing something is needed?16:37
ivvethe first step was to get autoscaling to work, next one would be cloudkitty which i guess is depending pretty much on telemetry16:38
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-repo_build master: [WIP] Make the git clone and wheel build optional  https://review.openstack.org/53701516:56
*** agrebennikov has joined #openstack-ansible17:10
*** sxc731 has quit IRC17:12
*** agrebennikov has quit IRC17:15
*** _jbadiapa has joined #openstack-ansible17:16
*** jbadiapa_ has quit IRC17:19
*** mislukking has quit IRC17:34
*** acormier has joined #openstack-ansible17:38
*** acormier has quit IRC17:44
*** acormier has joined #openstack-ansible17:45
*** acormier has quit IRC17:52
*** acormier has joined #openstack-ansible17:54
*** armaan has quit IRC17:58
openstackgerritMohammed Naser proposed openstack/openstack-ansible-os_magnum master: Refactor services to magnum_services  https://review.openstack.org/54362817:59
openstackgerritMohammed Naser proposed openstack/openstack-ansible-os_magnum master: Implement uWSGI for Magnum API  https://review.openstack.org/54362917:59
mnaserodyssey4me: squashed the changes in there :)18:00
*** sxc731 has joined #openstack-ansible18:17
*** jafeha__ has joined #openstack-ansible18:25
*** jafeha has quit IRC18:28
*** hamza21 has joined #openstack-ansible18:32
*** acormier has quit IRC18:35
*** acormier has joined #openstack-ansible18:37
*** armaan has joined #openstack-ansible18:40
*** acormier has quit IRC19:34
*** nattanon has joined #openstack-ansible19:41
nattanonHello guys !!! Did some one got gateway timeout( error504 ) when controller node is going down.19:43
nattanonIn case of me, I deployed openstack using OSA with 3 controller and 4 compute also 3 network node then trying to stop 1 controller for testing.19:45
nattanonthe result is control plane very slow.19:46
*** nattanon_ has joined #openstack-ansible19:47
*** lbragstad has joined #openstack-ansible19:50
*** hamza21 has quit IRC20:04
*** hybridpollo has joined #openstack-ansible20:13
JohnnyOSA@evrardjp: doing ok right now thanks.  How an idea on how to solve my bridging issue.  I'll post again if I can't get it working after I test my idea out.20:20
JohnnyOSAI have run into something odd, though.  Each time I deploy OS from scratch using OSA, I have a rabbitmq related cluster status error the first time the setup-infrastructure play is run:20:21
JohnnyOSATASK [rabbitmq_server : Check cluster status] *************************************************************************************** Sunday 18 February 2018  15:16:42 -0500 (0:00:00.250)       1:18:14.044 ******* fatal: [infra2_rabbit_mq_container-efa55da2]: FAILED! => {"changed": false, "cmd": "sleep 30; rabbitmqctl -q cluster_status | grep '{cluster_name,<<\"openstack\">>}'", "delta":20:22
JohnnyOSA"0:00:31.400837", "end": "2018-02-18 15:17:14.620760", "failed": true, "rc": 1, "start": "2018-02-18 15:16:43.219923", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []}20:22
JohnnyOSAWhen I run the same command by hand, it's fine.20:23
JohnnyOSA(I added the "sleep 30;" above to see if it was a race condition that delaying a little could fix).  When I run the play the 2nd time, it works fine.20:23
JohnnyOSAHas anyone else encountered that?20:23
JohnnyOSAThe addition of the sleep statement to the rabbitmq cluster check didn't resolve the initial check fail.20:24
JohnnyOSAIn any case -- nothing that's stopping me from deploying, just seems like a little bug.20:28
JohnnyOSALooks like the check may be in the wrong spot -- it's checking for rabbitmq openstack cluster status before it runs the rabbitmq join cluster command.  Or maybe it's intentionally there to check and make sure it's not part of the cluster yet, but the error logic is inverted from what it should be.20:39
*** sxc731 has quit IRC20:44
openstackgerritMerged openstack/openstack-ansible-lxc_container_create stable/queens: Generate a unique machine-id  https://review.openstack.org/54531620:46
openstackgerritMohammed Naser proposed openstack/openstack-ansible-os_magnum stable/pike: Zuul: Remove project name  https://review.openstack.org/53864221:27
*** acormier has joined #openstack-ansible21:30
*** acormier has quit IRC21:35
*** masber has joined #openstack-ansible21:36
*** lbragstad has quit IRC21:48
*** dariko has quit IRC21:51
*** dariko has joined #openstack-ansible21:52
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-lxc_hosts master: Clear the cached machine-id  https://review.openstack.org/54437622:02
*** Sha000000 has quit IRC22:04
*** jafeha has joined #openstack-ansible22:05
*** jafeha__ has quit IRC22:07
*** taseer1 has joined #openstack-ansible22:08
*** Taseer has quit IRC22:09
*** taseer2 has joined #openstack-ansible22:09
*** masber has quit IRC22:11
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-os_cinder stable/queens: Replace virtualenv-tools by a script  https://review.openstack.org/54572222:13
*** taseer1 has quit IRC22:13
*** threestrands has joined #openstack-ansible22:17
*** threestrands has quit IRC22:17
*** threestrands has joined #openstack-ansible22:17
openstackgerritMerged openstack/openstack-ansible-os_aodh stable/queens: Zuul: Remove project name  https://review.openstack.org/54569322:21
*** acormier has joined #openstack-ansible22:31
openstackgerritMerged openstack/openstack-ansible-os_gnocchi stable/pike: Add librados2-dev to distro package list  https://review.openstack.org/54549922:36
*** Sha000000 has joined #openstack-ansible22:36
*** dariko has quit IRC22:36
*** armaan has quit IRC22:38
*** Sha000000 has quit IRC22:39
*** Sha000000 has joined #openstack-ansible22:39
*** masber has joined #openstack-ansible22:59
*** masuberu has joined #openstack-ansible23:01
openstackgerritMerged openstack/openstack-ansible-os_cinder master: Replace virtualenv-tools by a script  https://review.openstack.org/54410623:04
*** masber has quit IRC23:04
*** masuberu has quit IRC23:13
*** antonym has quit IRC23:18
*** antonym has joined #openstack-ansible23:18
*** antonym has quit IRC23:31
*** antonym has joined #openstack-ansible23:38
*** antonym has joined #openstack-ansible23:38
*** antonym has quit IRC23:44
*** antonym has joined #openstack-ansible23:50
*** antonym has joined #openstack-ansible23:50
*** acormier has quit IRC23:55
*** acormier has joined #openstack-ansible23:55
*** acormier has quit IRC23:56
*** acormier has joined #openstack-ansible23:57

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!