Monday, 2016-10-03

*** galstrom is now known as galstrom_zzz00:03
*** darrenc has quit IRC00:07
*** darrenc has joined #openstack-ansible00:07
*** mcarden has quit IRC00:07
*** mcarden has joined #openstack-ansible00:09
*** rstarmer has quit IRC00:27
*** perniciouscaffei has quit IRC00:39
*** perniciouscaffei has joined #openstack-ansible00:40
*** phschwartz has quit IRC00:47
*** phschwartz has joined #openstack-ansible00:49
*** thorst has joined #openstack-ansible00:55
*** thorst has quit IRC01:04
*** johnmilton has joined #openstack-ansible01:08
*** AnarchyAo has joined #openstack-ansible01:22
*** weezS has joined #openstack-ansible01:42
*** bfg9000 has quit IRC01:49
*** dkehn has quit IRC01:56
*** thorst has joined #openstack-ansible02:03
*** messy has quit IRC02:05
*** dkehn has joined #openstack-ansible02:08
*** thorst has quit IRC02:10
*** johnmilton has quit IRC02:12
*** messy has joined #openstack-ansible02:17
*** sdake has quit IRC02:29
*** johnmilton has joined #openstack-ansible02:34
*** weezS has quit IRC02:50
*** weezS has joined #openstack-ansible02:55
*** weezS has quit IRC02:59
*** thorst has joined #openstack-ansible03:06
*** messy has quit IRC03:14
*** thorst has quit IRC03:14
*** sdake has joined #openstack-ansible03:21
*** messy has joined #openstack-ansible03:23
*** sdake_ has joined #openstack-ansible03:38
*** sdake has quit IRC03:40
*** jamesdenton has quit IRC03:47
*** Mudpuppy has quit IRC03:47
*** thorst has joined #openstack-ansible04:12
*** Mudpuppy has joined #openstack-ansible04:18
*** tek__ has joined #openstack-ansible04:18
*** tek__ has quit IRC04:18
*** tek__ has joined #openstack-ansible04:18
*** thorst has quit IRC04:19
*** chhavi has joined #openstack-ansible04:21
*** Mudpuppy has quit IRC04:23
openstackgerritTuan Luong-Anh proposed openstack/openstack-ansible-ops: Fix typo: remove redundant 'the'  https://review.openstack.org/38092104:46
*** tek__ has quit IRC04:47
*** tek__ has joined #openstack-ansible04:48
*** shausy has joined #openstack-ansible04:49
*** tek__ has quit IRC04:53
*** gouthamr has quit IRC04:56
*** thorst has joined #openstack-ansible05:18
*** thorst has quit IRC05:24
*** janki has joined #openstack-ansible05:36
*** admin0 has joined #openstack-ansible05:40
*** admin0 has quit IRC05:44
*** drifterza has quit IRC05:54
*** tek__ has joined #openstack-ansible06:09
*** jorge_munoz has quit IRC06:15
*** jorge_munoz has joined #openstack-ansible06:17
*** Oku_OS-away is now known as Oku_OS06:20
*** sdake has joined #openstack-ansible06:22
*** thorst has joined #openstack-ansible06:22
*** sdake_ has quit IRC06:23
openstackgerritJimmy McCrory proposed openstack/openstack-ansible-os_magnum: Add basic functional tests to role  https://review.openstack.org/35515506:27
openstackgerritJimmy McCrory proposed openstack/openstack-ansible-os_magnum: Add basic functional tests to role  https://review.openstack.org/35515506:29
*** thorst has quit IRC06:29
*** rgogunskiy has joined #openstack-ansible06:49
*** pcaruana has joined #openstack-ansible06:53
*** tek__ has quit IRC07:04
*** admin0 has joined #openstack-ansible07:04
admin0good morning07:05
Mr_Smurfgood morning07:05
admin0smurf :) league of legends ;) ?07:05
Mr_Smurfnaa, generic blue smurf...07:07
Mr_Smurf:)07:07
admin0:)07:07
admin0i am valdating newton + glance/cinder/nova + ceph + 16.04  => getting issues .. searching for someone else who tried this, or who can help07:10
admin0*validating07:11
*** sdake_ has joined #openstack-ansible07:14
*** sdake_ has quit IRC07:14
*** sdake has quit IRC07:15
*** sdake has joined #openstack-ansible07:26
*** thorst has joined #openstack-ansible07:27
*** drifterza has joined #openstack-ansible07:29
*** thorst has quit IRC07:34
*** fops has joined #openstack-ansible07:51
*** sdake has quit IRC07:58
*** evrardjp has quit IRC08:09
*** evrardjp has joined #openstack-ansible08:09
*** asettle has joined #openstack-ansible08:21
*** jperry has quit IRC08:27
*** thorst has joined #openstack-ansible08:32
odyssey4meadmin0 this is the purpose of the rc - keep digging to see if you find either a config problem, or a code problem08:35
*** thorst has quit IRC08:40
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_nova: Update default git branch to stable/newton  https://review.openstack.org/38020108:41
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_nova: Update default git branch to stable/newton  https://review.openstack.org/38020108:42
*** dalees has joined #openstack-ansible08:45
pjm6good morning guys08:50
drifterzao/08:54
asettleodyssey4me: Kelly had finalised her edits for the install guide. It's pretty hefty. You can see both her reports here (attached to the filed bug: https://bugs.launchpad.net/openstack-ansible/+bug/1628958 and https://bugs.launchpad.net/openstack-ansible/+bug/1629798 )08:57
openstackLaunchpad bug 1628958 in openstack-ansible "[DOCS] Edits to the OSA install guide" [High,Confirmed] - Assigned to Alexandra Settle (alexandra-settle)08:57
openstackLaunchpad bug 1629798 in openstack-ansible "[DOCS] Edits to the OSA install guide appendix" [High,Confirmed] - Assigned to Alexandra Settle (alexandra-settle)08:57
evrardjpgood morning pjm6 drifterza and all the others I forgot08:57
pjm6evrardjp, o/08:58
evrardjpasettle: wehere is the attachment?08:58
odyssey4meFYI to anyone who can help dig into this: https://bugs.launchpad.net/openstack-ansible/+bug/162979908:58
openstackLaunchpad bug 1629799 in openstack-ansible "[Newton RC] cinder-volume sometimes not getting installed" [Undecided,New]08:59
drifterzaevrardjp, could you have a look at my PRs and vote on them please ?08:59
evrardjpasettle: on this I mean https://bugs.launchpad.net/openstack-ansible/+bug/162979808:59
openstackLaunchpad bug 1629798 in openstack-ansible "[DOCS] Edits to the OSA install guide appendix" [High,Confirmed] - Assigned to Alexandra Settle (alexandra-settle)08:59
evrardjpdrifterza: yes sure!08:59
drifterzahttps://review.openstack.org/#/c/374008/, https://review.openstack.org/#/c/375251/08:59
drifterzaThanks dude.08:59
asettleDAMNIT, thanks for pointing it out evrardjp08:59
evrardjpyw09:00
asettlehttps://bugs.launchpad.net/openstack-ansible/+bug/162979809:00
openstackLaunchpad bug 1629798 in openstack-ansible "[DOCS] Edits to the OSA install guide appendix" [High,Confirmed] - Assigned to Alexandra Settle (alexandra-settle)09:00
*** chhavi has quit IRC09:00
*** chhavi has joined #openstack-ansible09:03
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible-os_cinder: Remove duplicate delegate_to  https://review.openstack.org/38099209:07
odyssey4meevrardjp are you looking into https://bugs.launchpad.net/openstack-ansible/+bug/1629799 ?09:08
openstackLaunchpad bug 1629799 in openstack-ansible "[Newton RC] cinder-volume sometimes not getting installed" [Undecided,New]09:08
evrardjpodyssey4me: not yet09:08
evrardjplet's say "a little"09:09
odyssey4meok, I'll keep posting findings in the bug for now09:09
odyssey4meotherwise we can converse in the channel09:09
evrardjpas you should :D09:09
evrardjpthat's true09:09
odyssey4mehow does the service restart find the venv?09:12
evrardjpodyssey4me: I don't like these kind of messages: Task "Ensure Rabbitmq vhost" has been omitted from the job because the conditional "[u"inventory_hostname == groups['cinder_all'][0]"]" was evaluated as "False"09:13
odyssey4meevrardjp I think we could do the rabbit/galera bits with a common set of playbooks in the tests repo09:14
evrardjpwhat do you mean? The full path isn't set?09:14
odyssey4meevrardjp not sure - it was just a thought09:14
odyssey4meandymccr ^ see comment about rabbitmq/galera - not sure if you have a bit of time to make that happen?09:14
evrardjpodyssey4me: even that a little further09:14
evrardjpTask "Create DB for service" has been omitted from the job because the conditional "[u"inventory_hostname == groups['cinder_all'][0]"]" was evaluated as "False"09:15
evrardjpI will check if the inventory sounds all right09:15
odyssey4meevrardjp I'm busy setting up a cinder role test instance.09:15
andymccrthere is a common db/rabbit test playbook already afaik.09:15
evrardjpcould you check if you have cinder_all in your inventory group, and not only cinder ?09:15
evrardjpodyssey4me: ^09:16
evrardjpand making sure the proper containers are in this group :p09:16
odyssey4meevrardjp looks right: https://github.com/openstack/openstack-ansible-os_cinder/blob/master/tests/inventory#L32-L4809:17
andymccri think we need to remove the static: no on service starts for these services - i've noticed nova has some issues with nova-compute and cinder with cinder-volume on localhost09:19
evrardjpinteresting09:19
evrardjpyes that could be a cause09:19
andymccrneutron had a similar problem09:19
andymccryou'll notice the service placement task is just ignored for some reason on localhost09:19
evrardjppfff I have these kind of things09:19
evrardjphate*09:20
andymccrevrardjp: i genuinely think its a bug in ansible i just cant recreate it in a sensible way to file a bug about it09:20
andymccrbut the inclusions are so random09:20
andymccri'll put a PR in for nova and cinder09:20
evrardjpthat's my hating part09:20
odyssey4melemme push up a patch - the dynamic inclusion clearly is very buggy09:20
andymccrodyssey4me: we can probably get away with doing it on service includes only09:20
evrardjpandymccr: odyssey4me one of you commits, not both :p09:20
andymccrif there is a warranted speed benefit09:20
andymccrodyssey4me:  all yours haha :D09:20
odyssey4me'cos for stable/newton, the dynamic inclusion is only forced for tasks which are static (no inventory things)09:21
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_cinder: Remove dynamic inclusion from inventory-based service setup  https://review.openstack.org/38099909:22
odyssey4melet's see how that goes - I'll look at the master patch, jmccrory picked up some sort of new package issue09:22
*** karimb has joined #openstack-ansible09:22
*** gtrxcb has joined #openstack-ansible09:25
evrardjpso on the log, every single thing I see skipped and that shouldn't be skipped IMO (like the db sync!) comes from a task that's included with inventory_hostname == groups['cinder_all'][0]09:26
openstackgerritAndy McCrae proposed openstack/openstack-ansible-os_nova: Remove dynamic inclusion from service setup  https://review.openstack.org/38100309:26
andymccrevrardjp: which log?09:28
andymccrevrardjp: that should only happen because the one host has already failed out and would be cinder-all[0] but since its failed it gets skipped from the include list.09:28
*** electrofelix has joined #openstack-ansible09:28
evrardjphttp://logs.openstack.org/39/380239/4/check/gate-openstack-ansible-os_cinder-ansible-func-ubuntu-trusty/b4e4bf4/console.html#_2016-10-02_04_19_04_62726909:28
*** gtrxcb has quit IRC09:29
evrardjpandymccr: well that would make sense, except I see the task target cinder host09:29
andymccrbut thats ok, db sync should only run once?09:29
evrardjpor then it's the complete strategy which is busted09:29
evrardjplet me dig deeper, I'll wait for your commit anyway09:30
evrardjpwell wait is not a proper wording but you get me09:30
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-tests: Work around bad pycparser wheel  https://review.openstack.org/38100709:31
evrardjpif a host is failed out it should be excluded from the play task, IIRC09:31
andymccrevrardjp: it hadnt failed yet - i thought you meant the db sync was never running09:31
evrardjpyes it never runs, but a lot of things seems to be skipped for no reason09:32
andymccrevrardjp: it is running, just on the cinder host09:32
odyssey4meevrardjp i the logs I have, it always runs09:32
andymccryou dont want it to run on more than one host - the db is central.09:32
odyssey4methe issue is not on the db sync09:32
evrardjpwell maybe I missed it09:33
andymccrits running on the cinder host09:33
andymccrit skips localhost cos its only host [0]09:33
andymccrit may be better to do "run_once: True"09:33
evrardjpI saw it skipped on the cinder host09:33
evrardjplet me verify09:33
andymccrhttp://logs.openstack.org/39/380239/4/check/gate-openstack-ansible-os_cinder-ansible-func-ubuntu-trusty/b4e4bf4/console.html#_2016-10-02_04_18_41_14062109:33
odyssey4meandymccr run_once won't work in a role, I don't think09:34
odyssey4meit works just fine in a playbook, but not in a role09:34
odyssey4me(because the role is executed against only one host without the broader context)09:35
odyssey4mefor master I'll push up a test review to overhaul the whole way this works to get rid of the inventory references entirely - the review will be a show example for a spec09:35
odyssey4mebut yeah, for newton we're stuck with this nonsense09:36
evrardjpoh well I reread the log, and obviously I misread09:36
evrardjpoh you gave me the link09:36
evrardjpthanks anyway :)09:36
*** thorst has joined #openstack-ansible09:37
*** sdake has joined #openstack-ansible09:44
*** thorst has quit IRC09:44
odyssey4meargh: http://logs.openstack.org/99/380999/1/check/gate-openstack-ansible-os_cinder-ansible-func-ubuntu-trusty/618d3d8/console.html#_2016-10-03_09_36_24_42948109:47
odyssey4meevrardjp andymccr we'll need to get this through asap: https://review.openstack.org/38100709:49
evrardjpodyssey4me: done, you've explained it quite good at the first time, I had no questions for you :p09:51
andymccrodyssey4me: will we need a similar PR for nova, since we override that var09:51
odyssey4meandymccr shall I add https://github.com/openstack/openstack-ansible-os_nova/blob/master/tests/nova-overrides.yml#L16-L20 to the tests vars?09:53
odyssey4methen remove from os_nova09:53
evrardjpfor sahara too09:53
odyssey4mewell then remove wherever we have it in the role09:53
evrardjpwell let me check before saying on sahara and tempest09:54
andymccrodyssey4me:  wont that mean libvirt-python is installed even when not needed? we could move that into the nova role itself09:54
andymccrsince it sounds like we may need it09:54
andymccrand that way we dont need to override that var for nova09:54
odyssey4meandymccr I don't think so - we can check whether it was installed for keystone, but should not have been09:55
odyssey4mehmm, pycparser was installed for keystone - but I think that's always the case09:57
odyssey4meto make a different mechanism for os_nova and wherever else we'd have to create a new var09:57
odyssey4memaybe something like nova_pip_no_binary - like https://github.com/openstack/openstack-ansible-repo_build/blob/master/defaults/main.yml#L64 ?09:58
odyssey4methen default it...09:58
evrardjpmmm09:58
andymccrodyssey4me: ok cool i think it works09:58
odyssey4mewill you push up a patch, or shall I ?09:59
odyssey4meanother option we could look into is actually doing a link instead of using the pip package - similar to what we do with ceph?09:59
evrardjpodyssey4me: why adding a new variable into the role, where it's supposed to be working fine because it's well handled by the repo_build. We just have to override for tests09:59
odyssey4meas suggested in https://bugs.launchpad.net/openstack-ansible/+bug/162585910:00
openstackLaunchpad bug 1625859 in openstack-ansible "Mitaka: libvirt-python package not consistently build in repo " [Undecided,New]10:00
odyssey4meandymccr as evrardjp has raised - adding it to the role will mean that even though our repo will have the right package, putting it into the nova role will force it to install from source... that's actually not what we want10:01
odyssey4me(it'll force the nova install process to always build from source, ignoring the repo)10:02
andymccrhmm10:02
andymccrdo we want that?10:02
odyssey4meI'm kinda thinking that maybe doing the link method will be better10:02
odyssey4methe binary and python bits are very clearly tied together10:02
evrardjpI like the linking, but what's the point if we fix the problem already with the repo?10:03
evrardjp(for this case)10:03
odyssey4meevrardjp the point is that the binary installed on compute might not match the binary installed on the repo10:03
evrardjpodyssey4me: if they have to be tied, maybe we should pin10:03
evrardjpthat's what pinned was meant for, right?10:04
odyssey4meevrardjp pinned binary? that never works well10:04
odyssey4mewe tried doing pinned binaries in juno, and it ended badly - ubuntu pulled the pinned package version10:04
evrardjpand with the fact that we have a repo that is now an apt-mirror, can't we use that to our advantage?10:05
*** vnogin has quit IRC10:07
*** karimb has quit IRC10:08
odyssey4meevrardjp it's not an apt mirror - just an apt cache10:08
evrardjpthat's true10:08
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-tests: Ensure libvirt-python always compiles from source  https://review.openstack.org/38102310:10
odyssey4mefor now - I think we should just do ^, then remove the overrides in any roles that have it10:10
odyssey4methis makes the workaround similar to how we do it in the repo build10:11
admin0 odyssey4me correct .. “ERROR cinder.volume.manager VolumeBackendAPIException: Bad or unexpected response from the storage volume backend API: rados and rbd python libraries not found  — anyone tested ceph integratio with newton yet” —this looks like a code issue ? some required packages failed to install ?10:11
odyssey4meadmin0 can you get into the venv and confirm whether the python modules are linked as they should be?10:11
odyssey4meadmin0 once you've verified that, try restarting the volume service and see whether the error is still there10:11
*** karimb has joined #openstack-ansible10:12
odyssey4meadmin0 this is supposed to link the libraruies: https://github.com/openstack/openstack-ansible-ceph_client/blob/master/tasks/ceph_install_python_libs.yml10:12
admin0the links are there10:15
odyssey4meok, that's good - if you restart cinder-volume then does the error persist?10:15
openstackgerritMerged openstack/openstack-ansible-tests: Work around bad pycparser wheel  https://review.openstack.org/38100710:16
admin0will upload cirros again to test10:16
admin0i meant create another volume again10:16
*** rgogunskiy has quit IRC10:17
*** vnogin has joined #openstack-ansible10:17
*** rgogunskiy has joined #openstack-ansible10:18
*** Mudpuppy has joined #openstack-ansible10:20
admin0odyssey4me:   https://gist.githubusercontent.com/a1git/6f24e6ffe1863241fddf98a641d599be/raw/7a8b6f61280c10604473890ff27cc4fb1eadec02/gistfile1.txt  — volumeID:     b84ad51e-f98f-4784-aaa8-ff7a16287b3a10:24
admin0let me gist the configs i used as well10:24
pjm6i just updated the playbooks to the last tag10:24
pjm613.3.4 and now i get an error executing "Run venv process script"10:25
pjm6in repo_build of openstack-infraestructure.yml10:25
*** Mudpuppy has quit IRC10:25
pjm6anyone had this error ?10:25
admin0odyssey4me:  config used: https://gist.github.com/a1git/f55bde9e46f58fb608e6bb87d9c7224c10:27
admin0env.d has a cinder.yml with the is_metal: false  override10:28
pjm6I think that the script /opt/op-venv-script.sh is the error10:30
admin0same goes for glance as well ( i am using glance backend to ceph as well)10:32
evrardjpodyssey4me: did you see the bad news there? https://review.openstack.org/#/c/380999/110:33
andymccrevrardjp: thats the PR he put in for the pycparser bit already i believe!10:38
evrardjpoh ok10:39
evrardjpI'm feeling a little slow today10:39
andymccrhaha evrardjp have yourself a leffe and all will be right again :D10:40
evrardjpthat's killing the diseases indeed10:40
evrardjpbut if I have to chose: https://www.wikiwand.com/en/Tripel_Karmeliet10:41
openstackgerritAndy McCrae proposed openstack/openstack-ansible-tests: Work around bad pycparser wheel  https://review.openstack.org/38103610:41
andymccrbackport ^10:42
*** thorst has joined #openstack-ansible10:42
odyssey4meevrardjp yes, I linked it earlier: http://logs.openstack.org/99/380999/1/check/gate-openstack-ansible-os_cinder-ansible-func-ubuntu-trusty/618d3d8/console.html#_2016-10-03_09_36_24_42948110:46
odyssey4menot sure if they pycparser will help it10:46
ionii have around 130k messages in queue ready, due to failing ceilometer, is there a way to to drop all the messages from rabbitmq?10:46
openstackgerritAndy McCrae proposed openstack/openstack-ansible-tests: Move "--no-binary libvirt-python" to ansible-tests  https://review.openstack.org/38104310:47
odyssey4mehmm, I see the pycparser ref - maybe it does10:48
odyssey4meioni sure, I think you can just delete the queue and it'll recreate if you restart the services10:48
*** openstackgerrit has quit IRC10:48
pjm6guys it seems that using the stable/mitaka repo solves that error (at least seems to skipped that error) :)10:48
evrardjpandymccr: https://review.openstack.org/#/c/381023/110:49
andymccrahh10:49
andymccrhaha10:49
andymccrok i'll remove mine10:49
*** openstackgerrit has joined #openstack-ansible10:49
*** thorst has quit IRC10:49
evrardjpyour message was better.10:50
evrardjpbut whatever!10:50
odyssey4meandymccr ok, adding the no-binary flag is harmless: http://logs.openstack.org/23/381023/1/check/gate-openstack-ansible-tests-ansible-func-ubuntu-trusty/032b4b0/console.html#_2016-10-03_10_21_10_41002110:50
odyssey4meit only instals if it's in the requirements10:50
andymccrodyssey4me: yeah i tested10:51
openstackgerritAndy McCrae proposed openstack/openstack-ansible-os_nova: Move "--no-binary librit-python" to ansible-tests  https://review.openstack.org/38104510:51
andymccrthe nova PR ^10:51
andymccrchanged the commit message to include the correct PR/depends-on tag10:51
evrardjpodyssey4me: cool that's what we 'thought then!10:51
evrardjpmo librit?10:52
odyssey4meandymccr s/librit/libvirt/10:52
evrardjpandymccr: ^10:52
odyssey4meFYI https://bugs.launchpad.net/cinder/+bug/162972610:52
openstackLaunchpad bug 1629726 in OpenStack Compute (nova) "recompiled pycparser 2.14 breaks Cinder db sync and Nova UTs" [Critical,Confirmed]10:52
openstackgerritAndy McCrae proposed openstack/openstack-ansible-os_nova: Move "--no-binary libvirt-python" to ansible-tests  https://review.openstack.org/38104510:52
andymccrlibrit sounds better anyway10:52
evrardjp:D10:53
odyssey4me:p10:53
odyssey4meevrardjp can you up your vote now that the gate's passed? https://review.openstack.org/#/c/381023/10:53
openstackgerritDonovan Francesco proposed openstack/openstack-ansible: Add integrated Trove deployment.  https://review.openstack.org/37400810:53
evrardjpodyssey4me: done10:54
evrardjpI'm still not convinced it's the best we could/should do, but I could see it working somehow10:54
evrardjpthanks drifterza, I'm on my way to test it btw10:54
odyssey4methis is implementing the same sort of changes as done in the integrated build10:55
drifterzacool evrardjp10:55
drifterzaI added the telemetry vhost stuff aswell10:55
odyssey4meandymccr os_sahara and os_tempest need the same patch as os_nova10:56
andymccrodyssey4me: true, will fix10:56
openstackgerritAndy McCrae proposed openstack/openstack-ansible-os_tempest: Move "--no-binary libvirt-python" to ansible-tests  https://review.openstack.org/38104810:58
openstackgerritAndy McCrae proposed openstack/openstack-ansible-os_tempest: Move "--no-binary libvirt-python" to ansible-tests  https://review.openstack.org/38104810:58
pjm6well didn't work after all :\ using the last stable/mitaka I have errors in repo_build10:59
pjm6"Run venv process script"10:59
pjm6the script bash /opt/op-venv-script.sh returns code is 9910:59
andymccrodyssey4me: sahara isnt using central testing yet so i dont think we can move it over.10:59
odyssey4meandymccr hmm, I think there's a review on the go for that - we can just update it11:00
pjm6pastebin.com/MpDNLyMb11:00
andymccrodyssey4me: makes sense.11:00
pjm6anyone have a clue about this?11:00
odyssey4meandymccr in fact, as I recall, that review needs some of your attention11:00
odyssey4mepjm6 looking11:01
pjm6odyssey4me, thanks11:01
odyssey4mepjm6 it looks like the same mycparser error might be hitting us there11:01
odyssey4meodd, because the u-c should be protecting us11:01
openstackgerritAndy McCrae proposed openstack/openstack-ansible-os_ironic: Adjust networking for flat network to work  https://review.openstack.org/38104911:02
pjm6odyssey4me, how do you figure out that was pycparser ?11:02
pjm6:o11:02
odyssey4meoh no - my mistake - the error is at line 107811:03
odyssey4meCould not find a version that satisfies the requirement kombu<3.1,>=3.0.36 (from celery) (from versions: 3.0.34)11:03
odyssey4meit looks like the tag may have gotten caught in the middle of a requirements update set somehow11:03
odyssey4mepjm6 can you register a bug for that please? I'll see if I can track it down tomorrow11:04
pjm6oh true sorry, I miss it :\11:04
pjm6Sure odyssey4me, could you guide me where I can do that?11:04
pjm6in launchpad?11:04
odyssey4mepjm6 yes11:05
odyssey4mehttps://bugs.launchpad.net/openstack-ansible/+filebug11:05
odyssey4mepjm6 put the error I've just quoted into the bug report, I'll try and replicate it tomorrow and figure out where it's coming from11:05
odyssey4methis shouldn't happen11:06
pjm6the error that is in line 1078 right?11:06
odyssey4meyep11:06
pjm6well the description is too long11:07
pjm6maybe could do11:07
pjm6 Could not find a version that satisfies the requirement kombu<3.1,>=3.0.36 ?11:07
odyssey4methe subject can just be Mitaka <tag>: repo build fails to find kombu11:08
odyssey4methen in the description you can put the whole error line11:08
pjm6ah so that line is just the Further information?11:08
odyssey4meand any custom settings you have relating to the repo/packages11:08
odyssey4meyou could gist the whole log file so that's it's a permalink - pastebin clears files so a reference to there will not last11:09
odyssey4meandymccr this is the sahara fixup to use ansible 2.1.1 and the central tests repo: https://review.openstack.org/35361211:10
pjm6odyssey4me, done11:10
pjm6i will try to figure out though which change was made11:10
odyssey4mepjm6 link?11:11
andymccrodyssey4me: yeah im looking at it now - gonna try fix it up!11:11
odyssey4mepjm6 it would have been a SHA bump - the changes made upstream11:11
odyssey4mepjm6 that's why the head of mitaka is working fine, because it's done another SHA bump11:11
pjm6https://bugs.launchpad.net/openstack-ansible/+bug/162984111:11
openstackLaunchpad bug 1629841 in openstack-ansible "Mitaka stable: repo build fails to find kombu " [Undecided,New]11:11
odyssey4meit is weird that it fails the build though... I'll try and replicate it11:11
odyssey4mepjm6 oh hang on - you say it's failing in stable/mitaka?11:12
odyssey4mepjm6 I thought it was failing on a specific tagged version?11:12
pjm6first I tried in a tag11:12
*** sdake_ has joined #openstack-ansible11:12
pjm6after it i tried with the stable/mitaka branch11:12
odyssey4mepjm6 so it failed on both?11:12
pjm6yes11:12
odyssey4meplease add the tag you tried and that you also tried with stable/mitaka11:12
odyssey4meto the bug report I mean11:13
pjm6its possible to edit?11:13
pjm6I already find it11:13
odyssey4meyep11:13
*** sdake has quit IRC11:14
pjm6updated =)11:14
admin0odyssey4me: i can verify that it setup the keyrings correctly and is pointing to the right pool11:14
odyssey4meadmin0 so the volume service, after a restart, is finding the libs?11:15
admin0“….is finding the libs?” — how do I verify this :D11:16
pjm6odyssey4me, if I rollback to a previous version, would have a problem? as I initiated this11:16
odyssey4meadmin0 the volume service started without any errors in the log file11:16
pjm6for example 13.3.0  ?11:17
odyssey4mepjm6 oh, this is your production environment?11:17
pjm6no, just testing11:17
odyssey4mepjm6 try a test build with just one tag back11:17
odyssey4meie 13.3.311:17
pjm6I'm trying to use shared storage (NOVA)11:17
pjm6with OCFS2 idk if anyone tried yet (via iSCSI)11:18
pjm6ok will do that11:18
openstackgerritAndy McCrae proposed openstack/openstack-ansible-os_sahara: Ansible 2.1.1 role testing  https://review.openstack.org/35361211:19
odyssey4meandymccr evrardjp a review of https://review.openstack.org/380759 would be nice to stabilise os_neutron11:19
evrardjpdid we check for tempest and sahara for the pip install options btw?11:20
odyssey4meevrardjp sahara - andymccr's working on it in https://review.openstack.org/35361211:20
andymccrevrardjp: tempest should be done11:20
odyssey4meevrardjp tempest the patch is in: https://review.openstack.org/38104811:20
evrardjpodyssey4me: andymccr's done the review11:21
andymccrsahara needs to move to central test - so im working on that, but also doesnt need libvirt in the testing11:21
andymccrso i think that one is ok11:21
evrardjpok11:21
admin0odyssey4me:  https://gist.githubusercontent.com/a1git/d9740013b66fa775628c27532ccb8da7/raw/3e1d19774318e7818d63b5bfc8315ec120ab0855/gistfile1.txt — looks OK to me but i might not be able to spot issues there11:21
*** fops has quit IRC11:22
odyssey4meadmin0 was that from the cinder-volume container?11:23
admin0yes11:23
odyssey4meadmin0 if so - looks fine to me, which means the libs were found11:23
odyssey4mewere there errors before that?11:23
admin0not that i could see11:23
odyssey4meok, then the issue is not related to finding the libs it seems11:24
odyssey4mewhat was the original issue you saw, and where did you see it?11:24
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_glance: Use dictionary for service group mappings  https://review.openstack.org/37893011:26
*** retreved has joined #openstack-ansible11:32
openstackgerritMerged openstack/openstack-ansible-tests: Ensure libvirt-python always compiles from source  https://review.openstack.org/38102311:32
*** fops has joined #openstack-ansible11:33
*** jrollen has joined #openstack-ansible11:35
openstackgerritDonovan Francesco proposed openstack/openstack-ansible: Adding Trove Horizon dashboard  https://review.openstack.org/37525111:35
odyssey4medrifterza would you be able to divert your attention from trove/monasca for the next week or so to help test and triage issues for the newton release?11:36
odyssey4meit would be very helpful to have more testers and bug triage helpers11:37
drifterzaokay sure11:37
drifterzajust take from launchpad ?11:37
odyssey4mein particular I don't think anyone's been doing any multi node testing with thorough tests after the build, so if you have the lab facilities for that then that would be great11:37
*** johnmilton has quit IRC11:38
*** Mudpuppy has joined #openstack-ansible11:38
odyssey4medrifterza yeah, look out for anything newton specific and help triage using an AIO - and ideally build a multi-node test environment on the side and throw some normal use cases at it to see if things break, then report any bugs you find11:38
drifterzak cool11:38
odyssey4meif you spot a problem, feel free to report without doing triage - triage can come later11:39
odyssey4methe report of the issue brings awareness, and people may get to triage it before you do11:39
openstackgerritMerged openstack/openstack-ansible-tests: Work around bad pycparser wheel  https://review.openstack.org/38103611:39
*** cbits has joined #openstack-ansible11:40
*** gouthamr has joined #openstack-ansible11:41
odyssey4methanks drifterza11:41
odyssey4mealso drifterza if you have ceph builds, then as you've seen with admin0's reports it looks like it needs better testing and there may be issues there11:42
odyssey4meinteresting new occasional test failure in os_neutron: http://logs.openstack.org/59/380759/4/gate/gate-openstack-ansible-os_neutron-ansible-func-ubuntu-trusty/88f62d2/console.html#_2016-10-03_11_42_25_06489511:46
*** thorst has joined #openstack-ansible11:47
*** sdake_ is now known as sdake11:52
openstackgerritAndy McCrae proposed openstack/openstack-ansible-os_sahara: Ansible 2.1.1 role testing  https://review.openstack.org/35361211:55
openstackgerritDonovan Francesco proposed openstack/openstack-ansible: Adding Trove Horizon dashboard  https://review.openstack.org/37525111:56
admin0drifterza: my test setup involves 3 controllers, 3 ceph nodes, 3 compute nodes , 1 log server .. first do it all on KVM based lab and then replicate it to hardware11:56
*** rgogunskiy has quit IRC11:58
mgariepygood morning everyone11:58
odyssey4medrifterza admin0 this may be a very useful tool for testing if you have a server for it: https://github.com/openstack/openstack-ansible-ops/tree/master/multi-node-aio11:58
admin0i have multiple servers that can handle this :)11:59
admin0so if I switch to this, and test it all11:59
admin0hmm..11:59
*** karimb has quit IRC12:00
openstackgerritMerged openstack/openstack-ansible-os_cinder: Remove dynamic inclusion from inventory-based service setup  https://review.openstack.org/38046412:00
*** rgogunskiy has joined #openstack-ansible12:01
*** rgogunskiy has quit IRC12:01
admin0odyssey4me: this does not cover ceph right  ?12:02
*** dragonmaster has joined #openstack-ansible12:02
*** johnmilton has joined #openstack-ansible12:04
*** johnmilton has quit IRC12:04
*** johnmilton has joined #openstack-ansible12:05
admin0how do I restart all *-api* services from deploy server :)12:07
admin0shortcut ?12:07
openstackgerritDonovan Francesco proposed openstack/openstack-ansible: Add integrated Trove deployment.  https://review.openstack.org/37400812:07
drifterzafor loop admin012:08
admin0:D12:08
drifterzadon't know of a ansible way.12:08
drifterza:P12:08
admin0in the log server, where do the logs end up ?12:08
odyssey4meadmin0 you could submit a patch to extend it to cover ceph too12:09
admin0iinside the container in /openstack, i only see myself12:09
admin0odyssey4me: i will do that, for that, i need to get the ceph working first :)12:09
odyssey4meadmin0 for now, perhaps rather work on that while you wait for deployments - but keep testing deployments with your current tooling12:10
admin0i will spin up the multi-node aio in another server12:11
admin0while i do not break this one12:11
drifterzaanyone else getting : Failed to build posix-spawn ?12:11
*** psilvad has joined #openstack-ansible12:11
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_cinder: Remove duplicate delegate_to  https://review.openstack.org/38099212:11
admin0neutron failed when i enabled vpnaas, failed on some openswan stuff .. — so its removed from my variables ..12:11
admin0on the logs server, where do the logs end up in12:12
admin0i want to confirm my findings with someone else before opening up a bug report ( so that its not my setup that might be the issue)12:13
*** v1k0d3n has quit IRC12:14
drifterzacat /etc/rsyslog.conf12:14
drifterzainside the log container12:14
*** hughmFLEXin has joined #openstack-ansible12:14
*** Mudpuppy has quit IRC12:14
admin0"/var/log/log-storage/%hostname%/%programname%.log" == while /var/log/log-storage has no files in it12:15
odyssey4meadmin0 rather do a bug report - the triage process includes a step for someone else to replicate12:15
openstackgerritAndy McCrae proposed openstack/openstack-ansible-os_sahara: Ansible 2.1.1 role testing  https://review.openstack.org/35361212:15
drifterzahmm odd, im getting this on zuul and my local testing:  Running setup.py bdist_wheel for posix-spawn: finished with status 'error'",12:16
admin0then here is what i will do .. i will spin up another machine first ..to run the multi-node aio .. (hopefully i can checkout stable/newton) there instead of master  and run the tests12:16
admin0if it works there, but not on mine, i will have at least 2 systems to confirm my findings12:16
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_cinder: Update tox.ini tests target for stable/newton  https://review.openstack.org/38061412:17
*** jrollen has quit IRC12:18
odyssey4meadmin0 that's fine - but do the bug report with the details of your setup, then if you dig into it and figure out more information you can always add it to the bug report12:18
*** hughmFLEXin has quit IRC12:19
admin0that is also correct .. will do :)12:20
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_cinder: Update ansible-role-requirements to stable/newton  https://review.openstack.org/38023912:21
*** schwicht has quit IRC12:26
odyssey4meandymccr hmm, now that's a problem: http://logs.openstack.org/45/381045/3/gate/gate-openstack-ansible-os_nova-ansible-func_lxd-ubuntu-xenial/a264118/logs/host/nova/nova-compute.log.txt.gz12:27
odyssey4methat's why https://review.openstack.org/381045 & https://review.openstack.org/381048 are failing for tempest/os_nova12:28
andymccrit looks like another race condition :(12:28
odyssey4meand that may be due to https://review.openstack.org/381003 :/12:28
openstackgerritMerged openstack/openstack-ansible: Fix a few grammatical errors  https://review.openstack.org/38080212:29
odyssey4meperhaps do a separate patch which combines both, then if it works just abandon those?12:29
odyssey4meref those in the separate patch12:29
odyssey4meoh hang on - those are targeting different branches12:30
andymccrit is giving the same error12:31
andymccrhmm12:31
mgariepyodyssey4me, can you +w this patch ? https://review.openstack.org/#/c/380776/12:31
odyssey4methis needs to go https://github.com/openstack/openstack-ansible-os_nova/blob/master/tasks/nova_install.yml#L1712:31
odyssey4methanks to https://github.com/openstack/openstack-ansible-os_nova/blob/master/tasks/nova_install_apt.yml#L9612:31
odyssey4memgariepy no, I made it - it needs two other cores to agree that it's a good patch12:33
mgariepyha ok ;)12:33
odyssey4meandymccr could perhaps give it a look over12:33
andymccrlgtm12:33
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_nova: Remove dynamic inclusion from inventory-based service setup  https://review.openstack.org/38100312:36
mhaydenhappy monday12:38
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_nova: Remove dynamic inclusion from inventory-based service setup  https://review.openstack.org/38108812:38
openstackgerritMarc Gariépy proposed openstack/openstack-ansible-os_nova: Add centos support for os_nova  https://review.openstack.org/37896312:39
odyssey4meandymccr https://review.openstack.org/381088 should solve that for master, whil I updated https://review.openstack.org/381003 to include the same for newton12:39
*** fguillot has joined #openstack-ansible12:40
odyssey4memhayden andymccr evrardjp reviews of https://review.openstack.org/380999 would be appreciated12:40
evrardjpk12:40
evrardjpwhat I like with ansible, is its dual theory12:41
evrardjpeither you're fast12:41
evrardjpeither you're reliable12:41
evrardjpit's been like that for ages now12:41
openstackgerritMerged openstack/openstack-ansible-os_neutron: Revert dynamic include for inventory-based conditionals  https://review.openstack.org/38075912:41
*** jrollen has joined #openstack-ansible12:41
*** karimb has joined #openstack-ansible12:44
*** jrollen has quit IRC12:45
*** jrollen has joined #openstack-ansible12:45
*** jroll has quit IRC12:53
*** schwicht has joined #openstack-ansible12:54
odyssey4meandymccr mhayden need this one voted through to get stable/newton on the right path: https://review.openstack.org/38099912:55
*** jrollen is now known as jroll12:55
openstackgerritMerged openstack/openstack-ansible-tests: Provide OS-specific kernel module path  https://review.openstack.org/38077613:04
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_neutron: Add CentOS support for os_neutron  https://review.openstack.org/38049113:06
*** klamath has joined #openstack-ansible13:08
*** klamath has quit IRC13:08
*** klamath has joined #openstack-ansible13:09
openstackgerritMerged openstack/openstack-ansible-ops: Fix typo: remove redundant 'the'  https://review.openstack.org/38092113:09
openstackgerritAndy McCrae proposed openstack/openstack-ansible-tests: Add sahara vars and playbook  https://review.openstack.org/38111613:11
cloudnullmornings13:11
admin0“ERROR cinder.volume.manager FunctionNotSupported: error creating image” — could be be the rbd driver ?13:13
admin0mornings13:13
openstackgerritAndy McCrae proposed openstack/openstack-ansible-os_sahara: Ansible 2.1.1 role testing  https://review.openstack.org/35361213:13
andymccrthat ansible-tests PR should make the 2.1.1 pr for sahara work now.13:14
*** goldenfri has joined #openstack-ansible13:14
cloudnulladmin0: could be ?13:15
cloudnullonce you get away from the reference it's more likely that things will run into that. which could simply be something they don't intend to implement.13:16
admin0cloudnull: this is the config I used https://gist.github.com/a1git/f55bde9e46f58fb608e6bb87d9c7224c   [ubuntu 16.04, stable/newton ] and this is the result I get when creating a cinder volume: https://gist.githubusercontent.com/a1git/6f24e6ffe1863241fddf98a641d599be/raw/7a8b6f61280c10604473890ff27cc4fb1eadec02/gistfile1.txt  — volumeID:    b84ad51e-f98f-4784-aaa8-ff7a16287b3a13:16
cloudnullwhat version is the deployment?13:16
admin0i did a checkout of stable/newton13:17
admin0to test13:17
*** jperry has joined #openstack-ansible13:17
cloudnullis that glance backed by ceph as well?13:18
admin0yes13:18
admin0i already checked the keyrings .. all check out fine13:18
*** jperry has quit IRC13:18
cloudnullwe're you uploading a new image or creating a snap of an existing one?13:19
admin0brand new install13:19
openstackgerritMerged openstack/openstack-ansible-os_cinder: Remove dynamic inclusion from inventory-based service setup  https://review.openstack.org/38099913:19
admin0trying to create a new image ; trying to create a new volume13:19
cloudnullmaybe its the client versions of ceph causing it to not talk to the backend?13:20
cloudnullsomething like a mismatch as described here: https://bugs.launchpad.net/charms/+source/cinder/+bug/158157213:21
openstackLaunchpad bug 1581572 in cinder (Juju Charms Collection) "Upgrade L->M: FunctionNotSupported on volume-create" [Undecided,Won't fix]13:21
admin0ceph servers  are still trusty ..  everything else mitaka ..  ceph-deploy fails on xenial due to systemd acting up13:21
admin0everything else xenial*13:21
cloudnullmattt: andymccr: odyssey4me: you guys have any insight into this ?13:22
* cloudnull is no ceph expert13:22
admin0hmm.. but ceph can also be on centos right ?13:22
odyssey4meadmin0 the ceph cluster can be on anything - assuming that ceph-auth can fetch keys between platforms13:23
cloudnullit can13:23
admin0it is fetching it .. i verified that the keys are there13:23
odyssey4meIIRC the fetch involves an ssh connection, so maybe you need keys on the cluster?13:23
odyssey4meok - that should be good then13:23
odyssey4meotherwise it's been too long - cloudnull it'd be great if we could path the multi-node test to be able to do ceph so we can test it out properly13:24
automagicallyMorning all13:24
matttwhat is /build/ceph-XmVvyr/ceph-10.2.2/src/build/rbd.c ?13:25
admin0i do ceph auth list on the ceph server and note down say  cinder or glance .. then login to their respective containers and say check the  /etc/ceph/ceph.client.cinder.keyring  and the key is there .. same for glance13:25
admin0mattt:  was that a question to me — coz i am not sure13:26
matttadmin0: well yes, it's your ceph cluster no?  :)13:26
admin0mattt:  https://www.openstackfaq.com/ceph-setup-ubuntu-three-node/ — that are all the command entered to build it up13:27
admin0just standard ceph-deploy few lines13:27
admin0that /build/ stuff is from the cinder_volume_container13:29
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible: Fix a few grammatical errors  https://review.openstack.org/38112213:29
admin0is_metal is false, so that container is running in one of the container nodes13:30
admin0controller*13:30
cloudnullodyssey4me: ++ I know that infra has been working on making multi-node tests in the gate work better.13:30
cloudnullso maybe in this cycle we can codify that13:30
odyssey4mecloudnull it's not useful to us unless we can get 5 nodes or more - just two nodes adds no value to our deployment13:31
cloudnullit may make the deployment faster by taking load down on the single host?13:32
cloudnullmornings automagically13:32
*** schwicht has quit IRC13:33
odyssey4meinteresting that there are no nova logs here: http://logs.openstack.org/03/381003/2/check/gate-openstack-ansible-os_nova-ansible-func-ubuntu-xenial/2197dc7/logs/host/13:34
odyssey4meeven though nova-compute clearly was installed and restarted: http://logs.openstack.org/03/381003/2/check/gate-openstack-ansible-os_nova-ansible-func-ubuntu-xenial/2197dc7/console.html#_2016-10-03_13_10_38_44689913:34
*** janki has quit IRC13:36
odyssey4megoing afk for the afternoon - be back tomorrow13:36
automagicallycloudnull: Been looking at how we do the repo build as I’m wondering if it would be possible to run a mitaka build with all of the telemetry components using the newton versions.13:38
automagicallyThoughts on that?13:38
openstackgerritMarc Gariépy proposed openstack/openstack-ansible-os_nova: Add CentOS support for os_nova  https://review.openstack.org/37896313:38
admin0thoughts on what I can do now ?how to test further ?13:39
*** jperry has joined #openstack-ansible13:43
*** bjolo has joined #openstack-ansible13:46
*** schwicht has joined #openstack-ansible13:46
*** fops has quit IRC13:51
*** fops has joined #openstack-ansible13:52
openstackgerritTravis Truman (automagically) proposed openstack/openstack-ansible-os_ceilometer: Cleanup test-vars handling  https://review.openstack.org/38113313:53
*** evilt0ne has joined #openstack-ansible13:59
*** evilt0ne has quit IRC13:59
*** evilt0ne has joined #openstack-ansible13:59
cloudnullautomagically: sorry was cafinating14:00
automagicallynp14:00
cloudnullautomagically: I think it should be possible14:00
automagicallySeems like our requirements templating would have to change pretty dramatically, no?14:00
cloudnullthey should be compatible.14:01
cloudnullI'm assuming you want to use the repo-build role from newton and build the a mitaka env.14:02
* cloudnull may not be properly cafinated at this point though14:02
automagicallycloudnull: Let me think through it a bit more. The primary issue would seem to be that we now define a single upper-constraints file for all wheel builds, but in this scenario, we’d effectively need multiple upper-constraints14:03
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-ops: Updated from global requirements  https://review.openstack.org/38113914:03
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-tests: Updated from global requirements  https://review.openstack.org/38114014:04
cloudnulldoesn't the constraint file come from openstack requirements ?14:05
cloudnulloh, are we talking about using newton ceilo w/ a mitaka deploy?14:06
* cloudnull may not be fully awake yet...14:07
*** Mudpuppy has joined #openstack-ansible14:07
openstackgerritMerged openstack/openstack-ansible-os_tempest: Move "--no-binary libvirt-python" to ansible-tests  https://review.openstack.org/38104814:07
*** shausy has quit IRC14:10
automagicallycloudnull: Yep, newton ceilo, aodh and gnocchi with a mitaka deploy14:11
*** jmckind has joined #openstack-ansible14:12
*** michaelgugino has joined #openstack-ansible14:14
cloudnullso it "should" go. but its likely to change some of the deps used by other services within a release so yes, the multi-constraint things will likely be needed.14:14
openstackgerritMajor Hayden proposed openstack/openstack-ansible-security: Update tox.ini tests target for stable/newton  https://review.openstack.org/38063514:17
*** spotz_zzz is now known as spotz14:17
*** woodard has joined #openstack-ansible14:18
automagicallycloudnull: Thanks for letting me bounce that off of you. I’ll play around with it a bit and see where I get14:18
*** galstrom_zzz is now known as galstrom14:19
cloudnullIn pondering that, I think it may be best to build it in an isolated env only selecting to build ceilo (and its components) then sync the results to your main set of repo servers.14:20
cloudnullsimilar to how we do the multi-arch stuff14:20
openstackgerritMarc Gariépy proposed openstack/openstack-ansible-tests: Fix CentOS package installation  https://review.openstack.org/38115914:23
*** chris_hultin|AWA is now known as chris_hultin14:24
automagicallyOne last question for you cloudnull - any idea WTH is going on here: http://logs.openstack.org/33/381133/1/check/gate-openstack-ansible-os_ceilometer-ansible-func_gnocchi-ubuntu-xenial-nv/23dc617/console.html#_2016-10-03_13_54_54_41011314:27
* cloudnull looking14:27
*** michaelgugino has quit IRC14:28
* kysse_ :C14:29
*** kysse_ is now known as kysse14:29
*** michaelgugino has joined #openstack-ansible14:30
vnoginguys, does anyone know in which playbook we execute dynamic_inventory.py script? :)14:33
*** DanyC has joined #openstack-ansible14:33
automagicallyvnogin: Ansible itself executes it to generate the inventory14:33
cloudnullautomagically: i have no idea.14:34
automagicallyAppreciate you looking, maybe I’ll bug infra14:34
cloudnullit looks like something within pip.14:34
*** woodard has quit IRC14:34
cloudnullbut i have no clue14:34
vnoginautomagically, tnx14:35
admin0any suggestions for me :D ?14:35
admin0i am kinda stuck14:35
admin0i redeployed twice, no help .. no errors14:35
ikalnytskyiautomagically: vnogin which mechanism is lied under that execution? according to ansible docs, the script should be passed via -i option. i didn't find any passing. :(14:35
admin0maybe the drives linked are different14:35
cloudnullautomagically: rather tox invoking pip via python subprocess (based on the stacktrace above)14:36
automagicallyikalnytskyi: https://github.com/openstack/openstack-ansible/blob/master/scripts/openstack-ansible.rc14:36
cloudnulladmin0: I personally am at a loss with ceph. i did notice in your paste with the logs that you were running 14.0.0 which is newton RC. maybe its something within the RC that's not working (either from openstack-ansible, or from upstream cinder) ?14:38
admin0yeah, wantted to help verify ceph stuff before we mark it as stable14:39
michaelguginois there a bug filed?14:40
michaelguginoI've been working with ceph playbook heavily last couple of weeks14:40
admin0does it work for you ?14:40
ikalnytskyiautomagically: so it's env variable, thank you! did you know anything about stable/mitaka branch? there's no such file there14:41
vnoginautomagically, ikalnytskyi it's correct for newton, and what about mitaka?14:41
michaelguginodoes what work?  ceph_client role?  Yes14:41
*** chhavi has quit IRC14:41
*** TxGirlGeek has joined #openstack-ansible14:42
admin0michaelgugino: , this is what i used to setup ceph:  https://www.openstackfaq.com/ceph-setup-ubuntu-three-node/   , config I used: https://gist.github.com/a1git/f55bde9e46f58fb608e6bb87d9c7224c    and the errors I get: https://gist.githubusercontent.com/a1git/6f24e6ffe1863241fddf98a641d599be/raw/7a8b6f61280c10604473890ff27cc4fb1eadec02/gistfile1.txt14:43
openstackgerritMajor Hayden proposed openstack/openstack-ansible-security: Update tox.ini tests target for stable/newton  https://review.openstack.org/38063514:44
michaelguginolet me see...14:44
admin0if you can PM me your ssh key,  you can have access to there as well :)14:44
*** psilvad has quit IRC14:45
*** Guest95 has joined #openstack-ansible14:45
*** psilvad has joined #openstack-ansible14:46
ikalnytskyivnogin: automagically it seems i got it - previously there were an ansible.cfg https://github.com/openstack/openstack-ansible/blob/stable/mitaka/playbooks/ansible.cfg thx for help.14:49
automagicallyYep, that’s it ikalnytskyi14:49
admin0michaelgugino:  https://gist.github.com/a1git/50707330835c430c2fff11b5209e9968 — latest I tried .. logs14:50
openstackgerritMarc Gariépy proposed openstack/openstack-ansible-os_neutron: Add CentOS support for os_neutron  https://review.openstack.org/38049114:52
michaelguginohttps://bugs.launchpad.net/charms/+source/cinder/+bug/158157214:52
openstackLaunchpad bug 1581572 in cinder (Juju Charms Collection) "Upgrade L->M: FunctionNotSupported on volume-create" [Undecided,Won't fix]14:52
michaelguginopossibly a mismatch between ceph client version and ceph backend14:53
mgariepycan someone review this please ? https://review.openstack.org/#/c/381159/14:53
michaelguginoadmin0: ^14:53
automagicallymgariepy: Looking14:54
*** DanyC has quit IRC14:55
admin0michaelgugino this means people need to upgrade ceph before upgrading to newton .. .. shouldn’t ansible check the verison and install appropriate libraries ?14:55
michaelguginoI'm not sure.  What version of ceph do you have deployed?14:56
*** phalmos has joined #openstack-ansible14:57
admin0default that comes with ubuntu 14.04 ( 16.04 failed due to some systemd issue)14:57
admin0hecking14:57
admin0checking!14:57
admin0ceph version 0.80.1114:57
*** vishwanathj has joined #openstack-ansible14:58
michaelguginoadmin0: that's a really old version of ceph.  I believe ceph is usually installed directly from upstream repos.  I suggest looking into ceph-ansible, that's what we use14:59
*** galstrom is now known as galstrom_zzz15:01
*** kstev has joined #openstack-ansible15:03
admin0i will re-setup the ceph with the latest to check out other featuers .. but thats a big assumption to base the client version on .. my thought was it will ssh, determine the correct version and install the appropriate versions15:03
admin0due to n-1 or release-1 or other *company* requirements, people also use the default that comes in the OS itself15:04
*** fguillot has quit IRC15:04
matttadmin0: you can use distro15:10
openstackgerritNolan Brubaker proposed openstack/openstack-ansible: Return append status, use it for accurate logging  https://review.openstack.org/38064015:10
matttadmin0: https://github.com/openstack/openstack-ansible-ceph_client/blob/master/defaults/main.yml#L32-L4515:10
matttperhaps you need to adjust your config15:10
admin0trigger happy me :) ceph servers are already rebuilding :D15:11
admin0but will try that first :)15:11
*** kylek3h has joined #openstack-ansible15:12
*** Fenuks has joined #openstack-ansible15:13
admin0mattt: my controllers and compute is in ubuntu 16.04  .. my ceph is in 14.04  (but can easily be centos as well)15:13
admin0in these situations, how does this variable work ?15:13
FenuksHello. Can anyone help? Getting error "Could not find a version that satisfies the requirement ndg-httpsclient (from versions: )15:13
admin0if I set it to distro, is it the distro of the ceph mons or distro of the controllers ?15:13
Fenuks" when trying to run setup-hosts playbook15:14
FenuksOSA version 13.3.415:15
admin0because in large deployments ( like 2-3 avaibality zones) you want to do rolling upgrades15:15
admin0this would mean upgrade everything at once  .. ceph + controlles or ceph + controllers + compute — so some confusion on the version part15:16
*** pcaruana has quit IRC15:18
admin0ceph_pkg_source: ceph = same as ceph-ansible i believe .. which is why it works everytime !15:18
matttadmin0: those configs control which client packages are installed on your openstack-nodes, so your cinder-volume, glance-api, nova-compute, etc.15:18
admin0ok15:19
openstackgerritMerged openstack/openstack-ansible: Fix a few grammatical errors  https://review.openstack.org/38112215:22
admin0going-home time .. will use the ceph-ansible way and give it a try :)15:23
admin0thanks for the pointers :)15:24
*** admin0 has quit IRC15:25
*** admin0 has joined #openstack-ansible15:25
*** admin0 has quit IRC15:25
michaelguginoodyssey4me: your fix didn't work for my cinder patch15:28
FenuksAnyone? pip search finds the package, there's a page on pypi, it just refuses to download and install it15:28
michaelguginoFenuks, what step are you on?  What play is failing?15:29
michaelguginoare you behind a web proxy?15:29
openstackgerritMerged openstack/openstack-ansible-tests: Updated from global requirements  https://review.openstack.org/38114015:30
Fenuksmichaelgugino: No proxy. Playb is lxc-hosts-setup.yml from setup-hosts.yml15:30
openstackgerritMerged openstack/openstack-ansible-tests: Fix CentOS package installation  https://review.openstack.org/38115915:31
FenuksError is "failed: [nir] => {"attempts": 5, "cmd": "/usr/local/bin/pip install -U ndg-httpsclient requests", "failed": true}". Package requiests is installed and up to date.15:32
*** cathrichardson has joined #openstack-ansible15:32
openstackgerritMajor Hayden proposed openstack/openstack-ansible-security: [TEST] Shaking out gate issues  https://review.openstack.org/38062115:32
automagicallyodyssey4me and andymccr - Thoughts on how best to resolve this issue: https://bugs.launchpad.net/openstack-ansible/+bug/1628952/comments/315:34
openstackLaunchpad bug 1628952 in openstack-ansible "os_ceilometer role missing functional gate testing of gnocchi storage option" [Undecided,Fix released] - Assigned to Travis Truman (travis-truman)15:34
automagicallySee https://bugs.launchpad.net/openstack-ansible/+bug/1628952/comments/4 for my amateur attempt at a solution that was show down by infra15:34
*** AnarchyAo has quit IRC15:35
michaelguginoFenuks: I'm really not sure.  Sometimes there are problems if you install pip with apt-get install python-pip.  There have been some changes with the openstack requirements constraints files recently.  You'll have to do some debugging on your machine locally to figure out why pip is failing.15:35
Fenuksmichaelgugino: It looks for package in repo-container, but I'm not sure where repo-containter looks for them and how it's populated…15:37
michaelguginoautomagically: what is the test name just too long?15:37
michaelguginoFenuks: if you're just running setup-hosts, I don't think the repo container is built yet15:37
automagicallymichaelgugino: Looks like tox pukes somehow because of the length of the directory name. Length of the directory name is directly influenced by the jenkins job name15:37
Fenuksmichaelgugino: I'm upgrading. For some reason, perhaps becouse swift is installed baremetal, node is trying to use repo container15:38
andymccrautomagically: could change the name to "gnocchi"15:39
andymccrother than that i cant think of a better way - similarly in swift we named the tests like "multi_reg" instead of func_multi_reg because of the length.15:39
openstackgerritTravis Truman (automagically) proposed openstack/openstack-ansible-os_ceilometer: Cleanup test-vars handling  https://review.openstack.org/38113315:39
automagicallyandymccr: Fair point, will give that a swing15:39
palendaeandymccr, Did you get the ring script testing started that you had asked about at midcycle?15:42
andymccrpalendae: no :( its on my todo list - i had a skeleton patch in, with the (good) intention of working that, but I'm trying to get virtualbmc to work for ironic now as a greater prio15:43
evrardjpI'm off for today15:43
*** mfisch` is now known as mfisch15:43
palendaeandymccr, np, I may take a look between this inventory bug cause it's hurting my head15:43
andymccrpalendae: that would be awesome.15:43
*** mfisch is now known as Guest722315:43
openstackgerritMajor Hayden proposed openstack/openstack-ansible-security: [TEST] Shaking out gate issues  https://review.openstack.org/38062115:43
* palendae goes to find the patch in gerrit15:45
openstackgerritTravis Truman (automagically) proposed openstack/openstack-ansible-os_ceilometer: Shorten the gnocchi scenario name  https://review.openstack.org/38120015:46
drifterzaanyone else getting this error: Running setup.py bdist_wheel for posix-spawn: finished with status 'error'"15:48
*** galstrom_zzz is now known as galstrom15:48
drifterzaI get it on zuul and my local aio15:48
openstackgerritDonovan Francesco proposed openstack/openstack-ansible: Add integrated Trove deployment.  https://review.openstack.org/37400815:48
*** Guest7223 is now known as mfisch15:49
*** mfisch has quit IRC15:49
*** mfisch has joined #openstack-ansible15:49
mgariepyodyssey4me, is rebase necesary when depending on another patch ?15:51
*** bgmccollum has joined #openstack-ansible15:53
openstackgerritMajor Hayden proposed openstack/openstack-ansible-security: [TEST] Shaking out gate issues  https://review.openstack.org/38062115:55
*** chhavi has joined #openstack-ansible15:56
mhaydenwow, something is causing chrony to stop in the gate15:57
palendaeandymccr, Was your skeleton patch on gerrit? Not seeing it https://review.openstack.org/#/q/owner:%22Andy+McCrae+%253Candy.mccrae%2540googlemail.com%253E%2215:58
andymccrpalendae: lemme look15:58
andymccrahh i got a lot less far than i thought... https://review.openstack.org/#/c/353075/ i basically got it to clone out the script so i could test it locally as part of a run. sorry, i thought i had already done some of the test startup15:59
palendaenp16:00
palendaeOut for lunch16:00
*** fguillot has joined #openstack-ansible16:00
openstackgerritMajor Hayden proposed openstack/openstack-ansible-security: [TEST] Shaking out gate issues  https://review.openstack.org/38062116:03
*** dragonmaster has quit IRC16:03
*** asettle__ has joined #openstack-ansible16:10
openstackgerritDeepak proposed openstack/openstack-ansible-tests: Renamed test-vars.yml to rolename-overrides.yml in README.rst  https://review.openstack.org/38121216:10
openstackgerritDonovan Francesco proposed openstack/openstack-ansible: Adding Trove Horizon dashboard  https://review.openstack.org/37525116:11
*** asettle has quit IRC16:14
*** asettle__ has quit IRC16:15
automagicallyandymccr: Can I get your reviews on https://review.openstack.org/#/c/381185/ and https://review.openstack.org/#/c/381200/ please16:17
mhaydenis it possible to see the /var/log/syslog in a gate job? i keep getting Permission Denied, even with sudo16:20
cloudnullso this is happening in ansible 2.2 http://docs.ansible.com/ansible/include_role_module.html16:20
cloudnullwhich may feed well into some great improvements.16:21
mhaydenoh that's fancy16:21
*** hughmFLEXin has joined #openstack-ansible16:23
openstackgerritMajor Hayden proposed openstack/openstack-ansible-security: [TEST] Shaking out gate issues  https://review.openstack.org/38062116:24
cloudnullwhere are we with newton16:29
cloudnulldo we have anything that needs to be specifically hammered on16:29
cloudnull?16:29
*** sdake has quit IRC16:30
*** hughmFLEXin has quit IRC16:31
openstackgerritMerged openstack/openstack-ansible-tests: Add sahara vars and playbook  https://review.openstack.org/38111616:31
*** hughmFLEXin has joined #openstack-ansible16:32
*** karimb has quit IRC16:33
*** sdake has joined #openstack-ansible16:34
*** drifterza has quit IRC16:35
cloudnullandymccr odyssey4me -- bump16:36
openstackgerritMajor Hayden proposed openstack/openstack-ansible-security: Skip V-38620 (chrony) in gate  https://review.openstack.org/38123616:36
openstackgerritMajor Hayden proposed openstack/openstack-ansible-security: Initial scaffolding for RHEL 7 STIG  https://review.openstack.org/38050916:37
cloudnullwoot!16:37
cloudnullmoar STIG16:38
mhaydenyarly16:38
mhaydenntpd is running in the gate jobs and chrony can't bind :|16:38
mhaydenalas, it must be skippered16:38
*** DanyC has joined #openstack-ansible16:44
*** admin0 has joined #openstack-ansible16:44
openstackgerritTravis Truman (automagically) proposed openstack/openstack-ansible-os_heat: add os_heat role functional tests for gate  https://review.openstack.org/37802416:47
*** deepak_jon has joined #openstack-ansible16:47
*** DanyC has quit IRC16:48
openstackgerritMerged openstack/openstack-ansible-plugins: Adding Magnum plugin  https://review.openstack.org/37802916:54
*** chhavi has quit IRC16:54
mhaydencloudnull: could you give me a look on that ntpd shenanigans? https://review.openstack.org/38123616:55
cloudnullmhayden: sure thing16:58
mhaydencloudnull: thanks mucho16:58
openstackgerritMerged openstack/openstack-ansible-security: Skip V-38620 (chrony) in gate  https://review.openstack.org/38123617:06
openstackgerritMajor Hayden proposed openstack/openstack-ansible-security: Skip V-38620 (chrony) in gate  https://review.openstack.org/38125117:09
admin0in our setup, what is the monitor_interface ? is it br-storage ?17:12
*** AnarchyAo has joined #openstack-ansible17:12
openstackgerritDeepak proposed openstack/openstack-ansible-tests: Renamed test-vars.yml to rolename-overrides.yml in README.rst  https://review.openstack.org/38121217:13
openstackgerritMajor Hayden proposed openstack/openstack-ansible-security: Skip V-38620 (chrony) in gate  https://review.openstack.org/38125417:30
openstackgerritMajor Hayden proposed openstack/openstack-ansible-security: Skip V-38620 (chrony) in gate  https://review.openstack.org/38125517:30
*** hughmFLEXin has quit IRC17:37
openstackgerritMajor Hayden proposed openstack/openstack-ansible-security: Update tox.ini tests target for stable/newton  https://review.openstack.org/38063517:37
*** hughmFLEXin has joined #openstack-ansible17:37
*** sdake has quit IRC17:39
openstackgerritDeepak proposed openstack/openstack-ansible-os_ceilometer: Update test-vars.yml for repositories  https://review.openstack.org/38125717:39
*** electrofelix has quit IRC17:40
*** sdake has joined #openstack-ansible17:44
*** adrian_otto has joined #openstack-ansible17:49
*** sdake has quit IRC18:01
*** poopcat has joined #openstack-ansible18:01
*** drifterza has joined #openstack-ansible18:01
*** poopcat has quit IRC18:10
*** poopcat has joined #openstack-ansible18:10
openstackgerritDeepak proposed openstack/openstack-ansible-os_cinder: Update test-vars.yml for repositories  https://review.openstack.org/38126718:10
openstackgerritMichael Gugino proposed openstack/openstack-ansible-os_cinder: Implement support for cinder qos specs  https://review.openstack.org/37513118:11
*** asettle has joined #openstack-ansible18:11
*** Fenuks has quit IRC18:17
*** hughmFLEXin has quit IRC18:17
*** jorge_munoz_ has joined #openstack-ansible18:17
*** jorge_munoz has quit IRC18:18
*** jorge_munoz_ is now known as jorge_munoz18:18
*** hughmFLEXin has joined #openstack-ansible18:19
*** mkrish004 has joined #openstack-ansible18:19
*** woodard has joined #openstack-ansible18:19
*** weezS has joined #openstack-ansible18:20
openstackgerritJimmy McCrory proposed openstack/openstack-ansible-os_magnum: Add basic functional tests to role  https://review.openstack.org/35515518:24
openstackgerritMerged openstack/openstack-ansible-tests: Renamed test-vars.yml to rolename-overrides.yml in README.rst  https://review.openstack.org/38121218:28
*** pcaruana has joined #openstack-ansible18:29
openstackgerritTravis Truman (automagically) proposed openstack/openstack-ansible-os_cinder: Remove duplicate delegate_to  https://review.openstack.org/38126918:30
*** woodard has quit IRC18:32
*** fops has quit IRC18:32
*** hughmFLEXin has quit IRC18:35
*** hughmFLEXin has joined #openstack-ansible18:36
andymccrhttps://review.openstack.org/#/c/353612/ - sahara 2.1.1 ready to go!18:36
mattti need to catch up on all these testing changes :(18:45
andymccrmattt: that one is a bit of a 2 parter, since its moving to ansible 2.1.1 as well as central testing repo18:46
*** admin0 has quit IRC18:47
andymccrbut we have a readme in the openstack-ansible-tests repo that might help, if not let me know and we'll try improverate it.18:47
matttandymccr: reading now18:47
openstackgerritMerged openstack/openstack-ansible-os_ceilometer: Cleanup test-vars handling  https://review.openstack.org/38113318:49
*** drifterza has quit IRC18:50
cloudnullandymccr: well done18:52
*** asettle has quit IRC19:03
*** Guest95 has quit IRC19:04
*** cbits has quit IRC19:06
*** hughmFLEXin has quit IRC19:07
*** hughmFLEXin has joined #openstack-ansible19:07
automagicallycloudnull or mhayden - Could I get a quick review on https://review.openstack.org/#/c/381200/19:09
*** phalmos has quit IRC19:10
*** AnarchyAo has quit IRC19:10
*** alij has joined #openstack-ansible19:10
*** TxGirlGeek has quit IRC19:10
alijHi, can anyone tell me what can be the reason that at times, suddenly, ansible is unable to SSH into some containers?19:11
openstackgerritMarc Gariépy proposed openstack/openstack-ansible-galera_server: Cleanup duplicate key warning.  https://review.openstack.org/38127319:11
openstackgerritMerged openstack/openstack-ansible-os_sahara: Ansible 2.1.1 role testing  https://review.openstack.org/35361219:11
*** asettle has joined #openstack-ansible19:12
alijEven though the cluster was brought up successfully and working fine for a couple of weeks.19:12
*** hughmFLEXin has quit IRC19:13
mhaydenautomagically: gandering19:14
mhaydenautomagically: aww, cloudnull sniped19:15
automagicallymhayden: cloudnull pushed it across the finish line19:15
*** hughmFLEXin has joined #openstack-ansible19:15
mhaydenalij: are you able to manually ssh to those containers from your deployment host?19:15
alijmhayden, what user name is used to ssh manually?19:18
alijcurrently repo container is not being SSH'd by ansible19:19
alijfatal: [infra1_repo_container-d2be75af] => SSH Error: data could not be sent to the remote host. Make sure this host can be reached over ssh19:19
*** hughmFLEXin has quit IRC19:20
*** hughmFLEXin has joined #openstack-ansible19:20
*** johnmilton has quit IRC19:21
*** catintheroof has joined #openstack-ansible19:22
*** sdake has joined #openstack-ansible19:22
*** sdake has quit IRC19:22
mhaydenalij: you should be able to ssh as root from your deployment host to that container19:23
alijyeah tried that, not working19:23
alij22: No route to host19:23
*** Mudpuppy has quit IRC19:26
mhaydenthere may be some networking issues in your deployment19:26
mhaydenis this a multi-node deployment or a single server (AIO)?19:27
openstackgerritJimmy McCrory proposed openstack/openstack-ansible-os_magnum: Add basic functional tests to role  https://review.openstack.org/35515519:27
jmccrorychris_hultin: it's passing now19:28
chris_hultinjmccrory: Awesome19:28
openstackgerritTravis Truman (automagically) proposed openstack/openstack-ansible-os_heat: Add os_heat role functional tests for gate  https://review.openstack.org/37802419:28
alijmhayden, its a multinode setup19:28
jmccroryhad to add haproxy to route through from vm to containers19:28
alijOkay, I see the problem. The actual IP of the container and the one in openstack_inventory.json is different :O19:28
alijDo containers change their IP over time?19:29
alijmhayden:19:31
mhaydenalij: they shouldn't ;)19:31
alijmhayden, I removed the openstack_inventory.json file (so a new one is created). Same thing is happening with another container19:32
*** fops has joined #openstack-ansible19:32
alijIts IP does not match the actual one19:32
openstackgerritMerged openstack/openstack-ansible-os_ceilometer: Shorten the gnocchi scenario name  https://review.openstack.org/38120019:33
*** deepak_jon has quit IRC19:35
*** johnmilton has joined #openstack-ansible19:35
*** spotz is now known as spotz_zzz19:36
*** fops has quit IRC19:38
michaelguginoodyssey4me: automagically cloudnull mhayden if anyone can look at my comments at https://review.openstack.org/#/c/375131/16 and help me out, that would  be great19:39
mhaydenmichaelgugino: whoa19:39
mhaydenthat's unusual19:39
michaelguginoindeed19:39
*** johnmilton has quit IRC19:39
*** hughmFLEXin has quit IRC19:40
* automagically looking19:40
* cloudnull looking19:40
*** johnmilton has joined #openstack-ansible19:41
*** hughmFLEXin has joined #openstack-ansible19:43
*** alij has quit IRC19:45
*** TxGirlGeek has joined #openstack-ansible19:46
*** asettle has quit IRC19:46
*** david-lyle has joined #openstack-ansible19:47
openstackgerritJimmy McCrory proposed openstack/openstack-ansible-os_magnum: Add basic functional tests to role  https://review.openstack.org/35515519:48
*** admin0 has joined #openstack-ansible19:48
automagicallymichaelgugino: I wonder if we add an inventory entry for 127.0.01 ansible_become=True if it will go away19:49
automagicallyLooks like you’ve found an Ansible bug there related to “localhost” magic19:49
michaelguginoWhy this crap decides to only affect my patch sets, I'll never know.19:50
*** bjolo has quit IRC19:51
*** alij has joined #openstack-ansible19:52
automagicallyHey, at least you didn’t get bit by https://github.com/ansible/ansible/issues/1775519:52
*** alij_ has joined #openstack-ansible19:52
*** fops has joined #openstack-ansible19:53
*** hughmFLEXin has quit IRC19:54
michaelguginowtf, alien emoji?19:55
*** alij_ has quit IRC19:56
*** alij has quit IRC19:56
mgariepylol. just because an emoji is much more clearer than plain ascii english.19:57
michaelgugino👽20:03
*** sdake has joined #openstack-ansible20:05
*** hughmFLEXin has joined #openstack-ansible20:06
openstackgerritTravis Truman (automagically) proposed openstack/openstack-ansible-os_ceilometer: Add storage details to role docs  https://review.openstack.org/38129020:10
admin0glance + ceph worked :)20:10
admin0cehcking cinder + ceph20:10
openstackgerritTravis Truman (automagically) proposed openstack/openstack-ansible-os_ceilometer: Remove unused tenant_name var  https://review.openstack.org/38129120:14
openstackgerritMajor Hayden proposed openstack/openstack-ansible-security: Initial docs scaffolding for RHEL 7 STIG  https://review.openstack.org/38129220:16
mhaydenmichaelgugino: could it be something within /etc/hosts not recognizing localhost?20:16
mhaydencloudnull: i backported that V-38620 skippage if you have a moment for ganderization https://review.openstack.org/38125120:17
cloudnullmhayden: done20:20
automagicallyHmm, upon recheck CentOS gate passed for the os_cinder role...20:21
*** hughmFLEXin has quit IRC20:25
* mhayden hugs cloudnull20:25
openstackgerritMerged openstack/openstack-ansible-security: Skip V-38620 (chrony) in gate  https://review.openstack.org/38125120:25
openstackgerritMerged openstack/openstack-ansible-security: Update tox.ini tests target for stable/newton  https://review.openstack.org/38063520:25
openstackgerritJimmy McCrory proposed openstack/openstack-ansible-tests: Allow db user name differing from db name  https://review.openstack.org/38129720:28
*** catintheroof has quit IRC20:29
*** david-lyle has quit IRC20:30
*** hughmFLEXin has joined #openstack-ansible20:30
*** drifterza has joined #openstack-ansible20:31
drifterzacloudnull, you around20:31
drifterza?20:31
drifterzacan someone review : https://review.openstack.org/#/c/375251/ , https://review.openstack.org/#/c/374008/20:32
drifterzaplease20:32
mhaydendrifterza: i'll look20:33
drifterzathanks major20:34
cloudnulldrifterza: kinda.20:34
cloudnullI'll have a look at those in a little while.20:34
*** david-lyle has joined #openstack-ansible20:35
*** Jeffrey4l__ has joined #openstack-ansible20:35
drifterzaI think they pretty solid20:35
drifterzaso shouldnt be to hectic20:35
*** Jeffrey4l_ has quit IRC20:35
*** spotz_zzz is now known as spotz20:36
*** phalmos has joined #openstack-ansible20:38
openstackgerritianeta hutchinson proposed openstack/openstack-ansible: [docs] Applying edits to the OSA install guide: overview  https://review.openstack.org/38130120:41
admin0cinder + ceph working as well :D20:44
admin0\o/20:44
cloudnulladmin0: what was the change needed?20:44
cloudnullsomthing within OSA that we need to adjust?20:44
*** david-lyle has quit IRC20:44
*** pcaruana has quit IRC20:45
admin0i had this:   controllers + compute = ubuntu 16.04 ,       ceph servers = 14.04 …  ceph servers were 0.8  version,   however the conttroller+compute got 0.10 version20:45
admin0so now i destroyed the ceph server and then used the ceph-ansible to create it, so that both point to the ceph* as the version to use20:45
drifterzayeah ceph doesnt like major version changes20:47
drifterzabetter to install using upstream repo's and perhaps version lock20:48
admin0yeah, but not always possible that way . .best would be to detect the version in the server and ln -s the approprirate client version :)20:48
admin0waiting for the ansible run to finsh, so that i finally test nova + ceph20:48
admin0and then can move ahead with other tests20:49
cloudnullawesome!20:50
openstackgerritJimmy McCrory proposed openstack/openstack-ansible-tests: Checksum all traffic traveling though the bridges  https://review.openstack.org/38130520:55
drifterzacloudnull, any chance of getting a repo called openstack-ansible-os_contrail or openstack-ansible-os_opencontrail ?20:58
*** thorst has quit IRC20:58
*** jmckind has quit IRC21:00
cloudnullodyssey4me: andymccr: ^21:00
cloudnulldrifterza: I'd say yes. however odyssey4me and andymccr will need to be the ones to get it started.21:01
*** hughmFLEXin has quit IRC21:01
cloudnullif you have a repo that you've been working on we can import that repo at a later time21:01
cloudnullwhich makes it easy to build out a POC and then import into the namespace when ready.21:02
openstackgerritJimmy McCrory proposed openstack/openstack-ansible-os_magnum: Add basic functional tests to role  https://review.openstack.org/35515521:02
*** retreved has quit IRC21:02
openstackgerritianeta hutchinson proposed openstack/openstack-ansible: [DOCS] Applies edits to the OSA install guide appendix A  https://review.openstack.org/38130621:03
admin0what would produce an error like this ? instance: 8a8780c4-3063-4e22-82d2-5e25ba359b12] Instance was not mapped to a cell, likely due to an older nova-api service running. _populate_instance_mapping /openstack/venvs/nova-14.0.0/lib/python2.7/site-packages/nova/conductor/manager.py:43621:06
drifterzayeah was hoping to use zuul to get gating tests21:07
drifterzahow can i do that on my own repo21:07
admin0glance+ceph, cinder+ceph works fine ..   nova+ceph = nope :(21:09
admin0will remove the nova-api containers and check after a re-do21:10
*** adrian_otto has quit IRC21:10
cloudnulldrifterza: IDK TBH.21:18
cloudnulli've never done that.21:18
cloudnullpersonal repo > zuul > nodepool < post comment.21:19
*** openstackgerrit has quit IRC21:19
cloudnullhum..21:19
cloudnullyou might be able to do that with gerrithub21:19
cloudnullwhich can be an overlay on a personal repo21:19
*** david-lyle has joined #openstack-ansible21:19
*** openstackgerrit has joined #openstack-ansible21:19
cloudnullwe used to have stackforge for this perpose but that's been decommissioned.21:19
cloudnullim not sure.21:20
*** schwicht has quit IRC21:20
cloudnullI'd recommend asking openstack-infra to see if they have some insight on if zuul+nodepool can be used outside of the OpenStack echosystem21:20
cloudnullwithout having to run your own zuul that it21:20
cloudnull*that is21:20
*** thorst has joined #openstack-ansible21:21
openstackgerritMerged openstack/openstack-ansible-ops: Updated from global requirements  https://review.openstack.org/38113921:22
*** alij has joined #openstack-ansible21:23
drifterzaeish it would be better if I can get a repo to use the same build process like the others.21:23
drifterzais there anything outstanding for newton21:24
drifterza?21:24
openstackgerritianeta hutchinson proposed openstack/openstack-ansible: [DOCS] Applies edits to the OSA install guide appendix B  https://review.openstack.org/38131221:24
*** thorst has quit IRC21:26
*** alij has quit IRC21:28
*** hughmFLEXin has joined #openstack-ansible21:34
mrdaMorning OSA21:36
openstackgerritMerged openstack/openstack-ansible-galera_server: Cleanup duplicate key warning.  https://review.openstack.org/38127321:39
*** hpe-hj has joined #openstack-ansible21:40
*** Mudpuppy has joined #openstack-ansible21:40
*** psilvad has quit IRC21:42
*** hj-hpe has quit IRC21:42
drifterzacloudnull, +w for my patches please dude.21:44
cloudnulldrifterza: I'm actually looking this over now.21:47
drifterzak cool21:47
michaelguginoautomagically: I replied to your comment on my patch set.21:47
*** gouthamr has quit IRC21:49
*** admin0 has quit IRC21:50
*** e-vad has joined #openstack-ansible21:50
*** vishwanathj is now known as vishwanathj_21:51
cloudnulldone. drifterza21:52
cloudnullnicely done on the trove to the integrated repo PR .21:53
*** schwicht has joined #openstack-ansible21:53
cloudnulllooks good21:53
drifterzathanks21:53
drifterzawill look into doing tempest tests in the near future21:53
*** jorge_munoz has quit IRC21:54
*** hughmFLEXin has quit IRC21:56
*** jperry has quit IRC22:02
*** schwicht has quit IRC22:06
*** fops has quit IRC22:07
*** david-lyle has quit IRC22:09
*** alij has joined #openstack-ansible22:10
*** alij_ has joined #openstack-ansible22:11
*** alij has quit IRC22:11
*** woodard has joined #openstack-ansible22:12
*** schwicht has joined #openstack-ansible22:13
*** michaelgugino has quit IRC22:14
*** alij_ has quit IRC22:16
*** sdake has quit IRC22:16
*** mkrish004 has quit IRC22:19
openstackgerritNish Patwa(nishpatwa_) proposed openstack/openstack-ansible-ops: Added cinder metric collection and telegraf conntrack plugin.  https://review.openstack.org/37913822:22
*** woodard has quit IRC22:23
*** galstrom is now known as galstrom_zzz22:24
*** chris_hultin is now known as chris_hultin|AWA22:26
*** adrian_otto has joined #openstack-ansible22:26
openstackgerritMerged openstack/openstack-ansible-os_nova: Move "--no-binary libvirt-python" to ansible-tests  https://review.openstack.org/38104522:29
*** sdake has joined #openstack-ansible22:33
*** schwicht has quit IRC22:34
*** TxGirlGeek has quit IRC22:35
*** david-lyle has joined #openstack-ansible22:36
openstackgerritMerged openstack/openstack-ansible: Add integrated Trove deployment.  https://review.openstack.org/37400822:44
*** phalmos has quit IRC22:45
*** kylek3h has quit IRC22:46
openstackgerritMerged openstack/openstack-ansible: Adding Trove Horizon dashboard  https://review.openstack.org/37525122:47
openstackgerritMerged openstack/openstack-ansible-os_ironic: Move to non stand-alone ironic  https://review.openstack.org/38043822:53
*** cathrichardson has quit IRC22:55
*** weezS has quit IRC22:58
*** poopcat has quit IRC23:03
*** fops has joined #openstack-ansible23:07
*** klamath has quit IRC23:12
*** fops has quit IRC23:13
*** schwicht has joined #openstack-ansible23:15
*** adrian_otto has quit IRC23:17
*** adrian_otto has joined #openstack-ansible23:20
*** alij has joined #openstack-ansible23:20
*** thorst has joined #openstack-ansible23:20
*** alij has quit IRC23:21
*** pmannidi has joined #openstack-ansible23:21
*** alij has joined #openstack-ansible23:21
*** alij has quit IRC23:26
*** thorst has quit IRC23:28
*** thorst has joined #openstack-ansible23:28
*** markvoelker has quit IRC23:29
*** jorge_munoz has joined #openstack-ansible23:29
*** fguillot has quit IRC23:31
*** thorst has quit IRC23:31
*** thorst has joined #openstack-ansible23:32
*** jorge_munoz has quit IRC23:33
*** jamielennox is now known as jamielennox|away23:35
*** david-lyle has quit IRC23:44
*** v1k0d3n has joined #openstack-ansible23:45
*** jamielennox|away is now known as jamielennox23:48
*** v1k0d3n has quit IRC23:50

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!