Thursday, 2018-10-04

*** spartakos has quit IRC00:19
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_monasca-agent stable/ocata: Setup branch for gerrit  https://review.openstack.org/59700600:26
*** cshen has quit IRC00:46
*** dave-mccowan has quit IRC00:52
*** gyee has quit IRC00:54
*** fatdragon has quit IRC01:30
*** Bhujay has joined #openstack-ansible02:24
*** spatel has joined #openstack-ansible02:40
openstackgerritzhulingjie proposed openstack/openstack-ansible-os_tacker master: Remove the unused tacker_horizon_dashboard_disable defined  https://review.openstack.org/60557102:48
*** Bhujay has quit IRC03:03
*** udesale has joined #openstack-ansible03:14
*** sawblade6 has quit IRC03:14
openstackgerritMerged openstack/openstack-ansible-os_ironic master: fix tox python3 overrides  https://review.openstack.org/60681703:23
openstackgerritcaoyuan proposed openstack/openstack-ansible-os_tacker master: Clean up the remaining vars and tasks from dashboard  https://review.openstack.org/60780203:27
openstackgerritcaoyuan proposed openstack/openstack-ansible-os_tacker master: Clean up the remaining stuff for dashboard  https://review.openstack.org/60780203:33
*** sawblade6 has joined #openstack-ansible03:39
*** shyamb has joined #openstack-ansible03:45
*** sawblade6 has quit IRC03:49
*** sawblade6 has joined #openstack-ansible03:50
*** sawblade6 has quit IRC03:54
*** spatel has quit IRC04:09
*** kukacz has quit IRC04:14
*** ianychoi_ has joined #openstack-ansible04:15
*** electrofelix has quit IRC04:15
*** kukacz has joined #openstack-ansible04:16
*** ianychoi has quit IRC04:17
*** shyamb has quit IRC04:22
*** shyamb has joined #openstack-ansible04:22
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-nspawn_hosts master: Modify the network to ensure their more restrictive  https://review.openstack.org/60780404:23
openstackgerritAndreas Jaeger proposed openstack/openstack-ansible-os_monasca-agent stable/ocata: Setup branch for gerrit  https://review.openstack.org/59700604:32
*** vnogin has joined #openstack-ansible04:35
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-nspawn_hosts master: Install the timezone package by default  https://review.openstack.org/60780504:36
*** vnogin has quit IRC04:39
*** sawblade6 has joined #openstack-ansible04:40
*** sawblade6 has quit IRC04:44
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-os_nova master: Correct ansible conditional jinja2 warning  https://review.openstack.org/60780604:48
*** cshen has joined #openstack-ansible04:54
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-os_swift master: Add variable for the ssh service and ensure its enabled  https://review.openstack.org/60780804:58
*** cshen has quit IRC04:59
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-os_swift master: Add variable for the ssh service and ensure its enabled  https://review.openstack.org/60780805:00
*** cshen has joined #openstack-ansible05:05
*** udesale has quit IRC05:09
*** cshen has quit IRC05:10
*** shyamb has quit IRC05:11
*** shyamb has joined #openstack-ansible05:11
*** udesale has joined #openstack-ansible05:15
*** shyamb has quit IRC05:26
openstackgerritjacky06 proposed openstack/openstack-ansible-openstack_openrc stable/rocky: Replace Chinese punctuation with English punctuation  https://review.openstack.org/60781005:40
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-os_swift master: remove loop control when running include_role  https://review.openstack.org/60781105:47
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-os_nova master: remove loop control when running include_role  https://review.openstack.org/60781305:52
*** udesale has quit IRC05:53
*** shyamb has joined #openstack-ansible05:53
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-os_cinder master: remove loop control when running include_role  https://review.openstack.org/60781405:56
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-os_nova master: remove loop control when running include_role  https://review.openstack.org/60781305:58
*** udesale has joined #openstack-ansible05:58
*** mma has joined #openstack-ansible06:05
openstackgerritjacky06 proposed openstack/openstack-ansible-os_gnocchi master: Trivial: Fix the pep8 warning  https://review.openstack.org/58904006:15
*** iurygregory has joined #openstack-ansible06:15
openstackgerritMerged openstack/openstack-ansible-openstack_openrc stable/rocky: Replace Chinese punctuation with English punctuation  https://review.openstack.org/60781006:19
AJaegercloudnull, odyssey4me, https://review.openstack.org/597006 is ready now - and https://review.openstack.org/607740 (for project-config) not needed since a duplicate merged and the readd is not needed, you have everything in-repo already. sorry for messing this up06:25
*** cshen has joined #openstack-ansible06:27
*** fghaas has joined #openstack-ansible06:28
openstackgerritMerged openstack/openstack-ansible-nspawn_hosts master: Install the timezone package by default  https://review.openstack.org/60780506:32
openstackgerritcaoyuan proposed openstack/openstack-ansible-os_tacker master: Clean up the remaining stuff for dashboard  https://review.openstack.org/60780206:34
openstackgerritcaoyuan proposed openstack/openstack-ansible-os_tacker master: Clean up the remaining stuff for dashboard  https://review.openstack.org/60780206:36
*** shyamb has quit IRC06:38
*** pcaruana has joined #openstack-ansible06:40
*** kwu83tw has quit IRC06:44
*** kwu_83tw has quit IRC06:44
*** shyamb has joined #openstack-ansible06:44
openstackgerritManuel Buil proposed openstack/openstack-ansible-os_neutron stable/rocky: Provide support for "force_metadata" in dnsmasq  https://review.openstack.org/60781906:57
evrardjpgood morning07:14
evrardjpodyssey4me: did you see the message of AJaeger above?07:16
*** cardinal_gray has joined #openstack-ansible07:24
*** cardinal_gray has quit IRC07:25
*** shardy has joined #openstack-ansible07:26
*** vollman has quit IRC07:28
*** cardinal_gray has joined #openstack-ansible07:28
*** cardinal_gray has left #openstack-ansible07:28
*** rgogunskiy has joined #openstack-ansible07:29
*** sawblade6 has joined #openstack-ansible07:30
*** udesale has quit IRC07:30
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible master: Move release version to different file  https://review.openstack.org/60782507:31
*** sawblade6 has quit IRC07:37
*** shyamb has quit IRC07:38
*** shyamb has joined #openstack-ansible07:38
*** tosky has joined #openstack-ansible07:45
*** sawblade6 has joined #openstack-ansible07:48
*** sawblade6 has quit IRC07:52
*** olivierb_ has joined #openstack-ansible07:52
*** udesale has joined #openstack-ansible07:53
*** pcaruana has quit IRC07:55
*** pcaruana has joined #openstack-ansible07:57
*** shyamb has quit IRC07:59
*** hamzaachi has joined #openstack-ansible08:01
*** mardim has joined #openstack-ansible08:13
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible stable/queens: Update all SHAs for 17.1.3  https://review.openstack.org/60783608:17
openstackgerritMerged openstack/openstack-ansible-os_monasca-agent stable/ocata: Setup branch for gerrit  https://review.openstack.org/59700608:25
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible stable/pike: Update all SHAs for 16.0.21  https://review.openstack.org/60784208:28
openstackgerritMerged openstack/ansible-hardening master: docs: Write files in binary mode  https://review.openstack.org/60773808:30
*** gkadam has joined #openstack-ansible08:30
*** cshen has quit IRC08:31
*** gkadam has quit IRC08:31
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_ironic stable/pike: Fix OpenSSL import in test config  https://review.openstack.org/60393908:32
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_ironic stable/pike: import zuul job settings from project-config  https://review.openstack.org/59505508:33
*** benkohl has joined #openstack-ansible08:40
*** DanyC has joined #openstack-ansible08:40
benkohlHi :) When I do `openstack-ansible setup-infrastructure.yml --syntax-check` I get  many warnings. The first says `Failed to parse /opt/openstack-ansible/inventory/dynamic_inventory.py with script plugin: Inventory script (/opt/openstack-ansible/inventory/dynamic_inventory.py) had an execution error: can't find tunnel in cidr_networks`08:41
*** udesale has quit IRC08:46
*** shyamb has joined #openstack-ansible08:46
openstackgerritMerged openstack/openstack-ansible-os_cinder master: Trivial: Fix the pep8 warning  https://review.openstack.org/58903508:48
*** udesale has joined #openstack-ansible08:49
noonedeadpunkmoring everyone08:50
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible stable/ocata: Update all SHAs for 15.1.29  https://review.openstack.org/60785008:50
noonedeadpunkbenkohl: make sure, that you've specified all required varibales in your user_variables.yml and openstack_user_config.yml08:50
noonedeadpunkAs it seems, that you've missed or misspelled it. for me it looks like http://paste.openstack.org/show/731455/ in openstack_user_config.yml08:53
benkohlnoonedeadpunk: For me it looks the same. Maybe it's because my network completly changed sice I done `scripts/bootstrap-ansible.sh`?08:56
openstackgerritMerged openstack/ansible-hardening master: fix tox python3 overrides  https://review.openstack.org/60651008:56
noonedeadpunkand a bit below in  global_overrides do you have cidr_networks: *cidr_networks?09:01
noonedeadpunkActually you should be able to run /opt/openstack-ansible/inventory/dynamic_inventory.py and get inventory as a result, without any errors or warnings in the beggining09:02
benkohlnoonedeadpunk: thank you for the hint. It was indeed a typo in the cidr_netowkrs: section :) thank you!09:03
openstackgerritMerged openstack/openstack-ansible-os_swift master: Trivial: Fix the pep8 warning  https://review.openstack.org/58905909:07
*** electrofelix has joined #openstack-ansible09:12
openstackgerritMerged openstack/openstack-ansible-os_neutron stable/pike: import zuul job settings from project-config  https://review.openstack.org/59506109:20
*** shyamb has quit IRC09:29
*** shyamb has joined #openstack-ansible09:30
*** shyamb has quit IRC09:40
*** FuzzyFerric has joined #openstack-ansible09:47
*** FuzzyFerric has left #openstack-ansible09:47
*** FuzzyFerric has joined #openstack-ansible09:47
*** Bhujay has joined #openstack-ansible09:48
*** priteau has joined #openstack-ansible09:48
*** sawblade6 has joined #openstack-ansible09:50
*** ullbeking has joined #openstack-ansible09:50
*** ullbeking has quit IRC09:50
FuzzyFerricHi09:55
FuzzyFerricI am having troubles with Ansible and NFS mounts in an LXC container. I was wondering if anyone had encountered this..  I am trying to mount an NFS share (on our SAN) as the /var/lib/glance/images folder for our OpenStack Queens (Ansible) installation. I have added the NFS mount exactly as the instructions show, to the user_variables.yml file, but it will not attach the NFS mount to that folder.09:55
FuzzyFerricIf I rename the folder to another one (for example /var/lib/glance/NFSimages, it creates it, and attaches the NFS mount to it just fine.  This is where the two solutions I am trying to employ come in..09:55
FuzzyFerric1.Set the NFS mount to /var/lib/glance/images exactly as the documentation states… < This does not work but is exactly what I am trying to do!09:55
FuzzyFerric2.Mount a new directory - /var/lib/glance/NFSimages (That works) and then redirect the Glance image store to use that directory (that does not work!)09:55
FuzzyFerricAny ideas?09:55
FuzzyFerricMy config is pretty much letter for letter on the documentation found at https://docs.openstack.org/openstack-ansible-os_glance/latest/ but I may be misunderstanding how to enter the glance_nfs_client: entry… I have it exactly as the example, but am bothered by the [ ] shown ?09:55
FuzzyFerricThanks09:55
FuzzyFerricFuzzy09:55
odyssey4meFuzzyFerric: The 'glance_nfs_client: []' line is a default. '[]' just defines it as a list, in the example below it you can see that it's a yaml list of dicts.09:58
*** sawblade6 has quit IRC09:58
odyssey4meif you gist/pastebin a sanitised version of your config then we can verify it.09:59
FuzzyFerricThanks, I will do that09:59
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_ironic stable/pike: Remove galera_client meta-dependency  https://review.openstack.org/60379510:02
*** udesale has quit IRC10:04
*** Bhujay has quit IRC10:06
FuzzyFerricodyssey4me - Gist is at https://gist.github.com/FuzzyFerric/5a49a344e9d0034f09e9a14195a87e10 (Kind of new to this Gist thing)10:09
odyssey4meFuzzyFerric: that looks about right - what branch/tag are you using to deploy with?10:11
*** udesale has joined #openstack-ansible10:13
FuzzyFerricSorry, could you please remind me on how I find that...10:14
FuzzyFerricodyssey4me : Branch is stable/queens, Not sure how to find the current tag10:22
odyssey4meFuzzyFerric: ok, that's good enough10:23
FuzzyFerricodyssey4me Tag: 17.1.0-8-g9435dc910:23
openstackgerritMerged openstack/openstack-ansible-os_neutron stable/rocky: Provide support for "force_metadata" in dnsmasq  https://review.openstack.org/60781910:24
odyssey4meFuzzyFerric: I think the issue is that the folder is bind-mounted to the host: https://github.com/openstack/openstack-ansible/commit/e992ff06e361489e2ecd05cefb5e58dbc621050710:26
odyssey4meif you add 'glance_container_bind_mounts: []' to your user_variables.yml and destroy/recreate the container then it should work10:26
FuzzyFerricThank you - I will try that10:27
*** shyamb has joined #openstack-ansible10:27
openstackgerritNicolas Bock proposed openstack/openstack-ansible master: Pretty-print output during bootstrap process  https://review.openstack.org/60752610:37
*** shyamb has quit IRC10:38
*** shyamb has joined #openstack-ansible10:38
*** udesale has quit IRC10:39
*** udesale has joined #openstack-ansible10:40
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_ironic stable/ocata: Fix OpenSSL import in test config  https://review.openstack.org/60789910:54
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_ironic stable/ocata: Updated from OpenStack Ansible Tests  https://review.openstack.org/60230910:55
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_ironic stable/ocata: import zuul job settings from project-config  https://review.openstack.org/59475110:55
openstackgerritMerged openstack/openstack-ansible-os_ironic stable/pike: Fix OpenSSL import in test config  https://review.openstack.org/60393910:56
*** dave-mccowan has joined #openstack-ansible11:01
*** pcaruana has quit IRC11:02
*** pcaruana has joined #openstack-ansible11:02
*** czunker has joined #openstack-ansible11:04
*** sawblade6 has joined #openstack-ansible11:29
*** sawblade6 has quit IRC11:34
openstackgerritMerged openstack/openstack-ansible-os_ironic stable/pike: import zuul job settings from project-config  https://review.openstack.org/59505511:42
*** sawblade6 has joined #openstack-ansible11:43
*** shyamb has quit IRC11:44
*** shyam89 has joined #openstack-ansible11:45
*** sawblade6 has quit IRC11:48
*** sawblade6 has joined #openstack-ansible12:01
jamesdentonAnyone have time to check this out? https://review.openstack.org/#/c/584447/12:01
*** sawblade6 has quit IRC12:10
*** tosky__ has joined #openstack-ansible12:37
*** tosky is now known as Guest839912:37
*** tosky__ is now known as tosky12:37
*** Guest8399 has quit IRC12:39
*** strattao has joined #openstack-ansible12:42
nicolasbockHi, good morning12:44
*** fghaas has quit IRC12:45
mgariepygood morning everyone12:54
arxcruzcan someone tell me if we have problems with the tests? my https://review.openstack.org/#/c/606084/ is failing...12:59
*** ansmith has joined #openstack-ansible13:00
*** jonher has quit IRC13:00
*** jonher has joined #openstack-ansible13:00
*** vollman has joined #openstack-ansible13:08
*** czunker has quit IRC13:09
jrosserarxcruz: something is badly wrong here http://logs.openstack.org/84/606084/3/check/openstack-ansible-deploy-aio_lxc-ubuntu-bionic/3e4e7d3/logs/ara-report/result/630a208c-78cf-4429-b961-1fc0c4f65465/13:09
jrosseri've seen this a lot over the last few days with packages installed from mirrors taking a very long time indeed13:09
arxcruzjrosser: yeah, me too13:12
arxcruzdo we have a lp for that? I can start to digg into it although i'm not familiar13:12
mgariepythat was fast Fetched 20.9 MB in 50min 29s (6905 B/s)13:13
odyssey4mehmm, that is odd - most especially because the mirror in question there is a mirror local to that data centre13:13
*** ohsnap has joined #openstack-ansible13:14
jrosseri've seen it all over, in different infra providers13:14
openstackgerritDmitriy Rabotjagov (noonedeadpunk) proposed openstack/openstack-ansible-os_ceilometer master: Fix of oslomsg undefined variables for services notifications  https://review.openstack.org/60765313:14
jrosserodyssey4me: if you want an extreme example look at this https://review.openstack.org/#/c/605440/13:15
noonedeadpunkfolks, can you remind me how to set from non-voting to voting test for zuul? Or it's made only from your side?13:18
AJaegernoonedeadpunk: update .zuul.yaml in the repo (or project-config), it's normally removing the "voting: false" line - and then adding to gate pipeline as well13:19
mgariepylogan-, are you around?13:19
noonedeadpunkAJaeger: thanks,found it. Completely forgotten about zuul.d folder )13:19
mgariepyanyone here is using ceph for volume in cinder?13:20
noonedeadpunkmgariepy: yep, I'm using13:21
mgariepyi'm wondering why when creating a volume from another volume, they are idependent (and quite fast to create) and when creating a volume from a snapshot they are dependent, independant if I flatten, but then takes a while to create.13:22
odyssey4mejrosser arxcruz interesting, use this query in logstash.openstack.org: filename:job-output.txt AND (build_node:ubuntu-xenial OR build_node:ubuntu-bionic) AND message:Fetched ? in ?13:22
*** shyam89 has quit IRC13:23
arxcruzodyssey4me: 86 hits13:24
arxcruzjust today13:24
arxcruz:O13:24
odyssey4meoh sure, because that's absolutely every ubuntu host - but look at the resulting speeds... they're mostly ok13:24
arxcruzi see13:25
arxcruzyeah, Fetched 14.8 MB in 2s (6357 kB/s)13:25
noonedeadpunkmgariepy: hm, it's strange that they are independent, as I thought that rbd clone is the only option, which might be used here, but it has relations, as it's COW13:25
odyssey4mejrosser: I'm fairly certain that we could do a lot to remove packages we currently install. A lot of them are there due to legacy, and removing packages we don't need (or installing packages optionally based on drivers and such) would cut down build times a lot.13:28
mgariepynoonedeadpunk, if i beleive the comments in the cinder rbd.py code, https://github.com/openstack/cinder/blob/master/cinder/volume/drivers/rbd.py#L572-L58213:29
mgariepyit does create a snapshot before cloning the volume.13:30
*** spatel has joined #openstack-ansible13:30
noonedeadpunkActually rbd clone might be done only from snapshot. But still created volume must have relations13:31
noonedeadpunkhttp://docs.ceph.com/docs/master/man/8/rbd/#commands13:31
noonedeadpunkAnd interesting info for me, that in case of exceeding rbd_max_clone_depth volume will be flattened13:33
AJaegerodyssey4me: did you find a solution for https://review.openstack.org/594750 ? That might be your final job import..13:33
*** Emine has joined #openstack-ansible13:34
odyssey4meAJaeger: I'll look into that now.13:34
odyssey4meThe others are going through.13:34
AJaegergreat, thanks13:35
mgariepyso the difference is the protection of the snapshot then ?13:36
openstackgerritMerged openstack/openstack-ansible-os_tacker master: Clean up the remaining stuff for dashboard  https://review.openstack.org/60780213:37
*** hamzaachi has quit IRC13:39
*** hamzaachi has joined #openstack-ansible13:39
*** evrardjp has quit IRC13:40
*** evrardjp has joined #openstack-ansible13:42
*** fghaas has joined #openstack-ansible13:42
*** Emine has quit IRC13:44
*** spatel has quit IRC13:47
*** pcaruana has quit IRC13:50
noonedeadpunkmgariepy: it's also linked to the snapshot, which is protected anyway, so I'd say there's no difference at all, except the fact of creating snapshot by cinder-volume before creating disk from it13:51
*** oanson has quit IRC13:51
noonedeadpunkhttp://paste.openstack.org/show/731487/13:52
AJaegerodyssey4me: worst case, we can just make the failing jobs non-voting...13:52
odyssey4meAJaeger: yep, worst case - given ocata is EM - we'll remove the functional test13:53
odyssey4meI've got some meetings now, but will dig into this a bit later - I'll kick off an instance now to reproduce it and inspect it.13:53
AJaegerodyssey4me: in that case, we need to first remove it in project-config - and then remove that one.13:53
AJaegerodyssey4me: thanks - please keep me updated.13:54
odyssey4meAJaeger: as far as I know, the functional tests for that repo are only present in-repo, so we can remove it without anything in project-config13:54
AJaegerodyssey4me: ah, good13:55
openstackgerritMerged openstack/openstack-ansible-os_ironic stable/pike: Remove galera_client meta-dependency  https://review.openstack.org/60379513:55
mgariepyhmm13:56
mgariepyi think the diff is that cinder doesn't have the data in mysql.13:57
*** priteau has quit IRC13:58
jrosserodyssey4me: that slow apt install is wierd isnt it - why it seems to persistently affect some of our jobs13:59
*** priteau has joined #openstack-ansible13:59
*** gkadam has joined #openstack-ansible14:00
odyssey4mejrosser: I wonder if it's specific to containers, or the same happens for hosts14:02
prometheanfireodyssey4me: :D14:02
*** hamzy has quit IRC14:10
*** mma has quit IRC14:10
spotzWell this is embarassing I broke my git-review:)14:10
jamesdentonhow so?14:11
spotzjamesdenton: I have a feeling it was when I installed python314:12
prometheanfirespotz: odd, let me see how I'm installing it14:12
jamesdentoncan you share the error you're getting?14:12
spotzfatal: 'review' appears to be a git command, but we were not14:12
spotzable to execute it. Maybe git-review is broken?14:12
spotzjamesdenton: not real helpful:)14:12
prometheanfirehttps://github.com/gentoo/gentoo/blob/master/dev-python/git-review/git-review-1.26.0.ebuild#L514:13
prometheanfiresupports multiple pythons14:13
spotzOn the plus side once I fix it I'll be prepared for the git and gerrit session in Berlin14:13
spotzprometheanfire: That's the only thing I've changed lately:(14:13
prometheanfirespotz: maybe it's only installed for one python for you :|14:13
prometheanfireso re-installing it?14:13
spotzthat was my next step, just need to remember how I put it in the first time:)14:14
*** mma has joined #openstack-ansible14:14
spotzpossibly pip vs hoebrew14:14
prometheanfirenew version too14:15
prometheanfirehttps://github.com/openstack-infra/git-review/compare/1.26.0...1.27.014:15
spotzThis might be fun:( -bash: pip: command not found14:15
prometheanfireouch, ya14:15
spotzOk this is going to take more then a few minutes I think:( It'll give me something to do at night at the horse show though14:17
ohsnapam i missing something here? this doc says in this test example each node only has 1 nic, but then goes on to show LACP/bonding being done14:19
ohsnaphttps://docs.openstack.org/openstack-ansible/rocky/user/test/example.html14:19
openstackgerritAmy Marrich (spotz) proposed openstack/openstack-ansible-os_horizon master: Turning off SSL is currently offline  https://review.openstack.org/60796914:20
spotzprometheanfire: reinstalled python and new pip is pip314:21
spotzOk off to the horse show:)14:22
prometheanfire:D14:23
*** tosky__ has joined #openstack-ansible14:27
*** tosky has quit IRC14:28
*** tosky__ is now known as tosky14:28
*** Bhujay has joined #openstack-ansible14:28
*** spatel has joined #openstack-ansible14:28
prometheanfirecloudnull: not sure if this will help with our logging or not https://docs.ansible.com/ansible/devel/porting_guides/porting_guide_2.7.html#modules14:29
*** fghaas has quit IRC14:29
*** kukacz has quit IRC14:30
openstackgerritMerged openstack/openstack-ansible-os_ironic stable/ocata: Fix OpenSSL import in test config  https://review.openstack.org/60789914:30
*** kukacz has joined #openstack-ansible14:30
cloudnullprometheanfire that might be useful14:30
*** skiedude has joined #openstack-ansible14:31
skiedudeWhy is it when i stop a rabbitmq container on one infra host, it stops it on the other infra host?14:35
benkohlI'm getting14:36
benkohlTASK [ceph-osd : use ceph-volume lvm batch to create filestore osds] ***************************************************************************************************************************************************************14:36
benkohlfatal: [marty]: FAILED! => {"changed": true, "cmd": ["ceph-volume", "--cluster", "ceph", "lvm", "batch", "--filestore", "--yes", "/dev/sdb", "/dev/sdd", "/dev/sde"], "delta": "0:00:00.199510", "end": "2018-10-04 14:34:16.684605"14:36
benkohl, "msg": "non-zero return code", "rc": 2, "start": "2018-10-04 14:34:16.485095", "stderr": "usage: ceph-volume lvm [-h]\nceph-volume lvm: error: unrecognized arguments: batch --filestore --yes /dev/sdb /dev/sdd /dev/sde", "stder14:36
benkohlr_lines": ["usage: ceph-volume lvm [-h]", "ceph-volume lvm: error: unrecognized arguments: batch --filestore --yes /dev/sdb /dev/sdd /dev/sde"], "stdout": "", "stdout_lines": []}14:36
benkohlWhat does this mean?14:36
*** shyamb has joined #openstack-ansible14:43
skiedudeah, rabbit defaults to pause_minority14:44
*** hamzy has joined #openstack-ansible14:45
openstackgerritMerged openstack/openstack-ansible-os_ironic stable/ocata: import zuul job settings from project-config  https://review.openstack.org/59475114:48
openstackgerritMerged openstack/openstack-ansible-os_ironic stable/ocata: Updated from OpenStack Ansible Tests  https://review.openstack.org/60230914:48
*** skiedude has quit IRC14:48
prometheanfireall non-wip stuff merged into ironic :D14:50
openstackgerritMerged openstack/openstack-ansible-nspawn_hosts master: Modify the network to ensure their more restrictive  https://review.openstack.org/60780414:52
*** weezS has joined #openstack-ansible14:56
*** kwu_83tw has joined #openstack-ansible14:59
*** kwu83tw has joined #openstack-ansible14:59
*** strattao has quit IRC15:00
*** olivierb_ has quit IRC15:04
*** olivierb_ has joined #openstack-ansible15:05
*** rgogunskiy has quit IRC15:07
*** FuzzyFerric has quit IRC15:10
*** DanyC has quit IRC15:11
*** DanyC has joined #openstack-ansible15:12
*** DanyC has quit IRC15:13
benkohlwhich ceph-ansible version does OSA use?15:15
*** mma has quit IRC15:17
spatelbenkohl: i believe 3.1.x depend which OSA version you are running15:18
spatelif queens then 3.115:18
spateli believe you can check requirement*.txt file15:18
spateljamesdenton: ^^15:18
spatelmorning!15:18
openstackgerritNicolas Bock proposed openstack/openstack-ansible master: Pretty-print output during bootstrap process  https://review.openstack.org/60752615:18
benkohlI searched within the OSA repo but didn't found anything. I use rocky rc215:22
*** shyamb has quit IRC15:23
benkohlI ask this because I'm getting `TASK [ceph-osd : use ceph-volume lvm batch to create filestore osds]` with `ceph-volume lvm: error: unrecognized arguments: batch --filestore --yes /dev/sdb /dev/sdd /dev/sde` and think it could be the `osd_scenario: lvm` variable15:23
cloudnullbenkohl the version of ceph-ansible we use can be found here https://github.com/openstack/openstack-ansible/blob/master/ansible-role-requirements.yml#L185-L18815:24
cloudnull** change the branch to your checkout15:25
*** macza has joined #openstack-ansible15:25
benkohloh sorry I searched for a number in that file but yeah - master is also a version :D15:26
openstackgerritTaseer Ahmed proposed openstack/openstack-ansible-os_blazar master: Add missing blazar_oslomsg_notify_password  https://review.openstack.org/60799115:29
*** olivierb_ has quit IRC15:29
*** olivierb_ has joined #openstack-ansible15:29
*** mma has joined #openstack-ansible15:32
*** mma has quit IRC15:35
spatelcloudnull: do you know how to find out neutron port which is available and allocated ?15:35
*** udesale has quit IRC15:36
spatelI think there is not simple command but we can find with  "neutron port-show aa7d41f3-337f-4d65-ad1a-72a18ffd6f90 | grep status"15:39
spatelstatus                | DOWN15:39
*** benkohl has quit IRC15:40
jamesdentonspatel what exactly are you looking to do?15:41
noonedeadpunkfolks, can you review https://review.openstack.org/#/c/607653/2 please?15:41
spatellets say i create bunch of sr-iov machine and they destroy them and re-create them so i want to find out if any port available and not in use15:42
*** hamzy_ has joined #openstack-ansible15:42
spatelin short garbage collection15:42
spatelthere are bunch of people going to work on cloud and i am sure they will create port and destroy port but sometime there are leftover port which is not in use and i want to get them free15:43
spateljamesdenton: ^^15:43
spateljamesdenton: one more question what is the best way to create instance using SR-IOV, any good method ?15:44
*** hamzy has quit IRC15:44
spatelcurrently i am using script to spin up port and then attach port to instance15:44
jamesdentonso to answer the first question: openstack port list -c id -c status -c binding_vnic_type and filtering that15:45
jamesdentonand you can add/remove columns as needed15:45
openstackgerritTaseer Ahmed proposed openstack/openstack-ansible master: Integrate Blazar with OpenStack Ansible  https://review.openstack.org/54995615:45
spateljamesdenton: why are you so awesome!!!15:46
jamesdentonthe method you're using to create ports then instances using those ports is fine. i don't know of an easier way with the clients15:46
spatelopenstack port list -c id -c status -c binding_vnic_type   <--- beautiful15:46
spateljamesdenton: yesterday i talked to sean from intel related NUMA issue15:47
spateli had 2 hour of discussion on freenode15:47
spatelcheck this out https://bugs.launchpad.net/nova/+bug/179592015:48
openstackLaunchpad bug 1795920 in OpenStack Compute (nova) "SR-IOV shared PCI numa not working " [Undecided,Confirmed]15:48
jamesdentonchecking15:49
jamesdentonoh very good. glad you made some progress on that15:50
spatelYes he said this bug is open and going to fix in stein release15:50
jamesdentoni am still working on getting my sr-iov node up and running. i had the day off yesterday and tried to do as little as possible15:51
spatelalso he suggest (hw:numa_nodes='2') to fix my issue to use shared PCI bus between numa15:52
spatelalso add hw:cpu_policy='dedicated'15:52
spatelso instance vCPU will spread out between two numa node equality15:53
spatelyes not very best for performance but it will give us what we want15:53
jamesdentondid it work?15:54
spatelyes it did work :)15:54
jamesdentonoh good15:54
spateli have already put 3 customer on SR-IOV and looks good and performance also not bad15:54
jamesdentonsweet15:55
*** olivierb_ has quit IRC15:55
spatelhe suggest me to use DPDK because he is using in their environment and he said they you can easily get 6mpps rate with 10G link15:55
*** Bhujay has quit IRC15:55
spatelhttps://dpdksummit.com/Archive/pdf/2016USA/Day02-Session04-ThomasHerbert-DPDKUSASummit2016.pdf15:56
jamesdentonhe's biased :P15:56
spatel:)15:56
spatelagreed15:56
jamesdentonseriously, though. working on the patches but i think it'll be while before its GA15:57
spatelcheck this bug out https://bugs.launchpad.net/nova/+bug/179506415:57
openstackLaunchpad bug 1795064 in OpenStack Compute (nova) "SR-IOV error IndexError: pop from empty list" [Medium,In progress] - Assigned to Matt Riedemann (mriedem)15:57
jamesdentongood deal15:57
jamesdentonwhat does your whitelist look like again?15:58
spatelin nova ?15:58
spatelpci_passthrough_whitelist = "{ "physical_network":"vlan", "devname":"eno2" }"15:59
*** gyee has joined #openstack-ansible16:00
jamesdentonthx16:00
spatelsean told me this about kernel 4.x  - if the device was bound to vfio_pci instead of the broadcom driver then it would existit in lspci but not have a netdev16:02
spateli would guess the default options for the gernel module cahnged and or you are using a different driver by default16:02
spatelthis two thing he said why your kernel 4.x having issue..16:03
spatelhe said use if you use the pci adddress instead 4.18 would likely be fine..16:03
jamesdentonwell it's easy enough to confirm, but vfio_pci is dpdk driver, i think?16:03
spateldon't use devname for kernel 4.x and use PCI address16:04
jamesdentonyeah ok16:04
spateli will give it a try later to see if 4.x work with that option16:04
noonedeadpunkcloudnull: I've placed update in patch, that you've reviewed https://review.openstack.org/#/c/605769/16:04
spatelnot sure about vfio_pci ( may be he like DPDK so was talking in that context)16:05
noonedeadpunkdoes it looks ok for you now?16:05
jamesdentonif you could see eno2 in 'ip link show' then likely not your issue16:05
spateli can see eno2 in `ip link show`16:06
spatelYesterday i have put two SR-IOV instance on single compute node and looks good16:07
spatelin production load16:07
spatelno packet drop :)16:08
jamesdentonthat's what i like to hear16:14
*** skiedude has joined #openstack-ansible16:26
*** strattao has joined #openstack-ansible16:27
spatelyup!!16:30
*** hamzaachi has quit IRC16:34
*** Bhujay has joined #openstack-ansible16:34
*** DanyC has joined #openstack-ansible16:36
*** DanyC has quit IRC16:40
*** DanyC has joined #openstack-ansible16:41
skiedudeAnyone have a quick minute to take a gander at https://bugs.launchpad.net/openstack-ansible/+bug/179613216:52
openstackLaunchpad bug 1796132 in openstack-ansible "SSL Verification Error on Launch Instance (queens)" [Undecided,New]16:52
skiedudeand I just realized I didn't make this in /nova bugs16:53
skiedudeI don't suppose there is an easy way to move it16:54
*** Bhujay has quit IRC17:01
*** mma has joined #openstack-ansible17:02
*** shardy has quit IRC17:04
*** mma has quit IRC17:06
*** gkadam has quit IRC17:08
openstackgerritNicolas Bock proposed openstack/openstack-ansible-os_neutron master: Fix whitespace in neutron.conf template  https://review.openstack.org/60803117:10
noonedeadpunkI think there's no way to move it between projects...17:11
noonedeadpunkskiedude: and have you specified extra vars for nova to suuport SSL? As they-re required if you wish to force nova listen on SSL, and config lines regarding this question are here https://github.com/openstack/openstack-ansible-os_nova/blob/master/templates/nova.conf.j2#L32-L3717:13
noonedeadpunksorry, these lines about nova vnc console17:15
openstackgerritAndy Smith proposed openstack/openstack-ansible master: Add qdrouterd role for oslo.messaging backend deployment  https://review.openstack.org/57026117:17
noonedeadpunkanyway, you may pass/override any parameter to nova config with nova_nova_conf_overrides17:17
skiedudenoonedeadpunk: I incorrectly assumed that it would figure out its own self signed SSLs if I enabled https17:17
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_horizon stable/ocata: role tests: Build horizon from stable/ocata, not master  https://review.openstack.org/60803517:17
*** pcaruana has joined #openstack-ansible17:17
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_horizon stable/ocata: import zuul job settings from project-config  https://review.openstack.org/59475017:18
noonedeadpunkskiedude: you might have problems with self-signed certificates, as python has strict checks about SSLs. And do you really need to encrypt all traffic in private mgmt network (which is not supposed to be available from world)?17:19
skiedudehonestly I was trying to get the single IP of the internal/external LB to work. When I tried setting the publiuri to https, it still seemed like certain things were trying to use SSL, so I figured maybe it would be easier to do it all https17:20
skiedudeto http*17:21
skiedudeI suppose I can go back to trying to get http to work17:23
openstackgerritNicolas Bock proposed openstack/openstack-ansible master: Set default glance image tag  https://review.openstack.org/60803717:26
odyssey4meskiedude: all endpoints https simply won't work, all http works fine but there is a known bug that spotz is working on to resolve17:26
skiedudeif I move everything to all http, is it then advised to disable haproxy_ssl ?17:27
odyssey4meskiedude: better for now to just use a different ip for public and private17:27
skiedudeok17:27
odyssey4meit's suggested to use a dns name for public anyway, so that it can change ip's later17:27
skiedudethe only other issue I seem to be running into with HA testing on multiple controllers is the apt-cacher-ng container loses its /run/apt-cacher-ng folder when the container is stopped/started, so then the service won't start until I manually remake its run folder17:28
nicolasbockxgerman_: Could you have a look at https://review.openstack.org/608037 please?17:28
nicolasbockI suspect that you had a reason to not set the tag, but maybe it's ok to set it anway and override if necessary?17:28
xgerman_Historically I was using the image0id and build my own image before I started downlaoding that from the artefact17:29
xgerman_but we can set that17:29
nicolasbockThanks17:30
*** Bhujay has joined #openstack-ansible17:30
skiedudeodyssey4me: if I set a DNS name for the external_lb_vip_address, but I'm using keepalived, won't I still need to set a hard IP for `haproxy_keepalived_external_vip_cidr: "1.2.3.4/32"`17:30
odyssey4meyeah, you still need an IP - but using the name from the start will mean if you change the name later you won't have to update the service catalog17:31
odyssey4meI'm off for the evening. Chat to you all tomorrow!17:32
skiedudethanks for the assist17:32
*** mma has joined #openstack-ansible17:34
evrardjpodyssey4me: are you still there?17:42
evrardjpor I missed you?17:42
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible stable/rocky: Update all SHAs for final RC  https://review.openstack.org/60804217:44
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible master: Move release version to different file  https://review.openstack.org/60782517:45
*** Emine has joined #openstack-ansible17:51
noonedeadpunkevrardjp: oh, you're here. May you look on my patches https://review.openstack.org/#/c/605769/4 (I've updated it since I showed it to you) and https://review.openstack.org/#/c/607653/218:00
*** olivierb has joined #openstack-ansible18:01
*** olivierb has quit IRC18:01
*** pcaruana has quit IRC18:01
*** mma has quit IRC18:07
*** hamzaachi has joined #openstack-ansible18:09
*** kwu_83tw has quit IRC18:13
*** kwu83tw has quit IRC18:13
*** Bhujay has quit IRC18:20
*** macza has quit IRC18:25
*** macza has joined #openstack-ansible18:26
*** mma has joined #openstack-ansible18:41
*** dcdamien has quit IRC18:42
*** dcdamien has joined #openstack-ansible18:42
*** electrofelix has quit IRC18:51
evrardjpnoonedeadpunk: ok18:51
*** hamzaachi has quit IRC19:03
prometheanfireis the vagrantfile for os-tests actually used for anything?19:09
*** DanyC has quit IRC19:12
*** DanyC has joined #openstack-ansible19:12
*** DanyC has quit IRC19:17
openstackgerritDmitriy Rabotjagov (noonedeadpunk) proposed openstack/openstack-ansible-os_cinder master: Added volume usage collection, when cinder_ceilometer_enabled  https://review.openstack.org/60576919:19
*** hamzaachi has joined #openstack-ansible19:23
openstackgerritAlex Redinger proposed openstack/openstack-ansible-os_keystone master: Add memcache flushing handler on db migrations  https://review.openstack.org/60806619:44
openstackgerritWayne Warren proposed openstack/openstack-ansible-ops master: Make OSA repo clone optional  https://review.openstack.org/60286119:44
*** mma has quit IRC20:02
*** mma has joined #openstack-ansible20:02
AJaegerevrardjp: could you review odyssey4me's change https://review.openstack.org/608035, please? that allows finishing import of zuul jobs for python3-first... I know it's still in check pipeline but I won't be around when it finishes ;)20:13
*** priteau has quit IRC20:15
evrardjpmnaser: could you vote on https://review.openstack.org/#/c/608035/1  please ?20:21
evrardjpor cloudnull ^20:21
evrardjpthanks AJaeger20:22
AJaegerthanks, evrardjp20:24
*** mma has quit IRC20:28
AJaegerevrardjp, odyssey4me, cloudnull - unfortunatley -1 by Zuul on https://review.openstack.org/#/c/608035/1 ;(20:34
*** hamzaachi has quit IRC20:34
*** priteau has joined #openstack-ansible20:35
*** macza has quit IRC20:40
*** macza has joined #openstack-ansible20:41
*** ansmith has quit IRC20:41
*** tosky has quit IRC20:42
*** tosky has joined #openstack-ansible20:43
*** hamzy_ has quit IRC20:44
*** kwu83tw has joined #openstack-ansible20:47
*** priteau has quit IRC20:48
*** kwu_83tw has joined #openstack-ansible20:48
*** strattao has quit IRC21:08
openstackgerritAlex Redinger proposed openstack/openstack-ansible-os_keystone master: Add memcache flushing handler on db migrations  https://review.openstack.org/60806621:18
*** DanyC has joined #openstack-ansible21:20
*** spatel has quit IRC21:34
*** skiedude has quit IRC22:08
*** ohsnap has quit IRC22:40
*** macza has quit IRC22:58
*** DanyC_ has joined #openstack-ansible23:03
*** DanyC has quit IRC23:06
prometheanfireis this setting up networkd, it's not the normal dir for that?  https://github.com/openstack/openstack-ansible-tests/blob/master/test-prepare-host.yml#L109-L11823:15
* prometheanfire doesn't see networkd in that file23:16
*** tosky has quit IRC23:17
openstackgerritMatthew Thode proposed openstack/openstack-ansible-tests master: add Gentoo jobs as non-voting  https://review.openstack.org/60810223:17
*** weezS has quit IRC23:19
openstackgerritjacky06 proposed openstack/openstack-ansible-os_cinder master: Switch include to include_tasks or import_playbook  https://review.openstack.org/58530723:58

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!