Wednesday, 2020-01-22

*** elduderino80 has joined #openstack-ansible00:00
*** hwoarang has quit IRC01:08
*** hwoarang has joined #openstack-ansible01:09
*** hwoarang has quit IRC01:26
*** hwoarang has joined #openstack-ansible01:27
*** gyee has quit IRC02:04
*** udesale has joined #openstack-ansible04:04
*** rh-jelabarre has quit IRC04:47
*** raukadah is now known as chandankumar04:50
*** evrardjp has quit IRC05:34
*** evrardjp has joined #openstack-ansible05:34
*** Jeffrey4l has quit IRC05:45
*** elenalindq has joined #openstack-ansible05:46
*** Jeffrey4l has joined #openstack-ansible05:46
*** shyamb has joined #openstack-ansible05:59
*** elenalindq has quit IRC06:14
*** elenalindq has joined #openstack-ansible06:25
*** shyamb has quit IRC06:38
*** shyamb has joined #openstack-ansible06:46
*** shyamb has quit IRC07:11
*** ivve has quit IRC07:30
*** rpittau|afk is now known as rpittau07:37
*** elduderino80 has quit IRC08:18
*** jbadiapa has quit IRC08:23
*** tosky has joined #openstack-ansible08:27
*** jftalta has joined #openstack-ansible08:37
*** ivve has joined #openstack-ansible08:37
openstackgerritJonathan Rosser proposed openstack/openstack-ansible-os_tempest master: Use correct pip executable for mixed distro/source installs  https://review.opendev.org/70362908:48
*** yolanda has quit IRC08:54
*** timmeyh has quit IRC08:58
*** yolanda has joined #openstack-ansible09:00
*** aedc has quit IRC09:21
evrardjpjrosser: do you have experience with molecule by any chance?09:43
*** DanyC has joined #openstack-ansible09:54
*** cshen has joined #openstack-ansible09:56
*** elenalindq has quit IRC09:59
openstackgerritDuncan Martin Walker proposed openstack/openstack-ansible-ops master: Module config updates in ELK 7x Metricbeat template  https://review.opendev.org/70375410:15
openstackgerritDuncan Martin Walker proposed openstack/openstack-ansible-ops master: Elastic beat index template configuration  https://review.opendev.org/70375510:16
openstackgerritDuncan Martin Walker proposed openstack/openstack-ansible-ops master: Expose interface configuration options for beat install  https://review.opendev.org/70375610:16
*** rohit02 has joined #openstack-ansible10:26
rohit02while deploying openstack ansible train getting this error " FAILED - RETRYING: Run nova-status upgrade check to validate a healthy configuration (1 retries left)"10:27
rohit02please help me on this10:30
*** L_SR has joined #openstack-ansible10:36
*** aedc has joined #openstack-ansible10:44
*** aedc has quit IRC10:49
*** shyamb has joined #openstack-ansible10:50
*** pcaruana has joined #openstack-ansible11:02
*** cshen_ has joined #openstack-ansible11:04
*** shyamb has quit IRC11:05
*** shyamb has joined #openstack-ansible11:05
*** cshen has quit IRC11:06
*** shyam89 has joined #openstack-ansible11:08
*** shyamb has quit IRC11:12
*** lkoranda has joined #openstack-ansible11:18
L_SRHello Community! Anyone with experience setting up SFC in neutron? I have a working OSA Train deployment with Openvswitch. Everything seems to be working fine up util I uncomment "sfc" from my neutron plugin list. I get different sorts of errors, from OpenFlow protocol mismatch on a OVS br-int in a compute node11:32
L_SR(https://pastebin.com/qUDuiQnWhttps://pastebin.com/qUDuiQnW), to losing heartbeats from Neutron agents at infra and computes. Am I missing some config? Thanks in advance11:32
L_SRSome additional facts: this is a lab environment, 1 infra 1 compute. Only VLAN as provider networks. All working OK until SFC plugin is activated in /etc/.../user_variables.yml11:33
L_SRAlso getting this error in the compute node when SFC is activated: https://pastebin.com/RGfBVAs1 (worths mentioning that I'm only using VLANs as provider networks with OVS)11:36
*** rpittau is now known as rpittau|bbl11:41
noonedeadpunkjrosser: regarding https://review.opendev.org/#/c/703629 - i think that inside venv only pip2 or pip3 can be present, and in both cases it should be symlinked to pip11:47
noonedeadpunklike pip version depends on python version inside venv11:48
noonedeadpunkah, disregard11:48
noonedeadpunkI just got the case11:48
noonedeadpunkrohit02: please check that you have placement service deployed11:52
noonedeadpunkit shiould be among keystone endpoints11:53
*** lkoranda has quit IRC11:53
jrossernoonedeadpunk: yes it’s for pip on the host11:53
jrosserdouble checking the conditionals and my understanding of the ansible pip module appreciated there11:54
noonedeadpunkrohit02: if it's not there - try defining https://opendev.org/openstack/openstack-ansible/src/branch/master/etc/openstack_deploy/conf.d/placement.yml.example and launching os-placement-install.yml11:55
noonedeadpunkjrosser: btw, I think your vote will be valid on https://review.opendev.org/#/c/703450/11:56
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible master: [DNM] Disable ansible cache  https://review.opendev.org/70362711:59
maharg101I have provided ceph_keyrings_dir and (vaulted) keyrings. It appears that TASK "Retrieve keyrings for openstack clients from ceph cluster" still attempts ssh to the ceph mons (which I can't allow). Is there a way round this ?12:04
*** udesale_ has joined #openstack-ansible12:04
noonedeadpunkjrosser: Like I was doing that tempest mixed setup, but I clean forgot where does tempest_mixed_setup come from...12:06
*** udesale has quit IRC12:07
jrossernoonedeadpunk: uh-oh http://codesearch.openstack.org/?q=tempest_mixed_setup&i=nope&files=&repos=12:11
noonedeadpunkI think I just didin't renamed it12:11
* jrosser puzzled12:11
noonedeadpunkIt should be tempest_plugin_install_source12:11
jrosserah right, i was unsure about the two of those being there12:11
jrosserwe should fix that in its own patch and rebase mine12:12
noonedeadpunkprobably we don't have any package key defined for tempest_plugins lol12:12
noonedeadpunkso "Install tempest plugins from packages" just never run?12:12
*** ivve has quit IRC12:12
jrossernoonedeadpunk: yes, i thought that whole task could probably be deleted12:18
jrosserbut another patch again i think for that :)12:18
*** shyam89 has quit IRC12:18
noonedeadpunktbh I'd leave it since we might have a usecase for it later:)12:19
* jrosser meeting overload this morning, will have some more time later12:19
jrosseryes, i decided to fix it in my patch even though it doesnt obviously do anything12:19
noonedeadpunk++12:19
jrossermaharg101: i'm not sure the fuctionality you want is in any of the stable branches?12:19
noonedeadpunkit might be backported to train actually...12:20
*** udesale_ has quit IRC12:21
*** udesale has joined #openstack-ansible12:21
noonedeadpunkno, https://review.opendev.org/#/c/671762/ is only for master....12:21
noonedeadpunkmaharg101: so this will be only for U, but you can probably cherry-pick this change12:22
maharg101ah12:22
*** lkoranda has joined #openstack-ansible12:22
jrossermaharg101: we have some quite good hooks for you having local forks of the ansible roles12:23
jrossertheres a few ways of doing that12:23
*** jawad_axd has joined #openstack-ansible12:24
maharg101thanks, I would appreciate any pointers on that12:25
jrossermaharg101: let me finish up my meetings and I’ll point you to some stuff12:32
maharg101jrosser: thanks I am having a look too, no rush :D12:32
*** zbr has quit IRC12:34
*** zbr has joined #openstack-ansible12:36
*** ivve has joined #openstack-ansible12:38
*** zbr has quit IRC12:46
*** zbr has joined #openstack-ansible12:48
*** rohit02 has quit IRC12:53
*** elenalindq has joined #openstack-ansible13:04
*** goldyfruit has joined #openstack-ansible13:04
*** elenalindq has quit IRC13:09
*** rh-jelabarre has joined #openstack-ansible13:10
*** DanyC has quit IRC13:11
*** elenalindq has joined #openstack-ansible13:15
*** rpittau|bbl is now known as rpittau13:20
*** elenalindq has quit IRC13:21
*** strattao has joined #openstack-ansible13:22
*** DanyC has joined #openstack-ansible13:24
*** DanyC has quit IRC13:25
*** zbr has quit IRC13:26
*** DanyC has joined #openstack-ansible13:26
noonedeadpunktheintern_: have a question regarding your paste - ceph_nfs_secret_key seems to be pretty important however I wasn't able to find this variable.13:27
*** zbr has joined #openstack-ansible13:30
openstackgerritJonathan Rosser proposed openstack/openstack-ansible stable/train: Document user-role-requirements.yml  https://review.opendev.org/70379013:31
jrossermaharg101: instead of explain it, i documented it :) https://review.opendev.org/70379013:31
jrosserL_SR: i think we have an SFC test in the os_neutron role CI, but maybe jamesdenton can advise?13:32
*** jbadiapa has joined #openstack-ansible13:33
L_SR@jrosser thanks for replying. I've been looking at the docs but a simple activation of the SFC neutron plugins breaks my neutron agents.13:33
maharg101jrosser: you are a star, thank you :)13:34
jrossermaharg101: let me know if its useful/works, we use that a lot here13:34
jrossergradually we need to backport/fix things on our deployment and user-role-requirements lets us keep that firmly under version control13:35
openstackgerritJonathan Rosser proposed openstack/openstack-ansible stable/train: Document user-role-requirements.yml  https://review.opendev.org/70379013:37
maharg101thanks noonedeadpunk I was able to cherry-pick that for now to get moving :)13:37
noonedeadpunkjrosser: shouldn't this ^ be for master?13:37
jrosserarrrgh yes you are right13:37
jamesdentonhellp13:37
jamesdentonhello13:37
*** L_SR has quit IRC13:37
openstackgerritJonathan Rosser proposed openstack/openstack-ansible master: Document user-role-requirements.yml  https://review.opendev.org/70379413:39
jrosserfixed13:39
jamesdentonL_SR I am not certain, but maybe vxlan networks are required for SFC?13:41
jamesdentoneh, n/m13:41
*** DanyC has quit IRC13:42
jrosseroh he left :(13:42
jamesdentonyeah13:42
*** DanyC has joined #openstack-ansible13:44
*** lkoranda has quit IRC13:44
jamesdentonthis implies that VXLAN or GRE is required: https://docs.openstack.org/networking-sfc/latest/contributor/ovs_driver_and_agent_workflow.html. Our docs could prob better call that out13:45
maharg101jrosser: local fork documentation is very useful thanks again13:45
*** lkoranda has joined #openstack-ansible13:45
*** shyamb has joined #openstack-ansible13:48
*** elenalindq has joined #openstack-ansible13:49
*** lkoranda has quit IRC13:50
*** lkoranda has joined #openstack-ansible13:53
*** elenalindq has quit IRC13:54
*** sshnaidm is now known as sshnaidm|mtg13:55
strattaoHey folks, hope all is well! I’ve been going through the backlog of posts here for the past few weeks… How come I haven’t seen any complaints from the deprecation of python2? Our offline builds are failing at the install pip_install step of setup-hosts. We get a “setuptools requires Python '>=3.5' but the running Python is 2.7.12” error. Doesn’t make sense to me though about why that is happening? I thought pip setuptools and wheel13:55
strattaoglobally pinned to specific versions? When I explicitly set those specific versions in user_variables.yml, then it fails with the same python error in the repo container… @jrosser any ideas if the offline install would give some grief like that?13:55
*** elenalindq has joined #openstack-ansible14:00
jrosserstrattao: o/ hello14:01
*** gafur has joined #openstack-ansible14:02
strattao\o :)14:02
jrosserthats interesting14:02
jrosserwhich branch are you using?14:02
jrosserand is there a particular version of setuptools involved there (45.0.0 springs to mind immediately as problematic)14:03
jrosseror was it 44.0.0, hmm14:03
strattaoran a test against stable/rocky stable/queens and stable/pike yesterday14:03
strattaoyeah, setuptools recently made a change on Jan 1 to remove any support for python 2 in 44.0.014:04
jrosserthere are some interesting things here https://github.com/pypa/pip/issues/758614:06
strattaobut I don’t know why it’s trying to install the latest version anyways…. I thought that was globally pinned to 39.0.1 in OSA…14:06
jrosserhow do you mirror/cache your python wheels14:06
strattaowe’ve got a couple offline repositories, we’re using devpi in our dev environment, but this is hitting us in production too…14:07
strattaofortunatly, only in a “test” region there, but still...14:08
strattaoOooh, good insight on that link though… I didn’t look at the wheels14:09
jrosserthe openstack CI fell victim to this becasue of the way the wheels were served14:09
jrosserpypi adds metadata14:09
jrossera simple apache doesnt, then pip falls back to looking at things like 'py2.py3' in the filenames14:10
jrosserand that can cause trouble if the packages arent described / named appropriately14:10
jrosserstrattao: i don't know if thats enough pointers for you to investigate further, otherwise some logs from your tests would be helpful14:14
openstackgerritDuncan Martin Walker proposed openstack/openstack-ansible-ops master: Module config updates in ELK 7x Metricbeat template  https://review.opendev.org/70375414:17
strattaoNo, I think that’s helpful! Will do some more digging into our mirror and check on the deltas. Will come back with some logs if we’re still stuck. Thanks for your help!14:17
*** lkoranda has quit IRC14:24
*** gafur has quit IRC14:24
*** shyamb has quit IRC14:43
openstackgerritJonathan Rosser proposed openstack/openstack-ansible-os_tempest stable/train: Use contraints for tempest plugins  https://review.opendev.org/70360714:44
openstackgerritMarc Gariépy (mgariepy) proposed openstack/openstack-ansible-openstack_hosts master: Fix kernel module for kernel > 5.0.0  https://review.opendev.org/70380614:45
jrossercould i get reviews on this please https://review.opendev.org/#/c/703569/214:46
mgariepylgtm14:47
*** jftalta has quit IRC14:57
*** jawad_axd has quit IRC15:08
*** jawad_axd has joined #openstack-ansible15:09
*** chandankumar is now known as chkumar|ruck15:10
openstackgerritMerged openstack/openstack-ansible-os_tempest stable/stein: Use contraints for tempest plugins  https://review.opendev.org/70345015:12
*** jawad_axd has quit IRC15:16
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible stable/stein: Bump SHAs for stable/stein  https://review.opendev.org/70213415:17
*** chkumar|ruck is now known as chkumar|rover15:23
maharg101noonedeadpunk: the commit I cherry-picked earlier has a bug; I've raised a bug at https://bugs.launchpad.net/openstack-ansible/+bug/1860572 with a patch that has worked for me.15:28
openstackLaunchpad bug 1860572 in openstack-ansible "Importing ceph keyrings from files fails" [Undecided,New]15:28
noonedeadpunkmaharg101: so the fix is to set delegate_facts ?15:29
maharg101also to define _keys as {}, and s/item/client/ - see the patch15:30
noonedeadpunkah, yes15:33
maharg101:)15:33
*** luksky has joined #openstack-ansible15:33
noonedeadpunkmaharg101: actually you can like push patches if you found bug (and allowed by your company policies)15:34
noonedeadpunkBut even submitting such bugs are very important15:34
maharg101noonedeadpunk: I will need to read up on contributor guidelines, but yes15:35
*** chkumar|rover is now known as raukadah15:35
noonedeadpunkIt's pretty easy - you need gerrit account https://review.opendev.org (and place your public ssh key in it) , install git-review module and configure it. Then you clone repo, do branch, edit it and do `git review`15:36
*** sshnaidm|mtg is now known as sshnaidm15:37
noonedeadpunkwhen bug is defined you should set in commit message "Closes-Bug: 1860572"15:37
openstackbug 1860572 in openstack-ansible "Importing ceph keyrings from files fails" [Undecided,New] https://launchpad.net/bugs/186057215:37
*** Nick_A has joined #openstack-ansible15:38
noonedeadpunkmaharg101: would you like to try it with this bug, or should I just apply your patch and place it?15:38
maharg101noonedeadpunk: please go ahead and apply yourself, I will need to read contributor guidelines in slow time :)15:39
maharg101but thanks for the précis15:40
*** elenalindq has quit IRC15:43
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-ceph_client master: Fix facts gathering for "from files" scenario  https://review.opendev.org/70382415:44
noonedeadpunkmaharg101: ^15:44
noonedeadpunkthanks for your help15:45
maharg101noonedeadpunk: np and ty too15:45
*** goldyfruit has quit IRC15:48
*** goldyfruit has joined #openstack-ansible15:48
openstackgerritDuncan Martin Walker proposed openstack/openstack-ansible-ops master: Module config updates in ELK 7x Metricbeat template  https://review.opendev.org/70375415:49
*** cshen_ has quit IRC16:08
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible master: Add ceph-mds and ceph-nfs setup  https://review.opendev.org/70242416:14
*** gyee has joined #openstack-ansible16:16
*** ivve has quit IRC16:28
*** tosky has quit IRC16:31
*** luksky has quit IRC16:47
*** macz has joined #openstack-ansible16:52
*** rpittau is now known as rpittau|afk17:03
*** udesale has quit IRC17:05
*** strattao has quit IRC17:19
*** strattao has joined #openstack-ansible17:19
*** sshnaidm is now known as sshnaidm|afk17:27
*** evrardjp has quit IRC17:34
*** evrardjp has joined #openstack-ansible17:34
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible master: [WIP] Add manila tempest testing  https://review.opendev.org/67465317:35
strattaojrosser - Thanks for the pointer. Our mirror was indeed not handling the metadata correctly. That’s beem resolved and now we’re back in business. Thanks again!17:36
jrosserawesome!17:36
openstackgerritMerged openstack/openstack-ansible master: Install appropriate tempest releases on stable branches  https://review.opendev.org/70356917:47
*** jawad_axd has joined #openstack-ansible17:48
*** jawad_axd has quit IRC17:52
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-os_manila master: Add manila CI  https://review.opendev.org/67593417:54
*** DanyC has quit IRC17:59
openstackgerritJonathan Rosser proposed openstack/openstack-ansible-os_tempest master: Use correct pip executable for mixed distro/source installs  https://review.opendev.org/70362918:01
openstackgerritJonathan Rosser proposed openstack/openstack-ansible-os_tempest master: Fix mixed plugin install vars  https://review.opendev.org/70385318:01
*** jawad_axd has joined #openstack-ansible18:08
*** spotz has joined #openstack-ansible18:12
*** jawad_axd has quit IRC18:19
*** goldyfruit has quit IRC18:24
*** goldyfruit has joined #openstack-ansible18:24
*** jbadiapa has quit IRC18:32
*** jbadiapa has joined #openstack-ansible18:37
*** aedc has joined #openstack-ansible18:39
*** jbadiapa has quit IRC18:46
*** luksky has joined #openstack-ansible19:13
*** goldyfruit has quit IRC19:27
*** theintern_ has joined #openstack-ansible19:32
*** theintern_ has quit IRC19:39
mgariepycan i have some review on this one: https://review.opendev.org/#/c/703806/19:45
openstackgerritJonathan Rosser proposed openstack/openstack-ansible stable/train: Install appropriate tempest releases on stable branches  https://review.opendev.org/70357219:46
jrossermgariepy: done19:47
*** goldyfruit has joined #openstack-ansible19:48
*** theintern_ has joined #openstack-ansible19:50
mgariepythanks19:55
mgariepymaybe it would be better to load what is needed and leave dependency resolution to modules directly.19:56
*** aedc has quit IRC20:01
*** aedc has joined #openstack-ansible20:01
*** szaher has quit IRC20:03
openstackgerritJonathan Rosser proposed openstack/openstack-ansible-os_tempest stable/train: Use contraints for tempest plugins  https://review.opendev.org/70360720:06
*** szaher has joined #openstack-ansible20:09
*** aedc has quit IRC20:19
*** aedc has joined #openstack-ansible20:19
*** elenalindq has joined #openstack-ansible20:21
*** aedc_ has joined #openstack-ansible20:25
*** aedc has quit IRC20:28
*** strattao has quit IRC20:42
*** mgariepy has quit IRC20:46
*** goldyfruit has quit IRC20:58
jrossercan i have some reviews here https://review.opendev.org/#/c/703853/120:59
*** goldyfruit has joined #openstack-ansible20:59
*** theintern_ has quit IRC21:06
*** pcaruana has quit IRC21:07
*** goldyfruit has quit IRC21:15
*** goldyfruit has joined #openstack-ansible21:16
openstackgerritJonathan Rosser proposed openstack/openstack-ansible-os_tempest master: Use correct pip executable for mixed distro/source installs  https://review.opendev.org/70362921:26
spotzjrosser: looking21:28
jrosserawesome thankyou21:29
spotzdone and my pleasure21:30
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible master: [WIP] Add manila tempest testing  https://review.opendev.org/67465321:54
*** goldyfruit_ has joined #openstack-ansible22:01
*** goldyfruit has quit IRC22:02
*** aedc_ has quit IRC22:26
*** goldyfruit_ has quit IRC22:34
*** goldyfruit_ has joined #openstack-ansible22:35
*** elenalindq has quit IRC22:35
*** goldyfruit has joined #openstack-ansible22:41
*** goldyfruit_ has quit IRC22:42
*** hwoarang has quit IRC23:38
*** hwoarang has joined #openstack-ansible23:45
openstackgerritMerged openstack/openstack-ansible-os_tempest master: Fix mixed plugin install vars  https://review.opendev.org/70385323:53

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!