Tuesday, 2020-01-21

*** DanyC has quit IRC00:39
*** macz has joined #openstack-ansible02:15
*** macz has quit IRC02:20
*** goldyfruit has quit IRC02:30
*** hwoarang has quit IRC03:39
*** hwoarang has joined #openstack-ansible03:40
*** goldyfruit has joined #openstack-ansible04:34
*** udesale has joined #openstack-ansible04:44
*** udesale has quit IRC04:44
*** udesale has joined #openstack-ansible04:44
*** shyamb has joined #openstack-ansible05:19
*** macz has joined #openstack-ansible05:20
*** macz has quit IRC05:22
*** evrardjp has quit IRC05:34
*** evrardjp has joined #openstack-ansible05:34
*** udesale_ has joined #openstack-ansible05:34
*** udesale has quit IRC05:37
*** raukadah is now known as chandankumar05:45
*** shyamb has quit IRC06:00
*** yolanda has quit IRC06:04
*** elenalindq has joined #openstack-ansible06:09
*** shyamb has joined #openstack-ansible06:12
*** shyamb has quit IRC06:52
*** miloa has joined #openstack-ansible07:11
*** yolanda has joined #openstack-ansible07:25
*** yolanda has quit IRC07:33
*** yolanda has joined #openstack-ansible07:34
*** shyamb has joined #openstack-ansible07:36
*** shyamb has quit IRC07:47
*** yolanda has quit IRC07:48
*** cshen has joined #openstack-ansible08:10
*** yolanda has joined #openstack-ansible08:21
*** shyamb has joined #openstack-ansible08:33
*** alti_17 has joined #openstack-ansible08:43
*** rpittau|afk is now known as rpittau08:48
*** tosky has joined #openstack-ansible09:07
*** goldyfruit has quit IRC09:11
arxcruzzbr|drover: around? How can I switch the shell from /bin/sh to /bin/bash in the shell module, globally? I just notice some tasks are failing because it's using /bin/sh and set -o pipefail only works on /bin/bash09:25
arxcruzand I don't want to put  args: executable: /bin/bash in all the calls09:25
zbr|droverthat is the only way09:25
zbr|droverbut is safe09:25
zbr|drovernot sure if possible globally but even possible you do not want it09:26
zbr|droverthere are systems that do not even have bash, if you need bash, be explicit about it.09:26
arxcruzi get the ansible_shell_executable09:26
zbr|droverdon't!09:26
arxcruzok09:26
zbr|droveri am saving your time09:26
arxcruzzbr|drover: what do you sugest?09:27
zbr|drovershow me the problematic place09:27
*** yolanda has quit IRC09:27
*** udesale_ has quit IRC09:28
arxcruzzbr|drover: 2020-01-20 12:50:45.245154 | ubuntu-bionic | /bin/sh: 1: set: Illegal option -o pipefail09:28
arxcruzzbr|drover: https://cb75b9f7de79cf5dfd82-897b9d2399687d2e3ad3e42a5a58dea8.ssl.cf2.rackcdn.com/702676/6/check/openstack-ansible-varstest-aio/ca87f1e/job-output.txt09:28
*** udesale_ has joined #openstack-ansible09:28
arxcruzthere are several other places but mostly have the option to skip if failing09:28
zbr|droveryeah, because you run on ubuntu, where default shell is not bash. but it has bash, be explicit. also raise a bug on ansible-lint to update the documentation, so we mention how to fix it.09:31
zbr|droveri am amazed that they did not add this to dash yet, https://askubuntu.com/questions/886537/set-e-o-pipefail-not-working-on-bash-script-on-ubuntu-1609:32
*** DanyC has joined #openstack-ansible09:32
zbr|droverif you raise the linter feature request, i will fix it.09:32
zbr|droveri made that mistake myself many times.09:33
*** yolanda has joined #openstack-ansible09:33
*** DanyC has quit IRC09:33
zbr|droverthis is also a reminder that we should always test cross-platform roles with two platforms at minimum, prob centos and ubuntu.09:34
zbr|droverbut if i update the linting rule to also raise when executable is not mentioned, we will be fine.09:34
zbr|droveri already had an idea about to do it nicely, with example on console.09:35
*** DanyC has joined #openstack-ansible09:35
arxcruzzbr|drover: the issue already exists https://github.com/ansible/ansible-lint/issues/49709:43
*** yolanda has quit IRC09:49
*** DanyC has quit IRC09:52
openstackgerritJonathan Rosser proposed openstack/openstack-ansible master: Install appropritate tempest releases on stable branches  https://review.opendev.org/70356909:53
openstackgerritJonathan Rosser proposed openstack/openstack-ansible master: Install appropriate tempest releases on stable branches  https://review.opendev.org/70356909:55
*** shyamb has quit IRC09:58
openstackgerritJonathan Rosser proposed openstack/openstack-ansible stable/train: Install appropriate tempest releases on stable branches  https://review.opendev.org/70357209:59
*** DanyC has joined #openstack-ansible09:59
openstackgerritJonathan Rosser proposed openstack/openstack-ansible stable/stein: Install appropriate tempest releases on stable branches  https://review.opendev.org/70357310:00
openstackgerritJonathan Rosser proposed openstack/openstack-ansible stable/stein: Install appropriate tempest releases on stable branches  https://review.opendev.org/70357310:02
*** ivve has joined #openstack-ansible10:07
openstackgerritkourosh vivan proposed openstack/openstack-ansible-rabbitmq_server master: Add NODENAME in rabbitmq env  https://review.opendev.org/70357710:09
*** openstackgerrit has quit IRC10:12
*** shyamb has joined #openstack-ansible10:21
*** openstackgerrit has joined #openstack-ansible10:24
openstackgerritArx Cruz proposed openstack/openstack-ansible master: DNM - POC - Collect logs  https://review.opendev.org/70267610:24
*** CeeMac has joined #openstack-ansible10:43
*** goldyfruit has joined #openstack-ansible10:47
*** udesale_ has quit IRC10:51
openstackgerritArx Cruz proposed openstack/openstack-ansible master: DNM - POC - Collect logs  https://review.opendev.org/70267610:57
*** shyamb has quit IRC11:06
*** goldyfruit has quit IRC11:10
*** shyamb has joined #openstack-ansible11:12
*** rpittau is now known as rpittau|bbl11:15
maharg101openstack-ansible appears to not respect the log_path setting in /etc/ansible/ansible.cfg - I was expecting to see the output from `/usr/local/bin/openstack-ansible setup-infrastructure.yml` et al in the log file.. What am I missing ?11:20
*** rodolof has quit IRC11:30
*** alti_17 has quit IRC11:42
openstackgerritArx Cruz proposed openstack/openstack-ansible master: DNM - POC - Collect logs  https://review.opendev.org/70267611:47
jrossermaharg101: you will find the log in /openstack/log/ansible-logging/ansible.log11:53
jrosserthat is controlled by the settings in /usr/local/bin/openstack-ansible.rc11:54
maharg101jrosser: thank you that is great12:00
noonedeadpunko/12:02
*** aedc has quit IRC12:09
*** aedc has joined #openstack-ansible12:09
*** yolanda has joined #openstack-ansible12:10
*** yolanda has quit IRC12:10
*** yolanda has joined #openstack-ansible12:11
*** aedc has quit IRC12:20
*** aedc has joined #openstack-ansible12:20
*** DanyC has quit IRC12:25
*** alti_17 has joined #openstack-ansible12:40
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible master: [WIP] Add manila tempest testing  https://review.opendev.org/67465312:48
*** shyamb has quit IRC12:48
*** nicolasbock has joined #openstack-ansible12:50
*** udesale has joined #openstack-ansible12:59
*** DanyC has joined #openstack-ansible12:59
openstackgerritJonathan Rosser proposed openstack/openstack-ansible-os_tempest stable/train: Use contraints for tempest plugins  https://review.opendev.org/70360713:02
openstackgerritJonathan Rosser proposed openstack/openstack-ansible stable/train: Install appropriate tempest releases on stable branches  https://review.opendev.org/70357213:03
*** rpittau|bbl is now known as rpittau13:05
openstackgerritJonathan Rosser proposed openstack/openstack-ansible stable/stein: Bump ansible version to 2.7.16  https://review.opendev.org/70339113:09
*** jbadiapa has joined #openstack-ansible13:09
openstackgerritJonathan Rosser proposed openstack/openstack-ansible stable/stein: Remove log compression before upload  https://review.opendev.org/70336313:09
*** zbr|drover has quit IRC13:18
openstackgerritJonathan Rosser proposed openstack/openstack-ansible-rabbitmq_server master: Bump rabbitmq version to 3.8.2 and erlang to 22.2.2  https://review.opendev.org/70339413:18
*** zbr has joined #openstack-ansible13:19
*** DanyC has quit IRC13:20
*** ansmith has joined #openstack-ansible13:27
openstackgerritJonathan Rosser proposed openstack/openstack-ansible-os_tempest stable/stein: TEMPORARY: Hardwire stein branch upper constraints URL  https://review.opendev.org/70361513:43
openstackgerritJonathan Rosser proposed openstack/openstack-ansible-os_tempest stable/stein: Revert "TEMPORARY: Hardwire stein branch upper constraints URL"  https://review.opendev.org/70361713:45
*** DanyC has joined #openstack-ansible13:45
*** lvdombrkr has joined #openstack-ansible14:03
*** ansmith_ has joined #openstack-ansible14:19
jrosserurgh https://fa41a0ce81614565dae6-7ca08d7dc339532aeab9467cc90f03e8.ssl.cf1.rackcdn.com/702853/3/check/openstack-ansible-deploy-aio_distro_metal-ubuntu-bionic/3f22109/logs/ara-report/result/c8fdcf86-6c90-4806-93d4-73953c6dd9bb/14:20
jrosserwe're installing tempest plugins on master/ubuntu/distro with pip214:20
*** ansmith has quit IRC14:22
cshenso we need pip3?14:23
jrosseri expect so, but the ansible pip module has made that choice for us14:23
cshenin my last week work, I found setuptools 45.0.0 doesn't support Python2, either.14:24
jrosseryes there was a lot of trouble with that14:25
*** mgariepy has joined #openstack-ansible14:37
openstackgerritDuncan Martin Walker proposed openstack/openstack-ansible-ops master: Updates to ELK_metrics_7x beat installation  https://review.opendev.org/70362514:38
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible master: [DNM] Disable ansible cache  https://review.opendev.org/70362714:40
openstackgerritJonathan Rosser proposed openstack/openstack-ansible-os_tempest master: Use correct pip executable for mixed distro/source installs  https://review.opendev.org/70362914:41
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-ops master: Stop using the ubuntu trusty nodeset  https://review.opendev.org/68284114:41
openstackgerritJonathan Rosser proposed openstack/openstack-ansible-os_tempest master: Use correct pip executable for mixed distro/source installs  https://review.opendev.org/70362915:05
arxcruzjrosser: i'll wait for the jobs finish to +1 ^15:07
jrosserarxcruz: sure no worries, i have a mass of patches there15:07
jrosserbig mess :/15:08
*** electrofelix has joined #openstack-ansible15:16
openstackgerritDuncan Martin Walker proposed openstack/openstack-ansible-ops master: Updates to ELK_metrics_7x beat installation  https://review.opendev.org/70362515:16
*** electrofelix has quit IRC15:31
*** electrofelix has joined #openstack-ansible15:36
*** electrofelix has quit IRC15:36
*** electrofelix has joined #openstack-ansible15:36
*** cshen has quit IRC15:44
*** chandankumar is now known as raukadah15:48
*** udesale has quit IRC15:59
*** openstackgerrit has quit IRC16:13
*** lvdombrkr has quit IRC16:28
jrosserevrardjp: do you know if there is a good reason why OSA does not pick up the zuul provided git repos for glance, cinder, blah blah in the CI jobs?16:29
*** miloa has quit IRC16:31
evrardjpmaster branch?16:31
*** macz has joined #openstack-ansible16:31
evrardjpin any case we should be git cloning what's zuul knows16:31
evrardjp-'s16:32
evrardjpelse how would the depends-on work?16:32
evrardjpnot sure if that's your question16:32
jrosserno, i mean more for cinder itself16:32
jrosserrather than os-cinder16:32
jrosserevrardjp: so for example here we try to clone from opendev.org for a service https://7727e75b0735fce8b288-3578f4b3c7df6e8f4dbcf87a4a72da28.ssl.cf1.rackcdn.com/703389/1/check/openstack-ansible-deploy-aio_lxc-ubuntu-bionic/0eedacd/logs/ara-report/result/0adb4a8b-f1fd-4c28-8697-e9bc44161742/16:33
*** tosky has quit IRC16:33
evrardjpoh yeah you mean why do we freeze components ?16:34
jrossernot really, the git repos are in the CI node from zuul16:34
jrosserbut still we clone from opendev.org as specified here https://github.com/openstack/openstack-ansible/blob/master/playbooks/defaults/repo_packages/openstack_services.yml16:35
evrardjpwell we want a stable build, not a latest build, as it's already tested by other upstream things. We are only integrating16:35
*** alti_17 has quit IRC16:35
evrardjpcorrect16:35
evrardjpoh you mean that you don't want to use the pip wheel from a remote location, but rely on a local git checkout?16:36
jrosserno16:36
jrosser:)16:36
jrosserthe git repos themselves16:36
evrardjpdamn I am not sure what you mean :p16:36
jrosserwe list all the openstack service git repos in openstack_services.yml16:37
jrosserand they point to opendev.org git servers16:37
jrosserthose repos also exist on the CI nodes courtesy of zuul16:37
evrardjpyes but these aren't the zuul provided copies, because the projects are not in required projects16:37
evrardjpand we can't assume they will be on the location we expect16:38
evrardjpdo we?16:38
jrosserok, and is there a good reason why we don't do that?16:38
evrardjpwell, if you add cinder in the required projects, you'll have master cinder available on the node we receive for the CI16:38
evrardjpor cinder HEAD of branch I mean16:39
*** gyee has joined #openstack-ansible16:39
evrardjpwhich is not necessarily the stable version16:39
evrardjpor the tagged version16:39
evrardjphere it's easy, we test at the bump. If the bump fails, we know the code is broken, and therefore we can adjust16:39
evrardjpit brings us stability16:39
evrardjpbut that can be changed of16:39
evrardjpofc*16:39
evrardjpwe could then just push those git repos into the repo-server16:40
jrosserinfra are asking why we hit their git server when same repos are on the CI node16:40
evrardjpha that's why you're asking :)16:41
jrosseryes, i am looking for the reason we never did that16:41
evrardjpwell16:41
jrosserbut for many many other things all the infra mirrors/etc are used16:41
evrardjpit's far before the zuul v3 area16:41
evrardjpwhat we could do, is having a pre-run playbook that checks out the version of the git repo with the version provided in openstack_services16:42
evrardjpso no cloning is necessary16:42
evrardjpbut then we are further away of what a user would do16:42
evrardjpbecause not everyone runs in zuul :p16:42
jrosseryes16:42
evrardjpI think it's a good convo for the meeting, and ppl can decide :)16:43
evrardjpit has pros and cons16:43
noonedeadpunkbtw it should be meeting time, but I've missed it:(16:44
evrardjpI proposed LONG ago to move to tags instead of shas for those repos, because it would be far simpler to fetch too16:44
evrardjpand reduce size if shallow are used.16:45
evrardjpbut it was more than once that I was bitten by this, so ... there was no urgency to change this.16:45
evrardjpjrosser: on top of the pre-run playbook, there needs to have a sync from the base node to the repo server node. And that's also super annoying :p16:46
evrardjpthough currently IIRC the repo-server node can be anything, including localhost, correct?16:47
evrardjpI am so has-been16:47
evrardjp:p16:47
jrosserwould wrangling the openstack_services.yml data to be file:///<> rather that https://<> be a quick win16:48
noonedeadpunkonly for ci?16:49
jrosser^ on the fly, conditionally on being in CI16:49
jrosserthats horrid actually, it's just a flat list of vars16:50
noonedeadpunkmaybe we can create another file for CI and include it conditionally instead of that one...16:51
*** openstackgerrit has joined #openstack-ansible16:51
openstackgerritDuncan Martin Walker proposed openstack/openstack-ansible-ops master: Updates to ELK_metrics_7x beat installation  https://review.opendev.org/70362516:51
noonedeadpunkor after that one to override just urls16:51
evrardjpthe openstack_services had to be a flat list of vars, for two reasons: ease of overriding only a single variable, and to be able to be easily read by py_pkgs lookup, which don't exist anymore16:53
evrardjpIt could as well be updated nowadays indeed16:53
jrossergiven that py_packages has gone we could easily factor out the base part of the url16:54
jrosserin fact thats a kinda cool feature16:56
jrosserbecasue you could have one var in userspace which would swing the whole lot over to local git repos, if a deployer wanted16:56
evrardjpto have a clone locally to use?16:56
evrardjpoh you mean just the base path?16:57
jrosseryeah16:57
evrardjpthat's super annoying for release management16:57
evrardjpbecause now the bump system needs to be templating like ansible would :p16:57
evrardjpbut all of this is possible16:57
evrardjpfor me the cleanest would be to ensure that localhost have the git repos to the right version with the openstack_services in the bootstrap steps. Which means on openstack CI you could already have it there checked out. Then it means the repo-server would just take it from a known location, always from git+file:.16:59
evrardjpmakes it simple to me, and makes the offline story easier: just put everything at the bootstrap location17:00
jrossermaybe, the deploy host isnt the best choice17:01
evrardjpwell that's what you are suggesting in CI :p17:01
evrardjparen't you?17:01
evrardjpor did I get that wrong?17:01
evrardjpSorry I am in a different meeting at the same time, so it's not always easy17:02
jrosserno worries, i will think more17:02
jrosserit depends if we make a CI band-aid or or more general thing to support offline installs17:02
evrardjpIt's a design decision that the community has to make17:02
evrardjpI am not sure what the problem really is though.17:03
openstackgerritDuncan Martin Walker proposed openstack/openstack-ansible-ops master: Updates to ELK_metrics_7x beat installation  https://review.opendev.org/70362517:03
evrardjpI mean those are nice things and improvements17:03
evrardjpbut I don't see a broken design there17:03
evrardjpjust design tradeoffs :p17:03
evrardjpwhich can be changed at any time17:04
*** rpittau is now known as rpittau|afk17:04
jrossernoonedeadpunk: change of subject slightly but i have a stack of patches which dig stein out of this tempest hole https://review.opendev.org/#/c/703573/217:09
jrosserjust need to figure out how to merge them as it's all somewhat circular17:10
*** DanyC has quit IRC17:12
noonedeadpunkjrosser: indeed... maybe we just comment out tempest neutron installation?17:15
noonedeadpunkand then revert it back, since fix is found?17:15
jrosseri made a start here https://review.opendev.org/#/c/703615/17:15
jrosserto hardwire the var that would have been set in the integrated repo17:15
jrosserbut i think i need to squash your change into that too17:16
jrosserbut yes disabling the neutron plugin temporarily is also completely do-able17:16
*** DanyC has joined #openstack-ansible17:18
noonedeadpunkjrosser: but it fails at the exactly same step horrid17:29
noonedeadpunkhttps://zuul.opendev.org/t/openstack/build/a5fba32b219a463bbdba9d7b03ecaf83/log/job-output.txt#1045717:29
noonedeadpunkwhy only ubuntu though...17:30
openstackgerritDuncan Martin Walker proposed openstack/openstack-ansible-ops master: Updates to ELK_metrics_7x beat installation  https://review.opendev.org/70362517:32
*** evrardjp has quit IRC17:34
*** evrardjp has joined #openstack-ansible17:34
jrossernoonedeadpunk: i think that because i need to squash https://review.opendev.org/#/c/703450/ and https://review.opendev.org/#/c/703629/ all into the same patch17:45
jrosseri really don't like this17:45
*** yolanda has quit IRC17:52
*** yolanda has joined #openstack-ansible17:54
*** DanyC_ has joined #openstack-ansible17:56
openstackgerritJonathan Rosser proposed openstack/openstack-ansible-os_tempest stable/stein: Use contraints for tempest plugins  https://review.opendev.org/70345017:56
*** DanyC_ has quit IRC17:57
*** DanyC has quit IRC17:59
*** macz has quit IRC18:03
noonedeadpunkjrosser: yeah, me too... sorry for not being really helpfull - working hard on manila stuff...18:10
jrosserI’ll concentrate on stein first18:10
jrossermaster and train are too different18:11
noonedeadpunkyep, but at least they are not broken (btw wondering why rocky works)18:28
*** electrofelix has quit IRC18:34
*** CeeMac has quit IRC18:51
jrosserwtf https://e1b7c5837d1435fd98ed-957e0323e7657520e3a7352c7d8ac713.ssl.cf5.rackcdn.com/703450/2/check/openstack-ansible-deploy-aio_metal-centos-7/ed7aa5b/logs/ara-report/result/8368bfe4-697e-4e7b-8aa3-66224d49c357/19:05
*** tosky has joined #openstack-ansible19:25
cjloadernoonedeadpunk: there anyway we can backport manilla stuff to Train? cc theintern_19:40
*** theintern_ has joined #openstack-ansible19:42
cjloadertheintern_: ^19:44
cjloadermanila***19:52
theintern_yup, I just don't have scroll back so I can't see what's been said19:53
*** nicolasbock has quit IRC19:57
theintern_so, the stuff I wrote was for train19:58
theintern_the tasks are a little broken (like having to manually create the ssh keys for the manila user), but the general process works.19:59
openstackgerritJonathan Rosser proposed openstack/openstack-ansible-os_tempest stable/stein: Use contraints for tempest plugins  https://review.opendev.org/70345020:00
theintern_I think I documented the workarounds in that doc I shared before20:00
jrossercjloader: new functionality is not backported20:06
cjloaderok20:06
cjloaderjust askin20:07
cjloadertheintern_: ^20:07
jrosserit's worth knowing the stuff in here https://docs.openstack.org/project-team-guide/stable-branches.html20:07
jrosserwhich is why patches to master are always preferable20:07
*** yolanda has quit IRC20:29
*** yolanda has joined #openstack-ansible20:30
*** yolanda has quit IRC20:46
*** elenalindq has quit IRC20:47
*** yolanda has joined #openstack-ansible20:50
*** ansmith has joined #openstack-ansible21:02
*** theintern_ has quit IRC21:02
*** ansmith_ has quit IRC21:04
*** DanyC has joined #openstack-ansible21:24
*** ansmith has quit IRC21:32
jrossercores: our stein branch is broken by a new release of neutron lib which is py3 only, and this is pulled in by the neutron tempest plugin22:15
jrosserthis patch fixes it and is ready for review https://review.opendev.org/#/c/703450/322:16
jrosserthis is a depends-on that patch https://review.opendev.org/#/c/703573/ which contains a full explanation in the commit message22:17
jrosserthe second patch will allow the temporary hardwiring of the u-c url in the first patch to be reverted, and its done like this because the dependancy is circular22:18
openstackgerritJonathan Rosser proposed openstack/openstack-ansible-os_tempest master: Use correct pip executable for mixed distro/source installs  https://review.opendev.org/70362922:24
*** hwoarang has quit IRC22:28
*** hwoarang has joined #openstack-ansible22:30
*** ansmith has joined #openstack-ansible22:38
*** DanyC has quit IRC22:58
*** tosky has quit IRC23:47

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!