Friday, 2017-12-22

« Thursday, 2017-12-21 Index Saturday, 2017-12-23 »
*** derekh has joined #tripleo00:06
*** ooolpbot has joined #tripleo00:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION00:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/173968600:10
openstackLaunchpad bug 1739686 in tripleo "Packaging: Gnocchi renaming broke systemd services" [Critical,In progress] - Assigned to Pradeep Kilambi (pkilambi)00:10
*** ooolpbot has quit IRC00:10
*** gvrangan has joined #tripleo00:10
*** rlandy|ruck has quit IRC00:15
*** gvrangan has quit IRC00:16
*** gvrangan has joined #tripleo00:17
*** gvrangan has quit IRC00:21
*** rbrady has quit IRC00:22
*** jobewan has quit IRC00:27
*** derekh has quit IRC00:27
*** gvrangan has joined #tripleo00:28
*** akrivoka has quit IRC00:29
*** gvrangan has quit IRC00:32
*** derekh has joined #tripleo00:32
*** matbu|pto has quit IRC00:52
*** derekh has quit IRC01:07
*** ooolpbot has joined #tripleo01:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION01:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/173968601:10
*** ooolpbot has quit IRC01:10
openstackLaunchpad bug 1739686 in tripleo "Packaging: Gnocchi renaming broke systemd services" [Critical,In progress] - Assigned to Pradeep Kilambi (pkilambi)01:10
openstackgerritMerged openstack/puppet-tripleo stable/pike: Correct typo in manila/share.pp resource chaining  https://review.openstack.org/52940601:26
*** tvignaud has quit IRC01:27
*** tvignaud has joined #tripleo01:28
*** psachin has joined #tripleo01:32
openstackgerritMerged openstack/puppet-tripleo stable/pike: Make sure rabbitmq is fully up before creating any rabbitmq resources  https://review.openstack.org/52948201:35
openstackgerritMerged openstack/puppet-tripleo stable/pike: Fix up the rabbitmq-ready check  https://review.openstack.org/52948301:35
*** rfolco has quit IRC01:52
*** liverpooler has joined #tripleo01:54
openstackgerritMerged openstack/tripleo-quickstart master: Use storage-environment.yaml in featureset024 for newton  https://review.openstack.org/52955902:02
*** ooolpbot has joined #tripleo02:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION02:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/173968602:10
openstackLaunchpad bug 1739686 in tripleo "Packaging: Gnocchi renaming broke systemd services" [Critical,In progress] - Assigned to Pradeep Kilambi (pkilambi)02:10
*** ooolpbot has quit IRC02:10
*** liverpooler has quit IRC02:20
*** itlinux has quit IRC02:32
*** psachin has quit IRC02:40
*** yamahata has quit IRC02:53
*** psachin has joined #tripleo02:55
*** jlabarre has quit IRC03:19
*** ramishra has quit IRC03:19
*** mhenkel_ has joined #tripleo03:20
*** itlinux has joined #tripleo03:21
*** mhenkel_ has quit IRC03:25
*** yamahata has joined #tripleo03:33
*** Goneri has quit IRC03:37
*** psahoo has joined #tripleo03:49
*** psahoo is now known as psahoo|BF03:50
*** ykarel has joined #tripleo03:59
*** ykarel_ has joined #tripleo04:01
*** psahoo|BF is now known as psahoo04:03
*** ykarel has quit IRC04:03
*** dtrainor has quit IRC04:12
*** shreshtha has joined #tripleo04:17
*** dbecker has quit IRC04:25
*** rcernin has quit IRC04:26
*** rcernin has joined #tripleo04:27
*** threestrands_ has quit IRC04:29
*** ykarel__ has joined #tripleo04:29
*** ykarel_ has quit IRC04:31
*** jaganathan has joined #tripleo04:33
*** anilvenkata has joined #tripleo04:35
*** dbecker has joined #tripleo04:39
*** udesale has joined #tripleo04:39
*** links has joined #tripleo04:43
*** dpawar has joined #tripleo04:47
*** rcernin has quit IRC04:47
*** rcernin has joined #tripleo04:49
itlinuxhello all I trying to build a BM PIKE I get this on step 3 http://paste.openstack.org/show/629615/04:50
itlinuxany suggestions ? Thanks04:51
*** ykarel_ has joined #tripleo04:57
*** pgadiya has joined #tripleo04:58
*** ykarel__ has quit IRC04:59
*** ramishra has joined #tripleo05:03
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates stable/pike: Case insentitive MAC address matching in OsNetConfigMappings  https://review.openstack.org/52964605:10
*** ykarel__ has joined #tripleo05:28
*** ykarel_ has quit IRC05:30
*** anilvenkata has quit IRC05:31
*** janki has joined #tripleo05:34
*** ykarel_ has joined #tripleo05:36
*** ykarel__ has quit IRC05:39
*** ykarel_ has quit IRC05:44
*** anilvenkata has joined #tripleo05:51
*** masco has joined #tripleo05:59
*** rwsu has joined #tripleo06:06
*** ratailor has joined #tripleo06:07
*** jfrancoa has joined #tripleo06:23
*** ykarel has joined #tripleo06:29
*** yprokule has joined #tripleo06:31
openstackgerritJose Luis Franco proposed openstack-infra/tripleo-ci master: Set repo setup release in playbook  https://review.openstack.org/50493906:34
openstackgerritJose Luis Franco proposed openstack-infra/tripleo-ci master: WIP: Upgrade UC and OC using tripleo-upgrade role  https://review.openstack.org/51564306:34
*** marios has joined #tripleo06:38
bandiniany takers for https://review.openstack.org/#/c/528378/ and https://review.openstack.org/#/c/528584/ ?06:42
-openstackstatus- NOTICE: Zuul.openstack.org is currently under heavy load and not starting new jobs. We're waiting for an admin to restart Zuul.06:45
*** anilvenkata has quit IRC06:47
*** anilvenkata has joined #tripleo06:47
*** dpawar has quit IRC06:51
*** mhenkel_ has joined #tripleo06:57
*** dpawar has joined #tripleo06:59
*** mhenkel_ has quit IRC07:01
*** rcernin has quit IRC07:04
*** ykarel has quit IRC07:15
*** pblaho has joined #tripleo07:17
*** pblaho has quit IRC07:18
*** pblaho has joined #tripleo07:18
*** mhenkel_ has joined #tripleo07:34
*** d0ugal has quit IRC07:43
*** d0ugal has joined #tripleo07:44
*** d0ugal has quit IRC07:44
*** d0ugal has joined #tripleo07:44
*** kristaps__ has joined #tripleo07:44
openstackgerritJose Luis Franco proposed openstack/tripleo-heat-templates stable/pike: [DO NOT MERGE] Testing upgrades O->P.  https://review.openstack.org/52980207:45
*** kristaps_ has quit IRC07:46
honzaon a containerized undercloud, how can one get the admin_password?  hiera returns nil07:52
*** ffiore has joined #tripleo08:03
openstackgerritHonza Pokorny proposed openstack/tripleo-common master: Add tripleo-ui container  https://review.openstack.org/51540708:10
*** ffiore_ has joined #tripleo08:12
*** ebarrera has joined #tripleo08:12
*** ffiore has quit IRC08:13
*** amoralej|off is now known as amoralej08:13
openstackgerritHonza Pokorny proposed openstack/python-tripleoclient master: Add tripleo-ui docker service to undercloud config  https://review.openstack.org/52284208:17
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci master: DNM: run CI with verbose  https://review.openstack.org/52857408:18
*** sshnaidm is now known as sshnaidm|off08:18
*** ebarrera has quit IRC08:18
*** ebarrera has joined #tripleo08:19
*** pcaruana has joined #tripleo08:24
openstackgerritHonza Pokorny proposed openstack/tripleo-heat-templates master: [WIP] tripleo ui docker  https://review.openstack.org/51549008:27
*** jpena|off is now known as jpena08:45
*** fragatina has joined #tripleo08:45
*** hjensas has joined #tripleo08:51
*** ccamacho has quit IRC08:54
*** ffiore has joined #tripleo08:59
*** ffiore_ has quit IRC08:59
*** jpich has joined #tripleo09:02
openstackgerritJanki Chhatbar proposed openstack/tripleo-heat-templates master: [WIP]Update steps for OpenDayLight  https://review.openstack.org/48920109:07
*** ccamacho has joined #tripleo09:07
*** karthiks has joined #tripleo09:09
*** mrch has joined #tripleo09:09
*** ykarel has joined #tripleo09:10
*** matbu has joined #tripleo09:11
*** matbu is now known as matbu|pto09:12
*** derekh has joined #tripleo09:18
*** lucas-afk is now known as lucasagomes09:31
*** ffiore has quit IRC09:36
*** florianf has joined #tripleo09:49
*** gfidente has joined #tripleo09:52
*** gfidente has quit IRC09:52
*** gfidente has joined #tripleo09:52
*** aditya_r has joined #tripleo09:55
*** paramite has joined #tripleo09:58
*** owalsh_ is now known as owalsh10:00
*** psachin has quit IRC10:12
*** shardy has joined #tripleo10:15
-openstackstatus- NOTICE: zuul has been restarted, all queues have been reset. please recheck your patches when appropriate10:18
*** ykarel is now known as ykarel|afk10:18
*** ramishra has quit IRC10:34
*** hjensas has quit IRC10:40
*** hjensas has joined #tripleo10:43
*** hjensas has quit IRC10:43
*** hjensas has joined #tripleo10:43
*** dsariel has joined #tripleo10:55
*** dpawar has quit IRC10:59
*** udesale has quit IRC11:00
*** rfolco has joined #tripleo11:09
*** aditya_r has quit IRC11:12
openstackgerritOliver Walsh proposed openstack/tripleo-puppet-elements master: WIP: add RT kernel to overcloud compute image  https://review.openstack.org/52938111:12
*** aditya_r has joined #tripleo11:13
*** itlinux has quit IRC11:16
openstackgerritMarios Andreou proposed openstack/tripleo-heat-templates master: Convert tags to when statements for Q major upgrade workflow  https://review.openstack.org/51090211:20
openstackgerritChandan Kumar proposed openstack/tripleo-quickstart master: Rename python-zaqar-tests to python-zaqar-tests-tempest  https://review.openstack.org/52733211:21
chandankumarsshnaidm|off: weshay ^^ still some syntex error is coming http://paste.openstack.org/show/629636/ please have a look11:22
chandankumari am trying ansible-playbook --syntax-check11:22
*** shreshtha has quit IRC11:24
*** kristaps_ has joined #tripleo11:29
*** anilvenkata has quit IRC11:29
openstackgerritChristian Schwede proposed openstack/tripleo-common master: Fix authentication issue in Swift ring rebalance playbook  https://review.openstack.org/52970711:30
*** kristaps__ has quit IRC11:30
*** pgadiya has quit IRC11:31
*** tosky has joined #tripleo11:35
*** janki has quit IRC11:41
*** dmacpher has quit IRC11:45
*** masco has quit IRC12:00
*** ratailor has quit IRC12:00
*** karthiks has quit IRC12:01
*** ratailor has joined #tripleo12:01
*** pkovar has joined #tripleo12:03
*** psahoo has quit IRC12:07
*** aditya_r has quit IRC12:09
*** ebarrera_ has joined #tripleo12:12
*** raildo has joined #tripleo12:14
*** ramishra has joined #tripleo12:20
*** ebarrera_ has quit IRC12:25
*** aditya_r has joined #tripleo12:32
*** nyechiel has joined #tripleo12:33
*** aditya_ra has joined #tripleo12:36
*** lucasagomes is now known as lucas-hungry12:38
*** ebarrera has quit IRC12:38
*** ebarrera has joined #tripleo12:39
*** aditya_r has quit IRC12:39
*** nyechiel has quit IRC12:50
openstackgerritLee Yarwood proposed openstack/tripleo-heat-templates master: upgrade: Remove n-api duplicate upgrade_tasks from Ocata  https://review.openstack.org/52296812:50
lyarwoodowalsh: ^ btw, clearing out some older reviews, that's the duplicate upgrade_tasks we spoke about a while ago if you have review time today12:50
openstackgerritDamien Ciabrini proposed openstack/puppet-tripleo master: Do not force provider in rabbitmq base profile  https://review.openstack.org/52982712:53
*** jpena is now known as jpena|lunch12:53
*** dciabrin has joined #tripleo12:58
*** ratailor has quit IRC13:00
*** dciabrin_ has quit IRC13:01
honzaEmilienM: is there a way to inspect the logs for the CI job that does patch merging?13:04
shardyhonza: you mean the gate CI jobs?13:12
honzashardy: yes, i'm debugging a "publish to tarballs.openstack.org" job13:12
shardyhonza: Hmm, got a link?  I thought that only happened when we tag a release13:13
honzashardy: my understanding is that a new tarball is release for each merge for tripleo-ui13:14
*** dciabrin has quit IRC13:14
*** dciabrin has joined #tripleo13:14
honzashardy: the only link i can provide for more context is this bug report https://bugs.launchpad.net/tripleo/+bug/173733513:15
openstackLaunchpad bug 1737335 in tripleo "tripleo-ui package fails to build in DLRN in "npm run build"" [Critical,Triaged]13:15
*** jaganathan has quit IRC13:15
honzashardy: i suspect that something changed during the zuul upgrade13:15
*** dciabrin_ has joined #tripleo13:18
shardyhonza: Ok I see http://tarballs.openstack.org/tripleo-ui/ but I'm not clear how that's related to the dlrn build failure, which appears to be a genuine issue with the npm run build that's run as part of the rpmbuild?13:18
shardyhonza: does building via dlrn work for you locally with the latest head tripleo-ui?13:19
*** dciabrin has quit IRC13:20
honzashardy: i have never used dlrn; i tested the -deps rpms and they appear to be built correctly; rdo says the dlrn build is fine; so the only piece left i can think of to check is the tarball job13:20
honzashardy: is it easy to set up dlrn locally?13:20
ykarel|afkhonza, have you checked comments on https://review.rdoproject.org/r/#/c/10982/13:21
shardyhonza: yes, I use the tripleo.sh script from openstack-infra/tripleo-ci/scripts/13:21
*** ykarel|afk is now known as ykarel13:21
shardyhonza: ./tripleo-ci/scripts/tripleo.sh --delorean-setup13:21
shardyrun once to install things13:21
honzaykarel: yes, that's what got me working on this again13:21
shardythen e.g ./tripleo-ci/scripts/tripleo.sh --delorean-build openstack/tripleo-ui13:21
ykarelhonza, ok13:21
honzashardy: awesome!13:21
ykarelhonza, what logs you are looking for13:21
ykarelhonza, do you mean: http://logs.openstack.org/21/215a849a152be56a0e6acf9edfe70d77769ac704/post/publish-openstack-python-tarball/8dae319/job-output.txt.gz13:22
shardyhonza: quickstart has a different method, but that's the method I'm familiar with, and it works for me13:22
* shardy tries building tripleo-ui13:22
honzaykarel: no, the javascript tarball one, but yes, that's the right area13:22
*** owalsh is now known as owalsh_afk13:23
ykarelhonza, ok13:23
honzaykarel: is there an interface where i can search these?13:24
ykarelhonza, do you have commit id13:24
ykarelthen http://logs.openstack.org/<2digitcommithash>/<commithash>13:25
shardyhonza: building it with tripleo.sh fails like in the bug for me13:25
honzaykarel: that's awesome, i'll save that forever :)13:25
ykarel:)13:26
shardyhonza: e.g see ~/tripleo/delorean/data/repos/<version dependent dirs>/rpmbuild.log13:26
honzashardy: that's excellent, i'm setting up dlrn now, looks i should be able to reproduce it13:26
mhenkelhi folks. quick question on queens: I am writing a container yaml and want to pass the node IP addresses of a role as an environment variable to the container13:26
mhenkelcan you refresh my mind which variable I should use?13:26
shardymhenkel: Hmm that's a good question - we always use hiera to set the per-node bind ips, e.g see https://review.openstack.org/#/c/526692/13:29
shardymhenkel: atm that data is only really consumed via config_settings, which may not be what you need in this case?13:29
mhenkelshardy: our entrypoint scripts have the ability to take a comma separated list of ip addresses to build all required config13:30
shardymhenkel: ack, so you need a comma delimited list of all IPs running the service?13:31
mhenkelshardy: exactly13:31
mhenkelit could also be a list I can convert into a string13:31
*** jlabarre has joined #tripleo13:31
shardymhenkel: we do calculate a list of IPs per service, like service_name_node_ips in hiera (see /etc/puppet/hieradata/all_nodes.json)13:32
shardymhenkel: that makes it easy to consume the lists via puppet-tripleo, but not so much via container environment variables13:33
shardyso we may need to figure out a way to do that13:33
mhenkelexactly13:33
mhenkelbecause I need to tell during container startup to read the hieradata and convert it to an environment variable13:34
mhenkelwould something like %{hiera('service_name_node_ip')} work?13:40
mhenkelwould something like %{hiera('service_name_node_ips')} work?13:40
*** suuuper has joined #tripleo13:43
*** links has quit IRC13:45
*** jpena|lunch is now known as jpena13:46
*** dtantsur|afk is now known as dtantsur13:47
*** aditya_ra has quit IRC13:50
*** aditya_r has joined #tripleo13:50
*** lucas-hungry is now known as lucasagomes13:51
mhenkelshardy: something like: https://pastebin.com/gE2JysJY13:55
*** ykarel is now known as ykarel|away13:56
*** aditya_r has quit IRC13:57
*** aditya_r has joined #tripleo13:58
*** hjensas has quit IRC13:58
*** hjensas has joined #tripleo14:00
mhenkelalternatively I can create an ansible task in host_prep_tasks which reads the hieradata I need and writes them into an environment file which is then read by container as an env-file14:01
mhenkelat what step is host_prep_task running? are service hieradata already written?14:01
*** ykarel|away has quit IRC14:02
*** aditya_r has quit IRC14:03
*** akrivoka has joined #tripleo14:04
shardymhenkel: I don't think the hiera interpolation will work in the docker_config environment, although we could possibly make paunch capable of resolving that format14:05
shardymhenkel: host_prep_tasks may work and yes it's after the hieradata is written, but before any of the deployment steps14:05
shardymhenkel: that's probably the quickest stopgap solution, but it'd be nice to work out a cleaner interface14:06
shardymhenkel: I'll give it some more thoughts but feel free to push any patches if you get it working14:06
mhenkelshardy: yes, an interface between hieradata and docker_config environment would be nice14:06
shardymhenkel: I don't think there are any examples of this usage yet, but it seems like a good and useful pattern to figure out14:07
mhenkelI will give it a try14:07
*** Goneri has joined #tripleo14:07
shardymhenkel: I wonder if we could make the environment resolve via a subsell, e.g CONTROLLER_NODES=$(hiera -c /etc/puppet/hiera.yaml controller_node_ips)14:08
shardyI suspect that also won't currently work but we can look more at the options inside paunch14:08
shardymhenkel: stevebaker is a good contact to discuss that I think14:08
mhenkelok14:08
shardybrb14:08
*** shardy has quit IRC14:08
*** amoralej is now known as amoralej|lunch14:10
*** shardy has joined #tripleo14:11
shardymhenkel_: further info, here is where we run paunch, which consumes the combined docker_config for each step, including the environment14:12
*** Goneri has quit IRC14:12
shardyhttps://github.com/openstack/tripleo-heat-templates/blob/master/common/deploy-steps-tasks.yaml#L6214:12
shardymhenkel_: https://github.com/openstack/paunch is the paunch tool itself, you can probably trace the environment handling there but I've not yet looked closely at it myself14:13
*** pblaho has quit IRC14:14
*** jobewan has joined #tripleo14:18
honzashardy: when using tripleo.sh for dlrn builds, is there a way to make local edits and rerun?  on my setup as per above, it keeps overwriting anything i modify14:35
EmilienMhello14:36
EmilienMhonza: did you get your answer?14:37
honzaEmilienM: yes, thank you14:37
shardyhonza: you mean edits to tripleo-ui or the spec file?14:37
honzashardy: spec file in this case14:37
shardyhonza: there is a dlrn option to use the local version I think, sec14:39
shardyhonza: FYI if it's the tripleo_ui repo, the trick is to modify ~/tripleo/<repo> not ~/tripleo/delorean/data/<repo>14:40
EmilienMhow to start Friday: learn that I broke zuul last night14:40
shardythe latter gets replaced every build14:40
EmilienMhttps://review.openstack.org/#/q/topic:zuul/beaker ddos zuul14:40
honzashardy: good to know!14:40
shardyhonza: I think you need the --dev flag to delorean, do cd ~/tripleo/delorean/venv/bin; . active; delorean --help14:42
shardyhonza: you can add that to tripleo.sh or copy the command it runs14:42
honzashardy: awesome, thank you14:42
shardyhonza: s/active/activate above14:43
*** shardy is now known as shardy_afk14:43
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: DNM - test RHSM with role variable  https://review.openstack.org/52881614:45
*** fragatina has quit IRC14:45
*** fragatina has joined #tripleo14:46
openstackgerritCarlos Camacho proposed openstack/tripleo-common master: Add UC backup Mistral workflow definition and actions  https://review.openstack.org/51761014:47
*** salmankhan has joined #tripleo14:49
ccamachohey d0ugal are you around? Im starting to write the tests for this patch https://review.openstack.org/#/c/517610, when having some cycles mind to check if is in general OK ?14:52
*** jlabarre has quit IRC14:55
*** amoralej|lunch is now known as amoralej14:58
*** chem has quit IRC15:03
*** shardy_afk is now known as shardy15:03
*** mrch has quit IRC15:11
*** hjensas has quit IRC15:13
EmilienMweshay: I'm looking at tripleo periodic jobs failures now15:14
EmilienMhttps://logs.rdoproject.org/openstack-periodic/periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset017-master/38e19a4/tempest.html.gz15:14
EmilienMsounds like this one it fails on master with barbican15:15
*** suuuper has quit IRC15:15
EmilienMmwhahaha: can you please help to see if it's alee's things ^.15:15
EmilienMurllib3.exceptions.ProtocolError: ('Connection aborted.', BadStatusLine("''",))15:15
EmilienMit sounds like15:15
mwhahahamost likely15:15
mwhahahabut that got merged15:15
EmilienMit is15:15
EmilienMhttps://review.openstack.org/#/c/529126/15:15
EmilienMmwhahaha: right? ^15:15
mwhahahayea15:15
EmilienMok let's see in the next run if that fixed it15:16
EmilienMI can check if that ci run had this patch or not, gimme a sec15:16
mwhahahayea same problem15:16
mwhahahahttps://logs.rdoproject.org/openstack-periodic/periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset017-master/38e19a4/subnode-2/var/log/containers/httpd/barbican-api/barbican_wsgi_main_error.log.txt.gz15:16
mwhahahaso we lose the version info from the containers15:17
mwhahahaso i have no idea what version is in the barbican container15:17
EmilienMmwhahaha:             "Image": "192.168.24.1:8787/master/centos-binary-barbican-api:22e15d3e1f9104a89dadf7036c0e387f21b6285f_387f078e",15:19
EmilienMin https://logs.rdoproject.org/openstack-periodic/periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset017-master/38e19a4/subnode-2/var/log/extra/docker/containers/barbican_api/docker_info.log.txt.gz15:19
EmilienM22e15d3e1f9104a89dadf7036c0e387f21b6285f_387f078e is build on the delorean hash15:19
mwhahahayea but then i have to find that hash15:19
EmilienMbut I'm failing to find the hash now15:19
mwhahahaso massively a pain in the butt15:19
EmilienMon https://trunk.rdoproject.org/centos7/15:20
EmilienMyeah I know15:20
shardyEmilienM, mwhahaha: Note that current-tripleo doesn't contain the patch you mentioned, it's still on 21deca815:22
shardyhttps://trunk.rdoproject.org/centos7-master/current-tripleo/15:22
EmilienMshardy: yeah, we're debugging the promotion pipeline now15:23
shardyah cool15:23
EmilienMshardy: periodic job that test latest consistent15:23
EmilienMmwhahaha: another failure on pike: https://logs.rdoproject.org/openstack-periodic/periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset005-pike/609f172/undercloud/home/jenkins/overcloud_deploy.log.txt.gz15:23
*** fultonj has joined #tripleo15:23
mwhahahathat ones a heat timeout15:24
mwhahahai don't think we backported the convergence stuff15:24
mwhahahaso that'll be new15:24
mwhahahaor infra related15:24
EmilienMmwhahaha: it sounds inconsistent, it was working well in previous run :(15:25
*** fultonj has quit IRC15:25
EmilienMouch, the same on https://logs.rdoproject.org/openstack-periodic/periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset007-pike/560c2cb/undercloud/home/jenkins/overcloud_deploy.log.txt.gz15:25
EmilienMweshay: need your help on that one: https://review.rdoproject.org/jenkins/job/periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset016-master/216/consoleFull15:27
EmilienMweshay: it's failing on "TASK [validate-tempest : Send tempest results by mail]"15:27
mwhahahalast thing i see is yum update15:27
mwhahahahttps://logs.rdoproject.org/openstack-periodic/periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset005-pike/609f172/subnode-2/var/log/journal.txt.gz#_Dec_22_04_09_1515:27
mwhahahaand15:30
mwhahahahttps://logs.rdoproject.org/openstack-periodic/periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset007-pike/560c2cb/subnode-2/var/log/journal.txt.gz#_Dec_22_04_09_1215:30
mwhahahaEmilienM: -^ so it's hung on yum -y update15:30
EmilienMit sounds like tempest-sendmail.tripleo.org is down15:30
EmilienMor at least the mail service on 808015:31
EmilienMmwhahaha: weird15:32
EmilienMmwhahaha: network issue maybe?15:33
mwhahahapossibly15:33
mwhahahawe'll see on the next run15:33
EmilienMmwhahaha: do you know who manages tempest-sendmail.tripleo.org ?15:33
*** dsariel has quit IRC15:33
EmilienMI guess it's arxcruz|off201815:33
mwhahahaprobably15:33
mwhahahacan we just disable it15:34
EmilienMI'm about to do it now.15:34
mwhahahahappy friday15:34
mwhahahathe day we turn everything off cause why not15:34
*** dsariel has joined #tripleo15:35
*** itlinux has joined #tripleo15:35
*** ecerquei has joined #tripleo15:36
*** ecerquei has quit IRC15:36
EmilienMwait actually15:36
EmilienMmwhahaha: the task failed but is ignored15:36
EmilienMI didn't see the "...ignoring"15:36
mwhahahak15:36
EmilienMthe failure is in jenkins15:36
EmilienM22:27:45 FATAL: remote file operation failed: /home/jenkins/secretFiles/e411df7e-5330-42ec-8ef7-e92917bb38dd at hudson.remoting.Channel@33178d00:upstream-centos-7-2-node-rdo-cloud-tripleo-6622: java.io.IOException: java.lang.reflect.InvocationTargetException15:36
EmilienMswitching on #rdo15:37
EmilienMmwhahaha: another failure: https://logs.rdoproject.org/openstack-periodic/periodic-tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset020-master/cfc72f4/tempest.html.gz15:39
EmilienMDetails: No "_member_" role found15:39
EmilienMthis one looks familiar ;-)15:39
mwhahahaHEH15:40
mwhahahaif i recall, you said it wasn't a problem :D15:40
EmilienMwas it me? are you sure? my twin did that15:40
mwhahahayour twin sucks15:40
EmilienM:-O15:41
*** dciabrin_ has quit IRC15:48
*** dciabrin_ has joined #tripleo15:48
openstackgerritEmilien Macchi proposed openstack/tripleo-quickstart-extras master: tempest: use Member role in Queens and beyond  https://review.openstack.org/52984915:49
EmilienMmwhahaha: ^ let's see15:49
EmilienMmwhahaha: I want to see if scenario002 pass, because we already configure auth.tempest_roles in featureset for scenario002, but I want to see if the featureset overrides the tempest config15:50
EmilienMmwhahaha: so the jenkins issue is solved since they migrated to the new version of SF - the yum update that hangs was hopefully temporary (network issue) - the tempest issue is in progress ^ - have you seen anything else?15:53
EmilienMthe barbican thing has merged15:54
mwhahahanot that i'm aware of15:54
*** morazi has quit IRC15:54
EmilienMok15:54
*** marios has quit IRC15:57
*** ebarrera has quit IRC16:05
*** fragatina has quit IRC16:08
*** fragatina has joined #tripleo16:08
openstackgerritCarlos Camacho proposed openstack/tripleo-common master: Add UC backup Mistral workflow definition and actions  https://review.openstack.org/51761016:09
*** itlinux has quit IRC16:12
*** fragatina has quit IRC16:18
*** hjensas has joined #tripleo16:21
EmilienMmwhahaha: I pushed https://review.openstack.org/529851 but I doubt it will land since evryone is on pto. I'll rather do the thin in t-q-e in the meantime if that works16:22
mwhahahak16:23
toskyalso because the change should be compatible with older versions16:24
EmilienMoh tosky is around16:24
toskytechnically I'm not around :)16:25
toskybut yeah16:25
EmilienMtosky: Member role was created before, for a long time, isn't?16:25
*** derekh has quit IRC16:25
toskyI don't remember - I lost the track between the various roles and their availability in devstack, packstack and tripleo16:25
toskybut if it was available in Ocata we are fine16:26
EmilienMtosky: for sure it was16:27
toskyEmilienM: but was it created by tripleo, or by all installers?16:27
EmilienMtosky: I checked, it's created by tripleo-quickstart-extras16:28
toskyEmilienM: and was it _member_ created too by tripleo-quickstart-extras?16:29
EmilienMtosky: no, by keystone16:29
toskyEmilienM: so now keystone does not have a "default" role anymore?16:30
arxcruz|off2018tosky: EmilienM _member_ role is a old role that was created automatically right? Also, I believe tempest is able to create these roles with some flag...16:30
toskyif it's deployer-specific, I would not set in default-overrides16:30
EmilienMhttps://review.openstack.org/#/c/522461/17/releasenotes/notes/removed-as-of-queens-94c04e88c08f89aa.yaml16:30
arxcruz|off2018EmilienM: yes, i'm taking care of tempest-sendmail.tripleo.org16:30
EmilienMarxcruz|off2018: ok thx16:30
arxcruz|off2018EmilienM: do you need it disabled ?16:31
EmilienMtosky: in that case, I guess https://review.openstack.org/#/c/529849 is good16:31
arxcruz|off2018this is where the sendmail service is running16:31
EmilienMarxcruz|off2018: well, it's failing to be used now16:31
EmilienMarxcruz|off2018: see https://review.rdoproject.org/jenkins/job/periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset016-master/216/consoleFull16:31
toskyEmilienM: yes, I think that 529849 is good16:32
EmilienMtosky: k16:32
arxcruz|off2018EmilienM: fixing16:32
openstackgerritEmilien Macchi proposed openstack/puppet-tripleo stable/pike: Do not force provider in rabbitmq base profile  https://review.openstack.org/52985616:33
EmilienMdciabrin_, bandini ^ backport16:33
*** salmankhan has quit IRC16:35
*** dsariel has quit IRC16:38
*** salmankhan has joined #tripleo16:39
arxcruz|off2018EmilienM: tempest-sendmail fixed, the service stopped, for $random reason, probably a restart in the vm16:42
EmilienMarxcruz|off2018: ok, thx!16:42
*** ramishra has quit IRC16:44
*** hjensas has quit IRC16:44
*** jpich has quit IRC16:46
*** dpawar has joined #tripleo16:54
*** fultonj has joined #tripleo16:56
*** dciabrin_ has quit IRC16:57
*** dciabrin_ has joined #tripleo16:58
*** fultonj has quit IRC16:59
*** fultonj has joined #tripleo16:59
*** itlinux has joined #tripleo17:00
*** dtantsur is now known as dtantsur|afk17:02
*** yprokule has quit IRC17:03
*** itlinux has quit IRC17:05
*** itlinux has joined #tripleo17:05
*** kristaps__ has joined #tripleo17:08
*** kristaps_ has quit IRC17:10
*** kristaps__ has quit IRC17:12
*** Goneri has joined #tripleo17:15
*** leseb has quit IRC17:21
*** lucasagomes is now known as lucas-afk17:24
*** gfidente has quit IRC17:24
*** leseb has joined #tripleo17:25
*** jfrancoa has quit IRC17:28
*** leseb has quit IRC17:31
*** leseb has joined #tripleo17:44
mwhahahaEmilienM: https://review.openstack.org/#/c/529309/17:51
mwhahahaperhaps related to our failings earlier?17:52
EmilienMmwhahaha: looking17:52
openstackgerritMerged openstack/tripleo-docs master: Include -E in tripleo-repos sudo calls  https://review.openstack.org/52965317:52
mwhahahahttps://review.openstack.org/#/c/528984/ was teh master patch from 2 days ago17:52
EmilienMmwhahaha: maybe17:52
EmilienMi approved anyway17:52
*** artom has quit IRC17:52
openstackgerritMerged openstack/tripleo-docs master: Fill in upgrades CI developer doc  https://review.openstack.org/52063617:55
openstackgerritMerged openstack/tripleo-docs master: Document using UEFI mode with overcloud nodes  https://review.openstack.org/51689317:56
mhenkeldoes anyone know if the trunk.registry.rdoproject.org registry is down? I have issues pulling any image18:00
*** dciabrin_ has quit IRC18:01
*** artom has joined #tripleo18:02
*** dsneddon has quit IRC18:02
*** dciabrin has joined #tripleo18:02
*** dhill_ has quit IRC18:12
*** dhill_ has joined #tripleo18:12
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: Add docker-registry service  https://review.openstack.org/52613218:13
*** dciabrin has quit IRC18:16
*** dciabrin has joined #tripleo18:17
*** hjensas has joined #tripleo18:19
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: DNM - test RHSM with role variable  https://review.openstack.org/52881618:23
EmilienMmhenkel: it should work, any example of failure?18:23
*** pkovar has quit IRC18:24
*** dsneddon has joined #tripleo18:24
mhenkelhttps://pastebin.com/uCtZzciR18:25
mhenkelor a straight docker pull:18:26
mhenkeldocker pull trunk.registry.rdoproject.org/master/centos-binary-base:3b85715c6488a692fcdf4e4c6a589d77c60eb5a6_a3792c8d18:26
mhenkelError response from daemon: manifest for trunk.registry.rdoproject.org/master/centos-binary-base:3b85715c6488a692fcdf4e4c6a589d77c60eb5a6_a3792c8d not found18:26
mhenkelusing dockerhub as a namespace works:18:27
mhenkelopenstack overcloud container image prepare   --namespace tripleoupstream   --tag latest   --push-destination 192.168.24.1:8787   --output-images-file overcloud_containers.yaml18:27
mhenkelbut it misses most of the images18:27
*** jpena is now known as jpena|off18:28
EmilienMfultonj: trailing space on https://review.openstack.org/#/c/521989/, I'm happy to approve though18:30
EmilienMfultonj: a follow-up works for me18:30
*** mhenkel_mobile has joined #tripleo18:32
openstackgerritCarol Bouchard proposed openstack/tripleo-heat-templates master: Latest Nexus Configuration Variables Updates  https://review.openstack.org/52750818:34
*** mhenkel_mobile has joined #tripleo18:36
*** mhenkel_mobile has quit IRC18:43
EmilienMstevebaker: you around by any chance?18:44
EmilienMI'm trying to debug why kolla containers fail to build now https://review.rdoproject.org/jenkins/job/periodic-tripleo-centos-7-master-containers-build/442/console18:44
mwhahahauh oh seems like containers-multinode, scenarios001/2 might be broken. https://review.openstack.org/#/c/518715/ has consistently faile don that the last few times18:46
mwhahahawill need to dig in after lunch18:46
EmilienMsounds like timeouts18:47
EmilienMbut yeah18:47
EmilienMmwhahaha: collect-logs takes so much time18:51
*** hjensas has quit IRC18:51
mwhahahaThat's why it needs to be in post18:52
*** dpawar has quit IRC18:54
EmilienMalso I've noticed that we don't have ARA anymore for quickstart playbooks18:56
EmilienMsee http://logs.openstack.org/49/529849/1/check/tripleo-ci-centos-7-scenario002-multinode-oooq-container/149ac00/logs/18:56
EmilienMprobably because it timeouts before18:56
fultonjEmilienM: thanks, i'm trying to get this in POST before January and not sure if gfidente is around to review by then. How about I workflow and do a follow-up to remove the space?18:56
*** mhenkel_mobile has joined #tripleo18:56
EmilienMfultonj: ok wfm18:56
fultonjcool18:56
*** mhenkel_mobile has quit IRC18:59
EmilienMactually ARA failed http://logs.openstack.org/49/529849/1/check/tripleo-ci-centos-7-scenario001-multinode-oooq-container/22e5e97/job-output.txt.gz#_2017-12-22_18_46_32_47200818:59
EmilienMdmsimard: you're on PTO iirc, but if you're around ^18:59
EmilienMwhy collect-logs takes so much time19:01
EmilienMsshnaidm|off: you around?19:01
EmilienMTASK [collect-logs : Compress logs to tar.gz] takes 4 minutes19:16
openstackgerritEmilien Macchi proposed openstack/tripleo-quickstart-extras master: collect-logs: use archive module to create tar.gz  https://review.openstack.org/52988119:24
*** florianf has quit IRC19:25
*** fultonj has quit IRC19:26
EmilienMsshnaidm|off, mwhahaha: just a heads-up: about executing collect-logs role in post, it's actually failing here http://logs.openstack.org/54/522554/8/check/tripleo-ci-centos-7-undercloud-oooq/60d9012/ara/result/206e7e5d-46d9-4937-868a-d2215ad5383a/19:28
EmilienMAccessing files from outside the working dir /var/lib/zuul/builds/60d9012b64d4425bb3ce7bdcb9a33cb5/work is prohibited19:28
EmilienMjeblair: hey, I was wondering if you could maybe help on this error ^ that we have with https://review.openstack.org/#/c/522554/ if you have time19:30
*** amoralej is now known as amoralej|off19:30
EmilienMit sounds like we use artcl_collect_dir = /home/zuul/workspace/logs but zuul-executor fails on permission19:31
EmilienMit fails on the "Fetch log archive" task, which moves the archive to /home/zuul/workspace/logs/primary.tar but it's denied19:33
EmilienMnote: the playbook works fine when it's executed in run (and not in post)19:33
itlinuxhello guys any suggestions on how to set the failed stack to COMPLETE. I tried this command update resource set status='COMPLETE' where id='e73496d2-71a7-4207-906f-98b1ccec8603'; but returns Query OK, 0 rows affected (0.00 sec) Rows matched: 0  Changed: 0  Warnings: 019:34
itlinuxbut it' still there..19:34
jeblairEmilienM: where's collect-logs role defined?19:34
EmilienMjeblair: https://git.openstack.org/cgit/openstack/tripleo-quickstart-extras/tree/roles/collect-logs/tasks/collect.yml#n26819:35
EmilienMI go lunch, back later19:38
jeblairEmilienM: fetch is going to pull data from a node (ie 'primary' in this case) to the zuul executor.  so the destination path, which is based on {{artcl_collect_dir}} must be within the zuul work dir.19:38
jeblairEmilienM: so i think you'll want to change the definition of artcl_collect_dir to something like {{zuul.executor.log_root}}19:39
jeblairEmilienM, sshnaidm|off, dmsimard: left comment on https://review.openstack.org/52255419:41
openstackgerritEmilien Macchi proposed openstack/puppet-tripleo master: Only create veritas rabbitmq users on the bootstrap node  https://review.openstack.org/52837819:41
openstackgerritEmilien Macchi proposed openstack/puppet-tripleo master: Give horizon's stanza in haproxy a per-server cookie  https://review.openstack.org/50255319:41
EmilienMjeblair: thanks a lot - I'll take a look when back on computer19:42
*** fultonj_ has joined #tripleo19:46
*** fultonj has joined #tripleo19:47
*** athomas has quit IRC19:50
*** salmankhan has quit IRC19:51
*** fultonj has quit IRC19:57
*** hjensas has joined #tripleo19:59
*** hjensas has quit IRC19:59
*** hjensas has joined #tripleo19:59
*** fultonj_ has quit IRC20:02
*** fultonj_ has joined #tripleo20:02
*** fultonj_ has quit IRC20:03
*** raildo has quit IRC20:11
*** pcaruana has quit IRC20:13
*** fragatina has joined #tripleo20:13
*** rfolco has quit IRC20:19
*** fragatina has quit IRC20:25
*** fragatina has joined #tripleo20:29
*** hjensas has quit IRC20:33
*** dsariel has joined #tripleo20:47
*** fragatina has quit IRC20:59
*** dsariel has quit IRC21:05
sshnaidm|offEmilienM, I have another approach for logs collection: https://review.openstack.org/#/c/527844/21:10
sshnaidm|offEmilienM, seems like it has still problem with ovb, can't connect to nodes, need to check what is the problem21:11
*** jobewan has quit IRC21:22
EmilienMsshnaidm|off: thanks21:28
EmilienMshardy: http://logs.openstack.org/16/528816/11/check/tripleo-ci-centos-7-containers-multinode/7cbdc67/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz#_2017-12-22_19_49_1921:32
EmilienMshardy: sounds like list_concat didn't work out21:32
EmilienMshardy: map_merge was working well21:33
EmilienMshardy: I guess it was an indentation error21:34
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: Introduce OS::TripleO::Services::Rhsm  https://review.openstack.org/52680821:34
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: DNM - test RHSM with role variable  https://review.openstack.org/52881621:34
openstackgerritEmilien Macchi proposed openstack/tripleo-common master: Manage legacy OS::TripleO::RandomString resources in constants  https://review.openstack.org/52615121:34
*** akrivoka has quit IRC21:36
openstackgerritEmilien Macchi proposed openstack/tripleo-quickstart-extras master: Add config to set neutron mtu in undercloud/overcloud  https://review.openstack.org/50966021:36
openstackgerritEmilien Macchi proposed openstack/tripleo-quickstart-extras master: Remove MTU-based tests from the master and pike skip lists  https://review.openstack.org/52829221:36
mwhahahaEmilienM: so did you spot the container build failure stuff21:41
mwhahaha"INFO:kolla.image.build.sensu-client:No package MariaDB-client available.", "INFO:kolla.image.build.sensu-client:\u001b[91mError: Not tolerating missing names on install, stopping."21:41
EmilienMmwhahaha: I didn't21:41
EmilienMmwhahaha: oh nice spot21:41
EmilienMmwhahaha: so all the rest if failing?21:41
mwhahahai think so21:42
mwhahahai think if one failes it just errors21:42
mwhahahanot sure why we wouldn't have a MariaDB-client though21:43
EmilienMthe only recent change on sensu was https://review.openstack.org/#/c/486379/121:43
mwhahahaalso why don't we use our own mirrors21:44
mwhahahabase: repos.lax.quadranet.com21:44
EmilienMwat21:44
EmilienMit's rdo infra yeah21:44
EmilienMwe don't have mirrors yet21:44
EmilienMlet me check tripleo-common21:44
EmilienMfor sensu21:44
mwhahahabut that's for centos base21:45
* mwhahaha shrugs21:45
mwhahahathat's in kolla itself i think21:45
mwhahahabecause we're using mirrors on the undercloud21:45
aleeEmilienM, mwhahaha -- at some point, I'd like to get https://review.openstack.org/#/c/527515/ in .  One of the checks keeps timing out though.21:46
EmilienMmwhahaha: yeah it's in kolla fo rsure21:46
EmilienMlet's go on kolla channel21:46
mwhahahaEmilienM: are we not specifying rpm_setup_config?21:47
mwhahahahttps://docs.openstack.org/kolla/latest/admin/image-building.html#red-hat21:47
EmilienMI've lost the URL of jenkins failure21:48
EmilienMdo you have it?21:48
mwhahahahttps://logs.rdoproject.org/openstack-periodic/periodic-tripleo-centos-7-master-containers-build/f99309a/console.txt.gz21:48
EmilienMthx21:48
EmilienMI'm not sure about rpm_setup_config, seems like no21:48
mwhahahaall this stuff is a tangled mess21:49
EmilienMit is21:49
mwhahahaso my next question, where is teh rdo-kolla-build kept21:49
*** paramite has quit IRC21:51
*** srini has joined #tripleo21:53
*** srini has quit IRC21:54
openstackgerritEmilien Macchi proposed openstack/tripleo-common master: Add Sensu repo to override template  https://review.openstack.org/52989021:59
EmilienMmwhahaha: ^21:59
openstackgerritEmilien Macchi proposed openstack/tripleo-common master: Add Sensu repo to override template  https://review.openstack.org/52989022:00
EmilienMmwhahaha: sorry, second patchset22:00
mwhahahaOH ALL RIGHT22:01
EmilienMlol22:01
mwhahahawe should probably file an actual bug on that one22:01
mwhahahafor the trackins22:01
EmilienMmwhahaha: please review https://review.openstack.org/#/c/529849/ - see my comment it's good22:02
EmilienMmwhahaha: I'm working on it22:02
mwhahahak22:02
EmilienMhttps://bugs.launchpad.net/tripleo/+bug/173983522:04
openstackLaunchpad bug 1739835 in tripleo "Enable Sensu repo in override template" [High,Triaged] - Assigned to Emilien Macchi (emilienm)22:04
openstackgerritEmilien Macchi proposed openstack/tripleo-common master: Add Sensu repo to override template  https://review.openstack.org/52989022:05
EmilienMmwhahaha: with bug reference22:06
mwhahahak22:06
*** mhenkel_ has quit IRC22:21
openstackgerritMerged openstack/tripleo-specs master: ffu: Spec update for M2  https://review.openstack.org/52635322:23
openstackgerritAlex Schultz proposed openstack/tripleo-common master: Parameterize Ansible environment vars in Mistral Workflow  https://review.openstack.org/52812422:28
*** itlinux has quit IRC22:35
*** mhenkel_ has joined #tripleo23:04
*** mhenkel_ has quit IRC23:08
*** artom has quit IRC23:15
*** jeblair is now known as corvus23:15
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: Introduce OS::TripleO::Services::Rhsm  https://review.openstack.org/52680823:32
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: DNM - test RHSM with role variable  https://review.openstack.org/52881623:32
*** Goneri has quit IRC23:36
« Thursday, 2017-12-21 Index Saturday, 2017-12-23 »

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!