Thursday, 2017-10-26

*** newmember has quit IRC00:00
*** benone has quit IRC00:01
openstackgerritAna Krivokapic proposed openstack/tripleo-validations master: Get rid of start imports  https://review.openstack.org/51522900:01
*** benone has joined #tripleo00:01
openstackgerritAna Krivokapic proposed openstack/tripleo-validations master: Get rid of star imports  https://review.openstack.org/51522900:02
*** ecerquei_ has joined #tripleo00:05
*** ooolpbot has joined #tripleo00:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION00:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/172286400:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/172745400:10
*** ooolpbot has quit IRC00:10
openstackLaunchpad bug 1722864 in tripleo "OVB frequent timeouts on rh1 cloud" [Critical,Triaged]00:10
openstackLaunchpad bug 1727454 in tripleo "OS_AUTH_URL in overcloudrc points to keystone API v2.0" [Critical,Triaged] - Assigned to Dougal Matthews (d0ugal)00:10
*** akrivoka has quit IRC00:11
*** achadha_ has quit IRC00:16
*** achadha has joined #tripleo00:17
openstackgerritSteve Baker proposed openstack/tripleo-common stable/pike: Action to always populate container image parameters  https://review.openstack.org/51523200:20
*** florianf has quit IRC00:20
*** achadha has quit IRC00:21
*** links has joined #tripleo00:23
*** benone has quit IRC00:30
*** benone has joined #tripleo00:31
openstackgerritzhongshengping proposed openstack/puppet-pacemaker master: Switch to Zuul v3 testing  https://review.openstack.org/51523400:39
*** trozet has quit IRC00:45
*** psahoo has joined #tripleo00:50
*** tzumainn has quit IRC00:51
*** bobh has joined #tripleo00:51
openstackgerritBrad P. Crochet proposed openstack/tripleo-common master: Validate roles data and network data  https://review.openstack.org/50856700:52
openstackgerritBrad P. Crochet proposed openstack/tripleo-common master: Add a Get Networks workflow  https://review.openstack.org/50941900:52
openstackgerritBrad P. Crochet proposed openstack/tripleo-common master: Add UpdateNetworks workflow  https://review.openstack.org/51346300:52
*** marrusl has quit IRC00:54
*** leitan has quit IRC00:57
*** leitan has joined #tripleo00:58
*** leitan has quit IRC00:58
*** rwsu has joined #tripleo01:02
*** ooolpbot has joined #tripleo01:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION01:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/172286401:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/172745401:10
*** ooolpbot has quit IRC01:10
openstackLaunchpad bug 1722864 in tripleo "OVB frequent timeouts on rh1 cloud" [Critical,Triaged]01:10
openstackLaunchpad bug 1727454 in tripleo "OS_AUTH_URL in overcloudrc points to keystone API v2.0" [Critical,Triaged] - Assigned to Dougal Matthews (d0ugal)01:10
*** benone has quit IRC01:10
*** benone has joined #tripleo01:11
openstackgerritzhongshengping proposed openstack/puppet-tripleo master: Switch to Zuul v3 testing  https://review.openstack.org/51525101:13
*** gvrangan has joined #tripleo01:15
openstackgerritSteve Baker proposed openstack/tripleo-common master: Implement a skopeo based image uploader  https://review.openstack.org/51525201:20
*** fzdarsky_ has joined #tripleo01:22
*** fzdarsky|afk has quit IRC01:26
*** daidv has joined #tripleo01:27
*** raissa has quit IRC01:32
*** yamahata has joined #tripleo01:33
*** psachin has joined #tripleo01:41
bnemecEmilienM: It's doubtful.  We're not running anywhere near capacity in rh1 right now.01:44
*** raissa has joined #tripleo01:46
*** gvrangan has quit IRC01:49
*** itlinux has joined #tripleo01:50
itlinuxhello all... I was wondering about zaqar.. which file should I run on the deployment since there are two.. one under the puppet the other under the environments folder.. I see the one under the env folder is calling the puppet one..01:51
EmilienMbnemec: ok01:54
*** yamahata has quit IRC01:55
*** amodi has joined #tripleo02:02
*** spectr has quit IRC02:03
*** spectr has joined #tripleo02:04
*** ooolpbot has joined #tripleo02:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION02:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/172286402:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/172745402:10
*** ooolpbot has quit IRC02:10
openstackLaunchpad bug 1722864 in tripleo "OVB frequent timeouts on rh1 cloud" [Critical,Triaged]02:10
openstackLaunchpad bug 1727454 in tripleo "OS_AUTH_URL in overcloudrc points to keystone API v2.0" [Critical,Triaged] - Assigned to Dougal Matthews (d0ugal)02:10
*** rwsu has quit IRC02:11
*** ramishra has joined #tripleo02:11
*** rwsu has joined #tripleo02:14
openstackgerritzhongshengping proposed openstack/puppet-tripleo master: Switch to Zuul v3 testing  https://review.openstack.org/51525102:17
*** bobh has quit IRC02:18
openstackgerritMerged openstack/tripleo-heat-templates master: our undercloud default nic should be eth1  https://review.openstack.org/51021202:23
*** itlinux has quit IRC02:29
zshi[TripleO CI] overcloud roles data is not complete, anyone know if this is a known issue? http://logs.openstack.org/17/491317/12/check/legacy-tripleo-ci-centos-7-scenario001-multinode-oooq-container-upgrades/26c73d0/logs/undercloud/home/zuul/overcloud_roles.yaml.txt.gz02:31
*** achadha has joined #tripleo02:39
*** achadha has quit IRC02:39
*** achadha has joined #tripleo02:40
openstackgerritToure Dunnon proposed openstack/python-tripleoclient master: Tripleoclient unified queue name.  https://review.openstack.org/50990202:40
*** larsks has quit IRC02:42
*** larsks has joined #tripleo02:44
*** itlinux has joined #tripleo02:46
*** rbrady-afk has quit IRC02:47
*** itlinux has quit IRC02:48
*** itlinux has joined #tripleo02:53
*** rwsu has quit IRC02:54
*** shreshtha has joined #tripleo02:55
*** shreshtha has quit IRC02:59
*** shreshtha has joined #tripleo03:00
*** achadha has quit IRC03:06
*** ecerquei_ has quit IRC03:08
*** ooolpbot has joined #tripleo03:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION03:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/172286403:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/172745403:10
*** ooolpbot has quit IRC03:10
openstackLaunchpad bug 1722864 in tripleo "OVB frequent timeouts on rh1 cloud" [Critical,Triaged]03:10
openstackLaunchpad bug 1727454 in tripleo "OS_AUTH_URL in overcloudrc points to keystone API v2.0" [Critical,Triaged] - Assigned to Dougal Matthews (d0ugal)03:10
openstackgerritOpenStack Proposal Bot proposed openstack/tripleo-common master: Updated from global requirements  https://review.openstack.org/51163303:16
openstackgerritMerged openstack/tripleo-common stable/pike: Use ANSIBLE_HOST_KEY_CHECKING var instead of ssh-common-args  https://review.openstack.org/51458403:22
*** itlinux has quit IRC03:22
EmilienMfultonj: ^ and the backport03:26
*** benone has quit IRC03:28
*** benone has joined #tripleo03:29
*** gvrangan has joined #tripleo03:30
*** rbrady has joined #tripleo03:35
*** rbrady has joined #tripleo03:35
*** amodi has quit IRC03:39
*** gkadam has joined #tripleo03:42
*** mdnadeem has joined #tripleo03:54
openstackgerritMerged openstack/tripleo-quickstart-extras master: Provide a quick workaround for 1727454  https://review.openstack.org/51516103:54
*** rbrady has quit IRC03:56
*** rbrady has joined #tripleo03:56
EmilienManother one03:57
*** gvrangan has quit IRC04:04
*** gvrangan has joined #tripleo04:06
*** EmilienM changes topic to "CI status: Orange - gate unstable - promotion 45 days | http://tripleo.org/ | https://docs.openstack.org/tripleo-docs/latest/"04:08
EmilienMjaosorior: ping04:08
*** ooolpbot has joined #tripleo04:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION04:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/172286404:10
openstackLaunchpad bug 1722864 in tripleo "OVB frequent timeouts on rh1 cloud" [Critical,Triaged]04:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/172745404:10
*** ooolpbot has quit IRC04:10
openstackLaunchpad bug 1727454 in tripleo "OS_AUTH_URL in overcloudrc points to keystone API v2.0" [Critical,Triaged] - Assigned to Dougal Matthews (d0ugal)04:10
*** achadha has joined #tripleo04:14
EmilienMbandini or jaosorior : when you're up - please babysit https://review.openstack.org/#/c/515123/04:15
EmilienMwe need it landed asap04:15
EmilienMI'm going to bed now, see you in few hours04:15
EmilienMjaosorior: I saw your restore :P04:16
openstackgerritEmilien Macchi proposed openstack/tripleo-quickstart master: Use the new containers tag name for master and pike  https://review.openstack.org/51505204:17
jaosoriorEmilienM: I restored it from my phone :D now I'04:18
jaosoriormpw O04:18
openstackgerritVincent S. Cojot proposed openstack/tripleo-heat-templates master: RHSM: when using proxy, test its connectivity first  https://review.openstack.org/51353004:18
jaosoriornow I'm on my machine04:19
EmilienMlol04:19
*** catintheroof has joined #tripleo04:19
jaosoriorEmilienM: no biggie, I'll keep an eye on it04:19
*** pdeore has joined #tripleo04:20
EmilienMjaosorior: thx, ttyl04:20
EmilienMjaosorior: also when it merges, please submit backport to pike04:21
EmilienMand thanks again. Now I'm out04:21
*** udesale has joined #tripleo04:22
*** catintheroof has joined #tripleo04:23
*** ykarel has joined #tripleo04:24
*** gvrangan has quit IRC04:29
*** skramaja has joined #tripleo04:33
*** udesale has quit IRC04:34
*** catintheroof has quit IRC04:38
*** catintheroof has joined #tripleo04:38
*** pmannidi_ has joined #tripleo04:40
*** pmannidi has quit IRC04:41
*** catintheroof has quit IRC04:43
*** dparkes has quit IRC04:48
*** benone has quit IRC04:48
*** benone has joined #tripleo04:49
*** achadha has quit IRC04:55
*** achadha has joined #tripleo05:09
*** ooolpbot has joined #tripleo05:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION05:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/172286405:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/172745405:10
*** ooolpbot has quit IRC05:10
openstackLaunchpad bug 1722864 in tripleo "OVB frequent timeouts on rh1 cloud" [Critical,Triaged]05:10
openstackLaunchpad bug 1727454 in tripleo "OS_AUTH_URL in overcloudrc points to keystone API v2.0" [Critical,Triaged] - Assigned to Dougal Matthews (d0ugal)05:10
*** masco has joined #tripleo05:12
*** yamahata has joined #tripleo05:12
openstackgerritMerged openstack/tripleo-docs master: Change mistral commands to use the openstack CLI instead  https://review.openstack.org/51457505:18
*** rwsu has joined #tripleo05:24
openstackgerritIan Wienand proposed openstack/diskimage-builder master: Move to a common lock-file directory  https://review.openstack.org/51407905:28
Tenguthank you EmilienM for the reactivation of gate and reviews :)05:29
*** gvrangan has joined #tripleo05:30
*** jbadiapa_ has quit IRC05:32
*** ratailor has joined #tripleo05:33
*** benone has quit IRC05:35
*** benone has joined #tripleo05:37
*** suuuper has joined #tripleo05:49
openstackgerritOpenStack Proposal Bot proposed openstack/tripleo-common master: Updated from global requirements  https://review.openstack.org/51163305:49
*** dparkes has joined #tripleo05:52
*** abregman has joined #tripleo05:53
*** benone has quit IRC05:55
*** benone has joined #tripleo05:56
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-common master: Add rsyslog sidecar image for container image prepare  https://review.openstack.org/51528205:56
openstackgerritAttila Darazs proposed openstack/tripleo-quickstart-extras master: GATE CHECK for quickstart-extras  https://review.openstack.org/47260706:00
*** gvrangan_odl has joined #tripleo06:01
*** gvrangan has quit IRC06:01
bandinimorning06:04
*** cshastri has joined #tripleo06:05
*** ooolpbot has joined #tripleo06:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION06:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/172286406:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/172745406:10
*** ooolpbot has quit IRC06:10
openstackLaunchpad bug 1722864 in tripleo "OVB frequent timeouts on rh1 cloud" [Critical,Triaged]06:10
openstackLaunchpad bug 1727454 in tripleo "OS_AUTH_URL in overcloudrc points to keystone API v2.0" [Critical,Triaged] - Assigned to Dougal Matthews (d0ugal)06:10
* Tengu crossing fingers for his reviews06:11
Tengueventually they will succeed :).06:12
*** iranzo has joined #tripleo06:16
openstackgerritMerged openstack/instack-undercloud master: Set notification_bind on zaqar websocket  https://review.openstack.org/51512306:20
*** shreshtha has quit IRC06:22
*** shreshtha has joined #tripleo06:22
*** achadha_ has joined #tripleo06:22
*** achadha has quit IRC06:26
*** achadha_ has quit IRC06:28
*** jaganathan has joined #tripleo06:30
*** rodolof has joined #tripleo06:30
*** udesale has joined #tripleo06:30
*** janki has joined #tripleo06:31
*** stendulker has joined #tripleo06:37
openstackgerritJuan Antonio Osorio Robles proposed openstack/instack-undercloud stable/pike: Set notification_bind on zaqar websocket  https://review.openstack.org/51529006:37
bandinijaosorior: faster than light ;)06:37
*** fzdarsky_ is now known as fzdarsky06:37
jaosoriorbandini: it's the coffee, it does wonders :P06:38
openstackgerritOpenStack Proposal Bot proposed openstack/tripleo-ui stable/pike: Imported Translations from Zanata  https://review.openstack.org/51453306:38
bandiniahah06:38
jaosoriormandre: thanks for the excellent review on the nova logging patch06:38
pdeoreHi guys06:50
pdeoreCan someone suggest me, what process needs to be followed to apply 2 patches in 2 different puppet-modules using swift upload?06:50
pdeoreI'm trying to backport and test 2 patches in 2 different puppet-module in newton eg. 1 in puppet-tripleo and 1 in puppet-glance,06:51
jaosoriorpdeore: have you read this http://hardysteven.blogspot.fi/2016/08/tripleo-deploy-artifacts-and-puppet.html ?06:51
rakhmerovhi, is there any known problem with TripleO now? Our mistral tripleO gate is failing: https://review.openstack.org/#/c/515012/06:52
pdeorejaosorior, yes I've gone through the same doc, and I cloned puppet-tripleo and puppet-glance in puppet-modules folder06:52
rakhmerovseems like some packages were not installed06:52
jaosoriorpdeore: so you need to be careful about the name.06:52
jaosoriorpdeore: can you do 'ls'  in the puppet-modules folder?06:52
*** hewbrocca_afk is now known as hewbrocca06:52
pdeorejaosorior, [stack@undercloud puppet-modules]$ ls06:53
pdeorepuppet-glance  tripleo06:53
pdeore[stack@undercloud puppet-modules]$06:53
jaosoriorpdeore: that's the issue06:54
jaosoriorpdeore: puppet-glance needs to be called glance06:54
jaosoriorpdeore: basically the naming you'll give it is the naming puppet is expecting06:54
jaosoriorso remove the "puppet" prefix from the folder names06:54
pdeorejaosorior, ohh is it ?06:54
pdeorejaosorior, thanks :)06:54
jaosoriorpdeore: no biggie06:54
*** jprovazn has joined #tripleo06:56
*** florianf has joined #tripleo06:56
*** jlinkes has joined #tripleo06:57
*** jbadiapa_ has joined #tripleo06:57
*** jbadiapa_ is now known as jbadiapa06:57
* Tengu scanding "gate! gate! gate" in the hope no timeout will occur06:58
mandrejaosorior: that was a bit more work than I thought, I'll do the other reviews later ;)06:59
openstackgerritRajesh Tailor proposed openstack/tripleo-heat-templates master: Enable TLS for ec2api service  https://review.openstack.org/50939307:00
*** pmannidi_ has quit IRC07:03
*** rcernin has quit IRC07:04
*** benone has quit IRC07:06
*** benone has joined #tripleo07:06
jaosoriorTengu: hopefully it's better today, the usage of heat convergence was reverted.07:06
Tengu:)07:06
jaosoriorwhich is suspected to have caused the time increase07:06
*** jlinkes has quit IRC07:06
Tenguhmm, what's this "RDO third party ci" ?07:07
*** ebarrera has joined #tripleo07:08
*** tesseract has joined #tripleo07:09
*** apetrich has quit IRC07:09
jaosoriorTengu: I assume it's elves spawning tripleo deployments, but I MIGHT be wrong. If that's not the case then I don't know.07:10
*** ooolpbot has joined #tripleo07:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION07:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/172286407:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/172745407:10
*** ooolpbot has quit IRC07:10
openstackLaunchpad bug 1722864 in tripleo "OVB frequent timeouts on rh1 cloud" [Critical,Triaged]07:10
openstackLaunchpad bug 1727454 in tripleo "OS_AUTH_URL in overcloudrc points to keystone API v2.0" [Critical,Triaged] - Assigned to Dougal Matthews (d0ugal)07:10
Tengujaosorior: "elves"...... like plural of elf, the ear-pointed thing that throw arrow in lord of the ring? :]07:11
jaosoriorTengu: or christmas elves07:11
openstackgerritSagi Shnaidman proposed openstack/tripleo-quickstart master: DNM. test ansible 2.4  https://review.openstack.org/51005907:11
Tengu:P07:12
jaosoriorsshnaidm: what's the RDO third party CI gate thingy?07:12
sshnaidmjaosorior, it's same ovb jobs, but running on rdo cloud, we move them there07:12
jaosoriornice!07:12
jaosoriorsshnaidm: are there still jobs running in rh1?07:12
Tenguah, ok :). so no more timeout hopefully07:12
sshnaidmjaosorior, yes, it will continue to run parallel some time07:13
jaosoriorsshnaidm: excellent07:13
jaosoriorthanks07:13
jaosoriorTengu: so might theory of elves might have been slightly off. But it was a close call.07:13
*** jlinkes has joined #tripleo07:13
Tenguuhuhu07:13
Tenguso. have a day off, I'll go further on the certodia script. although I'm a bit off with "plugin" concept in python app.07:14
jaosoriorTengu: by the way, your apache patch is going well this time :D07:14
Tengujaosorior: yup, saw that, it's in gate now, at last :).07:15
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci master: DNM: test containers update  https://review.openstack.org/51117507:15
Tenguonce I corrected the unit tests, it's smoother.07:15
Tenguthe other one for neutron-lbaas horizon activation seems ok, although I'm a bit lost in the CI results.07:15
*** ebarrera has quit IRC07:16
Tenguah. bah. failed.07:16
*** ebarrera has joined #tripleo07:16
*** Goneri has joined #tripleo07:16
*** aufi has joined #tripleo07:17
*** mcornea has joined #tripleo07:17
*** dmacpher has joined #tripleo07:17
jaosoriorTengu: lol shit, it timed out07:17
*** dciabrin has joined #tripleo07:18
Tenguo__O07:18
Tengunope07:18
Tenguonce again the Failed to get unit file state for neutron-openvswitch-agent.service: No such file or directory07:19
Tenguthis is interesting.07:19
jaosoriorTengu: uhm... which patch? the apache one or the horizon one?07:20
*** yprokule has joined #tripleo07:20
Tenguit happened in only one check this time. might be a transient issue, although a persistent.07:20
Tenguhorizon07:20
Tenguhttps://review.openstack.org/#/c/513274/ -> http://logs.openstack.org/74/513274/11/check/legacy-tripleo-ci-centos-7-containers-multinode/debfcc2/logs/undercloud/home/zuul/vxlan_networking.sh.log.txt.gz07:20
jaosoriorTengu: that's the apache one07:21
Tenguguh… too many tabs07:21
jaosoriorTengu: I'm starting to believe that's a red herring07:21
jaosoriorTengu: here you can see it's a timeout http://logs.openstack.org/74/513274/11/check/legacy-tripleo-ci-centos-7-containers-multinode/debfcc2/logs/undercloud/var/log/postci.txt.gz07:22
Tenguhmm, how do you see that?07:23
Tengudu to the "cancelled" at the end?07:23
jaosoriorTengu: search for the word "time out"07:23
Tenguah, timed out07:24
Tenguok, found it.07:24
jaosorioroh07:24
Tenguwas looking for "timeout"07:24
jaosoriorright07:24
jaosoriormissed the past tense there07:24
Tengu:)07:24
Tengusooo…07:24
Tengurecheck.07:24
jaosoriorlol07:24
openstackgerritLee Yarwood proposed openstack/tripleo-heat-templates master: WIP - Introduce fast-forward upgrade tasks and playbooks  https://review.openstack.org/49922107:24
openstackgerritLee Yarwood proposed openstack/tripleo-heat-templates master: WIP Provide per role bootstrap hostnames to RoleConfig  https://review.openstack.org/51529807:24
*** marios has joined #tripleo07:25
jaosoriormandre: by the way, how do container image promotions happen nowadays? Is it still something you gotta do manually?07:25
Tenguduh… the other one has also an error.07:25
jaosoriorTengu: where?07:25
Tengutimeout.07:25
jaosoriorTengu: which job?07:25
Tenguhttps://review.openstack.org/#/c/512978/ in the http://logs.openstack.org/78/512978/4/check-tripleo/legacy-tripleo-ci-centos-7-ovb-ha-oooq/c754204/job-output.txt.gz07:26
jaosorioroh right07:26
Tengufor legacy-tripleo-ci-centos-7-ovb-ha-oooq07:26
Tengucode 14307:26
Tenguthat one, I know it's "timeout". no use to search deeper.07:26
Tengu:)07:26
*** morazi has joined #tripleo07:26
Tenguso.... recheck. tadaaaa07:26
mandrejaosorior: containers images are now promoted and tagged in the dockerhub as part of the tripleo promotion07:26
mandrejaosorior: so no promotion no new container images07:26
jaosoriorI see07:27
jaosoriormandre: for an image to be included, it has to be here https://github.com/openstack/tripleo-common/blob/master/container-images/overcloud_containers.yaml right?07:27
*** yolanda has joined #tripleo07:27
*** ffiore has joined #tripleo07:28
mandrejaosorior: it also needs to be added somewhere else, moment07:28
jaosoriormandre: I'm trying to add the rsyslog image https://review.openstack.org/#/c/515282/ so I'm figuring out what I need to do.07:29
mandrejaosorior: https://github.com/rdo-infra/ci-config/tree/master/ci-scripts/container-push07:30
mandrejaosorior: that's for the push to the docker hub, not exactly sure where the filter for the images to build is set07:31
mandrejaosorior: panda|ruck|off would know07:31
jaosoriormandre: thanks!07:33
*** gvrangan_odl has quit IRC07:34
*** amoralej|off is now known as amoralej07:36
jaosoriormandre: thanks, submitted a patch https://review.rdoproject.org/r/#/c/10292/07:36
jaosoriormandre, panda|ruck|off: Does the image need to be first in tripleo-common ?07:37
*** jfrancoa has joined #tripleo07:38
*** jfrancoa has quit IRC07:42
*** jpena|off is now known as jpena07:43
*** ccamacho has joined #tripleo07:43
openstackgerritRajesh Tailor proposed openstack/tripleo-heat-templates master: Enable TLS for ec2api service  https://review.openstack.org/50939307:44
*** shreshtha has quit IRC07:44
*** gvrangan has joined #tripleo07:45
*** shreshtha has joined #tripleo07:45
openstackgerritJiri Tomasek proposed openstack/tripleo-ui master: Refactor Loader component  https://review.openstack.org/50918107:45
*** anshul has joined #tripleo07:49
*** paramite has joined #tripleo07:49
*** bogdando has joined #tripleo07:53
*** jfrancoa has joined #tripleo07:57
jprovaznhi, anyone else is getting empty list when running preparing OC container images? "openstack overcloud container image prepare   --namespace trunk.registry.rdoproject.org/master   --tag tripleo-ci-testing   --env-file ~/docker_registry.yaml"08:07
*** rodolof has quit IRC08:10
*** ooolpbot has joined #tripleo08:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION08:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/172286408:10
openstackLaunchpad bug 1722864 in tripleo "OVB frequent timeouts on rh1 cloud" [Critical,Triaged]08:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/172745408:10
*** ooolpbot has quit IRC08:10
openstackLaunchpad bug 1727454 in tripleo "OS_AUTH_URL in overcloudrc points to keystone API v2.0" [Critical,Triaged] - Assigned to Dougal Matthews (d0ugal)08:10
*** cylopez has joined #tripleo08:10
*** ykarel is now known as ykarel|lunch08:11
*** apetrich has joined #tripleo08:12
*** dsariel has joined #tripleo08:14
jaosoriorbogdando: thanks for the review! which logs are put there? the RA logs?08:16
bogdandoyupp, and the pacemaker / corosync08:17
bogdandoand some helper services like rsyncd08:17
bogdandofor galera RA08:17
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Add option for nova containers to log to stdout/stderr  https://review.openstack.org/50915708:17
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Remove log-dir option from neutron-dhcp execution  https://review.openstack.org/51046308:17
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Add option for Neutron containers to log to stdout/stderr  https://review.openstack.org/51046408:17
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Add option for nova compute container to log to stdout/stderr  https://review.openstack.org/51053708:17
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: libvirt: Remove unnecessary binding of /var/log/containers/nova  https://review.openstack.org/51056108:17
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Add option for nova-libvirt container to log to stdout/stderr  https://review.openstack.org/51056208:17
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Add option for heat containers to log to stdout/stderr  https://review.openstack.org/51503808:17
jaosoriormandre: addressed your comments ^^08:17
bogdandojaosorior, dciabrin: ^^08:17
Ngfwiw, dciabrin is on vacation until next week08:18
jaosoriorbogdando: uhm... but pacemaker and corosync are not containerized. So we don't really need to fetch their logs int he same way.08:18
jaosoriorbogdando: for those we'll just use the host's syslog08:18
bogdandoright08:18
bogdandobut pacemaker_remote is runing inside08:18
bogdandoand that's that I mean08:18
bogdandonot corosync perhaps08:18
jaosoriorbogdando: pacemaker_remote is running inside the container?08:19
bogdandoAFAIK08:19
bogdandoplease check with PIDONE folks08:19
jaosoriorI see08:19
Ngbandini: ^^08:19
jaosoriorbogdando: will do. Thanks!08:19
bandinipacemaker_remote runs inside the containers that use an OCF resource agent: aka in redis/galera/rabbit containers08:20
flaper87mwhahaha: EmilienM will need your +1 on this one again: https://review.openstack.org/#/c/513024/08:20
jaosoriorbandini: and pacemaker_remote uses syslog, right?08:21
jaosoriorflaper87: nice!08:21
flaper87jaosorior: :D08:21
bandinijaosorior: let me double check it probably depends on how it is being run (host vs container)08:22
*** rodolof has joined #tripleo08:22
bandiniflaper87: prrrrrrrrrrrrrr08:22
jaosoriorbandini: great! thanks!08:22
*** hamzy has quit IRC08:24
*** hamzy has joined #tripleo08:26
flaper87bandini: sssshhhhhhhhh, I'm generating more work for ya'08:26
bandinilol08:26
bogdandofolks, could you please comment on https://review.openstack.org/515123 ?08:26
*** dbecker has joined #tripleo08:27
bogdandoEach time I see an instack-only fix, I feel jumpy08:27
bogdandolike we're missing the whole containerized thing :) or am I missing something?08:27
jaosoriorbogdando: commented.08:27
jaosoriorbrb, lunch08:27
openstackgerritWojciech Dec proposed openstack/puppet-tripleo master: Adding manifest for Cisco VTS ML2 mechanism driver configuration  https://review.openstack.org/51064508:28
openstackgerritMerged openstack/tripleo-heat-templates stable/newton: Support for Satellite Capsule in rhel-registration  https://review.openstack.org/51324108:28
bandinibogdando: you are right. I believe it was needed to unblock things. I think it makes sense to add it in a separate review in puppet/services/zaqar*08:29
bogdandobandini: thanks! I feel much more confident now :)08:29
*** shardy has joined #tripleo08:29
Ngspeaking of unblocking things, what actually triggers the promotion and container upload?08:30
bandinibogdando: but it is good to remind folks about any instack only things these days :)08:30
bogdandoindeed08:30
bogdandogiven we wanna ditch it soon08:30
bandiniI for once would have missed it as well08:30
bandini*for one08:30
bogdandoand we're putting containers jobs non-voting as a bad habit :D08:31
bogdandowe're used to*08:31
bogdandoI know, I know, to unblock things08:31
bandinitrue that08:31
*** d0ugal has quit IRC08:32
*** d0ugal_ has joined #tripleo08:33
*** d0ugal_ has quit IRC08:33
*** d0ugal has joined #tripleo08:33
bandiniNg: https://www.rdoproject.org/blog/2017/03/rdo-ci-in-a-nutshell/ -> https://ci.centos.org/view/rdo/view/promotion-pipeline/08:34
*** aditya_r has joined #tripleo08:34
*** iranzo has quit IRC08:34
bandiniNg: but am not familiar with more details than that08:34
openstackgerritDougal Matthews proposed openstack/tripleo-common master: [WIP] Tempest  https://review.openstack.org/51531908:36
*** benone has quit IRC08:36
*** benone has joined #tripleo08:37
chandankumard0ugal: hello08:37
chandankumard0ugal: https://review.openstack.org/#/c/515319/ is it a tempest plugin?08:37
d0ugalchandankumar: Hi08:37
yolandaEmilienM, mwhahaha , can i get second +2 on https://review.openstack.org/#/c/499588/ ?08:37
*** iranzo has joined #tripleo08:37
*** iranzo has quit IRC08:37
*** iranzo has joined #tripleo08:37
Ngbandini: ta08:38
d0ugalchandankumar: yes, it will be - still very early on.08:38
*** rbowen has joined #tripleo08:38
d0ugalchandankumar: the goal is to test the Mistral workflows with Tempest08:38
chandankumard0ugal: can we keep the repo name to something like project -tempest-plugin?08:38
d0ugalchandankumar: repo name? do you mean the package name?08:39
chandankumarin order to avoid name confusion08:39
chandankumard0ugal: the package name is tripleo-common08:39
chandankumars/package/project08:39
d0ugalRight08:39
chandankumard0ugal: tempest plugin follows a project name convenction something like project-tempest-plugin naming08:40
d0ugalchandankumar: okay, that is what I attempted with tripleo_common_tempest_plugin. What should it be?08:41
*** lucas-afk is now known as lucasagomes08:41
d0ugalor maybe comment on the review if that is easier?08:41
chandankumard0ugal: one more question, since in queens we have tempest plugin split goal, so mistral should also have a seperate tempest goal08:41
lvdombrkrfolks, is there possible implement   2 key authentication in horizon?08:41
chandankumard0ugal: what about keeping it in a new mistral tempest plugin.08:41
d0ugalchandankumar: what is a split goal? What do you mean Mistral should have a seperate goal?08:42
chandankumard0ugal: yup08:42
d0ugalI don't understand.08:42
chandankumard0ugal: https://governance.openstack.org/tc/goals/queens/split-tempest-plugins.html08:42
d0ugalchandankumar: Mistral already has a plugin here: https://github.com/openstack/mistral08:42
d0ugalchandankumar: I see, so you are suggesting I make a new project called tripleo-common-tempest-plugin08:43
chandankumard0ugal: yup,08:44
d0ugalwith a new git repo etc.08:44
d0ugalThat sounds like a real pain tbh, but I'll read this spec and understand it more.08:44
chandankumard0ugal: https://review.openstack.org/#/q/topic:goal-split-tempest-plugins08:45
chandankumard0ugal: keeping the plugin seperate make ease of maintaince08:45
*** derekh has joined #tripleo08:45
*** gvrangan has quit IRC08:46
openstackgerritJiri Stransky proposed openstack/tripleo-quickstart-extras master: Simplify network_args  https://review.openstack.org/49968008:46
d0ugalchandankumar: I don't understand why - what if we make a change to the project that also requires a change to the plugin? Then it will be very painful08:46
*** gvrangan has joined #tripleo08:47
chandankumard0ugal: yup, we need to make changes at two places08:48
chandankumard0ugal: for a developer they need to submit patches at two places, but in term of maintaince it is quite easier08:48
d0ugalI still don't understand what is made easier08:49
d0ugalbut I am still reading the spec08:49
* chandankumar waits for tosky.08:49
openstackgerritMerged openstack/tripleo-ui master: Refactor SwiftApiService into thunks  https://review.openstack.org/50666608:51
*** dmellado has joined #tripleo08:53
dmelladochandankumar: o/08:53
chandankumardmellado: regarding this patch https://review.openstack.org/#/c/515319/ about keeping tempest plugin in a seperate repo08:54
chandankumard0ugal: dmellado can help you on understanding the usecase of keeping tempest plugin in a seperate repo08:55
dmelladochandankumar: didn't get the time to look at the patch yet08:55
dmelladobut overall keeping the tempest pugin on a separate repo was08:55
dmelladofirst) an agreement with the tc08:55
dmellado2) let me search for the document08:55
chandankumardmellado: : https://governance.openstack.org/tc/goals/queens/split-tempest-plugins.html08:55
dmelladohttps://governance.openstack.org/tc/goals/queens/split-tempest-plugins.html08:55
dmelladoyeah08:56
d0ugalOkay, I've read that08:56
dmelladoso overall, and the most important things to me08:56
*** yamahata has quit IRC08:56
dmellado1) decouple the requirements from the plugin from the main package08:56
dmelladoso it could be much easier for a packager to create one08:56
openstackgerritMerged openstack/tripleo-common master: chown fernet keys to match container's keystone user and group  https://review.openstack.org/51454308:56
openstackgerritMerged openstack/tripleo-quickstart master: use a non-default virthost_user for the basic test  https://review.openstack.org/44156008:56
chandankumarthe main pain for developer is submit patches at two places08:56
dmellado2) tempest is branchless, but most of the projects aren't08:56
dmelladoso deocupling the plugin allows you to keep a branchless tempest plugin repo while having branches on your main project's repo08:57
dmelladobesides that, take a look at the document and ping me/us on #openstack-qa if there's any doubt ;)08:57
*** ykarel|lunch is now known as ykarel08:58
d0ugalOkay, thanks08:58
openstackgerritMerged openstack/tripleo-ui master: Delete services/utils  https://review.openstack.org/50846608:58
openstackgerritDougal Matthews proposed openstack/tripleo-common master: Remove references to the current task from task() in baremetal.yaml  https://review.openstack.org/51369308:59
openstackgerritDougal Matthews proposed openstack/tripleo-common master: Remove references to the current task from task() in ceph-ansible.yaml  https://review.openstack.org/51369208:59
openstackgerritMerged openstack/tripleo-common master: Remove references to the current task from task() in access.yaml  https://review.openstack.org/51369409:01
openstackgerritMerged openstack/tripleo-common master: Remove references to the current task from task() in deployment.yaml  https://review.openstack.org/51369109:01
openstackgerritMerged openstack/tripleo-quickstart master: Use the new containers tag name for master and pike  https://review.openstack.org/51505209:01
openstackgerritMerged openstack/tripleo-common master: Remove references to the current task from task() in plan_management.yaml  https://review.openstack.org/51368909:01
openstackgerritMerged openstack/tripleo-heat-templates master: Run containerized mistral-api eventlet  https://review.openstack.org/51308209:02
openstackgerritMerged openstack/tripleo-heat-templates master: Enable neutron-lbaasv2 UI in Horizon  https://review.openstack.org/51297809:02
openstackgerritMerged openstack/tripleo-heat-templates master: Start using ipv6 nic-configs from THT repo instead of tripleo-ci  https://review.openstack.org/51255409:02
openstackgerritMerged openstack/tripleo-ui master: Remove unnecessary store imports from tests  https://review.openstack.org/50846709:03
openstackgerritMerged openstack/tripleo-common master: Remove references to the current task from task() in package_update.yaml  https://review.openstack.org/51369009:03
openstackgerritMichele Baldessari proposed openstack/tripleo-heat-templates stable/pike: Run containerized mistral-api eventlet  https://review.openstack.org/51532609:03
sociald0ugal: in the end I did the circle and now I'm stuck on eventlet and threading and ansible threading09:03
thervesocial, Sounds like a fun party09:04
openstackgerritArx Cruz proposed openstack/tripleo-quickstart master: Cleaning up featureset files from tripleo-ci related variables  https://review.openstack.org/51222509:05
socialI wonder if I shouldn't just fork there09:05
*** tosky has joined #tripleo09:05
chandankumard0ugal: we have just started #openstack-qa office hour on #openstack-qa channel, if you have any queries related to tempest plugin split goal feel free to ask09:05
chandankumarwe are there happy to help09:05
*** panda|ruck|off is now known as panda|ruck09:06
thervesocial, fork python process?09:06
socialtherve: yes but it probably brings more issues than it solves09:07
thervesocial, Yeah I was going to say, that never works as you'd like to :)09:07
panda|ruckjaosorior: mandre https://github.com/rdo-infra/ci-config/tree/master/ci-scripts/container-push/parsed_containers.txt. Right now is a static file, we have some patch to take it dynamically from the last suceded build, so it will also be different per release09:08
thervesocial, https://github.com/eventlet/eventlet/issues/210 I guess ansible uses multiprocessing09:08
jaganathanshardy, hi, please look into https://review.openstack.org/#/c/511411/09:09
*** ooolpbot has joined #tripleo09:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION09:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/172286409:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/172745409:10
*** ooolpbot has quit IRC09:10
openstackLaunchpad bug 1722864 in tripleo "OVB frequent timeouts on rh1 cloud" [Critical,Triaged]09:10
openstackLaunchpad bug 1727454 in tripleo "OS_AUTH_URL in overcloudrc points to keystone API v2.0" [Critical,Triaged] - Assigned to Dougal Matthews (d0ugal)09:10
*** aditya_r has quit IRC09:11
shardyjaganathan: Hi, ack, done09:11
Tenguoh. it's merged! it's merged!    (imagine the famous "it's aliiiivve" from Dr. Frankenstein)09:12
jaganathanshardy, thanks09:12
openstackgerritCédric Jeanneret proposed openstack/tripleo-heat-templates stable/pike: Enable neutron-lbaasv2 UI in Horizon  https://review.openstack.org/51532909:13
openstackgerritMichele Baldessari proposed openstack/tripleo-heat-templates master: Add --detailed-exitcodes when running puppet via ansible  https://review.openstack.org/51150909:14
openstackgerritMichele Baldessari proposed openstack/tripleo-heat-templates master: DO NOT MERGE testing containerized scenarios  https://review.openstack.org/51004009:14
thervesocial, I would seem that using ansible as a library inside an action is a lost cause...09:16
openstackgerritJanki Chhatbar proposed openstack/tripleo-heat-templates master: Env files for ODL deployments  https://review.openstack.org/51250109:16
therveBut it shouldn't be too hard to define your callback plugin anywya09:16
therveanyway09:16
therved0ugal, FTR I found the tempest split very frustrating too, but I made peace with it. Just make sure to only have "API" tests in them, not regression or stuff like that09:17
panda|ruckjaosorior: is rsyslog present only on master, or pike too ?09:19
*** ffiore has quit IRC09:21
jankishardy, hey. we both submitted changes to a patch https://review.openstack.org/#/c/512501/ at the same time. Can you please review it again. I can ping you once zuul job is run09:24
*** salmankhan has joined #tripleo09:26
*** pgadiya has joined #tripleo09:26
shardyjanki: Hey, no problem, done09:26
*** hamzy has quit IRC09:27
jankishardy, thanks :)09:27
*** hamzy has joined #tripleo09:28
d0ugaltherve: k, thanks. I feel like we want/need some of that stuff for the tripleo-common workflows tho'09:31
*** ffiore has joined #tripleo09:31
*** dtantsur|afk is now known as dtantsur09:31
d0ugalI feel like our tempest use might be a bit different, but maybe everyone thinks that :)09:31
*** salmankhan has quit IRC09:32
*** anilvenkata has joined #tripleo09:33
d0ugalsocial: wow. that sounds kinda scary :)09:33
*** psahoo has quit IRC09:34
*** salmankhan has joined #tripleo09:37
therved0ugal, In heat we made a compromise, having some tests in the new repo and keeping others inside09:37
therveAt least that's what the plan was09:37
d0ugalah, interesting. I'll look into that09:38
d0ugalthanks09:38
*** sshnaidm is now known as sshnaidm|afk09:39
openstackgerritPranali Deore proposed openstack/puppet-tripleo stable/newton: Sync the db as part of the glance-api install  https://review.openstack.org/51533309:39
openstackgerritMerged openstack/tripleo-quickstart-extras master: Set empty default for network_isolation_args  https://review.openstack.org/49754309:41
socialtherve: I don't give up that easy, I probably just need to find way to say eventlet about what's gonna happen next09:43
*** pgadiya has quit IRC09:43
thervesocial, Oh man you're an optimist09:44
therveWhen I hit an eventlet issue I generally call it a day09:44
*** salmankhan has quit IRC09:45
openstackgerritMerged openstack-infra/tripleo-ci master: Match job-output as console logs for getthelogs  https://review.openstack.org/51456009:45
openstackgerritMerged openstack/tripleo-quickstart-extras master: Switch vbmc to Systemd's instantiated services and open up corresponding firewall  https://review.openstack.org/51033109:45
*** salmankhan has joined #tripleo09:45
openstackgerritMerged openstack/tripleo-heat-templates master: update cinder kmgr parameter for Queens  https://review.openstack.org/51376709:45
*** gvrangan has quit IRC09:46
*** gvrangan has joined #tripleo09:46
*** benone has quit IRC09:47
*** benone has joined #tripleo09:47
*** iranzo has quit IRC09:51
*** rbowen has quit IRC09:51
*** adarazs is now known as adarazs|rover09:52
*** iranzo has joined #tripleo09:56
*** iranzo has quit IRC09:56
*** iranzo has joined #tripleo09:56
*** pgadiya has joined #tripleo09:59
d0ugalCan somebody help me figure out where the KeystoneURL Heat output comes from?10:00
d0ugalI am trying to work on this promotion blocker: https://bugs.launchpad.net/tripleo/+bug/172745410:00
openstackLaunchpad bug 1727454 in tripleo "OS_AUTH_URL in overcloudrc points to keystone API v2.0" [Critical,Triaged] - Assigned to Dougal Matthews (d0ugal)10:00
shardyhttps://github.com/openstack/tripleo-heat-templates/blob/master/overcloud.j2.yaml#L90810:01
shardyd0ugal: ^^10:01
d0ugalshardy: I see that, but I'm not sure where to go from there :)10:01
shardyhttps://github.com/openstack/tripleo-heat-templates/blob/master/network/endpoints/endpoint_map.yaml10:02
d0ugalshardy: aha, thanks10:02
d0ugalshardy: https://bugs.launchpad.net/tripleo/+bug/1727454/comments/3 (that is why I am headed in this direction fwiw)10:02
openstackLaunchpad bug 1727454 in tripleo "OS_AUTH_URL in overcloudrc points to keystone API v2.0" [Critical,Triaged] - Assigned to Dougal Matthews (d0ugal)10:02
*** salmankhan has quit IRC10:03
jprovaznmwhahaha: hi, just formality, could you please approve https://blueprints.launchpad.net/tripleo/+spec/nfs-ganesha ?10:03
shardyd0ugal: ack, yeah we basically calculate the endpoints based on that file combined with the enabled networks (which give us the actual IPs etc)10:03
shardye.g the ServiceNetMap maps each service endpoint to a specific vip10:04
shardyhttps://github.com/openstack/tripleo-heat-templates/blob/master/network/endpoints/endpoint_map.yaml#L412110:05
shardyd0ugal: there's hard-coded "2.0" path references for all three keystone endpoints, which I guess are related10:05
d0ugalshardy: https://github.com/openstack/tripleo-heat-templates/blob/master/network/endpoints/endpoint_map.yaml#L395710:05
d0ugalRighht10:05
d0ugalI never expected that to be hard coded here :)10:06
shardys/\/2.0/\//g :)10:06
d0ugalSounds good10:06
shardyyeah it looks like a historical mistake from before anythink could discover keystone versions10:06
d0ugalshardy: thanks for the help10:06
shardyd0ugal: np, hope that resolves the issue10:06
d0ugalme too :)10:06
openstackgerritMerged openstack-infra/tripleo-ci master: Mirror images from RDO server  https://review.openstack.org/51036210:07
d0ugalshardy: so I should change it to / and not /v3?10:08
*** ooolpbot has joined #tripleo10:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION10:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/172286410:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/172745410:10
*** ooolpbot has quit IRC10:10
openstackLaunchpad bug 1722864 in tripleo "OVB frequent timeouts on rh1 cloud" [Critical,Triaged]10:10
openstackLaunchpad bug 1727454 in tripleo "OS_AUTH_URL in overcloudrc points to keystone API v2.0" [Critical,Triaged] - Assigned to Dougal Matthews (d0ugal)10:10
openstackgerritDougal Matthews proposed openstack/tripleo-heat-templates master: Update the KeystoneURL to use v3  https://review.openstack.org/51535110:10
openstackgerritDougal Matthews proposed openstack/tripleo-heat-templates master: Update the KeystoneURL to use v3  https://review.openstack.org/51535110:13
*** sshnaidm|afk is now known as sshnaidm10:18
*** pgadiya has quit IRC10:21
shardyd0ugal: yes AFAIK keystoneauth should figure out the version using version discovery, but it'd be worth testing with the various *clients to ensure they all work OK10:22
*** pradk has joined #tripleo10:27
*** salmankhan has joined #tripleo10:30
*** gfidente|afk is now known as gfidente10:31
*** oidgar has joined #tripleo10:33
*** pgadiya has joined #tripleo10:33
openstackgerrityatin proposed openstack/tripleo-quickstart-extras master: Use shell instead of command module as using &> operator  https://review.openstack.org/50908410:41
openstackgerrityatin proposed openstack/tripleo-quickstart-extras master: Add reference of image for pike release in rdocloud env  https://review.openstack.org/50909010:41
*** apetrich has quit IRC10:41
*** rbowen has joined #tripleo10:45
*** ramishra has quit IRC10:45
openstackgerritDougal Matthews proposed openstack/tripleo-heat-templates master: Update the KeystoneURL to use v3  https://review.openstack.org/51535110:46
*** ramishra has joined #tripleo10:47
sociald0ugal: I think I'm hitting this one https://github.com/eventlet/eventlet/issues/42510:48
*** agurenko has quit IRC10:49
openstackgerritPradeep Kilambi proposed openstack/tripleo-puppet-elements master: Remove ceilometer Api package from overcloud image  https://review.openstack.org/51536010:51
*** fzdarsky is now known as fzdarsky|lunch10:51
*** fzdarsky|lunch has quit IRC10:51
d0ugalsocial: right, that'll be a problem.10:51
sociald0ugal: is there specific reason why we monkeypatch threads? ,)10:51
*** fzdarsky has joined #tripleo10:53
d0ugalsocial: I hope there is a reason, but I don't know it.10:53
sociald0ugal: well mistral works for me if I stop monkeypatching10:54
*** akrivoka has joined #tripleo10:55
d0ugalsocial: right, but that'll change the behaviour of everywhere we use thread, threading or Queue.10:56
socialyeah :/10:57
sociald0ugal: I wonder If there is way hot to provide non monkeypatched stuff for the ansible in the action :)10:57
d0ugalsocial: but if you want the reason, rakhmerov is most likely to know why we patch thread :)10:57
sociald0ugal: it's not only thread, also os and socket10:58
d0ugalyup10:58
d0ugalsocial: I think maybe we just need to find a different way of doing this.10:58
*** jpena is now known as jpena|lunch10:59
sociald0ugal: question is how much you want the ansible stuff vs how much work is it to stop monkeypatching11:00
d0ugalsocial: true11:00
socialbut there should be way to get around this11:00
thervesocial, There is no way monkeypatching can be removed in this cycle11:01
therveThe whole concurrency behavior of mistral (or openstack in general) relies on it11:02
socialwhat about tpool11:02
socialisn't that getting the original ones?11:02
socialso I should just put all ansible in tpool.proxy?11:02
*** amoralej is now known as amoralej|lunch11:03
therveI don't know about tpool, but I can't see how it would solve the issue11:04
*** yprokule has quit IRC11:05
*** pdeore has quit IRC11:06
openstackgerritmathieu bultel proposed openstack-infra/tripleo-ci master: WIP, test CI with experimental undercloud upgrade  https://review.openstack.org/51536111:07
openstackgerritmathieu bultel proposed openstack/python-tripleoclient master: Support to drive undercloud deploy via undercloud.conf  https://review.openstack.org/51135011:09
*** ooolpbot has joined #tripleo11:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION11:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/172286411:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/172745411:10
*** ooolpbot has quit IRC11:10
openstackLaunchpad bug 1722864 in tripleo "OVB frequent timeouts on rh1 cloud" [Critical,Triaged]11:10
openstackLaunchpad bug 1727454 in tripleo "OS_AUTH_URL in overcloudrc points to keystone API v2.0" [Critical,In progress] - Assigned to Dougal Matthews (d0ugal)11:10
openstackgerritSagi Shnaidman proposed openstack/tripleo-quickstart master: Update images location to new ones  https://review.openstack.org/51036311:13
*** udesale has quit IRC11:13
sshnaidmadarazs|rover, panda|ruck please review, just rebased it ^^11:13
openstackgerritJiri Tomasek proposed openstack/tripleo-ui master: Refactor Loader component  https://review.openstack.org/50918111:18
*** stendulker has quit IRC11:19
*** achadha has joined #tripleo11:23
Tenguanyone against a cherry-pink in pike for that one? https://review.openstack.org/#/c/515329/11:23
Tenguerr… *pick.11:23
adarazs|roversshnaidm: are these new paths working alreday?11:23
adarazs|roveralready11:23
*** achadha has quit IRC11:27
toskydo you think that I can safely recheck https://review.openstack.org/#/c/511907/ , or should I wait (some other issues with more priority, not a transient error which requires more investigation, etc etc)?11:27
*** bkopilov_ has quit IRC11:28
Tengujaosorior: apparently my apache base profile thing is on the right track. For now at least.11:29
Tenguthe fun part being: "duh, have to re-do the whole thing in order to get it in pike - yeaahhh" :P11:29
adarazs|rovertosky: I think you can recheck now, but let's ask panda|ruck to be sure.11:30
fultonjhi gfidente: I think we could probably land https://review.openstack.org/#/c/511418 and https://review.openstack.org/#/c/507526 today, right?11:31
*** janki has quit IRC11:31
* tosky looks at panda|ruck with puppy eyes11:32
gfidentefultonj hopefully11:35
*** links has quit IRC11:36
jaosoriorpanda|ruck: only on master (might be on pike depending on what's figured out from a mail thread)11:36
jaosoriorTengu: nice!11:37
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-common stable/pike: chown fernet keys to match container's keystone user and group  https://review.openstack.org/51536911:37
*** akrzos has quit IRC11:38
*** lucasagomes is now known as lucas-hungry11:40
openstackgerritSagi Shnaidman proposed openstack/tripleo-quickstart-extras master: DNM: test container upd with multiprocess  https://review.openstack.org/51537211:41
sshnaidmadarazs|rover, of course11:41
adarazs|roversshnaidm: cool, +211:42
*** akrzos has joined #tripleo11:42
*** thrash|bbl is now known as thrash11:43
*** abishop has joined #tripleo11:45
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Add option for nova containers to log to stdout/stderr  https://review.openstack.org/50915711:45
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Remove log-dir option from neutron-dhcp execution  https://review.openstack.org/51046311:45
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Add option for Neutron containers to log to stdout/stderr  https://review.openstack.org/51046411:45
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Add option for nova compute container to log to stdout/stderr  https://review.openstack.org/51053711:45
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: libvirt: Remove unnecessary binding of /var/log/containers/nova  https://review.openstack.org/51056111:45
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Add option for nova-libvirt container to log to stdout/stderr  https://review.openstack.org/51056211:45
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Add option for heat containers to log to stdout/stderr  https://review.openstack.org/51503811:45
jaosoriormandre: had to change the name of a parameter cause it was failing the pep8 test ^^11:45
*** bfournie has quit IRC11:47
*** ansmith has quit IRC11:47
*** bfournie has joined #tripleo11:47
openstackgerritJan Provaznik proposed openstack/tripleo-heat-templates master: Add a StorageNFS network for use by Manila/Ganesha  https://review.openstack.org/51223911:48
panda|rucktosky: the queue seems pretty clean at the moment, only 5h waiting time11:48
openstackgerritOr Idgar proposed openstack/tripleo-common master: WIP Add Octavia post deployment steps to tripleo workflows  https://review.openstack.org/48745011:49
*** eck`gone is now known as eck`11:51
toskypanda|ruck: I guess it's as good as I can ask, rechecking11:51
*** bfournie has quit IRC11:52
*** artom_ has joined #tripleo11:52
*** bobh has joined #tripleo11:54
*** adarazs|rover is now known as adarazs_brb|rove11:55
*** adarazs_brb|rove is now known as adarazs_brb11:55
*** jlinkes has quit IRC11:56
*** bobh has quit IRC12:00
panda|ruckjaosorior: then this'll have to wait until we use a dynamic list, or a different list per release.12:01
*** abregman is now known as abregman|mtg12:02
*** ratailor has quit IRC12:03
*** salmankhan has quit IRC12:04
*** ffiore has quit IRC12:04
*** ffiore_ has joined #tripleo12:04
*** salmankhan has joined #tripleo12:05
*** leitan has joined #tripleo12:06
*** jaganathan has quit IRC12:07
jaosoriorpanda|ruck: ok12:07
*** jaganathan has joined #tripleo12:07
jaosoriorpanda|ruck: any estimated time?12:08
*** ooolpbot has joined #tripleo12:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION12:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/172286412:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/172745412:10
*** ooolpbot has quit IRC12:10
openstackLaunchpad bug 1722864 in tripleo "OVB frequent timeouts on rh1 cloud" [Critical,Triaged]12:10
openstackLaunchpad bug 1727454 in tripleo "OS_AUTH_URL in overcloudrc points to keystone API v2.0" [Critical,In progress] - Assigned to Dougal Matthews (d0ugal)12:10
*** leitan has quit IRC12:10
*** raildo has joined #tripleo12:10
*** jlinkes has joined #tripleo12:11
*** ffiore_ has quit IRC12:11
*** jaganathan has quit IRC12:11
*** jaganathan has joined #tripleo12:12
*** jaganathan has quit IRC12:12
*** jpena|lunch is now known as jpena12:13
*** adarazs_brb is now known as adarazs|rover12:14
*** leitan has joined #tripleo12:15
*** brian83 has joined #tripleo12:19
*** shardy has quit IRC12:20
*** jcoufal has joined #tripleo12:20
*** jlinkes has quit IRC12:20
*** bfournie has joined #tripleo12:20
lvdombrkrfolks, someone tried implement 2 two-factor authentication in dashboard?12:21
*** bfournie has quit IRC12:21
*** yprokule has joined #tripleo12:21
*** marrusl has joined #tripleo12:21
*** atoth_ has joined #tripleo12:24
openstackgerritAttila Darazs proposed openstack/tripleo-quickstart-extras master: Switch to keystone v3 API for validate-simple on master  https://review.openstack.org/51538812:26
*** atoth has quit IRC12:26
adarazs|roverpanda|ruck, sshnaidm, EmilienM: https://review.openstack.org/51538812:26
*** rlandy has joined #tripleo12:27
*** pkovar has joined #tripleo12:27
sshnaidmadarazs|rover, I'm not sure you can do so in yaml12:28
*** jlinkes has joined #tripleo12:28
openstackgerritBrent Eagles proposed openstack/tripleo-common master: Add ansible playbook for configuring octavia  https://review.openstack.org/48745012:28
panda|rucksshnaidm: the variable gets evaluated after12:28
sshnaidmadarazs|rover, it should be like: https://review.openstack.org/#/c/508307/28/config/general_config/featureset010.yml12:28
*** agurenko has joined #tripleo12:29
sshnaidmpanda|ruck, I mean jinja templating in yaml12:29
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Add option for nova compute container to log to stdout/stderr  https://review.openstack.org/51053712:29
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: libvirt: Remove unnecessary binding of /var/log/containers/nova  https://review.openstack.org/51056112:29
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Add option for nova-libvirt container to log to stdout/stderr  https://review.openstack.org/51056212:29
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Add option for heat containers to log to stdout/stderr  https://review.openstack.org/51503812:29
*** ffiore_ has joined #tripleo12:30
panda|rucksshnaidm: adarazs|rover ah yeah, sorry maybe I wasn't clear in the meeting, you have to put that in the variable, the variab;le will so contain a jinja string12:31
panda|ruckand then it will get evaluated12:31
adarazs|roversshnaidm, panda|ruck: thanks! will fix.12:31
*** tzumainn has joined #tripleo12:34
openstackgerritBrent Eagles proposed openstack/tripleo-common master: Add ansible playbook for configuring octavia  https://review.openstack.org/48745012:34
*** lucas-hungry is now known as lucasagomes12:34
*** ffiore_ has quit IRC12:35
openstackgerritAttila Darazs proposed openstack/tripleo-quickstart-extras master: Switch to keystone v3 API for validate-simple on master  https://review.openstack.org/51538812:36
adarazs|roversshnaidm, panda|ruck: fixed.12:36
*** ffiore_ has joined #tripleo12:37
mwhahahajprovazn: so the BP is targeted to future. Is that something you were planning for queens? Also will you have it by queens-2?12:38
jprovaznmwhahaha: this is targeted for queens, patches are mostly done, just need to get them (and its dependencies) merged12:39
*** ansmith has joined #tripleo12:41
mwhahahajprovazn: please update the BP with this info12:41
openstackgerritAlfredo Moralejo proposed openstack/tripleo-quickstart-extras master: Provide a quick workaround for 1727454  https://review.openstack.org/51539012:41
*** tzumainn has quit IRC12:41
*** amoralej|lunch is now known as amoralej12:43
openstackgerritDougal Matthews proposed openstack/tripleo-common master: Remove references to the current task from task() in ceph-ansible.yaml  https://review.openstack.org/51369212:43
jprovaznmwhahaha: done12:44
*** dprince has joined #tripleo12:44
*** tzumainn has joined #tripleo12:44
*** tzumainn has quit IRC12:45
openstackgerritMerged openstack-infra/tripleo-ci master: Use infra proxy server for trunk.r.o in delorean-deps  https://review.openstack.org/50888412:45
jprovaznmwhahaha: thanks12:47
openstackgerritJohn Trowbridge proposed openstack/tripleo-quickstart-extras master: Make roles safe to include statically  https://review.openstack.org/51387112:51
openstackgerritJohn Trowbridge proposed openstack/tripleo-quickstart-extras master: Add undercloud to inventory before undercloud-setup  https://review.openstack.org/51445012:51
openstackgerritJohn Trowbridge proposed openstack/tripleo-quickstart-extras master: Add ability to build images to baremetal playbook  https://review.openstack.org/51350312:51
openstackgerritMerged openstack/tripleo-heat-templates master: Kubespray installation via config download mechanism  https://review.openstack.org/51127212:52
*** tzumainn has joined #tripleo12:53
*** skramaja has quit IRC12:53
*** pdeore has joined #tripleo12:54
*** abregman|mtg is now known as abregman12:55
sociald0ugal: therve: thrash: more and more I'm convinced that mistral has to stop monkeypatching, but I can't get that to pike, it will barely land to qeens12:57
*** shardy has joined #tripleo12:57
thervesocial, I don't know how I can unconvince you :)12:58
*** bobh has joined #tripleo12:58
*** Goneri has quit IRC12:59
*** apetrich has joined #tripleo13:00
*** pchavva has joined #tripleo13:00
*** rhallisey has joined #tripleo13:00
thervesocial, I'm not sure you realize how much work it would be to do that.13:02
zanebtherve: there's not using eventlet, and there's not using monkeypatching with eventlet. the latter is potentially do-able13:02
zanebthe former is most definitely not13:02
*** toure_biab is now known as toure13:02
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-common master: Add rsyslog sidecar image for container image prepare  https://review.openstack.org/51528213:02
*** yolanda has quit IRC13:04
zanebtherve: e.g. anything using oslo_service threadgroup should be getting eventlet greenthreads directly without needing to monkeypatch thread13:04
thervezaneb, I don't think mistral, especially the executor, is in position to use eventlet without the monkeypath13:04
zanebok, I haven't looked at the code so I don't know13:05
thervezaneb, I mean, say it's calling novaclient. If you don't use monkeypatch, you need to use threads13:06
*** cdearborn has joined #tripleo13:06
openstackgerritOr Idgar proposed openstack/tripleo-common master: Octavia post deployment mistral wrapper  https://review.openstack.org/51540213:06
*** chlong has joined #tripleo13:06
zanebtherve: you just call greenlet.thread() instead of thread.thread(), don't you? or are you saying that novaclient creates threads internally?13:07
thervezaneb, No, it calls requests.something that makes sockets calls13:08
zaneboh, right13:08
*** ooolpbot has joined #tripleo13:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION13:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/172286413:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/172745413:10
*** ooolpbot has quit IRC13:10
openstackLaunchpad bug 1722864 in tripleo "OVB frequent timeouts on rh1 cloud" [Critical,Triaged]13:10
zanebbut you could still do eventlet.monkey_patch(thread=False) couldn't you? according to the bug that would solve social's issue13:10
openstackLaunchpad bug 1727454 in tripleo "OS_AUTH_URL in overcloudrc points to keystone API v2.0" [Critical,In progress] - Assigned to Dougal Matthews (d0ugal)13:10
zanebtherve: ^13:10
thervezaneb, Then oslo.messaging doesn't work13:11
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-common master: Add rsyslog sidecar image for container image prepare  https://review.openstack.org/51528213:11
therveAnd I'm not sure it's thread related, I think it's more socket related13:12
*** Goneri has joined #tripleo13:12
*** jmelvin has joined #tripleo13:13
*** gvrangan has quit IRC13:14
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-common master: Add rsyslog sidecar image for container image prepare  https://review.openstack.org/51528213:14
socialzaneb: inside of the action?13:14
zanebsocial: no13:15
*** rbowen has quit IRC13:15
panda|rucksshnaidm: trown https://review.openstack.org/515388 for the master promotion13:15
adarazs|roverEmilienM, panda|ruck: btw this overcloud deploy also failed on the 0400UTC job. https://logs.rdoproject.org/openstack-periodic-4hr/periodic-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-master/5037bc0/undercloud/home/jenkins/overcloud_deploy.log.txt.gz#_2017-10-26_06_15_13 -- not sure if this is known error.13:15
adarazs|roveror if it's just a random error.13:15
*** jaosorior has quit IRC13:16
*** mdnadeem has quit IRC13:17
*** ykarel is now known as ykarel|away13:17
socialzaneb: it's os, time and thread13:17
socialzaneb: but yes, just switching it to false fixes the issue for me13:17
gfidentesshnaidm bnemec regarding this https://review.openstack.org/#/c/515188/113:17
gfidenteI wonder if you guys have any data telling us that scenario001 and scenario004 were timing out more?13:18
thervesocial, thread to false?13:19
socialtherve: simply I want something like this https://github.com/openstack/designate/commit/a656b4c4de62b6eab19305ddb9acf120044c7e6513:20
gfidentesshnaidm bnemec consider scenario004 wasn't even using ceph-ansible yet so ... I am not sure13:20
openstackgerritBrent Eagles proposed openstack/tripleo-heat-templates master: Run Octavia configuration on the overcloud  https://review.openstack.org/50819513:20
thervesocial, That's patching more stuff, not less?13:21
adarazs|rovergfidente: were the ceph related timeouts looking like this? https://logs.rdoproject.org/openstack-periodic-4hr/periodic-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-master/5037bc0/undercloud/home/jenkins/overcloud_deploy.log.txt.gz#_2017-10-26_06_15_1313:21
openstackgerritMerged openstack/tripleo-ui stable/pike: Imported Translations from Zanata  https://review.openstack.org/51453313:21
*** ykarel|away has quit IRC13:21
gfidenteadarazs|rover it is not ceph related13:21
*** bfournie has joined #tripleo13:21
gfidenteadarazs|rover I don't know why you guys went on making those non-voring13:22
adarazs|rovergfidente: dunno yet, I just started to pay attention to the jobs today.13:22
gfidenteadarazs|rover at that stage heat hasn't started the config steps yet13:23
gfidentethere are identical failures for the controller nodes in other jobs13:23
openstackgerritHonza Pokorny proposed openstack/tripleo-common master: Add tripleo-ui container  https://review.openstack.org/51540713:25
*** gkadam_ has joined #tripleo13:26
*** gkadam has quit IRC13:27
EmilienMhi13:27
EmilienMflaper87: ok13:27
EmilienMadarazs|rover: ok I'll look shortly13:27
*** shreshtha has quit IRC13:28
EmilienMadarazs|rover: sounds like "just" a timeout13:28
adarazs|roverEmilienM: that's promising :)13:29
EmilienMpanda|ruck, adarazs|rover: any other blocker so far, except https://review.openstack.org/#/c/515388/ ?13:29
*** lblanchard has joined #tripleo13:29
adarazs|roverEmilienM: otherwise things passed, except for https://bugs.launchpad.net/tripleo/+bug/172769813:29
openstackLaunchpad bug 1727698 in tripleo "validate-simple still uses overcloudrc instead of overcloudrc.v3, failing master promotion jobs" [Critical,In progress] - Assigned to Attila Darazs (adarazs)13:29
EmilienMadarazs|rover: YEAH !13:29
EmilienMthat's good. Let's see13:29
adarazs|roverEmilienM: we'll see probably only at the 1600UTC job.13:29
*** shreshtha has joined #tripleo13:29
adarazs|roverif it triggers...13:30
EmilienMadarazs|rover: I added tech debt to the bug report13:30
EmilienMbecause d0ugal is doing the right fix in tripleo-commo13:30
EmilienMd0ugal: hi, and thanks for your quick patch btw. I'll take a look asap today13:31
adarazs|roverEmilienM: ack. also the periodic jobs might not trigger because https://bugs.launchpad.net/tripleo/+bug/1724006/13:31
openstackLaunchpad bug 1724006 in tripleo "tracker bug: tripleo promotion jobs should kick every four hours" [Critical,Triaged]13:31
adarazs|roverEmilienM, panda|ruck: still everything is queued on the "openstack-periodic-4hr" pipeline from the 1200UTC jobs: https://review.rdoproject.org/zuul/ -- which will probably not get the validate-simple fix yet.13:32
EmilienMd0ugal: sounds like it fails on http://logs.openstack.org/51/515351/3/check/openstack-tox-pep8/b58c51d/job-output.txt.gz#_2017-10-26_11_01_06_19331913:33
EmilienMadarazs|rover: we can ask pabelanger to exceoptionally promote it in the gate13:33
adarazs|roverEmilienM: that could help.13:33
EmilienMit's free to ask, let me do it13:33
adarazs|roverEmilienM: thanks!13:34
EmilienMdone13:34
*** oidgar has quit IRC13:35
*** jprovazn has quit IRC13:35
*** pkovar has quit IRC13:36
*** lblanchard has quit IRC13:36
*** gkadam_ has quit IRC13:37
EmilienMtherve: it sounds like we have much less timeouts13:38
EmilienMfultonj, gfidente : I'm going to revert the non voting patch, it sounds like it's more stable now13:39
openstackgerritRicardo Noriega proposed openstack/tripleo-heat-templates master: Using stevedore alias for BGPVPN Service Plugin  https://review.openstack.org/51127713:39
fultonjEmilienM: awesome!13:39
fultonj001 back to voting13:39
fultonjand hopefully we can get 004 using ceph-asnible today, see how it does, and then make it vote soon13:40
*** rodolof has quit IRC13:40
gfidentefultonj I think that's voting from the start13:40
gfidentecause it was already before13:40
gfidentedon't tell EmilienM !13:40
fultonji think it's voting power was removed yesterday13:41
fultonjit was gerry mandered temporarily13:41
EmilienMfultonj, gfidente : what?13:41
EmilienMhow is it voting?13:41
gfidentefultonj yeah but by reverting the non-voting patch both are voting again13:41
fultonjgfidente: EmilienM made a temp change last night, did you see it?13:41
EmilienMI didn't13:41
EmilienMI'm reverting the non voting patch: https://review.openstack.org/51541113:42
EmilienMfultonj: ah /me sorry. Early here13:42
fultonjok, i got it13:42
gfidenteEmilienM fultonj yeah which makes both 001 and 004 voting13:42
fultonjgfidente: yep13:42
*** mrch has joined #tripleo13:42
fultonjboth voting13:42
gfidenteso we break CI more often!13:44
gfidentewonderful13:44
openstackgerritFlorian Fuchs proposed openstack/tripleo-validations master: Add lookup plugin for ironic nodes  https://review.openstack.org/51430813:44
openstackgerritFlorian Fuchs proposed openstack/tripleo-validations master: Add a health check for overcloud nodes  https://review.openstack.org/51056013:44
gfidenteEmilienM though would be nice to see the trend of the jobs13:44
gfidentehttp://tripleo.org/cistatus.html13:45
EmilienMgfidente: cistatus.tripleo.org13:45
EmilienMyou can already see it.13:45
*** pgadiya has quit IRC13:45
*** catintheroof has joined #tripleo13:45
*** catintheroof has quit IRC13:46
*** catintheroof has joined #tripleo13:46
EmilienMgfidente: if you click on the job, you can see charts13:47
EmilienMgfidente: and % of failures per day / week, etc13:47
gfidenteamazing13:47
openstackgerritAna Krivokapic proposed openstack/tripleo-validations master: Enhance repo validation to check for unwanted enabled repos  https://review.openstack.org/51541213:47
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: RHSM: when using proxy, test its connectivity first  https://review.openstack.org/51353013:48
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: RHSM: when using proxy, test its connectivity first  https://review.openstack.org/51353013:48
openstackgerritEmilien Macchi proposed openstack/tripleo-quickstart master: fs10: deploy steps with ansible  https://review.openstack.org/50830713:49
*** amodi has joined #tripleo13:49
*** rbowen has joined #tripleo13:51
*** catinthe_ has joined #tripleo13:52
therveEmilienM, I looked at logstash a bit, and most recent logs seem to be at least 5 days old13:53
therveIs it expected?13:53
*** ykarel|away has joined #tripleo13:53
*** jaosorior has joined #tripleo13:53
*** pkovar has joined #tripleo13:54
*** catintheroof has quit IRC13:55
EmilienMtherve: afik yeah elastic recheck data is lagging a lot13:58
EmilienMadarazs|rover: promoted in the gate13:58
adarazs|roverEmilienM: \o/13:59
therveDang, that lowers the usefulness quite a bit...13:59
openstackgerritAttila Darazs proposed openstack/tripleo-quickstart-extras master: GATE CHECK for quickstart-extras  https://review.openstack.org/47260714:00
*** ramishra has quit IRC14:00
*** masco has quit IRC14:02
*** ramishra has joined #tripleo14:02
*** jbadiapa has quit IRC14:07
*** rcernin has joined #tripleo14:08
*** pblaho has quit IRC14:08
*** pdeore has quit IRC14:09
*** ooolpbot has joined #tripleo14:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION14:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/172286414:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/172745414:10
*** ooolpbot has quit IRC14:10
openstackLaunchpad bug 1722864 in tripleo "OVB frequent timeouts on rh1 cloud" [Critical,Triaged]14:10
openstackLaunchpad bug 1727454 in tripleo "OS_AUTH_URL in overcloudrc points to keystone API v2.0" [Critical,In progress] - Assigned to Dougal Matthews (d0ugal)14:10
*** atoth_ is now known as atoth14:11
*** mrch has quit IRC14:13
*** jfrancoa has quit IRC14:15
*** catinthe_ has quit IRC14:17
*** catintheroof has joined #tripleo14:17
d0ugalsocial: it might be good to bring it up at the Mistral meeting on Monday?14:17
*** agurenko has quit IRC14:21
*** ffiore_ has quit IRC14:21
sociald0ugal: ACK14:22
*** iranzo has quit IRC14:23
openstackgerritToure Dunnon proposed openstack/python-tripleoclient master: Tripleoclient unified queue name.  https://review.openstack.org/50990214:24
*** newmember has joined #tripleo14:25
*** iranzo has joined #tripleo14:25
*** iranzo has quit IRC14:25
*** iranzo has joined #tripleo14:25
openstackgerritDougal Matthews proposed openstack/tripleo-heat-templates master: Make KeystoneURL versionless  https://review.openstack.org/51535114:25
d0ugalEmilienM: updated, sorry - I'm not that familiar with working in t-h-t. I get lots of strange errors locally in master with tox, but hopefully that does better ^14:25
panda|ruckjaosorior: I have some code for it in a review already, but it needa some cleanup, so I'm not sure when it will get merged14:26
EmilienMd0ugal: no worries14:26
EmilienMsdoran: James found this bug, that affects the tripleo inventory during config-download https://github.com/ansible/ansible/issues/3219614:29
openstackgerritJames Slagle proposed openstack/tripleo-quickstart-extras master: Use dynamic inventory  https://review.openstack.org/51542514:30
openstackgerritEmilien Macchi proposed openstack/tripleo-quickstart master: fs10: deploy steps with ansible  https://review.openstack.org/50830714:32
*** jfrancoa has joined #tripleo14:33
*** ffiore_ has joined #tripleo14:33
openstackgerritMarios Andreou proposed openstack/tripleo-heat-templates master: WIP: FFU reposwitch  https://review.openstack.org/51542914:36
adarazs|roversshnaidm, panda|ruck: don't merge this https://review.rdoproject.org/r/10258 until https://review.openstack.org/515388 merges -- we might be able to use the still queued 1600UTC promotion to test :)14:38
*** oidgar has joined #tripleo14:42
*** suuuper has quit IRC14:44
*** cshastri has quit IRC14:45
*** rbowen has quit IRC14:52
openstackgerritmathieu bultel proposed openstack/python-tripleoclient master: Add option for ceph ansible playbook  https://review.openstack.org/51543614:54
*** ykarel|away has quit IRC14:59
EmilienMadarazs|rover: your oooq-extras patch will merge in ~1h3515:00
*** trozet has joined #tripleo15:00
adarazs|roverEmilienM: that's still not going to make it for even the 1600UTC jobs...15:00
adarazs|rover:/15:00
adarazs|roverI'll just submit that change that raises the pipeline priority.15:01
EmilienMadarazs|rover: well, except if the jobs are still in queue in 1h3515:01
adarazs|roverat least we'll get another data point about how the jobs work.15:01
EmilienMadarazs|rover: 9 UTC is in 1h15:01
EmilienMif the jobs are in queue but not running for at least 30 min it's good15:02
adarazs|roveryeah, okay, maybe the queue will last.15:02
*** spectr has quit IRC15:02
*** gkadam_ has joined #tripleo15:02
*** jaosorior has left #tripleo15:02
sociald0ugal: I'll bump my review again and comment on it so it's ready to be discussed on monday15:04
d0ugalsocial: great, thanks.15:04
*** rcernin has quit IRC15:04
*** ooolpbot has joined #tripleo15:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION15:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/172286415:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/172745415:10
*** ooolpbot has quit IRC15:10
openstackLaunchpad bug 1722864 in tripleo "OVB frequent timeouts on rh1 cloud" [Critical,Triaged]15:10
openstackLaunchpad bug 1727454 in tripleo "OS_AUTH_URL in overcloudrc points to keystone API v2.0" [Critical,In progress] - Assigned to Dougal Matthews (d0ugal)15:10
openstackgerritmathieu bultel proposed openstack/tripleo-common master: Update ceph-ansible playbook path in parameter default for update  https://review.openstack.org/51544215:10
*** jprovazn has joined #tripleo15:12
*** liverpooler has joined #tripleo15:12
*** aufi has quit IRC15:13
openstackgerritMarian Krcmarik proposed openstack/tripleo-heat-templates master: Add some Database and Messaging standalone example role definitions  https://review.openstack.org/51544515:18
*** newmember has quit IRC15:19
*** shreshtha has quit IRC15:19
*** newmember has joined #tripleo15:19
*** catintheroof has quit IRC15:20
*** catintheroof has joined #tripleo15:20
*** pkovar has quit IRC15:21
openstackgerritDougal Matthews proposed openstack/tripleo-common master: [DNM] Setup Tempest for tripleo-common  https://review.openstack.org/51531915:21
openstackgerritJohn Fulton proposed openstack/tripleo-docs master: DockerCephDaemonImage is now optional for Ceph deployments  https://review.openstack.org/51544615:21
fultonjgfidente: ^15:22
gfidentefultonj thanks15:22
openstackgerritOr Idgar proposed openstack/tripleo-common master: Add ansible playbook for configuring octavia  https://review.openstack.org/48745015:23
openstackgerritSven Anderson proposed openstack/tripleo-quickstart master: TEST DON'T MERGE - Enabling EC2-API Tempest tests.  https://review.openstack.org/51513915:24
*** catintheroof has quit IRC15:25
*** artom_ is now known as artom15:25
openstackgerritChristian Schwede proposed openstack/tripleo-heat-templates stable/pike: Remove rsync from xinetd when upgrading to containerized deployment  https://review.openstack.org/51544815:26
*** ecerquei has joined #tripleo15:28
*** ykarel has joined #tripleo15:29
*** jfrancoa has quit IRC15:35
*** ykarel has quit IRC15:35
*** fultonj_ has joined #tripleo15:35
*** fultonj_ has quit IRC15:36
mandreis there a way to tell tempest to use the the local cirros image on the nodepool node?15:36
mandrei noticed a network failure when tempest tried to download cirros image in https://review.openstack.org/#/c/513323/15:37
*** ecerquei has quit IRC15:37
openstackgerritJiri Stransky proposed openstack/tripleo-heat-templates master: Allow installing multiple-node Kubernetes  https://review.openstack.org/51473015:37
*** fultonj has quit IRC15:38
*** ecerquei has joined #tripleo15:38
*** fultonj has joined #tripleo15:38
*** itlinux has joined #tripleo15:39
*** yprokule has quit IRC15:39
jistr|mtgsshardy: ^ with the above patch the worker node registered with the master successfully for me15:40
jistr|mtgspod launching etc. TBD15:40
jistr|mtgscc flaper87 ^15:40
openstackgerritPradeep Kilambi proposed openstack/python-tripleoclient master: Support to drive undercloud deploy via undercloud.conf  https://review.openstack.org/51135015:42
*** pkovar has joined #tripleo15:44
*** trozet has quit IRC15:45
*** dparkes has quit IRC15:45
*** catintheroof has joined #tripleo15:51
*** iranzo has quit IRC15:55
*** catintheroof has quit IRC15:55
*** athomas has quit IRC15:57
EmilienMlyarwood: have you seen https://www.openstack.org/summit/sydney-2017/summit-schedule/events/19296/making-fast-forward-upgrade-openstack-possible-with-configuration-mapping-tool ?15:58
flaper87jistr|mtgs: a.w.e.s.o.m.e15:58
flaper87jistr|mtgs: all caps15:58
jistr|mtgs:D15:58
*** catintheroof has joined #tripleo16:01
*** eggmaster has quit IRC16:02
EmilienMadarazs|rover: what did you do???? https://review.openstack.org/#/c/515388/16:02
*** bogdando has quit IRC16:03
EmilienMI hope you didn't kill it from the gate :(16:03
adarazs|roverEmilienM: I did not. it's still running.16:03
EmilienMyeah, I just hope it won't retry it16:03
adarazs|roverEmilienM: I do hope it will try to merge it.16:03
EmilienMyeah...16:03
sshnaidmadarazs|rover, if we want to run promotion we need this urgently: https://review.rdoproject.org/r/#/c/10258 , the queue is full16:03
adarazs|roverEmilienM: yeah fingers crossed. sorry. :/ tried to make sure the other won't get merged.16:03
adarazs|roversshnaidm: we don't want to run the promotion without https://review.openstack.org/51538816:04
EmilienMsshnaidm: you have my +216:04
sshnaidmadarazs|rover, uh, ok16:04
adarazs|roversshnaidm: and it looks like it will merge about 30 minutes after.16:04
EmilienMin less than 30min we're good I hope16:04
adarazs|roversshnaidm: so if the high priority will apply for the current jobs in the queue, when we merge it might start the jobs.16:05
adarazs|roversshnaidm: so it's worth waiting.16:05
sshnaidmadarazs|rover, sure16:05
EmilienM2 jobs are running, one tempest running and another one overlcoud still deploying16:05
*** ffiore_ has quit IRC16:07
mandreEmilienM, sshnaidm: one of you know if we still have the local cirros images on the nodepool nodes with zuulv3? that shouldn't change anything, right?16:07
EmilienMmandre: region mirrors you mean?16:07
EmilienMoh no16:07
EmilienMthe cirros images16:07
mandreI remember we set the pingtest to use a local path for the cirros image, but it looks like now we're pulling from the cirros website again16:08
EmilienMmandre: we can confirm with pabelanger ^ Paul: do we still have the local cirros images on the nodepool nodes with zuulv3?16:08
*** fragatina has quit IRC16:09
itlinuxhello all has anyone setup cells2 within ooo? I need to get regions and / or cells216:09
itlinuxany tips?16:09
pabelangerEmilienM: mandre: yes, they are still on disk16:10
pabelanger/opt/cache/files16:10
*** ooolpbot has joined #tripleo16:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION16:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/172286416:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/172745416:10
*** ooolpbot has quit IRC16:10
openstackLaunchpad bug 1722864 in tripleo "OVB frequent timeouts on rh1 cloud" [Critical,Triaged]16:10
EmilienMthx16:10
openstackLaunchpad bug 1727454 in tripleo "OS_AUTH_URL in overcloudrc points to keystone API v2.0" [Critical,In progress] - Assigned to Dougal Matthews (d0ugal)16:10
EmilienMpanda|ruck: removing alert on 1727454 ^16:10
EmilienMwe have a workaround, that is almost merged16:10
mandrepabelanger: thanks, looks like we reverted the changed that used the local images16:11
*** ecerquei has quit IRC16:11
EmilienMpabelanger: when you have time, please review https://review.openstack.org/#/c/515411/ - we're in better shape today16:11
*** dprince has quit IRC16:12
EmilienMpabelanger: thx16:13
*** ebarrera has quit IRC16:13
EmilienMfultonj, gfidente : fyi ^ scenario001 / 004 containers - voting again shortly.16:13
fultonjEmilienM: thanks16:14
mandreEmilienM: ack thx16:16
*** derekh has quit IRC16:17
*** psachin has quit IRC16:17
panda|ruckEmilienM: thanks.16:17
*** lucasagomes is now known as lucas-afk16:17
*** oidgar has quit IRC16:17
panda|ruckEmilienM:  I'don't see the alert on https://bugs.launchpad.net/tripleo/+bug/172771116:17
openstackLaunchpad bug 1727711 in tripleo "CI pike promotion: deployment fails" [Undecided,Triaged]16:17
EmilienMpanda|ruck: is it critical?16:19
EmilienMif no, alert won't popup16:19
EmilienMadarazs|rover: it's about to merge16:22
EmilienMand the openstack-periodic-4hr still in queue16:22
adarazs|roveryay :)16:22
EmilienMso next round should be better16:23
panda|ruckEmilienM: dammit16:23
*** gvrangan has joined #tripleo16:23
EmilienMpanda|ruck: ?16:23
panda|rucknow it's critical :)16:23
*** kjw3 has joined #tripleo16:23
EmilienMgood16:23
EmilienMpanda|ruck: https://github.com/weshayutin/tripleo-critical-bugs/blob/master/reports/launchpad.py#L5716:24
openstackgerritMartin André proposed openstack-infra/tripleo-ci master: Use local cirros image in tempest  https://review.openstack.org/51546216:26
mandreEmilienM, sshnaidm: please take a look when you have time ^^16:27
EmilienMoh yeah16:27
EmilienMI'm sad that we have to hardcode the version16:28
sshnaidmmandre, thanks, let's see if it's really there :)16:28
*** jlinkes has quit IRC16:28
EmilienMit would be great to rename the file first to a standard name16:28
sshnaidmEmilienM, it changes once a year (or two?)16:28
mandreEmilienM: or symlink to cirros-latest.img or something16:29
EmilienMif we can build some software that is smart enough to find a file on a disk I'll go for it16:29
EmilienMmandre: yes16:29
EmilienMsymlink16:29
EmilienMI even thing that it could be solved at an infra level16:30
EmilienMnot in tripleo-ci only16:30
openstackgerritMerged openstack/tripleo-quickstart-extras master: Switch to keystone v3 API for validate-simple on master  https://review.openstack.org/51538816:30
EmilienMprovide in the image a symlink16:30
EmilienMadarazs|rover: here we go ^16:30
EmilienMmandre: let me look where do we manage this image16:30
adarazs|roverEmilienM: yep, I was anxiously looking at the last job until it finished :D16:30
*** hewbrocca is now known as hewbrocca_afk16:31
EmilienMmandre: I commented in the review.16:33
mandresshnaidm: do we still use the pingtest or is it tempest only nowadays?16:33
EmilienMmandre: pingtest for ovb jobs16:34
adarazs|rovermandre: some jobs use the pingtest.16:34
EmilienMmandre: tempest for multinode jobs16:34
sshnaidmmandre, in pingtest we handle this16:34
*** Goneri has quit IRC16:34
sshnaidmmandre,  if we don't find, we downlaod16:34
mandresshnaidm: can you point me at the code?16:35
*** dparkes has joined #tripleo16:37
lyarwoodEmilienM: yeah they were in the PTG sessions, it wasn't something we could use tbh16:37
EmilienMsshnaidm: it would be better to change the workflow and try to find a local symlink16:37
EmilienMlyarwood: ok :(16:37
mandresshnaidm: it looks to me we download the cirros image once in ~/cirros.img and then reuse it if it's there16:37
EmilienMpanda|ruck: can  be closed I think16:37
*** cylopez has quit IRC16:37
EmilienMpanda|ruck: https://github.com/openstack/tripleo-common/commit/6bef899ed13e0dcc5ba6a99bc1859fb77682bb4c16:37
*** ecerquei has joined #tripleo16:38
EmilienMpanda|ruck: closed16:38
EmilienMpanda|ruck: sorry, https://bugs.launchpad.net/tripleo/+bug/172771116:38
openstackLaunchpad bug 1727711 in tripleo "CI pike promotion: deployment fails" [Critical,Fix released]16:38
sshnaidmmandre, https://github.com/openstack/tripleo-quickstart-extras/blob/6c45808360757dfda6b2cec344fa439f695f5b10/roles/validate-simple/templates/overcloud-validate.sh.j2#L7316:39
sshnaidmmandre, if it exists in {{ validate_image_path }} we don't download it16:39
sshnaidmmandre, and you won another patch opportunity! https://github.com/openstack/tripleo-quickstart-extras/blob/d83d1ade1a808e8d34d1cdfdb6e45c4242c9f0b5/roles/validate-simple/defaults/main.yml#L1616:40
sshnaidm:D16:40
mandresshnaidm: yay!16:41
EmilienMmandre, sshnaidm : I have a suggestion, if I may16:43
EmilienMwe could curl http://download.cirros-cloud.net/version/released16:43
EmilienMand download the right version if not on disk16:43
EmilienMthat way, no hardcoding, less CI issues in the future, more fun16:43
*** Goneri has joined #tripleo16:43
sshnaidmEmilienM, but we use infras path for image right now16:44
panda|ruckEmilienM: ok, makes sense, the patch was merged 13 hours ago and the last run opike promotion was around the same time16:44
EmilienMpanda|ruck: yup16:44
sshnaidmEmilienM, and it includes the version16:44
mandreEmilienM: but we would still have an external dependency on cirros website16:44
EmilienMsshnaidm: I guess what I'm saying, let's try to find a smart solution to stop hardcoding16:44
sshnaidmEmilienM, to get last version dynamically?16:44
EmilienMwe could have the symlink on local image + the curl16:44
openstackgerritMartin André proposed openstack/tripleo-quickstart-extras master: Fix path to local cirros image for pingtest  https://review.openstack.org/51546516:45
EmilienMok so let me propose it again :16:45
EmilienM1) change infra image to have a symlink with a static path16:45
EmilienM2) in oooq, if the file exist, use it otherwise try to download16:45
EmilienM3) when trying to download, use curl to figure out which version to download16:45
EmilienMcan we do that?16:46
mandreEmilienM: that I like better16:46
sshnaidmEmilienM, I'd prefer to download a particular version, that we know it works. If something changes in cirros image that will break us..16:46
sshnaidmEmilienM, and p.1 we need to change in infra <- pabelanger16:47
EmilienMsshnaidm: ?16:47
EmilienMsshnaidm: not sure I got the last sentence16:48
pabelangercatching up, is there an issue with cirros image on nodes?16:48
*** fzdarsky is now known as fzdarsky|afk16:49
sshnaidmEmilienM, "change infra image to have a symlink with a static path" - what do you mean here?16:49
sshnaidmpabelanger, no, but we think how to optimize it16:49
sshnaidmpabelanger, can infra have like symlink to latest_cirros_image.raw ?16:50
pabelangersshnaidm: it would be a change to devstack, but you can propose it. We don't really manage that, we just run a script to download images devstack needs and they end up in that location16:51
sshnaidmwell, I can, it's not complex16:52
pabelangerso, propose it, see what devstack people say16:52
*** dprince has joined #tripleo16:52
*** dparkes has quit IRC16:53
*** florianf has quit IRC16:53
*** marios has quit IRC16:55
*** achadha has joined #tripleo16:55
*** dmacpher has quit IRC16:56
*** morazi has quit IRC16:57
*** achadha_ has joined #tripleo16:57
*** achadha has quit IRC16:57
*** jpena is now known as jpena|off16:59
*** mcornea has quit IRC16:59
*** lblanchard has joined #tripleo17:00
openstackgerritMerged openstack/puppet-tripleo stable/newton: Fix libvirt exec deps for split-stack  https://review.openstack.org/51194517:00
*** achadha_ has quit IRC17:01
*** achadha has joined #tripleo17:02
*** anshul has quit IRC17:02
*** achadha has quit IRC17:03
*** achadha has joined #tripleo17:03
openstackgerritMerged openstack/python-tripleoclient master: Do not return the config download path but only print it  https://review.openstack.org/51458017:05
*** dsariel has quit IRC17:06
*** thrash is now known as thrash|biab17:07
openstackgerritHonza Pokorny proposed openstack/tripleo-ui master: Remove 'Refresh results' button on the nodes page  https://review.openstack.org/51547417:07
*** ccamacho has quit IRC17:08
*** ooolpbot has joined #tripleo17:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION17:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/172286417:10
*** ooolpbot has quit IRC17:10
openstackLaunchpad bug 1722864 in tripleo "OVB frequent timeouts on rh1 cloud" [Critical,Triaged]17:10
*** fragatina has joined #tripleo17:10
EmilienMcould I have a review on https://review.openstack.org/#/c/514777/ please?17:12
*** rwsu has quit IRC17:13
*** yamahata has joined #tripleo17:18
*** raildo has quit IRC17:19
*** Goneri has quit IRC17:20
*** pkovar has quit IRC17:21
*** dtantsur is now known as dtantsur|afk17:22
*** trown is now known as trown|lunch17:22
*** Goneri has joined #tripleo17:22
*** rwsu has joined #tripleo17:25
*** panda|ruck is now known as panda|ruck|off17:30
*** achadha has quit IRC17:31
*** jmelvin has quit IRC17:32
*** achadha has joined #tripleo17:32
*** newmember has quit IRC17:33
*** salmankhan has quit IRC17:37
*** gkadam_ has quit IRC17:40
hamzyhey y'all I am trying to set custom Images in THT but can't get past it still using default_image_name: http://paste.openstack.org/show/624740/17:41
*** tesseract has quit IRC17:45
*** raildo has joined #tripleo17:46
*** amoralej is now known as amoralej|off17:46
*** yamahata has quit IRC17:49
*** newmember has joined #tripleo17:50
*** sri_ has quit IRC17:50
*** ccamacho has joined #tripleo17:55
*** agurenko has joined #tripleo17:57
*** tosky has quit IRC18:00
*** thrash|biab is now known as thrash18:04
d0ugalEmilienM: https://review.openstack.org/#/c/515351/ passed18:07
EmilienMlooking18:08
EmilienMd0ugal: fyi since we haven't promoted yet we still have keystone v2 support in CI18:08
EmilienMso we need to verify your patch by checking overcloudrc file18:08
EmilienMand it looks good18:09
EmilienMhttp://paste.openstack.org/show/RNPHaSJpIUj5gGrAOjLS/18:09
EmilienMoh but we override it on master18:09
openstackgerritHonza Pokorny proposed openstack/tripleo-heat-templates master: [WIP] tripleo ui docker  https://review.openstack.org/51549018:09
d0ugalEmilienM: The slight catch is that the v3 version is also versionless18:10
d0ugalI just realised that.18:10
*** ooolpbot has joined #tripleo18:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION18:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/172286418:10
*** ooolpbot has quit IRC18:10
openstackLaunchpad bug 1722864 in tripleo "OVB frequent timeouts on rh1 cloud" [Critical,Triaged]18:10
EmilienMd0ugal: ok18:10
EmilienMd0ugal: also is it a big deal if we don't overrride IDENTITY_API_VERSION ?18:10
d0ugalEmilienM: that I don't know.18:11
d0ugalWe maybe need somebody with more keystone skills to check this :)18:11
*** catintheroof has quit IRC18:13
*** jkilpatr has joined #tripleo18:16
*** jkilpatr has quit IRC18:16
*** trown|lunch is now known as trown18:16
*** paramite has quit IRC18:20
*** yamahata has joined #tripleo18:21
*** toure is now known as toure_biab18:25
*** akrivoka has quit IRC18:26
*** jmelvin has joined #tripleo18:28
openstackgerritEmilien Macchi proposed openstack/tripleo-quickstart-extras master: Use dynamic inventory  https://review.openstack.org/51542518:33
openstackgerritEmilien Macchi proposed openstack/tripleo-quickstart-extras master: Use dynamic inventory  https://review.openstack.org/51542518:33
itlinuxhello all.. I have a question since I configured fernet and LDAP. I can see all users but cannot see any groups.. this is a test env but the POC env with UUID can see the groups and the users from the LDAP same config.. just fernet diff.. it says invalid token.. uhm!!18:36
*** brian83 has quit IRC18:41
*** jcoufal has quit IRC18:48
*** tosky has joined #tripleo18:49
*** catintheroof has joined #tripleo18:51
*** gvrangan has quit IRC18:51
*** oidgar has joined #tripleo18:55
*** catintheroof has quit IRC18:56
*** dparkes has joined #tripleo19:00
*** Goneri has quit IRC19:00
hamzywell I was finally able to make a change...19:01
hamzyresources.Compute<nested_stack>.resources.0<http://9.114.118.98:8080/v1/AUTH_7601193ac88b471092a5bb5108e63b7d/overcloud/puppet/compute-role.yaml>.parameter_groups.deprecated: : The grouped parameter ppc64le-overcloud-full does not reference a valid parameter."19:02
hamzydon't know how to fix that yet... :)19:02
*** catintheroof has joined #tripleo19:05
*** anilvenkata has quit IRC19:08
bnemecUgh, zuul restart enqueued 70 jobs at once in check-tripleo.19:08
bnemecExpect a lot of ovb job failures due to environment creation issues.19:08
bnemecWe do not have the capacity to create 70 large-ish heat stacks at once.19:09
rookmwhahaha: ever seen this : https://gist.githubusercontent.com/jtaleric/55d7e0a551e04786ecee32e717e3774b/raw/3dfa8fb7ab516356c00760f61f4c7d8def502a41/gistfile1.txt19:09
rookI simply switched from ovs_bridge to linux_bridge and ovs_bond to linux_bond in my networking templates19:09
rookI also changed the bonding mode19:09
bnemecrook: mwhahaha is on PTO this week.19:09
*** catintheroof has quit IRC19:09
rookwell damnit19:09
bnemecAre you sure you want linux bridge though?19:10
rookbnemec: how about you :P19:10
rookbnemec: oh yes19:10
rookfor sure man19:10
*** ooolpbot has joined #tripleo19:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION19:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/172286419:10
*** ooolpbot has quit IRC19:10
openstackLaunchpad bug 1722864 in tripleo "OVB frequent timeouts on rh1 cloud" [Critical,Triaged]19:10
rookI can break the cloud so bad, that OVS becomes the bottle neck19:10
bnemecMy understanding was that linux bridge is only used in very specific cases, mostly for third-party vendor networking drivers.19:10
rookand starts dropping packets.19:10
rooknegative.19:10
rookIMHO we should default to linux bridge.19:10
* rook gets firewalled off grafana link19:11
bnemecrook: I'm not sure any of those are actually errors.  Most are deprecation warnings.19:12
bnemecThere are a couple I'm not sure about, but mostly that's "normal".19:12
rookbnemec: the deployment is "stuck"19:13
rookbasically os-collect-config isn't moving19:13
rookand the resource list isn't progressing19:13
rookhttp://norton.perf.lab.eng.rdu.redhat.com:3000/dashboard/db/openstack-controller-general-system-performance?orgId=1&var-Cloud=openstack-12-containers&var-NodeType=controller&var-Node=overcloud-controller-2&var-Interface=interface-br-ex&var-Disk=disk-sda&var-OSD=All&var-Pool=All&var-cpus0=All&var-cpus00=All&from=1509002069754&to=150904526975419:14
rookbnemec: ^19:14
rookyou don't want to be using OVS as your control plane with that going on.19:14
rookbasically, pacemaker will start breaking the cloud down since we will start dropping packets.19:15
bnemecrook: Was the new networking config applied successfully?19:15
rookheart beats will be lost... then the cloud will become lost.19:15
rookbnemec: from what I can tell, yes19:15
rookyup, brctl show -- i see the bridges and vlans.19:15
*** jcoufal has joined #tripleo19:15
rookhowever, the vlans do not have ips19:15
rookso, maybe something is fubar.19:16
bnemecYeah, my experience has been that often when a puppet apply hangs it's a networking issue.19:17
*** pchavva has quit IRC19:17
rookshit19:18
rookare people testing linux bridge?19:18
rookinstead of ovs...19:18
bnemecrook: I doubt it.  Like I said, I was previously told that linux bridge was for very specific use cases and was not generally recommended.19:19
rookbnemec i think it is now recommended... right jcoufal ?19:20
*** salmankhan has joined #tripleo19:20
bnemecrook: Maybe check with dsneddon, beagles, and bfournie.19:20
*** gfidente has quit IRC19:20
rookbnemec sure... if was to use linux bridge do i have to pass another yaml/template?19:21
rookwith oSP1219:21
rookor should it "Just work" (tm)19:21
jcoufalrook: yea, dsneddon is better to ask o nthis19:21
bnemecrook: I don't know.  I started to look into linux bridge quite a while ago for my template generator tool and was basically told "don't bother".19:22
rookbnemec: i remember that..19:22
bnemecTheoretically it should just be another configuration like the ovs versions, but I don't know what it should look like exactly.19:22
bnemecrook: We do have an example config here: https://github.com/openstack/tripleo-heat-templates/blob/master/network/config/single-nic-linux-bridge-vlans/controller.yaml19:23
rookI am starting to bet it is how I did the bond19:24
*** salmankhan has quit IRC19:24
*** trown is now known as trown|brb19:26
*** kbyrne has quit IRC19:27
*** oidgar has quit IRC19:28
dsneddonrook, Let me know if you want me to take a look19:28
*** catintheroof has joined #tripleo19:28
*** kbyrne has joined #tripleo19:30
rookdsneddon: is the recommendation still ovs_bridge?19:31
openstackgerritPradeep Kilambi proposed openstack/puppet-tripleo master: Remove Ceilometer Api puppet classes  https://review.openstack.org/51550219:31
bnemec[heat-admin@overcloud-controller-0 ~]$ heat stack-list | grep baremetal | wc -l19:33
bnemec8019:33
bnemec^That's not good. :-/19:33
bnemecWe're never supposed to have more than 70.19:33
dsneddonrook, For what? The recommendation is to use ovs_bridge for tenant bridges for VLAN mode, and use no bridge for Internal API if possible.19:33
openstackgerritIan Main proposed openstack/python-tripleoclient master: Use ansible to deploy undercloud.  https://review.openstack.org/50958619:34
rookdsneddon: why does it matter for tenant bridges?19:34
dsneddonrook, Ideally, we don't put control plane or Internal API on a bridge, for resiliency if OVS hiccups.19:34
rookdsneddon :D yup... I have been able to make ovs hiccup a lot.19:35
*** trown|brb is now known as trown19:35
dsneddonrook, You can use linux_bridge for tenant bridges with the ML2/linuxbridge driver, but if you want to use ML2/OVS you need to use ovs_bridge for tenant bridges19:35
dsneddonrook, But we don't really test linuxbridge19:35
openstackgerritIan Main proposed openstack/python-tripleoclient master: Use ansible to deploy undercloud.  https://review.openstack.org/50958619:35
dsneddonrook, I hear linuxbridge now supports VXLAN and GRE tunnels, but I don't think anyone at RH has tried it.19:36
rooki don't follow, if I create a linux_bridge, but use vlanXX, with a IP... and tell ovs to use vlanXX for my tenant network, it can still use that vlan interface.19:36
rookall neutron cares about is a IP to terminate the tunnel to.19:36
dsneddonrook, You haven't explained what you are using these bridges for?19:36
dsneddonrook, If you are just creating VLANs for isolated networks, just use the "type: vlan" and set the "device:" equal to the NIC/bond you want the VLAN on. No bridge needed.19:36
rookI just don't follow how ML2/LB even came up... as I am not switching the OC neutron plugin.19:36
rookright19:37
rookdsneddon: agreed.19:37
rookI could of sworn I heard the direction was to remove ovs as the bridge used or OC control-plane.19:37
dsneddonrook, Yeah, the recommendation for non-tenant-bridge interfaces is to use straight VLANs and either interfaces or bonds with no bridge.19:37
dsneddonrook, Right, the only interfaces that need to be on an OVS bridge are the tenant bridges and the external bridge.19:38
*** cylopez has joined #tripleo19:39
gregworkdoes anyone know how to get instances/br-int to use jumbo frames?  is this a neutron ml2 parameter or something i could have done in heat during the oc deploy ?19:48
rookhttps://access.redhat.com/documentation/en-us/red_hat_openstack_platform/10/html-single/advanced_overcloud_customization/#sect-Configuring_Jumbo_Frames gregwork19:51
rook?19:51
gregworkrook: so i set those and ovs-appctl dpif/show lists the mtu as 9k19:52
openstackgerritMichele Baldessari proposed openstack/instack-undercloud master: WIP DNR Testing the logging of slow queries  https://review.openstack.org/51551019:52
gregworkhowever the dynamically attached interfaces that instances use are coming up on br-int as 150019:52
rookhttps://docs.openstack.org/mitaka/networking-guide/config-mtu.html19:53
gregworkok perfect19:53
gregworkis this configurable in heat prior to the oc deploy ?19:53
rookhttps://github.com/openstack/tripleo-heat-templates/blob/master/puppet/services/neutron-base.yaml#L6719:55
*** jcoufal has quit IRC19:56
*** liverpooler has quit IRC20:02
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: Add --detailed-exitcodes when running puppet via ansible  https://review.openstack.org/51150920:03
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: DO NOT MERGE testing containerized scenarios  https://review.openstack.org/51004020:03
EmilienMbandini: rebased so we can test with the workaround ^ but it should pass this time20:03
*** lblanchard has quit IRC20:06
*** ooolpbot has joined #tripleo20:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION20:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/172286420:10
openstackLaunchpad bug 1722864 in tripleo "OVB frequent timeouts on rh1 cloud" [Critical,Triaged]20:10
*** ooolpbot has quit IRC20:10
EmilienMadarazs|rover, panda|ruck|off, bnemec: do we have some action ^ ? if not I would close the alert.20:11
EmilienMit has been here for long time now.20:11
*** hamzy has quit IRC20:14
*** jprovazn has quit IRC20:16
openstackgerritSteve Baker proposed openstack/tripleo-quickstart-extras master: Make UI accessable by default on OVB  https://review.openstack.org/50796920:17
openstackgerritSteve Baker proposed openstack/tripleo-quickstart-extras master: Sudo fix overcloud-custom-tht-script.sh.j2  https://review.openstack.org/49901820:17
openstackgerritSteve Baker proposed openstack/tripleo-quickstart-extras master: Use os_keypair for key upload  https://review.openstack.org/44522420:17
openstackgerritSteve Baker proposed openstack/tripleo-quickstart-extras master: Allow OVB to attach undercloud to existing floating IP  https://review.openstack.org/50639720:17
openstackgerritBen Nemec proposed openstack-infra/tripleo-ci master: Update testenv-worker for newer novaclient  https://review.openstack.org/51551920:19
openstackgerritJan Provaznik proposed openstack/puppet-tripleo master: Add support for cephfs+ganesha backend in manila  https://review.openstack.org/47124720:24
openstackgerritRonelle Landy proposed openstack/tripleo-quickstart master: Get DLRN hash before setting up repos and images  https://review.openstack.org/51285520:25
*** bfournie has quit IRC20:28
*** bfournie has joined #tripleo20:28
*** newmember has quit IRC20:28
*** bfournie has quit IRC20:35
*** abregman has quit IRC20:36
openstackgerritRonelle Landy proposed openstack-infra/tripleo-ci master: Use rdoproject-based settings for containers and dlrn_hash for images  https://review.openstack.org/51466820:38
*** cylopez has quit IRC20:38
*** ansmith has quit IRC20:38
*** trozet has joined #tripleo20:40
*** cylopez has joined #tripleo20:41
*** ecerquei has quit IRC20:42
*** catintheroof has quit IRC20:49
*** jcoufal has joined #tripleo20:52
*** jcoufal has quit IRC20:59
*** achadha has quit IRC21:01
*** achadha has joined #tripleo21:01
*** achadha has quit IRC21:02
*** achadha has joined #tripleo21:02
*** raildo has quit IRC21:03
*** trown is now known as trown|outtypewww21:06
*** achadha_ has joined #tripleo21:06
openstackgerritMerged openstack/tripleo-heat-templates master: Add option for keystone containers to log to stdout/stderr  https://review.openstack.org/50851721:06
openstackgerritMerged openstack/tripleo-quickstart-extras master: Split general OVB setup tasks from the the stack create  https://review.openstack.org/51156821:06
*** achadha has quit IRC21:07
itlinuxhello the note "One can also specify several domains. For instance:" from this page https://docs.openstack.org/tripleo-docs/latest/install/advanced_deployment/domain_specific_ldap_backends.html show i can add more than one domain but it did not work for me.. I had a space in between domains and it failed everytime.. I now trying to add it again without space between domains and see..21:08
*** amodi has quit IRC21:10
*** achadha_ has quit IRC21:10
*** trozet has quit IRC21:11
*** pblaho has joined #tripleo21:11
openstackgerritRonelle Landy proposed openstack-infra/tripleo-ci master: Use rdoproject-based settings for containers and dlrn_hash for images  https://review.openstack.org/51466821:12
*** abishop has quit IRC21:13
*** cylopez has quit IRC21:14
*** rlandy is now known as rlandy|brb21:23
*** ansmith has joined #tripleo21:27
*** salmankhan has joined #tripleo21:29
*** dprince has quit IRC21:30
*** leitan has quit IRC21:33
openstackgerritSteve Baker proposed openstack/python-tripleoclient master: Autodetect insecure registry in container image prepare  https://review.openstack.org/51447321:36
*** bfournie has joined #tripleo21:42
*** bfournie has joined #tripleo21:42
*** achadha has joined #tripleo21:43
*** achadha has quit IRC21:48
*** rlandy|brb is now known as rlandy21:51
*** salmankhan has quit IRC21:51
*** salmankhan has joined #tripleo21:52
*** cdearborn has quit IRC21:52
openstackgerritAttila Darazs proposed openstack/tripleo-quickstart-extras master: GATE CHECK for quickstart-extras  https://review.openstack.org/47260722:00
*** salmankhan has quit IRC22:00
*** dciabrin has quit IRC22:00
*** cylopez has joined #tripleo22:05
*** jmelvin has quit IRC22:10
*** dciabrin has joined #tripleo22:15
*** pmannidi has joined #tripleo22:27
*** bobh has quit IRC22:30
*** bobh has joined #tripleo22:31
*** rlandy has quit IRC22:33
*** bobh has quit IRC22:36
*** itlinux has quit IRC22:39
*** apetrich has quit IRC22:43
*** apetrich has joined #tripleo22:46
*** sshnaidm is now known as sshnaidm|off22:46
*** achadha has joined #tripleo22:49
*** achadha has quit IRC22:49
*** achadha has joined #tripleo22:50
*** cylopez has quit IRC22:55
*** trozet has joined #tripleo23:04
*** tosky has quit IRC23:11
*** achadha has quit IRC23:12
*** achadha has joined #tripleo23:13
*** achadha has quit IRC23:14
*** achadha has joined #tripleo23:15
*** achadha has quit IRC23:16
*** achadha has joined #tripleo23:17
*** trozet has quit IRC23:17
*** pblaho has quit IRC23:19
*** achadha_ has joined #tripleo23:19
*** achadha has quit IRC23:21
*** achadha_ has quit IRC23:22
*** achadha has joined #tripleo23:22
*** achadha has quit IRC23:26
*** links has joined #tripleo23:46
*** achadha has joined #tripleo23:52
*** achadha has quit IRC23:56
*** gkadam_ has joined #tripleo23:56

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!