Tuesday, 2019-01-29

openstackgerritRedHat RDO CI proposed openstack/tripleo-heat-templates master: GATE CHECK for TripleO  https://review.openstack.org/60429800:00
*** _fragatina has joined #tripleo00:01
jidarmwhahaha: yep, I had missed one. It's running through the deploy now, thanks for the spot check ;)00:02
*** wolverineav has joined #tripleo00:02
*** itlinux has joined #tripleo00:10
NobodyCamGood afternoon Tripleo folks, anyone have any docs on trouble shooting the public network on the overcloud?00:12
openstackgerritwes hayutin proposed openstack/tripleo-quickstart master: WIP: add python3 to libvirt nodes  https://review.openstack.org/63362800:13
jidarNobodyCam: what specifically? The OVS bridge, routing, SNAT, tracing flows, building the network, vlans, etc?00:13
NobodyCamI am attempting to get public network attached to a overcloud instance: I followed the steps for non native vlan here: https://access.redhat.com/documentation/en-us/red_hat_openstack_platform/12/html/director_installation_and_usage/chap-performing_tasks_after_overcloud_creation#sect-Creating_the_Overcloud_External_Network00:15
NobodyCamhttps://www.irccloud.com/pastebin/Uu6n225P/00:16
openstackgerritJill Rouleau proposed openstack/tripleo-heat-templates master: step3: flatten nova service configuration  https://review.openstack.org/63359700:16
NobodyCamhttps://www.irccloud.com/pastebin/aIp3E2ax/00:16
jidaryou see the IP on your controller?00:17
NobodyCamovs-vsctl show? (I do not see it)00:18
jidarlook for errors in ovsdb or whatever in your system log00:19
jidarI'm having trouble rememering where the ip gets set for that interface, I don't think it's in `ip netns` but it might be00:20
NobodyCamon the controler00:20
*** sdake has quit IRC00:23
*** sdake has joined #tripleo00:24
*** ansmith has joined #tripleo00:34
*** wolverineav has quit IRC00:34
*** wolverineav has joined #tripleo00:35
*** jcoufal has quit IRC00:36
*** trown is now known as trown|outtypewww00:39
*** wolverineav has quit IRC00:39
*** wolverineav has joined #tripleo00:52
*** wolverineav has quit IRC00:56
*** ansmith has quit IRC01:03
*** ansmith has joined #tripleo01:04
openstackgerritRonelle Landy proposed openstack/tripleo-quickstart-extras master: WIP: Design new role for zuul-based reproducer  https://review.openstack.org/63106701:09
*** rlandy is now known as rlandy|bbl01:15
openstackgerritSteve Baker proposed openstack/tripleo-common master: Use the yaml stdout_callback for better prepare logging  https://review.openstack.org/63363301:18
*** rh-jelabarre has quit IRC01:24
*** _fragatina has quit IRC01:27
*** sdake has quit IRC01:28
openstackgerritSteve Baker proposed openstack/tripleo-common master: Use the yaml stdout_callback for better prepare logging  https://review.openstack.org/63363301:28
*** _fragatina has joined #tripleo01:28
*** gchamoul has quit IRC01:28
*** zoli has quit IRC01:28
jidaris there an easy way to better format the output of a heat stack that does a bunch of shell stuff01:31
jidarI guess without resorting to piping it through a few awk/sed scripts01:31
*** _fragatina has quit IRC01:32
*** ansmith has quit IRC01:32
*** gchamoul has joined #tripleo01:34
*** tosky has quit IRC01:34
*** wolverineav has joined #tripleo01:37
*** artom has joined #tripleo01:37
*** gchamoul has quit IRC01:47
*** fultonj has quit IRC02:07
*** gchamoul has joined #tripleo02:09
openstackgerritDavid Peacock proposed openstack/tripleo-heat-templates master: flatten haproxy service configuration  https://review.openstack.org/62663102:11
openstackgerritMerged openstack/puppet-tripleo master: httpd: Remove default post-save command for certmonger  https://review.openstack.org/63317102:24
*** tzumainn has quit IRC02:30
*** sdake has joined #tripleo02:31
openstackgerritMerged openstack/puppet-tripleo master: rabbitmq:  Remove default post-save command for certmonger  https://review.openstack.org/63321602:33
openstackgerritMerged openstack/tripleo-common master: Override fluentd plugin block  https://review.openstack.org/63299302:33
openstackgerritMerged openstack/tripleo-heat-templates master: Optional ICMP validation of controllers and gateways  https://review.openstack.org/62069802:35
openstackgerritMerged openstack/tripleo-heat-templates master: Look for parameters in parameter_groups  https://review.openstack.org/63180502:35
openstackgerritMerged openstack/python-tripleoclient stable/rocky: Improve error message around hieradata override file  https://review.openstack.org/63354802:35
openstackgerritMerged openstack/tripleo-heat-templates master: Enable ML2 baremetal by default with Ironic service  https://review.openstack.org/63258302:35
*** sdake has quit IRC02:37
*** sdake has joined #tripleo02:37
*** mschuppert has quit IRC02:45
*** psachin has joined #tripleo02:53
*** ykarel|away has joined #tripleo02:55
*** sdake has quit IRC02:58
*** sdake has joined #tripleo02:58
*** rlandy|bbl is now known as rlandy03:04
*** rlandy has quit IRC03:04
*** gkadam has joined #tripleo03:11
*** _fragatina has joined #tripleo03:12
*** _fragatina has quit IRC03:13
*** _fragatina has joined #tripleo03:14
*** apetrich has quit IRC03:15
*** sdake has quit IRC03:26
*** kplant has joined #tripleo03:27
kplantfor centos, is there another "stable" repository for tripleo other than the SIG centos-release-openstack-<release> ?03:29
*** sdake has joined #tripleo03:30
*** kplant_ has joined #tripleo03:33
*** kplant has quit IRC03:35
*** kplant_ is now known as kplant03:35
*** sdake has quit IRC03:42
*** ykarel|away is now known as ykarel03:42
ykarelkplant, are you seeing issues with centos-release-openstack-<release> packages?03:43
kplantyes, the undercloud fails to install completely03:43
ykarelthere are rdo repos which can also be used to deploy03:43
kplantspecifically with rocky, haven't tried anything older03:44
ykarelwhat's the error?03:45
kplantthe installation completes with the current centos7 master repo for rdo03:45
ykareland for using RDO repos u can follow:- https://docs.openstack.org/tripleo-docs/latest/install/installation/installing.html03:45
kplantone second, it's a pretty weak error. i'll paste it03:45
kplant^ that uses the centos7-master repo right?03:45
kplant2019-01-28 22:17:44,644 ERROR: 35014 -- ERROR configuring ironic03:46
ykarelkplant, it has options to configure repos for master as well as stable releases03:46
ykarellike sudo -E tripleo-repos -b ocata current for ocata03:47
ykarelkplant, that's the ERROR,  but to get cause behind it u need to scroll the logs03:47
ykarelERROR configuring ironic doesn't say much03:47
kplantyeah i agree03:47
kplantis there a better place to look instead of the installer log dropped in ~?03:47
ykarelthe place is same, can u share complete logs, i might look03:48
ykarelbasically some puppet script failed03:48
kplantsure, let me clean some things up and rerun to produce the error03:49
kplanti made a mess of the environment after that03:49
ykarelokk :)03:49
*** ykarel is now known as ykarel|afk03:50
*** udesale has joined #tripleo04:01
kplantykarel|afk: which log(s) would you like?04:03
*** ykarel|afk is now known as ykarel04:06
ykarelkplant, the logs where you see that ERROR04:06
*** _fragatina has quit IRC04:08
kplantokay, install is rolling - will paste when it's stopped04:09
kplantappreciate it, ahead of time04:09
ykarelkplant, i think i got the issue with centos repo04:09
kplantoh?04:10
ykarelkplant, might be https://lists.rdoproject.org/pipermail/users/2018-December/000448.html, but just wait for logs to confirm it04:11
ykareli see that commit is not released yet04:11
kplantsemi-related are there repos for production i should be using that are not the SIG repos?04:17
kplanttripleo-repos -b rocky current seems to be pretty unstable04:17
kplantgot the failure, install-undercloud.log is 686K which is larger than the max for pastebin04:21
*** chkumar|out is now known as chandankumar04:22
kplant2019-01-28 22:18:04,879 ERROR: 34356 -- Failed running docker-puppet.py for ironic04:23
kplantERROR: 34356 -- Notice: hiera(): Cannot load backend module_data: cannot load such file -- hiera/backend/module_data_backend04:23
kplanta little more data04:23
ykarelnot sufficient data04:24
kplanthow should i get this file to you? it's larger than the max for pastebin04:25
ykarelkplant, try searching: Error: /Stage04:25
kplantok04:25
kplanthere we go04:26
kplantError: /Stage[main]/Ironic::Pxe/Ironic::Pxe::Tftpboot_file[pxelinux.0]/File[/var/lib/ironic/tftpboot/pxelinux.0]: Could not evaluate: Could not retrieve information from environment production source(s) file:/usr/share/syslinux/pxelinux.004:26
kplantError: /Stage[main]/Ironic::Pxe/Ironic::Pxe::Tftpboot_file[chain.c32]/File[/var/lib/ironic/tftpboot/chain.c32]: Could not evaluate: Could not retrieve information from environment production source(s) file:/usr/share/syslinux/chain.c3204:26
ykarelperfect, same issue that i pointed04:26
ykarelso u need to use RDO repos04:26
kplantis there a more stable release option for rocky than "tripleo-repos -b rocky current" ?04:27
ykareltripleo-repos -b rocky current-tripleo04:29
kplantty!04:31
*** itlinux has quit IRC04:41
*** sdake has joined #tripleo04:50
*** spsurya has joined #tripleo05:05
*** shyamb has joined #tripleo05:11
*** kplant has quit IRC05:21
*** ratailor has joined #tripleo05:23
*** udesale has quit IRC05:29
*** jtomasek has joined #tripleo05:36
*** sdake has quit IRC05:41
*** hberaud|gone has quit IRC05:42
*** radeks_ has joined #tripleo05:44
*** shyamb has quit IRC05:44
*** shyamb has joined #tripleo05:48
*** sdake has joined #tripleo05:49
*** udesale has joined #tripleo05:51
*** udesale has quit IRC05:59
*** udesale has joined #tripleo06:00
*** jtomasek has quit IRC06:02
openstackgerritMerged openstack/tripleo-heat-templates master: Update parameters for cinder's Netapp backend  https://review.openstack.org/63305506:02
*** ykarel has quit IRC06:09
Tengudciabrin: hey, nice on :D06:18
*** ykarel has joined #tripleo06:21
*** noama has joined #tripleo06:25
*** mandre is now known as mandre|off06:25
*** hakhande_ has joined #tripleo06:26
*** nkinder has quit IRC06:28
*** ramishra has joined #tripleo06:33
*** agurenko has joined #tripleo06:36
*** agurenko has quit IRC06:42
*** yprokule has joined #tripleo06:43
*** ccamacho has quit IRC06:44
*** skramaja has joined #tripleo06:45
*** shyamb has quit IRC06:52
*** shyamb has joined #tripleo06:55
*** nkinder has joined #tripleo06:59
*** dsneddon has quit IRC06:59
*** radeks_ has quit IRC07:01
*** quiquell|off is now known as quiquell07:01
*** wolverineav has quit IRC07:03
*** dsneddon has joined #tripleo07:04
*** wolverineav has joined #tripleo07:04
Tengudciabrin: do you have any more context for this issue? version, environment and so on? anything in dmesg for instance?07:05
*** bfournie has quit IRC07:06
*** cylopez has joined #tripleo07:07
*** wolverineav has quit IRC07:09
*** udesale has quit IRC07:10
*** mschuppert has joined #tripleo07:11
*** moguimar has joined #tripleo07:12
*** florianf has joined #tripleo07:13
*** avivgt has quit IRC07:18
*** udesale has joined #tripleo07:18
*** ccamacho has joined #tripleo07:20
*** udesale has quit IRC07:22
*** udesale has joined #tripleo07:26
ykareljschlueter, different options: rabbitmq_install_plugins v/s rabbitmq_plugins_install07:27
ykareljschlueter, we have the former one, issue being introduced with the later one https://review.openstack.org/#/c/628150/7/docker/rabbitmq/Dockerfile.j207:28
ykarelmandre|off, ^^07:28
ykarelnot sure why they introduced new option07:28
Tengubecause "why not" ;)07:30
ykarelanyway we need to override it in tripleo-common07:30
mandre|offykarel: yeah there shouldn't be a rabbitmq_plugins_install block, instead they should have put the code in the block that was already there07:30
mandre|offykarel: better to submit a kolla patch to fix it07:31
*** iurygregory has joined #tripleo07:31
mandre|offykarel: I need to go, but if you submit a patch I'll happily +2 it07:31
ykarelmandre|off, okk doing07:33
*** wolverineav has joined #tripleo07:34
*** wolverineav has quit IRC07:38
*** shyamb has quit IRC07:38
*** jfrancoa has joined #tripleo07:41
*** slaweq has joined #tripleo07:43
ykarelmandre|off, https://review.openstack.org/#/c/633665/07:43
*** radeks_ has joined #tripleo07:49
openstackgerritSagi Shnaidman proposed openstack/openstack-virtual-baremetal master: WIP: use relative import in OVB  https://review.openstack.org/63366807:57
Tenguflorianf gchamoul jaosorior hello! is the mtg needed?07:57
openstackgerritRedHat RDO CI proposed openstack/tripleo-heat-templates master: GATE CHECK for TripleO  https://review.openstack.org/60429808:00
*** shardy has joined #tripleo08:02
*** apetrich has joined #tripleo08:09
*** sdake has quit IRC08:11
*** shardy has quit IRC08:11
*** shardy has joined #tripleo08:12
*** wolverineav has joined #tripleo08:15
*** dsneddon has quit IRC08:19
*** kopecmartin|off is now known as kopecmartin08:19
*** wolverineav has quit IRC08:19
*** gfidente has joined #tripleo08:21
*** gfidente has quit IRC08:25
*** bnemec has joined #tripleo08:29
*** thrash|g0ne is now known as thrash08:32
openstackgerritChandan Kumar proposed openstack/tripleo-quickstart-extras master: Set keystone specific vars for os_tempest from clouds.yaml  https://review.openstack.org/63318508:32
*** jpena|off is now known as jpena08:33
*** ksambor has joined #tripleo08:34
*** ramishra_ has joined #tripleo08:34
*** ramishra has quit IRC08:35
*** avivgt has joined #tripleo08:35
openstackgerritChandan Kumar proposed openstack-infra/tripleo-ci master: Run tempest using os_tempest role in standalone job  https://review.openstack.org/62750008:35
*** janki has joined #tripleo08:36
*** tosky has joined #tripleo08:42
openstackgerritRaviv proposed openstack/tripleo-upgrade stable/queens:  Add cli_opts_params.yaml to update prepare/converge.  https://review.openstack.org/63367408:44
openstackgerritRaviv proposed openstack/tripleo-upgrade stable/queens: Add cli_opts_params.yaml to update prepare/converge.  https://review.openstack.org/63367408:46
*** shyamb has joined #tripleo08:47
*** tkajinam has quit IRC08:48
*** pcaruana has joined #tripleo08:51
*** dsneddon has joined #tripleo08:51
*** galaxyyahoo has quit IRC08:51
*** galaxyyahoo has joined #tripleo08:52
*** moguimar has quit IRC08:52
*** ykarel is now known as ykarel|lunch08:52
lyarwoodEmilienM: sorry was already offline, re https://review.openstack.org/#/c/626952/ I'll get this moving again today.08:55
*** moguimar has joined #tripleo08:55
*** dmacpher_ has quit IRC08:56
*** dmacpher_ has joined #tripleo08:56
*** mrunge has quit IRC08:58
*** jpich has joined #tripleo09:01
openstackgerritUdi Kalifon proposed openstack/tempest-tripleo-ui master: Validators infrastructure  https://review.openstack.org/63123809:02
bnemecmwhahaha: FWIW, the undercloud wizard has been kept at least up to date enough to work. I still use it for my tripleo deployments.09:03
*** mrunge has joined #tripleo09:03
bnemecBut it was never intended to expose every option.09:04
bnemecIt's just a way to get a sane starting point for your network ranges and such.09:04
*** dsneddon has quit IRC09:05
openstackgerritRaviv proposed openstack/tripleo-upgrade stable/queens: Add cli_opts_params.yaml to update prepare/converge. (Queens)  https://review.openstack.org/63367909:06
*** dsneddon has joined #tripleo09:06
*** jtomasek has joined #tripleo09:06
*** gfidente has joined #tripleo09:06
openstackgerritSagi Shnaidman proposed openstack/openstack-virtual-baremetal master: WIP: Import auth with try/except  https://review.openstack.org/63368109:10
*** snecklifter has joined #tripleo09:11
*** bogdando has joined #tripleo09:13
*** ykarel|lunch is now known as ykarel09:20
*** snecklifter has quit IRC09:21
openstackgerritNatal Ngétal proposed openstack/tripleo-heat-templates master: [Configuration] Add missing py37 and corrected default envlist.  https://review.openstack.org/62412409:21
openstackgerritRajesh Tailor proposed openstack/tripleo-heat-templates master: Fail to live migration if instance has NUMA topology  https://review.openstack.org/63368509:24
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: TLS everywhere: Set post-save command for httpd  https://review.openstack.org/63317009:27
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: TLS everywhere: Set post-save command for RabbitMQ  https://review.openstack.org/63321709:27
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: TLS everywhere: Set post-save command for redis  https://review.openstack.org/63323909:27
openstackgerritThomas Herve proposed openstack/tripleo-heat-templates master: Remove RoleConfig  https://review.openstack.org/63297409:27
*** panda is now known as panda|numb09:28
*** jfrancoa has quit IRC09:32
jaosoriortherve: mind expanding a little bit that commit message? ^^09:33
therveSure09:33
bogdandoo/ PTAL https://review.openstack.org/#/c/632761/09:33
openstackgerritThomas Herve proposed openstack/tripleo-heat-templates master: Remove RoleConfig  https://review.openstack.org/63297409:35
*** dtantsur|afk is now known as dtantsur09:35
*** derekh has joined #tripleo09:36
*** aufi has joined #tripleo09:43
*** agurenko has joined #tripleo09:46
*** pbandark has joined #tripleo09:47
openstackgerritMartin Schuppert proposed openstack/puppet-tripleo master: WIP: cell_v2 multi-cell POC  https://review.openstack.org/60058809:47
openstackgerritSteven Hardy proposed openstack/tripleo-heat-templates master: run docker_puppet_tasks on any role  https://review.openstack.org/62507809:48
openstackgerritKamil Sambor proposed openstack/tripleo-heat-templates master: Switch default neutron ML2 mechanism driver to OVN  https://review.openstack.org/59305609:48
*** jfrancoa has joined #tripleo09:49
jaosoriorthanks therve09:51
*** numans_ is now known as numans_afk09:56
*** jfrancoa has quit IRC09:59
*** jfrancoa has joined #tripleo10:00
*** baysao has joined #tripleo10:01
*** pbandark has quit IRC10:02
*** numans_afk is now known as numans10:07
*** ooolpbot has joined #tripleo10:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION10:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/181374710:10
openstackLaunchpad bug 1813747 in tripleo "containers-build job is failing with: ERROR:kolla.common.utils:rabbitmq Failed with status: error" [Critical,Triaged] - Assigned to yatin (yatinkarel)10:10
*** ooolpbot has quit IRC10:10
*** shyamb has quit IRC10:10
*** chem has quit IRC10:10
*** shyamb has joined #tripleo10:11
*** chem has joined #tripleo10:11
*** florianf_ has joined #tripleo10:14
*** zaneb has quit IRC10:16
*** florianf has quit IRC10:16
*** chem has quit IRC10:16
*** ramishra_ has quit IRC10:23
*** hberaud has joined #tripleo10:24
*** rf0lc0 has joined #tripleo10:27
*** rfolco has quit IRC10:27
*** ramishra has joined #tripleo10:30
*** boazel has joined #tripleo10:38
*** shyamb has quit IRC10:38
*** shyamb has joined #tripleo10:40
*** boazel_ has quit IRC10:41
*** dsneddon has quit IRC10:41
*** chem has joined #tripleo10:44
*** shyamb has quit IRC10:45
*** suuuper has joined #tripleo10:46
*** suuuper has quit IRC10:47
*** baysao has quit IRC10:49
openstackgerritChandan Kumar proposed openstack/tripleo-quickstart-extras master: Set keystone specific vars for os_tempest from clouds.yaml  https://review.openstack.org/63318510:52
mariosgfidente: o/ any idea why the ceph_ansible_fetch set to /var/lib/ceph_ansible_fetch is a problem in https://review.openstack.org/#/c/631492 (e.g. http://logs.openstack.org/92/631492/5/check/tripleo-ci-centos-7-scenario001-standalone/8742926/logs/undercloud/home/zuul/standalone_deploy.log.txt.gz#_2019-01-28_18_06_44 ) - this is early work so no fire . been trying to find a missing backport but can't spot it yet10:52
*** rf0lc0 has quit IRC10:53
mariosgfidente: is seen on the standalone scenarios 1 and 4 (link above is 1)10:53
mariosgfidente: hm really it doesn't seem to be a problem with ceph-ansible itself but rather that we are(nt?) doing something for the directory like making sure its created :) maybe in some role but thought i'd ask you 'cos ceph' incase you recall :)10:54
marios(it works on master so we are missing some backport maybe)10:54
*** galaxyyahoo has quit IRC10:59
*** suuuper has joined #tripleo10:59
openstackgerritChandan Kumar proposed openstack-infra/tripleo-ci master: Run tempest using os_tempest role in standalone job  https://review.openstack.org/62750010:59
*** galaxyyahoo has joined #tripleo10:59
openstackgerritLukas Bezdicka proposed openstack/puppet-tripleo master: WIP Enable keystone authtoken caching on all the services  https://review.openstack.org/63370111:01
*** ssbarnea|bkp2 has quit IRC11:01
*** ssbarnea|rover has joined #tripleo11:02
*** janki has quit IRC11:02
openstackgerritMarios Andreou proposed openstack/tripleo-heat-templates stable/rocky: DO NOT MERGE testing for rocky standalones  https://review.openstack.org/63149211:02
*** rfolco has joined #tripleo11:03
*** morazi has quit IRC11:05
*** dsneddon has joined #tripleo11:06
*** udesale has quit IRC11:09
*** ooolpbot has joined #tripleo11:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION11:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/181374711:10
openstackLaunchpad bug 1813747 in tripleo "containers-build job is failing with: ERROR:kolla.common.utils:rabbitmq Failed with status: error" [Critical,Triaged] - Assigned to yatin (yatinkarel)11:10
*** ooolpbot has quit IRC11:10
*** dsneddon has quit IRC11:11
ykarelbogdando, also replied, not sure i explained correctly11:14
bogdandoykarel: nvm, that's me slow on those tools11:15
ssbarnea|roverdoes anyone knows something about epel metalink error? http://logstash.openstack.org/#/dashboard/file/logstash.json?query=message:%5C%22Cannot%20retrieve%20metalink%20for%20repository:%20epel%2Fx86_64.%20Please%20verify%20its%20path%20and%20try%20again%5C%2211:15
openstackgerritBogdan Dobrelya proposed openstack/ansible-role-tripleo-modify-image master: Track obsoleted packages replacements for updates  https://review.openstack.org/63348411:17
bogdandoykarel: magic!11:17
ykarelbogdando, ack, let's see CI now11:18
openstackgerritMerged openstack/tripleo-quickstart-extras master: Update cirros image from 3.5 to 3.6  https://review.openstack.org/63321411:18
openstackgerritSagi Shnaidman proposed openstack/openstack-virtual-baremetal master: WIP: use relative import in OVB  https://review.openstack.org/63366811:24
*** ansmith has joined #tripleo11:33
*** shyamb has joined #tripleo11:35
openstackgerritSagi Shnaidman proposed openstack/openstack-virtual-baremetal master: WIP: use relative import in OVB  https://review.openstack.org/63366811:40
*** dsneddon has joined #tripleo11:40
*** agurenko has quit IRC11:40
*** dsneddon has quit IRC11:45
EmilienMlyarwood: thanks11:49
openstackgerritMerged openstack/tripleo-quickstart master: Set overcloud_ssh_user to zuul in upgrades jobs.  https://review.openstack.org/63348611:52
*** ansmith has quit IRC11:52
*** shyamb has quit IRC11:53
*** shyamb has joined #tripleo11:55
noamahi11:55
*** holser_ has joined #tripleo11:55
noamais there some known issue installing undercloud from master?11:55
ssbarnea|roverbnemec: https://review.rdoproject.org/r/#/c/18294/11:55
noamahttps://www.irccloud.com/pastebin/b8a2CknW/11:56
noamai getting the above issue for all containers11:56
*** mcornea has joined #tripleo11:56
ykarelnoama, looks like podman bug https://github.com/containers/libpod/issues/1844, where are u seeing this, ci or locally Tengu ^^ if it's reproducable in noama environment good to find more info if not available related to that issue11:59
noamalocal11:59
Tenguhmm ?11:59
noamagetting this in dmesg11:59
noamaSELinux: mount invalid.  Same superblock, different security settings for (dev mqueue, type mqueue)11:59
noamacould be related?12:00
Tenguah, nah, not fatal nor important12:00
Tengunoama: care to provide a bit more logs? those two lines aren't really meaningful.12:00
noamayes12:01
noamawhat you need?12:01
Tenguykarel: noama is running with docker apparently.12:01
Tengunoama: well, lines before in order to catch the correct error12:01
noamai tried both docker and podman12:02
noamai think podman is default and now i just tried to overwrite podman -> docker in undercloud.conf12:02
Tenguyeah, podman is default. still. more logs before those two "warning" would help.12:03
ykarelhmm i think i have seen those selinux: mount invalid thing, when i switched between podman/docker in same env12:04
noamahttps://transfer.sh/KAVfP/install-undercloud.log12:04
Tenguykarel: yeah, they are common. Already asked the containers team, apparently there's no harm.12:04
ykarelTengu, ack12:04
noamalet me know if you need anything else12:05
* Tengu digging in the log12:05
ykarelError while evaluating a Function Call, enclose_ipv612:06
ykarelError while evaluating a Function Call, enclose_ipv6(): Wrong argument given  is not an ip address.12:06
ykarelseems a valid issue, not related to docker/podman12:06
noamai saw it also  but this code in puppet did not change long time12:07
Tengumaybe your env did?12:07
Tengubut that's indeed the root cause for you.12:07
ykarelu are trying default installation, or your custom changes?12:07
Tengugood eye, ykarel :)12:07
noamadefault12:07
noamawhat can be causing it?12:08
openstackgerritJon Schlueter proposed openstack/tripleo-common master: overcloud_containers.yaml.j2: remove unused *-base entry  https://review.openstack.org/51103912:08
*** suuuper1 has joined #tripleo12:09
TenguI'd say an IP in your settings might not be an IP? floating IP maybe?12:09
Tengunever saw this one, so I'm not really sure.12:09
*** ooolpbot has joined #tripleo12:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION12:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/181374712:10
openstackLaunchpad bug 1813747 in tripleo "containers-build job is failing with: ERROR:kolla.common.utils:rabbitmq Failed with status: error" [Critical,Triaged] - Assigned to yatin (yatinkarel)12:10
*** ooolpbot has quit IRC12:10
Tengunoama: anything in the /var/log/audit/audit.log maybe? grep denied in that file12:11
*** suuuper has quit IRC12:12
*** dsneddon has joined #tripleo12:12
*** agopi|off has joined #tripleo12:12
noamanothing there12:14
*** jpena is now known as jpena|lunch12:15
ykarelnoama, sudo hiera -c /etc/hiera.yaml rabbitmq::interface12:15
Tenguso the thing is, "$ip" is set to an empty value.12:16
noamageting nil?12:16
Tenguhttps://github.com/puppetlabs/puppetlabs-stdlib/blob/master/lib/puppet/parser/functions/enclose_ipv6.rb#L32 compared to the output "Wrong argument given  is not an ip address"  <- we can see the empty string12:16
*** dsneddon has quit IRC12:16
Tenguor ""12:16
*** dciabrin has quit IRC12:18
jschluetermwhahaha: I found one more in the python3 conversion in tripleo-common python3-pymongo12:19
*** dprince has joined #tripleo12:20
noamaTengu any idea why it empty or who is calling this code?12:21
*** skramaja has quit IRC12:22
Tengunoama: not really :/. what did ykarel command output?12:22
noamaTengu "nil"12:22
Tenguykarel: -^^  so there's something fishy in the config I guess?12:23
ykarelnoama, look at /etc/puppet/hieradata/net-map12:23
ykarellooks like some network mapping is wrong12:23
noamahttps://www.irccloud.com/pastebin/7Fy45XVr/12:23
ykarelso somethink is wrong, internal_api12:25
ykarelis blank12:26
Tengucare to share your undercloud.conf ?12:26
openstackgerritDan Prince proposed openstack/tripleo-heat-templates master: flatten the panko service  https://review.openstack.org/63356812:26
ykareland that rabbit::interface comes from:- "rabbitmq::interface": "%{hiera('internal_api')}",12:26
Tengunot only rabbit in fact.12:26
ykarelyes, right that's just example12:26
noamahttps://transfer.sh/4OkN9/undercloud.conf12:27
*** Vorrtex has joined #tripleo12:29
openstackgerritMerged openstack/tripleo-common master: Address python3 string issues with subprocess  https://review.openstack.org/63276112:31
*** ratailor has quit IRC12:31
jaosoriorowalsh: around?12:31
*** galaxyyahoo has quit IRC12:36
Tengunoama: no real idea. I don't see anything obvious in your undercloud.conf :/. what about you, ykarel ?12:36
*** pcaruana has quit IRC12:40
ykarelTengu, noama looks like "OS::TripleO::Undercloud::Net::SoftwareConfig": "/usr/share/openstack-tripleo-heat-templates/net-config-undercloud.yaml" is required12:41
noamarequried where?12:42
dprincebeen kicking this around for a month. Anybody want to give it a review: https://review.openstack.org/#/c/627642/12:42
EmilienMdprince: looking12:46
Tenguapparently it has the missing +w thanks to jaosorior12:46
EmilienMah, already reviewed12:46
dprinceEmilienM: you sir have already reviewed it12:46
* EmilienM hides12:47
Tengu:]12:47
*** quiquell is now known as quiquell|brb12:48
TenguEmilienM: about https://github.com/containers/libpod/issues/1844 - what should we do? I'm pretty sure this won't be corrected at all from containers team, and we have a (really ugly) w/a for it anyway.12:48
*** dsneddon has joined #tripleo12:49
*** pcaruana has joined #tripleo12:50
EmilienMTengu: not sure, tbh12:50
Tenguif it's really linked to the kernel version (and I don't see any reasons not to believe that), we're pretty screwed :/. corner case and the like12:51
*** abishop has joined #tripleo12:51
*** abishop has quit IRC12:52
*** morazi has joined #tripleo12:52
ykarelnoama, ignore that softwareconfig, that's already included with: environments/undercloud.yaml, i think hjensas can help you in that network think12:52
*** apetrich has quit IRC12:52
*** abishop has joined #tripleo12:53
noamajust looking on 2 commits that can be them introduced this issue , https://github.com/openstack/tripleo-heat-templates/commit/868c7685f19acdfba4aaa29ae1e12522d904f95f https://github.com/openstack/tripleo-heat-templates/commit/3df5f8db1ecb2e276d8744ad796a029a0f0a5a6e#diff-581b862bdd3ee8a7530e18793c56f31212:53
owalshjaosorior: hey12:53
jaosoriorowalsh: I'm trying to issue a SIGHUP for libvirtd in order for it to reload its config (namely, I want it to re-read the TLS certificate)12:54
jaosoriorany other options I should check?12:54
EmilienMTengu: if it's kernel, we'll wait for centos812:54
jaosoriorSIGHUP doesn't seem to be working12:54
*** apetrich has joined #tripleo12:55
*** agopi|off has quit IRC12:55
TenguEmilienM: yeah. guess we can put that issue on hold for now?12:55
*** dsneddon has quit IRC12:55
*** shyamb has quit IRC12:55
owalshjaosorior: not sure. kashyap on #openstack -nova would be the best person to ask12:55
EmilienMTengu: for now, yes12:55
Tengugood.12:56
jaosoriorowalsh: ok12:56
owalshjaosorior: docs say it should reload config though, so maybe a bug?12:56
jaosoriorowalsh: maybe12:57
openstackgerritDan Prince proposed openstack/tripleo-heat-templates master: flatten the congress service  https://review.openstack.org/63371612:57
ykarelnoama, i think https://review.openstack.org/#/c/628265/ is related12:58
Tengujaosorior: btw, could you get in touch with some sss guy for https://bugzilla.redhat.com/show_bug.cgi?id=1667276 ?12:59
openstackbugzilla.redhat.com bug 1667276 in rhosp-director "Selinux - bunch of "avc: denied" messages in logs on rhel8." [High,Assigned] - Assigned to cjeanner12:59
ykarelanyway all patches are related to hjensas so he can quickly guide what's wrong and what's missing12:59
*** mcornea has quit IRC12:59
jaosoriorTengu: I'll try again12:59
Tenguthanks :)12:59
jaosoriorssbarnea|rover: around?13:00
noamaykarel: thanks ill contact hjensas13:00
*** mcornea has joined #tripleo13:02
mariosgfidente: found it btw will post something in a sec13:03
marios(I think ()13:03
hjensasnoama: does'nt look like you have the latest bits.13:06
hjensasnoama: The net_ip_map should'nt have internal_api, storage, storage_mgmt etc for the undercloud. See: http://logs.openstack.org/65/628265/11/check/tripleo-ci-centos-7-undercloud-containers/28c0d36/logs/undercloud/etc/puppet/hieradata/net_ip_map.json.txt.gz13:07
noamahjensas?13:07
openstackgerritDan Prince proposed openstack/tripleo-heat-templates master: flatten the iscsid service  https://review.openstack.org/63372313:08
noamahgensas: this is what i have name=delorean-python-networking-vmware-nsx-71ff7272f4655d52a60e615b6a8a7647bc5b223c13:08
hjensasnoama: so, in your case the plan is rendered including all the networks. This should'nt be the case anymore, unless you use a custom roles data file specifying all those networks? Or for some reason you are not using https://github.com/openstack/tripleo-heat-templates/blob/master/network_data_undercloud.yaml as networks data.13:09
openstackgerritMarios Andreou proposed openstack/tripleo-heat-templates stable/rocky: Autocreate CephAnsibleFetchDirectoryBackup  https://review.openstack.org/63372413:09
mariosgfidente: ^13:09
*** ooolpbot has joined #tripleo13:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION13:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/181374713:10
openstackLaunchpad bug 1813747 in tripleo "containers-build job is failing with: ERROR:kolla.common.utils:rabbitmq Failed with status: error" [Critical,Triaged] - Assigned to yatin (yatinkarel)13:10
*** ooolpbot has quit IRC13:10
ykarelarxcruz|ruck, i think we can remove alert ^^, kolla patch merged13:11
noamahjensas: im using openstack undercloud install13:11
*** xek has joined #tripleo13:11
arxcruz|ruckykarel: ok13:11
hjensasnoama: I think this may be a promotion issue. Promotions are 4 days old now, and changes https://review.openstack.org/#/q/topic:bug/1809313+(status:open+OR+status:merged) merged 2-3 days ago.13:13
*** trown|outtypewww is now known as trown13:13
hjensasnoama: I'd go trough what you have after installing python-triploclient and compare to patches on that topic.13:13
openstackgerritDan Prince proposed openstack/tripleo-heat-templates master: Move the multipathd services into deployment  https://review.openstack.org/63372713:14
*** artom has quit IRC13:15
hjensasnoama: I'm going out for some excercice and lunch. Will be back in 2-3 hours.13:15
beaglescan anyone think of a reason why an undercloud deploy might mess up the generated hosts file by leaving out the ip on one of the lines? e.g. http://paste.openstack.org/show/744168/13:15
*** hjensas is now known as hjensas|afk13:15
*** artom has joined #tripleo13:15
openstackgerritDan Prince proposed openstack/tripleo-heat-templates master: flatten the congress service  https://review.openstack.org/63371613:15
jaosoriorTengu: seems to be a known issue https://bugzilla.redhat.com/show_bug.cgi?id=165153113:16
openstackbugzilla.redhat.com bug 1651531 in selinux-policy "avc: denied { write } for pid=27097 comm="sss_cache" name="config.ldb" dev="dm-0"" [High,Verified] - Assigned to lvrabec13:16
noamahjensas: ok ping me later13:16
openstackgerritDan Prince proposed openstack/tripleo-heat-templates master: flatten the panko service  https://review.openstack.org/63356813:17
jaosoriorTengu: fixed in selinux-policy-3.14.1-48.el813:17
Tengujaosorior: cool! will point that in the other BZ. Good finding!13:17
bogdandojaosorior, owalsh: may be related https://review.openstack.org/#/c/420026/13:18
bogdandotho that's for nova compute13:18
*** gkadam has quit IRC13:20
openstackgerritMichele Baldessari proposed openstack/puppet-pacemaker master: WIP Initial pcs 0.10 support  https://review.openstack.org/60787313:20
openstackgerritMichele Baldessari proposed openstack/puppet-pacemaker master: WIP Initial support for properties managed by pcs 0.10  https://review.openstack.org/62600513:20
EmilienMcan I get a review on https://review.openstack.org/#/c/632756/ please13:21
weshayno13:21
*** ade_lee has quit IRC13:21
openstackgerritYurii Prokulevych proposed openstack/tripleo-upgrade master: Migrate from with_X loop.  https://review.openstack.org/63373113:23
*** quiquell|brb is now known as quiquell13:26
*** agopi|off has joined #tripleo13:26
*** mburned_out is now known as mburned13:26
*** agopi|off is now known as agopi13:26
*** rlandy has joined #tripleo13:30
*** dsneddon has joined #tripleo13:30
ssbarnea|roverjaosorior: hi, yes i am.13:31
jaosoriorwanna log in bluejeans for the lp bashing?13:31
jaosoriorsome minutes at least is useful13:32
ssbarnea|roversure13:32
ssbarnea|roversend me bj ID13:32
ssbarnea|roverjaosorior: https://bluejeans.com/265541792813:33
openstackgerritYurii Prokulevych proposed openstack/tripleo-upgrade master: Migrate from with_X loop.  https://review.openstack.org/63373113:35
*** ansmith has joined #tripleo13:36
*** jpena|lunch is now known as jpena13:36
ykarelEmilienM, jaosorior can u check comment on https://review.openstack.org/#/c/632756/10, and block merge if valid, sorry for late comment13:37
EmilienMykarel: looking13:37
EmilienMykarel: I'm not sure how it would break redeploy13:38
ykarelEmilienM, trying to create symlink twice13:38
jaosoriorneither am I. ykarel can you expand on that?13:38
*** dsneddon has quit IRC13:38
noamahjensas: seems like this patch https://review.openstack.org/#/c/627980/ not promoted yet13:38
ykarelEmilienM, second try for os.symlink13:38
ykarelwhen /usr/local/bin/ansible-playbook already exists13:38
EmilienMwe would have to check the code of os.symlink but I suspect it's idempotent, no?13:40
EmilienMI can try it locally, give me a sec13:40
ykarelno13:40
ykareli tried, and it fails, with File Exists13:40
ykareltouch t3; python -c "import os; os.symlink('t3','t4');os.symlink('t3','t4')"13:41
*** matbu has quit IRC13:42
EmilienMjaosorior: please remove +A, I'll update the patch13:42
EmilienMykarel: nice catch, thx13:42
ykarelhmm but catched too late13:44
*** jcoufal has joined #tripleo13:44
*** toure|gone is now known as toure13:46
openstackgerritEmilien Macchi proposed openstack/python-tripleoclient master: tripleo_deploy: symlink ansible-playbook  https://review.openstack.org/63275613:46
EmilienMykarel: ^13:46
*** cfontain has joined #tripleo13:47
openstackgerritMarios Andreou proposed openstack/tripleo-heat-templates stable/rocky: DO NOT MERGE testing for rocky standalones  https://review.openstack.org/63149213:47
*** rh-jelabarre has joined #tripleo13:47
*** Skyraven has joined #tripleo13:49
dpeacockcores, can I get CR and maybe W on https://review.openstack.org/#/c/626631 please?13:49
ykarelEmilienM, ack13:49
*** cfontain_ has joined #tripleo13:51
*** cfontain has quit IRC13:51
ykarelEmilienM, syntax errors13:52
openstackgerritEmilien Macchi proposed openstack/python-tripleoclient master: tripleo_deploy: symlink ansible-playbook  https://review.openstack.org/63275613:54
ykarelstill :(13:54
openstackgerritMichele Baldessari proposed openstack/puppet-pacemaker master: WIP Initial pcs 0.10 support  https://review.openstack.org/60787313:55
openstackgerritMichele Baldessari proposed openstack/puppet-pacemaker master: WIP Initial support for properties managed by pcs 0.10  https://review.openstack.org/62600513:55
*** mmethot has joined #tripleo13:55
ykarelEmilienM, still, line continuation13:55
Tenguykarel: hmm I saw the one in the previous push, but now I don't see any syntaxe error... ?13:55
*** matbu has joined #tripleo13:55
ykarelor it working for u locally?13:55
*** panda|numb is now known as panda13:56
*** psachin has quit IRC13:56
bogdandoPTAL https://review.openstack.org/#/c/633484/13:56
ykarelTengu, line continue for if condition, should be in bracket or \13:56
EmilienMykarel: yeah, let me fix the pep813:57
Tengupep8...13:57
Tengukill it with fire :/13:57
ykareli think it's not just pep8, syntax error13:57
Tengunot sure for that one13:57
Tenguwell, anyway.13:57
*** Skyraven has quit IRC13:58
openstackgerritEmilien Macchi proposed openstack/python-tripleoclient master: tripleo_deploy: symlink ansible-playbook  https://review.openstack.org/63275613:59
bogdandomaybe subprocess and ln -sf would look better than that 6 levels of if?..14:00
bogdandoa subprocess call14:00
bogdandocuz really, my eyes...14:00
bogdandohard to follow the logic there14:00
bogdandoEmilienM, ykarel: ^^14:01
jaosorior#startmeeting TripleO14:01
openstackMeeting started Tue Jan 29 14:01:40 2019 UTC and is due to finish in 60 minutes.  The chair is jaosorior. Information about MeetBot at http://wiki.debian.org/MeetBot.14:01
openstackUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.14:01
*** openstack changes topic to " (Meeting topic: TripleO)"14:01
openstackThe meeting name has been set to 'tripleo'14:01
ykarelanything better is always welcome14:01
jaosorior#topic agenda14:01
*** openstack changes topic to "agenda (Meeting topic: TripleO)"14:01
jaosorior* Review past action items14:01
jaosorior* One off agenda items14:01
jaosorior* Squad status14:01
*** ykarel is now known as ykarel|away14:01
jaosorior* Bugs & Blueprints14:01
jaosorior* Projects releases or stable backports14:01
jaosorior* Specs14:02
jaosorior* open discussion14:02
jaosoriorAnyone can use the #link, #action and #info commands, not just the moderatorǃ14:02
Tengubogdando: not really sure calling subprocess would be better...14:02
jaosoriorHey folks! who's around?14:02
Tengu\o/14:02
bogdandoTengu: at least ln works idempotently14:02
bogdando\o/14:02
*** dsneddon has joined #tripleo14:02
marioso/14:02
ksamboro/14:02
Tengubogdando: errrr nope.. and not sure forcing ln is better.14:02
panda\o14:02
EmilienMo/14:03
Tengubogdando: "ln -f" is pretty terrible.14:03
beagleso/14:03
weshay0/14:03
chandankumar\o/14:03
arxcruz|ruck/o/14:04
jaosorior#topic review past action items14:04
*** openstack changes topic to "review past action items (Meeting topic: TripleO)"14:04
jaosoriorNone.14:04
jaosorior#topic one off agenda items14:04
*** openstack changes topic to "one off agenda items (Meeting topic: TripleO)"14:04
jaosorior#link https://etherpad.openstack.org/p/tripleo-meeting-items14:04
jaosoriorNone.14:04
rfolcoo/14:04
jaosorior#topic Squad status14:05
*** openstack changes topic to "Squad status (Meeting topic: TripleO)"14:05
jaosoriorci14:05
jaosorior#link https://etherpad.openstack.org/p/tripleo-ci-squad-meeting14:05
jaosoriorupgrade14:05
jaosorior#link https://etherpad.openstack.org/p/tripleo-upgrade-squad-status14:05
jaosoriorcontainers14:05
jaosorior#link https://trello.com/b/S8TmOU0u/tripleo-podman14:05
jaosoriorintegration14:05
jaosorior#link https://etherpad.openstack.org/p/tripleo-integration-squad-status14:05
jaosoriorui/cli14:05
jaosorior#link https://etherpad.openstack.org/p/tripleo-ui-cli-squad-status14:05
jaosoriorvalidations14:05
jaosorior#link https://etherpad.openstack.org/p/tripleo-validations-squad-status14:05
jaosoriornetworking14:05
jaosorior#link https://etherpad.openstack.org/p/tripleo-networking-squad-status14:05
jaosoriorsecurity14:05
openstackgerritSagi Shnaidman proposed openstack/openstack-virtual-baremetal master: WIP: use relative import in OVB  https://review.openstack.org/63366814:05
jaosorior#link https://etherpad.openstack.org/p/tripleo-security-squad14:05
jaosorioredge14:05
jaosorior#link https://etherpad.openstack.org/p/tripleo-edge-squad-status14:05
jaosoriorAny squad wanting to bring up their status, or a topic for the general public?14:05
jaosorioroh! seems chandankumar had an update on the previous topic. LEts bring it up now.14:05
dpeacocko/14:05
jaosorior(chkumar) updates on os_tempest integration with tripleo14:06
chandankumarHey Guys!14:06
jaosorior  http://lists.openstack.org/pipermail/openstack-discuss/2019-January/002151.html14:06
matbuo/14:06
jaosoriorsorry14:06
chandankumarHere is some few updates from os_tempest integration14:06
jaosorior#link http://lists.openstack.org/pipermail/openstack-discuss/2019-January/002151.html14:06
chemo/14:06
chandankumarjaosorior: we have landed the playbook and dependencies in TQ and TQE for os_tempest integration14:06
*** dsneddon has quit IRC14:06
chandankumarfinal job review will land today or tomorrow in TOCI14:07
jaosoriornice!14:07
chandankumarapart of that, we have fixed stackviz report generation and cloud name support.14:07
*** jcoufal has quit IRC14:07
chandankumarThanks to slaweq and jrosser from OSA team in help fixing the centos7 OSA temepst failure gate14:08
chandankumarI hope patches related to os_tempest lands soon14:08
chandankumarfor detailed update is here http://lists.openstack.org/pipermail/openstack-discuss/2019-January/002151.html14:08
chandankumarwill share some great news next week, :-)14:08
chandankumarjaosorior: done from my side14:09
jaosoriorchandankumar: thanks for bringing that up and for this work!14:09
jaosoriorAnybody else want to give an update (maybe squad related)14:09
jaosorior?14:09
*** tzumainn has joined #tripleo14:10
jaosorior#topic bugs & blueprints14:10
*** openstack changes topic to "bugs & blueprints (Meeting topic: TripleO)"14:10
jaosorior#link https://launchpad.net/tripleo/+milestone/stein-314:10
jaosoriorFor Stein we currently have 21 (for stein-3) blueprints open in Launchpad.14:10
jaosoriorBugs: 593 (0) stein-3 in Launchpad. 104 (-1) open Storyboard bugs.14:10
jaosorior#link https://storyboard.openstack.org/#!/project_group/7614:10
jaosorior#topic projects releases or stable backports14:12
*** openstack changes topic to "projects releases or stable backports (Meeting topic: TripleO)"14:12
*** shyamb has joined #tripleo14:12
jaosorior#topic specs14:14
*** openstack changes topic to "specs (Meeting topic: TripleO)"14:14
jaosorior#link https://review.openstack.org/#/q/project:openstack/tripleo-specs+status:open14:14
openstackgerritMartin Schuppert proposed openstack/puppet-tripleo master: Remove postsave_cmd and restart libvirt on cert files change  https://review.openstack.org/63374614:15
*** jcoufal has joined #tripleo14:16
jaosorior#topic open discussion14:16
*** openstack changes topic to "open discussion (Meeting topic: TripleO)"14:16
jaosoriorAnything else that folks want to bring up to the meeting?14:16
*** ade_lee has joined #tripleo14:17
toskymaybe not too important for the meeting, but I have few open questions in https://review.openstack.org/#/c/632964/14:17
rfolcoo/ reminder: CI community meeting (office hours) starts now at https://bluejeans.com/4113567798 - agenda: https://etherpad.openstack.org/p/tripleo-ci-squad-meeting14:18
*** shyamb has quit IRC14:20
ccamachofolks this spec https://review.openstack.org/#/c/622324/ is quite important if you have some time the feedback is very welcomed14:20
ccamachojistr matbu chem holser_ lbezdick yprokule Hobbestigrou14:21
ccamacho^14:21
holser_ccamacho ack14:22
jistrthanks ccamacho :)14:22
*** udesale has joined #tripleo14:24
*** ykarel|away has quit IRC14:25
*** holser__ has joined #tripleo14:26
*** holser_ has quit IRC14:26
jaosoriorAlright, if nothing else... thanks for joining!14:26
jaosorior#endmeeting14:26
*** openstack changes topic to "CI Status: GREENish | https://docs.openstack.org/tripleo-docs/latest/"14:26
openstackMeeting ended Tue Jan 29 14:26:36 2019 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)14:26
openstackMinutes:        http://eavesdrop.openstack.org/meetings/tripleo/2019/tripleo.2019-01-29-14.01.html14:26
openstackMinutes (text): http://eavesdrop.openstack.org/meetings/tripleo/2019/tripleo.2019-01-29-14.01.txt14:26
openstackLog:            http://eavesdrop.openstack.org/meetings/tripleo/2019/tripleo.2019-01-29-14.01.log.html14:26
jaosoriortosky: looking.14:26
toskythanks14:30
jaosoriortosky: uhm... how did you deploy?14:32
toskyjaosorior: I admit I didn't locally; I simply checked the results from the CI14:34
jaosoriortosky: the NtPServer parameter that you used is actually passed in by CI. so most likely the default value you set there is ignored.14:35
toskyjaosorior: does the CI set a single value or a list of values?14:35
jaosoriortosky: a single on14:35
jaosorior*one14:36
jaosoriorafaik14:36
toskywhich matches the first default value?14:36
toskyapparently no matches on openstack-infra/tripleo-ci http://codesearch.openstack.org/?q=0.pool.ntp.org&i=nope&files=&repos=14:37
*** dsneddon has joined #tripleo14:42
*** weshay has quit IRC14:43
*** lucasagomes has joined #tripleo14:44
*** pcaruana has quit IRC14:45
openstackgerritGael Chamoulaud proposed openstack/tripleo-validations master: Fix introspection data lookup  https://review.openstack.org/63127714:46
openstackgerritGael Chamoulaud proposed openstack/tripleo-validations master: Add node disks validation  https://review.openstack.org/60435614:46
*** dsneddon has quit IRC14:46
openstackgerritAlex Schultz proposed openstack/tripleo-common master: Add python3 packages to overrides  https://review.openstack.org/62967914:47
*** hberaud has quit IRC14:49
*** hberaud has joined #tripleo14:49
*** sdake has joined #tripleo14:50
*** sdake has quit IRC14:51
*** sdake has joined #tripleo14:53
bogdandobandini, jistr: so I dumped my thoughts https://review.openstack.org/#/c/622324/4/specs/stein/upgrades-with-operating-system.rst@453 we've discussed at the sprint14:53
*** pcaruana has joined #tripleo14:53
*** hberaud has quit IRC14:54
bogdando-1 goes not for the alternative scenario to prefer, but for better specifying the fallback paths14:54
*** hberaud has joined #tripleo14:54
openstackgerritJose Luis Franco proposed openstack/tripleo-heat-templates master: Correct *_short_bootstrap_node_name variable.  https://review.openstack.org/63375414:54
jaosoriortosky: can you pass the logs?14:54
openstackgerritAlex Schultz proposed openstack/tripleo-common master: Add python3 packages to overrides  https://review.openstack.org/62967914:55
toskyjaosorior: of the CI job? http://logs.openstack.org/64/632964/2/check/tripleo-ci-centos-7-scenario003-standalone/14:56
lucasagomeshi, if someone has some time mind taking a look at https://review.openstack.org/#/c/632724/ ? It's a trivial change (~1LOC) but enables an important feature for OVN. It has a +2 already as well. Thanks :D14:56
openstackgerritJose Luis Franco proposed openstack/tripleo-quickstart-extras master: Remove usage of target_upgrade_version.  https://review.openstack.org/60752514:59
* tosky bbl15:00
*** pbandark has joined #tripleo15:00
jaosoriorslagle, dprince: do you happen to know at what point of the deployment we configure the networks?15:01
*** hberaud has quit IRC15:01
dprincejaosorior: before step 0, very early15:01
jaosoriordprince: is that done in host_prep_tasks? or does it have it's own section?15:02
*** trozet_ has joined #tripleo15:02
dprincejaosorior: its done as part of each servers configuration, before host_prep_tasks even15:02
jaosoriorcool!15:03
jaosoriordprince: any hint on where that's done?15:03
dprincejaosorior: let me get you a link15:04
*** sshnaidm is now known as sshnaidm|mtg15:04
dprincejaosorior: the resource is created in puppet/role.role.j2.yaml. Its called NetworkDeployment15:05
slaglejaosorior: it's done in the "Server deployments" play from the main playbook15:05
dprinceslagle: that is where it ends up in the Ansible playbook. The raw source is still the NetworkDeployment in t-h-t right?15:06
jaosoriorack15:06
*** mmethot_ has joined #tripleo15:08
*** mmethot has quit IRC15:09
openstackgerritAlex Schultz proposed openstack/tripleo-common master: Add python3 packages to overrides  https://review.openstack.org/62967915:12
*** salmankhan has joined #tripleo15:14
*** dsneddon has joined #tripleo15:17
*** salmankhan has quit IRC15:18
*** udesale has quit IRC15:18
*** hberaud has joined #tripleo15:19
*** bfournie has joined #tripleo15:19
openstackgerritMerged openstack/tripleo-heat-templates master: Remove external_network_bridge Neutron option  https://review.openstack.org/60476415:20
*** mjturek has joined #tripleo15:20
*** wolverineav has joined #tripleo15:21
*** dmacpher_ has quit IRC15:22
*** dmacpher has joined #tripleo15:22
*** dsneddon has quit IRC15:24
*** wolverineav has quit IRC15:25
slagledprince: yep15:25
jaosoriorslagle, dprince: thanks for the pointers!15:27
*** moguimar has quit IRC15:28
*** avivgt has quit IRC15:29
*** pbandark has quit IRC15:32
*** sdake has quit IRC15:32
*** sshnaidm|mtg is now known as sshnaidm15:33
Tenguslagle: hello! could you sort out your ssh issue?15:33
*** mjturek has quit IRC15:34
slagleTengu: yes, it worked fine on redeploy15:35
slagleTengu: old templates I guess. I had updated everything on Friday, but suppose I missed it by a few hours15:35
*** sdake has joined #tripleo15:35
*** fultonj has joined #tripleo15:35
*** fultonj has quit IRC15:35
Tenguslagle: cool then :)15:36
*** fultonj has joined #tripleo15:37
*** ykarel|away has joined #tripleo15:38
*** ykarel|away is now known as ykarel15:39
openstackgerritLee Yarwood proposed openstack/puppet-tripleo master: placement: Initial extraction of the Placement service from Nova  https://review.openstack.org/62433515:44
*** ccamacho has quit IRC15:45
*** ccamacho has joined #tripleo15:46
openstackgerritQuique Llorente proposed openstack/tripleo-quickstart master: Dump virt-resize result to a file  https://review.openstack.org/63344415:48
*** weshay has joined #tripleo15:49
*** openstackgerrit has quit IRC15:51
*** openstackgerrit has joined #tripleo15:52
openstackgerritYurii Prokulevych proposed openstack/tripleo-upgrade master: Migrate from with_X loop.  https://review.openstack.org/63373115:52
*** dsneddon has joined #tripleo15:53
openstackgerritMerged openstack/tripleo-heat-templates master: flatten the mistral service configurations  https://review.openstack.org/62764215:56
openstackgerritDamien Ciabrini proposed openstack/tripleo-heat-templates master: Fix generation of configs that contain password files  https://review.openstack.org/63376815:58
openstackgerritRedHat RDO CI proposed openstack/tripleo-quickstart-extras master: GATE CHECK for quickstart-extras  https://review.openstack.org/56044516:00
openstackgerritRedHat RDO CI proposed openstack/tripleo-heat-templates master: GATE CHECK for TripleO  https://review.openstack.org/60429816:00
*** dsneddon has quit IRC16:01
openstackgerritMarios Andreou proposed openstack/tripleo-docs master: Move CI docs from contributor guide into new CI guide  https://review.openstack.org/63377116:05
*** _mmethot_ has joined #tripleo16:06
*** mjturek has joined #tripleo16:07
*** mmethot_ has quit IRC16:08
openstackgerritMerged openstack/tripleo-common master: Use the yaml stdout_callback for better prepare logging  https://review.openstack.org/63363316:08
*** jfrancoa has quit IRC16:09
*** hjensas|afk is now known as hjensas16:10
*** quiquell is now known as quiquell|off16:16
hjensasnoama: Hi, did you get any further on you unerdercloud deploy issue?16:16
*** cylopez has quit IRC16:16
*** paramite has quit IRC16:16
openstackgerritKamil Sambor proposed openstack/tripleo-heat-templates master: Switch default neutron ML2 mechanism driver to OVN  https://review.openstack.org/59305616:17
openstackgerritJill Rouleau proposed openstack/tripleo-heat-templates master: flatten ceilometer service configuration  https://review.openstack.org/63361716:17
hjensasnoama: I would try to ensure all containers are updated as part of the deploy. see: https://docs.openstack.org/tripleo-docs/latest/install/advanced_deployment/container_image_prepare.html#updating-existing-packages16:19
*** wolverineav has joined #tripleo16:21
openstackgerritNagasai Vinaykumar Kapalavai proposed openstack/tripleo-heat-templates master: Update to the ceilometer publisher list  https://review.openstack.org/60084316:21
*** dsneddon has joined #tripleo16:26
*** wolverineav has quit IRC16:30
*** pbandark has joined #tripleo16:31
*** dsneddon has quit IRC16:32
*** chandankumar is now known as chkumar|out16:35
*** dprince has quit IRC16:36
*** ksambor has quit IRC16:38
*** agopi is now known as agopi|lunch16:41
*** sdake has quit IRC16:46
*** iurygregory has quit IRC16:47
*** suuuper1 has quit IRC16:49
*** hberaud has quit IRC16:49
*** hberaud has joined #tripleo16:50
*** vinaykns has joined #tripleo16:52
*** hamzy has quit IRC16:56
openstackgerritRonelle Landy proposed openstack/tripleo-quickstart-extras master: WIP: Design new role for zuul-based reproducer  https://review.openstack.org/63106716:59
*** noama has quit IRC16:59
*** hamzy has joined #tripleo17:00
openstackgerritRonelle Landy proposed openstack/tripleo-quickstart-extras master: WIP: Design new role for zuul-based reproducer  https://review.openstack.org/63106717:01
*** vinaykns has quit IRC17:01
*** pcaruana has quit IRC17:01
*** vinaykns has joined #tripleo17:03
openstackgerritRonelle Landy proposed openstack/tripleo-quickstart-extras master: WIP: Design new role for zuul-based reproducer  https://review.openstack.org/63106717:04
*** dsneddon has joined #tripleo17:06
*** dprince has joined #tripleo17:06
*** hakhande_ has quit IRC17:06
*** yprokule has quit IRC17:10
*** dsneddon has quit IRC17:10
*** hamzy has quit IRC17:11
*** Chaserjim has quit IRC17:13
*** aufi has quit IRC17:14
openstackgerritSorin Sbarnea proposed openstack/tripleo-quickstart master: Enable testing using ansible molecule  https://review.openstack.org/61367217:14
*** bogdando has quit IRC17:15
openstackgerritDan Prince proposed openstack/tripleo-heat-templates master: step1: flatten the neutron service configurations  https://review.openstack.org/62966417:16
openstackgerritDan Prince proposed openstack/tripleo-heat-templates master: step2: flatten the neutron service configurations  https://review.openstack.org/63051317:16
*** ccamacho has quit IRC17:18
openstackgerritJill Rouleau proposed openstack/tripleo-heat-templates master: step2: flatten nova service configuration  https://review.openstack.org/63327817:21
*** mjturek has quit IRC17:24
*** kopecmartin is now known as kopecmartin|off17:24
*** ramishra has quit IRC17:25
dpeacockdprince: Do you have time to CR and maybe W https://review.openstack.org/#/c/626631 please?  I believe it's finally ready.17:25
dprincedpeacock: looking17:26
dpeacockdprince: thank you17:26
*** trown is now known as trown|lunch17:26
*** bnemec has quit IRC17:27
dprince dpeacock: one fixup is needed. Sorry :/17:28
dprincedpeacock: the firewall stuff needs to be removed now17:28
dpeacockdprince: thank you17:29
dprincedpeacock: shoudl be quick, and then I'll follow with a +2 ASAP17:29
dpeacockthanks man17:29
*** jpich has quit IRC17:32
openstackgerritDavid Peacock proposed openstack/tripleo-heat-templates master: flatten haproxy service configuration  https://review.openstack.org/62663117:33
dpeacockdprince: ^^ :-)17:33
dpeacockmwhahaha: ^^ :-)17:33
*** mjturek has joined #tripleo17:35
dprincedpeacock: +2, thanks. Once CI passes I will +A as its already got the acks17:37
dpeacockdprince: thank you17:38
dpeacock:-)17:38
*** cfontain_ has quit IRC17:39
*** dsneddon has joined #tripleo17:39
*** ykarel is now known as ykarel|away17:41
*** sdake has joined #tripleo17:44
*** agopi|lunch is now known as agopi17:46
*** dsneddon has quit IRC17:47
*** nkinder has quit IRC17:48
openstackgerritMerged openstack/tripleo-common master: nova-less-deploy: updates for metalsmith >= 0.9.0  https://review.openstack.org/63347717:51
jaosoriorEmilienM: can you check this out https://review.openstack.org/#/c/633170/ ?17:55
EmilienMjaosorior: sure17:55
openstackgerritJill Rouleau proposed openstack/tripleo-heat-templates master: flatten ceilometer service configuration  https://review.openstack.org/63361717:55
jaosoriorEmilienM: and these https://review.openstack.org/#/c/633217/ https://review.openstack.org/#/c/633238/ if you have time.17:56
EmilienMvery demanding :D17:57
jaosoriorhaha sorry :D17:58
jaosoriorthanks!17:58
EmilienMnp :)17:59
*** derekh has quit IRC18:01
*** jtomasek has quit IRC18:10
*** sdake has quit IRC18:10
*** dsneddon has joined #tripleo18:10
openstackgerritMerged openstack/tripleo-heat-templates master: Add VLAN as a supported network type for OVN  https://review.openstack.org/63272418:12
*** jpena is now known as jpena|off18:15
*** trown|lunch is now known as trown18:21
*** sdake has joined #tripleo18:37
openstackgerrityatin proposed openstack/tripleo-quickstart master: Dump virt-resize result to a file  https://review.openstack.org/63344418:40
*** hamzy has joined #tripleo18:52
openstackgerritMerged openstack/tripleo-common master: placement: Add missing healthcheck for extracted service  https://review.openstack.org/63205718:53
*** hberaud is now known as hberaud|gone18:54
*** _fragatina has joined #tripleo19:01
*** Vorrtex has quit IRC19:04
*** ykarel|away has quit IRC19:06
*** morazi has quit IRC19:12
dprinceSome flattening patches are ready for review: https://review.openstack.org/#/q/status:open+project:openstack/tripleo-heat-templates+branch:master+topic:bp/services-yaml-flattening+owner:dan-prince19:14
jidarmwhahaha: remember a few days ago when I was having a problem with the ceph image from the rh container registry, and we ended up tagging the image with :3-18 because that worked out of the box? I'm having a problem with my deploy now, see the following: https://gist.github.com/e19d7a8559f8e98d26e4be8d5e4b2c38 or for anyone else, my ceph host during deployment is looking for an image that I've verified is19:15
jidarthere but it doesn't seem to find it (it has an odd tag I had to deal with during the offline install process found here: https://access.redhat.com/articles/3348761)19:15
*** dtantsur is now known as dtantsur|afk19:17
jidar$ curl -X GET http://10.237.78.10:5000/v2/rhceph/rhceph-3-rhel7/tags/list => {"name":"rhceph/rhceph-3-rhel7","tags":["latest","3-18"]}19:17
jidar:psyduck:19:17
mwhahahajidar: did you set the insecure registries to include 10.237.78.10:5000?19:17
mwhahahaother wise it'll throw an error like that19:17
jidarit's included in my uhh, overcloud_images.yaml19:18
jidarDockerInsecureRegistryAddress: <etc>19:18
jidarwhich on my ceph node, made it's way into `/etc/sysconfig/docker`19:18
mwhahahayea not sure then19:19
openstackgerritMerged openstack/tripleo-common master: remove percona-xtrabackup  https://review.openstack.org/63351219:20
jidarsometimes it's kinda hard to tell where the problem is actually kicking off, for instance the stack deploy fails with a general error, https://gist.github.com/dd551c7f8c2c74737a36625a9033ad7819:21
jidarand I had to poke in the docker logs to get the first error19:21
jidar(on the ceph node)19:21
* mwhahaha defers to ceph folks19:22
* mwhahaha points to gfidente & fultonj 19:22
openstackgerritEmilien Macchi proposed openstack/ansible-role-tripleo-modify-image master: yum_update_buildah: add retry x3  https://review.openstack.org/63380519:22
jidarI'm not above bribery :P19:23
jidarand it looks like I'll be at rh summit in may :P hahahah19:24
fultonjjidar: what version are you using?19:29
jidar1319:29
fultonjjidar: does your uc contain the ceph image as per 'docker images'19:30
fultonj?19:30
jidarits in the docker registry for my repo server, see here: https://gist.github.com/e19d7a8559f8e98d26e4be8d5e4b2c3819:31
gfidentejidar --tls-verify=false ?19:32
jidaryea... it's a http server without a cert?19:32
jidarDockerInsecureRegistryAddress is set in my overcloud_images.yaml19:33
fultonjjidar: the host containing "the docker registry for my repo server" is not the undercloud right?19:33
jidarcorrect19:33
jidar10.237.78.10 != undercloud19:33
*** florianf_ has quit IRC19:34
fultonjjidar: when you deploy your overcloud you pass it a yaml file mapping containers to their locations. what do you see when you grep ceph out of that file?19:34
fultonjnormally that file is created by running `openstack overcloud container image prepare ...`19:34
jidar  DockerCephDaemonImage: 10.237.78.10:5000/rhceph/rhceph-3-rhel7:3-1819:34
jidarfultonj: yep19:35
jschluetermwhahaha: found we are installing 4 test packages in openstack-base kolla container ... zake, unittest2, testtools, fixtures  which I can not see any reason to have unittest tools installed in a container unless you were going to try to test19:36
jidarI'll note the script found here: https://access.redhat.com/articles/3348761 which I used to generate the local registry failed for the ceph bits and I had to manually tag it :3-1819:37
jschlueterhttps://review.openstack.org/#/c/63372619:37
mwhahahajschlueter: k. i thought zake was used by something like tooz19:37
mwhahahajschlueter: as a dep19:37
* jschlueter will go peek, but if it is it can be installed as a dep when it installs not explicitly called out19:38
jschluetermwhahaha: for tooz zake is the test/fake client/implementation19:39
fultonjjidar: so tripleo is passing 10.237.78.10:5000/rhceph/rhceph-3-rhel7:3-18 to ceph-ansible19:39
openstackgerritRonelle Landy proposed openstack/tripleo-quickstart-extras master: Design new role for zuul-based reproducer  https://review.openstack.org/63106719:39
openstackgerritSteve Baker proposed openstack/tripleo-common master: Make python uploader the default  https://review.openstack.org/61601919:39
jidarfultonj: yep, that's found in the first set of logs I sent over, time="2019-01-29T03:20:02.449736435Z" level=error msg="Handler for GET /v1.26/containers/10.237.78.10:5000/rhceph/rhceph-3-rhel7:3-18/json returned error: No such container: 10.237.78.10:5000/rhceph/rhceph-3-rhel7:3-18"19:40
mwhahahajschlueter: yea i was just running into some build problems in the container previously. i don't know the specifics19:41
gfidentejidar I think it's trying to use https by default19:41
gfidenteGet https://10.237.78.10:5000/v2/19:41
openstackgerritJill Rouleau proposed openstack/tripleo-heat-templates stable/queens: In process-templates script write output files to provided dir when using base path  https://review.openstack.org/63380819:41
jidarI also just tried changing my overcloud_images.yaml to :latest (because that tag also exists on that image) and it produced the same error, time="2019-01-29T19:35:02.605960249Z" level=error msg="Handler for GET /v1.26/containers/10.237.78.10:5000/rhceph/rhceph-3-rhel7:latest/json returned error: No such container: 10.237.78.10:5000/rhceph/rhceph-3-rhel7:latest"19:41
jidargfidente: I assume that would result in a ssl error unless I passed in -k19:41
jschluetermwhahaha: ack let's see what type of feedback I get on it, but I'm also crunching on similar for downstream19:42
jidargfidente: also, my /etc/sysconfig/docker on that node has the following line: INSECURE_REGISTRY="--insecure-registry 10.237.78.10:5000"19:42
gfidentejidar which logs are those btw ? ceph-ansible run log?19:44
fultonjjidar: which log gave you that error message? /var/log/mistral/ceph-install-workflow.log ?19:44
fultonjjinx19:44
fultonjceph-install-workflow.log should be on the uc19:44
jidarjournalctl -u docker19:45
jidarI don't have a mistral/ceph-install-workflow.log on my undercloud or ceph node19:46
fultonjjidar: you could look at ceph-install-workflow.log to get the exact command ansible is running on the host to reproduce the same command19:46
fultonjit might give you insight19:46
fultonje.g. it was parsed in correctly19:46
jidarfultonj: gfidente https://gist.github.com/4c00695d2b11b373e7a96d289001546b19:47
jidarthere's just nothing in that directory19:47
beaglesslagle, mwhahaha, can you think of any reason why the params being sent to host-config.sh when installing the undercloud would be bogus...19:47
jidarwoops, it's on my undercloud - my mistake19:48
fultonjjidar: that's an overclou dnode19:48
beaglesslagle, mwhahaha, e.g ",19:48
beagles                " blaster.localdomain blaster",19:48
beagles                "192.168.24.1 blaster.external.localdomain blaster.external",19:48
beagles                "192.168.24.1 blaster.ctlplane.localdomain blaster.ctlplane",19:48
mwhahahabeagles: maybe? what are you seeing19:48
mwhahahabeagles: yea that was the bug where we need to include disable vip something19:48
* mwhahaha digs up patch19:48
beaglesmwhahaha, ahh ok makes sense19:48
beaglesmwhahaha, couldn't figure out why we were doing this on the undercloud anyways19:49
mwhahahabeagles: https://review.openstack.org/#/c/613106/19:49
beaglesmwhahaha, thanks!19:49
beaglesmwhahaha, this isn't standalone fwiw - its just installing the undercloud19:49
mwhahahayea but it's the same concept under the covers19:49
beaglesmwhahaha, ack19:49
fultonjjidar: you might also find this useful https://docs.openstack.org/tripleo-docs/latest/install/advanced_deployment/ceph_config.html#override-ansible-run-options19:50
mwhahahaso there's somethign that sets that for tls19:50
beaglesgotcha19:50
fultonjjidar: you need to figure out the exact command and run it on a ceph node to see what's going wrong19:50
*** zenpac has joined #tripleo19:51
jidarfultonj: gfidente https://gist.github.com/8f81bc53ae2ceda5d34f0753c056732919:52
jidarthat's the only [ERROR] I see in the workflow log19:52
zenpacWhen building Undercloud on a KVM environment, do I need to set anything special in the Provisioning network creation.?19:52
fultonjjidar: that error, missing osd_scenario, is different19:55
fultonjplease specify an osd_scenario19:55
fultonjhttps://docs.openstack.org/tripleo-docs/latest/install/advanced_deployment/ceph_config.html#configure-osd-settings-with-ceph-ansible19:55
openstackgerritDan Prince proposed openstack/python-tripleoclient master: Drop unused utils.py roles functions  https://review.openstack.org/63381019:55
fultonjif you're using ceph-ansible 3.2 w/ bluesture then use lvm, if earlier than 3.2 use filestore and either collocated or non-collocated19:56
openstackgerritRonelle Landy proposed openstack/tripleo-quickstart-extras master: Design new role for zuul-based reproducer  https://review.openstack.org/63106719:59
jidarfultonj: ugh, I somehow missed this in the docs, thanks I'm re-running a deploy now20:00
*** holser__ is now known as holser|eod20:04
*** holser|eod has quit IRC20:04
fultonjjidar: i think if it got that far then it was able to get your ceph container onto the node already20:08
jidarso those container "errors" are a red herring?20:08
fultonjjidar: you can always directly 'docker pull PATH_TO_CEPH_CONTAINER' directly on the node and see what's going on.20:09
openstackgerritAlex Schultz proposed openstack/ansible-role-container-registry master: Fix become for tasks and handlers  https://review.openstack.org/63381220:09
fultonjjidar: i'd have to look at the timestamps to be sure20:09
fultonjjidar: 'docker images | grep -i ceph' on the overcloud node20:09
fultonjjidar: if that returns nothing, then try 'docker pull PATH_TO_CEPH_CONTAINER'20:10
jidarthey show up that way20:10
*** agopi is now known as agopi|brb20:10
fultonjjidar:  if 'docker images | grep -i ceph | wc -l > 0' then that's that and you will probably get past your issue by setting the osd_scenario as that's the complaint in the ceph-ansible log20:10
*** agopi|brb has quit IRC20:10
*** irclogbot_3 has quit IRC20:15
*** irclogbot_3 has joined #tripleo20:19
*** cfontain_ has joined #tripleo20:23
*** zaneb has joined #tripleo20:36
*** cylopez has joined #tripleo20:38
*** mjturek has quit IRC20:39
*** jtomasek has joined #tripleo20:41
*** mjturek has joined #tripleo20:42
*** sdake has quit IRC20:45
openstackgerritRonelle Landy proposed openstack/tripleo-quickstart-extras master: Design new role for zuul-based reproducer  https://review.openstack.org/63106720:51
*** agopi|brb has joined #tripleo20:54
*** agopi|brb is now known as agopi20:54
*** xek has quit IRC20:54
*** dprince has quit IRC20:57
*** bfournie has quit IRC20:57
*** mjturek has quit IRC21:01
*** nkinder has joined #tripleo21:03
openstackgerritSteve Baker proposed openstack/tripleo-common master: Break out tripleo-admin creation to its own role  https://review.openstack.org/63382721:09
* jidar groans21:23
jidarI can't seem to get nova scheduler to spin up the right baremetal nodes to profiles21:23
*** mjturek has joined #tripleo21:25
*** mjturek has quit IRC21:29
*** tzumainn is now known as tzumainn|bbl21:30
*** gfidente has quit IRC21:32
jidarok, sorry to bug you guys again but I've tagged the node properties with a profile, I've assigned the profile in the overcloud and I'm still getting ceph nodes deployed to controllers and compute nodes assigned to ceph nodes... https://gist.github.com/bf2f8e4a149c65001acff80b94107dfb21:33
jidarI have not tried > 14.1. ASSIGNING SPECIFIC NODE IDS21:33
fultonjjidar: i've used node assignment to get this done in the past21:35
fultonjhttps://access.redhat.com/documentation/en-us/reference_architectures/2017/html/hyper-converged_red_hat_openstack_platform_10_and_red_hat_ceph_storage_2/custom-templates#predictable_ips21:35
fultonji used a not-great script to get it done21:36
fultonjhttps://github.com/RHsyseng/hci/blob/master/scripts/ironic-assign.sh21:36
fultonji.e. there are more efficient ways to than in this script but it worked for me21:36
fultonjyou can borrow the commands from it21:36
*** ade_lee has quit IRC21:38
*** ansmith has quit IRC21:38
openstackgerritAlex Schultz proposed openstack/python-tripleoclient master: Fail if too many nameservers are provided  https://review.openstack.org/63256021:39
jidarthanks again fultonj21:39
*** jcoufal has quit IRC21:39
*** hamzy has quit IRC21:42
*** jtomasek has quit IRC22:01
*** trown is now known as trown|outtypewww22:01
*** sdake has joined #tripleo22:16
*** mcornea has quit IRC22:17
*** rh-jelabarre has quit IRC22:18
*** ade_lee has joined #tripleo22:24
*** dsneddon has quit IRC22:27
*** slaweq has quit IRC22:36
*** bfournie has joined #tripleo22:39
openstackgerritRonelle Landy proposed openstack/tripleo-quickstart-extras master: Design new role for zuul-based reproducer  https://review.openstack.org/63106722:41
*** ade_lee has quit IRC22:41
*** ade_lee has joined #tripleo22:42
openstackgerritwes hayutin proposed openstack/tripleo-quickstart master: write out the libvirt node ip addresses  https://review.openstack.org/63384322:49
openstackgerritwes hayutin proposed openstack/tripleo-quickstart master: write out the libvirt node ip addresses  https://review.openstack.org/63384322:51
*** tkajinam has joined #tripleo22:55
openstackgerritRonelle Landy proposed openstack/tripleo-quickstart-extras master: Design new role for zuul-based reproducer  https://review.openstack.org/63106722:56
*** dsneddon has joined #tripleo23:03
*** dsneddon has quit IRC23:08
*** saneax has joined #tripleo23:14
-openstackstatus- NOTICE: http://zuul.openstack.org is not working. https://zuul.openstack.org does work. Please use that while we investigate.23:15
*** radeks_ has quit IRC23:15
*** saneax has quit IRC23:20
*** saneax has joined #tripleo23:22
*** vinaykns has quit IRC23:32
*** sdake has quit IRC23:35
*** tzumainn|bbl is now known as tzumainn23:37
*** sdake has joined #tripleo23:37
*** dsneddon has joined #tripleo23:37
*** dsneddon has quit IRC23:45
*** dsneddon has joined #tripleo23:45
*** rcernin has quit IRC23:53
*** sdake has quit IRC23:55
*** dsneddon has quit IRC23:55
*** sdake has joined #tripleo23:55
skaIn https://docs.openstack.org/tripleo-docs/latest/install/environments/baremetal.html#minimum-system-requirements it states that 2 nics are on each Overcloud, one on the Provision/PXE net and the other on a Nat'd network. Why do the overcloud nodes need a Nat'd network ?23:56
skaIs there any special VLAN setup required?23:57
*** kplant has joined #tripleo23:57

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!