Monday, 2019-06-03

*** dsneddon has joined #tripleo00:03
*** dsneddon has quit IRC00:09
*** slaweq has joined #tripleo00:11
*** slaweq has quit IRC00:24
*** rfolco has quit IRC00:31
*** dsneddon has joined #tripleo00:40
*** Goneri has joined #tripleo00:46
*** dsneddon has quit IRC00:47
*** saneax has quit IRC00:52
*** tkajinam has quit IRC01:00
*** tkajinam has joined #tripleo01:02
*** rcernin has joined #tripleo01:09
*** slaweq has joined #tripleo01:11
*** dsneddon has joined #tripleo01:18
*** Goneri has quit IRC01:24
*** slaweq has quit IRC01:24
*** Goneri has joined #tripleo01:28
*** dsneddon has quit IRC01:31
*** Goneri has quit IRC01:34
*** tkajinam_ has joined #tripleo01:45
*** tkajinam has quit IRC01:48
*** owalsh has quit IRC01:49
*** owalsh has joined #tripleo01:57
*** dsneddon has joined #tripleo02:06
*** dmacpher has joined #tripleo02:11
*** dsneddon has quit IRC02:11
*** slaweq has joined #tripleo02:12
*** owalsh_ has joined #tripleo02:18
*** owalsh has quit IRC02:20
*** slaweq has quit IRC02:25
*** dsneddon has joined #tripleo02:37
*** dsneddon has quit IRC02:42
*** owalsh_ is now known as owalsh02:56
*** dsneddon has joined #tripleo02:58
*** dsneddon has quit IRC03:02
*** slaweq has joined #tripleo03:12
*** slaweq has quit IRC03:25
*** dsneddon has joined #tripleo03:29
*** dsneddon has quit IRC03:34
*** dmacpher has quit IRC03:39
*** ykarel|away has joined #tripleo03:53
*** dsneddon has joined #tripleo04:07
*** rascasoft has quit IRC04:14
*** rascasoft has joined #tripleo04:16
*** dsneddon has quit IRC04:20
*** ramishra has joined #tripleo04:24
*** hoonetorg has joined #tripleo04:25
*** ramishra_ has joined #tripleo04:28
*** ramishra has quit IRC04:30
*** altlogbot_2 has quit IRC04:36
*** janki has joined #tripleo04:38
*** altlogbot_2 has joined #tripleo04:38
*** raukadah is now known as chandankumar04:41
*** dsneddon has joined #tripleo04:49
*** ramishra has joined #tripleo04:51
*** dsneddon has quit IRC04:53
*** ramishra_ has quit IRC04:53
*** sshnaidm is now known as sshnaidm|off05:03
*** radeks has joined #tripleo05:05
*** pcaruana has joined #tripleo05:08
*** slaweq has joined #tripleo05:11
*** slaweq has quit IRC05:16
*** openstackgerrit has joined #tripleo05:20
openstackgerrityatin proposed openstack/tripleo-ci master: [DNM] Test ansible 2.8 with container build job  https://review.opendev.org/66268005:20
*** quiquell has joined #tripleo05:22
*** dsneddon has joined #tripleo05:24
itlinuxhello all05:24
itlinuxcan the horizon_config ad a block of code into the local_settings05:25
*** udesale has joined #tripleo05:26
*** dsneddon has quit IRC05:29
*** jtomasek has joined #tripleo05:32
*** saneax has joined #tripleo05:33
*** sanjayu_ has joined #tripleo05:34
*** sanjayu_ has quit IRC05:34
*** sanjayu_ has joined #tripleo05:34
*** marios has joined #tripleo05:37
itlinuxlooks like horizon does not have the extra option to write extra stuff into the local_settings..can someone let me know. Thanks05:37
*** dtantsur|afk is now known as dtantsur05:44
*** ykarel|away is now known as ykarel05:44
*** dsneddon has joined #tripleo05:45
openstackgerritMichele Baldessari proposed openstack/puppet-tripleo master: Make sure we pass the proper new pcs 0.10 variables  https://review.opendev.org/66034505:46
*** saneax has quit IRC05:46
ykarelitlinux, where u found horizon_config? i don't see such option in puppet-horizon05:47
ykareli see local_settings is configured via template https://github.com/openstack/puppet-horizon/blob/master/templates/local_settings.py.erb05:47
itlinuxin fact I was hoping to find something similar like keystone_config05:48
ykarelack so u assumed horizon_config is there05:49
itlinuxyes I did..05:49
itlinuxor something like that.. to modify the file05:49
itlinuxwithout having to hack the codes05:49
ykarelso u can check the template i shared ^^ and see if it has a way to configure for ur use case05:50
itlinuxI do not see it..05:50
ykarelfor example https://github.com/openstack/puppet-horizon/blob/master/templates/local_settings.py.erb#L418-L42405:50
ykarel^^ is configurable based on instance_options puppet variable05:51
itlinuxI would need to add a block like this:05:51
ykarelhttps://github.com/openstack/puppet-horizon/blob/master/manifests/init.pp#L61605:51
itlinuxhttp://paste.openstack.org/show/752417/05:51
*** yprokule has joined #tripleo05:51
itlinuxmaybe I just add a file to the enabled folder..05:52
itlinuxthat could be an option I think05:52
ykarelseems u trying to add custom dashboard05:54
ykareland i don't any option which will enable such customization to local_settings.py via template05:55
itlinuxok05:55
ykarelhmm may be it's possible by adding files to enabled folder05:56
itlinuxhow about adding section like this AVI_LBAAS_FULL_READONLY_UI = True  AVI_LBAAS_PANEL_NAME = "Avi Loadbalancer"05:56
ykarelsomeone working on horizon may have more idea05:56
itlinuxis there an option to add that?05:56
itlinuxok I will ask around05:56
itlinuxthanks ykarel05:56
ykareli know rdopiera knows about horizon, but he is not around currently05:57
*** skramaja has joined #tripleo05:57
itlinuxis he in the US?05:57
itlinuxI will try tomorrow then..05:57
*** ksambor has quit IRC05:59
*** jbadiapa has joined #tripleo06:02
*** ksambor has joined #tripleo06:02
*** slaweq has joined #tripleo06:11
openstackgerrityatin proposed openstack/tripleo-ci master: [DNM] Debug DISK_FULL issue with fs016 pike job  https://review.opendev.org/66248106:13
ykarelitlinux, i think he is in Europeon Timezone, so should be available in few hours06:16
itlinuxok06:16
itlinuxthanks06:16
*** ykarel is now known as ykarel|afk06:20
*** mschuppert has joined #tripleo06:22
*** slaweq has quit IRC06:24
*** ccamacho has joined #tripleo06:29
*** jfrancoa has joined #tripleo06:37
*** slaweq has joined #tripleo06:39
*** holser_ has joined #tripleo06:43
*** d0ugal has joined #tripleo06:44
openstackgerritMerged openstack/tripleo-common master: [Trivial fix]Remove unnecessary slash  https://review.opendev.org/65735706:45
*** florianf has joined #tripleo06:47
*** dsneddon has quit IRC06:49
openstackgerritcaoyuan proposed openstack/tripleo-quickstart-extras master: Fix some wrong URLs  https://review.opendev.org/65471206:53
*** fmount has quit IRC06:54
*** aedc has joined #tripleo06:57
*** tosky has joined #tripleo06:58
*** kopecmartin|off is now known as kopecmartin06:59
*** fmount has joined #tripleo06:59
*** cylopez has joined #tripleo07:00
*** numans has joined #tripleo07:00
*** avivgt has joined #tripleo07:05
openstackgerritYurii Prokulevych proposed openstack/tripleo-upgrade master: [DOC] Add note about roles_upgrade_order variable.  https://review.opendev.org/63146507:07
*** pkopec has joined #tripleo07:12
*** jfrancoa has quit IRC07:16
*** cylopez has quit IRC07:16
*** amoralej|off is now known as amoralej07:18
*** rpittau|afk is now known as rpittau07:19
*** dsneddon has joined #tripleo07:24
openstackgerrityolanda.robla proposed openstack/tripleo-common master: Add support for RHEL 8 and start using versionless element  https://review.opendev.org/66269307:27
*** jfrancoa has joined #tripleo07:29
*** dsneddon has quit IRC07:32
*** xek has joined #tripleo07:40
*** BlackDex has quit IRC07:41
*** aakarsh has quit IRC07:41
*** hamzy has quit IRC07:41
*** mnaser has quit IRC07:41
*** mugsie has quit IRC07:41
*** evrardjp has quit IRC07:41
*** irclogbot_1 has quit IRC07:44
*** jaosorior has joined #tripleo07:44
*** dansmith has quit IRC07:45
*** irclogbot_0 has joined #tripleo07:46
*** dansmith has joined #tripleo07:47
*** dasp has quit IRC07:47
*** hberaud|gone has quit IRC07:47
*** KingJ has quit IRC07:47
*** zaneb has quit IRC07:47
*** EvilienM has quit IRC07:47
*** ab-a has quit IRC07:47
*** jjoyce has quit IRC07:47
*** dtantsur has quit IRC07:47
*** egonzalez has quit IRC07:47
*** dasp has joined #tripleo07:52
*** hberaud|gone has joined #tripleo07:52
*** KingJ has joined #tripleo07:52
*** zaneb has joined #tripleo07:52
*** ab-a has joined #tripleo07:52
*** EvilienM has joined #tripleo07:52
*** jjoyce has joined #tripleo07:52
*** dtantsur has joined #tripleo07:52
*** egonzalez has joined #tripleo07:52
*** niven.freenode.net sets mode: +v EvilienM07:52
*** BlackDex has joined #tripleo07:53
*** aakarsh has joined #tripleo07:53
*** hamzy has joined #tripleo07:53
*** mnaser has joined #tripleo07:53
*** mugsie has joined #tripleo07:53
*** evrardjp has joined #tripleo07:53
*** jpena|off is now known as jpena07:55
*** ykarel|afk is now known as ykarel07:55
*** bogdando has joined #tripleo08:00
*** dsneddon has joined #tripleo08:00
openstackgerritKamil Sambor proposed openstack/tripleo-heat-templates master: Add creating br-ex for compute node in ovn  https://review.opendev.org/66193908:01
openstackgerritAharon Rasouli proposed openstack/tripleo-upgrade master: Leapp undercloud upgrade for osp15  https://review.opendev.org/66270308:02
*** paramite has joined #tripleo08:03
openstackgerritCarlos Camacho proposed openstack/python-tripleoclient master: Remove skiping tag validation as there are no validation in THT anymore  https://review.opendev.org/66090908:04
*** iurygregory has joined #tripleo08:05
openstackgerritKamil Sambor proposed openstack/tripleo-heat-templates master: Add creating br-ex for compute node in ovn  https://review.opendev.org/66193908:05
*** dsneddon has quit IRC08:06
*** ramishra has quit IRC08:07
*** apetrich has joined #tripleo08:10
*** yolanda has joined #tripleo08:11
*** holser_ has quit IRC08:16
*** jchhatbar has joined #tripleo08:20
*** janki has quit IRC08:20
*** marios has quit IRC08:21
openstackgerritAharon Rasouli proposed openstack/tripleo-upgrade master: Leapp undercloud upgrade  https://review.opendev.org/66271108:25
*** nkinder has joined #tripleo08:25
openstackgerritLuca Miccini proposed openstack/tripleo-common stable/stein: Adds redfish support to 'overcloud generate fencing'.  https://review.opendev.org/66271608:34
*** rcernin has quit IRC08:36
*** ykarel is now known as ykarel|lunch08:37
openstackgerritAdrian Chiris proposed openstack/os-net-config master: Add support for ethtool options for sriov_pf ports  https://review.opendev.org/66148608:38
openstackgerritAdrian Chiris proposed openstack/os-net-config master: Unify ethtool options logic  https://review.opendev.org/66148708:38
openstackgerritAdrian Chiris proposed openstack/os-net-config master: [FUP] Update sriov_pf.yaml samle with ethtool_opt  https://review.opendev.org/66271708:38
*** jchhatbar has quit IRC08:40
*** janki has joined #tripleo08:40
*** dsneddon has joined #tripleo08:41
openstackgerritAharon Rasouli proposed openstack/tripleo-upgrade master: Leapp undercloud upgrade  https://review.opendev.org/66271108:41
*** tkajinam_ has quit IRC08:46
*** dsneddon has quit IRC08:46
openstackgerritLuca Miccini proposed openstack/tripleo-common stable/stein: Adds redfish support to 'overcloud generate fencing'.  https://review.opendev.org/66271608:46
*** cylopez has joined #tripleo08:47
*** chem has joined #tripleo08:54
*** paramite has quit IRC08:56
*** paramite has joined #tripleo09:00
*** gfidente has joined #tripleo09:01
*** marios has joined #tripleo09:17
*** marios_|ruck has joined #tripleo09:17
*** dsneddon has joined #tripleo09:18
*** ramishra has joined #tripleo09:20
*** dtantsur has quit IRC09:20
*** holser_ has joined #tripleo09:22
*** dsneddon has quit IRC09:22
*** pbandark has joined #tripleo09:24
*** dtantsur has joined #tripleo09:25
bogdandoPTAL https://review.opendev.org/66071609:29
*** florianf has quit IRC09:30
*** ykarel|lunch is now known as ykarel09:34
*** dsneddon has joined #tripleo09:55
*** dsneddon has quit IRC10:00
*** cylopez has quit IRC10:01
*** ykarel_ has joined #tripleo10:05
*** ykarel has quit IRC10:08
*** ykarel_ is now known as ykarel10:22
*** ansmith_ has joined #tripleo10:24
*** ansmith has quit IRC10:27
*** dsneddon has joined #tripleo10:27
*** dsneddon has quit IRC10:32
*** florianf has joined #tripleo10:33
openstackgerritGiulio Fidente proposed openstack/puppet-tripleo master: Allow external Ganesha for the cephfs manila backend  https://review.opendev.org/66207410:55
*** janki has quit IRC10:57
*** janki has joined #tripleo10:58
*** bfournie has quit IRC11:00
*** dsneddon has joined #tripleo11:08
*** tosky has quit IRC11:11
*** dsneddon has quit IRC11:13
openstackgerritMerged openstack/tripleo-upgrade stable/rocky: Add support for network-data-file.  https://review.opendev.org/66089211:22
openstackgerritMerged openstack/puppet-tripleo stable/queens: Rebuild initramfs after applying change in kernel parameters  https://review.opendev.org/66237811:22
Tenguhello there11:26
*** jpena is now known as jpena|lunch11:31
*** janki has quit IRC11:33
*** udesale has quit IRC11:40
*** udesale has joined #tripleo11:40
*** ansmith_ has quit IRC11:44
ykarelTengu, hey11:44
*** dsneddon has joined #tripleo11:45
Tenguykarel: hoy :)11:46
ykarelTengu, actually we are seeing mass log generation in a pike job in fluentd_client container, may be u have some idea around it11:46
Tenguhmmmmm not really11:46
Tenguykarel: care to link those logs? I'm in a train, connection is a bit slow11:46
*** saneax has joined #tripleo11:46
ykarelTengu, logs not collected as they are too much :( > 6 GBS11:46
ykarelTengu, in short https://review.rdoproject.org/zuul/builds?result=DISK_FULL11:47
Tenguouch11:47
ykarelwe hitting ^^11:47
Tenguykarel: is it the container STDOUT?11:47
Tengunot sure this one has been taken down to pike though11:47
*** holser_ is now known as holser|lunch11:47
ykarelTengu, nope, see paste.openstack.org/show/752372/11:47
ykarelTengu, and interesting part is it not happens always11:48
ykarelhttps://review.rdoproject.org/zuul/builds?job_name=periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset016-pike11:48
Tenguykarel: you might want to ping metmon/cloudops folks for that one :/11:48
TenguI don't really know what's pushing things in that location11:49
ykarelTengu, sure, but it mainly looks docker related11:49
Tenguand iirc the log patches I've made aren't ported to pike.11:49
Tengu"only" rocky11:49
ykareldid u see path locatioons?11:49
ykarelin the pastebin11:49
ykarelsome recursive paths11:49
Tenguhmm.11:49
*** dsneddon has quit IRC11:50
Tenguykarel: this tree is created by a script that copies the logs?11:50
ykarelTengu, /me don't know11:50
ykarelbefore digging i though of pinging people who might be aware of it11:50
Tengulooks like the path /log/containers/host/extra/docker/ is repeated11:50
Tengunot really sure what can cause that.11:51
TenguI'd look into the collect-logs in ooq-extras iir11:51
Tenguiirc11:51
Tenguhmm. no real change affecting collect-logs11:53
ykarelTengu, okk Thanks, i will try to find out, btw this issue is existing from long ago11:53
Tengumaybe some bind-mount issue within the container?11:54
Tenguykarel: ah? ook. so this invalidate my previous statement11:54
Tenguany idea when it started?11:54
ykarelyes something like ^^ possible,11:54
Tenguif so, that might be due to the changes in the collectd-logs role (in oooq-extras).11:54
TenguOR some issues with bind-mount11:54
ykarelTengu, i can see 2019-01-11T05:18:5311:55
ykarelbut it's failing before ^^11:55
Tenguok11:56
Tengunot cool :/11:56
*** tesseract has joined #tripleo11:57
*** cylopez has joined #tripleo11:58
*** rfolco has joined #tripleo11:58
*** janki has joined #tripleo11:59
Tenguykarel: for what I can say, collect.yaml doesn't seem to have weird patch11:59
*** rh-jelabarre has joined #tripleo12:00
*** bfournie has joined #tripleo12:01
*** abishop has joined #tripleo12:03
ykarelTengu, ack, /me looking - /var/log:/var/log/containers/host:ro, may be https://review.opendev.org/#/c/581345/2/docker/services/fluentd-client.yaml related12:03
ykarelmerged 9 months ago12:04
Tengumight be the thing indeed.12:04
Tenguyou'll get a nice loop.12:04
*** aedc has quit IRC12:05
Tengumaybe we shouldn't fetch that "host" diretory.12:05
*** raildo has joined #tripleo12:05
*** aedc has joined #tripleo12:05
*** rlandy has joined #tripleo12:06
Tengu(meaning we can correct that from within oooq-extras/tasks/collect.yaml)12:06
*** tosky has joined #tripleo12:06
*** aedc has quit IRC12:06
Tenguykarel: still, I'd ping jbadiapa about it :)12:06
ykarelTengu, yes /me was looking for him :)12:07
Tenguhehe12:07
ykarelwasn't aware of nick12:07
Tenguok, almost at Brno..12:09
ykareljbadiapa, once available can u please check the mass log generation issue we seeing in pike jobs12:10
ykarelhttps://review.opendev.org/#/c/581345/ seems related, but may be u can quickly get to the issue12:11
*** janki has quit IRC12:13
*** cylopez has quit IRC12:13
*** cylopez has joined #tripleo12:15
*** amoralej is now known as amoralej|lunch12:16
*** dprince has joined #tripleo12:18
bogdandoo/ PTAL https://review.opendev.org/#/c/660716/12:18
*** dsneddon has joined #tripleo12:21
*** rfolco has quit IRC12:21
openstackgerritLuca Miccini proposed openstack/puppet-pacemaker master: WIP - Support for SBD (watchdog only)  https://review.opendev.org/66274012:23
openstackgerritYurii Prokulevych proposed openstack/tripleo-upgrade stable/queens: Add support for network-data-file.  https://review.opendev.org/66274112:23
*** rfolco has joined #tripleo12:24
openstackgerritLuca Miccini proposed openstack/puppet-pacemaker master: WIP - Support for SBD (watchdog only)  https://review.opendev.org/66274012:24
openstackgerritmathieu bultel proposed openstack/python-tripleoclient stable/queens: Use tripleo-admin user for minor updates  https://review.opendev.org/66274212:25
*** holser|lunch is now known as holser_12:26
*** apetrich has quit IRC12:26
*** dsneddon has quit IRC12:27
*** dprince has quit IRC12:27
*** apetrich has joined #tripleo12:27
*** jpena|lunch is now known as jpena12:29
*** vinaykns has joined #tripleo12:29
*** fultonj has joined #tripleo12:32
*** saneax has quit IRC12:35
openstackgerritLuca Miccini proposed openstack/puppet-pacemaker master: WIP - Support for SBD (watchdog only)  https://review.opendev.org/66274012:36
BlackDexis there a way to include the contents of an external file as a variable for the plan-environment.yaml?12:38
BlackDexLike the contents of a certificate?12:38
*** rascasoft has quit IRC12:39
BlackDexsomething like "SSLCertificate: - path: path/to/cert.crt"12:39
BlackDex?12:39
weshaymarios_|ruck fyi.. the tripleo gate has several red jobs fyi12:40
*** rascasoft has joined #tripleo12:41
*** ansmith_ has joined #tripleo12:42
*** jschlueter has quit IRC12:43
*** jschlueter has joined #tripleo12:43
*** vinaykns has quit IRC12:48
*** vkapalav has joined #tripleo12:49
marios_|ruckweshay: ack12:49
marios_|ruckweshay: i see 2 fails @ http://dashboard-ci.tripleo.org/d/cEEjGFFmz/cockpit?orgId=1&from=now-7d&to=now 'upstream gate jobs'12:51
marios_|ruckweshay: one is that f28 ... did you see something else12:51
*** mcornea has joined #tripleo12:53
*** morazi has joined #tripleo12:53
marios_|ruckweshay: maybe this you mean http://zuul.openstack.org/builds?job_name=tripleo-ci-centos-7-scenario000-multinode-oooq-container-updates12:53
marios_|ruckweshay: there are 2 fails on that will file a bug (one is check on e is gate)12:53
marios_|ruckweshay: hm one undercloud one overcloud... both package related http://logs.openstack.org/65/649965/32/check/tripleo-ci-centos-7-scenario000-multinode-oooq-container-updates/6f217e7/logs/undercloud/home/zuul/install_packages.sh.log.txt.gz#_2019-06-03_10_13_3412:55
marios_|ruckhttp://logs.openstack.org/12/657612/9/gate/tripleo-ci-centos-7-scenario000-multinode-oooq-container-updates/4a01a37/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz#_2019-06-03_10_49_0912:55
weshaymarios_|ruck ya.. couple tox jobs as well.. was looking at the live zuul queue12:56
openstackgerritLon Hohberger proposed openstack/tripleo-puppet-elements master: Add RHEL8 support for overcloud-full image  https://review.opendev.org/65273312:56
*** vkapalav is now known as vinaykns12:57
openstackgerritLon Hohberger proposed openstack/tripleo-common master: Overcloud-full image templates for RHEL8  https://review.opendev.org/65913612:57
marios_|ruckweshay: k am gonna hold on filing bug for now until we have more i think12:58
marios_|ruckweshay: noting logs though12:58
weshayk k..12:58
jbadiapaykarel, hi, I've just seen you ping me12:59
*** dsneddon has joined #tripleo12:59
ykareljbadiapa, hi yes i pinged12:59
ykarelwould like me to summarize or u seen IRC logs?12:59
ykareljbadiapa, in short in pike sceanrio001 we seeing mass log generation:- http://paste.openstack.org/show/752372/ and i think it's happening post your change 9 months ago:- https://review.opendev.org/#/c/581345/2/docker/services/fluentd-client.yaml13:01
ykarelalso it's happening randomly,13:01
EvilienMweshay: /me was talking to cloudnull about the reproducer, what's the latest status on it?13:03
*** dsneddon has quit IRC13:04
cloudnull^ o/13:04
cloudnullwas looking into what is causing http://logs.openstack.org/80/662580/1/check/tripleo-ci-centos-7-scenario001-standalone/a4cc78e/logs/undercloud/home/zuul/standalone_deploy.log.txt.gz#_2019-06-01_16_31_45 and if I can try out the reproducer scripts to figure it out13:04
*** owalsh_ has joined #tripleo13:04
*** owalsh has quit IRC13:06
jbadiapaykarel, where can I see a fate output for scenario001 on pike?13:07
ykareljbadiapa, https://review.rdoproject.org/zuul/builds?job_name=periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset016-pike13:07
ykarelbut NOTE job failing with DISK_FULL don't collect logs13:07
rlandyEvilienM: hi - I'm debugging a nova placement issue on a hardware deployment without net-iso ... who is the the contact for the recent placement changes?13:08
jbadiapaykarel, I would like to check the /var/lib/config-data or the /var/log/config-data of the jobs that are failling13:09
*** Vorrtex has joined #tripleo13:09
ykareljbadiapa, nope that are not collected due to mass logs13:10
ykarelthe logs generated are > 6 GB13:10
ykareljbadiapa, /var/lib/config-data should be same for the passing ones13:10
EvilienMrlandy: Lee or mschuppert13:10
rlandythanks13:11
*** aakarsh has quit IRC13:11
jbadiapaykarel, I was wondering if the issue is collecting the logs or generating it.13:12
BlackDexHello there, i'm getting the following error "Missing networks from environment configuration. Ensure the following networks are properly configured in the provided environment files"13:13
ykareljbadiapa, so somehow a loop is created due to /var/log and /var/log/containers in bind-mounts of fluentd_client container13:14
BlackDexWhile i just deployed the whole config, and just change one parameter in the plan-environment.yaml, and did a `openstack overcloud deploy --templates /path/to/template/13:14
jbadiapaykarel, yes, it's expected13:14
ykareljbadiapa, loop is expected?13:14
*** jaosorior has quit IRC13:15
BlackDexit seems i have to explicitly define the networking env's while they are already included in the plan-environment.yaml13:15
*** jcoufal has joined #tripleo13:18
jbadiapaykarel, yes. to be able to read the logs without changing all the templates.13:18
*** EvilienM is now known as EmilienM13:24
*** amoralej|lunch is now known as amoralej13:26
*** dsneddon has joined #tripleo13:31
openstackgerritFrancesco Pantano proposed openstack/tripleo-common master: Add the ability to compute osds number counting lvm devices  https://review.opendev.org/66275113:32
openstackgerritAlex Schultz proposed openstack/tripleo-puppet-elements stable/stein: Add upper constraints  https://review.opendev.org/66275213:34
*** mnaser has quit IRC13:34
openstackgerritAlex Schultz proposed openstack/tripleo-puppet-elements stable/rocky: Add upper constraints  https://review.opendev.org/66275413:34
openstackgerritAlex Schultz proposed openstack/tripleo-puppet-elements stable/stein: Add element to install all openstack clients  https://review.opendev.org/66260913:34
openstackgerritAlex Schultz proposed openstack/tripleo-puppet-elements stable/rocky: Add element to install all openstack clients  https://review.opendev.org/66261013:35
*** pkopec has quit IRC13:35
openstackgerritAlex Schultz proposed openstack/tripleo-puppet-elements stable/queens: Add upper constraints  https://review.opendev.org/66275513:35
*** aakarsh has joined #tripleo13:35
*** dsneddon has quit IRC13:36
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates stable/queens: [queens-only] Write docker config scripts only if config exists  https://review.opendev.org/66275613:36
*** mnaser has joined #tripleo13:38
*** panda has quit IRC13:39
*** panda has joined #tripleo13:42
ykareljbadiapa, okk so i looked further and bind mounting of /var/log is related to the issue we seeing with fluentd13:47
ykareljbadiapa, so there was past effort to handle similar issue with openshift, see https://github.com/openstack/ansible-role-collect-logs/commit/ce6204acf1b4c018b611148964c84625bc73b08813:47
ykarelsomehow ^^ is not working with that flentd_container13:48
ykarelTengu, fyi ^^13:48
ykarelmay be mandre remembers that issue?13:48
ykareland can relate to http://paste.openstack.org/show/752372/13:48
EmilienMweshay: you want to checkout out [qa][openstack-ansible] redefining devstack13:49
openstackgerritNathan Kinder proposed openstack/puppet-tripleo master: Don't require memcached_node_ips when deploying keystone  https://review.opendev.org/66275913:54
mandreykarel: it's definitely the same issue, you need to find a way to break the recursion during log collection13:55
ykareljbadiapa, mandre so that collect-logs patch is handling /var/log mount to /var/log but with fluentd_client case is /var/log mount to /var/log/containers/host13:55
ykarelmandre, yes13:55
mandreperhaps https://github.com/openstack/ansible-role-collect-logs/commit/ce6204acf1b4c018b611148964c84625bc73b088 is not working anymore due to the switch to podman?13:55
ykarelmandre, container_cp method is used which handles it differently for podman and docker13:56
mandreykarel: ah, ok, so the assumption we make is no longer valid in fluentd container due to the path difference13:56
ykarelmandre, yes13:57
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: Introduce param_config interface  https://review.opendev.org/66109313:57
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: Glance: wire param_config  https://review.opendev.org/66079113:58
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: Glance: wire param_config  https://review.opendev.org/66079113:58
mandreykarel: it would probably be safer to check mounted volumes with docker inspect13:58
*** blueDuckRandom has joined #tripleo13:59
*** ykarel_ has joined #tripleo14:00
openstackgerritFrancesco Pantano proposed openstack/tripleo-common master: Add the ability to compute osds number counting lvm devices  https://review.opendev.org/66275114:02
*** ykarel has quit IRC14:03
*** ansmith has joined #tripleo14:05
openstackgerritHarry Rybacki proposed openstack/tripleo-quickstart master: Update supplemental role to paramaterize networking  https://review.opendev.org/66206814:06
*** ansmith_ has quit IRC14:06
*** skramaja has quit IRC14:07
*** dsneddon has joined #tripleo14:07
fultonjskramaja abishop do you recall the syntax to generate the tht output of a derive paramters workflow without doing the deployment?14:08
fultonjfmount: ^14:08
fultonjit looks like we didn't document it14:09
fmountfultonj: thanks for asking here, basically we want to test the derive_parameters_formulas workflow without perform a full deployment14:09
fmountso I'm looking for a way to generate the tht output to use as input of that workflow14:10
fultonjthe workflow uses some info from tht and introspection data to produce the completed tht14:11
rlandyade_lee_: mschuppert: hello ... I am looking at this failed overcloud deployment on a hardware env ( note no network-iso). Does this error look familiar to you? https://sf.hosted.upshift.rdu2.redhat.com/logs/31/169131/10/check/tripleo-ci-base-baremetal-microcloud-ha-2/9a49602/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz#_2019-05-29_00_12_5814:12
*** dsneddon has quit IRC14:12
fultonjfmount: i think we only documented it downstream https://access.redhat.com/documentation/en-us/red_hat_openstack_platform/13/html/network_functions_virtualization_planning_and_configuration_guide/part-dpdk-configure14:13
mschuppertrlandy: checking14:13
openstackgerritKevin Carter (cloudnull) proposed openstack/tripleo-specs master: Add the "transformation" squad  https://review.opendev.org/66276314:13
fultonjupdate-plan-only14:13
blueDuckRandomIm kinda lost... I want to define 2 bonded interfaces for my ceph storage nodes, and use one of the bonds only for ceph mgmt. My understanding is that the vlans of each bond are defined in the network/config/bond-with-vlans/ceph-storage template, assigning each vlan as a "member" of the bond. Is this correct?14:14
fmountthanks fultonj, I'll take a look at the doc14:14
fultonjfmount: openstack overcloud deploy --templates --update-plan-only  -e ... -p /home/stack/plan-environment-derived-params.yaml14:14
fultonjfmount: that's the option i was trying to remember --update-plan-only14:14
fmountyeah14:14
fmountfultonj++14:14
fmountthx14:15
fultonjabishop skramaja never mind. found it14:15
*** quiquell has quit IRC14:22
openstackgerritAlex Schultz proposed openstack/tripleo-quickstart master: Add single minion node config  https://review.opendev.org/66234914:24
*** Goneri has joined #tripleo14:24
rlandymschuppert: my suspicion is that the deployment is missing the network isolation templates that we usually test with. If the issue is not easily diagnosed, my next step would be to add the network isolation and try the deployment again14:24
mschuppertrlandy: from https://sf.hosted.upshift.rdu2.redhat.com/logs/31/169131/10/check/tripleo-ci-base-baremetal-microcloud-ha-2/9a49602/logs/overcloud-controller-0/var/log/extra/docker/docker_allinfo.log.txt.gz most of the osp service containers on the controllers were  not created. the placement error is only where itthen failed at the end14:24
*** ChanServ sets mode: +o mwhahaha14:26
*** ykarel_ is now known as ykarel14:26
openstackgerrityatin proposed openstack/ansible-role-collect-logs master: Handle recursive copy of /var/log from containers  https://review.opendev.org/66276714:26
rlandymschuppert: ok - I'll try the deployment again14:26
ykarelmandre, jbadiapa Tengu starting with ^^14:26
*** aedc has joined #tripleo14:26
*** mwhahaha changes topic to "CI Status: YELLOWish (dfw mirror problems, should be fixed now so recheck), RDOCloud Status: pffft RED, promoted current-tripleo 3/18 | community irc meeting Tues@1400 UTC - tripleo-ci-community meeting Tues@1330 UTC | https://docs.openstack.org/tripleo-docs/latest/"14:27
mschuppertrlandy: ok, let me know how that will work14:27
rlandyk14:27
openstackgerritJose Luis Franco proposed openstack/tripleo-upgrade master: Automate the undercloud leapp upgrade.  https://review.opendev.org/66130214:31
*** paramite has quit IRC14:31
*** paramite has joined #tripleo14:32
openstackgerritgongysh proposed openstack/tripleo-quickstart master: Add proxy support for curl and yum repo  https://review.opendev.org/64506914:34
Tenguback online.14:35
Tenguykarel: could you find a correction?14:35
ykarelTengu, what correction?14:35
Tengufor the recurse log thingy14:35
openstackgerritJohn Fulton proposed openstack/tripleo-docs master: Fix formatting for mon_host_v1 example  https://review.opendev.org/66277014:35
openstackgerritMartin Schuppert proposed openstack/puppet-tripleo master: [WIP] not manage virtlogd via paunch and start virtlogd via wrapper  https://review.opendev.org/66277114:35
Tenguah, just saw it14:36
ykarelTengu, yes i proposed https://review.opendev.org/#/c/662767/114:36
openstackgerritKamil Sambor proposed openstack/tripleo-heat-templates master: Add creating br-ex for compute node in ovn  https://review.opendev.org/66193914:36
*** dsneddon has joined #tripleo14:39
openstackgerritEmilien Macchi proposed openstack/python-tripleoclient master: Wire in convert_docker_params  https://review.opendev.org/65156714:41
*** dsneddon has quit IRC14:43
openstackgerritMartin Schuppert proposed openstack/tripleo-heat-templates master: [WIP] not manage virtlogd via paunch and start virtlogd via wrapper  https://review.opendev.org/66277814:44
openstackgerritJohn Fulton proposed openstack/tripleo-heat-templates master: WIP/DNM: Prepare for Ceph by including Ansible roles  https://review.opendev.org/66100114:45
openstackgerritJohn Fulton proposed openstack/tripleo-heat-templates master: Prepare for Ceph by including Ansible roles  https://review.opendev.org/66100114:46
openstackgerritLuca Miccini proposed openstack/puppet-pacemaker master: WIP - Support for SBD (watchdog only)  https://review.opendev.org/66274014:50
*** ansmith has quit IRC14:51
ade_lee_rlandy, ack -- lmk if you need a look on your next deployment14:51
*** owalsh has joined #tripleo14:52
rlandyade_lee_: thanks - going to add the network isolation back - if possible - as it will make that deployment more standard14:52
fultonjgchamoul: https://review.opendev.org/#/c/662542/1/roles/ceph/tasks/ceph-ansible-installed.yaml@1514:53
fultonjgchamoul: you asked if i could add this new var to the playbook but it's there already. did perhaps you just not see it or are you asking for something else14:54
*** owalsh_ has quit IRC14:54
gchamoulfultonj: thanks, but I wanted you add this variable in the playbooks/ceph-ansible-installed.yaml14:58
openstackgerritMerged openstack/tripleo-puppet-elements stable/rocky: Add upper constraints  https://review.opendev.org/66275414:59
gchamoulfultonj: that's the playbooks used by the validation framework https://github.com/openstack/tripleo-validations/blob/master/playbooks/ceph-ansible-installed.yaml15:00
*** ccamacho has quit IRC15:01
gchamoulfultonj: even if the default value is false in the role, the playbook should mention it too. Only for clarity15:01
fultonjgchamoul: ok, i get it15:01
fultonjnp15:01
*** ykarel_ has joined #tripleo15:01
openstackgerritJohn Fulton proposed openstack/tripleo-validations master: Add option to fail if ceph-ansible is not installed  https://review.opendev.org/66254215:01
gchamoulfultonj: thanks15:02
fultonjgchamoul: https://review.opendev.org/#/c/662542/2/playbooks/ceph-ansible-installed.yaml15:02
*** ccamacho has joined #tripleo15:04
*** ykarel has quit IRC15:04
gchamoulfultonj: sorry to be annoying but could you please add it after the metadata? :S15:05
gchamoulfultonj: just to be consistent with all the playbooks15:05
openstackgerritMerged openstack/tripleo-puppet-elements stable/queens: Add upper constraints  https://review.opendev.org/66275515:05
fultonjgchamoul: done15:06
openstackgerritJohn Fulton proposed openstack/tripleo-validations master: Add option to fail if ceph-ansible is not installed  https://review.opendev.org/66254215:06
gchamoulfultonj: +2, thanks a lot!15:07
ykarel_rlandy, re. the issue u reference earlier15:07
*** ykarel_ is now known as ykarel15:07
fultonjthanks gchamoul15:07
ykarelrlandy, to me it seems the actual issue is:- [norpm] Attempting to install openstack-neutron but it will not be installed15:08
ykarelfollowed by (/Stage[main]/Neutron/Neutron_config[DEFAULT/bind_host]/ensure) change from 'absent' to 'present' failed: Could not set 'present' on ensure: No such file or directory - /etc/neutron/neutron.conf (file: /etc/puppet/modules/neutron/manifests/init.pp, line: 432)15:08
ykareljust in case u didn't find ^^ https://sf.hosted.upshift.rdu2.redhat.com/logs/31/169131/10/check/tripleo-ci-base-baremetal-microcloud-ha-2/9a49602/logs/overcloud-controller-0/var/log/journal.txt.gz#_May_28_23_52_0015:08
fultonjgchamoul: related to that change is this one which depends on it https://review.opendev.org/#/c/65713115:08
*** tosky has quit IRC15:08
rlandyykarel: thanks - there are multiple things that could go wrong here - trying to eliminate them one at a time15:09
ykarelrlandy, ack15:10
ykarelrlandy, so is the issue recurring? failing at same step?15:10
*** irclogbot_0 has quit IRC15:10
*** altlogbot_2 has quit IRC15:11
ykarelas that error looks more related to package dependencies15:11
ykareland could happen due to network as well15:11
*** dsneddon has joined #tripleo15:12
* ykarel need to leave now15:12
*** ykarel is now known as ykarel|away15:12
*** irclogbot_2 has joined #tripleo15:12
*** altlogbot_3 has joined #tripleo15:13
gchamoulfultonj: looks good to me. Don't really know if I can put my +2 on THT but I actually did. Let's be crazy :-)15:14
fultonjgchamoul: thanks15:15
rlandyykarel: ack  totally reproducible, - but this is hardware that belongs to another team15:15
rlandyso their setup may vary15:15
rlandyykarel: I have not yet rerun the deployment if you want to look at the undercloud15:16
*** aedc has quit IRC15:16
ykarel|awayrlandy, so u have access to the nodes15:16
ykarel|awaythen it would good to run the same step which failed15:16
ykarel|awayand it will clear the current issue15:16
*** dsneddon has quit IRC15:17
ykarel|awayrlandy, Run puppet host configuration for step 3 step failed for controller15:17
rlandyykarel|away: ack - I do15:17
ykarel|awayrlandy, ack then let me have access, i can check if i can find the issue quickly15:19
rlandygetting15:19
openstackgerritMerged openstack/tripleo-upgrade stable/queens: Add support for network-data-file.  https://review.opendev.org/66274115:20
*** xek has quit IRC15:23
*** dsneddon has joined #tripleo15:26
*** nkinder has quit IRC15:28
openstackgerritGiulio Fidente proposed openstack/puppet-tripleo master: Allow external Ganesha for the cephfs manila backend  https://review.opendev.org/66207415:31
*** dasp has quit IRC15:35
*** sanjayu_ has quit IRC15:36
*** chandankumar is now known as raukadah15:43
*** marios_|ruck has quit IRC15:44
*** marios has quit IRC15:44
*** zbr has quit IRC15:47
*** bogdando has quit IRC15:49
openstackgerritMerged openstack/tripleo-ui master: Retiring TripleO-UI  https://review.opendev.org/66111315:51
EmilienMadios15:51
*** ansmith has joined #tripleo15:51
*** yprokule has quit IRC15:52
*** dasp has joined #tripleo15:53
*** zbr has joined #tripleo15:55
openstackgerritEmilien Macchi proposed openstack/puppet-tripleo master: Introduce tripleo::config  https://review.opendev.org/66072615:56
*** ykarel|away has quit IRC15:56
openstackgerritAlex Schultz proposed openstack/tripleo-ci master: WIP: Add multinode minion job  https://review.opendev.org/66235016:10
openstackgerritAlex Schultz proposed openstack/tripleo-quickstart master: Add single minion node config  https://review.opendev.org/66234916:10
*** ansmith_ has joined #tripleo16:14
*** dtantsur is now known as dtantsur|afk16:15
*** ansmith has quit IRC16:17
*** tesseract has quit IRC16:27
*** cylopez has quit IRC16:28
*** rpittau is now known as rpittau|afk16:28
*** ayoung has joined #tripleo16:29
*** panda has quit IRC16:35
cloudnullweshay (or anyone else)\ do you by chance have a moment to go over using the reproducer tools?16:35
cloudnullRE: 08:05 <cloudnull> was looking into what is causing http://logs.openstack.org/80/662580/1/check/tripleo-ci-centos-7-scenario001-standalone/a4cc78e/logs/undercloud/home/zuul/standalone_deploy.log.txt.gz#_2019-06-01_16_31_45 and if I can try out the reproducer scripts to figure it out16:35
*** panda has joined #tripleo16:37
openstackgerritLuke Short proposed openstack/tripleo-common master: WIP: Add Molecule tests to tripleo-create-admin role.  https://review.opendev.org/66257716:38
openstackgerritLuke Short proposed openstack/tripleo-common master: Add common files that will be used across Molecule tests.  https://review.opendev.org/66280316:38
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: Introduce param_config interface  https://review.opendev.org/66109316:40
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: Glance: wire param_config  https://review.opendev.org/66079116:40
*** holser_ has quit IRC16:52
*** morazi has quit IRC16:55
*** gfidente is now known as gfidente|afk16:55
*** jpena is now known as jpena|off17:04
sshnaidm|offcloudnull, did you try? http://logs.openstack.org/80/662580/1/check/tripleo-ci-centos-7-undercloud-containers/db130a0/logs/reproducer-quickstart/reproducer-zuul-based-quickstart.sh17:08
mnaserEmilienM: we spoke about validations a while ago. I was wondering if they are meant to run pre-deploy, or if they are okay with running post-deploy too?17:08
sshnaidm|offcloudnull, the workflow is described here: http://logs.openstack.org/80/662580/1/check/tripleo-ci-centos-7-undercloud-containers/db130a0/logs/README-reproducer.html17:09
sshnaidm|offcloudnull, but basically you need to download http://logs.openstack.org/80/662580/1/check/tripleo-ci-centos-7-undercloud-containers/db130a0/logs/reproducer-quickstart/reproducer-zuul-based-quickstart.sh and http://logs.openstack.org/80/662580/1/check/tripleo-ci-centos-7-undercloud-containers/db130a0/logs/reproducer-quickstart/reproducer-zuul-based-quickstart.tar17:09
sshnaidm|offcloudnull, to put them in one folder and to run shell script17:09
*** jfrancoa has quit IRC17:18
cloudnullsshnaidm|off oh cool! I will give that a go now.17:19
cloudnull8core/8GiB RAM/90GiB storage should be enough to make that go ?17:19
sshnaidm|offcloudnull, it should create 8GB swap, so yeah17:20
sshnaidm|offcloudnull, but better to increase ram..17:21
weshaycloudnull sshnaidm|off my last pass required ansible 2.8 in the ansible-role-tripleo-reproducer requirements on centos-717:21
weshaysshnaidm|off we need jobs running in periodic not just check for the repro17:21
weshaysshnaidm|off let's chat about it tomorrow17:21
sshnaidm|offweshay, ack17:21
* weshay needs to setup something w/ you and arx we can cover it then17:22
*** rlandy has quit IRC17:22
weshaywould also love to drop docker, /me needs more input on the why we still need it17:22
*** amoralej is now known as amoralej|off17:22
*** rlandy has joined #tripleo17:22
sshnaidm|offweshay, unlike podman it's stable and works on all platforms17:23
sshnaidm|offit can be a reliable failover in case something wrong with podman17:24
weshayah.. ya.. we may need to narrow support for the reproducer platform17:24
weshaynot sure17:24
sshnaidm|offweshay, for example, it doesn't work on f2817:24
weshayya.. I think we can drop f28 at this point17:24
sshnaidm|offweshay, it will be very narrow.. :)17:24
weshay:)17:25
sshnaidm|offweshay, why to limit devs to use reproducer? It doesn't cost us anything to support docker17:25
sshnaidm|offit's already there and works, even cli almost the same17:26
weshaywell... we want a tight / good user experience. It's hard to keep everything working well all the time17:31
EmilienMmnaser: post deploy should work17:32
weshaysshnaidm|off are you back tomorrow?17:32
sshnaidm|offweshay, no, in Wed17:33
weshayk17:33
*** florianf has quit IRC17:33
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: Use ansible for AllNodesDeployment  https://review.opendev.org/65914817:34
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: Remove deployed-server bootstrap resource  https://review.opendev.org/66022117:35
*** Vorrtex has quit IRC17:38
*** udesale has quit IRC17:41
mnaserEmilienM: ok neat, there was somethings I wanted to do and I think it would fit nicely there17:44
openstackgerritDavid Peacock proposed openstack/python-tripleoclient master: WIP - Implement tripleo container image list command  https://review.opendev.org/64961917:53
*** morazi has joined #tripleo17:55
*** pbandark has quit IRC17:56
openstackgerritEmilien Macchi proposed openstack/puppet-tripleo master: Prepare glance-api to be refactored  https://review.opendev.org/66137718:12
*** cfontain has joined #tripleo18:15
*** radeks_ has joined #tripleo18:19
openstackgerritEmilien Macchi proposed openstack/puppet-tripleo master: Introduce tripleo::config  https://review.opendev.org/66072618:22
*** radeks has quit IRC18:22
openstackgerritEmilien Macchi proposed openstack/puppet-tripleo master: Prepare glance-api to be refactored  https://review.opendev.org/66137718:22
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: Introduce param_config interface  https://review.opendev.org/66109318:22
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: Glance: wire param_config  https://review.opendev.org/66079118:22
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: WIP - Use Ansible for {{server_resource_name}}Config  https://review.opendev.org/66247218:23
*** ramishra has quit IRC18:26
openstackgerritJohn Fulton proposed openstack/tripleo-heat-templates master: Warn if ceph health is not OK before proceeding  https://review.opendev.org/65717518:26
*** ansmith has joined #tripleo18:30
*** ansmith_ has quit IRC18:31
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: WIP - Use Ansible for {{server_resource_name}}Config  https://review.opendev.org/66247218:41
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: WIP - Use Ansible to configure the Hiera config  https://review.opendev.org/66256218:42
*** altlogbot_3 has quit IRC18:43
*** altlogbot_0 has joined #tripleo18:45
*** kopecmartin is now known as kopecmartin|off18:47
openstackgerritJohn Fulton proposed openstack/tripleo-heat-templates master: Warn if ceph health is not OK before proceeding  https://review.opendev.org/65717518:48
*** ansmith has quit IRC18:51
openstackgerritMerged openstack/tripleo-puppet-elements stable/stein: Add upper constraints  https://review.opendev.org/66275219:01
*** radeks__ has joined #tripleo19:01
*** radeks_ has quit IRC19:04
*** dsneddon has quit IRC19:07
*** altlogbot_0 has quit IRC19:21
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: WIP - Use Ansible for {{server_resource_name}}Config  https://review.opendev.org/66247219:22
*** altlogbot_2 has joined #tripleo19:27
*** dsneddon has joined #tripleo19:31
*** dsneddon has quit IRC19:37
*** cfontain has quit IRC19:40
openstackgerritAlex Schultz proposed openstack/tripleo-heat-templates master: Remove tripleo-ui references  https://review.opendev.org/66284419:54
*** hamzy_ has joined #tripleo20:06
*** radeks__ has quit IRC20:07
*** mugsie_ has joined #tripleo20:09
*** evrardjp_ has joined #tripleo20:09
*** BlackDex_ has joined #tripleo20:11
*** jcoufal has quit IRC20:11
*** dsneddon has joined #tripleo20:12
*** ayoung has quit IRC20:15
*** BlackDex has quit IRC20:15
*** hamzy has quit IRC20:15
*** mugsie has quit IRC20:15
*** evrardjp has quit IRC20:15
*** jtomasek has quit IRC20:16
*** radeks has joined #tripleo20:17
*** ayoung has joined #tripleo20:20
*** cfontain has joined #tripleo20:23
*** khyr0n has quit IRC20:26
*** Vorrtex has joined #tripleo20:31
*** abishop has quit IRC20:39
openstackgerritAlex Schultz proposed openstack/tripleo-quickstart-extras master: Move 'extra_tht_configs' tasks to overcloud-deploy role  https://review.opendev.org/62147320:40
*** altlogbot_2 has quit IRC20:45
*** Goneri has quit IRC20:49
*** ansmith has joined #tripleo20:50
openstackgerritJohn Fulton proposed openstack/tripleo-validations master: Update ceph-health to work with containers  https://review.opendev.org/65717320:51
*** bfournie has quit IRC20:52
*** slaweq has quit IRC20:52
*** jbadiapa has quit IRC20:52
openstackgerritJohn Fulton proposed openstack/tripleo-heat-templates master: Warn if ceph health is not OK before proceeding  https://review.opendev.org/65717520:52
openstackgerritJohn Fulton proposed openstack/tripleo-validations master: Update ceph-health to work with containers  https://review.opendev.org/65717320:55
openstackgerritJohn Fulton proposed openstack/tripleo-validations master: Update ceph-health to work with containers  https://review.opendev.org/65717320:56
openstackgerritMichele Baldessari proposed openstack/puppet-tripleo master: Make sure we pass the proper new pcs 0.10 variables  https://review.opendev.org/66034520:56
*** ansmith has quit IRC20:57
openstackgerritJohn Fulton proposed openstack/tripleo-heat-templates master: Warn if ceph health is not OK before proceeding  https://review.opendev.org/65717520:58
*** radeks has quit IRC21:03
*** rlandy is now known as rlandy|brb21:04
mnaserhmm21:06
mnaseris there any efforts to take the tripleo-validations and make them separate roles21:06
mnaserinstead of a bunch of playbooks+roles .. so they can be consumed?21:06
*** pcaruana has quit IRC21:07
fultonjmnaser: there are efforts to consume the tripleo-validations roles regardless of the tripleo-validtails playbooks21:08
fultonjs/validtails/validations21:09
mnaserfultonj: cool, cause right now the tough part is that they're all inside roles/ so consuming them as ansible standalone roles is a bit tricky21:09
mnaserbut then there's complications of repo explosion around that, so I dunno21:09
fultonjmnaser: yeah, there is repo explosion21:09
fultonjmnaser: e.g. i'm working on consuming the role here https://review.opendev.org/#/c/657175/9/deployment/ceph-ansible/ceph-base.yaml21:10
fultonjnow tht itself has embded anwsible which may get moved out to tripleo-ansible21:10
mnaserright, I'm trying to consume it in my own deployments (that aren't even done using tripleo) for things where we want to validate/ensure kernel versions, etc21:11
fultonjmnaser: perhaps the new tripleo-ansible squad will help the organization21:11
mnaserthings like "does this server have X" or something21:11
fultonjthere's ansible already in tripleo-common, tripleo-validations, tripleo-heat-templates21:12
mnaserthings like "is there enough space" is very much something we should probably all keep a same version of21:12
mwhahahamnaser: Tengu would be the person to ask about that effort tomorrow.21:12
mwhahahai know he would like to offer more generic things but it's still TBD21:12
mnasergotcha21:12
*** rlandy|brb is now known as rlandy21:18
*** slaweq has joined #tripleo21:20
*** raildo has quit IRC21:20
*** slaweq has quit IRC21:25
*** mcornea has quit IRC21:29
*** khyr0n has joined #tripleo21:34
*** sshnaidm|off has quit IRC21:34
*** sshnaidm has joined #tripleo21:40
openstackgerritAlex Schultz proposed openstack/tripleo-heat-templates master: Set TenantNetPhysnetMtu to 0 to allow different MTUs  https://review.opendev.org/66286321:40
*** sshnaidm is now known as sshnaidm|off21:41
*** Goneri has joined #tripleo21:47
openstackgerritEmilien Macchi proposed openstack/puppet-tripleo master: Introduce tripleo::config  https://review.opendev.org/66072621:47
openstackgerritEmilien Macchi proposed openstack/puppet-tripleo master: Prepare glance-api to be refactored  https://review.opendev.org/66137721:47
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: Introduce param_config interface  https://review.opendev.org/66109321:49
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: Glance: wire param_config  https://review.opendev.org/66079121:49
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates stable/stein: Add DPDK support for OVN  https://review.opendev.org/66209121:54
*** cfontain has quit IRC21:55
*** cfontain has joined #tripleo21:56
*** rcernin has joined #tripleo21:58
openstackgerritAlex Schultz proposed openstack/tripleo-docs master: Fix dib yum repos for ceph and stable versions  https://review.opendev.org/66286722:08
*** ansmith has joined #tripleo22:10
openstackgerritAlex Schultz proposed openstack/tripleo-docs master: Fix dib yum repos for ceph and stable versions  https://review.opendev.org/66286722:11
*** rh-jelabarre has quit IRC22:19
*** sai_p__ has joined #tripleo22:20
*** aakarsh has quit IRC22:24
openstackgerritSteve Baker proposed openstack/python-tripleoclient master: Drop the port from DockerInsecureRegistryAddress  https://review.opendev.org/66233222:40
mwhahahacloudnull: if you set_fact in ansible, is it scoped to a single host? ie i set_fact on node-a, node-b wont' know about it?22:42
openstackgerritMerged openstack/tripleo-quickstart-extras master: Replace dict combine in standalone containers-prepare-parameters  https://review.opendev.org/65979422:43
cloudnullit is scoped to the host however you can get to is via hostvars, something like `{{ hostvars['nodea']['somefact'] }}`22:45
mwhahahayea that seems to be what i wandered across on the internets22:47
mwhahahai shall try that22:47
cloudnullit works ok.22:48
cloudnullyou can also set local facts in an ini like file which can be used later.22:48
openstackgerritAlex Schultz proposed openstack/tripleo-quickstart-extras master: WIP: Undercloud minion role  https://review.opendev.org/66234322:48
mwhahahawell i'm trying to slurp up the facts from the playbook execution on one host and then use them to output on the second host22:49
cloudnulldepending on what the facts are one may be better than the other.22:49
*** aakarsh has joined #tripleo22:49
cloudnullhostvars is probably your best bet22:49
mwhahahahttps://review.opendev.org/#/c/662343/5/roles/undercloud-deploy/tasks/gather-outputs.yml and https://review.opendev.org/#/c/662343/5/playbooks/multinode-undercloud-minion.yml@1822:49
mcardenHi cloudnull. Enjoying the new gig? I see mrda has gone over there as well.22:51
*** tkajinam has joined #tripleo22:52
cloudnullmwhahaha ++ we did something similar in OSA which used the first host in the playbook run to generate the facts, then all other hosts would refer to the hostvars of that known node to populate the data.22:53
cloudnullmcarden OHAI !22:53
cloudnullhow you been ?22:53
cloudnullthe new gig has been great so far (its only week 3 but I'm loving it)22:54
mcardenPretty good. Been doin' the RHOSP13 thing for quite a while now. How's you been?22:54
cloudnullstill getting my sea legs but doing well22:54
openstackgerritAlex Schultz proposed openstack/tripleo-quickstart master: Add single minion node config  https://review.opendev.org/66234922:55
openstackgerritAlex Schultz proposed openstack/tripleo-docs master: Fix dib yum repos for ceph and stable versions  https://review.opendev.org/66286722:55
mcardenGlad to know you're there. You can fix All The Things for us. :)22:55
cloudnullyou just let me know !)22:55
mcardenHeh.22:55
mcardenOnce you've converted tripleo to be OSA, all will be well. :P22:56
mwhahahapffft22:57
* mcarden takes his troll hat off.22:57
* cloudnull hides head in the sand 22:57
* mwhahaha puts his hat on22:58
mwhahahatemplate files are a great way to manage configs22:58
* mwhahaha takes his hat off22:58
cloudnullmcarden so mrda is coming over too ? that's awesome ! so when you making the move?22:59
cloudnull:D22:59
mcardenHeh. AFAIK, mrda's Day1 was yesterday. Rest of us sitting back & watching how Red + Blue works out.23:00
*** zbr has quit IRC23:00
*** sanjayu_ has joined #tripleo23:02
cloudnullnice, I'll have to ping mrda to see where he's at23:02
mcardenMeanwhile, me, csmart and neiilc are stackin' for one of the bigger clients of both the red and the blue in this corner of the world.23:03
cloudnullnice that's super cool!23:03
cloudnullall rocking OSP13?23:03
cloudnullthat's awesome that you all are working together btw23:04
mcardenYeah, we kinda hired on as a team after the Rack. And yep, lots of OSP13 on lots of machines x86 and PPCLE in a coupla DCs.23:05
cloudnullthats sweet!23:08
*** squarelab has joined #tripleo23:09
mcardenTemplate files eh? Our current 'overcloud deploy' command has 43 yaml files passed to it (on top of what's in the default tripleo-heat-templates directory). Whee!23:10
squarelabHey all, looking for someone to answer some questions about tripleO and RDO. Looking to replace our current oVirt cluster.23:10
openstackgerritAlex Schultz proposed openstack/python-tripleoclient master: Remove tripleo-ui items from the undercloud install  https://review.opendev.org/66287323:11
cloudnullo/ squarelab I may not be of much help but what are you looking for?23:11
openstackgerritAlex Schultz proposed openstack/tripleo-heat-templates master: Remove tripleo-ui references  https://review.opendev.org/66284423:11
squarelabWe have 3 nodes HA oVirt hyperconverged. Is it a good idea at all, to consider openstack RDO deployed hyperconverged (Compute, data + network) on the same 3 nodes23:12
squarelabAll-in-one HA 3 node RDO ?23:12
*** Vorrtex has quit IRC23:12
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: WIP - Use Ansible for {{server_resource_name}}Config  https://review.opendev.org/66247223:12
mwhahahait might be depending on your use case really23:13
* cloudnull ^ Whoo, saved by an adult 23:14
* mwhahaha defaults to "maybe"23:14
cloudnullis a fan of words like "should" and "maybe"23:15
squarelabmwhahaha It's our local development infractructure, used to host our k8s clusters, and some infrastructure VM's too (AD, DHCP, and other vms..)23:15
cloudnullsquarelab is that for a POC?23:15
squarelabIt's for a stable development environment23:15
mwhahahaa 3 node hci isn't unheard off23:16
mwhahahabut it really depends on your hardware & limitations23:16
mwhahahathe issue comes when you try to update/upgrade as you'll have to be careful when you need to live migrate vms (if you need to)23:17
squarelab3x R620 DELL , Dual 10G, 6x1TB SSD's with 20 Cores per node23:17
mwhahahahaving a seperate control plane is safer for numerous reasons but if you really can't do more than 3 systems, it's viable23:17
squarelabOk so, one additionnal node to act as a controller, and 3 other nodes as Compute/data/network roles ?23:19
squarelabSo 4 controlers, 3 data , 3 network nodes. 4 nodes total.23:19
mwhahahawell then that is no longer HA23:19
mwhahahayou can only do 3 controllers23:19
squarelabHA!23:19
mwhahahaif it's for dev infrastructure you can probably survive23:20
mwhahahausually you can schedule downtime outside of business hours23:20
squarelabYes.23:20
cloudnullfor a development environment I'd probably gravitate toward 1 controller N computes, and then grow the environment to 3 controllers for full HA when that becomes mission critical23:20
EmilienMyes^23:21
mwhahahai'm not sure we've really tested going from 1 -> 3 controllers in tripleo, i've heard claims it "works"23:21
squarelabOk would be a better setup to no-ha controllers and have 3 nodes with compute + data23:21
EmilienMmwhahaha: yeah I think it's tested (scale out)23:21
EmilienMmwhahaha: however I suggest using pacemaker and not keepalived (as we'll remove it soon)23:22
*** dsneddon has quit IRC23:22
mwhahahayea you'd want to include the ha files to enable pacemaker if you plan on possibly scaling out23:22
cloudnulldepending on network topology you shouldnt loose connectivity if the controller goes down (like when using vlan provider networks and static addresses) but a lot of blast radius of OpenStack falls into "it depends"23:23
mwhahahaso docker-ha.yaml but ControllerCount: 123:23
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: WIP - Use Ansible for {{server_resource_name}}Config  https://review.opendev.org/66247223:23
cloudnullhowever take my comments with many grains of salt, I'm happy to help figure things out but I am new to Tripleo and may be less than helpful at this point when it comes to some of these best practices within the project.23:25
*** dsneddon has joined #tripleo23:26
openstackgerritDan Sneddon proposed openstack/os-net-config stable/stein: Add missing unit-test for IbInterface ethtool opts  https://review.opendev.org/66287823:32
openstackgerritSteve Baker proposed openstack/tripleo-common master: Transfer all images in a manifest list  https://review.opendev.org/66233723:34
openstackgerritDan Sneddon proposed openstack/os-net-config stable/rocky: Add missing unit-test for IbInterface ethtool opts  https://review.opendev.org/66287923:36
openstackgerritDan Sneddon proposed openstack/os-net-config stable/queens: Add missing unit-test for IbInterface ethtool opts  https://review.opendev.org/66288023:38
*** rcernin has quit IRC23:43
*** rcernin has joined #tripleo23:44
openstackgerritSteve Baker proposed openstack/tripleo-heat-templates master: Revert "Revert "Switch off nova metadata api on the undercloud""  https://review.opendev.org/65870623:49
openstackgerritEmilien Macchi proposed openstack/puppet-tripleo master: Introduce tripleo::config  https://review.opendev.org/66072623:50
openstackgerritEmilien Macchi proposed openstack/puppet-tripleo master: Prepare glance-api to be refactored  https://review.opendev.org/66137723:50
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: Introduce param_config interface  https://review.opendev.org/66109323:50
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: Glance: wire param_config  https://review.opendev.org/66079123:51

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!