Wednesday, 2018-12-19

*** wolverineav has joined #tripleo00:01
*** brault has joined #tripleo00:03
*** wolverineav has quit IRC00:05
*** brault has quit IRC00:07
*** itlinux has joined #tripleo00:08
openstackgerritMerged openstack/tripleo-heat-templates stable/rocky: Mount config-data/puppet-generated/nova for nova_api_ensure_default_cell  https://review.openstack.org/62313800:17
*** rlandy has quit IRC00:18
*** itlinux has quit IRC00:28
*** itlinux has joined #tripleo00:28
*** itlinux has quit IRC00:29
*** quiquell|off has quit IRC00:29
*** fragatina has joined #tripleo00:40
*** PagliaccisCloud has joined #tripleo00:41
*** PagliaccisCloud has quit IRC00:48
*** itlinux has joined #tripleo01:12
*** wolverineav has joined #tripleo01:18
*** wolverineav has quit IRC01:23
*** hjensas has joined #tripleo01:59
*** weshay_pto has quit IRC02:18
*** wolverineav has joined #tripleo02:33
*** wolverineav has quit IRC02:34
*** wolverin_ has joined #tripleo02:34
*** itlinux has quit IRC02:40
*** tzumainn has quit IRC02:48
openstackgerritMerged openstack-infra/tripleo-ci master: Remove tripleo-ci-centos-7-3nodes-multinode job  https://review.openstack.org/60970802:49
openstackgerritMerged openstack/tripleo-common stable/rocky: Move Octavia config opts to common config directory  https://review.openstack.org/62430402:55
openstackgerritMerged openstack/tripleo-heat-templates stable/queens: Remove nic for storage_mgt network  https://review.openstack.org/62456302:55
openstackgerritMerged openstack/tripleo-validations stable/rocky: Fix the ironic_inspector config file in the switch-vlans validation  https://review.openstack.org/62527202:55
*** psachin has joined #tripleo02:58
*** mschuppert has quit IRC03:00
*** mrsoul has quit IRC03:00
*** dmacpher has quit IRC03:08
*** dmacpher has joined #tripleo03:09
*** apetrich has quit IRC03:15
*** hjensas has quit IRC03:25
openstackgerritAlex Schultz proposed openstack/puppet-tripleo master: remove ssh from tripleo::firewall::pre  https://review.openstack.org/58243703:40
mwhahahasshnaidm|off, marios_|ruck: possible tempest conf problem? http://logs.openstack.org/94/624994/3/gate/tripleo-ci-centos-7-containers-multinode/d587461/logs/undercloud/home/zuul/tempest.log.txt.gz#_2018-12-19_02_25_5803:43
*** brault has joined #tripleo04:05
*** wolverin_ has quit IRC04:06
*** brault has quit IRC04:09
*** chkumar|out is now known as chandankumar04:12
*** wolverineav has joined #tripleo04:13
*** wolverineav has quit IRC04:13
*** slaweq has quit IRC04:13
*** udesale has joined #tripleo04:14
*** wolverineav has joined #tripleo04:14
*** cfontain has joined #tripleo04:14
*** wolverineav has quit IRC04:18
*** cfontain has quit IRC04:21
*** ykarel has joined #tripleo04:22
*** boazel_ has joined #tripleo04:25
*** boazel has quit IRC04:28
*** janki has joined #tripleo04:48
*** evrardjp_ has joined #tripleo05:04
*** evrardjp has quit IRC05:07
openstackgerritMerged openstack/tripleo-heat-templates master: flatten tuned service configuration  https://review.openstack.org/62532305:18
openstackgerritMerged openstack/tripleo-heat-templates master: flatten tripleo-firewall service configuration  https://review.openstack.org/62532405:18
openstackgerritMerged openstack/tripleo-validations stable/rocky: Fix neutron-sanity-check validations  https://review.openstack.org/62570305:18
*** ykarel has quit IRC05:24
openstackgerritMerged openstack/tripleo-common stable/rocky: Activate remaining set of healthchecks  https://review.openstack.org/61230405:29
openstackgerritMerged openstack/tripleo-common master: Better surface the error status and message when there is a failure  https://review.openstack.org/61733005:29
*** saneax has joined #tripleo05:31
*** ykarel has joined #tripleo05:36
*** udesale has quit IRC05:45
*** saneax has quit IRC05:48
*** udesale has joined #tripleo05:49
*** saneax has joined #tripleo05:50
*** saneax has quit IRC05:51
*** saneax has joined #tripleo05:53
*** saneax has quit IRC05:55
*** evrardjp has joined #tripleo06:00
*** evrardjp_ has quit IRC06:03
*** ratailor has joined #tripleo06:04
*** ratailor has quit IRC06:04
*** ratailor has joined #tripleo06:05
*** ratailor has quit IRC06:06
*** wolverineav has joined #tripleo06:12
*** wolverineav has quit IRC06:21
*** hjensas has joined #tripleo06:26
*** hjensas has quit IRC06:27
*** fragatina has quit IRC06:27
*** fragatina has joined #tripleo06:28
*** hjensas has joined #tripleo06:29
openstackgerritMerged openstack/python-tripleoclient stable/rocky: Don't exit on RUNNING status on delete  https://review.openstack.org/62571306:33
*** mgagne has quit IRC06:35
*** fragatina has quit IRC06:35
*** fragatina has joined #tripleo06:36
*** mgagne has joined #tripleo06:40
Tenguhello there06:42
*** fultonj has quit IRC06:42
*** ianw is now known as ianw_pto06:43
*** fultonj has joined #tripleo06:47
openstackgerritMerged openstack/python-tripleoclient master: Fix stack.name to stack.stack_name  https://review.openstack.org/62567506:53
openstackgerritMerged openstack/tripleo-quickstart master: Remove developer tools from tripleo .gitignore  https://review.openstack.org/61558906:53
openstackgerritMerged openstack/tripleo-heat-templates master: Rename tripleo-ci-centos-7-scenario00{6,9}-multinode-oooq  https://review.openstack.org/61983106:53
openstackgerritMerged openstack/tripleo-heat-templates master: Add config files/templates to integrate nsx plugin with container  https://review.openstack.org/60505606:54
openstackgerritMerged openstack/tripleo-heat-templates stable/rocky: Fix horizon's iptables rules for haproxy when split off a separate role  https://review.openstack.org/62559806:54
*** hberaud|gone has quit IRC06:54
openstackgerritMerged openstack/tripleo-heat-templates stable/rocky: Allow to skip docker reconfiguration during stack update  https://review.openstack.org/62495306:54
*** PagliaccisCloud has joined #tripleo06:55
*** ksambor has joined #tripleo06:59
*** fragatina has quit IRC07:01
*** fragatina has joined #tripleo07:01
*** mschuppert has joined #tripleo07:02
openstackgerritOpenStack Proposal Bot proposed openstack/tripleo-ui stable/rocky: Imported Translations from Zanata  https://review.openstack.org/62515807:03
*** hakhande_ has joined #tripleo07:11
*** paramite has joined #tripleo07:11
*** brault has joined #tripleo07:12
*** boazel_ has quit IRC07:13
*** quiquell has joined #tripleo07:13
*** boazel has joined #tripleo07:14
*** brault has quit IRC07:14
*** wolverineav has joined #tripleo07:20
*** wolverineav has quit IRC07:20
*** wolverineav has joined #tripleo07:20
*** ratailor has joined #tripleo07:21
openstackgerritHarald Jensås proposed openstack/tripleo-heat-templates master: Remove unused jinja code in network-isolation environment  https://review.openstack.org/62574807:28
*** avivgt has joined #tripleo07:28
*** holser_ has joined #tripleo07:30
*** aufi has joined #tripleo07:30
*** ykarel is now known as ykarel|lunch07:34
*** ccamacho has joined #tripleo07:40
*** moshele has joined #tripleo07:43
*** dciabrin has quit IRC07:45
*** waleedm has joined #tripleo07:45
*** wolverineav has quit IRC07:46
*** saneax has joined #tripleo07:49
*** HardCase has quit IRC07:53
*** agurenko has joined #tripleo07:58
openstackgerritRedHat RDO CI proposed openstack/tripleo-heat-templates stable/queens: GATE CHECK for TripleO  https://review.openstack.org/56722408:00
*** slaweq has joined #tripleo08:00
openstackgerritRedHat RDO CI proposed openstack/tripleo-heat-templates master: GATE CHECK for TripleO  https://review.openstack.org/60429808:00
openstackgerritRedHat RDO CI proposed openstack/tripleo-heat-templates stable/rocky: GATE CHECK for TripleO  https://review.openstack.org/60429308:00
*** tosky has joined #tripleo08:02
*** pcaruana has joined #tripleo08:03
*** jfrancoa has joined #tripleo08:07
*** gkadam has joined #tripleo08:11
*** jtomasek has joined #tripleo08:11
quiquelljfrancoa: Can you help us to merge this https://review.openstack.org/#/c/624656/ ? it's neede to have f28 jobs running08:16
quiquelljfrancoa: good morning btw08:17
therve_(çé''08:20
quiquelltherve: hello there08:21
therveHeh08:22
*** pcaruana has quit IRC08:24
bandinianyone around for a simple one? https://review.openstack.org/#/c/621660/08:24
*** shardy has joined #tripleo08:25
openstackgerritSurya Prakash (spsurya) proposed openstack/tripleo-validations master: dict_object.keys() is not required for *in* operator  https://review.openstack.org/62611408:27
paramiteHey guys, can we please move on with https://review.openstack.org/#/c/620402 ?08:28
*** amoralej|off is now known as amoralej08:29
bandiniparamite: done08:31
*** dciabrin_ has joined #tripleo08:31
paramitebandini, thanks!08:31
EmilienMmarios: hey good morning08:33
EmilienMmarios: https://review.openstack.org/#/c/625256/ should be fine now (did recheck for other issues though)08:33
*** pcaruana has joined #tripleo08:33
quiquellEmilienM: o/08:33
quiquellEmilienM: Can you help workflowing f28 fix after activating container prep https://review.openstack.org/#/c/624656/08:34
quiquellEmilienM: it has +2 and +1 zuul08:34
EmilienMquiquell: of course, let me see no08:34
EmilienMnow08:34
quiquellEmilienM: appreciate, also this is related it has +2 and +1zuul too https://review.openstack.org/#/c/625513/08:35
quiquellthat's all08:35
openstackgerritMartin Mágr proposed openstack/tripleo-heat-templates stable/rocky: Enable health check for OVN containers  https://review.openstack.org/61237408:35
openstackgerritMartin Mágr proposed openstack/tripleo-heat-templates stable/rocky: Enable ceilometer-agent-compute health check  https://review.openstack.org/61237208:35
EmilienMso demanding :P08:36
openstackgerritMartin Mágr proposed openstack/tripleo-heat-templates stable/rocky: Enable Sahara API health check  https://review.openstack.org/61237008:36
openstackgerritMartin Mágr proposed openstack/tripleo-heat-templates stable/rocky: Enable neutron-sriov-agent health check  https://review.openstack.org/61236908:36
quiquellEmilienM: That would be my christmas presents :-), thanks08:36
openstackgerritMartin Mágr proposed openstack/tripleo-heat-templates stable/rocky: Enable health check for Ironic inspector services  https://review.openstack.org/61237108:36
openstackgerritMartin Mágr proposed openstack/tripleo-heat-templates stable/rocky: Enable fluentd health check  https://review.openstack.org/61237308:36
quiquellfrom zuul noel08:36
EmilienMok done then :)08:36
*** ykarel|lunch is now known as ykarel08:37
*** agurenko has quit IRC08:37
jfrancoaquiquell: good morning sir08:37
marios_|rucko/ EmilienM yeah i saw that thanks but i think there is something more needed (sec on phone)08:37
quiquelljfrancoa: hello there, found some help around with the issue already08:37
EmilienMmarios_|ruck: yeah? what? no prob take time08:37
quiquelljfrancoa: btw, is this still needed ? https://review.openstack.org/#/c/604032/08:37
quiquelljfrancoa: Or are you already covering it ?08:38
jfrancoaquiquell: well...the idea is getting rid of multinode jobs right? so then it doesn't make too much sense anymore...unless I'm missing something08:38
quiquelljfrancoa: Ahh right, you mean just having standalone upgrades and all08:39
quiquelljfrancoa: yep let's the standalone transition settles then we can do upgrades cleanup at CI08:39
quiquelljfrancoa: but I suppose we still have Third Party at RDO running mixed_upgrades ?08:40
*** brault has joined #tripleo08:40
*** brault has quit IRC08:41
*** pcaruana has quit IRC08:41
*** brault has joined #tripleo08:41
*** agurenko has joined #tripleo08:41
marios_|ruckEmilienM: so fine we just add the -wsgi in https://review.openstack.org/#/c/625256/ and we don't need to change the image name in tht (abandoning https://review.openstack.org/#/c/625259/2 now)08:41
marios_|ruckEmilienM: (see pvt too please)08:42
jfrancoaquiquell: yes, anyway, it would be really nice to have some job  (maybe in rdo cloud) running a full upgrade, but that might imply a tone of work...let's leave the patches there and I'll try to work on it after the shutdown08:42
jfrancoaquiquell: I think last time I checked rdo mixed_upgrades only the updates job was working08:43
quiquelljfrancoa: ack, I will be around too so you can ping me if help is needed there08:44
jfrancoaquiquell: great, I'll do. it might be a very good moment to resurrect the upgrade jobs08:45
*** kopecmartin|off is now known as kopecmartin08:45
ykarelEmilienM, looks like still something is missing with the zaqar-wsgi image08:46
ykarelEmilienM, skopeo inspect docker://docker.io/tripleomaster/centos-binary-zaqar:d8bae7b99708a308fb52ec13ae71f5a5f42a0a5d_e972080c vs skopeo inspect docker://docker.io/tripleomaster/centos-binary-zaqar-wsgi:d8bae7b99708a308fb52ec13ae71f5a5f42a0a5d_e972080c08:47
*** jpena|off is now known as jpena08:47
ykareliirc it should be pulled using hash08:47
EmilienMlet me look08:48
ykarelack08:49
EmilienMunable to pull docker.io/tripleomaster/centos-binary-zaqar-wsgi08:51
*** rcernin has quit IRC08:51
marios_|ruckquiquell: please recheck https://review.openstack.org/#/c/604768/ added a comment last night08:51
EmilienMon my env, maybe it's just me08:51
EmilienMykarel: ^08:51
ykarelEmilienM, even with current-tripleo tag?08:51
EmilienMykarel: it works with it08:52
EmilienMlet me see the inspect08:52
ykarelcurrent-tripleo should work, i am talking about current-tripleo hash d8bae7b99708a308fb52ec13ae71f5a5f42a0a5d_e972080c08:53
quiquellmarios_|ruck: You have to move their standalone-upgrade task to extra-tags and remove the "standalone" tags now we can contatenate both08:54
quiquells/task/tag/08:54
EmilienMykarel: it sounds like the tags are missing08:54
marios_|ruckquiquell: but their tag in on the featureset08:54
ykarelyup08:54
ykarelEmilienM, how image was pushed there and who did that08:54
EmilienMall RepoTags actually08:54
EmilienMykarel: by using "docker cp"08:54
ykarelgenerally both images(tag and hash) are pushed when we do promotion08:55
quiquellmarios_|ruck: standalone_upgrade is not a tag08:55
marios_|ruckquiquell: this is about moving the extra tags from toci_gate_test.sh08:55
quiquellmarios_|ruck: it's just a fs attribute08:55
quiquellmarios_|ruck: standalone-upgrae is a tag used with ansible --tag mechanism08:56
marios_|ruckquiquell: yes i understand this but this isn't about 'move all tags to jobs'08:56
quiquellmarios_|ruck: but also adapting new jobs to work with it08:56
EmilienMthere is something we could do otherwise, is using docker save and docker load08:56
quiquellmarios_|ruck: bj ?08:56
ykarelEmilienM, so if u see here http://38.145.34.55/rocky.log Tag and push images08:56
marios_|ruckquiquell: this is about " Removes EXTRA_TAGS from toci_gate_test&quickstart.sh.j2"08:56
EmilienMlet me see if that would work08:56
marios_|ruckquiquell: like the bash variable specifically08:56
quiquellmarios_|ruck: we have "standalone-upgrade" tag and "standalone_upgrade" attribute08:57
quiquellmarios_|ruck: now with your feature you have two ways to express the tags tha a job need to do08:57
quiquellmarios_|ruck: old mechanism, just rewrite all the "tags" adding a "tags" vars to the job08:57
quiquellmarios_|ruck: new mechanism use "extra_tags" to just add the new ones08:58
quiquellmarios_|ruck: In that job the new one is standalone-upgrade comparing to the base job standalone08:58
EmilienMpanda: ping08:58
quiquellmarios_|ruck: so at the standalone upgrade jobs we have to port it to use extra_tags with your feature08:58
quiquellmarios_|ruck: ack ?08:58
*** gfidente has joined #tripleo08:59
quiquellmarios_|ruck: we can go to blue if you want08:59
EmilienMykarel: I think we should use "skopeo copy", it seems to copy the tags09:00
marios_|ruckquiquell: but that is still a different change. that is 'migrate standalone upgrade to use extra_tags' and it would require change in tripleo-quickstart featureset to remove the standalone-upgrade tag there right? (so dependson)09:00
marios_|ruckquiquell: this change isn't "migrate all jobs to use extra_tags " again it is remove the bash variable "EXTRA_TAGS from toci_gate_test&quickstart.sh.j2 "09:01
marios_|ruckquiquell: standalone-upgrade isn't in there ^09:01
marios_|ruckquiquell: so sure, maybe an extra change but not part of this one imo09:01
quiquellmarios_|ruck: featureset has nothing to do with that09:01
ykarelEmilienM, ack but /me never used that so can't say09:01
EmilienMi'm testing it locally09:02
quiquellmarios_|ruck: featurest is standalone_upgrade look at the underscore and it's a flag not a tag09:02
ykarelEmilienM, ack09:02
quiquellmarios_|ruck: We can do that at this one, no big deal man09:02
quiquellmarios_|ruck: At the end normal upgardes are going to disappear, so better add it to standalone upgrades09:02
quiquellmarios_|ruck: so we exercise your change with the stuff that is going to be relevant09:03
* quiquell is preparing the beer for marios_|ruck09:03
*** jpich has joined #tripleo09:04
*** yprokule has joined #tripleo09:05
marios_|ruckquiquell: i thought you meant this https://github.com/openstack/tripleo-quickstart/blob/master/config/general_config/featureset056.yml#L14 not https://github.com/openstack/tripleo-quickstart/blob/master/config/general_config/featureset056.yml#L1409:05
marios_|ruckhttps://github.com/openstack-infra/tripleo-ci/blob/932fc2157121c2179894ea544635a3d28c81d696/zuul.d/standalone-jobs.yaml#L62-L6409:06
marios_|ruckthat one rather09:06
marios_|ruckquiquell: i.e. from folco comment that is why i was referring to featureset09:06
quiquellmarios_|ruck: nah forget about fs09:06
quiquellmarios_|ruck: it's just about stanadlone-upgrade ansible tag09:06
quiquellmarios_|ruck: and refactoring standalone upgrade job with your stuff since this is going to be the relevant upgrade job sooner than later09:07
marios_|ruckquiquell: i can make the change but still not sure it belongs here09:07
marios_|ruckquiquell: reason is there are many places we use 'tags: under zuul.d09:07
marios_|ruckquiquell: not just standalone-upgrade09:07
quiquellmarios_|ruck: It's ok for base jobs09:07
quiquellmarios_|ruck: we can use only extra_tags at leave jobs09:07
quiquellmarios_|ruck: I mean the idea is that if the base jobs has "tags" we can modify that with "Âexta_tags"09:08
quiquellmarios_|ruck: we don't have too many of them09:08
quiquellmarios_|ruck: so we don't have to repeat all the tags there in the leave jobs09:08
quiquellmarios_|ruck: clear example is multinode upgrade jobs09:09
*** skramaja has joined #tripleo09:10
*** rodolof has joined #tripleo09:10
*** wolverineav has joined #tripleo09:10
quiquellmarios_|ruck: only the standalone-upgrade job parents a job with tags09:11
marios_|ruckquiquell: yes the other hits are on base.yaml09:11
quiquellmarios_|ruck: I suppose rfolco means that wit h this change the flag at fs is not needed, since we are not using is_featurset stuff09:11
marios_|ruckquiquell: well it wasn't wired up anyway09:12
marios_|ruckquiquell: i mean there is no mention of it in the tripleo-ci scripts09:12
marios_|ruckquiquell: which is why i was pushing back here09:12
quiquellmarios_|ruck: Yep, looks like copy paste from multinode upgrades09:12
marios_|ruckquiquell: i think its used just by the standalone role09:12
marios_|ruckquiquell: so i didn't want to touch that one from featureset09:12
quiquellmarios_|ruck: but we don't have to change that in the your review09:12
EmilienMykarel: I think we'll have to manually tag it09:13
quiquellmarios_|ruck: just adapt standalone-upgrade to use extra_tags, since this is going to be the main upgrade job in near feature09:13
EmilienMskopeo doesn't copy the tags either09:13
marios_|ruckquiquell: right but initially i thought you and folco were talking about the fs since that is what folco pointed to when i asked for clarification09:13
ykarelEmilienM, ack go for it09:13
*** moshele has quit IRC09:13
EmilienMykarel: I don't have credentials, panda does09:13
quiquellmarios_|ruck: Yep, my communication skill are near inexistent, sorry about that09:13
EmilienMpanda: when you're up, please copy the tags (at least the basic ones, like current, current-tripleo, etc)09:13
ykarelEmilienM, ack so we need to wait, i think anyone who has access to promoter server, will be able to do it09:13
quiquellykarel: I have access and marios_|ruck have access too09:14
openstackgerritMarios Andreou proposed openstack-infra/tripleo-ci master: Removes EXTRA_TAGS from toci_gate_test&quickstart.sh.j2  https://review.openstack.org/60476809:15
marios_|ruckchem please check ^09:15
*** wolverineav has quit IRC09:15
ykarelquiquell, ack let's wait for panda he played with it yesterday so would have more insight09:16
quiquellykarel: ack09:16
openstackgerritMerged openstack/python-tripleoclient master: Add unit test for undercloud ctlplane network config  https://review.openstack.org/62445609:16
openstackgerritMerged openstack/python-tripleoclient master: Calculate undercloud ctlplane DHCP allocation pools  https://review.openstack.org/62412909:16
openstackgerritMerged openstack/tripleo-common master: Do not pass insecure and mirrors as arguments  https://review.openstack.org/62262709:16
openstackgerritDougal Matthews proposed openstack/python-tripleoclient stable/rocky: Fix stack.name to stack.stack_name  https://review.openstack.org/62612409:20
d0ugalAnyone got a moment for a backport? ^09:22
*** brault has quit IRC09:24
*** chem has joined #tripleo09:28
openstackgerritMerged openstack/puppet-tripleo master: Make sure we do not match multiple remotes when waiting for them  https://review.openstack.org/62435209:29
openstackgerritMerged openstack/tripleo-heat-templates stable/rocky: Add config files/templates to integrate nsx plugin with container  https://review.openstack.org/62603109:29
openstackgerritMerged openstack-infra/tripleo-ci master: Add standalone scenario002 job  https://review.openstack.org/61870909:35
openstackgerritMerged openstack/tripleo-heat-templates master: Remove developer tools from tripleo .gitignore  https://review.openstack.org/61559009:35
openstackgerritMerged openstack/python-tripleoclient master: Remove developer tools from tripleo .gitignore  https://review.openstack.org/61585709:35
openstackgerritMerged openstack/tripleo-heat-templates stable/queens: Fix horizon's iptables rules for haproxy when split off a separate role  https://review.openstack.org/62560009:35
quiquellmarios_|ruck: 002 merged !!!!!09:35
quiquellyey !!!09:35
quiquellCannot believe it09:35
*** derekh has joined #tripleo09:37
*** rodolof has quit IRC09:39
*** rodolof has joined #tripleo09:40
*** brault has joined #tripleo09:45
*** florianf has joined #tripleo09:47
openstackgerritPranali Deore proposed openstack/tripleo-heat-templates master: Enable image inject metadata properties & user roles to be ignored  https://review.openstack.org/62613109:52
openstackgerritMerged openstack/tripleo-common stable/rocky: IPv6 healthcheck fixes for nova-vnc-proxy  https://review.openstack.org/62559409:54
openstackgerritNatal Ngétal proposed openstack/tripleo-image-elements master: [Configuration] Update min tox version.  https://review.openstack.org/62613310:00
openstackgerritNatal Ngétal proposed openstack/tripleo-common master: [Configuration] Update min tox version.  https://review.openstack.org/62613410:03
openstackgerritNatal Ngétal proposed openstack/tripleo-image-elements master: [Configuration] Add missing py37 and corrected default envlist.  https://review.openstack.org/62613510:10
*** salmankhan has joined #tripleo10:15
openstackgerritKamil Sambor proposed openstack/tripleo-common master: WIP: prevent upgrading to incompatible mechanism driver  https://review.openstack.org/62534110:18
mariosquiquell: sweet :)10:20
*** salmankhan1 has joined #tripleo10:23
*** salmankhan has quit IRC10:24
*** salmankhan1 is now known as salmankhan10:24
*** psachin has quit IRC10:29
*** ssbarnea|rover has quit IRC10:34
*** ssbarnea|rover has joined #tripleo10:35
*** dsneddon has quit IRC10:37
*** florianf has quit IRC10:47
*** rodolof has quit IRC10:51
*** rodolof has joined #tripleo10:51
marios_|ruckquiquell: y u no vote https://review.openstack.org/#/c/604768/11:03
*** rodolof has quit IRC11:03
quiquellmarios_|ruck: commented11:04
*** ccamacho has quit IRC11:05
marios_|ruckquiquell: srsly11:05
marios_|ruckquiquell: that is unrelated11:05
quiquellmarios_|ruck: Is part of the refactorin of the job11:05
openstackgerritEmilien Macchi proposed openstack/ansible-role-container-registry master: docker: check if ftype exists  https://review.openstack.org/62614911:05
quiquellmarios_|ruck: whole purpose is just add the tag that need to be appended so you reuse base ones11:06
marios_|ruckquiquell: no whole purpose is to add extra_tags and remove EXTRA_TAGS...11:06
quiquellmarios_|ruck: come on... is just one job man, strictly you are right, but it's better to have the new job right too like boy scout stuff11:07
marios_|ruckquiquell: no it is confusing11:07
marios_|ruckquiquell: each change should be self contained. there is a reason we don't just fix all the things in one review11:07
*** dsneddon has joined #tripleo11:07
openstackgerritMichele Baldessari proposed openstack/puppet-tripleo stable/rocky: Make sure we do not match multiple remotes when waiting for them  https://review.openstack.org/62615111:08
openstackgerritEmilien Macchi proposed openstack/ansible-role-container-registry master: docker: check if ftype exists  https://review.openstack.org/62614911:08
openstackgerritMichele Baldessari proposed openstack/puppet-tripleo stable/queens: Make sure we do not match multiple remotes when waiting for them  https://review.openstack.org/62615211:08
quiquellmarios_|ruck: As I see this, you created new meachanism, so it's good to use it at needed places in the project, standalone-upgrade is exactly the place11:08
*** florianf_ has joined #tripleo11:08
marios_|ruckquiquell: i am using it man. extra_tags11:08
marios_|ruckquiquell: anyway ok thanks for review11:09
quiquellmarios_|ruck: But you are not removing "tags"11:09
marios_|ruckquiquell: this review IS NOT ABOUT TAGS11:09
quiquellmarios_|ruck: kind of11:09
quiquellmarios_|ruck: Is not the extra_tags about not having to copy base jobs "tags" ?11:09
quiquellmarios_|ruck: multinode have a lot of them11:09
marios_|ruckquiquell: no, it is about removing EXTRA_TAGS from the bash, as it explains in the commit message11:09
marios_|rucknothing to do with tags11:10
quiquellmarios_|ruck: so we remove "tag" from the new job of we forget totally about the job and create new review11:11
quiquellfor it11:12
quiquellprefer the first is not much of effort but ok11:12
*** udesale has quit IRC11:13
*** ccamacho has joined #tripleo11:14
*** holser_ is now known as holser|lunch11:16
*** rodolof has joined #tripleo11:20
EmilienMpanda: I need to go now, but please copy the tags when you have time. There is no command for that I think, you'll need to manually push them.11:21
EmilienMthanks11:21
openstackgerritYurii Prokulevych proposed openstack/tripleo-upgrade master: [WIP] Address ansible-lint issues  https://review.openstack.org/62615711:23
*** pbandark has joined #tripleo11:28
pandaEmilienM: ykarel added current-tripleo-rdo and d8bae7b99708a308fb52ec13ae71f5a5f42a0a5d_e972080c tags to zaqar-wsgi11:31
ykarelpanda, ack11:32
ykarelseems enough, will recheck the patch11:33
*** salmankhan has quit IRC11:35
ykarelso featureset010 passed in the job11:36
*** jtomasek has quit IRC11:37
ykarelupdates job failed with the expected error, will recheck11:37
openstackgerritMichele Baldessari proposed openstack/puppet-pacemaker master: WIP Initial pcs 0.10 support  https://review.openstack.org/60787311:38
openstackgerritMichele Baldessari proposed openstack/puppet-pacemaker master: WIP Initial support for properties managed by pcs 0.10  https://review.openstack.org/62600511:38
*** jtomasek has joined #tripleo11:44
*** rodolof has quit IRC11:52
*** rodolof has joined #tripleo11:53
*** rfolco has quit IRC11:59
*** rf0lc0 has joined #tripleo11:59
*** aedc has joined #tripleo12:00
*** raildo has joined #tripleo12:04
*** rodolof has quit IRC12:05
*** ansmith has quit IRC12:08
*** jtomasek has quit IRC12:11
*** ratailor has quit IRC12:23
*** vpickard_ is now known as vpickard12:24
*** bfournie has quit IRC12:29
*** jpena is now known as jpena|lunch12:29
*** fultonj has quit IRC12:30
*** fultonj has joined #tripleo12:30
*** gfidente has quit IRC12:32
*** janki has quit IRC12:32
*** gfidente has joined #tripleo12:33
*** rh-jelabarre has joined #tripleo12:40
*** shyamb has joined #tripleo12:44
*** wolverineav has joined #tripleo12:47
*** cylopez has joined #tripleo12:48
*** cylopez has left #tripleo12:48
*** abishop has joined #tripleo12:48
*** salmankhan has joined #tripleo12:50
*** wolverineav has quit IRC12:51
shyambHi12:54
shyambAny document to enable ssl on rabbitmq in osp13?12:55
*** jtomasek has joined #tripleo12:57
shyambshardy: Tengu: ?12:58
*** weshay has joined #tripleo13:00
*** jpena|lunch is now known as jpena13:01
*** rlandy has joined #tripleo13:03
*** ykarel is now known as ykarel|away13:04
*** avivgt has quit IRC13:04
*** leanderthal has joined #tripleo13:11
*** ykarel|away has quit IRC13:12
*** jtomasek has quit IRC13:13
*** trown|outtypewww is now known as trown13:13
*** holser|lunch is now known as holser_13:13
*** jtomasek has joined #tripleo13:13
openstackgerritMerged openstack/tripleo-ui master: Modify the word url address  https://review.openstack.org/62377313:21
*** avivgt has joined #tripleo13:25
*** janki has joined #tripleo13:26
openstackgerritMerged openstack/tripleo-heat-templates master: Remove ties between ceilometer and panko  https://review.openstack.org/62040213:28
*** lblanchard has joined #tripleo13:31
*** aedc has quit IRC13:33
*** aedc has joined #tripleo13:33
*** jcoufal has joined #tripleo13:33
*** ykarel|away has joined #tripleo13:34
*** dprince has joined #tripleo13:38
*** ansmith has joined #tripleo13:40
*** saneax has quit IRC13:42
*** mmethot has quit IRC13:45
*** shyamb has quit IRC13:46
*** mmethot has joined #tripleo13:47
openstackgerritMerged openstack/tripleo-common master: Fix ansible-playbook call to python3  https://review.openstack.org/62551313:48
*** moshele has joined #tripleo13:48
*** agurenko has quit IRC13:49
hjensasHi, if anyone have time for a simple? review - https://review.openstack.org/62413013:50
*** bfournie has joined #tripleo13:51
*** aedc has quit IRC13:54
yprokulessbarnea|rover: hi13:58
yprokulessbarnea|rover: do U know what caused this http://logs.openstack.org/99/625799/1/check/openstack-tox-linters/4382276/job-output.txt.gz#_2018-12-19_06_27_20_54200713:58
*** ykarel|away is now known as ykarel14:00
*** suuuper has joined #tripleo14:03
*** ansmith has quit IRC14:08
*** ansmith has joined #tripleo14:10
*** tzumainn has joined #tripleo14:11
*** skramaja has quit IRC14:13
ssbarnea|roveryprokule: yes I do. i have a fix it14:15
ssbarnea|roveryprokule: i need this merged first https://review.openstack.org/#/c/626000/14:15
yprokulessbarnea|rover: what caused it ?14:17
ssbarnea|roveryprokule: apparently newer release of ansible-lint14:17
yprokulessbarnea|rover: I see14:18
yprokulessbarnea|rover: thanks14:18
ssbarnea|roveryprokule: here is the fix but is blocked by this outdarted blacklist file,  https://review.openstack.org/#/c/625997/14:18
ssbarnea|roveryprokule: if you can help me worflow these two we are done and future proof.14:18
ssbarnea|roverwe already use pre-commit on tripleo-quickstart-extras and we were not affected by this, but there we dont have the reqs-check job :D14:19
ssbarnea|roverso while trying to copy the config i had a small surprise14:19
ssbarnea|roverfixed linting and broke the reqs-check14:20
openstackgerritMartin Schuppert proposed openstack/tripleo-heat-templates master: Use templating for nova cell transport-url  https://review.openstack.org/62617714:20
*** agurenko has joined #tripleo14:21
*** moshele has quit IRC14:21
openstackgerritDavid Peacock proposed openstack/tripleo-heat-templates master: flatten tripleo-packages service configuration  https://review.openstack.org/62532614:24
ssbarnea|roveryprokule: do you know how to find someone to merge the reqs fix? I emailed the lists this morning but...14:25
yprokuleccamacho: maybe U know ^^14:25
ccamachoyprokule I think Cedric14:29
*** agurenko has quit IRC14:30
ccamachono sorry, ssbarnea|rover let me check the reviews14:30
ssbarnea|roverccamacho: https://review.openstack.org/#/c/626000/14:30
ssbarnea|roveri can make another one for few other missing ones: ansible-lint ansible-review bashate14:31
ssbarnea|roverbut this one is needed by another change.14:31
ssbarnea|roveri find is funny that bashate is not listed there, being an in-house linter.14:32
*** ssbarnea|rover has quit IRC14:40
*** ssbarnea has joined #tripleo14:40
*** leanderthal has quit IRC14:47
*** morazi has joined #tripleo14:47
openstackgerritDouglas Mendizábal proposed openstack/tripleo-heat-templates master: Add template code to configure hsm backends for barbican  https://review.openstack.org/61063414:48
*** udesale has joined #tripleo14:50
*** paramite has quit IRC14:53
*** akrivoka has joined #tripleo14:55
*** akrzos has joined #tripleo14:57
*** Vorrtex has joined #tripleo14:59
openstackgerritAlex Schultz proposed openstack/tripleo-heat-templates master: implement default ssh-from-ctlplane rule via hiera  https://review.openstack.org/58243614:59
*** waleedm has quit IRC14:59
*** rlandy is now known as rlandy|rover15:08
openstackgerritHarald Jensås proposed openstack/python-tripleoclient master: Remove DhcpStart and DhcpEnd - Replaced by AllocationPools  https://review.openstack.org/62618815:09
openstackgerritDan Prince proposed openstack/tripleo-heat-templates master: flatten the heat service configurations  https://review.openstack.org/62601215:17
*** moguimar has quit IRC15:21
*** marios_|ruck has quit IRC15:22
jankidsneddon, hey15:28
*** quiquell is now known as quiquell|off15:29
ssbarneayprokule:  there is something weird about requirements-check job - complains on tripleo-upgrades abut ansible not being listed on openstack/requirements ... which is really interesting....15:29
mwhahahassbarnea: ansible needs to be dropped from the requirements.txt15:30
mwhahahathat's the point of ansible-requirements.txt15:30
ssbarneanow i see two options: make requirements-check non voting, at least for start because it makes no sense or adding ansible to openstack requirements which is not going to be an easy task.15:30
ssbarneamwhahaha: ahh, didn't know about this approach. is it documented somewhere?15:32
mwhahahanot really15:32
mwhahahait's something we've had to do to work around the global requirements15:32
mwhahahacause ansible is gpl15:32
mwhahahanot apache so it can't be in the global reqs15:32
ssbarneamwhahaha: ouch,...15:33
openstackgerritSorin Sbarnea proposed openstack/tripleo-upgrade master: Migrate linting to pre-commit  https://review.openstack.org/62599715:34
*** ccamacho has quit IRC15:35
openstackgerritHarald Jensås proposed openstack/tripleo-heat-templates stable/rocky: Ironic Inspector - disjoint ip range(s) for HA  https://review.openstack.org/62531515:37
EmilienMpanda: thank you15:40
*** fragatina has quit IRC15:41
openstackgerritYurii Prokulevych proposed openstack/tripleo-upgrade master: [WIP] Address ansible-lint issues  https://review.openstack.org/62615715:45
openstackgerritMerged openstack/tripleo-heat-templates master: puppet_config for rabbitmq_bundle needs file_line  https://review.openstack.org/62166015:46
*** brault has quit IRC15:48
*** snecklifter has joined #tripleo15:52
snecklifterbr-virt15:52
*** snecklifter has left #tripleo15:52
openstackgerritDouglas Mendizábal proposed openstack/tripleo-heat-templates master: Add template code to configure hsm backends for barbican  https://review.openstack.org/61063415:54
*** morazi has quit IRC15:56
openstackgerritRedHat RDO CI proposed openstack/tripleo-heat-templates stable/queens: GATE CHECK for TripleO  https://review.openstack.org/56722416:00
larsksIt looks like I had a few ci failures yesterday for reasons unrelated to the code. /topic says ci status is "greenish". Should I just recheck everything?16:00
openstackgerritRedHat RDO CI proposed openstack/tripleo-heat-templates master: GATE CHECK for TripleO  https://review.openstack.org/60429816:00
openstackgerritRedHat RDO CI proposed openstack/tripleo-heat-templates stable/rocky: GATE CHECK for TripleO  https://review.openstack.org/60429316:00
mwhahahalarsks: yea we don't have any major issues at the moment16:00
larsksOkay, thanks.16:00
*** ccamacho has joined #tripleo16:01
*** fragatina has joined #tripleo16:01
*** ksambor has quit IRC16:09
openstackgerritSorin Sbarnea proposed openstack-infra/tripleo-ci master: Remove noop zuul job from tripleo templates  https://review.openstack.org/62590216:10
*** akrivoka has quit IRC16:11
ssbarneamwhahaha: yprokule rlandy|rover : i fixed the ansible issue with tripleo-upgrade linting, this should now pass https://review.openstack.org/#/c/625997/16:13
rlandy|roverssbarnea: thanks16:13
*** moshele has joined #tripleo16:15
*** akrivoka has joined #tripleo16:15
*** itlinux has joined #tripleo16:15
*** thrash is now known as thrash|biab16:18
*** moshele has quit IRC16:19
*** ykarel is now known as ykarel|away16:19
*** wolverineav has joined #tripleo16:23
*** gfidente is now known as gfidente|afk16:24
*** moguimar has joined #tripleo16:24
*** suuuper has quit IRC16:24
*** haleyb is now known as haleyb|afk16:25
*** moshele has joined #tripleo16:26
sri_mwhahaha, hi, I've couple of silly question, I need to create two overcloud stacks from with one undercloud node, i know that's not possible by default ? but is there any hacky way we can achieve this ? i am not worrying about managing the cluster with undercloud,16:27
*** wolverineav has quit IRC16:27
fultonjsri_: name the second overcloud's stack something different from overcloud16:28
fultonjsri_: e.g. openstack overcloud deploy --stack overcloud2 ...16:28
sri_fultonj, cool, I tought about it but then I came across this https://bugzilla.redhat.com/show_bug.cgi?id=124159616:30
openstackbugzilla.redhat.com bug 1241596 in rhosp-director "[RFE] Need to be able to deploy and manage multiple Overclouds from a single Undercloud" [High,Assigned] - Assigned to jrouleau16:30
sri_fultonj, i will give a try, thank you :)16:31
mwhahahasri_: yea, we just merged docs around that exact thing https://review.openstack.org/#/c/607405/16:31
*** janki has quit IRC16:31
mwhahahahttps://docs.openstack.org/tripleo-docs/latest/install/advanced_deployment/multiple_overclouds.html16:31
sri_mwhahaha, awesome :)16:31
*** moguimar has quit IRC16:31
mwhahahathere is also https://docs.openstack.org/tripleo-docs/latest/install/advanced_deployment/split_stack.html which uses multiple stacks16:32
*** moguimar has joined #tripleo16:33
sri_ack, mwhahaha thanks :)16:34
*** aufi has quit IRC16:35
*** udesale has quit IRC16:35
openstackgerritAlex Schultz proposed openstack/ansible-role-container-registry master: Reduce the number of tripleo jobs  https://review.openstack.org/62636016:37
*** jtomasek has quit IRC16:39
*** jistr has quit IRC16:41
*** jistr has joined #tripleo16:42
openstackgerritSergii Golovatiuk proposed openstack/tripleo-upgrade master: Migrate linting to pre-commit  https://review.openstack.org/62599716:46
openstackgerritSergii Golovatiuk proposed openstack/tripleo-upgrade master: [WIP] Address ansible-lint issues  https://review.openstack.org/62615716:46
*** jistr_ has joined #tripleo16:46
*** jistr has quit IRC16:47
*** dsneddon has quit IRC16:47
dtrainorshardy, I'm running in to an issue with a queens (downstream) deployment error:   Property error: resources.NetworkDeployment.properties.actions: "[u'']" is not an allowed value [CREATE, UPDATE, DELETE, SUSPEND, RESUME].  I was looking through logs and saw a comment by you http://eavesdrop.openstack.org/irclogs/%23tripleo/%23tripleo.2018-06-18.log.html16:49
openstackgerritSergii Golovatiuk proposed openstack/tripleo-upgrade master: Address ansible-lint issues  https://review.openstack.org/62615716:49
*** chandankumar is now known as chkumar|vanished16:50
dtrainorI'm ending up with an empty list for ComputeNetworkDeploymentActions http://paste.openstack.org/show/737741/ this either should not exist or it should be CREATE, but I'm not sure why I'm getting an empty list in the first place.  Can you provide some guidance please?16:50
*** moshele has quit IRC16:51
*** jistr_ has quit IRC16:51
*** jistr has joined #tripleo16:52
*** hakhande_ has quit IRC16:53
*** kopecmartin is now known as kopecmartin|off16:57
*** yprokule has quit IRC16:58
*** dsneddon has joined #tripleo17:00
openstackgerritEmilien Macchi proposed openstack/ansible-role-container-registry master: docker: check if ftype exists  https://review.openstack.org/62614917:02
*** HardCase has joined #tripleo17:05
openstackgerritEmilien Macchi proposed openstack/ansible-role-container-registry master: docker: check if ftype exists  https://review.openstack.org/62614917:09
*** jpich has quit IRC17:11
*** thrash|biab is now known as thrash17:13
openstackgerritDavid Peacock proposed openstack/tripleo-heat-templates master: flatten sshd service configuration  https://review.openstack.org/62597917:14
openstackgerritSorin Sbarnea proposed openstack-infra/tripleo-ci master: Avoid using hardcoded zuul user path in run-v3  https://review.openstack.org/62636417:14
*** moshele has joined #tripleo17:14
ssbarneaweshay: mwhahaha : can we also workflow https://review.openstack.org/#/c/582163/ ? same change already went into 3 other tripleo repos.17:23
*** mburned is now known as mburned_out17:31
*** fragatina has quit IRC17:39
itlinuxis there a plan to adopt kata containers17:43
mwhahahano17:44
itlinuxty17:44
*** derekh has quit IRC17:44
*** florianf_ has quit IRC17:45
dtrainori have a condition under which i know this node cleaning is not going to work.  is there a way to force the node out of "clean wait"?17:45
dtrainori think i can delete it, but that means i need to spend time introspecting it again etc17:46
mwhahahathat's a question best for ironic folks17:46
*** gkadam has quit IRC17:46
dtrainormy bad.  thought i switched to that channel tab :)17:46
itlinuxmost probably you have to intro it..17:47
dtrainoritlinux, that won't work on account of Invalid provision state for introspection: "clean wait", valid states are "['enroll', 'manageable', 'inspect failed', 'inspecting']"17:48
itlinuxwhat I am saying you probably have to delete it and re-add it. that's why I was saying intro again17:49
itlinuxnormally when I see something like that I get the console and see17:50
itlinuxwhat's the status is..17:50
itlinuxto track down the issue..17:50
dtrainorright, the status is that it's waiting to time out17:50
itlinuxwell some of those cases I notice.. that network or other communication do not work..17:51
itlinuxI remember having issues similar to yours..17:51
itlinuxand the switch port was config not correctly17:51
dtrainorsure, but ultimately i need it to stop waiting - either by failure or success - to then do what i need with it, instead of just sitting here waiting for it, that's what i'm trying to get around17:51
itlinuxI see..17:52
openstackgerritJaganathan Palanisamy proposed openstack/tripleo-heat-templates master: Derives NovaPCIPassthrough per SR-IOV node  https://review.openstack.org/62457317:52
itlinuxnot sure.. you can ask the ironic channel they are very active17:52
itlinuxin helping out17:52
dtrainoralready there :)17:53
itlinuxyou could try to manually set the state17:53
itlinuxmaybe that's an option17:53
*** jpena is now known as jpena|off17:54
*** trown is now known as trown|lunch17:56
*** rascasoft has joined #tripleo18:02
*** rascasoft_ has joined #tripleo18:03
*** rascasoft_ has quit IRC18:03
openstackgerritDavid Peacock proposed openstack/tripleo-heat-templates master: flatten sshd service configuration  https://review.openstack.org/62597918:04
*** salmankhan has quit IRC18:05
*** wolverineav has joined #tripleo18:12
*** wolverineav has quit IRC18:12
*** wolverineav has joined #tripleo18:12
*** wolverineav has quit IRC18:13
*** wolverineav has joined #tripleo18:19
openstackgerritSergii Golovatiuk proposed openstack/tripleo-upgrade master: Address ansible-lint issues  https://review.openstack.org/62615718:21
*** holser_ is now known as holser|eod18:26
openstackgerritSorin Sbarnea proposed openstack/tripleo-quickstart master: WIP: Avoid reproducer image resize failure when run root and non-root user  https://review.openstack.org/62564818:27
openstackgerritSorin Sbarnea proposed openstack-infra/tripleo-ci master: Avoid using hardcoded zuul user path in run-v3  https://review.openstack.org/62636418:30
*** shardy has quit IRC18:32
*** saneax has joined #tripleo18:33
openstackgerritSorin Sbarnea proposed openstack/tripleo-quickstart master: WIP: Avoid reproducer image resize failure when run root and non-root user  https://review.openstack.org/62564818:37
*** amoralej is now known as amoralej|off18:39
*** ykarel|away has quit IRC18:43
*** moshele has quit IRC18:46
*** cfontain has joined #tripleo18:52
*** cfontain has quit IRC18:56
openstackgerritRonelle Landy proposed openstack-infra/tripleo-ci master: DNM - Temp change periodic switch to rely on zuul.job  https://review.openstack.org/62527118:58
*** paramite has joined #tripleo19:00
*** saneax has quit IRC19:01
*** trown|lunch is now known as trown19:06
*** moshele has joined #tripleo19:06
openstackgerritRonelle Landy proposed openstack-infra/tripleo-ci master: WIP: Allow dlrn_hash_tag* vars to be overridden  https://review.openstack.org/62257519:08
tonglmwhahaha, EmilienM: Could you please help look at the cherry-picked patch: https://review.openstack.org/#/c/626030/?19:09
tonglThis is the last patch we need19:10
*** moshele has quit IRC19:12
tonglEmilienM: Thanks a lot!19:15
openstackgerritJill Rouleau proposed openstack/tripleo-heat-templates master: WIP: flatten nova service configuration  https://review.openstack.org/62637519:21
*** sshnaidm|off has quit IRC19:24
*** moshele has joined #tripleo19:27
*** sshnaidm has joined #tripleo19:27
HardCaseHey could I get a second pair of eyes on my ceph config? https://pastebin.com/f8GTbnth  Build is with queens 3 node with 3 osds 1 journal non-colocated and want to make sure I am building this right.19:27
*** haleyb|afk is now known as haleyb19:31
trozetmwhahaha: hi, do you know where the jinja templates are for the /etc/hosts/ stuff? I see https://raw.githubusercontent.com/openstack/tripleo-heat-templates/master/scripts/hosts-config.sh19:34
trozetmwhahaha: and on my overcloud there is /etc/cloud/templates/hosts.redhat.tmpl, but not sure what template writes that19:34
fultonjHardCase: i assume this is for a POC as you have a small amount pg numbers19:35
fultonjand OSDs19:35
fultonjyou should add a value for CephPoolDefaultPgNum as it defaults to 128 and you're going smaller19:35
HardCasefultonj: This is intended to be a production OpenStack cluster but I kept running into deployment errors about too many pgs being created.  Forgive my noobness.19:36
fultonjHardCase: no problem19:36
fultonjsda isn't your root disk right, it's a SSD that's dedicated to ceph journaling or similar19:37
fultonjHardCase: regarding the pg number error...19:37
*** gouthamr_ is now known as gouthamr19:38
fultonjError ERANGE: pg_num 128 size 3 would mean 768 total pgs, which exceeds max 600 (mon_max_pg_per_osd 200 * num_in_osds 3)19:38
fultonjsomething like ^ ?19:38
fultonjit's because of  https://ceph.com/community/new-luminous-pg-overdose-protection19:38
HardCaseRight, these are SuperMicros and despite my best efforts would not put the drive I wanted for the os so I assigned sdd as the os drive and the servers show 24576 MB RAM after introspection.19:38
HardCaseYeah like that, those were the errors I was getting19:39
fultonjHardCase: SuperMicros have this issue where /dev/sd{a,b,c,d} don't always point to the same device on reboot19:40
fultonjit can make debugging ceph deploys painful19:40
fultonji deployed a 1,000 OSD cluster on supermicros and worked around that inconsistency by using /dev/by-path19:41
fultonjHardCase: you might run into it too (though probability lower)19:41
HardCaseWhere did you put the /dev/by-path config?19:42
fultonjCephAnsibleDisksConfig:19:43
fultonj      - /dev/disk/by-path/pci-0000:03:00.0-scsi-0:2:1:019:43
fultonj      - /dev/disk/by-path/pci-0000:03:00.0-scsi-0:2:32:019:43
fultonjwhops19:43
fultonjCephAnsibleDisksConfig:19:43
fultonj    devices:19:43
fultonj      - /dev/disk/by-path/pci-0000:03:00.0-scsi-0:2:32:019:43
fultonj      - /dev/disk/by-path/pci-0000:03:00.0-scsi-0:2:1:019:43
fultonjfor example19:43
HardCaseOh so I can do that instead of - /dev/sdb - /dev/sdc ?19:44
fultonjyeah, provided you use YOUR pci- ID19:44
HardCaseThat would be much better than relying on the disk names19:44
fultonjat least they're consistent accross reboots19:45
fultonjIF this affects you19:45
fultonjsomething for your backpocket if the OSDs are not consistent19:45
HardCaseSo for the pgs errors, I'll read through this post but can you sum it up for me?  Do I need to apply mon_max_pg_per_osd or something?19:45
HardCaseI tried using the pgcalc to figure out my pg number but that is why I wanted a second pair of eyes, new to tripleo and ceph19:46
*** brault has joined #tripleo19:47
HardCaseBTW, I really appreciate you taking the time to answer my questions and look at this.  I don't typically like to bother anyone and figure this stuff out for myself but I'm a little under the gun for time.19:47
fultonjHardCase: if you only have 3 nodes, then you shouldn't set `CephPoolDefaultSize: 3`19:48
fultonj5 nodes is the min19:48
fultonjunless you're using all flash19:48
fultonjfor 3 OSD servers, use 'CephPoolDefaultSize: 2'19:49
fultonjthat way it can at least recover it's health with one OSD server down19:49
fultonjthat will affect your multiple19:49
HardCaseOh and that will take care of that errors?  Ah I get it.19:50
fultonjwell19:50
fultonj:)19:50
fultonji recommend starting there19:50
fultonjpg_num 128 size 3 would mean 768 total pgs,19:50
fultonjpg_num 128 size 2 would mean ...19:50
fultonjis what the first change does19:50
fultonjfor the second change...19:50
fultonjdrop the CephPools parameter19:51
*** brault has quit IRC19:51
fultonjand use CephPoolDefaultPgNum: 3219:51
fultonjthat will make your deployment suceed and not get hung up on overdoose protection19:51
HardCaseAhh ok19:52
fultonjhowever, it's still a low amount of OSDs and a low amount of nodes19:52
HardCaseAnd for future growth, if I add another node with the same hardware configuration, do I just increase CephPoolDefaultSize?19:52
HardCaseGot it19:52
fultonjafter the deployment19:53
HardCaseYeah I'll see about increasing my nodes19:53
fultonjyou can increase the pg and pgp values per pool19:53
fultonjthe overdose protection is there for a reason though19:53
fultonjthey're trying to prevent data loss from setting up a cluster with off numbers19:53
HardCaseOk that makes sense.19:54
HardCaseSo kinda confused, if I get a successful deployment going and later on want to add another node, what is the process?19:55
fultonjhttp://docs.ceph.com/docs/mimic/rados/operations/placement-groups/#set-the-number-of-placement-groups19:55
fultonjto change the pg number per pool19:55
fultonjon your monitor node (the controller by default)19:55
fultonjHardCase: the docs cover scale up19:55
HardCaseK fair enough19:56
HardCaseSo aside from the disk mapping does this look more appropriate? https://pastebin.com/MqAt0AXM19:56
*** vpickard has quit IRC19:56
trozetHobbestigrou: ping?19:57
*** wolverineav has quit IRC19:58
fultonjHardCase: you're missing CephPoolDefaultPgNum: 3219:58
HardCaseK, otherwise look ok?19:59
*** PagliaccisCloud has quit IRC20:02
fultonjthat should make the deployment pass20:02
fultonjHardCase: make sure you clean your disks20:02
fultonjyou can adjust your PG sizes after deployment20:03
*** HardCase has quit IRC20:03
*** HardCase has joined #tripleo20:04
*** sai_p_ has quit IRC20:04
*** vpickard has joined #tripleo20:06
*** moshele has quit IRC20:07
*** abishop has quit IRC20:10
*** jcoufal has quit IRC20:12
mwhahahatrozet: what do you mean jinja stuff for the hosts file?20:13
mwhahahatrozet: that hosts-config.sh is how it's updated20:13
trozetmwhahaha: yeah i realize that now, im seeing my hosts file is missing an IP: https://paste.fedoraproject.org/paste/EOdC1Jp6-tEEc1etKse74w20:13
mwhahahawhat ip is it missing?20:14
trozetmwhahaha: i see those entries are generated here: https://github.com/openstack/tripleo-heat-templates/blob/master/puppet/role.role.j2.yaml#L82220:14
mwhahahahrm so it would point to the network config being pad20:14
mwhahahas/pad/bad20:14
trozetmwhahaha: i think it should have 192.0.2.3 next to the fqdn and short entry20:14
mwhahahayea you're missing something (no idea what). it's right in ci20:15
openstackgerritJill Rouleau proposed openstack/tripleo-heat-templates master: Update memcache config in docker-uc-light env  https://review.openstack.org/62638420:15
mwhahahamaybe hjensas can point out what20:15
mwhahahahttp://logs.openstack.org/73/625673/2/check/tripleo-ci-centos-7-containers-multinode/962430f/logs/subnode-2/etc/hosts.txt.gz20:16
*** vpickard has quit IRC20:22
EmilienMis the gate ok?20:23
* EmilienM checks20:24
*** vpickard has joined #tripleo20:24
openstackgerritJill Rouleau proposed openstack/tripleo-heat-templates master: WIP: flatten nova service configuration  https://review.openstack.org/62637520:24
mwhahahadoesn't look like it20:27
mwhahahabut no idea why20:27
EmilienMwe just upgraded podman and container-selinux20:27
EmilienM(s/we/they/)20:27
jillrmwhahaha: could it possibly related to docker/services/memcahche being gone? https://review.openstack.org/#/c/626384/20:28
mwhahahano we don't use that file20:28
jillrhn, something else must be looking for it then  https://logs.rdoproject.org/75/626375/1/openstack-check/tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001/46060c0/logs/undercloud/home/zuul/undercloud_install.log.txt.gz#_2018-12-19_19_47_1720:29
mwhahahayea20:30
mwhahahapossibly new podman failure20:30
mwhahahastandard_init_linux.go:203: exec user process caused \"no such file or directory\"",20:30
EmilienMcould be fixed in newest version20:30
EmilienMwhat version of podman do you have?20:30
*** wolverineav has joined #tripleo20:30
mwhahahai've not seen that one before20:30
EmilienM0.11?20:30
EmilienMI've seen that20:30
EmilienMwe should have 0.12 now20:30
mwhahahapodman-0.12.1.2-2.git9551f6b.el7.x86_6420:31
mwhahahathat's a new one20:31
mwhahahathat's probably the new passwd failure20:31
EmilienMdamn20:31
mwhahahathe other one failed with a fact gathering problem http://logs.openstack.org/51/626151/1/gate/tripleo-ci-centos-7-containers-multinode/5119419/job-output.txt.gz#_2018-12-19_20_20_48_98693920:31
mwhahahawhich may just be infra related20:31
mwhahahawill need to keep an eye on the gate20:31
EmilienMyes I'll dig up in a bit20:32
weshaypodman-0.11.1.1-3.git594495d.el7.centos.x86_6420:32
weshayis what is currently in ci I think20:32
* weshay checks one more job to be sure20:32
EmilienMif the gates becomes too unstable, I can disable podman in one single patch in oooq20:32
weshayEmilienM, it's only 7hrs right now20:33
EmilienMi don't use hours to measure that20:34
EmilienMbut logstash queries20:34
*** wolverineav has quit IRC20:34
weshaypodman-0.12.1.2-2.git9551f6b.el7.x86_6420:34
weshayhow the f.. two recent jobs have two diff versions20:35
EmilienMmirrors?20:35
EmilienMgive it some time, we just got the rpms20:35
EmilienMi'm doing local testing, with selinux enforced20:35
weshay"2018-12-19 20:02:41,144 ERROR: 29964 -- Failed running docker-puppet.py for swift_ringbuilder",20:36
weshay    "2018-12-19 20:02:41,145 ERROR: 29964 -- standard_init_linux.go:203: exec user process caused \"no such file or directory\"",20:36
weshayI think you guys were talking about that issue20:36
weshayEmilienM, k20:36
weshayya.. that makes sense20:36
weshayfak20:36
weshayrlandy|rover, context ^20:36
*** weshay is now known as weshay|ruck20:37
weshay|ruckrlandy|rover, /me was watching the gate20:37
EmilienMthis bug is weird, it's random and super hard to reproduce20:38
*** vpickard has quit IRC20:39
EmilienMmwhahaha, weshay|ruck : I'm supposed to be on PTO tomorrow but if things go south, i'll disable podman everywhere in the gate during the break20:39
weshay|rucklolz20:40
weshay|ruckno podman when EmilienM is PTO :)20:40
*** PagliaccisCloud has joined #tripleo20:41
*** vpickard_ has joined #tripleo20:44
*** wolverineav has joined #tripleo20:45
*** wolverineav has quit IRC20:50
*** jfrancoa has quit IRC20:50
*** raildo has quit IRC20:50
openstackgerritwes hayutin proposed openstack/tripleo-heat-templates master: DNM - docker-puppet: set --log-level=debug  https://review.openstack.org/62442020:53
EmilienMI couldn't reproduce locally, I got successful deployment with new verison20:54
mwhahahait's probably just the new version of the same bu20:54
mwhahahabug20:54
*** wolverineav has joined #tripleo20:57
*** ssbarnea has quit IRC21:00
*** Vorrtex has quit IRC21:00
EmilienMyeah21:01
EmilienMat least if we would not make things worse, it would be okish21:02
*** tosky has quit IRC21:02
EmilienMI'll file a bug and keep digging21:02
*** vpickard_ has quit IRC21:02
EmilienMweshay|ruck, mwhahaha: can you please link to me the "exec user process caused" issue with podman 0.1221:02
weshay|ruckk.. I closed the window /me gets again21:04
bnemecAny idea why I keep getting this when doing a standalone baremetal install? http://paste.openstack.org/show/737759/21:04
bnemecBizarrely, the exact same steps work fine in a VM.21:04
bnemecThe only difference should be the name of the network interfaces.21:04
mwhahahaEmilienM: http://logs.openstack.org/03/625903/2/gate/tripleo-ci-centos-7-containers-multinode/23f5730/logs/undercloud/home/zuul/undercloud_install.log.txt.gz#_2018-12-19_20_05_5221:04
mwhahahabnemec: that's a new one, havent' see that one before21:05
weshay|ruckEmilienM, http://logs.openstack.org/03/625903/2/gate/tripleo-ci-centos-7-containers-multinode/23f5730/logs/undercloud/home/zuul/install-undercloud.log.txt.gz#_2018-12-19_20_05_52_12321:05
bnemecI had done some debugging and it looks like https://github.com/openstack/tripleo-common/blob/master/tripleo_common/inventory.py#L197 is returning a dict of networks with empty ip lists.21:07
tonybI kinda need to have a package installed on the (compute) host during the deploy.  Can someone point me in the right direction?21:07
tonybIt *was* installed on queens but we stoppd installing it on rocky and that's created an issue so I kinda want to put it back21:08
mwhahahabnemec: can you show your templates/params?21:08
mwhahahatonyb: which package?21:08
bnemecmwhahaha: http://paste.openstack.org/show/737760/21:09
*** wolverineav has quit IRC21:09
mwhahahatonyb: it's more complicated than what you're describing so that's why i'm asking21:09
bnemecThis is based on the two nic config.21:09
*** wolverineav has joined #tripleo21:09
*** dprince has quit IRC21:10
mwhahahabnemec: hmm that's weird cause i just deployed the 2nic yesterday21:10
mwhahahabnemec: with a similar paramst hing, i wonder if you have an old tripleo common maybe?21:10
redrobotHello #tripleo friends!  What version of ansible does TripleO use?  Is it > 2.0?21:11
bnemecmwhahaha: I used current-tripleo and just rebuilt this today.21:11
mwhahaharedrobot: depends on the version. but yes at least 2.5 would be a good start21:12
redrobotmwhahaha, awesome, thanks21:12
tonybmwhahaha: qemu-kvm21:12
mwhahahatonyb: it'll need to get added back into the image21:13
tonybmwhahaha: Oh okay I can do that21:13
mwhahahatonyb: though i thought we were still installing that21:14
mwhahahaor maybe because we dropped nova-compute it doesn't get added anymore21:14
tonybmwhahaha: It's in the containers but doens't seem to be on the hosts21:14
*** wolverineav has quit IRC21:14
mwhahahayea i don't think it was ever directly installed21:14
tonybmwhahaha: SHoudl I do it via tripleo-image-elements?21:15
mwhahahatripleo-puppet-elements21:15
tonybmwhahaha: Okay21:15
mwhahahahttps://github.com/openstack/tripleo-puppet-elements/tree/master/elements/overcloud-compute21:15
mwhahahain there probably21:15
tonybmwhahaha: Thanks!21:15
EmilienMmwhahaha, weshay|ruck : https://github.com/containers/libpod/issues/184421:17
*** brault has joined #tripleo21:19
*** brault has quit IRC21:23
openstackgerritwes hayutin proposed openstack-infra/tripleo-ci master: fix reproducer pip error, docutils  https://review.openstack.org/62639721:28
stevebakermwhahaha: hey, I have a packaging review when you have the chance https://review.rdoproject.org/r/#/c/17917/21:30
EmilienMdo we have this package in the promoted repo?21:32
EmilienMif not we might break the gate21:32
EmilienMjust be careful, I've +2 but I think we have to test it before21:32
stevebakerEmilienM: um, checking21:32
EmilienMsince it's a master-deps, it could be fine, although we need to double check21:33
*** ansmith has quit IRC21:35
EmilienMfor example I don't see it http://mirror.ord.rax.openstack.org:8080/rdo/centos7-master/build-deps/latest/x86_64/21:35
EmilienMit's there https://trunk.rdoproject.org/centos7-master/deps/latest/x86_64/golang-github-vbatts-tar-split-0.11.1-1.el7.x86_64.rpm21:38
stevebakerEmilienM: but it is in http://mirror.ord.rax.openstack.org:8080/rdo/centos7-master/deps/latest/x86_64/21:38
EmilienMright21:38
EmilienMso it should be fine21:38
EmilienMthe fedora job failed though21:38
*** bfournie has quit IRC21:39
EmilienMhttps://logs.rdoproject.org/17/17917/1/check/legacy-DLRN-rpmbuild-fedora/6a80565/buildset/fedora/repos/e6/b5/e6b50404ceced6f86eb2b3e223339ca17dd2d510_dev/rpmbuild.log21:40
EmilienMDEBUG: BUILDSTDERR: tripleo_common.tests.actions.test_vcs.GitCleanupActionTest.test_run_with_error ...    ERROR [tripleo_common.actions.vcs] Directory not found: /tmp/tmppr2i9d97/*_263093a3-208b-4d9f-bb96-26fa7a46abe3_import21:40
EmilienMlooks like some unit tests failures21:40
EmilienMoh actually no21:40
EmilienMDEBUG: BUILDSTDERR:   - nothing provides golang-github-vbatts-tar-split >= 0.11.1 needed by python3-tripleo-common-10.1.1-0.20181218205935.e6b5040.fc28.noarch21:40
openstackgerritJill Rouleau proposed openstack/tripleo-heat-templates master: WIP: flatten nova service configuration  https://review.openstack.org/62637521:41
mwhahahayea it needs to get added to fedora-stable21:42
stevebakeran older tar-split is in fedora21:43
stevebakerhttps://koji.fedoraproject.org/koji/packageinfo?packageID=2190321:44
openstackgerritMerged openstack/python-tripleoclient stable/rocky: Fix stack.name to stack.stack_name  https://review.openstack.org/62612421:44
openstackgerritMerged openstack/python-tripleoclient master: Add '--provide' option to node clean command  https://review.openstack.org/62173521:44
EmilienMstevebaker, mwhahaha : this? https://review.rdoproject.org/r/1794921:44
mwhahahaonly if it's available21:44
mwhahahawe'll see21:44
EmilienMotherwise we can use the one stevebaker linked21:45
EmilienMand hack in the distgit21:45
stevebakermwhahaha: anything older than 0.11.1 is missing the flag to compress on the fly, which the python uploader needs21:45
mwhahahawill probably need to sync with the rdo folks on how t get a newerver sion21:46
*** wolverineav has joined #tripleo21:46
*** trown is now known as trown|outtypewww21:47
EmilienMstevebaker: https://review.openstack.org/#/c/626149/ please21:48
*** wolverineav has quit IRC21:51
*** wolverineav has joined #tripleo21:55
*** wolverineav has quit IRC21:55
*** wolverineav has joined #tripleo21:56
openstackgerritRonelle Landy proposed openstack/tripleo-quickstart-extras master: Remove reproducer lines added to get zuul related info  https://review.openstack.org/62640021:56
*** slaweq has quit IRC22:13
*** avivgt has quit IRC22:16
*** rcernin has joined #tripleo22:19
*** rcernin has quit IRC22:36
*** rcernin has joined #tripleo22:38
*** lblanchard has quit IRC22:45
*** rcernin has quit IRC22:57
*** rcernin has joined #tripleo22:58
*** rcernin has quit IRC22:59
*** rcernin has joined #tripleo23:07
*** rascasoft has quit IRC23:12
*** PagliaccisCloud has quit IRC23:16
*** rlandy|rover is now known as rlandy|rover|bbl23:24
*** rcernin has quit IRC23:38
*** fragatina has joined #tripleo23:38
*** rcernin has joined #tripleo23:41
*** HardCase has quit IRC23:42
*** wolverineav has quit IRC23:45
*** wolverineav has joined #tripleo23:46
*** rascasoft has joined #tripleo23:48
*** wolverineav has quit IRC23:50
*** rascasoft has quit IRC23:54
*** wolverineav has joined #tripleo23:55
*** tosky has joined #tripleo23:56
openstackgerritMerged openstack/tripleo-heat-templates master: Fix issue with when statement in docker-registry.yaml.  https://review.openstack.org/62590323:57
*** thrash is now known as thrash|g0ne23:59
openstackgerritMerged openstack/puppet-tripleo stable/rocky: Make sure we do not match multiple remotes when waiting for them  https://review.openstack.org/62615123:59

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!