Monday, 2019-03-18

shyambHi00:00
shyambOnce I deploy overcloud with network isolation, my overcloud openstcak commands like endpoint list fails00:01
shyambthey try to access admin interface internally00:01
shyamband it's un-reachable from my client machine00:01
shyambHow to deal with this situation?00:01
shyambCan's I select public interface and stick to it throughout the command execution?00:02
shyambpublic interface is reachable but not admin00:02
*** wolverineav has quit IRC00:04
*** wolverineav has joined #tripleo00:05
*** slaweq_ has joined #tripleo00:11
*** wolverineav has quit IRC00:14
*** martinkennelly has quit IRC00:14
*** wolverineav has joined #tripleo00:22
*** slaweq_ has quit IRC00:24
*** cfontain has quit IRC00:27
*** shyamb has quit IRC00:28
*** wolverineav has quit IRC00:40
*** wolverineav has joined #tripleo00:40
*** wolverineav has quit IRC00:52
*** itlinux has joined #tripleo00:59
*** d0ugal has quit IRC01:06
*** slaweq_ has joined #tripleo01:11
*** d0ugal has joined #tripleo01:12
*** wolverineav has joined #tripleo01:13
*** wolverineav has quit IRC01:20
*** wolverineav has joined #tripleo01:21
*** slaweq_ has quit IRC01:24
*** wolverineav has quit IRC01:26
openstackgerritJon Schlueter proposed openstack/tripleo-common master: Adjust where iptables-services is injected  https://review.openstack.org/64294501:28
*** cfontain has joined #tripleo01:56
*** wolverineav has joined #tripleo02:04
*** gkadam_ has joined #tripleo02:11
*** slaweq_ has joined #tripleo02:11
*** wolverineav has quit IRC02:15
*** gkadam_ has quit IRC02:17
*** irclogbot_3 has quit IRC02:23
*** slaweq_ has quit IRC02:24
*** cfontain has quit IRC02:29
*** ykarel has joined #tripleo02:52
*** shyamb has joined #tripleo03:05
*** shyam89 has joined #tripleo03:11
*** slaweq_ has joined #tripleo03:11
*** shyam89 has quit IRC03:14
*** shyamb has quit IRC03:14
*** slaweq_ has quit IRC03:25
*** wolverineav has joined #tripleo03:29
openstackgerritRonelle Landy proposed openstack/tripleo-quickstart master: Add ipv4 undercloud_external_network when the overcloud is ipv6  https://review.openstack.org/64314003:32
openstackgerritRonelle Landy proposed openstack/tripleo-quickstart-extras master: Parameterize undercloud masquerade networks overrides  https://review.openstack.org/64292403:32
*** wolverineav has quit IRC03:33
*** cfontain has joined #tripleo04:04
*** janki has joined #tripleo04:05
*** udesale has joined #tripleo04:08
*** slaweq_ has joined #tripleo04:14
*** itlinux has quit IRC04:15
*** slaweq_ has quit IRC04:24
*** cfontain has quit IRC04:38
*** ramishra has joined #tripleo04:46
*** rodrigods has quit IRC05:01
*** pdeore has joined #tripleo05:01
*** cfontain has joined #tripleo05:05
*** skramaja has joined #tripleo05:11
*** social has quit IRC05:11
*** slaweq_ has joined #tripleo05:16
Tenguhello there :)05:19
ykarelo/05:21
*** fultonj has quit IRC05:22
*** absubram has joined #tripleo05:23
*** slaweq_ has quit IRC05:24
*** absubram_ has joined #tripleo05:27
*** absubram has quit IRC05:28
*** absubram_ is now known as absubram05:28
*** fultonj has joined #tripleo05:30
*** cfontain has quit IRC05:38
Tengufolks, some early PTAL? :) https://review.openstack.org/63695805:40
*** fultonj has quit IRC05:41
*** ykarel_ has joined #tripleo05:43
*** fultonj has joined #tripleo05:43
*** rcernin has quit IRC05:43
*** ykarel has quit IRC05:45
*** jaosorior has joined #tripleo05:45
*** ykarel_ is now known as ykarel05:51
ykarelTengu, seeing:-05:54
ykarelThe conditional check 'validate_services|bool|default(false)' failed. The error was: error while evaluating conditional (validate_services|bool|default(false)): 'validate_services' is undefined05:54
ykarelhttps://ci.centos.org/job/tripleo-quickstart-promote-pike-rdo_trunk-minimal/220/consoleText05:54
Tenguykarel: o_O again ? that |default should take care of the non-presence of that var.... -.-05:56
Tenguunless the |bool masks it and should be at the end? hmm.05:57
Tengumight be that..05:57
ykarelhmm but somehow |default it not taking care of it05:57
Tenguguess the |bool is messing around.05:57
*** saneax has joined #tripleo05:57
ykarelbut only happening in pike jobs05:59
Tenguansible version probably...05:59
*** rcernin has joined #tripleo05:59
openstackgerritCédric Jeanneret proposed openstack/tripleo-quickstart-extras master: The |bool seems to prevent the |default to kick in  https://review.openstack.org/64385706:00
Tenguykarel: do you have a way to test that one on pike? ^^06:00
Tenguwith depends-on and a fake, DNM review maybe?06:00
ykarelTengu, so same quickstart is used across all realeases, so ansible should be same06:01
Tenguykarel: well, apparently not - at least something is not the same on pike systems.06:02
ykarelhmm true, but not known yet06:02
Tenguif this is seen only on pike, there's something different there. either ansible, or maybe some dependency...06:02
*** jbadiapa has joined #tripleo06:06
*** cfontain has joined #tripleo06:09
ykarelTengu, okk it's just not pike, other releases are also affected06:10
ykarelso your patch should do the trick06:10
*** ratailor has joined #tripleo06:10
Tenguykarel: cool - as said, would be good to test it on the said failed deploy before merging :)06:10
*** slaweq_ has joined #tripleo06:11
ykarelTengu, hmm those jobs are defined in jenkins, don't think there is easy way to test it06:14
ykareltest the patch06:14
Tengu:(06:20
*** slaweq_ has quit IRC06:24
*** ksambor has joined #tripleo06:37
*** cfontain has quit IRC06:39
*** wolverineav has joined #tripleo06:45
*** absubram has quit IRC06:45
*** brault has joined #tripleo06:46
*** wolverineav has quit IRC06:50
*** lmiccini has joined #tripleo06:53
*** brault has quit IRC06:55
*** paramite has joined #tripleo06:56
*** jaosorior has quit IRC06:58
*** jfrancoa has joined #tripleo06:58
*** kopecmartin|off is now known as kopecmartin07:03
*** yprokule has joined #tripleo07:10
*** tkajinam_ has joined #tripleo07:11
*** jaosorior has joined #tripleo07:11
*** jtomasek has joined #tripleo07:13
*** tkajinam has quit IRC07:13
*** slaweq_ has joined #tripleo07:13
*** gfidente has joined #tripleo07:15
*** mschuppert has joined #tripleo07:17
*** pcaruana has joined #tripleo07:19
*** hjensas has quit IRC07:25
*** jaosorior has quit IRC07:35
*** hjensas has joined #tripleo07:36
*** apetrich has joined #tripleo07:38
*** jaosorior has joined #tripleo07:44
*** jaosorior has quit IRC07:44
*** cylopez has joined #tripleo07:45
*** xek has joined #tripleo07:45
*** iurygregory has joined #tripleo07:49
*** tosky has joined #tripleo08:05
*** tosky has quit IRC08:07
openstackgerritJose Luis Franco proposed openstack/tripleo-heat-templates master: Remove baremetal to containerized pacemaker upgrade_tasks.  https://review.openstack.org/64364908:07
*** florianf has joined #tripleo08:10
openstackgerritJose Luis Franco proposed openstack/tripleo-heat-templates master: Remove baremetal to containerized pacemaker upgrade_tasks.  https://review.openstack.org/64364908:13
*** ccamacho has joined #tripleo08:19
*** rpittau|afk is now known as rpittau08:19
*** ykarel is now known as ykarel|lunch08:21
*** amoralej|off is now known as amoralej08:22
*** tosky has joined #tripleo08:24
*** tkajinam_ has quit IRC08:24
*** bogdando has joined #tripleo08:28
*** jpena|off is now known as jpena08:29
*** lennyb has joined #tripleo08:34
*** ramishra has quit IRC08:35
*** ramishra has joined #tripleo08:35
*** sshnaidm|afk is now known as sshnaidm|rover08:42
*** suuuper has joined #tripleo09:01
*** brault has joined #tripleo09:03
*** brault has quit IRC09:09
*** holser_ has joined #tripleo09:10
*** aufi has joined #tripleo09:10
*** dtantsur|afk is now known as dtantsur09:11
openstackgerritrenminmin proposed openstack/diskimage-builder master: Add DIB_LOCAL_IMAGE to use ubuntu local cloud image  https://review.openstack.org/64388509:11
*** rascasoft has joined #tripleo09:12
*** chem has joined #tripleo09:25
*** ykarel|lunch is now known as ykarel09:27
*** martinkennelly has joined #tripleo09:28
*** rfolco has joined #tripleo09:34
*** shyamb has joined #tripleo09:41
shyambHi09:41
shyambI am using certmonger + FreeIPA to manage and issue certificates for overcloud09:41
shyambOne of the cert request is failing with return code 209:41
shyambhttp://paste.openstack.org/show/747952/09:41
shyambWhat could be the checks should I perform?09:42
shyambReturn code 2 means getcert request has been rejected09:42
sshnaidm|rovermarios_|ruck, fyi https://bugs.launchpad.net/tripleo/+bug/182057609:47
openstackLaunchpad bug 1820576 in tripleo "master: Standalone002 job fails, keystone container didn't start because could not bind to address 192.168.24.1:35357" [Critical,Triaged] - Assigned to Sagi (Sergey) Shnaidman (sshnaidm)09:47
ykarelsshnaidm|rover, master looking good currently, seeing only 2 failures09:49
ykarelmaster promotin i mean09:49
sshnaidm|roverykarel, yeah, one of them in the bug above.. but doesn't seem a real bug09:50
ykarelsshnaidm|rover, yes too me also09:50
sshnaidm|roverykarel, if it was keystone problem, it wouldn't work in other scenarios too09:50
ykarelsshnaidm|rover, yup right,09:50
ykarelsshnaidm|rover, good to rerun both these jobs in testproject, hopefully they pass and we have a promotion09:51
ykarelhttps://trunk-primary.rdoproject.org/api-centos-master-uc/api/civotes_detail.html?commit_hash=0cd6b282920214d2995d1203aa0ad7d33c825b10&distro_hash=b0217950876ab5861652a169206dd93fc796b13509:51
sshnaidm|roverykarel, https://review.rdoproject.org/r/#/c/19422/ :)09:51
ykarelsshnaidm|rover, cool but you need to adjust to used promotion-testing-hash09:52
sshnaidm|roverykarel, mm.. don't they take it automatically?09:52
ykarelsshnaidm|rover, no09:52
ykarelbecause it looks for zuul.pipeline09:52
sshnaidm|roverykarel, oh, really.. /me going to look what changed..09:53
*** pdeore has quit IRC09:53
openstackgerritKarthik S proposed openstack/os-net-config master: Removing the warnings generated due to yaml.load()  https://review.openstack.org/64323009:54
ykarelsshnaidm|rover, you can make Depends-On on https://review.openstack.org/#/c/625271/09:54
*** wolverineav has joined #tripleo09:54
sshnaidm|roverykarel, oh, there's a ready patch, nice09:55
ykarelyes i think there are many09:55
sshnaidm|roverseems like things changed since I was ruck/rover :)09:55
ykarelpossibly but zuul.pipeline thing is there since many days09:55
sshnaidm|roverykarel, well, I think it needs to be "or" there09:56
ykarelsshnaidm|rover, yes good to have09:57
*** wolverineav has quit IRC09:58
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci master: Add OR condition to periodic job detection  https://review.openstack.org/64390609:59
sshnaidm|roverykarel, marios_|ruck ^^09:59
sshnaidm|roverykarel, marios_|ruck is chronyd failures is something happening often? I think I saw them some time ago..09:59
marios_|rucksshnaidm|rover: i had some issues in stanadlone f28 but it was a while ago10:00
marios_|rucksshnaidm|rover: ack will check in a bit10:00
ykarelsshnaidm|rover, yes i seen chrony failures multiple times10:01
sshnaidm|roverI'm afraid it doesn't restart when get new ntp servers and tries to connect to old ones..10:02
sshnaidm|roverat least I saw it doing this once10:03
openstackgerritNatal Ngétal proposed openstack/python-tripleoclient master: Add a progress bar for image upload.  https://review.openstack.org/64075310:03
ykareli just saw failures, didn't looked what caused it10:03
*** shyamb has quit IRC10:04
*** cfontain has joined #tripleo10:11
*** shyamb has joined #tripleo10:14
*** cfontain has quit IRC10:16
sshnaidm|roverin which repo can I find "chrony" role that runs in overcloud deploy?10:22
ykareli think ansible-role-chrony10:24
*** udesale has quit IRC10:28
Hobbestigrouhi10:29
Hobbestigrouplease someone can check this patch https://review.openstack.org/#/c/643910/ ?10:29
*** shyamb has quit IRC10:30
*** shyamb has joined #tripleo10:30
*** lmiccini has quit IRC10:44
*** jbadiapa has quit IRC10:44
*** cfontain has joined #tripleo10:52
*** cfontain has quit IRC10:53
*** saneax has quit IRC10:57
TenguHobbestigrou: hmm, would that allow puppet to at last properly handle the non-ASCII things it fetches from the DB during migrations?10:58
HobbestigrouTengu, yes10:58
TenguHobbestigrou: isn't there a global config file we might want to use instead, just to be 100% sure puppet is called with that option?11:00
Tengunever really used puppet without a daemon/server..11:00
Tenguhm. brb, FOOD :D11:00
HobbestigrouTengu, no11:02
Hobbestigroui think this the best solution11:02
bandiniTengu: fyi I added some overcloud selinux issues on the etherpad (line 390 onwards)11:02
*** ratailor has quit IRC11:04
*** lmiccini has joined #tripleo11:07
*** slaweq_ is now known as slaweq11:14
*** lmiccini has quit IRC11:16
openstackgerritMerged openstack/tripleo-common master: Don't rely on crudini for octavia config  https://review.openstack.org/63718011:16
sshnaidm|rovermarios_|ruck, did you see? https://bugs.launchpad.net/tripleo/+bug/182058711:23
openstackLaunchpad bug 1820587 in tripleo "The tripleo-ci-centos-7-standalone is broken on master." [Undecided,New]11:24
marios_|rucksshnaidm|rover: nop... adding to etherpad ... :/11:24
sshnaidm|rovermarios_|ruck, mm.. tbh I don't see it fails11:25
marios_|rucksshnaidm|rover: yeah http://zuul.openstack.org/builds?job_name=tripleo-ci-centos-7-standalone11:25
marios_|rucklots of green stuff11:25
marios_|ruckone fail on the 16th afaics11:25
sshnaidm|rover2019-03-12 15:29:52.523564 - it's a week before11:25
marios_|rucksshnaidm|rover: added comment11:26
sshnaidm|rovermarios_|ruck, me too :) will close it11:26
marios_|ruckack11:28
sshnaidm|roverweshay|rover, let's merge it please https://review.openstack.org/#/c/643906/11:29
openstackgerritJose Luis Franco proposed openstack/tripleo-heat-templates master: Refactor ovn_dbs upgrade_tasks.  https://review.openstack.org/64392111:31
*** shyamb has quit IRC11:31
*** udesale has joined #tripleo11:45
*** rcernin has quit IRC11:46
*** martinkennelly has quit IRC11:47
*** ansmith has quit IRC11:49
*** hamdyk has joined #tripleo11:50
*** jaosorior has joined #tripleo11:51
*** raildo has joined #tripleo11:52
openstackgerritGael Chamoulaud proposed openstack/tripleo-validations master: Add rabbitmq-limits role  https://review.openstack.org/64012411:52
openstackgerritGael Chamoulaud proposed openstack/tripleo-validations master: Add nova-event-callback role  https://review.openstack.org/64012911:52
openstackgerritGael Chamoulaud proposed openstack/tripleo-validations master: Add mysql-open-files-limit role  https://review.openstack.org/64013111:52
openstackgerritGael Chamoulaud proposed openstack/tripleo-validations master: Add ceph role  https://review.openstack.org/64013511:52
openstackgerritGael Chamoulaud proposed openstack/tripleo-validations master: Add xfs-check-ftype role  https://review.openstack.org/64016011:52
openstackgerritGael Chamoulaud proposed openstack/tripleo-validations master: Add advanced-format-512e-support role  https://review.openstack.org/64016811:52
openstackgerritGael Chamoulaud proposed openstack/tripleo-validations master: Add no-op-firewall-nova-driver role  https://review.openstack.org/64037711:52
openstackgerritGael Chamoulaud proposed openstack/tripleo-validations master: Add controller-token role  https://review.openstack.org/64041011:52
openstackgerritGael Chamoulaud proposed openstack/tripleo-validations master: Add controller-ulimits role  https://review.openstack.org/64041711:52
openstackgerritGael Chamoulaud proposed openstack/tripleo-validations master: Add ctlplane-ip-range role  https://review.openstack.org/64074511:52
openstackgerritGael Chamoulaud proposed openstack/tripleo-validations master: Add node-disks role  https://review.openstack.org/64075411:52
openstackgerritGael Chamoulaud proposed openstack/tripleo-validations master: Add node-health role  https://review.openstack.org/64076011:52
openstackgerritGael Chamoulaud proposed openstack/tripleo-validations master: Add network-environment role  https://review.openstack.org/64076111:52
openstackgerritGael Chamoulaud proposed openstack/tripleo-validations master: Rename undercloud-neutron-sanity-check role  https://review.openstack.org/64077411:52
openstackgerritGael Chamoulaud proposed openstack/tripleo-validations master: Add default-node-count role  https://review.openstack.org/64077611:52
openstackgerritGael Chamoulaud proposed openstack/tripleo-validations master: Add switch-vlans role  https://review.openstack.org/64078611:52
openstackgerritGael Chamoulaud proposed openstack/tripleo-validations master: Add check-latest-minor-version role  https://review.openstack.org/64097211:52
openstackgerritGael Chamoulaud proposed openstack/tripleo-validations master: Add check-network-gateway role  https://review.openstack.org/64097511:52
Tengugchamoul: ouch :]11:52
gchamoulTengu: so stop putting -1 ;-)11:53
openstackgerritMerged openstack/tripleo-heat-templates master: Enable authtoken cache  https://review.openstack.org/64367611:53
Tengugchamoul: I'm not alone :D11:53
gchamoulTengu: kiddin'11:53
Tengugchamoul: seriously: maybe you want to group the things with the container_cli since there are some open questions with them? like, push them as last patches of your huge pile11:53
gchamoulTengu: yes will do that11:54
*** dprince has joined #tripleo11:55
Tengu(sorry zuul ;))11:55
gchamoulTengu: btw, I have a not so ugly way to determine the container_cli for the overcloud11:55
Tengugchamoul: ah? link ?11:55
Tengugchamoul: I've done something for that in some other projects11:56
gchamoulTengu: https://review.openstack.org/#/c/640131/5..6/roles/mysql-open-files-limit/tasks/main.yml11:56
gchamoulfor example11:56
Tengui.e. using systemd in order to know the state of dockerd, matching path for podman and the like.11:56
*** shyamb has joined #tripleo11:56
Tenguerf... "ignore_error" might trigger panda|pto ^^'11:56
Tengulemme show you if I can find it back.11:57
*** rh-jelabarre has joined #tripleo11:57
gchamoulTengu: yes, we were using it for the sake of UI11:58
Tengugchamoul: https://github.com/openstack/tripleo-common/blob/master/roles/tripleo-docker-rm/tasks/main.yaml#L2-L1111:59
Tengugchamoul: that one is probably better. then set_fact and Voilà.11:59
gchamoulTengu will take a look12:00
*** social has joined #tripleo12:00
*** rlandy has joined #tripleo12:01
*** udesale has quit IRC12:01
*** udesale has joined #tripleo12:02
gchamoulTengu: panda|pto is in pto so :P12:07
*** trown|outtypewww is now known as trown12:09
panda|pto...12:10
Tengugchamoul: weeeell... ;)12:10
panda|ptoI get triggered anyway.12:10
gchamoulforgot he always works during PTOs...12:10
TenguXD12:10
*** saneax has joined #tripleo12:11
panda|ptoI wish I could work today, instead of taking care of Italian taxes from 2 years ago.12:11
Tengupanda|pto: damn....12:11
*** lmiccini has joined #tripleo12:17
openstackgerritJose Luis Franco proposed openstack/tripleo-heat-templates master: Refactor ovn_dbs upgrade_tasks.  https://review.openstack.org/64392112:23
*** agopi__ has quit IRC12:23
openstackgerritGael Chamoulaud proposed openstack/tripleo-validations master: Add nova-event-callback role  https://review.openstack.org/64012912:27
openstackgerritGael Chamoulaud proposed openstack/tripleo-validations master: Add ceph role  https://review.openstack.org/64013512:27
openstackgerritGael Chamoulaud proposed openstack/tripleo-validations master: Add xfs-check-ftype role  https://review.openstack.org/64016012:27
openstackgerritGael Chamoulaud proposed openstack/tripleo-validations master: Add advanced-format-512e-support role  https://review.openstack.org/64016812:27
openstackgerritGael Chamoulaud proposed openstack/tripleo-validations master: Add no-op-firewall-nova-driver role  https://review.openstack.org/64037712:27
openstackgerritGael Chamoulaud proposed openstack/tripleo-validations master: Add controller-token role  https://review.openstack.org/64041012:27
openstackgerritGael Chamoulaud proposed openstack/tripleo-validations master: Add controller-ulimits role  https://review.openstack.org/64041712:27
openstackgerritGael Chamoulaud proposed openstack/tripleo-validations master: Add ctlplane-ip-range role  https://review.openstack.org/64074512:27
openstackgerritGael Chamoulaud proposed openstack/tripleo-validations master: Add node-disks role  https://review.openstack.org/64075412:27
openstackgerritGael Chamoulaud proposed openstack/tripleo-validations master: Add node-health role  https://review.openstack.org/64076012:27
openstackgerritGael Chamoulaud proposed openstack/tripleo-validations master: Add network-environment role  https://review.openstack.org/64076112:27
openstackgerritGael Chamoulaud proposed openstack/tripleo-validations master: Rename undercloud-neutron-sanity-check role  https://review.openstack.org/64077412:27
*** florianf has quit IRC12:27
openstackgerritGael Chamoulaud proposed openstack/tripleo-validations master: Add default-node-count role  https://review.openstack.org/64077612:27
openstackgerritGael Chamoulaud proposed openstack/tripleo-validations master: Add switch-vlans role  https://review.openstack.org/64078612:27
openstackgerritGael Chamoulaud proposed openstack/tripleo-validations master: Add check-latest-minor-version role  https://review.openstack.org/64097212:27
openstackgerritGael Chamoulaud proposed openstack/tripleo-validations master: Add check-network-gateway role  https://review.openstack.org/64097512:27
openstackgerritGael Chamoulaud proposed openstack/tripleo-validations master: Add collect-flavors-and-verify-profiles role  https://review.openstack.org/64102712:27
openstackgerritGael Chamoulaud proposed openstack/tripleo-validations master: Add deployment-images role  https://review.openstack.org/64131912:27
*** florianf has joined #tripleo12:27
*** udesale has quit IRC12:27
*** udesale has joined #tripleo12:28
*** aedc has joined #tripleo12:41
*** ansmith has joined #tripleo12:48
*** shyamb has quit IRC12:48
*** abishop has joined #tripleo12:49
*** agopi__ has joined #tripleo12:50
*** mcornea has joined #tripleo12:53
*** bfournie has quit IRC12:53
*** pcaruana|afk| has joined #tripleo12:54
*** pcaruana has quit IRC12:56
*** jpena is now known as jpena|lunch12:57
*** jtomasek has quit IRC13:03
*** morazi has joined #tripleo13:03
*** jtomasek_ has joined #tripleo13:03
*** jtomasek_ has quit IRC13:05
*** jtomasek has joined #tripleo13:05
openstackgerritBrent Eagles proposed openstack/tripleo-heat-templates master: DNM: checking existing multinode job against current state  https://review.openstack.org/64393413:06
openstackgerritMartin Schuppert proposed openstack/tripleo-heat-templates master: Run chown for nova log files on every run to fix wrong permissions  https://review.openstack.org/64393613:21
*** hberaud has joined #tripleo13:23
*** bfournie has joined #tripleo13:27
*** vinaykns has joined #tripleo13:30
*** morazi has quit IRC13:31
openstackgerritBrent Eagles proposed openstack/tripleo-heat-templates master: DNM: checking existing multinode job against current state  https://review.openstack.org/64393413:31
*** ade_lee__ has quit IRC13:31
*** ade_lee has joined #tripleo13:32
*** morazi has joined #tripleo13:32
openstackgerritBrent Eagles proposed openstack/tripleo-heat-templates master: DNM: checking existing multinode job against current state  https://review.openstack.org/64393413:34
openstackgerritBrent Eagles proposed openstack/tripleo-heat-templates master: DNM: checking existing multinode job against current state  https://review.openstack.org/64393413:36
*** skramaja_ has joined #tripleo13:37
*** skramaja has quit IRC13:38
*** absubram has joined #tripleo13:41
*** absubram_ has joined #tripleo13:42
*** absubram has quit IRC13:45
*** absubram_ is now known as absubram13:45
*** pcaruana|afk| has quit IRC13:48
openstackgerritEmilien Macchi proposed openstack/tripleo-common master: WIP - breakdown kolla template overrides  https://review.openstack.org/64292913:48
*** morazi has quit IRC13:49
*** tzumainn has joined #tripleo13:50
*** mjturek has joined #tripleo13:51
*** mcornea has quit IRC13:56
*** morazi has joined #tripleo13:58
openstackgerritEmilien Macchi proposed openstack/python-tripleoclient master: undercloud: python3 support for custom envs  https://review.openstack.org/64395013:59
*** amoralej is now known as amoralej|lunch14:02
*** skramaja_ has quit IRC14:03
*** jpena|lunch is now known as jpena14:04
*** dtrainor has joined #tripleo14:05
openstackgerritEmilien Macchi proposed openstack/tripleo-common master: WIP - breakdown kolla template overrides  https://review.openstack.org/64292914:11
*** mcornea has joined #tripleo14:14
*** agurenko has joined #tripleo14:15
*** dciabrin has quit IRC14:16
*** dciabrin has joined #tripleo14:16
openstackgerritAlex Schultz proposed openstack/tripleo-heat-templates stable/rocky: Enable authtoken cache  https://review.openstack.org/64395914:26
*** morazi has quit IRC14:28
*** morazi has joined #tripleo14:29
openstackgerritSorin Sbarnea proposed openstack/tripleo-quickstart master: [WIP] Add release configuration for stein  https://review.openstack.org/64396314:29
*** hjensas has quit IRC14:33
*** pcaruana has joined #tripleo14:33
weshay|roverjaosorior mwhahaha fyi.. master promotion incoming14:37
jaosorior:D14:37
rlandymwhahaha: why is 'Restart chronyd' false for the novacompute node? If you set a different server, it is never used. https://logs.rdoproject.org/33/614633/12/openstack-check/tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001/d4fba04/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz#_2019-03-18_07_47_06. The restart runs on the controller nodes.14:39
*** morazi has quit IRC14:40
*** shyamb has joined #tripleo14:41
mwhahaharlandy: because it wasn't running so the prvious task started it (no restart required)14:42
openstackgerritMerged openstack/tripleo-heat-templates stable/rocky: Add Mellanox SDN ML2 template for a containerized service  https://review.openstack.org/63902414:43
openstackgerritMerged openstack/python-tripleoclient master: First check ipv4 then ipv6 connectivity  https://review.openstack.org/64296214:43
rlandymwhahaha: I am using a custom ntp server. The server is set in /etc/chrony.conf but 'chronyc waitsync 20' does not return 0. If I get on the node and restart the service, it passes. Can we force the restart after?14:46
mwhahahanetworking?14:46
mwhahahacompute nodes dont' have internet access14:46
rlandythey do. If I manually restart the service, 'chronyc waitsync 20' works14:47
mwhahahawe haven't changed this code14:47
mwhahahasince we turned it on months ago14:47
mwhahahasomething else has changed14:47
*** morazi has joined #tripleo14:47
rlandyare we testing a custom ntp server anywhere?14:47
rlandyguessing that ci jobs never use a custom server that requires the restart14:48
mwhahahait would always restart it14:48
mwhahahabecause our list is different than the shipped one14:48
rlandyalways restarting it would help the custom server case - if that would not badly impact any of the current CI workflow14:49
mwhahahawe shouldn't always restart14:50
mwhahahasomething else has changed14:50
*** saneax has quit IRC14:50
*** amoralej|lunch is now known as amoralej14:54
mwhahahaalso we're relying on ansible to handle the restart logic. the only conditional we have is chrony_manage_service which is set to true14:57
mwhahahahttps://github.com/openstack/ansible-role-chrony/blob/master/handlers/main.yml14:57
rlandychecking where that setting14:59
mwhahahawe don't set it in tripleo so it's the default of true15:01
mwhahahai'd be willing to bet that it's more an environment thing than a chrony related thing15:02
mwhahahabecause you know rdo cloud is the most stable thing ever15:02
rlandylol15:02
*** shyamb has quit IRC15:03
*** dciabrin has quit IRC15:03
*** dciabrin has joined #tripleo15:03
*** boazel_ has joined #tripleo15:05
*** boazel has quit IRC15:08
*** hamdyk has quit IRC15:13
*** janki has quit IRC15:26
*** absubram has quit IRC15:29
*** absubram has joined #tripleo15:29
bogdandorlandy, mwhahaha: for the given logs, I think it got False http://git.openstack.org/cgit/openstack/tripleo-heat-templates/tree/deployment/timesync/chrony-baremetal-ansible.yaml#n15815:33
bogdandovia EnablePackageInstall15:33
bogdandowhere to trace down its actual value?15:33
mwhahahabut it's manage service15:33
mwhahahanot package15:33
*** moguimar has left #tripleo15:34
bogdandomwhahaha: just tracking the override it took15:34
bogdandochrony_manage_package was definitely falsy15:34
rlandybogdando: thanks for looking into this15:34
mwhahahai codesearch'ed it and no one is setting chrony_manage_service15:34
bogdandomwhahaha: #158 does15:34
mwhahahachrony_manage_package15:34
mwhahahanot chrony_manage_service15:35
bogdandoin ansible_group_vars15:35
mwhahahathey are two different things15:35
bogdandooh indeed15:35
rlandyrestart happens on the controller nodes15:35
mwhahahalook it's likely rdo cloud can't ntp whatever servers it's configured with15:35
mwhahahaif it's only compute that points to the masquerade conf or something15:36
mwhahahaor the network config15:36
mwhahahagotta stop focusing on the restart15:36
mwhahahabecause it's likely not already running on compute so a service start will skip a restart15:36
bogdandomwhahaha: but the ansible logs look weird15:39
bogdandothere is no "Ensure chrony has been restarted"15:39
bogdandobut there is records for the next and prev tasks15:40
bogdandoEnsure system is NTP time synced15:40
bogdandoand Disable NTP before configuring Chrony15:40
bogdandoand include_role : chrony got skipped.. why15:40
mwhahahawhat logs are you looking at15:41
*** ykarel is now known as ykarel|away15:41
mwhahahawe include rol chrony 5 times15:41
openstackgerritMerged openstack/python-tripleoclient master: Create commands for configuring BIOS on given nodes  https://review.openstack.org/57647115:42
mwhahaha(seems a bit excessive)15:42
bogdandohttps://logs.rdoproject.org/33/614633/12/openstack-check/tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001/d4fba04/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz#_2019-03-18_07_47_0615:42
mwhahahawe do nova compute first evidently15:43
mwhahahameh this log is so big15:44
*** morazi has quit IRC15:44
mwhahahahttps://logs.rdoproject.org/33/614633/12/openstack-check/tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001/d4fba04/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz#_2019-03-18_07_46_0515:44
bogdandomwhahaha: we do "include_role : chron" 5 times indeed, and it got skipped all :)15:47
mwhahahabut it didn't15:47
mwhahahai think ansible's output is just stupid15:47
bogdando:D15:47
mwhahahabecause it says it wasn't included but runs all the tasks15:47
bogdandoright, 1st time was skipped for overcloud-novacompute-0 only15:48
bogdandobut anyway I don't understand why it eats some tasks off the defined in host prep tasks15:49
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates stable/rocky: Revert "Revert "docker: wire SELinuxMode with Ansible vars""  https://review.openstack.org/64425715:50
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates stable/rocky: Revert "Revert "docker: wire SELinuxMode with Ansible vars""  https://review.openstack.org/64425715:50
*** kplant has joined #tripleo15:50
*** morazi has joined #tripleo15:50
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates stable/rocky: Revert "Revert "Set proper setype for service directories""  https://review.openstack.org/64425815:50
*** weshay|rover changes topic to "CI Status: GREENISH, RDOCloud Status: GREEN, promoted current-tripleo 3/18 | https://docs.openstack.org/tripleo-docs/latest/"15:50
weshay|rovermwhahaha jaosorior ^15:51
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates stable/rocky: Revert "Revert "Create missing directories before mounting them""  https://review.openstack.org/64426015:51
mwhahahaweshay|rover: a likely story15:51
weshay|roveractually an unlikely story15:51
bandinijaosorior: fyi https://bugs.launchpad.net/tripleo/+bug/1820577 filed today by lmiccini15:52
openstackLaunchpad bug 1820577 in tripleo "overcloud deployment fails at Run container-puppet tasks (generate config) during step 1 - /etc/pki/tls/private/haproxy: no such file or directory" [Undecided,New]15:52
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates stable/rocky: Revert "Revert "Create missing directories before mounting them""  https://review.openstack.org/64426015:53
jaosoriorbandini: how was it deployed?15:55
openstackgerritGael Chamoulaud proposed openstack/tripleo-validations master: Add Podman support to mysql-open-files-limit validation  https://review.openstack.org/64426215:56
bandinijaosorior: so we used overcloud-ssl yes with infrared. i will try and chase down the full failed command and add it to the lp15:56
jaosoriorbandini: ok15:56
bogdandomwhahaha: that build log looks strange, nova-compute-0 seems like skipping the world15:57
bogdandowas it some UNREACHABLE status eaten in logs?15:58
bogdandoso it got skipped all15:58
jaosoriorbandini: also, let me know if there's a reproducer environment.15:58
mwhahahawell that log was a success, so need to find a failure log15:59
mwhahahaseems odd anywya15:59
bandinijaosorior: ack I can get you one by tomorrow I think15:59
openstackgerritRedHat RDO CI proposed openstack/tripleo-heat-templates master: GATE CHECK for TripleO  https://review.openstack.org/60429816:00
openstackgerritRedHat RDO CI proposed openstack/tripleo-heat-templates stable/rocky: GATE CHECK for TripleO  https://review.openstack.org/60429316:00
*** rpioso is now known as rpioso|afk16:01
rlandyhttps://sf.hosted.upshift.rdu2.redhat.com/logs/25/165325/11/check/periodic-tripleo-ci-centos-7-baremetal-single_nic-3ctlr_1comp-featureset001-master/43a3306/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz#_2019-03-18_05_12_35 is the failing log16:01
*** suuuper has quit IRC16:01
*** weshay|rover is now known as weshay16:02
rlandymwhahaha: bogdando: ^^ because of the custom server set16:02
openstackgerritGael Chamoulaud proposed openstack/tripleo-validations master: Add Podman support to rabbitmq-limits validation  https://review.openstack.org/64426416:03
*** agurenko has quit IRC16:05
openstackgerritGael Chamoulaud proposed openstack/tripleo-validations master: Add rabbitmq-limits role  https://review.openstack.org/64012416:08
openstackgerritGael Chamoulaud proposed openstack/tripleo-validations master: Add mysql-open-files-limit role  https://review.openstack.org/64013116:08
bogdandorlandy, mwhahaha: so for the latter job logs, Install chrony configuration file has changed: true, but nothing notifies the service16:13
bogdandoso handler has nothing to restart16:13
bogdandoit seems the only notify gets from Ensure chronyd is running: true16:14
bogdandoor if a package was installed16:14
bogdandohttp://git.openstack.org/cgit/openstack/ansible-role-chrony/tree/tasks/config.yml#n9 fails to produce a notify?..16:15
*** cylopez has quit IRC16:16
sshnaidm|roverbogdando, hey16:17
bogdandohi16:17
sshnaidm|roverbogdando, just today dealt with that16:17
bogdandoiirc, handlers are very special to variables scoping16:17
openstackgerritwes hayutin proposed openstack/tripleo-quickstart-extras master: update the master skip list for barbican  https://review.openstack.org/64427016:17
bogdandomay be we should remove conditions from it16:17
sshnaidm|roverbogdando, I saw handler working finally16:17
bogdandomhh16:17
openstackgerritHarald Jensås proposed openstack/python-tripleoclient master: Undercloud - ironic inspector - host routes  https://review.openstack.org/64304216:17
sshnaidm|roverbogdando, are we talking about https://bugs.launchpad.net/tripleo/+bug/182058016:18
openstackLaunchpad bug 1820580 in tripleo "Chronyd sync fails in overcloud deployment" [Critical,Triaged]16:18
bogdandoyes16:18
bogdandosshnaidm|rover: https://sf.hosted.upshift.rdu2.redhat.com/logs/25/165325/11/check/periodic-tripleo-ci-centos-7-baremetal-single_nic-3ctlr_1comp-featureset001-master/43a3306/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz#_2019-03-18_05_12_3516:18
*** morazi has quit IRC16:18
sshnaidm|roverbogdando, in my bug I saw: 2019-03-18 08:34:50 | RUNNING HANDLER [chrony : Restart chronyd]16:19
bogdandowell it triggers but got skipped16:19
*** morazi has joined #tripleo16:20
sshnaidm|roverbogdando, I see, in upstream it "changed" though16:20
sshnaidm|roverbut still fails :D16:20
bogdandoI think that's when: fails it due to wrong scoping16:20
bogdandolet's just debug the val and see16:20
*** udesale has quit IRC16:21
sshnaidm|roverbogdando, yeah, would be helpful16:23
*** mpjetta has quit IRC16:25
*** mpjetta has joined #tripleo16:27
*** shyamb has joined #tripleo16:28
rlandysshnaidm|rover: https://bugs.launchpad.net/tripleo/+bug/1820580 looks like what I am now seeing in baremetal16:28
openstackLaunchpad bug 1820580 in tripleo "Chronyd sync fails in overcloud deployment" [Critical,Triaged]16:28
*** aufi has quit IRC16:29
rlandybut I see that on nova compute16:30
*** hjensas has joined #tripleo16:30
rlandyon second thoughts - it may be different - I don't see the traceback error16:31
sshnaidm|roverrlandy, traceback just tells about overcloud failure16:32
sshnaidm|roverrlandy, the reason is chronyd is stuck, and I see it not first time16:32
sshnaidm|rovermarios_|ruck,  https://bugs.launchpad.net/tripleo/+bug/1820580 is not a promotion blocker, can I remove the tag there?16:33
openstackLaunchpad bug 1820580 in tripleo "Chronyd sync fails in overcloud deployment" [Critical,Triaged]16:33
rlandysshnaidm|rover: if it helps I have the bm overcloud node available16:34
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates stable/rocky: Revert "Revert "Set proper setype for service directories""  https://review.openstack.org/64425816:34
sshnaidm|roverrlandy, and is it consistent for bm?16:34
rlandyI restarted the service manually and confirmed that it works after service reststart16:34
sshnaidm|roverrlandy, sure, I can look16:34
rlandysshnaidm|rover: can't really say - first time master bm deployment has gotten this far16:35
sshnaidm|roverrlandy, yeah, I saw this too when it doesn't restart. In my case it fails after a restart too16:35
*** wolverineav has joined #tripleo16:35
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates stable/rocky: Revert "Revert "docker: wire SELinuxMode with Ansible vars""  https://review.openstack.org/64425716:37
bogdandomwhahaha: I think this http://git.openstack.org/cgit/openstack/tripleo-heat-templates/tree/deployment/timesync/chrony-baremetal-ansible.yaml#n123 belong to the caller's handler scope, not the imported role16:40
mwhahahabogdando: no16:41
bogdandotrying to repro with a dummy role16:41
mwhahahaso it's specific to tripleo16:41
mwhahahabecause otherwise it won't restart until the end of the playbook16:41
mwhahahaand it's not something we want in the role itself16:41
mwhahahaif you don't flush handler, the next task fails when you change it16:41
mwhahahai swear this is an environmental thing16:42
mwhahahabecause if it was code, it would happen all the time downstream16:42
mwhahaha(and it doesn't)16:42
bogdandoI'm not sure it works at the playbooks level mwhahaha16:42
mwhahahait does16:42
bogdandoI know that it does and works for roles tho16:42
bogdandook, just trying to test this locally with a simple play...16:42
mwhahahai'm not hitting this downstream where we have to set the ntp servers16:42
mwhahahaso i know for a fact it's working correctly16:43
bogdandosame ansible versions?16:43
mwhahahaansible-2.7.6-1.el8.noarch16:43
*** gfidente has quit IRC16:44
*** brault has joined #tripleo16:45
*** shyamb has quit IRC16:46
*** brault has quit IRC16:50
*** morazi has quit IRC16:50
openstackgerritMartin Schuppert proposed openstack/tripleo-heat-templates stable/rocky: Remove ENV parameters for nova_cell_v2_discover_host.py  https://review.openstack.org/64428216:51
*** wolverineav has quit IRC16:52
*** morazi has joined #tripleo16:52
openstackgerritMartin Schuppert proposed openstack/tripleo-heat-templates stable/queens: Remove ENV parameters for nova_cell_v2_discover_host.py  https://review.openstack.org/64428416:53
*** gfidente has joined #tripleo16:55
weshayain't no party like a merge party cause a mege party don't quit!!16:55
bogdandomwhahaha: hm, works like a charm16:58
mwhahahaexactly16:58
mwhahahawe'd hit this all the time if this was a code problem16:58
*** itlinux has joined #tripleo16:58
*** wolverineav has joined #tripleo16:59
openstackgerritMartin Schuppert proposed openstack/tripleo-heat-templates stable/rocky: Remove unused parameter NovaPassword  https://review.openstack.org/64429417:00
openstackgerritMartin Schuppert proposed openstack/tripleo-heat-templates stable/rocky: Remove unused parameter NovaPassword  https://review.openstack.org/64429417:03
*** trown is now known as trown|lunch17:03
openstackgerritMartin Schuppert proposed openstack/tripleo-heat-templates stable/queens: Remove unused parameter NovaPassword  https://review.openstack.org/64429617:04
openstackgerritMerged openstack/tripleo-common master: cleanup sensu-client packages drop list  https://review.openstack.org/64294117:06
openstackgerritMerged openstack/tripleo-common master: Adjust where iptables-services is injected  https://review.openstack.org/64294517:06
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates stable/rocky: Optional ICMP validation of controllers and gateways  https://review.openstack.org/64429817:06
bogdandomwhahaha right, just that http://paste.openstack.org/show/747980/ reads as nonsense17:06
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates stable/queens: Optional ICMP validation of controllers and gateways  https://review.openstack.org/64429917:06
mwhahahapretty much17:06
bogdando:D17:07
*** mcornea has quit IRC17:08
*** bogdando has quit IRC17:13
weshayjaosorior this is fixed now right? https://bugs.launchpad.net/tripleo/+bug/181910517:13
openstackLaunchpad bug 1819105 in tripleo "IPv6 value in httpd's proxy_ips is breaking horizon" [Critical,In progress] - Assigned to Juan Antonio Osorio Robles (juan-osorio-robles)17:13
jaosoriorweshay: yeah17:14
jaosoriorweshay: this merged already https://github.com/puppetlabs/puppetlabs-apache/commit/7a33327f7b649f6dfa48aedd972036bfa23a399b17:14
*** ykarel|away has quit IRC17:18
sshnaidm|roveris "chrony_manage_service" true there?17:19
sshnaidm|rovermwhahaha, ^^17:20
mwhahahait's always true, we don't set it anywhere except in the defaults in the role17:20
sshnaidm|roverif it's not, then it explains why handler is skipped17:20
mwhahahathere is no reference to it in code17:20
mwhahahahttp://codesearch.openstack.org/?q=chrony_manage_service&i=nope&files=&repos=17:20
mwhahahapeople, it's rdo cloud17:20
mwhahahalike we can keep going around in circles about terrible ansible output and other things but it's environmental if it's not happening 100%17:21
sshnaidm|rovernon working hanlder? environmental thing?17:21
mwhahahawho says it's the handler17:22
rlandybaremetal does not run on rdocloud17:22
mwhahahajust cause it hapens tow ork later17:22
* mwhahaha gives up17:22
mwhahahayou guys figure it out17:22
mwhahahaadd some print statements in there or turn ansible debug on17:22
*** mpjetta has quit IRC17:22
*** kopecmartin is now known as kopecmartin|off17:22
rlandysshnaidm|rover: I am restarting the bm job ... pls log out of vm and zuul use there17:23
*** mcornea has joined #tripleo17:24
sshnaidm|roverrlandy, I'm out17:24
rlandythanks17:25
*** rpioso|afk is now known as rpioso17:25
bandinijaosorior: ok added more info https://bugs.launchpad.net/tripleo/+bug/1820577, will have an env tomorrow17:26
openstackLaunchpad bug 1820577 in tripleo "overcloud deployment fails at Run container-puppet tasks (generate config) during step 1 - /etc/pki/tls/private/haproxy: no such file or directory" [Undecided,New]17:26
*** yprokule has quit IRC17:26
mwhahaharlandy, sshnaidm|rover: why are you only configuring a single source?17:27
mwhahahathat's the problem17:27
mwhahahahttps://logs.rdoproject.org/openstack-periodic/git.openstack.org/openstack-infra/tripleo-ci/master/periodic-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-master/4978205/logs/overcloud-controller-0/etc/chrony.conf.txt.gz17:27
mwhahahayou need multiple sources17:27
mwhahahachrony doesn't work like ntp17:27
mwhahahait won't retry the lookup17:27
mwhahahawe switched the default to multiple sources for a reason17:28
rlandycan add multiple sources in the next run - OVB would use default sources17:29
rlandynot the one custom one17:29
mwhahahahttps://review.openstack.org/#/c/621930/17:29
sshnaidm|rovermwhahaha, in my case in rdo cloud it has multiple sources: http://logs.rdoproject.org/openstack-periodic/git.openstack.org/openstack-infra/tripleo-ci/master/periodic-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-master/4978205/logs/undercloud/etc/chrony.conf.txt.gz17:29
mwhahahai pulled that log from the bug report17:29
mwhahahahttps://launchpad.net/tripleo/+bug/182058017:30
openstackLaunchpad bug 1820580 in tripleo "Chronyd sync fails in overcloud deployment" [Critical,Triaged]17:30
*** mpjetta has joined #tripleo17:30
mwhahahaso let's stop looking at various logs and let's concentrate on a single config plz17:30
mwhahahais that the bug you're working on or not17:30
sshnaidm|rovermwhahaha, oh, it's overcloud17:30
*** lmiccini has quit IRC17:31
sshnaidm|rovermwhahaha, and what does configure it? it's not ci code I suppose17:31
mwhahahait's ci code17:31
mwhahahabecause the default will be those 4 servers17:31
sshnaidm|rovermwhahaha, role default is one server: chrony_ntp_pools: ['pool.ntp.org']17:33
mwhahahathat's pool17:33
mwhahahawe don't use pool17:33
mwhahahawe use server17:33
sshnaidm|rovermwhahaha, then it's just empty chrony_ntp_servers: []17:34
sshnaidm|roverso which parameter is passed there to role?17:34
mwhahahahttps://github.com/openstack/tripleo-quickstart-extras/blob/29857bee45530d71b6d053f7680439bac51b8ab5/roles/overcloud-deploy/tasks/pre-deploy.yml#L7417:34
mwhahahafix that17:34
sshnaidm|roversomething like --ntp-server ?17:34
*** ramishra has quit IRC17:35
mwhahahaor drop it17:35
mwhahaha(i'd recommend dropping it)17:35
openstackgerritHarald Jensås proposed openstack/tripleo-heat-templates master: Remove UndercloudCtlplaneSubnets defaults in UC env  https://review.openstack.org/64437317:35
mwhahahantp-server needs to get added multiple times (not sure if it does)17:35
sshnaidm|rovermwhahaha, how then can we configure it if we drop it?17:35
mwhahahaNtpServer in an environment file17:35
mwhahahalet me see17:35
rlandyin the network-environment.yaml file17:35
sshnaidm|roverafaik this file is not in all jobs17:36
rlandysshnaidm|rover, NtpServer17:36
rlandysshnaidm|rover: we can append to that file17:36
rlandywe did that with mtu values17:36
sshnaidm|roverrlandy, does  network-environment.yaml apply for all jobs? I think for net-iso only, isn't it?17:37
openstackgerritHarald Jensås proposed openstack/tripleo-quickstart-extras master: Use non-default ctlplane subnet in undercloud.conf  https://review.openstack.org/64368217:37
openstackgerritwes hayutin proposed openstack/tripleo-quickstart-extras master: [WIP] unskipping bootvolumepattern in order to get it fixed and design a logstash query  https://review.openstack.org/63547817:37
rlandysshnaidm|rover; there is nothing stopping us passing a local network-environment file to any job17:37
mwhahaharlandy: sshnaidm|rover: you can also just use mutiple servers with --ntp-server, just make them comma seperated (no spaces)17:38
mwhahaha--ntp-server gets translated to NtpServer17:38
mwhahahahttps://github.com/openstack/python-tripleoclient/blob/385a797ccb02f8aebfe2601bd11ad19a6418cb4c/tripleoclient/v1/overcloud_deploy.py#L9617:38
mwhahahaso it'll end up being NtpServer: host1,host2,host317:38
mwhahahawhich is fine17:38
* rlandy tries that17:38
sshnaidm|roveryeah, seem like it's better17:38
openstackgerritwes hayutin proposed openstack/tripleo-quickstart-extras master: unskipping bootvolumepattern in order to get it fixed and design a logstash query  https://review.openstack.org/63547817:38
sshnaidm|roverto make it comma separated string17:39
mwhahahayou're basically hitting https://bugs.launchpad.net/tripleo/+bug/180652117:39
openstackLaunchpad bug 1806521 in tripleo "deployment fails on Ensure system is NTP time synced" [Critical,Fix released] - Assigned to Alex Schultz (alex-schultz)17:39
mwhahahacause of the ntp_server config17:39
*** amoralej is now known as amoralej|off17:41
*** rpittau is now known as rpittau|afk17:43
*** martinkennelly has joined #tripleo17:45
martinkennellyHey all, anyone ever see ridiculous slow vm boots (20x slower, 5m to cloud init) on 16.04 installs. I switched to qemu virt type and it fixed it, but at the cost of qemu.17:46
martinkennellyIts a nested node.17:47
openstackgerritEmilien Macchi proposed openstack/python-tripleoclient master: undercloud: python3 support for custom envs  https://review.openstack.org/64395017:47
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci master: Add multiple ntp servers  https://review.openstack.org/64437817:48
sshnaidm|roverrlandy, mwhahaha let's see ^^17:48
*** itlinux has quit IRC17:50
*** chandankumar is now known as raukadah17:51
*** itlinux has joined #tripleo17:54
*** trown|lunch is now known as trown18:00
*** jpena is now known as jpena|off18:06
*** cfontain has joined #tripleo18:08
*** itlinux has quit IRC18:10
EmilienMjaosorior: hey, please look at https://bugs.launchpad.net/tripleo/+bug/182057718:12
openstackLaunchpad bug 1820577 in tripleo "overcloud deployment fails at Run container-puppet tasks (generate config) during step 1 - /etc/pki/tls/private/haproxy: no such file or directory" [High,Triaged]18:12
EmilienMjaosorior: it sounds like /etc/pki/tls/private/haproxy needs to be created in host_prep_tasks somewhere18:12
EmilienMjaosorior: since podman fails if the source of a bind mount doesn't exist18:13
*** itlinux has joined #tripleo18:15
*** cfontain has quit IRC18:16
*** morazi has quit IRC18:17
*** iurygregory has quit IRC18:17
*** jtomasek has quit IRC18:18
*** morazi has joined #tripleo18:18
*** hjensas has quit IRC18:19
*** jtomasek has joined #tripleo18:19
*** dprince has quit IRC18:22
*** dtantsur is now known as dtantsur|afk18:23
openstackgerritRafael Folco proposed openstack-infra/tripleo-ci master: Branching stable/stein upstream jobs  https://review.openstack.org/64438618:24
*** wolverineav has quit IRC18:31
*** itlinux has quit IRC18:34
*** itlinux has joined #tripleo18:38
*** morazi has quit IRC18:38
*** morazi has joined #tripleo18:38
*** gfidente has quit IRC18:42
weshaymwhahaha $topic for tomorrow.. branching for stein18:48
weshayjaosorior ^18:48
*** wolverineav has joined #tripleo18:49
mwhahahak18:50
*** saneax has joined #tripleo18:51
openstackgerritNagasai Vinaykumar Kapalavai proposed openstack/tripleo-heat-templates master: Include python-panko client.  https://review.openstack.org/63759718:56
*** saneax has quit IRC19:00
openstackgerritSergii Golovatiuk proposed openstack/tripleo-heat-templates master: Remove UpgradeRemoveUnusedPackages  https://review.openstack.org/64439819:10
*** sshnaidm|rover is now known as sshnaidm|afk19:13
*** itlinux has quit IRC19:15
openstackgerritNagasai Vinaykumar Kapalavai proposed openstack/tripleo-heat-templates master: Qdr: Add InternalTLS support  https://review.openstack.org/63942319:17
openstackgerritwes hayutin proposed openstack/tripleo-heat-templates stable/rocky: GATE CHECK for TripleO  https://review.openstack.org/64440019:21
*** itlinux has joined #tripleo19:24
*** dprince has joined #tripleo19:24
*** wolverineav has quit IRC19:25
*** jfrancoa has quit IRC19:28
openstackgerritNagasai Vinaykumar Kapalavai proposed openstack/tripleo-heat-templates master: Qdr: Add InternalTLS support  https://review.openstack.org/63942319:33
*** cfontain has joined #tripleo19:42
*** hjensas has joined #tripleo19:44
*** wolverineav has joined #tripleo19:44
*** wolverineav has quit IRC19:48
*** wolverineav has joined #tripleo19:48
openstackgerritMerged openstack/python-tripleoclient master: Refactor reading kolla config in image builder  https://review.openstack.org/63999119:49
openstackgerritMerged openstack/puppet-tripleo master: Deprecate warnings for Ceilometer and Gnocchi  https://review.openstack.org/64241419:49
openstackgerritMerged openstack/puppet-tripleo master: Run octavia-api under apache  https://review.openstack.org/63637919:49
openstackgerritMerged openstack/tripleo-common stable/rocky: Introduce a --plan option to replace --config-download-dir  https://review.openstack.org/64328719:49
openstackgerritMerged openstack/tripleo-common stable/rocky: Add ability to run osa playbooks from tripleo-deploy-openshift  https://review.openstack.org/64328819:49
openstackgerritMerged openstack/tripleo-common stable/rocky: Pass additional args to tripleo-deploy-openshift as ansible options  https://review.openstack.org/64328919:49
openstackgerritMerged openstack/tripleo-common stable/rocky: Option to run osa playbooks from path  https://review.openstack.org/64329019:50
openstackgerritMerged openstack/tripleo-heat-templates stable/rocky: Fix idempotency for horizon container logs  https://review.openstack.org/64297919:50
*** itlinux has quit IRC19:53
*** cfontain has quit IRC19:54
*** itlinux has joined #tripleo19:57
openstackgerritMerged openstack/tripleo-heat-templates stable/rocky: Add missing entries for Pure Storage Cinder Backend and fix typos  https://review.openstack.org/64176419:57
weshayMERGE PARTY19:57
openstackgerritMerged openstack/python-tripleoclient stable/rocky: Don't validate stack when creating/updating plan  https://review.openstack.org/64119119:57
openstackgerritMerged openstack/tripleo-heat-templates stable/rocky: Don't create service or endpoint for cinder API v1  https://review.openstack.org/64048019:57
openstackgerritMerged openstack/tripleo-puppet-elements stable/queens: Add numactl to overcloud image  https://review.openstack.org/64304019:57
openstackgerritMerged openstack/tripleo-heat-templates stable/queens: Switch scenario004-multinode-containers to Ceph filestore  https://review.openstack.org/64275419:57
openstackgerritMerged openstack/tripleo-heat-templates stable/queens: Fix idempotency for horizon container logs  https://review.openstack.org/64271819:57
openstackgerritMerged openstack/tripleo-heat-templates stable/queens: Tag tasks in in common tasks  https://review.openstack.org/64176919:57
openstackgerritMerged openstack/tripleo-heat-templates stable/queens: Add missing entries for Pure Storage Cinder Backend and fix typos  https://review.openstack.org/64176619:57
openstackgerritMerged openstack/tripleo-heat-templates master: fix tox python3 overrides  https://review.openstack.org/60823919:57
openstackgerritMerged openstack/tripleo-common master: Drop py35 jobs  https://review.openstack.org/63960619:57
openstackgerritMerged openstack/python-tripleoclient stable/queens: openstack overcloud failures  https://review.openstack.org/63982019:57
openstackgerritMerged openstack/python-tripleoclient master: Add unit tests for running and listing validations from the CLI  https://review.openstack.org/63842619:57
weshayMERGE PARTY19:57
weshayMERGE PARTY19:57
*** morazi has quit IRC19:58
*** morazi has joined #tripleo20:00
*** morazi has quit IRC20:08
*** morazi has joined #tripleo20:08
*** wolverineav has quit IRC20:09
*** wolverineav has joined #tripleo20:10
*** irclogbot_3 has joined #tripleo20:13
mwhahahadat stability20:14
mwhahahapretty sure it'll stop working in about an hour20:14
EmilienMweshay: YES YES20:15
EmilienMweshay: that happens when you remove voting on jobs :P20:15
weshaymwhahaha everything merged so.. if it all crashes we're done for the week20:16
*** wolverineav has quit IRC20:16
openstackgerritMerged openstack/os-net-config master: Removing the warnings generated due to yaml.load()  https://review.openstack.org/64323020:16
openstackgerritMerged openstack/tripleo-quickstart-extras master: The |bool seems to prevent the |default to kick in  https://review.openstack.org/64385720:16
*** wolverineav has joined #tripleo20:16
weshayweeee20:16
mwhahahaweshay: i'm done for the week after today anyway, you're on your own20:16
* mwhahaha runs away20:16
weshaylolz20:16
*** wolverineav has quit IRC20:16
*** wolverineav has joined #tripleo20:17
weshaygates going to be empty on a monday20:17
weshaywho are we20:17
*** holser_ has quit IRC20:17
openstackgerritAlex Schultz proposed openstack/tripleo-common master: Use ansible virtual package  https://review.openstack.org/64287520:24
*** irclogbot_3 has quit IRC20:25
*** abishop has quit IRC20:26
*** irclogbot_3 has joined #tripleo20:28
*** cfontain has joined #tripleo20:44
*** kplant has quit IRC20:45
*** cfontain has quit IRC20:48
*** jfrancoa has joined #tripleo20:52
*** holser_ has joined #tripleo20:53
*** pcaruana has quit IRC20:54
openstackgerritJohn Fulton proposed openstack/tripleo-heat-templates master: Open firewall port 3300 for ceph monitors v2 protocol  https://review.openstack.org/64368520:56
*** ansmith has quit IRC20:57
*** trown is now known as trown|outtypewww20:59
*** itlinux has quit IRC21:01
*** mjturek has quit IRC21:04
*** rh-jelabarre has quit IRC21:07
*** itlinux has joined #tripleo21:13
*** jfrancoa has quit IRC21:15
openstackgerritNagasai Vinaykumar Kapalavai proposed openstack/puppet-tripleo master: Qdr: InternalTLS support.  https://review.openstack.org/63129721:16
*** itlinux has quit IRC21:17
*** xek has quit IRC21:17
openstackgerritLuke Short proposed openstack/tripleo-heat-templates stable/queens: Convert with_dict tasks to use loop and be less chatty  https://review.openstack.org/64442521:18
openstackgerritNagasai Vinaykumar Kapalavai proposed openstack/tripleo-heat-templates master: Qdr: Add InternalTLS support  https://review.openstack.org/63942321:22
openstackgerritAlex Schultz proposed openstack/tripleo-heat-templates master: Qdr: Add InternalTLS support  https://review.openstack.org/63942321:24
*** itlinux has joined #tripleo21:25
*** dprince has quit IRC21:26
*** irclogbot_3 has quit IRC21:26
*** irclogbot_3 has joined #tripleo21:29
*** toure is now known as toure|gone21:33
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci master: Add multiple ntp servers  https://review.openstack.org/64437821:36
*** itlinux has quit IRC21:43
openstackgerritNagasai Vinaykumar Kapalavai proposed openstack/tripleo-heat-templates master: Update to the ceilometer publisher list  https://review.openstack.org/60084321:44
openstackgerritNagasai Vinaykumar Kapalavai proposed openstack/tripleo-heat-templates master: Qdr: Add InternalTLS support  https://review.openstack.org/63942321:44
*** itlinux has joined #tripleo21:44
*** bfournie has quit IRC21:48
*** raildo has quit IRC21:48
*** itlinux has quit IRC21:51
*** vinaykns has quit IRC21:58
*** morazi has quit IRC22:01
*** morazi has joined #tripleo22:02
*** rfolco has quit IRC22:04
*** jtomasek has quit IRC22:05
*** itlinux has joined #tripleo22:09
*** cfontain has joined #tripleo22:09
*** morazi has quit IRC22:15
*** morazi has joined #tripleo22:15
openstackgerritMerged openstack/tripleo-common stable/queens: Configurable host network for inventory  https://review.openstack.org/64306022:18
*** itlinux has quit IRC22:20
*** cfontain has quit IRC22:25
*** florianf has quit IRC22:26
*** morazi has quit IRC22:36
*** morazi has joined #tripleo22:37
*** holser_ has quit IRC22:50
*** tkajinam has joined #tripleo22:54
*** wolverineav has quit IRC22:57
*** wolverineav has joined #tripleo22:57
*** dmacpher has joined #tripleo23:02
*** wolverineav has quit IRC23:03
*** rcernin has joined #tripleo23:04
*** morazi has quit IRC23:29
*** morazi has joined #tripleo23:29
*** mcornea has quit IRC23:44
*** martinkennelly has quit IRC23:47
*** tosky has quit IRC23:48
openstackgerritDan Prince proposed openstack/tripleo-heat-templates master: flatten the ovn service configurations  https://review.openstack.org/63911923:54
*** wolverineav has joined #tripleo23:54
*** holser_ has joined #tripleo23:57
*** wolverineav has quit IRC23:58
*** agopi__ has quit IRC23:59

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!