| *** lbragstad_ has joined #tripleo | 00:12 | |
| *** lbragstad has quit IRC | 00:14 | |
| openstackgerrit | Takashi Kajinami proposed openstack/puppet-tripleo master: Improve unit test coverage for neutron manifests https://review.opendev.org/681450 | 00:20 |
|---|---|---|
| *** Goneri has quit IRC | 00:37 | |
| *** ricolin has joined #tripleo | 00:48 | |
| *** HardCase has joined #tripleo | 01:03 | |
| *** pcaruana has quit IRC | 01:09 | |
| *** slaweq has joined #tripleo | 01:11 | |
| openstackgerrit | Takashi Kajinami proposed openstack/puppet-tripleo master: Improve unit test coverage for neutron manifests https://review.opendev.org/681450 | 01:13 |
| *** slaweq has quit IRC | 01:16 | |
| HardCase | Hey all, I've been fighting a deployment issues. Can I get another set of eyes on this and help me see what I need to do to fix this.? Here are a couple snippets. | 01:22 |
| HardCase | https://pastebin.com/raw/Um2t5JxP | 01:23 |
| HardCase | https://pastebin.com/raw/brq3MJAW | 01:23 |
| *** d0ugal has quit IRC | 01:34 | |
| *** d0ugal has joined #tripleo | 01:48 | |
| *** jcoufal has quit IRC | 01:54 | |
| *** slaweq has joined #tripleo | 02:11 | |
| *** slaweq has quit IRC | 02:16 | |
| *** d0ugal has quit IRC | 02:26 | |
| openstackgerrit | Steve Baker proposed openstack/tripleo-quickstart-extras master: Support direct provisioning of bare metal https://review.opendev.org/664456 | 02:28 |
| *** rlandy|bbl has quit IRC | 02:37 | |
| *** devep has joined #tripleo | 02:37 | |
| *** devep has quit IRC | 02:41 | |
| *** d0ugal has joined #tripleo | 02:42 | |
| EmilienM | stevebaker: you seem to be the only core online | 03:02 |
| EmilienM | stevebaker: if I may ask a review https://review.opendev.org/#/c/681525/ - urgent for the stability of our gate | 03:02 |
| EmilienM | thanks | 03:02 |
| stevebaker | EmilienM: sure thing! | 03:02 |
| stevebaker | EmilienM: LGTM! | 03:04 |
| EmilienM | stevebaker: cheers | 03:04 |
| EmilienM | stevebaker: i go to bed now but let me know in PM if you need reviews I'll look in the morning. Thanks again and ttyl! | 03:05 |
| stevebaker | EmilienM: sweet, thanks. have pleasant dreams | 03:05 |
| EmilienM | hopefully not podman dreams :D | 03:05 |
| EmilienM | cheers | 03:05 |
| openstackgerrit | Steve Baker proposed openstack/tripleo-ci master: Tolerate None featureset_override https://review.opendev.org/681635 | 03:08 |
| *** ykarel|away has joined #tripleo | 03:13 | |
| *** chem` has joined #tripleo | 03:14 | |
| *** chem has quit IRC | 03:14 | |
| *** dtrainor has quit IRC | 03:16 | |
| *** dsneddon has quit IRC | 03:30 | |
| *** Garyx_ has joined #tripleo | 03:33 | |
| *** Garyx has quit IRC | 03:33 | |
| *** skramaja has joined #tripleo | 03:40 | |
| *** dsneddon has joined #tripleo | 03:45 | |
| *** dsneddon has quit IRC | 04:04 | |
| *** rh-jelabarre has quit IRC | 04:04 | |
| *** ykarel|away is now known as ykarel | 04:06 | |
| *** slaweq has joined #tripleo | 04:11 | |
| *** slaweq has quit IRC | 04:16 | |
| openstackgerrit | Saravanan KR proposed openstack/tripleo-ansible master: Create a role for OvS-DPDK host configuration https://review.opendev.org/677712 | 04:26 |
| *** ricolin has quit IRC | 04:27 | |
| openstackgerrit | junbo proposed openstack/os-net-config master: Add linkdelay option https://review.opendev.org/680569 | 04:30 |
| *** udesale has joined #tripleo | 04:31 | |
| openstackgerrit | Michael Chapman proposed openstack/puppet-tripleo master: Support networking-ansible-ml2 coordination https://review.opendev.org/681293 | 04:32 |
| *** pcaruana has joined #tripleo | 04:32 | |
| *** dsneddon has joined #tripleo | 04:39 | |
| *** pcaruana has quit IRC | 04:58 | |
| *** dsneddon has quit IRC | 05:12 | |
| *** pdeore has joined #tripleo | 05:18 | |
| *** waleedm has joined #tripleo | 05:19 | |
| *** jaosorior has joined #tripleo | 05:20 | |
| *** waleedm_ has joined #tripleo | 05:20 | |
| *** waleedm has quit IRC | 05:23 | |
| openstackgerrit | Sagi Shnaidman proposed openstack/ansible-role-collect-logs master: Run Sova patterns parsing in CI jobs https://review.opendev.org/678630 | 05:25 |
| *** sshnaidm|off is now known as sshnaidm|afk | 05:25 | |
| *** ykarel has quit IRC | 05:27 | |
| *** ratailor has joined #tripleo | 05:30 | |
| *** ramishra has joined #tripleo | 05:31 | |
| *** ccamacho has quit IRC | 05:33 | |
| *** sanjayu_ has joined #tripleo | 05:34 | |
| *** hamzy_ has quit IRC | 05:35 | |
| *** marios has joined #tripleo | 05:37 | |
| *** pdeore has quit IRC | 05:39 | |
| *** ykarel has joined #tripleo | 05:40 | |
| *** raukadah is now known as chandankumar | 05:41 | |
| *** radeks has joined #tripleo | 05:42 | |
| *** surpatil has joined #tripleo | 05:44 | |
| *** dsneddon has joined #tripleo | 05:46 | |
| *** lmiccini has joined #tripleo | 05:46 | |
| *** surpatil has quit IRC | 05:48 | |
| *** surpatil has joined #tripleo | 05:48 | |
| *** dsneddon has quit IRC | 05:50 | |
| *** slaweq has joined #tripleo | 05:53 | |
| *** sanjayu_ has quit IRC | 05:54 | |
| *** slaweq has quit IRC | 05:59 | |
| *** tkajinam has quit IRC | 06:00 | |
| *** tkajinam has joined #tripleo | 06:06 | |
| *** pcaruana has joined #tripleo | 06:08 | |
| *** slaweq has joined #tripleo | 06:13 | |
| *** fultonj has quit IRC | 06:16 | |
| *** dsneddon has joined #tripleo | 06:17 | |
| *** fultonj has joined #tripleo | 06:19 | |
| *** dsneddon has quit IRC | 06:22 | |
| openstackgerrit | Rabi Mishra proposed openstack/tripleo-heat-templates master: Remove containers before removing associated storage https://review.opendev.org/681647 | 06:24 |
| *** ccamacho has joined #tripleo | 06:35 | |
| *** rpittau|afk is now known as rpittau | 06:36 | |
| *** saneax has joined #tripleo | 06:36 | |
| *** jfrancoa has joined #tripleo | 06:37 | |
| *** cylopez has joined #tripleo | 06:39 | |
| *** pcaruana has quit IRC | 06:41 | |
| *** ricolin has joined #tripleo | 06:41 | |
| *** hamdyk has joined #tripleo | 06:44 | |
| openstackgerrit | Rabi Mishra proposed openstack/tripleo-heat-templates master: Remove containers before removing associated storage https://review.opendev.org/681647 | 06:45 |
| *** holser has joined #tripleo | 06:47 | |
| *** waleedm has joined #tripleo | 06:52 | |
| *** tkajinam_ has joined #tripleo | 06:53 | |
| *** tkajinam has quit IRC | 06:56 | |
| *** dsneddon has joined #tripleo | 06:57 | |
| *** ricolin has quit IRC | 06:59 | |
| *** waleedm_ has quit IRC | 07:01 | |
| *** dsneddon has quit IRC | 07:02 | |
| *** brault has joined #tripleo | 07:04 | |
| *** soniya29 has joined #tripleo | 07:04 | |
| *** hberaud|gone is now known as hberaud | 07:05 | |
| openstackgerrit | Kamil Sambor proposed openstack/tripleo-heat-templates master: WIP: Support connecting OVN DB over SSL https://review.opendev.org/680345 | 07:05 |
| *** spsurya has joined #tripleo | 07:08 | |
| *** aedc has joined #tripleo | 07:09 | |
| *** avivgts has quit IRC | 07:09 | |
| *** pcaruana has joined #tripleo | 07:11 | |
| *** egonzalez has joined #tripleo | 07:12 | |
| *** pierreprinetti has quit IRC | 07:15 | |
| *** ykarel is now known as ykarel|lunch | 07:15 | |
| *** ricolin has joined #tripleo | 07:18 | |
| openstackgerrit | Merged openstack/tripleo-common stable/queens: Install dumb-init rpm https://review.opendev.org/680132 | 07:24 |
| *** bcafarel has quit IRC | 07:24 | |
| *** jpich has joined #tripleo | 07:26 | |
| *** aedc has quit IRC | 07:27 | |
| *** aedc has joined #tripleo | 07:28 | |
| *** dsneddon has joined #tripleo | 07:35 | |
| *** soniya29 has quit IRC | 07:36 | |
| *** dsneddon has quit IRC | 07:40 | |
| *** hamzy has joined #tripleo | 07:42 | |
| *** jpena|off is now known as jpena | 07:42 | |
| *** marios has quit IRC | 07:45 | |
| *** bcafarel has joined #tripleo | 07:56 | |
| *** avivgts has joined #tripleo | 07:57 | |
| *** soniya29 has joined #tripleo | 08:01 | |
| *** avivgts has quit IRC | 08:01 | |
| *** dsneddon has joined #tripleo | 08:02 | |
| *** dsneddon has quit IRC | 08:07 | |
| *** avivgts has joined #tripleo | 08:07 | |
| *** tkajinam_ has quit IRC | 08:09 | |
| *** ykarel|lunch is now known as ykarel | 08:09 | |
| *** alexmcleod has joined #tripleo | 08:10 | |
| *** kopecmartin|off is now known as kopecmartin | 08:10 | |
| *** ykarel is now known as ykarel|meeting | 08:14 | |
| *** pkopec has joined #tripleo | 08:15 | |
| *** yolanda has quit IRC | 08:16 | |
| *** threestrands has quit IRC | 08:16 | |
| *** ykarel has joined #tripleo | 08:18 | |
| openstackgerrit | Merged openstack/tripleo-common stable/rocky: Install dumb-init rpm https://review.opendev.org/680131 | 08:18 |
| *** ykarel|meeting has quit IRC | 08:19 | |
| *** derekh has joined #tripleo | 08:28 | |
| openstackgerrit | Jaganathan Palanisamy proposed openstack/tripleo-heat-templates master: Incorrect group name issue on non DPDK compute https://review.opendev.org/679227 | 08:31 |
| *** marios has joined #tripleo | 08:32 | |
| *** bcafarel has quit IRC | 08:34 | |
| *** bcafarel has joined #tripleo | 08:35 | |
| openstackgerrit | Jose Luis Franco proposed openstack/tripleo-heat-templates master: Get rid of docker removing in post_upgrade tasks. https://review.opendev.org/681669 | 08:36 |
| *** dsneddon has joined #tripleo | 08:39 | |
| *** yolanda has joined #tripleo | 08:39 | |
| *** pierreprinetti has joined #tripleo | 08:42 | |
| *** dsneddon has quit IRC | 08:43 | |
| *** jaosorior has quit IRC | 08:45 | |
| openstackgerrit | Carlos Camacho proposed openstack/tripleo-ansible master: Exclude the MySQL folder when backing up the control plane https://review.opendev.org/680735 | 08:50 |
| *** pbandark has joined #tripleo | 08:50 | |
| *** gfidente has joined #tripleo | 08:53 | |
| *** udesale has quit IRC | 09:04 | |
| *** udesale has joined #tripleo | 09:07 | |
| *** dsneddon has joined #tripleo | 09:13 | |
| *** rcernin has quit IRC | 09:16 | |
| *** sshnaidm|afk is now known as sshnaidm|rover | 09:18 | |
| *** dsneddon has quit IRC | 09:20 | |
| slaweq | sshnaidm|rover: hi | 09:35 |
| slaweq | sshnaidm|rover: I'm looking at https://bugs.launchpad.net/tripleo/+bug/1843259 today | 09:35 |
| openstack | Launchpad bug 1843259 in tripleo "Periodic rocky fs020 job fails tempest tests tempest.scenario.test_security_groups_basic_ops.TestSecurityGroupsBasicOps.test_cross_tenant_traffic and tempest.scenario.test_security_groups_basic_ops.TestSecurityGroupsBasicOps.test_multiple_security_groups " [Critical,Triaged] - Assigned to Gabriele Cerami (gcerami) | 09:35 |
| slaweq | and I found that in failed job some sysctl settings related to bridges are set differently than they should be | 09:36 |
| slaweq | please see my last comment in LP | 09:36 |
| slaweq | sshnaidm|rover: do You maybe have any idea what could change those options? | 09:36 |
| sshnaidm|rover | slaweq, hi | 09:37 |
| sshnaidm|rover | slaweq, no idea tbh | 09:37 |
| *** ricolin has quit IRC | 09:37 | |
| sshnaidm|rover | slaweq, are python modules same too? | 09:38 |
| slaweq | sshnaidm|rover: I didn't noticed any other significant differences | 09:38 |
| slaweq | and when You have those mentioned sysctl knobs set to 0, iptables don't work on bridges | 09:39 |
| slaweq | so that's why SG are not working basically | 09:39 |
| *** ykarel_ has joined #tripleo | 09:39 | |
| sshnaidm|rover | and this is only for rocky? | 09:39 |
| *** ykarel has quit IRC | 09:40 | |
| slaweq | sshnaidm|rover: e.g. on same job on queens it is set like net.bridge.bridge-nf-call-iptables = 1 | 09:45 |
| *** udesale has quit IRC | 09:49 | |
| *** udesale has joined #tripleo | 09:50 | |
| openstackgerrit | Sergii Golovatiuk proposed openstack/tripleo-common stable/stein: healthcheck_port: run ss -ntp with sudo https://review.opendev.org/681695 | 09:53 |
| *** dsneddon has joined #tripleo | 09:54 | |
| openstackgerrit | Carlos Camacho proposed openstack/tripleo-ansible master: Exclude the MySQL folder when backing up the control plane https://review.opendev.org/680735 | 09:55 |
| *** hberaud is now known as hberaud|school-r | 09:56 | |
| *** dsneddon has quit IRC | 09:58 | |
| *** Tengu has quit IRC | 10:03 | |
| *** Tengu has joined #tripleo | 10:04 | |
| *** hberaud|school-r is now known as hberaud | 10:04 | |
| sshnaidm|rover | slaweq, are these sysctl values on undercloud or overcloud nodes? | 10:05 |
| slaweq | sshnaidm|rover: I checked it on overcloud compute node | 10:05 |
| slaweq | as there it may affect traffic | 10:06 |
| *** gfidente has quit IRC | 10:07 | |
| *** dtantsur|afk is now known as dtantsur | 10:08 | |
| *** aedc has quit IRC | 10:13 | |
| *** noama has joined #tripleo | 10:22 | |
| *** ykarel_ is now known as ykarel | 10:24 | |
| *** devep__ has joined #tripleo | 10:25 | |
| *** dsneddon has joined #tripleo | 10:27 | |
| *** panda is now known as panda|ruck | 10:28 | |
| *** dsneddon has quit IRC | 10:31 | |
| *** jaosorior has joined #tripleo | 10:32 | |
| *** HardCase has quit IRC | 10:32 | |
| openstackgerrit | jiasirui proposed openstack/tripleo-heat-templates master: Misspelling of words https://review.opendev.org/681708 | 10:41 |
| *** egonzalez has quit IRC | 10:49 | |
| *** holser has quit IRC | 10:51 | |
| *** holser has joined #tripleo | 10:51 | |
| *** hberaud is now known as hberaud|lunch | 10:51 | |
| *** lucasagomes has joined #tripleo | 10:58 | |
| *** matbu has joined #tripleo | 10:58 | |
| *** numans has joined #tripleo | 10:58 | |
| *** aedc has joined #tripleo | 10:58 | |
| openstackgerrit | Carlos Camacho proposed openstack/tripleo-ansible master: Exclude the MySQL folder when backing up the control plane https://review.opendev.org/680735 | 10:58 |
| *** dsneddon has joined #tripleo | 10:59 | |
| *** ykarel is now known as ykarel|afk | 10:59 | |
| openstackgerrit | Kamil Sambor proposed openstack/tripleo-heat-templates master: WIP: Support connecting OVN DB over SSL https://review.opendev.org/680345 | 10:59 |
| *** gfidente has joined #tripleo | 11:01 | |
| *** devep__ has quit IRC | 11:03 | |
| *** devep has joined #tripleo | 11:03 | |
| *** dsneddon has quit IRC | 11:03 | |
| *** ykarel|afk is now known as ykarel | 11:08 | |
| openstackgerrit | jiasirui proposed openstack/tripleo-specs master: fix the spelling mistakes https://review.opendev.org/681717 | 11:12 |
| *** lucasagomes has quit IRC | 11:12 | |
| *** devep has quit IRC | 11:16 | |
| openstackgerrit | jiasirui proposed openstack/tripleo-docs master: fix the spelling mistakes https://review.opendev.org/681721 | 11:22 |
| *** lucasagomes has joined #tripleo | 11:25 | |
| *** lucasagomes has quit IRC | 11:26 | |
| openstackgerrit | Merged openstack/tripleo-common master: healthcheck_port: run ss -ntp with sudo https://review.opendev.org/681525 | 11:27 |
| *** lucasagomes has joined #tripleo | 11:27 | |
| owalsh | sshnaidm|rover: hi, can you tell me when will that patch land in the container images ^^^. I want to CI a patch that depends on it | 11:29 |
| sshnaidm|rover | owalsh, it's tripleo package, so all containers will be updated with it | 11:29 |
| sshnaidm|rover | owalsh, you don't need dependency when it's merged | 11:30 |
| *** dsneddon has joined #tripleo | 11:30 | |
| owalsh | sshnaidm|rover: ack, but the containers need to be rebuilt after it merged. When does this happen? | 11:30 |
| *** jaosorior has quit IRC | 11:31 | |
| *** ansmith has joined #tripleo | 11:31 | |
| sshnaidm|rover | owalsh, in every tripleo job | 11:32 |
| sshnaidm|rover | owalsh, not rebuilt, just update and commit | 11:32 |
| owalsh | sshnaidm|rover: ah, cool, thanks | 11:32 |
| sshnaidm|rover | owalsh, rebuilding is used in promotion, for non-tripleo repos like nova, neutron, etc | 11:32 |
| owalsh | sshnaidm|rover: ack, makes sense. Should depends-on have worked prior to merging? Didn't seem to get the fix in some of the jobs | 11:36 |
| sshnaidm|rover | owalsh, yeah, should work | 11:36 |
| sshnaidm|rover | owalsh, in tripleo jobs | 11:36 |
| *** jpena is now known as jpena|lunch | 11:37 | |
| *** ansmith has quit IRC | 11:39 | |
| *** ratailor has quit IRC | 11:40 | |
| owalsh | sshnaidm|rover: hrmm, either that didn't happen or we still have problems with healthchecks | 11:42 |
| *** dprince has joined #tripleo | 11:42 | |
| openstackgerrit | Sagi Shnaidman proposed openstack/ansible-role-collect-logs master: Run Sova patterns parsing in CI jobs https://review.opendev.org/678630 | 11:44 |
| sshnaidm|rover | owalsh, let's see if it's available in repos already, it takes some time | 11:45 |
| *** ykarel is now known as ykarel|afk | 11:45 | |
| owalsh | sshnaidm|rover: I mean the depends-on didn't work yesterday | 11:45 |
| owalsh | ... or if it did then we still have issues with the Rabbitmq healthcheck | 11:46 |
| *** hberaud|lunch is now known as hberaud | 11:47 | |
| sshnaidm|rover | owalsh, you need to check if you have new built tripleo-common installed in your container/host to see if dependency worked or not | 11:47 |
| openstackgerrit | Kamil Sambor proposed openstack/tripleo-heat-templates master: WIP: test ci internal tls https://review.opendev.org/681726 | 11:48 |
| sshnaidm|rover | owalsh, check if you have openstack-tripleo-common-11.1.1-0.20190912113426.3283218 version | 11:48 |
| sshnaidm|rover | owalsh, or any date with 3283218 in the end | 11:49 |
| *** raildo has joined #tripleo | 11:49 | |
| openstackgerrit | Kamil Sambor proposed openstack/tripleo-heat-templates master: WIP: test ci internal tls https://review.opendev.org/681726 | 11:49 |
| owalsh | sshnaidm|rover: openstack-tripleo-common-container-base.noarch 11.1.1-0.20190911225615.3283218.el7 @gating-repo | 11:52 |
| owalsh | damn | 11:52 |
| sshnaidm|rover | owalsh, this includes this patch | 11:52 |
| owalsh | sshnaidm|rover: ack, I was hoping it didn't :-) | 11:53 |
| sshnaidm|rover | owalsh, so problem still exists? | 11:53 |
| *** florianf has quit IRC | 11:53 | |
| owalsh | sshnaidm|rover: different problem I think. The healthcheck passed later but had failed when the ansible task ran | 11:54 |
| sshnaidm|rover | owalsh, ack | 11:55 |
| openstackgerrit | Michele Baldessari proposed openstack/tripleo-heat-templates master: Revert Add OvnDbInternal to EndpointMap and use it for ovn_db_host https://review.opendev.org/679244 | 11:55 |
| openstackgerrit | Emilien Macchi proposed openstack/python-tripleoclient master: Rename 'undercloud-' to '<stack_name>-' https://review.opendev.org/681294 | 11:58 |
| EmilienM | owalsh, sshnaidm|rover : hi, what's going on? | 11:59 |
| owalsh | EmilienM: https://d2d026bac15ce725a48e-1bc5b9913cbe921487ac8cc8cbe072a3.ssl.cf1.rackcdn.com/681605/2/check/tripleo-ci-centos-7-containers-multinode/5efaf7d/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz | 11:59 |
| owalsh | EmilienM: when I fix the validation tasks so that they wait for a healthcheck to have run I'm seeing nova-compute healthcheck failures | 11:59 |
| EmilienM | does it have my patch? | 12:00 |
| EmilienM | i suspect no | 12:00 |
| owalsh | EmilienM: that's what I was discussing with sshnaidm|rover, looks like it does | 12:00 |
| EmilienM | how can you tell? | 12:00 |
| EmilienM | let's look at https://d2d026bac15ce725a48e-1bc5b9913cbe921487ac8cc8cbe072a3.ssl.cf1.rackcdn.com/681605/2/check/tripleo-ci-centos-7-containers-multinode/5efaf7d/logs/undercloud/var/log/tripleo-container-image-prepare.log.txt.gz | 12:01 |
| owalsh | EmilienM: rpm in https://d2d026bac15ce725a48e-1bc5b9913cbe921487ac8cc8cbe072a3.ssl.cf1.rackcdn.com/681605/2/check/tripleo-ci-centos-7-containers-multinode/5efaf7d/logs/subnode-2/var/log/extra/podman/containers/nova_compute/podman_info.log.txt.gz | 12:01 |
| EmilienM | indeed | 12:02 |
| sshnaidm|rover | EmilienM, it's installed: Updated: | 12:02 |
| sshnaidm|rover | openstack-tripleo-common-container-base.noarch 0:11.1.1-0.20190911225615.3283218 | 12:02 |
| *** soniya29 has quit IRC | 12:02 | |
| EmilienM | look: | 12:03 |
| EmilienM | https://d2d026bac15ce725a48e-1bc5b9913cbe921487ac8cc8cbe072a3.ssl.cf1.rackcdn.com/681605/2/check/tripleo-ci-centos-7-containers-multinode/5efaf7d/logs/undercloud/var/log/journal.txt.gz | 12:03 |
| EmilienM | Sep 12 00:44:02 undercloud.localdomain sudo[219289]: root : TTY=unknown ; PWD=/ ; USER=heat ; COMMAND=/usr/sbin/ss -ntp | 12:03 |
| EmilienM | so for example, heat healthcheck runs now with sudo for the ss | 12:04 |
| EmilienM | but there is one as root: | 12:04 |
| EmilienM | Sep 12 00:44:02 undercloud.localdomain sudo[219269]: root : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/sbin/ss -ntp | 12:04 |
| EmilienM | we can also see: | 12:05 |
| EmilienM | Sep 12 00:44:02 undercloud.localdomain sudo[219307]: root : TTY=unknown ; PWD=/ ; USER=nova ; COMMAND=/usr/sbin/ss -ntp | 12:05 |
| EmilienM | also you can see the healthchecks running: | 12:05 |
| EmilienM | https://d2d026bac15ce725a48e-1bc5b9913cbe921487ac8cc8cbe072a3.ssl.cf1.rackcdn.com/681605/2/check/tripleo-ci-centos-7-containers-multinode/5efaf7d/logs/undercloud/var/log/extra/services.txt.gz | 12:05 |
| EmilienM | nova_conductor healthcheck | 12:06 |
| EmilienM | tripleo_nova_scheduler.service loaded active running | 12:06 |
| EmilienM | I suspect the healthcheck is active but later (for some reasons) | 12:06 |
| EmilienM | so exactly what owalsh said :) | 12:06 |
| owalsh | EmilienM: active == the timer just triggered | 12:07 |
| *** bfournie has quit IRC | 12:07 | |
| owalsh | most should be inactive, but not failed | 12:07 |
| EmilienM | we should see the failed services (healthchecks timers as well) here: | 12:08 |
| EmilienM | https://d2d026bac15ce725a48e-1bc5b9913cbe921487ac8cc8cbe072a3.ssl.cf1.rackcdn.com/681605/2/check/tripleo-ci-centos-7-containers-multinode/5efaf7d/logs/undercloud/var/log/extra/failed_services.txt.gz | 12:08 |
| *** florianf has joined #tripleo | 12:09 | |
| EmilienM | we can see ironic-conductor healthcheck not working at all | 12:09 |
| EmilienM | and the known swift ones | 12:09 |
| EmilienM | but I don't see nova :/ | 12:09 |
| *** rh-jelabarre has joined #tripleo | 12:10 | |
| EmilienM | ah wait | 12:10 |
| EmilienM | I'm looking at the wrong log (undercloud) | 12:10 |
| EmilienM | owalsh: https://d2d026bac15ce725a48e-1bc5b9913cbe921487ac8cc8cbe072a3.ssl.cf1.rackcdn.com/681605/2/check/tripleo-ci-centos-7-containers-multinode/5efaf7d/logs/subnode-2/var/log/extra/failed_services.txt.gz | 12:11 |
| EmilienM | so yeah only nova compute has trouble | 12:11 |
| EmilienM | (which is better than before iiuc) | 12:12 |
| *** rh-jelabarre has quit IRC | 12:12 | |
| *** rh-jelabarre has joined #tripleo | 12:12 | |
| EmilienM | dalvarez: if someone from ovn folks can look at the ovn healthchecks failures in ^ i think we should investigate and fix them like we do now for nova | 12:12 |
| dalvarez | EmilienM: ack. otherwiseguy lucasagomes ^ do you guys have some cycles? im in the middle of fire :p | 12:13 |
| EmilienM | owalsh: I don't know how nova compute works underneath but is it always connected to rabbitmq? (i guess yes?) | 12:14 |
| EmilienM | if we look at timestamps: | 12:14 |
| EmilienM | Sep 12 00:42:45 centos-7-rax-ord-0011167288 podman[51875]: There is no nova-compute process with opened RabbitMQ ports (5672) running in the container | 12:14 |
| lucasagomes | dalvarez, I can yeah, just back from PTO but I will take a look at it today | 12:14 |
| EmilienM | and the nova compute logs : | 12:14 |
| dalvarez | lucasagomes++ <3 | 12:15 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-common stable/stein: healthcheck_port: run ss -ntp with sudo https://review.opendev.org/681695 | 12:15 |
| EmilienM | holser: ^ with -x option (for cherry-pick) | 12:16 |
| EmilienM | owalsh: do you see anything wrong in Sep 12 00:42:45 centos-7-rax-ord-0011167288 podman[51875]: There is no nova-compute process with opened RabbitMQ ports (5672) running in the container ? | 12:16 |
| EmilienM | wrong copy paste: https://d2d026bac15ce725a48e-1bc5b9913cbe921487ac8cc8cbe072a3.ssl.cf1.rackcdn.com/681605/2/check/tripleo-ci-centos-7-containers-multinode/5efaf7d/logs/subnode-2/var/log/containers/nova/nova-compute.log.txt.gz | 12:16 |
| owalsh | EmilienM: already looking, but nothing obvious | 12:16 |
| openstackgerrit | Jose Luis Franco proposed openstack/tripleo-ansible master: Enhance docker check verifying its socket existence. https://review.opendev.org/681444 | 12:18 |
| EmilienM | owalsh: I suspect something but I'm unsure. Since the container is running as privileged, maybe the "ss" good output is the one from root and not from nova | 12:18 |
| EmilienM | we can see in the "podman exec nova_compute top -bwn1" command that the process is run as "nova"; however I haven't tested this container when I did my patch | 12:20 |
| EmilienM | that would explain why the ironic_conductor healthcheck also fails on the undercloud | 12:20 |
| owalsh | EmilienM: weird... in my local undercloud nova is running as root... | 12:20 |
| EmilienM | owalsh: can i see? | 12:21 |
| owalsh | EmilienM: [root@undercloud stack]# podman exec -ti nova_compute ps -efw | 12:21 |
| owalsh | UID PID PPID C STIME TTY TIME CMD | 12:21 |
| owalsh | root 1 0 0 Sep11 ? 00:00:00 dumb-init --single-child -- kolla_start | 12:21 |
| owalsh | root 8 1 1 Sep11 ? 00:17:42 /usr/bin/python2 /usr/bin/nova-compute | 12:21 |
| owalsh | root 8103 0 0 12:21 pts/2 00:00:00 ps -efw | 12:21 |
| EmilienM | lucasagomes, dalvarez : hold on a bit on the ovn healthcheck. I might have an idea which would affect other containers as well | 12:22 |
| EmilienM | owalsh: I know why | 12:22 |
| EmilienM | owalsh: one sec | 12:22 |
| EmilienM | https://github.com/openstack/tripleo-heat-templates/blob/master/deployment/nova/nova-ironic-container-puppet.yaml#L162 | 12:23 |
| lucasagomes | EmilienM, ack | 12:23 |
| *** ykarel|afk is now known as ykarel | 12:23 | |
| owalsh | EmilienM: ahh | 12:23 |
| EmilienM | vs https://github.com/openstack/tripleo-heat-templates/blob/master/deployment/nova/nova-compute-container-puppet.yaml#L685 | 12:23 |
| EmilienM | ... | 12:23 |
| EmilienM | I'm not sure about the history here | 12:24 |
| owalsh | I expect it's just a bug | 12:25 |
| EmilienM | but what I suspect is that for root, it's fine, as the ps in my patch grep the root user | 12:25 |
| EmilienM | however for a privileged container... | 12:25 |
| *** lbragstad_ has quit IRC | 12:25 | |
| * owalsh got to drop for a few minutes... | 12:27 | |
| *** owalsh is now known as owalsh_brb | 12:27 | |
| *** ade_lee has quit IRC | 12:29 | |
| *** iurygregory has joined #tripleo | 12:30 | |
| *** rlandy has joined #tripleo | 12:31 | |
| *** dsneddon has quit IRC | 12:33 | |
| *** soniya29 has joined #tripleo | 12:36 | |
| *** ansmith has joined #tripleo | 12:38 | |
| *** jpena|lunch is now known as jpena | 12:38 | |
| EmilienM | paramite|clone: are you around? | 12:38 |
| holser | EmilienM thanks, looking | 12:39 |
| EmilienM | holser: I did it | 12:40 |
| holser | EmilienM thanks a lot :D | 12:41 |
| EmilienM | but I suspect this patch isn't enough | 12:41 |
| *** derekh has quit IRC | 12:42 | |
| EmilienM | i think that if the container is run as privileged, the "ss" shouldn't be run with sudo -u nova (example for nova) | 12:42 |
| *** owalsh_brb is now known as owalsh | 12:43 | |
| *** lmiccini has quit IRC | 12:44 | |
| EmilienM | owalsh: do you have a deployment on master I can use for testing? mine is deploying atm | 12:45 |
| *** dprince has quit IRC | 12:45 | |
| openstackgerrit | Merged openstack/tripleo-docs master: Document per-role NovaEnableRbdBackend usage https://review.opendev.org/675869 | 12:48 |
| *** soniya29 has quit IRC | 12:50 | |
| *** soniya29 has joined #tripleo | 12:54 | |
| *** derekh has joined #tripleo | 12:56 | |
| openstackgerrit | Carlos Camacho proposed openstack/tripleo-ansible master: Exclude the MySQL folder when backing up the control plane https://review.opendev.org/680735 | 12:58 |
| *** derekh has quit IRC | 12:59 | |
| EmilienM | owalsh: I'm trying to figure out if whether or not the fact that privileged containers 'ss' need to be run as root | 12:59 |
| weshay | EmilienM should I update tripleo-ansible from release-model: cycle-with-intermediary to cycle-trailing ? | 13:00 |
| weshay | for train | 13:00 |
| EmilienM | I find it bizarre that all healthchecks failing now are privileged on both overcloud & undercloud, it's a common pattern | 13:00 |
| *** derekh has joined #tripleo | 13:00 | |
| *** mcornea has joined #tripleo | 13:00 | |
| EmilienM | weshay: I honestly don't know. | 13:00 |
| EmilienM | we went back and forth with these things | 13:00 |
| weshay | EmilienM ok.. I'll find out | 13:00 |
| owalsh | EmilienM: ack, sorry had to step away again. Can use my undercloud... | 13:00 |
| EmilienM | weshay: maybe we can ask for advise on #openstack-release | 13:01 |
| weshay | aye | 13:01 |
| *** bfournie has joined #tripleo | 13:01 | |
| *** dsneddon has joined #tripleo | 13:02 | |
| *** morazi has joined #tripleo | 13:05 | |
| *** dsneddon has quit IRC | 13:06 | |
| *** surpatil has quit IRC | 13:09 | |
| *** jcoufal has joined #tripleo | 13:09 | |
| cloudnull | mornings | 13:11 |
| openstackgerrit | Andreas Florath proposed openstack/os-collect-config master: Fix config file documentation https://review.opendev.org/681739 | 13:12 |
| *** ade_lee has joined #tripleo | 13:13 | |
| *** Goneri has joined #tripleo | 13:14 | |
| *** lbragstad has joined #tripleo | 13:20 | |
| openstackgerrit | Carlos Camacho proposed openstack/tripleo-ansible master: Exclude the MySQL folder when backing up the control plane https://review.opendev.org/680735 | 13:25 |
| *** pcaruana has quit IRC | 13:30 | |
| *** aedc has quit IRC | 13:31 | |
| *** holser has quit IRC | 13:31 | |
| *** aedc has joined #tripleo | 13:32 | |
| *** skramaja has quit IRC | 13:33 | |
| EmilienM | sshnaidm|rover, owalsh : I'm working on a patch; the problem is that my patch fixed non privileged containers checking rabbitmq | 13:34 |
| EmilienM | but didn't solved it for privileged containers | 13:34 |
| EmilienM | I have a solution | 13:34 |
| openstackgerrit | Carlos Camacho proposed openstack/tripleo-ansible master: Exclude the MySQL folder when backing up the control plane https://review.opendev.org/680735 | 13:35 |
| *** aedc has quit IRC | 13:38 | |
| *** aedc has joined #tripleo | 13:39 | |
| *** ricolin has joined #tripleo | 13:39 | |
| *** dsneddon has joined #tripleo | 13:40 | |
| *** Vorrtex has joined #tripleo | 13:41 | |
| *** dsneddon has quit IRC | 13:45 | |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-common master: healthcheck_port: run ss with both sudo & root as best effort https://review.opendev.org/681752 | 13:46 |
| EmilienM | paramite|clone, dalvarez, owalsh, lucasagomes ^ | 13:47 |
| EmilienM | it should fix it | 13:47 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-common master: healthcheck_port: run ss with both sudo & root as best effort https://review.opendev.org/681752 | 13:47 |
| lucasagomes | EmilienM, thansk I will keep an eye in the logs after gate runs | 13:47 |
| *** paramite|clone is now known as paramite | 13:48 | |
| owalsh | EmilienM: sweet, I'll make https://review.opendev.org/681442 depends-on it | 13:48 |
| openstackgerrit | Jose Luis Franco proposed openstack/tripleo-upgrade master: Computes node-by-node ugprade. https://review.opendev.org/626564 | 13:49 |
| openstackgerrit | Carlos Camacho proposed openstack/tripleo-ansible master: Exclude the MySQL folder when backing up the control plane https://review.opendev.org/680735 | 13:49 |
| openstackgerrit | Oliver Walsh proposed openstack/tripleo-heat-templates master: Wait for first healthcheck before running validation tasks https://review.opendev.org/681442 | 13:52 |
| *** tkajinam has joined #tripleo | 13:55 | |
| *** hamzy has quit IRC | 13:58 | |
| *** ykarel is now known as ykarel|afk | 13:59 | |
| *** waleedm has quit IRC | 14:01 | |
| *** jbadiapa has quit IRC | 14:04 | |
| *** jbadiapa has joined #tripleo | 14:07 | |
| *** pcaruana has joined #tripleo | 14:08 | |
| *** aedc has quit IRC | 14:09 | |
| *** aedc has joined #tripleo | 14:10 | |
| *** holser has joined #tripleo | 14:11 | |
| *** aedc has quit IRC | 14:12 | |
| *** aedc has joined #tripleo | 14:13 | |
| *** dsneddon has joined #tripleo | 14:14 | |
| *** aakarsh|2 has joined #tripleo | 14:15 | |
| panda|ruck | we are having quite a few gates failing during undercloud installation with this error: 2019-09-11 18:35:37 | "Fail if nova-conductor healthcheck report failed status", | 14:17 |
| panda|ruck | is this known ? I'm about to open a bug | 14:17 |
| *** dsneddon has quit IRC | 14:19 | |
| *** lbragstad has quit IRC | 14:19 | |
| panda|ruck | e.g. https://797b5dd0409eb6074a68-91d51f4a8e8b53e225c243f147f194be.ssl.cf2.rackcdn.com/681300/1/gate/tripleo-ci-centos-7-undercloud-containers/8cba59e/logs/undercloud/home/zuul/undercloud_install.log.txt.gz | 14:20 |
| *** soniya29 has quit IRC | 14:20 | |
| lyarwood | panda|ruck: there was a CIX about this that I think DF took | 14:21 |
| panda|ruck | Ah yes I see EmilienM is working on it. | 14:21 |
| EmilienM | panda|ruck: https://review.opendev.org/#/c/681525/ and https://review.opendev.org/681752 should help | 14:23 |
| panda|ruck | the question is ... how did this reach the gates | 14:23 |
| panda|ruck | the bug was on periodic jobs | 14:23 |
| EmilienM | panda|ruck: let me explain : | 14:26 |
| *** hamzy has joined #tripleo | 14:27 | |
| EmilienM | panda|ruck: we bumped podman from 1.4 to 1.5 two days ago. 1.4 had a bug where the podman exec return code was wrong (always returned 0 in some cases) and the healthchecks are running "podman exec". Podman 1.5 fixed the issue; so when we bumped, it passed our CI (by luck probably as the bug as the bug seems racy) and reached the gate since Podman isn't gated by promoted jobs | 14:27 |
| EmilienM | panda|ruck: note that it passed 3 testing jobs: https://review.rdoproject.org/r/#/c/21994/ so I don't know why we didn't catch it before | 14:28 |
| sshnaidm|rover | EmilienM, would be nice to gate podman by some tripleo job.. although in this case it's really casy | 14:28 |
| EmilienM | sshnaidm|rover: we alraedy do it | 14:28 |
| EmilienM | check the patch ^ | 14:29 |
| EmilienM | rdoinfo-tripleo-master-testing-centos-7-multinode-1ctlr-featureset010 - rdoinfo-tripleo-master-centos-7-scenario001-standalone | 14:29 |
| EmilienM | and rdoinfo-tripleo-master-testing-centos-7-standalone-featureset052 | 14:29 |
| EmilienM | they all ran green | 14:29 |
| sshnaidm|rover | EmilienM, ack | 14:30 |
| sshnaidm|rover | EmilienM, well, race condition, not all jobs fail even now | 14:30 |
| EmilienM | right | 14:30 |
| panda|ruck | ok | 14:30 |
| panda|ruck | we're all going to die. | 14:30 |
| beagles | (last 4 lines sound like a good t-shirt candidate) | 14:32 |
| *** hamdykhader has joined #tripleo | 14:32 | |
| *** hamdyk has quit IRC | 14:34 | |
| *** hamdykhader has quit IRC | 14:36 | |
| *** aedc has quit IRC | 14:43 | |
| openstackgerrit | Carlos Camacho proposed openstack/tripleo-ansible master: Exclude the specific folders when backing up the control plane https://review.opendev.org/680735 | 14:45 |
| *** abishop has quit IRC | 14:45 | |
| *** dsneddon has joined #tripleo | 14:45 | |
| openstackgerrit | Carlos Camacho proposed openstack/tripleo-ansible master: Exclude the specific folders when backing up the control plane https://review.opendev.org/680735 | 14:47 |
| *** ykarel|afk is now known as ykarel|away | 14:48 | |
| *** hamzy has quit IRC | 14:48 | |
| *** lbragstad has joined #tripleo | 14:49 | |
| *** hamzy has joined #tripleo | 14:49 | |
| *** dsneddon has quit IRC | 14:50 | |
| *** Vorrtex has quit IRC | 14:51 | |
| *** nkinder has joined #tripleo | 14:51 | |
| openstackgerrit | Carlos Camacho proposed openstack/tripleo-ansible master: Exclude the specific folders when backing up the control plane https://review.opendev.org/680735 | 14:52 |
| *** bdodd has joined #tripleo | 14:53 | |
| *** ykarel|away has quit IRC | 14:53 | |
| nkinder | weshay, John was able to get his OOOQ patch updated for keycloak installation on the supplemental node updated to use a smaller java heap for the CI systems. | 14:54 |
| nkinder | weshay, any chance you can kick your patch to trigger CI to test it out? | 14:55 |
| nkinder | weshay, not sure if it just needs a recheck or something more... | 14:55 |
| *** pcaruana has quit IRC | 14:57 | |
| *** dsneddon has joined #tripleo | 15:03 | |
| weshay | nkinder yup.. will do.. | 15:04 |
| *** weshay is now known as weshay_passport | 15:05 | |
| *** tkajinam has quit IRC | 15:06 | |
| *** jfrancoa has quit IRC | 15:07 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/queens: Move nova cell v2 discovery to deploy_steps_tasks https://review.opendev.org/669827 | 15:07 |
| *** noama has quit IRC | 15:08 | |
| *** cylopez has quit IRC | 15:11 | |
| *** hamzy has quit IRC | 15:14 | |
| *** hamzy has joined #tripleo | 15:14 | |
| *** spsurya has quit IRC | 15:16 | |
| ksambor | hey o/ EmilienM, bogdando, beagles can you take a look here https://review.opendev.org/#/c/674849/ ? (also waiting for tests on the other patch which depends on previous one, so it will be nice to get review also there: https://review.opendev.org/#/c/680345/ ) | 15:19 |
| openstackgerrit | Luca Miccini proposed openstack/puppet-tripleo master: Enable deep_compare for fencing resource https://review.opendev.org/681778 | 15:23 |
| openstackgerrit | Luca Miccini proposed openstack/puppet-tripleo master: Enable deep_compare for fencing resource https://review.opendev.org/681778 | 15:25 |
| openstackgerrit | Carlos Camacho proposed openstack/tripleo-ansible master: Exclude the specific folders when backing up the control plane https://review.opendev.org/680735 | 15:30 |
| openstackgerrit | Bogdan Dobrelya (bogdando) proposed openstack/ansible-role-tripleo-modify-image master: Add docs for updating from local gating repo https://review.opendev.org/681781 | 15:32 |
| openstackgerrit | Damien Ciabrini proposed openstack/tripleo-heat-templates stable/rocky: HA: fix <service>_restart_bundle with minor update workflow https://review.opendev.org/681782 | 15:32 |
| openstackgerrit | Luca Miccini proposed openstack/puppet-tripleo master: Enable deep_compare for fencing resource https://review.opendev.org/681778 | 15:35 |
| *** ykarel has joined #tripleo | 15:37 | |
| *** d0ugal has quit IRC | 15:39 | |
| *** d0ugal has joined #tripleo | 15:42 | |
| *** rpittau is now known as rpittau|afk | 15:44 | |
| owalsh | EmilienM: CI is likely to pass (mostly) until this race is fixed https://review.opendev.org/681442 | 15:49 |
| owalsh | EmilienM: that ^^^ combined with the (1st) healthcheck fix yesterday caught the failing nova-compute healthcheck in https://review.opendev.org/681605 | 15:51 |
| EmilienM | owalsh: so is DependsOn order is good? | 15:51 |
| *** hamzy_ has joined #tripleo | 15:52 | |
| *** hamzy has quit IRC | 15:52 | |
| owalsh | EmilienM: not sure what you're asking, but the logs we were looking at earlier were from that DNM job | 15:52 |
| EmilienM | owalsh: I'm asking what patch we need to land first, mine, right? then yours | 15:53 |
| owalsh | EmilienM: ah, yes. I rebased on your patch when you proposed it | 15:53 |
| owalsh | EmilienM: so CI on https://review.opendev.org/681442 should tell us if your patch fixes all of the healthchecks (for nova at least) | 15:54 |
| EmilienM | ok | 15:55 |
| openstackgerrit | Alex Schultz proposed openstack/paunch stable/queens: Revert "Check if volume paths exist before executing Docker." https://review.opendev.org/681789 | 15:55 |
| openstackgerrit | Alex Schultz proposed openstack/paunch stable/rocky: Revert "Check if volume paths exist before executing Docker." https://review.opendev.org/681790 | 15:56 |
| openstackgerrit | Alex Schultz proposed openstack/paunch stable/stein: Revert "Check if volume paths exist before executing Docker." https://review.opendev.org/681791 | 15:56 |
| *** marios has quit IRC | 15:58 | |
| *** ykarel is now known as ykarel|away | 16:02 | |
| openstackgerrit | Luca Miccini proposed openstack/puppet-tripleo master: Enable deep_compare for fencing resource https://review.opendev.org/681778 | 16:03 |
| *** brault has quit IRC | 16:03 | |
| *** ricolin has quit IRC | 16:03 | |
| *** ricolin has joined #tripleo | 16:04 | |
| *** ricolin has quit IRC | 16:05 | |
| *** dtantsur is now known as dtantsur|afk | 16:09 | |
| *** artom has quit IRC | 16:10 | |
| *** avivgts has quit IRC | 16:15 | |
| *** ccamacho has quit IRC | 16:16 | |
| openstackgerrit | Merged openstack/puppet-tripleo master: Use memcached for token caching in ironic authtoken https://review.opendev.org/680856 | 16:16 |
| openstackgerrit | Merged openstack/puppet-pacemaker master: Extend deep_compare to stonith resources https://review.opendev.org/679407 | 16:17 |
| *** alexmcleod has quit IRC | 16:18 | |
| *** brault has joined #tripleo | 16:22 | |
| *** brault has quit IRC | 16:22 | |
| openstackgerrit | Luca Miccini proposed openstack/tripleo-heat-templates master: Enable deep_compare by default for stonith resource https://review.opendev.org/681813 | 16:24 |
| openstackgerrit | Luca Miccini proposed openstack/tripleo-heat-templates master: Enable deep_compare by default for stonith resources https://review.opendev.org/681813 | 16:25 |
| sshnaidm|rover | upgrades folks, did you see this error before? InternalError: (pymysql.err.InternalError) (1050, u\"Table 'scheduled_jobs_v2' already exists\") https://openstack.fortnebula.com:13808/v1/AUTH_e8fd161dc34c421a979a9e6421f823e9/zuul_opendev_logs_ab5/678630/9/check/tripleo-ci-centos-7-containerized-undercloud-upgrades/ab5b8e2/logs/undercloud/home/zuul/undercloud_upgrade.log.txt.gz | 16:26 |
| *** raildo has quit IRC | 16:28 | |
| *** hberaud is now known as hberaud|gone | 16:28 | |
| openstackgerrit | Sagi Shnaidman proposed openstack/ansible-role-collect-logs master: Run Sova patterns parsing in CI jobs https://review.opendev.org/678630 | 16:31 |
| *** udesale has quit IRC | 16:32 | |
| *** raildo has joined #tripleo | 16:39 | |
| *** gbarros has joined #tripleo | 16:43 | |
| *** gfidente has quit IRC | 16:46 | |
| *** pkopec has quit IRC | 16:48 | |
| *** weshay_passport is now known as weshay | 16:57 | |
| *** jpich has quit IRC | 16:57 | |
| *** florianf has quit IRC | 17:00 | |
| *** derekh has quit IRC | 17:00 | |
| *** hamzy_ has quit IRC | 17:09 | |
| *** hamzy_ has joined #tripleo | 17:11 | |
| *** artom has joined #tripleo | 17:13 | |
| *** pkopec has joined #tripleo | 17:15 | |
| *** jpena is now known as jpena|off | 17:15 | |
| *** Vorrtex has joined #tripleo | 17:16 | |
| *** soniya29 has joined #tripleo | 17:16 | |
| *** ykarel|away has quit IRC | 17:19 | |
| *** bogdando has quit IRC | 17:19 | |
| *** ykarel|away has joined #tripleo | 17:19 | |
| *** raildo has quit IRC | 17:22 | |
| *** soniya29 has quit IRC | 17:26 | |
| *** jcoufal has quit IRC | 17:29 | |
| *** saneax has quit IRC | 17:29 | |
| *** brault has joined #tripleo | 17:30 | |
| *** d0ugal has quit IRC | 17:33 | |
| *** matbu has quit IRC | 17:34 | |
| *** xek has joined #tripleo | 17:34 | |
| *** brault has quit IRC | 17:34 | |
| *** itlinux has joined #tripleo | 17:35 | |
| itlinux | hello guys.. | 17:36 |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart master: Add Keycloak setup to featureset039 https://review.opendev.org/671567 | 17:37 |
| *** matbu has joined #tripleo | 17:40 | |
| *** ksambor has quit IRC | 17:42 | |
| *** morazi has quit IRC | 17:46 | |
| owalsh | EmilienM: hey, so RDO CI failed on https://review.opendev.org/681442, but it's using docker not podman??? | 17:50 |
| EmilienM | owalsh: docker | 17:52 |
| EmilienM | owalsh: centos7 + pacemaker == docker | 17:52 |
| *** d0ugal has joined #tripleo | 17:52 | |
| owalsh | EmilienM: the tasks won't work with docker, don't have the services | 17:54 |
| EmilienM | owalsh: these tasks should be in a block with a when: container_cli == 'podman' | 17:55 |
| owalsh | EmilienM: ack, just skip for docker? | 17:56 |
| owalsh | or fallback to the old docker exec approach? | 17:57 |
| EmilienM | owalsh: let's skip | 17:57 |
| EmilienM | we are going to remove docker once we have centos8 | 17:57 |
| EmilienM | we don't support docker anymore at all | 17:57 |
| owalsh | works for me | 17:57 |
| *** pcaruana has joined #tripleo | 17:58 | |
| *** d0ugal has quit IRC | 17:59 | |
| *** brault has joined #tripleo | 17:59 | |
| EmilienM | owalsh: will you send a patch? (otherwise I can do it) | 18:03 |
| *** pkopec has quit IRC | 18:03 | |
| owalsh | EmilienM: yea, rolling one now | 18:03 |
| *** d0ugal has joined #tripleo | 18:03 | |
| *** pkopec has joined #tripleo | 18:03 | |
| *** brault has quit IRC | 18:04 | |
| EmilienM | ok | 18:04 |
| *** lbragstad has quit IRC | 18:07 | |
| *** d0ugal has quit IRC | 18:08 | |
| *** hamzy_ has quit IRC | 18:16 | |
| *** hamzy_ has joined #tripleo | 18:17 | |
| *** iurygregory has quit IRC | 18:19 | |
| *** d0ugal has joined #tripleo | 18:21 | |
| openstackgerrit | Oliver Walsh proposed openstack/tripleo-heat-templates master: Skip systemd healthcheck validation on docker https://review.opendev.org/681869 | 18:24 |
| owalsh | EmilienM: FYI ^ | 18:24 |
| *** pkopec has quit IRC | 18:27 | |
| openstackgerrit | Oliver Walsh proposed openstack/tripleo-heat-templates master: Skip systemd healthcheck validation on docker https://review.opendev.org/681869 | 18:30 |
| *** d0ugal has quit IRC | 18:32 | |
| owalsh | EmilienM: I'm outta here. I'll rebase https://review.opendev.org/681442 on top of ^^^ later once zuul finished | 18:34 |
| jschlueter | cloudnull, EmilienM: https://review.opendev.org/#/c/680125/4 found a bug in backport ... ENTRYPOINT didn't get move outside of the install block | 18:35 |
| owalsh | hopefully all green then | 18:35 |
| jschlueter | EmilienM, cloudnull: want me to propose the patch or you guys want to ? | 18:37 |
| jschlueter | for actually enabling dumb-init in rocky/queens | 18:37 |
| *** gbarros has quit IRC | 18:38 | |
| cloudnull | jschlueter thats what I had originally, however the kolla PTL wanted inside the block - https://review.opendev.org/#/c/680125/1 | 18:39 |
| jschlueter | cloudnull: then if you want to leave it that way then in tripleo-common you have to inject the ENTRYPOINT back into the install block | 18:40 |
| jschlueter | cloudnull: because right now on queens/OSP 13 with those changes as is no ENTRYPOINT comes through ... since dumb-init install block is truncated ... which also nukes the ENTRYPOINT in there | 18:41 |
| *** ade_lee has quit IRC | 18:42 | |
| cloudnull | jschlueter can set set that option https://review.opendev.org/#/c/680125/1/docker/mariadb/Dockerfile.j2@54 | 18:42 |
| openstackgerrit | Merged openstack/python-tripleoclient master: Ensure no duplicate IPs are used in undercloud.conf https://review.opendev.org/664224 | 18:43 |
| cloudnull | or I can add the entrypoint into the install block within tripleo-common | 18:43 |
| jschlueter | either way ... it is now mixed ... | 18:43 |
| jschlueter | or just fix it in downstream only | 18:45 |
| cloudnull | EmilienM ^ thoughts ? | 18:45 |
| *** d0ugal has joined #tripleo | 18:45 | |
| cloudnull | I'll toss up a change to tripleo-common to put the entrypoint there. | 18:45 |
| EmilienM | owalsh: no | 18:49 |
| EmilienM | please use container_cli | 18:49 |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/tripleo-common stable/queens: Add ENTRYPOINT to the dumb init install block https://review.opendev.org/681876 | 18:49 |
| EmilienM | don't do that | 18:50 |
| cloudnull | jschlueter EmilienM ^ | 18:50 |
| * jschlueter nods | 18:51 | |
| jschlueter | I'll wait for tomorrow to see where things land | 18:51 |
| cloudnull | ++ | 18:52 |
| EmilienM | owalsh: ^ | 18:53 |
| *** pkopec has joined #tripleo | 18:53 | |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: Only run healthcheck for podman https://review.opendev.org/681877 | 18:53 |
| EmilienM | owalsh: ^ | 18:53 |
| *** d0ugal has quit IRC | 18:56 | |
| cloudnull | EmilienM for that heat paste config problem, how do we go about injecting a file into our configs ? the error we were seeing is resolved just as soon as I set https://raw.githubusercontent.com/openstack/heat/master/etc/heat/api-paste.ini in place. | 18:56 |
| EmilienM | owalsh: ^ | 18:56 |
| cloudnull | re https://bugzilla.redhat.com/show_bug.cgi?id=1751718 | 18:56 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: Skip systemd healthcheck validation on docker https://review.opendev.org/681869 | 18:56 |
| openstack | bugzilla.redhat.com bug 1751718 in openstack-heat "Containerized heat-api fails to start/operate properly, locate api-paste.ini" [High,New] - Assigned to zbitter | 18:56 |
| EmilienM | owalsh: I pushed over your patch | 18:56 |
| openstackgerrit | Alex Schultz proposed openstack/python-tripleoclient stable/stein: Ensure no duplicate IPs are used in undercloud.conf https://review.opendev.org/681878 | 18:56 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: Wait for first healthcheck before running validation tasks https://review.opendev.org/681442 | 18:57 |
| openstackgerrit | Merged openstack/puppet-tripleo master: Support connecting OVN DB over SSL https://review.opendev.org/674849 | 19:00 |
| openstackgerrit | Merged openstack/python-tripleoclient master: PDF documentation build https://review.opendev.org/681448 | 19:00 |
| cloudnull | -cc mwhahaha re: bz 1751718 | 19:00 |
| *** gbarros has joined #tripleo | 19:02 | |
| *** jcoufal has joined #tripleo | 19:03 | |
| *** dciabrin has joined #tripleo | 19:06 | |
| *** dciabrin_ has quit IRC | 19:07 | |
| *** lucasagomes has quit IRC | 19:09 | |
| *** d0ugal has joined #tripleo | 19:11 | |
| *** ykarel|away has quit IRC | 19:18 | |
| *** itlinux is now known as itlinux-away | 19:22 | |
| *** itlinux-away is now known as itlinux | 19:24 | |
| *** itlinux is now known as itlinux-away | 19:24 | |
| *** itlinux-away is now known as itlinux | 19:24 | |
| *** itlinux is now known as itlinux-away | 19:24 | |
| openstackgerrit | Bob Fournier proposed openstack/diskimage-builder master: Use x86 architeture specific grub2 packages for RHEL https://review.opendev.org/681889 | 19:26 |
| *** artom has quit IRC | 19:26 | |
| *** itlinux-away is now known as itlinux | 19:26 | |
| *** itlinux is now known as itlinux-away | 19:26 | |
| *** itlinux-away is now known as itlinux | 19:27 | |
| *** itlinux is now known as itlinux-away | 19:27 | |
| *** d0ugal has quit IRC | 19:28 | |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart-extras master: WIP: allow external ansible role for 3rd party job https://review.opendev.org/673926 | 19:28 |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart-extras master: WIP: allow external ansible role for 3rd party job https://review.opendev.org/673926 | 19:28 |
| *** artom has joined #tripleo | 19:31 | |
| *** itlinux-away is now known as itlinux | 19:31 | |
| *** itlinux is now known as itlinux-away | 19:31 | |
| *** itlinux-away is now known as itlinux | 19:32 | |
| *** itlinux is now known as itlinux-away | 19:32 | |
| *** lbragstad has joined #tripleo | 19:32 | |
| *** chem` has quit IRC | 19:33 | |
| owalsh | EmilienM: np, probably more obvious that way | 19:34 |
| *** itlinux-away is now known as itlinux | 19:34 | |
| *** itlinux is now known as itlinux-away | 19:34 | |
| *** holser has quit IRC | 19:35 | |
| *** jcoufal has quit IRC | 19:36 | |
| *** d0ugal has joined #tripleo | 19:36 | |
| *** artom has quit IRC | 19:42 | |
| *** itlinux-away is now known as itlinux | 19:43 | |
| *** itlinux is now known as itlinux-away | 19:43 | |
| *** radek has joined #tripleo | 19:49 | |
| *** radek has quit IRC | 19:50 | |
| *** itlinux-away is now known as itlinux | 19:51 | |
| *** itlinux is now known as itlinux-away | 19:51 | |
| *** Vorrtex has quit IRC | 19:52 | |
| *** pkopec has quit IRC | 19:53 | |
| *** radek has joined #tripleo | 19:55 | |
| *** itlinux-away is now known as itlinux | 19:55 | |
| *** itlinux is now known as itlinux-away | 19:55 | |
| *** itlinux-away is now known as itlinux | 19:55 | |
| *** itlinux is now known as itlinux-away | 19:56 | |
| *** jbadiapa has quit IRC | 19:57 | |
| *** jtomasek has quit IRC | 19:58 | |
| *** itlinux-away is now known as itlinux | 19:59 | |
| *** itlinux is now known as itlinux-away | 19:59 | |
| sshnaidm|rover | EmilienM, hi, do you know where I can find /etc/neutron/conf.d/neutron-server/networking-sfc.conf file for neutron container in overcloud logs? http://logs.rdoproject.org/openstack-periodic-master/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-7-ovb-3ctlr_1comp_1supp-featureset039-master/ed3dbd8/logs/overcloud-controller-0/var/log/ | 20:01 |
| *** itlinux-away is now known as itlinux | 20:02 | |
| *** itlinux is now known as itlinux-away | 20:02 | |
| *** itlinux-away is now known as itlinux | 20:02 | |
| *** itlinux is now known as itlinux-away | 20:03 | |
| *** itlinux-away is now known as itlinux | 20:04 | |
| *** itlinux is now known as itlinux-away | 20:04 | |
| *** itlinux-away is now known as itlinux | 20:06 | |
| *** itlinux is now known as itlinux-away | 20:07 | |
| radek | Folks, I have some review which keeps failing on tripleo-ci-centos-7-undercloud-containers check with error: "fatal: [undercloud]: FAILED! => {"changed": false, "msg": "nova-scheduler isn't working (healthcheck failed)"}" | 20:08 |
| radek | here is full log: https://ee2c140fb29ecb3a815b-4a9c39ee8b7a6253d43363c4ec56be4d.ssl.cf5.rackcdn.com/681385/3/check/tripleo-ci-centos-7-undercloud-containers/a27b392/logs/undercloud/home/zuul/undercloud_install.log.txt.gz | 20:09 |
| mwhahaha | i believe that's a known issue that should be fixed as of yesterday | 20:09 |
| radek | Ohhh really, I will give a try with one more recheck than :) | 20:11 |
| *** aakarsh|2 has quit IRC | 20:12 | |
| *** itlinux-away is now known as itlinux | 20:13 | |
| *** itlinux is now known as itlinux-away | 20:13 | |
| weshay | mwhahaha /me looking for the config value for | 20:13 |
| weshay | 2019-09-11 16:07:21.068 7 ERROR neutron.service [-] Unrecoverable error: please check log for details.: ConfigFileValueError: Value for option bind_host from LocationInfo(location=<Locations.user: (4, True)>, detail='/etc/neutron/conf.d/neutron-server/networking-sfc.conf') is not valid: is not a valid host address | 20:13 |
| mwhahaha | the fix landed over night | 20:13 |
| weshay | is that here? http://logs.rdoproject.org/openstack-periodic-master/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-7-ovb-3ctlr_1comp_1supp-featureset039-master/c828452/logs/overcloud-controller-0/etc/puppet/hieradata/service_configs.json.txt.gz | 20:14 |
| weshay | "neutron::bind_host": "%{hiera('localhost_address')}", | 20:14 |
| weshay | http://logs.rdoproject.org/openstack-periodic-master/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-7-ovb-3ctlr_1comp_1supp-featureset039-master/c828452/logs/overcloud-controller-0/var/log/containers/neutron/server.log.txt.gz | 20:14 |
| mwhahaha | weshay: maybe? i don't know what networking-sfc.conf is | 20:15 |
| mwhahaha | would have to track that down | 20:15 |
| mwhahaha | i think neutron::bind_host goes in neutron.conf | 20:15 |
| mwhahaha | not networking-sfc.conf | 20:15 |
| *** radek has quit IRC | 20:16 | |
| mwhahaha | weshay: i don't think we set biund_host in that file? | 20:16 |
| mwhahaha | maybe it's coming from packaging? | 20:17 |
| *** itlinux-away is now known as itlinux | 20:18 | |
| *** itlinux is now known as itlinux-away | 20:18 | |
| *** itlinux-away is now known as itlinux | 20:20 | |
| *** itlinux is now known as itlinux-away | 20:20 | |
| *** radek has joined #tripleo | 20:20 | |
| *** xek has quit IRC | 20:21 | |
| *** itlinux-away is now known as itlinux | 20:21 | |
| *** itlinux is now known as itlinux-away | 20:21 | |
| *** itlinux-away is now known as itlinux | 20:21 | |
| *** itlinux is now known as itlinux-away | 20:21 | |
| *** itlinux-away is now known as itlinux | 20:23 | |
| *** itlinux is now known as itlinux-away | 20:23 | |
| *** itlinux-away is now known as itlinux | 20:23 | |
| *** itlinux is now known as itlinux-away | 20:23 | |
| *** ksambor has joined #tripleo | 20:26 | |
| *** ade_lee has joined #tripleo | 20:26 | |
| *** itlinux-away is now known as itlinux | 20:27 | |
| *** itlinux is now known as itlinux-away | 20:27 | |
| *** ksambor has quit IRC | 20:29 | |
| *** ksambor has joined #tripleo | 20:29 | |
| *** itlinux-away is now known as itlinux | 20:31 | |
| *** itlinux is now known as itlinux-away | 20:31 | |
| *** itlinux-away is now known as itlinux | 20:32 | |
| openstackgerrit | Sagi Shnaidman proposed openstack/ansible-role-collect-logs master: DNM: copy /etc of containers https://review.opendev.org/681923 | 20:32 |
| *** itlinux is now known as itlinux-away | 20:32 | |
| *** pcaruana has quit IRC | 20:32 | |
| sshnaidm|rover | weshay, ^^ | 20:33 |
| *** itlinux-away is now known as itlinux | 20:33 | |
| *** itlinux is now known as itlinux-away | 20:33 | |
| *** itlinux-away is now known as itlinux | 20:33 | |
| *** itlinux is now known as itlinux-away | 20:33 | |
| nkinder | cloudnull, question for you on this patch you worked on... - https://review.opendev.org/#/c/676506/ | 20:34 |
| openstackgerrit | wes hayutin proposed openstack/tripleo-heat-templates master: Revert "Convert kernel-baremetal-puppet to ansible" https://review.opendev.org/681925 | 20:34 |
| openstackgerrit | wes hayutin proposed openstack/tripleo-heat-templates master: Revert "Convert kernel-baremetal-puppet to ansible" https://review.opendev.org/681925 | 20:35 |
| nkinder | cloudnull, the puppet version you were converting sets localhost_address, which is pulled from hieradata for services like neutron | 20:35 |
| nkinder | cloudnull, weshay and I were looking into RDO CI failures for the fs039 job, which has been failing. It looks like the failures are due to localhost_address not being defined anymore | 20:36 |
| *** itlinux-away is now known as itlinux | 20:36 | |
| *** itlinux is now known as itlinux-away | 20:36 | |
| openstackgerrit | wes hayutin proposed openstack/ansible-role-collect-logs master: DNM: copy /etc of containers https://review.opendev.org/681923 | 20:36 |
| nkinder | cloudnull, sorry, I mean this patch - https://review.opendev.org/#/c/674060/ | 20:39 |
| *** ade_lee has quit IRC | 20:40 | |
| mwhahaha | nkinder: we ned to move that to the hieradata role | 20:40 |
| mwhahaha | (it doesn't actually make sense in that "service") | 20:41 |
| openstackgerrit | Damien Ciabrini proposed openstack/tripleo-heat-templates stable/rocky: HA: fix <service>_restart_bundle with minor update workflow https://review.opendev.org/681782 | 20:41 |
| *** Goneri has quit IRC | 20:42 | |
| *** ansmith has quit IRC | 20:45 | |
| *** itlinux-away is now known as itlinux | 20:45 | |
| *** itlinux is now known as itlinux-away | 20:45 | |
| *** hamzy_ has quit IRC | 20:49 | |
| *** pbandark has quit IRC | 20:50 | |
| *** pbandark has joined #tripleo | 20:51 | |
| *** d0ugal has quit IRC | 20:51 | |
| *** itlinux-away is now known as itlinux | 20:54 | |
| *** itlinux is now known as itlinux-away | 20:54 | |
| *** itlinux-away is now known as itlinux | 20:54 | |
| *** itlinux is now known as itlinux-away | 20:55 | |
| *** itlinux-away is now known as itlinux | 20:55 | |
| *** itlinux is now known as itlinux-away | 20:55 | |
| *** aakarsh|2 has joined #tripleo | 20:57 | |
| cloudnull | nkinder does localhost_address get set to the gateway device on the physical host ? | 20:58 |
| cloudnull | so it'd be different per-host ? | 20:58 |
| cloudnull | because, like what mwhahaha said, we can add something like localhost_address = ansible_host in the heiradata role | 20:59 |
| nkinder | cloudnull, it is always loopback (for IPv4) or 'localhost' for IPv6) | 20:59 |
| nkinder | cloudnull, IIRC, it is used to allow services to only listen on localhost when another service listening externally is terminating TLS for the service | 20:59 |
| nkinder | ...or other cases where we don't want to listen on the network | 21:00 |
| *** slaweq has quit IRC | 21:00 | |
| cloudnull | ok so we can set localhost_address = 127.0.0.1 or localhost_address = :: ? | 21:00 |
| nkinder | cloudnull, see where it is set here - https://github.com/openstack/tripleo-heat-templates/commit/d48d1bdb37a4262ffe36ae5003312dfdfad083ab | 21:00 |
| *** itlinux-away is now known as itlinux | 21:01 | |
| *** itlinux is now known as itlinux-away | 21:01 | |
| nkinder | we aren't using a v6 address, but the hostname 'localhost' which will resolve to the IPv6 loopback in a v6 only env | 21:01 |
| nkinder | ...at least that is my understanding. I didn't write the patch. :) | 21:01 |
| cloudnull | ++ | 21:02 |
| cloudnull | will take a look at that now | 21:02 |
| *** itlinux-away is now known as itlinux | 21:03 | |
| *** itlinux is now known as itlinux-away | 21:03 | |
| *** itlinux-away is now known as itlinux | 21:03 | |
| *** itlinux is now known as itlinux-away | 21:03 | |
| *** itlinux-away is now known as itlinux | 21:03 | |
| nkinder | cloudnull, much appreciated! | 21:05 |
| *** pbandark has quit IRC | 21:05 | |
| nkinder | cloudnull, please add myself and Grzegorz to the review | 21:07 |
| openstackgerrit | Martin Mágr proposed openstack/puppet-tripleo master: Add collectd-sensubility configuration https://review.opendev.org/678863 | 21:08 |
| *** d0ugal has joined #tripleo | 21:09 | |
| openstackgerrit | Radoslaw Smigielski proposed openstack/python-tripleoclient stable/queens: [FFU] Fix sensitive hostname in FFU upgrade run command https://review.opendev.org/681930 | 21:11 |
| *** artom has joined #tripleo | 21:18 | |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/tripleo-ansible master: Add local_address to the default hieradata on all hosts https://review.opendev.org/681933 | 21:19 |
| cloudnull | nkinder https://review.opendev.org/#/c/681933/ | 21:19 |
| cloudnull | that should do it. | 21:20 |
| *** bfournie has quit IRC | 21:20 | |
| cloudnull | do we have a test run we can add a "depends-on" to ? | 21:20 |
| *** ramishra has quit IRC | 21:23 | |
| *** zaneb has quit IRC | 21:25 | |
| *** zaneb has joined #tripleo | 21:25 | |
| openstackgerrit | Radoslaw Smigielski proposed openstack/python-tripleoclient stable/rocky: [FFU] Fix sensitive hostname in FFU upgrade run command https://review.opendev.org/681934 | 21:27 |
| *** d0ugal has quit IRC | 21:29 | |
| radek | mwhahaha: that gate job still failing with "nova-conductor isn't working (healthcheck failed)", example: https://408dbede262fdaf2175f-882fbdc9765e1a9e81809c5a97a4ce6a.ssl.cf2.rackcdn.com/681385/3/check/tripleo-ci-centos-7-standalone/f103ed1/logs/undercloud/home/zuul/standalone_deploy.log.txt.gz | 21:31 |
| openstackgerrit | Harald Jensås proposed openstack/tripleo-common master: [WIP] role_net_cidr_map https://review.opendev.org/679410 | 21:31 |
| openstackgerrit | Harald Jensås proposed openstack/python-tripleoclient master: [WIP] role_net_cidr_map https://review.opendev.org/679412 | 21:32 |
| *** lbragstad has quit IRC | 21:33 | |
| *** radek has quit IRC | 21:34 | |
| *** d0ugal has joined #tripleo | 21:34 | |
| *** radek has joined #tripleo | 21:34 | |
| *** bdodd has quit IRC | 21:34 | |
| *** hamzy_ has joined #tripleo | 21:37 | |
| nkinder | cloudnull, weshay might have something we can add a dependency on to trigger this job | 21:41 |
| *** raildo has joined #tripleo | 21:42 | |
| nkinder | cloudnull, maybe add a Resolves-Bug for https://bugs.launchpad.net/tripleo/+bug/1843422/ | 21:43 |
| openstack | Launchpad bug 1843422 in tripleo "OVB featureset039 all-TLS job fails in master" [Critical,Triaged] | 21:43 |
| mwhahaha | radek: I'll look in a bit. What repo is that patch for? I'm not a t a computer right now | 21:44 |
| *** mcornea has quit IRC | 21:45 | |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/tripleo-ansible master: Add local_address to the default hieradata on all hosts https://review.opendev.org/681933 | 21:48 |
| cloudnull | nkinder done. | 21:48 |
| nkinder | cloudnull++ | 21:49 |
| *** jcoufal has joined #tripleo | 21:51 | |
| *** devep has joined #tripleo | 21:52 | |
| weshay | cloudnull we should consider adding fs039 to zuul for tripleo-ansible | 21:53 |
| weshay | nkinder ^ | 21:53 |
| weshay | atm only fs001 is running | 21:54 |
| weshay | 2019-09-12 21:32:41.777949 | primary | TASK [nkinder.keycloak : wait for Keycloak management interface to be available] *** | 21:55 |
| weshay | 2019-09-12 21:32:41.795650 | primary | Thursday 12 September 2019 21:32:41 +0000 (0:00:00.789) 0:12:41.373 **** | 21:55 |
| weshay | 2019-09-12 21:37:42.993450 | primary | fatal: [supplemental]: FAILED! => { | 21:55 |
| weshay | 2019-09-12 21:37:42.993689 | primary | "changed": false, | 21:55 |
| weshay | 2019-09-12 21:37:42.993730 | primary | "elapsed": 300 | 21:55 |
| weshay | http://logs.rdoproject.org/72/21672/1/check/tripleo-ci-centos-7-ovb-1ctlr_2comp_1supp-featureset039/6ac437d/job-output.txt.gz | 21:55 |
| weshay | nkinder also ^ | 21:55 |
| *** weshay is now known as weshay|ruck | 22:04 | |
| *** jcoufal has quit IRC | 22:06 | |
| openstackgerrit | Merged openstack/python-tripleoclient stable/rocky: Add exclusions to the unused param warning https://review.opendev.org/680772 | 22:09 |
| nkinder | weshay|ruck, looks like it is still too much memory usage for the system - https://logs.rdoproject.org/72/21672/1/check/tripleo-ci-centos-7-ovb-1ctlr_2comp_1supp-featureset039/6ac437d/logs/supplemental/var/log/journal.txt.gz#_Sep_12_21_32_41 | 22:13 |
| nkinder | weshay|ruck, we should be able to reduce this quite a bit more. I'll update John's patch. | 22:13 |
| *** radek has quit IRC | 22:13 | |
| *** bfournie has joined #tripleo | 22:16 | |
| *** rcernin has joined #tripleo | 22:19 | |
| openstackgerrit | Nathan Kinder proposed openstack/tripleo-quickstart master: Add Keycloak setup to featureset039 https://review.opendev.org/671567 | 22:21 |
| nkinder | weshay|ruck, ^^^ | 22:25 |
| cloudnull | nkinder, weshay|ruck ++ we could totally add that job to tripleo-ansible. | 22:35 |
| cloudnull | is there a job definition for athat already ? | 22:35 |
| *** lbragstad has joined #tripleo | 22:40 | |
| *** rf0lc0 has joined #tripleo | 22:40 | |
| *** rfolco has quit IRC | 22:41 | |
| *** slaweq has joined #tripleo | 22:43 | |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/tripleo-ansible master: Add local_address to the default hieradata on all hosts https://review.opendev.org/681933 | 22:43 |
| *** slaweq has quit IRC | 22:48 | |
| *** devep has quit IRC | 22:55 | |
| *** devep has joined #tripleo | 22:57 | |
| *** raildo has quit IRC | 22:58 | |
| *** tkajinam has joined #tripleo | 23:03 | |
| *** saneax has joined #tripleo | 23:04 | |
| openstackgerrit | Steve Baker proposed openstack/tripleo-common master: Add missing allocations for active nodes https://review.opendev.org/678698 | 23:10 |
| openstackgerrit | Steve Baker proposed openstack/tripleo-common master: DNM never delete a nova server https://review.opendev.org/675498 | 23:10 |
| openstackgerrit | Steve Baker proposed openstack/tripleo-common master: Ignore failure calling cell_v2_discover_hosts from deployment https://review.opendev.org/681944 | 23:10 |
| *** devep has quit IRC | 23:12 | |
| *** d0ugal has quit IRC | 23:35 | |
| *** rlandy has quit IRC | 23:41 | |
| *** d0ugal has joined #tripleo | 23:43 | |
| openstackgerrit | Nathan Kinder proposed openstack/tripleo-quickstart master: Add Keycloak setup to featureset039 https://review.opendev.org/671567 | 23:50 |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Resolve broken zaqar container caused by logging issues https://review.opendev.org/681300 | 23:50 |
| weshay|ruck | cloudnull ya.. if you approve, I'll add it | 23:51 |
| weshay|ruck | sounds like you do | 23:51 |
| EmilienM | weshay|ruck: heads up before I leave | 23:58 |
| EmilienM | to stabilize gate | 23:58 |
| EmilienM | https://review.opendev.org/#/c/681869/ | 23:58 |
| EmilienM | https://review.opendev.org/#/c/681442/ | 23:58 |
| EmilienM | and https://review.opendev.org/#/c/681752/ should land soon | 23:59 |
| * EmilienM off | 23:59 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!