| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/tripleo-ansible master: Create a node import module and playbook https://review.opendev.org/692363 | 00:05 |
|---|---|---|
| *** ayoung has quit IRC | 00:07 | |
| *** ayoung has joined #tripleo | 00:08 | |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/python-tripleoclient master: Client code to do node import with ansible instead of mistral https://review.opendev.org/704561 | 00:08 |
| *** stevebaker has joined #tripleo | 00:13 | |
| openstackgerrit | Dan Sneddon proposed openstack/tripleo-heat-templates master: Remove static reference to InternalApi network https://review.opendev.org/704909 | 00:15 |
| *** mcornea has quit IRC | 00:22 | |
| *** holser has quit IRC | 00:22 | |
| *** holser has joined #tripleo | 00:47 | |
| *** rfolco has joined #tripleo | 00:55 | |
| *** holser has quit IRC | 01:06 | |
| openstackgerrit | James Slagle proposed openstack/tripleo-ansible master: Add strategy optimization https://review.opendev.org/704691 | 01:28 |
| *** rfolco has quit IRC | 01:29 | |
| openstackgerrit | James Slagle proposed openstack/tripleo-heat-templates master: DO-NOT-MERGE: test strategy optimization https://review.opendev.org/704914 | 01:30 |
| openstackgerrit | Steve Baker proposed openstack/python-tripleoclient master: Local file based image uploader https://review.opendev.org/693960 | 01:33 |
| *** stevebaker has quit IRC | 01:45 | |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-ansible master: WIP - Add module "container_puppet_config" https://review.opendev.org/702315 | 01:46 |
| openstackgerrit | Emilien Macchi proposed openstack/puppet-tripleo master: mysql: allow container-puppet-mysql to initiate the database https://review.opendev.org/704916 | 02:01 |
| EmilienM | dciabrin_ https://review.opendev.org/#/c/704916/ | 02:02 |
| *** ysandeep has quit IRC | 02:03 | |
| *** dsneddon has quit IRC | 02:16 | |
| openstackgerrit | Merged openstack/python-tripleoclient stable/train: Default to zero verbosity when using Ansible. https://review.opendev.org/704351 | 02:16 |
| EmilienM | slagle: let me know what you think about my comment on https://review.opendev.org/#/c/704441/ | 02:26 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: WIP - Deploy Puppet containers with tripleo-ansible https://review.opendev.org/702323 | 02:28 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: WIP - Deploy Puppet containers with tripleo-ansible https://review.opendev.org/702323 | 02:28 |
| openstackgerrit | Merged openstack/tripleo-ansible stable/train: Add action plugin for all_nodes data https://review.opendev.org/704883 | 02:38 |
| openstackgerrit | Merged openstack/tripleo-ansible master: Update molecule test jobs for new role name https://review.opendev.org/704875 | 02:38 |
| *** ysandeep has joined #tripleo | 02:41 | |
| *** dsneddon has joined #tripleo | 02:45 | |
| *** ccamacho has quit IRC | 02:50 | |
| *** mschuppert has quit IRC | 02:53 | |
| openstackgerrit | Merged openstack/tripleo-common stable/train: Clarify introspection failed attempt log message https://review.opendev.org/704340 | 02:55 |
| openstackgerrit | Merged openstack/python-tripleoclient stable/train: Enforce 0600 permissions on private SSH key file. https://review.opendev.org/703808 | 02:55 |
| openstackgerrit | Merged openstack/tripleo-common stable/stein: Clarify introspection failed attempt log message https://review.opendev.org/704341 | 02:55 |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Fix keepalived logging on disk https://review.opendev.org/704604 | 02:55 |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Create qemu user/group on controller https://review.opendev.org/704303 | 02:55 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates stable/train: Fix keepalived logging on disk https://review.opendev.org/704917 | 03:05 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates stable/stein: Fix keepalived logging on disk https://review.opendev.org/704918 | 03:05 |
| *** dsneddon has quit IRC | 03:12 | |
| *** dsneddon has joined #tripleo | 03:15 | |
| *** stevebaker has joined #tripleo | 03:17 | |
| openstackgerrit | Oliver Walsh proposed openstack/tripleo-common master: Add tripleo_role_networks to inventory role group vars https://review.opendev.org/704919 | 03:20 |
| *** dsneddon has quit IRC | 03:21 | |
| openstackgerrit | Oliver Walsh proposed openstack/tripleo-ansible master: Simplify ssh_known_hosts role https://review.opendev.org/704880 | 03:24 |
| *** psachin has joined #tripleo | 03:35 | |
| openstackgerrit | Oliver Walsh proposed openstack/tripleo-ansible master: Simplify ssh_known_hosts role https://review.opendev.org/704880 | 03:51 |
| *** dsneddon has joined #tripleo | 03:52 | |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-ansible master: WIP - Add module "container_puppet_config" https://review.opendev.org/702315 | 03:54 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-ansible master: WIP - Add module "container_puppet_config" https://review.opendev.org/702315 | 03:54 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: WIP - Deploy Puppet containers with tripleo-ansible https://review.opendev.org/702323 | 03:54 |
| *** dsneddon has quit IRC | 03:57 | |
| *** ykarel|away is now known as ykarel | 04:00 | |
| openstackgerrit | Oliver Walsh proposed openstack/tripleo-ansible master: Simplify ssh_known_hosts role https://review.opendev.org/704880 | 04:04 |
| *** rlandy|bbl is now known as rlandy | 04:08 | |
| *** skramaja has joined #tripleo | 04:25 | |
| *** dmacpher_ has quit IRC | 04:27 | |
| *** dmacpher has joined #tripleo | 04:32 | |
| *** udesale has joined #tripleo | 04:40 | |
| *** dsneddon has joined #tripleo | 04:48 | |
| *** dsneddon has quit IRC | 04:54 | |
| *** ysandeep has quit IRC | 04:54 | |
| *** ysandeep_ has joined #tripleo | 04:54 | |
| *** ysandeep_ has quit IRC | 04:56 | |
| *** ramishra has joined #tripleo | 05:10 | |
| *** dsneddon has joined #tripleo | 05:25 | |
| *** dsneddon has quit IRC | 05:30 | |
| *** surpatil has joined #tripleo | 05:44 | |
| *** raukadah is now known as chkumar|rover | 05:57 | |
| *** bandini has joined #tripleo | 06:02 | |
| *** soniya29 has joined #tripleo | 06:02 | |
| *** abdysn has joined #tripleo | 06:16 | |
| *** ratailor has joined #tripleo | 06:34 | |
| *** surpatil has quit IRC | 06:44 | |
| *** marios has joined #tripleo | 06:44 | |
| *** udesale_ has joined #tripleo | 06:46 | |
| *** udesale has quit IRC | 06:47 | |
| openstackgerrit | Francesco Pantano proposed openstack/tripleo-heat-templates stable/train: Ensure Ceph dependencies are installed in pre-provisioned nodes https://review.opendev.org/704926 | 06:47 |
| *** lmiccini has joined #tripleo | 06:53 | |
| chkumar|rover | Any tripleo cores around https://review.opendev.org/#/c/703953/ needs +w on this , thanks :-) | 06:57 |
| *** apetrich has joined #tripleo | 07:01 | |
| chkumar|rover | FYI! Gate queue is very high, please donot workflow patches | 07:02 |
| sshnaidm|afk | chkumar|rover, nope :( | 07:04 |
| sshnaidm|afk | only OPs can do it | 07:05 |
| chkumar|rover | yes, let's wait for other people to join, may be arxcruz might have | 07:05 |
| sshnaidm|afk | and all OPs are from western hemisphere | 07:06 |
| *** slaweq has joined #tripleo | 07:06 | |
| sshnaidm|afk | chkumar|rover, do you know what's the problem? | 07:07 |
| sshnaidm|afk | seems like upgrades failed because of role rename | 07:09 |
| chkumar|rover | sshnaidm|afk, nope stilling looking | 07:09 |
| chkumar|rover | tripleo-ci-centos-7-scenario000-multinode-oooq-container-updates | 07:09 |
| chkumar|rover | sshnaidm|afk, https://5e7e7be1ea42142e6d74-f918abb3dcdfb01ed824790c230ea283.ssl.cf2.rackcdn.com/702720/2/gate/tripleo-ci-centos-7-scenario000-multinode-oooq-container-updates/86dbe46/logs/undercloud/home/zuul/overcloud_deploy.log | 07:12 |
| chkumar|rover | sshnaidm|afk, http://mirror.mtl01.inap.opendev.org/centos/7/os/x86_64/Packages/PyYAML-3.10-11.el7.x86_64.rpm: [Errno 14] curl#6 - "Could not resolve host: mirror.mtl01.inap.opendev.org; Unknown error" | 07:12 |
| *** waleedm has joined #tripleo | 07:14 | |
| *** waleedm_ has joined #tripleo | 07:15 | |
| chkumar|rover | http://mirror.mtl01.inap.opendev.org/centos/7/os/x86_64/ is working fine there | 07:15 |
| *** waleedm has quit IRC | 07:15 | |
| *** waleedm has joined #tripleo | 07:16 | |
| *** yprokule has joined #tripleo | 07:20 | |
| *** apetrich has quit IRC | 07:22 | |
| *** jtomasek has joined #tripleo | 07:22 | |
| chkumar|rover | sshnaidm|afk, for role rename , we need this https://review.opendev.org/#/c/704922/ | 07:22 |
| sshnaidm|afk | chkumar|rover, ok | 07:23 |
| *** jfrancoa has joined #tripleo | 07:24 | |
| *** ratailor has quit IRC | 07:26 | |
| *** dsneddon has joined #tripleo | 07:27 | |
| sshnaidm|afk | Jan 30 06:05:36 undercloud.localdomain kernel: iptables dropped: IN=eth0 OUT= MAC=fa:16:3e:48:7c:19:e8:04:62:1c:a6:80:08:00 SRC=176.113.115.248 DST=198.72.124.63 LEN=40 TOS=0x00 PREC=0x00 TTL=240 ID=33994 PROTO=TCP SPT=47949 DPT=34882 WINDOW=1024 RES=0x00 SYN URGP=0 | 07:27 |
| *** ratailor has joined #tripleo | 07:27 | |
| sshnaidm|afk | chkumar|rover, this is dropped packet to proxy address.. | 07:27 |
| sshnaidm|afk | no idea why it's dropped though | 07:27 |
| chkumar|rover | sshnaidm|afk, http://files.openstack.org/mirror/logs/rsync-mirrors/centos.log | 07:27 |
| *** dsneddon has quit IRC | 07:32 | |
| *** yolanda has quit IRC | 07:32 | |
| *** ykarel is now known as ykarel|lunch | 07:34 | |
| dciabrin_ | EmilienM, still around by chance? | 07:38 |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/train: Check to make sure compute service is deployed before scale down https://review.opendev.org/704220 | 07:40 |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/stein: Remove dracut-config-generic package https://review.opendev.org/704825 | 07:40 |
| *** bogdando has joined #tripleo | 07:41 | |
| openstackgerrit | Daniel Bengtsson proposed openstack/tripleo-heat-templates stable/rocky: Remove dracut-config-generic package. https://review.opendev.org/704930 | 07:45 |
| *** chem has quit IRC | 07:46 | |
| *** jtomasek has quit IRC | 07:47 | |
| *** tesseract has joined #tripleo | 07:47 | |
| *** chem has joined #tripleo | 07:48 | |
| *** mschuppert has joined #tripleo | 07:49 | |
| openstackgerrit | Merged openstack/tripleo-common master: Tune ansible configuration for better performance https://review.opendev.org/704675 | 07:49 |
| openstackgerrit | Merged openstack/tripleo-validations master: molecule-xfs_check_ftypefailure (non-voting), remove from gate https://review.opendev.org/704164 | 07:49 |
| openstackgerrit | Abdallah Yasin proposed openstack/tripleo-heat-templates master: Fix the mounting issues for the TLS everywhere deployment https://review.opendev.org/703953 | 07:52 |
| *** hberaud|gone is now known as hberaud | 07:57 | |
| *** udesale_ has quit IRC | 07:58 | |
| *** udesale_ has joined #tripleo | 07:58 | |
| *** jpena|off is now known as jpena | 08:10 | |
| openstackgerrit | Bogdan Dobrelya (bogdando) proposed openstack/tripleo-common master: Only generate cloudrc for stacks running Keystone https://review.opendev.org/697121 | 08:10 |
| *** sshnaidm|afk is now known as sshnaidm | 08:12 | |
| *** dpawlik has quit IRC | 08:14 | |
| *** rpittau|afk is now known as rpittau | 08:14 | |
| *** tkajinam has quit IRC | 08:15 | |
| *** ccamacho has joined #tripleo | 08:19 | |
| *** dpawlik has joined #tripleo | 08:23 | |
| openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-ci master: Revert "Disable gzip on main collect-logs config" https://review.opendev.org/704933 | 08:24 |
| *** jtomasek has joined #tripleo | 08:25 | |
| *** lmiccini has quit IRC | 08:27 | |
| *** udesale_ has quit IRC | 08:28 | |
| *** lmiccini has joined #tripleo | 08:29 | |
| sshnaidm | jpena, that should fix ^ | 08:29 |
| sshnaidm | zbr, ping me when you're online | 08:30 |
| *** florianf has joined #tripleo | 08:30 | |
| jpena | sshnaidm: I guess that parameter should be set on the jobs running at review.rdo, right? | 08:31 |
| *** dmsimard5 has joined #tripleo | 08:31 | |
| *** soniya29 has quit IRC | 08:32 | |
| *** dmsimard has quit IRC | 08:33 | |
| *** dmsimard5 is now known as dmsimard | 08:33 | |
| sshnaidm | jpena, update in https://bugs.launchpad.net/tripleo/+bug/1861378 | 08:33 |
| openstack | Launchpad bug 1861378 in tripleo "Multiple post_failure on master periodic pipeline" [Critical,Confirmed] | 08:33 |
| sshnaidm | jpena, it shouldn't be set in this file | 08:33 |
| *** tmazur has joined #tripleo | 08:34 | |
| openstackgerrit | Jaganathan Palanisamy proposed openstack/tripleo-common stable/stein: Derive new nova compute parameter https://review.opendev.org/704937 | 08:35 |
| openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-ci master: Disable gzip on upstream and enable on OVB https://review.opendev.org/704938 | 08:36 |
| sshnaidm | zbr, jpena ^ | 08:36 |
| sshnaidm | chkumar|rover, vote please ^ | 08:37 |
| zbr | sshnaidm: why to create two changes instead of one? to make it slower to get merged? | 08:40 |
| sshnaidm | zbr, yes, I like to watch jobs running | 08:40 |
| zbr | sshnaidm: everyone with his own kinks | 08:40 |
| marios | haha | 08:41 |
| zbr | how about doing only that line https://review.opendev.org/#/c/704938/1/toci-quickstart/config/testenv/multinode.yml without any deps | 08:42 |
| zbr | in 4-5h we may have it merged | 08:42 |
| *** iurygregory has joined #tripleo | 08:42 | |
| openstackgerrit | Francesco Pantano proposed openstack/tripleo-validations stable/queens: Fix default ceph-ansible repo https://review.opendev.org/704941 | 08:43 |
| zbr | i am not very pleased to see a revert of a valid change, default gzip disabled was desired behvior. | 08:44 |
| *** tosky has joined #tripleo | 08:46 | |
| sshnaidm | zbr, valid change? it's a mistake change | 08:46 |
| sshnaidm | zbr, and should have been reviewed by at least 2 people, but that's other story | 08:46 |
| zbr | mistale change, revert it, and later make another change to put it back? | 08:47 |
| sshnaidm | zbr, ?? | 08:48 |
| *** apetrich has joined #tripleo | 08:48 | |
| zbr | from my discussions with wes, it was clear that the expected behavior of the role would be to never archive by default and on upstream jobs. | 08:48 |
| zbr | only rdo needed archival and that for technical reasons (their lack of storage compression) | 08:48 |
| zbr | what am I missing? | 08:49 |
| sshnaidm | zbr, you need to look how collect logs playbook is executed: http://paste.openstack.org/show/788961/ | 08:49 |
| sshnaidm | zbr, collect-logs.yml is the *last* | 08:49 |
| sshnaidm | and it overrides everything you set anywhere | 08:49 |
| sshnaidm | it's not a "default" | 08:50 |
| zbr | ouch | 08:50 |
| zbr | now it makes sense | 08:50 |
| sshnaidm | zbr, defaults are in "defaults" of the role itself | 08:50 |
| sshnaidm | and there it should be default value | 08:50 |
| zbr | there is correct one | 08:50 |
| zbr | this explains the unexpected outcomes | 08:51 |
| sshnaidm | zbr, and all environment related settings are in environment files, like multinode.yml, ovb.yml, etc | 08:51 |
| zbr | can we make a single change, an leave a note in collect logs to avoid other similar accident | 08:51 |
| sshnaidm | zbr, no need | 08:51 |
| zbr | if you say so | 08:52 |
| sshnaidm | I think it's pretty obvious that default of role is in "defaults" folder of role | 08:52 |
| *** pkopec has joined #tripleo | 08:53 | |
| *** waleedm_ has quit IRC | 09:00 | |
| *** jpena is now known as jpena|off | 09:00 | |
| *** waleedm has quit IRC | 09:01 | |
| *** waleedm has joined #tripleo | 09:02 | |
| *** waleedm_ has joined #tripleo | 09:02 | |
| *** gfidente has joined #tripleo | 09:04 | |
| Tengu | bogdando: heya! care to have a look at https://review.opendev.org/#/c/704808/ ? thank you :) | 09:05 |
| bogdando | Tengu: done | 09:05 |
| Tengu | thanks! | 09:06 |
| *** apevec has joined #tripleo | 09:06 | |
| openstackgerrit | Jose Luis Franco proposed openstack/tripleo-heat-templates stable/stein: Force facts cache refreshing after OS upgrade. https://review.opendev.org/698894 | 09:09 |
| chkumar|rover | sshnaidm, little confused at one place https://review.opendev.org/#/c/704933/1 and https://review.opendev.org/#/c/704938 | 09:10 |
| chkumar|rover | at one place we are reverting and we are setting to false | 09:10 |
| sshnaidm | chkumar|rover, reverting patch that disable gzip on ovb, to get logs server up again | 09:11 |
| sshnaidm | chkumar|rover, next patch will disable gzip on upstream so we can browse logs | 09:11 |
| *** jpich has joined #tripleo | 09:12 | |
| chkumar|rover | sshnaidm, ack, make sense | 09:13 |
| *** lucasagomes has joined #tripleo | 09:15 | |
| *** holser has joined #tripleo | 09:16 | |
| *** xek_ has joined #tripleo | 09:17 | |
| openstackgerrit | Merged openstack/tripleo-common stable/rocky: Raise exception on KeyboardInterrupt https://review.opendev.org/704817 | 09:22 |
| openstackgerrit | Merged openstack/tripleo-common stable/stein: Raise exception on KeyboardInterrupt https://review.opendev.org/704816 | 09:22 |
| openstackgerrit | Merged openstack/tripleo-common stable/train: Raise exception on KeyboardInterrupt https://review.opendev.org/704815 | 09:27 |
| openstackgerrit | Merged openstack/tripleo-common stable/queens: Raise exception on KeyboardInterrupt https://review.opendev.org/704819 | 09:27 |
| openstackgerrit | Merged openstack/tripleo-common stable/train: Make healthchecks more strict https://review.opendev.org/704651 | 09:27 |
| *** dsneddon has joined #tripleo | 09:27 | |
| *** waleedm__ has joined #tripleo | 09:28 | |
| *** dtantsur|afk is now known as dtantsur | 09:29 | |
| *** holser has quit IRC | 09:30 | |
| *** waleedm_ has quit IRC | 09:30 | |
| *** waleedm has quit IRC | 09:30 | |
| openstackgerrit | Julie Pichon proposed openstack/ansible-role-tripleo-modify-image master: Add double quotes around the printf statements in yum_update.sh https://review.opendev.org/704780 | 09:30 |
| *** alexmcleod has joined #tripleo | 09:30 | |
| openstackgerrit | Merged openstack/python-tripleoclient master: Add kwarg to set an ansible.cfg file https://review.opendev.org/704683 | 09:30 |
| openstackgerrit | Merged openstack/python-tripleoclient master: Fix all py27 tests https://review.opendev.org/704859 | 09:30 |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/queens: Add SSHD composable service to Networker role definition https://review.opendev.org/704894 | 09:31 |
| *** waleedm has joined #tripleo | 09:31 | |
| *** dsneddon has quit IRC | 09:32 | |
| *** holser has joined #tripleo | 09:32 | |
| *** derekh has joined #tripleo | 09:33 | |
| *** ykarel|lunch is now known as ykarel | 09:33 | |
| *** udesale has joined #tripleo | 09:35 | |
| sshnaidm | chkumar|rover, the queue freed up ^ | 09:53 |
| openstackgerrit | Harald Jensås proposed openstack/tripleo-common master: Support baremetal 'extra' property for node and port https://review.opendev.org/704475 | 09:55 |
| ykarel | sshnaidm, re. gzip, do not want gzip for standalone/multinodes in rdo? standalone-rdocloud.yml and multinode-rdocloud.yml etc ? | 09:56 |
| ykarel | or i didn't get that part | 09:56 |
| openstackgerrit | Jose Luis Franco proposed openstack/tripleo-heat-templates master: Force facts cache refreshing after OS upgrade. https://review.opendev.org/704947 | 09:57 |
| sshnaidm | ykarel, actually we'd better gzip them in rdo, as it allows to browse gzipped files | 09:57 |
| openstackgerrit | Arx Cruz proposed openstack/tripleo-quickstart master: DNM - Testing fs020 tempest https://review.opendev.org/704948 | 09:57 |
| ykarel | sshnaidm, ack, so u revising the patch, right? | 09:58 |
| ykarel | me not sure about vexxhost though, is it swift backed? or same as rdo | 09:59 |
| ykarel | if it's same as rdo good to do there similar | 09:59 |
| openstackgerrit | Jose Luis Franco proposed openstack/tripleo-heat-templates stable/train: Revert "Force facts cache refreshing before upgrade." https://review.opendev.org/704949 | 09:59 |
| apevec | ykarel, same as rdo for now | 10:04 |
| apevec | we'll explore moving logs to Swift in vexx after migration, to match upstream | 10:04 |
| ykarel | sshnaidm, ^^ so please do same for vexxhost | 10:04 |
| ykarel | apevec, Thanks | 10:04 |
| apevec | ykarel, logserver US is https://tree.taiga.io/project/morucci-software-factory/us/3337 | 10:05 |
| apevec | new logserver.rdoproject.org is up | 10:06 |
| *** suuuper has joined #tripleo | 10:06 | |
| sshnaidm | apevec, does vexxhost have its own logs server? | 10:07 |
| openstackgerrit | Sorin Sbarnea proposed openstack/tripleo-ci master: Disable gzip on upstream and enable on OVB (direct) https://review.opendev.org/704952 | 10:07 |
| apevec | please comment in https://tree.taiga.io/project/morucci-software-factory/task/3342 | 10:07 |
| apevec | sshnaidm, yes, logserver.rdoproject.org is new empty machine in Vexx | 10:07 |
| sshnaidm | apevec, wait, so it's only one server now and it's on vexxhost? | 10:08 |
| apevec | old one is logs.rdoproject.org | 10:08 |
| apevec | in rdocloud | 10:09 |
| apevec | we need to switch, that's the US I linked | 10:09 |
| apevec | let's comment in taiga what it would take | 10:09 |
| sshnaidm | apevec, ok, and you'll do the same config that doesn't allow browsing gzipped logs? or will it be possible? | 10:10 |
| chkumar|rover | sshnaidm, thanks :-) | 10:10 |
| apevec | it's the same config as in rdocloud | 10:10 |
| apevec | afaik | 10:10 |
| apevec | sshnaidm, please comment in taiga | 10:10 |
| apevec | I'm not the one doing the work | 10:10 |
| openstackgerrit | Sorin Sbarnea proposed openstack/tripleo-ci master: Disable gzip on upstream and enable on OVB (direct) https://review.opendev.org/704952 | 10:11 |
| sshnaidm | apevec, it's about patch that is now running, I need to know what settings to set for rdo | 10:12 |
| openstackgerrit | Sorin Sbarnea proposed openstack/tripleo-ci master: Disable gzip on upstream and enable on OVB (direct) https://review.opendev.org/704952 | 10:12 |
| sshnaidm | apevec, ok, let's assume it's like in rdo for now | 10:12 |
| openstackgerrit | Sorin Sbarnea proposed openstack/tripleo-ci master: Disable gzip on upstream and enable on OVB (direct) https://review.opendev.org/704952 | 10:13 |
| openstackgerrit | Arx Cruz proposed openstack/ansible-role-collect-logs master: Refactoring ara tasks https://review.opendev.org/704762 | 10:14 |
| openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-ci master: Disable gzip on upstream and enable on OVB https://review.opendev.org/704938 | 10:20 |
| sshnaidm | ykarel, ^^ | 10:20 |
| ykarel | sshnaidm, and standalone | 10:21 |
| ykarel | and vexxhost? | 10:21 |
| sshnaidm | ykarel, it's symlink | 10:21 |
| ykarel | ohhk it's same it hink | 10:22 |
| sshnaidm | no such jobs and configs for vexhost yet | 10:22 |
| sshnaidm | but good point, we need to create ones | 10:22 |
| ykarel | sshnaidm, i see -vexxhost files sshnaidm, okk, also include zbr suggestion as he has duplicate patch | 10:23 |
| ykarel | sshnaidm, i mean https://github.com/openstack/tripleo-ci/tree/master/toci-quickstart/config/testenv | 10:23 |
| openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-ci master: Disable gzip on upstream and enable on OVB https://review.opendev.org/704938 | 10:24 |
| sshnaidm | oh, missed it | 10:24 |
| *** ratailor has quit IRC | 10:24 | |
| openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-ci master: Disable gzip on upstream and enable on OVB https://review.opendev.org/704938 | 10:25 |
| ykarel | ack | 10:26 |
| *** ratailor has joined #tripleo | 10:26 | |
| *** ratailor has quit IRC | 10:26 | |
| *** ratailor has joined #tripleo | 10:27 | |
| *** ratailor has quit IRC | 10:29 | |
| *** ratailor has joined #tripleo | 10:30 | |
| *** ratailor has quit IRC | 10:31 | |
| *** ratailor has joined #tripleo | 10:32 | |
| *** ratailor has quit IRC | 10:40 | |
| *** ratailor has joined #tripleo | 10:41 | |
| *** ratailor has quit IRC | 10:41 | |
| *** dsneddon has joined #tripleo | 10:42 | |
| openstackgerrit | Merged openstack/tripleo-docs master: Document openstack overcloud admin authorize https://review.opendev.org/704887 | 10:43 |
| chkumar|rover | sshnaidm, can we link this bug https://bugs.launchpad.net/tripleo/+bug/1861378 also in commit message https://review.opendev.org/#/c/704938/ | 10:44 |
| openstack | Launchpad bug 1861378 in tripleo "Multiple post_failure on master periodic pipeline" [Critical,Confirmed] | 10:44 |
| *** ratailor has joined #tripleo | 10:44 | |
| *** abdysn has quit IRC | 10:46 | |
| *** pcaruana has quit IRC | 10:46 | |
| *** apetrich has quit IRC | 10:47 | |
| *** dsneddon has quit IRC | 10:49 | |
| openstackgerrit | Gael Chamoulaud proposed openstack/tripleo-validations master: Make groups documentation part dynamic https://review.opendev.org/703060 | 10:50 |
| openstackgerrit | Gael Chamoulaud proposed openstack/tripleo-validations master: Remove 'no-op-firewall-nova-driver' validator https://review.opendev.org/696538 | 10:50 |
| openstackgerrit | Gael Chamoulaud proposed openstack/tripleo-validations master: Remove 'no-op-firewall-nova-driver' validator https://review.opendev.org/696538 | 10:51 |
| *** hberaud is now known as hberaud|school-r | 10:52 | |
| *** dsneddon has joined #tripleo | 10:52 | |
| openstackgerrit | Gael Chamoulaud proposed openstack/tripleo-validations master: Adds Search Path Override https://review.opendev.org/703515 | 10:52 |
| openstackgerrit | Francesco Pantano proposed openstack/puppet-tripleo master: Add ceph dashboard frontend endpoint and tls-e integration https://review.opendev.org/702839 | 10:52 |
| *** zbr has quit IRC | 10:52 | |
| *** udesale has quit IRC | 10:53 | |
| openstackgerrit | Francesco Pantano proposed openstack/puppet-tripleo master: Add ceph dashboard frontend endpoint and tls-e integration https://review.opendev.org/702839 | 10:54 |
| *** ratailor_ has joined #tripleo | 10:55 | |
| openstackgerrit | Michele Baldessari proposed openstack/puppet-tripleo master: WIP rabbitmq ra https://review.opendev.org/685068 | 10:56 |
| *** dsneddon has quit IRC | 10:57 | |
| *** ratailor has quit IRC | 10:58 | |
| openstackgerrit | Michele Baldessari proposed openstack/tripleo-heat-templates master: WIP test rabbitmq https://review.opendev.org/685077 | 10:59 |
| openstackgerrit | yatin proposed openstack/tripleo-heat-templates master: Add missing firewall rule for iscsid in HA deployments https://review.opendev.org/704805 | 11:01 |
| ykarel | chkumar|rover, ^^ | 11:01 |
| *** hberaud|school-r is now known as hberaud|lunch | 11:03 | |
| openstackgerrit | Gael Chamoulaud proposed openstack/tripleo-validations master: Delete healthcheck-service-status role https://review.opendev.org/704117 | 11:06 |
| openstackgerrit | Gael Chamoulaud proposed openstack/tripleo-validations master: Add custom ansible-lint rule for Role Names https://review.opendev.org/703463 | 11:06 |
| openstackgerrit | Gael Chamoulaud proposed openstack/tripleo-validations master: Add basic molecule tests for uncovered roles https://review.opendev.org/704158 | 11:06 |
| *** rpittau is now known as rpittau|bbl | 11:14 | |
| openstackgerrit | Chandan Kumar (raukadah) proposed openstack/tripleo-quickstart-extras master: Revert "update master skip list, nova issues and timeout" https://review.opendev.org/704962 | 11:15 |
| openstackgerrit | Francesco Pantano proposed openstack/tripleo-validations stable/rocky: Sync 'validations/ceph-ansible-installed.yaml' with the new role https://review.opendev.org/703926 | 11:16 |
| openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-ci master: Disable gzip on upstream and enable on OVB https://review.opendev.org/704938 | 11:17 |
| sshnaidm | chkumar|rover, ^ | 11:17 |
| chkumar|rover | sshnaidm, thanks! | 11:18 |
| openstackgerrit | Rabi Mishra proposed openstack/tripleo-common master: Remove workbook and action related to plan environment https://review.opendev.org/704963 | 11:19 |
| openstackgerrit | Lukas Bezdicka proposed openstack/tripleo-heat-templates stable/train: WIP placement: Add db stamp task during migration https://review.opendev.org/703810 | 11:21 |
| openstackgerrit | Lukas Bezdicka proposed openstack/tripleo-heat-templates stable/train: WIP: DNM: Undercloud FFWD from queens to train https://review.opendev.org/704964 | 11:21 |
| *** ykarel is now known as ykarel|afk | 11:22 | |
| *** zbr has joined #tripleo | 11:23 | |
| *** dsneddon has joined #tripleo | 11:25 | |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/tripleo-upgrade master: Deduplicate ffu release lists https://review.opendev.org/704367 | 11:27 |
| *** csmart has left #tripleo | 11:30 | |
| openstackgerrit | Rabi Mishra proposed openstack/tripleo-common master: Remove workbook related to plan environment https://review.opendev.org/704963 | 11:34 |
| *** zbr has quit IRC | 11:35 | |
| *** zbr has joined #tripleo | 11:35 | |
| *** ykarel|afk is now known as ykarel | 11:36 | |
| odyssey4me | morning folks - it would appear that there is consistent failure for the tripleo-ci-centos-7-scenario004-standalone job on stable/stein and has been for some time... is anyone working out the issue to get it resolved? | 11:37 |
| odyssey4me | chkumar|rover: ^ | 11:37 |
| openstackgerrit | Francesco Pantano proposed openstack/puppet-tripleo master: Add ceph dashboard frontend endpoint and tls-e integration https://review.opendev.org/702839 | 11:38 |
| chkumar|rover | odyssey4me, Ah, it is a tempest related failure | 11:39 |
| chkumar|rover | TypeError: create_network() got an unexpected keyword argument 'dns_domain' | 11:39 |
| chkumar|rover | thanks for checking that | 11:39 |
| odyssey4me | chkumar|rover: looks like it might relate to the version of openstacksdk being used | 11:39 |
| odyssey4me | https://github.com/ansible/ansible/issues/64495 | 11:39 |
| *** abdysn has joined #tripleo | 11:39 | |
| odyssey4me | https://github.com/ansible/ansible/issues/64841 | 11:40 |
| openstackgerrit | Marios Andreou proposed openstack/tripleo-quickstart master: Split fs20 periodic tempest - api* in fs1 scenario* in fs20 https://review.opendev.org/701016 | 11:40 |
| openstackgerrit | Rabi Mishra proposed openstack/tripleo-common master: Remove workbook related to plan environment https://review.opendev.org/704963 | 11:40 |
| odyssey4me | chkumar|rover: looks like this is a recorded bug malready, but no solution yet: https://bugs.launchpad.net/tripleo/+bug/1860810 | 11:40 |
| openstack | Launchpad bug 1860810 in tripleo "os_ansible_tempest fails w/ create_network() got an unexpected keyword argument 'dns_domain'" [High,Triaged] | 11:40 |
| marios | sshnaidm: panda: weshay: wdyt re https://review.rdoproject.org/r/#/c/24724/ 5hrs? reasoning in commit message and https://tree.taiga.io/project/tripleo-ci-board/task/1383 | 11:41 |
| openstackgerrit | Francesco Pantano proposed openstack/tripleo-ansible master: Add grafana vip on the storage network https://review.opendev.org/704308 | 11:42 |
| *** grami[m] has joined #tripleo | 11:42 | |
| *** soniya29 has joined #tripleo | 11:43 | |
| chkumar|rover | odyssey4me, python2-openstacksdk-0.27.0-0.20190405041020.4174082.el7.noarch | 11:43 |
| chkumar|rover | is used | 11:43 |
| chkumar|rover | ykarel, can you update the openstacksdk version for stein in rdo deps/ | 11:44 |
| chkumar|rover | ? | 11:44 |
| openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-quickstart master: add support for rhel8/centos8 virthosts https://review.opendev.org/702100 | 11:44 |
| sshnaidm | dtantsur, lil fix^ | 11:44 |
| ykarel | chkumar|rover, openstacksdk comes from u-c | 11:44 |
| chkumar|rover | ykarel, https://bugs.launchpad.net/tripleo/+bug/1860810 | 11:45 |
| openstack | Launchpad bug 1860810 in tripleo "os_ansible_tempest fails w/ create_network() got an unexpected keyword argument 'dns_domain'" [High,Triaged] | 11:45 |
| ykarel | chkumar|rover, https://github.com/openstack/requirements/blob/stable/stein/upper-constraints.txt#L443 | 11:45 |
| ykarel | so need to bump upstream | 11:45 |
| odyssey4me | chkumar|rover ykarel what version of ansible are we using for stein? | 11:45 |
| cgoncalves | arxcruz, hey. could you please abandon https://review.opendev.org/#/c/687559/ ? | 11:46 |
| ykarel | in rdo we have 2.8.6 | 11:46 |
| *** ratailor_ has quit IRC | 11:46 | |
| ykarel | since stein | 11:46 |
| arxcruz | cgoncalves: sure, done | 11:46 |
| cgoncalves | thank you | 11:46 |
| arxcruz | yw | 11:46 |
| *** ramishra has quit IRC | 11:47 | |
| *** holser has quit IRC | 11:48 | |
| dtantsur | sshnaidm: no luck, same error :( | 11:48 |
| *** pcaruana has joined #tripleo | 11:48 | |
| dtantsur | sshnaidm: do I need to tell it explicitly that I have RHEL 8 on that side? | 11:50 |
| sshnaidm | dtantsur, do you run the script itself on centos8 or remotely? | 11:50 |
| sshnaidm | dtantsur, try it | 11:50 |
| openstackgerrit | Carlos Goncalves proposed openstack/tripleo-heat-templates master: Ensure /var/run/octavia is present upon reboot https://review.opendev.org/704773 | 11:51 |
| *** hberaud|lunch is now known as hberaud | 11:53 | |
| *** paramite has joined #tripleo | 11:54 | |
| dtantsur | sshnaidm: remotely from my Fedora | 11:57 |
| dtantsur | I can try running from the same machine if it's supported nowadays | 11:58 |
| sshnaidm | dtantsur, yeah, I think we tried this option only | 11:58 |
| dtantsur | okay, lemme try | 11:58 |
| sshnaidm | dtantsur, it's kinda experimental | 11:58 |
| dtantsur | that kids with their shiny new OS versions, amiright? | 11:59 |
| *** ramishra has joined #tripleo | 12:02 | |
| openstackgerrit | Federico Ressi proposed openstack/tripleo-quickstart-extras master: Allow to disable test package building https://review.opendev.org/704979 | 12:03 |
| *** rfolco has joined #tripleo | 12:08 | |
| EmilienM | dciabrin_: here | 12:14 |
| grami[m] | anyone seen this error when deploying http://paste.openstack.org/show/788971/ | 12:16 |
| odyssey4me | chkumar|rover ykarel with rewgards to the stable/stein issue... what're our options? | 12:19 |
| *** pcaruana has quit IRC | 12:21 | |
| *** ykarel is now known as ykarel|afk | 12:25 | |
| *** morazi has joined #tripleo | 12:26 | |
| *** raildo has joined #tripleo | 12:27 | |
| *** jpich has quit IRC | 12:27 | |
| *** jpich has joined #tripleo | 12:28 | |
| chkumar|rover | odyssey4me, we need to update this version first https://github.com/openstack/requirements/blob/stable/stein/upper-constraints.txt#L443 | 12:29 |
| chkumar|rover | and then we can update it in rdo | 12:29 |
| Tengu | chkumar|rover: heya! apparently there are some issues with tempest in the CI - is it already known? | 12:29 |
| odyssey4me | chkumar|rover: ok, want me to push a patch up? | 12:29 |
| chkumar|rover | odyssey4me, yes sure go ahead | 12:29 |
| chkumar|rover | Tengu, Where? | 12:30 |
| Tengu | chkumar|rover: at least here: https://53cfbe20d54fcd346846-7e165b3b1cbfb7e5b567389713168c5c.ssl.cf1.rackcdn.com/703953/4/check/tripleo-ci-centos-7-containers-multinode/94a29e1/job-output.txt | 12:30 |
| Tengu | search for "self.curve, Q_S_bytes" | 12:30 |
| chkumar|rover | Tengu, currently seeing this https://bugs.launchpad.net/tripleo/+bug/1860810 | 12:30 |
| openstack | Launchpad bug 1860810 in tripleo "os_ansible_tempest fails w/ create_network() got an unexpected keyword argument 'dns_domain'" [High,Triaged] | 12:30 |
| Tengu | not the first time I see this failure in CI | 12:30 |
| chkumar|rover | Tengu, it is new looking into the logs | 12:32 |
| Tengu | chkumar|rover: I was trying to find if it was new or not. | 12:32 |
| Tengu | "yay". | 12:32 |
| Tengu | not really easy to find actual errors in the tempest.log | 12:33 |
| Tengu | maybe I'm not looking at the right place? | 12:33 |
| chkumar|rover | Tengu, Look into controller logs | 12:33 |
| chkumar|rover | Tengu, https://53cfbe20d54fcd346846-7e165b3b1cbfb7e5b567389713168c5c.ssl.cf1.rackcdn.com/703953/4/check/tripleo-ci-centos-7-containers-multinode/94a29e1/logs/undercloud/var/log/tempest/tempest_run.log | 12:33 |
| chkumar|rover | Tengu, Details: {u'message': u'Unable to complete operation on subnet 54af6b42-b336-4f06-83d9-214cd39da9c2: One or more ports have an IP allocation from this subnet.', u'type': u'SubnetInUse', u'detail': u''} | 12:33 |
| Tengu | oh. meh. I was on the undercloud/home/zuul/tempest/tempest.log | 12:34 |
| chkumar|rover | you have unique id 54af6b42-b336-4f06-83d9-214cd39da9c2 | 12:34 |
| chkumar|rover | go to each nodes and looks in var/logs/extra/errors.txt 54af6b42-b336-4f06-83d9-214cd39da9c2 | 12:34 |
| Tengu | hmmm so it might be due to some failed cleanup | 12:34 |
| chkumar|rover | it will take you to the right place | 12:34 |
| openstackgerrit | Francesco Pantano proposed openstack/tripleo-heat-templates master: Add the certificate specs in ceph_mgr service https://review.opendev.org/702846 | 12:35 |
| fultonj | gfidente marios abishop fmount thanks for your reviews. i've added your suggestions. ci is green if you care to review again. https://review.opendev.org/#/q/topic:bp/multiple-external-ceph | 12:35 |
| *** xek_ has quit IRC | 12:36 | |
| Tengu | chkumar|rover: hm. subnode-1 has an empty error.txt.txt :/ | 12:36 |
| marios | ack fultonj will add to queue for next reviews | 12:39 |
| chkumar|rover | Tengu, yes, that is empty, looking at neutron logs, give me some time will poke back | 12:39 |
| *** soniya29 has quit IRC | 12:40 | |
| *** chem has quit IRC | 12:42 | |
| chkumar|rover | weshay, mwhahaha https://review.opendev.org/#/c/704922/ please act it | 12:43 |
| openstackgerrit | Carlos Goncalves proposed openstack/tripleo-heat-templates master: Ensure /var/run/octavia is present upon reboot https://review.opendev.org/704773 | 12:43 |
| weshay | chkumar|rover++ | 12:43 |
| chkumar|rover | *ack | 12:43 |
| fmount | fultonj: ack, I'll take a look soon! | 12:44 |
| *** ansmith has quit IRC | 12:45 | |
| *** chem has joined #tripleo | 12:46 | |
| Tengu | chkumar|rover: 2020-01-30 10:55:50.403 34 DEBUG neutron.db.db_base_plugin_v2 [req-4f6cd682-f9ab-4176-bcf2-afe8a702da2a d9f817fe59204ecebff21c01966e5a1a 9a9b9774201f4ac7ae1f9b35cf5e1872 - default default] Subnet 54af6b42-b336-4f06-83d9-214cd39da9c2 still has internal router ports, cannot delete _subnet_check_ip_allocations_internal_router_ports | 12:46 |
| Tengu | /usr/lib/python2.7/site-packages/neutron/db/db_base_plugin_v2.py:1009 | 12:46 |
| dtantsur | sshnaidm: is there a way to pass --connection=local to ansible or should I really configure a local SSH connection? | 12:51 |
| *** bfournie has quit IRC | 12:52 | |
| sshnaidm | dtantsur, with quickstart.sh I don't think it's supported right now.. it also requires 127.0.0.2 iirc | 12:53 |
| odyssey4me | chkumar|rover ykarel|afk With thanks to sshnaidm we've tracked the root cause for https://bugs.launchpad.net/tripleo/+bug/1860810 down to https://github.com/ansible/ansible/commit/6c74e29618a6872bc0da66e4992cfcd9cebf6acc which should have updated the minimum openstacksdk version too... I'll push a patch to ansible to fix that | 12:55 |
| openstack | Launchpad bug 1860810 in tripleo "os_ansible_tempest fails w/ create_network() got an unexpected keyword argument 'dns_domain'" [High,Triaged] | 12:55 |
| odyssey4me | chkumar|rover: meanwhile the issue to figure out is why stable/stein's tests are running ansible 2.9 | 12:56 |
| *** rh-jelabarre has joined #tripleo | 12:56 | |
| sshnaidm | odyssey4me, I bumped up ansible version recently | 12:56 |
| sshnaidm | odyssey4me, it's all because of that :) | 12:56 |
| sshnaidm | odyssey4me, I mean in tripleo-ci/quickstart | 12:57 |
| odyssey4me | sshnaidm: ok, we need to revert stable/stein's tests back to ansible 2.8 to get them working again if that's an option | 12:57 |
| sshnaidm | odyssey4me, which job is it? | 12:57 |
| dtantsur | sshnaidm: Data could not be sent to remote host "stack@127.0.0.2". Make sure this host can be reached over ssh: root@127.0.0.2. I guess using root is required? | 12:58 |
| odyssey4me | sshnaidm: tripleo-ci-centos-7-scenario004-standalone | 12:58 |
| *** rlandy has joined #tripleo | 12:59 | |
| sshnaidm | dtantsur, better to setup both auto logins | 12:59 |
| sshnaidm | dtantsur, stack and root | 12:59 |
| dtantsur | :( | 12:59 |
| sshnaidm | odyssey4me, can you paste link to logs please? | 13:00 |
| odyssey4me | sshnaidm: https://zuul.opendev.org/t/openstack/build/ab9748d5160f49ba9b80232692a849aa | 13:01 |
| *** marios is now known as marios|call | 13:01 | |
| odyssey4me | sshnaidm: or the last 3 fails in https://review.opendev.org/#/c/703762/1 | 13:01 |
| sshnaidm | chkumar|rover, odyssey4me is os_tempest branched? | 13:02 |
| chkumar|rover | sshnaidm, we run os_tempest from master | 13:02 |
| chkumar|rover | sshnaidm, on osa side, it is branched it is branched | 13:03 |
| sshnaidm | chkumar|rover, so we run os_tempest from master on stein jobs? | 13:03 |
| chkumar|rover | sshnaidm, we run os_tempest from master not tempest | 13:04 |
| odyssey4me | chkumar|rover: I don't think os_tempest determines the ansible version that executes it though? | 13:04 |
| chkumar|rover | tempest is installed from packages, which comes from rdoinfo | 13:04 |
| openstackgerrit | Sorin Sbarnea proposed openstack/ansible-role-collect-logs master: WIP: Refactor tempest report flattening https://review.opendev.org/704856 | 13:04 |
| sshnaidm | I wonder if we can just bump openstacksdk there | 13:04 |
| odyssey4me | sshnaidm: is tripleo-quickstart not branched? | 13:05 |
| sshnaidm | odyssey4me, nope, it's not branched | 13:06 |
| chkumar|rover | gfidente, Hello regarding ceph centos8 repos | 13:06 |
| chkumar|rover | when it will be available? | 13:06 |
| odyssey4me | sshnaidm: well, that would certainly make looking after older branches fun | 13:06 |
| sshnaidm | odyssey4me, yeah, we'll need to come with some upper limits for ansible for releases | 13:07 |
| sshnaidm | odyssey4me, it's wip | 13:07 |
| openstackgerrit | Francesco Pantano proposed openstack/tripleo-heat-templates master: Add the certificate specs in ceph_mgr service https://review.opendev.org/702846 | 13:07 |
| odyssey4me | chkumar|rover: where are the overrides given to os_tempest when it runs? I need to understand which host executes the os_ modules... there was a way in OSA to oveeride upper constraints and we can use that, but it depends on what's being used to action the module | 13:08 |
| gfidente | chkumar|rover I'll add you to an email thread with more infos | 13:09 |
| *** florianf has quit IRC | 13:09 | |
| chkumar|rover | gfidente, please keep weshay rfolco apevec and amoralej|off in cc thanks :-) | 13:10 |
| gfidente | yeah I had wes and amorale | 13:10 |
| *** ykarel|afk is now known as ykarel | 13:10 | |
| sshnaidm | dtantsur, did you try our new fancy zuul reproducer? | 13:11 |
| ykarel | odyssey4me, ack /me looks to lp to get more context | 13:11 |
| chkumar|rover | odyssey4me, https://opendev.org/openstack/tripleo-ci/src/branch/master/zuul.d/base.yaml#L38 | 13:11 |
| *** florianf has joined #tripleo | 13:13 | |
| dtantsur | sshnaidm: nope, why? | 13:15 |
| sshnaidm | dtantsur, it might be better than running quickstart.sh | 13:15 |
| sshnaidm | dtantsur, for some cases | 13:15 |
| dtantsur | sshnaidm: sure, if the task at hand has any relationship to the CI ;) | 13:15 |
| odyssey4me | chkumar|rover: do we override either of these defaults anywhere? https://github.com/openstack/openstack-ansible-os_tempest/blob/master/defaults/main.yml#L34-L38 | 13:15 |
| sshnaidm | dtantsur, well, ya | 13:16 |
| dtantsur | I mean, thank you, but that's very far from what I'm trying to do (i.e. have a clean undercloud) | 13:16 |
| chkumar|rover | odyssey4me, yes, https://github.com/openstack/tripleo-ci/blob/master/zuul.d/standalone-jobs.yaml#L412 and https://opendev.org/openstack/tripleo-quickstart-extras/src/branch/master/playbooks/tempest.yml | 13:17 |
| chkumar|rover | odyssey4me, there are few in featureset specific files also | 13:17 |
| chkumar|rover | os_tempest is used for standalone job in stein only | 13:17 |
| ykarel | ohhk got it ansible bump to 2.9 breaked it, quickstart had missing os-tempest based job for stein | 13:17 |
| ykarel | why not going to non os-tempest one in stein | 13:18 |
| chkumar|rover | from train onwards almost all the jobs are on os_tempest using those overrides | 13:18 |
| odyssey4me | chkumar|rover: yea, but from train onwards the openstacksdk version is new enough to cope | 13:18 |
| *** dmacpher has quit IRC | 13:19 | |
| chkumar|rover | ykarel, quickstart is branchless | 13:19 |
| ykarel | chkumar|rover, so? | 13:19 |
| *** florianf has quit IRC | 13:19 | |
| odyssey4me | so yeah, I think the options here are to do a downstream openstacksdk bump - or to revert to using the older standalone job mechanism in stein | 13:19 |
| ykarel | for openstacksdk i would say it should come via upstream as stein is released long back | 13:20 |
| odyssey4me | there may be one more option, which is to not use packages and to use pip instead... looking through the overrides | 13:21 |
| chkumar|rover | odyssey4me, we just need to flip the switch for stein and we will be using validate-tempest for stein | 13:21 |
| odyssey4me | ykarel: yes, but a change to upper-constraints is not appropriate - this is not an openstack issue, this is a tripleo/ansible issue | 13:21 |
| openstackgerrit | Sorin Sbarnea proposed openstack/ansible-role-collect-logs master: POC: Improve resiliency of collection https://review.opendev.org/703586 | 13:21 |
| odyssey4me | chkumar|rover: ok, that sounds sensible to me - I will push a patch upstream to ansible to get the minimum openstacksdk version bumped | 13:22 |
| odyssey4me | (for ansible 2.9) | 13:22 |
| *** xek has joined #tripleo | 13:23 | |
| ykarel | odyssey4me, yes in RDO we pick from u-c, because updating in RDO will impact all projects wherever it's used | 13:23 |
| ykarel | so if we go without u-c we might see other issues | 13:23 |
| openstackgerrit | Francesco Pantano proposed openstack/tripleo-ansible master: Add grafana vip on the storage network https://review.opendev.org/704308 | 13:24 |
| *** mcornea has joined #tripleo | 13:25 | |
| *** artom has quit IRC | 13:26 | |
| *** ysandeep has joined #tripleo | 13:28 | |
| *** rpittau|bbl is now known as rpittau | 13:29 | |
| *** apetrich has joined #tripleo | 13:29 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Remove /run bind-mount from mistral containers https://review.opendev.org/704808 | 13:29 |
| *** holser has joined #tripleo | 13:33 | |
| chkumar|rover | odyssey4me, one more question we are hitting this issue only in scenario 04 or in all standalone jobs? | 13:34 |
| chkumar|rover | at all places | 13:36 |
| *** rh-jelabarre has quit IRC | 13:36 | |
| odyssey4me | chkumar|rover: I only see it in scenario4 for that patch, but it may be happening in others but not triggered in my patch? | 13:37 |
| chkumar|rover | http://zuul.openstack.org/builds?job_name=tripleo-ci-centos-7-scenario001-standalone&job_name=tripleo-ci-centos-7-scenario002-standalone&job_name=tripleo-ci-centos-7-scenario003-standalone&job_name=tripleo-ci-centos-7-scenario004-standalone&branch=stable%2Fstein&branch=tripleo-ci-centos-7-standalone | 13:37 |
| odyssey4me | chkumar|rover: pretty much every review for stable/stein in THT is failing, so it's not all that hard to figure out | 13:38 |
| *** ansmith has joined #tripleo | 13:38 | |
| *** bfournie has joined #tripleo | 13:39 | |
| dtantsur | sshnaidm: when through all the hops with root@127.0.0.2: it still uses Python 2 >_< | 13:41 |
| openstackgerrit | Martin Mágr proposed openstack/tripleo-heat-templates master: [WIP] Enable configuration of notifier publishers https://review.opendev.org/705006 | 13:42 |
| openstackgerrit | Chandan Kumar (raukadah) proposed openstack/tripleo-ci master: Use os_tempest flipswitch from fs052 https://review.opendev.org/705007 | 13:42 |
| sshnaidm | dtantsur, sigh.. so it's not that ready like I thought | 13:43 |
| chkumar|rover | odyssey4me, ^^ can you put a depends-on your patch | 13:43 |
| *** dmacpher has joined #tripleo | 13:45 | |
| openstackgerrit | Jose Luis Franco proposed openstack/tripleo-upgrade master: Initital ffwd2 patch to automate OS upgrade. https://review.opendev.org/704905 | 13:45 |
| *** chem has quit IRC | 13:47 | |
| *** chem has joined #tripleo | 13:48 | |
| *** florianf has joined #tripleo | 13:49 | |
| openstackgerrit | Chandan Kumar (raukadah) proposed openstack/tripleo-quickstart master: Enable heat tempest plugin for undercloud https://review.opendev.org/705013 | 13:54 |
| *** marios|call is now known as marios | 13:56 | |
| *** pcaruana has joined #tripleo | 14:03 | |
| *** sshnaidm is now known as sshnaidm|afk | 14:07 | |
| *** jdandrea has joined #tripleo | 14:11 | |
| *** ekultails has joined #tripleo | 14:16 | |
| *** dtantsur is now known as dtantsur|brb | 14:18 | |
| openstackgerrit | Arie Bregman proposed openstack/ansible-role-collect-logs master: Fix undefined variable in infrared tasks https://review.opendev.org/705020 | 14:20 |
| openstackgerrit | Arx Cruz proposed openstack/tripleo-quickstart master: DNM - Testing fs020 tempest https://review.opendev.org/704948 | 14:26 |
| *** lmiccini has quit IRC | 14:31 | |
| cloudnull | mornings | 14:32 |
| *** sshnaidm|afk is now known as sshnaidm | 14:32 | |
| *** psachin has quit IRC | 14:32 | |
| *** pcaruana has quit IRC | 14:34 | |
| Tengu | cloudnull: heya! I could give a try to your patch for the ansible_async - it works well! | 14:34 |
| cloudnull | nice! | 14:34 |
| Tengu | cloudnull: so I guess we can request reviews and all | 14:36 |
| cloudnull | ++ | 14:37 |
| cloudnull | https://review.opendev.org/#/c/704836 | 14:37 |
| cloudnull | its in recheck hell atm | 14:38 |
| cloudnull | but progress is being made | 14:38 |
| Tengu | cloudnull: yep! | 14:40 |
| Tengu | there's a "small" issue in CI apparently. | 14:40 |
| cloudnull | it seems that way | 14:41 |
| cloudnull | tripleo-ci and OVB seem to be very upset as well | 14:41 |
| Tengu | yeah... tempest as well. | 14:41 |
| *** artom has joined #tripleo | 14:43 | |
| *** lmiccini has joined #tripleo | 14:45 | |
| *** ysandeep has quit IRC | 14:46 | |
| matbu | mwhahaha: hey sorry for the mistake reviews regarding tripleo-ansible i didn't get your thoughts at first :/ is this review is right now : https://review.rdoproject.org/r/24754 | 14:46 |
| mwhahaha | yea | 14:47 |
| mwhahaha | so when it gets released we'll merge that | 14:47 |
| slagle | odyssey4me: hey, in reference to your comments about the tags with include_tasks, I can't seem to get that to work the way you describe. see http://paste.openstack.org/show/788978/ | 14:48 |
| *** artom has quit IRC | 14:48 | |
| odyssey4me | slagle: looking | 14:49 |
| *** rh-jelabarre has joined #tripleo | 14:49 | |
| slagle | it looks like putting "always" on the play makes it apply to all tasks run by include_tasks | 14:49 |
| odyssey4me | slagle: move the tag to the include_tasks task | 14:49 |
| slagle | the always? | 14:50 |
| odyssey4me | slagle: yep | 14:50 |
| openstackgerrit | Juan Badia Payno proposed openstack/tripleo-ansible master: [WIP] Add service management support. https://review.opendev.org/681017 | 14:50 |
| bogdando | odyssey4me: tags will not work for include_ | 14:50 |
| bogdando | only import (static) evals it | 14:50 |
| openstackgerrit | Alex Schultz proposed openstack/python-tripleoclient stable/train: Fix all py27 tests https://review.opendev.org/705033 | 14:51 |
| openstackgerrit | Alex Schultz proposed openstack/python-tripleoclient stable/stein: Fix all py27 tests https://review.opendev.org/705035 | 14:51 |
| slagle | odyssey4me: ok, that works. | 14:51 |
| bogdando | I mean if a tag is hidden in the included tasks | 14:51 |
| odyssey4me | bogdando: I know what you mean, but it is possible. see https://odyssey4.me/2019/11/26/ansible-include-tags.html | 14:51 |
| slagle | odyssey4me: must be some difference between setting the tags on the task vs the play | 14:52 |
| odyssey4me | bogdando: yes, it won't be exposed through --list-tags and it may not work with --skip-tags, but it kinda works | 14:52 |
| bogdando | mhm, ok! :) | 14:52 |
| slagle | odyssey4me: i would have thought setting the tag on the play would cause be equivalent to setting it on the include_task, but i guess not | 14:52 |
| odyssey4me | slagle: yeah, I wonder if that's intended behaviour or a bug | 14:53 |
| slagle | certainly undocumented either way :) | 14:53 |
| owalsh | Tengu: hey, still see healthcheck sudo issues with https://review.opendev.org/703818 | 14:55 |
| Tengu | owalsh: define "healthcheck sudo issue" ? It might be linked to https://review.opendev.org/704808 which just merged today | 14:56 |
| owalsh | Tengu: http://logs.rdoproject.org/18/703818/2/openstack-check/tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001/bf851cd/logs/overcloud-novacompute-0/var/log/journal.txt | 14:56 |
| owalsh | Jan 27 08:55:27 overcloud-novacompute-0 sudo[29939]: nova : command not allowed ; TTY=unknown ; PWD=/ ; USER=nova ; COMMAND=/usr/sbin/ss -ntuap | 14:56 |
| Tengu | ah, fun. neutron has the same. | 14:57 |
| Tengu | owalsh: will investigate this after my call. | 14:57 |
| *** waleedm has quit IRC | 14:58 | |
| *** waleedm__ has quit IRC | 14:58 | |
| *** udesale has joined #tripleo | 14:58 | |
| owalsh | Tengu: ack, EmilienM FYI healthcheck sudo fun and games have returned | 14:58 |
| matbu | mwhahaha: ack thanks :) | 14:59 |
| EmilienM | owalsh: /me silently leaves the room and disappear in dark | 15:00 |
| owalsh | good plan | 15:00 |
| *** abdysn has quit IRC | 15:01 | |
| *** pcaruana has joined #tripleo | 15:02 | |
| * bogdando pings EmilienM in the darkness with sudo | 15:04 | |
| EmilienM | bogdando: in meetings | 15:04 |
| bogdando | no worries, just a healthcheck! | 15:04 |
| *** artom has joined #tripleo | 15:11 | |
| *** ysandeep has joined #tripleo | 15:12 | |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/python-tripleoclient master: Revert "Revert "Overload stdout callback plugin"" https://review.opendev.org/704384 | 15:17 |
| *** holser has quit IRC | 15:18 | |
| *** ysandeep has quit IRC | 15:20 | |
| *** jaosorior has joined #tripleo | 15:21 | |
| *** chkumar|rover is now known as raukadah | 15:24 | |
| openstackgerrit | Gael Chamoulaud proposed openstack/python-tripleoclient master: TripleO Validations Logging CLI Introduction https://review.opendev.org/695397 | 15:24 |
| *** jmasud has quit IRC | 15:24 | |
| openstackgerrit | Gael Chamoulaud proposed openstack/python-tripleoclient master: WIP Groups from groups.yaml file https://review.opendev.org/704521 | 15:25 |
| *** hberaud is now known as hberaud|school-r | 15:26 | |
| *** jaosorior has quit IRC | 15:27 | |
| *** ccamacho has quit IRC | 15:27 | |
| openstackgerrit | Rabi Mishra proposed openstack/tripleo-common master: Remove workbook related to plan environment https://review.opendev.org/704963 | 15:27 |
| *** psachin has joined #tripleo | 15:29 | |
| owalsh | cloudnull, slagle, fultonj, EmilienM: hi, WDYT about https://review.opendev.org/704919 wondering if I can just drop the host var from the inventory, don't see it used anywhere | 15:31 |
| openstackgerrit | Martin Mágr proposed openstack/tripleo-heat-templates master: [WIP] Enable configuration of notifier publishers https://review.opendev.org/705006 | 15:31 |
| cloudnull | owalsh +1 if its not used anywhere , then i say remove it | 15:32 |
| Tengu | owalsh: would be interesting to check the systemd unit files for the healthchecks though | 15:32 |
| Tengu | owalsh: just in order to ensure overcloud does have the right content in there.. | 15:33 |
| slagle | owalsh: yea i'd grep for it in t-h-t and a config-download dir, and if it's not there, kill it off. | 15:33 |
| openstackgerrit | Ryan McCabe proposed openstack/tripleo-heat-templates stable/train: Revert "Remove panko" https://review.opendev.org/704869 | 15:33 |
| openstackgerrit | Ryan McCabe proposed openstack/tripleo-heat-templates stable/train: Revert "Remove panko" https://review.opendev.org/704869 | 15:33 |
| *** marios is now known as marios|call | 15:33 | |
| weshay | stevebaker, fyi.. we're making some updates to https://opendev.org/openstack/tripleo-quickstart/src/branch/master/roles/tripleo-inventory/templates/get-overcloud-nodes.py.j2 to handle metalsmith | 15:33 |
| owalsh | slagle: ack, it's there but it's the global_var that they get | 15:34 |
| owalsh | since include_vars takes precedence over inventory | 15:34 |
| *** jmasud has joined #tripleo | 15:37 | |
| Tengu | owalsh: I'll do a deploy tomorrow on my lab in order to check what's going on. Not 100% sure to fully understand the issue, based on those logs, it's not really clear. Unless "root" sudo is limited, it shouldn't be an issue. | 15:38 |
| Tengu | owalsh: and we actually miss some files in the CI logs, for instance the systemd unit files :/ | 15:38 |
| *** ade_lee has joined #tripleo | 15:39 | |
| *** jmasud has quit IRC | 15:43 | |
| *** marios|call is now known as marios | 15:43 | |
| ykarel | is issue with scenario010 known? | 15:43 |
| ykarel | see many failures, random? or fixed? | 15:43 |
| ykarel | http://zuul.openstack.org/builds?job_name=tripleo-ci-centos-7-scenario010-standalone&branch=master | 15:43 |
| Tengu | ykarel: the one related to tempest at some point? | 15:43 |
| ykarel | Tengu, tripleo_nova_migration_target_healthcheck.service loaded failed failed nova_migration_target healthcheck" | 15:43 |
| *** hberaud|school-r is now known as hberaud | 15:43 | |
| Tengu | ykarel: hmmm | 15:44 |
| ykarel | known? | 15:44 |
| Tengu | not to me at least | 15:44 |
| *** TrevorV has joined #tripleo | 15:44 | |
| openstackgerrit | Adriano Petrich proposed openstack/python-tripleoclient master: Client code to do node import with ansible instead of mistral https://review.opendev.org/704561 | 15:45 |
| ykarel | weshay, any idea ^^ | 15:45 |
| * ykarel checks etherpad | 15:45 | |
| Tengu | Jan 30 10:17:08 standalone.localdomain healthcheck_nova_migration_target[111073]: There is no sshd process listening on port(s) 2022 in the container | 15:45 |
| Tengu | that's the actual error. might be linked to what owalsh pointed me 30 minutes earlier | 15:45 |
| Tengu | thought.... sounds weird. | 15:45 |
| ykarel | don't see anything in etherpad | 15:46 |
| openstackgerrit | wes hayutin proposed openstack/python-tripleoclient master: return py27 to voting https://review.opendev.org/705046 | 15:46 |
| weshay | cloudnull, ^ /me checks other branches | 15:46 |
| Tengu | I'm deploying a master env for some healthcheck-related things, I might be able to check a bit more. | 15:46 |
| Tengu | ykarel: -^ | 15:46 |
| * cloudnull needs to cherry-pick that change back to stable | 15:47 | |
| Tengu | ykarel: at least it seems to be listening on requested port: https://8fab99ee9257e46d0210-c8abcbb4c7ff2481652631255808ba42.ssl.cf1.rackcdn.com/702690/1/gate/tripleo-ci-centos-7-scenario010-standalone/03bb93f/logs/undercloud/var/log/containers/stdouts/nova_migration_target.log (for instance) | 15:47 |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/python-tripleoclient stable/train: Fix all py27 tests https://review.opendev.org/705033 | 15:47 |
| *** Trevor_V has joined #tripleo | 15:47 | |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/python-tripleoclient stable/stein: Fix all py27 tests https://review.opendev.org/705035 | 15:47 |
| mwhahaha | cloudnull: i already did | 15:47 |
| weshay | Tengu, owalsh if you are referring to the work to fix https://bugs.launchpad.net/tripleo/+bug/1861393 | 15:47 |
| openstack | Launchpad bug 1861393 in tripleo "Multiple volume related test failed due iscsiadm getting sessions: iscsiadm: and VolumeDeviceNotFound in nova compute" [Critical,In progress] - Assigned to chandan kumar (chkumar246) | 15:47 |
| mwhahaha | but whatevs :D | 15:47 |
| cloudnull | oh opps | 15:47 |
| cloudnull | i can abandon those | 15:48 |
| mwhahaha | don't | 15:48 |
| mwhahaha | it just pushed over it | 15:48 |
| weshay | and related bugs.. we have a live env up.. because the logs are borked.. which actually may be related to the patches | 15:48 |
| Tengu | weshay: hmmmm I don't think so | 15:48 |
| weshay | ykarel, what's the context? | 15:48 |
| Tengu | weshay: http://zuul.openstack.org/builds?job_name=tripleo-ci-centos-7-scenario010-standalone&branch=master | 15:48 |
| ykarel | yes context ^6 | 15:48 |
| cloudnull | mwhahaha my bad | 15:48 |
| *** ratailor has joined #tripleo | 15:48 | |
| mwhahaha | its fine, it just reset the ci that's all | 15:49 |
| Tengu | weshay: apparently some healthchecks are failing, mostly nova_migration thing - ssh port (2022) isn't seen as open/listening | 15:49 |
| owalsh | weshay: not related to the ssh conf | 15:49 |
| weshay | Tengu, I have no words | 15:49 |
| Tengu | weshay: I have some, but they aren't nice :) | 15:50 |
| *** ratailor_ has joined #tripleo | 15:50 | |
| Tengu | lemme deploy a thing locally - hopefully I'll be able to investigate a bit. | 15:50 |
| weshay | Tengu, let's chat for a minute | 15:50 |
| Tengu | though.... that's weird. | 15:50 |
| Tengu | weshay: you want some meet|bjns? | 15:50 |
| weshay | https://meet.google.com/twn-octg-irk?authuser=1 | 15:50 |
| *** TrevorV has quit IRC | 15:51 | |
| owalsh | Tengu: FYI it took a few attempts to find the magic combination that worked for this https://review.opendev.org/681525 | 15:51 |
| owalsh | maybe podman version is different and it's back to square one | 15:51 |
| *** ratailor has quit IRC | 15:54 | |
| openstackgerrit | Juan Badia Payno proposed openstack/tripleo-ansible master: [WIP] Add service management support. https://review.opendev.org/681017 | 15:56 |
| *** holser has joined #tripleo | 15:56 | |
| openstackgerrit | wes hayutin proposed openstack/tripleo-ci master: turn off validate_services https://review.opendev.org/705051 | 16:04 |
| Tengu | owalsh: maybe.... we'll first unlock CI, then work on it. | 16:04 |
| weshay | mwhahaha, ^ | 16:04 |
| *** iurygregory has quit IRC | 16:05 | |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart master: Use metalsmith for getting OC servers in inventory when available https://review.opendev.org/705052 | 16:06 |
| *** skramaja has quit IRC | 16:06 | |
| *** dtantsur|brb is now known as dtantsur | 16:06 | |
| rlandy | weshay: ^^ | 16:07 |
| openstackgerrit | Marios Andreou proposed openstack/tripleo-quickstart master: Split fs20 periodic tempest - api* in fs1 scenario* in fs20 https://review.opendev.org/701016 | 16:08 |
| openstackgerrit | wes hayutin proposed openstack/tripleo-ci master: turn off validate_services https://review.opendev.org/705051 | 16:08 |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart master: Use metalsmith for getting OC servers in inventory when available https://review.opendev.org/705052 | 16:09 |
| weshay | Tengu, https://etherpad.openstack.org/p/tripleo-meeting-items | 16:09 |
| *** xek has quit IRC | 16:10 | |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart master: Use metalsmith for getting OC servers in inventory when available https://review.opendev.org/705052 | 16:11 |
| *** jmasud has joined #tripleo | 16:11 | |
| *** aakarsh has joined #tripleo | 16:14 | |
| *** aakarsh has quit IRC | 16:18 | |
| *** jmasud has quit IRC | 16:19 | |
| openstackgerrit | Luke Short proposed openstack/paunch master: podman: force rm --storage and unlink lingering overlayfs https://review.opendev.org/698999 | 16:19 |
| openstackgerrit | Oliver Walsh proposed openstack/tripleo-common master: Add tripleo_role_networks to inventory role group vars https://review.opendev.org/704919 | 16:20 |
| *** jmasud has joined #tripleo | 16:20 | |
| *** leifmadsen has joined #tripleo | 16:20 | |
| openstackgerrit | Oliver Walsh proposed openstack/tripleo-ansible master: Simplify ssh_known_hosts role https://review.opendev.org/704880 | 16:21 |
| owalsh | weshay: FYI ^^ had to push a fix for the inventory patch, should be good to merge if CI plays nice | 16:25 |
| weshay | nice /me looks | 16:25 |
| dtantsur | sshnaidm: so, on RHEL 7 quickstart fails with "/bin/sh: /usr/bin/python3: No such file or directory\n" | 16:26 |
| dtantsur | is there a supported RHEL version? :) | 16:26 |
| weshay | owalsh, dam.. nice patch :) | 16:26 |
| * weshay watches | 16:26 | |
| sshnaidm | dtantsur, I think it fails to load vars for rhel and mixes with centos | 16:27 |
| sshnaidm | dtantsur, lemme look | 16:27 |
| openstackgerrit | Sorin Sbarnea proposed openstack/tripleo-ci master: Bring ansible verbosity to 2 on collect-logs https://review.opendev.org/705059 | 16:27 |
| *** jmasud has quit IRC | 16:29 | |
| sshnaidm | dtantsur, can you search in log task "Include OS specific variables" and tell me what's loaded? | 16:31 |
| Tengu | owalsh: basically the ss call didn't change - one time as root, one time as user "foo" (nova, neutron, whatever)... I'm a bit surprised this is linked to the "--user root" change, to be honest | 16:31 |
| dtantsur | sshnaidm: it fails on the very first task it runs, i.e. gathering facts | 16:31 |
| dtantsur | so I assume ansible is trying to use python 3 | 16:31 |
| dtantsur | which is super awkward | 16:31 |
| Tengu | owalsh: and I know it took some time, and this is why I didn't change the command itself :/. I was going to work on the sudo part later, since it creates SELinux denials due to the dbus socket being exposed in some containers because of shared /run directory with the host :( | 16:33 |
| dtantsur | python version = 2.7.5 (default, Jun 11 2019, 14:33:56) [GCC 4.8.5 20150623 (Red Hat 4.8.5-39)] | 16:33 |
| *** jmasud has joined #tripleo | 16:33 | |
| dtantsur | well, no. why on earth would it execute python 3 then? | 16:33 |
| owalsh | Tengu: previously it would be been one time as $USER and one time sudo. IIUC now $USER == root | 16:33 |
| ykarel | Tengu, looks like it's failing since patch https://review.opendev.org/#/c/704675/3 | 16:33 |
| sshnaidm | dtantsur, 2.7 on which OS? and what version of ansible | 16:33 |
| Tengu | ykarel: hm, I don't see the link to the healthchecks failing.. = | 16:34 |
| ykarel | Tengu, in that patch? | 16:34 |
| dtantsur | sshnaidm: RHEL 7.7, http://paste.openstack.org/show/788983/ | 16:34 |
| Tengu | owalsh: the "sudo" is there to allow impersonating $USER | 16:34 |
| beagles | anybody seeing "The error was: AttributeError: 'str' object has no attribute 'get'" in "Async assignment of Keystone user to roles" during deployment? | 16:34 |
| Tengu | so unless a process isn't running as $USER..... | 16:35 |
| owalsh | Tengu: ah, yes | 16:35 |
| ykarel | Tengu, it failed twice in that patch | 16:35 |
| dtantsur | sshnaidm: and fails nearly immediately with http://paste.openstack.org/show/788984/ | 16:35 |
| owalsh | Tengu: hang on... IIRC podman exec always runs as root unless you specify a user, has this changed? | 16:36 |
| openstackgerrit | Florian Fuchs proposed openstack/tripleo-validations master: Add FFU validation to check for existence of a backup file https://review.opendev.org/701179 | 16:36 |
| Tengu | owalsh: hm, "podman exec" executes as the USER set in the container at build time (Dockerfile) | 16:36 |
| Tengu | unless you pass --user | 16:36 |
| owalsh | Tengu: that's new | 16:36 |
| openstackgerrit | Florian Fuchs proposed openstack/tripleo-validations master: Add FFU validation to check for existence of a backup file https://review.opendev.org/701179 | 16:36 |
| Tengu | owalsh: ah, yes. but that's an "old" new | 16:37 |
| Tengu | owalsh: probably prio 1.0 | 16:37 |
| owalsh | not that old AFAIK | 16:37 |
| owalsh | 1.x definitely | 16:37 |
| Tengu | hmm. don't remember :/ | 16:37 |
| Tengu | still. | 16:37 |
| sshnaidm | dtantsur, hmm.. can you set "interpreter_python: auto" in ansible.cfg in quickstart | 16:38 |
| beagles | EmilienM, thoughts on "The error was: AttributeError: 'str' object has no attribute 'get'" during async role assignment for keystone? | 16:38 |
| sshnaidm | dtantsur, "interpreter_python = auto" | 16:38 |
| EmilienM | beagles: ouch | 16:38 |
| owalsh | Tengu: so --root should just restore the previous behaviour... something else changed in sudo conf? | 16:38 |
| EmilienM | beagles: do you have logs or can I ssh? | 16:38 |
| mwhahaha | beagles: something is a string instead of a dict | 16:38 |
| Tengu | owalsh: that's what I want to figure out. I'm deploying something right now in order to investigate. | 16:38 |
| dtantsur | sshnaidm: I can, but will re-running quickstart overwrite this file? | 16:39 |
| Tengu | owalsh: and I suspect the overcloud images aren't running with the right paunch lib version, meaning it will probably not deploy with --user root | 16:39 |
| sshnaidm | dtantsur, I mean in source folder | 16:39 |
| dtantsur | ack | 16:39 |
| mwhahaha | beagles: might just be ''. ive seen that if the service config is bad and someone does something like upgrade_tasks: '' instead of upgrade_tasks: [] | 16:39 |
| openstackgerrit | Sorin Sbarnea proposed openstack/ansible-role-collect-logs master: Improve molecule testing https://review.opendev.org/705061 | 16:39 |
| beagles | EmilienM, ooo.. this is just a fresh standaline deploy so that's .. intereresting. | 16:39 |
| beagles | weird | 16:40 |
| *** jmasud has quit IRC | 16:40 | |
| Tengu | owalsh: step-5 for the undercloud, after that I'll fetch the images and deploy the overcloud. Though the overcloud images aren't the one used in the CI I think :/. I'll probably need to tweak them a bit. | 16:40 |
| * beagles tries without octavia in the env list | 16:40 | |
| Tengu | not sure if I can fetch the CI overcloud images.... weshay maybe? | 16:40 |
| dtantsur | sshnaidm: even putting python2 doesn't help. maybe it's called differently? | 16:41 |
| EmilienM | beagles: it could be get_domain_id() | 16:41 |
| weshay | Tengu, you can download the centos-7 ones.. need a passwd for rhel8 | 16:41 |
| weshay | what do you need? | 16:41 |
| weshay | http://images.rdoproject.org/master/rdo_trunk/current-tripleo/ | 16:42 |
| Tengu | weshay: the overcloud images used in CI, centos-7 | 16:42 |
| EmilienM | https://github.com/openstack/tripleo-heat-templates/blob/a5f1d5c6e280f12d048ba7ebd2c38189ec9c5070/deployment/octavia/octavia-api-container-puppet.yaml#L139-L149 | 16:42 |
| sshnaidm | dtantsur, remove your .quickstart | 16:42 |
| EmilienM | although I don't see anything fancy in there beagles | 16:42 |
| sshnaidm | dtantsur, just let's start from scratch | 16:42 |
| Tengu | weshay: ah, that's the link I have. perfect, thanks! | 16:42 |
| dtantsur | jawohl! | 16:42 |
| *** lmiccini has quit IRC | 16:42 | |
| ykarel | Tengu, ohhk it's ur patch i think post which it's failing | 16:43 |
| ykarel | Strict health check | 16:43 |
| Tengu | ykarel: not 100% sure either | 16:43 |
| EmilienM | beagles: any chance to run ansible-playbook with vvvv | 16:43 |
| *** udesale has quit IRC | 16:43 | |
| dtantsur | sshnaidm: it overwrote /root/.quickstart/tripleo-quickstart/ansible.cfg ... | 16:43 |
| ykarel | Tengu, https://review.opendev.org/#/c/704651/ | 16:43 |
| beagles | EmilienM, I'll see what I can do! | 16:43 |
| ykarel | from logs/time it's near 100% :) | 16:43 |
| beagles | (there isn't much info there without it afaict) | 16:44 |
| Tengu | ykarel: interesting... | 16:44 |
| ykarel | i see it's cherrypicked | 16:44 |
| ykarel | so if it's sure block it | 16:44 |
| * owalsh biab | 16:44 | |
| EmilienM | beagles: it could be in get_role_assignments() as wlel | 16:44 |
| ykarel | ohhk cherry pick merged too | 16:44 |
| * dtantsur inserts interpreter_python while it's running | 16:44 | |
| Tengu | ykarel: that said, there's https://review.opendev.org/#/c/705051/ that should stop checking the service states, this will give me some more time to check that specific issue | 16:44 |
| EmilienM | beagles: if you give me your deployment comamnd I can reproduce and debug for you | 16:44 |
| ykarel | Tengu, ack | 16:45 |
| ykarel | no bug there | 16:45 |
| dtantsur | sshnaidm: no luck | 16:45 |
| Tengu | ykarel: I'll try to make some mover verbose output for that pipe. maybe it's "just" a timing issue. | 16:45 |
| sshnaidm | dtantsur, do you run with this patch applied or clean from repo? | 16:46 |
| ykarel | Tengu, ack | 16:46 |
| ykarel | seeing it's randomness it's possible | 16:46 |
| sshnaidm | dtantsur, maybe patch broke something for rhel7 | 16:46 |
| Tengu | ykarel: race conditions - the best ones ;) | 16:46 |
| ykarel | :) | 16:46 |
| dtantsur | sshnaidm: I no longer have it applied | 16:47 |
| Tengu | still - I think there might be two issues - that possible race, and the one with the sudo denial pointed by owalsh | 16:47 |
| dtantsur | I'm on 47cfbe6b69ba20d28c4bd407dc46c674400cdaa4 | 16:47 |
| Tengu | will need some time tomorrow to debug it properly. | 16:47 |
| beagles | EmilienM, basically standalone off of the docs, with an octavia specific env file http://paste.openstack.org/show/788985/ | 16:48 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-ansible master: WIP - Add module "container_puppet_config" https://review.opendev.org/702315 | 16:49 |
| openstackgerrit | Oliver Walsh proposed openstack/tripleo-ansible master: Simplify ssh_known_hosts role https://review.opendev.org/704880 | 16:49 |
| EmilienM | beagles: ok i'm afk this afternoon but i'll try this later, let me know if you figured it out | 16:49 |
| beagles | EmilienM, cool thanks! | 16:49 |
| Tengu | ykarel, owalsh, weshay I'll check tomorrow for those healthchecks - getting late here, and I'm dead -.-'. | 16:50 |
| cloudnull | anyone around mind giving https://review.opendev.org/#/c/704714/ a nudge ? | 16:50 |
| *** holser__ has joined #tripleo | 16:50 | |
| EmilienM | beagles: are you familiar with how to run ansible manually? | 16:50 |
| Tengu | owalsh: care top make some LP and give it to me? | 16:50 |
| openstackgerrit | yatin proposed openstack/tripleo-heat-templates master: Add missing firewall rule for iscsid in HA deployments https://review.opendev.org/704805 | 16:50 |
| ykarel | Tengu, ack /me depends-on validation off patch ^^ | 16:50 |
| *** ykarel is now known as ykarel|away | 16:51 | |
| Tengu | ykarel|away: +1 | 16:51 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-ansible master: WIP - Add module "container_puppet_config" https://review.opendev.org/702315 | 16:51 |
| owalsh | Tengu: already have a BZ IIRC | 16:51 |
| openstackgerrit | Luke Short proposed openstack/tripleo-common master: WIP: Remove unused create_overcloudrc workflow. https://review.opendev.org/694139 | 16:52 |
| owalsh | Tengu: https://bugs.launchpad.net/tripleo/+bug/1860569 | 16:52 |
| openstack | Launchpad bug 1860569 in tripleo "Sorry, user {cinder,nova,heat} is not allowed to execute '/usr/sbin/ss -ntuap' as ... on controller-0." [Medium,Fix released] - Assigned to Cédric Jeanneret (cjeanner) | 16:52 |
| Tengu | owalsh: care to add me to it? I'll work on it tomorrow | 16:52 |
| Tengu | ah, that very one! | 16:52 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: WIP - Deploy Puppet containers with tripleo-ansible https://review.opendev.org/702323 | 16:52 |
| Tengu | good. Yeah, I'll rework on it then :). | 16:52 |
| *** holser has quit IRC | 16:52 | |
| beagles | EmilienM, used to know :) once the heat config stuff has run, it's just running the playbooks from the standalone-ansible-<hash> dir with t he proper inventory, isn't it? alhtough I see there isn't an shell script like there once was | 16:53 |
| sshnaidm | and ansible>2.8 everywhere? then I have no idea why autodetection doesn't work.. | 16:53 |
| sshnaidm | dtantsur, ^ | 16:53 |
| EmilienM | beagles: yes that's it | 16:53 |
| Tengu | OK Folks - see you tomorrow! | 16:53 |
| EmilienM | beagles: I think the shell script is only present for overclouds. | 16:53 |
| beagles | EmilienM, yeah should be no big deal | 16:54 |
| dtantsur | sshnaidm: yep, 2.9.5 seems | 16:56 |
| * owalsh bbl to check on CI | 16:56 | |
| sshnaidm | dtantsur, what do you run exactly? | 16:57 |
| ykarel|away | looks like more issues are there, is http://zuul.openstack.org/builds?branch=master&job_name=tripleo-ci-centos-7-scenario000-multinode-oooq-container-updates job known | 16:57 |
| ykarel|away | it's voting one | 16:57 |
| beagles | EmilienM, got it - it's running now | 16:57 |
| *** marios is now known as marios|out | 16:59 | |
| ykarel|away | ack revert is there for updates fix https://review.opendev.org/#/c/704885 | 16:59 |
| ykarel|away | will depend on it | 16:59 |
| *** lucasagomes has quit IRC | 16:59 | |
| openstackgerrit | yatin proposed openstack/tripleo-heat-templates master: Add missing firewall rule for iscsid in HA deployments https://review.opendev.org/704805 | 16:59 |
| zbr | mwhahaha: was https://opendev.org/openstack/tripleo-ci/commit/8d117bb228c8a79f4c67375a1f990239fa718cd3 aimed to become a new default? | 17:00 |
| mwhahaha | no | 17:00 |
| zbr | mwhahaha: maybe you can help me undo it, see https://review.opendev.org/#/c/705059/ | 17:01 |
| zbr | sshnaidm: weshay ^ | 17:01 |
| sshnaidm | zbr, I found it pretty helpful and useful for debug | 17:01 |
| sshnaidm | zbr, it's not a big file usually, and even if it is - just gzip it | 17:02 |
| zbr | sure. there is also a debug option on zuul, but nobody made it always on/ | 17:02 |
| sshnaidm | zbr, nobody makes it on never | 17:02 |
| weshay | sshnaidm, the gzip of that file would be in a zuul playbook right? | 17:03 |
| weshay | chicken and egg issue there | 17:03 |
| weshay | IMHO I find that level of verbosity difficult to parse.. | 17:03 |
| sshnaidm | weshay, why? you can gzip in the same script, no any problem | 17:03 |
| zbr | yes it can be gzipped, and even putting a head -n on it, but v4 is not for humans. | 17:04 |
| openstackgerrit | Florian Fuchs proposed openstack/tripleo-validations master: Add FFU undercloud validation https://review.opendev.org/703621 | 17:04 |
| weshay | zbr, nack to head -n | 17:04 |
| weshay | I like seeing the whole thing.. | 17:04 |
| sshnaidm | weshay, because you look at the file that was generated by a specific patch which dumped there a lot of info, take a look at regular file | 17:04 |
| *** bogdando has quit IRC | 17:04 | |
| sshnaidm | weshay, we don't even gzip it usually, as it's not a biggie | 17:04 |
| *** ratailor_ has quit IRC | 17:05 | |
| dtantsur | sshnaidm: http://paste.openstack.org/show/788987/ | 17:05 |
| openstackgerrit | Florian Fuchs proposed openstack/tripleo-validations master: Add FFU validation to check for existence of a backup file https://review.opendev.org/701179 | 17:06 |
| openstackgerrit | Sorin Sbarnea proposed openstack/ansible-role-collect-logs master: POC: Parallelize collection commands https://review.opendev.org/703586 | 17:07 |
| *** tesseract has quit IRC | 17:08 | |
| lbragstad | hey folks - i have a couple of questions on https://review.opendev.org/#/c/702031/11 and https://review.opendev.org/#/c/702032/2 - the later is no longer needed given the current state of the former, right? | 17:10 |
| ykarel|away | ohh 2 voting jobs in gate are being reset | 17:11 |
| ykarel|away | sshnaidm, gzip revert is not yet merged ^^ | 17:11 |
| ykarel|away | need to prioritize fixes for both of those | 17:11 |
| openstackgerrit | Sorin Sbarnea proposed openstack/ansible-role-collect-logs master: POC: Parallelize collection commands https://review.opendev.org/703586 | 17:11 |
| ykarel|away | scenario010 and -updates jobs | 17:11 |
| *** marios|out has quit IRC | 17:12 | |
| ykarel|away | weshay, ^^ | 17:12 |
| weshay | ykarel|away, ya.. we know | 17:12 |
| weshay | ykarel|away, https://etherpad.openstack.org/p/ruckroversprint21 | 17:13 |
| ykarel|away | weshay, ack i saw update 4 hour ago | 17:13 |
| ykarel|away | so thought it's not in priority | 17:13 |
| ykarel|away | also noticed non-voting job running in gate tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades | 17:16 |
| ykarel|away | https://review.opendev.org/#/c/704917/ | 17:16 |
| dtantsur | sshnaidm: okay, it seems to only happen if I use --release tripleo-ci/RedHat-8/master. If I change to CentOS-7 is passes this point. Any ideas? | 17:16 |
| dtantsur | sshnaidm: ofc you have ansible_python_interpreter: 3 there... | 17:19 |
| *** suuuper has quit IRC | 17:20 | |
| openstackgerrit | Carlos Goncalves proposed openstack/tripleo-heat-templates master: Ensure /var/run/octavia is present upon reboot https://review.opendev.org/704773 | 17:20 |
| EmilienM | slagle: +2 on the patches for decomposing. I'll refactor later | 17:20 |
| sshnaidm | dtantsur, yeah, missed that, seems like it was from times we didn't have auto discovery, but RHEL8 should have python3 though | 17:22 |
| sshnaidm | dtantsur, so how did it fail then? | 17:22 |
| sshnaidm | dtantsur, and it has python3 only, no py2 in rhel8 | 17:22 |
| dtantsur | sshnaidm: the virthost is RHEL 7 | 17:22 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-ansible master: WIP - Add module "container_puppet_config" https://review.opendev.org/702315 | 17:22 |
| dtantsur | (the only version quickstart supports, really) | 17:22 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: WIP - Deploy Puppet containers with tripleo-ansible https://review.opendev.org/702323 | 17:22 |
| sshnaidm | dtantsur, oh, I see, I think we can try to remove it, should work imho | 17:23 |
| dtantsur | yeah, I hope ansible does the right thing | 17:23 |
| weshay | ykarel|away, https://trello.com/c/LgHxo6jL/1312-cixlp1861083tripleociproa-master-containerized-undercloud-upgrade-job-failed-with-tripleopodman-role-not-found | 17:23 |
| dtantsur | oh, and I forgot --no-clone (is there a reason it's not there by default?) | 17:24 |
| *** florianf has quit IRC | 17:24 | |
| ykarel|away | weshay, need https://review.rdoproject.org/r/#/c/24754/ | 17:26 |
| openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-quickstart master: Remove hardcoding of python interpreter for rhel8 https://review.opendev.org/705070 | 17:26 |
| ykarel|away | ci red there | 17:26 |
| ykarel|away | need new tripleo-ansible package build | 17:26 |
| ade_lee | slagle, mwhahaha EmilienM so -just to confirm -- there is no hook anywhere to run code to deregister nodes whenever a openstack stack delete runs , right? | 17:27 |
| sshnaidm | ykarel|away, I think we had it with raukadah patch? | 17:27 |
| ykarel|away | sshnaidm, which patch? | 17:27 |
| mwhahaha | ade_lee: not a stack delete, no | 17:27 |
| weshay | ykarel|away, we need a lot of things atm | 17:27 |
| weshay | :) | 17:27 |
| mwhahaha | ade_lee: if you're refering to a node delete, we try and run code (if it's up). see nova-compute for an example | 17:28 |
| ykarel|away | sshnaidm, openstack/releases one? | 17:28 |
| ade_lee | mwhahaha, ok -- so I guess I can do this by having folks run a standalone script beforehand. | 17:28 |
| sshnaidm | ykarel|away, yeah | 17:28 |
| ykarel|away | if yes then no | 17:28 |
| *** yprokule has quit IRC | 17:28 | |
| ykarel|away | that do not trigger package build | 17:28 |
| ade_lee | mwhahaha, yeah - that would be a scale-down, with scale-tasks and I'm testing that right now | 17:28 |
| ykarel|away | either commit in tripleo-ansible upstream or distgit needs to merge | 17:29 |
| weshay | ykarel|away, are there know issues w/ those jobs? | 17:29 |
| ykarel|away | sshnaidm, ^^ | 17:29 |
| ade_lee | mwhahaha, is there a way for me to access the ansible variables for all the nodes in the stack? | 17:29 |
| ade_lee | (in my standalone script) | 17:29 |
| sshnaidm | ykarel|away, commit upstream..? | 17:29 |
| *** jmasud has joined #tripleo | 17:30 | |
| ade_lee | mwhahaha, I need to access the service_metadata which we write there now .. | 17:30 |
| mwhahaha | ade_lee: probably not | 17:30 |
| ykarel|away | weshay, jobs are fine, tripleo-ansible-1.1.0 package is not available yet | 17:30 |
| slagle | ade_lee: for "stack delete" or "overcloud delete", no. we don't run config-download after those commands | 17:30 |
| mwhahaha | ade_lee: unless that ends up in the tripleo ivnentory | 17:30 |
| weshay | FOLKS... STOP TYPING.. YOU ARE MAKING THINGS WORSE :) /me calls for an early weekend for everyone!!! | 17:30 |
| *** tmazur has quit IRC | 17:31 | |
| *** gfidente is now known as gfidente|afk | 17:31 | |
| ade_lee | hmm .. I guess I could put that info there .. | 17:31 |
| ykarel|away | see https://trunk.rdoproject.org/centos7-master/current/ tripleo-ansible 1.1.0 not yet there | 17:31 |
| weshay | ykarel|away, k.. what's holding that up? | 17:31 |
| ykarel|away | weshay, commit in tripleo-ansible upstream or distgit | 17:32 |
| ade_lee | mwhahaha, slagle is the code anywhere that you know of that writes stuff to the inventory that I can look at? | 17:32 |
| ykarel|away | package builds only after change in repo | 17:32 |
| mwhahaha | tripleo-common | 17:32 |
| dtantsur | sshnaidm: w00t, it's moving now :) thx for your help | 17:33 |
| ykarel|away | weshay, i can send dummy patch in distgit to trigger it | 17:33 |
| weshay | hooo ray | 17:33 |
| sshnaidm | dtantsur, sure, np | 17:33 |
| *** evrardjp has joined #tripleo | 17:33 | |
| *** jmasud has quit IRC | 17:34 | |
| *** jmasud_ has joined #tripleo | 17:34 | |
| sshnaidm | ykarel|away, yeah, because I don't think we can merge anything now to upstream | 17:35 |
| openstackgerrit | Jose Luis Franco proposed openstack/tripleo-upgrade master: Initital ffwd2 patch to automate OS upgrade. https://review.opendev.org/704905 | 17:35 |
| openstackgerrit | Ryan McCabe proposed openstack/python-tripleoclient master: Revert "Remove panko" https://review.opendev.org/705072 | 17:37 |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart master: Use metalsmith for getting OC servers in inventory when available https://review.opendev.org/705052 | 17:37 |
| *** holser__ has quit IRC | 17:38 | |
| weshay | sshnaidm, ykarel|away yup.. gates are FOOOKED | 17:38 |
| *** holser has joined #tripleo | 17:39 | |
| dtantsur | is it somehow related to 38.145.34.141/rcm-guest/images/rhel8/master/rdo_trunk/current-tripleo/overcloud-full.tar.md5 hanging? | 17:41 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-ansible master: WIP - Add module "container_puppet_config" https://review.opendev.org/702315 | 17:42 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: WIP - Deploy Puppet containers with tripleo-ansible https://review.opendev.org/702323 | 17:42 |
| openstackgerrit | Ryan McCabe proposed openstack/python-tripleoclient stable/train: Revert "Remove panko" https://review.opendev.org/705074 | 17:42 |
| weshay | dtantsur, what's up? | 17:42 |
| weshay | dtantsur, ur running rhel8 tripleo jobs? | 17:43 |
| weshay | you feeling ok? | 17:43 |
| weshay | dpawlik, ^ | 17:43 |
| dtantsur | no, I'm quite sick, trying to get a working undercloud adds to it :D | 17:43 |
| weshay | heh.. sorry :) | 17:43 |
| weshay | dpawlik, did you send an invite? | 17:44 |
| dtantsur | just for you to understand how miserable I am: I got tasked with showing some people ironic. I said, "oh, I'll just set up an undercloud on a beefy machine!". | 17:44 |
| weshay | dtantsur, can you send a log | 17:44 |
| dpawlik | weshay, not yet | 17:44 |
| weshay | dtantsur, so.. that server is passwd protected | 17:44 |
| weshay | dtantsur, pretty sure you don't have the keys dude | 17:44 |
| *** grami[m] has quit IRC | 17:44 | |
| dtantsur | weshay: ehhhm, then why do we add a link to it to our public release files? Oo | 17:45 |
| dpawlik | weshay, still dunno how long I will cooperate with work on new server deployment | 17:45 |
| weshay | dtantsur, because the link doesn't reveal anything :) | 17:45 |
| weshay | dtantsur, it's RHEL | 17:45 |
| weshay | no download for you | 17:45 |
| *** pkopec has quit IRC | 17:45 | |
| weshay | dtantsur, go show people w/ OSP :) | 17:45 |
| dtantsur | weshay: and it doesn't respond with HTTP 403 "subscription needed" because we hate everyone? | 17:45 |
| dtantsur | ;) | 17:45 |
| weshay | well.. for that you ask our rdo admins like dpawlik | 17:46 |
| weshay | dtantsur, seperation of church and state and all | 17:46 |
| dtantsur | weshay: well, if you point me at something that can give me an OSP undercloud without spending another day fighting weird issues :) | 17:46 |
| weshay | not sure who is church and who is state | 17:46 |
| * dtantsur assumes he's church | 17:47 | |
| dtantsur | Poor faith locked away from the treasures of public | 17:47 |
| dtantsur | On a serious note, how far are we from supporting CentOS 8? | 17:48 |
| weshay | dtantsur, various ways to skin that cat re: an OSP unercloud | 17:48 |
| weshay | dtantsur, again.. ask #rdo | 17:48 |
| weshay | church / state | 17:48 |
| openstackgerrit | Ryan McCabe proposed openstack/python-tripleoclient stable/train: Revert "Remove panko" https://review.opendev.org/705074 | 17:48 |
| dtantsur | weshay: if I find you on #rdo, I'll apply some holy water! | 17:49 |
| *** jmasud_ has quit IRC | 17:49 | |
| weshay | lolz | 17:49 |
| weshay | dtantsur, if you have a tenant in rdo.. you can access those rhel images | 17:49 |
| weshay | or internally | 17:49 |
| dtantsur | weshay: that's from an internal machine, yes | 17:50 |
| weshay | well.. I take that back .. I think you still need a key | 17:50 |
| * weshay checks | 17:50 | |
| * dpawlik it is a very secret machine, nobody knows about that except weshay | 17:51 | |
| weshay | dpawlik, bah.. I'm not the admin :) | 17:51 |
| weshay | you guys are | 17:51 |
| *** jpich has quit IRC | 17:52 | |
| dtantsur | okay folks, thank you for hearing out my complaints, I'll continue suffering tomorrow | 17:52 |
| *** dtantsur is now known as dtantsur|afk | 17:52 | |
| * dpawlik im not so long in RDO. Im still discovering new things | 17:52 | |
| weshay | dpawlik, right.. so let's jump on a conf.. and I'll explain this one to you | 17:53 |
| dpawlik | weshay, let me finish one thing with tristanC | 17:53 |
| *** abishop has quit IRC | 17:54 | |
| *** abishop has joined #tripleo | 17:54 | |
| *** derekh has quit IRC | 18:00 | |
| *** holser has quit IRC | 18:01 | |
| ykarel|away | sshnaidm, weshay tripleo-ansible-1.1.0 is build https://trunk.rdoproject.org/centos7-master/current/tripleo-ansible-1.1.0-0.20200130175603.6f33d53.el7.noarch.rpm | 18:01 |
| ykarel|away | but need to be cautious while merging tht patch | 18:02 |
| ykarel|away | as mirror sometimes takes time to sync | 18:02 |
| *** rpittau is now known as rpittau|afk | 18:02 | |
| sshnaidm | ykarel|away, ack | 18:02 |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/tripleo-common stable/stein: Dynamically set the number of Ansible forks. https://review.opendev.org/705076 | 18:04 |
| ekultails | clounull: It looks like we (thankfully) re-use Ansible bits from OSA to generate the clouds.yaml file: https://github.com/openstack/ansible-config_template. However, I couldn't find anything about generating an RC file. Not sure if I'm duplicating effort or not right now. Was wondering if you had some more insight. :-) | 18:05 |
| odyssey4me | ekultails: there's another role - openstack-ansible-openrc or something like that | 18:06 |
| ekultails | odyssey4me: Thanks for getting that Ansible forks backport up. We probably want to get it all the back to Queens, too. | 18:06 |
| ekultails | odyssey4me: Cool, I'll look around for that. Thanks! | 18:06 |
| ekultails | Bingo: https://github.com/openstack/openstack-ansible-openstack_openrc | 18:06 |
| odyssey4me | ekultails: yep, that's my plan - good approach... I think we could infer a lot more scale-related things for both openstack and ansible from the environment | 18:06 |
| odyssey4me | ekultails: for example, we know the size of the overcloud - so why don't we use that to tune the undercloud appropriately | 18:07 |
| ekultails | odssey4me: Agreed. A lot of things are very static and/or hard-coded. | 18:07 |
| odyssey4me | ekultails: it's not about being perfect, but it is about having a 'sensible default'; | 18:07 |
| odyssey4me | ekultails: the same could be applied to all sorts of things, like threads/processes, etc... | 18:08 |
| ekultails | odyseey4me: I'm all on board with that. Moving towards that is something I hope we can accomplish by the Ussuri release. | 18:09 |
| odyssey4me | ekultails: it's easy enough in ansible - but many things in heat override those settings... so it's going to be a little bit of fun straddling both for a while | 18:09 |
| odyssey4me | s/heat/THT/ | 18:10 |
| ekultails | We've mostly just been focusing on large deployment blockers lately. Soon I can think we can divert more focus into finding what optimizations we can do and how. Tripleo Heat Templates definitely complicate things a bit. An abstraction layer that OSA never had to deal with. :-P | 18:12 |
| ekultails | odyssey4me: If you ever need help dissecting things in THT, or elsewhere, let me know. I've picked up a thing or two over the years dealing with TripleO. | 18:13 |
| ekultails | I'm not sure if we have an official scale upstream squad. There could be some value to putting a group together and having bi-weekly sprints/meet-ups. | 18:14 |
| ekultails | Doesn't look like a scale squad exists: https://specs.openstack.org/openstack/tripleo-specs/specs/policy/squads.html | 18:15 |
| *** numans has joined #tripleo | 18:16 | |
| *** sshnaidm is now known as sshnaidm|afk | 18:20 | |
| openstackgerrit | Sorin Sbarnea proposed openstack/tripleo-ci master: Disable gzip on upstream and enable on OVB (direct) https://review.opendev.org/704952 | 18:20 |
| odyssey4me | ekultails: tyvm, appreciate the offer :) | 18:23 |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart master: Use metalsmith for getting OC servers in inventory when available https://review.opendev.org/705052 | 18:28 |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart master: Use metalsmith for getting OC servers in inventory when available https://review.opendev.org/705052 | 18:33 |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/queens: Run update without yum update to apply hotfixes. https://review.opendev.org/704743 | 18:35 |
| *** hberaud is now known as hberaud|gone | 18:35 | |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart master: Run RDO jobs with baremetal provisioning https://review.opendev.org/680571 | 18:36 |
| *** weshay changes topic to "CI Status: RED, STOP RECHECKING | community irc meeting Tues@1400 UTC - tripleo-ci-community meeting Tues@1330 UTC | https://docs.openstack.org/tripleo-docs/latest/" | 18:36 | |
| weshay | ALL ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ | 18:36 |
| *** bnemec has joined #tripleo | 18:41 | |
| *** gfidente|afk is now known as gfidente | 18:43 | |
| openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-operator-ansible master: Fix filter issues and add molecule test https://review.opendev.org/705085 | 18:52 |
| openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-operator-ansible master: Fix filter issues and add molecule test https://review.opendev.org/705085 | 18:52 |
| sshnaidm|afk | mwhahaha, take a look please in your time ^ | 18:52 |
| *** sshnaidm|afk is now known as sshnaidm|off | 18:53 | |
| mwhahaha | sshnaidm|afk: k did you see my note about alphabetizing the jobs? | 18:53 |
| weshay | mwhahaha, which language? | 18:54 |
| mwhahaha | the queen's english | 18:54 |
| weshay | ah.. +1 | 18:54 |
| sshnaidm|off | mwhahaha, not yet | 19:05 |
| sshnaidm|off | stevebaker, weshay, https://github.com/openstack/tripleo-quickstart/blob/master/roles/tripleo-inventory/templates/get-overcloud-nodes.py.j2#L31:L31 | 19:05 |
| sshnaidm|off | weshay, no nova - no overcloud nodes :) | 19:05 |
| * sshnaidm|off off off | 19:06 | |
| weshay | sshnaidm|off, ya.. we already commmented, have a patch | 19:06 |
| stevebaker | hi | 19:06 |
| weshay | sshnaidm|off, https://review.opendev.org/#/c/705052/ | 19:06 |
| openstackgerrit | Brent Eagles proposed openstack/tripleo-ansible master: Octavia: do not attempt container restart on empty list https://review.opendev.org/705093 | 19:06 |
| weshay | stevebaker, howdy.. think we should land this prior to switching over.. or we'll be flying blind w/ logs https://review.opendev.org/#/c/705052/ | 19:07 |
| stevebaker | weshay: what logs would be missing without it? | 19:08 |
| weshay | stevebaker, just the overcloud ;) | 19:08 |
| stevebaker | that seems useful | 19:08 |
| weshay | meh.. some would argue ;) | 19:08 |
| stevebaker | heh | 19:09 |
| stevebaker | I'm fine with https://review.opendev.org/#/c/705052/ depending on https://review.opendev.org/#/c/705052/ | 19:09 |
| stevebaker | ugh | 19:09 |
| stevebaker | I'm fine with https://review.opendev.org/#/c/680571/ depending on https://review.opendev.org/#/c/705052/ | 19:10 |
| *** paramite has quit IRC | 19:14 | |
| stevebaker | weshay, rlandy: what if longer term you switched quickstart to just use the generated config-download inventory? http://logs.rdoproject.org/71/680571/9/openstack-check/tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001/8152d28/logs/undercloud/var/lib/mistral/overcloud/tripleo-ansible-inventory.yaml.txt.gz | 19:15 |
| weshay | stevebaker, that probably would be fine | 19:20 |
| weshay | we'd have to merge it into the original one.. | 19:20 |
| weshay | and remove the undercloud config there | 19:21 |
| weshay | because we're not executing from the undercloud | 19:21 |
| weshay | meh | 19:21 |
| weshay | layers of ansible.. | 19:22 |
| *** bnemec has quit IRC | 19:24 | |
| beagles | EmilienM, fwiw it is get_domain_id copied some paste info http://paste.openstack.org/show/788988/ not sure what other info would be helpful | 19:26 |
| cloudnull | hey all, if folks have some time, i'd really appreciate reviews on the following - https://review.opendev.org/#/q/owner:kevin%2540cloudnull.com+status:open+topic:mistral_to_ansible+label:verified%253D%252B1%252Cuser%253Dzuul | 19:28 |
| mwhahaha | beagles: what does that ansible task look like? | 19:31 |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/tripleo-ansible master: Add cli playbook to retrieve the horizon url https://review.opendev.org/704631 | 19:31 |
| *** jmasud has joined #tripleo | 19:31 | |
| mwhahaha | beagles: the issue is likely that the item being passed in as "all_domains" contains a '' | 19:31 |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/python-tripleoclient master: Convert horizon url workflow to ansible https://review.opendev.org/704632 | 19:31 |
| *** gfidente has quit IRC | 19:35 | |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/tripleo-heat-templates master: Rename roles that we're missed https://review.opendev.org/705102 | 19:41 |
| rlandy | fine by me | 19:41 |
| *** jmasud has quit IRC | 19:42 | |
| beagles | mwhahaha, what do you mean by "look like"? I accidentally snipped the actual task name off of the paste I realize. It was task path: /usr/share/ansible/roles/tripleo_keystone_resources/tasks/user_per_role.yml:17 - Async assignment of Keystone user to roles ... | 19:43 |
| beagles | weird there was no tracing with args | 19:43 |
| weshay | rlandy, ya.. but it won't work.. we run ansible from a virthost or laptop | 19:43 |
| *** morazi has quit IRC | 19:43 | |
| weshay | you won't be able to ssh to it if we use the one generated by tripleo | 19:44 |
| rlandy | it would be nice to have one less thing to maintain though | 19:47 |
| mwhahaha | pffft where's the fun in that | 19:49 |
| mwhahaha | beagles: do you have an env i can poke at? | 19:49 |
| beagles | mwhahaha, sadly not on vpn -might be tricky to get you in there | 19:49 |
| mwhahaha | beagles: or tell me how you built the env? | 19:50 |
| *** alexmcleod has quit IRC | 19:52 | |
| beagles | mwhahaha, starting from a basic centos image - bsaically folowed our u/s standalone containers based deployment docs | 19:52 |
| mwhahaha | k i shall try it out | 19:53 |
| mwhahaha | what version did you install? | 19:53 |
| beagles | (using current-tripleo master) | 19:53 |
| mwhahaha | current-tripleo or current-tripleo-dev | 19:53 |
| beagles | current-tripleo | 19:53 |
| mwhahaha | use current-tripleo-dev | 19:53 |
| beagles | k :) | 19:53 |
| mwhahaha | bet you're getting stuck on something that hasn't promoted yet | 19:53 |
| mwhahaha | only use current-tripleo for stables | 19:53 |
| beagles | probably so | 19:53 |
| mwhahaha | current-tripleo-dev is what we get in CI so we know it usually works | 19:54 |
| mwhahaha | (for master) | 19:54 |
| beagles | gotcha | 19:54 |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/tripleo-ansible master: Cleanup after rename-pocolyps https://review.opendev.org/703477 | 19:58 |
| *** hamzy_ has joined #tripleo | 20:11 | |
| *** hamzy has quit IRC | 20:14 | |
| *** psachin has quit IRC | 20:16 | |
| openstackgerrit | Ryan McCabe proposed openstack/tripleo-heat-templates stable/train: Revert "Remove panko" https://review.opendev.org/704869 | 20:30 |
| openstackgerrit | Ryan McCabe proposed openstack/tripleo-heat-templates stable/train: Revert "Remove panko" https://review.opendev.org/704869 | 20:35 |
| *** rcernin has quit IRC | 20:36 | |
| *** jmasud has joined #tripleo | 20:37 | |
| *** jtomasek has quit IRC | 20:38 | |
| openstackgerrit | Jose Luis Franco proposed openstack/tripleo-upgrade master: Ensure that ceph-ansible is installed in the undercloud. https://review.opendev.org/705114 | 20:43 |
| *** jtomasek has joined #tripleo | 20:43 | |
| *** jfrancoa has quit IRC | 20:43 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/train: Fix keepalived logging on disk https://review.opendev.org/704917 | 20:44 |
| *** jmasud has quit IRC | 20:44 | |
| *** jmasud has joined #tripleo | 20:45 | |
| *** jmasud has quit IRC | 20:47 | |
| *** artom has quit IRC | 20:49 | |
| ade_lee | mwhahaha, slagle -- so if I understand the scale down process -- first I call the node delete -- and then I have to do an openstack stack deploy? | 20:52 |
| ade_lee | the openstack stack deploy is when the scale tasks will run? | 20:52 |
| ade_lee | or do I just need to do a node delete -- and thats when the scale tasks run? | 20:52 |
| mwhahaha | no i think they run on node delete, EmilienM wrote that stuff | 20:53 |
| mwhahaha | cause i think it reuses the last config download to execute the tasks on the node being removed | 20:53 |
| mwhahaha | (would have to verify in code) | 20:53 |
| ade_lee | mwhahaha, ok - so I don't need to do a stack deploy | 20:53 |
| mwhahaha | you'd still stack deploy i think | 20:53 |
| mwhahaha | cause you need to lower the number in the stack | 20:54 |
| *** holser has joined #tripleo | 20:55 | |
| mwhahaha | wait maybe not | 20:55 |
| *** Trevor_V has quit IRC | 20:55 | |
| *** apetrich has quit IRC | 20:55 | |
| mwhahaha | docs seem to point to the node delete doing the required stack bits | 20:56 |
| * mwhahaha shrugs | 20:56 | |
| ade_lee | ok :/ | 20:56 |
| *** apevec has quit IRC | 20:59 | |
| mwhahaha | weshay: rdo cloud go poof? | 21:04 |
| *** dking_desktop has joined #tripleo | 21:05 | |
| ade_lee | mwhahaha, slagle EmilienM -- are the ansible taks executed in a scale down operation logged anywhere? | 21:06 |
| mwhahaha | probably? | 21:06 |
| mwhahaha | i'd assume at least in ansible.log | 21:06 |
| slagle | agreed | 21:07 |
| ade_lee | hmm .. I see nothing there | 21:07 |
| slagle | oh, check the output of the mistral execution. looks like it might be using a temp work_dir | 21:13 |
| slagle | the path of which is returned in the execution output | 21:14 |
| slagle | probably /tmp/ansible-mistral-action* | 21:14 |
| slagle | at least, that is what the python code tells me | 21:15 |
| slagle | why EmilienM did that, I don't know. | 21:15 |
| slagle | would have to ask EmilienM | 21:15 |
| slagle | just keep saying his name and he appears | 21:15 |
| mwhahaha | he's off flying a plane | 21:16 |
| mwhahaha | it should show up in the output i thought | 21:17 |
| slagle | i don't see how that relates to responding on irc | 21:17 |
| weshay | mwhahaha, logging did | 21:18 |
| *** alexmcleod has joined #tripleo | 21:22 | |
| *** rfolco has quit IRC | 21:24 | |
| *** rfolco has joined #tripleo | 21:24 | |
| *** ansmith has quit IRC | 21:24 | |
| *** dpawlik has quit IRC | 21:25 | |
| *** ekultails has quit IRC | 21:27 | |
| *** rh-jelabarre has quit IRC | 21:38 | |
| *** slaweq has quit IRC | 21:43 | |
| *** slaweq has joined #tripleo | 21:45 | |
| *** bfournie has quit IRC | 21:48 | |
| openstackgerrit | Steve Baker proposed openstack/tripleo-ansible master: Skeleton role, get with the decade https://review.opendev.org/705124 | 21:50 |
| *** alexmcleod has quit IRC | 21:52 | |
| *** slaweq has quit IRC | 21:55 | |
| openstackgerrit | James Slagle proposed openstack/tripleo-ansible master: Add strategy optimization https://review.opendev.org/704691 | 22:03 |
| *** ansmith has joined #tripleo | 22:07 | |
| *** ssbarnea- has joined #tripleo | 22:08 | |
| *** ayoung has quit IRC | 22:14 | |
| openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-operator-ansible master: Fix filter issues and add molecule test https://review.opendev.org/705085 | 22:31 |
| *** raildo has quit IRC | 22:33 | |
| *** bfournie has joined #tripleo | 22:42 | |
| openstackgerrit | Merged openstack/tripleo-operator-ansible master: Add overcloud status role https://review.opendev.org/703700 | 22:55 |
| *** apetrich has joined #tripleo | 22:55 | |
| *** tkajinam has joined #tripleo | 23:10 | |
| *** jmasud has joined #tripleo | 23:12 | |
| *** jdandrea has quit IRC | 23:13 | |
| *** jmasud has quit IRC | 23:18 | |
| *** rcernin has joined #tripleo | 23:20 | |
| openstackgerrit | Alex Schultz proposed openstack/tripleo-operator-ansible master: Add tripleo overcloud deploy role https://review.opendev.org/705131 | 23:29 |
| openstackgerrit | Alex Schultz proposed openstack/tripleo-operator-ansible master: Add tripleo overcloud deploy role https://review.opendev.org/705131 | 23:36 |
| *** ysandeep has joined #tripleo | 23:40 | |
| openstackgerrit | Alex Schultz proposed openstack/tripleo-operator-ansible master: Add tripleo overcloud deploy role https://review.opendev.org/705131 | 23:46 |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/rocky: Add SSHD composable service to Networker role definition https://review.opendev.org/704893 | 23:48 |
| *** kopecmartin has left #tripleo | 23:50 | |
| openstackgerrit | Alex Schultz proposed openstack/tripleo-operator-ansible master: Add tripleo overcloud deploy role https://review.opendev.org/705131 | 23:53 |
| *** kopecmartin has joined #tripleo | 23:53 | |
| openstackgerrit | Alex Schultz proposed openstack/tripleo-operator-ansible master: Add tripleo overcloud deploy role https://review.opendev.org/705131 | 23:58 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!