openstackgerrit | Luke Short proposed openstack/tripleo-common master: Expose --limit, --skip-tags, and --tags in config-download. https://review.opendev.org/692420 | 00:10 |
---|---|---|
openstackgerrit | Merged openstack/tripleo-common master: Move plan container creation to utils https://review.opendev.org/708802 | 00:14 |
openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart-extras master: update build-test-packages for centos-8 https://review.opendev.org/709837 | 00:20 |
openstackgerrit | Merged openstack/tripleo-heat-templates stable/train: Set octavia-ansible dir ownership to Ansible user https://review.opendev.org/708645 | 00:20 |
openstackgerrit | Merged openstack/tripleo-heat-templates stable/stein: Set octavia-ansible dir ownership to Ansible user https://review.opendev.org/708646 | 00:20 |
*** beagles is now known as beagles_rpm_mode | 00:20 | |
*** jmasud has joined #tripleo | 00:26 | |
openstackgerrit | Merged openstack/tripleo-ansible stable/train: container_puppet_config: disable SElinux labelling https://review.opendev.org/709646 | 00:27 |
*** dsavineau has quit IRC | 00:31 | |
openstackgerrit | Luke Short proposed openstack/python-tripleoclient master: Expose --limit, --skip-tags, and --tags on the CLI. https://review.opendev.org/692421 | 00:41 |
*** ekultails has quit IRC | 00:51 | |
*** rh-jelabarre has quit IRC | 00:58 | |
openstackgerrit | Merged openstack/python-tripleoclient master: Remove mistral from the generate_fencing_parameters deploy workflow https://review.opendev.org/707187 | 01:02 |
openstackgerrit | Merged openstack/tripleo-ci master: add delorean_repo.md5 to logging https://review.opendev.org/709597 | 01:02 |
openstackgerrit | Merged openstack/tripleo-heat-templates stable/train: Remove libvirt packaged dependencies https://review.opendev.org/707401 | 01:02 |
openstackgerrit | Merged openstack/tripleo-common master: Bracket IPv6 address in ironic_inspector healthcheck https://review.opendev.org/707263 | 01:02 |
*** rh-jelabarre has joined #tripleo | 01:05 | |
openstackgerrit | Bob Fournier proposed openstack/tripleo-common stable/train: Bracket IPv6 address in ironic_inspector healthcheck https://review.opendev.org/709921 | 01:10 |
*** bfournie has joined #tripleo | 01:27 | |
openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart-extras master: Use ansible_package_manager in playbooks/prepare-slave.yml https://review.opendev.org/709866 | 02:01 |
openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart-extras master: update build-test-packages for centos-8 https://review.opendev.org/709837 | 02:17 |
*** jmasud has quit IRC | 02:22 | |
openstackgerrit | Steve Baker proposed openstack/tripleo-ansible master: module tripleo_baremetal_expand_roles https://review.opendev.org/706417 | 02:29 |
openstackgerrit | Steve Baker proposed openstack/tripleo-ansible master: module metalsmith_instances https://review.opendev.org/706418 | 02:29 |
openstackgerrit | Steve Baker proposed openstack/tripleo-ansible master: module tripleo_baremetal_check_existing https://review.opendev.org/707043 | 02:29 |
*** mrunge has quit IRC | 02:30 | |
openstackgerrit | Steve Baker proposed openstack/tripleo-ansible master: module tripleo_baremetal_populate_environment https://review.opendev.org/707295 | 02:30 |
openstackgerrit | Steve Baker proposed openstack/tripleo-ansible master: Playbooks for overcloud node (un)provision https://review.opendev.org/707044 | 02:30 |
*** mrunge has joined #tripleo | 02:32 | |
openstackgerrit | Kevin Carter (cloudnull) proposed openstack/python-tripleoclient master: Remove mistral from the bios_configuration workflows https://review.opendev.org/709861 | 02:32 |
openstackgerrit | Steve Baker proposed openstack/python-tripleoclient master: WIP switch to ansible for overcloud node (un)provision https://review.opendev.org/708749 | 02:36 |
*** rlandy has quit IRC | 02:42 | |
openstackgerrit | Kevin Carter (cloudnull) proposed openstack/tripleo-ansible master: Baremetal Configure Playbook https://review.opendev.org/691667 | 02:43 |
openstackgerrit | Merged openstack/python-tripleoclient master: Revert "Default to zero verbosity when using Ansible." https://review.opendev.org/708208 | 02:45 |
openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart-extras master: Use ansible_package_manager in playbooks/prepare-slave.yml https://review.opendev.org/709866 | 02:52 |
openstackgerrit | Rabi Mishra proposed openstack/tripleo-common master: Move package_update worflow related functionality to utils https://review.opendev.org/706815 | 02:52 |
openstackgerrit | Rabi Mishra proposed openstack/tripleo-common master: Move parameter actions functionality to utils - Part 1/2 https://review.opendev.org/709546 | 02:52 |
openstackgerrit | Ronelle Landy proposed openstack/tripleo-ci master: DNM: Testing use_testenv_broker set to false https://review.opendev.org/709940 | 02:56 |
openstackgerrit | Rabi Mishra proposed openstack/python-tripleoclient master: Pass verbose boolean value to wait_for_stack_ready() https://review.opendev.org/706253 | 03:05 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-ansible master: WIP - container_puppet_config: skip containers without new config https://review.opendev.org/709823 | 03:17 |
openstackgerrit | John Fulton proposed openstack/tripleo-common master: Do not create temporary swift URLS for ceph-ansible https://review.opendev.org/709249 | 03:19 |
openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart master: Add release files for master CentOS 8 https://review.opendev.org/709560 | 03:19 |
*** rlandy has joined #tripleo | 03:21 | |
*** rlandy has quit IRC | 03:22 | |
*** dsneddon has quit IRC | 03:27 | |
openstackgerrit | Merged openstack/tripleo-common master: Improve upload-swift-artifacts handling of json data https://review.opendev.org/708286 | 03:29 |
*** bdodd has joined #tripleo | 03:36 | |
*** rh-jelabarre has quit IRC | 03:36 | |
openstackgerrit | Rabi Mishra proposed openstack/tripleo-common master: WIP Modify roles to remove unused services https://review.opendev.org/709692 | 03:46 |
openstackgerrit | Ronelle Landy proposed openstack/tripleo-ci master: DNM: Demo of parenting centos 8 https://review.opendev.org/709950 | 03:47 |
openstackgerrit | Rabi Mishra proposed openstack/tripleo-common master: WIP Modify roles to remove unused services https://review.opendev.org/709692 | 03:55 |
*** dsneddon has joined #tripleo | 03:58 | |
openstackgerrit | Merged openstack/diskimage-builder master: Add CentOS 8 support https://review.opendev.org/684308 | 04:02 |
openstackgerrit | Merged openstack/diskimage-builder master: Do not include efibootmgr and efivars for ppc architectures https://review.opendev.org/709811 | 04:02 |
openstackgerrit | Merged openstack/diskimage-builder master: Change tgt pkg-map to target-restore CentOS/RHEL-8 https://review.opendev.org/709159 | 04:05 |
openstackgerrit | Merged openstack/diskimage-builder master: fix iscsi-boot element exiting build even if dracut-regenerate used https://review.opendev.org/707340 | 04:06 |
*** dsneddon has quit IRC | 04:08 | |
*** panda has quit IRC | 04:12 | |
*** panda has joined #tripleo | 04:13 | |
*** dsneddon has joined #tripleo | 04:37 | |
*** dsneddon has quit IRC | 04:42 | |
*** dsneddon has joined #tripleo | 04:45 | |
*** dsneddon has quit IRC | 04:50 | |
*** raukadah is now known as chandankumar | 05:09 | |
*** ykarel|away is now known as ykarel | 05:13 | |
*** yprokule has joined #tripleo | 05:19 | |
*** yprokule has quit IRC | 05:21 | |
*** yprokule has joined #tripleo | 05:21 | |
*** dsneddon has joined #tripleo | 05:25 | |
*** dsneddon has quit IRC | 05:31 | |
*** evrardjp has quit IRC | 05:34 | |
*** evrardjp has joined #tripleo | 05:35 | |
*** skramaja has joined #tripleo | 05:35 | |
*** udesale has joined #tripleo | 05:41 | |
*** udesale has quit IRC | 05:41 | |
*** udesale has joined #tripleo | 05:41 | |
*** jdandrea has quit IRC | 05:41 | |
*** ramishra has quit IRC | 05:42 | |
*** ramishra has joined #tripleo | 05:50 | |
openstackgerrit | Chandan Kumar (raukadah) proposed openstack/tripleo-ci master: Improve build images role for CentOS8 https://review.opendev.org/708599 | 05:55 |
*** ramishra has quit IRC | 05:55 | |
*** ramishra has joined #tripleo | 05:56 | |
openstackgerrit | Merged openstack/python-tripleoclient stable/train: Allow import to specify image location ipxe=false https://review.opendev.org/707518 | 05:57 |
*** jmasud has joined #tripleo | 05:59 | |
*** dsneddon has joined #tripleo | 05:59 | |
*** dsneddon has quit IRC | 06:04 | |
*** sri_ has joined #tripleo | 06:04 | |
*** ratailor has joined #tripleo | 06:06 | |
*** kozhukalov has joined #tripleo | 06:08 | |
openstackgerrit | Chandan Kumar (raukadah) proposed openstack/tripleo-ci master: Improve build images role for CentOS8 https://review.opendev.org/708599 | 06:12 |
*** ratailor has quit IRC | 06:18 | |
*** ratailor has joined #tripleo | 06:21 | |
*** udesale has quit IRC | 06:24 | |
*** udesale has joined #tripleo | 06:25 | |
*** shyamb has joined #tripleo | 06:28 | |
shyamb | Hi | 06:31 |
shyamb | podman pull from undercloud registry is failing with error "unsupported docker v2s2 media type: """ | 06:32 |
shyamb | in rhosp16 | 06:32 |
shyamb | ykarel: If you have any idea about this issue, please let me know | 06:32 |
*** saneax has joined #tripleo | 06:33 | |
*** dsneddon has joined #tripleo | 06:37 | |
shyamb | ykarel: This bugzilla bug looks exactly same: https://bugzilla.redhat.com/show_bug.cgi?id=1793960 | 06:38 |
openstack | bugzilla.redhat.com bug 1793960 in ansible-role-tripleo-modify-image "buildah builds images that podman can't pull (unsupported docker v2s2 media type: "")" [High,Closed: errata] - Assigned to aschultz | 06:38 |
*** lmiccini has joined #tripleo | 06:41 | |
*** dsneddon has quit IRC | 06:42 | |
Tengu | chandankumar: heya! not sure if you can help me - I'm trying to deploy master on centos-8, and apparently there are some issues with "current-tripleo" packages. For instance, the ansible-role-container-registry package download returns a 403... ? | 06:42 |
Tengu | should I use another flavour? | 06:42 |
*** rcernin has quit IRC | 06:47 | |
Tengu | ah, apparently using "consistent" is... consistent | 06:52 |
openstackgerrit | Francesco Pantano proposed openstack/tripleo-heat-templates master: [WIP] Add CephBasePoolVars structure to handle pools variables https://review.opendev.org/709297 | 06:53 |
openstackgerrit | Merged openstack/tripleo-heat-templates stable/train: Fix krb-service-principals with service_net_map_replace https://review.opendev.org/709599 | 06:59 |
chandankumar | Tengu, can you use tripleo-ci-testing repo | 07:01 |
*** marios has joined #tripleo | 07:01 | |
*** marios is now known as marios|ruck | 07:01 | |
Tengu | chandankumar: ah? damn, ok. I wasn't sure about that one :). I'll test once I have the "usual" failure with network config. | 07:01 |
chandankumar | Tengu, we are testing all jobs using toci testing, we have not yet promoted current-tripleo (which is out of sync) | 07:01 |
Tengu | IF I have it | 07:01 |
Tengu | oh, ok. this explains | 07:02 |
chandankumar | Tengu, ansibelr-role-container-registry known issue we have seen this in current-tripleo | 07:02 |
chandankumar | Tengu, if you want, try standaloen scenario2 | 07:02 |
Tengu | chandankumar: out of curiosity - is there a doc about the usage of each repo? | 07:02 |
chandankumar | Tengu, we are dealing with weired error there | 07:02 |
Tengu | chandankumar: on my side I'm hitting a consistent error with the os-net-config, it fails activating the ctlplane interface - that was yesterday, using the "current" repo. | 07:03 |
chandankumar | Tengu, https://review.opendev.org/#/c/709560/16/config/release/tripleo-ci/CentOS-8/promotion-testing-hash-master.yml and https://hackmd.io/5uYRmLaOTI2raTbHWsaiSQ?view | 07:03 |
Tengu | ah, great, thanks for the links! | 07:03 |
chandankumar | Tengu, https://review.rdoproject.org/r/#/c/24835/ is this one amoralej|off mentioned in his last comment | 07:04 |
chandankumar | here we were trying to pull c8 deps in rhel8 | 07:04 |
chandankumar | i mean about os-net-config | 07:04 |
Tengu | yeah, so we'll probably abandon that c8-on-rhel8 thing. | 07:05 |
chandankumar | Tengu, yes, will do that | 07:06 |
Tengu | meh... really need to figure out that NetworkConfig script issue -.- | 07:06 |
chandankumar | Tengu, https://logserver.rdoproject.org/29/25329/13/check/periodic-tripleo-ci-centos-8-scenario002-standalone-master/aa73ff4/logs/undercloud/home/zuul/standalone_deploy.log.txt.gz scenario 2 issue | 07:06 |
chandankumar | it is working fine in rhel8 and centos7 | 07:06 |
*** jfrancoa has joined #tripleo | 07:07 | |
chandankumar | may be soemthing wrong with this part https://opendev.org/openstack/tripleo-ansible/src/branch/master/tripleo_ansible/roles/tripleo_keystone_resources/tasks/user_per_role.yml#L23-L25 | 07:07 |
Tengu | that's what prevents me deploying a standalone so far ;_; | 07:07 |
Tengu | hmmm. maybe. not sure. I'm not there now ;_; | 07:07 |
Tengu | is there any weird/specific things done on the centos-8 VM in order to get that @|#ßð networkconfig pass? | 07:07 |
chandankumar | Tengu, ceph ansibel has issue, it does not works with ansible-2.0 fyi | 07:07 |
chandankumar | Tengu, right now nothing | 07:07 |
Tengu | "Device br-ctlplane does not seem to be present, delaying initialization." meh. | 07:08 |
Tengu | then it falls back on dhcp, and fails. | 07:08 |
chandankumar | Tengu, better open a bz and do it cix | 07:08 |
Tengu | yeah, wait, will do the deploy using the repo version you pointed - this one was using "consistent", since I was near the error point I let it run | 07:09 |
chandankumar | Tengu, not consistent, it is tripleo-ci-testing | 07:09 |
Tengu | yes. lemme test that one. | 07:09 |
chandankumar | new promotion pattern | 07:09 |
Tengu | as said - I was already running against consistent, trying to find a way out :) | 07:09 |
chandankumar | current -> consistent -> componet testing -> promoted component -> tocitesting -> current tripleo | 07:10 |
Tengu | yep, with the schema, it's easier :) | 07:10 |
* Tengu bookmarks | 07:11 | |
*** udesale has quit IRC | 07:12 | |
*** udesale has joined #tripleo | 07:12 | |
*** shyamb has quit IRC | 07:14 | |
*** dsneddon has joined #tripleo | 07:17 | |
*** dsneddon has quit IRC | 07:22 | |
openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-quickstart-extras master: DNM: clean nodes on OVB https://review.opendev.org/709816 | 07:23 |
openstackgerrit | Merged openstack/tripleo-common stable/train: Bracket IPv6 address in ironic_inspector healthcheck https://review.opendev.org/709921 | 07:25 |
openstackgerrit | Chandan Kumar (raukadah) proposed openstack/tripleo-ansible master: Fixed the condition for gather_domains https://review.opendev.org/709959 | 07:30 |
Tengu | bah.... same issue. | 07:32 |
Tengu | that part is sooooo obscure, a real pain. | 07:32 |
chandankumar | Tengu, https://review.opendev.org/709959 | 07:34 |
chandankumar | Tengu, which one domain or os-net-config? | 07:34 |
Tengu | os-net-config | 07:34 |
Tengu | lemme provide the log once it fails for good. | 07:34 |
chandankumar | Tengu, may be slawq can help | 07:34 |
ykarel | shyamb yes, that issue was fixed recently upstream, do u have those patches applied | 07:36 |
Tengu | and I don't see anything relevant in the job config.... that's so weird | 07:36 |
ykarel | shyamb and if u have used buildah manually, u can pass --format docker while building images, https://review.opendev.org/#/c/703846/ is the upstream patch | 07:37 |
ykarel | Tengu, how u doing standalone deployment ? | 07:39 |
ykarel | in a vm in rdo cloud? | 07:39 |
ykarel | what's ur standalone_param file | 07:40 |
Tengu | ykarel: on a VM on my own computer, VM managed by libvirt (and ansible). | 07:40 |
ykarel | Tengu, okk, and what image u used? | 07:40 |
Tengu | ykarel: wait, re-launching, the file will be generated shortly | 07:40 |
Tengu | ykarel: official cloud.centos.org centos-8 image (not stream) | 07:40 |
Tengu | with 2 network interfaces | 07:41 |
ykarel | ohhk i think i used the same | 07:41 |
ykarel | but i did with 1 interface | 07:41 |
Tengu | and I nmcli unmanage eth1 | 07:41 |
Tengu | and config points to eth1 for neutron public interface | 07:41 |
Tengu | (standalone_param still not generated, should be shortly) | 07:41 |
ykarel | in my case even with 1 interface, there was extra eth1 file on system, i used to remove that | 07:42 |
*** slaweq_ has joined #tripleo | 07:42 | |
Tengu | yeah so I have 2 networks - the standard one (default) by libvirt, with DHCP, and a "ctlplane" one, without any DHCP. | 07:43 |
Tengu | this setup works just fine with centos-7 deploy. | 07:43 |
Tengu | it has worked for the last 2 years..... | 07:43 |
Tengu | so there's something weird with the centos-8 itself at some point. | 07:43 |
Tengu | I've deployed master on centos-7 a fair amount of time ;). | 07:43 |
ykarel | Tengu, i had ens3 named file, i did sudo rm /etc/sysconfig/network-scripts/ifcfg-ens3 | 07:44 |
Tengu | ykarel: in my case, it's eth0, eth1 | 07:44 |
Tengu | ykarel: http://paste.openstack.org/show/790009/ the template I use | 07:45 |
Tengu | "ip" is set to 192.168.24.1 | 07:45 |
*** slaweq_ is now known as slaweq | 07:45 | |
ykarel | Tengu, ack file looks good | 07:46 |
ykarel | wrt centos7 and centos8 there are changes related to network management | 07:46 |
ykarel | i don't have details though | 07:46 |
ykarel | btw what error u seeing with os-net-config | 07:46 |
Tengu | wait - my deploy is fetching the containers :) | 07:47 |
ykarel | ok :) | 07:47 |
Tengu | ok, deploy started, rendering j2 | 07:47 |
*** avivgta has quit IRC | 07:48 | |
Tengu | creating stacks... | 07:48 |
Tengu | hopefully I'll get the wanted debug, last run didn't output the actual error -.- | 07:48 |
*** dsneddon has joined #tripleo | 07:51 | |
*** dciabrin has joined #tripleo | 07:54 | |
Tengu | ykarel: so in journalctl, I see Feb 26 07:52:06 undercloud.localdomain /etc/sysconfig/network-scripts/ifup-eth[11225]: Device br-ctlplane does not seem to be present, delaying initialization. | 07:54 |
Tengu | (script still on jold) | 07:54 |
Tengu | *hold | 07:54 |
openstackgerrit | yatin proposed openstack/tripleo-heat-templates master: [DNM] Test build-test-package in centos7/rhel8 https://review.opendev.org/709964 | 07:55 |
*** dsneddon has quit IRC | 07:56 | |
Tengu | hmmm. interesting. I still see networkmanager trying to do things with eth1 | 07:56 |
Tengu | although it should be unmanaged.... | 07:56 |
Tengu | wtf | 07:56 |
openstackgerrit | Sagi Shnaidman proposed openstack/python-tripleoclient master: DNM: test build pkg https://review.opendev.org/709971 | 07:57 |
openstackgerrit | Merged openstack/python-tripleoclient master: Local file based image uploader https://review.opendev.org/693960 | 07:57 |
ykarel | sshnaidm, duplicate :) | 07:57 |
sshnaidm | ykarel, where? | 07:58 |
ykarel | sshnaidm, https://review.opendev.org/709964 | 07:58 |
ykarel | [DNM] Test build-test-package in centos7/rhel8 | 07:58 |
Tengu | ykarel: http://paste.openstack.org/show/790010/ (ping slaweq - if you have some time, having a hard time deploying master on centos-8, NetworkConfig step fails) | 07:58 |
sshnaidm | ykarel, ok, more testing :) | 07:59 |
ykarel | sshnaidm, ack :) | 07:59 |
ykarel | Tengu, as a quick check can u try removing that eth1 file | 07:59 |
ykarel | i think i hit similar issue | 07:59 |
Tengu | ykarel: ok! re-running (thought the interface does exist for real) | 08:00 |
Tengu | *though | 08:00 |
ykarel | Tengu, for me too that didn't existed | 08:00 |
Tengu | the VM description has two interfaces. | 08:00 |
Tengu | ykarel: mine does | 08:00 |
ykarel | Tengu, ohkk | 08:01 |
Tengu | http://paste.openstack.org/show/790011/ | 08:01 |
Tengu | ok, and I have no udev rule for naming or whatsoever. | 08:01 |
ykarel | ack | 08:02 |
openstackgerrit | Athlan-Guyot sofer proposed openstack/tripleo-upgrade master: Add config-heat and config-resource options. https://review.opendev.org/709972 | 08:02 |
*** ykarel is now known as ykarel|lunch | 08:03 | |
*** jidar has quit IRC | 08:04 | |
*** tesseract has joined #tripleo | 08:06 | |
*** ansmith_ has joined #tripleo | 08:06 | |
*** ansmith has quit IRC | 08:07 | |
openstackgerrit | mathieu bultel proposed openstack/python-tripleoclient master: Move ansible hosts file as a constant https://review.opendev.org/709430 | 08:08 |
Tengu | meh. same issue, ykarel|lunch :( | 08:09 |
Tengu | still. Seeing Feb 26 08:05:31 undercloud.localdomain NetworkManager[1476]: <info> [1582704331.9717] audit: op="connections-load" args="/etc/sysconfig/network-scripts/ifcfg-eth1" pid=12860 uid=0 result="success" | 08:09 |
Tengu | there I think the interface isn't unmanaged. | 08:09 |
Tengu | need to check that. | 08:09 |
*** jcapitao has joined #tripleo | 08:11 | |
Tengu | oh. wait. shouldn't we stop NetworkManager service alltogether? | 08:11 |
*** jmasud has quit IRC | 08:13 | |
openstackgerrit | Athlan-Guyot sofer proposed openstack/tripleo-upgrade stable/train: Add config-heat and config-resource options. https://review.opendev.org/709975 | 08:14 |
*** jmasud has joined #tripleo | 08:14 | |
*** flfuchs has joined #tripleo | 08:17 | |
Tengu | bleh. still not working. there's something wrong. | 08:17 |
Tengu | slaweq: heya! would you have some time for me? :) | 08:18 |
*** udesale has quit IRC | 08:18 | |
openstackgerrit | Merged openstack/python-tripleoclient master: Don't use the delete_deployment_plan workflow, call the action directly https://review.opendev.org/705678 | 08:18 |
slaweq | Tengu: hi, sure | 08:18 |
slaweq | what's up? | 08:18 |
Tengu | slaweq: great - I'm trying to deploy master on a centos-8 VM, for now "standalone", and I'm hitting issues with the NetworkConfig step (so, really early). It apparently can't set up br-ctlplane | 08:19 |
Tengu | slaweq: and I don't understand what I'm doing wrong here, especially since my deploy is working just fine on centos-7 :/. | 08:19 |
Tengu | slaweq: the os-net-config scripts shows this: http://paste.openstack.org/show/790010/ | 08:20 |
*** tosky has joined #tripleo | 08:20 | |
*** shyamb has joined #tripleo | 08:21 | |
Tengu | slaweq: my standalone_parameters.yaml shows http://paste.openstack.org/show/790012/ and the deploy command is http://paste.openstack.org/show/790013/ | 08:21 |
*** iurygregory has joined #tripleo | 08:21 | |
*** rcernin has joined #tripleo | 08:22 | |
Tengu | slaweq: so I'm a bit lost right now :(. if you have some idea, that would be nice | 08:23 |
slaweq | Tengu: I don't know but for me it looked as it failed on this: | 08:24 |
slaweq | running ifup on interface: eth1 | 08:24 |
slaweq | what do You have in /etc/sysconfig/network-scripts/ifcfg-eth1 ? | 08:24 |
Tengu | slaweq: it's generated by os-net-config - I see that there's BOOTPROTO=dhcp - this is the fallback, "safe config" when it can't apply the one we actually want with bridge and so on | 08:25 |
openstackgerrit | mathieu bultel proposed openstack/tripleo-validations master: Add FFU validation to check for existence of a backup file https://review.opendev.org/701179 | 08:25 |
Tengu | slaweq: thing is, I don't have DHCP on that interface (it's in a specific network). And I *never* had one - centos-7 was working like 2 days ago, before I started testing the centos-8 thing. | 08:26 |
Tengu | slaweq: and I deployed a fair amount of standalone (note, undercloud is also failing for the vers same reason) | 08:26 |
slaweq | Tengu: and who should create br-ctlplane then? | 08:26 |
Tengu | slaweq: br-ctlplane seems to be create by the os-net-config thing... | 08:27 |
Tengu | check line 22 of http://paste.openstack.org/show/790010/ | 08:27 |
slaweq | Tengu: and is it really created? | 08:27 |
Tengu | that's the initial error. | 08:27 |
Tengu | that's when os-net-config tries to start the bridge... and fails, but the absence of reason is a bit annoying. | 08:28 |
Tengu | so when that thing fails, it falls back on the "safe config" which enable DHCP on all interfaces. | 08:28 |
Tengu | (which fails here because no dhcp server on eth1 network) | 08:29 |
Tengu | but, as said: this is working without any issue on centos-7. So there's something different somewhere, and I can't find what it is. I've even disabled NetworkManager services in order to ensure it's not playing naughty with os-net-config. | 08:29 |
*** dsneddon has joined #tripleo | 08:30 | |
slaweq | Tengu: can You check what You have in /etc/sysconfig/network-scripts/ifcfg-br-ctlplane ? | 08:30 |
Tengu | that file is removed by the script....... | 08:30 |
Tengu | sooo easy to debug, right? :( | 08:30 |
openstackgerrit | Andreas Jaeger proposed openstack/tripleo-quickstart-extras master: Use current stackviz tarball https://review.opendev.org/709979 | 08:31 |
*** amoralej|off is now known as amoralej | 08:31 | |
Tengu | slaweq: so tripleo runs a script located in /var/lib/tripleo-config/scripts/run_os_net_config.sh - that one wraps things around os-net-config and is the one doing the fallback, cleanup and so on | 08:32 |
Tengu | slaweq: maybe you want an access to the node directly? Might be easier. | 08:32 |
slaweq | Tengu: if that is possible, then yes :) | 08:32 |
Tengu | slaweq: tmate in DM :) | 08:33 |
*** jpich has joined #tripleo | 08:34 | |
*** dsneddon has quit IRC | 08:34 | |
*** udesale has joined #tripleo | 08:39 | |
*** cylopez has joined #tripleo | 08:40 | |
*** guits has quit IRC | 08:41 | |
*** jpena|off is now known as jpena | 08:46 | |
*** hberaud has joined #tripleo | 08:48 | |
*** hberaud has quit IRC | 08:49 | |
*** hberaud has joined #tripleo | 08:49 | |
openstackgerrit | Rabi Mishra proposed openstack/tripleo-common master: WIP Modify roles to remove unused services https://review.opendev.org/709692 | 08:53 |
*** shyamb has quit IRC | 08:55 | |
*** tkajinam has quit IRC | 08:57 | |
*** dsneddon has joined #tripleo | 09:01 | |
*** dsneddon has quit IRC | 09:05 | |
*** lennyb has quit IRC | 09:06 | |
*** lennyb has joined #tripleo | 09:07 | |
*** ykarel|lunch is now known as ykarel | 09:08 | |
ykarel | Tengu, ack :( | 09:11 |
Tengu | ykarel: apparently we're missing a dependency on network-scripts-openvswitch | 09:13 |
Tengu | ykarel: it's installed on the upstream CI job, but probably manually | 09:13 |
openstackgerrit | Rabi Mishra proposed openstack/tripleo-common master: Move parameter actions functionality to utils - Part 1/2 https://review.opendev.org/709546 | 09:13 |
*** hberaud has quit IRC | 09:13 | |
Tengu | nothing depends on that one, at least with the tripleo-ci-testing packages | 09:13 |
ykarel | Tengu, mmm isn't that dep for openvsiwthc | 09:13 |
Tengu | at least it's not installed. | 09:13 |
Tengu | slaweq: w00t! | 09:14 |
*** lucasagomes has joined #tripleo | 09:15 | |
Tengu | slaweq: soooo yeah. installing that package helps a lot - and killing the dhclient as well :). guess I can go forward | 09:15 |
Tengu | ykarel: lemme create an LP so that we can have a trace. | 09:17 |
*** hberaud has joined #tripleo | 09:17 | |
ykarel | Tengu, ack | 09:18 |
*** xek_ has joined #tripleo | 09:19 | |
ykarel | Tengu, can u check what version of openvswitch is installed on your system | 09:20 |
ykarel | network-scripts-openvswitch is dep for rdo-openvswitch | 09:21 |
Tengu | ykarel: funky. I don't have that rdo-openvswitch | 09:21 |
ykarel | Tengu, what u have? | 09:21 |
ykarel | rpm -qa|grep openvswitch | 09:21 |
ykarel | and from what repo it got installed | 09:21 |
Tengu | ykarel: openvswitch-2.12.0-1.el8.x86_64 + python3-openvswitch-2.12.0-1.el8.x86_64 | 09:21 |
Tengu | and, manually pulled, network-scripts-openvswitch-2.12.0-1.el8.x86_64 | 09:22 |
ykarel | Tengu, and yum info openvswitch | 09:22 |
ykarel | from which repo it was pulled | 09:22 |
Tengu | coming | 09:22 |
Tengu | yum is.... slow. | 09:22 |
Tengu | From repo : delorean-master-testing | 09:22 |
Tengu | ykarel: https://bugs.launchpad.net/tripleo/+bug/1864821 | 09:24 |
openstack | Launchpad bug 1864821 in tripleo "[CentOS-8] nothing installs network-scripts-openvswitch package" [High,Triaged] | 09:24 |
Tengu | you have some more info there, like repolist | 09:24 |
ykarel | Tengu, okk | 09:24 |
ykarel | in ci it possibly didn't hit becase there we specify rhosp-openvswitch | 09:24 |
Tengu | hehe | 09:24 |
Tengu | that will probably help yeah..... | 09:25 |
*** psachin has joined #tripleo | 09:26 | |
Tengu | ykarel: do you want me to inspect other things? I'm going to crash the VM in order to get a fresh env. | 09:26 |
ykarel | Tengu, go for it | 09:26 |
ykarel | i think rdo-openvswitch is the reason not seen in CI | 09:27 |
Tengu | probably yeah. My guess is, we should depends on "something" more in order to ensure that package is present. | 09:27 |
Tengu | else.... well, we're doomed :) | 09:27 |
Tengu | so my lab will manually pull that network-script-openvswitch package. | 09:27 |
Tengu | not a big deal for me, once I know the issue :) | 09:27 |
ykarel | Tengu, for CI i was referring https://opendev.org/zuul/zuul-jobs/src/branch/master/roles/multi-node-bridge/vars/CentOS.yaml#L4 | 09:28 |
ykarel | and rdo-openvswitch https://github.com/rdo-common/rdo-openvswitch/blob/ussuri-c8-rdo/rdo-openvswitch.spec#L26 | 09:29 |
ykarel | which provides rhosp-openvswitch | 09:29 |
Tengu | heh | 09:31 |
Tengu | so should we make python3-tripleoclient depend on something like that rdo-openvswitch or something? | 09:31 |
Tengu | just to ensure ppl don't hit the same issue as I | 09:31 |
ykarel | hmm that should work i think | 09:32 |
*** tesseract has quit IRC | 09:35 | |
*** tesseract has joined #tripleo | 09:36 | |
*** dsneddon has joined #tripleo | 09:37 | |
Tengu | ykarel: what does that rhosp-openvswitch install? currently, python-tripleoclient depends on openvswitch itself. Maybe we should replace that one by "rdo-openvswitch", or directly "rhosp-openvswitch" ? | 09:37 |
Tengu | oh. oho. ok. so this seems to depend on the OS version. | 09:38 |
Tengu | we probably can do something more.... clean, as it's done for the pyver global. | 09:39 |
Tengu | lemme try to tweak something. | 09:39 |
*** avivgt has joined #tripleo | 09:40 | |
*** dsneddon has quit IRC | 09:42 | |
*** jidar has joined #tripleo | 09:42 | |
Tengu | ykarel: https://review.rdoproject.org/r/25371 something like that? | 09:44 |
ykarel | Tengu, looking | 09:45 |
*** avivgt has quit IRC | 09:46 | |
chandankumar | ykarel, https://logserver.rdoproject.org/29/25329/14/check/periodic-tripleo-ci-centos-8-scenario002-standalone-master/a7e33c8/logs/undercloud/home/zuul/standalone_deploy.log.txt.gz | 09:47 |
chandankumar | ykarel, failed at same place but with different error | 09:47 |
ykarel | Tengu, we need to handle rhosp case | 09:47 |
ykarel | as there we don't have rdo-openvswitch | 09:47 |
chandankumar | ykarel, let's downgrade ansible to 2.8 then ? | 09:48 |
Tengu | oh. so we should depends-on rhosp-openvswitch instead? | 09:48 |
ykarel | Tengu, when rdo use rdo-openvswitch, else openvswitch | 09:49 |
ykarel | Tengu, use %if 0%{?rhosp} == 0 | 09:49 |
Tengu | ykarel: downstream openvswitch has the right dependency? | 09:49 |
ykarel | Tengu, i think yes but let me cross check | 09:50 |
Tengu | ykarel: so I keep the if rhel > 7, add a second condition bellow for rhosp, if true then rhosp-openvswitch, else rdo-openvswitch... and if not rhel>7, openvswitch - that should be OK? | 09:51 |
*** alexmcleod has joined #tripleo | 09:51 | |
*** flfuchs has quit IRC | 09:53 | |
ykarel | Tengu, %if 0%{?rhosp} == 0 && 0%{?rhel} > 7 rdo-openvswitch else openvswitch | 09:54 |
Tengu | oh. ok. no need to inject rhosp-openvswitch. OK. | 09:54 |
ykarel | this way we will not change for downstream, so safe i think | 09:55 |
Tengu | fine for me! | 09:55 |
openstackgerrit | Gael Chamoulaud proposed openstack/python-tripleoclient master: TripleO Validations Logging CLI Introduction https://review.opendev.org/695397 | 09:55 |
openstackgerrit | Gael Chamoulaud proposed openstack/python-tripleoclient master: Get validation groups info from groups.yaml file https://review.opendev.org/704521 | 09:55 |
Tengu | ykarel: review updated | 09:55 |
ykarel | Tengu, ack /me checks | 09:55 |
Tengu | ykarel: btw, suddenly I got the ens3 interface, pushed by dracut... what the hell -.- | 09:56 |
ykarel | Tengu, missed % | 09:57 |
ykarel | in second global | 09:57 |
Tengu | oh... meh | 09:57 |
*** avivgt has joined #tripleo | 09:58 | |
openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-ansible master: DNM: debug keystone https://review.opendev.org/709996 | 09:59 |
ykarel | Tengu, and wrt of rhosp-openvswitch, i checked it depends on network-script-openvswitch | 10:02 |
openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-ansible master: DNM: debug keystone https://review.opendev.org/709996 | 10:03 |
ykarel | chandankumar, for scenario002 i think should try to get it fixed, for 001/004 to test ansible downgrade can be tried i think | 10:04 |
openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates master: Use ipc:host for cinder-backup https://review.opendev.org/709999 | 10:05 |
openstackgerrit | Chandan Kumar (raukadah) proposed openstack/tripleo-quickstart master: Add release files for master CentOS 8 https://review.opendev.org/709560 | 10:05 |
*** pkopec has joined #tripleo | 10:07 | |
*** dsneddon has joined #tripleo | 10:15 | |
openstackgerrit | Francesco Pantano proposed openstack/tripleo-ansible master: [WIP] Add a new set of tasks to build the openstack pool list https://review.opendev.org/709083 | 10:16 |
*** hjensas has quit IRC | 10:18 | |
*** dsneddon has quit IRC | 10:20 | |
*** hjensas has joined #tripleo | 10:21 | |
*** alexmcleod has quit IRC | 10:22 | |
*** alexmcleod has joined #tripleo | 10:23 | |
Tengu | meh... msg: 'Failed to download packages: Cannot download python3-gnocchiclient-7.0.4-0.20200221072248.64814b9.el8.noarch.rpm: All mirrors were tried' I thought gnocchi was dead long ago... ? | 10:27 |
*** skramaja has quit IRC | 10:30 | |
openstackgerrit | Sagi Shnaidman proposed openstack/ansible-role-collect-logs master: Add disk usage statistics https://review.opendev.org/710006 | 10:37 |
*** avivgt has quit IRC | 10:37 | |
sshnaidm | marios|ruck, chandankumar take a look pls ^^ | 10:37 |
marios|ruck | sshnaidm: ack | 10:39 |
openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-quickstart-extras master: DNM: test logs https://review.opendev.org/710007 | 10:43 |
openstackgerrit | Harald Jensås proposed openstack/python-tripleoclient master: Fix unit test_get_image timezone issue https://review.opendev.org/710008 | 10:46 |
openstackgerrit | Harald Jensås proposed openstack/python-tripleoclient master: Add option to control ironic network interfaces https://review.opendev.org/700103 | 10:47 |
*** avivgt has joined #tripleo | 10:51 | |
*** dsneddon has joined #tripleo | 10:51 | |
*** dsneddon has quit IRC | 10:56 | |
*** ykarel is now known as ykarel|afk | 10:59 | |
*** suuuper has joined #tripleo | 11:00 | |
openstackgerrit | Chandan Kumar (raukadah) proposed openstack/tripleo-quickstart master: Add release files for master CentOS 8 https://review.opendev.org/709560 | 11:05 |
openstackgerrit | Chandan Kumar (raukadah) proposed openstack/tripleo-quickstart-extras master: update build-test-packages for centos-8 https://review.opendev.org/709837 | 11:07 |
*** tesseract has quit IRC | 11:08 | |
*** tesseract has joined #tripleo | 11:11 | |
openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-quickstart-extras master: Fix prepare-slave playbook for centos8 OVB https://review.opendev.org/709866 | 11:15 |
*** dsneddon has joined #tripleo | 11:23 | |
*** shyamb has joined #tripleo | 11:27 | |
shyamb | Hi | 11:27 |
*** dsneddon has quit IRC | 11:28 | |
openstackgerrit | Chandan Kumar (raukadah) proposed openstack/tripleo-ci master: Improve build images role for CentOS8 https://review.opendev.org/708599 | 11:30 |
openstackgerrit | Chandan Kumar (raukadah) proposed openstack/tripleo-ci master: Improve build images role for CentOS8 https://review.opendev.org/708599 | 11:30 |
*** jaosorior has joined #tripleo | 11:32 | |
openstackgerrit | Chandan Kumar (raukadah) proposed openstack/tripleo-ci master: Improve build images role for CentOS8 https://review.opendev.org/708599 | 11:33 |
openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-quickstart-extras master: Fix prepare-slave playbook for centos8 OVB https://review.opendev.org/709866 | 11:38 |
*** shyamb has quit IRC | 11:45 | |
*** ykarel|afk is now known as ykarel | 11:52 | |
*** dsneddon has joined #tripleo | 12:01 | |
*** dsneddon has quit IRC | 12:06 | |
*** shyamb has joined #tripleo | 12:08 | |
*** sshnaidm is now known as sshnaidm|bbl | 12:09 | |
*** jcapitao is now known as jcapitao_lunch | 12:10 | |
*** jmasud has quit IRC | 12:12 | |
*** leanderthal has joined #tripleo | 12:12 | |
*** ratailor has quit IRC | 12:14 | |
*** jmasud has joined #tripleo | 12:14 | |
*** bfournie has quit IRC | 12:23 | |
*** psachin has quit IRC | 12:25 | |
*** suuuper has quit IRC | 12:33 | |
*** udesale_ has joined #tripleo | 12:34 | |
*** jpena is now known as jpena|lunch | 12:34 | |
*** dsneddon has joined #tripleo | 12:35 | |
*** udesale has quit IRC | 12:36 | |
openstackgerrit | Merged openstack/ansible-role-collect-logs master: Dynamically generate a list of files for rsync https://review.opendev.org/703765 | 12:37 |
*** Goneri has joined #tripleo | 12:38 | |
*** dsneddon has quit IRC | 12:40 | |
*** beagles_rpm_mode is now known as beagles | 12:43 | |
openstackgerrit | Chandan Kumar (raukadah) proposed openstack/ansible-role-collect-logs master: Add the DLRN build project.ini to the log files https://review.opendev.org/709868 | 12:46 |
*** ansmith_ has quit IRC | 12:52 | |
dciabrin | bnemec howdy o/ would it be possible to recheck https://review.opendev.org/#/c/709588/ ? I don't have +2 on that project | 12:52 |
*** mcornea has joined #tripleo | 12:53 | |
*** morazi has joined #tripleo | 12:56 | |
*** rlandy has joined #tripleo | 13:00 | |
*** marios|ruck is now known as marios|ruck|call | 13:01 | |
*** rh-jelabarre has joined #tripleo | 13:04 | |
*** psachin has joined #tripleo | 13:06 | |
*** dsneddon has joined #tripleo | 13:08 | |
*** dsneddon has quit IRC | 13:13 | |
*** amoralej is now known as amoralej|lunch | 13:14 | |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-ansible master: filters: make get_domain_id more robust https://review.opendev.org/709727 | 13:14 |
*** bfournie has joined #tripleo | 13:15 | |
*** skramaja has joined #tripleo | 13:16 | |
*** jcapitao_lunch is now known as jcapitao | 13:17 | |
*** jpich has quit IRC | 13:20 | |
*** jpich has joined #tripleo | 13:20 | |
EmilienM | mwhahaha: have you seen that one in CI? Error: error pulling image "192.168.24.1:8787/tripleomaster/centos-binary-ovn-controller:da4c8b0acc02c322be90322cef0517f785b14b27_b5a8f808-updated-20200225190224": unable to pull 192.168.24.1:8787/tripleomaster/centos-binary-ovn-controller:da4c8b0acc02c322be90322cef0517f785b14b27_b5a8f808-updated-20200225190224: unable to pull image: Error writing blob: error storing | 13:25 |
EmilienM | blob to file "/var/tmp/storage708985759/6": read tcp 192.168.24.3:55340->192.168.24.1:8787: read: connection reset by peer | 13:25 |
*** jpena|lunch is now known as jpena | 13:26 | |
*** suuuper has joined #tripleo | 13:27 | |
EmilienM | https://bugs.launchpad.net/tripleo/+bug/1864844 | 13:27 |
openstack | Launchpad bug 1864844 in tripleo "image-serve registry: error writing blob / error storing blob to file" [High,Triaged] | 13:27 |
*** Goneri has quit IRC | 13:28 | |
*** xaban06 has joined #tripleo | 13:31 | |
xaban06 | Hi, "openstack overcloud update converge" will probably fail with a time out. It is currently at Step 5, but idle for 1.5+ hour. How can I start troubleshooting, where should I look? | 13:32 |
*** ykarel is now known as ykarel|afk | 13:36 | |
*** ysandeep is now known as ysandeep|away | 13:38 | |
openstackgerrit | Ryan McCabe proposed openstack/tripleo-common master: [WIP] Enable configuration for ComputeCollectd https://review.opendev.org/710035 | 13:39 |
*** ansmith has joined #tripleo | 13:40 | |
*** Goneri has joined #tripleo | 13:42 | |
*** dsneddon has joined #tripleo | 13:46 | |
*** shyamb has quit IRC | 13:51 | |
*** dsneddon has quit IRC | 13:52 | |
*** marios|ruck|call is now known as marios|ruck | 13:52 | |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-quickstart-extras master: Use tripleo-operator-ansible for standalone https://review.opendev.org/705775 | 13:56 |
*** dsavineau has joined #tripleo | 13:56 | |
*** amoralej|lunch is now known as amoralej | 13:59 | |
cloudnull | mornings | 14:00 |
*** ykarel|afk is now known as ykarel | 14:02 | |
*** slaweq has quit IRC | 14:05 | |
*** dasp has quit IRC | 14:08 | |
*** slaweq has joined #tripleo | 14:09 | |
openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart master: Add release files for master CentOS 8 https://review.opendev.org/709560 | 14:14 |
*** leanderthal has quit IRC | 14:16 | |
*** leanderthal has joined #tripleo | 14:17 | |
*** rainleander has joined #tripleo | 14:20 | |
*** dsneddon has joined #tripleo | 14:20 | |
*** leanderthal has quit IRC | 14:20 | |
*** sri_ has quit IRC | 14:25 | |
openstackgerrit | Kevin Carter (cloudnull) proposed openstack/tripleo-ansible master: Add raid configuration playbook and options https://review.opendev.org/709831 | 14:25 |
*** dsneddon has quit IRC | 14:25 | |
openstackgerrit | Juan Badia Payno proposed openstack/tripleo-ansible master: Fix error with command ansible module and pipes https://review.opendev.org/710046 | 14:25 |
*** abdysn has joined #tripleo | 14:28 | |
*** abdysn has quit IRC | 14:28 | |
*** xaban06 has quit IRC | 14:28 | |
*** jdandrea has joined #tripleo | 14:29 | |
openstackgerrit | Kevin Carter (cloudnull) proposed openstack/tripleo-ansible master: Implement concurrency in baremetal cleaning https://review.opendev.org/709783 | 14:30 |
openstackgerrit | Kevin Carter (cloudnull) proposed openstack/tripleo-ansible master: Add raid configuration playbook and options https://review.opendev.org/709831 | 14:30 |
openstackgerrit | Kevin Carter (cloudnull) proposed openstack/tripleo-ansible master: Create a bios reset playbook https://review.opendev.org/709860 | 14:30 |
openstackgerrit | Kevin Carter (cloudnull) proposed openstack/tripleo-ansible master: Create a bios apply playbook https://review.opendev.org/709862 | 14:30 |
*** hberaud has quit IRC | 14:34 | |
openstackgerrit | Brent Eagles proposed openstack/tripleo-quickstart-extras master: Allow full path to be specified for amphora destination https://review.opendev.org/692858 | 14:34 |
*** hberaud has joined #tripleo | 14:34 | |
openstackgerrit | Athlan-Guyot sofer proposed openstack/tripleo-upgrade stable/train: Add config-heat and config-resource options. https://review.opendev.org/709975 | 14:37 |
openstackgerrit | Ronelle Landy proposed openstack/tripleo-ci master: Add base centos 8 jobs for parenting https://review.opendev.org/709950 | 14:38 |
openstackgerrit | Athlan-Guyot sofer proposed openstack/tripleo-upgrade master: Add config-heat and config-resource options. https://review.opendev.org/709972 | 14:38 |
openstackgerrit | Athlan-Guyot sofer proposed openstack/tripleo-upgrade master: Add config-heat and config-resource options. https://review.opendev.org/709972 | 14:40 |
openstackgerrit | Ronelle Landy proposed openstack/tripleo-ci master: Add base centos 8 jobs for parenting https://review.opendev.org/709950 | 14:42 |
openstackgerrit | Harald Jensås proposed openstack/tripleo-common master: Support baremetal 'extra' property for node and port https://review.opendev.org/704475 | 14:47 |
*** iurygregory has quit IRC | 14:49 | |
*** rleander has joined #tripleo | 14:50 | |
*** rainleander has quit IRC | 14:52 | |
openstackgerrit | Chandan Kumar (raukadah) proposed openstack/tripleo-quickstart master: [CentOS-8] Install ansible 2.8 https://review.opendev.org/710049 | 14:53 |
*** dsneddon has joined #tripleo | 14:55 | |
*** sshnaidm|bbl is now known as sshnaidm | 14:56 | |
openstackgerrit | Athlan-Guyot sofer proposed openstack/tripleo-upgrade master: Allow to switch from parallel to serial update. https://review.opendev.org/702931 | 14:57 |
*** jbadiapa has quit IRC | 14:58 | |
openstackgerrit | Ronelle Landy proposed openstack/tripleo-ci master: Add base centos 8 jobs for parenting https://review.opendev.org/709950 | 15:00 |
*** dsneddon has quit IRC | 15:00 | |
fultonj | EmilienM: is disable_paunch by default getting backported to train? | 15:01 |
*** TrevorV has joined #tripleo | 15:01 | |
EmilienM | fultonj: no | 15:01 |
EmilienM | fultonj: at least not before it has proven to be really stable and performant | 15:01 |
fultonj | EmilienM: http://paste.openstack.org/show/790031/ | 15:02 |
fultonj | i'm hitting issues like ^ and i basically re-run and don't hit them again | 15:03 |
openstackgerrit | Rabi Mishra proposed openstack/tripleo-common master: Modify roles to remove unused services https://review.opendev.org/642032 | 15:03 |
EmilienM | fultonj: if you want more logs, you need to enable ConfigDebug | 15:03 |
fultonj | https://review.opendev.org/#/c/709573/ | 15:03 |
EmilienM | it's disabled by default because it leaks sensitive informations like passwords and such | 15:03 |
fultonj | like that ^ | 15:03 |
fultonj | EmilienM: ok | 15:03 |
EmilienM | fultonj: yeah I need to figure that out when mwhahaha is up | 15:03 |
fultonj | EmilienM: are you seeing those kinds of intermittent issues too? | 15:04 |
EmilienM | fultonj: yes, it happens. It can be lot of things | 15:04 |
EmilienM | fultonj: container engine, networking, etc | 15:04 |
* fultonj using it on overcloud and undercloud | 15:04 | |
fultonj | worked good on undercloud | 15:04 |
fultonj | basically works for me aside from intermitten issues | 15:04 |
EmilienM | fultonj: ConfigDebug: True will give you all infos | 15:04 |
fultonj | i'll get logs and open bug if i hit it more | 15:04 |
fultonj | thx | 15:05 |
*** psachin has quit IRC | 15:05 | |
*** ykarel is now known as ykarel|afk | 15:06 | |
*** saneax has quit IRC | 15:07 | |
openstackgerrit | Ronelle Landy proposed openstack/tripleo-ci master: Add base centos 8 jobs for parenting https://review.opendev.org/709950 | 15:09 |
*** suuuper has quit IRC | 15:10 | |
openstackgerrit | Rabi Mishra proposed openstack/tripleo-common master: Move parameter actions functionality to utils - Part 1/2 https://review.opendev.org/709546 | 15:10 |
openstackgerrit | Rabi Mishra proposed openstack/tripleo-common master: Move generate_fencing_parameters functionality to utils https://review.opendev.org/710055 | 15:10 |
*** TrevorV has quit IRC | 15:11 | |
*** TrevorV has joined #tripleo | 15:11 | |
openstackgerrit | yatin proposed openstack/ansible-role-collect-logs master: Add the DLRN build projects.ini to the log files https://review.opendev.org/709868 | 15:14 |
openstackgerrit | Emma Foley proposed openstack/tripleo-heat-templates master: [WIP] Add STF environment https://review.opendev.org/694623 | 15:15 |
*** skramaja has quit IRC | 15:18 | |
*** rleander has quit IRC | 15:18 | |
*** rleander has joined #tripleo | 15:20 | |
*** mugsie has quit IRC | 15:20 | |
cloudnull | anyone around mind giving https://review.opendev.org/#/c/708942/ a nudge ? | 15:22 |
*** mugsie has joined #tripleo | 15:22 | |
chandankumar | Hey around? want to take a look at c8 undercloud install timeout https://review.rdoproject.org/r/#/c/25366/ and logs here https://logserver.rdoproject.org/66/25366/1/check/periodic-tripleo-ci-centos-8-singlenode-featureset027-master/6260ff1/logs/undercloud/home/zuul/undercloud_install.log.txt.gz feel free to update the wip patches, if have something | 15:25 |
*** dsneddon has joined #tripleo | 15:26 | |
*** cylopez has quit IRC | 15:28 | |
*** dsneddon has quit IRC | 15:31 | |
*** marios|ruck is now known as marios|ruck|call | 15:31 | |
*** iurygregory has joined #tripleo | 15:34 | |
openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-quickstart-extras master: Fix prepare-slave playbook for centos8 OVB https://review.opendev.org/709866 | 15:37 |
*** suuuper has joined #tripleo | 15:38 | |
*** dsneddon has joined #tripleo | 15:45 | |
*** Trevor_V has joined #tripleo | 15:46 | |
*** psachin has joined #tripleo | 15:47 | |
*** TrevorV has quit IRC | 15:49 | |
*** dasp has joined #tripleo | 15:52 | |
*** marios|ruck|call is now known as marios|ruck | 15:52 | |
*** psachin has quit IRC | 15:57 | |
openstackgerrit | Lance Bragstad proposed openstack/tripleo-validations master: WIP: Only validate token_flush for non-persistent tokens https://review.opendev.org/710065 | 15:57 |
*** dsavineau has left #tripleo | 15:59 | |
*** TrevorV has joined #tripleo | 15:59 | |
*** Trevor_V has quit IRC | 16:03 | |
*** iurygregory has quit IRC | 16:05 | |
mwhahaha | chandankumar: usually that hang is an OOM | 16:10 |
mwhahaha | chandankumar: we're missing teh container image prepare logs so I don't know why that hung , https://logserver.rdoproject.org/66/25366/1/check/periodic-tripleo-ci-centos-8-singlenode-featureset027-master/6260ff1/logs/undercloud/var/log/ | 16:12 |
*** avivgt has quit IRC | 16:14 | |
*** lmiccini has quit IRC | 16:21 | |
*** udesale_ has quit IRC | 16:24 | |
chandankumar | mwhahaha, thanks, doing a recheck, | 16:26 |
chandankumar | it was the first run | 16:27 |
openstackgerrit | Gael Chamoulaud proposed openstack/python-tripleoclient master: TripleO Validations Logging CLI Introduction https://review.opendev.org/695397 | 16:27 |
openstackgerrit | Gael Chamoulaud proposed openstack/python-tripleoclient master: Get validation groups info from groups.yaml file https://review.opendev.org/704521 | 16:27 |
openstackgerrit | Pablo Caruana proposed openstack/tripleo-heat-templates stable/train: Use ipc:host for cinder-backup https://review.opendev.org/710076 | 16:30 |
*** pcaruana has joined #tripleo | 16:31 | |
*** psachin has joined #tripleo | 16:37 | |
*** bfournie has quit IRC | 16:42 | |
sshnaidm | cloudnull, did you see ovb error in https://review.opendev.org/#/c/709816/ ? 'Node' object has no attribute '__getitem__' - it happens when registering nodes | 16:45 |
sshnaidm | cloudnull, wonder how it's related to tested code | 16:45 |
cloudnull | i had not . | 16:46 |
* cloudnull looking | 16:46 | |
cloudnull | which ovb job ? | 16:46 |
*** xek__ has joined #tripleo | 16:48 | |
sshnaidm | cloudnull, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001 for example | 16:48 |
* cloudnull looking | 16:49 | |
cloudnull | which log file did you see that in ? | 16:49 |
*** rleander has quit IRC | 16:49 | |
sshnaidm | cloudnull, https://logserver.rdoproject.org/16/709816/2/openstack-check/tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001/5b80a1a/logs/undercloud/home/zuul/overcloud_prep_images.log.txt.gz | 16:49 |
sshnaidm | cloudnull, it fails on openstack overcloud node import instackenv.json | 16:50 |
*** tesseract has quit IRC | 16:50 | |
cloudnull | hum. | 16:50 |
cloudnull | i dont think that has any relation to the code being tested. | 16:50 |
sshnaidm | print('Successfully registered node UUID %s' % node['uuid'] - actually it fails on report only | 16:50 |
cloudnull | but I think I know where that issue is | 16:50 |
*** dsneddon has quit IRC | 16:50 | |
*** xek_ has quit IRC | 16:51 | |
openstackgerrit | Marios Andreou proposed openstack/tripleo-heat-templates master: Add NeutronSecurityGroupQuota to allow setting quota_security_group https://review.opendev.org/710083 | 16:53 |
marios|ruck | ykarel|afk: chandankumar: ^^ but will continue tomorrow | 16:53 |
*** pcaruana has quit IRC | 16:53 | |
ykarel|afk | marios|ruck, nice, | 16:55 |
ykarel|afk | for testing can u try bumping from 10 | 16:55 |
openstackgerrit | Marios Andreou proposed openstack/tripleo-heat-templates master: Add NeutronSecurityGroupQuota to allow setting quota_security_group https://review.opendev.org/710083 | 16:55 |
marios|ruck | ykarel|afk: yeah we need to bump it for the job will poke at it some more tomorrow | 16:55 |
ykarel|afk | marios|ruck, ack | 16:56 |
*** jaosorior has quit IRC | 16:57 | |
openstackgerrit | Kevin Carter (cloudnull) proposed openstack/python-tripleoclient master: Remove mistral when running the register_or_update workflow https://review.opendev.org/709583 | 16:59 |
cloudnull | sshnaidm ^ | 16:59 |
*** ykarel|afk is now known as ykarel|away | 17:00 | |
*** marios|ruck is now known as marios|ruck|call | 17:01 | |
*** lucasagomes has quit IRC | 17:01 | |
openstackgerrit | Kevin Carter (cloudnull) proposed openstack/python-tripleoclient master: Remove mistral from the undeploy_roles workflow https://review.opendev.org/709614 | 17:02 |
openstackgerrit | Kevin Carter (cloudnull) proposed openstack/python-tripleoclient master: Remove mistral from the configure workflow https://review.opendev.org/709616 | 17:02 |
openstackgerrit | Kevin Carter (cloudnull) proposed openstack/python-tripleoclient master: Remove mistral from the configure_manageable_nodes workflow https://review.opendev.org/709633 | 17:02 |
openstackgerrit | Kevin Carter (cloudnull) proposed openstack/python-tripleoclient master: Remove the mistral from the clean_.*_nodes workflow https://review.opendev.org/709755 | 17:03 |
openstackgerrit | Kevin Carter (cloudnull) proposed openstack/python-tripleoclient master: Remove the mistral from the create_raid_configuration workflow https://review.opendev.org/709858 | 17:03 |
openstackgerrit | Kevin Carter (cloudnull) proposed openstack/python-tripleoclient master: Remove mistral from the bios_configuration workflows https://review.opendev.org/709861 | 17:03 |
cloudnull | sshnaidm rebased all the dependent reviews and reran the rdo check on that DNM change | 17:05 |
sshnaidm | cloudnull, cool, let's see how it goes | 17:05 |
*** pcaruana has joined #tripleo | 17:06 | |
*** dsneddon has joined #tripleo | 17:09 | |
openstackgerrit | Ronelle Landy proposed openstack/tripleo-ci master: Add base centos 8 jobs for parenting https://review.opendev.org/709950 | 17:10 |
*** psachin has quit IRC | 17:12 | |
*** marios|ruck|call is now known as marios|out | 17:15 | |
*** marios|out is now known as marios|ruck | 17:16 | |
*** jcoufal has joined #tripleo | 17:18 | |
*** marios|ruck is now known as marios|out | 17:18 | |
openstackgerrit | wes hayutin proposed openstack/tripleo-ci master: DNM yet, make centos-8 build containers, voting, gating https://review.opendev.org/710091 | 17:25 |
openstackgerrit | Merged openstack/tripleo-docs master: Document override tripleo-ci-testing with dlrn_hash_tag testproject https://review.opendev.org/708914 | 17:31 |
*** evrardjp has quit IRC | 17:34 | |
*** evrardjp has joined #tripleo | 17:35 | |
*** gfidente is now known as gfidente|afk | 17:40 | |
*** jpena is now known as jpena|off | 17:40 | |
*** holser has joined #tripleo | 17:41 | |
openstackgerrit | wes hayutin proposed openstack/tripleo-repos master: DNM yet, add current w/ include_pkgs to tripleo-ci-testing tag https://review.opendev.org/710098 | 17:44 |
openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart master: WIP: add current with include_pkgs to master promotion jobs https://review.opendev.org/710099 | 17:45 |
*** jpich has quit IRC | 17:48 | |
openstackgerrit | Kevin Carter (cloudnull) proposed openstack/python-tripleoclient master: Remove the mistral from the check_deprecated_parameters workflow https://review.opendev.org/709141 | 17:49 |
*** yprokule has quit IRC | 17:55 | |
*** marios|out has quit IRC | 17:59 | |
weshay|ruck | mwhahaha, scen1-3 centos-8 are passing.. scen04 got hit by.. a number of these errors | 18:02 |
weshay|ruck | 2020-02-26 16:02:16 | - '2020-02-26 16:00:55,548 ERROR: 44422 -- Error: Failed to evict container: "": Failed to find container "container-puppet-clustercheck" in state: no container with name or ID container-puppet-clustercheck found: no such container' | 18:02 |
mwhahaha | odd | 18:02 |
weshay|ruck | will run 04 again to see if that's consistent | 18:02 |
mwhahaha | is 004 using docker by chance? | 18:02 |
* weshay|ruck looks | 18:03 | |
weshay|ruck | OS::TripleO::Services::Docker: ../../deployment/deprecated/docker/docker-baremetal-ansible.yaml | 18:03 |
weshay|ruck | aye ContainerCli: docker | 18:04 |
mwhahaha | yea so for centos8 we likely want to use podman | 18:04 |
weshay|ruck | aye | 18:04 |
weshay|ruck | will go through those | 18:04 |
mwhahaha | i think we do it beause pacemaker | 18:04 |
* mwhahaha has vague recollections | 18:04 | |
weshay|ruck | yes | 18:04 |
mwhahaha | so perhaps 004 is non-voting for centos8 until we can cut it over | 18:05 |
*** cylopez has joined #tripleo | 18:08 | |
*** Goneri has quit IRC | 18:11 | |
*** Goneri has joined #tripleo | 18:12 | |
EmilienM | weshay|ruck, mwhahaha : yes scenario004 has docker + pacemaker | 18:14 |
EmilienM | IMHO we should put sc004 non voting, then when we don't run scn004 on centos7, we switch to podman | 18:15 |
EmilienM | weshay|ruck: how does it sound? | 18:15 |
EmilienM | are the check jobs be on centos8 right? | 18:15 |
weshay|ruck | EmilienM, ya ya.. we're looking at centos-8 deployments man | 18:15 |
weshay|ruck | EmilienM, please keep up | 18:15 |
weshay|ruck | centos-7 is so yesterday's news | 18:16 |
EmilienM | a likely story | 18:16 |
weshay|ruck | lol | 18:17 |
*** chandankumar is now known as raukadah | 18:21 | |
*** bfournie has joined #tripleo | 18:26 | |
*** amoralej is now known as amoralej|off | 18:33 | |
*** ramishra has quit IRC | 18:34 | |
*** jcapitao is now known as jcapitao_off | 18:35 | |
openstackgerrit | Merged openstack/python-tripleoclient master: Add source auth to image push https://review.opendev.org/709818 | 18:45 |
openstackgerrit | Merged openstack/ansible-role-collect-logs master: Add disk usage statistics https://review.opendev.org/710006 | 18:45 |
*** jmasud has quit IRC | 18:45 | |
*** rlandy is now known as rlandy|mtg | 18:46 | |
openstackgerrit | Sorin Sbarnea proposed openstack/tripleo-upgrade master: WIP: linters refresh https://review.opendev.org/710111 | 18:47 |
openstackgerrit | Emilien Macchi proposed openstack/python-tripleoclient stable/train: Add source auth to image push https://review.opendev.org/710114 | 18:51 |
*** tosky has quit IRC | 18:56 | |
openstackgerrit | Merged openstack/tripleo-ansible stable/train: BaR Rename the mysql_short_bootstrap_name https://review.opendev.org/709841 | 18:58 |
openstackgerrit | wes hayutin proposed openstack/python-tripleoclient stable/train: Add missing download_ansible_playbooks function https://review.opendev.org/709066 | 18:59 |
*** dpawlik has quit IRC | 19:01 | |
openstackgerrit | Harald Jensås proposed openstack/tripleo-heat-templates master: ControlPlaneSubnetCidr in net_vip_map_external https://review.opendev.org/710120 | 19:15 |
openstackgerrit | Merged openstack/tripleo-heat-templates master: Add global groupvar to set the ansible async dir https://review.opendev.org/704836 | 19:16 |
*** dpawlik has joined #tripleo | 19:18 | |
*** cylopez has quit IRC | 19:18 | |
*** rlandy|mtg is now known as rlandy | 19:27 | |
*** morazi has quit IRC | 19:27 | |
*** avivgt has joined #tripleo | 19:32 | |
openstackgerrit | Brent Eagles proposed openstack/tripleo-heat-templates stable/stein: Added OctaviaDeploymentConfig to deployed server role https://review.opendev.org/710122 | 19:35 |
*** pkopec has quit IRC | 19:35 | |
openstackgerrit | Martin Mágr proposed openstack/tripleo-heat-templates master: [WIP] Remove topic suffix from default value https://review.opendev.org/710123 | 19:38 |
openstackgerrit | Steve Baker proposed openstack/python-tripleoclient master: New command "overcloud node extract provisioned" https://review.opendev.org/674141 | 19:41 |
openstackgerrit | Brent Eagles proposed openstack/tripleo-quickstart-extras master: DNM:Allow full path to be specified for amphora destination https://review.opendev.org/692858 | 19:45 |
*** jfrancoa has quit IRC | 19:57 | |
*** suuuper has quit IRC | 19:57 | |
*** hberaud has quit IRC | 20:01 | |
*** morazi has joined #tripleo | 20:04 | |
*** morazi has quit IRC | 20:04 | |
*** morazi has joined #tripleo | 20:04 | |
*** hberaud has joined #tripleo | 20:08 | |
openstackgerrit | Brent Eagles proposed openstack/tripleo-heat-templates master: Sync neutron-ml2-ansible.yaml files https://review.opendev.org/710131 | 20:09 |
*** sshnaidm is now known as sshnaidm|afk | 20:11 | |
*** jcapitao_off has quit IRC | 20:17 | |
*** hberaud has quit IRC | 20:18 | |
openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart master: Correct the component dlrn repo link in centos 8 master release file https://review.opendev.org/710134 | 20:18 |
openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-quickstart master: DNM: use vexxhost registry for promotion jobs https://review.opendev.org/710135 | 20:19 |
*** cylopez has joined #tripleo | 20:26 | |
*** kozhukalov has quit IRC | 20:33 | |
*** jdandrea has quit IRC | 20:35 | |
*** kozhukalov has joined #tripleo | 20:36 | |
*** jdandrea has joined #tripleo | 20:36 | |
*** holser has quit IRC | 20:42 | |
*** holser has joined #tripleo | 20:46 | |
*** alexmcleod has quit IRC | 20:53 | |
*** jcoufal has quit IRC | 20:59 | |
*** cylopez has quit IRC | 21:06 | |
*** pcaruana has quit IRC | 21:11 | |
*** holser has quit IRC | 21:16 | |
*** jmasud has joined #tripleo | 21:21 | |
*** rcernin has quit IRC | 21:21 | |
*** bnemec has quit IRC | 21:23 | |
*** kozhukalov has quit IRC | 21:29 | |
*** slaweq has quit IRC | 21:32 | |
*** ansmith has quit IRC | 21:45 | |
openstackgerrit | wes hayutin proposed openstack/tripleo-ci master: make centos-8 build containers, voting, gating https://review.opendev.org/710091 | 21:48 |
sshnaidm|afk | cloudnull, last patch fixed errors with nodes, but now the deployment fails: https://logserver.rdoproject.org/16/709816/2/openstack-check/tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001/d4b0287/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz | 22:01 |
cloudnull | that's failing in something with the deploy (metalsmith) which is still using mistral at that point | 22:03 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: hiera-steps-tasks: new task to compute Puppet config hash https://review.opendev.org/709794 | 22:07 |
cloudnull | sshnaidm|afk checking other changes in that string of reviews it looks like the fs001 job passes elsewhere | 22:11 |
cloudnull | so maybe intermittent ? | 22:11 |
openstackgerrit | Merged openstack/python-tripleoclient master: Add handler for exception raising https://review.opendev.org/708942 | 22:12 |
*** rfolco has quit IRC | 22:12 | |
*** tosky has joined #tripleo | 22:12 | |
*** sshnaidm|afk has quit IRC | 22:23 | |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: hiera-steps-tasks: new task to compute Puppet config hash https://review.opendev.org/709794 | 22:26 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-ansible master: tripleo_container_manage: interface to skip containers that would re-run https://review.opendev.org/710147 | 22:26 |
openstackgerrit | Merged openstack/python-tripleoclient master: Increase ssh port timeout https://review.opendev.org/709843 | 22:30 |
openstackgerrit | Merged openstack/puppet-tripleo master: Add support for glance multistore https://review.opendev.org/704373 | 22:30 |
openstackgerrit | Merged openstack/tripleo-quickstart master: Add release files for master CentOS 8 https://review.opendev.org/709560 | 22:30 |
openstackgerrit | Merged openstack/tripleo-quickstart master: [CentOS-8] Install ansible 2.8 https://review.opendev.org/710049 | 22:30 |
openstackgerrit | Merged openstack/tripleo-heat-templates master: Improve the ability to enable swap https://review.opendev.org/709015 | 22:30 |
*** Goneri has quit IRC | 22:30 | |
*** TrevorV has quit IRC | 22:38 | |
openstackgerrit | Merged openstack/tripleo-common master: Do not create temporary swift URLS for ceph-ansible https://review.opendev.org/709249 | 22:47 |
openstackgerrit | Merged openstack/ansible-role-collect-logs master: Add the DLRN build projects.ini to the log files https://review.opendev.org/709868 | 22:47 |
*** rcernin has joined #tripleo | 22:49 | |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: Deprecate Keepalived service https://review.opendev.org/657067 | 22:51 |
*** tkajinam has joined #tripleo | 22:53 | |
*** toure is now known as toure|gone | 23:07 | |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: hiera-steps-tasks: new task to compute Puppet config hash https://review.opendev.org/709794 | 23:08 |
*** bnemec has joined #tripleo | 23:18 | |
*** rlandy is now known as rlandy|bbl | 23:18 | |
*** xek__ has quit IRC | 23:37 | |
*** ysandeep|away is now known as ysandeep | 23:42 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!