Wednesday, 2020-02-26

openstackgerritLuke Short proposed openstack/tripleo-common master: Expose --limit, --skip-tags, and --tags in config-download.  https://review.opendev.org/69242000:10
openstackgerritMerged openstack/tripleo-common master: Move plan container creation to utils  https://review.opendev.org/70880200:14
openstackgerritwes hayutin proposed openstack/tripleo-quickstart-extras master: update build-test-packages for centos-8  https://review.opendev.org/70983700:20
openstackgerritMerged openstack/tripleo-heat-templates stable/train: Set octavia-ansible dir ownership to Ansible user  https://review.opendev.org/70864500:20
openstackgerritMerged openstack/tripleo-heat-templates stable/stein: Set octavia-ansible dir ownership to Ansible user  https://review.opendev.org/70864600:20
*** beagles is now known as beagles_rpm_mode00:20
*** jmasud has joined #tripleo00:26
openstackgerritMerged openstack/tripleo-ansible stable/train: container_puppet_config: disable SElinux labelling  https://review.opendev.org/70964600:27
*** dsavineau has quit IRC00:31
openstackgerritLuke Short proposed openstack/python-tripleoclient master: Expose --limit, --skip-tags, and --tags on the CLI.  https://review.opendev.org/69242100:41
*** ekultails has quit IRC00:51
*** rh-jelabarre has quit IRC00:58
openstackgerritMerged openstack/python-tripleoclient master: Remove mistral from the generate_fencing_parameters deploy workflow  https://review.opendev.org/70718701:02
openstackgerritMerged openstack/tripleo-ci master: add delorean_repo.md5 to logging  https://review.opendev.org/70959701:02
openstackgerritMerged openstack/tripleo-heat-templates stable/train: Remove libvirt packaged dependencies  https://review.opendev.org/70740101:02
openstackgerritMerged openstack/tripleo-common master: Bracket IPv6 address in ironic_inspector healthcheck  https://review.opendev.org/70726301:02
*** rh-jelabarre has joined #tripleo01:05
openstackgerritBob Fournier proposed openstack/tripleo-common stable/train: Bracket IPv6 address in ironic_inspector healthcheck  https://review.opendev.org/70992101:10
*** bfournie has joined #tripleo01:27
openstackgerritRonelle Landy proposed openstack/tripleo-quickstart-extras master: Use ansible_package_manager in playbooks/prepare-slave.yml  https://review.opendev.org/70986602:01
openstackgerritwes hayutin proposed openstack/tripleo-quickstart-extras master: update build-test-packages for centos-8  https://review.opendev.org/70983702:17
*** jmasud has quit IRC02:22
openstackgerritSteve Baker proposed openstack/tripleo-ansible master: module tripleo_baremetal_expand_roles  https://review.opendev.org/70641702:29
openstackgerritSteve Baker proposed openstack/tripleo-ansible master: module metalsmith_instances  https://review.opendev.org/70641802:29
openstackgerritSteve Baker proposed openstack/tripleo-ansible master: module tripleo_baremetal_check_existing  https://review.opendev.org/70704302:29
*** mrunge has quit IRC02:30
openstackgerritSteve Baker proposed openstack/tripleo-ansible master: module tripleo_baremetal_populate_environment  https://review.opendev.org/70729502:30
openstackgerritSteve Baker proposed openstack/tripleo-ansible master: Playbooks for overcloud node (un)provision  https://review.opendev.org/70704402:30
*** mrunge has joined #tripleo02:32
openstackgerritKevin Carter (cloudnull) proposed openstack/python-tripleoclient master: Remove mistral from the bios_configuration workflows  https://review.opendev.org/70986102:32
openstackgerritSteve Baker proposed openstack/python-tripleoclient master: WIP switch to ansible for overcloud node (un)provision  https://review.opendev.org/70874902:36
*** rlandy has quit IRC02:42
openstackgerritKevin Carter (cloudnull) proposed openstack/tripleo-ansible master: Baremetal Configure Playbook  https://review.opendev.org/69166702:43
openstackgerritMerged openstack/python-tripleoclient master: Revert "Default to zero verbosity when using Ansible."  https://review.opendev.org/70820802:45
openstackgerritRonelle Landy proposed openstack/tripleo-quickstart-extras master: Use ansible_package_manager in playbooks/prepare-slave.yml  https://review.opendev.org/70986602:52
openstackgerritRabi Mishra proposed openstack/tripleo-common master: Move package_update worflow related functionality to utils  https://review.opendev.org/70681502:52
openstackgerritRabi Mishra proposed openstack/tripleo-common master: Move parameter actions functionality to utils - Part 1/2  https://review.opendev.org/70954602:52
openstackgerritRonelle Landy proposed openstack/tripleo-ci master: DNM: Testing use_testenv_broker set to false  https://review.opendev.org/70994002:56
openstackgerritRabi Mishra proposed openstack/python-tripleoclient master: Pass verbose boolean value to wait_for_stack_ready()  https://review.opendev.org/70625303:05
openstackgerritEmilien Macchi proposed openstack/tripleo-ansible master: WIP - container_puppet_config: skip containers without new config  https://review.opendev.org/70982303:17
openstackgerritJohn Fulton proposed openstack/tripleo-common master: Do not create temporary swift URLS for ceph-ansible  https://review.opendev.org/70924903:19
openstackgerritRonelle Landy proposed openstack/tripleo-quickstart master: Add release files for master CentOS 8  https://review.opendev.org/70956003:19
*** rlandy has joined #tripleo03:21
*** rlandy has quit IRC03:22
*** dsneddon has quit IRC03:27
openstackgerritMerged openstack/tripleo-common master: Improve upload-swift-artifacts handling of json data  https://review.opendev.org/70828603:29
*** bdodd has joined #tripleo03:36
*** rh-jelabarre has quit IRC03:36
openstackgerritRabi Mishra proposed openstack/tripleo-common master: WIP Modify roles to remove unused services  https://review.opendev.org/70969203:46
openstackgerritRonelle Landy proposed openstack/tripleo-ci master: DNM: Demo of parenting centos 8  https://review.opendev.org/70995003:47
openstackgerritRabi Mishra proposed openstack/tripleo-common master: WIP Modify roles to remove unused services  https://review.opendev.org/70969203:55
*** dsneddon has joined #tripleo03:58
openstackgerritMerged openstack/diskimage-builder master: Add CentOS 8 support  https://review.opendev.org/68430804:02
openstackgerritMerged openstack/diskimage-builder master: Do not include efibootmgr and efivars for ppc architectures  https://review.opendev.org/70981104:02
openstackgerritMerged openstack/diskimage-builder master: Change tgt pkg-map to target-restore CentOS/RHEL-8  https://review.opendev.org/70915904:05
openstackgerritMerged openstack/diskimage-builder master: fix iscsi-boot element exiting build even if dracut-regenerate used  https://review.opendev.org/70734004:06
*** dsneddon has quit IRC04:08
*** panda has quit IRC04:12
*** panda has joined #tripleo04:13
*** dsneddon has joined #tripleo04:37
*** dsneddon has quit IRC04:42
*** dsneddon has joined #tripleo04:45
*** dsneddon has quit IRC04:50
*** raukadah is now known as chandankumar05:09
*** ykarel|away is now known as ykarel05:13
*** yprokule has joined #tripleo05:19
*** yprokule has quit IRC05:21
*** yprokule has joined #tripleo05:21
*** dsneddon has joined #tripleo05:25
*** dsneddon has quit IRC05:31
*** evrardjp has quit IRC05:34
*** evrardjp has joined #tripleo05:35
*** skramaja has joined #tripleo05:35
*** udesale has joined #tripleo05:41
*** udesale has quit IRC05:41
*** udesale has joined #tripleo05:41
*** jdandrea has quit IRC05:41
*** ramishra has quit IRC05:42
*** ramishra has joined #tripleo05:50
openstackgerritChandan Kumar (raukadah) proposed openstack/tripleo-ci master: Improve build images role for CentOS8  https://review.opendev.org/70859905:55
*** ramishra has quit IRC05:55
*** ramishra has joined #tripleo05:56
openstackgerritMerged openstack/python-tripleoclient stable/train: Allow import to specify image location ipxe=false  https://review.opendev.org/70751805:57
*** jmasud has joined #tripleo05:59
*** dsneddon has joined #tripleo05:59
*** dsneddon has quit IRC06:04
*** sri_ has joined #tripleo06:04
*** ratailor has joined #tripleo06:06
*** kozhukalov has joined #tripleo06:08
openstackgerritChandan Kumar (raukadah) proposed openstack/tripleo-ci master: Improve build images role for CentOS8  https://review.opendev.org/70859906:12
*** ratailor has quit IRC06:18
*** ratailor has joined #tripleo06:21
*** udesale has quit IRC06:24
*** udesale has joined #tripleo06:25
*** shyamb has joined #tripleo06:28
shyambHi06:31
shyambpodman pull from undercloud registry is failing with error "unsupported docker v2s2 media type: """06:32
shyambin rhosp1606:32
shyambykarel: If you have any idea about this issue, please let me know06:32
*** saneax has joined #tripleo06:33
*** dsneddon has joined #tripleo06:37
shyambykarel: This bugzilla bug looks exactly same: https://bugzilla.redhat.com/show_bug.cgi?id=179396006:38
openstackbugzilla.redhat.com bug 1793960 in ansible-role-tripleo-modify-image "buildah builds images that podman can't pull (unsupported docker v2s2 media type: "")" [High,Closed: errata] - Assigned to aschultz06:38
*** lmiccini has joined #tripleo06:41
*** dsneddon has quit IRC06:42
Tenguchandankumar: heya! not sure if you can help me - I'm trying to deploy master on centos-8, and apparently there are some issues with "current-tripleo" packages. For instance, the ansible-role-container-registry package download returns a 403... ?06:42
Tengushould I use another flavour?06:42
*** rcernin has quit IRC06:47
Tenguah, apparently using "consistent" is... consistent06:52
openstackgerritFrancesco Pantano proposed openstack/tripleo-heat-templates master: [WIP] Add CephBasePoolVars structure to handle pools variables  https://review.opendev.org/70929706:53
openstackgerritMerged openstack/tripleo-heat-templates stable/train: Fix krb-service-principals with service_net_map_replace  https://review.opendev.org/70959906:59
chandankumarTengu, can you use tripleo-ci-testing repo07:01
*** marios has joined #tripleo07:01
*** marios is now known as marios|ruck07:01
Tenguchandankumar: ah? damn, ok. I wasn't sure about that one :). I'll test once I have the "usual" failure with network config.07:01
chandankumarTengu, we are testing all jobs using toci testing, we have not yet promoted current-tripleo (which is out of sync)07:01
TenguIF I have it07:01
Tenguoh, ok. this explains07:02
chandankumarTengu, ansibelr-role-container-registry known issue we have seen this in current-tripleo07:02
chandankumarTengu, if you want, try standaloen scenario207:02
Tenguchandankumar: out of curiosity - is there a doc about the usage of each repo?07:02
chandankumarTengu, we are dealing with weired error there07:02
Tenguchandankumar: on my side I'm hitting a consistent error with the os-net-config, it fails activating the ctlplane interface - that was yesterday, using the "current" repo.07:03
chandankumarTengu, https://review.opendev.org/#/c/709560/16/config/release/tripleo-ci/CentOS-8/promotion-testing-hash-master.yml and https://hackmd.io/5uYRmLaOTI2raTbHWsaiSQ?view07:03
Tenguah, great, thanks for the links!07:03
chandankumarTengu, https://review.rdoproject.org/r/#/c/24835/ is this one amoralej|off mentioned in his last comment07:04
chandankumarhere we were trying to pull c8 deps in rhel807:04
chandankumari mean about os-net-config07:04
Tenguyeah, so we'll probably abandon that c8-on-rhel8 thing.07:05
chandankumarTengu, yes, will do that07:06
Tengumeh... really need to figure out that NetworkConfig script issue -.-07:06
chandankumarTengu, https://logserver.rdoproject.org/29/25329/13/check/periodic-tripleo-ci-centos-8-scenario002-standalone-master/aa73ff4/logs/undercloud/home/zuul/standalone_deploy.log.txt.gz scenario 2 issue07:06
chandankumarit is working fine in rhel8 and centos707:06
*** jfrancoa has joined #tripleo07:07
chandankumarmay be soemthing wrong with this part https://opendev.org/openstack/tripleo-ansible/src/branch/master/tripleo_ansible/roles/tripleo_keystone_resources/tasks/user_per_role.yml#L23-L2507:07
Tenguthat's what prevents me deploying a standalone so far ;_;07:07
Tenguhmmm. maybe. not sure. I'm not there now ;_;07:07
Tenguis there any weird/specific things done on the centos-8 VM in order to get that @|#ßð networkconfig pass?07:07
chandankumarTengu, ceph ansibel has issue, it does not works with ansible-2.0 fyi07:07
chandankumarTengu, right now nothing07:07
Tengu"Device br-ctlplane does not seem to be present, delaying initialization."   meh.07:08
Tenguthen it falls back on dhcp, and fails.07:08
chandankumarTengu, better open a bz and do it cix07:08
Tenguyeah, wait, will do the deploy using the repo version you pointed - this one was using "consistent", since I was near the error point I let it run07:09
chandankumarTengu, not consistent, it is tripleo-ci-testing07:09
Tenguyes. lemme test that one.07:09
chandankumarnew promotion pattern07:09
Tenguas said - I was already running against consistent, trying to find a way out :)07:09
chandankumarcurrent -> consistent -> componet testing -> promoted component -> tocitesting -> current tripleo07:10
Tenguyep, with the schema, it's easier :)07:10
* Tengu bookmarks07:11
*** udesale has quit IRC07:12
*** udesale has joined #tripleo07:12
*** shyamb has quit IRC07:14
*** dsneddon has joined #tripleo07:17
*** dsneddon has quit IRC07:22
openstackgerritSagi Shnaidman proposed openstack/tripleo-quickstart-extras master: DNM: clean nodes on OVB  https://review.opendev.org/70981607:23
openstackgerritMerged openstack/tripleo-common stable/train: Bracket IPv6 address in ironic_inspector healthcheck  https://review.opendev.org/70992107:25
openstackgerritChandan Kumar (raukadah) proposed openstack/tripleo-ansible master: Fixed the condition for gather_domains  https://review.opendev.org/70995907:30
Tengubah.... same issue.07:32
Tenguthat part is sooooo obscure, a real pain.07:32
chandankumarTengu, https://review.opendev.org/70995907:34
chandankumarTengu, which one domain or os-net-config?07:34
Tenguos-net-config07:34
Tengulemme provide the log once it fails for good.07:34
chandankumarTengu, may be slawq can help07:34
ykarelshyamb yes, that issue was fixed recently upstream, do u have those patches applied07:36
Tenguand I don't see anything relevant in the job config.... that's so weird07:36
ykarelshyamb and if u have used buildah manually, u can pass --format docker while building images, https://review.opendev.org/#/c/703846/ is the upstream patch07:37
ykarelTengu, how u doing standalone deployment ?07:39
ykarelin a vm in rdo cloud?07:39
ykarelwhat's ur standalone_param file07:40
Tenguykarel: on a VM on my own computer, VM managed by libvirt (and ansible).07:40
ykarelTengu, okk, and what image u used?07:40
Tenguykarel: wait, re-launching, the file will be generated shortly07:40
Tenguykarel: official cloud.centos.org centos-8 image (not stream)07:40
Tenguwith 2 network interfaces07:41
ykarelohhk i think i used the same07:41
ykarelbut i did with 1 interface07:41
Tenguand I nmcli unmanage eth107:41
Tenguand config points to eth1 for neutron public interface07:41
Tengu(standalone_param still not generated, should be shortly)07:41
ykarelin my case even with 1 interface, there was extra eth1 file on system, i used to remove that07:42
*** slaweq_ has joined #tripleo07:42
Tenguyeah so I have 2 networks - the standard one (default) by libvirt, with DHCP, and a "ctlplane" one, without any DHCP.07:43
Tenguthis setup works just fine with centos-7 deploy.07:43
Tenguit has worked for the last 2 years.....07:43
Tenguso there's something weird with the centos-8 itself at some point.07:43
TenguI've deployed master on centos-7 a fair amount of time ;).07:43
ykarelTengu, i had ens3 named file, i did sudo rm /etc/sysconfig/network-scripts/ifcfg-ens307:44
Tenguykarel: in my case, it's eth0, eth107:44
Tenguykarel: http://paste.openstack.org/show/790009/  the template I use07:45
Tengu"ip" is set to 192.168.24.107:45
*** slaweq_ is now known as slaweq07:45
ykarelTengu, ack file looks good07:46
ykarelwrt centos7 and centos8 there are changes related to network management07:46
ykareli don't have details though07:46
ykarelbtw what error u seeing with os-net-config07:46
Tenguwait - my deploy is fetching the containers :)07:47
ykarelok :)07:47
Tenguok, deploy started, rendering j207:47
*** avivgta has quit IRC07:48
Tengucreating stacks...07:48
Tenguhopefully I'll get the wanted debug, last run didn't output the actual error -.-07:48
*** dsneddon has joined #tripleo07:51
*** dciabrin has joined #tripleo07:54
Tenguykarel: so in journalctl, I see Feb 26 07:52:06 undercloud.localdomain /etc/sysconfig/network-scripts/ifup-eth[11225]: Device br-ctlplane does not seem to be present, delaying initialization.07:54
Tengu(script still on jold)07:54
Tengu*hold07:54
openstackgerrityatin proposed openstack/tripleo-heat-templates master: [DNM] Test build-test-package in centos7/rhel8  https://review.opendev.org/70996407:55
*** dsneddon has quit IRC07:56
Tenguhmmm. interesting. I still see networkmanager trying to do things with eth107:56
Tengualthough it should be unmanaged....07:56
Tenguwtf07:56
openstackgerritSagi Shnaidman proposed openstack/python-tripleoclient master: DNM: test build pkg  https://review.opendev.org/70997107:57
openstackgerritMerged openstack/python-tripleoclient master: Local file based image uploader  https://review.opendev.org/69396007:57
ykarelsshnaidm, duplicate :)07:57
sshnaidmykarel, where?07:58
ykarelsshnaidm, https://review.opendev.org/70996407:58
ykarel[DNM] Test build-test-package in centos7/rhel807:58
Tenguykarel: http://paste.openstack.org/show/790010/  (ping slaweq - if you have some time, having a hard time deploying master on centos-8, NetworkConfig step fails)07:58
sshnaidmykarel, ok, more testing :)07:59
ykarelsshnaidm, ack :)07:59
ykarelTengu, as a quick check can u try removing that eth1 file07:59
ykareli think i hit similar issue07:59
Tenguykarel: ok! re-running (thought the interface does exist for real)08:00
Tengu*though08:00
ykarelTengu, for me too that didn't existed08:00
Tenguthe VM description has two interfaces.08:00
Tenguykarel: mine does08:00
ykarelTengu, ohkk08:01
Tenguhttp://paste.openstack.org/show/790011/08:01
Tenguok, and I have no udev rule for naming or whatsoever.08:01
ykarelack08:02
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-upgrade master: Add config-heat and config-resource options.  https://review.opendev.org/70997208:02
*** ykarel is now known as ykarel|lunch08:03
*** jidar has quit IRC08:04
*** tesseract has joined #tripleo08:06
*** ansmith_ has joined #tripleo08:06
*** ansmith has quit IRC08:07
openstackgerritmathieu bultel proposed openstack/python-tripleoclient master: Move ansible hosts file as a constant  https://review.opendev.org/70943008:08
Tengumeh. same issue, ykarel|lunch :(08:09
Tengustill. Seeing Feb 26 08:05:31 undercloud.localdomain NetworkManager[1476]: <info>  [1582704331.9717] audit: op="connections-load" args="/etc/sysconfig/network-scripts/ifcfg-eth1" pid=12860 uid=0 result="success"08:09
Tenguthere I think the interface isn't unmanaged.08:09
Tenguneed to check that.08:09
*** jcapitao has joined #tripleo08:11
Tenguoh. wait. shouldn't we stop NetworkManager service alltogether?08:11
*** jmasud has quit IRC08:13
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-upgrade stable/train: Add config-heat and config-resource options.  https://review.opendev.org/70997508:14
*** jmasud has joined #tripleo08:14
*** flfuchs has joined #tripleo08:17
Tengubleh. still not working. there's something wrong.08:17
Tenguslaweq: heya! would you have some time for me? :)08:18
*** udesale has quit IRC08:18
openstackgerritMerged openstack/python-tripleoclient master: Don't use the delete_deployment_plan workflow, call the action directly  https://review.opendev.org/70567808:18
slaweqTengu: hi, sure08:18
slaweqwhat's up?08:18
Tenguslaweq: great - I'm trying to deploy master on a centos-8 VM, for now "standalone", and I'm hitting issues with the NetworkConfig step (so, really early). It apparently can't set up br-ctlplane08:19
Tenguslaweq: and I don't understand what I'm doing wrong here, especially since my deploy is working just fine on centos-7 :/.08:19
Tenguslaweq: the os-net-config scripts shows this: http://paste.openstack.org/show/790010/08:20
*** tosky has joined #tripleo08:20
*** shyamb has joined #tripleo08:21
Tenguslaweq: my standalone_parameters.yaml shows http://paste.openstack.org/show/790012/ and the deploy command is http://paste.openstack.org/show/790013/08:21
*** iurygregory has joined #tripleo08:21
*** rcernin has joined #tripleo08:22
Tenguslaweq: so I'm a bit lost right now :(. if you have some idea, that would be nice08:23
slaweqTengu: I don't know but for me it looked as it failed on this:08:24
slaweqrunning ifup on interface: eth108:24
slaweqwhat do You have in /etc/sysconfig/network-scripts/ifcfg-eth1 ?08:24
Tenguslaweq: it's generated by os-net-config - I see that there's BOOTPROTO=dhcp - this is the fallback, "safe config" when it can't apply the one we actually want with bridge and so on08:25
openstackgerritmathieu bultel proposed openstack/tripleo-validations master: Add FFU validation to check for existence of a backup file  https://review.opendev.org/70117908:25
Tenguslaweq: thing is, I don't have DHCP on that interface (it's in a specific network). And I *never* had one - centos-7 was working like 2 days ago, before I started testing the centos-8 thing.08:26
Tenguslaweq: and I deployed a fair amount of standalone (note, undercloud is also failing for the vers same reason)08:26
slaweqTengu: and who should create br-ctlplane then?08:26
Tenguslaweq: br-ctlplane seems to be create by the os-net-config thing...08:27
Tengucheck line 22 of http://paste.openstack.org/show/790010/08:27
slaweqTengu: and is it really created?08:27
Tenguthat's the initial error.08:27
Tenguthat's when os-net-config tries to start the bridge... and fails, but the absence of reason is a bit annoying.08:28
Tenguso when that thing fails, it falls back on the "safe config" which enable DHCP on all interfaces.08:28
Tengu(which fails here because no dhcp server on eth1 network)08:29
Tengubut, as said: this is working without any issue on centos-7. So there's something different somewhere, and I can't find what it is. I've even disabled NetworkManager services in order to ensure it's not playing naughty with os-net-config.08:29
*** dsneddon has joined #tripleo08:30
slaweqTengu: can You check what You have in /etc/sysconfig/network-scripts/ifcfg-br-ctlplane ?08:30
Tenguthat file is removed by the script.......08:30
Tengusooo easy to debug, right? :(08:30
openstackgerritAndreas Jaeger proposed openstack/tripleo-quickstart-extras master: Use current stackviz tarball  https://review.opendev.org/70997908:31
*** amoralej|off is now known as amoralej08:31
Tenguslaweq: so tripleo runs a script located in /var/lib/tripleo-config/scripts/run_os_net_config.sh - that one wraps things around os-net-config and is the one doing the fallback, cleanup and so on08:32
Tenguslaweq: maybe you want an access to the node directly? Might be easier.08:32
slaweqTengu: if that is possible, then yes :)08:32
Tenguslaweq: tmate in DM :)08:33
*** jpich has joined #tripleo08:34
*** dsneddon has quit IRC08:34
*** udesale has joined #tripleo08:39
*** cylopez has joined #tripleo08:40
*** guits has quit IRC08:41
*** jpena|off is now known as jpena08:46
*** hberaud has joined #tripleo08:48
*** hberaud has quit IRC08:49
*** hberaud has joined #tripleo08:49
openstackgerritRabi Mishra proposed openstack/tripleo-common master: WIP Modify roles to remove unused services  https://review.opendev.org/70969208:53
*** shyamb has quit IRC08:55
*** tkajinam has quit IRC08:57
*** dsneddon has joined #tripleo09:01
*** dsneddon has quit IRC09:05
*** lennyb has quit IRC09:06
*** lennyb has joined #tripleo09:07
*** ykarel|lunch is now known as ykarel09:08
ykarelTengu, ack :(09:11
Tenguykarel: apparently we're missing a dependency on network-scripts-openvswitch09:13
Tenguykarel: it's installed on the upstream CI job, but probably manually09:13
openstackgerritRabi Mishra proposed openstack/tripleo-common master: Move parameter actions functionality to utils - Part 1/2  https://review.opendev.org/70954609:13
*** hberaud has quit IRC09:13
Tengunothing depends on that one, at least with the tripleo-ci-testing packages09:13
ykarelTengu, mmm isn't that dep for openvsiwthc09:13
Tenguat least it's not installed.09:13
Tenguslaweq: w00t!09:14
*** lucasagomes has joined #tripleo09:15
Tenguslaweq: soooo yeah. installing that package helps a lot - and killing the dhclient as well :). guess I can go forward09:15
Tenguykarel: lemme create an LP so that we can have a trace.09:17
*** hberaud has joined #tripleo09:17
ykarelTengu, ack09:18
*** xek_ has joined #tripleo09:19
ykarelTengu, can u check what version of openvswitch is installed on your system09:20
ykarelnetwork-scripts-openvswitch is dep for rdo-openvswitch09:21
Tenguykarel: funky. I don't have that rdo-openvswitch09:21
ykarelTengu, what u have?09:21
ykarelrpm -qa|grep openvswitch09:21
ykareland from what repo it got installed09:21
Tenguykarel: openvswitch-2.12.0-1.el8.x86_64 + python3-openvswitch-2.12.0-1.el8.x86_6409:21
Tenguand, manually pulled, network-scripts-openvswitch-2.12.0-1.el8.x86_6409:22
ykarelTengu, and yum info  openvswitch09:22
ykarelfrom which repo it was pulled09:22
Tengucoming09:22
Tenguyum is.... slow.09:22
TenguFrom repo    : delorean-master-testing09:22
Tenguykarel: https://bugs.launchpad.net/tripleo/+bug/186482109:24
openstackLaunchpad bug 1864821 in tripleo "[CentOS-8] nothing installs network-scripts-openvswitch package" [High,Triaged]09:24
Tenguyou have some more info there, like repolist09:24
ykarelTengu, okk09:24
ykarelin ci it possibly didn't hit becase there we specify rhosp-openvswitch09:24
Tenguhehe09:24
Tenguthat will probably help yeah.....09:25
*** psachin has joined #tripleo09:26
Tenguykarel: do you want me to inspect other things? I'm going to crash the VM in order to get a fresh env.09:26
ykarelTengu, go for it09:26
ykareli think rdo-openvswitch is the reason not seen in CI09:27
Tenguprobably yeah. My guess is, we should depends on "something" more in order to ensure that package is present.09:27
Tenguelse.... well, we're doomed :)09:27
Tenguso my lab will manually pull that network-script-openvswitch package.09:27
Tengunot a big deal for me, once I know the issue :)09:27
ykarelTengu, for CI i was referring https://opendev.org/zuul/zuul-jobs/src/branch/master/roles/multi-node-bridge/vars/CentOS.yaml#L409:28
ykareland rdo-openvswitch https://github.com/rdo-common/rdo-openvswitch/blob/ussuri-c8-rdo/rdo-openvswitch.spec#L2609:29
ykarelwhich provides rhosp-openvswitch09:29
Tenguheh09:31
Tenguso should we make python3-tripleoclient depend on something like that rdo-openvswitch or something?09:31
Tengujust to ensure ppl don't hit the same issue as I09:31
ykarelhmm that should work i think09:32
*** tesseract has quit IRC09:35
*** tesseract has joined #tripleo09:36
*** dsneddon has joined #tripleo09:37
Tenguykarel: what does that rhosp-openvswitch install? currently, python-tripleoclient depends on openvswitch itself. Maybe we should replace that one by "rdo-openvswitch", or directly "rhosp-openvswitch" ?09:37
Tenguoh. oho. ok. so this seems to depend on the OS version.09:38
Tenguwe probably can do something more.... clean, as it's done for the pyver global.09:39
Tengulemme try to tweak something.09:39
*** avivgt has joined #tripleo09:40
*** dsneddon has quit IRC09:42
*** jidar has joined #tripleo09:42
Tenguykarel: https://review.rdoproject.org/r/25371  something like that?09:44
ykarelTengu, looking09:45
*** avivgt has quit IRC09:46
chandankumarykarel, https://logserver.rdoproject.org/29/25329/14/check/periodic-tripleo-ci-centos-8-scenario002-standalone-master/a7e33c8/logs/undercloud/home/zuul/standalone_deploy.log.txt.gz09:47
chandankumarykarel, failed at same place but with different error09:47
ykarelTengu, we need to handle rhosp case09:47
ykarelas there we don't have rdo-openvswitch09:47
chandankumarykarel, let's downgrade ansible to 2.8 then ?09:48
Tenguoh. so we should depends-on rhosp-openvswitch instead?09:48
ykarelTengu, when rdo use rdo-openvswitch, else openvswitch09:49
ykarelTengu, use %if 0%{?rhosp} == 009:49
Tenguykarel: downstream openvswitch has the right dependency?09:49
ykarelTengu, i think yes but let me cross check09:50
Tenguykarel: so I keep the if rhel > 7, add a second condition bellow for rhosp, if true then rhosp-openvswitch, else rdo-openvswitch... and if not rhel>7, openvswitch - that should be OK?09:51
*** alexmcleod has joined #tripleo09:51
*** flfuchs has quit IRC09:53
ykarelTengu, %if 0%{?rhosp} == 0 && 0%{?rhel} > 7 rdo-openvswitch else openvswitch09:54
Tenguoh. ok. no need to inject rhosp-openvswitch. OK.09:54
ykarelthis way we will not change for downstream, so safe i think09:55
Tengufine for me!09:55
openstackgerritGael Chamoulaud proposed openstack/python-tripleoclient master: TripleO Validations Logging CLI Introduction  https://review.opendev.org/69539709:55
openstackgerritGael Chamoulaud proposed openstack/python-tripleoclient master: Get validation groups info from groups.yaml file  https://review.opendev.org/70452109:55
Tenguykarel: review updated09:55
ykarelTengu, ack /me checks09:55
Tenguykarel: btw, suddenly I got the ens3 interface, pushed by dracut... what the hell -.-09:56
ykarelTengu, missed %09:57
ykarelin second global09:57
Tenguoh... meh09:57
*** avivgt has joined #tripleo09:58
openstackgerritSagi Shnaidman proposed openstack/tripleo-ansible master: DNM: debug keystone  https://review.opendev.org/70999609:59
ykarelTengu, and wrt of rhosp-openvswitch, i checked it depends on network-script-openvswitch10:02
openstackgerritSagi Shnaidman proposed openstack/tripleo-ansible master: DNM: debug keystone  https://review.opendev.org/70999610:03
ykarelchandankumar, for scenario002 i think should try to get it fixed, for 001/004 to test ansible downgrade can be tried i think10:04
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates master: Use ipc:host for cinder-backup  https://review.opendev.org/70999910:05
openstackgerritChandan Kumar (raukadah) proposed openstack/tripleo-quickstart master: Add release files for master CentOS 8  https://review.opendev.org/70956010:05
*** pkopec has joined #tripleo10:07
*** dsneddon has joined #tripleo10:15
openstackgerritFrancesco Pantano proposed openstack/tripleo-ansible master: [WIP] Add a new set of tasks to build the openstack pool list  https://review.opendev.org/70908310:16
*** hjensas has quit IRC10:18
*** dsneddon has quit IRC10:20
*** hjensas has joined #tripleo10:21
*** alexmcleod has quit IRC10:22
*** alexmcleod has joined #tripleo10:23
Tengumeh... msg: 'Failed to download packages: Cannot download python3-gnocchiclient-7.0.4-0.20200221072248.64814b9.el8.noarch.rpm: All mirrors were tried'   I thought gnocchi was dead long ago... ?10:27
*** skramaja has quit IRC10:30
openstackgerritSagi Shnaidman proposed openstack/ansible-role-collect-logs master: Add disk usage statistics  https://review.opendev.org/71000610:37
*** avivgt has quit IRC10:37
sshnaidmmarios|ruck, chandankumar take a look pls ^^10:37
marios|rucksshnaidm: ack10:39
openstackgerritSagi Shnaidman proposed openstack/tripleo-quickstart-extras master: DNM: test logs  https://review.opendev.org/71000710:43
openstackgerritHarald Jensås proposed openstack/python-tripleoclient master: Fix unit test_get_image timezone issue  https://review.opendev.org/71000810:46
openstackgerritHarald Jensås proposed openstack/python-tripleoclient master: Add option to control ironic network interfaces  https://review.opendev.org/70010310:47
*** avivgt has joined #tripleo10:51
*** dsneddon has joined #tripleo10:51
*** dsneddon has quit IRC10:56
*** ykarel is now known as ykarel|afk10:59
*** suuuper has joined #tripleo11:00
openstackgerritChandan Kumar (raukadah) proposed openstack/tripleo-quickstart master: Add release files for master CentOS 8  https://review.opendev.org/70956011:05
openstackgerritChandan Kumar (raukadah) proposed openstack/tripleo-quickstart-extras master: update build-test-packages for centos-8  https://review.opendev.org/70983711:07
*** tesseract has quit IRC11:08
*** tesseract has joined #tripleo11:11
openstackgerritSagi Shnaidman proposed openstack/tripleo-quickstart-extras master: Fix prepare-slave playbook for centos8 OVB  https://review.opendev.org/70986611:15
*** dsneddon has joined #tripleo11:23
*** shyamb has joined #tripleo11:27
shyambHi11:27
*** dsneddon has quit IRC11:28
openstackgerritChandan Kumar (raukadah) proposed openstack/tripleo-ci master: Improve build images role for CentOS8  https://review.opendev.org/70859911:30
openstackgerritChandan Kumar (raukadah) proposed openstack/tripleo-ci master: Improve build images role for CentOS8  https://review.opendev.org/70859911:30
*** jaosorior has joined #tripleo11:32
openstackgerritChandan Kumar (raukadah) proposed openstack/tripleo-ci master: Improve build images role for CentOS8  https://review.opendev.org/70859911:33
openstackgerritSagi Shnaidman proposed openstack/tripleo-quickstart-extras master: Fix prepare-slave playbook for centos8 OVB  https://review.opendev.org/70986611:38
*** shyamb has quit IRC11:45
*** ykarel|afk is now known as ykarel11:52
*** dsneddon has joined #tripleo12:01
*** dsneddon has quit IRC12:06
*** shyamb has joined #tripleo12:08
*** sshnaidm is now known as sshnaidm|bbl12:09
*** jcapitao is now known as jcapitao_lunch12:10
*** jmasud has quit IRC12:12
*** leanderthal has joined #tripleo12:12
*** ratailor has quit IRC12:14
*** jmasud has joined #tripleo12:14
*** bfournie has quit IRC12:23
*** psachin has quit IRC12:25
*** suuuper has quit IRC12:33
*** udesale_ has joined #tripleo12:34
*** jpena is now known as jpena|lunch12:34
*** dsneddon has joined #tripleo12:35
*** udesale has quit IRC12:36
openstackgerritMerged openstack/ansible-role-collect-logs master: Dynamically generate a list of files for rsync  https://review.opendev.org/70376512:37
*** Goneri has joined #tripleo12:38
*** dsneddon has quit IRC12:40
*** beagles_rpm_mode is now known as beagles12:43
openstackgerritChandan Kumar (raukadah) proposed openstack/ansible-role-collect-logs master: Add the DLRN build project.ini to the log files  https://review.opendev.org/70986812:46
*** ansmith_ has quit IRC12:52
dciabrinbnemec howdy o/ would it be possible to recheck https://review.opendev.org/#/c/709588/ ? I don't have +2 on that project12:52
*** mcornea has joined #tripleo12:53
*** morazi has joined #tripleo12:56
*** rlandy has joined #tripleo13:00
*** marios|ruck is now known as marios|ruck|call13:01
*** rh-jelabarre has joined #tripleo13:04
*** psachin has joined #tripleo13:06
*** dsneddon has joined #tripleo13:08
*** dsneddon has quit IRC13:13
*** amoralej is now known as amoralej|lunch13:14
openstackgerritEmilien Macchi proposed openstack/tripleo-ansible master: filters: make get_domain_id more robust  https://review.opendev.org/70972713:14
*** bfournie has joined #tripleo13:15
*** skramaja has joined #tripleo13:16
*** jcapitao_lunch is now known as jcapitao13:17
*** jpich has quit IRC13:20
*** jpich has joined #tripleo13:20
EmilienMmwhahaha: have you seen that one in CI? Error: error pulling image "192.168.24.1:8787/tripleomaster/centos-binary-ovn-controller:da4c8b0acc02c322be90322cef0517f785b14b27_b5a8f808-updated-20200225190224": unable to pull 192.168.24.1:8787/tripleomaster/centos-binary-ovn-controller:da4c8b0acc02c322be90322cef0517f785b14b27_b5a8f808-updated-20200225190224: unable to pull image: Error writing blob: error storing13:25
EmilienMblob to file "/var/tmp/storage708985759/6": read tcp 192.168.24.3:55340->192.168.24.1:8787: read: connection reset by peer13:25
*** jpena|lunch is now known as jpena13:26
*** suuuper has joined #tripleo13:27
EmilienMhttps://bugs.launchpad.net/tripleo/+bug/186484413:27
openstackLaunchpad bug 1864844 in tripleo "image-serve registry: error writing blob / error storing blob to file" [High,Triaged]13:27
*** Goneri has quit IRC13:28
*** xaban06 has joined #tripleo13:31
xaban06Hi, "openstack overcloud update converge" will probably fail with a time out. It is currently at Step 5, but idle for 1.5+ hour. How can I start troubleshooting, where should I look?13:32
*** ykarel is now known as ykarel|afk13:36
*** ysandeep is now known as ysandeep|away13:38
openstackgerritRyan McCabe proposed openstack/tripleo-common master: [WIP] Enable configuration for ComputeCollectd  https://review.opendev.org/71003513:39
*** ansmith has joined #tripleo13:40
*** Goneri has joined #tripleo13:42
*** dsneddon has joined #tripleo13:46
*** shyamb has quit IRC13:51
*** dsneddon has quit IRC13:52
*** marios|ruck|call is now known as marios|ruck13:52
openstackgerritEmilien Macchi proposed openstack/tripleo-quickstart-extras master: Use tripleo-operator-ansible for standalone  https://review.opendev.org/70577513:56
*** dsavineau has joined #tripleo13:56
*** amoralej|lunch is now known as amoralej13:59
cloudnullmornings14:00
*** ykarel|afk is now known as ykarel14:02
*** slaweq has quit IRC14:05
*** dasp has quit IRC14:08
*** slaweq has joined #tripleo14:09
openstackgerritRonelle Landy proposed openstack/tripleo-quickstart master: Add release files for master CentOS 8  https://review.opendev.org/70956014:14
*** leanderthal has quit IRC14:16
*** leanderthal has joined #tripleo14:17
*** rainleander has joined #tripleo14:20
*** dsneddon has joined #tripleo14:20
*** leanderthal has quit IRC14:20
*** sri_ has quit IRC14:25
openstackgerritKevin Carter (cloudnull) proposed openstack/tripleo-ansible master: Add raid configuration playbook and options  https://review.opendev.org/70983114:25
*** dsneddon has quit IRC14:25
openstackgerritJuan Badia Payno proposed openstack/tripleo-ansible master: Fix error with command ansible module and pipes  https://review.opendev.org/71004614:25
*** abdysn has joined #tripleo14:28
*** abdysn has quit IRC14:28
*** xaban06 has quit IRC14:28
*** jdandrea has joined #tripleo14:29
openstackgerritKevin Carter (cloudnull) proposed openstack/tripleo-ansible master: Implement concurrency in baremetal cleaning  https://review.opendev.org/70978314:30
openstackgerritKevin Carter (cloudnull) proposed openstack/tripleo-ansible master: Add raid configuration playbook and options  https://review.opendev.org/70983114:30
openstackgerritKevin Carter (cloudnull) proposed openstack/tripleo-ansible master: Create a bios reset playbook  https://review.opendev.org/70986014:30
openstackgerritKevin Carter (cloudnull) proposed openstack/tripleo-ansible master: Create a bios apply playbook  https://review.opendev.org/70986214:30
*** hberaud has quit IRC14:34
openstackgerritBrent Eagles proposed openstack/tripleo-quickstart-extras master: Allow full path to be specified for amphora destination  https://review.opendev.org/69285814:34
*** hberaud has joined #tripleo14:34
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-upgrade stable/train: Add config-heat and config-resource options.  https://review.opendev.org/70997514:37
openstackgerritRonelle Landy proposed openstack/tripleo-ci master: Add base centos 8 jobs for parenting  https://review.opendev.org/70995014:38
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-upgrade master: Add config-heat and config-resource options.  https://review.opendev.org/70997214:38
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-upgrade master: Add config-heat and config-resource options.  https://review.opendev.org/70997214:40
openstackgerritRonelle Landy proposed openstack/tripleo-ci master: Add base centos 8 jobs for parenting  https://review.opendev.org/70995014:42
openstackgerritHarald Jensås proposed openstack/tripleo-common master: Support baremetal 'extra' property for node and port  https://review.opendev.org/70447514:47
*** iurygregory has quit IRC14:49
*** rleander has joined #tripleo14:50
*** rainleander has quit IRC14:52
openstackgerritChandan Kumar (raukadah) proposed openstack/tripleo-quickstart master: [CentOS-8] Install ansible 2.8  https://review.opendev.org/71004914:53
*** dsneddon has joined #tripleo14:55
*** sshnaidm|bbl is now known as sshnaidm14:56
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-upgrade master: Allow to switch from parallel to serial update.  https://review.opendev.org/70293114:57
*** jbadiapa has quit IRC14:58
openstackgerritRonelle Landy proposed openstack/tripleo-ci master: Add base centos 8 jobs for parenting  https://review.opendev.org/70995015:00
*** dsneddon has quit IRC15:00
fultonjEmilienM: is disable_paunch by default getting backported to train?15:01
*** TrevorV has joined #tripleo15:01
EmilienMfultonj: no15:01
EmilienMfultonj: at least not before it has proven to be really stable and performant15:01
fultonjEmilienM: http://paste.openstack.org/show/790031/15:02
fultonji'm hitting issues like ^ and i basically re-run and don't hit them again15:03
openstackgerritRabi Mishra proposed openstack/tripleo-common master: Modify roles to remove unused services  https://review.opendev.org/64203215:03
EmilienMfultonj: if you want more logs, you need to enable ConfigDebug15:03
fultonjhttps://review.opendev.org/#/c/709573/15:03
EmilienMit's disabled by default because it leaks sensitive informations like passwords and such15:03
fultonjlike that ^15:03
fultonjEmilienM: ok15:03
EmilienMfultonj: yeah I need to figure that out when mwhahaha is up15:03
fultonjEmilienM: are you seeing those kinds of intermittent issues too?15:04
EmilienMfultonj: yes, it happens. It can be lot of things15:04
EmilienMfultonj: container engine, networking, etc15:04
* fultonj using it on overcloud and undercloud15:04
fultonjworked good on undercloud15:04
fultonjbasically works for me aside from intermitten issues15:04
EmilienMfultonj: ConfigDebug: True will give you all infos15:04
fultonji'll get logs and open bug if i hit it more15:04
fultonjthx15:05
*** psachin has quit IRC15:05
*** ykarel is now known as ykarel|afk15:06
*** saneax has quit IRC15:07
openstackgerritRonelle Landy proposed openstack/tripleo-ci master: Add base centos 8 jobs for parenting  https://review.opendev.org/70995015:09
*** suuuper has quit IRC15:10
openstackgerritRabi Mishra proposed openstack/tripleo-common master: Move parameter actions functionality to utils - Part 1/2  https://review.opendev.org/70954615:10
openstackgerritRabi Mishra proposed openstack/tripleo-common master: Move generate_fencing_parameters functionality to utils  https://review.opendev.org/71005515:10
*** TrevorV has quit IRC15:11
*** TrevorV has joined #tripleo15:11
openstackgerrityatin proposed openstack/ansible-role-collect-logs master: Add the DLRN build projects.ini to the log files  https://review.opendev.org/70986815:14
openstackgerritEmma Foley proposed openstack/tripleo-heat-templates master: [WIP] Add STF environment  https://review.opendev.org/69462315:15
*** skramaja has quit IRC15:18
*** rleander has quit IRC15:18
*** rleander has joined #tripleo15:20
*** mugsie has quit IRC15:20
cloudnullanyone around mind giving https://review.opendev.org/#/c/708942/ a nudge ?15:22
*** mugsie has joined #tripleo15:22
chandankumarHey around? want to take a look at c8 undercloud install timeout https://review.rdoproject.org/r/#/c/25366/ and logs here https://logserver.rdoproject.org/66/25366/1/check/periodic-tripleo-ci-centos-8-singlenode-featureset027-master/6260ff1/logs/undercloud/home/zuul/undercloud_install.log.txt.gz feel free to update the wip patches, if have something15:25
*** dsneddon has joined #tripleo15:26
*** cylopez has quit IRC15:28
*** dsneddon has quit IRC15:31
*** marios|ruck is now known as marios|ruck|call15:31
*** iurygregory has joined #tripleo15:34
openstackgerritSagi Shnaidman proposed openstack/tripleo-quickstart-extras master: Fix prepare-slave playbook for centos8 OVB  https://review.opendev.org/70986615:37
*** suuuper has joined #tripleo15:38
*** dsneddon has joined #tripleo15:45
*** Trevor_V has joined #tripleo15:46
*** psachin has joined #tripleo15:47
*** TrevorV has quit IRC15:49
*** dasp has joined #tripleo15:52
*** marios|ruck|call is now known as marios|ruck15:52
*** psachin has quit IRC15:57
openstackgerritLance Bragstad proposed openstack/tripleo-validations master: WIP: Only validate token_flush for non-persistent tokens  https://review.opendev.org/71006515:57
*** dsavineau has left #tripleo15:59
*** TrevorV has joined #tripleo15:59
*** Trevor_V has quit IRC16:03
*** iurygregory has quit IRC16:05
mwhahahachandankumar: usually that hang is an OOM16:10
mwhahahachandankumar: we're missing teh container image prepare logs so I don't know why that hung , https://logserver.rdoproject.org/66/25366/1/check/periodic-tripleo-ci-centos-8-singlenode-featureset027-master/6260ff1/logs/undercloud/var/log/16:12
*** avivgt has quit IRC16:14
*** lmiccini has quit IRC16:21
*** udesale_ has quit IRC16:24
chandankumarmwhahaha, thanks, doing a recheck,16:26
chandankumarit was the first run16:27
openstackgerritGael Chamoulaud proposed openstack/python-tripleoclient master: TripleO Validations Logging CLI Introduction  https://review.opendev.org/69539716:27
openstackgerritGael Chamoulaud proposed openstack/python-tripleoclient master: Get validation groups info from groups.yaml file  https://review.opendev.org/70452116:27
openstackgerritPablo Caruana proposed openstack/tripleo-heat-templates stable/train: Use ipc:host for cinder-backup  https://review.opendev.org/71007616:30
*** pcaruana has joined #tripleo16:31
*** psachin has joined #tripleo16:37
*** bfournie has quit IRC16:42
sshnaidmcloudnull, did you see ovb error in https://review.opendev.org/#/c/709816/ ? 'Node' object has no attribute '__getitem__' - it happens when registering nodes16:45
sshnaidmcloudnull, wonder how it's related to tested code16:45
cloudnulli had not .16:46
* cloudnull looking 16:46
cloudnullwhich ovb job ?16:46
*** xek__ has joined #tripleo16:48
sshnaidmcloudnull, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001 for example16:48
* cloudnull looking 16:49
cloudnullwhich log file did you see that in ?16:49
*** rleander has quit IRC16:49
sshnaidmcloudnull, https://logserver.rdoproject.org/16/709816/2/openstack-check/tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001/5b80a1a/logs/undercloud/home/zuul/overcloud_prep_images.log.txt.gz16:49
sshnaidmcloudnull, it fails on  openstack overcloud node import instackenv.json16:50
*** tesseract has quit IRC16:50
cloudnullhum.16:50
cloudnulli dont think that has any relation to the code being tested.16:50
sshnaidmprint('Successfully registered node UUID %s' % node['uuid'] - actually it fails on report only16:50
cloudnullbut I think I know where that issue is16:50
*** dsneddon has quit IRC16:50
*** xek_ has quit IRC16:51
openstackgerritMarios Andreou proposed openstack/tripleo-heat-templates master: Add NeutronSecurityGroupQuota to allow setting quota_security_group  https://review.opendev.org/71008316:53
marios|ruckykarel|afk: chandankumar: ^^ but will continue tomorrow16:53
*** pcaruana has quit IRC16:53
ykarel|afkmarios|ruck, nice,16:55
ykarel|afkfor testing can u try bumping from 1016:55
openstackgerritMarios Andreou proposed openstack/tripleo-heat-templates master: Add NeutronSecurityGroupQuota to allow setting quota_security_group  https://review.opendev.org/71008316:55
marios|ruckykarel|afk: yeah we need to bump it for the job will poke at it some more tomorrow16:55
ykarel|afkmarios|ruck, ack16:56
*** jaosorior has quit IRC16:57
openstackgerritKevin Carter (cloudnull) proposed openstack/python-tripleoclient master: Remove mistral when running the register_or_update workflow  https://review.opendev.org/70958316:59
cloudnullsshnaidm ^16:59
*** ykarel|afk is now known as ykarel|away17:00
*** marios|ruck is now known as marios|ruck|call17:01
*** lucasagomes has quit IRC17:01
openstackgerritKevin Carter (cloudnull) proposed openstack/python-tripleoclient master: Remove mistral from the undeploy_roles workflow  https://review.opendev.org/70961417:02
openstackgerritKevin Carter (cloudnull) proposed openstack/python-tripleoclient master: Remove mistral from the configure workflow  https://review.opendev.org/70961617:02
openstackgerritKevin Carter (cloudnull) proposed openstack/python-tripleoclient master: Remove mistral from the configure_manageable_nodes workflow  https://review.opendev.org/70963317:02
openstackgerritKevin Carter (cloudnull) proposed openstack/python-tripleoclient master: Remove the mistral from the clean_.*_nodes workflow  https://review.opendev.org/70975517:03
openstackgerritKevin Carter (cloudnull) proposed openstack/python-tripleoclient master: Remove the mistral from the create_raid_configuration workflow  https://review.opendev.org/70985817:03
openstackgerritKevin Carter (cloudnull) proposed openstack/python-tripleoclient master: Remove mistral from the bios_configuration workflows  https://review.opendev.org/70986117:03
cloudnullsshnaidm rebased all the dependent reviews and reran the rdo check on that DNM change17:05
sshnaidmcloudnull, cool, let's see how it goes17:05
*** pcaruana has joined #tripleo17:06
*** dsneddon has joined #tripleo17:09
openstackgerritRonelle Landy proposed openstack/tripleo-ci master: Add base centos 8 jobs for parenting  https://review.opendev.org/70995017:10
*** psachin has quit IRC17:12
*** marios|ruck|call is now known as marios|out17:15
*** marios|out is now known as marios|ruck17:16
*** jcoufal has joined #tripleo17:18
*** marios|ruck is now known as marios|out17:18
openstackgerritwes hayutin proposed openstack/tripleo-ci master: DNM yet, make centos-8 build containers, voting, gating  https://review.opendev.org/71009117:25
openstackgerritMerged openstack/tripleo-docs master: Document override tripleo-ci-testing with dlrn_hash_tag testproject  https://review.opendev.org/70891417:31
*** evrardjp has quit IRC17:34
*** evrardjp has joined #tripleo17:35
*** gfidente is now known as gfidente|afk17:40
*** jpena is now known as jpena|off17:40
*** holser has joined #tripleo17:41
openstackgerritwes hayutin proposed openstack/tripleo-repos master: DNM yet, add current w/ include_pkgs to tripleo-ci-testing tag  https://review.opendev.org/71009817:44
openstackgerritwes hayutin proposed openstack/tripleo-quickstart master: WIP: add current with include_pkgs to master promotion jobs  https://review.opendev.org/71009917:45
*** jpich has quit IRC17:48
openstackgerritKevin Carter (cloudnull) proposed openstack/python-tripleoclient master: Remove the mistral from the check_deprecated_parameters workflow  https://review.opendev.org/70914117:49
*** yprokule has quit IRC17:55
*** marios|out has quit IRC17:59
weshay|ruckmwhahaha, scen1-3 centos-8 are passing.. scen04 got hit by.. a number of these errors18:02
weshay|ruck2020-02-26 16:02:16 |   - '2020-02-26 16:00:55,548 ERROR: 44422 -- Error: Failed to evict container: "": Failed to find container "container-puppet-clustercheck" in state: no container with name or ID container-puppet-clustercheck found: no such container'18:02
mwhahahaodd18:02
weshay|ruckwill run 04 again to see if that's consistent18:02
mwhahahais 004 using docker by chance?18:02
* weshay|ruck looks18:03
weshay|ruck  OS::TripleO::Services::Docker: ../../deployment/deprecated/docker/docker-baremetal-ansible.yaml18:03
weshay|ruckaye   ContainerCli: docker18:04
mwhahahayea so for centos8 we likely want to use podman18:04
weshay|ruckaye18:04
weshay|ruckwill go through those18:04
mwhahahai think we do it beause pacemaker18:04
* mwhahaha has vague recollections18:04
weshay|ruckyes18:04
mwhahahaso perhaps 004 is non-voting for centos8 until we can cut it over18:05
*** cylopez has joined #tripleo18:08
*** Goneri has quit IRC18:11
*** Goneri has joined #tripleo18:12
EmilienMweshay|ruck, mwhahaha : yes scenario004 has docker + pacemaker18:14
EmilienMIMHO we should put sc004 non voting, then when we don't run scn004 on centos7, we switch to podman18:15
EmilienMweshay|ruck: how does it sound?18:15
EmilienMare the check jobs be on centos8 right?18:15
weshay|ruckEmilienM, ya ya.. we're looking at centos-8 deployments man18:15
weshay|ruckEmilienM, please keep up18:15
weshay|ruckcentos-7 is so yesterday's news18:16
EmilienMa likely story18:16
weshay|rucklol18:17
*** chandankumar is now known as raukadah18:21
*** bfournie has joined #tripleo18:26
*** amoralej is now known as amoralej|off18:33
*** ramishra has quit IRC18:34
*** jcapitao is now known as jcapitao_off18:35
openstackgerritMerged openstack/python-tripleoclient master: Add source auth to image push  https://review.opendev.org/70981818:45
openstackgerritMerged openstack/ansible-role-collect-logs master: Add disk usage statistics  https://review.opendev.org/71000618:45
*** jmasud has quit IRC18:45
*** rlandy is now known as rlandy|mtg18:46
openstackgerritSorin Sbarnea proposed openstack/tripleo-upgrade master: WIP: linters refresh  https://review.opendev.org/71011118:47
openstackgerritEmilien Macchi proposed openstack/python-tripleoclient stable/train: Add source auth to image push  https://review.opendev.org/71011418:51
*** tosky has quit IRC18:56
openstackgerritMerged openstack/tripleo-ansible stable/train: BaR Rename the mysql_short_bootstrap_name  https://review.opendev.org/70984118:58
openstackgerritwes hayutin proposed openstack/python-tripleoclient stable/train: Add missing download_ansible_playbooks function  https://review.opendev.org/70906618:59
*** dpawlik has quit IRC19:01
openstackgerritHarald Jensås proposed openstack/tripleo-heat-templates master: ControlPlaneSubnetCidr in net_vip_map_external  https://review.opendev.org/71012019:15
openstackgerritMerged openstack/tripleo-heat-templates master: Add global groupvar to set the ansible async dir  https://review.opendev.org/70483619:16
*** dpawlik has joined #tripleo19:18
*** cylopez has quit IRC19:18
*** rlandy|mtg is now known as rlandy19:27
*** morazi has quit IRC19:27
*** avivgt has joined #tripleo19:32
openstackgerritBrent Eagles proposed openstack/tripleo-heat-templates stable/stein: Added OctaviaDeploymentConfig to deployed server role  https://review.opendev.org/71012219:35
*** pkopec has quit IRC19:35
openstackgerritMartin Mágr proposed openstack/tripleo-heat-templates master: [WIP] Remove topic suffix from default value  https://review.opendev.org/71012319:38
openstackgerritSteve Baker proposed openstack/python-tripleoclient master: New command "overcloud node extract provisioned"  https://review.opendev.org/67414119:41
openstackgerritBrent Eagles proposed openstack/tripleo-quickstart-extras master: DNM:Allow full path to be specified for amphora destination  https://review.opendev.org/69285819:45
*** jfrancoa has quit IRC19:57
*** suuuper has quit IRC19:57
*** hberaud has quit IRC20:01
*** morazi has joined #tripleo20:04
*** morazi has quit IRC20:04
*** morazi has joined #tripleo20:04
*** hberaud has joined #tripleo20:08
openstackgerritBrent Eagles proposed openstack/tripleo-heat-templates master: Sync neutron-ml2-ansible.yaml files  https://review.opendev.org/71013120:09
*** sshnaidm is now known as sshnaidm|afk20:11
*** jcapitao_off has quit IRC20:17
*** hberaud has quit IRC20:18
openstackgerritRonelle Landy proposed openstack/tripleo-quickstart master: Correct the component dlrn repo link in centos 8 master release file  https://review.opendev.org/71013420:18
openstackgerritSagi Shnaidman proposed openstack/tripleo-quickstart master: DNM: use vexxhost registry for promotion jobs  https://review.opendev.org/71013520:19
*** cylopez has joined #tripleo20:26
*** kozhukalov has quit IRC20:33
*** jdandrea has quit IRC20:35
*** kozhukalov has joined #tripleo20:36
*** jdandrea has joined #tripleo20:36
*** holser has quit IRC20:42
*** holser has joined #tripleo20:46
*** alexmcleod has quit IRC20:53
*** jcoufal has quit IRC20:59
*** cylopez has quit IRC21:06
*** pcaruana has quit IRC21:11
*** holser has quit IRC21:16
*** jmasud has joined #tripleo21:21
*** rcernin has quit IRC21:21
*** bnemec has quit IRC21:23
*** kozhukalov has quit IRC21:29
*** slaweq has quit IRC21:32
*** ansmith has quit IRC21:45
openstackgerritwes hayutin proposed openstack/tripleo-ci master: make centos-8 build containers, voting, gating  https://review.opendev.org/71009121:48
sshnaidm|afkcloudnull, last patch fixed errors with nodes, but now the deployment fails: https://logserver.rdoproject.org/16/709816/2/openstack-check/tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001/d4b0287/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz22:01
cloudnullthat's failing in something with the deploy (metalsmith) which is still using mistral at that point22:03
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: hiera-steps-tasks: new task to compute Puppet config hash  https://review.opendev.org/70979422:07
cloudnullsshnaidm|afk checking other changes in that string of reviews it looks like the fs001 job passes elsewhere22:11
cloudnullso maybe intermittent ?22:11
openstackgerritMerged openstack/python-tripleoclient master: Add handler for exception raising  https://review.opendev.org/70894222:12
*** rfolco has quit IRC22:12
*** tosky has joined #tripleo22:12
*** sshnaidm|afk has quit IRC22:23
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: hiera-steps-tasks: new task to compute Puppet config hash  https://review.opendev.org/70979422:26
openstackgerritEmilien Macchi proposed openstack/tripleo-ansible master: tripleo_container_manage: interface to skip containers that would re-run  https://review.opendev.org/71014722:26
openstackgerritMerged openstack/python-tripleoclient master: Increase ssh port timeout  https://review.opendev.org/70984322:30
openstackgerritMerged openstack/puppet-tripleo master: Add support for glance multistore  https://review.opendev.org/70437322:30
openstackgerritMerged openstack/tripleo-quickstart master: Add release files for master CentOS 8  https://review.opendev.org/70956022:30
openstackgerritMerged openstack/tripleo-quickstart master: [CentOS-8] Install ansible 2.8  https://review.opendev.org/71004922:30
openstackgerritMerged openstack/tripleo-heat-templates master: Improve the ability to enable swap  https://review.opendev.org/70901522:30
*** Goneri has quit IRC22:30
*** TrevorV has quit IRC22:38
openstackgerritMerged openstack/tripleo-common master: Do not create temporary swift URLS for ceph-ansible  https://review.opendev.org/70924922:47
openstackgerritMerged openstack/ansible-role-collect-logs master: Add the DLRN build projects.ini to the log files  https://review.opendev.org/70986822:47
*** rcernin has joined #tripleo22:49
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: Deprecate Keepalived service  https://review.opendev.org/65706722:51
*** tkajinam has joined #tripleo22:53
*** toure is now known as toure|gone23:07
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: hiera-steps-tasks: new task to compute Puppet config hash  https://review.opendev.org/70979423:08
*** bnemec has joined #tripleo23:18
*** rlandy is now known as rlandy|bbl23:18
*** xek__ has quit IRC23:37
*** ysandeep|away is now known as ysandeep23:42

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!