| *** rfolco has quit IRC | 01:02 | |
| *** rlandy|bbl is now known as rlandy | 02:19 | |
| *** skramaja has joined #oooq | 03:57 | |
| *** jmasud has quit IRC | 03:57 | |
| *** jfrancoa has joined #oooq | 04:04 | |
| *** ysandeep is now known as ysandeep|off | 04:24 | |
| *** ratailor has joined #oooq | 04:28 | |
| *** raukadah is now known as chkumar|rover | 04:31 | |
| *** ykarel|away has joined #oooq | 04:43 | |
| *** ykarel|away is now known as ykarel | 04:43 | |
| *** marios has joined #oooq | 05:09 | |
| *** marios is now known as marios|ruck | 05:09 | |
| *** marios|ruck has quit IRC | 05:15 | |
| *** marios has joined #oooq | 05:22 | |
| *** Tengu has quit IRC | 05:22 | |
| *** Tengu has joined #oooq | 05:24 | |
| *** udesale has joined #oooq | 05:24 | |
| chkumar|rover | ykarel: is it ok to do recheck https://review.opendev.org/#/c/744826/ so that ussuri updates job passes? | 05:29 |
|---|---|---|
| ykarel | chkumar|rover, hmm ok can do | 05:31 |
| ykarel | i see that jobs is green, so good to get in patch too | 05:31 |
| ykarel | in last recheck it passed | 05:32 |
| ykarel | so i didn't do it this time, but ok to re run | 05:32 |
| ykarel | just posted recheck | 05:32 |
| chkumar|rover | ykarel: thanks! | 05:34 |
| chkumar|rover | marios: Good morning! https://review.rdoproject.org/r/28848 and https://review.rdoproject.org/r/28847 please have a look, when free | 05:34 |
| marios | ack chkumar|rover morning will do | 05:45 |
| *** saneax has joined #oooq | 05:54 | |
| chkumar|rover | marios: I was going through the ussuri jobs, added the failed jobs in the hackmd | 06:11 |
| marios | chkumar|rover: thanks, btw don't have core @ https://review.rdoproject.org/r/#/c/28848/ | 06:15 |
| chkumar|rover | marios: no problem, jpena|off will merge that | 06:16 |
| chkumar|rover | marios: thanks for looking into that :-) | 06:16 |
| marios | chkumar|rover: :) | 06:16 |
| *** bhagyashris is now known as bhagyashris|off | 07:13 | |
| *** bogdando has joined #oooq | 07:15 | |
| chkumar|rover | marios: https://review.rdoproject.org/r/#/c/28889/ - periodic-tripleo-ci-centos-8-multinode-1ctlr-featureset030-ussuri SUCCESS in 1h 36m 22s pased | 07:33 |
| chkumar|rover | marios: let's see how the upgrade job behaves | 07:34 |
| *** jmasud has joined #oooq | 07:35 | |
| marios | chkumar|rover: ack ... but which upgrade job? | 07:39 |
| marios | chkumar|rover: ah you mean update https://review.rdoproject.org/r/#/c/28890/ | 07:39 |
| marios | thanks chkumar|rover | 07:39 |
| chkumar|rover | marios: periodic-tripleo-ci-centos-8-scenario000-multinode-oooq-container-updates-ussuri this job | 07:40 |
| *** jpena|off is now known as jpena | 07:51 | |
| *** saneax has quit IRC | 07:54 | |
| chkumar|rover | akahat: svyas arxcruz kopecmartin|pto agenda for today's tempest meeting https://hackmd.io/fIOKlEBHQfeTZjZmrUaEYQ?view#2020-08-07 feel free to update or remove it | 07:58 |
| marios | ykarel: didn't get to the first 2 chkumar|rover beat me to it left minor comments on the other 2 will check again thanks | 08:00 |
| *** tosky has joined #oooq | 08:04 | |
| *** dmellado has quit IRC | 08:09 | |
| *** dmellado has joined #oooq | 08:14 | |
| *** sshnaidm|afk is now known as sshnaidm|off | 08:19 | |
| *** saneax has joined #oooq | 08:21 | |
| *** ratailor has quit IRC | 08:21 | |
| ykarel | marios, Thanks, will check those | 08:22 |
| * ykarel going for lunch for now | 08:23 | |
| marios | chkumar|rover: any idea if weshay|ruck disabled train8 promotion? last run is from 06th https://review.rdoproject.org/zuul/builds?pipeline=openstack-periodic-integration-stable2 | 08:25 |
| marios | chkumar|rover: looking at logs | 08:25 |
| *** saneax has quit IRC | 08:27 | |
| marios | chkumar|rover: nm... i think *just* reported its there now https://review.rdoproject.org/zuul/builds?pipeline=openstack-periodic-integration-stable2 | 08:28 |
| chkumar|rover | marios: the promoter runs once a day so i think we are good there, and the job finished right now | 08:35 |
| chkumar|rover | marios: Do we want to re-trigger the promoter | 08:35 |
| chkumar|rover | so that it will promote train & ussuri also? | 08:36 |
| marios | can it really me true that train will promote | 08:37 |
| marios | chkumar|rover: :D | 08:37 |
| marios | chkumar|rover: yeah sec though double checking criteria | 08:37 |
| chkumar|rover | marios: sure | 08:37 |
| chkumar|rover | all possible jobs have passed | 08:37 |
| marios | chkumar|rover: \o/ i think so :) | 08:37 |
| marios | chkumar|rover: ok let's go then ... want to google meet & tmate? | 08:38 |
| chkumar|rover | marios: yes google meet | 08:38 |
| marios | chkumar|rover: logging in | 08:38 |
| marios | chkumar|rover: can i have 15 mins sorry... quick errand is a bit urgent | 08:39 |
| chkumar|rover | marios: sure | 08:39 |
| marios | chkumar|rover: is it ok for you at the top of the hour? | 08:39 |
| marios | chkumar|rover: in 20? | 08:39 |
| chkumar|rover | marios: yes will work for me | 08:39 |
| marios | chkumar|rover: great thanks | 08:39 |
| *** saneax has joined #oooq | 08:39 | |
| *** saneax has quit IRC | 08:40 | |
| *** derekh has joined #oooq | 08:52 | |
| chkumar|rover | marios: https://logserver.rdoproject.org/90/28890/1/check/periodic-tripleo-ci-centos-8-scenario000-multinode-oooq-container-updates-ussuri/019fa3b/logs/undercloud/home/zuul/overcloud_update_run_Controller.log.txt.gz | 09:08 |
| chkumar|rover | marios: it just started http://promoter.rdoproject.org/logs/centos8_train.log | 09:11 |
| marios | chkumar|rover: yah 2020-08-07 09:10:34,158 25357 INFO promoter Containers promote 'aggregate: 22e3f3c7337045d5a5f3ef6b6c8914a3, commit: 15e74046c12ea80c30f8874028a5d39d55031c71, distro: 33c7425dbbfaa5f3adeac4ed017b1b032e55c02d, component: validation, timestamp: 1596773121' to current-tripleo: Attempting promotion | 09:11 |
| * marios crosses eyes/fingers/hands/legs/toes | 09:11 | |
| chkumar|rover | marios: we need to fix the config source_namespace': 'tripleotrain', 'target_namespace': 'tripleotrain' | 09:13 |
| marios | chkumar|rover: where in logs? | 09:14 |
| marios | chkumar|rover: looking | 09:14 |
| chkumar|rover | promoter Passing extra vars to playbook: {'release': 'train', 'script_root': '/home/centos/ci-config', 'distro_name': 'centos', 'distro_version': '8', 'manifest_push': False, 'target_registries_push': True, 'candidate_label': 'tripleo-ci-testing', 'named_label': 'current-tripleo', 'commit_hash': '15e74046c12ea80c30f8874028a5d39d55031c71', 'distro_hash': '33c7425dbbfaa5f3adeac4ed017b1b032e55c02d', | 09:14 |
| chkumar|rover | 'full_hash': '22e3f3c7337045d5a5f3ef6b6c8914a3', 'containers_list': ['aodh-api', 'aodh-evaluator', 'aodh-listener', 'aodh-notifier', 'barbican-api', 'barbican-keystone-listener', 'barbican-worker', 'ceilometer-central', 'ceilometer-compute', 'ceilometer-notification', 'ceilometer-ipmi', 'cinder-api', 'cinder-backup', 'cinder-scheduler', 'cinder-volume', 'collectd', 'cron', 'designate-api', | 09:14 |
| chkumar|rover | 'designate-backend-bind9', 'designate-central', 'designate-mdns', 'designate-producer', 'designate-sink', 'designate-worker', 'ec2-api', 'etcd', 'glance-api', 'gnocchi-api', 'gnocchi-metricd', 'gnocchi-statsd', 'haproxy', 'heat-all', 'heat-api-cfn', 'heat-api', 'heat-engine', 'horizon', 'ironic-api', 'ironic-conductor', 'ironic-inspector', 'ironic-pxe', 'ironic-neutron-agent', 'iscsid', 'keepalived', | 09:14 |
| chkumar|rover | 'keystone', 'manila-api', 'manila-scheduler', 'manila-share', 'mariadb', 'memcached', 'mistral-api', 'mistral-engine', 'mistral-executor', 'mistral-event-engine', 'multipathd', 'neutron-dhcp-agent', 'neutron-l3-agent', 'neutron-metadata-agent', 'neutron-openvswitch-agent', 'neutron-sriov-agent', 'neutron-server-ovn', 'neutron-metadata-agent-ovn', 'nova-api', 'nova-compute-ironic', 'nova-compute', | 09:14 |
| chkumar|rover | 'nova-conductor', 'nova-libvirt', 'nova-novncproxy', 'nova-scheduler', 'nova-serialproxy', 'novajoin-notifier', 'novajoin-server', 'octavia-api', 'octavia-health-manager', 'octavia-housekeeping', 'octavia-worker', 'ovn-controller', 'ovn-nb-db-server', 'ovn-northd', 'ovn-sb-db-server', 'panko-api', 'placement-api', 'qdrouterd', 'rabbitmq', 'redis', 'sahara-api', 'sahara-engine', 'swift-account', | 09:14 |
| chkumar|rover | 'swift-container', 'swift-object', 'swift-proxy-server', 'tripleoclient', 'zaqar-wsgi', 'tempest', 'rsyslog'], 'source_namespace': 'tripleotrain', 'target_namespace': 'tripleotrain'} | 09:14 |
| chkumar|rover | sorry | 09:14 |
| marios | chkumar|rover: yeah np i see it though | 09:14 |
| marios | chkumar|rover: on tmux? | 09:16 |
| marios | get back on we can do it now? | 09:16 |
| marios | chkumar|rover: | 09:16 |
| chkumar|rover | yes | 09:16 |
| chkumar|rover | let join back | 09:16 |
| marios | chkumar|rover: also joining meet again | 09:17 |
| chkumar|rover | yes | 09:17 |
| *** ratailor has joined #oooq | 09:24 | |
| chkumar|rover | marios: https://review.rdoproject.org/r/#/c/28893/ | 09:24 |
| marios | chkumar|rover: yes :) ++ | 09:25 |
| *** dtantsur|afk is now known as dtantsur | 09:30 | |
| *** ratailor_ has joined #oooq | 09:32 | |
| *** ratailor has quit IRC | 09:35 | |
| chkumar|rover | marios: arxcruz https://communityblog.fedoraproject.org/nest-with-fedora-registration-now-open/ starting today if interested | 09:46 |
| chkumar|rover | it is free | 09:46 |
| marios | thanks chkumar|rover will check | 09:46 |
| marios | https://bugs.launchpad.net/tripleo/+bug/1890798 luckily is not gate blocker | 09:52 |
| openstack | Launchpad bug 1890798 in tripleo "periodic centos8 Ussuri multinode minor update job fails: tderr": "Error: resource 'ip-192.168.24.16' is not running on any node" [Critical,Triaged] | 09:52 |
| chkumar|rover | marios: thanks! | 09:54 |
| *** ykarel has quit IRC | 10:16 | |
| *** ykarel has joined #oooq | 10:16 | |
| chkumar|rover | marios: https://trunk.rdoproject.org/centos8-train/current-tripleo/ train promoted \0/ | 10:28 |
| *** ykarel has quit IRC | 10:31 | |
| marios | chkumar|rover: \o/ | 10:33 |
| marios | woo | 10:33 |
| marios | chkumar|rover: let's go pub | 10:33 |
| *** ykarel has joined #oooq | 10:35 | |
| chkumar|rover | marios: hehe, I am living in a dry state | 10:35 |
| marios | chkumar|rover: :) | 10:36 |
| arxcruz | chkumar|rover: https://3f62b4ad98707906215f-a6d8fe9727d1386fddbc5723b731175d.ssl.cf5.rackcdn.com/745121/3/check/tripleo-ci-centos-7-containers-multinode-queens/2512a98/job-output.txt | 10:38 |
| arxcruz | need your help, since you know these configs | 10:38 |
| chkumar|rover | arxcruz: let me check | 10:38 |
| chkumar|rover | arxcruz: tempest_private_net_seg_id: '' should be empty | 10:55 |
| chkumar|rover | otherwise it will not work | 10:55 |
| arxcruz | are you sure? | 10:55 |
| chkumar|rover | yes | 10:55 |
| chkumar|rover | arxcruz: http://codesearch.openstack.org/?q=tempest_private_net_seg_id%3A&i=nope&files=&repos= | 10:56 |
| *** Tengu has quit IRC | 11:01 | |
| *** Tengu has joined #oooq | 11:03 | |
| *** ykarel has quit IRC | 11:05 | |
| *** ykarel has joined #oooq | 11:05 | |
| *** ykarel has quit IRC | 11:10 | |
| *** ykarel has joined #oooq | 11:11 | |
| weshay|ruck | 0/ | 11:22 |
| marios | weshay|ruck: o/ source_namespace: tripleotraincentos8 | 11:22 |
| marios | target_namespace: tripleotraincentos8 | 11:22 |
| marios | http://dashboard-ci.tripleo.org/d/QrkFP-zGz/upstream-and-rdo-promotions?orgId=1&fullscreen&panelId=18 | 11:22 |
| marios | weshay|ruck: sorry wrong paste initially see ^^ | 11:22 |
| weshay|ruck | chkumar|rover, oh.. I thought we'd get a free google nest when we register our fedora workstation lolz | 11:23 |
| weshay|ruck | lolz | 11:23 |
| weshay|ruck | ur right | 11:23 |
| chkumar|rover | weshay|ruck: https://review.rdoproject.org/r/28893 | 11:23 |
| * weshay|ruck sends a high five to marios | 11:23 | |
| * marios rebounds a "ha faaaiv" to chkumar|rover | 11:24 | |
| * chkumar|rover sends back | 11:24 | |
| * weshay|ruck cross over dribbles... and dunks a red hat reward across the team... BAM | 11:24 | |
| marios | # cool. story. BRO! | 11:25 |
| weshay|ruck | lol.. who are you emilien | 11:25 |
| weshay|ruck | that's his catch phrase | 11:25 |
| marios | weshay|ruck: hey that was mine i started it in upgrades | 11:25 |
| weshay|ruck | cool city brno | 11:25 |
| marios | weshay|ruck: :D i will fight emilien for it | 11:25 |
| weshay|ruck | marios++ is the OG | 11:25 |
| marios | weshay|ruck: it was somthing like ' so instead we're gonna do this things to fast forward 3 versions' | 11:26 |
| marios | and i was like | 11:26 |
| marios | cool story bro | 11:26 |
| weshay|ruck | lolz.. | 11:27 |
| weshay|ruck | brb | 11:28 |
| *** jpena is now known as jpena|lunch | 11:32 | |
| marios | weshay|ruck: chkumar|rover: any idea off hand why some components didn't run yesterday? e.g. source_namespace: tripleotraincentos8 | 11:44 |
| marios | target_namespace: tripleotraincentos8 | 11:44 |
| marios | https://review.rdoproject.org/zuul/builds?pipeline=openstack-component-swift | 11:44 |
| marios | weshay|ruck: chkumar|rover: ^^^ that also https://review.rdoproject.org/zuul/builds?pipeline=openstack-component-security | 11:44 |
| weshay|ruck | marios, chkumar|rover fyi https://code.engineering.redhat.com/gerrit/208368 | 11:44 |
| chkumar|rover | marios: may be got stuck due to network issue | 11:45 |
| marios | chkumar|rover: yeah maybe... i was thinking that too but i would expect some node_fails or _something_ | 11:45 |
| chkumar|rover | marios: zuul executor is itself on vexxhost | 11:45 |
| chkumar|rover | so no result | 11:46 |
| marios | chkumar|rover: ack makes sense thanks let's hope we get it today | 11:46 |
| chkumar|rover | yes | 11:46 |
| chkumar|rover | weshay|ruck: checking | 11:46 |
| marios | chkumar|rover: i was looking at security we have bug there but it has little progress | 11:46 |
| marios | chkumar|rover: source_namespace: tripleotraincentos8 | 11:46 |
| marios | target_namespace: tripleotraincentos8 | 11:46 |
| marios | oh for god's sake this paste ! | 11:46 |
| marios | chkumar|rover: https://bugs.launchpad.net/tripleo/+bug/1890266 | 11:46 |
| openstack | Launchpad bug 1890266 in tripleo "centos 8 security component + integration pipeline master - Failed container(s): ['nova_wait_for_api_service" [Critical,Triaged] | 11:46 |
| chkumar|rover | it was coming in fs039 na? | 11:47 |
| * chkumar|rover checks again | 11:47 | |
| chkumar|rover | marios: yes security component as well as fs039 | 11:48 |
| marios | chkumar|rover: yeah | 11:49 |
| weshay|ruck | chkumar|rover, so is the vexhost registry back? | 11:53 |
| * weshay|ruck looks | 11:53 | |
| chkumar|rover | weshay|ruck: yes sir | 11:53 |
| chkumar|rover | weshay|ruck: all is working normal | 11:53 |
| weshay|ruck | nice | 11:53 |
| weshay|ruck | chkumar|rover, well..except for vex | 11:54 |
| weshay|ruck | oh I lie.. master is running on rdo | 11:55 |
| chkumar|rover | ussuri was good today except upgrade job | 11:55 |
| weshay|ruck | chkumar|rover, marios anyone want to tmate w/ me as a fix http://dashboard-ci.tripleo.org/d/wb8HBhrWk/cockpit?orgId=1&fullscreen&panelId=231 | 11:55 |
| weshay|ruck | will probably fix https://logserver.rdoproject.org/openstack-periodic-integration-stable1/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-8-ovb-3ctlr_1comp-featureset001-ussuri/fc7eb97/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz | 11:56 |
| chkumar|rover | weshay|ruck: yes | 11:56 |
| weshay|ruck | k.. starting here | 11:58 |
| weshay|ruck | https://docs.google.com/document/d/1bHVPN-lcXyY7imLdvj2J7I55s-vtF3ffPG-y2Cj8u38/edit#heading=h.q5iy2cx16xoi | 11:58 |
| *** rfolco has joined #oooq | 12:00 | |
| marios | weshay|ruck: joining promoter sync for few mins? wana do after? | 12:00 |
| weshay|ruck | arxcruz, https://linuxconfig.org/how-to-install-docker-in-rhel-8 | 12:04 |
| *** rlandy has joined #oooq | 12:16 | |
| arxcruz | Problem: package docker-ce-3:19.03.12-3.el7.x86_64 requires containerd.io >= 1.2.2-3, but none of the providers can be installed | 12:17 |
| arxcruz | marios: rfolco ^ | 12:18 |
| chkumar|rover | arxcruz: check my notes on promoter doc | 12:18 |
| arxcruz | chkumar|rover: yeah, we are just discussing about it :) | 12:19 |
| chkumar|rover | arxcruz: https://hackmd.io/M1IjwgcPQLK_ttOLFUSPHQ#Chandan-Kumar%E2%80%99s-notes | 12:19 |
| *** ykarel has quit IRC | 12:26 | |
| chkumar|rover | arxcruz: akahat svyas weshay|ruck tempest meeting time | 12:30 |
| arxcruz | chkumar|rover: sec, me and weshay|ruck are in another meeting | 12:30 |
| chkumar|rover | ok | 12:31 |
| weshay|ruck | chkumar|rover, marios ok.. fixed http://dashboard-ci.tripleo.org/d/wb8HBhrWk/cockpit?orgId=1&fullscreen&panelId=231 | 12:33 |
| marios | thanks weshay|ruck | 12:36 |
| *** jpena|lunch is now known as jpena | 12:36 | |
| *** ratailor_ has quit IRC | 12:43 | |
| *** udesale_ has joined #oooq | 12:44 | |
| *** udesale has quit IRC | 12:47 | |
| rlandy | chkumar|rover: fyi ... https://bugzilla.redhat.com/show_bug.cgi?id=1867132 Buildah package upgrade from 1.14.9 ->1.15.x for rhos-16.2-rhel-8-trunk-build | 12:52 |
| openstack | bugzilla.redhat.com bug 1867132 in distribution "Buildah package upgrade from 1.14.9 ->1.15.x for rhos-16.2-rhel-8-trunk-build" [Unspecified,New] - Assigned to lhh | 12:52 |
| rlandy | chkumar|rover: due to config, the depends-on changes didn't take | 12:53 |
| rlandy | but we got one passing job | 12:53 |
| rlandy | with container push and dockerfile upload | 12:53 |
| chkumar|rover | rlandy: yup | 12:54 |
| chkumar|rover | rlandy: https://review.opendev.org/745311 | 12:54 |
| rlandy | weshay|ruck: where did you and sshnaidm|off leave the conversation on toci and the usptream repo installs? | 12:55 |
| weshay|ruck | sec | 12:55 |
| rlandy | chkumar|rover: thanks | 12:56 |
| weshay|ruck | chkumar|rover, marios yatin is probably the best reviewer here: but FYI https://review.rdoproject.org/r/#/c/28897/1/jenkins/jobs/scripts/centos-train-current-tripleo.sh https://review.opendev.org/#/c/745327/1/config/release/centosci/train-current-tripleo.yml | 13:25 |
| weshay|ruck | rlandy, k.. help me remember the context please | 13:25 |
| rlandy | sec | 13:29 |
| rfolco | chkumar|rover, weshay|ruck rlandy arxcruz any good soul could please review/merge this small one ? https://review.rdoproject.org/r/28831 | 13:29 |
| rfolco | arxcruz, I could be stealing, killing, kidnapping... but I am just asking your review | 13:30 |
| rfolco | thanks chkumar|rover arxcruz | 13:31 |
| rfolco | arxcruz, perhaps you don't know what is that famous argument for asking money on semaphores anymore, now that you are living in europe | 13:32 |
| chkumar|rover | marios: I am logging out now | 13:32 |
| chkumar|rover | see ya on monday | 13:32 |
| *** chkumar|rover is now known as raukadah | 13:32 | |
| rfolco | and thx rlandy :) | 13:33 |
| arxcruz | rfolco: yeah, i had to read twice to remember lol | 13:33 |
| rlandy | weshay|ruck: when running tests that run toci - standalone for example, if we remove the upstream repos, toci fails - expecting t install those repos | 13:33 |
| rlandy | tripleo-ansible | 13:33 |
| rlandy | collections | 13:33 |
| * rlandy gets line | 13:33 | |
| rfolco | arxcruz, you are now a gringo, if you return to brazil, you are an easy target to robbers on copacabana beach | 13:34 |
| arxcruz | rfolco: I'm from Salvador, I know where to not go | 13:35 |
| arxcruz | besides, i hate rio and sao paulo with all my strength | 13:35 |
| arxcruz | i would never go there :) | 13:35 |
| arxcruz | I hated when we had to travel to tutoia for those boring meetings | 13:36 |
| rfolco | arxcruz, oxi | 13:36 |
| arxcruz | rfolco: clap hands meetings | 13:36 |
| rlandy | https://github.com/openstack/tripleo-ci/blob/master/roles/run-test/templates/toci_gate_test.sh.j2 ( need to change path here) | 13:36 |
| marios | o/ raukadah have a good one! | 13:38 |
| rlandy | weshay|ruck: https://opendev.org/openstack/tripleo-quickstart/src/branch/master/quickstart.sh#L144 | 13:41 |
| weshay|ruck | rlandy, ah right.. we talked about it.. but didn't get much. let me look at that today | 13:43 |
| *** ykarel has joined #oooq | 14:02 | |
| rlandy | weshay|ruck: just testing out buildah packages - will look into ^^ afterwards | 14:03 |
| weshay|ruck | marios, fyi https://review.rdoproject.org/r/#/c/28899/ | 14:10 |
| weshay|ruck | rlandy, I'm running some local tests w/ the role and collection setupo | 14:10 |
| rlandy | weshay|ruck: great - thanks | 14:11 |
| marios | weshay|ruck: looking | 14:21 |
| marios | weshay|ruck: ack ok for c*7* | 14:21 |
| weshay|ruck | rlandy, ok.. so on the local install side of things... | 14:23 |
| weshay|ruck | rlandy, that code in quickstart.sh makes no diff whether it's there or not | 14:24 |
| weshay|ruck | operator-ansible and collections wind up on the same path | 14:24 |
| rlandy | so we can just ditch it | 14:24 |
| weshay|ruck | rlandy, well | 14:24 |
| weshay|ruck | not 100% sure yet | 14:24 |
| weshay|ruck | if [ -x "$ZUUL_CLONER" ] && [ ! -z "$ZUUL_BRANCH" ]; then | 14:24 |
| weshay|ruck | so just to confirm | 14:24 |
| weshay|ruck | what we're saying here | 14:24 |
| weshay|ruck | if ZUUL_CLONER is defined and ZUUL_BRANCH is not null? | 14:26 |
| weshay|ruck | rlandy, https://review.opendev.org/#/c/745346/ | 14:29 |
| weshay|ruck | rlandy, just proceeding carefully for a use case I'm not familiar w/ | 14:30 |
| rlandy | weshay|ruck: ok - I won't force merge that | 14:34 |
| *** ysandeep|off is now known as ysandeep | 14:51 | |
| rlandy | ysandeep: hi - thought you were out today? | 14:53 |
| ysandeep | rlandy, Hey o/ I was, Just logged in to see what's going with our 16.2 work so that I can pick it up on monday | 14:54 |
| rlandy | ysandeep: we have good news and bad news .... | 14:57 |
| rlandy | we have a set of containers uploaded | 14:57 |
| rlandy | so you can continue | 14:57 |
| rlandy | but we need to switch to rhel 8.3 | 14:57 |
| rlandy | so that may cause issues | 14:57 |
| rlandy | I am testing | 14:58 |
| ysandeep | rlandy, rhel 8.3, Because of that buildah package version? | 14:58 |
| rlandy | because 16.2 is based off rhel 8.3 now - eventually 8.4 | 14:59 |
| ysandeep | rlandy, okay, we will even not using rhel 8 | 15:01 |
| ysandeep | 8.3 with rhos17 | 15:01 |
| rlandy | ysandeep: 17 will probably be another version | 15:01 |
| weshay|ruck | rlandy, are packages not updating to the latest base? | 15:08 |
| *** yolanda has quit IRC | 15:12 | |
| *** yolanda has joined #oooq | 15:13 | |
| rlandy | weshay|ruck: in reference to which packages? | 15:14 |
| weshay|ruck | rlandy, rhel 8.1 -> 8.2 | 15:15 |
| rlandy | weshay|ruck: I don't think that is an issue - idk | 15:15 |
| rlandy | we're talking 8.3 | 15:15 |
| weshay|ruck | ok | 15:17 |
| *** ykarel is now known as ykarel|away | 15:34 | |
| ysandeep | rlandy, minor comment here - https://review.opendev.org/#/c/744166/3/roles/build-containers/vars/main.yaml | 15:36 |
| rlandy | k | 15:37 |
| *** skramaja has quit IRC | 15:45 | |
| *** marios is now known as marios|out | 15:59 | |
| *** marios|out has quit IRC | 16:04 | |
| *** dtantsur is now known as dtantsur|afk | 16:04 | |
| *** jpena is now known as jpena|off | 16:10 | |
| *** dtantsur|afk has quit IRC | 16:11 | |
| *** bogdando has quit IRC | 16:15 | |
| *** ysandeep is now known as ysandeep|off | 16:19 | |
| *** udesale_ has quit IRC | 16:41 | |
| *** derekh has quit IRC | 17:01 | |
| rlandy | weshay|ruck: your patch is under test in internal | 17:48 |
| weshay|ruck | heh | 17:48 |
| rlandy | well so far life if just fine without those tripleo quickstart installs | 17:58 |
| weshay|ruck | rlandy, https://zuul.openstack.org/stream/e925747832114ab1bb8f74dfeac8d83b?logfile=console.log | 17:59 |
| weshay|ruck | ya.. standalone thinks it's ok thus far | 17:59 |
| weshay|ruck | rlandy, /me wonders about ci.centos | 17:59 |
| weshay|ruck | I'll try a local run I suppose | 17:59 |
| rlandy | weshay|ruck: that code must be there for a reason | 18:09 |
| rlandy | but it's only centos, we can switch case it | 18:09 |
| rlandy | https://sf.hosted.upshift.rdu2.redhat.com/zuul/t/tripleo-ci-internal/stream/05f46914c1f94848955ed968a1ee394a?logfile=console.log | 18:09 |
| rlandy | just fine so far | 18:09 |
| rlandy | maybe upgrades needs it | 18:09 |
| weshay|ruck | k | 18:09 |
| *** ykarel|away has quit IRC | 18:19 | |
| rlandy | weshay|ruck: anything ruck/rover -wise for next week? | 18:30 |
| rlandy | who has access to promoter? | 18:30 |
| weshay|ruck | rlandy, both marios and chandan | 18:32 |
| rlandy | ok | 18:32 |
| *** ykarel has joined #oooq | 18:42 | |
| weshay|ruck | rlandy, fyi.. build_id artifact as file in the logs https://review.opendev.org/#/c/745385/ | 18:51 |
| weshay|ruck | thinking about pulling that for monitoring and adding a column to each job w/ the build id | 18:51 |
| weshay|ruck | rlandy, let me know if you have any thoughts around that | 18:51 |
| rlandy | looking | 18:52 |
| rlandy | weshay|ruck: commented | 18:56 |
| rlandy | not sure what extra value this gives | 18:57 |
| rlandy | if we are not capturing the hash, that should be added to get_hash | 18:57 |
| rlandy | is that just missing for check jobs? | 18:58 |
| *** ykarel is now known as ykarel|away | 19:00 | |
| weshay|ruck | rlandy, so.. we have a promotion problem | 19:01 |
| weshay|ruck | centos-8 train promoted chandan and marios told me so... ykarel is reporting missing containers | 19:01 |
| weshay|ruck | I'm seeing the right container for https://hub.docker.com/r/tripleotraincentos8/centos-binary-openstack-base/tags?page=1&name=22e3f3c7337045d5a5f3ef6b6c8914a3 | 19:01 |
| weshay|ruck | https://hub.docker.com/r/tripleotraincentos8/centos-binary-rsyslog/tags?page=1&name=22e3f3c7337045d5 | 19:02 |
| rlandy | weshay|ruck: which containers are missing then? | 19:02 |
| weshay|ruck | but vwala | 19:02 |
| weshay|ruck | neutron-server is missing | 19:02 |
| weshay|ruck | | requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http://mirror.iad.rax.opendev.org:8082/v2/tripleotraincentos8/centos-binary-neutron-server/manifests/22e3f3c7337045d5a5f3ef6b6c8914a3 | 19:02 |
| weshay|ruck | https://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_ab1/745173/2/check/tripleo-ci-centos-8-containers-multinode-train/ab18778/logs/undercloud/home/zuul/undercloud_install.log | 19:02 |
| rlandy | hmmm .. did we fall into that jijna condition? | 19:03 |
| weshay|ruck | which I think is a overcloud_containers.j2 vs.yaml issue | 19:03 |
| weshay|ruck | ya | 19:03 |
| rlandy | yes | 19:03 |
| rlandy | I think chandan had a change in there to set neutron to something | 19:03 |
| rlandy | we fixed this once before | 19:04 |
| weshay|ruck | rlandy, anyhoo | 19:04 |
| rlandy | we switched to the non-j2 | 19:04 |
| weshay|ruck | ya... I suspect I'll have to manually promote the missing containers | 19:04 |
| rlandy | in the ini file | 19:04 |
| weshay|ruck | ya | 19:04 |
| rlandy | what's there now? | 19:04 |
| * weshay|ruck looks | 19:05 | |
| weshay|ruck | rlandy, http://promoter.rdoproject.org/config/CentOS-8/train.ini | 19:06 |
| rlandy | weshay|ruck: ok - so we need to fix the ini and run manual promoter | 19:06 |
| rlandy | like in hackmd | 19:07 |
| * rlandy gets onto promoter server | 19:07 | |
| weshay|ruck | rlandy, luckily it's here https://registry.rdoproject.org:8443/oapi/v1/namespaces/tripleotraincentos8/imagestreamtags/ | 19:07 |
| weshay|ruck | centos-binary-neutron-server:22e3f3c7337045d5a5f3ef6b6c8914a3 | 19:07 |
| rlandy | weshay|ruck: ok - do you have tmate open on promoter? | 19:08 |
| weshay|ruck | rlandy, | 19:09 |
| weshay|ruck | aye | 19:09 |
| weshay|ruck | rlandy, going to pull and push some containers here | 19:10 |
| weshay|ruck | https://gist.github.com/weshayutin/692c80f2d4179dcf2108265bd9218bc9 | 19:10 |
| rlandy | weshay|ruck: rather than running manual promotion? | 19:10 |
| rlandy | we need to fix the ini anyways | 19:10 |
| weshay|ruck | aye | 19:12 |
| rlandy | weshay|ruck: ok - whatever works but we will hit this issue on next promotion | 19:13 |
| weshay|ruck | rlandy, ya.. can you work on the config please while I pull and push containers | 19:14 |
| rlandy | weshay|ruck: standalone on 17 just passed | 19:14 |
| rlandy | with your patch | 19:14 |
| rlandy | weshay|ruck++ | 19:14 |
| weshay|ruck | cool.. | 19:14 |
| rlandy | weshay|ruck: sure - let we can manually promote if you get tired | 19:15 |
| rlandy | one line :) | 19:15 |
| rlandy | weshay|ruck: see my change on tmux? ok? | 19:19 |
| rlandy | I saved it - fee free to change it back | 19:21 |
| weshay|ruck | rlandy, k.. /me looks.. neutorn-server is uploading now | 19:21 |
| weshay|ruck | rlandy, from that jinja are we missing any others? | 19:21 |
| * weshay|ruck looks | 19:21 | |
| rlandy | weshay|ruck: if we are I'd like to manually promote so we can test the change | 19:22 |
| rlandy | force promote that hash | 19:22 |
| weshay|ruck | rlandy, ah.. that is an idea too | 19:22 |
| weshay|ruck | rlandy, one sec though this is almost done | 19:23 |
| rlandy | k | 19:23 |
| rlandy | weshay|ruck: in the mean time, what should we about https://review.opendev.org/#/c/745346/ | 19:24 |
| rlandy | bring it to scrum on monday? | 19:24 |
| * rlandy know you are out | 19:24 | |
| rlandy | does spring downstream free | 19:24 |
| weshay|ruck | rlandy, https://opendev.org/openstack/tripleo-common/src/branch/stable/train/container-images/overcloud_containers.yaml.j2#L549-L565 | 19:24 |
| weshay|ruck | rlandy, I think that's it right? | 19:24 |
| weshay|ruck | rlandy, https://hub.docker.com/r/tripleotraincentos8/centos-binary-neutron-server/tags?page=1&name=22e3f3c7337045d5a5f3ef6b6c8914a3 | 19:25 |
| rlandy | that is the condition that excludes the containers, right | 19:25 |
| rlandy | nice - it's there | 19:25 |
| weshay|ruck | or it's all of those | 19:25 |
| weshay|ruck | neturonapi | 19:25 |
| weshay|ruck | etc.. | 19:25 |
| rlandy | we need them all uploaded | 19:26 |
| rlandy | each one is used in a different scenario | 19:26 |
| weshay|ruck | rlandy, so manual push is best bet then | 19:31 |
| rlandy | ok - let's do this thing | 19:31 |
| rlandy | weshay|ruck: I'm on tmux | 19:32 |
| weshay|ruck | rlandy, aye | 19:32 |
| rlandy | weshay|ruck: we need ag hash, commit hash, distro hash | 19:33 |
| weshay|ruck | so.. | 19:34 |
| weshay|ruck | 22e3f3c7337045d5a5f3ef6b6c8914a3 | 19:34 |
| weshay|ruck | and | 19:34 |
| weshay|ruck | commit_hash: 15e74046c12ea80c30f8874028a5d39d55031c71 | 19:34 |
| weshay|ruck | distro_hash: 33c7425dbbfaa5f3adeac4ed017b1b032e55c02d | 19:34 |
| weshay|ruck | from validations? | 19:35 |
| weshay|ruck | as it's last? | 19:35 |
| weshay|ruck | rlandy, ^ | 19:35 |
| rlandy | k .. pasting command ... | 19:35 |
| rlandy | let me confirm distro hash - one sec | 19:37 |
| weshay|ruck | rlandy, promoter Dlrn promote 'aggregate: 22e3f3c7337045d5a5f3ef6b6c8914a3, commit: 15e74046c12ea80c30f8874028a5d39d55031c71, distro: 33c7425dbbfaa5f3adeac4ed017b1b032e55c02d, component: validation, timestamp: 1596773121' from tripleo-ci-testing to current-tripleo: (subhash aggregate: b1c8141f555f2423cc246d9c020fc60f, commit: cb24eb9d0d38d16195b8cdd6c04ded892de4fb3a, distro: 4acaff5b0437c615562fa2860fdd48abd11117d6, component: network, | 19:37 |
| weshay|ruck | timestamp: None) Successfully promoted | 19:37 |
| weshay|ruck | rlandy, ya.. promoter confirms it | 19:37 |
| weshay|ruck | those are the right values | 19:37 |
| *** ykarel|away has quit IRC | 19:38 | |
| weshay|ruck | this logging sucks | 19:38 |
| rlandy | weshay|ruck: ok - see command on tmux? | 19:38 |
| * weshay|ruck looks | 19:38 | |
| rlandy | ok to run? | 19:38 |
| * weshay|ruck double checks | 19:38 | |
| rlandy | ini is changed | 19:39 |
| rlandy | so we could see trouble | 19:39 |
| weshay|ruck | rlandy, all values are correct | 19:39 |
| rlandy | weshay|ruck: k - let' try this | 19:39 |
| rlandy | here we go | 19:40 |
| weshay|ruck | rlandy++ | 19:40 |
| weshay|ruck | thank you | 19:40 |
| rlandy | weshay|ruck: let's see if it works first | 19:40 |
| weshay|ruck | rlandy, cheating.. / using yatins job to test that tq patch :) https://ci.centos.org/view/rdo/view/tripleo-gate/job/tripleo-quickstart-gate-master-delorean-full-ykarel-featureset052/ | 19:55 |
| weshay|ruck | thanks yatin | 19:55 |
| rlandy | cool | 19:56 |
| rlandy | weshay|ruck: did you know that module_hotfixes=1 take preference in repos? I did not /o\ | 20:00 |
| arxcruz | OMG | 20:01 |
| arxcruz | OMG | 20:01 |
| arxcruz | OMG | 20:01 |
| arxcruz | raukadah: weshay|ruck https://d4425aae35dc8050b142-eecb7ff79b5c6e121d6c20fabad8af79.ssl.cf5.rackcdn.com/745121/3/check/tripleo-ci-centos-7-containers-multinode-queens/8afae4c/logs/undercloud/var/log/tempest/stestr_results.html | 20:01 |
| arxcruz | os_tempest running on queens!!! | 20:01 |
| weshay|ruck | NICE | 20:01 |
| * arxcruz opens a beer | 20:01 | |
| weshay|ruck | rlandy, I'm not very familiar w/ yum modules | 20:02 |
| weshay|ruck | arxcruz, nice work dude | 20:02 |
| weshay|ruck | rlandy, centos-8 train repromoted successfully | 20:38 |
| rlandy | weshay|ruck: yay | 20:39 |
| rlandy | that's a handy tool panda built | 20:39 |
| *** jfrancoa has quit IRC | 20:39 | |
| rlandy | weshay|ruck: guess I'll do something about trying to promote networking on 17 next week | 20:53 |
| *** rfolco has quit IRC | 20:57 | |
| *** rlandy has quit IRC | 21:18 | |
| *** tosky has quit IRC | 22:58 | |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!