| *** Goneri has quit IRC | 00:13 | |
| *** Goneri has joined #oooq | 00:17 | |
| *** dsneddon has quit IRC | 00:45 | |
| *** Goneri has quit IRC | 01:05 | |
| *** dsneddon has joined #oooq | 01:12 | |
| *** dsneddon has quit IRC | 01:18 | |
| *** apetrich has quit IRC | 01:57 | |
| *** dsneddon has joined #oooq | 01:58 | |
| *** rfolco has quit IRC | 02:14 | |
| *** dsneddon has quit IRC | 02:16 | |
| *** dsneddon has joined #oooq | 02:20 | |
| *** dsneddon has quit IRC | 02:25 | |
| *** dsneddon has joined #oooq | 02:42 | |
| *** dsneddon has quit IRC | 02:47 | |
| *** dsneddon has joined #oooq | 03:43 | |
| *** dsneddon has quit IRC | 03:49 | |
| *** dsneddon has joined #oooq | 04:45 | |
| *** raukadah is now known as chandankumar | 04:48 | |
| *** dsneddon has quit IRC | 05:02 | |
| *** quiquell has joined #oooq | 05:34 | |
| *** marios has joined #oooq | 05:35 | |
| *** quiquell has quit IRC | 05:40 | |
| *** quiquell has joined #oooq | 05:40 | |
| *** ratailor has joined #oooq | 05:50 | |
| *** kopecmartin|off is now known as kopecmartin | 05:57 | |
| *** dsneddon has joined #oooq | 05:59 | |
| *** jfrancoa has joined #oooq | 06:07 | |
| *** dsneddon has quit IRC | 06:13 | |
| *** dsneddon has joined #oooq | 06:20 | |
| *** holser_ has joined #oooq | 06:25 | |
| *** jfrancoa has quit IRC | 06:26 | |
| *** dsneddon has quit IRC | 06:28 | |
| *** dsneddon has joined #oooq | 06:34 | |
| *** dsneddon has quit IRC | 06:39 | |
| *** jfrancoa has joined #oooq | 06:45 | |
| *** dsneddon has joined #oooq | 06:52 | |
| *** dsneddon has quit IRC | 06:58 | |
| *** jtomasek has joined #oooq | 07:03 | |
| *** holser_ has quit IRC | 07:12 | |
| *** holser_ has joined #oooq | 07:13 | |
| *** tesseract has joined #oooq | 07:20 | |
| *** dtantsur|afk is now known as dtantsur | 07:20 | |
| *** saneax has joined #oooq | 07:32 | |
| *** bogdando has joined #oooq | 07:32 | |
| *** dsneddon has joined #oooq | 07:51 | |
| *** jpena|off is now known as jpena | 07:54 | |
| *** apetrich has joined #oooq | 07:56 | |
| *** bogdando_ has joined #oooq | 08:07 | |
| marios | biab | 08:08 |
|---|---|---|
| *** marios has quit IRC | 08:08 | |
| *** bogdando has quit IRC | 08:09 | |
| *** bogdando_ is now known as bogdando | 08:09 | |
| *** dsneddon has quit IRC | 08:10 | |
| *** dsneddon has joined #oooq | 08:15 | |
| *** tosky has joined #oooq | 08:31 | |
| *** jfrancoa has quit IRC | 08:57 | |
| *** sshnaidm|afk is now known as sshnaidm | 09:08 | |
| *** marios has joined #oooq | 09:10 | |
| *** jfrancoa has joined #oooq | 09:12 | |
| *** dsneddon has quit IRC | 09:25 | |
| chandankumar | sshnaidm: Hello | 09:28 |
| chandankumar | sshnaidm: please have a look at this https://review.rdoproject.org/r/#/c/20902/ and https://review.rdoproject.org/r/#/c/20898/ | 09:28 |
| marios | panda: o/ you OK? anything major happening? ping me if you need ruck|rovering help | 09:28 |
| *** saneax has quit IRC | 09:28 | |
| *** rfolco has joined #oooq | 09:29 | |
| *** saneax has joined #oooq | 09:31 | |
| *** jaosorior has joined #oooq | 09:31 | |
| panda | marios: I look out of the window, and I see the beatiful green grass of Ireland. Then I look at the rhos dashboard, and it looks even greener. | 09:34 |
| *** dsneddon has joined #oooq | 09:36 | |
| *** dsneddon has quit IRC | 09:40 | |
| *** derekh has joined #oooq | 09:40 | |
| chandankumar | marios: I think we can keep the fs020 jobs running using openstack-check as it is https://review.rdoproject.org/r/#/c/20898/ ? | 09:43 |
| *** jaosorior has quit IRC | 09:47 | |
| marios | chandankumar: yeah i see it complains with your update "tripleo-ci-centos-7-ovb-1ctlr_2comp-featureset020-queens not defined" ... maybe it just needs depends-on? | 09:48 |
| *** ykarel has joined #oooq | 09:49 | |
| chandankumar | marios: I have removed those jobs I think | 09:50 |
| chandankumar | Ah I think I got the issue | 09:52 |
| marios | chandankumar: it complains about tripleo-ci-centos-7-ovb-1ctlr_2comp-featureset020-queens and that is defined at https://review.rdoproject.org/r/#/c/20902/10/zuul.d/ovb-jobs.yaml so you need depends-on i think? | 09:52 |
| chandankumar | release shoudl be in periodic jobs and brnach -override is in check jobs | 09:53 |
| *** ykarel is now known as ykarel|afk | 09:57 | |
| chandankumar | now it worked | 10:02 |
| sshnaidm | chandankumar, I don't understand - why do you hardcode branches in check jobs? | 10:11 |
| *** ykarel|afk is now known as ykarel | 10:12 | |
| *** jaosorior has joined #oooq | 10:14 | |
| chandankumar | sshnaidm: you mean https://review.rdoproject.org/r/#/c/20902/12/zuul.d/ovb-jobs.yaml@103 override-checkout? | 10:19 |
| sshnaidm | chandankumar, I mean all tripleo-ci-centos* jobs there | 10:19 |
| *** jaosorior has quit IRC | 10:19 | |
| chandankumar | I have just copied from the existing one | 10:20 |
| sshnaidm | chandankumar, from which one? | 10:21 |
| chandankumar | sshnaidm: or we want to pass the branch name something like that tripleo-ci-centos-7-ovb-1ctlr_2comp-featureset020-{branch} | 10:21 |
| sshnaidm | chandankumar, no need to mention any branch, look at tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001 definition as example | 10:22 |
| *** jaosorior has joined #oooq | 10:22 | |
| chandankumar | sshnaidm: https://github.com/rdo-infra/rdo-jobs/blob/master/zuul.d/ovb-jobs.yaml#L37 | 10:22 |
| chandankumar | ok, got it, will update the patchset | 10:23 |
| sshnaidm | chandankumar, all right, so you need to run them on specific branch to test specific release file, that makes sense | 10:25 |
| chandankumar | sshnaidm: ok, so I donot need to update those? | 10:25 |
| sshnaidm | chandankumar, I asked this from 4-th patch :) | 10:25 |
| sshnaidm | chandankumar, so you don't need only tripleo-ci-centos-7-ovb-1ctlr_2comp-featureset020-master | 10:26 |
| sshnaidm | chandankumar, usual 020 job will run on master: line 159 https://review.rdoproject.org/r/#/c/20902/12/zuul.d/ovb-jobs.yaml | 10:27 |
| chandankumar | sshnaidm: Ok, I am updating the patch | 10:28 |
| *** panda is now known as panda|ruck | 10:56 | |
| *** saneax has quit IRC | 11:10 | |
| *** amoralej|off is now known as amoralej | 11:10 | |
| *** amoralej is now known as amoralej|lunch | 11:19 | |
| *** tosky___ has joined #oooq | 11:19 | |
| *** tosky has quit IRC | 11:21 | |
| *** ratailor has quit IRC | 11:24 | |
| sshnaidm | chandankumar, why do you use override-checkout not in all jobs? | 11:25 |
| sshnaidm | chandankumar, only in 020 | 11:25 |
| *** jpena is now known as jpena|lunch | 11:32 | |
| *** dsneddon has joined #oooq | 11:36 | |
| *** dsneddon has quit IRC | 11:42 | |
| chandankumar | I am confused here | 11:45 |
| chandankumar | release is used in periodic jobs | 11:45 |
| chandankumar | branch-override in check jobs | 11:45 |
| chandankumar | and where is override-checkout used? | 11:45 |
| chandankumar | I have copied the same jobs defined earlier | 11:46 |
| chandankumar | sshnaidm: ^^ | 11:47 |
| chandankumar | in fs001, we are specifing branches only | 11:48 |
| chandankumar | sshnaidm: updated the jobs based on fs01 | 11:55 |
| *** saneax has joined #oooq | 12:02 | |
| chandankumar | rfolco: | 12:10 |
| chandankumar | Alfredo Moralejo | 12:10 |
| chandankumar | rfolco: amoralej | 12:10 |
| *** tosky___ is now known as tosky | 12:12 | |
| ykarel | rfolco, i think i mistakenly removed tempest tag https://bugs.launchpad.net/tripleo/+bug/1830351 | 12:20 |
| openstack | Launchpad bug 1830351 in tripleo "periodic-tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset020-queens fails tempest run for tempest.api.volume.admin.test_volumes_backup test group" [Critical,Triaged] - Assigned to chandan kumar (chkumar246) | 12:20 |
| ykarel | can u readd it back | 12:20 |
| ykarel | i added promotion-blocker tag | 12:20 |
| *** amoralej|lunch is now known as amoralej | 12:21 | |
| *** jpena|lunch is now known as jpena | 12:23 | |
| *** ykarel_ has joined #oooq | 12:45 | |
| *** ykarel has quit IRC | 12:47 | |
| chandankumar | marios: https://bugs.launchpad.net/tripleo/+bug/1827863 and https://bugs.launchpad.net/tripleo/+bug/1828550 closing | 12:49 |
| openstack | Launchpad bug 1827863 in tripleo "(stable/stein) standalone-upgrade job failing tempest post upgrade - test_server_security_groups" [High,Triaged] - Assigned to Marios Andreou (marios-b) | 12:49 |
| openstack | Launchpad bug 1828550 in tripleo "Rocky standalone failing in tempest.api.compute.security_groups.test_security_groups.SecurityGroupsTestJSON" [High,Triaged] - Assigned to Marios Andreou (marios-b) | 12:49 |
| *** ykarel_ has quit IRC | 12:49 | |
| chandankumar | rfolco: https://sf.hosted.upshift.rdu2.redhat.com/logs/periodic/code.engineering.redhat.com/openstack/tripleo-ci-internal-jobs/master/tripleo-ci-rhel-8-standalone-rhos-15/67b12ba/logs/tempest.html.gz | 12:52 |
| *** altlogbot_2 has quit IRC | 12:55 | |
| *** ykarel has joined #oooq | 12:56 | |
| *** altlogbot_1 has joined #oooq | 12:56 | |
| chandankumar | rfolco: https://tree.taiga.io/project/tripleo-ci-board/task/1066 | 12:57 |
| *** dsneddon has joined #oooq | 13:00 | |
| rfolco | marios, sshnaidm, weshay, panda, rlandy, arxcruz, rfolco, chkumar, zbr, kopecmartin | 13:00 |
| rfolco | ping scrum | 13:00 |
| *** Goneri has joined #oooq | 13:03 | |
| panda|ruck | chandankumar: do you know if there's a bug for https://logs.rdoproject.org/openstack-periodic-master/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-7-scenario001-standalone-master/1aa2484/job-output.txt.gz#_2019-05-27_02_15_41_431351 ? | 13:05 |
| chandankumar | panda|ruck: it is started poping up today | 13:06 |
| chandankumar | panda|ruck: in master jobs | 13:06 |
| chandankumar | panda|ruck: there is no bug for that | 13:06 |
| chandankumar | we have seen this issue earlier | 13:06 |
| panda|ruck | chandankumar: a bug to reopen then ? | 13:07 |
| panda|ruck | chandankumar: it's in master standalone for now | 13:07 |
| chandankumar | panda|ruck: i am finding the old bug | 13:08 |
| chandankumar | panda|ruck: https://bugs.launchpad.net/tripleo/+bug/1792862 | 13:11 |
| openstack | Launchpad bug 1792862 in tripleo "[master] Telemetry Tempest integration tests failed giving Unable to complete operation on subnet b13c76ec-c851-48d0-91a9-245a2fdcad9b: One or more ports have an IP allocation from this subnet." [Critical,Fix released] - Assigned to chandan kumar (chkumar246) | 13:11 |
| panda|ruck | chandankumar: seems different | 13:13 |
| chandankumar | panda|ruck: https://logs.rdoproject.org/openstack-periodic-master/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-7-scenario001-standalone-master/1aa2484/job-output.txt.gz#_2019-05-27_02_15_41_438585 | 13:14 |
| chandankumar | panda|ruck: go little down | 13:14 |
| panda|ruck | chandankumar: you mean the part with testtools.matchers._impl.MismatchError: 'CREATE_COMPLETE' != u'CREATE_FAILED': Unable to match $.stack.stack_status as CREATE_COMPLETE, got CREATE_FAILED ? | 13:16 |
| panda|ruck | chandankumar: now we have testtools.matchers._impl.MismatchError: 2 != 1: Unable to match $.servers.`len` as 2, got 1 | 13:17 |
| panda|ruck | chandankumar: I'll open a new bug | 13:17 |
| chandankumar | panda|ruck: ok, sure | 13:17 |
| panda|ruck | chandankumar: yep, because this time it means that the scaling test failed | 13:18 |
| panda|ruck | as the number of servers is still 1 | 13:18 |
| chandankumar | panda|ruck: yes, the scaling tests failed, I am seeing this one review https://review.opendev.org/#/c/661265/ | 13:19 |
| panda|ruck | chandankumar: ah I also see the same error in the bug too, so even the integration test is failing | 13:19 |
| rfolco | panda|ruck, please check bugs to ruck verify at https://tree.taiga.io/project/tripleo-ci-board/task/1086 - thanks. | 13:21 |
| *** saneax has quit IRC | 13:23 | |
| rfolco | ykarel, np I re-added tempest tag to the bug. | 13:33 |
| ykarel | rfolco, Thanks | 13:34 |
| chandankumar | panda|ruck: bug filed, please add tempest tag to it? | 13:41 |
| panda|ruck | chandankumar: which one ? | 13:42 |
| panda|ruck | chandankumar: I was reading that one again word byword | 13:42 |
| chandankumar | panda|ruck: telemetry one | 13:42 |
| panda|ruck | and even there scaling failed, so maybe it's better that I reopen the old one | 13:42 |
| chandankumar | panda|ruck: marios sshnaidm please review one more time https://review.rdoproject.org/r/#/c/20902/ thanks :-) | 13:43 |
| chandankumar | marios: I am going to attack on queens one now | 13:43 |
| panda|ruck | chandankumar: the tempest tag means that something is broken in tempest, or that a test ran by tempest failed ? | 13:43 |
| chandankumar | panda|ruck: any tempest tests failed will be tagged under that | 13:43 |
| *** udesale has joined #oooq | 13:44 | |
| chandankumar | if it is blocking upstream jobs, then we need to put it to skip list and start the investigation | 13:44 |
| chandankumar | panda|ruck: last time I was working on telemetry fix, heard that gnocchi is getting deprecated | 13:47 |
| chandankumar | I need to check with the mom dfg | 13:47 |
| panda|ruck | chandankumar: reopened, tegged promotion-blocker ci and tempest | 13:48 |
| chandankumar | so nothing got changed on telemetry-tempest-plugin side | 13:50 |
| marios | weshay: i guess we are not syncing today? | 14:02 |
| marios | weshay: i have in calendar for now | 14:02 |
| marios | weshay: np don't need something just checking | 14:03 |
| panda|ruck | marios: it's holiday in US | 14:03 |
| marios | panda|ruck: ah really (meant about his travelling more but didn't know was also holiday ) | 14:03 |
| ykarel | panda|ruck, chandankumar scenario001-standalone may be intermittent failure, i have seen this in rdoinfo gate jobs and with recheck jobs passed:- https://review.rdoproject.org/r/#/c/20896/ | 14:04 |
| ykarel | have u guys seen some consistent failures? | 14:04 |
| *** dsneddon has quit IRC | 14:05 | |
| chandankumar | ykarel: scenario1 and scenario2 broken upstream also | 14:05 |
| panda|ruck | ykarel: not enough data, yesterday it wasn't showing | 14:05 |
| ykarel | chandankumar, broken with same tempest test? | 14:05 |
| chandankumar | ykarel: telemetry tempest tests | 14:06 |
| chandankumar | https://bugs.launchpad.net/tripleo/+bug/1792862 | 14:06 |
| openstack | Launchpad bug 1792862 in tripleo "[master] Telemetry Tempest integration tests failed giving Unable to complete operation on subnet b13c76ec-c851-48d0-91a9-245a2fdcad9b: One or more ports have an IP allocation from this subnet." [Critical,Triaged] - Assigned to chandan kumar (chkumar246) | 14:06 |
| chandankumar | https://review.opendev.org/661265 and https://review.opendev.org/#/c/660748/ | 14:06 |
| chandankumar | both places it screwed | 14:06 |
| chandankumar | I am not sure at how many places it is failing | 14:07 |
| ykarel | chandankumar, ack hmm seeing consistent failures:- http://zuul.openstack.org/builds?job_name=tripleo-ci-centos-7-scenario001-standalone&job_name=tripleo-ci-centos-7-scenario002-standalone&branch=master | 14:08 |
| *** saneax has joined #oooq | 14:09 | |
| *** ykarel is now known as ykarel|afk | 14:14 | |
| chandankumar | panda|ruck: I am comparing passed and failed job | 14:21 |
| chandankumar | panda|ruck: http://logs.openstack.org/67/661267/4/check/tripleo-ci-centos-7-scenario001-standalone/7b3956d/logs/undercloud/var/log/extra/errors.txt.txt.gz | 14:21 |
| chandankumar | and http://logs.openstack.org/periodic/opendev.org/openstack/tripleo-ci/master/tripleo-ci-centos-7-scenario001-standalone/a923deb/logs/undercloud/var/log/extra/errors.txt.txt.gz | 14:21 |
| *** saneax has quit IRC | 14:24 | |
| *** saneax has joined #oooq | 14:25 | |
| *** dsneddon has joined #oooq | 14:33 | |
| chandankumar | panda|ruck: I am sure somehting is related to this https://logs.rdoproject.org/openstack-periodic-master/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-7-scenario001-standalone-master/1aa2484/logs/undercloud/var/log/containers/ceilometer/central.log.txt.gz?level=ERROR#_2019-05-27_01_52_29_529 | 14:33 |
| chandankumar | I am not able to find the unique id to link back | 14:33 |
| chandankumar | time to log off, will see ya tomorrow | 14:39 |
| *** chandankumar is now known as raukadah | 14:39 | |
| rfolco | sshnaidm, Why do we convert overcloud image to undercloud image in convert-upload-undercloud.sh script ? | 14:43 |
| sshnaidm | rfolco, I'm not sure it's relevant anymore | 14:43 |
| sshnaidm | rfolco, we used to publish undercloud image before | 14:43 |
| rfolco | sshnaidm, ok, will just skip this one... thx | 14:44 |
| *** dsneddon has quit IRC | 14:46 | |
| *** dsneddon has joined #oooq | 14:53 | |
| *** dsneddon has quit IRC | 14:58 | |
| *** dsneddon has joined #oooq | 15:06 | |
| *** quiquell has quit IRC | 15:09 | |
| *** apahim__ has quit IRC | 15:14 | |
| *** dsneddon has quit IRC | 15:15 | |
| *** jfrancoa has quit IRC | 15:28 | |
| *** bogdando has quit IRC | 15:30 | |
| raukadah | sshnaidm: I think I made the required changes https://review.rdoproject.org/r/#/c/20902/ please have a look, thanks :-) | 15:46 |
| sshnaidm | raukadah, I don't see override checkout though.. | 15:49 |
| *** dsneddon has joined #oooq | 15:50 | |
| * marios out | 15:54 | |
| *** marios has quit IRC | 15:59 | |
| *** ykarel|afk has quit IRC | 16:12 | |
| *** dsneddon has quit IRC | 16:12 | |
| *** kopecmartin is now known as kopecmartin|off | 16:39 | |
| *** dtantsur is now known as dtantsur|afk | 16:40 | |
| *** dsneddon has joined #oooq | 16:46 | |
| raukadah | sshnaidm: sorry was away | 16:47 |
| raukadah | sshnaidm: will make the changes | 16:47 |
| raukadah | sshnaidm: need +w on this https://review.opendev.org/#/c/661599/ | 16:47 |
| *** tesseract has quit IRC | 16:49 | |
| *** derekh has quit IRC | 17:00 | |
| *** dsneddon has quit IRC | 17:00 | |
| *** amoralej is now known as amoralej|off | 17:22 | |
| *** jpena is now known as jpena|off | 17:23 | |
| *** dsneddon has joined #oooq | 17:34 | |
| *** dsneddon has quit IRC | 17:52 | |
| *** holser_ has quit IRC | 17:56 | |
| *** dsneddon has joined #oooq | 18:19 | |
| *** dsneddon has quit IRC | 18:33 | |
| *** dsneddon has joined #oooq | 18:41 | |
| *** dsneddon has quit IRC | 18:45 | |
| *** dsneddon has joined #oooq | 18:46 | |
| *** tosky has quit IRC | 18:50 | |
| *** dsneddon has quit IRC | 18:53 | |
| *** dsneddon has joined #oooq | 19:28 | |
| *** dsneddon has quit IRC | 19:41 | |
| *** dsneddon has joined #oooq | 19:51 | |
| *** dsneddon has quit IRC | 19:59 | |
| *** tosky has joined #oooq | 20:16 | |
| *** jtomasek_ has joined #oooq | 20:29 | |
| *** dsneddon has joined #oooq | 20:29 | |
| *** jtomasek has quit IRC | 20:30 | |
| *** jtomasek has joined #oooq | 20:36 | |
| *** jtomasek_ has quit IRC | 20:37 | |
| *** dsneddon has quit IRC | 20:50 | |
| *** Goneri has quit IRC | 20:56 | |
| *** tosky has quit IRC | 20:58 | |
| *** sshnaidm has quit IRC | 21:40 | |
| *** sshnaidm has joined #oooq | 21:42 | |
| *** dsneddon has joined #oooq | 21:53 | |
| *** dsneddon has quit IRC | 22:06 | |
| *** dsneddon has joined #oooq | 22:47 | |
| *** dsneddon has quit IRC | 22:55 | |
| *** apetrich has quit IRC | 23:03 | |
| *** dsneddon has joined #oooq | 23:21 | |
| *** dsneddon has quit IRC | 23:27 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!