| *** jmasud has quit IRC | 00:06 | |
| *** jmasud has joined #oooq | 00:27 | |
| *** rfolco has quit IRC | 00:30 | |
| *** jmasud has quit IRC | 00:39 | |
| *** jmasud has joined #oooq | 00:46 | |
| *** jmasud has quit IRC | 00:47 | |
| *** jmasud has joined #oooq | 01:12 | |
| *** jmasud has quit IRC | 01:29 | |
| *** Goneri has quit IRC | 01:37 | |
| *** apetrich has quit IRC | 02:09 | |
| *** ysandeep|away is now known as ysandeep|rover | 02:11 | |
| ysandeep|rover | weshay|ruck, o/ | 02:18 |
|---|---|---|
| ysandeep|rover | dlrn purge again.. face palm :D | 02:22 |
| *** jmasud has joined #oooq | 02:28 | |
| *** sanjayu__ has quit IRC | 02:47 | |
| *** jmasud has quit IRC | 03:00 | |
| *** hamzy_ has joined #oooq | 03:29 | |
| *** hamzy has quit IRC | 03:31 | |
| *** ysandeep|rover is now known as ysandeep|BRB | 04:08 | |
| *** ysandeep|BRB is now known as ysandeep|rover | 04:23 | |
| *** ykarel|away is now known as ykarel | 04:25 | |
| ykarel | ysandeep|rover, what dlrn purge? | 04:26 |
| ysandeep|rover | ykarel, yes please check email from wes | 04:27 |
| ykarel | ysandeep|rover, ack looking | 04:27 |
| ykarel | hmm something is wrong,, looking | 04:30 |
| ysandeep|rover | ykarel, ack .. i am looking on https://bugs.launchpad.net/tripleo/+bug/1872881 in the meantime | 04:31 |
| openstack | Launchpad bug 1872881 in tripleo "Cinder volume failed to build and went to ERROR state - No valid backend was found ( Stderr: ' Volume group "cinder-volumes" not found\n)" [Critical,Triaged] | 04:31 |
| ysandeep|rover | master gate jobs are affected due to this ^^.. checking further | 04:31 |
| ykarel | ack | 04:32 |
| *** jmasud has joined #oooq | 04:38 | |
| ykarel | ysandeep|rover, i checked, keystoneclient is fine | 04:43 |
| ykarel | last promotion for clients was on 10th April | 04:43 |
| ykarel | https://trunk.rdoproject.org/api-centos8-master-uc/api/report.html?package=python-keystoneclient | 04:44 |
| ykarel | and keystoneclient 4.0.0 got into consistent on 13th | 04:44 |
| ysandeep|rover | ykarel, ack , no issue with purge script then? | 04:48 |
| ykarel | ysandeep|rover, doesn't seem that | 04:48 |
| ykarel | i will do some more checks | 04:48 |
| ykarel | but if u have more detail i can check in that direction | 04:49 |
| ysandeep|rover | ykarel, wes only mentioned about python3-keystoneclient in his email. i guess we are good then.. | 04:50 |
| ykarel | but he didn't mentioned during which bug he noticed that | 04:50 |
| ykarel | maybe checking that bug we can get more context | 04:51 |
| ysandeep|rover | not sure. will revisit after checking the cinder issue. | 04:53 |
| *** jmasud has quit IRC | 04:54 | |
| ysandeep|rover | seems like issue using vg creation - nothing in lvm output - https://storage.gra.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_3ea/715006/8/gate/tripleo-ci-centos-8-standalone/3ea0819/logs/undercloud/var/log/extra/lvm.txt | 04:57 |
| ysandeep|rover | during* vg | 04:57 |
| ykarel | ysandeep|rover, ack, ysandeep|rover i replied to the email, in case u find still an issue let us know, we can check again | 05:00 |
| ysandeep|rover | ykarel, ack | 05:00 |
| *** skramaja has joined #oooq | 05:02 | |
| *** ratailor has joined #oooq | 05:23 | |
| ysandeep|rover | ykarel, http://paste.openstack.org/show/792127/ | 05:33 |
| *** jmasud has joined #oooq | 05:35 | |
| ykarel | ysandeep|rover, i think main one is kernel: loop: module loaded | 05:36 |
| *** udesale has joined #oooq | 05:37 | |
| ysandeep|rover | ykarel, hmm seems like that didn't load | 05:38 |
| ysandeep|rover | https://storage.gra.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_3ea/715006/8/gate/tripleo-ci-centos-8-standalone/3ea0819/logs/undercloud/var/log/extra/lsmod.txt -- loop module didn't load confirmed from lsmod output.. good run have it | 05:40 |
| ysandeep|rover | loop is generally a kernel module.. i will try to pull that image locally and execute those steps manually to reproduce it.. may be issue in OS itself. | 05:45 |
| ykarel | OS looks same | 05:46 |
| ykarel | running losetup should load it automatic, but somehow either losetup didn't executed or running it didn't load it | 05:46 |
| *** pojadhav|away is now known as pojadhav | 05:48 | |
| ykarel | ohhk so it actually didn't ran | 05:53 |
| ykarel | so loop didn't loaded | 05:53 |
| ysandeep|rover | ykarel, how you confirmed that? | 05:55 |
| ykarel | ysandeep|rover, https://opendev.org/openstack/tripleo-heat-templates/src/branch/master/deployment/cinder/cinder-common-container-puppet.yaml#L122 | 05:56 |
| ykarel | so somehow that file exists, so task didn't got triggered | 05:56 |
| *** ratailor has quit IRC | 06:00 | |
| *** marios has joined #oooq | 06:04 | |
| *** jmasud has quit IRC | 06:09 | |
| *** jmasud has joined #oooq | 06:11 | |
| *** ratailor has joined #oooq | 06:12 | |
| ykarel | we can easily test this theory and get it clear, and in parallel try to find what's causing it | 06:13 |
| ykarel | and unblock gate if it's get true | 06:13 |
| ysandeep|rover | ykarel, test this theory - by adding debug in that task? | 06:18 |
| ykarel | ysandeep|rover, fire a patch which changes the name of creates file | 06:21 |
| ykarel | add Partial-Bug | 06:21 |
| ysandeep|rover | ykarel, you mean chainging /dev/loop2 to something else like /dev/loop3 | 06:22 |
| ysandeep|rover | or /var/lib/cinder/cinder-volumes file? | 06:23 |
| ykarel | iirc loop3 is used for ceph | 06:23 |
| ykarel | so we need to use something else | 06:23 |
| *** jfrancoa has joined #oooq | 06:25 | |
| ykarel | can also try touch /dev/loop2cinder in the shell task, and change creates: /dev/loop2cinder | 06:25 |
| ysandeep|rover | ykarel, ack, on it.. | 06:27 |
| ykarel | ack | 06:37 |
| *** bogdando has joined #oooq | 06:40 | |
| *** dpawlik has joined #oooq | 06:49 | |
| *** sanjayu__ has joined #oooq | 06:55 | |
| *** ccamacho has joined #oooq | 07:11 | |
| ykarel | ysandeep|rover, fyi https://review.rdoproject.org/r/#/c/26346/ breaked jobs in case not already known | 07:22 |
| *** tosky has joined #oooq | 07:23 | |
| ysandeep|rover | ykarel, ack thanks! | 07:24 |
| zbr | marios: tx for comments on https://review.opendev.org/#/c/717723/ -- answered them, not sure if any change is needed, let me know. | 07:25 |
| marios | zbr: thanks will chekc | 07:31 |
| zbr | marios: fyi, i already started to discuss with ansible team about module unittesting, which is currently not docuented, more of DIY like in that review. | 07:32 |
| zbr | but at some point we will document a clean way to write unittests for modules, i suppose we will see more appearing in the future. | 07:33 |
| zbr | probably you already observed that the test itself is very simple/easy to read, but it required some "utils". | 07:34 |
| *** jmasud has quit IRC | 07:35 | |
| *** jmasud has joined #oooq | 07:36 | |
| *** amoralej|off is now known as amoralej | 07:42 | |
| *** ysandeep|rover is now known as ysandeep|lunch | 07:48 | |
| zbr | marios: give me a +2 to avoid self on https://review.opendev.org/#/c/717826/ | 07:49 |
| marios | zbr: i will not. bcause you ignored my questions at https://review.opendev.org/#/c/717829/1 | 07:52 |
| *** jpena|off is now known as jpena | 07:53 | |
| marios | zbr: ;) | 07:53 |
| * marios chains self to railings | 07:53 | |
| marios | hell no we won't go! | 07:53 |
| *** ykarel is now known as ykarel|lunch | 07:54 | |
| zbr | marios: done. tbh, i missed the comment. | 07:55 |
| zbr | marios: i hope you do not really need a "Story: #123" on any change. But a better comment would have being clearly preffered. | 07:56 |
| zbr | sometimes i forget that reviewers do not have the same context as me. | 07:56 |
| marios | zbr: k will check in couple mins finishing another review now | 07:56 |
| *** jmasud has quit IRC | 07:56 | |
| *** jmasud has joined #oooq | 07:57 | |
| zbr | i wonder if our new folks could help with tasks like this: replace install-docker usage with ensure-docker. | 08:02 |
| marios | zbr: yes ++ to get them more involved...but reviews is the first place to start imho | 08:05 |
| marios | zbr: like if someone reviewed your first patch then you can say ok now go do tripleo-ansible | 08:05 |
| marios | zbr: also .. "thanks" https://review.opendev.org/#/c/717829/1//COMMIT_MSG | 08:05 |
| marios | ;) | 08:05 |
| * marios moves on with life | 08:05 | |
| zbr | several changes already merged long time ago, yep. | 08:06 |
| zbr | we will have to do more replacements of install with ensure, all roles are migrated. | 08:08 |
| *** skramaja has quit IRC | 08:17 | |
| *** skramaja has joined #oooq | 08:17 | |
| *** ccamacho has quit IRC | 08:20 | |
| *** jbadiapa has joined #oooq | 08:28 | |
| *** ykarel|lunch is now known as ykarel | 08:37 | |
| *** ysandeep|lunch is now known as ysandeep|rover | 08:40 | |
| *** ccamacho has joined #oooq | 08:40 | |
| *** ccamacho has quit IRC | 08:40 | |
| *** ratailor has quit IRC | 08:41 | |
| *** ratailor has joined #oooq | 08:42 | |
| *** skramaja has quit IRC | 08:42 | |
| bogdando | the tempest seems turned faily in standalone jobs :/ | 08:42 |
| bogdando | got the root cause or a known bug per chance? | 08:42 |
| *** skramaja has joined #oooq | 08:42 | |
| bogdando | https://b80f1b34771e9bfe51ef-3e8293bc1a4c00f43de19f0dd1b5b796.ssl.cf2.rackcdn.com/720115/1/check/tripleo-ci-centos-8-standalone/da001d4/logs/undercloud/var/log/tempest/stestr_results.html repeats pretty much for anympatch | 08:44 |
| bogdando | any patch | 08:44 |
| ysandeep|rover | bogdando, https://bugs.launchpad.net/tripleo/+bug/1872881 | 08:44 |
| openstack | Launchpad bug 1872881 in tripleo "Cinder volume failed to build and went to ERROR state - No valid backend was found ( Stderr: ' Volume group "cinder-volumes" not found\n)" [Critical,In progress] - Assigned to Sandeep Yadav (sandeepyadav93) | 08:44 |
| bogdando | ysandeep|rover: thanks | 08:44 |
| *** ccamacho has joined #oooq | 08:45 | |
| *** dtantsur|afk is now known as dtantsur | 08:49 | |
| *** jmasud has quit IRC | 08:54 | |
| *** jmasud has joined #oooq | 08:56 | |
| *** holser has quit IRC | 09:03 | |
| *** holser has joined #oooq | 09:05 | |
| *** holser has quit IRC | 09:06 | |
| zbr | it looks bit ugly but avoids use of virtualenv on py3, which would count as "more sturdy" | 09:06 |
| *** jmasud has quit IRC | 09:07 | |
| *** holser has joined #oooq | 09:10 | |
| *** apetrich has joined #oooq | 09:16 | |
| *** holser has quit IRC | 09:37 | |
| *** holser has joined #oooq | 09:41 | |
| *** ccamacho has quit IRC | 09:44 | |
| holser | bogdando Do we have a | 09:47 |
| holser | fix for tempest issue | 09:47 |
| bogdando | holser: https://bugs.launchpad.net/tripleo/+bug/1872881 | 09:47 |
| openstack | Launchpad bug 1872881 in tripleo "Cinder volume failed to build and went to ERROR state - No valid backend was found ( Stderr: ' Volume group "cinder-volumes" not found\n)" [Critical,In progress] - Assigned to Sandeep Yadav (sandeepyadav93) | 09:47 |
| *** cgoncalves has joined #oooq | 10:03 | |
| *** ccamacho has joined #oooq | 10:05 | |
| *** skramaja has quit IRC | 10:42 | |
| *** derekh has joined #oooq | 10:49 | |
| *** jtomasek has quit IRC | 10:56 | |
| *** ysandeep|rover is now known as ysandeep|coffee | 11:00 | |
| *** jtomasek has joined #oooq | 11:01 | |
| *** ysandeep|coffee is now known as ysandeep|rover | 11:17 | |
| *** jpena is now known as jpena|lunch | 11:30 | |
| *** dsneddon has quit IRC | 11:53 | |
| *** udesale_ has joined #oooq | 12:04 | |
| *** udesale has quit IRC | 12:06 | |
| *** amoralej is now known as amoralej|lunch | 12:10 | |
| *** rfolco has joined #oooq | 12:17 | |
| *** Goneri has joined #oooq | 12:21 | |
| weshay|ruck | https://trello.com/b/0VFswmht/pcci-retrospective?menu=filter&filter=label:UniSprint25 | 12:27 |
| rfolco | arxcruz, rfolco, zbr, panda, sshnaidm, rlandy, marios, ysandeep, bhagyashris, soniya29, pojadhav, akahat, weshay, chandankumar | 12:32 |
| rfolco | retro mtg ^ | 12:32 |
| rfolco | https://meet.google.com/jpw-ymjt-ixs?authuser=1 | 12:32 |
| rfolco | https://trello.com/b/0VFswmht/pcci-retrospective?menu=filter&filter=label:unisprint25 | 12:33 |
| *** jpena|lunch is now known as jpena | 12:33 | |
| *** yolanda has quit IRC | 12:43 | |
| marios | weshay|ruck: current-tripleo delorean and delorean-deps lets us get around the dependency issues added with https://code.engineering.redhat.com/gerrit/#/c/196858/41/playbooks/tripleo-buildcontainers/pre.yaml@37 & periodic-tripleo-build-containers-rhel-8-master https://sf.hosted.upshift.rdu2.redhat.com/zuul/t/tripleo-ci-internal/build/256be977fed5452fa5f3e80635e1cf66 : SUCCESS in 24m 57s (non-voting) | 12:51 |
| marios | weshay|ruck: i did that cos we were hitting deps issues and rlandy said you suggested to try with those ^ | 12:52 |
| zbr | out 16 people in meeting, i see cards only from ~6 | 12:53 |
| *** ykarel is now known as ykarel|afk | 12:55 | |
| *** holser has quit IRC | 13:02 | |
| weshay|ruck | https://docs.openstack.org/project-team-guide/ptl.html#criteria-when-considering-new-cores | 13:03 |
| *** holser has joined #oooq | 13:04 | |
| *** ratailor has quit IRC | 13:04 | |
| *** amoralej|lunch is now known as amoralej | 13:05 | |
| *** ysandeep|rover is now known as ysandeep|away | 13:32 | |
| *** TrevorV has joined #oooq | 13:37 | |
| *** ykarel|afk is now known as ykarel | 14:03 | |
| marios | weshay|ruck: we didn't pick ruck|rovers | 14:13 |
| marios | zbr: aware of any issues tox-molecule fails for me 404 for https://images.rdoproject.org/centos8/master/rdo_trunk/tripleo-ci-testing/overcloud-full.tar https://f3720cbaa64e3cd59c51-f4d168cdb20f40841821e4b213645c0f.ssl.cf5.rackcdn.com/715397/8/check/openstack-tox-molecule/9a63171/tox/reports.html but perhaps issue with the image server itself? | 14:18 |
| marios | zbr: had it twice so far at https://review.opendev.org/#/c/715397/8 | 14:18 |
| marios | dont see anything on ruck|rover hackmd | 14:18 |
| zbr | marios: 404 is very explicit and not among that status codes that can be retried. feels like img server issue | 14:19 |
| zbr | how is the image updated? is that operation atomic? | 14:20 |
| marios | zbr: well am not touching that here at all its featureset update | 14:20 |
| marios | zbr: ack thanks | 14:20 |
| zbr | rename is atomic, remove and recreate file is not. | 14:20 |
| zbr | tbh, i really like that error, is very easy to read :D | 14:21 |
| *** jmasud has joined #oooq | 14:30 | |
| *** ysandeep|away is now known as ysandeep | 14:31 | |
| ysandeep | weshay|ruck, cix | 14:31 |
| *** bogdando has quit IRC | 14:39 | |
| *** jmasud has quit IRC | 14:41 | |
| *** jmasud has joined #oooq | 14:43 | |
| *** dtantsur is now known as dtantsur|brb | 14:55 | |
| weshay|ruck | panda, 1 sec | 15:01 |
| *** ykarel is now known as ykarel|away | 15:29 | |
| *** Goneri has quit IRC | 15:30 | |
| *** Goneri has joined #oooq | 15:33 | |
| *** amoralej is now known as amoralej|off | 15:43 | |
| * marios shutdown sequence | 15:52 | |
| *** jmasud has quit IRC | 15:53 | |
| *** marios has quit IRC | 16:04 | |
| chandankumar | weshay|ruck, Hello | 16:05 |
| chandankumar | weshay|ruck, image sanity script is taking too much time https://review.rdoproject.org/r/#/c/26461/ | 16:05 |
| *** dtantsur|brb is now known as dtantsur | 16:11 | |
| weshay|ruck | rfolco, https://review.rdoproject.org/r/#/c/26506/ | 16:17 |
| weshay|ruck | 2020-04-15 13:40:45.912012 | TASK [Run Sanitization on overcloud images] | 16:18 |
| weshay|ruck | 2020-04-15 09:40:46.639686 | primary | [ 0.0] Examining the guest ... | 16:18 |
| weshay|ruck | chandankumar, ^ | 16:18 |
| weshay|ruck | that's an odd time stamp | 16:18 |
| weshay|ruck | chandankumar, if it can complete in roughly 3 hours | 16:18 |
| weshay|ruck | it may be ok | 16:18 |
| weshay|ruck | if it's well over 3 hours.. we'll have to rethink it | 16:19 |
| weshay|ruck | chandankumar, when you run it locally how long does it take? | 16:19 |
| weshay|ruck | anyone anyone around? | 16:19 |
| weshay|ruck | need a review | 16:19 |
| weshay|ruck | 0/ | 16:20 |
| rfolco | weshay|ruck, +2, could add a md5_url debug task too the same way | 16:20 |
| weshay|ruck | rfolco, ya.. but that should always be there.. right? | 16:20 |
| weshay|ruck | rfolco, can I pick ur brain for a few minutes on this re: the component promotion job? | 16:20 |
| rfolco | md5? no, for centos7 old releases, we go on commit_url | 16:20 |
| weshay|ruck | https://meet.google.com/pwk-fsrt-npu?authuser=1 | 16:21 |
| rfolco | weshay|ruck, ok | 16:21 |
| weshay|ruck | rfolco, https://logserver.rdoproject.org/openstack-periodic-master/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-centos-8-master-promote-promoted-components-to-tripleo-ci-testing/dce0054/job-output.txt | 16:21 |
| *** jmasud has joined #oooq | 16:24 | |
| *** jmasud has quit IRC | 16:37 | |
| *** udesale_ has quit IRC | 16:49 | |
| weshay|ruck | https://review.rdoproject.org/r/#/c/26171/ | 16:50 |
| *** dtantsur is now known as dtantsur|afk | 16:53 | |
| zbr | weshay|ruck: is standalone failure known? https://review.opendev.org/#/c/717826/ | 17:08 |
| *** jmasud has joined #oooq | 17:09 | |
| *** jpena is now known as jpena|off | 17:10 | |
| *** derekh has quit IRC | 17:17 | |
| weshay|ruck | zbr, there is a fix for standalone working it's way through the gate | 17:24 |
| *** yolanda has joined #oooq | 17:27 | |
| *** dpawlik has quit IRC | 17:48 | |
| *** dsneddon has joined #oooq | 18:11 | |
| *** dsneddon has quit IRC | 18:16 | |
| *** sanjayu__ has quit IRC | 19:14 | |
| *** jmasud has quit IRC | 19:49 | |
| *** yolanda has quit IRC | 19:50 | |
| *** jmasud has joined #oooq | 19:52 | |
| *** yolanda has joined #oooq | 20:03 | |
| *** jmasud has quit IRC | 20:44 | |
| *** jmasud has joined #oooq | 20:45 | |
| *** jmasud has quit IRC | 20:54 | |
| *** jmasud has joined #oooq | 20:56 | |
| *** jfrancoa has quit IRC | 21:22 | |
| *** jtomasek has quit IRC | 21:42 | |
| *** ccamacho has quit IRC | 22:11 | |
| *** TrevorV has quit IRC | 22:18 | |
| *** jmasud has quit IRC | 22:22 | |
| *** rfolco has quit IRC | 22:24 | |
| *** jmasud has joined #oooq | 22:29 | |
| *** Goneri has quit IRC | 22:47 | |
| *** jmasud has quit IRC | 23:09 | |
| *** jmasud has joined #oooq | 23:10 | |
| *** tosky has quit IRC | 23:39 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!