| *** rfolco has quit IRC | 00:26 | |
| *** gouthamr_ has quit IRC | 00:59 | |
| *** gouthamr_ has joined #oooq | 01:05 | |
| *** Goneri has quit IRC | 01:18 | |
| *** gouthamr_ has quit IRC | 01:25 | |
| *** gouthamr_ has joined #oooq | 01:37 | |
| *** rlandy|bbl is now known as rlandy | 01:49 | |
| *** rlandy has quit IRC | 02:04 | |
| *** apetrich has quit IRC | 02:13 | |
| *** gouthamr_ has quit IRC | 02:52 | |
| *** gouthamr_ has joined #oooq | 02:56 | |
| *** pojadhav is now known as pojadhav|SickLea | 02:57 | |
| *** pojadhav|SickLea is now known as pojadhav|Sick | 02:57 | |
| *** gouthamr_ has quit IRC | 03:26 | |
| *** gouthamr_ has joined #oooq | 03:32 | |
| *** saneax has joined #oooq | 03:35 | |
| *** saneax has quit IRC | 03:40 | |
| *** saneax has joined #oooq | 03:41 | |
| *** gouthamr_ has quit IRC | 04:00 | |
| *** saneax has quit IRC | 04:00 | |
| *** saneax has joined #oooq | 04:01 | |
| *** saneax has quit IRC | 04:03 | |
| *** saneax has joined #oooq | 04:03 | |
| *** gouthamr_ has joined #oooq | 04:11 | |
| *** soniya29 has joined #oooq | 04:15 | |
| *** saneax has quit IRC | 04:17 | |
| *** saneax has joined #oooq | 04:18 | |
| *** ratailor has joined #oooq | 04:22 | |
| *** saneax has quit IRC | 04:22 | |
| *** saneax has joined #oooq | 04:22 | |
| *** saneax has quit IRC | 04:24 | |
| *** saneax has joined #oooq | 04:25 | |
| *** ykarel has joined #oooq | 04:27 | |
| *** gouthamr_ has quit IRC | 04:29 | |
| *** gouthamr_ has joined #oooq | 04:30 | |
| *** gouthamr_ has quit IRC | 04:35 | |
| *** gouthamr_ has joined #oooq | 04:40 | |
| *** saneax has quit IRC | 04:52 | |
| *** saneax has joined #oooq | 04:53 | |
| *** saneax has quit IRC | 04:55 | |
| *** saneax has joined #oooq | 04:55 | |
| *** ysandeep|away is now known as ysandeep|rover | 05:03 | |
| *** saneax has quit IRC | 05:03 | |
| *** saneax has joined #oooq | 05:03 | |
| *** udesale has joined #oooq | 05:13 | |
| *** saneax has quit IRC | 05:17 | |
| *** saneax has joined #oooq | 05:19 | |
| *** saneax has quit IRC | 05:20 | |
| akahat | arxcruz, chandankumar your feedback is needed on Lungi's comment: https://review.opendev.org/#/c/731501/ | 05:32 |
|---|---|---|
| akahat | s/Lungi/Luigi/ | 05:32 |
| *** jfrancoa has joined #oooq | 05:33 | |
| chandankumar | akahat: I agree with luigi, because not each deployment has member role so it might fail | 05:38 |
| *** marios has joined #oooq | 05:38 | |
| chandankumar | so better to depend on auth.tempest_role | 05:39 |
| ysandeep|rover | folks, looking for reviews on this new c8 train tempest job https://review.rdoproject.org/r/#/c/28343/ , test run is green | 05:43 |
| bhagyashris | ysandeep|rover, fyi i have reported this bug https://bugs.launchpad.net/tripleo/+bug/1886829 | 05:53 |
| openstack | Launchpad bug 1886829 in tripleo "ERROR paunch [ ] Error executing ['podman', 'container', 'exists', '* (max containers)']: returned 1" [Medium,Triaged] | 05:53 |
| ysandeep|rover | bhagyashris, thank you.. | 05:53 |
| ysandeep|rover | I will add to RR list, but if you already have idea what's causing that failure.. please feel free to take the bug | 05:54 |
| ysandeep|rover | bhagyashris, i noticed this too which running component job for sc4 c8 train | 05:55 |
| ysandeep|rover | while* running | 05:55 |
| bhagyashris | ysandeep|rover, ack | 05:55 |
| bhagyashris | ysandeep|rover, it's still failing on component job for sc4 c8 train | 05:56 |
| bhagyashris | ? | 05:56 |
| ysandeep|rover | bhagyashris, i ran job once - it failed that time | 05:57 |
| bhagyashris | ysandeep|rover, ack will check that | 05:57 |
| ysandeep|rover | bhagyashris, https://review.rdoproject.org/r/#/c/28442/ fyi.. test run | 05:58 |
| bhagyashris | ysandeep|rover, ack thanks | 05:59 |
| *** saneax has joined #oooq | 06:15 | |
| *** sanjayu_ has joined #oooq | 06:49 | |
| *** gouthamr_ has quit IRC | 06:50 | |
| *** saneax has quit IRC | 06:52 | |
| *** gouthamr_ has joined #oooq | 06:52 | |
| ysandeep|rover | zbr, fyi.. minion job failing consistently for master branch.. I am opening a bug https://zuul.openstack.org/builds?job_name=tripleo-ci-centos-8-containers-undercloud-minion&branch=master | 07:03 |
| *** gouthamr_ has quit IRC | 07:04 | |
| *** gouthamr_ has joined #oooq | 07:05 | |
| *** skramaja has joined #oooq | 07:06 | |
| *** amoralej|off is now known as amoralej | 07:07 | |
| *** gouthamr_ has quit IRC | 07:15 | |
| *** gouthamr_ has joined #oooq | 07:22 | |
| *** zbr7 is now known as zbr|ruck | 07:23 | |
| ysandeep|rover | zbr, created RR notes for this sprint https://hackmd.io/6Bx0FXwlRNCc75l39NSKvg | 07:26 |
| *** sanjayu__ has joined #oooq | 07:34 | |
| *** sanjayu_ has quit IRC | 07:36 | |
| *** sanjayu__ has quit IRC | 07:40 | |
| *** soniya29 has quit IRC | 07:40 | |
| *** saneax has joined #oooq | 07:43 | |
| *** gouthamr_ has quit IRC | 07:46 | |
| *** sanjayu_ has joined #oooq | 07:47 | |
| *** saneax has quit IRC | 07:50 | |
| *** sanjayu__ has joined #oooq | 07:51 | |
| *** ysandeep|rover is now known as ysandeep|lunch | 07:52 | |
| *** gouthamr_ has joined #oooq | 07:52 | |
| *** ysandeep|lunch is now known as ysandeep | 07:53 | |
| *** ysandeep is now known as ysandeep|lunch | 07:53 | |
| *** sanjayu_ has quit IRC | 07:54 | |
| *** sshnaidm has joined #oooq | 07:55 | |
| *** sanjayu_ has joined #oooq | 07:55 | |
| *** gouthamr_ has quit IRC | 07:57 | |
| *** sanjayu__ has quit IRC | 07:59 | |
| *** udesale_ has joined #oooq | 08:00 | |
| *** udesale has quit IRC | 08:03 | |
| *** gouthamr_ has joined #oooq | 08:09 | |
| *** udesale_ has quit IRC | 08:10 | |
| *** sanjayu_ has quit IRC | 08:19 | |
| *** ysandeep|lunch is now known as ysandeep|rover | 08:34 | |
| *** derekh has joined #oooq | 08:36 | |
| *** apetrich has joined #oooq | 08:49 | |
| *** tosky has joined #oooq | 09:10 | |
| *** udesale has joined #oooq | 09:12 | |
| *** Tengu has quit IRC | 09:13 | |
| *** saneax has joined #oooq | 09:13 | |
| *** Tengu has joined #oooq | 09:15 | |
| marios | zbr_: do you off hand know/seen this issue before (tox -e py37 --> ERROR: InterpreterNotFound: python3.7 but thre is definitely a /usr/bin/python37 | 09:20 |
| marios | zbr_: this is the tox.ini https://opendev.org/openstack/python-tripleoclient/src/branch/master/tox.ini | 09:20 |
| *** dtantsur|afk is now known as dtantsur | 09:29 | |
| zbr | you missed a point in exec name | 09:29 |
| marios | zbr_: no not that | 09:29 |
| zbr | tox will find it if is in PATH. never had a problem with that, especially if you are using "pyXY" env names. | 09:31 |
| marios | zbr_: ack thanks not sure what's going on then i checked PATH etc and things are installed in 'normal' places /usr/bin etc | 09:32 |
| zbr | where is the failure on ci? | 09:32 |
| marios | zbr_: no local | 09:32 |
| marios | zbr_: i am trying to fix some test but i need to be able to run it first :D | 09:32 |
| zbr | have you tried to turn it off and on again? ;) | 09:33 |
| marios | zbr_: k sec trying | 09:33 |
| zbr | i often use alternative pythons from pyenv and for these i sometimes need tox-pyenv insalled, but i doubt is your case. | 09:34 |
| zbr | you mentioned a system python in the link. | 09:34 |
| zbr | anyone around using a TKL keyboard? | 09:35 |
| zbr | marios: i am having a WTF moment, maybe you can help me spot the cause? look at https://logserver.rdoproject.org/54/28454/9/check/mol-get_hash/64fd990/tox/reports.html | 10:05 |
| zbr | The error was: 'dict object' has no attribute 'master' | 10:08 |
| zbr | but there is no such thing in that tasks, no dictionary, no master mentioned. | 10:08 |
| zbr | release can be 'master' but that does not explain how: release not in ['queens','rocky','stein'] -- would give that error. | 10:10 |
| marios | zbr: gimme few fighting with magicmock | 10:16 |
| arxcruz | chandankumar: https://review.opendev.org/#/c/739948/ please | 10:18 |
| marios | zbr: can't spot something... but perhaps one of those things is set to 'master' ? 19 commit_url: "{{ dlrn_hash_baseurl }}/component/{{ component }}/{{ promote_source }}/commit.yaml"$ | 10:23 |
| zbr | ansible mentions "dict", someone tried to do a {{ foo.master }} | 10:24 |
| zbr | or foo['master'] | 10:24 |
| zbr | but whom?! | 10:24 |
| zbr | i am perplexed, and locally it run succesfully. | 10:24 |
| panda | zbr: some of the time is a impluicit dependency on variables | 10:32 |
| panda | that's why I consider jinja templating in config files harmful | 10:32 |
| panda | don't mix logic with configuration ... :( | 10:32 |
| *** ysandeep|rover is now known as ysandeep|afk | 10:42 | |
| zbr | very limited / well controlled templating is ok. | 10:53 |
| zbr | but i agree with panda, easy to abuse, especially as most people are not aware (or forget) about lazy evaluation of jinja2 | 10:54 |
| bhagyashris | akahat, sshnaidm zbr please vote +1 if you are agree with this https://review.rdoproject.org/r/#/c/28443/ and https://review.rdoproject.org/r/#/c/28444/ | 10:54 |
| sshnaidm | zbr, please remove +w ^ | 10:56 |
| sshnaidm | bhagyashris, need to fix ovb jobs definitions there | 10:56 |
| zbr | done. next time add a -W | 10:57 |
| *** ysandeep|afk is now known as ysandeep|rover | 10:58 | |
| zbr | as a note, I never seen so much support (votes) on another change in our team. | 10:58 |
| zbr | and sshnaidm -1 appeared as a +1 in gerrit :D | 10:58 |
| zbr | few pixels difference | 10:58 |
| sshnaidm | yeah, need colors | 10:59 |
| zbr | it gets colors when is a minus | 10:59 |
| zbr | -2 or workflow -1 | 10:59 |
| zbr | i bet is fixed in new gerrit, if we ever get it | 10:59 |
| sshnaidm | bhagyashris, these settings need to be added to all "ovb" jobs: https://github.com/rdo-infra/rdo-jobs/blob/master/zuul.d/integration-pipeline-stable3.yaml#L9-L11 | 11:01 |
| bhagyashris | sshnaidm, do i change this in same patch ... because this patch just separate out the c7 train jobs ... i want your opinion on it | 11:02 |
| sshnaidm | bhagyashris, yeah, better to have it right in one patch | 11:03 |
| bhagyashris | sshnaidm, ack will do it | 11:03 |
| sshnaidm | bhagyashris, cool, thanks | 11:03 |
| bhagyashris | sshnaidm, and this needs to be done only for ovb jobs right ? just reconfirming ... | 11:05 |
| sshnaidm | bhagyashris, right | 11:06 |
| zbr | panda: marios: here is a more interesting result: https://review.rdoproject.org/r/#/c/28454/ -- passes on centos8 and fails on centos7 | 11:10 |
| zbr | my mistake was to run it on centos-7 initially when it was in fact tested only on 8 by us. | 11:11 |
| zbr | i will remove the broken job and allow someone else to fix it. | 11:11 |
| zbr | one very cool feature is that I can tell molecule to enforce use of delegated, even if scenario was defined to use docker. | 11:12 |
| zbr | quite practical for zuul testing. | 11:12 |
| zbr | it is hilarious that we have c8 job defined in a file named with centos-7 | 11:13 |
| zbr | and that we had two jobs running delegated, on both centos7 and 8 but they where running a single scenario using docker, testing only c8. | 11:14 |
| zbr | so basically we tested that molecule can run on both, nothing more. | 11:14 |
| zbr | the tested role was tested only on centos8 docker images by both jobs. | 11:15 |
| zbr | ...layers. | 11:15 |
| zbr | panda: do we need get_hash on centos-7? | 11:16 |
| zbr | marios: panda: i need you to review https://review.rdoproject.org/r/#/c/28454/ -- afaik it can be merged as is. | 11:18 |
| panda | zbr: I think we do, get_hash may be used also by stable branches | 11:18 |
| ysandeep|rover | zbr, you already saw this https://logserver.rdoproject.org/openstack-component-common/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-8-scenario003-standalone-common-master/1206f81/job-output.txt ? component jobs failing with this error | 11:19 |
| panda | bhagyashris: is this ready to be merged ? https://review.rdoproject.org/r/28444 | 11:22 |
| bhagyashris | panda, nope before that this should get merge https://review.rdoproject.org/r/#/c/28443/ | 11:23 |
| bhagyashris | panda, but i am waiting for +1 from those who haven't vote | 11:23 |
| panda | zbr: why are you making the driver a parameter of the test ? | 11:25 |
| panda | zbr: is there any chance that job will be run on non-delegated ? seems quite improbable to me | 11:25 |
| *** soniya29 has joined #oooq | 11:27 | |
| bhagyashris | sshnaidm, Done | 11:27 |
| ysandeep|rover | weshay_ruck, Hey o/ fyi.. New RR notes https://hackmd.io/6Bx0FXwlRNCc75l39NSKvg - 2 new hot issues | 11:28 |
| marios | zbr: ack will do | 11:30 |
| marios | 14:18 < zbr> marios: panda: i need you to review https://review.rdoproject.org/r/#/c/28454/ -- afaik it can be merged as is. | 11:30 |
| marios | zbr: has WIP | 11:30 |
| weshay_ruck | ysandeep|rover, k.. | 11:33 |
| panda | mario: you heard him, merge it as it is, quickly! | 11:33 |
| chandankumar | marios: weshay_ruck https://code.engineering.redhat.com/gerrit/#/c/203744/ and https://code.engineering.redhat.com/gerrit/#/c/205474/ please have a look when free | 11:47 |
| marios | chandankumar: ack adding to queue | 11:48 |
| zbr | panda: good point avoid the override of driver. | 11:50 |
| zbr | i need it only for this scenario, let me try to see if I can avoid defining it in base job. | 11:50 |
| marios | zbr|ruck: ysandeep|rover: looks like upstream queue is very long today or no? | 11:51 |
| marios | (check actually) | 11:51 |
| marios | not gate i mean | 11:51 |
| zbr | it may be tricky as I bet zuul does not merge tox_environment dictionary | 11:51 |
| ysandeep|rover | marios, yes its long.. I see some known failures and multiple random tempest failures | 11:52 |
| marios | ysandeep|rover: thx | 11:55 |
| *** bhagyashris is now known as bhagyashris|brb | 12:04 | |
| weshay_ruck | zbr, did you see my logstash bug? | 12:05 |
| *** zbr_ has quit IRC | 12:05 | |
| weshay_ruck | zbr, renick btw | 12:05 |
| zbr | there is a ruck nick also. i have two clients for the moment (after irccloud lame failure) | 12:06 |
| zbr | weshay_ruck: if you can post link again it would be great,.... lost between too many thread | 12:07 |
| *** amoralej is now known as amoralej|lunch | 12:07 | |
| weshay_ruck | zbr, https://bugs.launchpad.net/tripleo/+bug/1886878 | 12:10 |
| openstack | Launchpad bug 1886878 in tripleo "ansible-role-collect-logs is not getting all the right files into the logstash" [Critical,Triaged] | 12:10 |
| weshay_ruck | zbr, please make that your top priority as ruck/rover we have a lot of various issues in the gate and I can't determine the impact w/o logstash | 12:12 |
| zbr | sure, but i am not sure if that logstash issue is new. never touched this area. but the logic seems simple. | 12:13 |
| zbr | that bug description could use some improvemetns, i need to guess the bug | 12:14 |
| zbr | "all the right files" seems like a political declaration ;) | 12:15 |
| zbr | but... log files matter! | 12:15 |
| zbr | arxcruz: can you help with ^ ? -- see you are the author of the logstash specific code. | 12:18 |
| weshay_ruck | zbr, it's pretty clear.. cat $files > logstash.txt | 12:18 |
| weshay_ruck | and that's not resulting in a logstash.txt file w/ the contents of the deploy | 12:19 |
| weshay_ruck | zbr, jesus man | 12:19 |
| weshay_ruck | zbr, https://meet.google.com/qzy-anqy-xwn | 12:19 |
| weshay_ruck | I'll show u | 12:19 |
| weshay_ruck | zbr, https://storage.gra.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_110/739764/1/gate/tripleo-ci-centos-8-standalone/110e880/logs/undercloud/var/log/extra/logstash.txt | 12:22 |
| *** rlandy has joined #oooq | 12:23 | |
| *** rlandy is now known as rlandy|ruck2 | 12:24 | |
| rlandy|ruck2 | zbr|ruck: hey ... | 12:26 |
| rlandy|ruck2 | https://bugs.launchpad.net/tripleo/+bug/1886867 | 12:26 |
| openstack | Launchpad bug 1886867 in tripleo "Tripleo upstream jobs are failing undercloud install/standalone deploy with "requests.exceptions.HTTPError: 429 Client Error: Too Many Requests for url"" [High,Triaged] | 12:26 |
| rlandy|ruck2 | we got gate failures :( | 12:26 |
| ysandeep|rover | marios, the bug you reported just now - 1886953 might be because of missing iptables rules - we hit same issue and testing with ykarel's https://review.opendev.org/#/c/739963/4 | 12:26 |
| rlandy|ruck2 | that was yesterday's issues | 12:27 |
| marios | ysandeep|rover: thanks noting... i saw that the previous task to the one that failed is 'set ip tables' when digging earlier | 12:27 |
| ysandeep|rover | marios, sry not same but because of iptables we are facing issues | 12:27 |
| marios | ysandeep|rover: ack might be | 12:27 |
| weshay_ruck | zbr, https://storage.gra.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_110/739764/1/gate/tripleo-ci-centos-8-standalone/110e880/logs/undercloud/home/zuul/standalone_deploy.log | 12:28 |
| rlandy|ruck2 | sshnaidm: did you have any success with new iPXE image? | 12:30 |
| rlandy|ruck2 | sshnaidm: worth trying that on downstream? | 12:30 |
| arxcruz | zbr: checking, i don't remember being author of this though | 12:30 |
| sshnaidm | rlandy|ruck2, definitely worth, I replaced it in psi | 12:31 |
| rlandy|ruck2 | sshnaidm: which psi :)? | 12:31 |
| sshnaidm | rlandy|ruck2, not sure what success means here, let's hope smaller image is less burden on cloud | 12:31 |
| rlandy|ruck2 | sshnaidm: you replaced it in psi internal or public? | 12:31 |
| sshnaidm | rlandy|ruck2, rhos-dev-ci on https://rhos-d.infra.prod.upshift.rdu2.redhat.com | 12:32 |
| rlandy|ruck2 | ok great | 12:32 |
| sshnaidm | rlandy|ruck2, now I'm confused, what is what? | 12:32 |
| rlandy|ruck2 | public has a different url | 12:32 |
| sshnaidm | rlandy|ruck2, oh, that one you sent me recently? | 12:32 |
| rlandy|ruck2 | sshnaidm: that is public | 12:33 |
| weshay_ruck | akahat, 0/ 2 min | 12:33 |
| sshnaidm | rlandy|ruck2, ack | 12:33 |
| rlandy|ruck2 | I'll check internal | 12:33 |
| sshnaidm | rlandy|ruck2, so, need to replace there as well? | 12:33 |
| rlandy|ruck2 | sshnaidm: I never managed to get those nodes in internal to complete introspection | 12:34 |
| rlandy|ruck2 | they started | 12:34 |
| rlandy|ruck2 | so we had ipmi access | 12:34 |
| rlandy|ruck2 | but never shut down | 12:34 |
| rlandy|ruck2 | so maybe this ipxe boot image will do better | 12:34 |
| sshnaidm | rlandy|ruck2, btw, I'm fixing restart of introspection, it always failed: https://review.opendev.org/740256 | 12:34 |
| sshnaidm | rlandy|ruck2, maybe worth to increase retry timeout and node timeout, cli supports it now | 12:35 |
| rlandy|ruck2 | yeah - I did ... getting review | 12:35 |
| *** ysandeep|rover is now known as ysandeep|afk | 12:37 | |
| *** bhagyashris|brb is now known as bhagyashris | 12:37 | |
| rlandy|ruck2 | I'll try with the new image | 12:37 |
| weshay_ruck | ysandeep++ | 12:39 |
| zbr | weshay_ruck: that sed is bollocks, produces nothing when run on this file. | 12:39 |
| weshay_ruck | ysandeep|afk, nice catch on minion http://dashboard-ci.tripleo.org/d/3sUHfh9Wz/jobs-exploration?orgId=1&fullscreen&panelId=22 will help you | 12:39 |
| weshay_ruck | zbr, k.. | 12:39 |
| weshay_ruck | BOLLOCKS! | 12:39 |
| rlandy|ruck2 | sshnaidm: updated_at | 2020-07-08T19:58:33Z size | 917504 | 12:41 |
| rlandy|ruck2 | sshnaidm: ^^ looks like that was updated | 12:41 |
| sshnaidm | rlandy|ruck2, right | 12:41 |
| rlandy|ruck2 | ok great | 12:42 |
| zbr | can someone explain me what is the desired outcome of that sed part? what is the expected to include/exclude and what is the desired output format? | 12:42 |
| weshay_ruck | akahat, ? | 12:43 |
| weshay_ruck | zbr, so logstash requires a timestamp + [info,error] etc | 12:45 |
| zbr | considering that this logstash.txt seems to be fed to sova, sshnaidm would likely know the exact format expected. | 12:45 |
| weshay_ruck | zbr, sova uses it.. but infra pulls this file specifically | 12:46 |
| zbr | i need a link to docs mentioning the format expected | 12:47 |
| zbr | i really doubt grep/sed can parse/sanitize random/generic logs. | 12:47 |
| zbr | removing suffix yes, not not sanitizing | 12:48 |
| *** ysandeep|afk is now known as ysandeep | 12:58 | |
| weshay_ruck | zbr, https://opendev.org/opendev/base-jobs/src/branch/master/roles/submit-logstash-jobs/defaults/main.yaml#L66 | 12:59 |
| zbr | yes, i am already talking with infra, asking about expected file format. | 12:59 |
| ysandeep | weshay_ruck, thanks! yes that's nice view.. i was unaware about this view | 12:59 |
| zbr | as fungi just said that file format is very important (but failed to provide link to it) | 12:59 |
| zbr | i know that our sed line is broken, but now i am trying to identify what I am supposed to produce | 13:00 |
| zbr | feels like reverse engineering | 13:00 |
| zbr | garbage in, garbage out | 13:01 |
| sshnaidm | zbr, iirc it should have first field as a timestamp, second one is log prefix | 13:01 |
| sshnaidm | zbr, but better to confirm with clarkb or somebody there | 13:01 |
| zbr | as a timestamp, which format? seconds? iso 8601? | 13:02 |
| weshay_ruck | rlandy|ruck2, akahat bhagyashris sshnaidm scrum | 13:02 |
| zbr | clark is out this weekm bt i will get anser. | 13:02 |
| sshnaidm | zbr, as a console of usual job | 13:02 |
| sshnaidm | they index consoles as is | 13:03 |
| zbr | this means the purpose of our filter is to remove timestamps when they exist | 13:03 |
| *** TrevorV has joined #oooq | 13:11 | |
| *** amoralej|lunch is now known as amoralej | 13:12 | |
| weshay_ruck | sshnaidm, https://hackmd.io/bpi-R-7mRAO8NVr7ZtU_oA | 13:18 |
| *** Goneri has joined #oooq | 13:20 | |
| *** soniya29 has quit IRC | 13:24 | |
| *** skramaja has quit IRC | 13:29 | |
| weshay_ruck | https://review.opendev.org/#/c/736421/ | 13:39 |
| *** saneax has quit IRC | 14:00 | |
| *** ratailor has quit IRC | 14:04 | |
| rlandy|ruck2 | sshnaidm: new ipxe-boot image did it! - passed introspection \o/ | 14:41 |
| rlandy|ruck2 | on to deploy | 14:41 |
| sshnaidm | rlandy|ruck2, yay \o/ | 14:41 |
| *** soniya29 has joined #oooq | 14:45 | |
| *** soniya29 has quit IRC | 14:51 | |
| *** bhagyashris is now known as bhagyashris|dinn | 14:52 | |
| weshay_ruck | zbr, ruck /rover sync https://meet.google.com/tbr-rgjz-cjc?authuser=1 | 14:54 |
| weshay_ruck | zbr, thanks.. going through the new tempestskip list.. going to turn that on this sprint.. well.. nowish | 14:57 |
| rlandy|ruck2 | arxcruz: pls review I have the right repo name: https://code.engineering.redhat.com/gerrit/205814 Add openstack-tempest-skiplist to tripleo-ci-internal resources | 15:03 |
| weshay_ruck | https://review.rdoproject.org/r/#/q/topic:allvexx+(status:open+OR+status:merged) | 15:10 |
| rlandy|ruck2 | sshnaidm: what fixed this error we were seeing in rdocloud? "metalsmith.exceptions.DeploymentFailed: Failed to attach VIF 317f9231-37c0-47fd-ad13-769e428a8d52 to bare metal node ceafaa63-6104-4615-a9de-ed1b4a11eb0c: Client Error for url: https://192.168.24.2:13385/v1/nodes/ceafaa63-6104-4615-a9de-ed1b4a11eb0c/vifs, Unable to attach VIF 317f9231-37c0-47fd-ad13-769e428a8d52, not enough free physical ports.\n", | 15:27 |
| rlandy|ruck2 | ^^ same failure in internal OVB deploy | 15:27 |
| sshnaidm | rlandy|ruck2, it's still ongoing issue | 15:27 |
| sshnaidm | rlandy|ruck2, we see it sporadically, more on vexx than rdo-cloud, so I suppose it's related to slowness of infra | 15:28 |
| rlandy|ruck2 | sshnaidm: well for better or worse, internal psi can reproduce that problem | 15:28 |
| sshnaidm | rlandy|ruck2, more context in: https://bugs.launchpad.net/tripleo/+bug/1879472 | 15:29 |
| openstack | Launchpad bug 1879472 in tripleo "OVB overcloud deploy fails sporadically with "not enough free physical ports" error" [Critical,Triaged] | 15:29 |
| sshnaidm | rlandy|ruck2, we'll need to introduce something for ironic tuning in puppet | 15:29 |
| sshnaidm | rlandy|ruck2, it just tells us that HW and infrastructure on psi is way worse that we had.. | 15:30 |
| rlandy|ruck2 | sshnaidm: I have the node held. Is it worth any investigation on the node? | 15:30 |
| rlandy|ruck2 | otherwise I'll drop my hold | 15:30 |
| rlandy|ruck2 | and rerun | 15:30 |
| rlandy|ruck2 | and say a small prayer | 15:30 |
| *** ysandeep is now known as ysandeep|away | 15:30 | |
| *** ykarel is now known as ykarel|away | 15:33 | |
| *** bhagyashris|dinn is now known as bhagyashris | 15:49 | |
| *** ykarel|away has quit IRC | 15:53 | |
| *** marios has quit IRC | 16:00 | |
| *** udesale_ has joined #oooq | 16:08 | |
| *** udesale has quit IRC | 16:10 | |
| *** amoralej is now known as amoralej|off | 16:12 | |
| *** jfrancoa has quit IRC | 16:23 | |
| *** udesale_ has quit IRC | 16:27 | |
| *** jfrancoa has joined #oooq | 16:40 | |
| *** gchamoul has quit IRC | 16:55 | |
| *** derekh has quit IRC | 16:59 | |
| *** sshnaidm is now known as sshnaidm|afk | 17:12 | |
| *** dtantsur is now known as dtantsur|afk | 17:45 | |
| *** EmilienM is now known as EmilienM|PTO | 18:38 | |
| rlandy|ruck2 | weshay_ruck: how's it going with the gate failures? | 18:57 |
| weshay_ruck | rlandy|ruck2, check jobs are blocking a lot of things from hitting the gates.. | 18:57 |
| weshay_ruck | minion mostly | 18:57 |
| weshay_ruck | which the fix is in the gate as of a few minutes ago | 18:58 |
| weshay_ruck | so we're good | 18:58 |
| weshay_ruck | got real quiet everywhere | 18:58 |
| rlandy|ruck2 | weshay_ruck: nice ... | 18:58 |
| rlandy|ruck2 | making some progress on OVB | 18:59 |
| rlandy|ruck2 | debugging deploy failures now | 18:59 |
| rlandy|ruck2 | looks like network | 18:59 |
| weshay_ruck | thank you :) | 19:00 |
| *** rlandy|ruck2 is now known as rlandy|brb | 19:15 | |
| *** tosky has quit IRC | 19:26 | |
| weshay_ruck | rlandy|brb, ping me when ur back.. have an ovb question | 19:36 |
| *** rlandy|brb is now known as rlandy | 19:36 | |
| rlandy | weshay_ruck: ping | 19:36 |
| weshay_ruck | just want to confirm an idea | 19:36 |
| weshay_ruck | https://meet.google.com/www-nhwk-gqp | 19:36 |
| weshay_ruck | rlandy, https://review.rdoproject.org/r/28474 | 20:08 |
| weshay_ruck | rlandy, https://review.rdoproject.org/r/#/c/28473/ | 20:11 |
| weshay_ruck | rlandy, parent: tripleo-ci-base-ovb-rdo-centos-8 | 20:22 |
| weshay_ruck | 16 - job: | 20:23 |
| weshay_ruck | 17 name: tripleo-ci-base-ovb-rdo-centos-8 | 20:23 |
| weshay_ruck | 18 abstract: true | 20:23 |
| weshay_ruck | 19 description: | | 20:23 |
| weshay_ruck | 20 Base abstract job for OVB in RDO CI centos-8 zuulv3 jobs | 20:23 |
| weshay_ruck | 21 parent: tripleo-ci-base-ovb-notebroker-centos-8 | 20:23 |
| weshay_ruck | 22 # Upgraded from 3.5h to 4h after we got at least featureset001 timing out | 20:23 |
| weshay_ruck | 23 # often in train and stein. | 20:23 |
| weshay_ruck | 24 # https://trunk-primary.rdoproject.org/api-centos-train/api/civotes_detail.html?commit_hash=72487d804ef4c64d16889b1b474252f6963a18c2&distro_hash=3f633a877cc44c0fa774e06dbf99c7db29419b2f | 20:23 |
| weshay_ruck | 25 timeout: 14400 | 20:23 |
| weshay_ruck | 26 nodeset: tripleo-ovb-centos-8-primary | 20:23 |
| weshay_ruck | rlandy, https://review.rdoproject.org/r/#/c/28475/ | 20:24 |
| *** jfrancoa has quit IRC | 20:50 | |
| weshay_ruck | rlandy, 2020-07-09 20:53:20.074653 | primary | stack_status_reason: Stack CREATE completed successfully | 20:55 |
| *** jbadiapa has quit IRC | 20:58 | |
| weshay_ruck | rlandy, https://review.rdoproject.org/r/#/c/28477/ | 20:59 |
| *** TrevorV has quit IRC | 21:06 | |
| *** yolanda has quit IRC | 21:16 | |
| *** yolanda has joined #oooq | 21:17 | |
| rlandy | https://sf.hosted.upshift.rdu2.redhat.com/logs/36/200436/30/check/periodic-tripleo-ci-rhel-8-ovb-3ctlr_1comp-featureset001-internal-baremetal-rhos-17/45dd65b/logs/overcloud-controller-0/etc/ | 21:19 |
| *** rfolco has joined #oooq | 23:03 | |
| *** rfolco has quit IRC | 23:07 | |
| *** dmellado has quit IRC | 23:39 | |
| *** rlandy has quit IRC | 23:58 | |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!