| *** Goneri has quit IRC | 00:39 | |
| recheck | [gh-ansible] v2.9.0rc3 → https://github.com/ansible/ansible/releases/tag/v2.9.0rc3 | 00:40 |
|---|---|---|
| *** dsneddon has quit IRC | 01:34 | |
| *** dsneddon has joined #oooq | 02:07 | |
| *** apetrich has quit IRC | 02:09 | |
| *** dsneddon has quit IRC | 02:52 | |
| *** dsneddon has joined #oooq | 02:59 | |
| *** dsneddon has quit IRC | 03:04 | |
| *** rlandy|bbl is now known as rlandy | 03:30 | |
| *** ykarel|away has joined #oooq | 03:33 | |
| *** dsneddon has joined #oooq | 03:37 | |
| *** rlandy has quit IRC | 03:49 | |
| *** epoojad1 has joined #oooq | 03:58 | |
| *** sanjayu_ has joined #oooq | 04:12 | |
| *** rascasoft has quit IRC | 04:15 | |
| *** rascasoft has joined #oooq | 04:16 | |
| *** dsneddon has quit IRC | 04:36 | |
| *** surpatil has joined #oooq | 04:50 | |
| *** jtomasek has joined #oooq | 04:52 | |
| *** surpatil has quit IRC | 04:53 | |
| *** surpatil has joined #oooq | 04:54 | |
| *** dsneddon has joined #oooq | 04:57 | |
| *** dsneddon has quit IRC | 05:02 | |
| *** marios has joined #oooq | 05:02 | |
| *** marios is now known as marios|rover | 05:02 | |
| *** epoojad1 has quit IRC | 05:10 | |
| *** dsneddon has joined #oooq | 05:25 | |
| *** dsneddon has quit IRC | 05:30 | |
| *** ykarel|away is now known as ykarel | 05:43 | |
| *** jfrancoa has joined #oooq | 05:46 | |
| *** dsneddon has joined #oooq | 05:46 | |
| *** weshay_ has joined #oooq | 05:47 | |
| *** ykarel is now known as ykarel|afk | 05:48 | |
| *** dsneddon has quit IRC | 05:51 | |
| *** ykarel|afk has quit IRC | 05:54 | |
| *** weshay has quit IRC | 05:55 | |
| *** udesale has joined #oooq | 05:56 | |
| *** irclogbot_2 has quit IRC | 05:56 | |
| *** irclogbot_0 has joined #oooq | 05:56 | |
| *** ykarel|afk has joined #oooq | 06:10 | |
| *** ykarel|afk is now known as ykarel | 06:14 | |
| *** kopecmartin|off is now known as kopecmartin | 06:17 | |
| *** dsneddon has joined #oooq | 06:40 | |
| *** jbadiapa has joined #oooq | 06:51 | |
| *** tesseract has joined #oooq | 07:03 | |
| *** dsneddon has quit IRC | 07:03 | |
| *** ccamacho has joined #oooq | 07:04 | |
| *** dsneddon has joined #oooq | 07:08 | |
| *** amoralej|off is now known as amoralej | 07:11 | |
| *** holser has joined #oooq | 07:17 | |
| *** jbadiapa has quit IRC | 07:25 | |
| *** jbadiapa has joined #oooq | 07:25 | |
| *** apetrich has joined #oooq | 07:29 | |
| *** bogdando has joined #oooq | 07:30 | |
| *** soniya29 has joined #oooq | 07:37 | |
| *** jaosorior has joined #oooq | 07:38 | |
| ykarel | soniya29, https://trunk.rdoproject.org/centos7-master/deps/latest/noarch/python2-setuptools-40.8.0-1.el7.noarch.rpm | 07:38 |
| *** chem|eod is now known as chem | 07:41 | |
| *** jpena|off is now known as jpena | 07:41 | |
| *** ykarel is now known as ykarel|lunch | 07:56 | |
| *** soniya29 is now known as soniya29|lunch | 08:00 | |
| *** soniya29|lunch is now known as soniya29 | 08:35 | |
| *** ykarel|lunch is now known as ykarel | 08:43 | |
| *** akahat has joined #oooq | 09:14 | |
| *** dsneddon has quit IRC | 09:22 | |
| *** dsneddon has joined #oooq | 09:55 | |
| *** derekh has joined #oooq | 09:58 | |
| *** skramaja has joined #oooq | 10:35 | |
| zbr | ykarel: my nose it telling me that very soon backporting setuptools/pip/tox/virtualenv will become a serious nightmare.2020-01-01 is very near and they are very keen to drop 2.7 even now. | 10:39 |
| *** dsneddon has quit IRC | 10:44 | |
| ykarel | zbr, you mean there will be python3 only releases for ^^? | 10:45 |
| zbr | ykarel: nope. but PSF pulls the plug in 2.7, and most python package maintainers will do the same. This means that Red Hat would have to move maintenance downstream. | 10:46 |
| marios|rover | can someome review that please so we can merge it need to get more info for the bug https://review.opendev.org/#/c/688007/ onliner adds to logs | 10:48 |
| ykarel | zbr, yes that's the only option for rhel7 | 10:52 |
| *** rfolco has joined #oooq | 11:02 | |
| *** rfolco is now known as rfolco|ruck | 11:09 | |
| *** dsneddon has joined #oooq | 11:18 | |
| recheck | [taiga-blog] Join #Hackotoberfest with Taiga! → https://blog.taiga.io/join-hackotoberfest-with-taiga.html | 11:18 |
| *** jbadiapa has quit IRC | 11:21 | |
| *** dsneddon has quit IRC | 11:24 | |
| *** Goneri has joined #oooq | 11:31 | |
| *** jpena is now known as jpena|lunch | 11:33 | |
| *** dsneddon has joined #oooq | 11:45 | |
| *** amoralej is now known as amoralej|lunch | 11:54 | |
| *** Tengu has quit IRC | 11:56 | |
| marios|rover | weshay_: ping call ? | 12:00 |
| weshay_ | hey sorry | 12:02 |
| *** Tengu has joined #oooq | 12:12 | |
| rfolco|ruck | marios|rover, weshay_: if we merge https://review.opendev.org/#/c/687665/ I think rhel8 containers will be tagged right in promotion | 12:16 |
| recheck | [taiga-blog] Join #Hackotoberfest with Taiga! → https://blog.taiga-staging.io/join-hackotoberfest-with-taiga.html | 12:31 |
| recheck | [taiga-blog] Taiga On Premise launch, 4.2 release and end of old pricing → https://blog.taiga-staging.io/taiga-on-premise-launch-42-release-and-end-of-old-pricing.html | 12:31 |
| recheck | [taiga-blog] Taiga Larix Cajanderi Release (4.0.0) → https://blog.taiga-staging.io/taiga-larix-cajanderi-release-400.html | 12:31 |
| recheck | [taiga-blog] Taiga Pinus Contorta Release (3.4.0) → https://blog.taiga-staging.io/taiga-pinus-contorta-release-340.html | 12:31 |
| recheck | [taiga-blog] Taiga Picea Mariana Release (3.3.0) → https://blog.taiga-staging.io/taiga-picea-mariana-release-330.html | 12:31 |
| recheck | [taiga-blog] Taiga Betula Nana Release (3.2.0) → https://blog.taiga-staging.io/taiga-betula-nana-release-320.html | 12:31 |
| marios|rover | rfolco|ruck: ack in call will check in bit | 12:31 |
| recheck | [taiga-blog] Taiga Plans for 2018 → https://blog.taiga-staging.io/taiga-plans-for-2018.html | 12:31 |
| recheck | [taiga-blog] Taiga Community: Taiga.pm, getting to know Taiga.io → https://blog.taiga-staging.io/taiga-community-taigapm-getting-to-know-taigaio.html | 12:31 |
| recheck | [taiga-blog] Kanban insights: a new agile project management methodology → https://blog.taiga-staging.io/kanban-insights-a-new-agile-project-management-methodology.html | 12:31 |
| recheck | [taiga-blog] Taiga Perovskia Atriplicifolia Release (3.1.0) → https://blog.taiga-staging.io/taiga-perovskia-atriplicifolia-release-310.html | 12:31 |
| recheck | [taiga-blog] What’s an Epic? Our research → https://blog.taiga-staging.io/whats-an-epic-our-research.html | 12:31 |
| recheck | [taiga-blog] Taiga Stellaria Borealis Release (3.0.0) → https://blog.taiga-staging.io/taiga-stellaria-borealis-release-300.html | 12:31 |
| recheck | [taiga-blog] Definition of Ready & Definition of Done: the difference → https://blog.taiga-staging.io/definition-of-ready-definition-of-done-the-difference.html | 12:32 |
| recheck | [taiga-blog] Kanban vs Scrum - How to choose? → https://blog.taiga-staging.io/kanban-vs-scrum-how-to-choose.html | 12:32 |
| recheck | [taiga-blog] Taiga Ursus Americanus Release (2.1.0) → https://blog.taiga-staging.io/taiga-ursus-americanus-release-210.html | 12:32 |
| *** rlandy has joined #oooq | 12:32 | |
| recheck | [taiga-blog] Taiga Pulsatilla Patens Release (2.0) → https://blog.taiga-staging.io/taiga-pulsatilla-patens-release-20.html | 12:32 |
| recheck | [taiga-blog] Taiga Dryas Octopetala Release (1.10.0) → https://blog.taiga-staging.io/taiga-dryas-octopetala-release-1100.html | 12:32 |
| recheck | [taiga-blog] Difference between user stories and tasks → https://blog.taiga-staging.io/difference-between-user-stories-and-tasks.html | 12:32 |
| recheck | [taiga-blog] Priority and severity: What’s the difference? → https://blog.taiga-staging.io/priority-and-severity-whats-the-difference.html | 12:32 |
| recheck | [taiga-blog] You helped us win the best agile tool 2015 award → https://blog.taiga-staging.io/you-helped-us-win-the-best-agile-tool-2015-award.html | 12:32 |
| recheck | [taiga-blog] Taiga Abies Sibirica Release 1.9.0 → https://blog.taiga-staging.io/taiga-abies-sibirica-release-190.html | 12:32 |
| recheck | [taiga-blog] Dread Pirate Roberts, our QA role → https://blog.taiga-staging.io/dread-pirate-roberts-our-qa-role.html | 12:32 |
| recheck | [taiga-blog] Personal Kanban using Taiga → https://blog.taiga-staging.io/personal-kanban-using-taiga.html | 12:32 |
| recheck | [taiga-blog] Manage your remote team well with these 4 simple tips → https://blog.taiga-staging.io/manage-your-remote-team-well-with-these-4-simple-tips.html | 12:32 |
| recheck | [taiga-blog] GitHub: A beginner's guide, Part II → https://blog.taiga-staging.io/github-a-beginners-guide-part-ii.html | 12:32 |
| recheck | [taiga-blog] GitHub: A beginner's guide, Part I → https://blog.taiga-staging.io/github-a-beginners-guide-part-i.html | 12:32 |
| recheck | [taiga-blog] You're on your own for an entire week! → https://blog.taiga-staging.io/youre-on-your-own-for-an-entire-week.html | 12:32 |
| recheck | [taiga-blog] Create to-do lists that actually get done → https://blog.taiga-staging.io/create-to-do-lists-that-actually-get-done.html | 12:32 |
| recheck | [taiga-blog] 6 excellent continuous integration tools → https://blog.taiga-staging.io/6-excellent-continuous-integration-tools.html | 12:32 |
| recheck | [taiga-blog] DevOps in an Agile setup → https://blog.taiga-staging.io/devops-in-an-agile-setup.html | 12:32 |
| recheck | [taiga-blog] Taiga Sarracenia Purpurea Release (1.8.0) → https://blog.taiga-staging.io/taiga-sarracenia-purpurea-release-180.html | 12:32 |
| recheck | [taiga-blog] Does documentation fit in an agile setup? → https://blog.taiga-staging.io/does-documentation-fit-in-an-agile-setup.html | 12:32 |
| recheck | [taiga-blog] Taiga Empetrum Nigrum Release (1.7.0) → https://blog.taiga-staging.io/taiga-empetrum-nigrum-release-170.html | 12:32 |
| recheck | [taiga-blog] 4 things I learnt in 5 months with Agile → https://blog.taiga-staging.io/4-things-i-learnt-in-5-months-with-agile.html | 12:32 |
| recheck | [taiga-blog] Agile terms you must know → https://blog.taiga-staging.io/agile-terms-you-must-know.html | 12:32 |
| recheck | [taiga-blog] 4 steps to get started with Agile → https://blog.taiga-staging.io/4-steps-to-get-started-with-agile.html | 12:32 |
| recheck | [taiga-blog] User stories demystified → https://blog.taiga-staging.io/user-stories-demystified.html | 12:32 |
| recheck | [taiga-blog] What is Kanban? → https://blog.taiga-staging.io/what-is-kanban.html | 12:32 |
| recheck | [taiga-blog] Agile as a management tool for non-IT industry: an insight → https://blog.taiga-staging.io/agile_as_management_tool_for_non_IT.html | 12:32 |
| recheck | [taiga-blog] Q: "I'd like to measure the sprint progress through closed tasks" → https://blog.taiga-staging.io/q-id-like-to-measure-the-sprint-progress-through-closed-tasks.html | 12:32 |
| recheck | [taiga-blog] 4 reasons you shouldn’t fall back to emails for project management → https://blog.taiga-staging.io/4-reasons-you-shouldnt-fall-back-to-emails-for-project-management.html | 12:32 |
| recheck | [taiga-blog] Taiga Abies Bifolia Release (1.6.0) → https://blog.taiga-staging.io/taiga-abies-bifolia-release-160.html | 12:32 |
| recheck | [taiga-blog] Your team doesn't update the PM tool? Here is what you can do. → https://blog.taiga-staging.io/your-team-doesnt-update-the-pm-tool-here-is-what-you-can-do.html | 12:33 |
| recheck | [taiga-blog] Taiga Betula Pendula FOSDEM 2015* Release (1.5.0) → https://blog.taiga-staging.io/taiga-betula-pendula-fosdem-2015-release-150.html | 12:33 |
| recheck | [taiga-blog] Taiga goes to FOSDEM 2015! → https://blog.taiga-staging.io/taiga-goes-to-fosdem-2015.html | 12:33 |
| recheck | [taiga-blog] Help - There's no one at the controls of Taiga.io! → https://blog.taiga-staging.io/help-theres-no-one-at-the-controls-of-taigaio.html | 12:33 |
| recheck | [taiga-blog] Taiga Abies veitchii Release (v1.4.0) → https://blog.taiga-staging.io/taiga-abies-veitchii-release-v140.html | 12:33 |
| recheck | [taiga-blog] EPIC Stories → https://blog.taiga-staging.io/epic-stories.html | 12:33 |
| recheck | [taiga-blog] Taiga Dryas Hookeriana Release (v1.3.0) → https://blog.taiga-staging.io/taiga-dryas-hookeriana-release-v130.html | 12:33 |
| recheck | [taiga-blog] Taiga Picea Obovata Release (v1.2.0) → https://blog.taiga-staging.io/taiga-picea-obovata-release-v120.html | 12:33 |
| recheck | [taiga-blog] Our first TAIGA DAY → https://blog.taiga-staging.io/our-first-taiga-day.html | 12:33 |
| recheck | [taiga-blog] Taiga Alnus maximowiczii release (v1.1.0 ) → https://blog.taiga-staging.io/taiga-alnus-maximowiczii-release-v110.html | 12:33 |
| recheck | [taiga-blog] Welcome, you've been taigatized! → https://blog.taiga-staging.io/welcome-youve-been-taigatized.html | 12:33 |
| marios|rover | zbr: kill it with fire ^ | 12:34 |
| rlandy | oh please | 12:35 |
| rlandy | "you've been taigatized!" | 12:35 |
| rlandy | Indeed | 12:35 |
| *** jpena|lunch is now known as jpena | 12:35 | |
| *** holser has quit IRC | 12:35 | |
| rlandy | weshay_: still want to go through the timeout from last night? | 12:35 |
| *** holser has joined #oooq | 12:36 | |
| zbr | woq. | 12:43 |
| *** recheck has quit IRC | 12:44 | |
| *** recheck has joined #oooq | 12:44 | |
| zbr | marios|rover: done, removed taiga blog feed. | 12:45 |
| zbr | it went well for few weeks, until itdidn't | 12:45 |
| marios|rover | zbr: ack thx | 12:45 |
| zbr | marios|rover: I think I know what happened, is not my bot, they deployed staging to productions.... you see links? | 12:46 |
| zbr | the bot was "right" the feed was updated, all links were "new". | 12:46 |
| *** dsneddon has quit IRC | 12:49 | |
| rlandy | marios|rover: rfolco|ruck: I'm w+'ing https://review.rdoproject.org/r/#/c/23074/ | 12:50 |
| rlandy | to make promoter tests voting | 12:50 |
| rfolco|ruck | rlandy, make promoter jobs great again | 12:50 |
| rlandy | done | 12:51 |
| rfolco|ruck | \o/ | 12:51 |
| marios|rover | rlandy: ack | 12:51 |
| weshay_ | arxcruz, I may be a few minutes late to the mtg | 12:54 |
| *** jbadiapa has joined #oooq | 12:57 | |
| *** jbadiapa has quit IRC | 12:58 | |
| rfolco|ruck | weshay_, did you lock promoter down? I cannot access it anymore | 12:58 |
| *** jbadiapa has joined #oooq | 12:58 | |
| zbr | who wants to assist me with centos8 work? | 13:03 |
| zbr | weshay_: good news: upstream we already have centos-8 nodes but zuul roles need updates for them, not usable yet / working on it. | 13:04 |
| zbr | example https://review.opendev.org/#/c/688118/ | 13:04 |
| kopecmartin | arxcruz: do we have a meeting? | 13:05 |
| *** holser has quit IRC | 13:05 | |
| weshay_ | arxcruz, ping | 13:05 |
| weshay_ | arxcruz, is pto | 13:06 |
| *** holser has joined #oooq | 13:09 | |
| *** amoralej|lunch is now known as amoralej | 13:11 | |
| weshay_ | https://github.com/openstack/tripleo-ci/blob/master/toci-quickstart/config/collect-logs.yml | 13:13 |
| rlandy | 2019-10-11 11:28:23 | Ansible timed out at 5541 seconds. | 13:15 |
| rlandy | really??????? | 13:15 |
| rlandy | that's too much | 13:15 |
| rlandy | weshay_: ^^ I hear you on the performance regression | 13:16 |
| rlandy | there is NO way a deployment needs that long | 13:16 |
| * rlandy checks for stalling pieces | 13:16 | |
| rlandy | 2019-10-11 10:03:12 | "FileDescriptorStoreMax": "0", | 13:17 |
| rlandy | 2019-10-11 11:28:19 | "FragmentPath": "/usr/lib/systemd/system/chronyd.service", | 13:17 |
| rlandy | 2019-10-11 11:28:19 | "GuessMainPID": "yes", | 13:17 |
| rlandy | 1.5 hrs in the same step? | 13:17 |
| rlandy | 2019-10-11 10:03:12 | RUNNING HANDLER [chrony : Restart chronyd] ************************************* | 13:17 |
| rlandy | 2019-10-11 10:03:12 | changed: [overcloud-novacompute-0] => { | 13:17 |
| rlandy | arxcruz: raukadah: can you tell me if baremetal is running with the right combination of tempest variables and is kicking the right roles ... | 13:23 |
| rlandy | master currently fails on 2019-10-11 10:57:16.082367 | primary | TASK [Copy clouds.yaml file from user's home to /root directory] ************** | 13:24 |
| rlandy | ^^ there is no clouds.yaml where it is looking for it | 13:24 |
| *** dsneddon has joined #oooq | 13:24 | |
| rlandy | https://github.com/openstack/tripleo-quickstart-extras/blob/master/playbooks/tempest.yml#L22 | 13:24 |
| rlandy | ^^ on that line | 13:24 |
| rlandy | weshay_: ^^ master gets by deploy though :) | 13:25 |
| *** akahat has quit IRC | 13:35 | |
| marios|rover | reviews please https://review.opendev.org/#/c/687375/1 for https://bugs.launchpad.net/tripleo/+bug/1843259 | 13:39 |
| openstack | Launchpad bug 1843259 in tripleo "Periodic rocky fs020 job fails tempest tests tempest.scenario.test_security_groups_basic_ops.TestSecurityGroupsBasicOps.test_cross_tenant_traffic and tempest.scenario.test_security_groups_basic_ops.TestSecurityGroupsBasicOps.test_multiple_security_groups " [Critical,In progress] - Assigned to Luke Short (ekultails) | 13:39 |
| zbr | rlandy: weshay_ marios|rover : can we sf https://review.opendev.org/#/c/679409/ ? | 13:41 |
| weshay_ | soniya29, surpatil https://github.com/rdo-infra/ci-config/blob/master/ci-scripts/infra-setup/roles/rrcockpit/files/telegraf/zuulv3_job_builds.py#L105-L119 | 13:44 |
| marios|rover | zbr: voted... jobs there look good wondering if it impacts rdo jobs that inherit from upstream | 13:45 |
| zbr | marios|rover: we already moved lots of jobs to 2.8 already, this is only moving the min bit upwords. FYI, pbelanger just sent an email to propose changing default on zuul itself to 2.8,... hoefully we would be able to merge this before zuul does | 13:46 |
| marios|rover | zbr: ack | 13:46 |
| zbr | once we do, we could start removing the ansible interpreter vars | 13:47 |
| *** aakarsh has joined #oooq | 13:50 | |
| rlandy | zbr: checking | 13:54 |
| rlandy | zbr: done | 13:54 |
| zbr | thanks! | 13:55 |
| *** udesale has quit IRC | 13:57 | |
| *** udesale has joined #oooq | 13:58 | |
| *** soniya29 has quit IRC | 13:58 | |
| *** surpatil has quit IRC | 13:58 | |
| *** surpatil has joined #oooq | 13:59 | |
| rlandy | weshay_: ha ... when you are free, have something to show you wrt running time and chrony... look at this .... | 14:01 |
| rlandy | 2019-10-10 19:20:54 | TASK [Set timezone fact] ******************************************************* | 14:01 |
| rlandy | 2019-10-10 19:20:54 | ok: [standalone] | 14:01 |
| rlandy | 2019-10-10 19:20:54 | Thursday 10 October 2019 19:20:54 -0400 (0:00:00.075) 0:02:14.229 ****** | 14:01 |
| rlandy | 2019-10-10 23:20:55 | | 14:01 |
| rlandy | 2019-10-10 23:20:55 | TASK [Set timezone to UTC] ***************************************************** | 14:01 |
| rlandy | note the four hours when we switch to UTC | 14:01 |
| rlandy | it just logs four hours - it's the time change | 14:01 |
| weshay_ | rlandy, k.. need a few | 14:04 |
| rlandy | woohoo osp 16 deploys standalone | 14:18 |
| *** bogdando has quit IRC | 14:22 | |
| *** skramaja has quit IRC | 14:27 | |
| weshay_ | rlandy, so really the node should be on utc to start | 14:29 |
| weshay_ | rlandy, is that just an internal zuul / nodepool issue? | 14:29 |
| rlandy | weshay_: I think so - because rdocloud should be utc | 14:32 |
| rlandy | I am not sure how deploy time is calculated | 14:33 |
| rlandy | and if that is taken into account | 14:33 |
| *** ykarel is now known as ykarel|away | 14:33 | |
| rlandy | checking ovb to confirm | 14:33 |
| rlandy | weshay_: unrelated ... this is osp 16 standalone running tempest now ... https://sf.hosted.upshift.rdu2.redhat.com/zuul/t/tripleo-ci-internal/stream/f196b614cc584530915485b379e7b8af?logfile=console.log | 14:34 |
| weshay_ | great | 14:34 |
| marios|rover | :qa | 14:35 |
| rlandy | weshay_: this is rdocloud ... | 14:35 |
| rlandy | 2019-10-11 08:10:28 | TASK [Set timezone fact] ******************************************************* | 14:35 |
| rlandy | 2019-10-11 08:10:28 | ok: [standalone] | 14:35 |
| rlandy | 2019-10-11 08:10:28 | Friday 11 October 2019 08:10:28 -0400 (0:00:00.084) 0:02:05.065 ******** | 14:35 |
| rlandy | 2019-10-11 12:10:28 | | 14:35 |
| rlandy | 2019-10-11 12:10:28 | TASK [Set timezone to UTC] ***************************************************** | 14:35 |
| rlandy | 2019-10-11 12:10:28 | changed: [standalone] | 14:35 |
| rlandy | 2019-10-11 12:10:28 | Friday 11 October 2019 08:10:28 -0400 (0:00:00.502) 0:02:05.568 ******** | 14:35 |
| rlandy | http://logs.rdoproject.org/07/688107/1/openstack-check/tripleo-ci-rhel-8-scenario001-standalone-rdo/6bd9961/logs/undercloud/home/zuul/standalone_deploy.log.txt.gz | 14:36 |
| rlandy | now I am not sure if that factors into deploy time or not | 14:36 |
| rlandy | probably not - otherwise this would time out | 14:36 |
| *** TrevorV has joined #oooq | 14:37 | |
| *** ykarel|away has quit IRC | 14:38 | |
| rlandy | 2019-10-11 12:37:56 | "Requires": "-.mount basic.target system.slice", | 14:38 |
| rlandy | 2019-10-11 13:02:53 | "RequiresMountsFor": "/var/tmp", | 14:38 |
| rlandy | 2019-10-11 13:02:53 | "Restart": "no", | 14:38 |
| rlandy | so it does a little | 14:39 |
| weshay_ | marios|rover, rfolco|ruck no updates in the etherpad? :) | 14:39 |
| rlandy | weshay_: so within chronyd restart task we jump about 30 mins | 14:40 |
| rlandy | but idk how deploy time is calculated | 14:40 |
| rlandy | and if that factors in | 14:40 |
| rlandy | see log: | 14:40 |
| marios|rover | weshay_: i've added few notes but no new bugs that i'm aware of no | 14:40 |
| rlandy | http://logs.rdoproject.org/openstack-regular/opendev.org/openstack/tripleo-ci/master/tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001/a9deaaa/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz | 14:40 |
| weshay_ | rlandy, btw.. you can see bm voting in this view :) https://trunk-primary.rdoproject.org/api-centos-master-uc/api/civotes_detail.html?commit_hash=11596de92d0715f7c71348f59104ffe71399079e&distro_hash=aba8ec542777d218da0a947f2fa3a801fde3696b | 14:41 |
| rlandy | weshay_: it has done for a long time :) | 14:41 |
| rlandy | it reports | 14:41 |
| weshay_ | rlandy, ya.. I know.. but the visibility has been less then clear | 14:41 |
| weshay_ | nice to see it here :) | 14:41 |
| rlandy | also - I haven't done the final steps to move the logs to public | 14:42 |
| rfolco|ruck | weshay_, I am looking at fs001, no updates | 14:45 |
| weshay_ | we may need to consider splitting large logs | 14:49 |
| marios|rover | anyone know whats up with logreduce i'm getting TypeError: __init__() got an unexpected keyword argument 'exclude_lines' | 14:54 |
| marios|rover | anyone used it lately? | 14:54 |
| weshay_ | rfolco|ruck, marios|rover I rdo cloud is fucked up | 14:55 |
| weshay_ | our ovb jobs are not getting ips.. not sure .. but that's what my initial poking is telling me | 14:56 |
| marios|rover | weshay_: wasn't sure if that was a question or a statement | 14:56 |
| weshay_ | rlandy, ping.. | 15:01 |
| rlandy | weshay_: do we still need the periodic-tripleo-ci-rhel-8-standalone-need-images-rhos-15 jobs? | 15:01 |
| weshay_ | rlandy, bm master is deploying w/ podman on centos-7 | 15:01 |
| weshay_ | rlandy, https://sf.hosted.upshift.rdu2.redhat.com/logs/periodic-hourly/code.engineering.redhat.com/openstack/tripleo-ci-internal-jobs/master/periodic-tripleo-ci-centos-7-ha_lab_andromeda-baremetal_3ctlr_2comp-featureset001-master/d4bc147/logs/undercloud/home/zuul/overcloud-deploy.sh | 15:01 |
| weshay_ | vs. | 15:01 |
| weshay_ | http://logs.rdoproject.org/30/682630/5/openstack-check/tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001/6066f2f/logs/undercloud/home/zuul/overcloud-deploy.sh | 15:01 |
| *** surpatil has quit IRC | 15:01 | |
| weshay_ | rlandy, we have something wrong in our settings | 15:02 |
| * rlandy looks at ovb | 15:03 | |
| weshay_ | marios|rover, rfolco|ruck it's an indication we need to jump on #sf-ops and ping kforde about.. but we may need more investigation on our side | 15:03 |
| rlandy | weshay_: to begin ... that is not our master job - the logs you linked belong to pidone | 15:04 |
| rlandy | weshay_: this is our master job ... periodic-tripleo-ci-centos-7-bm_envA-3ctlr_1comp-featureset001-master | 15:04 |
| rlandy | which may also be wrong :) | 15:04 |
| rlandy | checking that one | 15:04 |
| weshay_ | ah dam | 15:05 |
| weshay_ | rlandy, is this the right one? https://sf.hosted.upshift.rdu2.redhat.com/logs/periodic-hourly/code.engineering.redhat.com/openstack/tripleo-ci-internal-jobs/master/periodic-tripleo-ci-centos-7-bm_envA-3ctlr_1comp-featureset001-master/30e09f2/ | 15:05 |
| weshay_ | ya | 15:05 |
| weshay_ | rfolco|ruck, ok.. bm is working on the deploy | 15:07 |
| weshay_ | https://sf.hosted.upshift.rdu2.redhat.com/logs/periodic-hourly/code.engineering.redhat.com/openstack/tripleo-ci-internal-jobs/master/periodic-tripleo-ci-centos-7-bm_envA-3ctlr_1comp-featureset001-master/30e09f2/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz | 15:07 |
| weshay_ | not working in ovb | 15:07 |
| rlandy | yes | 15:07 |
| weshay_ | so we have a pretty good indication that rdo-cloud is f.. w/ us | 15:07 |
| weshay_ | bm is failing on | 15:08 |
| weshay_ | 2019-10-11 10:57:16.082367 | primary | TASK [Copy clouds.yaml file from user's home to /root directory] *************** | 15:08 |
| weshay_ | 2019-10-11 10:57:16.171761 | primary | Friday 11 October 2019 10:57:16 +0000 (0:00:01.600) 0:00:23.828 ******** | 15:08 |
| weshay_ | 2019-10-11 10:57:17.968523 | primary | An exception occurred during task execution. To see the full traceback, use -vvv. The error was: If you are using a module and expect the file to exist on the remote, see the remote_src option | 15:08 |
| weshay_ | 2019-10-11 10:57:17.969073 | primary | fatal: [undercloud]: FAILED! => { | 15:08 |
| weshay_ | 2019-10-11 10:57:17.969146 | primary | "changed": false | 15:08 |
| weshay_ | 2019-10-11 10:57:17.969162 | primary | } | 15:08 |
| rlandy | weshay_: ack - tried to ping tempest guys about that above | 15:09 |
| rlandy | but they are gone today | 15:09 |
| rlandy | maybe I have a setting missing? | 15:09 |
| rlandy | baremetal is one check behind usually | 15:10 |
| rlandy | as it polls for the change afterwards | 15:10 |
| rlandy | I reduced the frequency of the pipeline | 15:10 |
| rlandy | https://sf.hosted.upshift.rdu2.redhat.com/logs/36/183136/3/check/tripleo-ci-rhel-8-standalone-rhos-16/f196b61/ | 15:11 |
| rlandy | hello osp 16 standlaone | 15:11 |
| weshay_ | I'm on the box.. it's def missing | 15:12 |
| weshay_ | rlandy, actually moved to /etc/openstack | 15:13 |
| weshay_ | rlandy, you file a boog? | 15:13 |
| rlandy | weshay_: :) ... did I or will I? I did not yet, I will | 15:14 |
| weshay_ | rlandy, I am now | 15:14 |
| weshay_ | easy fix :) | 15:14 |
| rlandy | ok then | 15:14 |
| *** ykarel|away has joined #oooq | 15:14 | |
| rlandy | weshay_: so is our master bM deploy doing the right thing now wrt podman? | 15:18 |
| * rlandy wants to delete pidone job if they are not using it | 15:19 | |
| weshay_ | rlandy, so.. not sure how the pidone job is different than our bm job.. ours works | 15:19 |
| weshay_ | rlandy, ya.. totally | 15:19 |
| weshay_ | rlandy, I suspect.. this works fine w/ os-tempest | 15:20 |
| rlandy | weshay_: let's talk this afternoon re: downstream/osp16/baremetal when you are not so busy. | 15:20 |
| rlandy | what we can get rid of etc. | 15:21 |
| rlandy | I want to bring up train and env C now | 15:21 |
| rlandy | or 16 on C | 15:21 |
| *** ykarel|away is now known as ykarel | 15:21 | |
| *** kopecmartin is now known as kopecmartin|off | 15:21 | |
| *** udesale has quit IRC | 15:23 | |
| weshay_ | rlandy, can we run bm w/ a change maybe.. not a big deal https://review.opendev.org/688148 | 15:29 |
| weshay_ | rfolco|ruck, ok.. let's see wtf.. is going on w/ rdo-cloud | 15:29 |
| weshay_ | rfolco|ruck, want to chat? | 15:30 |
| rfolco|ruck | yes | 15:30 |
| rfolco|ruck | weshay_, on your room | 15:31 |
| rfolco|ruck | weshay_, gmeet | 15:31 |
| weshay_ | rfolco|ruck, oh.. I have a room? what is it lolz? | 15:31 |
| rlandy | weshay_: ack | 15:31 |
| rfolco|ruck | weshay_, your invite says https://meet.google.com/etf-xwxz-kwa?authuser=1 | 15:31 |
| rlandy | weshay_: kicking that now | 15:32 |
| weshay_ | rfolco|ruck, https://trunk-primary.rdoproject.org/api-centos-master-uc/api/civotes_detail.html?commit_hash=11596de92d0715f7c71348f59104ffe71399079e&distro_hash=aba8ec542777d218da0a947f2fa3a801fde3696b | 15:33 |
| rlandy | ok -bm test in progress | 15:36 |
| *** jaosorior has quit IRC | 15:55 | |
| *** ykarel is now known as ykarel|afk | 15:55 | |
| *** sanjayu_ has quit IRC | 16:01 | |
| rascasoft | rlandy, "bm test in progress" it's so good to read this :) | 16:14 |
| rlandy | rascasoft: OMG - how are you??? | 16:15 |
| rascasoft | rlandy, fine fine, really fine what about you all? | 16:15 |
| rlandy | rascasoft: ok - still here :) | 16:15 |
| rlandy | rascasoft: what's going on? how's the new life? miss us much? | 16:15 |
| rascasoft | rlandy, too much, too much | 16:16 |
| rlandy | lol - good to hear from you! | 16:16 |
| rlandy | still fighting overcloud deploy battles | 16:17 |
| weshay_ | rlandy, the mtu on baremetal what should that be? | 16:18 |
| weshay_ | you love mtu.. like you love linting :) | 16:18 |
| rlandy | weshay_: we stopped changing mtus | 16:18 |
| rlandy | used to be 1350 | 16:18 |
| rascasoft | rlandy, that's a battle worth fighting!!! | 16:18 |
| rlandy | we haven't gotten into that in a while | 16:19 |
| rlandy | why? what happened with mtus now? | 16:19 |
| weshay_ | rlandy, https://sf.hosted.upshift.rdu2.redhat.com/logs/periodic-hourly/code.engineering.redhat.com/openstack/tripleo-ci-internal-jobs/master/periodic-tripleo-ci-centos-7-bm_envA-3ctlr_1comp-featureset001-master/30e09f2/logs/overcloud-controller-0/var/log/extra/network.txt.gz | 16:20 |
| weshay_ | rlandy, should be 1350 right? https://opendev.org/openstack/tripleo-heat-templates/src/branch/master/ci/environments/network/multiple-nics/nic-configs/controller.yaml#L178 | 16:21 |
| rlandy | weshay_: we are not deploying multinic on bm | 16:22 |
| rlandy | that's ovb | 16:23 |
| rlandy | we had a role to adjust mtus and we are no longer calling it | 16:23 |
| rlandy | it was working with 1500 so I left it | 16:23 |
| weshay_ | rlandy, where does os-net-config log to? I forget | 16:25 |
| *** aakarsh|2 has joined #oooq | 16:25 | |
| rlandy | weshay_: what are you looking to trace? | 16:26 |
| weshay_ | rfolco|ruck, https://github.com/openstack/os-net-config | 16:26 |
| rlandy | maybe if I understand that I can help more? | 16:27 |
| *** marios|rover has quit IRC | 16:27 | |
| weshay_ | rlandy, so the net interfaces on the overcloud are not configured at all.. all we have is eth0 | 16:27 |
| weshay_ | rlandy, want to join our party? | 16:27 |
| rlandy | on ovb or bm? | 16:27 |
| * rlandy better join the party | 16:27 | |
| weshay_ | ovb | 16:27 |
| weshay_ | rlandy, but 1500 on the bm overcloud controllers is bad afaict | 16:28 |
| rfolco|ruck | rlandy, https://meet.google.com/etf-xwxz-kwa | 16:28 |
| weshay_ | rlandy, do we have a completed overcloud deployment? | 16:28 |
| *** aakarsh has quit IRC | 16:28 | |
| weshay_ | on bm | 16:28 |
| *** aakarsh|2 has quit IRC | 16:32 | |
| *** jfrancoa has quit IRC | 16:47 | |
| *** holser has quit IRC | 16:47 | |
| *** derekh has quit IRC | 16:48 | |
| weshay_ | rfolco|ruck, rlandy https://github.com/openstack/tripleo-heat-templates/blob/master/network/scripts/run-os-net-config.sh | 16:54 |
| weshay_ | rfolco|ruck, rlandy https://review.opendev.org/#/q/status:merged+tripleo+age:3week | 16:58 |
| *** dsneddon has quit IRC | 16:59 | |
| *** dsneddon has joined #oooq | 17:01 | |
| weshay_ | rfolco|ruck, rlandy https://review.opendev.org/#/c/687437/ | 17:02 |
| weshay_ | https://opendev.org/openstack/tripleo-heat-templates/commit/ff7cce93ebcdf4fd868329be94d618f9e755049f | 17:03 |
| zbr | rlandy: are you aware of tripleo-ci-centos-7-scenario000-multinode-oooq-container-updates failure? | 17:04 |
| zbr | https://review.opendev.org/#/c/679409/4 | 17:04 |
| zbr | rfolco|ruck: ^^ | 17:04 |
| *** amoralej is now known as amoralej|off | 17:05 | |
| weshay_ | rlandy, rfolco|ruck https://opendev.org/openstack/tripleo-heat-templates/src/branch/master/ci/environments/network/multiple-nics/nic-configs/controller.yaml | 17:05 |
| *** jpena is now known as jpena|off | 17:05 | |
| *** dsneddon has quit IRC | 17:06 | |
| rlandy | cf06b61d670b301c57fce70e19aa17ac7561b037 | 17:09 |
| rlandy | https://github.com/openstack/tripleo-heat-templates/commits/master | 17:09 |
| rlandy | b66148533710d587595bfc27afe852348a9e124e | 17:10 |
| *** dsneddon has joined #oooq | 17:19 | |
| *** dsneddon has quit IRC | 17:24 | |
| weshay_ | rfolco|ruck, http://logs.rdoproject.org/openstack-periodic-master/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-7-standalone-master/4874249/job-output.txt | 17:25 |
| weshay_ | 2019-10-11 13:59:07.323495 | primary | ++(/etc/ci/mirror_info.sh:75): NODEPOOL_PERCONA_PROXY=mirror.regionone.rdo-cloud-tripleo.rdoproject.org:8080/percona | 17:25 |
| weshay_ | 2019-10-11 13:59:07.323553 | primary | +(/home/zuul/src/opendev.org/openstack/tripleo-ci/toci_gate_test.sh:25): sudo rm -rf /opt/git | 17:25 |
| weshay_ | 2019-10-11 15:32:11.574954 | primary | +(/home/zuul/src/opendev.org/openstack/tripleo-ci/toci_gate_test.sh:29): export NODEPOOL_PROVIDER=rdo-cloud-tripleo | 17:25 |
| *** rascasoft has quit IRC | 17:28 | |
| *** rascasoft has joined #oooq | 17:28 | |
| rlandy | brb | 17:36 |
| *** rlandy is now known as rlandy|brb | 17:36 | |
| *** dsneddon has joined #oooq | 17:50 | |
| *** rlandy|brb is now known as rlandy | 18:08 | |
| rlandy | weshay_: what's your schedule like this afternoon? | 18:31 |
| weshay_ | rlandy, better chat now if you need to.. I have to run to an appointment at 1:25 | 18:32 |
| rlandy | weshay_: ok - just need a few minutes | 18:32 |
| weshay_ | k.. 2min | 18:32 |
| rlandy | ok - what do I deploy on the hardware undercloud? | 18:33 |
| rlandy | can I delete one | 18:34 |
| rlandy | can I delete needs images? | 18:34 |
| rlandy | are we ok with osp016 config | 18:34 |
| rlandy | note comments | 18:34 |
| rlandy | done | 18:34 |
| rlandy | in under 2 minutes | 18:34 |
| weshay_ | rlandy, https://meet.google.com/raf-ptkp-keq | 18:35 |
| weshay_ | rlandy, ? | 18:38 |
| *** rlandy has quit IRC | 18:38 | |
| rfolco|ruck | weshay_, that rm -rf delay is just a coincidence, cannot find any other case | 18:39 |
| *** rlandy has joined #oooq | 18:39 | |
| rlandy | weshay_: ok - back | 18:40 |
| weshay_ | rfolco|ruck, there were 4 in a row | 18:40 |
| weshay_ | no? | 18:40 |
| weshay_ | rlandy, hey | 18:40 |
| weshay_ | rfolco|ruck, ok.. retrigger those 4 timedout w/ a test project on that hash | 18:41 |
| rfolco|ruck | weshay_, which 4? where did you see it? | 18:41 |
| rfolco|ruck | https://review.rdoproject.org/zuul/builds?pipeline=openstack-periodic-master&result=TIMED_OUT | 18:43 |
| weshay_ | there were 4 timed out jobs in master pipeline | 18:43 |
| rfolco|ruck | fail for diff reasons | 18:43 |
| *** jrist has quit IRC | 18:43 | |
| rfolco|ruck | rm -rf was not the root cause IMHO | 18:44 |
| *** jbadiapa has quit IRC | 18:45 | |
| *** jrist has joined #oooq | 18:51 | |
| weshay_ | http://logs.rdoproject.org/openstack-periodic-master/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset037-updates-master/a67c38f/job-output.txt | 18:58 |
| weshay_ | http://logs.rdoproject.org/openstack-periodic-master/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-7-singlenode-featureset050-upgrades-master/b6ee98f/job-output.txt | 18:58 |
| weshay_ | http://logs.rdoproject.org/openstack-periodic-master/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-7-standalone-master/4874249/job-output.txt | 18:58 |
| weshay_ | rfolco|ruck, those 3 have the issue | 18:58 |
| weshay_ | this one does not.. | 18:59 |
| weshay_ | http://logs.rdoproject.org/openstack-periodic-master/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-7-standalone-full-tempest-master/af234d9/job-output.txt | 18:59 |
| weshay_ | rfolco|ruck, the last one timed out in tempest | 18:59 |
| weshay_ | 2019-10-11 14:25:25.198255 | primary | TASK [os_tempest : Execute tempest tests] ************************************** | 18:59 |
| weshay_ | 2019-10-11 14:25:25.223162 | primary | Friday 11 October 2019 14:25:25 +0000 (0:00:00.100) 0:32:49.632 ******** | 18:59 |
| weshay_ | 2019-10-11 16:44:48.913629 | | 18:59 |
| rfolco|ruck | weshay_, ok will file a bug with these logs then | 19:00 |
| *** TrevorV has quit IRC | 19:00 | |
| *** weshay_ is now known as weshay | 19:00 | |
| *** aakarsh|2 has joined #oooq | 19:17 | |
| *** jtomasek has quit IRC | 19:49 | |
| *** ykarel|afk has quit IRC | 19:50 | |
| *** holser has joined #oooq | 20:40 | |
| rlandy | weshay: you around? | 20:51 |
| *** holser has quit IRC | 21:14 | |
| *** rfolco|ruck has quit IRC | 21:17 | |
| *** tesseract has quit IRC | 21:18 | |
| *** rlandy has quit IRC | 21:57 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!