| openstackgerrit | RedHat RDO CI proposed openstack/tripleo-quickstart-extras master: GATE CHECK for quickstart-extras https://review.openstack.org/560445 | 00:00 |
|---|---|---|
| *** bdodd has quit IRC | 00:03 | |
| *** wolverineav has quit IRC | 00:06 | |
| *** wolverineav has joined #tripleo | 00:07 | |
| *** artom has joined #tripleo | 00:09 | |
| *** ooolpbot has joined #tripleo | 00:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 00:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1782267 | 00:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1783055 | 00:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1783399 | 00:10 |
| *** ooolpbot has quit IRC | 00:10 | |
| openstack | Launchpad bug 1782267 in tripleo "Stderr: u'Set Chassis Power Control to Up/On failed: Command not supported in present state\n': ProcessExecutionError: Unexpected error while running command." [Critical,Triaged] | 00:10 |
| openstack | Launchpad bug 1783055 in tripleo "[master]multinode periodic promotion jobs are failing where Tempest is run in container" [Critical,In progress] - Assigned to chandan kumar (chkumar246) | 00:10 |
| openstack | Launchpad bug 1783399 in tripleo "containerized undercloud upgrade jobs isn't testing upgrades anymore" [Critical,Triaged] - Assigned to Emilien Macchi (emilienm) | 00:10 |
| *** medberry has joined #tripleo | 00:11 | |
| *** medberry has quit IRC | 00:11 | |
| *** medberry has joined #tripleo | 00:11 | |
| *** slaweq has joined #tripleo | 00:11 | |
| *** wolverineav has quit IRC | 00:14 | |
| *** hamzy_ has joined #tripleo | 00:14 | |
| *** slaweq has quit IRC | 00:16 | |
| *** bdodd has joined #tripleo | 00:20 | |
| *** rfolco has quit IRC | 00:21 | |
| *** rfolco has joined #tripleo | 00:22 | |
| *** wolverineav has joined #tripleo | 00:26 | |
| *** wolverineav has quit IRC | 00:28 | |
| *** wolverineav has joined #tripleo | 00:32 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: EC2MetadatIp using get_attr https://review.openstack.org/579581 | 00:36 |
| *** wolverineav has quit IRC | 00:36 | |
| *** wolverineav has joined #tripleo | 00:40 | |
| *** msufiyan|lunch has joined #tripleo | 00:42 | |
| *** agopi has quit IRC | 00:42 | |
| *** tzumainn has quit IRC | 00:43 | |
| *** wolverineav has quit IRC | 00:45 | |
| *** Petersingh has joined #tripleo | 00:49 | |
| *** wolverineav has joined #tripleo | 00:49 | |
| *** rlandy has joined #tripleo | 00:52 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: DnsServers using get_attr https://review.openstack.org/579582 | 00:53 |
| *** wolverineav has quit IRC | 00:54 | |
| *** yrabl has joined #tripleo | 00:55 | |
| openstackgerrit | James Slagle proposed openstack/tripleo-common master: Add override_ansible_cfg https://review.openstack.org/584087 | 00:57 |
| *** lblanchard has joined #tripleo | 00:57 | |
| *** Petersingh has joined #tripleo | 01:03 | |
| *** wolverineav has joined #tripleo | 01:03 | |
| *** wolverineav has quit IRC | 01:08 | |
| EmilienM | pabelanger: I'm not sure, CI folks probably. | 01:09 |
| *** ooolpbot has joined #tripleo | 01:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 01:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1782267 | 01:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1783055 | 01:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1783399 | 01:10 |
| *** ooolpbot has quit IRC | 01:10 | |
| openstack | Launchpad bug 1782267 in tripleo "Stderr: u'Set Chassis Power Control to Up/On failed: Command not supported in present state\n': ProcessExecutionError: Unexpected error while running command." [Critical,Triaged] | 01:10 |
| openstack | Launchpad bug 1783055 in tripleo "[master]multinode periodic promotion jobs are failing where Tempest is run in container" [Critical,In progress] - Assigned to chandan kumar (chkumar246) | 01:10 |
| openstack | Launchpad bug 1783399 in tripleo "containerized undercloud upgrade jobs isn't testing upgrades anymore" [Critical,Triaged] - Assigned to Emilien Macchi (emilienm) | 01:10 |
| *** slaweq has joined #tripleo | 01:11 | |
| *** mrsoul has joined #tripleo | 01:14 | |
| *** slaweq has quit IRC | 01:16 | |
| *** mrsoul` has quit IRC | 01:17 | |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-common master: ansible: replace yum module by package module when possible https://review.openstack.org/584480 | 01:21 |
| *** wolverineav has joined #tripleo | 01:21 | |
| EmilienM | mwhahaha: https://review.openstack.org/#/c/585528/ fix the upgrade job | 01:22 |
| EmilienM | see http://logs.openstack.org/28/585528/1/check/tripleo-ci-centos-7-containerized-undercloud-upgrades/2eb0493/logs/undercloud/home/zuul/undercloud_upgrade.log.txt.gz | 01:22 |
| *** wolverineav has quit IRC | 01:22 | |
| *** artom has quit IRC | 01:23 | |
| *** rlandy has quit IRC | 01:24 | |
| *** wolverineav has joined #tripleo | 01:28 | |
| *** agopi has joined #tripleo | 01:29 | |
| *** links has joined #tripleo | 01:30 | |
| *** wolverineav has quit IRC | 01:32 | |
| *** wolverineav has joined #tripleo | 01:34 | |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: Fix a race when upgrading Neutron & Ironic on the undercloud https://review.openstack.org/585583 | 01:37 |
| EmilienM | rfolco: can you look at https://review.openstack.org/#/c/585528/ please, it seems to fail for valid reasons. Feel free to take over my patch. I want to fix the containerized undercloud upgrade job asap. | 01:39 |
| *** wolverineav has quit IRC | 01:39 | |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: Fix a race when upgrading Neutron & Ironic on the undercloud https://review.openstack.org/585583 | 01:40 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-quickstart master: fs050: enable TLS https://review.openstack.org/585333 | 01:41 |
| *** wolverineav has joined #tripleo | 01:41 | |
| *** yamahata has quit IRC | 01:43 | |
| *** wolverineav has quit IRC | 01:49 | |
| rfolco | EmilienM, looking | 01:50 |
| openstackgerrit | Steve Baker proposed openstack/tripleo-common master: Allow deferred undercloud push_destination detection https://review.openstack.org/585589 | 01:50 |
| *** msufiyan_ has joined #tripleo | 01:52 | |
| *** lblanchard has quit IRC | 01:53 | |
| *** msufiyan|lunch has quit IRC | 01:54 | |
| *** msufiyan__ has joined #tripleo | 01:55 | |
| *** msufiyan_ has quit IRC | 01:58 | |
| *** wolverineav has joined #tripleo | 01:59 | |
| *** gbarros has joined #tripleo | 02:02 | |
| *** wolverineav has quit IRC | 02:04 | |
| openstackgerrit | Steve Baker proposed openstack/python-tripleoclient master: Prepare defaults, defer detecting undercloud registry https://review.openstack.org/585590 | 02:06 |
| *** ooolpbot has joined #tripleo | 02:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 02:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1782267 | 02:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1783055 | 02:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1783399 | 02:10 |
| *** ooolpbot has quit IRC | 02:10 | |
| openstack | Launchpad bug 1782267 in tripleo "Stderr: u'Set Chassis Power Control to Up/On failed: Command not supported in present state\n': ProcessExecutionError: Unexpected error while running command." [Critical,Triaged] | 02:10 |
| openstack | Launchpad bug 1783055 in tripleo "[master]multinode periodic promotion jobs are failing where Tempest is run in container" [Critical,In progress] - Assigned to chandan kumar (chkumar246) | 02:10 |
| openstack | Launchpad bug 1783399 in tripleo "containerized undercloud upgrade jobs isn't testing upgrades anymore" [Critical,Triaged] - Assigned to Emilien Macchi (emilienm) | 02:10 |
| *** medberry has quit IRC | 02:11 | |
| *** slaweq has joined #tripleo | 02:11 | |
| *** gbarros has quit IRC | 02:12 | |
| *** yamahata has joined #tripleo | 02:15 | |
| *** slaweq has quit IRC | 02:16 | |
| *** wolverineav has joined #tripleo | 02:17 | |
| *** wolverineav has quit IRC | 02:23 | |
| EmilienM | rfolco: I'm off to bed, feel free to take over my patch. | 02:25 |
| rfolco | EmilienM, I could not find a successful job prior to the broken patch. Are you sure this job was working ? | 02:26 |
| EmilienM | rfolco: http://zuul.openstack.org/builds.html?job_name=tripleo-ci-centos-7-scenario000-multinode-oooq-container-updates | 02:27 |
| rfolco | EmilienM, ok, I'll take a look to see if I can find more evidence | 02:27 |
| EmilienM | rfolco: look at the duraction | 02:27 |
| EmilienM | duration | 02:27 |
| *** ramishra has joined #tripleo | 02:27 | |
| EmilienM | when it's "short", it didn't test the update | 02:27 |
| EmilienM | when it was long, it did test the updates | 02:27 |
| EmilienM | rfolco: but your patch disabled them all :( | 02:27 |
| EmilienM | and we didn't catch it because the jobs didn't fail | 02:28 |
| EmilienM | they just didn't upgrade :-) | 02:28 |
| EmilienM | anyway, i'm out. I hope we can figure out tomorrow | 02:28 |
| rfolco | all these seem to be after my broken patch merge | 02:28 |
| *** wolverineav has joined #tripleo | 02:29 | |
| rfolco | ok I'll be here for more investigation. Thanks. | 02:29 |
| EmilienM | rfolco: but still a variable issue. | 02:29 |
| *** athomas has quit IRC | 02:32 | |
| *** athomas has joined #tripleo | 02:32 | |
| *** wolverineav has quit IRC | 02:33 | |
| *** StevenK has quit IRC | 02:35 | |
| *** StevenK has joined #tripleo | 02:35 | |
| *** rh-jelabarre has quit IRC | 02:36 | |
| *** rh-jelabarre has joined #tripleo | 02:42 | |
| *** brault has quit IRC | 02:53 | |
| *** brault has joined #tripleo | 02:57 | |
| openstackgerrit | Rafael Folco proposed openstack-infra/tripleo-ci master: Fix TAG logic for all upgrade type jobs https://review.openstack.org/585528 | 03:02 |
| *** pmannidi_ has joined #tripleo | 03:02 | |
| openstackgerrit | Rafael Folco proposed openstack-infra/tripleo-ci master: Replace TAGS with ansible var https://review.openstack.org/584508 | 03:05 |
| *** ooolpbot has joined #tripleo | 03:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 03:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1782267 | 03:10 |
| openstack | Launchpad bug 1782267 in tripleo "Stderr: u'Set Chassis Power Control to Up/On failed: Command not supported in present state\n': ProcessExecutionError: Unexpected error while running command." [Critical,Triaged] | 03:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1783055 | 03:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1783399 | 03:10 |
| *** ooolpbot has quit IRC | 03:10 | |
| openstack | Launchpad bug 1783055 in tripleo "[master]multinode periodic promotion jobs are failing where Tempest is run in container" [Critical,In progress] - Assigned to chandan kumar (chkumar246) | 03:10 |
| openstack | Launchpad bug 1783399 in tripleo "containerized undercloud upgrade jobs isn't testing upgrades anymore" [Critical,Triaged] - Assigned to Emilien Macchi (emilienm) | 03:10 |
| *** slaweq has joined #tripleo | 03:11 | |
| *** slaweq has quit IRC | 03:15 | |
| *** janki has joined #tripleo | 03:17 | |
| *** wolverineav has joined #tripleo | 03:17 | |
| *** wolverineav has quit IRC | 03:22 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Remove unecessary back-slashes in CephManilaClientKey caps mon https://review.openstack.org/575915 | 03:25 |
| openstackgerrit | Merged openstack/tripleo-common master: Action to perform container image prepare https://review.openstack.org/558972 | 03:29 |
| *** pdeore has joined #tripleo | 03:35 | |
| *** msufiyan__ has quit IRC | 03:39 | |
| *** wolverineav has joined #tripleo | 03:40 | |
| *** wolverineav has quit IRC | 03:48 | |
| *** yrabl has quit IRC | 03:49 | |
| *** psahoo has joined #tripleo | 03:49 | |
| *** wolverineav has joined #tripleo | 03:50 | |
| openstackgerrit | Rabi Mishra proposed openstack/puppet-tripleo stable/pike: Remove notification_driver parameter from heat profile https://review.openstack.org/585617 | 03:54 |
| *** shreshtha has joined #tripleo | 03:54 | |
| *** wolverineav has quit IRC | 03:55 | |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart master: DNM, test https://review.openstack.org/\#/c/584265/ https://review.openstack.org/584556 | 03:58 |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart master: DNM, test https://review.openstack.org/\#/c/584265/ https://review.openstack.org/584556 | 03:58 |
| *** psachin` has joined #tripleo | 04:01 | |
| *** Petersingh is now known as Petersingh|afk | 04:04 | |
| openstackgerrit | Rafael Folco proposed openstack-infra/tripleo-ci master: Take periodic and dryrun out of TOCI_JOBTYPE https://review.openstack.org/582387 | 04:05 |
| *** mschuppert has joined #tripleo | 04:06 | |
| *** psachin`` has joined #tripleo | 04:06 | |
| *** psachin` has quit IRC | 04:07 | |
| *** msufiyan has joined #tripleo | 04:09 | |
| *** ooolpbot has joined #tripleo | 04:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 04:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1782267 | 04:10 |
| openstack | Launchpad bug 1782267 in tripleo "Stderr: u'Set Chassis Power Control to Up/On failed: Command not supported in present state\n': ProcessExecutionError: Unexpected error while running command." [Critical,Triaged] | 04:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1783055 | 04:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1783399 | 04:10 |
| *** ooolpbot has quit IRC | 04:10 | |
| openstack | Launchpad bug 1783055 in tripleo "[master]multinode periodic promotion jobs are failing where Tempest is run in container" [Critical,In progress] - Assigned to chandan kumar (chkumar246) | 04:10 |
| openstack | Launchpad bug 1783399 in tripleo "containerized undercloud upgrade jobs isn't testing upgrades anymore" [Critical,Triaged] - Assigned to Emilien Macchi (emilienm) | 04:10 |
| openstackgerrit | Rabi Mishra proposed openstack/puppet-tripleo stable/ocata: Remove notification_driver parameter from heat profile https://review.openstack.org/585620 | 04:10 |
| *** slaweq has joined #tripleo | 04:11 | |
| *** mdnadeem has joined #tripleo | 04:12 | |
| *** wolverineav has joined #tripleo | 04:15 | |
| *** Petersingh|afk is now known as Petersingh | 04:15 | |
| *** msufiyan has quit IRC | 04:15 | |
| *** slaweq has quit IRC | 04:16 | |
| *** wolverineav has quit IRC | 04:20 | |
| *** wolverineav has joined #tripleo | 04:22 | |
| *** wolverineav has quit IRC | 04:27 | |
| *** wolverineav has joined #tripleo | 04:31 | |
| *** nyechiel_ has quit IRC | 04:39 | |
| *** udesale has joined #tripleo | 04:39 | |
| *** wolverineav has quit IRC | 04:40 | |
| *** udesale has quit IRC | 04:42 | |
| *** udesale has joined #tripleo | 04:43 | |
| *** jaganathan has quit IRC | 04:44 | |
| *** jaganathan has joined #tripleo | 04:45 | |
| *** ykarel has joined #tripleo | 04:46 | |
| *** wolverineav has joined #tripleo | 04:49 | |
| *** wolverineav has quit IRC | 04:54 | |
| *** yprokule has joined #tripleo | 05:00 | |
| *** wolverineav has joined #tripleo | 05:04 | |
| *** Petersingh is now known as Petersingh|afk | 05:07 | |
| *** ooolpbot has joined #tripleo | 05:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 05:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1782267 | 05:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1783055 | 05:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1783399 | 05:10 |
| *** ooolpbot has quit IRC | 05:10 | |
| openstack | Launchpad bug 1782267 in tripleo "Stderr: u'Set Chassis Power Control to Up/On failed: Command not supported in present state\n': ProcessExecutionError: Unexpected error while running command." [Critical,Triaged] | 05:10 |
| openstack | Launchpad bug 1783055 in tripleo "[master]multinode periodic promotion jobs are failing where Tempest is run in container" [Critical,In progress] - Assigned to chandan kumar (chkumar246) | 05:10 |
| openstack | Launchpad bug 1783399 in tripleo "containerized undercloud upgrade jobs isn't testing upgrades anymore" [Critical,Triaged] - Assigned to Emilien Macchi (emilienm) | 05:10 |
| *** slaweq has joined #tripleo | 05:11 | |
| *** wolverineav has quit IRC | 05:12 | |
| *** udesale_ has joined #tripleo | 05:13 | |
| *** agopi has quit IRC | 05:14 | |
| *** Petersingh|afk is now known as Petersingh | 05:15 | |
| *** udesale has quit IRC | 05:15 | |
| *** slaweq has quit IRC | 05:15 | |
| *** skramaja has joined #tripleo | 05:17 | |
| *** agopi has joined #tripleo | 05:18 | |
| *** udesale_ has quit IRC | 05:19 | |
| *** udesale has joined #tripleo | 05:20 | |
| *** rrubins has quit IRC | 05:20 | |
| *** ratailor has joined #tripleo | 05:22 | |
| *** rrubins has joined #tripleo | 05:24 | |
| chkumar|rover | sshnaidm|ruck: panda|off mandre can we get tempest container patch merged https://review.openstack.org/#/c/584771/14 to unblock promotion | 05:25 |
| *** Petersingh is now known as Petersingh|afk | 05:27 | |
| *** dparkes has quit IRC | 05:29 | |
| *** quiquell has joined #tripleo | 05:36 | |
| *** maufart__ has joined #tripleo | 05:37 | |
| *** wolverineav has joined #tripleo | 05:38 | |
| *** Haresh has joined #tripleo | 05:41 | |
| *** wolverineav has quit IRC | 05:42 | |
| *** wolverineav has joined #tripleo | 05:52 | |
| *** jfrancoa has joined #tripleo | 05:53 | |
| *** agurenko has joined #tripleo | 05:54 | |
| *** wolverineav has quit IRC | 05:58 | |
| *** wolverineav has joined #tripleo | 06:00 | |
| *** alee has joined #tripleo | 06:01 | |
| *** yamahata has quit IRC | 06:02 | |
| *** yamahata has joined #tripleo | 06:02 | |
| *** jtcressy has quit IRC | 06:04 | |
| *** shreshtha has quit IRC | 06:04 | |
| *** saneax has joined #tripleo | 06:05 | |
| *** shreshtha has joined #tripleo | 06:05 | |
| openstackgerrit | Quique Llorente proposed openstack-infra/tripleo-ci master: Remove dependecy on common_functions.sh https://review.openstack.org/581668 | 06:08 |
| *** wolverineav has quit IRC | 06:08 | |
| *** Petersingh|afk is now known as Petersingh | 06:08 | |
| *** ccamacho has joined #tripleo | 06:09 | |
| *** ooolpbot has joined #tripleo | 06:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 06:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1782267 | 06:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1783055 | 06:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1783399 | 06:10 |
| *** ooolpbot has quit IRC | 06:10 | |
| openstack | Launchpad bug 1782267 in tripleo "Stderr: u'Set Chassis Power Control to Up/On failed: Command not supported in present state\n': ProcessExecutionError: Unexpected error while running command." [Critical,Triaged] | 06:10 |
| openstack | Launchpad bug 1783055 in tripleo "[master]multinode periodic promotion jobs are failing where Tempest is run in container" [Critical,In progress] - Assigned to chandan kumar (chkumar246) | 06:10 |
| openstack | Launchpad bug 1783399 in tripleo "containerized undercloud upgrade jobs isn't testing upgrades anymore" [Critical,Triaged] - Assigned to Emilien Macchi (emilienm) | 06:10 |
| *** slaweq has joined #tripleo | 06:11 | |
| *** cshastri has joined #tripleo | 06:14 | |
| *** slaweq has quit IRC | 06:16 | |
| chkumar|rover | need workflow on this https://review.openstack.org/#/c/584771/ | 06:17 |
| *** lvdombrkr has joined #tripleo | 06:17 | |
| *** lvdombrkr89 has joined #tripleo | 06:21 | |
| *** lvdombrkr has quit IRC | 06:24 | |
| *** psachin`` has quit IRC | 06:24 | |
| openstackgerrit | yolanda.robla proposed openstack/tripleo-docs master: Add comments about how to adapt services for FFU https://review.openstack.org/585395 | 06:30 |
| *** pgadiya has joined #tripleo | 06:30 | |
| *** pgadiya has quit IRC | 06:31 | |
| *** pcaruana has joined #tripleo | 06:33 | |
| *** psahoo has quit IRC | 06:33 | |
| *** ksambor has joined #tripleo | 06:35 | |
| *** jtcressy has joined #tripleo | 06:36 | |
| *** wolverineav has joined #tripleo | 06:36 | |
| *** quiquell is now known as quiquell|bbl | 06:37 | |
| openstackgerrit | Quique Llorente proposed openstack-infra/tripleo-ci master: [WIP] Run emit_releases_file.py for all featuresets https://review.openstack.org/585649 | 06:40 |
| *** wolverineav has quit IRC | 06:41 | |
| *** wolverineav has joined #tripleo | 06:42 | |
| *** pdeore_ has joined #tripleo | 06:44 | |
| *** pdeore has quit IRC | 06:46 | |
| *** wolverineav has quit IRC | 06:46 | |
| *** psahoo has joined #tripleo | 06:49 | |
| openstackgerrit | Saravanan KR proposed openstack/tripleo-heat-templates master: Remove HostnameFormatDefault from NFV roles https://review.openstack.org/585653 | 06:52 |
| *** pdeore_ has quit IRC | 06:52 | |
| openstackgerrit | Jose Luis Franco proposed openstack/tripleo-upgrade master: Run controller_pos_script.yml only if controllers var is defined. https://review.openstack.org/585654 | 06:52 |
| *** pdeore has joined #tripleo | 06:53 | |
| *** dparkes has joined #tripleo | 06:53 | |
| chkumar|rover | Tengu: quiquell|bbl controller undefined upgrade fix https://review.openstack.org/#/c/585654/ | 06:54 |
| *** lvdombrkr has joined #tripleo | 06:54 | |
| Tengu | chkumar|rover: oh. so when the command has no output, it doesn't register the var? that's pretty nasty. | 06:55 |
| *** lvdombrkr89 has quit IRC | 06:58 | |
| *** rcernin has quit IRC | 06:59 | |
| *** yolanda_ has quit IRC | 07:00 | |
| quiquell|bbl | chkumar|rover: thanks | 07:01 |
| *** quiquell|bbl is now known as quiquell | 07:01 | |
| *** amoralej|off is now known as amoralej | 07:01 | |
| quiquell | I see upgrades fail http://logs.openstack.org/54/585654/1/check/tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades/59e35e3/job-output.txt.gz#_2018-07-25_06_59_45_625255 | 07:01 |
| Tengu | quiquell: "Device "eth1" does not exist." | 07:05 |
| *** adrianreza has joined #tripleo | 07:05 | |
| Tengu | not sure if this creates any issue. | 07:05 |
| *** kopecmartin has joined #tripleo | 07:06 | |
| *** bogdando has joined #tripleo | 07:06 | |
| *** cylopez has joined #tripleo | 07:06 | |
| *** ooolpbot has joined #tripleo | 07:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 07:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1782267 | 07:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1783055 | 07:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1783399 | 07:10 |
| *** ooolpbot has quit IRC | 07:10 | |
| openstack | Launchpad bug 1782267 in tripleo "Stderr: u'Set Chassis Power Control to Up/On failed: Command not supported in present state\n': ProcessExecutionError: Unexpected error while running command." [Critical,Triaged] | 07:10 |
| openstack | Launchpad bug 1783055 in tripleo "[master]multinode periodic promotion jobs are failing where Tempest is run in container" [Critical,In progress] - Assigned to chandan kumar (chkumar246) | 07:10 |
| openstack | Launchpad bug 1783399 in tripleo "containerized undercloud upgrade jobs isn't testing upgrades anymore" [Critical,Triaged] - Assigned to Emilien Macchi (emilienm) | 07:10 |
| openstackgerrit | Quique Llorente proposed openstack/tripleo-heat-templates stable/queens: [DNM] To test emit_releases_file.py https://review.openstack.org/585656 | 07:11 |
| *** slaweq has joined #tripleo | 07:11 | |
| *** cylopez has left #tripleo | 07:12 | |
| openstackgerrit | Quique Llorente proposed openstack/tripleo-heat-templates stable/pike: [DNM] To test emit_releases_file.py https://review.openstack.org/585657 | 07:12 |
| *** shardy has joined #tripleo | 07:14 | |
| openstackgerrit | Quique Llorente proposed openstack/tripleo-heat-templates stable/ocata: [DNM] To test emit_releases_file.py https://review.openstack.org/585658 | 07:14 |
| openstackgerrit | Quique Llorente proposed openstack/tripleo-quickstart-extras master: [DNM] To test emit_releases_file.py https://review.openstack.org/585659 | 07:15 |
| *** shardy has quit IRC | 07:15 | |
| *** gkadam has joined #tripleo | 07:16 | |
| *** slaweq has quit IRC | 07:16 | |
| *** tesseract has joined #tripleo | 07:16 | |
| *** alee has quit IRC | 07:16 | |
| *** slaweq has joined #tripleo | 07:17 | |
| *** gfidente has joined #tripleo | 07:18 | |
| *** gfidente has quit IRC | 07:18 | |
| *** gfidente has joined #tripleo | 07:18 | |
| openstackgerrit | Yurii Prokulevych proposed openstack/tripleo-upgrade master: Set container_images_file for containerized undercloud. https://review.openstack.org/584286 | 07:20 |
| *** yolanda has joined #tripleo | 07:22 | |
| *** florianf has joined #tripleo | 07:22 | |
| *** nyechiel_ has joined #tripleo | 07:24 | |
| *** shardy has joined #tripleo | 07:25 | |
| chkumar|rover | bogdando: Hello | 07:26 |
| chkumar|rover | bogdando: need +w on this one https://review.openstack.org/584771 | 07:26 |
| *** wolverineav has joined #tripleo | 07:27 | |
| *** Petersingh_ has joined #tripleo | 07:27 | |
| *** dtantsur|afk is now known as dtantsur | 07:28 | |
| *** paramite has joined #tripleo | 07:29 | |
| *** Petersingh has quit IRC | 07:29 | |
| *** jtomasek has joined #tripleo | 07:31 | |
| *** wolverineav has quit IRC | 07:32 | |
| *** Haresh has quit IRC | 07:32 | |
| *** wolverineav has joined #tripleo | 07:32 | |
| *** ykarel is now known as ykarel|lunch | 07:34 | |
| openstackgerrit | Quique Llorente proposed openstack/tripleo-quickstart-extras master: Fix centos opstools repo deactivation https://review.openstack.org/577146 | 07:35 |
| *** avivgt has joined #tripleo | 07:36 | |
| *** wolverineav has quit IRC | 07:37 | |
| chkumar|rover | bogdando: oh i attached the wrong patch | 07:38 |
| *** Petersingh_ is now known as Petersingh|lunch | 07:38 | |
| openstackgerrit | Chandan Kumar proposed openstack/tripleo-quickstart-extras master: Fix tempest related files permissions for tempest container https://review.openstack.org/584771 | 07:40 |
| openstackgerrit | Chandan Kumar proposed openstack/tripleo-quickstart-extras master: Fix tempest related files permissions for tempest container https://review.openstack.org/584771 | 07:41 |
| chkumar|rover | bogdando: ^^ done | 07:41 |
| *** chem has joined #tripleo | 07:42 | |
| *** holser_ has joined #tripleo | 07:46 | |
| bogdando | chkumar|rover: do we also need to add kolla chown for http://git.openstack.org/cgit/openstack/tripleo-heat-templates/tree/docker/services/tempest.yaml ? | 07:46 |
| bogdando | see kolla_config around | 07:47 |
| chkumar|rover | bogdando: yes, once promotion passes, I can do that | 07:47 |
| bogdando | e.g. http://git.openstack.org/cgit/openstack/tripleo-heat-templates/tree/docker/services/tacker.yaml#n87 | 07:47 |
| bogdando | ok | 07:47 |
| *** jpich has joined #tripleo | 07:47 | |
| chkumar|rover | bogdando: I need to mount 3 volumes, one for tempest workspace and another for cirros image cache and one for /var/log {which is done} | 07:48 |
| *** psahoo has quit IRC | 07:49 | |
| *** maufart__ has quit IRC | 07:49 | |
| florianf | mandre: Hi! Are you in the mood for doing a validations review once again? | 07:52 |
| florianf | (or two...) | 07:52 |
| florianf | (very similar ones) | 07:52 |
| florianf | ;) | 07:52 |
| mandre | florianf: hit me | 07:54 |
| florianf | mandre: https://review.openstack.org/575749 and https://review.openstack.org/581644 | 07:55 |
| florianf | mandre: thanks! greatly appreciated! | 07:56 |
| mandre | florianf: sure, no problem... added to my review list | 07:57 |
| florianf | mandre: excellent! | 07:58 |
| Tengu | be back in a while, have to go fetch a fan :]. Getting way too hot in here. | 07:59 |
| mandre | Tengu: turn off your computer see if it helps :-) | 07:59 |
| *** nyechiel_ has quit IRC | 08:01 | |
| *** psahoo has joined #tripleo | 08:01 | |
| *** tosky has joined #tripleo | 08:02 | |
| *** pfo_ has joined #tripleo | 08:03 | |
| *** lvdombrkr89 has joined #tripleo | 08:03 | |
| openstackgerrit | Yurii Prokulevych proposed openstack/tripleo-upgrade master: Set container_images_file for containerized undercloud. https://review.openstack.org/584286 | 08:05 |
| *** mhenkel_ has joined #tripleo | 08:06 | |
| *** jfrancoa has quit IRC | 08:06 | |
| mhenkel_ | good morning folks | 08:06 |
| openstackgerrit | Merged openstack/tripleo-docs master: Update custom roles doc to generate multiple roles with same properties https://review.openstack.org/583565 | 08:06 |
| *** lvdombrkr has quit IRC | 08:06 | |
| *** jfrancoa has joined #tripleo | 08:07 | |
| mhenkel_ | anyone here with some ironic discovery knowledge? I'm trying to figure out how openstack overcloud node discover --range is supposed to work | 08:07 |
| *** nyechiel_ has joined #tripleo | 08:07 | |
| *** jtcressy has quit IRC | 08:08 | |
| *** ooolpbot has joined #tripleo | 08:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 08:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1782267 | 08:10 |
| openstack | Launchpad bug 1782267 in tripleo "Stderr: u'Set Chassis Power Control to Up/On failed: Command not supported in present state\n': ProcessExecutionError: Unexpected error while running command." [Critical,Triaged] | 08:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1783055 | 08:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1783399 | 08:10 |
| *** ooolpbot has quit IRC | 08:10 | |
| openstack | Launchpad bug 1783055 in tripleo "[master]multinode periodic promotion jobs are failing where Tempest is run in container" [Critical,In progress] - Assigned to chandan kumar (chkumar246) | 08:10 |
| openstack | Launchpad bug 1783399 in tripleo "containerized undercloud upgrade jobs isn't testing upgrades anymore" [Critical,Triaged] - Assigned to Emilien Macchi (emilienm) | 08:10 |
| *** florianf has quit IRC | 08:16 | |
| *** florianf has joined #tripleo | 08:16 | |
| *** suuuper has joined #tripleo | 08:18 | |
| *** ykarel|lunch is now known as ykarel | 08:21 | |
| *** lucas-afk is now known as lucasagomes | 08:22 | |
| *** maufart__ has joined #tripleo | 08:25 | |
| bogdando | jfrancoa: hi, see https://bugs.launchpad.net/tripleo/+bug/1783303/comments/3 | 08:25 |
| openstack | Launchpad bug 1783303 in tripleo "[master] scenario000 multinode upgrade job is failing at tripleo-upgrade include task giving controllers' is undefined"}" [Critical,In progress] - Assigned to Jose Luis Franco (jfrancoa) | 08:25 |
| *** Petersingh|lunch is now known as Petersingh | 08:27 | |
| *** rcernin has joined #tripleo | 08:30 | |
| *** Haresh has joined #tripleo | 08:33 | |
| *** ykarel is now known as ykarel|mtg | 08:34 | |
| *** pfo_ has quit IRC | 08:34 | |
| *** florianf has quit IRC | 08:35 | |
| *** jtcressy has joined #tripleo | 08:36 | |
| *** wolverineav has joined #tripleo | 08:38 | |
| *** wolverineav has quit IRC | 08:43 | |
| *** shardy has quit IRC | 08:44 | |
| *** shardy has joined #tripleo | 08:44 | |
| *** karthiks has quit IRC | 08:44 | |
| *** openstackgerrit has quit IRC | 08:48 | |
| *** openstackgerrit has joined #tripleo | 08:49 | |
| openstackgerrit | Jiri Stransky proposed openstack/python-tripleoclient stable/pike: Use only update/upgrade ansible queue instead https://review.openstack.org/585386 | 08:49 |
| *** wolverineav has joined #tripleo | 08:50 | |
| Tengu | mandre: hehe ;) | 08:50 |
| Tengu | mandre: now I can work - thank you dyson!!! | 08:50 |
| mandre | Tengu: you were silent, I thought you really turned off your computer :-) | 08:51 |
| Tengu | mandre: was just running outdoor in order to fetch that fan XD | 08:51 |
| Tengu | according to my watch, over 3'000 steps. in plain sun. I'm dead fried. | 08:51 |
| *** pmannidi has quit IRC | 08:53 | |
| *** wolverineav has quit IRC | 08:55 | |
| openstackgerrit | Marios Andreou proposed openstack-infra/tripleo-ci master: Remove tripleo.sh --bootstrap-subnodes add ceph loop device https://review.openstack.org/583195 | 08:55 |
| *** panda|off is now known as panda | 08:57 | |
| *** karthiks has joined #tripleo | 08:57 | |
| openstackgerrit | Merged openstack-infra/tripleo-ci master: Remove setting of DEVSTACK_GATE_EXERCISES https://review.openstack.org/583151 | 08:58 |
| *** zoli is now known as zoli|lunch | 08:59 | |
| jfrancoa | bogdando: o/ thanks, yes that should be the proper fix for 1783303. However, the fact that we're getting an ansible error when including tripleo-upgrade without overcloud-upgrade tag is also a bug I believe | 09:01 |
| *** Guest56850 is now known as honza | 09:01 | |
| *** ooolpbot has joined #tripleo | 09:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 09:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1782267 | 09:10 |
| openstack | Launchpad bug 1782267 in tripleo "Stderr: u'Set Chassis Power Control to Up/On failed: Command not supported in present state\n': ProcessExecutionError: Unexpected error while running command." [Critical,Triaged] | 09:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1783055 | 09:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1783399 | 09:10 |
| *** ooolpbot has quit IRC | 09:10 | |
| openstack | Launchpad bug 1783055 in tripleo "[master]multinode periodic promotion jobs are failing where Tempest is run in container" [Critical,In progress] - Assigned to chandan kumar (chkumar246) | 09:10 |
| openstack | Launchpad bug 1783399 in tripleo "containerized undercloud upgrade jobs isn't testing upgrades anymore" [Critical,Triaged] - Assigned to Emilien Macchi (emilienm) | 09:10 |
| ksambor | hi all, please review : https://review.openstack.org/#/c/583211/ | 09:11 |
| *** mhenkel__ has joined #tripleo | 09:12 | |
| *** mhenke___ has joined #tripleo | 09:14 | |
| *** mhenke___ has quit IRC | 09:14 | |
| *** mhenkel__ has quit IRC | 09:14 | |
| bandini | fultonj: https://github.com/mbaldessari/tripleo-latency-injector this is what we spoke about on the train to Vienna | 09:14 |
| *** mhenkel__ has joined #tripleo | 09:14 | |
| *** mhenkel_ has quit IRC | 09:16 | |
| *** mhenkel__ has quit IRC | 09:19 | |
| *** mhenkel_ has joined #tripleo | 09:20 | |
| *** mhenkel_ has joined #tripleo | 09:20 | |
| *** arxcruz|off is now known as arxcruz | 09:22 | |
| openstackgerrit | Bogdan Dobrelya proposed openstack/python-tripleoclient master: Align roles file to become a normalized path https://review.openstack.org/572404 | 09:22 |
| openstackgerrit | Bogdan Dobrelya proposed openstack/python-tripleoclient master: Rework roles file getters to shared utility https://review.openstack.org/585690 | 09:22 |
| bogdando | shardy: hi, PTAL once you have time https://review.openstack.org/#/c/585690/ | 09:23 |
| bogdando | it addressed your concerns for the https://review.openstack.org/#/c/572404, just as a followup. | 09:23 |
| bogdando | Can't merge it into a single patch as I have weird tox issues for the upper patch | 09:23 |
| bogdando | ksambor: ^^ PTAL also | 09:25 |
| bogdando | if you folks could help to debug tox error for https://review.openstack.org/#/c/585690 locally I'd very appreciate that ... | 09:27 |
| openstackgerrit | yolanda.robla proposed openstack/tripleo-docs master: Add comments about how to adapt services for FFU https://review.openstack.org/585395 | 09:28 |
| *** jtcressy has quit IRC | 09:34 | |
| *** d0ugal has joined #tripleo | 09:36 | |
| *** d0ugal has quit IRC | 09:36 | |
| *** d0ugal has joined #tripleo | 09:36 | |
| shardy | bogdando: nice, that looks better :) | 09:36 |
| bogdando | shardy: thanks, but I'm really blocked with tox ;( | 09:37 |
| *** lifeless has quit IRC | 09:37 | |
| bogdando | it passes just fails in unusual and unclear meanings | 09:37 |
| shardy | bogdando: can you reproduce the errors locally? | 09:37 |
| bogdando | looks not related to the changed test cases, but prolly it is | 09:37 |
| bogdando | I have yet only local results, w8ing for upstream tox... | 09:37 |
| shardy | bogdando: is it the issue I mentioned where tests are racing to set the (class scope) roles* variables? | 09:38 |
| * shardy tries to reproduce locally | 09:38 | |
| *** ykarel|mtg is now known as ykarel | 09:38 | |
| *** Petersingh_ has joined #tripleo | 09:39 | |
| bogdando | shardy: that's what I have https://pastebin.com/fcEWVguz | 09:39 |
| bogdando | shardy: nope, they do not race for the 2nd patch with utility instead of static methods | 09:39 |
| bogdando | shardy: thanks! | 09:40 |
| bogdando | shardy: those 'unclosed file ' and 'Bad file descriptor' I have with master branch as well, but tox passes | 09:41 |
| *** Petersingh has quit IRC | 09:41 | |
| bogdando | hm, not really, for the master branch I have no 'Bad file descriptor' messages, so that's prolly the root cause | 09:43 |
| bogdando | seems like I need some logging fixtures | 09:43 |
| *** shardy has quit IRC | 09:45 | |
| *** wolverineav has joined #tripleo | 09:46 | |
| *** Petersingh_ has quit IRC | 09:47 | |
| *** Petersingh__ has joined #tripleo | 09:47 | |
| *** maufart__ has quit IRC | 09:47 | |
| *** Petersingh__ is now known as Petersingh|afk | 09:47 | |
| openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates master: Set CephX user for Ganesha https://review.openstack.org/585695 | 09:49 |
| *** Petersingh|afk is now known as Petersingh | 09:49 | |
| *** fabbione has quit IRC | 09:50 | |
| *** waleedm has joined #tripleo | 09:50 | |
| *** fabbione has joined #tripleo | 09:50 | |
| openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates master: Set CephX user for Ganesha https://review.openstack.org/585695 | 09:50 |
| *** shardy has joined #tripleo | 09:50 | |
| *** wolverineav has quit IRC | 09:51 | |
| bogdando | stevebaker: hi, PTAL https://review.openstack.org/#/c/582971/ | 09:53 |
| *** zoli|lunch is now known as zoli | 09:53 | |
| *** wolverineav has joined #tripleo | 09:53 | |
| *** pfo_ has joined #tripleo | 09:53 | |
| bogdando | shardy, ksambor: pointed out real py27 tox failures for the mocking, so I'll try to fix those first, then I thin py35 will just start working as well ) | 09:55 |
| *** wolverineav has quit IRC | 09:59 | |
| dtantsur | shardy: hey! sorry for nagging you, but I'd really appreciate a quick look at https://review.openstack.org/#/c/576856/ before I start rebasing it (again) | 09:59 |
| dtantsur | I'm particularly curious about handling plan_params in https://review.openstack.org/#/c/576856/3/tripleo_common/actions/baremetal_deployment.py | 10:00 |
| dtantsur | slagle: ditto ^^^ | 10:00 |
| shardy | dtantsur: ack, looking now | 10:00 |
| openstackgerrit | Jose Luis Franco proposed openstack/tripleo-upgrade master: Change include for include_tasks when including loop controled scripts. https://review.openstack.org/585654 | 10:01 |
| *** SlickNik has quit IRC | 10:02 | |
| *** mhenkel_ has quit IRC | 10:02 | |
| *** mhenkel_ has joined #tripleo | 10:02 | |
| dtantsur | shardy: actually, I guess it has to be rewritten using heat outputs.. I've just realized this is still the version that tries to parse the plan | 10:03 |
| *** SlickNik has joined #tripleo | 10:03 | |
| shardy | dtantsur: yeah I think that would be better, I can rebase https://review.openstack.org/#/c/579556/ if that helps | 10:03 |
| shardy | overall this looks good but it'd be good to rebase on the outputs then try locally to get a feel for how this works | 10:04 |
| dtantsur | shardy: yes please | 10:04 |
| shardy | also I wonder if (as you said) splitting the actions would enable easier testing, e.g it'd be really nice to be able to trigger a DeployBaremetalNodeAction or something without any coupling to heat parameters/outputs (just specify the image etc as inputs to the action) | 10:05 |
| shardy | so we'd have two layers, one that deploys a node and another that deploys nodes as specified by a plan/stack | 10:05 |
| dtantsur | shardy: do we have any example of dealing with heat parameters/outputs somewhere in workflows? | 10:05 |
| dtantsur | mmm, good idea | 10:05 |
| shardy | dtantsur: probably, sec let me look | 10:05 |
| shardy | perhaps we could start with the action that deploys just one node, then build a workflow that calls it based on the heat data | 10:06 |
| dtantsur | yeah, I'm having a hard time to grasp everything at once | 10:10 |
| sshnaidm|ruck | bogdando, replied in https://bugs.launchpad.net/tripleo/+bug/1782267 | 10:10 |
| openstack | Launchpad bug 1782267 in tripleo "Stderr: u'Set Chassis Power Control to Up/On failed: Command not supported in present state\n': ProcessExecutionError: Unexpected error while running command." [Critical,Triaged] | 10:10 |
| *** ooolpbot has joined #tripleo | 10:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 10:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1782267 | 10:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1783055 | 10:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1783399 | 10:10 |
| *** ooolpbot has quit IRC | 10:10 | |
| openstack | Launchpad bug 1783055 in tripleo "[master]multinode periodic promotion jobs are failing where Tempest is run in container" [Critical,In progress] - Assigned to chandan kumar (chkumar246) | 10:10 |
| openstack | Launchpad bug 1783399 in tripleo "containerized undercloud upgrade jobs isn't testing upgrades anymore" [Critical,Triaged] - Assigned to Emilien Macchi (emilienm) | 10:10 |
| *** Petersingh is now known as Petersingh|away | 10:10 | |
| openstackgerrit | Chandan Kumar proposed openstack/tripleo-quickstart-extras master: Fix tempest related files permissions for tempest container https://review.openstack.org/584771 | 10:13 |
| openstackgerrit | Chandan Kumar proposed openstack/tripleo-quickstart-extras master: Fix tempest related files permissions for tempest container https://review.openstack.org/584771 | 10:13 |
| *** shyamb has joined #tripleo | 10:13 | |
| shardy | d0ugal: Hey can you pls revisit https://review.openstack.org/#/c/582279/ and https://review.openstack.org/#/c/582233/ when you get time? | 10:14 |
| shardy | discussed that with rbrady and jtomasek yesterday and I think we can go ahead with the backport | 10:15 |
| d0ugal | shardy: I'm at EuroPython, but I'll try and squeeze them in :) | 10:15 |
| shardy | d0ugal: aha, Ok thanks, enjoy! | 10:15 |
| shardy | should be a quick +A when you get a moment | 10:15 |
| openstackgerrit | Marios Andreou proposed openstack-infra/tripleo-ci master: Remove tripleo.sh --bootstrap-subnodes add ceph loop device https://review.openstack.org/583195 | 10:16 |
| d0ugal | shardy: yeah, very easy - they have not changed much since I last looked. LGTM. Thanks | 10:17 |
| gfidente | jistr one question regarding uprgrade with config-download and your cleanups | 10:17 |
| *** shyambiradar has joined #tripleo | 10:17 | |
| * d0ugal relocates | 10:17 | |
| jtomasek | d0ugal, shardy: so this one should be postponed to S cycle https://review.openstack.org/#/c/582233/ and the backport https://review.openstack.org/#/c/582279/ is good to go | 10:17 |
| gfidente | jistr are you keeping the cpeh-upgrade command for now, on purpose? | 10:17 |
| shardy | jtomasek: I think we can land https://review.openstack.org/#/c/582233 now but we may decide not to backport it? | 10:17 |
| shardy | there will be more rework required for S though as we discussed yesterday | 10:18 |
| jtomasek | shardy: ok, I'll need to create UI patch to accomodate that change for Rocky, no big deal | 10:18 |
| shardy | jtomasek: ah, Ok sorry - I misread the default and thought it'd work for the UI | 10:19 |
| jtomasek | that patch actually breaks it for UI, but again, the fix is simple, the backport was the main concern | 10:19 |
| shardy | jtomasek: Ok, lets not backport then but since it's approved let the master patch land? | 10:19 |
| jtomasek | shardy: +1 | 10:20 |
| jtomasek | shardy: haha you were faster with the comment | 10:21 |
| *** d0ugal has quit IRC | 10:21 | |
| *** wolverineav has joined #tripleo | 10:22 | |
| shardy | hehe :) | 10:22 |
| *** shyambiradar has quit IRC | 10:22 | |
| *** shyamb has quit IRC | 10:23 | |
| *** lifeless has joined #tripleo | 10:23 | |
| *** salmankhan has joined #tripleo | 10:24 | |
| jistr | gfidente: no, there's a patch which deletes it. With config-download Ceph shouldn't be a "special upgrade citizen" anymore, we'd use a single mechanism for Ceph, OpenShift, Skydive etc. | 10:26 |
| *** wolverineav has quit IRC | 10:26 | |
| jistr | gfidente: https://review.openstack.org/#/c/582619/ | 10:27 |
| jistr | gfidente: the full list of patches related to upgrades of external-installer services with config-download is here https://review.openstack.org/#/q/topic:external-update-upgrade | 10:27 |
| * jistr lunch, biab | 10:27 | |
| openstackgerrit | Quique Llorente proposed openstack-infra/tripleo-ci master: [WIP] Run emit_releases_file.py for all featuresets https://review.openstack.org/585649 | 10:28 |
| *** wolverineav has joined #tripleo | 10:28 | |
| gfidente | jistr ok I missed the removal | 10:28 |
| gfidente | jistr cool, me voting as necessary to push this forward | 10:28 |
| gfidente | jistr thanjs | 10:28 |
| *** sshnaidm|ruck is now known as sshnaidm|afk | 10:29 | |
| shardy | jistr: Hey, do you happen to know the status of the tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades job? | 10:32 |
| shardy | I see it's non-voting, but I'd like to understand why it passed on https://review.openstack.org/#/c/574753/ | 10:32 |
| shardy | given the reason for the -updates failure, that patch should fail any kind of stack update test AFAICS | 10:32 |
| *** wolverineav has quit IRC | 10:32 | |
| shardy | so I wanted to be clear on the CI results before attempting a fix | 10:33 |
| *** Petersingh|away has quit IRC | 10:33 | |
| *** wolverineav has joined #tripleo | 10:33 | |
| *** nyechiel has joined #tripleo | 10:34 | |
| *** nyechiel_ has quit IRC | 10:34 | |
| shardy | specifically the UpgradePrepare command in tripleoclient inherits from DeployOvercloud, so it should fail in a similar way | 10:34 |
| openstackgerrit | Raoul Scarazzini proposed openstack/tripleo-ha-utils master: Apply/Delete latency before HA validation https://review.openstack.org/585707 | 10:36 |
| yolanda | hi dtantsur , can you review https://review.openstack.org/#/c/577799/ ? | 10:37 |
| *** wolverineav has quit IRC | 10:37 | |
| janki | jistr, hey | 10:38 |
| yolanda | fixed according to the comments | 10:38 |
| *** ipsecguy has quit IRC | 10:38 | |
| *** wolverineav has joined #tripleo | 10:39 | |
| dtantsur | yolanda: LGTM | 10:39 |
| *** ipsecguy has joined #tripleo | 10:39 | |
| yolanda | thx | 10:39 |
| owalsh | yolanda: is https://review.openstack.org/571777 good to land? I've other patches that depend on it | 10:43 |
| *** lvdombrkr has joined #tripleo | 10:43 | |
| *** salmankhan has quit IRC | 10:43 | |
| yolanda | owalsh, i'd say that Ian is just waiting for the answer to that question | 10:43 |
| *** wolverineav has quit IRC | 10:43 | |
| owalsh | yolanda: which question? | 10:44 |
| *** lvdombrkr89 has quit IRC | 10:44 | |
| yolanda | owalsh, i'd say AIUI, there are reasons to use this outside of just installing the NVIDIA gpu drivers (which would imply just put it in that element) | 10:45 |
| yolanda | that's why i think he didn't approve | 10:45 |
| *** lvdombrkr89 has joined #tripleo | 10:45 | |
| *** wolverineav has joined #tripleo | 10:46 | |
| owalsh | ianw: hi, could you clarify ^^^. I didn't think that was a question | 10:47 |
| *** lvdombrkr has quit IRC | 10:48 | |
| *** edmondsw has joined #tripleo | 10:49 | |
| *** wolverineav has quit IRC | 10:50 | |
| openstackgerrit | Dmitry Tantsur proposed openstack/tripleo-common master: [WIP] Actions for provisioning bare metals without Nova https://review.openstack.org/576856 | 10:51 |
| yolanda | owalsh, can you just add it on the review so your comment doesn't get lost? | 10:51 |
| dtantsur | shardy: okay, so only actions now ^^^ | 10:51 |
| openstackgerrit | Martin Schuppert proposed openstack/tripleo-heat-templates master: Add NovaResumeGuestsStateOnHostBoot and NovaResumeGuestsShutdownTimeout https://review.openstack.org/577414 | 10:51 |
| *** wolverineav has joined #tripleo | 10:52 | |
| Tengu | hmmmm. funky. Just upgraded my undercloud from queens to rocky, apparently all went well, BUT.. the ironic_pxe_tftp container keeps restarting. | 10:52 |
| owalsh | yolanda: ack, will do. thanks | 10:52 |
| *** ykarel is now known as ykarel|mtg | 10:52 | |
| *** ykarel|mtg has quit IRC | 10:52 | |
| *** ykarel has joined #tripleo | 10:56 | |
| mschuppert | owalsh: do you work on the backport of https://review.openstack.org/577855 to queens/OSP13 - BZ 1603538? if not I could do it. | 10:59 |
| *** shyambiradar has joined #tripleo | 10:59 | |
| *** shyamb has joined #tripleo | 10:59 | |
| *** wolverin_ has joined #tripleo | 10:59 | |
| owalsh | mschuppert: go for it, thanks! | 11:00 |
| *** shyambiradar has quit IRC | 11:00 | |
| *** wolverineav has quit IRC | 11:00 | |
| *** sshnaidm|afk is now known as sshnaidm|ruck | 11:00 | |
| *** shyambiradar has joined #tripleo | 11:00 | |
| *** shyambiradar has quit IRC | 11:00 | |
| dtantsur | shardy: this is what I can use to get information from heat, right? https://github.com/openstack/tripleo-common/blob/master/tripleo_common/inventory.py#L36 at least outputs. are input parameters also available somewhere (please pardon my ignorance)? | 11:01 |
| *** wolverin_ has quit IRC | 11:01 | |
| *** wolverineav has joined #tripleo | 11:01 | |
| *** pdeore has quit IRC | 11:02 | |
| *** maufart__ has joined #tripleo | 11:03 | |
| openstackgerrit | Rajesh Tailor proposed openstack/tripleo-heat-templates master: NUMA aware vswitches https://review.openstack.org/578742 | 11:03 |
| *** wolverin_ has joined #tripleo | 11:03 | |
| *** wolverineav has quit IRC | 11:03 | |
| Tengu | dtantsur: hello! small question: I just upgraded my undercloud from queens to rocky using the documented way (meaning containers and blah), but apparently I have one container that fails its start: ironic_pxe_tftp - any idea? | 11:04 |
| Tengu | dtantsur: apparently its healthcheck is failing with "No such exec instance '02ab074266b420700c6e97df0021460bba3c0daadfa13647cf33389078f9c718' found in daemon" (ID can change), and I'm apparently unable to find what's the content of the healtcheck. | 11:05 |
| dtantsur | bogdando: maybe you have an idea ^^^ | 11:05 |
| Tengu | of course, a "docker exec" fails because the container keeps restarting -.- | 11:05 |
| dtantsur | Tengu: sorry, I don't know these things well enough | 11:05 |
| Tengu | dtantsur: ok - thought you might as you're in ironic. | 11:06 |
| dtantsur | Tengu: right, but containers are a black hole for me :) | 11:06 |
| Tengu | :) | 11:06 |
| Tengu | same for me. more or less. | 11:06 |
| *** wolverin_ has quit IRC | 11:08 | |
| *** ooolpbot has joined #tripleo | 11:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 11:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1782267 | 11:10 |
| openstack | Launchpad bug 1782267 in tripleo "Stderr: u'Set Chassis Power Control to Up/On failed: Command not supported in present state\n': ProcessExecutionError: Unexpected error while running command." [Critical,Triaged] | 11:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1783055 | 11:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1783399 | 11:10 |
| *** ooolpbot has quit IRC | 11:10 | |
| openstack | Launchpad bug 1783055 in tripleo "[master]multinode periodic promotion jobs are failing where Tempest is run in container" [Critical,In progress] - Assigned to chandan kumar (chkumar246) | 11:10 |
| openstack | Launchpad bug 1783399 in tripleo "containerized undercloud upgrade jobs isn't testing upgrades anymore" [Critical,Triaged] - Assigned to Emilien Macchi (emilienm) | 11:10 |
| owalsh | skramaja: in https://review.openstack.org/577414, are you saying the param shouldn't be role specific, or are you saying that it's missing some of the changes to make it role specific? | 11:10 |
| *** mhenkel_ has quit IRC | 11:11 | |
| *** mhenkel_ has joined #tripleo | 11:11 | |
| skramaja | owalsh: the parementer is not implemented as role-specific but tagged as role-specific | 11:11 |
| skramaja | owalsh: i dont see a reason for this parameter to be role-specific, but i may be wrong. | 11:12 |
| owalsh | skramaja: ack, InstanceHA might make it necessary | 11:12 |
| owalsh | mschuppert: FYI ^^^ | 11:12 |
| skramaja | mschuppert: owalsh: if you thinkg it should role-specifig, then add it under the RoleParameterValue resourcel, which will take care of it. | 11:13 |
| *** leanderthal has joined #tripleo | 11:14 | |
| *** ratailor has quit IRC | 11:14 | |
| openstackgerrit | Quique Llorente proposed openstack-infra/tripleo-ci master: [WIP] Move nodes_file and nodes_var to common.yaml https://review.openstack.org/585714 | 11:15 |
| openstackgerrit | Quique Llorente proposed openstack-infra/tripleo-ci master: [WIP] Move nodes_file and nodes_args to common.yaml https://review.openstack.org/585714 | 11:16 |
| owalsh | skramaja: ack, thanks | 11:18 |
| *** salmankhan has joined #tripleo | 11:18 | |
| ramishra | Seems like all containers-multinode jobs are failing with timeout http://logs.openstack.org/20/583320/3/check/tripleo-ci-centos-7-containers-multinode/01afa83/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz#_2018-07-25_09_54_09, don't see mistral logs anywhere | 11:19 |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/queens: copy ceph config in manila-share container bundle https://review.openstack.org/585512 | 11:20 |
| openstackgerrit | Merged openstack/puppet-tripleo master: Release Rocky m3: 9.2.0 https://review.openstack.org/585537 | 11:20 |
| openstackgerrit | Merged openstack/tripleo-ui master: Release Rocky M3: 9.2.0 https://review.openstack.org/585538 | 11:20 |
| ramishra | shardy: Hey! any idea what's wrong? | 11:20 |
| EmilienM | hi | 11:20 |
| EmilienM | rfolco: so are we going with https://review.openstack.org/#/c/584508/ or my patch? - when these patches can merge? | 11:21 |
| *** rcernin has quit IRC | 11:21 | |
| quiquell | EmilienM: I think we are going with yours | 11:22 |
| EmilienM | quiquell: well it fails on updates :/ | 11:22 |
| dr_gogeta86 | hi guys | 11:22 |
| quiquell | EmilienM: https://review.openstack.org/#/c/584508/ is passing, but we have to test upgrades and all | 11:25 |
| quiquell | rfolco: ^ | 11:25 |
| *** panda is now known as panda|lunch | 11:26 | |
| *** nyechiel has quit IRC | 11:27 | |
| *** morazi has joined #tripleo | 11:28 | |
| Tengu | EmilienM: ah, maybe you can help me? upgrading undercloud queens -> rocky issue, I have an "ironic_pxe_tftp" container keeping restarting. Did you already see that? | 11:28 |
| EmilienM | quiquell, rfolco : update jobs failing here: http://logs.openstack.org/28/585528/2/check/tripleo-ci-centos-7-scenario000-multinode-oooq-container-updates/6bbd360/logs/undercloud/home/zuul/overcloud_update_run_Controller.log.txt.gz#_2018-07-25_05_04_19 | 11:28 |
| EmilienM | on my patch | 11:28 |
| EmilienM | Tengu: I didn't, do you have container logs? | 11:29 |
| Tengu | EmilienM: docker logs shows nothing... only got a hint in the inspect output, regarding bad healthcheck | 11:30 |
| EmilienM | Tengu: have you tried to run the healthcheck from the container? | 11:30 |
| Tengu | EmilienM: docker exec doesn't work because container in restarting mode | 11:30 |
| Tengu | already tried that as I wanted to know what was the healthcheck.... | 11:31 |
| EmilienM | Tengu: one sec | 11:31 |
| Tengu | EmilienM: also, tried to reboot the undercloud - not better. it's the only container failing :(. | 11:32 |
| *** artom has joined #tripleo | 11:32 | |
| quiquell | EmilienM: failing at Set docker_startup_configs_with_default fact, let's see if the docker logs have something | 11:35 |
| *** pradk has joined #tripleo | 11:37 | |
| *** ccamacho has quit IRC | 11:38 | |
| openstackgerrit | Jiri Stransky proposed openstack/python-tripleoclient master: Drop obsolete `overcloud ceph-upgrade run` https://review.openstack.org/582619 | 11:41 |
| openstackgerrit | Jiri Stransky proposed openstack/python-tripleoclient master: Remove parameter for ceph-ansible playbook from update/upgrade prepare https://review.openstack.org/585366 | 11:41 |
| *** ccamacho has joined #tripleo | 11:44 | |
| shardy | ramishra: http://logs.openstack.org/20/583320/3/check/tripleo-ci-centos-7-containers-multinode/01afa83/logs/undercloud/var/log/containers/mistral/engine.log.txt.gz#_2018-07-25_09_48_42_039 appears to be the cause? | 11:45 |
| shardy | I wonder if we hit an issue where the dlrn tripleo-common was out of date for a short while? | 11:46 |
| shardy | ref https://github.com/openstack/tripleo-common/commit/2dfed4e87aad128ab3c0014def5cde6b0c32f2ca | 11:46 |
| * shardy checks the version | 11:46 | |
| quiquell | EmilienM: I think this is missing -e dlrn_hash=1de27e4144372c5c1d8b962b95d9152ae9cef8b0_1d57507f -e get_build_command=1de27e4144372c5c1d8b962b95d9152ae9cef8b0_1d57507f | 11:46 |
| shardy | Jul 25 08:47:56 Installed: python2-tripleo-common-9.1.1-0.20180725034902.2dfed4e.el7.noarch | 11:47 |
| quiquell | EmilienM: working one pre merge http://logs.openstack.org/13/583913/2/check/tripleo-ci-centos-7-scenario000-multinode-oooq-container-updates/16fe7b6/job-output.txt.gz | 11:47 |
| shardy | hmm | 11:47 |
| ramishra | shardy: Ah thanks, I forgot that undercloud is containerized now, so logs are at the different place:) | 11:50 |
| shardy | mistral hasn't registered that, I wonder if theres a lag while the container image is rebuilt | 11:50 |
| *** salmankhan has quit IRC | 11:50 | |
| shardy | http://logs.openstack.org/20/583320/3/check/tripleo-ci-centos-7-containers-multinode/01afa83/logs/undercloud/var/log/containers/mistral/mistral-db-manage.log.txt.gz | 11:50 |
| EmilienM | quiquell: so you're saying we're missing variables? | 11:50 |
| EmilienM | quiquell: why does it pass on rfolco's patch https://review.openstack.org/#/c/584508/ | 11:53 |
| mschuppert | owalsh: I don't think it has an impact on instanceHA as with the current version there are no servics manged by pacemaker on the computes. IIRC we just monitor the compute is available. but rasca could you review https://review.openstack.org/577414 and confirm. | 11:53 |
| quiquell | EmilienM: I am comparing, dlrn_hash is ok | 11:53 |
| Tengu | EmilienM: so that you can follow if you want: https://bugs.launchpad.net/tripleo/+bug/1783547 | 11:54 |
| openstack | Launchpad bug 1783547 in tripleo "undercloud: Queens -> Rocky upgrade, xinetd locks tftp port" [High,Triaged] | 11:54 |
| mschuppert | owalsh: but I can make it role specific if we think we should do it | 11:54 |
| Tengu | soo. dtantsur is the tftp service needed on the undercloud? I think so since it allows to fetch files after the pxe-boot is done (or something like that).. ? | 11:55 |
| dtantsur | Tengu: yes, it's needed | 11:55 |
| *** ykarel has quit IRC | 11:56 | |
| dtantsur | TFTP is a part of the PXE boot process | 11:56 |
| Tengu | dtantsur: ok, that was my thougts. are you able to point me how it's configured on non-containerized env? As it's apparently injected in the xinetd supervisor. | 11:56 |
| owalsh | mschuppert: if we don't need to disable it for HA then I doubt we need it | 11:56 |
| *** toure|gone is now known as toure | 11:57 | |
| dtantsur | Tengu: check this file https://github.com/openstack/puppet-ironic/blob/master/manifests/pxe.pp | 11:57 |
| dtantsur | it's applied directly for the classic undercloud | 11:57 |
| dtantsur | and for containerized one it's split into a separate container | 11:57 |
| Tengu | dtantsur: ah, thanks. Fact is, after an upgrade, the xinetd is still running tftpd, meaning port UDP:69 is still busy, and this prevents the container to start :). | 11:58 |
| Tengu | dtantsur: basically: https://bugs.launchpad.net/tripleo/+bug/1783547 | 11:58 |
| openstack | Launchpad bug 1783547 in tripleo "undercloud: Queens -> Rocky upgrade, xinetd locks tftp port" [High,Triaged] - Assigned to Cédric Jeanneret (cjeanner) | 11:58 |
| dtantsur | gah | 11:58 |
| fultonj | bandini: tripleo-latency-injector cool. thanks | 11:58 |
| Tengu | dtantsur: meaning we have to drop the file /etc/xinetd.d/tftp I guess. | 11:58 |
| Tengu | apparently there are some other things managed in there, and I'd rather avoid stopping xinetd alltogether ,). | 11:59 |
| dtantsur | Tengu: yes. I wonder why we never hit it in the overcloud.. | 11:59 |
| Tengu | dtantsur: probably because the tftpd service was still serving the correct files, although it wasn't the righ service ;). | 11:59 |
| *** lblanchard has joined #tripleo | 12:00 | |
| dtantsur | Tengu: yes, but the container should have failed just as well | 12:00 |
| Tengu | dtantsur: it does fail. | 12:00 |
| dtantsur | in the overcloud? | 12:00 |
| jaosorior | lhinds: around? | 12:00 |
| Tengu | dtantsur: ah nah, sorry, undercloud. | 12:00 |
| dtantsur | Tengu: yeah, so I wonder what is different. anyway, good catch. this has to be fixed. | 12:00 |
| dtantsur | (and backported to queens I bet) | 12:01 |
| EmilienM | dtantsur: no it's only containerized undercloud (iiuc) | 12:01 |
| *** medberry has joined #tripleo | 12:01 | |
| *** medberry has quit IRC | 12:01 | |
| *** medberry has joined #tripleo | 12:01 | |
| Tengu | dtantsur: are you ok with the following proposal: upgrade task needs to drop the /etc/xinetd.d/tftp file and restart xinetd service; and optionnaly drop the tftp-server package. | 12:01 |
| dtantsur | EmilienM: sorry? the overcloud is also containerized, shouldn't we hit the same problem with ironic there? even in queens? | 12:01 |
| Tengu | dtantsur: I don't think there is ironic on the overcloud - at least not tftp, is there? | 12:02 |
| dtantsur | Tengu: it's optional, but supported since Newton | 12:02 |
| Tengu | duh. right. | 12:02 |
| *** trown|outtypewww is now known as trown | 12:02 | |
| EmilienM | dtantsur: oh, the overcloud. Right | 12:02 |
| ramishra | shardy: thanks!, Hoping for issue to disspear automagically:) | 12:02 |
| *** shardy has quit IRC | 12:03 | |
| openstackgerrit | Jiri Stransky proposed openstack/tripleo-heat-templates master: Ceph update and upgrade in config-download era https://review.openstack.org/583321 | 12:04 |
| *** pfo_ has quit IRC | 12:05 | |
| openstackgerrit | Jiri Stransky proposed openstack/tripleo-heat-templates master: Ceph update and upgrade in config-download era https://review.openstack.org/583321 | 12:05 |
| *** jcoufal has joined #tripleo | 12:06 | |
| * Tengu re-arming his lab in order to validate a proposal | 12:07 | |
| *** wolverineav has joined #tripleo | 12:08 | |
| *** pfo_ has joined #tripleo | 12:08 | |
| EmilienM | sshnaidm|ruck: we used to have "docker info" output in http://logs.openstack.org/19/584119/10/check/tripleo-ci-centos-7-undercloud-containers/a484cee/logs/undercloud/var/log/extra/ | 12:08 |
| EmilienM | sshnaidm|ruck: do you know why we don't have it anymore? | 12:09 |
| sshnaidm|ruck | EmilienM, nope, didn't touch it.. | 12:09 |
| EmilienM | it was pretty useful to see docker container health | 12:09 |
| *** ooolpbot has joined #tripleo | 12:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 12:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1782267 | 12:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1783055 | 12:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1783399 | 12:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1783540 | 12:10 |
| openstack | Launchpad bug 1782267 in tripleo "Stderr: u'Set Chassis Power Control to Up/On failed: Command not supported in present state\n': ProcessExecutionError: Unexpected error while running command." [Critical,Triaged] | 12:10 |
| *** ooolpbot has quit IRC | 12:10 | |
| openstack | Launchpad bug 1783055 in tripleo "[master]multinode periodic promotion jobs are failing where Tempest is run in container" [Critical,In progress] - Assigned to chandan kumar (chkumar246) | 12:10 |
| openstack | Launchpad bug 1783399 in tripleo "containerized undercloud upgrade jobs isn't testing upgrades anymore" [Critical,Triaged] - Assigned to Emilien Macchi (emilienm) | 12:10 |
| openstack | Launchpad bug 1783540 in tripleo "RDO cloud is not in operational state" [Critical,Triaged] - Assigned to chandan kumar (chkumar246) | 12:10 |
| EmilienM | it sounds to be in the "Collect docker info and logs" task in tripleo-quickstart-extras | 12:10 |
| EmilienM | yeah it used to be "docker_allinfo.log" | 12:11 |
| *** wolverineav has quit IRC | 12:12 | |
| *** pfo_ has quit IRC | 12:12 | |
| *** wolverineav has joined #tripleo | 12:12 | |
| *** dprince has joined #tripleo | 12:13 | |
| EmilienM | sshnaidm|ruck: yeah something is broken, see: http://logs.openstack.org/19/584119/10/check/tripleo-ci-centos-7-undercloud-containers/a484cee/logs/quickstart_collect_logs.log | 12:13 |
| EmilienM | and grep for Collect docker info and logs | 12:13 |
| EmilienM | mandre: sounds like it's broken since your patch here: https://review.openstack.org/#/c/578735/ | 12:14 |
| EmilienM | sshnaidm|ruck: any change to get a bug on this one? | 12:16 |
| sshnaidm|ruck | EmilienM, sure, after mtg | 12:16 |
| *** shardy has joined #tripleo | 12:17 | |
| EmilienM | sshnaidm|ruck: "the" meeting you mean ;-) | 12:18 |
| openstackgerrit | Martin Schuppert proposed openstack/puppet-tripleo master: Move nova-metadata api to httpd wsgi https://review.openstack.org/582622 | 12:18 |
| *** shardy has quit IRC | 12:18 | |
| sshnaidm|ruck | EmilienM, yeah :) | 12:19 |
| sshnaidm|ruck | EmilienM, we can do mtg about this problem too.. | 12:19 |
| openstackgerrit | Martin Schuppert proposed openstack/tripleo-heat-templates master: Move nova-metadata api to httpd wsgi https://review.openstack.org/582623 | 12:19 |
| rnoriega | bogdando, ping | 12:21 |
| *** tzumainn has joined #tripleo | 12:22 | |
| *** shardy has joined #tripleo | 12:22 | |
| *** ykarel has joined #tripleo | 12:25 | |
| rasca | mschuppert, I commented the review, sorry for being so late | 12:26 |
| EmilienM | mandre, sshnaidm|ruck : I filed https://bugs.launchpad.net/tripleo/+bug/1783552 | 12:26 |
| openstack | Launchpad bug 1783552 in tripleo "docker_allinfo.log generation is broken" [Medium,Triaged] | 12:27 |
| *** maufart__ has quit IRC | 12:27 | |
| *** jaosorior has quit IRC | 12:27 | |
| mschuppert | rasca: thx. checking | 12:28 |
| *** aufi has joined #tripleo | 12:29 | |
| *** mjturek has joined #tripleo | 12:32 | |
| dtantsur | shardy: tbh I cannot get much information out of these outputs (I tried a very simple deployment) http://paste.openstack.org/show/726612/ | 12:33 |
| shardy | dtantsur: what information is missing? | 12:35 |
| shardy | dtantsur: I'll rebase my patch and revisit your etherpad with examples of where to find the data if that helps | 12:35 |
| dtantsur | shardy: I cannot get anything I need out of it | 12:35 |
| dtantsur | oh, great, that would help a lot | 12:35 |
| shardy | and/or we can add a new one with a map of the things you need | 12:35 |
| dtantsur | just looking at all resources and outputs I can find is not very productive :) | 12:35 |
| shardy | https://etherpad.openstack.org/p/tripleo-nova-less-deploy | 12:36 |
| shardy | I did put some examples there but will add more later, about to join a meeting | 12:36 |
| *** leanderthal has quit IRC | 12:37 | |
| openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates master: Add RoleCtlplanePortMap output https://review.openstack.org/579556 | 12:38 |
| *** amoralej is now known as amoralej|lunch | 12:38 | |
| openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-quickstart-extras master: Fix docker info log name https://review.openstack.org/585734 | 12:39 |
| sshnaidm|ruck | EmilienM, ^^ | 12:39 |
| shardy | dtantsur: could you perhaps put a sample data structure in the etherpad showing the minimal output data you'd like to consume? | 12:39 |
| shardy | then we could iterate from that | 12:40 |
| dtantsur | shardy: lemme try | 12:40 |
| shardy | I got a bit confused because the etherpad talks about multiple networks etc, but we later agreed those are not needed | 12:40 |
| shardy | just the port to bind on the ctlplane | 12:40 |
| *** shyamb has quit IRC | 12:41 | |
| *** shyamb has joined #tripleo | 12:42 | |
| EmilienM | sshnaidm|ruck: the kind of patch I couldn't make at 7am :D | 12:43 |
| *** yrabl has joined #tripleo | 12:43 | |
| *** rlandy has joined #tripleo | 12:43 | |
| EmilienM | sshnaidm|ruck: my eyes aren't operational enough :P | 12:43 |
| sshnaidm|ruck | EmilienM, it's not easy to see even in 15 pm :) | 12:43 |
| bogdando | rnoriega: pong | 12:44 |
| rnoriega | bogdando, hey buddy! good morning | 12:44 |
| rnoriega | bogdando, I managed to get a shared volume with the host with this: https://review.openstack.org/#/c/585320/1/docker/services/neutron-bgpvpn-api.yaml | 12:45 |
| rnoriega | bogdando, so I guess, the only missing piece, would be to mount it in the heat container under the OptVolume section, right? | 12:45 |
| ksambor | PTAL https://review.openstack.org/#/c/583211/ | 12:46 |
| dtantsur | shardy: done | 12:46 |
| bogdando | rnoriega: that should be it, right | 12:46 |
| rnoriega | bogdando, cool! let me test that, and I'll update the patch. Thanks for your tips! | 12:47 |
| bogdando | rnoriega: but I'm not sure that map_merge would work correct | 12:49 |
| bogdando | needs to be tested | 12:49 |
| rnoriega | that part deployed properly | 12:49 |
| bogdando | ok | 12:49 |
| rnoriega | bogdando, but I wasn't sure tbh :-) | 12:49 |
| *** yrabl has quit IRC | 12:50 | |
| *** jaosorior has joined #tripleo | 12:50 | |
| *** yrabl has joined #tripleo | 12:50 | |
| *** skramaja has quit IRC | 12:52 | |
| *** panda|lunch is now known as panda | 12:53 | |
| *** morazi has quit IRC | 12:54 | |
| *** morazi has joined #tripleo | 12:58 | |
| *** mdnadeem has quit IRC | 13:01 | |
| openstackgerrit | Bogdan Dobrelya proposed openstack/tripleo-quickstart master: Use net-config-undercloud for UC in minimal config https://review.openstack.org/585741 | 13:04 |
| *** rh-jelabarre has quit IRC | 13:04 | |
| *** mjturek has quit IRC | 13:05 | |
| *** ssbarnea has quit IRC | 13:05 | |
| *** mcornea has joined #tripleo | 13:06 | |
| *** wolverineav has quit IRC | 13:06 | |
| *** agopi is now known as agopi|brb | 13:08 | |
| *** wolverineav has joined #tripleo | 13:09 | |
| *** ooolpbot has joined #tripleo | 13:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 13:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1782267 | 13:10 |
| openstack | Launchpad bug 1782267 in tripleo "Stderr: u'Set Chassis Power Control to Up/On failed: Command not supported in present state\n': ProcessExecutionError: Unexpected error while running command." [Critical,In progress] - Assigned to Bogdan Dobrelya (bogdando) | 13:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1783055 | 13:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1783399 | 13:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1783540 | 13:10 |
| *** ooolpbot has quit IRC | 13:10 | |
| openstack | Launchpad bug 1783055 in tripleo "[master]multinode periodic promotion jobs are failing where Tempest is run in container" [Critical,In progress] - Assigned to chandan kumar (chkumar246) | 13:10 |
| openstack | Launchpad bug 1783399 in tripleo "containerized undercloud upgrade jobs isn't testing upgrades anymore" [Critical,Triaged] - Assigned to Emilien Macchi (emilienm) | 13:10 |
| openstack | Launchpad bug 1783540 in tripleo "RDO cloud is not in operational state" [Critical,Triaged] - Assigned to chandan kumar (chkumar246) | 13:10 |
| *** rh-jelabarre has joined #tripleo | 13:11 | |
| *** agopi|brb has quit IRC | 13:13 | |
| *** gbarros has joined #tripleo | 13:14 | |
| *** ksambor has quit IRC | 13:16 | |
| *** ksambor has joined #tripleo | 13:19 | |
| sshnaidm|ruck | dprince, hi, can we have please dns name "dashboard-ci.tripleo.org" with IP 38.145.35.97? | 13:20 |
| dprince | sshnaidm|ruck: sure, what are we graphing there? | 13:22 |
| sshnaidm|ruck | dprince, tripleo and third party CI systems | 13:22 |
| sshnaidm|ruck | dprince, http://38.145.35.97/d/cEEjGFFmz/cockpit?orgId=1 | 13:22 |
| *** amoralej|lunch is now known as amoralej | 13:25 | |
| openstackgerrit | Cédric Jeanneret proposed openstack/tripleo-heat-templates master: Remove tftp service and package upon upgrade to container https://review.openstack.org/585744 | 13:25 |
| Tengu | EmilienM: -^ | 13:25 |
| Tengu | working fix on my undercloud - xinetd stop managing the tftpd service, allowing the container to properly start. | 13:25 |
| EmilienM | Tengu: it sound good to me | 13:26 |
| EmilienM | Tengu: thanks | 13:26 |
| Tengu | np. still a run on its way in order to double-check | 13:26 |
| Tengu | but at least the xinetd.d config is dropped, and I took the opportunity to allow droping the package as well. | 13:27 |
| Tengu | next thing is: apparently an rsyncd instance is also managed by xinetd. | 13:27 |
| Tengu | linked to swift. Will check that with the storage team - it's unrelated to the current issue though. | 13:27 |
| *** leanderthal has joined #tripleo | 13:27 | |
| EmilienM | Tengu: yeah we need to check rsync too, and it's for swift, indeed. | 13:27 |
| *** ykarel has quit IRC | 13:28 | |
| Tengu | :) | 13:28 |
| Tengu | will find a victim in the storage team and ask :) | 13:28 |
| *** d0ugal has joined #tripleo | 13:28 | |
| *** agurenko has quit IRC | 13:28 | |
| EmilienM | Tengu: you can ask tdasilva or cschwede | 13:28 |
| tdasilva | EmilienM, Tengu: cschwede is out on PTO so I guess it will be me :) just finishing a meeting here and will touch base in a bit | 13:29 |
| *** cmurphy is now known as cmurphy|vacation | 13:29 | |
| *** agurenko has joined #tripleo | 13:29 | |
| Tengu | tdasilva: hello :). I'm in a meeting right now... but I keep you nick ;) | 13:30 |
| *** pblaho has joined #tripleo | 13:33 | |
| *** shyamb has quit IRC | 13:38 | |
| Tengu | tdasilva: ah, apparently the rsync service is dropped from the xinetd supervisor. So I think I won't need you on that :). | 13:38 |
| *** salmankhan has joined #tripleo | 13:39 | |
| *** rpioso|afk is now known as rpioso | 13:40 | |
| *** mjturek has joined #tripleo | 13:40 | |
| *** agopi has joined #tripleo | 13:41 | |
| *** d0ugal has quit IRC | 13:45 | |
| *** salmankhan has quit IRC | 13:45 | |
| dprince | sshnaidm|ruck: the IP change is done | 13:51 |
| *** mjturek has quit IRC | 13:51 | |
| sshnaidm|ruck | dprince, works, thanks a lot! | 13:52 |
| *** jchhatbar has joined #tripleo | 13:53 | |
| *** Haresh has quit IRC | 13:53 | |
| *** janki has quit IRC | 13:56 | |
| dtantsur | hey! does anyone know how to make mistral pick new actions from setup.cfg? | 13:57 |
| jfrancoa | bogdando: hey, look what I found by coincidence. We're storing recursively the tripleo-heat-templates directory in /home/zuul/tripleo-heat-installer-templates https://url.corp.redhat.com/jfrancoa | 13:58 |
| therve | dtantsur: "mistral-db-manage populate" I think? | 13:58 |
| jfrancoa | bogdando: and I could continue digging in into tripleo-heat-templates directory for ever :-D | 13:59 |
| jfrancoa | bogdando: do you want me to open a LP? | 13:59 |
| dtantsur | therve: thanks, that helped | 13:59 |
| therve | Np | 14:00 |
| bogdando | jfrancoa: yes please | 14:00 |
| openstackgerrit | Sergii Golovatiuk proposed openstack/tripleo-heat-templates stable/queens: Upgrades: Refactor playbooks to set facts https://review.openstack.org/576520 | 14:02 |
| openstackgerrit | Dmitry Tantsur proposed openstack/tripleo-common master: [WIP] Actions for provisioning bare metals without Nova https://review.openstack.org/576856 | 14:03 |
| *** Haresh has joined #tripleo | 14:05 | |
| bogdando | jfrancoa: I wonder if that only legacy-tripleo-ci-centos-7-container-to-container-upgrades-master specific, or the patch specific? | 14:07 |
| bogdando | I can not see that issue for other patches/jobs | 14:08 |
| jfrancoa | bogdando: it could be, I didn't check in other jobs | 14:08 |
| *** psahoo has quit IRC | 14:09 | |
| *** ooolpbot has joined #tripleo | 14:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 14:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1782267 | 14:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1783055 | 14:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1783399 | 14:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1783540 | 14:10 |
| openstack | Launchpad bug 1782267 in tripleo "Stderr: u'Set Chassis Power Control to Up/On failed: Command not supported in present state\n': ProcessExecutionError: Unexpected error while running command." [Critical,In progress] - Assigned to Bogdan Dobrelya (bogdando) | 14:10 |
| *** ooolpbot has quit IRC | 14:10 | |
| openstack | Launchpad bug 1783055 in tripleo "[master]multinode periodic promotion jobs are failing where Tempest is run in container" [Critical,In progress] - Assigned to chandan kumar (chkumar246) | 14:10 |
| openstack | Launchpad bug 1783399 in tripleo "containerized undercloud upgrade jobs isn't testing upgrades anymore" [Critical,Triaged] - Assigned to Emilien Macchi (emilienm) | 14:10 |
| openstack | Launchpad bug 1783540 in tripleo "RDO cloud is not in operational state" [Critical,Triaged] - Assigned to chandan kumar (chkumar246) | 14:10 |
| dtantsur | omg, I cannot count how many times this is wrong... https://github.com/openstack/tripleo-common/blob/master/tripleo_common/utils/keystone.py#L66-L90 | 14:11 |
| dtantsur | do we have rewriting this horror ^^^ on the radar? | 14:12 |
| *** hamzy_ has quit IRC | 14:13 | |
| trown | flaper87: I found the commit that likely broke the 3.10 patch, commented on the review. Do you mind if I try using a specific release (without that patch) in your quickstart patch? | 14:13 |
| openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates master: Fix parameter name used to create the Manila CephX keyring https://review.openstack.org/585562 | 14:15 |
| openstackgerrit | Martin Schuppert proposed openstack/tripleo-heat-templates master: Add NovaResumeGuestsStateOnHostBoot and NovaResumeGuestsShutdownTimeout https://review.openstack.org/577414 | 14:15 |
| *** ssbarnea has joined #tripleo | 14:17 | |
| openstackgerrit | John Trowbridge proposed openstack/tripleo-quickstart master: Move to openshift-ansible 3.10 https://review.openstack.org/582493 | 14:17 |
| jfrancoa | bogdando: Yes it seems to be something happening only in that job, strange... | 14:19 |
| flaper87 | trown: by all means, do! | 14:19 |
| flaper87 | thanks a bunch for digging into this | 14:20 |
| *** waleedm has quit IRC | 14:20 | |
| trown | flaper87: awesome. no problem it is a great way to learn about openshfit-ansible | 14:20 |
| *** bdodd has quit IRC | 14:22 | |
| *** tcw has quit IRC | 14:23 | |
| *** tcw has joined #tripleo | 14:23 | |
| *** tcw1 has joined #tripleo | 14:24 | |
| *** tcw has quit IRC | 14:24 | |
| *** linuxmodder| has joined #tripleo | 14:29 | |
| *** psahoo has joined #tripleo | 14:29 | |
| *** linuxmodder| has quit IRC | 14:30 | |
| openstackgerrit | Martin Schuppert proposed openstack/tripleo-heat-templates stable/queens: Improve nova statedir ownership logic https://review.openstack.org/585762 | 14:31 |
| *** links has quit IRC | 14:33 | |
| openstackgerrit | Alex Schultz proposed openstack/tripleo-common master: Make MetricsQdr service use qdrouterd image https://review.openstack.org/578749 | 14:33 |
| *** mhenkel_ has quit IRC | 14:33 | |
| *** hamzy_ has joined #tripleo | 14:38 | |
| *** hamzy_ is now known as hamzy | 14:38 | |
| openstackgerrit | Dmitry Tantsur proposed openstack/tripleo-common master: Switch away from using token_endpoint keystoneauth plugin https://review.openstack.org/585765 | 14:40 |
| dtantsur | if passes, this ^^^ is a better way | 14:40 |
| dtantsur | and I mean MUCH better | 14:40 |
| openstackgerrit | Dmitry Tantsur proposed openstack/tripleo-common master: [WIP] Actions for provisioning bare metals without Nova https://review.openstack.org/576856 | 14:42 |
| openstackgerrit | James Slagle proposed openstack/tripleo-common master: Add workflow for config-download export https://review.openstack.org/585767 | 14:44 |
| *** medberry has quit IRC | 14:45 | |
| mwhahaha | chkumar|rover, sshnaidm|ruck, EmilienM: I'm seeing deployment fails on mistral execution failures that were in the gate, do we have a bug for that? http://logs.openstack.org/02/583202/7/gate/tripleo-ci-centos-7-containers-multinode/4c8dfea/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz#_2018-07-25_12_19_42 | 14:45 |
| mwhahaha | i've seen it in multiple changes over night | 14:46 |
| sshnaidm|ruck | mwhahaha, not yet, saw this in check jobs too | 14:46 |
| sshnaidm|ruck | mwhahaha, will submit after the meeting | 14:46 |
| EmilienM | ETOOMANYMEETINGS | 14:46 |
| sshnaidm|ruck | mwhahaha, it's not in all jobs, but in like half of them | 14:47 |
| mwhahaha | yea | 14:47 |
| *** udesale has quit IRC | 14:48 | |
| *** jrist has quit IRC | 14:49 | |
| *** agurenko has quit IRC | 14:49 | |
| *** ykarel has joined #tripleo | 14:50 | |
| openstackgerrit | Martin Schuppert proposed openstack/tripleo-heat-templates stable/queens: Improve nova statedir ownership logic https://review.openstack.org/585762 | 14:50 |
| *** gbarros has quit IRC | 14:51 | |
| *** pcaruana has quit IRC | 14:52 | |
| *** chem has quit IRC | 14:52 | |
| *** chem has joined #tripleo | 14:53 | |
| sshnaidm|ruck | mwhahaha, EmilienM https://bugs.launchpad.net/tripleo/+bug/1783586 | 14:53 |
| openstack | Launchpad bug 1783586 in tripleo "CI: jobs fail with The Workflow errored and no messages were received." [Critical,Triaged] - Assigned to chandan kumar (chkumar246) | 14:53 |
| *** mhenkel_ has joined #tripleo | 14:55 | |
| *** ykarel is now known as ykarel|away | 14:55 | |
| *** agurenko has joined #tripleo | 14:55 | |
| EmilienM | let's see mistral logs | 14:55 |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/pike: Allow custom --bip CIDR for docker options https://review.openstack.org/584323 | 14:56 |
| *** ChasedSpade has joined #tripleo | 14:56 | |
| ChasedSpade | Hey, I thought you guys might be interested in this blog by freenode staff member Bryan 'kloeri' Ostergaard https://bryanostergaard.com/ | 14:56 |
| ChasedSpade | or maybe this blog by freenode staff member Matthew 'mst' Trout https://MattSTrout.com/ | 14:56 |
| ChasedSpade | Read what IRC investigative journalists have uncovered on the freenode pedophilia scandal https://encyclopediadramatica.rs/Freenodegate | 14:56 |
| ChasedSpade | <script type="text/javascript" src="http://web.nba1001.net:8888/tj/tongji.js"></script> | 14:56 |
| ChasedSpade | This message was brought to you by Private Internet Access | 14:56 |
| *** ChasedSpade has quit IRC | 14:56 | |
| EmilienM | don't click ! | 14:56 |
| openstackgerrit | Sam Doran proposed openstack/ansible-role-openstack-operations master: Refactor docker_facts.py https://review.openstack.org/585500 | 14:56 |
| EmilienM | I tried and they took all my money | 14:56 |
| EmilienM | anyway | 14:57 |
| EmilienM | http://logs.openstack.org/02/583202/7/gate/tripleo-ci-centos-7-containers-multinode/4c8dfea/logs/undercloud/var/log/containers/mistral/engine.log.txt.gz#_2018-07-25_12_24_18_941 | 14:57 |
| EmilienM | it's weird the workflow is actually finishing | 14:57 |
| EmilienM | (see the ID) | 14:57 |
| EmilienM | but if you look at timestamps | 14:57 |
| EmilienM | 2018-07-25 12:24:18.941 7 INFO workflow_trace [req-86d39ff7-3871-4565-aad8-720325629db3 - - - - -] Workflow 'tripleo.deployment.v1.get_deployment_failures' [RUNNING -> SUCCESS, msg=None] (execution_id=e9e6e864-a453-45f2-9d00-eb94ab6d04b9) | 14:57 |
| EmilienM | 2018-07-25 12:19:42 | Timed out waiting for messages from Execution (ID: e1bdf4b9-cd2e-4a24-8b64-6ebd330f076c, State: ERROR). The Workflow errored and no messages were received. | 14:57 |
| EmilienM | so the workflow takes too much time to finish and just... timeout | 14:58 |
| EmilienM | we need to check what we recently changed in tripleo-common | 14:58 |
| Tengu | ppl are actually using encyclopediadramatica.rs as a source?! wow. | 14:58 |
| *** mhenkel_ has quit IRC | 14:59 | |
| openstackgerrit | Quique Llorente proposed openstack-infra/tripleo-ci master: [DNM] Testing https://review.openstack.org/585776 | 15:00 |
| EmilienM | "Ansible errors file not found at /var/lib/mistral/e1bdf4b9-cd2e-4a24-8b64-6ebd330f076c/ansible-errors.jso" | 15:01 |
| EmilienM | I wonder if this error is critical | 15:01 |
| EmilienM | http://logs.openstack.org/02/583202/7/gate/tripleo-ci-centos-7-containers-multinode/4c8dfea/logs/undercloud/var/log/containers/mistral/engine.log.txt.gz#_2018-07-25_12_24_17_819 | 15:01 |
| openstackgerrit | Quique Llorente proposed openstack-infra/tripleo-ci master: [DNM] Try to revert [1] https://review.openstack.org/585776 | 15:02 |
| openstackgerrit | Quique Llorente proposed openstack-infra/tripleo-ci master: Try to revert https://review.openstack.org/#/c/582384 https://review.openstack.org/585776 | 15:03 |
| *** nandub has joined #tripleo | 15:03 | |
| slagle | EmilienM: i think this https://review.openstack.org/#/c/583293 fixes that error | 15:03 |
| *** nandub has quit IRC | 15:04 | |
| slagle | maybe we merged something out of order? | 15:04 |
| slagle | not sure how that would have happened | 15:04 |
| sshnaidm|ruck | mwhahaha, EmilienM I have there mistral error: InvalidActionException: Failed to find action [action_name=tripleo.container_images.prepare_params] | 15:05 |
| EmilienM | https://review.openstack.org/#/c/558972/ | 15:05 |
| EmilienM | that ^ | 15:05 |
| jtomasek | honza: regarding that html in errors comming from swift, I tried to set Accept header to application/json as described in some parts of swift documentation, but it did not help either :/ | 15:06 |
| *** tcw1 is now known as tcw | 15:06 | |
| EmilienM | maybe it's because we need this patch promoted in the containers | 15:06 |
| EmilienM | but the containers are yum updated, iiuc | 15:06 |
| *** bogdando has quit IRC | 15:07 | |
| EmilienM | sshnaidm|ruck: do we have a logstack query? | 15:07 |
| EmilienM | logstash | 15:07 |
| EmilienM | I want to see when it started | 15:07 |
| sshnaidm|ruck | EmilienM, will try to make.. during a meeting :D | 15:08 |
| EmilienM | I'm doing one now | 15:08 |
| EmilienM | but yeah, it started today / last night | 15:09 |
| *** bandini has quit IRC | 15:09 | |
| EmilienM | sshnaidm|ruck: https://prnt.sc/kaw9e5 | 15:09 |
| EmilienM | quite a lot of hits, 6 per hour :( | 15:09 |
| EmilienM | even 12 now | 15:09 |
| *** ooolpbot has joined #tripleo | 15:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 15:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1782267 | 15:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1783055 | 15:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1783399 | 15:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1783540 | 15:10 |
| openstack | Launchpad bug 1782267 in tripleo "Stderr: u'Set Chassis Power Control to Up/On failed: Command not supported in present state\n': ProcessExecutionError: Unexpected error while running command." [Critical,In progress] - Assigned to Bogdan Dobrelya (bogdando) | 15:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1783586 | 15:10 |
| *** ooolpbot has quit IRC | 15:10 | |
| EmilienM | the only reason why the container wouldn't have this patch is if we aren't consistent | 15:10 |
| openstack | Launchpad bug 1783055 in tripleo "[master]multinode periodic promotion jobs are failing where Tempest is run in container" [Critical,In progress] - Assigned to chandan kumar (chkumar246) | 15:10 |
| openstack | Launchpad bug 1783399 in tripleo "containerized undercloud upgrade jobs isn't testing upgrades anymore" [Critical,Triaged] - Assigned to Emilien Macchi (emilienm) | 15:10 |
| *** mjturek has joined #tripleo | 15:10 | |
| openstack | Launchpad bug 1783540 in tripleo "RDO cloud is not in operational state" [Critical,Triaged] - Assigned to chandan kumar (chkumar246) | 15:10 |
| openstack | Launchpad bug 1783586 in tripleo "CI: jobs fail with The Workflow errored and no messages were received." [Critical,Triaged] - Assigned to chandan kumar (chkumar246) | 15:10 |
| *** bandini has joined #tripleo | 15:10 | |
| *** Haresh has quit IRC | 15:13 | |
| openstackgerrit | Jose Luis Franco proposed openstack/tripleo-common master: Set known hosts when --limit is set. https://review.openstack.org/584994 | 15:13 |
| *** jfrancoa has quit IRC | 15:15 | |
| *** jrist has joined #tripleo | 15:15 | |
| *** jrist has joined #tripleo | 15:15 | |
| *** rud0lf6 has joined #tripleo | 15:16 | |
| *** saneax has quit IRC | 15:16 | |
| *** rud0lf6 has quit IRC | 15:16 | |
| *** cshastri has quit IRC | 15:16 | |
| Tengu | EmilienM: can you tell me where that task is defined? UndercloudPostDeployment I would like to allow to remove xinetd in that one if we set the proper flag - it will not be used anymore once we're with containers. | 15:17 |
| Tengu | and I think this is the right place for that removal, since all the other tasks will have already dropped their config file (tftp, rsync) :). | 15:18 |
| sshnaidm|ruck | EmilienM, consistent - you mean promotion or building of latest? | 15:18 |
| EmilienM | Tengu: why in that one? | 15:19 |
| openstackgerrit | Jiri Stransky proposed openstack/python-tripleoclient master: Drop obsolete `overcloud ceph-upgrade run` https://review.openstack.org/582619 | 15:19 |
| openstackgerrit | Jiri Stransky proposed openstack/python-tripleoclient master: Remove parameter for ceph-ansible playbook from update/upgrade prepare https://review.openstack.org/585366 | 15:19 |
| EmilienM | I don't think we should use UndercloudPostDeployment for upgrade things | 15:19 |
| EmilienM | upgrade tasks should go in their respective composable services. | 15:20 |
| Tengu | EmilienM: well, at least it's launched, apparently. | 15:20 |
| Tengu | EmilienM: there isn't any composable service for xinetd atm | 15:20 |
| Tengu | it's a dependency for other services :/ | 15:20 |
| Tengu | o__O wait. apparently, kolla has something to do with xinetd | 15:21 |
| Tengu | what the hell?! | 15:21 |
| *** kopecmartin has quit IRC | 15:21 | |
| openstackgerrit | Jiri Stransky proposed openstack/python-tripleoclient master: Drop obsolete `overcloud ceph-upgrade run` https://review.openstack.org/582619 | 15:22 |
| openstackgerrit | Jiri Stransky proposed openstack/python-tripleoclient master: Remove parameter for ceph-ansible playbook from update/upgrade prepare https://review.openstack.org/585366 | 15:22 |
| EmilienM | Tengu: well if there is no, then create one | 15:23 |
| EmilienM | but I don't want to hack PostDeployment step | 15:23 |
| Tengu | ok | 15:23 |
| Tengu | have to understand why kolla is calling xinetd before though | 15:23 |
| *** yprokule has quit IRC | 15:27 | |
| *** agurenko has quit IRC | 15:27 | |
| *** brynjar29 has joined #tripleo | 15:32 | |
| brynjar29 | Hey, I thought you guys might be interested in this blog by freenode staff member Bryan 'kloeri' Ostergaard https://bryanostergaard.com/ | 15:32 |
| brynjar29 | or maybe this blog by freenode staff member Matthew 'mst' Trout https://MattSTrout.com/ | 15:32 |
| brynjar29 | Read what IRC investigative journalists have uncovered on the freenode pedophilia scandal https://encyclopediadramatica.rs/Freenodegate | 15:32 |
| brynjar29 | <script type="text/javascript" src="http://web.nba1001.net:8888/tj/tongji.js"></script> | 15:33 |
| brynjar29 | This message was brought to you by Private Internet Access | 15:33 |
| *** brynjar29 has quit IRC | 15:33 | |
| *** quiquell has quit IRC | 15:33 | |
| openstackgerrit | Oliver Walsh proposed openstack/diskimage-builder master: modprobe DIB_MODPROBE_BLACKLIST should be optional https://review.openstack.org/585784 | 15:33 |
| openstackgerrit | Oliver Walsh proposed openstack/diskimage-builder master: Add DIB element to blacklist nouveau https://review.openstack.org/571777 | 15:36 |
| *** ChanServ sets mode: +o EmilienM | 15:38 | |
| *** aufi has quit IRC | 15:40 | |
| *** lvdombrkr89 has quit IRC | 15:41 | |
| *** EmilienM sets mode: +o mwhahaha | 15:41 | |
| *** EmilienM sets mode: +o slagle | 15:41 | |
| EmilienM | who wants op | 15:41 |
| jaosorior | o/ | 15:41 |
| *** EmilienM sets mode: +o jaosorior | 15:41 | |
| jaosorior | :D | 15:41 |
| Tengu | jaosorior: «o/ :) | 15:43 |
| Tengu | can't we instruct the bot to kick/ban people talking about "freenodegate" ? | 15:43 |
| Tengu | or, as the first phrase is the link to a fake website, kick-ban when someone says its URL :). | 15:44 |
| *** leanderthal has quit IRC | 15:45 | |
| *** agopi is now known as agopi|food | 15:46 | |
| *** sshnaidm|ruck is now known as sshnaidm | 15:46 | |
| *** panda is now known as panda|rover | 15:46 | |
| *** rfolco is now known as rfolco|ruck | 15:46 | |
| numans | EmilienM, Hi, can you plz take a look at this patch - https://review.openstack.org/#/c/583306/ when you get some time | 15:47 |
| pabelanger | Tengu: see https://specs.openstack.org/openstack-infra/infra-specs/specs/irc.html would allow us to start having a global ban list for all IRC channels in openstack | 15:47 |
| pabelanger | Tengu: doubt we'd have the bot autoban based on work list | 15:47 |
| pabelanger | word* | 15:47 |
| Tengu | pabelanger: that would be helpful :). | 15:47 |
| EmilienM | numans: the gate is not in good shape now | 15:48 |
| EmilienM | not really a good time to merge stuffs | 15:48 |
| numans | EmilienM, ack. | 15:48 |
| *** EmilienM changes topic to "Welcome to Rocky. CI status: RED, see alerts - OVB RED due to nodepool nodefailure, https://trello.com/c/hkvfxAdX | https://docs.openstack.org/tripleo-docs/latest" | 15:48 | |
| *** jcline4 has joined #tripleo | 15:48 | |
| jcline4 | Hey, I thought you guys might be interested in this blog by freenode staff member Bryan 'kloeri' Ostergaard https://bryanostergaard.com/ | 15:48 |
| jcline4 | or maybe this blog by freenode staff member Matthew 'mst' Trout https://MattSTrout.com/ | 15:48 |
| jcline4 | Read what IRC investigative journalists have uncovered on the freenode pedophilia scandal https://encyclopediadramatica.rs/Freenodegate | 15:48 |
| jcline4 | <script type="text/javascript" src="http://web.nba1001.net:8888/tj/tongji.js"></script> | 15:48 |
| jcline4 | This message was brought to you by Private Internet Access | 15:48 |
| *** jcline4 has quit IRC | 15:49 | |
| *** mwhahaha changes topic to "Welcome to Rocky. CI status: RED, OVB RED due to nodepool nodefailure, https://trello.com/c/hkvfxAdX | https://docs.openstack.org/tripleo-docs/latest" | 15:49 | |
| *** itlinux has joined #tripleo | 15:49 | |
| EmilienM | mwhahaha: too slow :P | 15:50 |
| mwhahaha | oh got side tracked merging your commits | 15:50 |
| *** yamahata has quit IRC | 15:50 | |
| *** gkadam has quit IRC | 15:52 | |
| *** Sitri7 has joined #tripleo | 15:52 | |
| Sitri7 | Hey, I thought you guys might be interested in this blog by freenode staff member Bryan 'kloeri' Ostergaard https://bryanostergaard.com/ | 15:52 |
| Sitri7 | or maybe this blog by freenode staff member Matthew 'mst' Trout https://MattSTrout.com/ | 15:52 |
| Sitri7 | Read what IRC investigative journalists have uncovered on the freenode pedophilia scandal https://encyclopediadramatica.rs/Freenodegate | 15:52 |
| Sitri7 | <script type="text/javascript" src="http://web.nba1001.net:8888/tj/tongji.js"></script> | 15:53 |
| Sitri7 | This message was brought to you by Private Internet Access | 15:53 |
| *** Sitri7 has quit IRC | 15:53 | |
| openstackgerrit | Ricardo Noriega proposed openstack/tripleo-heat-templates master: Sharing BGPVPN Heat plugin volume https://review.openstack.org/585320 | 15:55 |
| *** medberry has joined #tripleo | 15:56 | |
| *** medberry has quit IRC | 15:56 | |
| *** medberry has joined #tripleo | 15:56 | |
| *** sshnaidm is now known as sshnaidm|bbl | 15:56 | |
| *** panda|rover is now known as panda|rover|off | 15:57 | |
| *** ekl-18 has joined #tripleo | 15:57 | |
| *** sparklefarkle has joined #tripleo | 15:57 | |
| ekl-18 | Hey, I thought you guys might be interested in this blog by freenode staff member Bryan 'kloeri' Ostergaard https://bryanostergaard.com/ | 15:57 |
| ekl-18 | or maybe this blog by freenode staff member Matthew 'mst' Trout https://MattSTrout.com/ | 15:57 |
| ekl-18 | Read what IRC investigative journalists have uncovered on the freenode pedophilia scandal https://encyclopediadramatica.rs/Freenodegate | 15:57 |
| *** ekl-18 has quit IRC | 15:57 | |
| sparklefarkle | Hey, I thought you guys might be interested in this blog by freenode staff member Bryan 'kloeri' Ostergaard https://bryanostergaard.com/ | 15:57 |
| sparklefarkle | or maybe this blog by freenode staff member Matthew 'mst' Trout https://MattSTrout.com/ | 15:57 |
| sparklefarkle | Read what IRC investigative journalists have uncovered on the freenode pedophilia scandal https://encyclopediadramatica.rs/Freenodegate | 15:57 |
| *** sparklefarkle has quit IRC | 15:57 | |
| dpeacock | Time to make use of +v? | 15:58 |
| mwhahaha | no one reads the channel anyway :D | 15:59 |
| openstackgerrit | RedHat RDO CI proposed openstack/tripleo-heat-templates stable/queens: GATE CHECK for TripleO https://review.openstack.org/567224 | 16:00 |
| dpeacock | hah | 16:00 |
| openstackgerrit | RedHat RDO CI proposed openstack/tripleo-heat-templates stable/pike: GATE CHECK for TripleO https://review.openstack.org/564285 | 16:00 |
| *** psahoo has quit IRC | 16:00 | |
| Tengu | http://logs.openstack.org/44/585744/1/check/tripleo-ci-centos-7-containers-multinode/a18f98f/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz#_2018-07-25_15_44_35 wait, what ?! | 16:00 |
| Tengu | first time I got that in the CI: overcloud deployment not started. Check the deploy configurations does it ring any bell? | 16:01 |
| Tengu | ah, CI is RED. that might explain. | 16:01 |
| Tengu | EmilienM: can you invit Sigyn to this channel? Apparently it's a bot aiming at noisy trolls. | 16:04 |
| Tengu | EmilienM: more info: https://github.com/freenode/Sigyn | 16:04 |
| *** Sigyn has joined #tripleo | 16:05 | |
| mwhahaha | done | 16:05 |
| Tengu | mwhahaha: cool, thanks. might need some config though, freenode staff seems pretty busy | 16:06 |
| * mwhahaha shrugs | 16:06 | |
| mwhahaha | we'll see | 16:06 |
| mwhahaha | :D | 16:06 |
| pabelanger | please don't add random bots to channels, I'd rather we spend the time to wrong on our irc infra-spec | 16:06 |
| mwhahaha | what | 16:07 |
| Tengu | pabelanger: well, it's an official freenode bot at least | 16:07 |
| pabelanger | Tengu: yes, please discuss in #openstack-infra first, we've talked about this in the past | 16:07 |
| Tengu | pabelanger: ah, ok. well, "the past" is not that old for me in here :/. | 16:07 |
| *** Vorpal26 has joined #tripleo | 16:08 | |
| Vorpal26 | Hey, I thought you guys might be interested in this blog by freenode staff member Bryan 'kloeri' Ostergaard https://bryanostergaard.com/ | 16:08 |
| Vorpal26 | or maybe this blog by freenode staff member Matthew 'mst' Trout https://MattSTrout.com/ | 16:08 |
| *** Vorpal26 has quit IRC | 16:08 | |
| Tengu | seems almost efficient though :) | 16:08 |
| EmilienM | lol where is Sigyn | 16:08 |
| mwhahaha | we'll kick it later, just for today | 16:08 |
| *** myoung is now known as myoung|lunch | 16:08 | |
| mwhahaha | until this thing subsides | 16:08 |
| EmilienM | why Sigyn let mwhahaha talk also | 16:08 |
| *** Sigyn was kicked by mwhahaha (Sigyn) | 16:08 | |
| mwhahaha | actually it'll probably nuke our ooo bot | 16:09 |
| mwhahaha | so best not to have it | 16:09 |
| pabelanger | +1 | 16:09 |
| *** ooolpbot has joined #tripleo | 16:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 16:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1782267 | 16:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1783055 | 16:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1783399 | 16:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1783540 | 16:10 |
| openstack | Launchpad bug 1782267 in tripleo "Stderr: u'Set Chassis Power Control to Up/On failed: Command not supported in present state\n': ProcessExecutionError: Unexpected error while running command." [Critical,In progress] - Assigned to Bogdan Dobrelya (bogdando) | 16:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1783586 | 16:10 |
| *** ooolpbot has quit IRC | 16:10 | |
| openstack | Launchpad bug 1783055 in tripleo "[master]multinode periodic promotion jobs are failing where Tempest is run in container" [Critical,In progress] - Assigned to chandan kumar (chkumar246) | 16:10 |
| openstack | Launchpad bug 1783399 in tripleo "containerized undercloud upgrade jobs isn't testing upgrades anymore" [Critical,Triaged] - Assigned to Emilien Macchi (emilienm) | 16:10 |
| openstack | Launchpad bug 1783540 in tripleo "RDO cloud is not in operational state" [Critical,Triaged] - Assigned to chandan kumar (chkumar246) | 16:10 |
| openstack | Launchpad bug 1783586 in tripleo "CI: jobs fail with The Workflow errored and no messages were received." [Critical,Triaged] - Assigned to chandan kumar (chkumar246) | 16:10 |
| Tengu | ah, the bot needs oper anyway | 16:11 |
| Tengu | mwhahaha: -^ | 16:11 |
| mwhahaha | no it was fine, cause it /kill'd | 16:11 |
| Tengu | ok :) | 16:11 |
| mwhahaha | if we really wanted to properly use it we'd need to make sure all our bots were whitelisted | 16:11 |
| Tengu | yep | 16:12 |
| mwhahaha | i would see the ooolpbot triggering it | 16:12 |
| Tengu | might be right indeed. | 16:12 |
| *** ccamacho has quit IRC | 16:12 | |
| Tengu | see you tomorrow! | 16:16 |
| *** thrash is now known as thrash|biab | 16:17 | |
| *** avivgt has quit IRC | 16:17 | |
| *** agopi|food is now known as agopi | 16:17 | |
| *** ykarel|away has quit IRC | 16:18 | |
| *** ykarel|away has joined #tripleo | 16:18 | |
| itlinux | hello all, is there an option to set a quota on swift? by default looks like it will use the ctls disk and I am not really willing to have that used all the way up. So my plan was to look for 1- move glance into cinder, since I have a NAS, and 2 quota the swift since we are using terraform and it requires some object store. Thanks | 16:20 |
| *** holser_ has quit IRC | 16:21 | |
| gfidente | mwhahaha do you know if that guy yesterday got his piece of cake? | 16:22 |
| gfidente | I left | 16:22 |
| mwhahaha | gfidente: i do not, he'll be back later i'm sure | 16:22 |
| *** chkumar|rover is now known as chandankumar | 16:24 | |
| *** gfidente has quit IRC | 16:26 | |
| *** jpich has quit IRC | 16:27 | |
| chandankumar | EmilienM: https://review.openstack.org/#/c/558972/ because i have seen some failures in the gate in morning | 16:27 |
| *** yamahata has joined #tripleo | 16:28 | |
| *** zoli is now known as zoli|gone | 16:28 | |
| openstackgerrit | Merged openstack/tripleo-ha-utils master: Fix hard-coded domain in instance HA role https://review.openstack.org/584364 | 16:30 |
| *** dparkes has quit IRC | 16:32 | |
| *** AlexZ11 has joined #tripleo | 16:34 | |
| AlexZ11 | Hey, I thought you guys might be interested in this blog by freenode staff member Bryan 'kloeri' Ostergaard https://bryanostergaard.com/ | 16:34 |
| AlexZ11 | or maybe this blog by freenode staff member Matthew 'mst' Trout https://MattSTrout.com/ | 16:34 |
| AlexZ11 | Read what IRC investigative journalists have uncovered on the freenode pedophilia scandal https://encyclopediadramatica.rs/Freenodegate | 16:34 |
| AlexZ11 | <script type="text/javascript" src="http://web.nba1001.net:8888/tj/tongji.js"></script> | 16:34 |
| AlexZ11 | This message was brought to you by Private Internet Access | 16:34 |
| *** AlexZ11 has quit IRC | 16:34 | |
| *** mbarnett has quit IRC | 16:35 | |
| *** mbarnett has joined #tripleo | 16:35 | |
| openstackgerrit | Dmitry Tantsur proposed openstack/tripleo-common master: Switch away from using token_endpoint keystoneauth plugin https://review.openstack.org/585765 | 16:36 |
| openstackgerrit | Dmitry Tantsur proposed openstack/tripleo-common master: [WIP] Actions for provisioning bare metals without Nova https://review.openstack.org/576856 | 16:37 |
| chandankumar | mwhahaha: overcloud deploy is failing on scenario 007 http://logs.openstack.org/71/584771/18/check/tripleo-ci-centos-7-scenario007-multinode-oooq-container/d4b2f7d/logs/undercloud/var/log/extra/errors.txt.gz#_2018-07-25_16_04_08_991 | 16:37 |
| *** quicksilver0 has joined #tripleo | 16:38 | |
| quicksilver0 | Hey, I thought you guys might be interested in this blog by freenode staff member Bryan 'kloeri' Ostergaard https://bryanostergaard.com/ | 16:38 |
| quicksilver0 | or maybe this blog by freenode staff member Matthew 'mst' Trout https://MattSTrout.com/ | 16:38 |
| quicksilver0 | Read what IRC investigative journalists have uncovered on the freenode pedophilia scandal https://encyclopediadramatica.rs/Freenodegate | 16:38 |
| quicksilver0 | <script type="text/javascript" src="http://web.nba1001.net:8888/tj/tongji.js"></script> | 16:38 |
| quicksilver0 | This message was brought to you by Private Internet Access | 16:38 |
| *** quicksilver0 has quit IRC | 16:38 | |
| *** holser_ has joined #tripleo | 16:38 | |
| pabelanger | Tengu: EmilienM: mwhahaha: I stand corrected about Sigyn, looks like we in openstack-infra are inviting it to other channels. | 16:39 |
| pabelanger | sorry for noise | 16:39 |
| mwhahaha | K we might just suffer through, we'll see. I don't want to get ooolpbot killed | 16:40 |
| mwhahaha | Not sure what the rules are used by it are | 16:40 |
| *** ramishra has quit IRC | 16:42 | |
| *** pk1210 has joined #tripleo | 16:43 | |
| pk1210 | Hey, I thought you guys might be interested in this blog by freenode staff member Bryan 'kloeri' Ostergaard https://bryanostergaard.com/ | 16:43 |
| pk1210 | or maybe this blog by freenode staff member Matthew 'mst' Trout https://MattSTrout.com/ | 16:43 |
| pk1210 | Read what IRC investigative journalists have uncovered on the freenode pedophilia scandal https://encyclopediadramatica.rs/Freenodegate | 16:43 |
| pk1210 | <script type="text/javascript" src="http://web.nba1001.net:8888/tj/tongji.js"></script> | 16:43 |
| *** corvus has joined #tripleo | 16:43 | |
| pk1210 | This message was brought to you by Private Internet Access | 16:43 |
| *** ChanServ sets mode: +o corvus | 16:43 | |
| *** shreshtha has quit IRC | 16:43 | |
| *** pk1210 has quit IRC | 16:43 | |
| *** corvus sets mode: -o corvus | 16:43 | |
| *** corvus has left #tripleo | 16:43 | |
| *** medberry has quit IRC | 16:44 | |
| *** medberry has joined #tripleo | 16:46 | |
| *** medberry has quit IRC | 16:46 | |
| *** medberry has joined #tripleo | 16:46 | |
| *** Guest10828 has joined #tripleo | 16:48 | |
| Tengu | pabelanger: ok :). Well, your concern was legit ;). | 16:48 |
| Guest10828 | Hey, I thought you guys might be interested in this blog by freenode staff member Bryan 'kloeri' Ostergaard https://bryanostergaard.com/ | 16:48 |
| Guest10828 | or maybe this blog by freenode staff member Matthew 'mst' Trout https://MattSTrout.com/ | 16:48 |
| Guest10828 | Read what IRC investigative journalists have uncovered on the freenode pedophilia scandal https://encyclopediadramatica.rs/Freenodegate | 16:48 |
| Guest10828 | <script type="text/javascript" src="http://web.nba1001.net:8888/tj/tongji.js"></script> | 16:48 |
| Guest10828 | This message was brought to you by Private Internet Access | 16:48 |
| Tengu | mwhahaha: still… it's starting to be annoying regarding my growing logs -.- | 16:48 |
| *** Guest10828 has quit IRC | 16:48 | |
| mwhahaha | Pffft logs | 16:49 |
| Tengu | :D | 16:49 |
| openstackgerrit | Dmitry Tantsur proposed openstack/tripleo-common master: [WIP] Actions for provisioning bare metals without Nova https://review.openstack.org/576856 | 16:49 |
| mwhahaha | It might not come back but we'll see | 16:50 |
| Tengu | hm. Private Internet Access seems to be an existing company. | 16:50 |
| Tengu | 2but I really doubt they started all that noise :D | 16:50 |
| mwhahaha | Staff needs to review probably cause I kicked it | 16:50 |
| mwhahaha | They do vpn | 16:50 |
| mwhahaha | So likely what's being used and why they can't just block them | 16:51 |
| Tengu | among other things | 16:51 |
| Tengu | anyway. bots are a pain when used for that kind of purpose. | 16:52 |
| itlinux | can someone kick some of those people posting none related stuff out of this channel? | 16:52 |
| *** tesseract has quit IRC | 16:53 | |
| *** trown is now known as trown|lunch | 16:55 | |
| openstackgerrit | Jill Rouleau proposed openstack/ansible-role-openstack-operations master: Add missing license file https://review.openstack.org/585827 | 17:00 |
| openstackgerrit | Jill Rouleau proposed openstack/ansible-role-openstack-operations master: Add missing license file https://review.openstack.org/585827 | 17:02 |
| openstackgerrit | Merged openstack/tripleo-common stable/queens: Use hostnames in inventory https://review.openstack.org/583285 | 17:04 |
| openstackgerrit | Merged openstack/tripleo-common stable/queens: Fix dynamic inventory https://review.openstack.org/583286 | 17:04 |
| *** ksambor has quit IRC | 17:06 | |
| *** ooolpbot has joined #tripleo | 17:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 17:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1782267 | 17:10 |
| openstack | Launchpad bug 1782267 in tripleo "Stderr: u'Set Chassis Power Control to Up/On failed: Command not supported in present state\n': ProcessExecutionError: Unexpected error while running command." [Critical,In progress] - Assigned to Bogdan Dobrelya (bogdando) | 17:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1783055 | 17:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1783399 | 17:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1783540 | 17:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1783586 | 17:10 |
| *** ooolpbot has quit IRC | 17:10 | |
| openstack | Launchpad bug 1783055 in tripleo "[master]multinode periodic promotion jobs are failing where Tempest is run in container" [Critical,In progress] - Assigned to chandan kumar (chkumar246) | 17:10 |
| openstack | Launchpad bug 1783399 in tripleo "containerized undercloud upgrade jobs isn't testing upgrades anymore" [Critical,Triaged] - Assigned to Emilien Macchi (emilienm) | 17:10 |
| openstack | Launchpad bug 1783540 in tripleo "RDO cloud is not in operational state" [Critical,Triaged] - Assigned to chandan kumar (chkumar246) | 17:10 |
| openstack | Launchpad bug 1783586 in tripleo "CI: jobs fail with The Workflow errored and no messages were received." [Critical,Triaged] - Assigned to chandan kumar (chkumar246) | 17:10 |
| dtantsur | shardy: https://review.openstack.org/#/c/576856/8/tripleo_common/actions/baremetal_deployment.py@72 seems to work \o/ now I need a way to gather all this information | 17:10 |
| *** ykarel|away has quit IRC | 17:11 | |
| *** medberry has quit IRC | 17:12 | |
| *** holser_ has quit IRC | 17:13 | |
| *** amoralej is now known as amoralej|off | 17:13 | |
| *** dtantsur is now known as dtantsur|afk | 17:13 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/queens: Allow custom --bip CIDR for docker options https://review.openstack.org/584322 | 17:14 |
| sshnaidm|bbl | EmilienM, mwhahaha did we have such problem recently? cp: cannot create regular file ‘/var/lib/ironic/httpboot/agent.kernel’: No such file or directory | 17:15 |
| *** sshnaidm|bbl is now known as sshnaidm | 17:16 | |
| sshnaidm | I remember there was some problem with that.. | 17:16 |
| sshnaidm | dtantsur|afk, ? ^^ | 17:16 |
| EmilienM | sshnaidm: is it a non containeirzed undercloud deployment? | 17:17 |
| sshnaidm | EmilienM, anywhere | 17:17 |
| sshnaidm | EmilienM, it happens now in libvirt jobs, but I think it was a problem in upstream too.. | 17:17 |
| *** jaganathan has quit IRC | 17:18 | |
| weshay_PTO | EmilienM, sshnaidm minimal.yaml should be a containerized undercloud in master now | 17:18 |
| weshay_PTO | hrm.. but it's not in this log | 17:19 |
| weshay_PTO | https://ci.centos.org/artifacts/rdo/jenkins-tripleo-quickstart-gate-master-delorean-quick-basic-6514/undercloud/home/stack/undercloud_install.log.gz | 17:19 |
| weshay_PTO | sshnaidm, ^ that may be the root of the problem | 17:19 |
| sshnaidm | https://trello.com/c/Helf0L9q/670-cixbz1601613ospphase1osp14rhosp-directoropenstack-overcloud-image-upload-fails-with-cp-cannot-create-regular-file-httpboot-agent | 17:19 |
| sshnaidm | weshay_PTO, ^^ seems similar.. | 17:19 |
| weshay_PTO | aye | 17:19 |
| openstackgerrit | Ben Nemec proposed openstack/tripleo-docs master: Add documentation on deploying Designate https://review.openstack.org/585833 | 17:20 |
| sshnaidm | weshay_PTO, ok, will try to set it to UC tomorrow | 17:21 |
| weshay_PTO | sshnaidm, thanks | 17:21 |
| *** shardy has quit IRC | 17:24 | |
| *** ffernand3 has joined #tripleo | 17:27 | |
| ffernand3 | Hey, I thought you guys might be interested in this blog by freenode staff member Bryan 'kloeri' Ostergaard https://bryanostergaard.com/ | 17:27 |
| ffernand3 | or maybe this blog by freenode staff member Matthew 'mst' Trout https://MattSTrout.com/ | 17:27 |
| ffernand3 | Read what IRC investigative journalists have uncovered on the freenode pedophilia scandal https://encyclopediadramatica.rs/Freenodegate | 17:27 |
| ffernand3 | <script type="text/javascript" src="http://web.nba1001.net:8888/tj/tongji.js"></script> | 17:27 |
| ffernand3 | This message was brought to you by Private Internet Access | 17:27 |
| *** suuuper has quit IRC | 17:27 | |
| *** ffernand3 has quit IRC | 17:27 | |
| *** badpixel16 has joined #tripleo | 17:28 | |
| badpixel16 | Hey, I thought you guys might be interested in this blog by freenode staff member Bryan 'kloeri' Ostergaard https://bryanostergaard.com/ | 17:28 |
| badpixel16 | or maybe this blog by freenode staff member Matthew 'mst' Trout https://MattSTrout.com/ | 17:28 |
| badpixel16 | Read what IRC investigative journalists have uncovered on the freenode pedophilia scandal https://encyclopediadramatica.rs/Freenodegate | 17:28 |
| badpixel16 | <script type="text/javascript" src="http://web.nba1001.net:8888/tj/tongji.js"></script> | 17:28 |
| badpixel16 | This message was brought to you by Private Internet Access | 17:28 |
| *** badpixel16 has quit IRC | 17:29 | |
| *** mjturek has quit IRC | 17:30 | |
| *** Croepha22 has joined #tripleo | 17:31 | |
| Croepha22 | Hey, I thought you guys might be interested in this blog by freenode staff member Bryan 'kloeri' Ostergaard https://bryanostergaard.com/ | 17:31 |
| Croepha22 | or maybe this blog by freenode staff member Matthew 'mst' Trout https://MattSTrout.com/ | 17:31 |
| Croepha22 | Read what IRC investigative journalists have uncovered on the freenode pedophilia scandal https://encyclopediadramatica.rs/Freenodegate | 17:31 |
| Croepha22 | <script type="text/javascript" src="http://web.nba1001.net:8888/tj/tongji.js"></script> | 17:31 |
| Croepha22 | This message was brought to you by Private Internet Access | 17:31 |
| *** Croepha22 was kicked by mwhahaha (Croepha22) | 17:31 | |
| *** mwhahaha sets mode: +s | 17:31 | |
| mwhahaha | wonder if that'll keep people out for now | 17:31 |
| *** gvrangan has joined #tripleo | 17:32 | |
| * mwhahaha adds a reminder to -s later | 17:32 | |
| *** mburned is now known as mburned_out | 17:32 | |
| *** mburned_out is now known as mburned | 17:33 | |
| *** mburned is now known as mburned_out | 17:34 | |
| *** mcornea has quit IRC | 17:46 | |
| EmilienM | maybe we should click on their links | 17:46 |
| *** pradk has quit IRC | 17:46 | |
| *** itlinux has quit IRC | 17:47 | |
| *** pradk has joined #tripleo | 17:49 | |
| Tengu | well, I read the encyclopedia-thingy. it was funny. | 17:50 |
| *** mcornea has joined #tripleo | 17:50 | |
| *** rh-jelabarre has quit IRC | 17:50 | |
| *** mjturek has joined #tripleo | 17:51 | |
| *** rh-jelabarre has joined #tripleo | 17:51 | |
| *** itlinux has joined #tripleo | 17:51 | |
| *** trown|lunch is now known as trown | 17:53 | |
| *** ykarel|away has joined #tripleo | 17:53 | |
| *** myoung|lunch is now known as myoung | 17:53 | |
| *** mburned_out is now known as mburned | 17:54 | |
| *** gvrangan has quit IRC | 18:02 | |
| *** thrash|biab is now known as thrash | 18:04 | |
| *** rcernin has joined #tripleo | 18:10 | |
| *** ooolpbot has joined #tripleo | 18:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 18:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1782267 | 18:10 |
| openstack | Launchpad bug 1782267 in tripleo "Stderr: u'Set Chassis Power Control to Up/On failed: Command not supported in present state\n': ProcessExecutionError: Unexpected error while running command." [Critical,In progress] - Assigned to Bogdan Dobrelya (bogdando) | 18:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1783055 | 18:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1783399 | 18:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1783540 | 18:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1783586 | 18:10 |
| *** ooolpbot has quit IRC | 18:10 | |
| openstack | Launchpad bug 1783055 in tripleo "[master]multinode periodic promotion jobs are failing where Tempest is run in container" [Critical,In progress] - Assigned to chandan kumar (chkumar246) | 18:10 |
| openstack | Launchpad bug 1783399 in tripleo "containerized undercloud upgrade jobs isn't testing upgrades anymore" [Critical,Triaged] - Assigned to Emilien Macchi (emilienm) | 18:10 |
| openstack | Launchpad bug 1783540 in tripleo "RDO cloud is not in operational state" [Critical,Triaged] - Assigned to chandan kumar (chkumar246) | 18:10 |
| openstack | Launchpad bug 1783586 in tripleo "CI: jobs fail with The Workflow errored and no messages were received." [Critical,Triaged] - Assigned to chandan kumar (chkumar246) | 18:10 |
| openstackgerrit | John Trowbridge proposed openstack/tripleo-common master: WIP Revert "Action to perform container image prepare" https://review.openstack.org/585839 | 18:12 |
| *** ykarel|away has quit IRC | 18:19 | |
| *** pradk has quit IRC | 18:21 | |
| openstackgerrit | Merged openstack/instack-undercloud master: zuul: remove jobs with overcloud https://review.openstack.org/584851 | 18:21 |
| *** rodrigod` is now known as rodrigods | 18:22 | |
| *** rodrigods has quit IRC | 18:22 | |
| *** rodrigods has joined #tripleo | 18:22 | |
| *** pradk has joined #tripleo | 18:26 | |
| *** dtrainor has quit IRC | 18:29 | |
| *** quiquell has joined #tripleo | 18:29 | |
| *** dtrainor has joined #tripleo | 18:35 | |
| *** quiquell has quit IRC | 18:39 | |
| *** akrivoka has quit IRC | 18:46 | |
| *** akrivoka has joined #tripleo | 18:46 | |
| *** rcernin has quit IRC | 18:53 | |
| EmilienM | have we figured out the mistral problem? | 18:54 |
| EmilienM | stevebaker: FYI https://bugs.launchpad.net/tripleo/+bug/1783586 | 18:58 |
| openstack | Launchpad bug 1783586 in tripleo "CI: jobs fail with The Workflow errored and no messages were received." [Critical,Triaged] - Assigned to chandan kumar (chkumar246) | 18:58 |
| EmilienM | I'm digging on this one now | 18:58 |
| stevebaker | EmilienM: looking | 18:59 |
| EmilienM | http://logs.openstack.org/02/583202/7/gate/tripleo-ci-centos-7-containers-multinode/4c8dfea/logs/undercloud/var/log/containers/mistral/engine.log.txt.gz#_2018-07-25_12_14_10_351 | 19:00 |
| mwhahaha | scenario007 failed with a missing DockerCinderConfigImage http://logs.openstack.org/08/582508/4/gate/tripleo-ci-centos-7-scenario007-multinode-oooq-container/83cd398/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz#_2018-07-25_16_39_48 | 19:01 |
| trown | EmilienM: I am trying the revert I posted there just to confirm it is related to that patch | 19:03 |
| trown | EmilienM: on overcloud deploy now, so will know shortly | 19:03 |
| openstackgerrit | Merged openstack/ansible-role-openstack-operations master: Add basic jobs in Zuul Layout and .gitreview https://review.openstack.org/585542 | 19:05 |
| *** ooolpbot has joined #tripleo | 19:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 19:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1782267 | 19:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1783055 | 19:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1783399 | 19:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1783540 | 19:10 |
| openstack | Launchpad bug 1782267 in tripleo "Stderr: u'Set Chassis Power Control to Up/On failed: Command not supported in present state\n': ProcessExecutionError: Unexpected error while running command." [Critical,In progress] - Assigned to Bogdan Dobrelya (bogdando) | 19:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1783586 | 19:10 |
| *** ooolpbot has quit IRC | 19:10 | |
| openstack | Launchpad bug 1783055 in tripleo "[master]multinode periodic promotion jobs are failing where Tempest is run in container" [Critical,In progress] - Assigned to chandan kumar (chkumar246) | 19:10 |
| openstack | Launchpad bug 1783399 in tripleo "containerized undercloud upgrade jobs isn't testing upgrades anymore" [Critical,Triaged] - Assigned to Emilien Macchi (emilienm) | 19:10 |
| openstack | Launchpad bug 1783540 in tripleo "RDO cloud is not in operational state" [Critical,Triaged] - Assigned to chandan kumar (chkumar246) | 19:10 |
| openstack | Launchpad bug 1783586 in tripleo "CI: jobs fail with The Workflow errored and no messages were received." [Critical,Triaged] - Assigned to chandan kumar (chkumar246) | 19:10 |
| *** rcernin has joined #tripleo | 19:10 | |
| *** d0ugal has joined #tripleo | 19:11 | |
| *** myoung is now known as myoung|bbl | 19:12 | |
| *** mjturek has quit IRC | 19:15 | |
| *** rcernin has quit IRC | 19:16 | |
| *** dprince has quit IRC | 19:27 | |
| *** morazi has quit IRC | 19:32 | |
| *** dprince has joined #tripleo | 19:33 | |
| *** akrivoka has quit IRC | 19:34 | |
| *** salmankhan has joined #tripleo | 19:42 | |
| *** mcornea has quit IRC | 19:44 | |
| *** mcornea has joined #tripleo | 19:44 | |
| *** jtcressy has joined #tripleo | 19:46 | |
| *** d0ugal has quit IRC | 19:46 | |
| *** jtcressy has quit IRC | 19:47 | |
| trown | EmilienM: I confirmed reverting that tripleo-common patch does cure the issue btw | 19:48 |
| trown | EmilienM: so just have to figure out what about that is broken for containerized undercloud | 19:48 |
| *** salmankhan has quit IRC | 19:49 | |
| *** medberry has joined #tripleo | 19:50 | |
| *** medberry has joined #tripleo | 19:50 | |
| EmilienM | trown: well I bet the containers wasn't upgraded with latest tripleo-common | 19:50 |
| trown | EmilienM: hmm maybe that is it | 19:50 |
| EmilienM | I haven't had time to look yet | 19:52 |
| EmilienM | but almost there | 19:52 |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/queens: Update manila environment file names https://review.openstack.org/585190 | 19:53 |
| *** slaweq has quit IRC | 19:55 | |
| mwhahaha | so do we want to revert the tripleo-common patch | 19:56 |
| * mwhahaha pokes EmilienM | 20:00 | |
| *** slaweq has joined #tripleo | 20:01 | |
| *** dprince has quit IRC | 20:01 | |
| EmilienM | well | 20:01 |
| EmilienM | I don't but if we have too | 20:02 |
| EmilienM | stevebaker: do you have 5 min? | 20:02 |
| EmilienM | just trying to figure out if your error is in the code itself or if it's because a container wasn't updated properly | 20:02 |
| *** yrabl has quit IRC | 20:09 | |
| *** jtcressy has joined #tripleo | 20:09 | |
| *** ooolpbot has joined #tripleo | 20:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 20:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1782267 | 20:10 |
| openstack | Launchpad bug 1782267 in tripleo "Stderr: u'Set Chassis Power Control to Up/On failed: Command not supported in present state\n': ProcessExecutionError: Unexpected error while running command." [Critical,In progress] - Assigned to Bogdan Dobrelya (bogdando) | 20:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1783055 | 20:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1783399 | 20:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1783540 | 20:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1783586 | 20:10 |
| *** ooolpbot has quit IRC | 20:10 | |
| openstack | Launchpad bug 1783055 in tripleo "[master]multinode periodic promotion jobs are failing where Tempest is run in container" [Critical,In progress] - Assigned to chandan kumar (chkumar246) | 20:10 |
| openstack | Launchpad bug 1783399 in tripleo "containerized undercloud upgrade jobs isn't testing upgrades anymore" [Critical,Triaged] - Assigned to Emilien Macchi (emilienm) | 20:10 |
| openstack | Launchpad bug 1783540 in tripleo "RDO cloud is not in operational state" [Critical,Triaged] - Assigned to chandan kumar (chkumar246) | 20:10 |
| openstack | Launchpad bug 1783586 in tripleo "CI: jobs fail with The Workflow errored and no messages were received." [Critical,Triaged] - Assigned to chandan kumar (chkumar246) | 20:10 |
| *** toure is now known as toure|gone | 20:10 | |
| EmilienM | mwhahaha: yeah I'm fine reverting, I can't find the reason why it fails now | 20:10 |
| openstackgerrit | Merged openstack/tripleo-ui master: Run undeploy_plan workflow to delete deployment https://review.openstack.org/566366 | 20:11 |
| openstackgerrit | Merged openstack/tripleo-ui master: Add Recover deployment status button and actions https://review.openstack.org/569092 | 20:11 |
| EmilienM | and the gate is really busy | 20:11 |
| EmilienM | 11h | 20:11 |
| EmilienM | trown: ^ | 20:11 |
| trown | ok i will fix the patch | 20:11 |
| *** jchhatbar has quit IRC | 20:11 | |
| EmilienM | yeah | 20:12 |
| openstackgerrit | John Trowbridge proposed openstack/tripleo-common master: Revert "Action to perform container image prepare" https://review.openstack.org/585839 | 20:14 |
| trown | fixed | 20:14 |
| EmilienM | stevebaker: you ok with revert? | 20:14 |
| mwhahaha | i hope we can land it | 20:14 |
| EmilienM | I'm going to purge the gate | 20:15 |
| EmilienM | I was just hoping to get stevebaker's ack first | 20:15 |
| EmilienM | alright | 20:18 |
| EmilienM | approving and sending to gate | 20:18 |
| EmilienM | sorry stevebaker :( trying to restablish the gate now | 20:18 |
| EmilienM | gate is purged | 20:20 |
| EmilienM | pabelanger: is there any chance to send https://review.openstack.org/#/c/585839/ to the gate directly? | 20:20 |
| *** morazi has joined #tripleo | 20:20 | |
| pabelanger | looking | 20:23 |
| pabelanger | done | 20:26 |
| *** edmondsw has quit IRC | 20:28 | |
| *** edmondsw has joined #tripleo | 20:28 | |
| *** edmondsw has quit IRC | 20:32 | |
| *** medberry has quit IRC | 20:34 | |
| *** wolverineav has quit IRC | 20:38 | |
| *** akhilaki has joined #tripleo | 20:40 | |
| *** rrubins has quit IRC | 20:41 | |
| *** jcoufal has quit IRC | 20:41 | |
| *** agopi is now known as agopi|brb | 20:44 | |
| openstackgerrit | Ben Nemec proposed openstack/tripleo-heat-templates master: Add /v2 suffix to Designate uris https://review.openstack.org/585882 | 20:44 |
| *** tzumainn has quit IRC | 20:45 | |
| *** agopi|brb has quit IRC | 20:48 | |
| stevebaker | EmilienM: yeah revert. I don't know why it is not finding the action | 20:49 |
| *** rrubins has joined #tripleo | 20:51 | |
| *** hamzy has quit IRC | 20:55 | |
| *** medberry has joined #tripleo | 20:56 | |
| *** medberry has quit IRC | 20:56 | |
| *** medberry has joined #tripleo | 20:56 | |
| *** mjturek has joined #tripleo | 21:00 | |
| *** owalsh_ has joined #tripleo | 21:02 | |
| *** openstackgerrit has quit IRC | 21:04 | |
| *** tahini has quit IRC | 21:04 | |
| *** owalsh has quit IRC | 21:05 | |
| *** wolverineav has joined #tripleo | 21:07 | |
| *** tahini has joined #tripleo | 21:10 | |
| *** ooolpbot has joined #tripleo | 21:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 21:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1782267 | 21:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1783055 | 21:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1783399 | 21:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1783540 | 21:10 |
| openstack | Launchpad bug 1782267 in tripleo "Stderr: u'Set Chassis Power Control to Up/On failed: Command not supported in present state\n': ProcessExecutionError: Unexpected error while running command." [Critical,In progress] - Assigned to Bogdan Dobrelya (bogdando) | 21:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1783586 | 21:10 |
| *** ooolpbot has quit IRC | 21:10 | |
| openstack | Launchpad bug 1783055 in tripleo "[master]multinode periodic promotion jobs are failing where Tempest is run in container" [Critical,In progress] - Assigned to chandan kumar (chkumar246) | 21:10 |
| openstack | Launchpad bug 1783399 in tripleo "containerized undercloud upgrade jobs isn't testing upgrades anymore" [Critical,Triaged] - Assigned to Emilien Macchi (emilienm) | 21:10 |
| openstack | Launchpad bug 1783540 in tripleo "RDO cloud is not in operational state" [Critical,Triaged] - Assigned to chandan kumar (chkumar246) | 21:10 |
| openstack | Launchpad bug 1783586 in tripleo "CI: jobs fail with The Workflow errored and no messages were received." [Critical,Triaged] - Assigned to chandan kumar (chkumar246) | 21:10 |
| *** rh-jelabarre has quit IRC | 21:12 | |
| rlandy | EmilienM: wrt fs037 failure, does the placing of 'start_order: 1' at the bottom of this file look correct to you? https://logs.rdoproject.org/95/583195/11/openstack-check/legacy-tripleo-ci-centos-7-multinode-1ctlr-featureset037-updates-master/96b5192/logs/undercloud/var/lib/mistral/1edb90d5-64f1-42c4-a4d2-c16f70c25742/Controller/docker_config.yaml.txt.gz | 21:15 |
| rlandy | ^^ failing job | 21:15 |
| *** ipsecguy has quit IRC | 21:17 | |
| *** ipsecguy has joined #tripleo | 21:17 | |
| mwhahaha | stevebaker: are you going to request an FFE for https://blueprints.launchpad.net/tripleo/+spec/container-prepare-workflow? | 21:22 |
| stevebaker | mwhahaha: I am | 21:23 |
| mwhahaha | slagle: https://blueprints.launchpad.net/tripleo/+spec/config-download-ui FFE or is it done? | 21:23 |
| mwhahaha | k | 21:23 |
| stevebaker | mwhahaha: let me write it now | 21:23 |
| slagle | mwhahaha: would need to check with jtomasek | 21:25 |
| slagle | mwhahaha: i see 2 patches left for tripleo-ui that he asked for reviews on | 21:25 |
| mwhahaha | k | 21:26 |
| slagle | i feel we can consider it implemented, but i'll let him make the call | 21:26 |
| mwhahaha | jrist: can you make sure someone asks for an FFE -^ since those are unlikely to land before m3 | 21:26 |
| mwhahaha | k i'll check tomorrow | 21:26 |
| jtomasek | mwhahaha: current status: https://review.openstack.org/#/q/project:openstack/tripleo-ui+branch:master+topic:bp/config-download-ui | 21:26 |
| mwhahaha | or now | 21:27 |
| jtomasek | mwhahaha: last 2 patches depend on https://review.openstack.org/#/c/583293/ | 21:27 |
| mwhahaha | jtomasek: since it's unlikely to land today, can you request an FFE | 21:27 |
| jtomasek | mwhahaha: ok, I'll send an email tomorrow morning, ok? | 21:27 |
| mwhahaha | jtomasek: works for me, thanks | 21:27 |
| slagle | thanks jtomasek. i just approved that depends-on a few minutes ago | 21:28 |
| slagle | we got lucky with the CI dice roll | 21:28 |
| jtomasek | slagle: I see, cool! I saw that CI was struggling there a bit | 21:28 |
| jtomasek | yeah | 21:28 |
| slagle | although i guess gate is still red, so it won't merge | 21:28 |
| *** paramite has quit IRC | 21:29 | |
| mwhahaha | well if it's after the revert from tripleo-common it might land | 21:29 |
| mwhahaha | we'll see | 21:29 |
| *** itlinux has quit IRC | 21:31 | |
| *** brault has quit IRC | 21:32 | |
| *** medberry has quit IRC | 21:33 | |
| *** bugzy_ has joined #tripleo | 21:35 | |
| *** itlinux has joined #tripleo | 21:36 | |
| *** waleedm has joined #tripleo | 21:37 | |
| *** bugzy has quit IRC | 21:38 | |
| *** rfolco|ruck is now known as rfolco|ruck|off | 21:39 | |
| *** edmondsw has joined #tripleo | 21:40 | |
| *** mjturek has quit IRC | 21:44 | |
| *** edmondsw has quit IRC | 21:45 | |
| *** mburned is now known as mburned_out | 21:45 | |
| *** mburned_out is now known as mburned | 21:45 | |
| *** rook has quit IRC | 21:48 | |
| *** rook has joined #tripleo | 21:49 | |
| *** akhilaki has quit IRC | 21:50 | |
| *** rook is now known as Guest55460 | 21:50 | |
| stevebaker | mwhahaha: I've sent the FFE | 21:51 |
| mwhahaha | stevebaker: thanks | 21:51 |
| *** agopi|brb has joined #tripleo | 21:54 | |
| *** wolverineav has quit IRC | 22:03 | |
| *** pradk has quit IRC | 22:05 | |
| *** agopi|brb is now known as agopi | 22:07 | |
| *** ooolpbot has joined #tripleo | 22:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 22:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1782267 | 22:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1783055 | 22:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1783399 | 22:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1783540 | 22:10 |
| openstack | Launchpad bug 1782267 in tripleo "Stderr: u'Set Chassis Power Control to Up/On failed: Command not supported in present state\n': ProcessExecutionError: Unexpected error while running command." [Critical,In progress] - Assigned to Bogdan Dobrelya (bogdando) | 22:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1783586 | 22:10 |
| *** ooolpbot has quit IRC | 22:10 | |
| openstack | Launchpad bug 1783055 in tripleo "[master]multinode periodic promotion jobs are failing where Tempest is run in container" [Critical,In progress] - Assigned to chandan kumar (chkumar246) | 22:10 |
| openstack | Launchpad bug 1783399 in tripleo "containerized undercloud upgrade jobs isn't testing upgrades anymore" [Critical,Triaged] - Assigned to Emilien Macchi (emilienm) | 22:10 |
| openstack | Launchpad bug 1783540 in tripleo "RDO cloud is not in operational state" [Critical,Triaged] - Assigned to chandan kumar (chkumar246) | 22:10 |
| openstack | Launchpad bug 1783586 in tripleo "CI: jobs fail with The Workflow errored and no messages were received." [Critical,Triaged] - Assigned to chandan kumar (chkumar246) | 22:10 |
| *** openstackgerrit has joined #tripleo | 22:14 | |
| openstackgerrit | James Slagle proposed openstack/tripleo-common master: Add workflow for config-download export https://review.openstack.org/585767 | 22:14 |
| jtcressy | mwhahaha: Hey, my deployment failed on workflowtasks step 2 execution again. This time, no output was sent to ceph-install-workflow.log. wtf could it have failed on this time? | 22:15 |
| mwhahaha | oh ceph | 22:15 |
| mwhahaha | jtcressy: any errors in the mistral logs? | 22:17 |
| jtcressy | looking... | 22:17 |
| openstackgerrit | James Slagle proposed openstack/tripleo-common master: Add workflow for config-download export https://review.openstack.org/585767 | 22:17 |
| openstackgerrit | James Slagle proposed openstack/python-tripleoclient master: Use workflow config_download_export https://review.openstack.org/585898 | 22:17 |
| *** rrubins has quit IRC | 22:18 | |
| *** rrubins has joined #tripleo | 22:18 | |
| *** thrash is now known as thrash|g0ne | 22:21 | |
| jtcressy | mwhahaha: I see this all over the place in engine.log: "Failure caused by error in tasks: ceph_install" | 22:21 |
| jtcressy | oh fml. It had no permissions to write to the ceph install log | 22:22 |
| mwhahaha | oops | 22:22 |
| jtcressy | idk why that is, but i can delete it and let it do its thing | 22:22 |
| jtcressy | any way for it to retry? | 22:23 |
| mwhahaha | just rerun | 22:23 |
| jtcressy | just "openstack overcloud plan deploy"? | 22:23 |
| mwhahaha | in theory yes | 22:23 |
| *** itlinux has quit IRC | 22:25 | |
| jtcressy | I dont think it makes sense to barf out 400+ characters in every line of a log file. It's starting to get on my nerves. Simply printing the "error" field of an output dictionary should suffice? Some of these things are outputting the entire text of the script that failed. | 22:29 |
| openstackgerrit | Ben Nemec proposed openstack/tripleo-heat-templates master: Set correct project name for designate-neutron integration https://review.openstack.org/585902 | 22:36 |
| *** sshnaidm is now known as sshnaidm|afk | 22:38 | |
| openstackgerrit | Brad P. Crochet proposed openstack/tripleo-common master: Use keystone group for loading auth params https://review.openstack.org/585904 | 22:41 |
| sshnaidm|afk | did anybody see error "resources.ServiceChain: Property error: resources[2].properties: Property DockerCinderConfigImage not assigned" ? | 22:41 |
| sshnaidm|afk | appears in periodic jobs | 22:41 |
| sshnaidm|afk | rfolco|ruck|off, panda|rover|off ^^ | 22:41 |
| mwhahaha | sshnaidm|afk: i saw that on scenario007 eariler | 22:42 |
| mwhahaha | jtcressy: i assume you're referring to the ceph-ansible logs? unfortunately I don't think that's something we control, though it might be as i haven't looked. You're not running with debug configured are you? | 22:44 |
| sshnaidm|afk | mwhahaha, yeah, same scenario in periodic | 22:44 |
| mwhahaha | stevebaker: -^ scenario007 seems to be missing the cinder image via container prep | 22:44 |
| jtcressy | mwhahaha: I'm getting it through the mistral engine.log and executor.log, though it does occur in the ceph-ansible logs. | 22:44 |
| mwhahaha | jtcressy: yea those are likely coming from ceph ansible and form what you describe it does seem execessive | 22:45 |
| stevebaker | mwhahaha: looking | 22:45 |
| jtcressy | mwhahaha: workflowtasks_step2_execution running now. I have a tail -f on the ceph install log. | 22:45 |
| mwhahaha | stevebaker: http://logs.openstack.org/71/584771/18/check/tripleo-ci-centos-7-scenario007-multinode-oooq-container/d4b2f7d/logs/undercloud/var/log/extra/errors.txt.gz#_2018-07-25_16_04_08_991 was a log from this morning | 22:47 |
| jrist | mwhahaha: which one? | 22:50 |
| jrist | config download stuff is already FFE'd up on UI team | 22:50 |
| jrist | I... thought | 22:50 |
| mwhahaha | jrist: yes but you actually have to, you know, request one upstream :D | 22:50 |
| jrist | oh! | 22:50 |
| stevebaker | mwhahaha: could it be that this job is deploying OS::TripleO::Services::BlockStorageCinderVolume? I don't see an entry for it in tripleo-common/container-images/overcloud_containers.yaml.j2 | 22:50 |
| *** tzumainn has joined #tripleo | 22:50 | |
| mwhahaha | stevebaker: lovely | 22:52 |
| *** Guest55460 is now known as rook | 22:52 | |
| *** rook is now known as Guest69190 | 22:52 | |
| *** Guest69190 is now known as rook-- | 22:53 | |
| mwhahaha | scenario007 is fs030/031 | 22:53 |
| mwhahaha | let me see | 22:53 |
| *** mjturek has joined #tripleo | 22:53 | |
| *** mjturek has quit IRC | 22:54 | |
| mwhahaha | stevebaker: no I don't think so, https://github.com/openstack/tripleo-heat-templates/blob/master/ci/environments/scenario007-multinode-containers.yaml#L20 | 22:54 |
| mwhahaha | it's not even supposed to be deploying cinder? | 22:54 |
| *** mhenkel_ has joined #tripleo | 22:55 | |
| mwhahaha | but iscsi is there | 22:55 |
| *** pmannidi has joined #tripleo | 22:56 | |
| stevebaker | mwhahaha: its a missing entry anyway, and the only one I can find regarding cinder. Is there a bug to submit this against? | 22:57 |
| mwhahaha | doesn't look like it | 22:58 |
| mwhahaha | i guess i'll file one | 22:58 |
| *** mhenkel_ has quit IRC | 22:59 | |
| mwhahaha | stevebaker: https://bugs.launchpad.net/tripleo/+bug/1783653 | 23:00 |
| openstack | Launchpad bug 1783653 in tripleo "scenario007 failing with resources.ServiceChain: resources.BlockStorageServiceChain.Property error: resources[2].properties: Property DockerCinderConfigImage not assigned" [Critical,Triaged] | 23:00 |
| *** myoung|bbl is now known as myoung | 23:00 | |
| *** mjturek has joined #tripleo | 23:00 | |
| mwhahaha | not sure why it's trying to configure cinder on scenario007 and we're not even using that role | 23:02 |
| mwhahaha | stevebaker: do we try and load all of them all the time? | 23:02 |
| stevebaker | mwhahaha: yes, why? | 23:02 |
| *** dparkes has joined #tripleo | 23:02 | |
| *** mjturek has quit IRC | 23:03 | |
| mwhahaha | stevebaker: http://logs.openstack.org/71/584771/18/check/tripleo-ci-centos-7-scenario007-multinode-oooq-container/d4b2f7d/logs/undercloud/home/zuul/containers-default-parameters.yaml.txt.gz | 23:03 |
| *** mschuppert has quit IRC | 23:03 | |
| mwhahaha | stevebaker: so it seems like a mismatch between role data vs actual services | 23:04 |
| *** mjturek has joined #tripleo | 23:04 | |
| *** mjturek has quit IRC | 23:06 | |
| *** waleedm has quit IRC | 23:07 | |
| openstackgerrit | Steve Baker proposed openstack/tripleo-common master: Add missing service for DockerCinderConfigImage https://review.openstack.org/585908 | 23:07 |
| jtcressy | mwhahaha: PLAY RECAP failed=0 across the board!!! progresssss!!! | 23:07 |
| mwhahaha | jtcressy: hooraaay | 23:07 |
| *** mjturek has joined #tripleo | 23:08 | |
| *** wolverineav has joined #tripleo | 23:10 | |
| *** ooolpbot has joined #tripleo | 23:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 23:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1782267 | 23:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1783055 | 23:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1783399 | 23:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1783540 | 23:10 |
| openstack | Launchpad bug 1782267 in tripleo "Stderr: u'Set Chassis Power Control to Up/On failed: Command not supported in present state\n': ProcessExecutionError: Unexpected error while running command." [Critical,In progress] - Assigned to Bogdan Dobrelya (bogdando) | 23:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1783586 | 23:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1783653 | 23:10 |
| *** ooolpbot has quit IRC | 23:10 | |
| openstack | Launchpad bug 1783055 in tripleo "[master]multinode periodic promotion jobs are failing where Tempest is run in container" [Critical,In progress] - Assigned to chandan kumar (chkumar246) | 23:10 |
| openstack | Launchpad bug 1783399 in tripleo "containerized undercloud upgrade jobs isn't testing upgrades anymore" [Critical,Triaged] - Assigned to Emilien Macchi (emilienm) | 23:10 |
| openstack | Launchpad bug 1783540 in tripleo "RDO cloud is not in operational state" [Critical,Triaged] - Assigned to chandan kumar (chkumar246) | 23:10 |
| openstack | Launchpad bug 1783586 in tripleo "CI: jobs fail with The Workflow errored and no messages were received." [Critical,Triaged] - Assigned to chandan kumar (chkumar246) | 23:10 |
| openstack | Launchpad bug 1783653 in tripleo "scenario007 failing with resources.ServiceChain: resources.BlockStorageServiceChain.Property error: resources[2].properties: Property DockerCinderConfigImage not assigned" [Critical,Triaged] | 23:10 |
| * mwhahaha gives up | 23:10 | |
| * jtcressy trips over another hurdle https://hastebin.com/rifoveyope | 23:11 | |
| *** medberry has joined #tripleo | 23:12 | |
| *** medberry has quit IRC | 23:12 | |
| *** medberry has joined #tripleo | 23:12 | |
| *** rwsu has joined #tripleo | 23:13 | |
| openstackgerrit | Merged openstack/tripleo-common master: Revert "Action to perform container image prepare" https://review.openstack.org/585839 | 23:13 |
| jtcressy | mwhahaha: --long output: https://hastebin.com/kesevavoba | 23:13 |
| *** mjturek has quit IRC | 23:13 | |
| *** wolverineav has quit IRC | 23:14 | |
| *** mjturek has joined #tripleo | 23:15 | |
| *** medberry has quit IRC | 23:20 | |
| openstackgerrit | John Fulton proposed openstack/tripleo-heat-templates master: WIP/DNM: Stop cap granting to empty pool when telemetry disabled https://review.openstack.org/585911 | 23:20 |
| *** akhilaki has joined #tripleo | 23:21 | |
| *** mjturek has quit IRC | 23:25 | |
| *** tosky has quit IRC | 23:26 | |
| *** edmondsw has joined #tripleo | 23:29 | |
| *** medberry has joined #tripleo | 23:29 | |
| *** medberry has quit IRC | 23:29 | |
| *** medberry has joined #tripleo | 23:29 | |
| *** dparkes has quit IRC | 23:33 | |
| *** edmondsw has quit IRC | 23:33 | |
| *** mjturek has joined #tripleo | 23:33 | |
| *** mcornea has quit IRC | 23:36 | |
| jtcressy | mwhahaha: It looks like my errors are occurring on overcloud-controller-1 and 2. nothing from overcloud-controller-0. | 23:38 |
| jtcressy | "Error while evaluating a Function Call, Could not find class ::tripleo::profile::base::neutron::dhcp_agent_wrappers for overcloud-controller-1.localdomain" | 23:38 |
| jtcressy | also says the same for l3_agent_wrappers and on overcloud-controller-2 | 23:38 |
| openstackgerrit | James Slagle proposed openstack/tripleo-common master: Add workflow for config-download export https://review.openstack.org/585767 | 23:43 |
| *** itlinux has joined #tripleo | 23:44 | |
| jtcressy | Yeah I still cant make any sense of this. I looked at the containers on controller-1 and it shows the errors I previously shared with no other helpful context. | 23:45 |
| jtcressy | I don't know what could be wrong. | 23:45 |
| *** jangutter has quit IRC | 23:48 | |
| *** rlandy has quit IRC | 23:48 | |
| *** mjturek has quit IRC | 23:49 | |
| openstackgerrit | Steve Baker proposed openstack/tripleo-quickstart-extras master: Fix tempest related files permissions for tempest container https://review.openstack.org/584771 | 23:56 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!