| *** bardia has left #openstack-infra | 00:02 | |
| anteaya | es06 has figured itself out | 00:03 |
|---|---|---|
| anteaya | only 3 unassigned shards left | 00:03 |
| *** rockyg has quit IRC | 00:03 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/tripleo-ci: [WIP] Initial support for centos-7 jenkins slave https://review.openstack.org/312725 | 00:04 |
| *** mixos has quit IRC | 00:04 | |
| *** chem has quit IRC | 00:06 | |
| *** doug-fish has joined #openstack-infra | 00:08 | |
| *** fawadkhaliq has quit IRC | 00:09 | |
| *** mriedem has joined #openstack-infra | 00:11 | |
| *** yamamoto has joined #openstack-infra | 00:11 | |
| *** adduarte has quit IRC | 00:11 | |
| *** piet has quit IRC | 00:12 | |
| *** doug-fish has quit IRC | 00:13 | |
| *** doug-fish has joined #openstack-infra | 00:13 | |
| *** docaedo2 has joined #openstack-infra | 00:16 | |
| *** yamamoto has quit IRC | 00:17 | |
| *** thorst has joined #openstack-infra | 00:18 | |
| *** doug-fish has quit IRC | 00:18 | |
| *** tphummel has quit IRC | 00:19 | |
| *** gyee has quit IRC | 00:20 | |
| *** amitgandhinz has joined #openstack-infra | 00:22 | |
| *** tphummel has joined #openstack-infra | 00:23 | |
| openstackgerrit | David Lyle proposed openstack-infra/project-config: Adding tempest-horizon repo and job https://review.openstack.org/312272 | 00:25 |
| *** Sukhdev has quit IRC | 00:35 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/tripleo-ci: [WIP] Initial support for centos-7 jenkins slave https://review.openstack.org/312725 | 00:36 |
| *** thorst has quit IRC | 00:36 | |
| *** thorst has joined #openstack-infra | 00:36 | |
| *** shashank_hegde has quit IRC | 00:37 | |
| *** baoli has quit IRC | 00:37 | |
| *** gildub has joined #openstack-infra | 00:38 | |
| *** kjorgensen has quit IRC | 00:38 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/tripleo-ci: [WIP] Initial support for centos-7 jenkins slave https://review.openstack.org/312725 | 00:40 |
| *** thorst has quit IRC | 00:41 | |
| *** amit213 has quit IRC | 00:42 | |
| *** kjorgens_ has joined #openstack-infra | 00:43 | |
| *** kjorgens_ has quit IRC | 00:43 | |
| *** kjorgensen has joined #openstack-infra | 00:44 | |
| *** thorst has joined #openstack-infra | 00:45 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/tripleo-ci: [WIP] Initial support for centos-7 jenkins slave https://review.openstack.org/312725 | 00:46 |
| *** pvaneck has quit IRC | 00:47 | |
| *** kjorgens_ has joined #openstack-infra | 00:47 | |
| *** tphummel has quit IRC | 00:47 | |
| *** kjorgensen has quit IRC | 00:48 | |
| *** tphummel has joined #openstack-infra | 00:49 | |
| *** kjorgens_ has quit IRC | 00:51 | |
| *** esker has joined #openstack-infra | 00:52 | |
| *** banix has joined #openstack-infra | 00:53 | |
| *** tphummel_ has joined #openstack-infra | 00:55 | |
| *** tphummel has quit IRC | 00:55 | |
| *** tphummel_ is now known as tphummel | 00:55 | |
| *** esker has quit IRC | 00:57 | |
| *** matt-borland has quit IRC | 00:57 | |
| *** mixos has joined #openstack-infra | 00:58 | |
| *** roxanaghe has joined #openstack-infra | 00:58 | |
| *** baoli has joined #openstack-infra | 01:01 | |
| *** amrith is now known as _amrith_ | 01:01 | |
| *** _amrith_ is now known as amrith | 01:02 | |
| *** roxanaghe has quit IRC | 01:03 | |
| *** cap has joined #openstack-infra | 01:03 | |
| *** piet has joined #openstack-infra | 01:04 | |
| *** zhurong has joined #openstack-infra | 01:04 | |
| *** mtanino has quit IRC | 01:05 | |
| *** yamamoto has joined #openstack-infra | 01:07 | |
| *** Jeffrey4l has joined #openstack-infra | 01:07 | |
| *** cap has quit IRC | 01:08 | |
| *** baoli has quit IRC | 01:09 | |
| *** kengo_sakai has joined #openstack-infra | 01:09 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/tripleo-ci: [WIP] Initial support for centos-7 jenkins slave https://review.openstack.org/312725 | 01:10 |
| *** baoli has joined #openstack-infra | 01:12 | |
| *** yamamoto has quit IRC | 01:12 | |
| *** amit213 has joined #openstack-infra | 01:13 | |
| *** mriedem has quit IRC | 01:14 | |
| *** amit213 has quit IRC | 01:16 | |
| *** kengo_sakai has quit IRC | 01:16 | |
| *** mixos has quit IRC | 01:16 | |
| *** kengo_sakai has joined #openstack-infra | 01:17 | |
| *** ddieterly has quit IRC | 01:18 | |
| *** xarses has joined #openstack-infra | 01:20 | |
| *** eliqiao has quit IRC | 01:21 | |
| *** sdake has joined #openstack-infra | 01:22 | |
| *** eliqiao has joined #openstack-infra | 01:22 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/tripleo-ci: [WIP] Initial support for centos-7 jenkins slave https://review.openstack.org/312725 | 01:24 |
| *** baoli has quit IRC | 01:25 | |
| *** kengo_sakai has quit IRC | 01:26 | |
| *** esker has joined #openstack-infra | 01:28 | |
| *** jerryz has quit IRC | 01:28 | |
| *** dims has quit IRC | 01:30 | |
| *** esker has quit IRC | 01:33 | |
| *** dims has joined #openstack-infra | 01:35 | |
| anteaya | not sure how there are 4 unassigned shards now, but that is what I am seeing | 01:37 |
| clarkb | anteaya: I think they may get assigned then after failing enough get reassigned | 01:37 |
| clarkb | in any case it does look a bit better now but not great | 01:37 |
| anteaya | ah okay thanks | 01:37 |
| anteaya | yeah like you say | 01:38 |
| *** gildub has quit IRC | 01:40 | |
| *** vhosakot has joined #openstack-infra | 01:40 | |
| *** thiagop has joined #openstack-infra | 01:42 | |
| *** hdd has quit IRC | 01:42 | |
| *** yamamoto has joined #openstack-infra | 01:43 | |
| *** tphummel has quit IRC | 01:44 | |
| *** hdd has joined #openstack-infra | 01:44 | |
| *** julim has joined #openstack-infra | 01:45 | |
| *** afranc has quit IRC | 01:49 | |
| *** yamamoto has quit IRC | 01:50 | |
| openstackgerrit | amrith proposed openstack-infra/project-config: Adding new repository trove-image-builder https://review.openstack.org/312805 | 01:52 |
| *** doug-fish has joined #openstack-infra | 01:53 | |
| *** bpokorny has joined #openstack-infra | 01:54 | |
| pabelanger | o.0 | 01:54 |
| pabelanger | trove-image-builder? | 01:54 |
| *** zhurong has quit IRC | 01:55 | |
| *** piet has quit IRC | 01:56 | |
| openstackgerrit | amrith proposed openstack-infra/project-config: Adding new repository trove-image-builder https://review.openstack.org/312805 | 01:57 |
| amrith | pabelanger, hellpo | 01:58 |
| amrith | hell | 01:58 |
| amrith | hello | 01:58 |
| amrith | third time's the charm :) | 01:58 |
| amrith | yes, trove-image-builder | 01:58 |
| *** doug-fish has quit IRC | 01:58 | |
| *** yamamoto has joined #openstack-infra | 01:59 | |
| *** jogo has quit IRC | 02:00 | |
| *** thorst has quit IRC | 02:01 | |
| *** thorst has joined #openstack-infra | 02:01 | |
| *** jogo has joined #openstack-infra | 02:02 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/tripleo-ci: [WIP] Initial support for centos-7 jenkins slave https://review.openstack.org/312725 | 02:03 |
| *** bpokorny has quit IRC | 02:03 | |
| *** savihou has quit IRC | 02:04 | |
| *** esker has joined #openstack-infra | 02:04 | |
| *** savihou has joined #openstack-infra | 02:04 | |
| *** anteaya has quit IRC | 02:05 | |
| openstackgerrit | Jianghua Wang proposed openstack-infra/nodepool: Add namespace for nodepool https://review.openstack.org/310698 | 02:07 |
| *** salv-orlando has joined #openstack-infra | 02:08 | |
| *** sdake_ has joined #openstack-infra | 02:08 | |
| *** esker has quit IRC | 02:09 | |
| *** thorst has quit IRC | 02:09 | |
| *** sdake has quit IRC | 02:11 | |
| *** doug-fish has joined #openstack-infra | 02:12 | |
| *** banix has quit IRC | 02:12 | |
| openstackgerrit | Kien Ha proposed openstack-infra/jenkins-job-builder: Add test for mailer plugin https://review.openstack.org/312810 | 02:14 |
| *** zhurong has joined #openstack-infra | 02:15 | |
| *** doug-fish has quit IRC | 02:17 | |
| *** salv-orlando has quit IRC | 02:17 | |
| *** woodster_ has quit IRC | 02:18 | |
| *** DevBox has quit IRC | 02:18 | |
| *** tqtran has quit IRC | 02:19 | |
| *** thiagop has quit IRC | 02:20 | |
| *** jerryz has joined #openstack-infra | 02:21 | |
| *** yamamoto has quit IRC | 02:21 | |
| openstackgerrit | amrith proposed openstack-infra/project-config: Adding new repository trove-image-builder https://review.openstack.org/312805 | 02:24 |
| *** sdake_ has quit IRC | 02:27 | |
| *** jaosorior has joined #openstack-infra | 02:28 | |
| openstackgerrit | Rabi Mishra proposed openstack-infra/project-config: Don't run tempest tests in heat grenade job https://review.openstack.org/312811 | 02:28 |
| *** vhosakot has quit IRC | 02:29 | |
| *** apoorvad has quit IRC | 02:30 | |
| *** salv-orlando has joined #openstack-infra | 02:30 | |
| *** hdd has quit IRC | 02:31 | |
| *** salv-orlando has quit IRC | 02:31 | |
| *** amitgandhinz has quit IRC | 02:31 | |
| *** salv-orlando has joined #openstack-infra | 02:31 | |
| *** fawadkhaliq has joined #openstack-infra | 02:32 | |
| openstackgerrit | Merged openstack-infra/tripleo-ci: Enable undercloud ssl on nonha job https://review.openstack.org/273743 | 02:33 |
| *** vhosakot has joined #openstack-infra | 02:34 | |
| *** tlian2 has quit IRC | 02:34 | |
| *** fitoduarte has joined #openstack-infra | 02:39 | |
| *** esker has joined #openstack-infra | 02:40 | |
| *** banix has joined #openstack-infra | 02:41 | |
| *** yamahata has quit IRC | 02:42 | |
| *** zz_dimtruck is now known as dimtruck | 02:44 | |
| *** esker has quit IRC | 02:44 | |
| *** salv-orlando has quit IRC | 02:45 | |
| *** amrith is now known as _amrith_ | 02:47 | |
| *** roxanaghe has joined #openstack-infra | 02:47 | |
| *** jaosorior has quit IRC | 02:48 | |
| *** DevBox has joined #openstack-infra | 02:51 | |
| *** roxanaghe has quit IRC | 02:52 | |
| *** banix has quit IRC | 02:52 | |
| *** jianghua has quit IRC | 02:52 | |
| *** zhurong has quit IRC | 02:53 | |
| *** Jeffrey4l has quit IRC | 03:05 | |
| *** Jeffrey4l has joined #openstack-infra | 03:05 | |
| *** thorst has joined #openstack-infra | 03:07 | |
| *** thorst has quit IRC | 03:15 | |
| *** esker has joined #openstack-infra | 03:15 | |
| *** mixos has joined #openstack-infra | 03:18 | |
| *** esker has quit IRC | 03:20 | |
| *** salv-orlando has joined #openstack-infra | 03:20 | |
| openstackgerrit | Kien Ha proposed openstack-infra/jenkins-job-builder: Add test for mailer plugin https://review.openstack.org/312810 | 03:21 |
| *** gongysh has joined #openstack-infra | 03:30 | |
| openstackgerrit | Chaozhe Chen(ccz) proposed openstack/requirements: Clean up removed hacking rule from [flake8] ignore lists https://review.openstack.org/283654 | 03:33 |
| *** pt_15 has quit IRC | 03:36 | |
| *** rbrndt has joined #openstack-infra | 03:38 | |
| *** rossella_s has quit IRC | 03:41 | |
| *** rossella_s has joined #openstack-infra | 03:41 | |
| *** fawadkhaliq has quit IRC | 03:41 | |
| *** salv-orlando has quit IRC | 03:42 | |
| *** hdd has joined #openstack-infra | 03:45 | |
| *** shashank_hegde has joined #openstack-infra | 03:47 | |
| *** dimtruck is now known as zz_dimtruck | 03:48 | |
| *** rfolco has quit IRC | 03:50 | |
| *** kzaitsev_mb has joined #openstack-infra | 03:51 | |
| *** piet has joined #openstack-infra | 03:51 | |
| *** pleia2 has quit IRC | 03:51 | |
| *** esker has joined #openstack-infra | 03:51 | |
| *** bpokorny has joined #openstack-infra | 03:51 | |
| *** armax has quit IRC | 03:52 | |
| *** armax has joined #openstack-infra | 03:53 | |
| *** bpokorny has quit IRC | 03:57 | |
| *** esker has quit IRC | 03:57 | |
| *** daemontool has quit IRC | 03:57 | |
| *** armax has quit IRC | 03:58 | |
| *** daemontool has joined #openstack-infra | 03:58 | |
| *** bpokorny has joined #openstack-infra | 03:59 | |
| *** amitgandhinz has joined #openstack-infra | 04:03 | |
| *** kushal has joined #openstack-infra | 04:11 | |
| *** thorst has joined #openstack-infra | 04:13 | |
| *** asettle has quit IRC | 04:13 | |
| *** sdake has joined #openstack-infra | 04:18 | |
| *** thorst has quit IRC | 04:19 | |
| *** rbrndt has quit IRC | 04:20 | |
| *** psachin has joined #openstack-infra | 04:20 | |
| *** Nikolay_St has joined #openstack-infra | 04:20 | |
| *** jerryz has quit IRC | 04:21 | |
| *** jerryz has joined #openstack-infra | 04:21 | |
| openstackgerrit | Merged openstack-infra/system-config: Allow root logins from localhost https://review.openstack.org/312065 | 04:22 |
| *** zhurong has joined #openstack-infra | 04:24 | |
| *** kzaitsev_mb has quit IRC | 04:24 | |
| *** esker has joined #openstack-infra | 04:27 | |
| *** kushal has quit IRC | 04:29 | |
| *** vhosakot has quit IRC | 04:30 | |
| *** kjorgensen has joined #openstack-infra | 04:31 | |
| *** esker has quit IRC | 04:32 | |
| *** kjorgensen has quit IRC | 04:35 | |
| dstufft | asselin_: https://github.com/pypa/warehouse/pull/1166 this should fix it on Warehouse, will do the same on PyPI in a few minutes | 04:35 |
| *** bpokorny has quit IRC | 04:35 | |
| openstackgerrit | feipeng proposed openstack/requirements: Add crc16 lib to requirments crc16 is used by redis hash storage calculation.redis driver is merged into dragonflow,so we need it add to requirements https://review.openstack.org/298485 | 04:36 |
| *** piet has quit IRC | 04:39 | |
| openstackgerrit | Kien Ha proposed openstack-infra/jenkins-job-builder: Add test and update documentation for mailer plugin https://review.openstack.org/312810 | 04:47 |
| *** sdake has quit IRC | 04:47 | |
| *** sdake has joined #openstack-infra | 04:47 | |
| *** mixos has quit IRC | 04:49 | |
| *** shashank_hegde has quit IRC | 04:49 | |
| dstufft | asselin_: ok, deployed on PyPI and Warehouse now, that should make list_packages_with_serial() signifcantly faster (125% on my local development box, but will be more than that when you factor in lock contention and such) | 04:50 |
| dstufft | going to bed now! | 04:50 |
| dstufft | er sorry, not 125%, 125 times. | 04:51 |
| dstufft | (really going to bed now) | 04:52 |
| *** amitgandhinz has quit IRC | 04:54 | |
| *** abregman has joined #openstack-infra | 04:58 | |
| *** shashank_hegde has joined #openstack-infra | 05:01 | |
| *** esker has joined #openstack-infra | 05:03 | |
| *** flwang1 has quit IRC | 05:03 | |
| *** esker has quit IRC | 05:08 | |
| *** roxanaghe has joined #openstack-infra | 05:08 | |
| *** Nikolay_St has quit IRC | 05:12 | |
| *** roxanaghe has quit IRC | 05:12 | |
| *** mixos has joined #openstack-infra | 05:12 | |
| *** abregman has quit IRC | 05:14 | |
| *** hdd has quit IRC | 05:15 | |
| *** abregman has joined #openstack-infra | 05:16 | |
| *** kzaitsev_mb has joined #openstack-infra | 05:17 | |
| *** thorst has joined #openstack-infra | 05:18 | |
| *** fawadkhaliq has joined #openstack-infra | 05:18 | |
| *** harlowja_at_home has joined #openstack-infra | 05:20 | |
| *** ifarkas has quit IRC | 05:22 | |
| *** thorst has quit IRC | 05:25 | |
| *** harlowja_at_home has quit IRC | 05:26 | |
| *** yolanda has joined #openstack-infra | 05:26 | |
| *** javeriak has joined #openstack-infra | 05:28 | |
| *** Hal has joined #openstack-infra | 05:31 | |
| *** Hal is now known as Guest97937 | 05:32 | |
| *** jerryz has quit IRC | 05:34 | |
| *** kushal has joined #openstack-infra | 05:34 | |
| openstackgerrit | Merged openstack-infra/project-config: Correct image name for generated magnum image https://review.openstack.org/312667 | 05:37 |
| openstackgerrit | Kien Ha proposed openstack-infra/jenkins-job-builder: Add test and update documentation for mailer plugin https://review.openstack.org/312810 | 05:37 |
| *** esikachev has joined #openstack-infra | 05:37 | |
| *** esikachev has quit IRC | 05:42 | |
| openstackgerrit | yolanda.robla proposed openstack-infra/system-config: Start using read/write AFS volume for PyPI mirror https://review.openstack.org/312630 | 05:44 |
| openstackgerrit | Kien Ha proposed openstack-infra/jenkins-job-builder: Add test and update documentation for mailer plugin https://review.openstack.org/312810 | 05:45 |
| *** Guest97937 has quit IRC | 05:49 | |
| *** amitgandhinz has joined #openstack-infra | 05:50 | |
| *** armax has joined #openstack-infra | 05:55 | |
| *** amitgandhinz has quit IRC | 05:55 | |
| openstackgerrit | Merged openstack-infra/project-config: Kolla-kubernetes https://review.openstack.org/312592 | 05:55 |
| *** javeriak has quit IRC | 05:56 | |
| *** kjorgensen has joined #openstack-infra | 05:56 | |
| openstackgerrit | Merged openstack-infra/puppet-elasticsearch: Use current elasticsearch url https://review.openstack.org/312699 | 05:59 |
| *** kjorgensen has quit IRC | 06:00 | |
| *** armax has quit IRC | 06:01 | |
| *** openstackgerrit has quit IRC | 06:03 | |
| *** oanson has joined #openstack-infra | 06:03 | |
| *** openstackgerrit has joined #openstack-infra | 06:03 | |
| *** kzaitsev_mb has quit IRC | 06:03 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack-infra/project-config: Normalize projects.yaml https://review.openstack.org/312832 | 06:04 |
| *** mixos has quit IRC | 06:06 | |
| openstackgerrit | Alexey Weyl proposed openstack-infra/irc-meetings: Change time and irc channel of Vitrage project weekly meeting https://review.openstack.org/312509 | 06:07 |
| *** vgridnev has joined #openstack-infra | 06:07 | |
| openstackgerrit | Merged openstack-infra/project-config: Disable App Catalog periodic job https://review.openstack.org/311790 | 06:08 |
| openstackgerrit | Merged openstack-infra/project-config: Vitrage - Jenkins https://review.openstack.org/312053 | 06:09 |
| openstackgerrit | Merged openstack-infra/project-config: Add publish-to-pypi job for tripleo-puppet-elements https://review.openstack.org/312642 | 06:09 |
| openstackgerrit | Merged openstack-infra/project-config: Add pep8 job to stacklight-integration-tests https://review.openstack.org/312590 | 06:09 |
| yolanda | good morning | 06:15 |
| *** asettle has joined #openstack-infra | 06:18 | |
| *** shashank_hegde has quit IRC | 06:20 | |
| *** thorst has joined #openstack-infra | 06:23 | |
| lennyb | anteaya: yes, I am still experiencing #link http://paste.openstack.org/show/496032 . I am trying to debug another zuul issue and found that zuul uses the command from the pastebin, so I run it manually and failed. It's always on the same commit. | 06:25 |
| *** shashank_hegde has joined #openstack-infra | 06:26 | |
| *** thorst has quit IRC | 06:30 | |
| *** e0ne has joined #openstack-infra | 06:32 | |
| *** sdake has quit IRC | 06:32 | |
| *** DevBox has quit IRC | 06:36 | |
| *** nadya has joined #openstack-infra | 06:40 | |
| *** nadya has quit IRC | 06:42 | |
| openstackgerrit | Merged openstack/diskimage-builder: Add documentation for dib-lint https://review.openstack.org/311671 | 06:43 |
| *** e0ne has quit IRC | 06:43 | |
| *** tesseract has joined #openstack-infra | 06:44 | |
| *** tesseract is now known as Guest21288 | 06:45 | |
| *** hdaniel has joined #openstack-infra | 06:48 | |
| *** amitgandhinz has joined #openstack-infra | 06:51 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/requirements: Updated from generate-constraints https://review.openstack.org/309273 | 06:54 |
| *** gildub has joined #openstack-infra | 06:55 | |
| *** amitgandhinz has quit IRC | 06:55 | |
| *** arxcruz has joined #openstack-infra | 07:00 | |
| openstackgerrit | yolanda.robla proposed openstack-infra/project-config: Set image build in magnum to periodic https://review.openstack.org/312842 | 07:06 |
| *** pahuang has quit IRC | 07:06 | |
| *** oanson has quit IRC | 07:08 | |
| *** roxanaghe has joined #openstack-infra | 07:09 | |
| *** flwang1 has joined #openstack-infra | 07:11 | |
| *** roxanaghe has quit IRC | 07:14 | |
| *** dtantsur|afk is now known as dtantsur | 07:15 | |
| *** flwang1 has quit IRC | 07:16 | |
| *** esikachev has joined #openstack-infra | 07:18 | |
| *** yfried has joined #openstack-infra | 07:20 | |
| *** flwang1 has joined #openstack-infra | 07:22 | |
| *** kushal has quit IRC | 07:23 | |
| *** oanson has joined #openstack-infra | 07:24 | |
| openstackgerrit | Carlos Camacho proposed openstack-infra/tripleo-ci: Fix validation for stable branch https://review.openstack.org/312350 | 07:25 |
| *** thorst has joined #openstack-infra | 07:27 | |
| *** hdaniel has quit IRC | 07:27 | |
| *** kzaitsev_mb has joined #openstack-infra | 07:28 | |
| openstackgerrit | yolanda.robla proposed openstack-infra/system-config: Update documentation about infra cloud https://review.openstack.org/308277 | 07:29 |
| *** yfried has quit IRC | 07:29 | |
| *** shashank_hegde has quit IRC | 07:33 | |
| *** HeOS has joined #openstack-infra | 07:34 | |
| *** thorst has quit IRC | 07:35 | |
| *** yolanda has quit IRC | 07:36 | |
| *** shardy has joined #openstack-infra | 07:37 | |
| openstackgerrit | Merged openstack-infra/system-config: Run ansible-playbook in timeout https://review.openstack.org/311913 | 07:37 |
| *** shardy has quit IRC | 07:38 | |
| *** shardy has joined #openstack-infra | 07:38 | |
| *** flwang1 has quit IRC | 07:39 | |
| *** asettle has quit IRC | 07:40 | |
| *** ifarkas has joined #openstack-infra | 07:40 | |
| *** mikelk has joined #openstack-infra | 07:41 | |
| *** jlanoux has joined #openstack-infra | 07:42 | |
| *** hdaniel has joined #openstack-infra | 07:42 | |
| *** javeriak has joined #openstack-infra | 07:43 | |
| *** oanson has quit IRC | 07:43 | |
| *** kzaitsev_mb has quit IRC | 07:44 | |
| *** yolanda has joined #openstack-infra | 07:44 | |
| *** amitgandhinz has joined #openstack-infra | 07:52 | |
| openstackgerrit | Merged openstack-infra/project-config: Move image update cron back https://review.openstack.org/311890 | 07:53 |
| *** amitgandhinz has quit IRC | 07:57 | |
| *** dmk0202 has joined #openstack-infra | 07:57 | |
| openstackgerrit | Merged openstack-infra/project-config: translations: Ignore version failures https://review.openstack.org/312765 | 07:57 |
| *** armax has joined #openstack-infra | 07:58 | |
| *** zzzeek has quit IRC | 08:00 | |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Get translation jobs into healthcheck https://review.openstack.org/311459 | 08:00 |
| openstackgerrit | Merged openstack-infra/project-config: Normalize projects.yaml https://review.openstack.org/312832 | 08:01 |
| *** hdaniel has quit IRC | 08:01 | |
| *** armax has quit IRC | 08:03 | |
| *** dmk0202 has quit IRC | 08:03 | |
| *** zzzeek has joined #openstack-infra | 08:04 | |
| *** vtapia_ has quit IRC | 08:05 | |
| openstackgerrit | Merged openstack-infra/project-config: puppet/experimental: enable puppet4 jobs on xenial https://review.openstack.org/312754 | 08:05 |
| *** e0ne has joined #openstack-infra | 08:06 | |
| *** fawadkhaliq has quit IRC | 08:06 | |
| *** kushal has joined #openstack-infra | 08:08 | |
| *** yolanda has quit IRC | 08:08 | |
| openstackgerrit | Merged openstack-infra/project-config: User right pipeline for neutron periodic jobs https://review.openstack.org/312783 | 08:10 |
| *** dmk0202 has joined #openstack-infra | 08:11 | |
| *** vtapia_ has joined #openstack-infra | 08:12 | |
| *** kzaitsev_mb has joined #openstack-infra | 08:12 | |
| *** yolanda has joined #openstack-infra | 08:13 | |
| *** dingyichen has quit IRC | 08:14 | |
| openstackgerrit | Merged openstack-infra/project-config: Change service user domain for identity v3 only test https://review.openstack.org/271127 | 08:15 |
| *** oanson has joined #openstack-infra | 08:15 | |
| *** sflanigan has quit IRC | 08:18 | |
| *** lucas-afk is now known as lucasagomes | 08:19 | |
| *** obondarev has quit IRC | 08:20 | |
| *** obondarev has joined #openstack-infra | 08:21 | |
| *** derekh has joined #openstack-infra | 08:23 | |
| *** gongysh has quit IRC | 08:27 | |
| *** javeriak has quit IRC | 08:29 | |
| *** thorst has joined #openstack-infra | 08:32 | |
| *** dtantsur is now known as dtantsur|brb | 08:33 | |
| *** jistr has joined #openstack-infra | 08:34 | |
| *** thorst has quit IRC | 08:40 | |
| *** hdaniel has joined #openstack-infra | 08:44 | |
| *** e0ne has quit IRC | 08:46 | |
| *** e0ne has joined #openstack-infra | 08:49 | |
| openstackgerrit | Derek Higgins proposed openstack-infra/tripleo-ci: Stop destroying VM's that don't exist https://review.openstack.org/312863 | 08:49 |
| *** amitgandhinz has joined #openstack-infra | 08:53 | |
| *** yottatsa has joined #openstack-infra | 08:53 | |
| *** electrofelix has joined #openstack-infra | 08:56 | |
| *** amitgandhinz has quit IRC | 08:57 | |
| *** psachin has quit IRC | 09:00 | |
| *** gsagie has joined #openstack-infra | 09:00 | |
| *** yottatsa has quit IRC | 09:00 | |
| gsagie | Hello all, we would like to create sub repositories for project Kuryr, i was wondering if there is a quicker way to do it instead of creating all as new projects and then attaching them to Kuryr in the governance repo? | 09:01 |
| *** psachin has joined #openstack-infra | 09:03 | |
| *** nijaba_ has quit IRC | 09:05 | |
| *** abregman is now known as abregman|afk | 09:06 | |
| *** dizquierdo has joined #openstack-infra | 09:07 | |
| *** nijaba has joined #openstack-infra | 09:07 | |
| *** binbincong has quit IRC | 09:14 | |
| *** binbincong has joined #openstack-infra | 09:15 | |
| openstackgerrit | Adam Coldrick proposed openstack-infra/storyboard-webclient: Add UI for making stories private to a list of people https://review.openstack.org/312663 | 09:16 |
| openstackgerrit | Adam Coldrick proposed openstack-infra/storyboard-webclient: WIP: Complex priorities UI in stories https://review.openstack.org/312666 | 09:16 |
| *** skolekonov_ has quit IRC | 09:17 | |
| *** gildub has quit IRC | 09:17 | |
| *** skolekonov has joined #openstack-infra | 09:17 | |
| *** vgridnev has quit IRC | 09:18 | |
| openstackgerrit | Sylwester Brzeczkowski proposed openstack-infra/project-config: Add fuel-extension-volume-manager project https://review.openstack.org/312487 | 09:18 |
| *** javeriak has joined #openstack-infra | 09:20 | |
| *** sdake has joined #openstack-infra | 09:24 | |
| openstackgerrit | yolanda.robla proposed openstack-infra/shade: Add baymodel list, get and search call for shade+magnum https://review.openstack.org/308009 | 09:37 |
| *** thorst has joined #openstack-infra | 09:38 | |
| openstackgerrit | yolanda.robla proposed openstack-infra/shade: Add baymodel list, get and search call for shade+magnum https://review.openstack.org/308009 | 09:39 |
| *** sambetts|afk is now known as sambetts | 09:40 | |
| *** thorst has quit IRC | 09:45 | |
| *** nadya has joined #openstack-infra | 09:45 | |
| *** e0ne has quit IRC | 09:48 | |
| *** e0ne has joined #openstack-infra | 09:49 | |
| *** Nikolay_St has joined #openstack-infra | 09:51 | |
| *** dtantsur|brb is now known as dtantsur | 09:51 | |
| *** tosky has joined #openstack-infra | 09:53 | |
| *** amitgandhinz has joined #openstack-infra | 09:54 | |
| *** apuimedo has quit IRC | 09:55 | |
| *** beisner has quit IRC | 09:58 | |
| *** amitgandhinz has quit IRC | 09:58 | |
| *** armax has joined #openstack-infra | 10:00 | |
| *** zhurong has quit IRC | 10:01 | |
| *** beisner has joined #openstack-infra | 10:01 | |
| *** arxcruz has quit IRC | 10:04 | |
| *** armax has quit IRC | 10:04 | |
| *** e0ne has quit IRC | 10:05 | |
| *** sdague has joined #openstack-infra | 10:06 | |
| *** yolanda has quit IRC | 10:09 | |
| *** vgridnev has joined #openstack-infra | 10:10 | |
| openstackgerrit | Darragh Bailey proposed openstack-infra/git-review: Fix test_remote_url to work when remote is restricted https://review.openstack.org/312885 | 10:10 |
| *** amotoki has quit IRC | 10:10 | |
| *** amotoki has joined #openstack-infra | 10:11 | |
| *** arxcruz has joined #openstack-infra | 10:11 | |
| *** yolanda has joined #openstack-infra | 10:13 | |
| *** Jeffrey4l has quit IRC | 10:15 | |
| *** Jeffrey4l has joined #openstack-infra | 10:17 | |
| *** _amrith_ is now known as amrith | 10:21 | |
| openstackgerrit | Sergey Kraynev proposed openstack-infra/project-config: Add ci-cd-pipeline-app-murano project to openstack https://review.openstack.org/309383 | 10:22 |
| *** kmartin has quit IRC | 10:28 | |
| *** yottatsa has joined #openstack-infra | 10:28 | |
| *** sdake has quit IRC | 10:29 | |
| openstackgerrit | yolanda.robla proposed openstack-infra/shade: Add magnum baymodel calls to shade. https://review.openstack.org/308009 | 10:40 |
| openstackgerrit | Carlos Camacho proposed openstack-infra/tripleo-ci: Fix validation for stable branch https://review.openstack.org/312350 | 10:40 |
| *** thorst has joined #openstack-infra | 10:41 | |
| *** deadnull_ has joined #openstack-infra | 10:42 | |
| *** abregman|afk is now known as abregman | 10:44 | |
| openstackgerrit | amrith proposed openstack-infra/infra-manual: Update section on Gerrit permissions for shared permissions https://review.openstack.org/312893 | 10:45 |
| *** roxanaghe has joined #openstack-infra | 10:46 | |
| *** yamamoto has joined #openstack-infra | 10:46 | |
| openstackgerrit | amrith proposed openstack-infra/project-config: Adding new repository trove-image-builder https://review.openstack.org/312805 | 10:46 |
| *** asettle has joined #openstack-infra | 10:46 | |
| openstackgerrit | amrith proposed openstack-infra/infra-manual: Update section on Gerrit permissions for shared permissions https://review.openstack.org/312893 | 10:48 |
| *** nadya has quit IRC | 10:48 | |
| *** thorst has quit IRC | 10:50 | |
| openstackgerrit | Sergey Kraynev proposed openstack-infra/project-config: Add ci-cd-pipeline-app-murano project to openstack https://review.openstack.org/309383 | 10:50 |
| *** roxanaghe has quit IRC | 10:50 | |
| *** e0ne has joined #openstack-infra | 10:51 | |
| *** javeriak has quit IRC | 10:51 | |
| *** asettle has quit IRC | 10:51 | |
| *** yamamoto has quit IRC | 10:52 | |
| *** amitgandhinz has joined #openstack-infra | 10:54 | |
| openstackgerrit | Sylwester Brzeczkowski proposed openstack-infra/project-config: Add fuel-extension-volume-manager project https://review.openstack.org/312487 | 10:56 |
| *** kushal has quit IRC | 10:57 | |
| *** yamamoto has joined #openstack-infra | 10:58 | |
| *** amitgandhinz has quit IRC | 10:59 | |
| *** javeriak has joined #openstack-infra | 11:04 | |
| *** links has joined #openstack-infra | 11:05 | |
| *** yamamoto has quit IRC | 11:10 | |
| *** yamamoto has joined #openstack-infra | 11:10 | |
| *** yamamoto has quit IRC | 11:11 | |
| *** yamamoto has joined #openstack-infra | 11:12 | |
| *** amrith is now known as _amrith_ | 11:12 | |
| *** yamamoto has quit IRC | 11:13 | |
| *** yamamoto has joined #openstack-infra | 11:13 | |
| *** hamzy has quit IRC | 11:13 | |
| *** yamamoto has quit IRC | 11:15 | |
| *** yamamoto has joined #openstack-infra | 11:16 | |
| *** nadya has joined #openstack-infra | 11:18 | |
| *** gildub has joined #openstack-infra | 11:20 | |
| *** rhallisey has joined #openstack-infra | 11:22 | |
| *** nadya has quit IRC | 11:23 | |
| *** ddieterly has joined #openstack-infra | 11:25 | |
| openstackgerrit | Sergey Kraynev proposed openstack-infra/project-config: Add ci-cd-pipeline-app-murano project to openstack https://review.openstack.org/309383 | 11:25 |
| *** ldnunes has joined #openstack-infra | 11:31 | |
| *** yottatsa has quit IRC | 11:32 | |
| *** yolanda has quit IRC | 11:32 | |
| *** yottatsa has joined #openstack-infra | 11:37 | |
| *** yolanda has joined #openstack-infra | 11:38 | |
| *** thorst has joined #openstack-infra | 11:40 | |
| *** rossella_s has quit IRC | 11:40 | |
| *** brucet has quit IRC | 11:41 | |
| *** rossella_s has joined #openstack-infra | 11:41 | |
| openstackgerrit | Sergey Kraynev proposed openstack-infra/project-config: Add ci-cd-pipeline-app-murano project to openstack https://review.openstack.org/309383 | 11:42 |
| *** eantyshev has joined #openstack-infra | 11:43 | |
| *** yottatsa has quit IRC | 11:44 | |
| *** kushal has joined #openstack-infra | 11:45 | |
| *** yamamoto has quit IRC | 11:45 | |
| *** yamamoto has joined #openstack-infra | 11:46 | |
| *** yamamoto has quit IRC | 11:46 | |
| *** rfolco has joined #openstack-infra | 11:46 | |
| *** baoli has joined #openstack-infra | 11:46 | |
| *** yamamoto has joined #openstack-infra | 11:46 | |
| *** hamzy has joined #openstack-infra | 11:47 | |
| *** Goneri has quit IRC | 11:47 | |
| *** baoli_ has joined #openstack-infra | 11:47 | |
| *** kushal has quit IRC | 11:50 | |
| *** baoli has quit IRC | 11:51 | |
| openstackgerrit | Sergey Kraynev proposed openstack-infra/project-config: Add ci-cd-pipeline-app-murano project to openstack https://review.openstack.org/309383 | 11:52 |
| *** weshay has joined #openstack-infra | 11:53 | |
| *** someara2 has joined #openstack-infra | 11:53 | |
| *** links has quit IRC | 11:53 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/system-config: Add ubuntu-precise logging to nodepool-builder https://review.openstack.org/312908 | 11:54 |
| pabelanger | morning | 11:55 |
| *** yottatsa has joined #openstack-infra | 11:55 | |
| *** amitgandhinz has joined #openstack-infra | 11:55 | |
| *** tpsilva has joined #openstack-infra | 11:55 | |
| *** timl0101 has joined #openstack-infra | 11:56 | |
| pabelanger | wouldn't mine a +A on the stack above ^ to fix up our nodepool-builder logging configuration | 11:56 |
| *** gordc has joined #openstack-infra | 11:56 | |
| *** someara2_ has joined #openstack-infra | 11:57 | |
| *** yamamoto has quit IRC | 11:58 | |
| *** nadya has joined #openstack-infra | 11:58 | |
| *** yamamoto has joined #openstack-infra | 12:00 | |
| *** amitgandhinz has quit IRC | 12:00 | |
| *** someara2 has quit IRC | 12:01 | |
| *** ddieterly is now known as ddieterly[away] | 12:02 | |
| *** ekarlso has quit IRC | 12:06 | |
| *** ekarlso has joined #openstack-infra | 12:06 | |
| *** brucet has joined #openstack-infra | 12:07 | |
| *** |-paul-| has joined #openstack-infra | 12:11 | |
| *** psilvad has joined #openstack-infra | 12:13 | |
| *** aysyd has joined #openstack-infra | 12:13 | |
| *** binbincong has quit IRC | 12:13 | |
| *** zhurong has joined #openstack-infra | 12:13 | |
| *** ccamacho is now known as ccamacho|lunch | 12:13 | |
| *** dprince has joined #openstack-infra | 12:15 | |
| *** rodrigods has quit IRC | 12:17 | |
| *** rodrigods has joined #openstack-infra | 12:18 | |
| *** psilvad has quit IRC | 12:18 | |
| *** brucet has quit IRC | 12:19 | |
| *** krtaylor has quit IRC | 12:20 | |
| *** pradk has joined #openstack-infra | 12:23 | |
| *** ddieterly[away] is now known as ddieterly | 12:26 | |
| *** psilvad has joined #openstack-infra | 12:26 | |
| *** binbincong has joined #openstack-infra | 12:30 | |
| *** ddieterly is now known as ddieterly[away] | 12:30 | |
| *** javeriak has quit IRC | 12:31 | |
| *** kjorgensen has joined #openstack-infra | 12:31 | |
| rcarrillocruz | pabelanger: if you get a chance, i'd love to get some other core reviews on my cloud launcher changes | 12:33 |
| *** burgerk has joined #openstack-infra | 12:33 | |
| *** kdas_ has joined #openstack-infra | 12:33 | |
| rcarrillocruz | so we can start playing with it to upgrade services to trusty from precise | 12:33 |
| pabelanger | rcarrillocruz: sure, I'll try and look later this morning | 12:33 |
| rcarrillocruz | ++ | 12:33 |
| *** someara2_ has left #openstack-infra | 12:33 | |
| *** roxanaghe has joined #openstack-infra | 12:34 | |
| openstackgerrit | Merged openstack-infra/storyboard-webclient: Removed grunt test-unit in favor of just running karma https://review.openstack.org/304555 | 12:35 |
| openstackgerrit | Sylwester Brzeczkowski proposed openstack-infra/project-config: Add fuel-extension-volume-manager project https://review.openstack.org/312487 | 12:35 |
| *** kjorgensen has quit IRC | 12:36 | |
| *** ddieterly[away] is now known as ddieterly | 12:37 | |
| openstackgerrit | Lukas Bednar proposed openstack-infra/jenkins-job-builder: Fix typo in doc of workspace-cleaner wrapper https://review.openstack.org/312926 | 12:38 |
| *** roxanaghe has quit IRC | 12:38 | |
| *** yolanda has quit IRC | 12:38 | |
| *** kdas_ is now known as kushal | 12:40 | |
| *** kushal has quit IRC | 12:40 | |
| *** kushal has joined #openstack-infra | 12:40 | |
| openstackgerrit | Merged openstack-infra/storyboard-webclient: Updated README https://review.openstack.org/304556 | 12:42 |
| *** |-paul-| has quit IRC | 12:43 | |
| *** yolanda has joined #openstack-infra | 12:44 | |
| *** yamamoto has quit IRC | 12:44 | |
| *** yamamoto has joined #openstack-infra | 12:44 | |
| *** yamamoto has quit IRC | 12:44 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/tripleo-ci: [WIP] Initial support for centos-7 jenkins slave https://review.openstack.org/312725 | 12:45 |
| *** yamamoto has joined #openstack-infra | 12:45 | |
| *** jcoufal has joined #openstack-infra | 12:46 | |
| *** ddieterly has quit IRC | 12:46 | |
| openstackgerrit | Derek Higgins proposed openstack-infra/tripleo-ci: Use the overcloud full images from the cache https://review.openstack.org/312397 | 12:46 |
| *** dizquierdo has quit IRC | 12:47 | |
| *** ddieterly has joined #openstack-infra | 12:48 | |
| *** vhosakot has joined #openstack-infra | 12:49 | |
| *** kgiusti has joined #openstack-infra | 12:49 | |
| *** ddieterly has quit IRC | 12:49 | |
| *** banix has joined #openstack-infra | 12:50 | |
| *** bapalm has joined #openstack-infra | 12:54 | |
| *** penguinolog has quit IRC | 12:56 | |
| *** jheroux has joined #openstack-infra | 12:58 | |
| *** xyang1 has joined #openstack-infra | 12:58 | |
| *** trown|outtypewww is now known as trown | 12:58 | |
| *** yolanda has quit IRC | 13:00 | |
| *** tosky_ has joined #openstack-infra | 13:00 | |
| *** tonytan4ever has joined #openstack-infra | 13:01 | |
| *** penguinolog has joined #openstack-infra | 13:01 | |
| *** kushal has quit IRC | 13:02 | |
| *** |-paul-| has joined #openstack-infra | 13:02 | |
| *** amitgandhinz has joined #openstack-infra | 13:03 | |
| *** _amrith_ is now known as amrith | 13:03 | |
| *** tosky has quit IRC | 13:03 | |
| *** yamamoto has quit IRC | 13:03 | |
| *** eharney has joined #openstack-infra | 13:04 | |
| *** piet has joined #openstack-infra | 13:05 | |
| *** tlian has joined #openstack-infra | 13:05 | |
| *** yolanda has joined #openstack-infra | 13:05 | |
| *** Hal has joined #openstack-infra | 13:07 | |
| *** Hal is now known as Guest27987 | 13:07 | |
| *** tonytan4ever has quit IRC | 13:08 | |
| *** sshnaidm_ is now known as sshnaidm | 13:08 | |
| *** esikachev has quit IRC | 13:08 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/tripleo-ci: [WIP] Initial support for centos-7 jenkins slave https://review.openstack.org/312725 | 13:09 |
| *** psilvad has quit IRC | 13:12 | |
| *** Goneri has joined #openstack-infra | 13:13 | |
| *** asettle has joined #openstack-infra | 13:13 | |
| openstackgerrit | yolanda.robla proposed openstack-infra/project-config: Integrate shade+magnum neutron job https://review.openstack.org/312940 | 13:15 |
| *** skraynev has quit IRC | 13:15 | |
| *** tonytan4ever has joined #openstack-infra | 13:15 | |
| yolanda | hi pabelanger, care reviewing https://review.openstack.org/312630 ? | 13:16 |
| openstackgerrit | Merged openstack-infra/tripleo-ci: Tempest for tripleo CI https://review.openstack.org/295844 | 13:17 |
| *** abregman has quit IRC | 13:17 | |
| *** esker has joined #openstack-infra | 13:17 | |
| *** abregman has joined #openstack-infra | 13:17 | |
| pabelanger | yolanda: +A | 13:18 |
| *** jsavak has joined #openstack-infra | 13:18 | |
| *** yamahata has joined #openstack-infra | 13:19 | |
| *** psilvad has joined #openstack-infra | 13:19 | |
| yolanda | thanks, willing to have pypi mirrors available again | 13:19 |
| *** esikachev has joined #openstack-infra | 13:20 | |
| *** ccamacho|lunch is now known as ccamacho | 13:21 | |
| *** ddieterly has joined #openstack-infra | 13:22 | |
| openstackgerrit | Merged openstack-infra/system-config: Start using read/write AFS volume for PyPI mirror https://review.openstack.org/312630 | 13:23 |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: Run tempest tests with periodic jobs https://review.openstack.org/297038 | 13:26 |
| *** gildub has quit IRC | 13:26 | |
| *** tlian2 has joined #openstack-infra | 13:27 | |
| *** tlian has quit IRC | 13:27 | |
| *** esker has quit IRC | 13:27 | |
| *** zz_dimtruck is now known as dimtruck | 13:28 | |
| *** timl0101 has quit IRC | 13:28 | |
| *** esker has joined #openstack-infra | 13:28 | |
| *** oanson has quit IRC | 13:28 | |
| *** matt-borland has joined #openstack-infra | 13:29 | |
| *** piet has quit IRC | 13:30 | |
| *** yamahata has quit IRC | 13:30 | |
| *** krtaylor has joined #openstack-infra | 13:30 | |
| *** yamahata has joined #openstack-infra | 13:30 | |
| *** mriedem has joined #openstack-infra | 13:31 | |
| *** akshai has joined #openstack-infra | 13:31 | |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: use 24hours everywhere in grafana/neutron.yaml https://review.openstack.org/312950 | 13:33 |
| bswartz | is there a plan to phase out jenkins? | 13:33 |
| AJaeger | gsagie: there's no short-cut. But what do you mean with sub repositories? | 13:34 |
| AJaeger | gsagie: what exactly do you want to do | 13:35 |
| pabelanger | bswartz: yes, we have an effort with zuulv2.5 to migrate from jenkins to zuul-launcher (ansible) | 13:35 |
| *** daemontool_ has joined #openstack-infra | 13:35 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/tripleo-ci: [WIP] Initial support for centos-7 jenkins slave https://review.openstack.org/312725 | 13:35 |
| bswartz | pabelanger: okay thanks -- so I take it that it's a homegrown project that leverages ansible to do more or less what jenkins currently does? | 13:36 |
| *** |-paul-| has quit IRC | 13:36 | |
| *** daemontool has quit IRC | 13:37 | |
| pabelanger | bswartz: Yup, here is our current topic on it. https://review.openstack.org/#/q/topic:v25 | 13:37 |
| bswartz | cool | 13:37 |
| AJaeger | bswartz: to do what we need from Jenkins in OpenStack CI | 13:37 |
| AJaeger | bswartz: we do not need the full feature set of Jenkins, so replacing it is easier | 13:38 |
| pabelanger | bswartz: for the most part, we are using ansible-playbook to drive the nodes. However jeblair has also written some ansible modules to add some new functionality. | 13:38 |
| AJaeger | pabelanger: could you review https://review.openstack.org/#/c/312660/ and https://review.openstack.org/#/c/312731/ , please? | 13:38 |
| openstackgerrit | Carlos Camacho proposed openstack-infra/tripleo-ci: Fix validation for stable branch https://review.openstack.org/312350 | 13:39 |
| pabelanger | AJaeger: +A | 13:40 |
| *** mtanino has joined #openstack-infra | 13:41 | |
| *** inc0 has joined #openstack-infra | 13:41 | |
| AJaeger | thanks, pabelanger | 13:41 |
| *** skraynev has joined #openstack-infra | 13:41 | |
| *** kushal has joined #openstack-infra | 13:42 | |
| AJaeger | team : I'd like to publish source translation files to tarballs.openstack.org/translation-source/PROJECT/BRANCH - see https://review.openstack.org/#/c/309560 . Is that a good place to put them? | 13:43 |
| *** sigmavirus24_awa is now known as sigmavirus24 | 13:45 | |
| openstackgerrit | Merged openstack-infra/project-config: openstack-manuals has stable branch. https://review.openstack.org/312660 | 13:45 |
| *** ddieterly is now known as ddieterly[away] | 13:45 | |
| pabelanger | I'm happy to say our ubuntu-precise dib build successfully last night: http://nodepool.openstack.org/image.log | 13:46 |
| pabelanger | We'll do uploads today with nodepool | 13:47 |
| AJaeger | woot! | 13:47 |
| pabelanger | then add experimental jobs to replace bare-precise | 13:47 |
| pabelanger | test | 13:47 |
| pabelanger | and cut over! | 13:47 |
| *** openstackgerrit has quit IRC | 13:47 | |
| *** openstackgerrit has joined #openstack-infra | 13:48 | |
| *** dimtruck is now known as zz_dimtruck | 13:51 | |
| *** vhosakot has quit IRC | 13:51 | |
| yolanda | pabelanger, congrats | 13:52 |
| openstackgerrit | Merged openstack-infra/project-config: Zuul: Create api-ref-jobs and api-guide-jobs templates https://review.openstack.org/312731 | 13:52 |
| ogelbukh | hi, does anyone experience spontaneous log offs from Gerrit, every hour and a half or so? | 13:52 |
| *** ddieterly[away] is now known as ddieterly | 13:52 | |
| ogelbukh | I mean Gerrit webui at review.openstack.org | 13:53 |
| sylwesterB | folks, why does it happen? http://logs.openstack.org/87/312487/4/check/gate-project-config-layout/2960ccf/console.html#_2016-05-05_12_45_18_547 | 13:53 |
| sylwesterB | i'm trying to create a project https://review.openstack.org/#/c/312487/ | 13:54 |
| *** asettle has quit IRC | 13:57 | |
| *** esikachev has quit IRC | 13:58 | |
| pabelanger | Just had a request from wfoster to update the DNS records for x86.trystack.org. | 14:00 |
| pabelanger | As a heads up, I'll be making the change to the DNS now | 14:00 |
| pabelanger | x86.trystack.org from 128.136.179.2 to be 8.43.86.2 | 14:00 |
| *** deadnull_ has quit IRC | 14:01 | |
| pabelanger | wfoster: change as been made | 14:01 |
| pabelanger | #status log updated x86.trystack.org dns records from 128.136.179.2 to be 8.43.86.2 | 14:01 |
| *** yamamoto has joined #openstack-infra | 14:03 | |
| *** armax has joined #openstack-infra | 14:03 | |
| *** mhickey has joined #openstack-infra | 14:04 | |
| openstackgerrit | greghaynes proposed openstack/diskimage-builder: Add install-bin element https://review.openstack.org/311646 | 14:05 |
| dmsimard | Could anyone restart the openstack bot if there are no ongoing meetings ? It hasn't come back to #rdo after yesterday's incident. I would've rather waited until it restarted by itself but it hasn't happened yet apparently. | 14:07 |
| *** links has joined #openstack-infra | 14:07 | |
| *** armax has quit IRC | 14:08 | |
| *** dmanchad has joined #openstack-infra | 14:09 | |
| openstackgerrit | yolanda.robla proposed openstack-infra/shade: WIP: Add magnum baymodel calls to shade. https://review.openstack.org/308009 | 14:09 |
| *** burgerk has quit IRC | 14:12 | |
| *** mixos has joined #openstack-infra | 14:13 | |
| *** zz_dimtruck is now known as dimtruck | 14:13 | |
| *** yamamoto has quit IRC | 14:13 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/tripleo-ci: [WIP] Initial support for centos-7 jenkins slave https://review.openstack.org/312725 | 14:15 |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/system-config: Refresh log files for tripleo project https://review.openstack.org/312985 | 14:16 |
| *** xarses has quit IRC | 14:16 | |
| *** thiagop has joined #openstack-infra | 14:16 | |
| *** links has quit IRC | 14:16 | |
| openstackgerrit | greghaynes proposed openstack/diskimage-builder: Add tinycorelinux element https://review.openstack.org/311647 | 14:16 |
| openstackgerrit | Emilien Macchi proposed openstack-infra/project-config: retire puppet-unit-{node} jobs https://review.openstack.org/312987 | 14:16 |
| openstackgerrit | Jay Dobies proposed openstack-infra/project-config: Add api-ref jobs for Heat https://review.openstack.org/312726 | 14:17 |
| openstackgerrit | greghaynes proposed openstack/diskimage-builder: Add tinycorelinux element https://review.openstack.org/311647 | 14:17 |
| *** mixos has quit IRC | 14:18 | |
| amrith | hello infra, g'morning. am looking for some reviews of https://review.openstack.org/312805, and https://review.openstack.org/312806 to make a new repository for trove-image-builder and https://review.openstack.org/312893 to upgrade infra-manual on a comment that Craig Bryant had on the first review. | 14:20 |
| amrith | I'm at the point in the documentation where it now says "Wait here" (http://docs.openstack.org/infra/manual/creators.html#wait-here) | 14:21 |
| amrith | thanks ... | 14:21 |
| *** sdague has quit IRC | 14:21 | |
| *** sdague has joined #openstack-infra | 14:22 | |
| *** rbrndt has joined #openstack-infra | 14:22 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/project-config: Use m1.large for centos-7 on tripleo-test-cloud-rh1 https://review.openstack.org/312992 | 14:22 |
| *** tosky_ has quit IRC | 14:22 | |
| *** tosky_ has joined #openstack-infra | 14:23 | |
| *** Na3iL has joined #openstack-infra | 14:23 | |
| *** jaypipes has joined #openstack-infra | 14:25 | |
| *** rm_work has quit IRC | 14:27 | |
| *** krotscheck has quit IRC | 14:27 | |
| *** vkramskikh has quit IRC | 14:27 | |
| *** anteaya has joined #openstack-infra | 14:28 | |
| *** mjb has quit IRC | 14:28 | |
| *** jistr has quit IRC | 14:29 | |
| *** StevenK has quit IRC | 14:29 | |
| openstackgerrit | greghaynes proposed openstack/diskimage-builder: Split pip out of pip-and-virtualenv https://review.openstack.org/311651 | 14:30 |
| *** zhurong has quit IRC | 14:32 | |
| AJaeger | sylwesterB: you need to define the jobs you want to run in jenkins/jobs/ first. Did you read the Infra Manual's Creator's Guide? | 14:32 |
| *** krotscheck has joined #openstack-infra | 14:33 | |
| pabelanger | amrith: Is trove-image-builder going to replace diskimage-builder? Or you'll be adding elements for diskimage-builder into the repo | 14:33 |
| *** esikachev has joined #openstack-infra | 14:34 | |
| openstackgerrit | Lucas Alvares Gomes proposed openstack/requirements: Add python-daemon to global-requirements https://review.openstack.org/313004 | 14:34 |
| amrith | pabelanger, trove-image-builder will contain tools for building images | 14:34 |
| *** xarses has joined #openstack-infra | 14:34 | |
| amrith | based initially at least on the existing DIB elements we already have | 14:34 |
| amrith | there's a conversation on the ML on the longer term direction | 14:35 |
| * amrith runs to get a link | 14:35 | |
| *** doug-fish has joined #openstack-infra | 14:35 | |
| sylwesterB | AJaeger: I just used a template, isn't that enough? | 14:35 |
| amrith | pabelanger, see http://markmail.org/message/6zgvhkswxyfle77w | 14:35 |
| *** mjb has joined #openstack-infra | 14:35 | |
| sylwesterB | AJaeger: or I use it in a wrong way? | 14:36 |
| fungi | amrith: pabelanger: my read was that it was going to start primarily as the dib elements from the trove-integration repo split out into the new repo | 14:36 |
| mordred | amrith: so, repos are forever ... is there really anything you'd need in a trove-image-builder repo that couldn't go directly into dib? | 14:36 |
| AJaeger | sylwesterB: I haven't seen your change: But templates in zuul are just syntactic sugar. zuul triggers when to run a job, jenkins defines how the job looks like. You still need to declare them | 14:36 |
| mordred | trove-image-elements seems like a potentially better name - trove-image-builder sounds like a fork of or competitor to dib - at least to me | 14:37 |
| fungi | is the contention over the name? like would calling it trove-image-elements help? | 14:37 |
| *** piet has joined #openstack-infra | 14:37 | |
| *** jkraj has joined #openstack-infra | 14:37 | |
| pabelanger | fungi: amrith: Ah, okay. Looking at the repo name, I assume it was a replacement to diskimage-builder | 14:37 |
| mordred | I'm mostly just chatting and trying to understand | 14:37 |
| mordred | I'm not sure I'm at the point of contention yet :) | 14:37 |
| fungi | heh, we arrived at the same name | 14:38 |
| amrith | mordred, reading scrollback, one second | 14:38 |
| * amrith thinks about the question | 14:38 | |
| fungi | contention was probably the wrong word. more like confusion i guess | 14:38 |
| sylwesterB | AJaeger: i thought it is already defined as template like 'gate-{name}-python27-db', then I just need to put the project name in {name} and it should work... Am I wrong? | 14:39 |
| AJaeger | sylwesterB: see http://docs.openstack.org/infra/manual/creators.html on how to define jobs | 14:39 |
| amrith | so let me answer fungi pabelanger and mordred this way. the one thing that won't be a dib in the short term is a shell script that would build images | 14:39 |
| amrith | based on some trove specific command lines | 14:39 |
| AJaeger | sylwesterB: you're wrong. You need to instantiate a templae in jenkins first | 14:39 |
| amrith | like, for example <hypothetical> | 14:39 |
| amrith | trove-image-create mysql 5.6 | 14:39 |
| amrith | something along the lines of the wrapper that clark posted in the ML discussion | 14:40 |
| fungi | amrith: yep, we have a similar wrapper script for hand-generation of our nodepool images too | 14:40 |
| openstackgerrit | Ivan Kolodyazhny proposed openstack/requirements: Add watchdog to global-requirements https://review.openstack.org/311173 | 14:40 |
| amrith | in addition to that there's the fact that I want the things in the tool | 14:40 |
| *** oanson has joined #openstack-infra | 14:40 | |
| amrith | to be versioned (i.e. with trove releases) | 14:40 |
| amrith | and managed with stable and things like that | 14:40 |
| *** hdaniel has quit IRC | 14:40 | |
| *** MarkAtwood has joined #openstack-infra | 14:41 | |
| fungi | a script which wraps dib doesn't seem out of place in a repo of dib elements associated with that goal, but i'm going to carefully step back from the naming bikeshed precipice i accidentally strolled up to | 14:41 |
| amrith | there's also the issue of reviews on the elements | 14:41 |
| sylwesterB | AJaeger: http://docs.openstack.org/infra/manual/creators.html#add-translation-server-support - isn't that outdated? None of the already defined projects have 'jobs' section | 14:41 |
| amrith | and I don't think that putting them in dib directly is the best approach at that | 14:41 |
| mordred | k. that makes sense - although I think it does speak to a deficiency with dib that we should fix and I worry that by making a whole repo for it we'll be insulating ourselves from the need to fix the fundamental issue | 14:41 |
| amrith | since (to the best that I can understand) dib doesn't release along with openstack release. | 14:41 |
| mordred | which is the trove and infra both feel the need to write wrapper scripts | 14:41 |
| EmilienM | hi, can we have a final approval on https://review.openstack.org/#/c/301375/ please? maybe PTL needs to approve it | 14:41 |
| amrith | mordred, that's a good point | 14:42 |
| fungi | amrith: i think the question was not about putting trove elements in dib, but rather whether pieces of dib you're (almost certainly not) reimplementing would be better implemented in dib directly | 14:42 |
| mordred | but that's not a hill to die on - just a concern | 14:42 |
| *** DevBox has joined #openstack-infra | 14:42 | |
| amrith | fungi, to be clear, I intend to reinvent 0.00% of dib | 14:42 |
| mordred | otoh - I think we all agree that it's a thing we want to fix | 14:42 |
| fungi | amrith: right, that was my takeaway from the ml thread too | 14:42 |
| greghaynes | amrith: mordred Agreed re: there is probably a deficiency in dib - I don't have any great ideas for fixing that one though :( | 14:42 |
| mordred | ++ | 14:42 |
| amrith | I will be using elements from triple-o and the dib tool as far as I can | 14:43 |
| fungi | just trying to clarify for people who maybe didn't follow the thread closely | 14:43 |
| mordred | greghaynes: I have some thoughts ... | 14:43 |
| sylwesterB | AJaeger: nvm i think i got it, thanks! | 14:43 |
| amrith | literally all I am doing here is taking elements which are in an obscure trove-integration directory and making them a project unto themselves | 14:43 |
| pabelanger | I'm happy to try trove dibs :) I've been using diskimage-builder a lot lately | 14:43 |
| tosky_ | mordred, fungi, greghaynes, amrith: the discussion about the tooling is ortogonal to the repository creation, which would be at least like sahara-image-elements (and I don't see why calling it -builder would lead to confusion about its scope) | 14:44 |
| greghaynes | About things living in DIB vs another repo - I think code which is specific to trove should live in a trove repo. In the past we had a not-great time with ironic-specific code in dib which meant that dib cores had to review code that only ironic folks really understood | 14:44 |
| amrith | one thing to do is of course to put the image builder into trove itself. we thought about that a lot and decided not to go that route for a couple of specific reasons. | 14:44 |
| mordred | greghaynes: I think we should learn a bit from docker ui - and have dib be able to understand "disk-image-create trove/mysql-5.6" | 14:44 |
| fungi | amrith: i think we're all in favor of the plan, some were just confused by the choice of repo name. ultimately i try not to bikeshed on naming things as my time is better spent elsewhere, so i don't care much what you name it | 14:44 |
| mordred | fungi: ++ | 14:44 |
| amrith | fungi, let me explain the name | 14:44 |
| mordred | yah - it was just a quick check-in on the name | 14:44 |
| amrith | I wanted to call it trove-image-elements | 14:44 |
| mordred | I dont' think it's actually a big problem | 14:44 |
| *** egafford has joined #openstack-infra | 14:44 | |
| amrith | but there were those who felt that 'elements' are wedded to the DIB way of doing things | 14:44 |
| amrith | and therefore wanted a generic name that was not tied to DIB | 14:45 |
| mordred | ah. so - that IS one of my concerns | 14:45 |
| amrith | mine too mordred | 14:45 |
| openstackgerrit | Sylwester Brzeczkowski proposed openstack-infra/project-config: Add fuel-extension-volume-manager project https://review.openstack.org/312487 | 14:45 |
| mordred | because I think the people who want to ditch dib have still not actually expressed deficiencies that cannot be addressed, so the idea of ditching an openstack project for something else rather than fixing it is a thing I think is quite problematic | 14:45 |
| tosky_ | that's an opinion | 14:46 |
| mordred | it is | 14:46 |
| *** tellesnobrega has joined #openstack-infra | 14:46 | |
| amrith | TBH, I see a lot of reasons why people want to use a new tool but not a clear articulation that those reasons are shortcomings of DIB. some are shortcomings of our elements (likely) and I've recorded so far one. | 14:46 |
| mordred | it's my opinion | 14:46 |
| amrith | https://bugs.launchpad.net/trove-image-builder/+bug/1578454 | 14:46 |
| openstack | Launchpad bug 1578454 in Image Builder for OpenStack Trove "reduce the datastore/database matrix in image elements" [Undecided,New] - Assigned to Amrith (amrith) | 14:46 |
| tosky_ | why the name would be a potential threat? | 14:46 |
| *** pmackinn has joined #openstack-infra | 14:46 | |
| mordred | tosky_: well, because of the reason given as to why people don't want to call it trove-image-elements like sahara did | 14:46 |
| mordred | which is that there are people who explicitly want to leave the door open for not dib | 14:47 |
| amrith | mordred, I am happy to rename the project to trove-image-elements if that is the community consensus. I will equally well call it fred if that's what the community decides. | 14:47 |
| *** ramishra has quit IRC | 14:47 | |
| greghaynes | So, one fear I would have is that the *-image-elements is a nice convention, and at this point is pretty clearly indicates what the rpo is (and mayb dib can have smarts to automatically make use of those) | 14:47 |
| tosky_ | mordred: I still don't get why it would be forbidden to leave the door open, and even if the decision would be DIB, why -builder would be a problem | 14:47 |
| AJaeger | sylwesterB: translation support section is accurate and assumes that your repo is gating. Don't add translations for a new repository, do that afterwards once your repo is setup properly... | 14:47 |
| anteaya | lennyb: in http://eavesdrop.openstack.org/irclogs/%23openstack-infra/%23openstack-infra.2016-05-05.log.html#t2016-05-05T06:25:16 you say 'its always on the same commit' what do you mean by that? | 14:47 |
| greghaynes | I am not super concerned about the name though, just a thought | 14:47 |
| *** dizquierdo has joined #openstack-infra | 14:48 | |
| mordred | tosky_: because builder implies another tool, whereas elements implies content and maybe helpers for using an ecosystem we have | 14:48 |
| sylwesterB | AJaeger: yeah, I just wanted to use it as an example, anyway I think got it, thanks for help | 14:48 |
| sylwesterB | ;) | 14:48 |
| tosky_ | mordred: I disagree; I don't like the sahara-image-elements name too, even if it contains DIB, because it contains also a wrapper builder script, and I would prefer sahara-image-builder too | 14:48 |
| tosky_ | even with DIBs | 14:48 |
| mordred | tosky_: I can see that | 14:48 |
| *** dizquierdo has quit IRC | 14:48 | |
| mordred | tosky_: I'm not _strongly_ against the name | 14:48 |
| mordred | mostly just talking out loud | 14:49 |
| *** dizquierdo has joined #openstack-infra | 14:49 | |
| egafford | In my experience, the build env isolation issue in DIB is the biggest source of trouble. Errors due to bleed between the host and guest envs is extremely difficult to diagnose in the field when it comes up. | 14:49 |
| mordred | to make sure we've all thought it through and stuff, since there are clearly a bunch of opinions here | 14:49 |
| egafford | From the thread: "Yep, isolation is definitely something DIB currently gives up in order to provide speed/lower resource usage." | 14:49 |
| mordred | egafford: yah. and I think that's something that can and should be addressed | 14:49 |
| *** ramishra has joined #openstack-infra | 14:49 | |
| greghaynes | I mean, theres an existing tool to address it ;) | 14:49 |
| amrith | egafford, I have heard tell of these issues but I have not (in two years of using DIB) ever faced this problem. | 14:49 |
| greghaynes | but yea, tradeoffs | 14:50 |
| egafford | In a customer-facing tool for a use case that's usually going to be occasional, that's not always the right tradeoff. | 14:50 |
| amrith | I am sure that all tools will have some problems | 14:50 |
| *** sdake has joined #openstack-infra | 14:50 | |
| amrith | and I would like some examples of this bleed issue | 14:50 |
| persia | There are N tools that build images: building new ones seems odd. Is there a list of desired features somewhere? | 14:50 |
| openstackgerrit | yolanda.robla proposed openstack-infra/shade: WIP: Add magnum baymodel calls to shade. https://review.openstack.org/308009 | 14:50 |
| mordred | egafford: right. but virt-dib can solve the problem on the customer level | 14:50 |
| amrith | because there are likely ways to prevent it in DIB | 14:50 |
| amrith | persia, I have not seen one. | 14:51 |
| *** jistr has joined #openstack-infra | 14:51 | |
| mordred | egafford: there are ways to deal with it in envs where it makes sense ... and there are also ways we can make it better for the other envs where things like virt-dib do not make sense | 14:51 |
| egafford | amrith: To my knowledge you've also not directly supported a customer-facing image gen tool, true? | 14:51 |
| tosky_ | amrith: you would write something to prevent them vs having already them prevented | 14:51 |
| egafford | mordred: virt-dib is a cool idea, yeah (and uses libguestfs with an elements-formatted set of input.) | 14:51 |
| amrith | egafford, I have ... people try to use DIB all the time in the field. so FALSE | 14:51 |
| egafford | amrith: Okay, fair enough. | 14:52 |
| persia | Might I suggest that the various groups arguing about image builders collaborate on a feature list? Some features are fundamentally incompatible (e.g. guaranteed reliability + install-time package scripts), but it would allow the various interest groups to usefully agree about tradeoffs to decide the right number of tools to use within OpenStack. | 14:52 |
| amrith | tosky_, no, I'd try and understand the problem. | 14:52 |
| mordred | persia: well, yeah, I think that's exactly what I've been trying to get at - we _have_ a tool. I'd like to see a set of clear requests of it, then work through them to see if there can be a plan to address them. if some of them are unaddressable, then bubbling back to the place the current conversation is sitting would be a great next step | 14:53 |
| *** jlanoux has quit IRC | 14:53 | |
| greghaynes | persia: That would be *amazing* | 14:53 |
| pabelanger | mordred: ++ | 14:53 |
| persia | Right then. Someone open an etherpad and start adding bullet points. | 14:53 |
| persia | Are the other parties with feature needs identified? (I presume not all are in this channel) | 14:54 |
| amrith | persia, there's a ML thread going on ... http://markmail.org/message/qpaccjlw2pgvz3wv | 14:55 |
| tosky_ | persia: there is a disagreement whether the points raised on the trove image building spec are self-explaining or valid enough | 14:55 |
| pabelanger | I also agree build isolation for DIB is an issue too. I've had some problems debugging issues between a centos-7 and ubuntu-trusty build host | 14:55 |
| greghaynes | I think that discussion is going to be use specific though, so probably worth having from the specific group making use of it | 14:55 |
| tosky_ | persia: that's where it started, plus the thread that amrith point out to | 14:55 |
| mordred | pabelanger: ++ | 14:55 |
| tosky_ | persia: which contains feedback from sahara too | 14:55 |
| egafford | pabelanger: ++ (clearly, but you know) | 14:55 |
| mordred | so yeah - I think persia is right - it's probably time to collect the feedback from the mailing list and the trove spec | 14:56 |
| *** DevBox has quit IRC | 14:56 | |
| tosky_ | also, for Trove, we are talking about image customization, more than building (take an existing image, add a package) | 14:56 |
| greghaynes | Ya, and what would be equally amazing is bugs filed! | 14:56 |
| greghaynes | especially in DIB | 14:56 |
| amrith | tosky_, that's news to me. | 14:56 |
| persia | Unfortunately, I wouldn't get to this until 25th May or so, and I don't think that is fast enough, based on the traffic I've seen. | 14:56 |
| mordred | and extract requirements to present to dib - and then set up a time to start working on soutions | 14:56 |
| persia | So I hope someone else can drive this. | 14:56 |
| tosky_ | amrith: it matches my experience | 14:56 |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: Increase timeout and logging for crm_resource https://review.openstack.org/313011 | 14:57 |
| *** psachin has quit IRC | 14:57 | |
| mordred | tosky_: customization and building are essentially the smae thing- the only difference is where you get your initial content | 14:57 |
| egafford | The trouble with prioritizing speed and resource efficiency over reliability is that the flows of this tool, or any image gen tool, will (generally) be exercised seldom, and its outputs used for a long time. | 14:57 |
| mordred | egafford: that's a false assumption | 14:57 |
| nibalizer | good morning | 14:57 |
| anteaya | morning nibalizer | 14:58 |
| mordred | egafford: the tradeoffs are different for different people for sure, but there is not one consistent ansewr to that tradeoff | 14:58 |
| tosky_ | mordred: separating the two helps | 14:58 |
| mordred | tosky_: I disagree | 14:58 |
| egafford | mordred: I respect that may sometimes be false, but it is absolutely the case for the use cases in Sahara and (I believe) in Trove. | 14:58 |
| *** flepied has quit IRC | 14:58 | |
| mordred | tosky_: the majority of the operations performed in either are the same - the only real difference is "are you starting from something like debootstrap, or are you starting from a pre-built image" | 14:59 |
| mordred | after that, you're manipulating content | 14:59 |
| *** ayoung has quit IRC | 14:59 | |
| amrith | egafford, given that elements are written infrequently and used numerous times makes your point somewhat moot. | 14:59 |
| *** derekh has quit IRC | 14:59 | |
| mordred | so - it's very unlikely we're going to solve this right now in the infra channel | 14:59 |
| mordred | I think persia's suggestoin is a good one | 14:59 |
| mordred | which is that we should make sure we've actually collected the concerns and desires in a place | 15:00 |
| amrith | once grooved, elements work well over a very long time ... | 15:00 |
| persia | mordred: There are build systems that start much more basic than that (e.g. raw bootstrapping of the toolchain with multiple cycles into cross and non-cross to avoid "wizard" class bugs) | 15:00 |
| mordred | persia: yup | 15:00 |
| mordred | persia: I have built gcc more times than I care to remember :) | 15:00 |
| amrith | I've built os'es more times than I care to remember ... | 15:01 |
| *** burgerk has joined #openstack-infra | 15:02 | |
| persia | I was thinking of models like Aboriginal or Baserock, but yes, we've all done it manually also | 15:02 |
| mordred | amrith: so glad we're not in the business of doing _that_ anymore :) | 15:02 |
| *** jaosorior has joined #openstack-infra | 15:02 | |
| amrith | I still do for shits and giggles ... | 15:04 |
| pmackinn | amrith, what precisely is being debated here? the name of the repo that we agreed to create? | 15:04 |
| openstackgerrit | Anne Gentle proposed openstack-infra/project-config: Adds API reference publishing jobs for Swift https://review.openstack.org/313015 | 15:04 |
| mordred | pmackinn: we moved on from that into the wider issue | 15:05 |
| amrith | pmackinn, that's where it started. | 15:05 |
| *** esker has quit IRC | 15:05 | |
| mordred | pmackinn: I think we're mostly all enjoying a lovely thursday (friday for tokyo/australia) discussion of image building approaches now | 15:05 |
| openstackgerrit | Paul Belanger proposed openstack-infra/tripleo-ci: [WIP] Initial support for centos-7 jenkins slave https://review.openstack.org/312725 | 15:05 |
| pmackinn | modred, no need for a "wider issue" if the trove project has agreement on a proposal | 15:05 |
| pmackinn | which i thought we had | 15:06 |
| mordred | pmackinn: lack of need has never prevented discussion | 15:06 |
| amrith | pmackinn, I disagree that we had. | 15:06 |
| amrith | that we had an agreement | 15:06 |
| *** jaosorior has quit IRC | 15:06 | |
| mordred | pmackinn: and yet I will agree with amrith that I disagree that an agreement was had, and also I'm going to disagree that this is 100% purely a trove thing, since there are clearly cross-project implications to the particular discussion being had at the moment | 15:07 |
| persia | pmackinn: This has come up several times in the past: rather than just pragmatically solving the immediate need, it would be better to understand the problem, so as to prevent future uncertainty and disagreement. | 15:07 |
| mordred | persia: ++ | 15:07 |
| *** ewilson has joined #openstack-infra | 15:07 | |
| * persia has personally created at least 5 tools to generate images and considers this a low number for people working in this space | 15:07 | |
| tosky_ | persia: I can say that no one is trying to solve an immediate need just for the sake of it | 15:08 |
| pmackinn | modred, persia: os governance recognizes that there are different toolchains useful for building images | 15:08 |
| pmackinn | DIB is not mandated afaik | 15:08 |
| mordred | that is true | 15:09 |
| mordred | however, it is a thing that exists | 15:09 |
| mordred | and I believe the current request is "could we try to fix the thing openstack made before we try to replace it" | 15:09 |
| mordred | I dont thin kthat's an unreasonable request to be made | 15:09 |
| mordred | it's the sort of thing that we should aspire to as a commmunity of people working on a common problem space | 15:10 |
| pmackinn | nothing is being replaced; an upstream automated trove image build tool doesn't exist today | 15:10 |
| amrith | and beyond that, if there are more than one tool, I think it is reasonable to consider the software engineering cost of that choice should also be weighed. | 15:10 |
| greghaynes | Its also entirely possible this isnt an either-or discussion, but a 'maybe in some cases we need to integrate our tool with another.', but for some reason this problem is repeatedly framed that way | 15:10 |
| persia | amrith: ++ | 15:10 |
| mordred | amrith: ++ | 15:10 |
| mordred | greghaynes: ++ | 15:10 |
| pmackinn | software engineering cost of a non-existent tool? help me please | 15:11 |
| pabelanger | greghaynes: agree | 15:11 |
| amrith | It would lead to a false choice for an end user if we land in a situation where the user has to use tool A for one db's images and tool B for another db's images. | 15:11 |
| rhallisey | how can I add the kolla-core group as a subgroup of kolla-kubernetes-core ? | 15:11 |
| mordred | persia: right. but upstream automated image build tool does - so for trove to desire to solve that problem differently than the current solution implies a community cost, and to do so without trying to fix the existing tool is weird | 15:11 |
| mordred | gah | 15:11 |
| egafford | greghaynes: ++ ; I don't think this needs to be overwhelmingly all-or-nothing. | 15:11 |
| mordred | pmackinn: ^^ | 15:11 |
| tosky_ | greghaynes: it is, and I think this is the case (where mordred disagrees), for the way a Trove image is "built" | 15:12 |
| persia | Rather than expressing this in terms of fixing d-i-b, I think it would be constructive to understand the feature needs. It may be that something other than d-i-b is a better basis for a tool that solves all the problems we have. I doubt that, but avoiding the prejudgement allows us to understand the problem more clearly. | 15:13 |
| clarkb | rhallisey: in th group member page there is a section fot adding a group as a mber. add the kolla-core group there | 15:13 |
| *** r-mibu has quit IRC | 15:13 | |
| amrith | persia ++ | 15:13 |
| *** r-mibu has joined #openstack-infra | 15:13 | |
| yolanda | mordred, our pypi mirrors look better with your patch | 15:13 |
| greghaynes | tosky_: The issue is that its entirely possible the existing tool can be made to fix the deficiencies (possibly by integration), and so we should make sure to know what problems we are trying to solve, whether we can, then decide whether we need to rewrite/replace. | 15:13 |
| fungi | as a similar example, we have lots of problems using trove (e.g., things like lack of cross-provider replication), but i'd much rather bring those feature requests to trove and help them add those (if they're interested in them at least), before we go off and invent a separate dbaas that meets our specific needs | 15:14 |
| amrith | I would like to know what problems we have with the current DIB solution so we can fix that. either in DIB, or the existing elements, ... | 15:14 |
| pmackinn | sorry but why is "fix DIB first" the leading supposition? | 15:14 |
| *** vhosakot has joined #openstack-infra | 15:14 | |
| pmackinn | amrith, which elements? | 15:14 |
| amrith | fungi, would love to know what this issue with replication is (later) | 15:14 |
| persia | pmackinn: Indeed: it shouldn't be. | 15:14 |
| fungi | pmackinn: work within the community is the leading supposition, rather than leave the community and do things on your own | 15:14 |
| mordred | yes | 15:14 |
| mordred | that | 15:15 |
| persia | yes | 15:15 |
| rhallisey | clarkb, is that via launchpad? | 15:15 |
| amrith | pmackinn, like the issue you raised yesterday with the os/datastore matrix; that's a choice. maybe a bad one, but we may be able to fix it in the existing elements. we do have elements ... | 15:15 |
| mordred | fixing the exisitng tool rather than replacing it is my personal preference | 15:15 |
| clarkb | rhallisey: no in gerrit | 15:15 |
| *** pleia2 has joined #openstack-infra | 15:15 | |
| mordred | but what persia said is right now | 15:15 |
| mordred | but what persia said is right on | 15:15 |
| mordred | we should outline the needs first | 15:15 |
| pabelanger | because I don't know, where is the current process to build trove images today? Is there any logs around? | 15:15 |
| clarkb | rhallisey: launchpad isnt used for group management | 15:15 |
| mordred | before we talk about fixing or replacing | 15:15 |
| rhallisey | clarkb, cool thanks | 15:15 |
| openstackgerrit | amrith proposed openstack-infra/infra-manual: Update section on Gerrit permissions for shared permissions https://review.openstack.org/312893 | 15:16 |
| tosky_ | mordred: would this prevent even a proof-of-concept to show the alternative idea? | 15:16 |
| nibalizer | rhallisey: https://review.openstack.org/#/admin/groups/460,members | 15:16 |
| persia | tosky_: In the absence of comprehended requirements, a PoC has limited utility. That said, if a PoC helps comprehend requirements, it is essential. | 15:16 |
| greghaynes | Nothing prevents making a PoC - generally PoC's arent made as permanent repos though | 15:16 |
| amrith | tosky_, why not describe the problem being fixed? | 15:16 |
| pmackinn | i've already explained that this automation doesn't exist; how did we get to "leave the community"? os governance recognizes virt-builder | 15:17 |
| tosky_ | amrith: I thought it was, and we have a disagrement here | 15:17 |
| *** xarses has quit IRC | 15:17 | |
| rhallisey | clarkb, can you add me to that list so I can add in the kolla team? | 15:17 |
| rhallisey | not sure how the first person gets added | 15:17 |
| fungi | rhallisey: we add the ptl as the initial member on groups for newly-created repos | 15:18 |
| rhallisey | gotcha | 15:18 |
| amrith | tosky_, do point me to that and I promise I'll write them down ... there was one in email yesterday and I've logged it in lp. there's this mention of isolation and bleeding that I don't understand and I'd like to know more about. beyond that, what? (see https://bugs.launchpad.net/trove-image-builder/+bug/1578454) | 15:18 |
| openstack | Launchpad bug 1578454 in Image Builder for OpenStack Trove "reduce the datastore/database matrix in image elements" [Undecided,New] - Assigned to Amrith (amrith) | 15:18 |
| fungi | so sdake in this case would then adjust group membership in gerrit once added as the initial member | 15:18 |
| rhallisey | fungi, cool thanks, can you add sdake | 15:18 |
| sdake | fungi wfm | 15:18 |
| fungi | once one of us adds him to it | 15:18 |
| rhallisey | then we'll take it from there | 15:18 |
| fungi | clarkb: were you doing that, or shall i? | 15:19 |
| mordred | tosky_: yah. it does not feel like, from my side, there are a clear set of deficiencies expressed. it's entirely possible I've missed that - so making sure we have a place we can all point to where we can all come to the same understanding of the issues would be fantastic | 15:19 |
| clarkb | fungi: go for it | 15:19 |
| rhallisey | thanks guys! | 15:19 |
| sc68cal | do my eyes decieve me? Does gerrit now highlight RST correctly? | 15:19 |
| mordred | sc68cal: that can't possibly be true | 15:19 |
| fungi | sdake: you are now the initial member of the kolla-kubernetes-core group in gerrit https://review.openstack.org/#/admin/groups/1380,members | 15:19 |
| sc68cal | mordred: https://review.openstack.org/#/c/312199/6/specs/newton/neutron-stadium.rst | 15:20 |
| tosky_ | amrith: isolation and no need for root, are strong points, IMHO; then explicit control instead of environment variables passed around, and the native operating in place too (minimize the changes applied to the image) | 15:20 |
| sdake | fungi thanks | 15:20 |
| pabelanger | pmackinn: we do have some jobs with ironic and magnum publishing dibs in the gate. I'm happy to help with the automation | 15:20 |
| pmackinn | pabelanger, i mean trove | 15:21 |
| mordred | tosky_: the first two I understand. can you expand on what you mean by the last two? | 15:21 |
| greghaynes | It would be *great* to get those written down somewhere so I don't have to keep replying to those issues :) | 15:21 |
| amrith | tosky_, as I've said in the review, not needing root isn't really a problem, using environment variables was a choice for parameterization. | 15:21 |
| amrith | these are things that we can or should fix in the DIB elements | 15:21 |
| amrith | having a partially built image which can be customized is also do'able with DIB | 15:21 |
| amrith | that the existing elements didn't do it doesn't mean that it can't be done | 15:21 |
| *** julim has quit IRC | 15:22 | |
| mordred | ++ | 15:22 |
| amrith | to greghaynes point earlier, customizing images with DIB is absolutely doable | 15:22 |
| amrith | I do it regularly | 15:22 |
| *** docaedo2 has quit IRC | 15:22 | |
| tosky_ | amrith: I personally think is feasible, of course, everything which can be computed can be implemented, but | 15:22 |
| *** aviau has quit IRC | 15:22 | |
| tosky_ | is it going to be an after-thoughts? | 15:22 |
| nibalizer | sc68cal: sorry but I have to read that replacing every instance of 'neutron' with 'pokemon' | 15:22 |
| amrith | tosky_, I don't understand the statement/comment. | 15:22 |
| *** _ody has quit IRC | 15:22 | |
| fungi | it did seem like a good half of the issues raised in that thread were from people who simply didn't know how dib is implemented or what its featureset is | 15:22 |
| nibalizer | and yes it isn't highlighting random 'if' 'and' 'or's any more | 15:22 |
| tosky_ | fungi: and I disagree with that | 15:22 |
| fungi | which could indicate a need for clearer documentation | 15:23 |
| fungi | and a more intuitive interface | 15:23 |
| *** Swami has joined #openstack-infra | 15:23 | |
| pabelanger | pmackinn: right, I'm offering to help learn more about trove and seeing if we can get a minimal DIB going with the current elements that exist today. If the issue is around the automation, count me in | 15:23 |
| *** _ody has joined #openstack-infra | 15:23 | |
| fungi | tosky_: i didn't mean to suggest that _your_ particular issues stemmed from that, but a lot of the dogpiled issues did | 15:23 |
| *** ifarkas has quit IRC | 15:23 | |
| *** med_ has quit IRC | 15:23 | |
| *** kmartin has joined #openstack-infra | 15:23 | |
| clarkb | pabelanger: I thought trove already builds an image daily or something | 15:23 |
| amrith | pabelanger, I'm already about 70% of the way there ... | 15:23 |
| *** tlian2 has quit IRC | 15:23 | |
| tosky_ | fungi: I have the opposite feeling, that the pushback against a proposed alternative (libguestfs in this case) are based on a incomplete knowledge of the tool and related architecture | 15:24 |
| clarkb | the ubuntu mysql image on tarballs | 15:24 |
| amrith | the eisting DIB's are in the trove-integration project | 15:24 |
| clarkb | (using dib via red stack) | 15:24 |
| amrith | in scripts/files/elements | 15:24 |
| *** med_ has joined #openstack-infra | 15:24 | |
| pabelanger | clarkb: I don't know honestly, I'd have to look into it. But putting the offer on the table. | 15:24 |
| amrith | the redstack command invokes dib with a constructed command line | 15:24 |
| pabelanger | amrith: ack | 15:24 |
| amrith | simialr to the infra script | 15:24 |
| amrith | I showed that somewhere in the ML discussion | 15:24 |
| *** julim has joined #openstack-infra | 15:24 | |
| *** med_ is now known as Guest82506 | 15:24 | |
| amrith | anyway, as soon as the infra change lands, I'll start pushing dib stuff up there. | 15:25 |
| pmackinn | which is not a usable general purpose image builder | 15:25 |
| *** aviau has joined #openstack-infra | 15:25 | |
| *** Guest82506 is now known as medberry | 15:25 | |
| fungi | tosky_: so you're saying you think a libguestfs content generator in dib would be a poor fit? or did dib authors say that? | 15:25 |
| *** medberry has quit IRC | 15:25 | |
| *** medberry has joined #openstack-infra | 15:25 | |
| pabelanger | tosky_: I've linked this in #tripleo earlier today, but ianw is working on some libguestfs support in DIB: https://review.openstack.org/#/c/312656/ | 15:25 |
| *** armax has joined #openstack-infra | 15:25 | |
| fungi | tosky_: or are you saying there was an overwhelming majority of trove contributors who feel that libguestfs is _the_ solution? | 15:25 |
| tosky_ | pabelanger: is that the right review? | 15:26 |
| amrith | fungi, I don't believe there is such an overwhelming majority | 15:26 |
| pabelanger | tosky_: doh: https://review.openstack.org/#/c/312158/ | 15:26 |
| pabelanger | ugh | 15:26 |
| pabelanger | https://review.openstack.org/#/c/307588/ | 15:27 |
| *** yottatsa has quit IRC | 15:27 | |
| pabelanger | there we go | 15:27 |
| pabelanger | copy / paste fail | 15:27 |
| tosky_ | no, that's one tool | 15:27 |
| pmackinn | pabelanger, lol | 15:28 |
| pabelanger | tosky_: like I said, it's a start to use libguestfs | 15:28 |
| tosky_ | fungi: I have to agree with amrith that there is no overwhelming majority, but there is a interesting group | 15:28 |
| pabelanger | pmackinn: ? | 15:28 |
| *** jlanoux has joined #openstack-infra | 15:29 | |
| pmackinn | pabelanger, third time is the charm, that's all | 15:29 |
| tosky_ | fungi: and for your comment, I think that virt-dib is a possible solution that addresses some issues, and I still hold that for trove image building a simpler solution is possible | 15:29 |
| sc68cal | nibalizer: heh. I need to try that now | 15:29 |
| pabelanger | Yup, new batteries now | 15:29 |
| sc68cal | I had pokemon stadium for n64. It was dope | 15:29 |
| *** tlian has joined #openstack-infra | 15:30 | |
| *** xarses has joined #openstack-infra | 15:32 | |
| *** oanson has quit IRC | 15:32 | |
| *** ayoung has joined #openstack-infra | 15:32 | |
| *** yamahata has quit IRC | 15:33 | |
| openstackgerrit | greghaynes proposed openstack/diskimage-builder: Add install-bin element https://review.openstack.org/311646 | 15:34 |
| *** yottatsa has joined #openstack-infra | 15:34 | |
| openstackgerrit | greghaynes proposed openstack/diskimage-builder: Add tinycorelinux element https://review.openstack.org/311647 | 15:35 |
| openstackgerrit | greghaynes proposed openstack/diskimage-builder: Split pip out of pip-and-virtualenv https://review.openstack.org/311651 | 15:35 |
| *** dizquierdo is now known as dizquierdo_afk | 15:38 | |
| *** dmk0202 has quit IRC | 15:38 | |
| anteaya | I've been foisting myself on the scientific working group | 15:40 |
| anteaya | what a great group of people | 15:40 |
| anteaya | we still are working on the lines of communication thing right now | 15:40 |
| anteaya | so this bit came in a private email rather than a public one | 15:41 |
| anteaya | we are working on getting things where they should be publicly | 15:41 |
| anteaya | to that end | 15:41 |
| anteaya | the scientific working group has requested to be able to use storyboard | 15:41 |
| anteaya | in addition to other tasks, they have a subteam called stories | 15:41 |
| anteaya | which they are defining | 15:41 |
| openstackgerrit | Paul Belanger proposed openstack-infra/tripleo-ci: [WIP] Initial support for centos-7 jenkins slave https://review.openstack.org/312725 | 15:42 |
| anteaya | but would amount to creating user stories for scientific purposes | 15:42 |
| *** rossella_s has quit IRC | 15:42 | |
| anteaya | does anyone have any thoughts on the question "May the scientific working group use StoryBoard?" | 15:42 |
| anteaya | I told them we may need to chew on this question a bit before we arrive at an answer | 15:44 |
| anteaya | so consider this the first round of asking, and I'll come back to it again if the time is not optimal for discussion now | 15:44 |
| clarkb | there is no existing task set or bug list right? | 15:45 |
| *** esikachev has quit IRC | 15:45 | |
| anteaya | clarkb: correct, they had a first meeting at the ops meetup in manchester | 15:45 |
| anteaya | then two meetings at the austin summit | 15:45 |
| anteaya | so far they are directing the 80 or so folks who showed up at summit to subscribe to the user committee and ops mailing lists for communication | 15:46 |
| fungi | anteaya: i would suggest they wait just a little bit. ttx was planning to have a proposal for next tuesday, leading into a tc resolution on a general task tracking solution for the developer community. if it turns out that storyboard.openstack.org isn't going to be around long-term then i'd hate to have to roll them into the migration effort | 15:46 |
| *** mikelk has quit IRC | 15:46 | |
| anteaya | I talked them out of starting their own mailing list | 15:46 |
| *** ayoung has quit IRC | 15:46 | |
| *** Guest21288 has quit IRC | 15:46 | |
| anteaya | fungi: understood, I felt that might be an argument | 15:47 |
| anteaya | so told them that patience was in order though didn't want to bog them down in the details of why yet | 15:47 |
| anteaya | also they are getting their heads around booking a meeting slot | 15:47 |
| fungi | if sb ends up being the long-term plan, then we can commit to keeping the service up and running | 15:47 |
| anteaya | I've offered to help them figure that out and I feel they will get back to me when they are ready | 15:48 |
| *** sridhar_ram has joined #openstack-infra | 15:48 | |
| anteaya | fungi: understood | 15:48 |
| anteaya | and makes sense | 15:48 |
| anteaya | mostly wanted to convey the request which came in private for reasons I stated above | 15:48 |
| anteaya | so now you know | 15:48 |
| fungi | at which point the decision for them can be based more on whether the current featureset is sufficient for their initial needs | 15:48 |
| *** salv-orlando has joined #openstack-infra | 15:49 | |
| anteaya | I'll paste the relevent bits of the email, I don't think I'm crossing a privacy line by doing so | 15:50 |
| anteaya | http://paste.openstack.org/show/496247/ | 15:50 |
| *** earlephilhower has joined #openstack-infra | 15:50 | |
| *** kzaitsev_mb has quit IRC | 15:51 | |
| pabelanger | clarkb: looks like https://review.openstack.org/#/c/311890/ merged but nodepool didn't start builds. it landed at Thu May 5 07:53:16 2016 +0000 so we should have been fine. Maybe we needed to also restart nodepool-builder? | 15:51 |
| clarkb | yes would need to restart builder to pick up new image | 15:52 |
| *** apoorvad has joined #openstack-infra | 15:53 | |
| *** signed8bit has joined #openstack-infra | 15:54 | |
| bunting | Hi, I have tried to implement upper constraints in python-magnumclient (https://review.openstack.org/#/c/301541/). Do upper constraints work for clients as it fails with a bit of a cryptic message? | 15:55 |
| *** kzaitsev_mb has joined #openstack-infra | 15:56 | |
| clarkb | they work for anything as long as your pip is new enough | 15:56 |
| zxiiro | electrofelix: waynr when are we releasing 1.5? I don't see it on pypi yet | 15:56 |
| pabelanger | clarkb: okay, do you mind helping land https://review.openstack.org/#/c/312158/ and https://review.openstack.org/#/c/312908 then I'll restart nodepool-builder | 15:56 |
| rcarrillocruz | scientific working group? | 15:57 |
| rcarrillocruz | anteaya: what is that about? just curious... | 15:57 |
| fungi | zxiiro: i see it on pypi. are you looking at a different pypi? | 15:57 |
| anteaya | rcarrillocruz: yes, they are awesome! | 15:57 |
| anteaya | rcarrillocruz: picture tim bell times about 80 | 15:57 |
| rcarrillocruz | lol | 15:57 |
| fungi | zxiiro: https://pypi.python.org/pypi/jenkins-job-builder | 15:57 |
| anteaya | academic, large research | 15:57 |
| anteaya | national academic networks | 15:58 |
| rcarrillocruz | cloud related, willing to host stuff in our infra? | 15:58 |
| *** akshai has quit IRC | 15:58 | |
| mordred | anteaya: wait - is that just actually 80 tim bells in a room? | 15:58 |
| *** fitoduarte has quit IRC | 15:58 | |
| anteaya | rcarrillocruz: not so much that | 15:58 |
| mordred | anteaya: or one tim bell that is 80 times the size of a normal tim bell? | 15:58 |
| anteaya | ha ha ha | 15:58 |
| anteaya | 80 individuals | 15:58 |
| mordred | becuase of those are TERRIFYING | 15:58 |
| mordred | ah | 15:58 |
| anteaya | each as wonderful to be around as tim bell | 15:58 |
| mordred | 80 individuals who all have similarities to tim bell | 15:58 |
| fungi | it's a tim bell with the strength of 80 tim bells | 15:58 |
| mordred | fungi: also terrifying | 15:58 |
| anteaya | mordred: that's the one | 15:58 |
| *** akshai has joined #openstack-infra | 15:59 | |
| zxiiro | fungi: ah i'm blind, i didn't see it when i searched | 15:59 |
| anteaya | so high throughput needs | 15:59 |
| anteaya | big storage, large fluctuating compute needs | 15:59 |
| anteaya | scheduler issues | 15:59 |
| clarkb | bunting: http://logs.openstack.org/41/301541/1/check/gate-python-magnumclient-docs/f20a078/console.html#_2016-05-04_22_07_12_199 is the issue, you must have requirements that are of the path or url variety.remove them and it ahould work | 15:59 |
| zxiiro | pypi sorts 1.3.0 and 1.4.0 as the top search | 15:59 |
| fungi | zxiiro: pypi search is... well let's just say it's somewhat broken and not actively maintained. needs work and current efforts are primarily going into warehouse rather than trying to fix up something which is soon(ish) to be obsoleted | 16:00 |
| anteaya | rcarrillocruz: fabulous group of folks | 16:00 |
| openstackgerrit | yolanda.robla proposed openstack-infra/shade: Add magnum baymodel calls to shade. https://review.openstack.org/308009 | 16:00 |
| anteaya | rcarrillocruz: but very limited resources | 16:00 |
| anteaya | rcarrillocruz: academic funding patterns and all | 16:00 |
| openstackgerrit | Paul Belanger proposed openstack-infra/tripleo-ci: [WIP] Initial support for centos-7 jenkins slave https://review.openstack.org/312725 | 16:00 |
| *** jsavak has quit IRC | 16:00 | |
| rcarrillocruz | it's awesome the project is embracing folks doing stuff of that caliber | 16:00 |
| *** jsavak has joined #openstack-infra | 16:00 | |
| rcarrillocruz | ++++ | 16:01 |
| *** arxcruz has quit IRC | 16:02 | |
| fungi | rcarrillocruz: those are the users who make me want to work on openstack. furthering humanity's knowledge rather than helping some corporate exec make the mortgage payments on a fourth vacation home | 16:03 |
| rcarrillocruz | exactly my thoughts | 16:03 |
| rcarrillocruz | doing stuff that *matters* you know... | 16:03 |
| bunting | clarkb: I don't quite understand what you mean by that? | 16:03 |
| dstufft | zxiiro: fungi is saying it nicely, I'd say that current PyPI search is a tire fire D: | 16:04 |
| nibalizer | rcarrillocruz: any sense of the new ips for infracloud? | 16:04 |
| *** sputnik13 has joined #openstack-infra | 16:04 | |
| anteaya | rcarrillocruz: exactly, this is what I tell them | 16:04 |
| *** dtantsur is now known as dtantsur|afk | 16:04 | |
| nibalizer | i feel bad for deleting them all >_> | 16:04 |
| anteaya | rcarrillocruz: I tell them to make their communication open as quickly as possible since we all want to help them | 16:04 |
| rcarrillocruz | nibalizer: i could ssh in to some instances | 16:04 |
| *** sputnik13 has quit IRC | 16:04 | |
| anteaya | rcarrillocruz: so much fun working with them | 16:04 |
| rcarrillocruz | and they are booting up from a lab dhcp | 16:04 |
| rcarrillocruz | which means | 16:04 |
| zxiiro | dstufft: haha good to know | 16:04 |
| fungi | dstufft: i simply didn't want to test out your asbestos underwear | 16:05 |
| rcarrillocruz | the NIC is not on the vlan we expect | 16:05 |
| rcarrillocruz | but as the task tracking system is having issues, i can't login to open tickets and all | 16:05 |
| rcarrillocruz | i'm 'hoping' to get that sorted soon | 16:05 |
| *** davideagnello has joined #openstack-infra | 16:05 | |
| fungi | rcarrillocruz: the hpe task tracking system? | 16:05 |
| rcarrillocruz | fungi: yeah | 16:05 |
| *** timl0101 has joined #openstack-infra | 16:05 | |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/elastic-recheck: Add bug for TripleO timeouts https://review.openstack.org/313038 | 16:05 |
| fungi | okay, just making sure it wasn't _our_ task tracking system having issues | 16:06 |
| rcarrillocruz | aka jira | 16:06 |
| *** derekh has joined #openstack-infra | 16:06 | |
| fungi | got it | 16:06 |
| crinkle | task tracking systems* >.> | 16:06 |
| crinkle | rcarrillocruz: yay some progress \o/ :D | 16:07 |
| *** woodster_ has joined #openstack-infra | 16:07 | |
| rcarrillocruz | 'progress' :D | 16:07 |
| rcarrillocruz | but hey, we know some are powered on at least... | 16:07 |
| *** sputnik13 has joined #openstack-infra | 16:07 | |
| crinkle | which is much much better than last week | 16:07 |
| fungi | and no longer waterlogged | 16:08 |
| clarkb | bunting: http://logs.openstack.org/41/301541/1/check/gate-python-magnumclient-python27/6132515/tox/py27-2.log.txt is the tox log which is a bit easier to read, I thought it was complaining that you had eg -e http://somedep in your requirements file but I think that is how it is installing magnumclient itself | 16:08 |
| openstackgerrit | Merged openstack-infra/system-config: Remove devstack-centos7 logging for nodepool https://review.openstack.org/312158 | 16:08 |
| *** binbincong has quit IRC | 16:08 | |
| clarkb | bunting: I would have to look at neutron to see if they do something different | 16:09 |
| nibalizer | rcarrillocruz: crinkle ok just poke whenever the dns needs to be dns'd | 16:09 |
| nibalizer | i know it was annoying last time hobbling along with hosts files and dnsmasq hax | 16:10 |
| rcarrillocruz | nibalizer: i will, so... we can haz dns on git repo? | 16:10 |
| *** shashank_hegde has joined #openstack-infra | 16:10 | |
| nibalizer | rcarrillocruz: not today :( | 16:10 |
| nibalizer | one day | 16:10 |
| rcarrillocruz | or that's not yet in place? | 16:10 |
| *** kzaitsev_mb has quit IRC | 16:10 | |
| rcarrillocruz | heh | 16:10 |
| crinkle | we have the inventory file with hostnames and ips | 16:10 |
| rcarrillocruz | funny we both wanted that for so long in two different groups | 16:10 |
| *** kjorgensen has joined #openstack-infra | 16:10 | |
| crinkle | so just need to do some sed magic with the dns tool | 16:10 |
| *** yamahata has joined #openstack-infra | 16:10 | |
| rcarrillocruz | we need to have designate v2 on some cloud provider really | 16:10 |
| rcarrillocruz | maybe we could bribe vexxhost to upgrade | 16:11 |
| nibalizer | i mean we could cerate the infracloud zone and deletgate it to vexxhost and experiment with using vexxhost for dns | 16:11 |
| nibalizer | at that point it would be ansible yah? | 16:11 |
| rcarrillocruz | well... i put designate v1 on shade to some extent | 16:11 |
| rcarrillocruz | and that broke | 16:11 |
| nibalizer | nice | 16:11 |
| rcarrillocruz | so mordred pulled it out | 16:11 |
| rcarrillocruz | as i really put it in a bad moment | 16:11 |
| nibalizer | crinkle: the bifrost inventory file? | 16:12 |
| rcarrillocruz | they were already moving over in the project to v2 | 16:12 |
| crinkle | nibalizer: yeah | 16:12 |
| openstackgerrit | Merged openstack-infra/system-config: Add ubuntu-precise logging to nodepool-builder https://review.openstack.org/312908 | 16:12 |
| rcarrillocruz | which is what i've worked on last month, zones and recordsets for designate v2 are now in shade | 16:12 |
| crinkle | nibalizer: not that that's up to date | 16:12 |
| nibalizer | yah the first round of dns was generated from that, so yeah, whenveer that gets updated to reality it can go into dns | 16:12 |
| rcarrillocruz | and i just started writing the os_zone ansible module, which i expect to push early next week | 16:12 |
| *** binbincong has joined #openstack-infra | 16:12 | |
| rcarrillocruz | after that will come os_recordset | 16:12 |
| nibalizer | also if another infra-core could push this through https://review.openstack.org/#/c/312173/ that would make running ansible less annoying | 16:13 |
| nibalizer | it doesn't like it when hosts don't exist | 16:13 |
| bunting | clarkb: I added the line to the neutron client and it seems to cause the same error | 16:13 |
| mugsie | rcarrillocruz: rax has designate v2 active | 16:13 |
| mugsie | just in an early access mode | 16:13 |
| rcarrillocruz | mugsie: o_O orly? | 16:13 |
| rcarrillocruz | mordred: ^ | 16:14 |
| rcarrillocruz | that's awesome! | 16:14 |
| clarkb | bunting I am more curious to see how neutron makes it work than to copy the same broken elsewhere | 16:14 |
| mugsie | yeah - you have to sign up somewhere ... | 16:14 |
| *** medberry is now known as med_ | 16:14 | |
| mordred | mugsie: WOOT!!!! | 16:14 |
| *** yottatsa has quit IRC | 16:14 | |
| mordred | mugsie: we can almost certainly get that enabled for us | 16:14 |
| electrofelix | zxiiro: odd, it's showing up as there for me | 16:14 |
| rcarrillocruz | \o/ | 16:14 |
| EmilienM | nibalizer: hey, I'll let you check & +a (or not) https://review.openstack.org/#/c/312987/ to make sure I'm not doing wrong | 16:15 |
| electrofelix | zxiiro: https://pypi.python.org/pypi/jenkins-job-builder/ | 16:15 |
| mugsie | I would imagine so :) | 16:15 |
| *** bpokorny has joined #openstack-infra | 16:15 | |
| nibalizer | EmilienM: you can do no wrong in my eyes | 16:15 |
| *** vgridnev has quit IRC | 16:15 | |
| nibalizer | fungi: clarkb i'm having a hard time understanding why https://review.openstack.org/#/c/312173/ doesn't affect our precise java hosts (jenkins masters, mostly) | 16:15 |
| nibalizer | er | 16:15 |
| nibalizer | http://www.ubuntu.com/usn/usn-2964-1/ <--- this | 16:16 |
| EmilienM | nibalizer: ♥ | 16:16 |
| nibalizer | oh maybe because it only appears at 7u99 and precise stopped at 7u79 | 16:16 |
| clarkb | bunting but they look the same, your best bet is probably to find Nakato and or lifeless and aee if they recogbize the issue | 16:18 |
| *** electrocucaracha has left #openstack-infra | 16:18 | |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/elastic-recheck: Add bug for TripleO timeouts https://review.openstack.org/313038 | 16:18 |
| bunting | clarkb: The neutron client does not seem to implement it however, but sure ill try and get in touch with them | 16:19 |
| *** egafford has quit IRC | 16:19 | |
| openstackgerrit | Derek Higgins proposed openstack-infra/tripleo-ci: Use the overcloud full images from the cache https://review.openstack.org/312397 | 16:19 |
| clarkb | bunting: not neutronclient, neutron | 16:19 |
| fungi | rcarrillocruz: nibalizer: crinkle: so... *actually* we could probably do dns in git pretty easily (even without designate at all) for *.ic.openstack.org since all we need is some delegation in the openstack.org domain. having dns in git for all of openstack.org is a much bigger conversation since we share custody of that domain with foundation staff whose priorities and tool choices are not | 16:20 |
| fungi | necessarily the same as ours | 16:20 |
| fungi | so what is convenient for us is not always convenient for them | 16:20 |
| *** lucasagomes is now known as lucas-afk | 16:20 | |
| *** hdd has joined #openstack-infra | 16:20 | |
| crinkle | fungi: ooooh this would be neat | 16:20 |
| *** vgridnev has joined #openstack-infra | 16:21 | |
| fungi | crinkle: that said, i agree with nibalizer on the "not today" part | 16:21 |
| rcarrillocruz | yeah, thing is if we should put a lot of effort on dealing with the current rax dns client issues or rather wait to have designate v2 usable for us | 16:21 |
| crinkle | haha | 16:21 |
| zxiiro | electrofelix: yep we got it sorted out. i was using pypi's broken search | 16:21 |
| rcarrillocruz | i'm ofc in favor of the latter, for dogfooding etc | 16:21 |
| bunting | clarkb: Yeah I got confused there. It seems to run into problems on the clients | 16:21 |
| fungi | would need to spend a little time trying out existing puppet module(s) for bind 10 | 16:21 |
| fungi | and writing up some basic deployment automation | 16:21 |
| *** vgridnev has quit IRC | 16:21 | |
| rcarrillocruz | but for sure, dns in git repo for the subdomain would be great | 16:21 |
| *** derekh has quit IRC | 16:22 | |
| * rcarrillocruz yells moar automation plz | 16:22 | |
| fungi | if we ended up moving some of our services to *.project.openstack.org or something down the road, that might be a solution to the shared custody issue | 16:22 |
| fungi | e.g. start redirecting from https://review.openstack.org/ to https://review.project.openstack.org/ and so on | 16:23 |
| rcarrillocruz | we had a supersimilar issue in gozer at some point | 16:23 |
| *** salv-orlando has quit IRC | 16:23 | |
| *** BobBall is now known as BobBall_AWOL | 16:23 | |
| rcarrillocruz | where we had a lot of our services as *.gozer.hpcloud.net | 16:24 |
| rcarrillocruz | whereas others in *.hpcloud.net | 16:24 |
| asselin_ | dstufft, thanks, bandersnatchmirror now able to do a full sync | 16:24 |
| rcarrillocruz | i pushed to have everything in *.gozer.hpcloud.net , but didn't get much traction | 16:24 |
| *** bpokorny has quit IRC | 16:24 | |
| nibalizer | fungi: so before we go full bind, i think we should investigate using vexxhost | 16:24 |
| nibalizer | since they run designate | 16:25 |
| *** yolanda has quit IRC | 16:25 | |
| *** trown is now known as trown|lunch | 16:25 | |
| mordred | nibalizer: so does rackspace now, fwiw | 16:27 |
| *** kmartin has quit IRC | 16:27 | |
| nibalizer | oh is that the cloud beta thing i got an email about? | 16:28 |
| mugsie | nibalizer: should have been | 16:28 |
| mordred | dunno. mugsie just told us they have it running now | 16:28 |
| mugsie | if it was the "DNS Early Access" | 16:28 |
| mordred | nibalizer: I agree though - our node launching stuff will be easier to integrate if we can also shade/ansible the dns entries at the same time | 16:28 |
| *** sdake_ has joined #openstack-infra | 16:28 | |
| mordred | although if that doesn't work, running our own also seems fine | 16:28 |
| fungi | mordred: agreed, if there is designate available to us, while we may not be able to directly push zonefiles into it the api is hopefully sufficient we can run a translator to check and update the records we're hosting in it | 16:29 |
| *** mhickey has quit IRC | 16:29 | |
| mordred | fungi: actually, designate does accept zonefile imports | 16:29 |
| nibalizer | mordred: interesting, because automatically creating dns in launch node is great, but that runs counter to keeping the dns in git | 16:29 |
| mordred | nibalizer: not necessarily | 16:29 |
| fungi | even better. i thought that was what we needed v2 for | 16:29 |
| mordred | nibalizer: if we say "call this server foo.openstack.org" - we can also say "call this IP bar.openstack.org" | 16:29 |
| nibalizer | fungi: at gozer i wrote a quick script that idempotently synced a yaml file full of dns records with the designate ip | 16:30 |
| mordred | and those can be in our ansibles for nodes | 16:30 |
| *** yolanda has joined #openstack-infra | 16:30 | |
| nibalizer | s/ip/api/ | 16:30 |
| mordred | fungi: it does not yet support _updating_ an existing zonefile | 16:30 |
| nibalizer | that being said, we still have N-clouds worth of reverse records to manage | 16:30 |
| *** inc0 has quit IRC | 16:30 | |
| mordred | fungi: but I talked with Kiall about that at the summit | 16:30 |
| mordred | nibalizer: exactly | 16:30 |
| nibalizer | + infracloud datacenter | 16:30 |
| fungi | mordred: that's what i meant. push in a new zonefile to replace the old one (is that what you mean by updating?) | 16:30 |
| *** inc0 has joined #openstack-infra | 16:30 | |
| mordred | fungi: yes | 16:30 |
| Kiall | Adding update support should be easy enough... at least, for smaller zones. | 16:31 |
| *** sdake has quit IRC | 16:31 | |
| mordred | fungi: Kiall said that should be possible to add - although there is a performance implication for larger zones | 16:31 |
| mordred | look! it's Kiall | 16:31 |
| *** sridhar_ram1 has joined #openstack-infra | 16:31 | |
| rcarrillocruz | o/ | 16:31 |
| pabelanger | clarkb: I've restarted nodepool-builder | 16:31 |
| Kiall | my ears were burning ;) | 16:31 |
| *** yottatsa has joined #openstack-infra | 16:31 | |
| mordred | however, I'm not fully convinced that us managing this via zone files in git would be superior | 16:31 |
| mugsie | mordred: we should be able do it | 16:31 |
| mordred | since many of the ips we're managing are themselves data we're getting from the cloud | 16:31 |
| pabelanger | clarkb: think we need to do manual builds today? | 16:32 |
| mordred | so we'd have to wind up either templating a zone file (ew) or having a multi-step process for git | 16:32 |
| openstackgerrit | Andrea Frittoli proposed openstack-infra/project-config: Add gate-tempest-dsvm-neutron-full-ssh to periodic https://review.openstack.org/313051 | 16:32 |
| mordred | like "create the node, get its ip, make another commit to git" | 16:32 |
| *** shashank_hegde has quit IRC | 16:32 | |
| pabelanger | clarkb: I'm going to kick off a ubuntu-precise, since I'd like to work on it | 16:33 |
| *** sridhar_ram has quit IRC | 16:33 | |
| fungi | gonna go grab lunch a little ways down the beach, should be back in ~90 minutes give or take | 16:33 |
| openstackgerrit | Anne Gentle proposed openstack-infra/project-config: Adds API reference publishing jobs for Swift https://review.openstack.org/313015 | 16:34 |
| pabelanger | fungi: enjoy | 16:34 |
| *** salv-orlando has joined #openstack-infra | 16:35 | |
| *** jamesmcarthur has joined #openstack-infra | 16:35 | |
| *** jamesmcarthur_ has joined #openstack-infra | 16:36 | |
| nibalizer | mordred: i tend to agree, like with ansible we have a split between stuff that is data from the cloud (a records) then stuff that we create and should manage in git (a records for static resources, cname, txt, srv records) | 16:36 |
| *** jamesmcarthur has left #openstack-infra | 16:37 | |
| *** lakshmiS has joined #openstack-infra | 16:37 | |
| *** bpokorny has joined #openstack-infra | 16:38 | |
| * rcarrillocruz thinks of a process where one-off plays or actions that imply getting data dynamically triggers a proposed changed in system-config git repo | 16:38 | |
| rcarrillocruz | something related to the finglonger thing | 16:38 |
| rcarrillocruz | i have yet to experiment with that idea | 16:38 |
| *** nadya has quit IRC | 16:40 | |
| clarkb | pabelanger: if we have any images that are more than a few days old its probably worth updating them too (debian maybe?) | 16:40 |
| *** kmartin has joined #openstack-infra | 16:40 | |
| *** dizquierdo_afk is now known as dizquierdo | 16:40 | |
| rcarrillocruz | so that whenever we do a change on an existing resource or service we get the corresponding git change that 'converges' to that state | 16:40 |
| *** jamesmcarthur has joined #openstack-infra | 16:41 | |
| *** jamesmcarthur has left #openstack-infra | 16:41 | |
| clarkb | wait designate can't update a zone /me decides maybe he shouldn't think too hard about the one thing a dns management api should manage to do | 16:41 |
| *** jamesmca_ has joined #openstack-infra | 16:41 | |
| clarkb | mordred: there is one major reason to do it this way | 16:42 |
| clarkb | actually two | 16:42 |
| clarkb | centralized control of updates because right now its wild west and you don't fix that if you let random things continue to update records | 16:42 |
| openstackgerrit | Paul Belanger proposed openstack-infra/tripleo-ci: [WIP] Initial support for centos-7 jenkins slave https://review.openstack.org/312725 | 16:43 |
| clarkb | but also you could at any time just run a bind and nothing changes except where you copy the file to | 16:43 |
| *** fedexo has joined #openstack-infra | 16:43 | |
| clarkb | mordred: it has to be multistep regardless because of how we put things in production | 16:44 |
| *** akshai has quit IRC | 16:44 | |
| clarkb | I am unaware of any other magical way of saying this service is ready and available please hit it now internet | 16:44 |
| clarkb | (er you can do that without dns like with a load balancer but its multistep regardless) | 16:45 |
| pabelanger | clarkb: ya, we can do debian | 16:45 |
| pabelanger | clarkb: I'll kick that off after ubuntu-precise | 16:45 |
| *** yottatsa has quit IRC | 16:46 | |
| *** akshai has joined #openstack-infra | 16:47 | |
| *** johnny has joined #openstack-infra | 16:47 | |
| *** yottatsa has joined #openstack-infra | 16:48 | |
| *** dprince has quit IRC | 16:48 | |
| *** johnny is now known as Guest40712 | 16:48 | |
| clarkb | pabelanger: anteaya: should we continue the es upgrade? | 16:49 |
| pabelanger | clarkb: if anteaya is ready | 16:49 |
| anteaya | was just opening elasticsearch-head | 16:49 |
| clarkb | looking at elasticsearch head it appears that things are happier but not amazing | 16:49 |
| openstackgerrit | Paul Belanger proposed openstack-infra/tripleo-ci: [WIP] Initial support for centos-7 jenkins slave https://review.openstack.org/312725 | 16:49 |
| openstackgerrit | Everett Toews proposed openstack-infra/irc-meetings: Remove the API WG 0000 UTC meeting https://review.openstack.org/313053 | 16:49 |
| anteaya | clarkb pabelanger yup, all ready, thanks | 16:49 |
| clarkb | we can continue to try the rolling upgrade process | 16:49 |
| clarkb | I just worry we will need to do a full cluster restart at the end anyways | 16:50 |
| pabelanger | clarkb: anteaya: okay, disabling allocation | 16:50 |
| anteaya | we can restart tomorrow can we not? | 16:50 |
| anteaya | pabelanger clarkb ack | 16:50 |
| anteaya | election time! | 16:50 |
| anteaya | I'd like to see one | 16:51 |
| pabelanger | allocation disabled | 16:51 |
| clarkb | anteaya: ya, we can always do a full restart later | 16:51 |
| *** Na3iL has quit IRC | 16:51 | |
| clarkb | pabelanger: this is transient allocation disabled? | 16:51 |
| anteaya | thanks | 16:51 |
| clarkb | pabelanger: just gonna restart 05? | 16:51 |
| pabelanger | clarkb: yes | 16:51 |
| clarkb | kk | 16:51 |
| pabelanger | need to remove 05 from emergency first | 16:51 |
| clarkb | ya its still running 1.7.3 | 16:51 |
| pabelanger | es05 now removed | 16:51 |
| *** akshai has quit IRC | 16:52 | |
| pabelanger | waiting for puppet to do its thing | 16:52 |
| clarkb | pabelanger: I thin kwe can actually remove all of them from emergency, I didn't realize it would not restart the srevice for us on package install | 16:52 |
| clarkb | which was the big reason for putting them in the emergency file | 16:52 |
| pabelanger | clarkb: sure, I can do that now | 16:52 |
| pabelanger | all remaining elasticsearch hosts have been removed | 16:53 |
| pabelanger | another 7mins before puppet wheel starts again | 16:53 |
| mordred | clarkb: good point | 16:54 |
| anteaya | ah okay, I'll stop refreshing for a few minutes | 16:54 |
| *** akshai has joined #openstack-infra | 16:54 | |
| pabelanger | anteaya: Ya, I'll ping just before I stop es05 | 16:54 |
| anteaya | pabelanger: thanks | 16:54 |
| *** jamesmca_ has quit IRC | 16:54 | |
| clarkb | mordred: it definitely isn't perfect and I think an even more ideal world would be one where nova and designate automagically do thing sfor you if asked | 16:55 |
| clarkb | mordred: eg nova boot --update-my-dns-kthxbai foo.org | 16:55 |
| mordred | clarkb: guess what ... that exists | 16:55 |
| electrofelix | zxiiro: did you see my comments on https://review.openstack.org/#/c/261587/? | 16:55 |
| pabelanger | clarkb: so, restart the rest of elasticsearch servers first, then reenable transient allocation? | 16:55 |
| *** Na3iL has joined #openstack-infra | 16:55 | |
| openstackgerrit | Everett Toews proposed openstack-infra/irc-meetings: Remove the API WG 0000 UTC meeting https://review.openstack.org/313053 | 16:56 |
| mordred | clarkb: designate v2 has that integratoin, and has plugins for nova and neutron to do it | 16:56 |
| clarkb | mordred: oh I was told it didn't because nova and designate didn't have a good way to cooperate | 16:56 |
| zxiiro | electrofelix: yes, I've talked to my intern about it. He's gonna give it another try to combine the entry points into 1 | 16:56 |
| mordred | clarkb: so if the deployer has deployed the right config, it is totally a thing | 16:56 |
| clarkb | greghaynes: ^ make your cloud better | 16:56 |
| mordred | greghaynes: ++ | 16:56 |
| clarkb | pabelanger: lets continue doing one at a time like we did yesterday | 16:56 |
| pabelanger | clarkb: ack | 16:56 |
| clarkb | pabelanger: if it turns out that es really hates that then we can shift gears and restart the entire cluster | 16:57 |
| mordred | clarkb: basically, Kiall and mugsie have made it work the way we've always wanted | 16:57 |
| *** jamesmcarthur has joined #openstack-infra | 16:57 | |
| mordred | clarkb: now we just have to, you know, wait for deployers | 16:57 |
| rcarrillocruz | yeah, the reverse dns is depicted here: http://docs.openstack.org/developer/designate/integrations.html | 16:58 |
| openstackgerrit | Merged openstack-infra/jenkins-job-builder: Fix typo in doc of workspace-cleaner wrapper https://review.openstack.org/312926 | 16:58 |
| *** ccamacho has quit IRC | 16:58 | |
| *** pmackinn has left #openstack-infra | 16:59 | |
| *** jlanoux has quit IRC | 16:59 | |
| *** fitoduarte has joined #openstack-infra | 16:59 | |
| clarkb | rcarrillocruz: does it work for non floating ips too? | 17:00 |
| pabelanger | okay puppet wheel starting again | 17:00 |
| *** jerryz has joined #openstack-infra | 17:00 | |
| *** sdake_ has quit IRC | 17:00 | |
| clarkb | mordred: where I think automagic DNS makes a ton of sense is with multiple zones/domains | 17:02 |
| clarkb | mordred: all your cattle go into the cattle.openstack.org domain, then in openstack.org you CNAME over to whatever the current herd is | 17:03 |
| clarkb | mordred: in that world you actually need/want both things | 17:03 |
| electrofelix | zxiiro: only if it makes sense to you as well | 17:03 |
| rcarrillocruz | clarkb: i haven't had time to play with it tbh... | 17:03 |
| *** pvaneck has joined #openstack-infra | 17:03 | |
| rcarrillocruz | Kiall, mugsie : ^ ? | 17:03 |
| zxiiro | electrofelix: yep, i agree. In fact I think it will make documentation easier as it will all be under 1 entry point instead of split between 2. | 17:03 |
| *** fedexo has quit IRC | 17:04 | |
| EmilienM | pabelanger: re - tarballs, ping me if you have time this afternoon to finish the work - otherwise when you can, it's up to you and your schedule | 17:04 |
| pabelanger | EmilienM: won't be today, we didn't build new ubuntu-trusty images in nodepool today | 17:04 |
| pabelanger | EmilienM: so, tomorrow for sure! | 17:05 |
| EmilienM | pabelanger: ack | 17:05 |
| EmilienM | shardy: ^ fyi no tarball for today -- working on the zuul patch in the meantime. | 17:05 |
| *** javeriak has joined #openstack-infra | 17:05 | |
| mugsie | clarkb: designate will take any IP and create any of the record types we support. so you could do cattle.openstack.org and CNAME no problem | 17:05 |
| *** kzaitsev_mb has joined #openstack-infra | 17:06 | |
| mugsie | as long as the CNAME is not the root of another domain of course | 17:06 |
| zxiiro | electrofelix: since 1.5 is released and we can start making backwards incompatible changes for 2.0. I'm gonna get my intern to start cleaning up code so that we use the convert_xml helper function where appropriate and setting either defaults or required for all functions instead of allowing the indeterministic (optional) settings. | 17:06 |
| clarkb | mugsie: specifically asking about automagic cooperation between nova/neutron and designate though | 17:06 |
| *** oanson has joined #openstack-infra | 17:06 | |
| clarkb | mugsie: so that anytime I make an instead I get A, AAAA, and reverse PTRs for the IP addrs associated with that instance | 17:06 |
| mugsie | oh, soory, did not real enough scrollback | 17:06 |
| *** yolanda has quit IRC | 17:07 | |
| clarkb | I know designate will let me manually manage that domain just fine, which is what I want for the "production" records | 17:07 |
| clarkb | but if all the behind the scenes can be done for me without thinking to hard that is even better | 17:07 |
| *** yolanda has joined #openstack-infra | 17:07 | |
| *** shardy has quit IRC | 17:07 | |
| mugsie | there is 3 modes for the integration. 1 pushes records for a network into the dnsmasq instance, and when a floating ip is associated woth a port it pushes the record to designate | 17:08 |
| mugsie | another is push all records for the network to designate (if you have a provider network etc). | 17:08 |
| *** abregman has quit IRC | 17:08 | |
| electrofelix | zxiiro: just need to keep in mind that AFAIK all openstack CI jobs are still using JJB HEAD, so try and avoid any XML changes even though we're should be allowed to break compatibility. I believe they should be moving to using zuul + ansible and away from jenkins soonish | 17:08 |
| openstackgerrit | Emilien Macchi proposed openstack-infra/project-config: add tarball jobs to puppet-tripleo https://review.openstack.org/313063 | 17:09 |
| mugsie | but that has a limitation of a single zone per network, which is not ideal for the shared external network model where VMs just connect to the provider network | 17:09 |
| clarkb | oh it doesn't base it upon who the tenant is? | 17:09 |
| openstackgerrit | Paul Belanger proposed openstack-infra/project-config: Add experimental ubuntu-precise infra jobs https://review.openstack.org/313064 | 17:09 |
| mugsie | not when it is set to push all port dns info to designate (instead of just floating IPs) | 17:09 |
| mugsie | we identifyed it as a shortcoming in the summit | 17:10 |
| clarkb | mordred: rcarrillocruz ^ so that actually won't work for us in most clouds | 17:10 |
| mugsie | clarkb: you need the clouds to enable it as well | 17:10 |
| zxiiro | electrofelix: sounds good. i'll keep that in mind with the changes. | 17:10 |
| clarkb | ya mordred mentioned we also need the deployers to catch up | 17:10 |
| mugsie | as it has neutron call directly to designate | 17:10 |
| pabelanger | clarkb: anteaya: es05 was just upgraded. Ready to restart the service? | 17:10 |
| clarkb | mugsie: most of the clouds we consume don't let us floating IP | 17:10 |
| *** signed8bit is now known as signed8bit_Zzz | 17:10 | |
| *** shashank_hegde has joined #openstack-infra | 17:10 | |
| clarkb | pabelanger: I am ready | 17:10 |
| clarkb | mugsie: and ideally we would not floating ip | 17:11 |
| mugsie | yeah - my head was stuck in the private network + floating ip model when I looked at it | 17:11 |
| mugsie | we need to get it updated | 17:11 |
| clarkb | anyways good info to have, thank you for getting me up to speed | 17:11 |
| mugsie | np | 17:11 |
| *** shashank_hegde has quit IRC | 17:11 | |
| mugsie | ping me if you have anyu other questions :) | 17:11 |
| anteaya | pabelanger: cool | 17:12 |
| pabelanger | clarkb: anteaya okay, stopping es05 | 17:12 |
| anteaya | thanks | 17:12 |
| amrith | persia, I created the etherpad you suggested https://etherpad.openstack.org/p/image-generation-in-openstack | 17:13 |
| amrith | mordred pabelanger fungi ^^ | 17:13 |
| anteaya | 07 was elected, that was fast | 17:13 |
| amrith | tosky_, ^^ | 17:13 |
| mordred | amrith: awesome! | 17:13 |
| pabelanger | now starting | 17:13 |
| amrith | who did I miss, pmackinn isn't here, I'll let him know on #openstack-trove | 17:13 |
| tosky_ | ack | 17:14 |
| persia | amrith: thank you | 17:14 |
| clarkb | mugsie: ya I think in an ideal world the way our many clouds and many region DNS would work is that we would have the root domain say openstack.org managed somewhere via a zone file. This would get deliberate updates to add and remove hosts from production and delegate DNS for each of the clouds to their cloud local designate. Then the cloud local designate would mostly automagically update when we | 17:14 |
| clarkb | add and remove instances. A, AAAA, and PTRs | 17:14 |
| pabelanger | clarkb: anteaya: okay, es05 back online. enabling transient allocation again | 17:14 |
| *** jsavak has quit IRC | 17:14 | |
| amrith | and egafford in #openstack-sahara | 17:14 |
| pabelanger | and enabled | 17:14 |
| anteaya | pabelanger clarkb ack | 17:14 |
| *** jsavak has joined #openstack-infra | 17:15 | |
| anteaya | pabelanger clarkb 05 took on nodes with good speed | 17:15 |
| pabelanger | ya, way faster then es06 | 17:15 |
| clarkb | anteaya: ya it is possible it was holding all of the locks, if that is the case restarting it may have fixed us. But I honeslty don't grok the underlying bug/issue that well | 17:15 |
| anteaya | yay happenstance | 17:16 |
| pabelanger | anteaya: clarkb: ready to move to es04? | 17:16 |
| clarkb | pabelanger: lets wait a few minutes to see if those shards settle in a bit more | 17:16 |
| pabelanger | ack | 17:16 |
| anteaya | pabelanger clarkb one shard unassigned | 17:16 |
| anteaya | yup, I'm fine to see if it gets picked up | 17:17 |
| *** jistr has quit IRC | 17:17 | |
| anteaya | linux foundation did a survey of open source working conditions: http://storage.pardot.com/6342/148112/JobsReport2016_Infographic.jpg | 17:18 |
| *** zeih has joined #openstack-infra | 17:18 | |
| clarkb | pabelanger: anteaya the yellow shard 1 on es06 appers to be recovering proprely | 17:19 |
| anteaya | clarkb: yay | 17:19 |
| anteaya | also the phrase big tent has grown a life of its own: https://www.linux.com/blog/thinking-big-supporting-open-source-decades-come | 17:19 |
| *** Sukhdev has joined #openstack-infra | 17:20 | |
| clarkb | and the yellow 1 on es03 | 17:20 |
| pabelanger | I see 2 yellow shards on es06 | 17:20 |
| *** gyee has joined #openstack-infra | 17:21 | |
| clarkb | pabelanger: ya the second seems stalled, this isn't always an issue as es will only recover so many shards per instance on both ends | 17:21 |
| *** ddieterly is now known as ddieterly[away] | 17:21 | |
| clarkb | I think if we wait a bit we should see if things are going to be happy | 17:21 |
| anteaya | I see shards numbered from 0 through to 4 | 17:21 |
| mugsie | clarkb: yeah, that would be ideal. you *could* do something simlar with ansible, just without the PTR. we need to update the ptr code to work on non Floating IP clouds | 17:21 |
| anteaya | does the number indicates something important? | 17:21 |
| anteaya | indicate | 17:21 |
| clarkb | anteaya: no, each index has 5 shards with 1 replica (meaning each of the 5 shards is copied once) | 17:22 |
| clarkb | so 0,1,2,3,4 are just identifiers which which pf the 5 shards it is | 17:23 |
| anteaya | okay thank you | 17:23 |
| *** tqtran has joined #openstack-infra | 17:23 | |
| *** thorst has quit IRC | 17:23 | |
| electrofelix | zxiiro: seems we got a report about problems with XML whitespace on python 2.6 with JJB. While I'm aware that we deprecated support, I wonder if we possibly should have retained it for the last 1.x release and removed it for 2.0? | 17:24 |
| anteaya | I see nine shards entitled 0 on es06 | 17:24 |
| electrofelix | https://storyboard.openstack.org/#!/story/2000572 | 17:24 |
| *** thorst has joined #openstack-infra | 17:24 | |
| clarkb | electrofelix: meh, python2.6 hasn't been supported for years now | 17:24 |
| *** madhu_ak has joined #openstack-infra | 17:24 | |
| zxiiro | electrofelix: honestly I don't think it's worth the effort | 17:24 |
| clarkb | anteaya: each column is a different index, we make one index per day | 17:24 |
| *** jefrite has quit IRC | 17:24 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/tripleo-ci: [WIP] Initial support for centos-7 jenkins slave https://review.openstack.org/312725 | 17:24 |
| openstackgerrit | Doug Hellmann proposed openstack-infra/release-tools: fix the way we detect the previous version in release.sh https://review.openstack.org/313075 | 17:24 |
| zxiiro | electrofelix: we purposely broke 2.6 compatibility if i recall for another issue | 17:25 |
| anteaya | clarkb: ah | 17:25 |
| *** trown|lunch is now known as trown | 17:25 | |
| anteaya | thank you | 17:25 |
| clarkb | supporting python2.6 at this point is silly | 17:25 |
| clarkb | even rhel6 has python2.7 abilities iirc | 17:25 |
| anteaya | clarkb: now I see it | 17:25 |
| *** jang has joined #openstack-infra | 17:25 | |
| anteaya | and we appear to have no unassigned shards at present | 17:25 |
| pabelanger | nice, no unassigned shards | 17:25 |
| * mordred recalls neeting to support 2.4 in the early days | 17:26 | |
| electrofelix | zxiiro: I don't think we did have anything specific, just removed the patch to XML minidom and requirements | 17:26 |
| clarkb | mordred: I think nova may still have a small bit of 2.4 code because of xen | 17:27 |
| electrofelix | but not too pushed, more surprised someone was still using it | 17:27 |
| mordred | clarkb: yah. but there was a time, iirc, when swift had 2.4 nodes in production because lucid | 17:27 |
| EmilienM | I don't know if it's only me, but Gerrit has been performing super slowly for ~15 min | 17:27 |
| notmyname | mordred: ?! I don't remember supporting py24 in swift. py26 definitely | 17:28 |
| zxiiro | I could of sworn that there was some patch that removed something to support py26 merged in the past | 17:28 |
| clarkb | mordred: lucid was 2.6 | 17:28 |
| clarkb | iirc | 17:28 |
| mordred | notmyname: oh yeah? cool. I just remember it wrong then | 17:28 |
| zxiiro | so i had assumed py26 was broken | 17:28 |
| mordred | too much ptsd, not enough time | 17:28 |
| clarkb | EmilienM: what does super slowly mean? | 17:28 |
| *** thorst has quit IRC | 17:28 | |
| anteaya | mordred: stig liked your giant tim bell line, he will be posting to the -infra list soon | 17:28 |
| EmilienM | clarkb: random 502 errors and > 15s for a git review or UI update | 17:29 |
| electrofelix | zxiiro: we probably just should have added some kind of release note calling it out specifically | 17:29 |
| EmilienM | today should not be super busy, it's holiday in lot of countries | 17:29 |
| AJaeger | team : I'd like to publish source translation files to tarballs.openstack.org/translation-source/PROJECT/BRANCH - see https://review.openstack.org/#/c/309560 . Is that a good place to put them? | 17:29 |
| clarkb | wow looks like the GCing has pciked up | 17:29 |
| AJaeger | fungi, clarkb, pleia2 ^: I'd like you to chime in on this, please ^ | 17:29 |
| clarkb | maybe we sould entertain the notion that gerrit has massive memory leaks | 17:29 |
| anteaya | clarkb is pabelanger good to work on es04 now? | 17:30 |
| zxiiro | electrofelix: yeah in hindsight that probably would have been a good idea | 17:30 |
| mordred | anteaya: thankfully, tim bell liked it too | 17:30 |
| anteaya | mordred: oh good! | 17:30 |
| pabelanger | I see 3 yellow shards in total now | 17:30 |
| clarkb | AJaeger: my first inclination would be to have zanata host them | 17:30 |
| anteaya | such a happy bunch those scientists | 17:30 |
| jlk | any of you using gertty on OSX? | 17:30 |
| clarkb | AJaeger: we can still remove them from the git repos, but if by pushing them to zanata as part of the normal process we can then serve those files to others that would be great | 17:31 |
| *** tonytan4ever has quit IRC | 17:31 | |
| zxiiro | electrofelix: Ah I was thinking of this patch https://review.openstack.org/#/c/264078/ | 17:31 |
| clarkb | AJaeger: if zanata is not capable of doing that then yes I think that path is fine | 17:31 |
| electrofelix | zxiiro: fancy reviewing https://review.openstack.org/#/c/63580/ | 17:31 |
| zxiiro | electrofelix: i thought we merged it in master if i'm not incorrect | 17:31 |
| *** Na3iL has quit IRC | 17:31 | |
| clarkb | EmilienM: it looks like our old memory issues with gerrit have returned but instaed of hitting htem at 12GB heap we hit them at 30GB heap | 17:31 |
| electrofelix | zxiiro: yeap, that's the one, it prevents the whitespace being added around XML data | 17:31 |
| *** jsavak has quit IRC | 17:31 | |
| *** nikhil has quit IRC | 17:31 | |
| *** kushal has quit IRC | 17:31 | |
| EmilienM | clarkb: ok, just reporting in case something happens, maybe it's just me | 17:32 |
| *** nikhil has joined #openstack-infra | 17:32 | |
| *** signed8bit_Zzz is now known as signed8bit | 17:32 | |
| anteaya | AJaeger: I had gotten as far as opening that patch up in a tab | 17:32 |
| electrofelix | I mentioned it in the issue logged on storyboard, apparently the user is running Scientific Linux 6, so they should have access to python 2.7 anyway. | 17:32 |
| EmilienM | sounds like I'm not, I've seen other complaints | 17:32 |
| anteaya | I just got a gerrit 502 | 17:32 |
| AJaeger | clarkb: zanata has them already but not as convenient... | 17:32 |
| lxsli | anteaya: me too | 17:32 |
| zxiiro | electrofelix: I bookmarked the review. I'll take a look at it the next time i review things | 17:33 |
| skolekonov | yep, Gerrit works slowly for me too | 17:33 |
| AJaeger | clarkb: do you mean: A separate location on zanata? | 17:33 |
| anteaya | somebody care to take a look at gerrit's javamelody? | 17:33 |
| clarkb | AJaeger: I was just thinking that maybe zanata had a downlaod this POT link and a resonable url we can use | 17:33 |
| clarkb | AJaeger: if so then that seems like a good option to avoid copying to two locations | 17:33 |
| *** ayoung has joined #openstack-infra | 17:33 | |
| clarkb | anteaya: yes thats what I am doing | 17:33 |
| anteaya | clarkb: thank you | 17:34 |
| clarkb | anteaya: see scrollback | 17:34 |
| anteaya | sorry I missed that | 17:34 |
| *** tonytan4ever has joined #openstack-infra | 17:34 | |
| AJaeger | clarkb: right now you can download pot files but it's rather complicatd to get there ;( | 17:35 |
| anteaya | zaro: looks like we again have gerrit memory issues | 17:35 |
| *** shashank_hegde has joined #openstack-infra | 17:35 | |
| clarkb | peaked at about 4.5% GC time, but we hvae twice the cpu now so I think thats roughly 9% on the old scale | 17:36 |
| AJaeger | https://translate.openstack.org/webtrans/translate?project=aodh&iteration=master&localeId=de&locale=en%20#doc:aodh/locale/aodh - and then I can download zip files. And getting there means: Go to project, select version, select language, select document, translate it, go to document overview - and then you can download ;( | 17:36 |
| clarkb | wow | 17:36 |
| anteaya | looks like gerrit memory use just expands to take up whatever we give it | 17:37 |
| clarkb | you have to select a language to get the pot? | 17:37 |
| AJaeger | Oh, that's the translated files - not the source ;( | 17:37 |
| *** zeih has quit IRC | 17:37 | |
| clarkb | AJaeger: ya I would expect the pot to be easier? | 17:37 |
| AJaeger | Sorry, let me try finding it again.. | 17:37 |
| clarkb | anteaya: ya I think gerrit must hvae a memory leak | 17:37 |
| anteaya | looks like it, yes | 17:37 |
| AJaeger | clarkb: I can't find anything ;((( I thought there was a way to do it but I'm lost right now | 17:38 |
| pabelanger | anteaya: clarkb: down to 2 yellow shards, but I cannot tell if they are still recovering. I cannot see size_in_bytes changing | 17:38 |
| clarkb | pabelanger: it is changing for one of them | 17:38 |
| clarkb | 3 on es07 | 17:38 |
| clarkb | you have to hit refresh each time | 17:39 |
| AJaeger | clarkb: so, let's go with my change then if that is the proper location and the right way of doing it | 17:39 |
| pabelanger | I see it at 23376935087 currently | 17:40 |
| *** egafford has joined #openstack-infra | 17:40 | |
| clarkb | pabelanger: if you hit refresh then reopen the shard data you should see it updated | 17:40 |
| clarkb | pabelanger: it won't update the little float window on refresh you have to close and open | 17:40 |
| pabelanger | clarkb: Ah, okay. I was refreshing with the panel still open | 17:41 |
| *** jsavak has joined #openstack-infra | 17:41 | |
| pabelanger | I see the change now | 17:41 |
| anteaya | clarkb: pabelanger cool | 17:42 |
| pabelanger | anteaya: AJaeger: do you mind reviewing https://review.openstack.org/#/c/313064/ to add experimental job to test our new ubuntu-precise DIB | 17:43 |
| * anteaya reviews | 17:43 | |
| * AJaeger will review | 17:44 | |
| pabelanger | 1 yellow shard left | 17:44 |
| pabelanger | \o/ | 17:44 |
| anteaya | yay! | 17:44 |
| *** javeriak_ has joined #openstack-infra | 17:44 | |
| clarkb | cluster might actually go green for the first time in ever | 17:45 |
| pabelanger | woah | 17:45 |
| AJaeger | cool! | 17:45 |
| *** javeriak has quit IRC | 17:46 | |
| mordred | clarkb: woot! | 17:46 |
| clarkb | pabelanger: once it goes green I think we are good to do 04 | 17:47 |
| * mordred hands clarkb a cake that he promises he's done almost nothing to | 17:47 | |
| clarkb | mordred: do you have bacon and eggs? feel like bacon and eggs for breakfast | 17:47 |
| anteaya | gerrit is painfully slow | 17:47 |
| pabelanger | clarkb: woah, what is purple? | 17:47 |
| anteaya | can I advocate for a restart? | 17:47 |
| clarkb | pabelanger: relocating, you can ignore those | 17:47 |
| *** dprince has joined #openstack-infra | 17:48 | |
| pabelanger | okay, all green now | 17:48 |
| clarkb | pabelanger: it does that to better balance shards across the hosts | 17:48 |
| mordred | clarkb: I _had_ bacon and eggs | 17:48 |
| mordred | clarkb: but I have now eaten them | 17:48 |
| anteaya | I see cluster health: green (110 of 110) | 17:48 |
| pabelanger | clarkb: anteaya: disabling transient allocation | 17:48 |
| anteaya | pabelanger clarkb ack | 17:48 |
| clarkb | anteaya: we can restart gerrit, might be good to see if zaro has any input first though | 17:48 |
| anteaya | clarkb: fair enough, has anyone seen him so far today? | 17:49 |
| anteaya | zaro: you about? | 17:49 |
| clarkb | I haven't seen zaro | 17:49 |
| anteaya | I have not either | 17:49 |
| pabelanger | okay, stopping es04 | 17:50 |
| *** dizquierdo has quit IRC | 17:50 | |
| anteaya | pabelanger clarkb ack | 17:50 |
| pabelanger | now tarting | 17:50 |
| pabelanger | starting* | 17:50 |
| *** jamesmcarthur has quit IRC | 17:51 | |
| *** jamesmcarthur_ is now known as jamesmcarthur | 17:51 | |
| pabelanger | es04 back online, enabling transient allocation | 17:51 |
| AJaeger | clarkb, anteaya, pabelanger: So, if tarballs is the proper place (and I just checked zanata docs, there's no documented way that I could find for downloading pot files), please review https://review.openstack.org/#/c/309560/ once gerrit works again for you. | 17:51 |
| *** rm_work has joined #openstack-infra | 17:51 | |
| zaro | anteaya, clarkb : forgot my morning today. catching up with discussion now | 17:52 |
| pabelanger | clarkb: anteaya: I see 3 yellow shards currently | 17:52 |
| clarkb | pabelanger: ya looks good. iam going to go find breakfast now that I thoguht about bacon and eggs | 17:53 |
| clarkb | will keep an eye on irc | 17:53 |
| pabelanger | clarkb: ack | 17:53 |
| anteaya | clarkb: enjoy food | 17:53 |
| anteaya | pabelanger: yay fast reallocation | 17:53 |
| zaro | clarkb: did we do anything yet? | 17:53 |
| anteaya | zaro: yes we are interested in your thoughts on gerrit | 17:53 |
| HenryG | Hi, the Neutron unit test jobs are sometimes getting eventlet dependency failures and I can't figure out why. | 17:53 |
| zaro | anteaya: is it slow for others? | 17:53 |
| anteaya | zaro: just looked at the memory usage | 17:53 |
| anteaya | zaro: yes | 17:54 |
| HenryG | Example: http://logs.openstack.org/46/303346/40/check/gate-neutron-python27/daa7202/console.html#_2016-05-04_08_13_37_325 | 17:54 |
| anteaya | zaro: I looked at http://cacti.openstack.org/cacti/graph.php?action=view&local_graph_id=27&rra_id=all clarkb looked at java melody | 17:54 |
| anteaya | zaro: also 502 errors again | 17:54 |
| anteaya | hey HenryG | 17:55 |
| HenryG | Hello there anteaya | 17:55 |
| anteaya | HenryG: I'm trying to recall the last time we had an evenlet version issue question | 17:55 |
| anteaya | my mind is foggy on this | 17:55 |
| anteaya | it may have come up during summit? | 17:55 |
| anteaya | I can't recall who had the issue or what the fix was | 17:56 |
| *** vkramskikh has joined #openstack-infra | 17:56 | |
| anteaya | HenryG: I feel that is less than helpful for your needs | 17:56 |
| openstackgerrit | Merged openstack-infra/project-config: add tarball jobs to puppet-tripleo https://review.openstack.org/313063 | 17:56 |
| HenryG | anteaya: I did a codesearch for eventlet===0.19.0 and got nothing, so I don't know where that upperconstraint is coming from. | 17:56 |
| *** StevenK has joined #openstack-infra | 17:56 | |
| *** tosky_ has quit IRC | 17:56 | |
| anteaya | yeah that whole topic is voodoo to me | 17:57 |
| anteaya | sigh | 17:57 |
| anteaya | I don't know what to suggest | 17:57 |
| anteaya | not very helpful | 17:57 |
| *** Sukhdev has quit IRC | 17:57 | |
| zaro | anteaya, clarkb : i remember there was a bug on a query that would make gerrit slow. maybe we should look to see if that's the issue first | 17:58 |
| anteaya | zaro: sounds fine to me, are you able to take care of that investigation? | 17:58 |
| *** electrofelix has quit IRC | 17:59 | |
| *** Sukhdev has joined #openstack-infra | 17:59 | |
| *** ewilson has quit IRC | 18:00 | |
| zaro | anteaya: no, would require admin to look at connections i think | 18:00 |
| *** ewilson has joined #openstack-infra | 18:00 | |
| zaro | clarkb: maybe look for this, https://code.google.com/p/gerrit/issues/detail?id=4036 | 18:00 |
| anteaya | thanks he is having breakfast now | 18:01 |
| openstackgerrit | Adam Coldrick proposed openstack-infra/storyboard: Allow the creation of private stories https://review.openstack.org/310952 | 18:01 |
| *** Jeffrey4l has quit IRC | 18:01 | |
| mgagne | HenryG: it's coming from this dependent change: https://review.openstack.org/#/c/309273/14 (Depends-On: Icd3c2d243424e4396218ff43b857c8d7e4bf6f75) | 18:01 |
| anteaya | pabelanger: two yellow shards both of which are increasing in size | 18:03 |
| pabelanger | anteaya: ack | 18:03 |
| *** thorst_ has joined #openstack-infra | 18:04 | |
| HenryG | mgagne: thanks. I guess we will be getting a few hits until that goes all green? | 18:04 |
| mgagne | HenryG: I just happened to read backlog, I'm not sure about the specific of your issue or the underlying issue | 18:05 |
| pabelanger | anteaya: clarkb: green now | 18:06 |
| anteaya | pabelanger clarkb yay | 18:06 |
| clarkb | cool, on to 3 now | 18:06 |
| pabelanger | yup | 18:06 |
| pabelanger | allocation disabled | 18:07 |
| pabelanger | stopping es03 | 18:07 |
| pabelanger | now starting | 18:08 |
| pabelanger | es03 back online | 18:09 |
| anteaya | that is a pretty purple | 18:09 |
| pabelanger | enabling transient allocation now | 18:09 |
| pabelanger | okay, I only see 1 yellow shard now | 18:10 |
| anteaya | I have one yellow one purple | 18:10 |
| pabelanger | woah, green | 18:11 |
| pabelanger | that was fast | 18:11 |
| anteaya | yay fast | 18:11 |
| pabelanger | okay, moving to es02 | 18:11 |
| *** salv-orlando has quit IRC | 18:11 | |
| pabelanger | clarkb: anteaya ^ | 18:11 |
| anteaya | ack | 18:11 |
| pabelanger | transient allocation disabled | 18:11 |
| *** yottatsa has quit IRC | 18:12 | |
| *** Sukhdev has quit IRC | 18:12 | |
| pabelanger | stopping elastic search | 18:12 |
| *** Sukhdev has joined #openstack-infra | 18:12 | |
| *** yottatsa has joined #openstack-infra | 18:12 | |
| pabelanger | starting now | 18:12 |
| *** yottatsa has quit IRC | 18:12 | |
| anteaya | I can't get elasticsearch-head to connect | 18:12 |
| clarkb | anteaya: 02 is the one behind the proxy | 18:13 |
| anteaya | ah | 18:13 |
| pabelanger | es02 online now | 18:13 |
| anteaya | I'm dark then | 18:13 |
| pabelanger | enabling transient allocation again | 18:13 |
| pabelanger | elasticsearch-head back online for me now | 18:13 |
| *** dlundquist has joined #openstack-infra | 18:13 | |
| anteaya | elasticsearch-head is also back online for me too | 18:15 |
| dlundquist | I'm experiencing some strangeness with my gerrit account: I doesn't show all my patches as my own -- patches to openstack/neutron-lib do not appear on my dashboard, and I can't abandon them | 18:15 |
| anteaya | two purple one yellow shards | 18:15 |
| anteaya | dlundquist: well for starters gerrit is a bit slow at the moment due to memory issues | 18:15 |
| *** yolanda has quit IRC | 18:15 | |
| dlundquist | anteaya: I noticed this first last week at the summit | 18:16 |
| anteaya | so it is possible that right this minute that may be the source of the issue | 18:16 |
| anteaya | dlundquist: ah thank you that helps | 18:16 |
| pabelanger | clarkb: anteaya: I am showing a green cluster now | 18:16 |
| clarkb | yay | 18:16 |
| clarkb | all done then ty ty | 18:16 |
| anteaya | pabelanger clarkb green, yay | 18:16 |
| anteaya | clarkb: woot, thanks for teaching us | 18:16 |
| AJaeger | dlundquist: please show a change that works and one that doesn't | 18:16 |
| pabelanger | great! | 18:16 |
| anteaya | dlundquist: I'm guessing you have managed to give yourself two gerrit accounts | 18:16 |
| pabelanger | Ya, interesting watching elasticsearch do its thing | 18:16 |
| anteaya | dlundquist: if so, a gerrit admin will need to search the db and see what is happening | 18:17 |
| dlundquist | https://review.openstack.org/#/c/310909/ <- Bad, https://review.openstack.org/#/c/310954/ <- Good | 18:17 |
| *** ddieterly[away] is now known as ddieterly | 18:18 | |
| anteaya | yup there are two Dustin Lunquists in the gerrit db | 18:18 |
| anteaya | both have the same email address | 18:18 |
| *** burgerk_ has joined #openstack-infra | 18:18 | |
| AJaeger | one has username dustin.lundquist (good one), the other dlundquist (bad one) | 18:19 |
| *** Nakato has quit IRC | 18:19 | |
| *** sridhar_ram1 is now known as sridhar_ram | 18:20 | |
| dlundquist | AJaeger: How difficult is it to merge them? | 18:20 |
| fungi | wow. 400 lines over lunch? that's a lot of scrollback for the week after the summit... | 18:20 |
| AJaeger | dlundquist: for me impossible ;) You need an infra-root, not sure how easy that is... | 18:21 |
| *** craige has quit IRC | 18:21 | |
| openstackgerrit | Ben Nemec proposed openstack-infra/tripleo-ci: Calculate deployment times for the Heat resources https://review.openstack.org/313097 | 18:21 |
| pabelanger | AJaeger: dlundquist: I am not sure how to do that currently | 18:21 |
| clarkb | we dont actuallyerge them | 18:22 |
| *** burgerk has quit IRC | 18:22 | |
| *** Nakato has joined #openstack-infra | 18:22 | |
| clarkb | *merge them | 18:22 |
| clarkb | we disable one account and set its openid as valid on the other | 18:22 |
| clarkb | so step one is identify which of the two accounts you want to use going forward | 18:22 |
| *** inc0 has quit IRC | 18:22 | |
| *** craige has joined #openstack-infra | 18:22 | |
| *** ddieterly is now known as ddieterly[away] | 18:23 | |
| clarkb | pabelanger: it unfortunately involves live db edit to the account_external_ids table | 18:23 |
| dlundquist | I would prefer to use dlundquist for consistency -- will I be the owner of all my reviews | 18:23 |
| clarkb | dlundquist: no we wont update all of the changes | 18:24 |
| clarkb | this is more of a fix it for the future than a fix all the things | 18:24 |
| clarkb | pabelanger: so I hate doing it:) | 18:24 |
| dlundquist | okay | 18:24 |
| dlundquist | so on my end I need to fix the username in my git remotes, anything else? | 18:25 |
| pabelanger | clarkb: same :) | 18:25 |
| clarkb | anteaya do you have the account id numbers? | 18:25 |
| anteaya | clarkb: I do not | 18:25 |
| clarkb | dlundquist: thats about it, but also stop making new accounts | 18:25 |
| anteaya | let me see if I can get them | 18:25 |
| dlundquist | clarkb: now I know, thank you | 18:25 |
| *** jsavak has quit IRC | 18:26 | |
| anteaya | gerrit ids 11255 and 10558: http://paste.openstack.org/show/496258/ | 18:27 |
| anteaya | clarkb pabelanger ^^ | 18:27 |
| clarkb | 10558 is the one we want to keep | 18:28 |
| anteaya | I concur | 18:28 |
| pabelanger | okay | 18:29 |
| pabelanger | let me see about getting some SQL syntax going | 18:29 |
| pabelanger | will update with pastebine | 18:29 |
| pabelanger | pastebin* | 18:29 |
| anteaya | pabelanger: good plan | 18:29 |
| clarkb | pabelanger: careful the user passwords go in that table too | 18:29 |
| clarkb | pabelanger: so you may need to remove some rows | 18:30 |
| anteaya | pabelanger: also since this involved editing the db, you always have the option to say not now if you can't give it 100% focus | 18:30 |
| pabelanger | clarkb: okay, looking for documentation first | 18:30 |
| clarkb | oh I don't think any of this is documented | 18:30 |
| pabelanger | anteaya: right, won't be doing anything until everybody agrees | 18:30 |
| clarkb | but maybe I am wrong | 18:30 |
| anteaya | pabelanger: sounds like a great approach | 18:31 |
| anteaya | clarkb: I don't know of any documentation | 18:31 |
| *** doug-fis_ has joined #openstack-infra | 18:31 | |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Retire operations-guide and ha-guide (1/2) https://review.openstack.org/313104 | 18:31 |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Retire operations-guide and ha-guide (1/2) https://review.openstack.org/313105 | 18:31 |
| *** eil397 has joined #openstack-infra | 18:31 | |
| *** sambetts is now known as sambetts|afk | 18:31 | |
| clarkb | I don't think this is a use case that upstream has ever really considered | 18:31 |
| pabelanger | I see: http://docs.openstack.org/infra/system-config/gerrit.html#combining-gerrit-accounts | 18:31 |
| *** e0ne has quit IRC | 18:32 | |
| clarkb | pabelanger: ya thats something we don't like doing (it even says so there) | 18:32 |
| *** doug-fi__ has joined #openstack-infra | 18:32 | |
| *** inc0 has joined #openstack-infra | 18:32 | |
| anteaya | pabelanger: look at that | 18:32 |
| clarkb | in this case if you select * from account_external_ids where account_id = 10558; and query for the other id you will see that there are two openids | 18:33 |
| clarkb | and a non overlapping set of emails | 18:33 |
| *** nadya has joined #openstack-infra | 18:33 | |
| * AJaeger cannot count to 2 - just send two patches number 1 of 2 ;( | 18:33 | |
| anteaya | AJaeger: ha ha ha | 18:33 |
| anteaya | AJaeger: I have a story | 18:33 |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Retire operations-guide and ha-guide (2/2) https://review.openstack.org/313105 | 18:33 |
| clarkb | pabelanger: what we want to do is set the openid for the second account to be valid for the first, then gerrit set-account --inactive 11255 | 18:34 |
| anteaya | so long ago I was a camera assistant in film | 18:34 |
| AJaeger | anteaya: at least I double checked ;) | 18:34 |
| *** doug-fish has quit IRC | 18:34 | |
| anteaya | and part of our job was to ensure we tracked all the equipment | 18:34 |
| *** eil397 has left #openstack-infra | 18:34 | |
| *** Sukhdev has quit IRC | 18:34 | |
| anteaya | often we would rent an extra camera package for a day, about 25 separate cases | 18:34 |
| anteaya | and then have to send them all back to the rental house at the end of the day | 18:35 |
| clarkb | pabelanger: fungi is a good one to weigh in on unraveling the openids as he has plenty of experience, I am not sure if the email on the openid row has to match the primary email or what | 18:35 |
| anteaya | each case had to have a label: 1 of 25, 2 of 25 etc | 18:35 |
| AJaeger | fungi: Yes, I'll get the bonus points ;) | 18:35 |
| *** doug-fis_ has quit IRC | 18:35 | |
| anteaya | legend has it a new trainee was being irrattting to his team so they told him to label the cases and went and had a beer | 18:36 |
| anteaya | after 90 minutes he announced he had finished | 18:36 |
| AJaeger | any other project-config core to review my translation publishing change? I'll work now on the followup to not propose pot files... https://review.openstack.org/309560 | 18:36 |
| anteaya | he had labeled all 25 cases, 1 of 25 | 18:36 |
| anteaya | ha ha ha | 18:36 |
| dims | anteaya : LOL | 18:36 |
| AJaeger | Wow! That's worth than me... | 18:36 |
| pabelanger | clarkb: sure, will hold off until fungi responds | 18:36 |
| anteaya | dims: ha ha ha | 18:36 |
| clarkb | zaro: I am not sure how I can check if other people are running that query | 18:36 |
| openstackgerrit | Merged openstack-infra/system-config: Remove infracloud from ansible inventory https://review.openstack.org/312173 | 18:36 |
| anteaya | AJaeger: figured you'd like that | 18:37 |
| AJaeger | ;) | 18:37 |
| fungi | clarkb: pabelanger: yeah, the various db queries in that document are risky. they get exercised less frequently than we upgrade gerrit, so schema changes may render some of it moot or even dangerous | 18:37 |
| clarkb | zaro: gerrit doesnt let us list all of the running queries as far as I know. But the slowness is related to memory use and garbage collecting | 18:37 |
| *** doug-fi__ has quit IRC | 18:37 | |
| pabelanger | fungi: how do you suggest we proceed with dlundquist | 18:38 |
| *** esker has joined #openstack-infra | 18:40 | |
| *** esker has quit IRC | 18:40 | |
| fungi | pabelanger: these days i basically sql update the account_id in account_external_ids for the "wrong" openid url to be whatever the "right" openid url is (so that they can authenticate with either openid and get to the same gerrit account) and then use the gerrit api to set the "wrong" account --inactive via the gerrit ssh api, and then tell gerrit to flush all its caches | 18:40 |
| fungi | er, sql update the account_id in account_external_ids for the "wrong" openid url to be the same as the account_id from the "right" openid url | 18:41 |
| *** doug-fish has joined #openstack-infra | 18:42 | |
| fungi | so something like "update from account_external_ids set account_id=<good account id number> where external_id=<bad id's url>; | 18:42 |
| fungi | " | 18:42 |
| *** doug-fish has quit IRC | 18:42 | |
| *** doug-fish has joined #openstack-infra | 18:43 | |
| *** doug-fish has quit IRC | 18:43 | |
| *** doug-fish has joined #openstack-infra | 18:43 | |
| clarkb | s/from// | 18:43 |
| fungi | afaict everything associated with the "bad" id is ignored once that account is set --inactive | 18:43 |
| fungi | yep, clarkb sqlizes superiorly | 18:44 |
| *** doug-fish has quit IRC | 18:44 | |
| *** tqtran has quit IRC | 18:44 | |
| * fungi is a poor excuse for a dba | 18:44 | |
| *** ddieterly[away] is now known as ddieterly | 18:44 | |
| *** doug-fish has joined #openstack-infra | 18:44 | |
| *** flwang1 has joined #openstack-infra | 18:44 | |
| pabelanger | fungi: do you mind doing it this time? And posting your steps? | 18:45 |
| fungi | pabelanger: sure | 18:45 |
| fungi | just a sec | 18:45 |
| mgagne | http://docs.openstack.org/infra/system-config/gerrit.html#combining-gerrit-accounts ? | 18:45 |
| *** esker has joined #openstack-infra | 18:45 | |
| anteaya | mgagne: yeah pabelanger linked that above | 18:45 |
| *** nadya has quit IRC | 18:46 | |
| anteaya | we were commenting on the bit that says infra doesn't like doing this | 18:46 |
| pabelanger | anteaya: did you get a chance to load 313064 for review? | 18:46 |
| fungi | mgagne: assumed incomplete/incorrect, probably last tested under gerrit 2.8 or maybe even 2.4 | 18:46 |
| anteaya | pabelanger: I can't remember, I'll check again | 18:46 |
| mgagne | :O | 18:46 |
| *** jsavak has joined #openstack-infra | 18:46 | |
| mgagne | will be careful when using those steps on my side :O | 18:46 |
| fungi | mgagne: nowadays we mostly just burn the old account down and assume it's gone | 18:46 |
| anteaya | pabelanger: I had +A'd and it had gotten stuck | 18:46 |
| anteaya | pabelanger: hopefully it is on its way now | 18:47 |
| fungi | mgagne: this is probably something that would make a good upstream feature request, and none of us has likely thought to file it | 18:47 |
| openstackgerrit | David Lyle proposed openstack-infra/project-config: Adding tempest-horizon repo and job https://review.openstack.org/312272 | 18:47 |
| pabelanger | anteaya: great, thanks | 18:47 |
| *** nadya has joined #openstack-infra | 18:47 | |
| fungi | mgagne: mostly gerrit treats openid accounts as an afterthought though, so they likely don't even know this is suboptimal | 18:48 |
| mgagne | https://code.google.com/p/gerrit/issues/detail?id=567 | 18:48 |
| mgagne | not much progress since 2010-2013 | 18:48 |
| jlvillal | Getting 502 proxy error from Gerrit. Not sure if known issue. | 18:48 |
| anteaya | pabelanger: welcome, thanks for the reminder, the comment window was stuck open in my browser | 18:48 |
| * jlvillal just got back from lunch | 18:48 | |
| *** sdake has joined #openstack-infra | 18:48 | |
| anteaya | jlvillal: yes thank you | 18:48 |
| clarkb | jlvillal: ya it has run out of memory again /me is waiting for zaro to get back to on our latest query | 18:48 |
| jlvillal | Thanks! | 18:49 |
| fungi | pabelanger: ssh review.openstack.org | 18:49 |
| *** doug-fish has quit IRC | 18:49 | |
| fungi | sudo -H mysql | 18:49 |
| clarkb | zaro: so ya I don't know how to check if that type of query is affecting us | 18:49 |
| andreaf | hi - small project-config review please, adding tempest test with ssh enabled to periodic: https://review.openstack.org/#/c/313051/ | 18:49 |
| *** doug-fish has joined #openstack-infra | 18:50 | |
| *** tqtran has joined #openstack-infra | 18:50 | |
| *** nadya has quit IRC | 18:50 | |
| fungi | pabelanger: use reviewdb; | 18:52 |
| fungi | update account_external_ids set account_id=10558 where account_id=11255 and external_id like "https://login.launchpad.net/%"; | 18:52 |
| fungi | ssh review.openstack.org -p 29418 gerrit set-account --inactive 11255 | 18:53 |
| fungi | ssh review.openstack.org -p 29418 gerrit flush-caches | 18:53 |
| fungi | pabelanger: that's all done (cache flushing is in progress now) | 18:54 |
| *** sdake_ has joined #openstack-infra | 18:55 | |
| pabelanger | fungi: great, thanks | 18:55 |
| fungi | so much slow gerrit | 18:55 |
| anteaya | so much | 18:56 |
| clarkb | ya I can't find a way to check on the thing zaro mentioned | 18:56 |
| clarkb | we proably ashould just restart it | 18:56 |
| anteaya | +1 restart | 18:56 |
| fungi | dlundquist: if you were previously seeing an account id of 11255 at https://review.openstack.org/#/settings/ then you should log out and back in and it will now be the older 10558 account | 18:56 |
| nibalizer | +1 reboat | 18:56 |
| *** sdake has quit IRC | 18:57 | |
| anteaya | rowboats | 18:57 |
| fungi | we're going to need a bigger reboat | 18:57 |
| fungi | flush-caches is _still_ underway | 18:58 |
| dlundquist | fungi: thank you, I'm logging in as 10558 now | 18:58 |
| fungi | finally completed | 18:58 |
| anteaya | yay! | 18:58 |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Do not store source translation files in git https://review.openstack.org/313114 | 18:59 |
| anteaya | who wants to restart? | 18:59 |
| *** hdaniel has joined #openstack-infra | 18:59 | |
| zaro | clarkb: does show connections show it? | 18:59 |
| clarkb | zaro: I don't think so but I can double check | 19:00 |
| clarkb | zaro: because most queries will be via http | 19:00 |
| *** piet has quit IRC | 19:00 | |
| zaro | clarkb: i think we saw that query coming from 3rd party ci in the past | 19:00 |
| openstackgerrit | Merged openstack-infra/project-config: Add experimental ubuntu-precise infra jobs https://review.openstack.org/313064 | 19:00 |
| *** piet has joined #openstack-infra | 19:01 | |
| clarkb | session start idle user host | 19:01 |
| clarkb | those are teh columns | 19:01 |
| zaro | clarkb: it was from either REST or ssh | 19:02 |
| *** thiagop is now known as thiagop-afk | 19:02 | |
| anteaya | zaro: I don't know that it was a third party ci | 19:03 |
| AJaeger | anteaya, clarkb, pabelanger: Could either of you review the translation pot publishing change https://review.openstack.org/309560 , please? | 19:03 |
| clarkb | zaro: show-conncetions is ssh | 19:04 |
| clarkb | but it doens't show you what command or query is being run | 19:04 |
| *** thiagop has joined #openstack-infra | 19:04 | |
| clarkb | anyways I thin kwe should restart gerrit now. I don't see a way to interrogate gerrit for this info | 19:04 |
| anteaya | AJaeger: 309560 +A | 19:05 |
| anteaya | clarkb: ++ restart | 19:05 |
| anteaya | rowboat | 19:05 |
| anteaya | big boats | 19:05 |
| anteaya | whatever it takes | 19:05 |
| clarkb | fungi: nibalizer pabelanger as the other active roots what say you? | 19:06 |
| AJaeger | thanks, anteaya | 19:06 |
| anteaya | AJaeger: welcome | 19:06 |
| fungi | tear it all down | 19:06 |
| anteaya | fungi: that's the spirit | 19:06 |
| *** ccamacho has joined #openstack-infra | 19:06 | |
| zaro | clarkb: how about close connections to see if that fixes it? | 19:06 |
| clarkb | zaro: there are several hundred | 19:07 |
| clarkb | I wouldn't know where to start | 19:07 |
| *** bpokorny_ has joined #openstack-infra | 19:07 | |
| zaro | clarkb: close all? | 19:07 |
| clarkb | zaro: but I don't think this is the issue, the issue is we have no memory and spend a ton of time garbage collecting | 19:07 |
| *** bpokorny_ has quit IRC | 19:08 | |
| nibalizer | clarkb: i already +1'd restarting | 19:08 |
| nibalizer | i said reboat though | 19:08 |
| *** bpokorny_ has joined #openstack-infra | 19:08 | |
| nibalizer | becuase I have to add my little flavoring to everything... it a problem | 19:08 |
| fungi | yeah, it seems unlikely that _running_ queries would impact gc workload | 19:08 |
| *** doug-fish has quit IRC | 19:08 | |
| fungi | maybe completed queries would contribute to it? | 19:09 |
| *** javeriak_ has quit IRC | 19:09 | |
| zaro | clarkb: are we sure gc is running now? | 19:09 |
| clarkb | zaro: according to melody yes | 19:09 |
| clarkb | zaro: its the same symptoms as before we upgraded the host | 19:09 |
| zaro | ok, i thought connections is contributing to the problem | 19:09 |
| fungi | just less often because now it takes more time to fill all our memory | 19:09 |
| clarkb | my initial reaction is that gerrit has a rather unfortunate memory leak somewhere | 19:10 |
| anteaya | clarkb: I'll jump on that wagon | 19:10 |
| fungi | and is relying on periodic garbage collection in the vm to chip away at it | 19:10 |
| fungi | s/vm/jvm/ | 19:10 |
| zaro | argh! maybe it's version we are using. i've not seen anybody else report memory leaks on 2.11 | 19:10 |
| *** bpokorny has quit IRC | 19:10 | |
| anteaya | zaro: the version of what? the jvm version? | 19:11 |
| fungi | presumably gerrit version | 19:11 |
| zaro | the version of gerrit, or fork of gerrit | 19:11 |
| fungi | 2.11.4-11-ga14450f | 19:11 |
| fungi | we could try re-syncing to latest 2.11.x | 19:12 |
| zaro | latest 2.11 is something like 2.11.8 now | 19:12 |
| *** piet has quit IRC | 19:12 | |
| anteaya | fungi: what would that entail? | 19:12 |
| fungi | changelog for newer 2.11 mentions memory leak fixes? or just guessing they might have accidentally fixed some? | 19:12 |
| fungi | anteaya: fast-forward our openstack/2.11 branch and reapply any outstanding backports we're maintaining | 19:13 |
| *** maishsk has joined #openstack-infra | 19:13 | |
| anteaya | I'm guessing maintenance window, db backups etc as well? | 19:13 |
| *** signed8bit is now known as signed8bit_Zzz | 19:13 | |
| fungi | anteaya: we could do db backups, but mostly i think it's just a gerrit restart. presumably we wouldn't need an offline reindex to go between 2.11.x versions | 19:14 |
| *** akshai has quit IRC | 19:14 | |
| zaro | reindex not required | 19:14 |
| anteaya | okay | 19:14 |
| *** akshai has joined #openstack-infra | 19:14 | |
| anteaya | so restart today, propose the patch for the update and schedule a time for the restart to fast-forward? | 19:15 |
| *** nadya has joined #openstack-infra | 19:15 | |
| fungi | that's a possibility. still feels like a punt though... we don't know why it's leaking uncollected allocations, and so we don't have any context to suggest it's fixed in a later 2.11 point release | 19:16 |
| zaro | quick review of release notes doesn't seem to indicate any fixes for memory leaks | 19:16 |
| zaro | it could be that we have configured gerrit in a way to expose a leak which other places have not | 19:17 |
| fungi | re-syncing with upstream is still not a terrible suggestion, because it's hygienically good to do periodically anyway | 19:17 |
| openstackgerrit | Paul Belanger proposed openstack-infra/bindep: [WIP] Add ubuntu-precise support https://review.openstack.org/313121 | 19:17 |
| zaro | +1 | 19:18 |
| clarkb | and we need that patch to alway emit data in events | 19:18 |
| fungi | i just wouldn't put a lot of hope in it solving this issue | 19:18 |
| clarkb | ya | 19:18 |
| clarkb | ok who is restarting gerrit? Should I do it now? | 19:18 |
| clarkb | someone else want todo it? | 19:18 |
| anteaya | clarkb: yes please | 19:18 |
| fungi | i can | 19:18 |
| zaro | on a side note, just noticed that SAP moved to 2.12 and had lots of issues. | 19:18 |
| anteaya | fungi: yes please | 19:18 |
| clarkb | fungi: why don't you do it so I can continue to rest and not worry too much about computers | 19:19 |
| anteaya | zaro: is there a list of the issues? | 19:19 |
| anteaya | clarkb: yes rest | 19:19 |
| fungi | #status notice Gerrit is restarting to address performance issues related to a suspected memory leak | 19:19 |
| openstackstatus | fungi: sending notice | 19:19 |
| zaro | anteaya: https://groups.google.com/d/msg/repo-discuss/lzv_vvcOaKQ/I2XUXsADBAAJ | 19:21 |
| -openstackstatus- NOTICE: Gerrit is restarting to address performance issues related to a suspected memory leak | 19:21 | |
| anteaya | zaro: thank you | 19:21 |
| openstackgerrit | Merged openstack-infra/project-config: Translations: Publish pot files to tarballs.o.o https://review.openstack.org/309560 | 19:22 |
| openstackstatus | fungi: finished sending notice | 19:22 |
| anteaya | zaro: wow | 19:23 |
| *** signed8bit_Zzz is now known as signed8bit | 19:23 | |
| AJaeger | team, I fear we have to revert https://review.openstack.org/#/c/308731/ - the display of jobs (sucess/fails) is now completely broken ;( | 19:25 |
| *** mriedem has quit IRC | 19:25 | |
| anteaya | indexing continues to be unhappy making | 19:25 |
| AJaeger | could you double check, please? | 19:25 |
| anteaya | AJaeger: can you offer the revert? | 19:25 |
| * AJaeger does not see Success / Fail anymore. | 19:25 | |
| AJaeger | anteaya: on my way... | 19:25 |
| anteaya | AJaeger: thanks | 19:25 |
| anteaya | AJaeger: also have you a recent example patch that shows the new behaviour? | 19:26 |
| *** trown is now known as trown|outtypewww | 19:26 | |
| fungi | anteaya: just force reload gerrit | 19:26 |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/system-config: Revert "Fix URL detection in testresult match" https://review.openstack.org/313125 | 19:26 |
| fungi | AJaeger: approving now and will restart again as soon as it propagates | 19:26 |
| AJaeger | anteaya: take any and force reload ;( | 19:26 |
| AJaeger | thanks, fungi. So, back to drawing board - ianw, can you try again, please? | 19:27 |
| * zaro afk for about 1.5 hrs | 19:27 | |
| anteaya | zaro: ack thank you | 19:27 |
| anteaya | AJaeger: fungi thank you | 19:27 |
| *** e0ne has joined #openstack-infra | 19:27 | |
| pabelanger | fungi: clarkb are we interested in standing up ubuntu precise deb mirror for our dib, or simply skipping precise in nodepool/scripts/configure_mirror.sh? | 19:29 |
| *** akshai has quit IRC | 19:29 | |
| pabelanger | see: http://logs.openstack.org/21/313121/1/experimental/gate-bindep-bindep-fallback-ubuntu-precise/c441286/console.html | 19:29 |
| *** trown|outtypewww is now known as trown | 19:29 | |
| clarkb | pabelanger: skip precise, it is going away soon anyways | 19:29 |
| clarkb | and we never had a mirror for it | 19:29 |
| pabelanger | I am cool with that | 19:29 |
| fungi | yeah, seems like excess work for little gain | 19:29 |
| *** akshai has joined #openstack-infra | 19:30 | |
| *** zeih has joined #openstack-infra | 19:30 | |
| *** doug-fish has joined #openstack-infra | 19:31 | |
| *** kzaitsev_mb has quit IRC | 19:32 | |
| *** trown is now known as trown|outtypewww | 19:32 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/project-config: Don't configure deb mirrors for ubuntu-precise https://review.openstack.org/313129 | 19:33 |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Get translation jobs into healthcheck https://review.openstack.org/311459 | 19:33 |
| pabelanger | clarkb: fungi: ^ | 19:33 |
| anteaya | <-- afk for a bit | 19:34 |
| *** nadya has quit IRC | 19:36 | |
| *** doug-fish has quit IRC | 19:36 | |
| *** matt-borland has quit IRC | 19:38 | |
| *** kzaitsev_mb has joined #openstack-infra | 19:43 | |
| *** doug-fish has joined #openstack-infra | 19:44 | |
| *** doug-fish has quit IRC | 19:49 | |
| EmilienM | pabelanger: do you know why only lint job ran on https://review.openstack.org/#/c/305886/ ? | 19:50 |
| EmilienM | is it because we restarted something or? | 19:50 |
| *** doug-fish has joined #openstack-infra | 19:50 | |
| pabelanger | EmilienM: I think something is broken? cc AJaeger | 19:50 |
| pabelanger | EmilienM: look in comments | 19:51 |
| EmilienM | I did recheck, it looks ok | 19:52 |
| *** dprince has quit IRC | 19:54 | |
| fungi | EmilienM: click "toggle ci" and then expand the comment left by jenkins | 19:54 |
| fungi | gate-puppet-openstack-integration-3-scenario003-tempest-centos-7 FAILUREin 19m 41s | 19:54 |
| EmilienM | mhh ok I was wondering why the jobs report was different | 19:54 |
| *** e0ne has quit IRC | 19:55 | |
| fungi | EmilienM: once https://review.openstack.org/313125 merges and propagates i'll restart gerrit again and get it back to normal | 19:55 |
| openstackgerrit | greghaynes proposed openstack/diskimage-builder: Add tinycorelinux element https://review.openstack.org/311647 | 19:55 |
| openstackgerrit | greghaynes proposed openstack/diskimage-builder: Split pip out of pip-and-virtualenv https://review.openstack.org/311651 | 19:55 |
| EmilienM | cool | 19:56 |
| *** zeih has quit IRC | 19:56 | |
| *** piet has joined #openstack-infra | 19:57 | |
| *** piet has quit IRC | 19:57 | |
| *** thiagop has quit IRC | 19:58 | |
| AJaeger | and that change just had several timeouts ;( | 19:59 |
| openstackgerrit | Paul Belanger proposed openstack-infra/tripleo-ci: [WIP] Initial support for centos-7 jenkins slave https://review.openstack.org/312725 | 20:01 |
| *** daemontool_ has quit IRC | 20:01 | |
| *** bpokorny_ has quit IRC | 20:02 | |
| sdague | fungi: something seems odd in the way jobs are reporting to gerrit | 20:03 |
| *** bpokorny has joined #openstack-infra | 20:03 | |
| sdague | like a format break | 20:03 |
| sdague | https://review.openstack.org/#/c/168438/50 last Jenkins is a good example | 20:03 |
| fungi | sdague: https://review.openstack.org/313125 is a revert for that | 20:03 |
| AJaeger | sdague: https://review.openstack.org/313125 | 20:03 |
| fungi | as soon as it propagates i'll restart gerrit again | 20:03 |
| AJaeger | sdague: so, thanks for reporting, should be fixed again soonish | 20:04 |
| sdague | ah, yeh, .+ is never a good idea | 20:04 |
| * fungi debates sending a status notice about it now that several people have asked | 20:04 | |
| pabelanger | clarkb: managed to get tripleo-ci working on our centos-7 dib. Pretty happy about that | 20:04 |
| pabelanger | clarkb: a little more testing, then we should be able to retire the fedora-22 snapshot build | 20:04 |
| *** Sukhdev has joined #openstack-infra | 20:06 | |
| *** hdd has quit IRC | 20:06 | |
| AJaeger | fungi, I'm in favour of status notice | 20:07 |
| fungi | i was hoping to just send one more on the next restart but didn't anticipate jobs to have to be retriggered | 20:07 |
| AJaeger | yeah ;( | 20:07 |
| fungi | though we're 2 minutes from gating at this point, so i'll hold off | 20:07 |
| fungi | almost in the clear | 20:08 |
| AJaeger | great | 20:08 |
| *** ayoung has quit IRC | 20:10 | |
| AJaeger | passed check queue... | 20:10 |
| *** hamzy has quit IRC | 20:10 | |
| openstackgerrit | Merged openstack-infra/project-config: NPM Jobs now run on Xenial https://review.openstack.org/312742 | 20:11 |
| *** jkraj has quit IRC | 20:11 | |
| *** amrith is now known as _amrith_ | 20:11 | |
| AJaeger | Is puppet stuck somehow? http://puppetboard.openstack.org/node/proposal.slave.openstack.org hasn't been updated for 63 mins - and I'm eager to see pot uploads to tarball ;) | 20:12 |
| fungi | chances are ansible is hung again | 20:12 |
| *** piet has joined #openstack-infra | 20:13 | |
| *** vgridnev has joined #openstack-infra | 20:13 | |
| *** rhallisey has quit IRC | 20:14 | |
| *** rhallisey has joined #openstack-infra | 20:14 | |
| *** rhallisey has quit IRC | 20:14 | |
| pabelanger | nope, it is still running | 20:15 |
| *** rhallisey has joined #openstack-infra | 20:15 | |
| pabelanger | I've been tailing logs for a while | 20:15 |
| *** flwang1 has quit IRC | 20:17 | |
| *** alex_xu has quit IRC | 20:18 | |
| AJaeger | that's long and strange - the run times are irregular: 8:08;8:38;8:53;9:08 - and now 70 mins nothing.. | 20:18 |
| AJaeger | (that's local time) | 20:18 |
| openstackgerrit | Ben Nemec proposed openstack-infra/tripleo-ci: TEST: Delete the overcloud when finished https://review.openstack.org/297328 | 20:19 |
| openstackgerrit | Ben Nemec proposed openstack-infra/tripleo-ci: Test overcloud deletion in periodic job https://review.openstack.org/296765 | 20:19 |
| openstackgerrit | Merged openstack-infra/system-config: Revert "Fix URL detection in testresult match" https://review.openstack.org/313125 | 20:19 |
| openstackgerrit | Paul Belanger proposed openstack-infra/project-config: Add experimental centos-7 jobs to check-tripleo-jobs https://review.openstack.org/313146 | 20:19 |
| AJaeger | fungi: gerrit change merged ^ | 20:20 |
| rcarrillocruz | clarkb, pabelanger : i'd appreciate if you could give some love to https://review.openstack.org/#/q/topic:cloud_launcher | 20:22 |
| *** egafford has left #openstack-infra | 20:22 | |
| *** alex_xu has joined #openstack-infra | 20:22 | |
| fungi | AJaeger: thanks. i think now it should be safe enough for me to hand-patch on the server and restart it since puppet won't re-restart if it flip-flops a couple times | 20:23 |
| openstackgerrit | Paul Belanger proposed openstack-infra/tripleo-ci: [WIP] Initial support for centos-7 jenkins slave https://review.openstack.org/312725 | 20:25 |
| AJaeger | yeah, puppet finished on proposal slave | 20:25 |
| *** arxcruz has joined #openstack-infra | 20:26 | |
| *** diana_clarke has joined #openstack-infra | 20:26 | |
| *** inc0 has quit IRC | 20:27 | |
| *** oanson has quit IRC | 20:27 | |
| fungi | #status notice Gerrit is restarting to revert incorrect changes to test result displays | 20:28 |
| openstackstatus | fungi: sending notice | 20:28 |
| *** inc0 has joined #openstack-infra | 20:28 | |
| samueldmq | hi | 20:28 |
| *** banix has quit IRC | 20:28 | |
| samueldmq | oops, was about to report 503 from gerrit (cc fungi) | 20:28 |
| samueldmq | :) | 20:28 |
| openstackgerrit | Paul Belanger proposed openstack-infra/tripleo-ci: [WIP] Initial support for centos-7 jenkins slave https://review.openstack.org/312725 | 20:28 |
| fungi | EmilienM: sdague: AJaeger: should be all fixed now | 20:29 |
| -openstackstatus- NOTICE: Gerrit is restarting to revert incorrect changes to test result displays | 20:29 | |
| pabelanger | rcarrillocruz: Ya, I should have some time tomorrow morning to dive into it. Going to try setting up devstack to use it | 20:29 |
| EmilienM | fungi: ack | 20:29 |
| AJaeger | thanks, fungi! | 20:29 |
| fungi | AJaeger: thanks for spotting/reverting | 20:29 |
| *** dmk0202 has joined #openstack-infra | 20:29 | |
| * AJaeger pushed that change and was eager to have it ;( | 20:30 | |
| fungi | well, at least we know now what _not_ to do in that regex, so maybe the next try will be better. we could also test it out on review-dev for added safety | 20:30 |
| openstackstatus | fungi: finished sending notice | 20:30 |
| *** tonytan4ever has quit IRC | 20:31 | |
| AJaeger | ;) | 20:32 |
| *** tonytan4ever has joined #openstack-infra | 20:32 | |
| openstackgerrit | Emilien Macchi proposed openstack-infra/project-config: stop puppet-unit 3.3 and 3.4 jobs starting from newton https://review.openstack.org/313149 | 20:34 |
| EmilienM | nibalizer: also need your eyes on ^ | 20:34 |
| *** daemontool_ has joined #openstack-infra | 20:35 | |
| *** sdake has joined #openstack-infra | 20:35 | |
| *** sdake_ has quit IRC | 20:36 | |
| *** arxcruz has quit IRC | 20:37 | |
| *** sdague has quit IRC | 20:37 | |
| AJaeger | yeah, pot files are uploaded : http://tarballs.openstack.org/translation-source/keystone/ | 20:38 |
| AJaeger | but missing the version ;( | 20:39 |
| *** kzaitsev_mb has quit IRC | 20:39 | |
| openstackgerrit | Ben Nemec proposed openstack-infra/tripleo-ci: Calculate deployment times for the Heat resources https://review.openstack.org/313097 | 20:44 |
| *** kgiusti has quit IRC | 20:45 | |
| *** thorst_ has quit IRC | 20:46 | |
| *** piet has quit IRC | 20:46 | |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Fix publishing location for translations https://review.openstack.org/313152 | 20:48 |
| AJaeger | anteaya, fungi: My latest change published to wrong location, could you review the above and merge soon if you have time, please? | 20:48 |
| AJaeger | project-config cores - reviews are welcome ^ Thanks! | 20:49 |
| *** amit213 has joined #openstack-infra | 20:50 | |
| anteaya | AJaeger: +2 | 20:50 |
| AJaeger | thanks! | 20:50 |
| anteaya | welcome | 20:51 |
| *** esker has quit IRC | 20:52 | |
| *** thorst_ has joined #openstack-infra | 20:53 | |
| fungi | AJaeger: with keep-heirarchy: true that's going to create tarballs/translation-source/**/*.pot not tarballs/**/*.pot right? | 20:54 |
| fungi | looks like that's what's intended though | 20:55 |
| fungi | approving | 20:55 |
| fungi | i should have looked at the script changes first | 20:55 |
| AJaeger | fungi, yes, that's what I want. right now it publishes to http://tarballs.openstack.org/translation-source/nova/ - without the version in it. | 20:56 |
| AJaeger | And I want http://tarballs.openstack.org/translation-source/nova/master/*.pot | 20:56 |
| fungi | yeah, makes sense. thanks! | 20:56 |
| AJaeger | so, expect that it now does the right thing. | 20:56 |
| AJaeger | Thanks, fungi! | 20:56 |
| *** aysyd has quit IRC | 20:57 | |
| *** thorst_ has quit IRC | 20:57 | |
| *** esker has joined #openstack-infra | 20:57 | |
| *** amotoki has quit IRC | 20:58 | |
| *** piet has joined #openstack-infra | 20:59 | |
| *** esikachev has joined #openstack-infra | 21:01 | |
| *** fawadkhaliq has joined #openstack-infra | 21:04 | |
| * AJaeger will check results tomorrow and waves good-bye | 21:04 | |
| *** rcernin has joined #openstack-infra | 21:05 | |
| anteaya | AJaeger: good night! | 21:08 |
| openstackgerrit | Merged openstack-infra/project-config: Fix publishing location for translations https://review.openstack.org/313152 | 21:10 |
| *** hdaniel has quit IRC | 21:10 | |
| *** psilvad has quit IRC | 21:11 | |
| lifeless | bunting: clarkb: whats up? | 21:11 |
| *** thorst_ has joined #openstack-infra | 21:12 | |
| *** yamahata has quit IRC | 21:13 | |
| fungi | lifeless: easy bindep review https://review.openstack.org/202728 if i can get a +2 from someone i'll go ahead and tag 1.0.0 after that lands | 21:13 |
| clarkb | lifeless magnumclient change ti use constraints fails on the you cant use file or url paths | 21:14 |
| openstackgerrit | Merged openstack-infra/project-config: retire puppet-unit-{node} jobs https://review.openstack.org/312987 | 21:14 |
| lifeless | fungi: is 3 tested? | 21:14 |
| lifeless | fungi: I'm fairly sure I made sure all the deps were 3 ready... | 21:14 |
| fungi | lifeless: nope, ~lhf task would be converting from mox to mock for tests | 21:14 |
| lifeless | oh hullnuts | 21:15 |
| fungi | bindep in theory works on py3k, but tests do not | 21:15 |
| lifeless | +2 anyhow | 21:15 |
| *** ldnunes has quit IRC | 21:15 | |
| fungi | i'm happy to add 3.x classifiers later if we can get to a point where tests succeed under it | 21:15 |
| *** hrybacki is now known as hrybacki|gone | 21:15 | |
| fungi | thanks! | 21:15 |
| *** dlundquist has left #openstack-infra | 21:16 | |
| *** thorst_ has quit IRC | 21:17 | |
| *** ddieterly is now known as ddieterly[away] | 21:17 | |
| fungi | i started trying to convert the existing tests to mock, but did not get far what with other distractions | 21:17 |
| *** yamahata has joined #openstack-infra | 21:19 | |
| *** flepied has joined #openstack-infra | 21:20 | |
| *** andymaier has joined #openstack-infra | 21:25 | |
| openstackgerrit | Merged openstack-infra/bindep: Update PyPI trove classifiers preparing for 1.0.0 https://review.openstack.org/202728 | 21:26 |
| *** vgridnev has quit IRC | 21:29 | |
| *** flwang1 has joined #openstack-infra | 21:31 | |
| *** andymaier has quit IRC | 21:31 | |
| *** lakshmiS has quit IRC | 21:32 | |
| pabelanger | fungi: do you have a moment to review: https://review.openstack.org/#/c/313129/ that's to disable the deb mirrors for ubuntu-precise | 21:33 |
| *** fawadkhaliq has quit IRC | 21:33 | |
| *** jheroux has quit IRC | 21:34 | |
| *** Goneri has quit IRC | 21:39 | |
| *** ddieterly[away] is now known as ddieterly | 21:41 | |
| *** sputnik13 has quit IRC | 21:43 | |
| *** maishsk has quit IRC | 21:44 | |
| *** maishsk has joined #openstack-infra | 21:45 | |
| *** sputnik13 has joined #openstack-infra | 21:46 | |
| openstackgerrit | Merged openstack-infra/project-config: Don't configure deb mirrors for ubuntu-precise https://review.openstack.org/313129 | 21:49 |
| openstackgerrit | David Lyle proposed openstack-infra/project-config: Adding tempest-horizon repo and job https://review.openstack.org/312272 | 21:49 |
| *** sdake has quit IRC | 21:50 | |
| *** jang has quit IRC | 21:50 | |
| *** piet has quit IRC | 21:50 | |
| *** sputnik13 has quit IRC | 21:51 | |
| *** sdake has joined #openstack-infra | 21:51 | |
| *** |-paul-| has joined #openstack-infra | 21:51 | |
| *** maishsk has quit IRC | 21:52 | |
| *** maishsk has joined #openstack-infra | 21:53 | |
| *** dizquierdo has joined #openstack-infra | 21:53 | |
| *** sdake has quit IRC | 21:56 | |
| *** vhosakot has quit IRC | 21:57 | |
| *** amitgandhinz has quit IRC | 21:58 | |
| *** ayoung has joined #openstack-infra | 22:03 | |
| *** pahuang has joined #openstack-infra | 22:05 | |
| *** hdd has joined #openstack-infra | 22:06 | |
| *** kzaitsev_mb has joined #openstack-infra | 22:06 | |
| *** dimtruck is now known as zz_dimtruck | 22:07 | |
| *** ccamacho has quit IRC | 22:07 | |
| pabelanger | I think bluebox is out of FIPs, is there a new way to clean them up> | 22:08 |
| *** Sukhdev has quit IRC | 22:08 | |
| *** ccamacho has joined #openstack-infra | 22:09 | |
| *** hdaniel has joined #openstack-infra | 22:10 | |
| pabelanger | using the method I know how too :) | 22:10 |
| *** esikachev has quit IRC | 22:10 | |
| *** pvaneck has quit IRC | 22:11 | |
| pabelanger | okay, bluebox happy again: http://grafana.openstack.org/dashboard/db/nodepool-blue-box | 22:11 |
| *** Sukhdev has joined #openstack-infra | 22:11 | |
| *** akshai has quit IRC | 22:12 | |
| *** kzaitsev_mb has quit IRC | 22:12 | |
| *** sigmavirus24 is now known as sigmavirus24_awa | 22:14 | |
| *** yamamoto has joined #openstack-infra | 22:15 | |
| *** eharney has quit IRC | 22:15 | |
| *** asettle has joined #openstack-infra | 22:18 | |
| *** docaedo2 has joined #openstack-infra | 22:18 | |
| *** banix has joined #openstack-infra | 22:20 | |
| jhesketh | Morning | 22:23 |
| anteaya | morning jhesketh | 22:23 |
| *** Sukhdev has quit IRC | 22:24 | |
| *** jsavak has quit IRC | 22:26 | |
| *** jcoufal has quit IRC | 22:26 | |
| *** apoorvad has quit IRC | 22:27 | |
| *** hdaniel has quit IRC | 22:28 | |
| *** camunoz_ has joined #openstack-infra | 22:28 | |
| *** rcernin has quit IRC | 22:29 | |
| *** yamamoto has quit IRC | 22:31 | |
| *** jsavak has joined #openstack-infra | 22:32 | |
| *** Guest27987 has quit IRC | 22:33 | |
| *** Sukhdev has joined #openstack-infra | 22:33 | |
| *** thiagop-afk has quit IRC | 22:33 | |
| *** yamamoto has joined #openstack-infra | 22:36 | |
| *** yamamoto has quit IRC | 22:36 | |
| *** yamamoto has joined #openstack-infra | 22:37 | |
| *** yamamoto has quit IRC | 22:37 | |
| *** yamamoto has joined #openstack-infra | 22:37 | |
| *** signed8bit is now known as signed8bit_Zzz | 22:39 | |
| *** ewilson has quit IRC | 22:41 | |
| *** yamamoto has quit IRC | 22:42 | |
| *** zz_dimtruck is now known as dimtruck | 22:42 | |
| *** zzelle has joined #openstack-infra | 22:43 | |
| *** thorst_ has joined #openstack-infra | 22:43 | |
| *** jcoufal has joined #openstack-infra | 22:47 | |
| *** dingyichen has joined #openstack-infra | 22:48 | |
| *** jsavak has quit IRC | 22:49 | |
| *** |-paul-| has quit IRC | 22:49 | |
| *** Sukhdev has quit IRC | 22:49 | |
| *** jcoufal has quit IRC | 22:49 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/project-config: Add experimental-project-config-layout for ubuntu-precise https://review.openstack.org/313182 | 22:49 |
| pabelanger | ianw: should be an easy review ^ | 22:49 |
| pabelanger | and our last job to test before removing bare-precise from the gate | 22:50 |
| *** rhallisey has quit IRC | 22:50 | |
| *** david-lyle has quit IRC | 22:51 | |
| *** thorst_ has quit IRC | 22:52 | |
| *** gordc has quit IRC | 22:52 | |
| *** apoorvad has joined #openstack-infra | 22:53 | |
| *** david-lyle has joined #openstack-infra | 22:53 | |
| *** salv-orlando has joined #openstack-infra | 22:53 | |
| *** salv-orlando has quit IRC | 22:54 | |
| pabelanger | also, pretty happy with ubuntu-precise so far. should be able to move some tests around tomorrow to start using it | 22:54 |
| *** salv-orlando has joined #openstack-infra | 22:54 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/tripleo-ci: Initial support for centos-7 jenkins slave https://review.openstack.org/312725 | 22:55 |
| pabelanger | and tripleo-ci is working under centos-7 ^ | 22:55 |
| *** zeih has joined #openstack-infra | 22:57 | |
| *** david-lyle has quit IRC | 22:58 | |
| *** newmember has joined #openstack-infra | 23:01 | |
| *** fitoduarte has quit IRC | 23:01 | |
| *** zeih has quit IRC | 23:01 | |
| *** ams_ has quit IRC | 23:03 | |
| *** davideag_ has joined #openstack-infra | 23:04 | |
| *** newmember has quit IRC | 23:04 | |
| rm_work | Hey, maybe not the right room, but -- I've heard that PBR doesn't allow building two different packages/eggs from the same repo? Anyone that can shed a little more light on that (or provide some useful reading)? | 23:06 |
| *** ayoung has quit IRC | 23:07 | |
| *** tpsilva has quit IRC | 23:07 | |
| *** davideagnello has quit IRC | 23:07 | |
| *** kzaitsev_mb has joined #openstack-infra | 23:08 | |
| *** ddieterly has quit IRC | 23:08 | |
| anteaya | rm_work: you are probably going to want mordred or lifeless for the answer to that one | 23:08 |
| fungi | rm_work: technically #openstack-oslo i think, but lots of the pbr authors hang out in here too | 23:09 |
| fungi | rm_work: i don't know of any examples of doing that, but i also don't know that it's impossible | 23:09 |
| rm_work | yeah, I find that most of the useful people I want to talk to hang out in here as well as wherever else :P | 23:09 |
| rm_work | (or just live here to begin with...) | 23:10 |
| fungi | infra is the new catch-all channel | 23:10 |
| rm_work | heh, I know I tend to treat it that way >_> (sorry if that's annoying) | 23:10 |
| anteaya | I don't even notice anymore | 23:11 |
| rm_work | maybe if you weren't so knowledgable <_< | 23:11 |
| anteaya | here is a video of the two folks chairing the scientific working group https://www.youtube.com/watch?v=WKBTBo1sOYE | 23:11 |
| docaedo | I does make sense - the infra team is the glue that holds this whole crazy mess together you know | 23:11 |
| anteaya | rm_work: oh I don't know anything | 23:11 |
| anteaya | rm_work: I just know who does | 23:11 |
| rm_work | heh | 23:12 |
| rm_work | WTB #openstack-directory-services | 23:12 |
| anteaya | docaedo: would explain the speed with which I find I can get anything done | 23:12 |
| anteaya | glue feet | 23:12 |
| docaedo | anteaya: hahaha | 23:12 |
| anteaya | :) | 23:12 |
| rm_work | alright, I guess mordred / lifeless, if you could hit me up when you're around, I have some questions -- we're trying to split out our agent code (which needs to run on a minimal VM) from our main codebase, and I'm not sure PBR will allow us to do that and keep it in the same repo :/ | 23:14 |
| rm_work | ^^ this is for Octavia | 23:14 |
| fungi | rm_work: seems like it would be easy enough to test. the main place i would expect it to fall apart is if pbr looks in the root of the git work tree for configuration | 23:16 |
| *** jaypipes has quit IRC | 23:16 | |
| rm_work | well I'm reading the docs and it's not clear that there's a way to tell it in one config file to make two differently named eggs | 23:17 |
| rm_work | so that's where I'm stuck -- looks like it's kinda designed to assume it's building one package | 23:17 |
| rm_work | and that lines up with what i've been told anecdotally | 23:17 |
| fungi | ahh, i was wondering if putting them in different subtrees of the repo would work | 23:17 |
| rm_work | hmm | 23:17 |
| rm_work | interesting | 23:18 |
| rm_work | I guess we could literally move EVERYTHING one layer deeper | 23:18 |
| fungi | but i know we've been generally pretty consistent about pushing the one repo one package paradigm because even if you got pbr doing it, the rest of our build and publication pipeline assumes it too | 23:18 |
| rm_work | but I think that would break everything about how devstack works | 23:19 |
| rm_work | yes | 23:19 |
| rm_work | that's what I was thinking | 23:19 |
| rm_work | most everything else assumes it'll find things in a specific way inside the repo | 23:19 |
| rm_work | whether PBR supports it somehow or not, we may just have to split into a second repo :/ | 23:19 |
| *** zzelle has quit IRC | 23:19 | |
| rm_work | openstack/octavia and openstack/octavia-agent maybe | 23:19 |
| *** zzelle has joined #openstack-infra | 23:19 | |
| fungi | that's similar to what trove and ironic do | 23:20 |
| rm_work | but there's a ton of overhead around that :( | 23:20 |
| rm_work | ah, so there's precedent there? | 23:20 |
| *** zzelle has quit IRC | 23:20 | |
| fungi | also if you're trying to have two projects in one git repo but use tag-based release workflows, you're relegated to releasing all of the repo in lockstep. you can't tag "part" of a repo | 23:21 |
| rm_work | well, they do need to be released in lockstep anyway | 23:21 |
| rm_work | they're very tightly coupled | 23:21 |
| rm_work | so that'd almost be better | 23:21 |
| fungi | how big are they if packaged together? | 23:21 |
| rm_work | waaaay too big | 23:21 |
| rm_work | so, the fedora image we use as a base seems to be about 220mb | 23:22 |
| fungi | a counterexample is zuul, which includes several daemons and client tools all in one git repo/python package | 23:22 |
| rm_work | building including our venv, we run out of space if we do less than a 2GB image with DIB | 23:22 |
| fungi | ahh, so maybe packaging them together is not a good model ;) | 23:22 |
| rm_work | looking at just the prereqs, it is more files than the size of the entire base image, lol | 23:23 |
| *** MarkAtwood has quit IRC | 23:23 | |
| clarkb | thats bigger than our images if your remove our caches | 23:23 |
| rm_work | I am also looking at options involving building a movable venv on the devstack host and then just copying it onto the image, but that gets a little messy and is STILL way bigger than we need | 23:23 |
| rm_work | (right now we build the agent, and thus the rest of our project, ON the VM image with DIB) | 23:24 |
| rm_work | the agent and its prereqs should be basically nothing | 23:24 |
| rm_work | maybe we can somehow do a custom build for the agent and not rely on PBR | 23:25 |
| rm_work | and let PBR continue to build the main project as normal | 23:25 |
| *** salv-orlando has quit IRC | 23:26 | |
| clarkb | in the case of zuul we just install all of zuul its not that big | 23:26 |
| anteaya | just found the intel keynote thing: https://www.youtube.com/watch?v=Kpe_Po9Ku24 | 23:28 |
| anteaya | all I can say is wow | 23:28 |
| rm_work | I'm going to look into that -- we don't really need the agent built automatically by PBR, we'll build it ourself via our devstack scripts (and deployers via the CLI tools we provide), so it might be fine to just use a separate build system for it | 23:28 |
| *** mtanino has quit IRC | 23:30 | |
| *** mtanino has joined #openstack-infra | 23:30 | |
| *** krotscheck has quit IRC | 23:31 | |
| *** krotscheck has joined #openstack-infra | 23:31 | |
| *** skraynev has quit IRC | 23:32 | |
| openstackgerrit | Derek Higgins proposed openstack-infra/tripleo-ci: Update the cistatus report https://review.openstack.org/313189 | 23:32 |
| *** jamesmca_ has joined #openstack-infra | 23:33 | |
| *** mriedem has joined #openstack-infra | 23:34 | |
| EmilienM | fungi: if you have time this week, can we approve https://review.openstack.org/#/c/301375/ please ? | 23:35 |
| *** dizquierdo has quit IRC | 23:36 | |
| lifeless | rm_work: pbr will not allow you tod o that | 23:37 |
| rm_work | ok, that's what I thought | 23:37 |
| rm_work | I think I have a line on a good alternative | 23:37 |
| rm_work | thanks for the confirmation lifeless! | 23:37 |
| lifeless | rm_work: I'm not for or against pbr allowing folk to do that; its a design angle already present when I started hacking on pbr | 23:37 |
| *** sridhar_ram has quit IRC | 23:37 | |
| rm_work | yeah no worries | 23:38 |
| lifeless | rm_work: but at least to date, -infra has been organised around one-repo-one-artifact | 23:38 |
| *** jamesmca_ has quit IRC | 23:38 | |
| lifeless | and pbr is a 1:1 with that | 23:38 |
| rm_work | just needed to cross off my list "verify PBR can't do this" before I looked at alternatives, due diligence and all | 23:38 |
| rm_work | there are alternatives, but I try to figure out what the "right way" is before I start hacking something together :P | 23:39 |
| lifeless | sure | 23:39 |
| rm_work | "right way" ~= "openstack way" | 23:39 |
| *** dizquierdo has joined #openstack-infra | 23:39 | |
| *** tqtran has quit IRC | 23:41 | |
| craige | o/ | 23:42 |
| *** dmk0202 has quit IRC | 23:42 | |
| *** dimtruck is now known as zz_dimtruck | 23:44 | |
| *** davideag_ has quit IRC | 23:45 | |
| *** andreykurilin has quit IRC | 23:47 | |
| *** dtantsur|afk has quit IRC | 23:47 | |
| *** jamesmca_ has joined #openstack-infra | 23:47 | |
| kjorgensen | Hi folks, I am trying to set up zuul at my organization, but I'm having trouble with the gearman jenkins plugin (I think). The connection with our gerrit server seems to be ok, and my test patches are triggering events, but then when zuul launches the job it gets stuck in the queue for my jenkins job. | 23:48 |
| *** andreykurilin has joined #openstack-infra | 23:48 | |
| kjorgensen | for example, when I check the 'status' in the gearman server I see something like this | 23:48 |
| *** _amrith_ is now known as amrith | 23:48 | |
| *** jbernard has quit IRC | 23:48 | |
| kjorgensen | build:job:SLAVE102 | 23:48 |
| *** BobBall_AWOL has quit IRC | 23:49 | |
| kjorgensen | any suggestions on where to look for debugging this issue? | 23:49 |
| *** jbernard has joined #openstack-infra | 23:49 | |
| anteaya | kjorgensen: have you any logs and if yes can you put information in a paste service? | 23:49 |
| *** BobBall_AWOL has joined #openstack-infra | 23:50 | |
| kjorgensen | yes maybe, which logs? | 23:50 |
| anteaya | lets see what zuul thinks is happening | 23:51 |
| anteaya | that is often a good place to begin | 23:51 |
| *** xarses has quit IRC | 23:51 | |
| *** jamesmca_ has quit IRC | 23:52 | |
| *** ayoung has joined #openstack-infra | 23:53 | |
| kjorgensen | ok here is a snippet from /var/log/zuul/zuul.log http://paste.openstack.org/show/496292/ | 23:55 |
| anteaya | okay so the last line is 2016-05-05 23:15:36,283 INFO zuul.Gerrit: Updating information for 25194,24 | 23:56 |
| anteaya | did a comment get added to change 25194 patchset 24 at that timestamp? | 23:56 |
| kjorgensen | yes | 23:57 |
| *** Guest40712 has quit IRC | 23:57 | |
| anteaya | wonderful | 23:57 |
| anteaya | what was the content of the comment? | 23:57 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!
