| fungi | oh, _gerrit_ is downloading it, not our puppet module? | 00:00 |
|---|---|---|
| clarkb | oh! huh | 00:00 |
| jeblair | i believe so, because it's happening in 'gerrit-initial-init' | 00:01 |
| clarkb | ya I agree, it is erroring inside of that exec, not within a "native" puppet resource | 00:01 |
| *** doug-fis_ has joined #openstack-infra | 00:02 | |
| jeblair | hrm. our gerrit source code is declaring a dep on 1.51 | 00:02 |
| *** eil397 has quit IRC | 00:02 | |
| *** yamamoto has joined #openstack-infra | 00:02 | |
| jeblair | so i don't understand where bcprov-jdk16-144.jar is coming from | 00:02 |
| jeblair | http://git.openstack.org/cgit/openstack-infra/gerrit/tree/gerrit-pgm/src/main/resources/com/google/gerrit/pgm/libraries.config | 00:03 |
| jeblair | codesearch to the rescue | 00:03 |
| *** doug-fish has quit IRC | 00:03 | |
| jeblair | (that's not where i was looking, so clearly i don't understand deps here) | 00:03 |
| jeblair | OH | 00:03 |
| jeblair | that's in *master* | 00:03 |
| jeblair | i think we may have just discovered that our puppet module doesn't work with gerrit master | 00:04 |
| clarkb | which isn't surprising, but don't we feed in a specific war that isn't master? | 00:04 |
| openstackgerrit | Vipin Balachandran proposed openstack/requirements: Add defusedxml to requirements https://review.openstack.org/311857 | 00:04 |
| jeblair | oh, er... that's not in master | 00:06 |
| *** salv-orlando has joined #openstack-infra | 00:07 | |
| clarkb | http://git.openstack.org/cgit/openstack-infra/gerrit/tree/gerrit-pgm/src/main/resources/com/google/gerrit/pgm/init/libraries.config?h=openstack/2.11.4 is what I think we should be running | 00:07 |
| *** jerryz has quit IRC | 00:07 | |
| *** doug-fis_ has quit IRC | 00:07 | |
| jeblair | that's in openstack master | 00:07 |
| jeblair | which is ancient | 00:07 |
| jeblair | 2016-05-02 23:40:39.698 | Notice: /Stage[main]/Gerrit/Exec[download:http://tarballs.openstack.org/ci/gerrit/gerrit-v2.8.4.19.4548330.war]/returns: executed successfully | 00:07 |
| jeblair | which is what that module is testing | 00:07 |
| clarkb | huh | 00:07 |
| * clarkb looks to see where that comes form | 00:07 | |
| clarkb | found it | 00:08 |
| clarkb | it is in spec/acceptance/fixtures/default.pp | 00:08 |
| clarkb | jeblair: do you want to push a patch to update ^ or should I? | 00:08 |
| jeblair | clarkb: i agree that seems to be the prob (along with the spec acceptance that checks it) | 00:08 |
| jeblair | clarkb: can you please? | 00:09 |
| *** yamamoto has quit IRC | 00:09 | |
| clarkb | can do, one sec | 00:09 |
| *** markvoelker has joined #openstack-infra | 00:09 | |
| *** heyongli_ has quit IRC | 00:09 | |
| *** heyongli_ has joined #openstack-infra | 00:10 | |
| openstackgerrit | Clark Boylan proposed openstack-infra/puppet-gerrit: Use current prod war in testing https://review.openstack.org/311894 | 00:10 |
| clarkb | if ^ works we can recheck the cache timeout change after ^ merges | 00:11 |
| *** Sukhdev has quit IRC | 00:11 | |
| *** ddieterly has joined #openstack-infra | 00:11 | |
| *** salv-orlando has quit IRC | 00:14 | |
| *** salv-orlando has joined #openstack-infra | 00:14 | |
| *** vtapia_ has quit IRC | 00:14 | |
| *** baoli has joined #openstack-infra | 00:14 | |
| *** salv-orlando has quit IRC | 00:15 | |
| jeblair | clarkb: i think there are other version strings in the beaker asserts | 00:16 |
| *** doug-fish has joined #openstack-infra | 00:16 | |
| *** salv-orlando has joined #openstack-infra | 00:16 | |
| *** baoli has quit IRC | 00:16 | |
| clarkb | jeblair: git grep 2.11 only shows that one line | 00:16 |
| *** piet has quit IRC | 00:18 | |
| jeblair | clarkb: git grep 2.8 shows more | 00:18 |
| clarkb | oh derp I needed to do that | 00:18 |
| *** piet has joined #openstack-infra | 00:18 | |
| nibalizer | i believe i have cleaned all the infracloud dns records | 00:18 |
| clarkb | I have curled review.o.o to get the string that *should* show up in beaker and will update those two asserts | 00:19 |
| *** heyongli_ has quit IRC | 00:20 | |
| *** heyongli_ has joined #openstack-infra | 00:20 | |
| *** amitgandhinz has joined #openstack-infra | 00:20 | |
| clarkb | hrm it still fails before it gets to the asserts | 00:21 |
| *** vtapia_ has joined #openstack-infra | 00:22 | |
| clarkb | jeblair: http://logs.openstack.org/94/311894/1/check/gate-puppet-gerrit-puppet-beaker-rspec-ubuntu-trusty/39c3444/console.html#_2016-05-03_00_19_07_565 | 00:22 |
| *** amitgandhinz has quit IRC | 00:22 | |
| clarkb | also a 404 | 00:22 |
| *** salv-orlando has quit IRC | 00:22 | |
| openstackgerrit | Clark Boylan proposed openstack-infra/puppet-gerrit: Use current prod war in testing https://review.openstack.org/311894 | 00:23 |
| clarkb | that will fail but it is more complete | 00:23 |
| *** salv-orlando has joined #openstack-infra | 00:25 | |
| *** psilvad has quit IRC | 00:25 | |
| clarkb | our best bet may be to make that job non voting for now | 00:26 |
| clarkb | guessing this also breaks git review tests thugh | 00:26 |
| jeblair | clarkb: yeah, it's looking like they are deleting old releases | 00:26 |
| clarkb | I will make zuul change for this | 00:27 |
| *** mylu has quit IRC | 00:28 | |
| jeblair | their mirrors still have it, but not the master site | 00:28 |
| *** heyongli_ has quit IRC | 00:30 | |
| *** Sukhdev has joined #openstack-infra | 00:30 | |
| openstackgerrit | Clark Boylan proposed openstack-infra/project-config: Make puppet-gerrit beaker rspec non voting https://review.openstack.org/311898 | 00:30 |
| *** heyongli_ has joined #openstack-infra | 00:30 | |
| jeblair | aprvd | 00:32 |
| jeblair | #status log gerrit configuration update blocked on failing beaker tests due to missing bouncycastle releases; job being made nonvoting in https://review.openstack.org/311898 | 00:37 |
| openstackstatus | jeblair: finished logging | 00:37 |
| *** heyongli_ has quit IRC | 00:40 | |
| *** heyongli_ has joined #openstack-infra | 00:41 | |
| *** sigmavirus24 is now known as sigmavirus24_awa | 00:45 | |
| openstackgerrit | Merged openstack-infra/project-config: Make puppet-gerrit beaker rspec non voting https://review.openstack.org/311898 | 00:46 |
| nibalizer | they just pulled the jar or something? | 00:46 |
| clarkb | nibalizer: ya they all 404 | 00:46 |
| clarkb | I can get the cache timeout change approved and rechecked once zuul reloads its layout | 00:47 |
| *** fitoduarte has quit IRC | 00:47 | |
| openstackgerrit | Merged openstack-infra/puppet-openstackci: Initiate nodepool-builder on third_party_ci.rst https://review.openstack.org/293087 | 00:48 |
| nibalizer | clarkb: i can pull https://repo1.maven.org/maven2/org/bouncycastle/bcprov-jdk15on/1.51/bcprov-jdk15on-1.51.jar | 00:49 |
| clarkb | nibalizer: ya jeblair said the mirrors still have it, but gerrit downloads from bouncycastle directly | 00:49 |
| clarkb | nibalizer: maybe what we need to do is point to maven nexus instead and make a new war | 00:49 |
| nibalizer | huh | 00:50 |
| nibalizer | gerrit the application? | 00:50 |
| nibalizer | because we have repo1.maven in our gerrit module | 00:50 |
| clarkb | nibalizer: yup, it has an "init" command which we use and that is what does the downloads | 00:50 |
| *** fawadkhaliq has quit IRC | 00:50 | |
| nibalizer | nea | 00:50 |
| nibalizer | neat | 00:50 |
| clarkb | nibalizer: http://git.openstack.org/cgit/openstack-infra/gerrit/tree/gerrit-pgm/src/main/resources/com/google/gerrit/pgm/init/libraries.config?h=openstack/2.11.4 is the file to update | 00:50 |
| *** heyongli_ has quit IRC | 00:50 | |
| *** piet has quit IRC | 00:50 | |
| *** heyongli_ has joined #openstack-infra | 00:51 | |
| nibalizer | ok, do you want me to do that? | 00:51 |
| clarkb | nibalizer: if you are up to it, you can use my https://review.openstack.org/311894 change (well update it first) to test a resulting war too | 00:53 |
| *** kjorgensen has quit IRC | 00:56 | |
| *** kjorgensen has joined #openstack-infra | 00:58 | |
| openstackgerrit | Merged openstack-infra/puppet-openstackci: Clarify oscc_file_contents instructions https://review.openstack.org/282010 | 00:58 |
| nibalizer | clarkb: oh man I don't really undertand the gerrit pipeline | 00:59 |
| nibalizer | so we push a tag and that builds it and deposits it on tarballs? | 00:59 |
| *** heyongli_ has quit IRC | 01:01 | |
| openstackgerrit | Merged openstack-infra/tripleo-ci: tripleo.sh: deploy missing deps to run rdopkg https://review.openstack.org/311868 | 01:01 |
| clarkb | nibalizer: if you push a patch you should get a testing war that is useable | 01:01 |
| clarkb | nibalizer: then if we merge that we can a non testing war | 01:01 |
| clarkb | no tag required due to upstream determining versions for us mostly | 01:01 |
| nibalizer | oh | 01:01 |
| nibalizer | so patches in review generate tarballs | 01:02 |
| nibalizer | noice | 01:02 |
| nibalizer | i was confused how i'd work around that | 01:02 |
| nibalizer | but i don't have to | 01:02 |
| *** kjorgensen has quit IRC | 01:02 | |
| clarkb | nibalizer: and note the branch you push to, its based onthe release version | 01:02 |
| *** heyongli_ has joined #openstack-infra | 01:03 | |
| *** salv-orlando has quit IRC | 01:04 | |
| nibalizer | clarkb: https://review.openstack.org/#/c/311903/ eh? | 01:04 |
| clarkb | nibalizer: ya that should make you a war at http://tarballs.openstack.org/ci/test/ which you can then plug into my earlier change (don't forget to update the asserts too) to test | 01:05 |
| *** baoli has joined #openstack-infra | 01:07 | |
| *** thorst has quit IRC | 01:08 | |
| *** thorst has joined #openstack-infra | 01:09 | |
| *** david-lyle has joined #openstack-infra | 01:09 | |
| *** heyongli_ has quit IRC | 01:10 | |
| clarkb | nibalizer: ansible looks stuck | 01:14 |
| clarkb | you just kill the process? | 01:14 |
| nibalizer | i havent killed anything recently | 01:15 |
| nibalizer | currently jn line for tacos | 01:15 |
| Clint | kill some tacos | 01:15 |
| * clarkb kills some ansibles | 01:15 | |
| *** yamahata has quit IRC | 01:15 | |
| *** bpokorny_ has joined #openstack-infra | 01:16 | |
| *** Hal has joined #openstack-infra | 01:16 | |
| *** Hal is now known as Guest73008 | 01:17 | |
| nibalizer | its abboying that it gets stuck | 01:17 |
| nibalizer | maybe we need to wrap ansible in timeout | 01:17 |
| *** thorst has quit IRC | 01:17 | |
| clarkb | nibalizer: ya I think we should consider that, can be really conservative too. 2 hours would've been enough today for example | 01:17 |
| clarkb | logging ended at 2213UTC | 01:18 |
| *** bpokorny_ has quit IRC | 01:18 | |
| nibalizer | yea | 01:18 |
| nibalizer | post tacos i will put up a patch | 01:18 |
| *** bpokorny_ has joined #openstack-infra | 01:18 | |
| *** bpokorny has quit IRC | 01:19 | |
| *** cody-somerville has joined #openstack-infra | 01:21 | |
| *** cody-somerville has quit IRC | 01:21 | |
| *** cody-somerville has joined #openstack-infra | 01:21 | |
| *** zz_dimtruck is now known as dimtruck | 01:23 | |
| *** gildub has joined #openstack-infra | 01:26 | |
| *** ddieterly is now known as ddieterly[away] | 01:26 | |
| *** nelsnelson has joined #openstack-infra | 01:27 | |
| *** Jeffrey4l has joined #openstack-infra | 01:28 | |
| *** banix has quit IRC | 01:28 | |
| fungi | clarkb: nibalizer: pabelanger posted a patch earlier to adjust the localhost connections in ansible in an attempt to avoid something related to that, i think | 01:28 |
| fungi | or that might have been strictly to address memory consumption | 01:29 |
| *** jyuso has joined #openstack-infra | 01:30 | |
| *** EricGonczer_ has joined #openstack-infra | 01:30 | |
| *** jerryz has joined #openstack-infra | 01:32 | |
| openstackgerrit | Dan Prince proposed openstack-infra/tripleo-ci: Add planet blog aggregator feeds to website https://review.openstack.org/311910 | 01:33 |
| openstackgerrit | Hongbin Lu proposed openstack/requirements: Bump upper-constraints on magnumclient to 2.1.0 https://review.openstack.org/311911 | 01:36 |
| *** baoli has quit IRC | 01:37 | |
| *** EricGonczer_ has quit IRC | 01:38 | |
| *** edmondsw has quit IRC | 01:42 | |
| *** bardia has quit IRC | 01:42 | |
| morgan | mordred: ++ | 01:44 |
| clarkb | I have rechecked and approved the maxAge fix | 01:44 |
| clarkb | when that merges I can #status | 01:44 |
| *** baoli has joined #openstack-infra | 01:45 | |
| *** anteaya has quit IRC | 01:47 | |
| clarkb | nibalizer: http://tarballs.openstack.org/ci/test/gerrit-v2.11.4.13.93a6f3b.war want me to update my change with that war to test or you going to do it? | 01:48 |
| openstackgerrit | Spencer Krum proposed openstack-infra/system-config: Run ansible-playbook in timeout https://review.openstack.org/311913 | 01:49 |
| nibalizer | clarkb: i was about to | 01:53 |
| *** itsuugo has quit IRC | 01:53 | |
| nibalizer | but yea if you want to go for it | 01:53 |
| clarkb | ok will do | 01:53 |
| *** EricGonczer_ has joined #openstack-infra | 01:56 | |
| openstackgerrit | Clark Boylan proposed openstack-infra/puppet-gerrit: Use working war in testing https://review.openstack.org/311894 | 01:57 |
| clarkb | nibalizer: ^ | 01:57 |
| *** mriedem has quit IRC | 01:57 | |
| *** doug-fish has quit IRC | 01:57 | |
| *** doug-fish has joined #openstack-infra | 01:57 | |
| *** doug-fis_ has joined #openstack-infra | 02:00 | |
| *** bpokorny_ has quit IRC | 02:01 | |
| *** doug-fish has quit IRC | 02:01 | |
| *** doug-fis_ has quit IRC | 02:05 | |
| clarkb | nibalizer: https://repo1.maven.org/maven2/org/bouncycastle/bcprov-jdk15on/1.51/bcprov-jdk15on-1.51.ja is a 404 too :) | 02:05 |
| clarkb | wow I managed to use the gerrit web editor for the new patch | 02:07 |
| *** doug-fish has joined #openstack-infra | 02:07 | |
| *** rhallisey has quit IRC | 02:10 | |
| nibalizer | ugh | 02:11 |
| nibalizer | i can screw up anything! | 02:11 |
| openstackgerrit | Merged openstack-infra/puppet-gerrit: Change default login cache length to 7 days https://review.openstack.org/311888 | 02:12 |
| *** apoorvad has quit IRC | 02:12 | |
| clarkb | #status log https://review.openstack.org/311888 has merged and should update the gerrit config to set cache maxAge to 7days. Please double check the config file is up to date on review.o.o before restarting the service. | 02:14 |
| *** piet has joined #openstack-infra | 02:14 | |
| *** thorst has joined #openstack-infra | 02:15 | |
| openstackgerrit | Clark Boylan proposed openstack-infra/puppet-gerrit: Use working war in testing https://review.openstack.org/311894 | 02:16 |
| *** zhurong has joined #openstack-infra | 02:16 | |
| *** Sukhdev has quit IRC | 02:18 | |
| *** _ody_ has joined #openstack-infra | 02:18 | |
| *** _ody has quit IRC | 02:19 | |
| *** _amrith_ is now known as amrith | 02:19 | |
| *** jerryz has quit IRC | 02:19 | |
| *** jerryz has joined #openstack-infra | 02:19 | |
| *** sdake has joined #openstack-infra | 02:20 | |
| *** thorst has quit IRC | 02:22 | |
| *** tphummel has quit IRC | 02:23 | |
| clarkb | nibalizer: success! | 02:23 |
| nibalizer | \o/ | 02:24 |
| *** madhu_ak has quit IRC | 02:24 | |
| *** yamamoto has joined #openstack-infra | 02:24 | |
| *** ddieterly[away] has quit IRC | 02:26 | |
| *** aarefiev has quit IRC | 02:26 | |
| *** piet has quit IRC | 02:27 | |
| *** aarefiev has joined #openstack-infra | 02:28 | |
| *** piet has joined #openstack-infra | 02:28 | |
| *** ddieterly has joined #openstack-infra | 02:31 | |
| *** ddieterly is now known as ddieterly[away] | 02:32 | |
| *** fedexo has joined #openstack-infra | 02:33 | |
| *** EricGonczer_ has quit IRC | 02:34 | |
| *** hdd has quit IRC | 02:37 | |
| *** yamamoto has quit IRC | 02:37 | |
| *** piet has quit IRC | 02:42 | |
| *** binbincong has joined #openstack-infra | 02:50 | |
| *** yamamoto has joined #openstack-infra | 02:50 | |
| *** kzaitsev_mb has quit IRC | 02:57 | |
| *** baoli has quit IRC | 03:01 | |
| *** amrith is now known as _amrith_ | 03:04 | |
| *** tphummel has joined #openstack-infra | 03:11 | |
| *** bpokorny has joined #openstack-infra | 03:15 | |
| *** bpokorny has quit IRC | 03:15 | |
| *** bpokorny has joined #openstack-infra | 03:15 | |
| *** thorst has joined #openstack-infra | 03:20 | |
| *** yamamoto has quit IRC | 03:26 | |
| *** DevBox has joined #openstack-infra | 03:27 | |
| *** thorst has quit IRC | 03:28 | |
| *** asettle has quit IRC | 03:29 | |
| *** asettle has joined #openstack-infra | 03:30 | |
| *** piet has joined #openstack-infra | 03:32 | |
| *** ddieterly[away] has quit IRC | 03:33 | |
| *** Jeffrey4l has quit IRC | 03:37 | |
| *** rfolco has joined #openstack-infra | 03:49 | |
| *** harlowja_at_home has joined #openstack-infra | 03:49 | |
| *** tlian has quit IRC | 03:50 | |
| *** kzaitsev_mb has joined #openstack-infra | 03:51 | |
| *** kzaitsev_mb has quit IRC | 03:56 | |
| *** piet has quit IRC | 04:01 | |
| *** oanson has joined #openstack-infra | 04:03 | |
| *** tqtran has quit IRC | 04:07 | |
| *** docaedo2 has joined #openstack-infra | 04:07 | |
| openstackgerrit | Merged openstack-infra/project-config: Do not run release notes for openstack-manuals/liberty https://review.openstack.org/311701 | 04:08 |
| *** doug-fish has quit IRC | 04:09 | |
| *** asettle has quit IRC | 04:10 | |
| *** asettle has joined #openstack-infra | 04:10 | |
| *** kuromagi has quit IRC | 04:13 | |
| *** Jeffrey4l has joined #openstack-infra | 04:14 | |
| *** asettle has quit IRC | 04:15 | |
| *** Clint has quit IRC | 04:15 | |
| *** Jeffrey4l_ has joined #openstack-infra | 04:15 | |
| *** Guest73008 has quit IRC | 04:15 | |
| *** pleia2 has quit IRC | 04:16 | |
| *** waynr has quit IRC | 04:16 | |
| *** Jeffrey4l__ has joined #openstack-infra | 04:16 | |
| *** pleia2 has joined #openstack-infra | 04:16 | |
| *** rfolco has quit IRC | 04:16 | |
| *** links has joined #openstack-infra | 04:17 | |
| *** Jeffrey4l__ has quit IRC | 04:17 | |
| *** Jeffrey4l__ has joined #openstack-infra | 04:17 | |
| *** kuromagi has joined #openstack-infra | 04:17 | |
| *** kzaitsev_mb has joined #openstack-infra | 04:17 | |
| *** markvoelker has quit IRC | 04:19 | |
| *** Jeffrey4l_ has quit IRC | 04:20 | |
| *** Jeffrey4l has quit IRC | 04:20 | |
| *** waynr has joined #openstack-infra | 04:21 | |
| *** Jeffrey4l__ has quit IRC | 04:22 | |
| *** Clint has joined #openstack-infra | 04:23 | |
| *** yamamoto has joined #openstack-infra | 04:23 | |
| *** yamamoto has quit IRC | 04:23 | |
| *** thorst has joined #openstack-infra | 04:25 | |
| *** thorst has quit IRC | 04:32 | |
| *** psachin has joined #openstack-infra | 04:34 | |
| *** kzaitsev_mb has quit IRC | 04:39 | |
| *** kzaitsev_mb has joined #openstack-infra | 04:40 | |
| *** harlowja_at_home has quit IRC | 04:41 | |
| *** kzaitsev_mb has quit IRC | 04:46 | |
| *** oanson has quit IRC | 04:47 | |
| *** asselin has joined #openstack-infra | 04:48 | |
| openstackgerrit | Sergey Vilgelm proposed openstack-dev/pbr: Parse requrements files in extras https://review.openstack.org/311929 | 04:50 |
| *** asselin__ has quit IRC | 04:50 | |
| *** sree has joined #openstack-infra | 04:56 | |
| *** tphummel has quit IRC | 04:57 | |
| *** kzaitsev_mb has joined #openstack-infra | 05:01 | |
| openstackgerrit | Sergey Vilgelm proposed openstack-dev/pbr: Parse requrements files in extras https://review.openstack.org/311929 | 05:01 |
| *** abregman has joined #openstack-infra | 05:02 | |
| *** bpokorny has quit IRC | 05:04 | |
| openstackgerrit | Sergey Vilgelm proposed openstack-dev/pbr: Parse requrements files in extras https://review.openstack.org/311929 | 05:06 |
| *** kzaitsev_mb has quit IRC | 05:07 | |
| openstackgerrit | Sergey Vilgelm proposed openstack-dev/pbr: Parse requrements files in extras https://review.openstack.org/311929 | 05:08 |
| *** kzaitsev_mb has joined #openstack-infra | 05:09 | |
| *** asettle has joined #openstack-infra | 05:15 | |
| *** Jeffrey4l__ has joined #openstack-infra | 05:18 | |
| *** markvoelker has joined #openstack-infra | 05:19 | |
| *** DevBox has quit IRC | 05:20 | |
| *** yamamoto has joined #openstack-infra | 05:24 | |
| *** markvoelker has quit IRC | 05:24 | |
| *** Jeffrey4l__ has quit IRC | 05:24 | |
| *** thorst has joined #openstack-infra | 05:30 | |
| openstackgerrit | Sergey Vilgelm proposed openstack-dev/pbr: Parse requrements files in extras https://review.openstack.org/311929 | 05:35 |
| *** sdake has quit IRC | 05:37 | |
| *** thorst has quit IRC | 05:37 | |
| *** sdake has joined #openstack-infra | 05:38 | |
| *** yamamoto has quit IRC | 05:40 | |
| openstackgerrit | fumihiko kakuma proposed openstack-infra/devstack-gate: Use local.conf instead of localrc in devstack configuration https://review.openstack.org/311668 | 05:40 |
| *** kzaitsev_mb has quit IRC | 05:43 | |
| *** yolanda has joined #openstack-infra | 05:44 | |
| *** DevBox has joined #openstack-infra | 05:44 | |
| *** yolanda has quit IRC | 05:48 | |
| *** yolanda has joined #openstack-infra | 05:48 | |
| openstackgerrit | fumihiko kakuma proposed openstack-infra/devstack-gate: Use local.conf instead of localrc in devstack configuration https://review.openstack.org/311668 | 05:52 |
| *** kzaitsev_mb has joined #openstack-infra | 05:55 | |
| openstackgerrit | Merged openstack-infra/project-config: Add magnum plugin to keystone2 job in shade https://review.openstack.org/311610 | 05:55 |
| *** asettle has quit IRC | 05:58 | |
| *** xarses has quit IRC | 05:59 | |
| *** xarses has joined #openstack-infra | 06:04 | |
| *** yamamoto has joined #openstack-infra | 06:08 | |
| *** salv-orlando has joined #openstack-infra | 06:11 | |
| *** kzaitsev_mb has quit IRC | 06:15 | |
| *** rcernin has joined #openstack-infra | 06:15 | |
| *** kzaitsev_mb has joined #openstack-infra | 06:17 | |
| *** kushal has quit IRC | 06:18 | |
| *** sree has quit IRC | 06:19 | |
| *** sree has joined #openstack-infra | 06:19 | |
| *** markvoelker has joined #openstack-infra | 06:20 | |
| tonyb | A whole bunch of the stable-periodic pipeline just failed with "UNSTABLE" jobs. | 06:21 |
| tonyb | is there an infra-root around that canpoke at that? | 06:22 |
| tonyb | eg http://lists.openstack.org/pipermail/openstack-stable-maint/2016-May/004275.html | 06:23 |
| *** yamamoto has quit IRC | 06:23 | |
| *** sree has quit IRC | 06:23 | |
| *** markvoelker has quit IRC | 06:25 | |
| *** yolanda has quit IRC | 06:27 | |
| *** yolanda has joined #openstack-infra | 06:27 | |
| *** gibi has quit IRC | 06:33 | |
| *** Adri2000 has quit IRC | 06:33 | |
| *** gibi has joined #openstack-infra | 06:34 | |
| *** yolanda has quit IRC | 06:34 | |
| *** thorst has joined #openstack-infra | 06:35 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/requirements: Updated from generate-constraints https://review.openstack.org/309273 | 06:36 |
| *** kzaitsev_mb has quit IRC | 06:37 | |
| *** ccamacho has joined #openstack-infra | 06:38 | |
| jhesketh | tonyb: looks like a bunch of jobs are unstable | 06:39 |
| jhesketh | let me poke | 06:39 |
| tonyb | jhesketh: thanks. | 06:39 |
| tonyb | jhesketh: double thanks as you're not s'posed to be around ATM | 06:39 |
| * jhesketh makes no promises | 06:40 | |
| *** yolanda has joined #openstack-infra | 06:40 | |
| *** kzaitsev_mb has joined #openstack-infra | 06:41 | |
| *** Adri2000 has joined #openstack-infra | 06:41 | |
| yolanda | #status alert Filesystem on logs.openstack.org is broken, we are on the process of repairing it. Please stop checking your jobs until further notice | 06:42 |
| openstackstatus | yolanda: sending alert | 06:42 |
| *** thorst has quit IRC | 06:42 | |
| *** nbloom has joined #openstack-infra | 06:42 | |
| *** tesseract has joined #openstack-infra | 06:44 | |
| -openstackstatus- NOTICE: Filesystem on logs.openstack.org is broken, we are on the process of repairing it. Please stop checking your jobs until further notice | 06:44 | |
| *** ChanServ changes topic to "Filesystem on logs.openstack.org is broken, we are on the process of repairing it. Please stop checking your jobs until further notice" | 06:44 | |
| *** tesseract is now known as Guest40479 | 06:44 | |
| *** daemontool_ has quit IRC | 06:45 | |
| openstackstatus | yolanda: finished sending alert | 06:47 |
| jhesketh | yolanda: oh, looks like you're working on it | 06:47 |
| jhesketh | yolanda: did you unmount it? | 06:47 |
| yolanda | yes | 06:47 |
| * jhesketh was just trying to figure out why it didn't remount readonly | 06:47 | |
| *** Guest40479 has quit IRC | 06:47 | |
| jhesketh | okay, I'll leave you to it | 06:47 |
| jhesketh | I'm around if you need a hand though | 06:48 |
| yolanda | i'm running fsck now | 06:48 |
| jhesketh | tonyb: ^ | 06:48 |
| *** gibi has quit IRC | 06:48 | |
| jhesketh | yolanda: don't forget you'll need to do some log shuffling when done as they are currently being written to the static partition | 06:48 |
| tonyb | jhesketh, yolanda: Thanks! | 06:48 |
| yolanda | jhesketh, care reminding me the rsync command you used last time? | 06:48 |
| *** tesseract- has joined #openstack-infra | 06:49 | |
| jhesketh | sigh, it's not in my bash history | 06:49 |
| *** gibi has joined #openstack-infra | 06:49 | |
| yolanda | i'll figure... | 06:50 |
| *** sree has joined #openstack-infra | 06:52 | |
| jhesketh | yolanda: something like: rsync -vv -aHAXPh --ignore-existing --dry-run backup.logs/ logs/ | 06:52 |
| jhesketh | check the dry-run first | 06:53 |
| yolanda | ++ | 06:54 |
| *** gibi has quit IRC | 06:54 | |
| *** gibi has joined #openstack-infra | 06:55 | |
| *** DevBox has quit IRC | 06:57 | |
| *** kzaitsev_mb has quit IRC | 06:58 | |
| *** fedexo has quit IRC | 06:59 | |
| *** salv-orlando has quit IRC | 07:04 | |
| *** arxcruz has joined #openstack-infra | 07:04 | |
| *** rcernin_ has joined #openstack-infra | 07:04 | |
| openstackgerrit | yolanda.robla proposed openstack-infra/shade: Add baymodel list, get and search call for shade+magnum https://review.openstack.org/308009 | 07:09 |
| *** dimtruck is now known as zz_dimtruck | 07:10 | |
| *** jed56 has joined #openstack-infra | 07:11 | |
| openstackgerrit | Samuel Gauthier proposed openstack-infra/project-config: add networking-vpp project to OpenStack https://review.openstack.org/311941 | 07:12 |
| openstackgerrit | yolanda.robla proposed openstack-infra/shade: Add initial setup for magnum in shade https://review.openstack.org/243239 | 07:14 |
| *** haypo has joined #openstack-infra | 07:15 | |
| *** yaume has joined #openstack-infra | 07:16 | |
| *** kaisers1 has joined #openstack-infra | 07:17 | |
| *** markvoelker has joined #openstack-infra | 07:21 | |
| *** zeih has joined #openstack-infra | 07:22 | |
| *** markvoelker has quit IRC | 07:26 | |
| *** zz_dimtruck is now known as dimtruck | 07:26 | |
| haypo | hi. what's the issue with check jobs logs? https://review.openstack.org/#/c/311612/ was checked 1 day ago, but http://logs.openstack.org/12/311612/1/check/gate-keystone-python27-db/a35964b/ says "File Not Found" | 07:26 |
| *** nadya has joined #openstack-infra | 07:27 | |
| haypo | one or two weeks ago, i read there that it sometimes takes several hours to copy logs. is it still the case? | 07:27 |
| frickler | haypo: see the topic ;) | 07:27 |
| haypo | oh | 07:29 |
| haypo | frickler: hum, i see :) | 07:29 |
| *** asettle has joined #openstack-infra | 07:30 | |
| *** nmagnezi has joined #openstack-infra | 07:31 | |
| *** vincentll has joined #openstack-infra | 07:32 | |
| *** rcernin_ has quit IRC | 07:33 | |
| *** dimtruck is now known as zz_dimtruck | 07:35 | |
| *** rcernin has quit IRC | 07:36 | |
| *** pfallenop has quit IRC | 07:38 | |
| *** nadya has quit IRC | 07:39 | |
| *** thorst has joined #openstack-infra | 07:40 | |
| *** binbincong has quit IRC | 07:40 | |
| *** pfallenop has joined #openstack-infra | 07:45 | |
| *** thorst has quit IRC | 07:47 | |
| *** ggnel_t has joined #openstack-infra | 07:47 | |
| *** ggnel_t2 has joined #openstack-infra | 07:47 | |
| *** chlong has quit IRC | 07:47 | |
| *** ggnel_t has quit IRC | 07:47 | |
| *** ggnel_t2 has quit IRC | 07:48 | |
| *** ggnel_t has joined #openstack-infra | 07:48 | |
| *** shardy has joined #openstack-infra | 07:50 | |
| openstackgerrit | Balazs Gibizer proposed openstack-infra/irc-meetings: Increasing the frequency of notification meeting https://review.openstack.org/311948 | 07:52 |
| *** ggnel_t has quit IRC | 07:53 | |
| *** ggnel_t has joined #openstack-infra | 07:53 | |
| *** yuanying has joined #openstack-infra | 07:55 | |
| *** sdake has quit IRC | 07:56 | |
| *** binbincong has joined #openstack-infra | 07:56 | |
| *** spiffxp has joined #openstack-infra | 07:56 | |
| *** maximov_ has joined #openstack-infra | 07:58 | |
| *** larainema_ has joined #openstack-infra | 07:58 | |
| *** scottda has quit IRC | 07:58 | |
| *** yonglihe has quit IRC | 07:58 | |
| *** dham1 has quit IRC | 07:58 | |
| *** fkautz has quit IRC | 07:58 | |
| *** DuncanT has quit IRC | 07:58 | |
| *** boris-42 has quit IRC | 07:58 | |
| *** rguillebert has quit IRC | 07:58 | |
| *** sweston has quit IRC | 07:58 | |
| *** zhiyan has quit IRC | 07:58 | |
| *** jed56 has quit IRC | 07:58 | |
| *** cargonza has quit IRC | 07:58 | |
| *** jaranovich has quit IRC | 07:58 | |
| *** hrybacki has quit IRC | 07:58 | |
| *** mwhahaha has quit IRC | 07:58 | |
| *** NobodyCam has quit IRC | 07:58 | |
| *** asettle has quit IRC | 07:58 | |
| *** docaedo2 has quit IRC | 07:58 | |
| *** jyuso has quit IRC | 07:58 | |
| *** larainema has quit IRC | 07:58 | |
| *** GheRivero has quit IRC | 07:58 | |
| *** vdrok has quit IRC | 07:58 | |
| *** msuriar has quit IRC | 07:58 | |
| *** maximov has quit IRC | 07:58 | |
| *** spiffxp_ has quit IRC | 07:58 | |
| *** bryan_att has quit IRC | 07:58 | |
| *** rackertom has quit IRC | 07:58 | |
| *** timl0101 has quit IRC | 07:58 | |
| *** woodster_ has quit IRC | 07:58 | |
| *** zzzeek has quit IRC | 07:58 | |
| *** hughsaunders has quit IRC | 07:58 | |
| *** zxiiro has quit IRC | 07:58 | |
| *** scottda has joined #openstack-infra | 07:58 | |
| *** sulo has quit IRC | 07:58 | |
| *** vdrok_ has joined #openstack-infra | 07:58 | |
| *** larainema_ is now known as larainema | 07:58 | |
| *** zhiyan_ has joined #openstack-infra | 07:58 | |
| *** NobodyCam_ has joined #openstack-infra | 07:58 | |
| *** cargonza has joined #openstack-infra | 07:58 | |
| *** dham1 has joined #openstack-infra | 07:58 | |
| *** vdrok_ has quit IRC | 07:58 | |
| *** vdrok_ has joined #openstack-infra | 07:58 | |
| *** scottda has quit IRC | 07:58 | |
| *** scottda has joined #openstack-infra | 07:58 | |
| *** dham1 has quit IRC | 07:58 | |
| *** dham1 has joined #openstack-infra | 07:58 | |
| *** cargonza has quit IRC | 07:58 | |
| *** cargonza has joined #openstack-infra | 07:58 | |
| *** asettle has joined #openstack-infra | 07:58 | |
| *** yolanda has quit IRC | 07:58 | |
| *** Guest78717 has quit IRC | 07:58 | |
| *** mmedvede has quit IRC | 07:58 | |
| *** dstanek has quit IRC | 07:58 | |
| *** dtroyer has quit IRC | 07:58 | |
| *** ayoung has quit IRC | 07:58 | |
| *** pblaho has quit IRC | 07:58 | |
| *** d0ugal has quit IRC | 07:58 | |
| *** anthonyper has quit IRC | 07:58 | |
| *** gus has quit IRC | 07:58 | |
| *** nt has quit IRC | 07:58 | |
| *** docaedo has quit IRC | 07:58 | |
| *** auggy has quit IRC | 07:58 | |
| *** yuanying_ has quit IRC | 07:58 | |
| *** lbragstad has quit IRC | 07:58 | |
| *** jlk has quit IRC | 07:58 | |
| *** mrodden has quit IRC | 07:58 | |
| *** jyuso has joined #openstack-infra | 07:58 | |
| *** sulo has joined #openstack-infra | 07:58 | |
| *** maximov_ is now known as maximov | 07:58 | |
| *** pblaho has joined #openstack-infra | 07:59 | |
| *** msuriar has joined #openstack-infra | 07:59 | |
| *** d0ugal has joined #openstack-infra | 07:59 | |
| *** DuncanT_ has joined #openstack-infra | 07:59 | |
| *** BobBall has joined #openstack-infra | 07:59 | |
| *** jistr has joined #openstack-infra | 07:59 | |
| *** zxiiro has joined #openstack-infra | 07:59 | |
| *** dstanek has joined #openstack-infra | 07:59 | |
| *** auggy has joined #openstack-infra | 07:59 | |
| *** sweston has joined #openstack-infra | 07:59 | |
| *** BobBall is now known as Guest82571 | 07:59 | |
| *** mrodden has joined #openstack-infra | 07:59 | |
| *** lbragstad has joined #openstack-infra | 07:59 | |
| *** nt has joined #openstack-infra | 07:59 | |
| *** jlk has joined #openstack-infra | 07:59 | |
| *** hrybacki has joined #openstack-infra | 07:59 | |
| *** anthonyper has joined #openstack-infra | 07:59 | |
| *** ayoung has joined #openstack-infra | 08:00 | |
| *** jlk has quit IRC | 08:00 | |
| *** jlk has joined #openstack-infra | 08:00 | |
| *** docaedo has joined #openstack-infra | 08:00 | |
| *** bryan_att has joined #openstack-infra | 08:00 | |
| *** zhiyan_ is now known as zhiyan | 08:00 | |
| *** dtroyer has joined #openstack-infra | 08:00 | |
| *** fkautz has joined #openstack-infra | 08:00 | |
| *** yonglihe has joined #openstack-infra | 08:00 | |
| *** hughsaunders has joined #openstack-infra | 08:00 | |
| *** zzzeek has joined #openstack-infra | 08:00 | |
| *** chlong has joined #openstack-infra | 08:01 | |
| *** DuncanT_ is now known as DuncanT | 08:02 | |
| *** gus has joined #openstack-infra | 08:02 | |
| *** rguillebert has joined #openstack-infra | 08:02 | |
| *** matrohon has joined #openstack-infra | 08:03 | |
| *** yolanda has joined #openstack-infra | 08:03 | |
| *** mwhahaha has joined #openstack-infra | 08:04 | |
| *** woodster_ has joined #openstack-infra | 08:05 | |
| yolanda | fsck finished, going to move logs and mount again | 08:05 |
| *** jlanoux has joined #openstack-infra | 08:05 | |
| openstackgerrit | Samuel Gauthier proposed openstack-infra/project-config: add networking-vpp project to OpenStack https://review.openstack.org/311941 | 08:05 |
| *** pilgrimstack has joined #openstack-infra | 08:05 | |
| openstackgerrit | Rob Cresswell proposed openstack/requirements: Add horizon-cisco-ui to projects.txt https://review.openstack.org/300062 | 08:06 |
| *** rackertom has joined #openstack-infra | 08:08 | |
| *** jerryz has quit IRC | 08:08 | |
| *** timl0101 has joined #openstack-infra | 08:09 | |
| *** boris-42 has joined #openstack-infra | 08:10 | |
| *** GheRivero has joined #openstack-infra | 08:10 | |
| *** jaranovich has joined #openstack-infra | 08:11 | |
| *** mmedvede has joined #openstack-infra | 08:11 | |
| *** jed56 has joined #openstack-infra | 08:11 | |
| matrohon | hi all, | 08:12 |
| matrohon | Is there something broken on static.openstack.org? | 08:13 |
| matrohon | I'm having some merge failed on doc jobs : http://logs.openstack.org/29/311729/1/gate/gate-networking-bgpvpn-docs/1b11566/console.html#_2016-05-03_07_59_59_523 | 08:13 |
| *** sshnaidm has quit IRC | 08:14 | |
| *** jogo has quit IRC | 08:16 | |
| *** fbo has joined #openstack-infra | 08:17 | |
| *** ifarkas has joined #openstack-infra | 08:17 | |
| matrohon | AJaeger, hi | 08:19 |
| matrohon | AJaeger, ^ | 08:19 |
| *** lipeng has joined #openstack-infra | 08:20 | |
| odyssey4me | matrohon you may notice the topic of this channel indicates that there are issues in general with the logs - all other channels also got the notice | 08:21 |
| matrohon | odyssey4me, thanks, I didn't look at the topic! | 08:22 |
| lipeng | Hi, when I sign 'OpenStack Project Individual Contributor License Agreement' on web pages and commit, Server error occured. | 08:22 |
| yolanda | #status ok Logs filesystem has been successfully restored, please recheck your jobs | 08:22 |
| openstackstatus | yolanda: sending ok | 08:22 |
| lipeng | Code Review - Error | 08:22 |
| lipeng | Server Error | 08:22 |
| lipeng | Cannot store contact information | 08:22 |
| lipeng | Can anyone help me? | 08:22 |
| *** markvoelker has joined #openstack-infra | 08:22 | |
| *** chem has joined #openstack-infra | 08:22 | |
| AJaeger | lipeng: If you already followed the instructions at http://docs.openstack.org/infra/manual/developers.html#account-setup and still get it, see https://ask.openstack.org/question/56720 for additional tips. | 08:24 |
| *** ChanServ changes topic to "Discussion of OpenStack Developer and Community Infrastructure | docs http://docs.openstack.org/infra/ | bugs https://storyboard.openstack.org/ | source https://git.openstack.org/cgit/openstack-infra/ | channel logs http://eavesdrop.openstack.org/irclogs/%23openstack-infra/" | 08:24 | |
| -openstackstatus- NOTICE: Logs filesystem has been successfully restored, please recheck your jobs | 08:24 | |
| haypo | "NOTICE: Logs filesystem has been successfully restored, please recheck your jobs" good job, thanks ;) | 08:24 |
| *** jogo has joined #openstack-infra | 08:25 | |
| yolanda | hi, so logs filesystem is ok again | 08:25 |
| odyssey4me | thanks yolanda :) | 08:26 |
| AJaeger | matrohon: see yolanda's message - she repaired the file system. recheck your change... | 08:26 |
| AJaeger | yolanda: Thanks! | 08:26 |
| yolanda | glad to help | 08:26 |
| openstackgerrit | Julien Danjou proposed openstack/requirements: Remove Ceilometer from projects https://review.openstack.org/311989 | 08:26 |
| matrohon | AJaeger, yolanda : thanks! | 08:26 |
| *** markvoelker has quit IRC | 08:27 | |
| jd__ | thank you infra! | 08:27 |
| openstackstatus | yolanda: finished sending ok | 08:27 |
| *** keedya has quit IRC | 08:28 | |
| *** hashar has joined #openstack-infra | 08:29 | |
| *** |-paul-| has joined #openstack-infra | 08:30 | |
| odyssey4me | hmm, I'm still getting 'UNSTABLE' results from jobs | 08:30 |
| odyssey4me | an example: https://review.openstack.org/311965 | 08:31 |
| yolanda | oh, docs-draft crashed as well | 08:31 |
| yolanda | i fixed logs | 08:31 |
| yolanda | so i'll check other volumes and repair again | 08:31 |
| odyssey4me | ah ok - that makes sense :/ | 08:32 |
| yolanda | disk fun today! | 08:33 |
| AJaeger | ;( | 08:33 |
| yolanda | #status notice Filesystem on docs-draft.openstack.org is broken, we are on the process of repairing it. Please stop checking jobs using this filesystem until further notice | 08:33 |
| openstackstatus | yolanda: sending notice | 08:33 |
| *** kushal has joined #openstack-infra | 08:34 | |
| *** itsuugo has joined #openstack-infra | 08:34 | |
| -openstackstatus- NOTICE: Filesystem on docs-draft.openstack.org is broken, we are on the process of repairing it. Please stop checking jobs using this filesystem until further notice | 08:35 | |
| lennyb | Hi Infra, I faced a strange zuul deadlock #link http://paste.openstack.org/show/495932/ caused by patchset 12 of #link https://review.openstack.org/#/c/309273 | 08:35 |
| *** dmk0202 has joined #openstack-infra | 08:35 | |
| openstackstatus | yolanda: finished sending notice | 08:36 |
| *** dingyichen has quit IRC | 08:37 | |
| sc68cal | Is infra using storyboard? we have a bug that probably needs some infra help, that was talked about last week- but I want to make sure it doesn't get lost in the shuffle - https://bugs.launchpad.net/devstack/+bug/1570584 | 08:38 |
| openstack | Launchpad bug 1570584 in devstack "Docs page broken - running off page" [Undecided,New] | 08:38 |
| *** derekh has joined #openstack-infra | 08:39 | |
| openstackgerrit | Merged openstack-infra/irc-meetings: Increasing the frequency of notification meeting https://review.openstack.org/311948 | 08:40 |
| *** thorst has joined #openstack-infra | 08:45 | |
| yolanda | AJaeger, i'll need to revert the shade+magnum again, it's totally weird. It passed several of my non-voting jobs, but now since i merged, it fails on a neutron test :( | 08:45 |
| yolanda | there must be some side effect | 08:45 |
| openstackgerrit | yolanda.robla proposed openstack-infra/project-config: Revert "Add magnum plugin to keystone2 job in shade" https://review.openstack.org/311992 | 08:45 |
| *** jang has joined #openstack-infra | 08:45 | |
| *** haypo has left #openstack-infra | 08:46 | |
| AJaeger | yolanda: what fun ;( | 08:48 |
| yolanda | yep, going to move to non-voting again, and debug, not sure if that's something new, because the non-voting and voting jobs were identical | 08:48 |
| yolanda | and the failing one is not even a magnum test, is a neutron test | 08:49 |
| AJaeger | strange | 08:50 |
| *** thorst has quit IRC | 08:52 | |
| *** e0ne has joined #openstack-infra | 08:52 | |
| odyssey4me | it would appear that docs-draft is working again yolanda | 08:54 |
| odyssey4me | well, tests are passing | 08:55 |
| *** sileht has quit IRC | 09:01 | |
| *** sileht has joined #openstack-infra | 09:02 | |
| *** electrofelix has joined #openstack-infra | 09:02 | |
| *** dizquierdo has joined #openstack-infra | 09:03 | |
| *** dizquierdo has quit IRC | 09:04 | |
| *** sshnaidm has joined #openstack-infra | 09:04 | |
| *** vgridnev has quit IRC | 09:05 | |
| openstackgerrit | Merged openstack-infra/project-config: Revert "Add magnum plugin to keystone2 job in shade" https://review.openstack.org/311992 | 09:05 |
| *** asettle has quit IRC | 09:05 | |
| *** asettle has joined #openstack-infra | 09:06 | |
| *** dizquierdo has joined #openstack-infra | 09:06 | |
| *** markmcd__ has quit IRC | 09:09 | |
| *** markmcd has quit IRC | 09:09 | |
| *** markmcd has joined #openstack-infra | 09:10 | |
| *** markmcd1 has joined #openstack-infra | 09:11 | |
| *** asettle has quit IRC | 09:11 | |
| yolanda | odyssey4me, it's in the process of being restored, and while the volume is unmounted, the docs are placed on another volume | 09:12 |
| *** zz_dimtruck is now known as dimtruck | 09:12 | |
| odyssey4me | yolanda ah ok... restored? wow, much brokenness :/ | 09:13 |
| *** skolekonov has joined #openstack-infra | 09:13 | |
| *** skolekonov has quit IRC | 09:13 | |
| lipeng | AJaeger: I followed your advice and now it is OK, thanks! | 09:14 |
| *** dizquierdo has quit IRC | 09:14 | |
| *** dizquierdo has joined #openstack-infra | 09:15 | |
| yolanda | #status ok Docs-draft filesystem has been restored. Please check your affected jobs again | 09:19 |
| openstackstatus | yolanda: sending ok | 09:19 |
| openstackgerrit | Sean M. Collins proposed openstack-infra/project-config: Make grenade-dsvm-neutron-multinode voting https://review.openstack.org/299843 | 09:20 |
| *** oanson has joined #openstack-infra | 09:20 | |
| *** e0ne has quit IRC | 09:21 | |
| *** zeih has quit IRC | 09:21 | |
| -openstackstatus- NOTICE: Docs-draft filesystem has been restored. Please check your affected jobs again | 09:21 | |
| *** dimtruck is now known as zz_dimtruck | 09:22 | |
| *** markvoelker has joined #openstack-infra | 09:23 | |
| *** sheeprine_ is now known as sheeprine | 09:23 | |
| *** sheeprine has joined #openstack-infra | 09:23 | |
| *** jordanP has joined #openstack-infra | 09:24 | |
| *** dizquierdo has quit IRC | 09:24 | |
| openstackstatus | yolanda: finished sending ok | 09:25 |
| *** dizquierdo has joined #openstack-infra | 09:25 | |
| *** oanson has quit IRC | 09:27 | |
| *** markvoelker has quit IRC | 09:28 | |
| *** asettle has joined #openstack-infra | 09:28 | |
| *** dizquierdo has quit IRC | 09:32 | |
| *** sambetts|afk is now known as sambetts | 09:32 | |
| *** dizquierdo has joined #openstack-infra | 09:34 | |
| *** asettle has quit IRC | 09:39 | |
| *** gildub has quit IRC | 09:41 | |
| *** lipeng has quit IRC | 09:41 | |
| *** dizquierdo has quit IRC | 09:43 | |
| *** tosky has joined #openstack-infra | 09:46 | |
| *** ccamacho has left #openstack-infra | 09:47 | |
| *** links has quit IRC | 09:48 | |
| *** thorst has joined #openstack-infra | 09:50 | |
| *** dizquierdo has joined #openstack-infra | 09:51 | |
| *** thorst has quit IRC | 09:57 | |
| frickler | yolanda: I'm still seeing logging errors after your o.k. message, like http://logs.openstack.org/18/307718/2/check/gate-nova-docs/301bfd9/console.html , if you could have another look at that? | 09:57 |
| frickler | ah, that is static.openstack.org instead of logs, probably needs fixing, too? | 09:58 |
| yolanda | frickler, i fixed logs and docs-draft. Both should be working now, i tested creating files inside docs-draft and works for me now | 09:59 |
| yolanda | can you recheck again ? | 10:00 |
| frickler | yolanda: can you check static.openstack.org, too, please? | 10:00 |
| *** jlanoux has quit IRC | 10:00 | |
| frickler | http://logs.openstack.org/18/307718/2/check/gate-nova-releasenotes/c704fe3/console.html#_2016-05-03_08_28_57_454 | 10:00 |
| *** jlanoux has joined #openstack-infra | 10:00 | |
| yolanda | frickler, everything is static.openstack.org | 10:00 |
| yolanda | docs-draft is just a volume on that server | 10:01 |
| frickler | yolanda: hmm, o.k., so I'll just try another recheck, thx | 10:01 |
| yolanda | please try and let me know | 10:01 |
| *** rossella_s has joined #openstack-infra | 10:01 | |
| *** kengo_sakai has joined #openstack-infra | 10:02 | |
| *** e0ne has joined #openstack-infra | 10:02 | |
| *** links has joined #openstack-infra | 10:04 | |
| *** links has quit IRC | 10:07 | |
| *** zhurong has quit IRC | 10:08 | |
| frickler | yolanda: looking better now, will take another hour though for all of the jobs to finish | 10:11 |
| yolanda | frickler, cool that it works | 10:11 |
| *** kushal has quit IRC | 10:13 | |
| *** zeih has joined #openstack-infra | 10:13 | |
| *** _amrith_ is now known as amrith | 10:14 | |
| *** links has joined #openstack-infra | 10:14 | |
| *** Guest82571 is now known as BobBall | 10:23 | |
| *** cody-somerville has quit IRC | 10:23 | |
| *** markvoelker has joined #openstack-infra | 10:24 | |
| *** sdague has joined #openstack-infra | 10:25 | |
| *** hieulq has joined #openstack-infra | 10:27 | |
| *** kushal has joined #openstack-infra | 10:27 | |
| *** markvoelker has quit IRC | 10:28 | |
| *** hieulq has quit IRC | 10:29 | |
| *** hieulq has joined #openstack-infra | 10:29 | |
| *** jlanoux_ has joined #openstack-infra | 10:30 | |
| *** rhallisey has joined #openstack-infra | 10:30 | |
| *** jlanoux has quit IRC | 10:30 | |
| *** mikelk has joined #openstack-infra | 10:31 | |
| *** jlanoux has joined #openstack-infra | 10:32 | |
| *** jlanoux_ has quit IRC | 10:33 | |
| *** Kennan has quit IRC | 10:35 | |
| *** hieulq has quit IRC | 10:35 | |
| *** hashar has quit IRC | 10:35 | |
| *** Kennan has joined #openstack-infra | 10:35 | |
| *** hieulq has joined #openstack-infra | 10:35 | |
| *** kushal has quit IRC | 10:39 | |
| *** rossella_s has quit IRC | 10:39 | |
| openstackgerrit | Jianghua Wang proposed openstack-infra/nodepool: Add namespace for nodepool https://review.openstack.org/310698 | 10:39 |
| *** hieulq has quit IRC | 10:40 | |
| *** jlanoux_ has joined #openstack-infra | 10:43 | |
| *** zeih_ has joined #openstack-infra | 10:45 | |
| *** zeih has quit IRC | 10:45 | |
| *** jlanoux has quit IRC | 10:46 | |
| *** markus_z has joined #openstack-infra | 10:51 | |
| *** pfallenop has quit IRC | 10:52 | |
| *** thorst has joined #openstack-infra | 10:55 | |
| *** Kennan has quit IRC | 10:58 | |
| *** lucasagomes is now known as lucas-hungry | 10:59 | |
| *** thorst has quit IRC | 11:02 | |
| *** amrith is now known as _amrith_ | 11:02 | |
| odyssey4me | has anyone else been seeing tox errors for 'baseenv=python2' on a mac ? | 11:02 |
| odyssey4me | sorry, that's actually 'basepython = python2' | 11:03 |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: Update setuptools in Centos for DLRN https://review.openstack.org/312016 | 11:03 |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: Update setuptools in Centos for DLRN https://review.openstack.org/312016 | 11:06 |
| *** chem has quit IRC | 11:08 | |
| *** kengo_sakai has quit IRC | 11:09 | |
| *** zz_dimtruck is now known as dimtruck | 11:13 | |
| *** Kennan has joined #openstack-infra | 11:14 | |
| *** zeih_ has quit IRC | 11:17 | |
| *** rossella_s has joined #openstack-infra | 11:18 | |
| *** zeih has joined #openstack-infra | 11:18 | |
| *** yolanda has quit IRC | 11:22 | |
| *** dimtruck is now known as zz_dimtruck | 11:23 | |
| *** links has quit IRC | 11:24 | |
| *** markvoelker has joined #openstack-infra | 11:24 | |
| *** yolanda has joined #openstack-infra | 11:27 | |
| *** hashar has joined #openstack-infra | 11:27 | |
| *** markvoelker has quit IRC | 11:29 | |
| *** gordc has joined #openstack-infra | 11:29 | |
| *** kushal has joined #openstack-infra | 11:31 | |
| *** banix has joined #openstack-infra | 11:34 | |
| *** banix has quit IRC | 11:36 | |
| *** Hal has joined #openstack-infra | 11:36 | |
| *** Hal is now known as Guest59570 | 11:37 | |
| sdague | how do I find a shortname for a 3rd party ci in jenkins? | 11:38 |
| *** rossella_s has quit IRC | 11:41 | |
| *** thorst has joined #openstack-infra | 11:43 | |
| *** rossella_s has joined #openstack-infra | 11:44 | |
| *** Guest59570 has quit IRC | 11:45 | |
| *** dizquierdo has quit IRC | 11:48 | |
| *** ccamacho has joined #openstack-infra | 11:49 | |
| *** kengo_sakai has joined #openstack-infra | 11:52 | |
| *** dprince has joined #openstack-infra | 11:53 | |
| *** lucas-hungry is now known as lucasagomes | 11:54 | |
| *** weshay has joined #openstack-infra | 11:55 | |
| *** zz_ja has quit IRC | 11:55 | |
| *** zeih has quit IRC | 11:56 | |
| *** zeih has joined #openstack-infra | 11:57 | |
| *** baoli has joined #openstack-infra | 11:57 | |
| *** tpsilva has joined #openstack-infra | 11:57 | |
| *** rfolco has joined #openstack-infra | 12:00 | |
| *** kengo_sakai has quit IRC | 12:01 | |
| *** weshay is now known as weshay_mtg | 12:02 | |
| *** ldnunes has joined #openstack-infra | 12:02 | |
| *** links has joined #openstack-infra | 12:03 | |
| *** psilvad has joined #openstack-infra | 12:04 | |
| *** zz_ja has joined #openstack-infra | 12:04 | |
| *** trown|outtypewww is now known as trown | 12:06 | |
| *** kgiusti has joined #openstack-infra | 12:08 | |
| *** yaume has quit IRC | 12:09 | |
| *** yaume has joined #openstack-infra | 12:09 | |
| *** psilvad has quit IRC | 12:09 | |
| *** zz_ja has quit IRC | 12:13 | |
| *** sshnaidm has quit IRC | 12:14 | |
| *** aysyd has joined #openstack-infra | 12:15 | |
| pabelanger | morning | 12:16 |
| openstackgerrit | yolanda.robla proposed openstack-infra/project-config: Revert "Revert "Add magnum plugin to keystone2 job in shade"" https://review.openstack.org/312032 | 12:16 |
| *** krtaylor has quit IRC | 12:18 | |
| nbloom | Hi, I update our(Vitrage) post_test_hook.sh and reran an experimental job that calls it though it doesn't seem to have been updated.. does the update takes time? | 12:20 |
| *** krtaylor has joined #openstack-infra | 12:20 | |
| *** markvoelker has joined #openstack-infra | 12:22 | |
| toabctl | I'm trying to get a new requirement (called "spec_cleaner") into the global requirements. but the test run fails with "No matching distribution found for spec-cleaner>=0.8.2" . on pypi is 0.8.2 available. how often are the pypi mirrors updated? | 12:22 |
| toabctl | the logs are here: http://logs.openstack.org/68/311468/3/check/gate-requirements-integration-dsvm/4e44e1d/console.html | 12:22 |
| *** burgerk has joined #openstack-infra | 12:23 | |
| *** zz_ja has joined #openstack-infra | 12:24 | |
| AJaeger | toabctl: we had some problems with our pypi mirroring and some have been working last night on it. I haven't checked backscroll from last 18 hours whether it's solved - but fear it takes a little bit longer. | 12:25 |
| openstackgerrit | Merged openstack-infra/tripleo-ci: Finished: Update deprecated commands in tripleo.sh (Old heat * calls) https://review.openstack.org/309039 | 12:25 |
| *** nadya has joined #openstack-infra | 12:25 | |
| *** sshnaidm has joined #openstack-infra | 12:25 | |
| toabctl | AJaeger: ok. then I'll way a bit and retrigger the test later. thx | 12:25 |
| AJaeger | toabctl: Normally it should be available within an hour | 12:25 |
| openstackgerrit | Merged openstack-infra/puppet-gerrit: Use working war in testing https://review.openstack.org/311894 | 12:25 |
| AJaeger | toabctl: or ask before you leave the office today whether pypi mirror is up to date again - and then recheck | 12:25 |
| *** nadya has quit IRC | 12:26 | |
| *** nadya has joined #openstack-infra | 12:27 | |
| *** amotoki has joined #openstack-infra | 12:27 | |
| *** amotoki has quit IRC | 12:27 | |
| nbloom | nevermind, found my mistake | 12:27 |
| *** vgridnev has joined #openstack-infra | 12:28 | |
| *** EricGonczer_ has joined #openstack-infra | 12:29 | |
| *** jheroux has joined #openstack-infra | 12:32 | |
| *** _prad_ has joined #openstack-infra | 12:33 | |
| *** _prad_ is now known as pradk_ | 12:33 | |
| openstackgerrit | vinay kumar muddu proposed openstack/diskimage-builder: Included "sudo" for devuser element https://review.openstack.org/308747 | 12:35 |
| *** julim has joined #openstack-infra | 12:36 | |
| pabelanger | AJaeger: do you mind +A https://review.openstack.org/#/c/311721. I've confirmed with tripleo PTL they are good with starting up a new node on tripleo-test-cloud-rh1 | 12:36 |
| *** kzaitsev_mb has joined #openstack-infra | 12:39 | |
| *** Hal has joined #openstack-infra | 12:42 | |
| *** Hal is now known as Guest20643 | 12:42 | |
| *** javeriak has joined #openstack-infra | 12:44 | |
| *** nadya has quit IRC | 12:44 | |
| electrofelix | fungi: hoping you have a few mins to iron how you'd like to handle JJB releases | 12:47 |
| openstackgerrit | Emilien Macchi proposed openstack-infra/project-config: Implement periodic job to update Puppet OpenStack constraints https://review.openstack.org/301375 | 12:47 |
| *** EricGonczer_ has quit IRC | 12:47 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/system-config: Wrap ansible-playbook in a 30min timeout https://review.openstack.org/312045 | 12:48 |
| pabelanger | fungi: nibalizer: clarkb: mordred: not pretty but fixes us having to manually kill ansible-playbook ever few hours. ^ | 12:49 |
| fungi | electrofelix: what commit do you want tagged as 1.5.0? the master branch tip or something older? | 12:49 |
| pabelanger | currently it is OOM on the final step, almost every time | 12:49 |
| javeriak | fungi, clarkb, jeblair, pleia2 ; i tried creating a branch on my openstack repo using https://wiki.openstack.org/wiki/Fuel/Plugins#Creating_branches ; but i ended up creating a topic one of of master; and now it wont allow backport cherrypicks or any commit; can i please get the branch deleted, and some guidance on how to really create a new one off of master | 12:49 |
| AJaeger | pabelanger: ok, let me review... | 12:50 |
| pabelanger | fungi: if you also have a moment for https://review.openstack.org/#/c/311754/ that will help EmilienM generate tarballs | 12:50 |
| fungi | still waking up, and keeping an eye out for the impending openssl advisory before i know how today's shaping up, but i'll take a look shortly | 12:51 |
| AJaeger | javeriak: please read http://docs.openstack.org/infra/manual/drivers.html for official documentation | 12:51 |
| fungi | i don't think branches need anything particularly special to be able to propose backports to them | 12:52 |
| javeriak | AJaeger thanks; do i still need someone from the infra team to delete the topic one i have currently? | 12:53 |
| *** piet has joined #openstack-infra | 12:53 | |
| fungi | javeriak: not sure what you mean by "topic branch" in this context. can you elaborate on how you created it? | 12:53 |
| *** xyang1 has joined #openstack-infra | 12:53 | |
| AJaeger | javeriak: we're confused, do you have a link to show us what you did? | 12:53 |
| javeriak | fungi sure; i followed the 'from the web UI' steps here https://wiki.openstack.org/wiki/Fuel/Plugins#Creating_branches | 12:54 |
| *** Goneri has joined #openstack-infra | 12:54 | |
| AJaeger | javeriak: which repository? | 12:54 |
| javeriak | this one https://github.com/openstack/fuel-plugin-plumgrid | 12:54 |
| pabelanger | fungi: good to know | 12:54 |
| *** psilvad has joined #openstack-infra | 12:55 | |
| AJaeger | and which "topic branch" is the problem? | 12:55 |
| javeriak | AJaeger the commit i pushed, ended up going into master; the branch is stable/7.0 | 12:55 |
| fungi | javeriak: that looks like the same way i would have created a branch | 12:55 |
| AJaeger | javeriak: So, you by accident merged a change into master instead of branch? Do you have a reference to it? | 12:56 |
| *** psilvad has quit IRC | 12:56 | |
| fungi | javeriak: it sounds more like you're expecting git-review to know to propose changes against that branch without telling it to do so? | 12:56 |
| *** psilvad has joined #openstack-infra | 12:56 | |
| fungi | branch is a command-line parameter to git-review, but it can also be inferred from the defaultbranch setting in .gitreview if you want to update it on that branch so you can avoid specifying a branch name every time | 12:56 |
| javeriak | fungi; the commit is here: https://review.openstack.org/#/c/311209/ ; it wouldnt allow a cherrpick and push to the stable/7.0 so i did a new commit; but that ended up getting merged into master | 12:57 |
| *** kengo_sakai has joined #openstack-infra | 12:57 | |
| AJaeger | javeriak: "Branch master" | 12:57 |
| javeriak | fungi i cloned the new branch specially using git clone -b ; did my changes and then pushed | 12:57 |
| AJaeger | "Topic: stable/7.0" - topic is just a label | 12:57 |
| AJaeger | Branch: master is the important information | 12:57 |
| fungi | javeriak: "pushed" using the `git review` commnd, or something else? | 12:58 |
| javeriak | fungi yes git review | 12:58 |
| AJaeger | javeriak: as fungi said, you need to tell git review to use the right branch. | 12:58 |
| AJaeger | javeriak: see http://docs.openstack.org/infra/manual/drivers.html#create-stable-branch on .gitreview | 12:58 |
| mordred | pabelanger: did the localhost/local_connection thing fix anything? | 12:58 |
| fungi | javeriak: either `git review stable/7.0` or update .gitreview on that branch to set defaultbranch=stable/7.0 | 12:58 |
| javeriak | hmm but its worked before; i mean for other repo's when i do a git review, it always pushes to whatever branch im working off of locally | 12:58 |
| AJaeger | Or run "git review stable/7.0" to push to 7.0 | 12:59 |
| openstackgerrit | Merged openstack-infra/project-config: Add centos-7 to tripleo cloud https://review.openstack.org/311721 | 12:59 |
| fungi | javeriak: someone has probably updated the .gitreview file on those for you already | 12:59 |
| *** asettle has joined #openstack-infra | 12:59 | |
| AJaeger | javeriak: there's nothing here for us to do at all. You have all the power to fix this yourself ;) | 13:00 |
| *** Guest20643 has quit IRC | 13:00 | |
| javeriak | oh... so i need to update the git review and thats all..; thanks guys :) | 13:00 |
| AJaeger | javeriak: fungi and myself can give you a hand, but I do not see anything that needs us | 13:00 |
| pabelanger | mordred: I haven't tested / landed the patch yet. So open to suggestions to how to properly test | 13:00 |
| fungi | the .gitreview file, yes | 13:00 |
| *** kushal has quit IRC | 13:00 | |
| javeriak | they should've put that in the web ui guide page though; managing a repo is tricky :) | 13:01 |
| rcarrillocruz | pabelanger: you aware nibalizer pushed similar patch for ansible OOM problem? | 13:01 |
| *** kengo_sakai has quit IRC | 13:01 | |
| rcarrillocruz | https://review.openstack.org/#/c/311913/1/run_all.sh | 13:01 |
| fungi | javeriak: git review is not written by the gerrit developers, so integrating a configuration file for it into the gerrit ui would be strange | 13:01 |
| pabelanger | rcarrillocruz: haha, I am now :) | 13:01 |
| AJaeger | javeriak: it's documented in the Infra documentation that I mentioned... | 13:02 |
| pabelanger | rcarrillocruz: thanks, abandoned my | 13:02 |
| pabelanger | mine* | 13:02 |
| rcarrillocruz | :-) np | 13:03 |
| *** tlian has joined #openstack-infra | 13:04 | |
| *** yaume_ has joined #openstack-infra | 13:04 | |
| AJaeger | fungi, did you see my mail on openstack-infra with the bindep plan? Can you take the first step, please? | 13:04 |
| *** weshay_mtg is now known as weshay | 13:04 | |
| *** edmondsw has joined #openstack-infra | 13:04 | |
| fungi | AJaeger: yep, replying to it is on my to do pile | 13:06 |
| fungi | also trying to get my last stack of exit code changes redone for bindep, but maybe i'll save that for 1.1.0 | 13:06 |
| *** yaume has quit IRC | 13:07 | |
| AJaeger | fungi, then I'll wait ;) | 13:07 |
| *** vgridnev has quit IRC | 13:07 | |
| *** oanson has joined #openstack-infra | 13:07 | |
| electrofelix | fungi: I think stick with what we were happy with last week - bea7bdf608a4ae77acbca7689c30f88ab8990c1d | 13:08 |
| fungi | okay, tagging that momentarily | 13:10 |
| mordred | pabelanger: when you say "OOM on the last step" - do you mean the last step in the puppet role? | 13:11 |
| *** mylu has joined #openstack-infra | 13:11 | |
| electrofelix | fungi: as a general process, is the preferred approach to request from one of the infra cores to apply the tag as needed? | 13:12 |
| *** mylu has quit IRC | 13:12 | |
| pabelanger | mordred: usually in TASK [puppet : post facts] is when things start breaking | 13:12 |
| mordred | kk. thanks | 13:12 |
| openstackgerrit | Dan Prince proposed openstack-infra/tripleo-ci: Add planet blog aggregator feeds to website https://review.openstack.org/311910 | 13:12 |
| electrofelix | fungi: or specially to request it from you? | 13:12 |
| *** MarkAtwood has joined #openstack-infra | 13:13 | |
| fungi | electrofelix: for now, yes. in the future we'll likely be granting the current jjb core team further autonomy in that realm | 13:13 |
| *** inc0 has joined #openstack-infra | 13:13 | |
| *** yaume_ has quit IRC | 13:14 | |
| mordred | pabelanger: so - we _do_ read in all of the log file stuff into ram | 13:14 |
| fungi | electrofelix: but 1.5.0 release tag is pushed now, and release jobs are hopefully running for it. happy to tag further releases for you in the future, was just hesitant to do it in the middle of the summit | 13:14 |
| *** zz_dimtruck is now known as dimtruck | 13:14 | |
| openstackgerrit | Noam Bloom proposed openstack-infra/project-config: Vitrage - Jenkins https://review.openstack.org/312053 | 13:14 |
| *** zhurong has joined #openstack-infra | 13:14 | |
| mordred | pabelanger: so I think your connection_local thing will help | 13:15 |
| pabelanger | mordred: \o/ | 13:15 |
| *** _ari_ has joined #openstack-infra | 13:16 | |
| electrofelix | fungi: that's ok, as long as we know what's needed, who to ask, etc. presume ok to ask in the room in general and any infra-core will take care of it | 13:16 |
| mordred | pabelanger, fungi: uhm. can either of you shell in to puppetmaster? | 13:17 |
| pabelanger | mordred: I have a shell | 13:17 |
| mordred | pabelanger: dns is resolving a new server for me | 13:18 |
| fungi | mordred: i was able to ssh in | 13:18 |
| *** akshai has joined #openstack-infra | 13:18 | |
| mordred | I'm getting The authenticity of host 'puppetmaster.openstack.org (23.253.245.198)' can't be established. | 13:18 |
| pabelanger | puppetmaster.openstack.org. 3584 IN A 23.253.245.198 is my dig | 13:18 |
| mordred | OH | 13:18 |
| mordred | duh | 13:18 |
| mordred | sorry | 13:18 |
| fungi | ipv4? | 13:18 |
| mordred | all my bad | 13:18 |
| mordred | PHEW | 13:18 |
| mordred | no - I was in a non-mordred shell on my laptop :) | 13:19 |
| *** inc0 has quit IRC | 13:19 | |
| mordred | so that's good - accounts that are not my actual account in fact cannot log in | 13:19 |
| *** inc0 has joined #openstack-infra | 13:19 | |
| *** nbloom has quit IRC | 13:20 | |
| *** nbloom has joined #openstack-infra | 13:20 | |
| fungi | always a good thing | 13:21 |
| *** nadya has joined #openstack-infra | 13:22 | |
| mordred | fungi, pabelanger: to try pabelanger's patch, we need to enable ansible root logins from localhost | 13:22 |
| mordred | any security concerns with that? | 13:22 |
| *** sc68cal has quit IRC | 13:22 | |
| fungi | mordred: as in let root ssh into itself? | 13:23 |
| fungi | oh | 13:23 |
| *** |-paul-| has quit IRC | 13:23 | |
| fungi | enable remote root logins in sshd | 13:23 |
| mordred | well - we currently enable them only from puppetmaster.openstack.org | 13:23 |
| fungi | it's key-based auth only anyway, so no concerns | 13:23 |
| mordred | k | 13:23 |
| * mordred makes patch | 13:24 | |
| *** dimtruck is now known as zz_dimtruck | 13:24 | |
| openstackgerrit | Darragh Bailey proposed openstack-infra/git-review: Limit listing of reviews by branch when specified https://review.openstack.org/312056 | 13:24 |
| *** nadya has quit IRC | 13:24 | |
| openstackgerrit | Dan Prince proposed openstack-infra/tripleo-ci: Add planet blog aggregator feeds to website https://review.openstack.org/311910 | 13:24 |
| openstackgerrit | Merged openstack/diskimage-builder: Remove cloud-initramfs-growroot package https://review.openstack.org/215439 | 13:24 |
| *** salv-orlando has joined #openstack-infra | 13:25 | |
| *** NobodyCam_ is now known as NobodyCam | 13:25 | |
| *** sc68cal has joined #openstack-infra | 13:25 | |
| *** sc68cal has quit IRC | 13:27 | |
| *** piet has quit IRC | 13:28 | |
| *** eharney has joined #openstack-infra | 13:28 | |
| *** asettle has quit IRC | 13:28 | |
| *** sc68cal has joined #openstack-infra | 13:28 | |
| *** piet has joined #openstack-infra | 13:28 | |
| *** julim has quit IRC | 13:29 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/project-config: Don't configure a mirror for tripleo-centos-7 https://review.openstack.org/312058 | 13:29 |
| pabelanger | good news is centos-7 dib boots in tripleo-test-cloud-rh1 but no AFS mirrors prevent it from coming online. ^ is a workaround | 13:30 |
| *** julim has joined #openstack-infra | 13:32 | |
| *** salv-orlando has quit IRC | 13:32 | |
| dims | pabelanger : fungi : any ETA for the AFS issues around pypi mirrors? guessing by end of this week? | 13:34 |
| *** jamesmcarthur has joined #openstack-infra | 13:34 | |
| *** inc0 has quit IRC | 13:34 | |
| *** Hal has joined #openstack-infra | 13:34 | |
| *** ccarmack has joined #openstack-infra | 13:35 | |
| *** inc0 has joined #openstack-infra | 13:35 | |
| *** Hal is now known as Guest48392 | 13:35 | |
| pabelanger | dims: fungi still running, it was restarted at May02 0:00. I don't know how long, but if a full restore, 2.5 days was my calculation using 300GB at 12/MBps | 13:36 |
| *** jlanoux_ has quit IRC | 13:36 | |
| fungi | dims: as far as them still not being updated? i would hope sometime today but i don't know exactly how much data has changed with the pypi file re-org | 13:36 |
| *** yaume has joined #openstack-infra | 13:36 | |
| *** sc68cal has quit IRC | 13:36 | |
| fungi | pabelanger's estimate is about as exact as i think we can make | 13:37 |
| mordred | ya. I'd guess 2.5 days too | 13:37 |
| dims | fungi : ack, will ping back late on friday or early monday if things are not back to normal | 13:37 |
| dims | thanks pabelanger mordred | 13:37 |
| jeblair | if we need it sooner, we can switch to the rw volume | 13:38 |
| dims | jeblair : i am holding back releases | 13:39 |
| *** sree has quit IRC | 13:39 | |
| dims | jeblair : so far nothing really critical | 13:39 |
| *** degorenko has joined #openstack-infra | 13:39 | |
| *** piet has quit IRC | 13:39 | |
| *** sree has joined #openstack-infra | 13:40 | |
| *** jamesmcarthur has quit IRC | 13:41 | |
| mordred | pabelanger: so - our fine friends in #ansible-devel tell us that connection: local tasks also run in a subprocess | 13:41 |
| *** javeriak has quit IRC | 13:41 | |
| mordred | so we should still be getting process separation | 13:42 |
| pabelanger | mordred: ack | 13:42 |
| mordred | which makes me sad panda | 13:42 |
| phschwartz_ | mordred: yes connection: local forces a subprocess. This was part of what was also adding to the anisble-puppet run bloat which makes me a sad panda. lol | 13:43 |
| *** baoli has quit IRC | 13:44 | |
| *** ddieterly has joined #openstack-infra | 13:44 | |
| *** baoli has joined #openstack-infra | 13:45 | |
| *** sree has quit IRC | 13:45 | |
| *** deadnull_ has joined #openstack-infra | 13:45 | |
| openstackgerrit | Brent Eagles proposed openstack-infra/tripleo-ci: Fail pingtest more quickly https://review.openstack.org/308486 | 13:45 |
| mordred | phschwartz_: I'm confused ... how is local subprocess any different than subprocess to run ssh? | 13:46 |
| *** anteaya has joined #openstack-infra | 13:46 | |
| * mordred is still on first coffee, likely missing something | 13:46 | |
| *** mriedem has joined #openstack-infra | 13:46 | |
| *** dizquierdo has joined #openstack-infra | 13:46 | |
| *** annegentle has joined #openstack-infra | 13:46 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/puppet-ssh: Allow root logins from localhost https://review.openstack.org/312064 | 13:47 |
| openstackgerrit | Monty Taylor proposed openstack-infra/system-config: Allow root logins from localhost https://review.openstack.org/312065 | 13:48 |
| mordred | pabelanger: ^^ I think those should get ansible able to ssh to itself | 13:48 |
| *** sc68cal has joined #openstack-infra | 13:48 | |
| pabelanger | mordred: ack | 13:50 |
| clarkb | mordred it should be cheaper even due to cow | 13:50 |
| *** jamesmcarthur has joined #openstack-infra | 13:51 | |
| mordred | I think I'm asking the wrong question here and/or being unclear | 13:54 |
| *** pradk has quit IRC | 13:55 | |
| *** x00350071 is now known as xiangxinyong | 13:56 | |
| *** sigmavirus24_awa is now known as sigmavirus24 | 13:56 | |
| clarkb | I think we should local connection not ssh to self | 13:56 |
| mordred | it sounds like regardless of how heavy of a subprocess it is that we have in the task, it's not task-specific that would cause the OOM, rather it would theoretically be running _anything_ at a similar concurrency for a similar duration | 13:57 |
| *** matrohon has quit IRC | 13:57 | |
| *** burgerk has quit IRC | 13:58 | |
| mordred | and we just happen to be hitting it on our final task | 13:58 |
| *** oanson has quit IRC | 13:58 | |
| mordred | I find that hard to believe, since our playbook and role are actually rather trivial and I can't imagine anyone would be able to use ansible at all if that was the case | 13:59 |
| anteaya | sdague: third party ci systems should be listed here: https://review.openstack.org/#/admin/groups/270,members but being listed requires the ci operators to request to be listed so some many not be on the list | 14:00 |
| anteaya | sdague: then run a curl command with the email address | 14:00 |
| anteaya | curl -X GET 'https://review.openstack.org/accounts/<email>' | 14:00 |
| sdague | anteaya: ok, cool, thanks | 14:00 |
| anteaya | if by shortname you mean gerrit username, I am finding some accounts have not created a gerrit username for themselves | 14:01 |
| anteaya | as that is a manual step | 14:01 |
| *** tonytan4ever has joined #openstack-infra | 14:01 | |
| anteaya | and you are welcome | 14:01 |
| anteaya | sdague: let me know if you need more | 14:01 |
| sdague | anteaya: yeh, I was thinking about gerrit username | 14:01 |
| sdague | just because it's not clear that I can do certain queries with the long name | 14:02 |
| anteaya | okay, some are not setting that for themselves I have learned | 14:02 |
| sdague | ah, ok | 14:02 |
| anteaya | ah | 14:02 |
| openstackgerrit | Merged openstack-infra/storyboard: Stop overriding the signal module in terminate() https://review.openstack.org/308492 | 14:02 |
| fungi | mordred: is it possible our plays generate an atypical volume of stdout and it's being buffered to memory on the puppetmaster? | 14:02 |
| anteaya | the email is a good backup | 14:02 |
| sdague | yeh, I think vmware is one of those | 14:02 |
| sdague | but 9008 works (which I think is it's internal id) | 14:02 |
| anteaya | sdague: also if you do the curl command you get the gerrit account id, you can use the gerrit account id in queries | 14:02 |
| anteaya | yeah that sounds like the gerrit account id | 14:03 |
| *** banix has joined #openstack-infra | 14:03 | |
| anteaya | so, awesome | 14:03 |
| sdague | just fyi, it's related to this thread - http://lists.openstack.org/pipermail/openstack-dev/2016-May/093753.html | 14:03 |
| anteaya | thanks | 14:03 |
| * anteaya reads | 14:03 | |
| mordred | fungi: not really - the entirety of the output of /var/lib/puppet/reports is only 488M | 14:03 |
| mordred | fungi: and we only process one log at a time | 14:03 |
| fungi | that includes facter output? i recall we had issues with extremely large facts at one point | 14:04 |
| fungi | though i agree this seems unlikely | 14:04 |
| *** esker has quit IRC | 14:04 | |
| *** xarses has quit IRC | 14:04 | |
| mordred | fungi: I'm playing with a patch right now to skip processing the facts | 14:04 |
| anteaya | sdague: nice work | 14:06 |
| clarkb | mordred it does copy a bunch of git repos though perhaps that is all in memory? | 14:06 |
| *** Jeffrey4l has joined #openstack-infra | 14:06 | |
| clarkb | I could see that potentially being different with ssh vs local | 14:06 |
| mordred | clarkb: no - different task | 14:07 |
| mordred | clarkb: this is just focusing on the report facts task, which is where the OOM is apparently happening | 14:07 |
| anteaya | odyssey4me: I have not seen anyone else reporting tox errors for 'basepython = python2' on a mac | 14:08 |
| clarkb | mordred: right but it is python which means we may never get the earlier memory back | 14:08 |
| mordred | clarkb: and the subprocess for the git repo copy should be a different subprocess | 14:08 |
| *** kzaitsev_mb has quit IRC | 14:08 | |
| mordred | clarkb: so we should get it back due to the subprocess going away | 14:09 |
| odyssey4me | anteaya thanks - was just checking as this error was new to me, changing 'python2' to 'python2.7' seems to resolve it | 14:09 |
| anteaya | odyssey4me: thanks for sharing the fix :) | 14:10 |
| bswartz | AJaeger: what is "Needed-By"? I've never heard of this | 14:10 |
| anteaya | bswartz: it is a companion to Depends-On | 14:10 |
| bswartz | does it work exactly like depends-on, only in reverse? | 14:10 |
| *** links has quit IRC | 14:10 | |
| anteaya | bswartz: patch B Depends-On patch A, patch A is Needed-By patch B | 14:11 |
| *** ddieterly is now known as ddieterly[away] | 14:11 | |
| AJaeger | bswartz: it's the counterpart but has no effect, just for documentation | 14:11 |
| anteaya | bswartz: mostly it is for reviewers to be able to track the relationship | 14:11 |
| bswartz | Ah! okay that help | 14:11 |
| clarkb | mordred and the source side isnt also reading it all to memory? | 14:11 |
| anteaya | bswartz: thanks for asking | 14:11 |
| AJaeger | bswartz: and it's documented here http://docs.openstack.org/infra/manual/creators.html#add-new-repository-to-the-governance-repository as part of governance setup | 14:11 |
| *** lucasagomes is now known as lucas-post-offic | 14:11 | |
| clarkb | mordred I am just trying to think how ssh could be different than local | 14:11 |
| bswartz | AJaeger: ty | 14:11 |
| mordred | clarkb: right. I'm having a hard time believe it would be | 14:12 |
| mordred | clarkb: like, I think if we could prove it was we would have found a _giant_ bug in ansible | 14:12 |
| clarkb | mordred: ++ | 14:12 |
| openstackgerrit | Monty Taylor proposed openstack-infra/ansible-puppet: Stop posting facts https://review.openstack.org/312101 | 14:13 |
| mordred | clarkb: currently thinking about trying that ^^ | 14:13 |
| mordred | clarkb: (taking the sledgehammer approach to try to whittle down what is or isn't affecting things) | 14:14 |
| *** nadya has joined #openstack-infra | 14:14 | |
| *** ddieterly[away] is now known as ddieterly | 14:15 | |
| openstackgerrit | Ben Swartzlander proposed openstack-infra/project-config: Add manila-specs repo https://review.openstack.org/311853 | 14:20 |
| *** annegentle has quit IRC | 14:20 | |
| *** jamesmcarthur has quit IRC | 14:20 | |
| anteaya | sc68cal: yes, infra uses storyboard | 14:21 |
| anteaya | lennyb: https://review.openstack.org/#/c/309273 hasn't merged yet, so please review the patch and include your paste: http://paste.openstack.org/show/495932/ with your issue so the requirements reviewers can be aware how this is affecting you | 14:22 |
| *** abregman has quit IRC | 14:23 | |
| *** jlanoux has joined #openstack-infra | 14:24 | |
| *** irdkehn has joined #openstack-infra | 14:24 | |
| anteaya | sc68cal: and yes, cleaning up old docs from the docs site is an issue that has affected us for some time and to be honest, I don't know what our workflow is for addressing it | 14:25 |
| nibalizer | good morning | 14:25 |
| *** amitgandhinz has joined #openstack-infra | 14:25 | |
| *** rbrndt has joined #openstack-infra | 14:25 | |
| mordred | it's a nibalizer !!! | 14:26 |
| *** dynarro has joined #openstack-infra | 14:27 | |
| *** arxcruz has quit IRC | 14:27 | |
| anteaya | morning nibalizer | 14:27 |
| *** mylu has joined #openstack-infra | 14:27 | |
| *** zhurong has quit IRC | 14:27 | |
| *** dkehn has joined #openstack-infra | 14:28 | |
| pabelanger | clarkb: fungi: as a follow up to our xenial plan, we can flip our infra votes voting first: https://review.openstack.org/#/c/311878/ I confirmed the current experimental jobs are passing | 14:29 |
| *** dkehn has quit IRC | 14:29 | |
| *** irdkehn is now known as dkehn | 14:30 | |
| *** nmagnezi_ has joined #openstack-infra | 14:31 | |
| *** dkehn_ has joined #openstack-infra | 14:31 | |
| *** nmagnezi has quit IRC | 14:31 | |
| fungi | pabelanger: yeah, if we're going to start having other projects running voting jobs on it, we should be testing to make sure we don't break it | 14:32 |
| fungi | go for it | 14:32 |
| pabelanger | fungi: my thoughts too | 14:32 |
| lennyb | anteaya: are you sure they are related? I can't see the connection | 14:34 |
| *** deadnull_ has quit IRC | 14:34 | |
| *** pradk_ is now known as pradk | 14:37 | |
| *** burgerk has joined #openstack-infra | 14:37 | |
| sc68cal | anteaya: ok. I just don't want it to sink back below the waves ;) | 14:37 |
| sc68cal | give me root and i'll do it ;) | 14:37 |
| AJaeger | sc68cal: I'll take care of it now... | 14:37 |
| openstackgerrit | Merged openstack-infra/system-config: Add directory resources to puppetdb module https://review.openstack.org/311636 | 14:38 |
| *** piet has joined #openstack-infra | 14:38 | |
| sc68cal | AJaeger: ok. sorry to add to your workload | 14:39 |
| sc68cal | has there been discussion about using rsync, with all the flags it needs, including --delete | 14:39 |
| openstackgerrit | Paul Belanger proposed openstack/diskimage-builder: DNM - test ubuntu-minimal for precise https://review.openstack.org/312104 | 14:40 |
| sc68cal | oh wait ftp. doh | 14:40 |
| AJaeger | sc68cal: http://docs.openstack.org/developer/devstack/stack.sh.html is gone - together wit hsome even more dated content... | 14:40 |
| openstackgerrit | Dan Prince proposed openstack-infra/tripleo-ci: Add planet blog aggregator feeds to website https://review.openstack.org/311910 | 14:41 |
| openstackgerrit | Merged openstack-infra/project-config: Move ubuntu-xenial voting for infra jobs https://review.openstack.org/311878 | 14:41 |
| sc68cal | AJaeger: ok, thanks :) | 14:41 |
| *** zeih has quit IRC | 14:41 | |
| fungi | sc68cal: docs.o.o is (currently) hosted at rackspace cloudsites, not on a normal webserver, so availability of protocols to update it with are limited | 14:41 |
| openstackgerrit | Ronald Bradford proposed openstack-infra/project-config: Remove kite configuration https://review.openstack.org/297738 | 14:41 |
| sc68cal | gotcha. makes sense :) | 14:41 |
| anteaya | lennyb: well you posted that they are related | 14:41 |
| anteaya | lennyb: I have no idea, my point is that if you experience something as a result of a patchset you need to add a comment on the patchset | 14:42 |
| anteaya | posting to the infra channel will not get the information to the people who need to see it | 14:42 |
| anteaya | sc68cal: ha ha ha | 14:42 |
| anteaya | AJaeger: thanks for cleaning it up | 14:43 |
| anteaya | sc68cal: I guess the workflow is ping AJaeger :) | 14:43 |
| AJaeger | anteaya: please don't document that workflow ;) | 14:44 |
| anteaya | ha ha ha | 14:44 |
| anteaya | ha ha ha | 14:44 |
| anteaya | :) | 14:44 |
| *** nadya has quit IRC | 14:45 | |
| anteaya | so last night there was a issue with the log server, first mention of it in backscroll was 2016-05-03T06:21:58 <tonyb> A whole bunch of the stable-periodic pipeline just failed with "UNSTABLE" jobs. | 14:45 |
| *** baoli has quit IRC | 14:45 | |
| AJaeger | anteaya: speaking of review: What do you think about https://review.openstack.org/#/c/310929/ ? Those are my first review guidelines | 14:45 |
| anteaya | then yolanda popped into channel and changed the status | 14:45 |
| AJaeger | anteaya: yolanda fixed the filesystem | 14:45 |
| nibalizer | what was wrong with the filesystem? | 14:45 |
| anteaya | is anyone aware of what the issue _was_ with the log server? | 14:45 |
| anteaya | AJaeger: yes, but what happened that fixing it was required? | 14:46 |
| AJaeger | anteaya: no idea ;( | 14:46 |
| *** ramishra has quit IRC | 14:46 | |
| anteaya | yeah the backscroll also gives no clues | 14:46 |
| lennyb | anteaya: I see your point. It also looks like a bug in zuul that should be handled. I am wandering if it's only me who sees this behavior. I needed to restart zuul in order to keep my CI running | 14:46 |
| anteaya | lennyb: even if it is only you, you need to share your experience with the folks that can do something about it | 14:47 |
| *** e0ne has quit IRC | 14:47 | |
| anteaya | lennyb: you might be the canary in the coal mine, you never know | 14:47 |
| *** mtanino has joined #openstack-infra | 14:47 | |
| anteaya | lennyb: http://www.wisegeek.org/what-does-it-mean-to-be-a-canary-in-a-coal-mine.htm | 14:47 |
| fungi | [Tue May 3 04:16:51 2016] end_request: I/O error, dev xvde, sector 60641024 | 14:48 |
| *** Keedya has joined #openstack-infra | 14:48 | |
| anteaya | fungi: thank you | 14:48 |
| fungi | (from dmesg on static.o.o) | 14:48 |
| fungi | the first of many thousands of error messages about tha underlying block device | 14:48 |
| *** ramishra has joined #openstack-infra | 14:48 | |
| fungi | er, that | 14:48 |
| openstackgerrit | Moshe Levi proposed openstack-infra/irc-meetings: Change sriov meeting frequency to weekly https://review.openstack.org/312107 | 14:49 |
| *** baoli has joined #openstack-infra | 14:49 | |
| *** esker has joined #openstack-infra | 14:49 | |
| fungi | most common cause is network interruption between the nova host and the cinder backend | 14:49 |
| lennyb | anteaya: you know, they all dead... eventually :) | 14:49 |
| *** esker has quit IRC | 14:49 | |
| anteaya | lennyb: eventually | 14:49 |
| *** flepied has quit IRC | 14:49 | |
| *** esker has joined #openstack-infra | 14:49 | |
| anteaya | fungi: ah, do we have any form of recovery? | 14:50 |
| *** asselin__ has joined #openstack-infra | 14:50 | |
| fungi | anteaya: yolanda took the filesystem offline and ran a consistency check/repair, then brought it back online | 14:51 |
| *** fawadkhaliq has joined #openstack-infra | 14:51 | |
| *** asselin has quit IRC | 14:51 | |
| anteaya | yes, so that is our recovery workflow I guess then | 14:51 |
| anteaya | thank you | 14:51 |
| fungi | last mount registered in the log at 09:16:26 utc so presumably that's approximately when it was fixed | 14:51 |
| * clarkb didnt realize we had rsynced data last time but that likely is the cause of the perms issues we have seen in thr past... | 14:52 | |
| *** doug-fish has joined #openstack-infra | 14:52 | |
| anteaya | yes, the backscroll confirms | 14:52 |
| fungi | rsync should preserve ownership/permissions (if they used the correct options with it anyway) | 14:53 |
| clarkb | with -a | 14:53 |
| *** rossella_s has quit IRC | 14:53 | |
| *** baoli has quit IRC | 14:53 | |
| fungi | yeah, i didn't look to see how they ran it | 14:53 |
| clarkb | but its the only thing I can figure and it wasnt a step that was made known previously | 14:53 |
| *** Keedya has quit IRC | 14:53 | |
| yolanda | anteaya, yes, fixed that | 14:53 |
| yolanda | on docs-draft and on logs | 14:54 |
| anteaya | yolanda: yes I saw, thank you | 14:54 |
| anteaya | yolanda: just had not seen the cause discussed in backscroll | 14:54 |
| clarkb | yolanda: did you write anything to the filesystems ? | 14:54 |
| clarkb | if so can you share how that was done as I syspect this is the source of the odd permissions issues we have seen | 14:55 |
| yolanda | clarkb, i unmounted, ran fsck, and rsynced the content that was on /srv/static while it was unmounted | 14:55 |
| fungi | most common occurrence of that disconnect failure pattern are maintenance or an unplanned outage in rackspace dfw | 14:55 |
| openstackgerrit | Derek Higgins proposed openstack-infra/tripleo-ci: [NO MERGY] Test a fake periodic job https://review.openstack.org/229789 | 14:55 |
| clarkb | yolanda: what was the rsync command | 14:55 |
| yolanda | checking in history | 14:55 |
| yolanda | rsync -vv -aHAXPh --ignore-existing --dry-run /tmp/docs-draft/ /srv/static/docs-draft/ | 14:56 |
| yolanda | same for logs, and of course, removing the dry-run | 14:56 |
| *** mtanino has quit IRC | 14:57 | |
| anteaya | fungi: ah thank you | 14:57 |
| clarkb | yolanda: do you know if that was the same command used previously when we had the file owner ship issues? | 14:58 |
| *** kengo_sakai has joined #openstack-infra | 14:58 | |
| *** doug-fis_ has joined #openstack-infra | 14:58 | |
| *** tosky has quit IRC | 14:58 | |
| yolanda | clarkb, got the command from jhesketh, is the same that we used last time | 14:58 |
| *** baoli has joined #openstack-infra | 14:59 | |
| *** tosky has joined #openstack-infra | 14:59 | |
| *** nmagnezi_ has quit IRC | 14:59 | |
| *** xarses has joined #openstack-infra | 15:00 | |
| *** xarses has quit IRC | 15:00 | |
| *** doug-fi__ has joined #openstack-infra | 15:00 | |
| *** xarses has joined #openstack-infra | 15:00 | |
| clarkb | ok the -a should preserve the ownership bits | 15:01 |
| *** doug-fish has quit IRC | 15:01 | |
| clarkb | if we do find any files owned by root again we should try to trace it back to the recovery. I did not realize we did any write ops to the fs last time when I was trying to debug that ... | 15:02 |
| *** _ody_ is now known as _ody | 15:02 | |
| *** kengo_sakai has quit IRC | 15:02 | |
| *** doug-fis_ has quit IRC | 15:02 | |
| *** doug-fi__ has quit IRC | 15:05 | |
| openstackgerrit | Tim Laszlo proposed openstack-infra/shade: Add support for host aggregates https://review.openstack.org/310937 | 15:05 |
| *** doug-fish has joined #openstack-infra | 15:07 | |
| *** chem has joined #openstack-infra | 15:07 | |
| *** mylu has quit IRC | 15:08 | |
| *** hashar is now known as hasharAway | 15:08 | |
| dynarro | hey pabelanger, it's doraly navarro, we met at the summit. I got REALLY curious about infra after our conversation and I wanted to know if you could tell me how to start contribute, maybe point me a low-hanging-fruit bug to start with. | 15:09 |
| mordred | dynarro: welcome to the jungle! | 15:10 |
| dynarro | mordred, hey there! | 15:10 |
| *** psachin has quit IRC | 15:10 | |
| *** tesseract- has quit IRC | 15:12 | |
| pabelanger | dynarro: excellent! We have an openstack-infra meeting today, see: http://eavesdrop.openstack.org/#Project_Infrastructure_Team_Meeting I highly recommend joining us | 15:12 |
| pabelanger | dynarro: as for getting started, what things interest you | 15:13 |
| *** r-mibu_ has quit IRC | 15:13 | |
| *** r-mibu has joined #openstack-infra | 15:13 | |
| *** tphummel has joined #openstack-infra | 15:14 | |
| *** jamesmcarthur has joined #openstack-infra | 15:16 | |
| fungi | dynarro: http://docs.openstack.org/infra/system-config/project.html#contributing | 15:17 |
| fungi | that's our canned answer anyway | 15:18 |
| dynarro | cool! I try to be there. I don't know, I was hoping on an easy software development bug in which I can learn how infra works | 15:18 |
| *** zz_dimtruck is now known as dimtruck | 15:19 | |
| *** links has joined #openstack-infra | 15:19 | |
| openstackgerrit | yolanda.robla proposed openstack-infra/project-config: Remove keystone2+magnum job https://review.openstack.org/312114 | 15:19 |
| dynarro | but as I'm still new to coding I don't mind learning other stuff :) | 15:20 |
| *** markmcd has quit IRC | 15:21 | |
| *** markmcd1 has quit IRC | 15:21 | |
| anteaya | since we are using the status page as a team communication tool now, do we think https://wiki.openstack.org/wiki/Infrastructure_Status should be added to the channel topic? | 15:21 |
| *** markmcd has joined #openstack-infra | 15:21 | |
| *** markmcd1 has joined #openstack-infra | 15:21 | |
| *** sdake has joined #openstack-infra | 15:23 | |
| *** yaume has quit IRC | 15:23 | |
| dynarro | fungi, yeah I was reading that wiki before and I was looking to the storyboard, but I don't know where to start | 15:24 |
| anteaya | tonyb: so tacker knows that if someone else takes the slot directly before or after their meeting they don't get to change their meeting time then, correct? https://review.openstack.org/#/c/311789/ | 15:25 |
| *** EricGonczer_ has joined #openstack-infra | 15:25 | |
| anteaya | tonyb: all the rest of us can deal with utc time, and there is a resolution stating we use it | 15:25 |
| AJaeger | dynarro: start with one repository that sounds interesting and start reviewing - and get an overview with reading http://docs.openstack.org/infra/ . Welcome! | 15:25 |
| anteaya | tonyb: http://git.openstack.org/cgit/openstack/governance/tree/resolutions/20150512-utc.rst | 15:26 |
| *** sdake_ has joined #openstack-infra | 15:26 | |
| dynarro | AJaeger, cool, thanks! | 15:27 |
| pabelanger | dynarro: if you are looking to get into puppet, we are working on converting some of our servers from ubuntu-precise to ubuntu-trusty. | 15:27 |
| *** tonytan_brb has joined #openstack-infra | 15:27 | |
| pabelanger | dynarro: We're also trying to bring more mirrors online, like RPM and gems, if you want to learn more about AFS | 15:27 |
| *** vincentll has quit IRC | 15:28 | |
| *** sdake has quit IRC | 15:28 | |
| mnaser | just curious, was there a block storage issue that's causing those fs issues? | 15:28 |
| *** vgridnev has joined #openstack-infra | 15:29 | |
| *** jyuso has quit IRC | 15:29 | |
| clarkb | zaro: https://review.openstack.org/#/c/311903/2 will build a war that is useable for deployments with puppet again if you are able to review that | 15:29 |
| *** kmartin has quit IRC | 15:30 | |
| anteaya | mnaser: hello | 15:30 |
| *** jyuso has joined #openstack-infra | 15:30 | |
| *** tonytan4ever has quit IRC | 15:31 | |
| anteaya | mnaser: http://eavesdrop.openstack.org/irclogs/%23openstack-infra/%23openstack-infra.2016-05-03.log.html#t2016-05-03T14:48:06 | 15:31 |
| openstackgerrit | yolanda.robla proposed openstack-infra/project-config: Move shade+magnum neutron job to non-voting https://review.openstack.org/312120 | 15:31 |
| fungi | mnaser: strangely, there was a block storage issue reported impacting two of the three regions we use in that provider, but not the one where the system in question was hosted https://status.rackspace.com/index/viewincidents?group=11 | 15:32 |
| *** kzaitsev_mb has joined #openstack-infra | 15:32 | |
| fungi | i haven't checked our trouble tickets though | 15:32 |
| mnaser | hi anteaya | 15:32 |
| mnaser | that's the worst | 15:32 |
| *** julim has quit IRC | 15:32 | |
| *** dizquierdo has quit IRC | 15:33 | |
| *** julim has joined #openstack-infra | 15:33 | |
| anteaya | mnaser: oh there are worse things | 15:33 |
| clarkb | zaro then if we get 311903 merged we can update the change to https://review.openstack.org/#/c/311894/ to use the non test uri | 15:33 |
| anteaya | mnaser: but sad fs systems are sad making :( | 15:33 |
| clarkb | zaro: but hoping you can confirm if that change looks good to you (and maybe if you know how upstream gerrit is handling this problem) | 15:34 |
| *** EricGonc_ has joined #openstack-infra | 15:34 | |
| openstackgerrit | Chris Denneen proposed openstack-infra/jenkins-job-builder: gitlab trigger: Support new "trigger-open-merge-request-push" options https://review.openstack.org/312121 | 15:34 |
| *** hdd has joined #openstack-infra | 15:34 | |
| clarkb | nibalizer: did you get around to launching new server(s) yesterday? if so any word on https://review.openstack.org/#/c/311872/ ? | 15:35 |
| *** nbloom has quit IRC | 15:35 | |
| *** ccarmack has left #openstack-infra | 15:35 | |
| nibalizer | no i didn't but i might do that today | 15:35 |
| nibalizer | i mean, maybe | 15:35 |
| nibalizer | there are quite a few irons in the fire | 15:35 |
| *** EricGonczer_ has quit IRC | 15:36 | |
| openstackgerrit | Clark Boylan proposed openstack-infra/project-config: Revert "Make puppet-gerrit beaker rspec non voting" https://review.openstack.org/312123 | 15:36 |
| clarkb | nibalizer: kk | 15:36 |
| *** mtanino has joined #openstack-infra | 15:36 | |
| *** salv-orlando has joined #openstack-infra | 15:36 | |
| clarkb | yolanda: pabelanger ^ 312123 is the revert to make puppet-gerrit beaker rspec voting again | 15:36 |
| pabelanger | clarkb: ack | 15:38 |
| *** piet has quit IRC | 15:38 | |
| openstackgerrit | Spencer Krum proposed openstack-infra/system-config: Add a storyboard-dev server https://review.openstack.org/312124 | 15:38 |
| nibalizer | clarkb: in theory that is the next server I would be building | 15:38 |
| yolanda | clarkb, approve | 15:40 |
| *** kushal has joined #openstack-infra | 15:40 | |
| *** jang has quit IRC | 15:40 | |
| *** mylu has joined #openstack-infra | 15:41 | |
| *** lucas-post-offic is now known as lucasagomes | 15:41 | |
| pabelanger | any folks proficient with grub? Running into the following error with ubuntu-precise dib: http://paste.openstack.org/show/495974/ | 15:41 |
| morgan | pabelanger: looking. | 15:41 |
| clarkb | as a heads up one thing I will be attempting to do in the near future is upgrading elasticsearch to latest version of 1.7.x ES | 15:42 |
| clarkb | if anyone is interested in learning ore about ES I am happy to help them do it instead :) | 15:42 |
| clarkb | hubcap said at the summit that this should make our lives better with the broken shard replication allocation | 15:43 |
| morgan | pabelanger: thats a new one. | 15:43 |
| pabelanger | clarkb: I'd be interested in learning more about ES | 15:43 |
| anteaya | clarkb: I'm interested in following along | 15:44 |
| openstackgerrit | Merged openstack/requirements: Babel Integration tests https://review.openstack.org/309808 | 15:44 |
| pabelanger | morgan: currently trying to get more output | 15:44 |
| morgan | pabelanger: that would be good | 15:44 |
| clarkb | pabelanger: anteaya great, maybe we can aim for end of week, thursday/friday | 15:45 |
| *** mylu has quit IRC | 15:45 | |
| anteaya | clarkb: let's aim for that | 15:45 |
| *** piet has joined #openstack-infra | 15:45 | |
| *** kmartin has joined #openstack-infra | 15:45 | |
| morgan | pabelanger: since this is dib, i'm assuming this is local build not pxe or something, right? | 15:46 |
| pabelanger | anteaya: clarkb: ack | 15:46 |
| anteaya | pabelanger: great | 15:47 |
| pabelanger | morgan: Right, running it locally from centos-7 host machine | 15:47 |
| anteaya | clarkb: did you want to put an agenda item on today's meeting agenda about selecting a week for the operating system control plane upgrade sprint we agreed to do? | 15:47 |
| *** eil397 has joined #openstack-infra | 15:47 | |
| *** bpokorny has joined #openstack-infra | 15:48 | |
| *** pradk has quit IRC | 15:49 | |
| *** tonytan_brb has quit IRC | 15:49 | |
| morgan | pabelanger: the only things that tend to point to that in my experience is where the partitioning scheme didn't work on the img. | 15:49 |
| clarkb | anteaya: ya I can do that shortly | 15:49 |
| morgan | pabelanger: but more output probably would help (i can also try and centos7 a machine and try it here as well if you'd like) | 15:49 |
| anteaya | clarkb: awesome, thank you | 15:49 |
| electrofelix | fungi: I've noticed that there hasn't been an upload to pypi of JJB 1.5.0, something not get published correctly? | 15:50 |
| openstackgerrit | Ghe Rivero proposed openstack-infra/shade: Add quotas support https://review.openstack.org/285110 | 15:50 |
| fungi | electrofelix: i'll take a look | 15:51 |
| *** annegentle has joined #openstack-infra | 15:51 | |
| openstackgerrit | Merged openstack-infra/project-config: Revert "Make puppet-gerrit beaker rspec non voting" https://review.openstack.org/312123 | 15:51 |
| openstackgerrit | Ghe Rivero proposed openstack-infra/shade: Add quotas support https://review.openstack.org/285110 | 15:51 |
| *** doug-fish has quit IRC | 15:52 | |
| *** sridhar_ram has joined #openstack-infra | 15:52 | |
| *** doug-fish has joined #openstack-infra | 15:52 | |
| *** ggnel_t has quit IRC | 15:52 | |
| *** tonytan4ever has joined #openstack-infra | 15:52 | |
| *** mikelk has quit IRC | 15:52 | |
| *** hasharAway is now known as hashar | 15:52 | |
| openstackgerrit | Merged openstack-infra/jenkins-job-builder: Update workspace-cleanup to support newer options https://review.openstack.org/310084 | 15:52 |
| *** tonytan4ever has quit IRC | 15:53 | |
| yolanda | fungi, electrofelix , that is because our pypi mirror is out of sync | 15:53 |
| fungi | yolanda: no, it's not because of that | 15:53 |
| electrofelix | yolanda: shouldn't it appear in the main pypi repo though? | 15:53 |
| yolanda | ah, pypi | 15:53 |
| fungi | electrofelix: yolanda: http://logs.openstack.org/91/91fef0bd90b06f8f0e64319987bb9995e639c857/release/jenkins-job-builder-tarball/759facb/console.html#_2016-05-03_13_17_04_094 | 15:53 |
| *** EricGonc_ has quit IRC | 15:53 | |
| yolanda | ok pypi directly, not to our mirrors ok | 15:53 |
| fungi | looks like it failed to write the tarball to static.openstack.org | 15:53 |
| *** doug-fish has quit IRC | 15:53 | |
| pabelanger | morgan: Ya, I was thinking that was the issue too. Going to run parted manually and see if I can reproduce the DIB failure | 15:53 |
| fungi | is the tarballs volume also in a bad state? | 15:54 |
| morgan | pabelanger: ok sounds good. let me know if you need to poke at a parted command being run / help out, happy to do so. | 15:54 |
| morgan | pabelanger: s/need/want me/ | 15:54 |
| *** pradk has joined #openstack-infra | 15:55 | |
| *** inc0 has quit IRC | 15:56 | |
| dynarro | pabelanger, the actually converting servers from ubuntu-precise to ubuntu-trusty sounds really good, where can I found more info about that? | 15:58 |
| *** tphummel has quit IRC | 15:58 | |
| *** eil397 has left #openstack-infra | 15:59 | |
| openstackgerrit | yolanda.robla proposed openstack-infra/project-config: Move shade+magnum neutron job to non-voting https://review.openstack.org/312120 | 16:01 |
| *** lindsayk_ is now known as lindsayk | 16:02 | |
| *** dmk0202 has quit IRC | 16:03 | |
| *** salv-orlando has quit IRC | 16:03 | |
| *** kjorgensen has joined #openstack-infra | 16:04 | |
| sdake_ | did anyone in infra team register kolla-kubernetes in pypi? | 16:04 |
| *** earlephilhower has quit IRC | 16:05 | |
| *** doug-fish has joined #openstack-infra | 16:05 | |
| *** doug-fish has quit IRC | 16:05 | |
| *** gordc has quit IRC | 16:05 | |
| *** kjorgensen has quit IRC | 16:06 | |
| *** doug-fish has joined #openstack-infra | 16:06 | |
| *** kjorgensen has joined #openstack-infra | 16:06 | |
| *** diazjf has joined #openstack-infra | 16:06 | |
| *** keedya has joined #openstack-infra | 16:06 | |
| *** lakshmiS has joined #openstack-infra | 16:07 | |
| *** doug-fish has quit IRC | 16:08 | |
| *** doug-fish has joined #openstack-infra | 16:08 | |
| *** mylu has joined #openstack-infra | 16:11 | |
| *** e0ne has joined #openstack-infra | 16:11 | |
| anteaya | sdake_: I doubt it, but checking pypi should tell you if the name is registered and the owner if it is | 16:11 |
| anteaya | AJaeger: have you a moment for a repo retirement clarification question? | 16:12 |
| anteaya | AJaeger: my read of http://docs.openstack.org/infra/manual/drivers.html#remove-project-content is that all the files are gone including the dot files, with only the readme remaining | 16:12 |
| anteaya | AJaeger: kite and kiteclient still have dot files remaining, along with the new readme | 16:12 |
| anteaya | AJaeger: what are your thoughts? | 16:12 |
| *** ifarkas has quit IRC | 16:13 | |
| *** mylu has quit IRC | 16:13 | |
| anteaya | AJaeger: 297738 is the patch for reference | 16:13 |
| *** earlephilhower has joined #openstack-infra | 16:13 | |
| openstackgerrit | Merged openstack-infra/jenkins-job-builder: Update Google Cloud Storage publisher https://review.openstack.org/310080 | 16:15 |
| *** roxanaghe has joined #openstack-infra | 16:15 | |
| *** matt-borland has joined #openstack-infra | 16:16 | |
| *** infra-red has joined #openstack-infra | 16:16 | |
| *** mylu has joined #openstack-infra | 16:16 | |
| *** nadya has joined #openstack-infra | 16:16 | |
| *** abregman has joined #openstack-infra | 16:16 | |
| openstackgerrit | Davanum Srinivas (dims) proposed openstack-infra/project-config: Add a functional job for python-k8sclient https://review.openstack.org/312146 | 16:17 |
| *** nadya has quit IRC | 16:17 | |
| *** abregman has quit IRC | 16:17 | |
| *** abregman has joined #openstack-infra | 16:17 | |
| *** mylu has quit IRC | 16:18 | |
| openstackgerrit | Emilien Macchi proposed openstack-infra/project-config: zuul/layout: add missing experimental jobs for Puppet CI https://review.openstack.org/312148 | 16:18 |
| *** sputnik13 has joined #openstack-infra | 16:19 | |
| *** roxanaghe has quit IRC | 16:19 | |
| pabelanger | dynarro: I hope to talk about it today in our meeting | 16:20 |
| dynarro | pabelanger, cool then! | 16:20 |
| *** apoorvad has joined #openstack-infra | 16:21 | |
| *** docaedo2 has joined #openstack-infra | 16:21 | |
| *** apoorvad has quit IRC | 16:22 | |
| *** fawadkhaliq has quit IRC | 16:22 | |
| *** apoorvad has joined #openstack-infra | 16:22 | |
| sdake_ | anteaya yup we got itsorted out, its a friendly rather then a squatter :) | 16:22 |
| sdake_ | I think they were squatting in case of unfriendlies :) | 16:23 |
| anteaya | good news | 16:23 |
| pabelanger | dynarro: here is our etherpad from austin about the topic: https://etherpad.openstack.org/p/newton-infra-distro-upgrade-plans | 16:23 |
| sdake_ | anteaya i did the same thing (dot files) on kolla-mesos retiremeenet | 16:23 |
| sdake_ | anteaya I can show you how I solved it | 16:23 |
| dynarro | pabelanger, thanks | 16:24 |
| sdake_ | https://github.com/openstack/kolla-mesos | 16:24 |
| sdake_ | anteaya of course you will have to add the acls back in to get the readme.rst with the exactgit hash id in | 16:24 |
| anteaya | sdake_: thanks for the example, I was looking for one | 16:26 |
| anteaya | right so easier to delete the dot files while the acl files still exist | 16:27 |
| anteaya | sdake_: thank you | 16:27 |
| sdake_ | anteaya dims actually suggsted it | 16:27 |
| *** gyee has joined #openstack-infra | 16:27 | |
| sdake_ | so I dont take credit for it :) | 16:27 |
| *** ccamacho is now known as ccamacho|away | 16:29 | |
| anteaya | sdake_: thank you | 16:29 |
| AJaeger | anteaya: you're right - that should have been all cleaned out in the previous patch. But if we clean this up now, the instructions won't work for the HEAD^1 checkout, so I would leave it. Or do it like sdake_ suggested - feel free t ocomment and WIP the change... | 16:29 |
| *** pilgrimstack has quit IRC | 16:30 | |
| anteaya | AJaeger: thanks | 16:30 |
| *** javeriak has joined #openstack-infra | 16:31 | |
| AJaeger | project-config cores, could you review a change to use constraints for Babel in our scripts, please? https://review.openstack.org/309809 . The requirements change has merged | 16:31 |
| *** diazjf has left #openstack-infra | 16:32 | |
| *** annegentle has quit IRC | 16:33 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/system-config: Remove devstack-centos7 logging for nodepool https://review.openstack.org/312158 | 16:34 |
| *** doug-fish has quit IRC | 16:36 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/project-config: Add ceph-deb-hammer.list to both trusty and xenial https://review.openstack.org/312161 | 16:36 |
| electrofelix | waynr: you happy with https://review.openstack.org/274195? | 16:36 |
| *** doug-fish has joined #openstack-infra | 16:37 | |
| *** doug-fish has quit IRC | 16:37 | |
| *** johnny has joined #openstack-infra | 16:38 | |
| *** johnny is now known as Guest21848 | 16:39 | |
| openstackgerrit | Merged openstack-infra/jenkins-job-builder: Removing perModuleEmail paramater management https://review.openstack.org/259987 | 16:39 |
| *** jlanoux has quit IRC | 16:39 | |
| dims | anteaya : AJaeger : hopefully easy one when you get a chance https://review.openstack.org/#/c/312146/ please | 16:40 |
| anteaya | dims: if it is voting (and it appears that it is) it goes in the gate pipeline as well | 16:41 |
| *** bpokorny_ has joined #openstack-infra | 16:42 | |
| openstackgerrit | Davanum Srinivas (dims) proposed openstack-infra/project-config: Add a functional job for python-k8sclient https://review.openstack.org/312146 | 16:42 |
| dims | anteaya : ack done | 16:42 |
| anteaya | dims: +2 | 16:43 |
| anteaya | and thank you | 16:43 |
| *** inc0 has joined #openstack-infra | 16:43 | |
| *** bpokorny_ has quit IRC | 16:43 | |
| *** roxanaghe has joined #openstack-infra | 16:43 | |
| dims | anteaya : thanks for the quick review | 16:43 |
| anteaya | timing frw | 16:44 |
| *** bpokorny_ has joined #openstack-infra | 16:44 | |
| anteaya | ftw | 16:44 |
| anteaya | for rrrrraaa win was the other acronym | 16:44 |
| dims | :) | 16:44 |
| *** bpokorny has quit IRC | 16:45 | |
| *** gordc has joined #openstack-infra | 16:46 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/system-config: Switch non dib image loggers to INFO https://review.openstack.org/312170 | 16:48 |
| pabelanger | ianw: clarkb: ^ Should fix our empty log files for non-dib image builds. | 16:48 |
| openstackgerrit | Jordan Pittier proposed openstack/requirements: Change urllib3 version to urllib3>=1.15 https://review.openstack.org/312172 | 16:50 |
| openstackgerrit | Spencer Krum proposed openstack-infra/system-config: Remove infracloud from ansible inventory https://review.openstack.org/312173 | 16:50 |
| nibalizer | clarkb: ^^ | 16:51 |
| anteaya | nibalizer: can you expand that commit message to say why? | 16:51 |
| nibalizer | anteaya: sure | 16:51 |
| anteaya | nibalizer: thanks | 16:52 |
| *** vhosakot has joined #openstack-infra | 16:52 | |
| anteaya | hard to stay current with all the things | 16:52 |
| *** infra-red has quit IRC | 16:52 | |
| openstackgerrit | Spencer Krum proposed openstack-infra/system-config: Remove infracloud from ansible inventory https://review.openstack.org/312173 | 16:52 |
| *** madhu_ak has joined #openstack-infra | 16:52 | |
| anteaya | wonderful, thank you | 16:53 |
| anteaya | <-- going for a walk, expected to be back in about an hour | 16:54 |
| *** RickA-HP has joined #openstack-infra | 16:54 | |
| *** tlian has quit IRC | 16:55 | |
| openstackgerrit | Ronald Bradford proposed openstack-infra/project-config: Remove kite configuration https://review.openstack.org/297738 | 16:55 |
| *** doug-fish has joined #openstack-infra | 16:57 | |
| *** akshai has quit IRC | 16:57 | |
| anteaya | bugs! | 16:57 |
| anteaya | the bugs have started | 16:57 |
| *** Jeffrey4l has quit IRC | 16:58 | |
| *** rkukura has joined #openstack-infra | 16:59 | |
| *** akshai has joined #openstack-infra | 16:59 | |
| odyssey4me | is there a specific stable maint IRC channel? | 17:00 |
| *** doug-fish has quit IRC | 17:00 | |
| zaro | morning | 17:00 |
| *** tonytan4ever has joined #openstack-infra | 17:01 | |
| *** hashar has quit IRC | 17:01 | |
| *** hdd has quit IRC | 17:01 | |
| jroll | odyssey4me: #openstack-stable | 17:02 |
| odyssey4me | ah, thanks jroll | 17:02 |
| jroll | np | 17:02 |
| *** pilgrimstack has joined #openstack-infra | 17:03 | |
| *** jistr has quit IRC | 17:04 | |
| *** tlian has joined #openstack-infra | 17:04 | |
| krotscheck | Who's on vacation right now? | 17:05 |
| krotscheck | Actually, lemme reask that question. | 17:05 |
| krotscheck | Is jeblair on vacation right now? | 17:05 |
| *** RickA-HP has quit IRC | 17:05 | |
| clarkb | krotscheck: I think he mentioned he was largely afk this week | 17:05 |
| krotscheck | clarkb: Coooooolio. | 17:05 |
| *** sshnaidm has quit IRC | 17:06 | |
| krotscheck | clarkb: I'll ping him next week to finish NPM mirror things. | 17:06 |
| *** dizquierdo has joined #openstack-infra | 17:06 | |
| *** doug-fish has joined #openstack-infra | 17:06 | |
| *** ericksonsantos has joined #openstack-infra | 17:06 | |
| waynr | electrofelix: looking! | 17:08 |
| *** vhosakot has quit IRC | 17:09 | |
| *** ams_ has joined #openstack-infra | 17:09 | |
| *** jordanP has quit IRC | 17:09 | |
| waynr | electrofelix: looks like patch is in merge conflict | 17:09 |
| *** sambetts is now known as sambetts|afk | 17:09 | |
| zxiiro | electrofelix: did we release yet? | 17:10 |
| *** Guest48392 has quit IRC | 17:10 | |
| mordred | krotscheck: I approve of our new NPM mirror overlords | 17:10 |
| *** mriedem1 has joined #openstack-infra | 17:10 | |
| *** trown is now known as trown|lunch | 17:10 | |
| krotscheck | mordred: It really is the Big Man of the mirrors, isn't it. | 17:10 |
| mordred | yup | 17:10 |
| *** mriedem has quit IRC | 17:11 | |
| *** Hal has joined #openstack-infra | 17:11 | |
| *** Hal is now known as Guest70523 | 17:11 | |
| *** doug-fish has quit IRC | 17:12 | |
| pabelanger | morgan: appears to be related to a centos-7 build host; possible missing dependency. Running from ubuntu-trusty, ubuntu-precise worked as expect | 17:12 |
| zaro | clarkb: good new about gerrit memory. | 17:12 |
| *** earlephilhower has quit IRC | 17:13 | |
| timothyb89 | fungi, jhesketh, pabelanger, clarkb, mtreinish: if you have a free moment, could you take a look at this revised StackViz patch? https://review.openstack.org/#/c/311768/ | 17:13 |
| *** vhosakot has joined #openstack-infra | 17:14 | |
| *** _amrith_ is now known as amrith | 17:14 | |
| *** earlephilhower has joined #openstack-infra | 17:15 | |
| mtreinish | timothyb89: that's pabelanger's revert from yesterday | 17:16 |
| *** doug-fish has joined #openstack-infra | 17:16 | |
| pabelanger | timothyb89: have you run stackviz across all our images? Personally, I'd like to see some logs attached to the issue just confirming stackviz builds properly | 17:17 |
| pabelanger | just to make sure we don't break nodepool dibs again | 17:17 |
| zaro | clarkb: had a question for you on already merged change https://review.openstack.org/#/c/311894 | 17:17 |
| *** tphummel has joined #openstack-infra | 17:17 | |
| timothyb89 | mtreinish: ah, you're right, sorry! this is the correct link: https://review.openstack.org/#/c/311815/ | 17:17 |
| clarkb | zaro: ok | 17:17 |
| clarkb | zaro: the version we have deployed is no longer deployable | 17:18 |
| timothyb89 | pabelanger: we saw it build correctly save for a (now fixed) race condition on Fedora, at least | 17:18 |
| clarkb | zaro: so no we cannot test with it or even make a new gerrit with it | 17:18 |
| openstackgerrit | Merged openstack-infra/storyboard: Don't try to cancel the timer thread if it isn't alive https://review.openstack.org/308471 | 17:18 |
| clarkb | zaro: which is why I have asked you to review the change that updates the gerrit war so that we can potentially switch to it | 17:18 |
| timothyb89 | pabelanger: I'd be happy to manually test on the images, but I'm unsure how to do so | 17:19 |
| clarkb | zaro: also curious how upstream gerrit is dealing with this | 17:19 |
| clarkb | zaro: as ideally we would do what they are doining | 17:19 |
| *** mriedem1 is now known as mriedem | 17:20 | |
| pabelanger | timothyb89: my current way is using tools/build-image.sh in openstack-infra/project-config. You'll need to export some variables to setup the distro, and include stackviz element. | 17:21 |
| pabelanger | timothyb89: otherwise, you can use disk-image-create directly | 17:21 |
| *** bpokorny_ has quit IRC | 17:21 | |
| pabelanger | timothyb89: you can then look into nodepool/nodepool.yaml for the 5 OSes we do DIBs for | 17:22 |
| zaro | clarkb: i reviewed the other change, pls take a look. | 17:22 |
| *** abregman has quit IRC | 17:22 | |
| *** inc0 has quit IRC | 17:22 | |
| *** bpokorny has joined #openstack-infra | 17:22 | |
| openstackgerrit | Merged openstack-infra/project-config: Add a functional job for python-k8sclient https://review.openstack.org/312146 | 17:23 |
| *** roxanaghe has quit IRC | 17:23 | |
| timothyb89 | pabelanger: alright, I'll take a look, thank you! | 17:23 |
| clarkb | zaro: repo2 doesn't have valid ssl | 17:23 |
| zaro | clarkb: I'm still not sure why you think we can't deploy 2.11.4-11 but can deploy 2.11.4-13 | 17:23 |
| clarkb | zaro: my preference would be to use repo1 as a result, maybe you can ask why gerrit is using insecure repos? | 17:23 |
| clarkb | zaro: because -11 uses the old url for bouncy castle which is now a 404 | 17:23 |
| clarkb | zaro: this causes gerrit init to fail | 17:23 |
| clarkb | zaro: basically the -11 war is DOA | 17:24 |
| *** roxanaghe has joined #openstack-infra | 17:24 | |
| zaro | clarkb: ahh ok i didn't realize the ssl thing | 17:25 |
| *** weshay has quit IRC | 17:25 | |
| zaro | but yeah, makes sense now. | 17:25 |
| *** weshay has joined #openstack-infra | 17:26 | |
| *** lucasagomes is now known as lucas-dinner | 17:27 | |
| *** salv-orlando has joined #openstack-infra | 17:27 | |
| *** ddieterly is now known as ddieterly[away] | 17:27 | |
| *** e0ne has quit IRC | 17:31 | |
| *** nadya has joined #openstack-infra | 17:33 | |
| *** skolekonov__ has joined #openstack-infra | 17:33 | |
| *** vhosakot has quit IRC | 17:34 | |
| *** serverascode has quit IRC | 17:34 | |
| *** woodster_ has quit IRC | 17:35 | |
| *** sweston has quit IRC | 17:35 | |
| *** zxiiro has quit IRC | 17:35 | |
| *** maximov has quit IRC | 17:35 | |
| *** zhiyan has quit IRC | 17:35 | |
| *** dougwig has quit IRC | 17:35 | |
| *** xgerman has quit IRC | 17:35 | |
| *** lindsayk has quit IRC | 17:35 | |
| *** pvaneck has joined #openstack-infra | 17:35 | |
| *** serverascode has joined #openstack-infra | 17:35 | |
| *** zhiyan has joined #openstack-infra | 17:37 | |
| zaro | clarkb: i'm not sure why gerrit chose to use not secure connection. i'm guessing it's a bug since they use https to download all other maven resources. | 17:37 |
| *** lindsayk has joined #openstack-infra | 17:37 | |
| *** fmccrthy has quit IRC | 17:37 | |
| *** patrickeast has quit IRC | 17:37 | |
| *** maximov has joined #openstack-infra | 17:37 | |
| *** woodster_ has joined #openstack-infra | 17:37 | |
| *** sweston has joined #openstack-infra | 17:38 | |
| openstackgerrit | Merged openstack-infra/project-config: Don't configure a mirror for tripleo-centos-7 https://review.openstack.org/312058 | 17:38 |
| *** patrickeast has joined #openstack-infra | 17:38 | |
| electrofelix | zxiiro: yes, but there was a problem with the upload to tarballs and the release didn't get pushed to pypi | 17:39 |
| *** akshai has quit IRC | 17:39 | |
| *** tonytan4ever has quit IRC | 17:39 | |
| *** xgerman has joined #openstack-infra | 17:39 | |
| *** dougwig has joined #openstack-infra | 17:40 | |
| electrofelix | waynr: I must have approved something that caused an issue :p | 17:40 |
| *** akshai has joined #openstack-infra | 17:41 | |
| *** dynarro has quit IRC | 17:41 | |
| *** fmccrthy has joined #openstack-infra | 17:41 | |
| *** sileht has quit IRC | 17:42 | |
| *** jerryz has joined #openstack-infra | 17:42 | |
| *** zxiiro has joined #openstack-infra | 17:42 | |
| waynr | electrofelix: so i am going to optimistically say that i will set aside some time either tonight or tomorrow night to rebase the 2.0 work onto master branch now that the 1.5 release is underway | 17:43 |
| openstackgerrit | Jim Rollenhagen proposed openstack-infra/project-config: Add api-ref jobs for ironic https://review.openstack.org/312184 | 17:44 |
| *** skolekonov__ has quit IRC | 17:45 | |
| openstackgerrit | Darragh Bailey proposed openstack-infra/jenkins-job-builder: Compatibility support for older maven project plugins https://review.openstack.org/274195 | 17:46 |
| *** wajdi has joined #openstack-infra | 17:46 | |
| electrofelix | waynr: it's tagged from a commit last week, so we're definitely free to start moving forward with v2 stuff | 17:46 |
| *** sileht has joined #openstack-infra | 17:47 | |
| *** vhosakot has joined #openstack-infra | 17:48 | |
| *** skolekonov has joined #openstack-infra | 17:48 | |
| zaro | clarkb: hopefully well get an answer soon, https://gerrit-review.googlesource.com/#/c/77179 | 17:48 |
| *** dizquierdo has quit IRC | 17:49 | |
| *** skolekonov is now known as skolekonov__ | 17:49 | |
| openstackgerrit | Merged openstack-infra/storyboard-webclient: Remove pointless variable creation https://review.openstack.org/306401 | 17:51 |
| fungi | electrofelix: waynr: i don't think it's jjb's fault. i suspect it's a problem with the tarballs volume on static.openstack.org (perhaps related to the logs and docs-draft volume problems from earlier today?) but i don't have time to look into it yet. dealing with openssl vulnerability updates and then need to prep for the weekly team meeting | 17:51 |
| fungi | electrofelix: waynr: the job log had a java traceback about a write error and ended with an "UNSTABLE" status | 17:51 |
| mordred | wajdi: heya! saw your message in #openstack-ironic ... we definitelky want to include fungi in such a discussion | 17:52 |
| mordred | fungi: wajdi may want to be involved in donating baremetal resources to infra | 17:52 |
| *** jamesmcarthur has quit IRC | 17:52 | |
| electrofelix | fungi: tag is there, so as long as we can find a way to retrigger the release job sometime this week to upload the necessary, I don't think there is any pressure (though maybe avoid doing it Friday...) | 17:53 |
| *** salv-orlando has quit IRC | 17:53 | |
| fungi | electrofelix: it's a simple zuul enqueue-ref command to get the machinery retriggered as soon as we suss out why tarballs.o.o refused the upload | 17:54 |
| clarkb | mordred: as in here is cloud with ironic flavors or here is hardware to make an infra cloud? | 17:55 |
| *** kzaitsev_mb has quit IRC | 17:56 | |
| mat128 | clarkb: not sure what was discussed (I wasn't part of it) but my understanding was more like providing a third party CI setup that can actually test against baremetal in a lab | 17:56 |
| jesusaur | fungi: clarkb: jeblair: was there every any discussion about what to do about the zuul tests hitting the 50MB subunit limit? | 17:57 |
| mordred | clarkb: I do not know | 17:57 |
| fungi | jesusaur: none to my knowledge | 17:57 |
| mordred | clarkb: I believe the ultimate motivation is to enhance infra's ability to test ironic things - but digging in to the details of what is desired and what is possible is likely useful | 17:57 |
| *** akshai has quit IRC | 17:58 | |
| *** baoli has quit IRC | 18:00 | |
| *** pilgrimstack1 has joined #openstack-infra | 18:00 | |
| *** inc0 has joined #openstack-infra | 18:00 | |
| *** kzaitsev_mb has joined #openstack-infra | 18:01 | |
| *** baoli has joined #openstack-infra | 18:01 | |
| *** pilgrimstack has quit IRC | 18:01 | |
| *** sshnaidm has joined #openstack-infra | 18:01 | |
| *** akshai has joined #openstack-infra | 18:01 | |
| *** dolphm has left #openstack-infra | 18:02 | |
| *** vhosakot_ has joined #openstack-infra | 18:03 | |
| *** vhosakot_ has quit IRC | 18:03 | |
| *** markvoelker has quit IRC | 18:04 | |
| *** vhosakot_ has joined #openstack-infra | 18:04 | |
| *** annegentle has joined #openstack-infra | 18:04 | |
| *** piet has quit IRC | 18:04 | |
| *** vhosakot has quit IRC | 18:05 | |
| *** markvoelker has joined #openstack-infra | 18:05 | |
| *** tosky has quit IRC | 18:07 | |
| *** inc0 has quit IRC | 18:07 | |
| *** markvoelker_ has joined #openstack-infra | 18:07 | |
| *** markvoelker has quit IRC | 18:08 | |
| *** kushal has quit IRC | 18:09 | |
| *** inc0 has joined #openstack-infra | 18:10 | |
| jesusaur | fungi: any preference on where/how I should start that conversation? | 18:10 |
| *** skolekonov__ has quit IRC | 18:10 | |
| *** amrith is now known as _amrith_ | 18:11 | |
| fungi | jesusaur: if you want to add a "when" to that, probably after people are rested up from last week | 18:11 |
| fungi | some of the potential participants for such conversations aren't really around until next week | 18:13 |
| *** HeOS has joined #openstack-infra | 18:13 | |
| jesusaur | ah, ok | 18:14 |
| * AJaeger has to leave now and won't be around for the IRC meeting | 18:14 | |
| AJaeger | One wish for today: project-config cores, could you review a change to use constraints for Babel in our scripts, please? https://review.openstack.org/309809 . The requirements change has merged... | 18:15 |
| *** trown|lunch is now known as trown | 18:15 | |
| nibalizer | hah | 18:15 |
| nibalizer | AJaeger: <3 | 18:15 |
| *** _amrith_ is now known as amrith | 18:16 | |
| *** Remy has joined #openstack-infra | 18:18 | |
| openstackgerrit | Merged openstack-infra/project-config: zuul/layout: add missing experimental jobs for Puppet CI https://review.openstack.org/312148 | 18:19 |
| *** tonytan4ever has joined #openstack-infra | 18:19 | |
| anteaya | AJaeger: thank you | 18:19 |
| *** markus_z has quit IRC | 18:19 | |
| *** Goneri has quit IRC | 18:23 | |
| *** Goneri has joined #openstack-infra | 18:24 | |
| openstackgerrit | Darragh Bailey proposed openstack-infra/jenkins-job-builder: Test stream no encoding bug https://review.openstack.org/312197 | 18:24 |
| *** vgridnev has quit IRC | 18:25 | |
| *** electrofelix has quit IRC | 18:26 | |
| *** ddieterly[away] has quit IRC | 18:27 | |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Define job-groups for api-ref and api-guide https://review.openstack.org/312198 | 18:27 |
| *** flwang1 has joined #openstack-infra | 18:29 | |
| flwang1 | ttx: ping re the tags of zaqar | 18:29 |
| openstackgerrit | Paul Belanger proposed openstack-infra/project-config: Add gate-tripleo-ci-centos-7-nonha experimental job https://review.openstack.org/312200 | 18:31 |
| *** armax_ has joined #openstack-infra | 18:31 | |
| pabelanger | EmilienM: ^ experimental tripleo job for puppet-aodh | 18:31 |
| *** bpokorny_ has joined #openstack-infra | 18:31 | |
| *** bpokorny_ has quit IRC | 18:31 | |
| *** bpokorny has quit IRC | 18:31 | |
| Remy | Hi! Quick question, does Zuul require a specific version of Gerrit to work? I am using Gerrit 2.11.4-11-ga14450f with the latest revision of Zuul from the repository and I get this error when zuul tries to send the jobs statuses to Gerrit: http://pastebin.com/nd3EsJTy | 18:31 |
| *** bpokorny has joined #openstack-infra | 18:32 | |
| *** edmondsw has quit IRC | 18:32 | |
| EmilienM | pabelanger: trigger: gate? | 18:33 |
| anteaya | pabelanger: what does the [OT] tag mean? | 18:33 |
| EmilienM | it's ok for experimental? | 18:33 |
| clarkb | Remy: those are the same versions we use | 18:33 |
| *** dynarro has joined #openstack-infra | 18:33 | |
| *** armax has quit IRC | 18:33 | |
| *** armax_ is now known as armax | 18:33 | |
| morgan | anteaya: off topic? | 18:33 |
| anteaya | really? | 18:33 |
| clarkb | infra-root what is test-magnum-devstack? and will you be sad if I delete it? | 18:33 |
| pabelanger | EmilienM: Ya, I left it as gate, since it will replace fedora-22 eventually | 18:33 |
| EmilienM | pabelanger: also, why in ironic project? | 18:33 |
| pabelanger | anteaya: yes, off-topic | 18:33 |
| anteaya | clarkb: I don't know what that is, I have no attachment to it personally | 18:34 |
| pabelanger | EmilienM: there is the single location where jobs are defined | 18:34 |
| mordred | clarkb: I know yolanda was working on getting magnum support going | 18:34 |
| anteaya | pabelanger: oh, I didn't consider your thread off topic at all | 18:34 |
| Remy | clarkb: arf, my mistake I pasted the wrong version. I'm using 2.12.2 for Gerrit sorry. | 18:34 |
| *** ddieterly has joined #openstack-infra | 18:34 | |
| EmilienM | pabelanger: ok. +1 | 18:34 |
| anteaya | Remy: we haven't started testing gerrit 2.12 yet, so yes would be interested in your experience with the 2.12 and zuul interaction | 18:35 |
| pabelanger | anteaya: Ya, I was being cautious as not sure members we interested in speaking at conferences outside of OpenStack summit | 18:35 |
| pabelanger | EmilienM: as a clean up, we could create a job-template specific to tripleo things | 18:35 |
| anteaya | oh okay, caution can be a good thing | 18:35 |
| anteaya | Remy: do you have more build log than that? | 18:36 |
| anteaya | Remy: what was zuul working on when it encountered that error? | 18:36 |
| EmilienM | pabelanger: ++ | 18:36 |
| anteaya | Remy: build log/log | 18:37 |
| Remy | anteaya: I do not have the full logs, as they were on my test machine. I could try to repro. Basically what I was just doing was testing that the gate jobs would work fine. | 18:37 |
| Remy | They did get triggered, and built, but gerrit never received the information back | 18:38 |
| anteaya | we would be interested in full logs of that experience if you could reproduce, thank you | 18:38 |
| anteaya | if zuul and 2.12 are unhappy together we also would like to get to the bottom of the situation | 18:39 |
| Remy | oki doki, I'm going to rebuild my test env, and provide you with more info. Thank you :) | 18:39 |
| anteaya | Remy: thanks so much | 18:39 |
| ttx | flwang1: o/ | 18:40 |
| *** salv-orlando has joined #openstack-infra | 18:40 | |
| flwang1 | ttx: i just replied your comments on https://review.openstack.org/#/c/310317/1 | 18:40 |
| flwang1 | ttx: but i'm not really sure if i followed | 18:40 |
| ttx | reading | 18:40 |
| clarkb | Remy: anteaya it would also be good if you could manually run such an ssh command to see how it fails | 18:41 |
| ttx | flwang1: it's core reviewers reviews | 18:41 |
| clarkb | its possible you just don't have a verify category and it explodes | 18:41 |
| flwang1 | ttx: can you let me know which rule is requiring that? http://governance.openstack.org/reference/tags/team_diverse-affiliation.html#requirements | 18:41 |
| anteaya | pabelanger: so pyconau talk submission proposal is closing soon, do you want to start an infra thread to see if anyone has or is going to submit a talk about infra tools? | 18:41 |
| ttx | the sum of all reviews done by core reviewers against patches submitted to any of the git repositories managed by the team in mitaka is 83% RedHat+CatalystIT | 18:42 |
| *** d34dh0r53 is now known as m1r4nt15_b0y | 18:42 | |
| Remy | clarkb: this I have | 18:42 |
| *** chem has quit IRC | 18:42 | |
| anteaya | pabelanger: https://2016.pycon-au.org/programme/call_for_proposals closes the 8th of May | 18:42 |
| ttx | flwang1: ^ | 18:42 |
| *** hdd has joined #openstack-infra | 18:42 | |
| *** marcusvrn_ has quit IRC | 18:43 | |
| flwang1 | ttx: do you mean the reviews counts reviewed by core reviewers from 2 companies vs. reviews by the whole core reviewers team ? | 18:43 |
| ttx | yes, 2 companies represent 83% of all reviews by core developers | 18:43 |
| flwang1 | the sum of all reviews done by core reviewers against patches submitted to any of the git repositories managed by the team in mitaka, i can see your point. but then i question is how to define the 'team' | 18:44 |
| ttx | which is hardly surprising given that you represent 80% of active core reviewers | 18:44 |
| pabelanger | anteaya: I just see pleia2 link https://etherpad.openstack.org/p/infra-conferences-2016 on a follow-up email. What do you think of listing it there? | 18:44 |
| Remy | clarkb: anteaya : here is the result I got from running the SSH command manually: http://pastebin.com/iTGNRkrF | 18:44 |
| flwang1 | i don't think it's a 'core team' but a general team, maybe i'm wrong | 18:44 |
| ttx | the team is the Zaqar project team | 18:44 |
| anteaya | pabelanger: even better | 18:44 |
| rcarrillocruz | folks, not sure if i'll be for infra meeting, have yet to get my son asleep | 18:44 |
| *** nadya has quit IRC | 18:45 | |
| *** salv-orlando has quit IRC | 18:45 | |
| anteaya | rcarrillocruz: understood, thanks for the update | 18:45 |
| ttx | flwang1: the rule is "no two organizations should represent >80% of the sum of all reviews done by core reviewers against patches submitted to any of the git repositories managed by the team" | 18:45 |
| anteaya | rcarrillocruz: hopefully he will drift off before the end of the meeting :) | 18:46 |
| clarkb | Remy: I think those errors are due to ssh escaping | 18:46 |
| clarkb | Remy: try wrapping the entire gerrit command in ''s | 18:46 |
| ttx | I agree it could be clearer, but that is meant as a core review share -- as exemplified by the testing script | 18:46 |
| Remy | clarkb: ok, I'm going to try that | 18:46 |
| *** javeriak has quit IRC | 18:46 | |
| Remy | thank you | 18:46 |
| flwang1 | ttx: ok, thanks for the clarification. i will abandon the patch for now | 18:47 |
| ttx | <80% of commits, reviews, core reviews and core reviewers basically | 18:47 |
| ttx | flwang1: note that if you add a new core that may just help | 18:48 |
| ttx | since the RAX ones are a bit inactive | 18:48 |
| *** salv-orlando has joined #openstack-infra | 18:48 | |
| *** salv-orlando has quit IRC | 18:48 | |
| flwang1 | ttx: yep, i see. i'm encouraging the guys from huawei to contribute more | 18:48 |
| *** EricGonczer_ has joined #openstack-infra | 18:49 | |
| flwang1 | ttx: again, many thanks | 18:49 |
| ttx | since you seem to fill everything else (are at 80% on the core reviewer criteria) | 18:49 |
| ttx | cheers | 18:49 |
| *** hdd has quit IRC | 18:50 | |
| *** roxanaghe has quit IRC | 18:50 | |
| *** armax has quit IRC | 18:51 | |
| *** salv-orlando has joined #openstack-infra | 18:51 | |
| yolanda | clarkb, it's mine yes, i'm using that to test magnum+shade integration | 18:51 |
| *** baoli has quit IRC | 18:52 | |
| *** roxanaghe has joined #openstack-infra | 18:52 | |
| *** hashar has joined #openstack-infra | 18:53 | |
| *** dprince has quit IRC | 18:53 | |
| *** hashar has quit IRC | 18:53 | |
| *** hashar has joined #openstack-infra | 18:53 | |
| *** salv-orlando has quit IRC | 18:54 | |
| clarkb | yolanda: can you delete it and recreate in the jenkins account instead of the ci account? | 18:54 |
| clarkb | yolanda: the issue is that the ci accounts have their hosts added to ansible inventory and that host causes ansible to sit and wiat for forever | 18:54 |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Define job-groups for api-ref and api-guide https://review.openstack.org/312198 | 18:56 |
| jhesketh | Morning | 18:56 |
| *** baoli has joined #openstack-infra | 18:56 | |
| anteaya | jhesketh: morning | 18:56 |
| *** yolanda has quit IRC | 18:56 | |
| *** kgiusti has quit IRC | 18:57 | |
| *** links has quit IRC | 18:58 | |
| *** doug-fis_ has joined #openstack-infra | 18:58 | |
| *** baoli has quit IRC | 18:58 | |
| *** armax has joined #openstack-infra | 18:59 | |
| pabelanger | anteaya: added into about pycon to the etherpad | 18:59 |
| pabelanger | info* | 18:59 |
| *** banix has quit IRC | 18:59 | |
| *** doug-fi__ has joined #openstack-infra | 19:00 | |
| anteaya | pabelanger: great, thank you | 19:00 |
| *** EricGonczer_ has quit IRC | 19:00 | |
| pleia2 | meeting time | 19:00 |
| clarkb | ugh already? | 19:00 |
| *** kgiusti has joined #openstack-infra | 19:02 | |
| *** doug-fish has quit IRC | 19:02 | |
| *** doug-fis_ has quit IRC | 19:03 | |
| *** julim has quit IRC | 19:04 | |
| *** doug-fi__ has quit IRC | 19:04 | |
| anteaya | clarkb: did you add pick a week for the operating system control plane upgrade sprint? | 19:04 |
| clarkb | no, busy with more pressing things currently | 19:04 |
| anteaya | I understand | 19:04 |
| anteaya | if there is open discussion I'll try to introduce it there | 19:05 |
| anteaya | unless you would like to? | 19:05 |
| clarkb | ya thats fine | 19:05 |
| *** baoli has joined #openstack-infra | 19:05 | |
| anteaya | great, thanks | 19:05 |
| openstackgerrit | Ben Nemec proposed openstack-infra/project-config: Add stable branch jobs for tripleo-ci https://review.openstack.org/297390 | 19:06 |
| *** kzaitsev_mb has quit IRC | 19:06 | |
| *** julim has joined #openstack-infra | 19:07 | |
| *** bpokorny_ has joined #openstack-infra | 19:12 | |
| pabelanger | ianw: mind giving me a quick rundown on break=after-error for diskimage-builder? Is is a simple as export break=after-error ? | 19:14 |
| *** EricGonczer_ has joined #openstack-infra | 19:16 | |
| *** ddieterly is now known as ddieterly[away] | 19:16 | |
| *** bpokorny has quit IRC | 19:16 | |
| *** vhosakot_ has quit IRC | 19:16 | |
| *** gyee has quit IRC | 19:17 | |
| *** jamesmcarthur has joined #openstack-infra | 19:20 | |
| *** banix has joined #openstack-infra | 19:20 | |
| *** maishsk has joined #openstack-infra | 19:21 | |
| *** ddieterly[away] is now known as ddieterly | 19:21 | |
| openstackgerrit | Merged openstack-infra/jenkins-job-builder: Compatibility support for older maven project plugins https://review.openstack.org/274195 | 19:21 |
| *** matrohon has joined #openstack-infra | 19:23 | |
| *** Sukhdev has joined #openstack-infra | 19:23 | |
| timothyb89 | pabelanger: looks like the stackviz patch is running correctly on Ubuntu and Fedora, log output in a comment here: https://review.openstack.org/#/c/311815/1 | 19:25 |
| *** roxanaghe has quit IRC | 19:28 | |
| openstackgerrit | John Trowbridge proposed openstack-infra/tripleo-ci: Fix overcloud pingtest for stable branches https://review.openstack.org/312212 | 19:30 |
| *** EricGonc_ has joined #openstack-infra | 19:30 | |
| EmilienM | I'm not sure infra can help, but let's try: I'm currently testing Ubuntu Xenial images and I'm having SSL troubles: http://logs.openstack.org/30/308530/6/experimental/gate-puppet-openstack-integration-3-scenario002-tempest-ubuntu-xenial/d91c189/console.html#_2016-05-03_12_09_55_464 - see [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed (_ssl.c:590) | 19:30 |
| EmilienM | packages in trusty: http://logs.openstack.org/30/308530/6/check/gate-puppet-openstack-integration-3-scenario003-tempest-ubuntu-trusty/8d287e1/logs/dpkg-l.txt.gz | 19:31 |
| EmilienM | and packages in xenial: http://logs.openstack.org/30/308530/6/experimental/gate-puppet-openstack-integration-3-scenario002-tempest-ubuntu-xenial/d91c189/logs/dpkg-l.txt.gz | 19:31 |
| anteaya | EmilienM: there was an openssl cve today, I'm not sure if that is related or not | 19:31 |
| clarkb | EmilienM: I would check if xenial python requests package honors your cert list | 19:31 |
| mordred | morgan: ^^ | 19:31 |
| mordred | yah | 19:31 |
| mordred | what clarkb just said | 19:31 |
| clarkb | because upstream requests does not | 19:31 |
| EmilienM | anteaya: not related, I'm having this issue for weeks | 19:31 |
| clarkb | and if ubuntu stopped patching that then well bad things | 19:31 |
| morgan | mordred: oh hi? | 19:31 |
| mordred | the distro packaged requests usually patch the part of requests that ignores system certs | 19:31 |
| anteaya | EmilienM: okay thanks | 19:31 |
| EmilienM | anteaya: thanks! | 19:32 |
| morgan | mordred: correct | 19:32 |
| EmilienM | clarkb, morgan: ok I'll check that. Thanks a lot | 19:32 |
| EmilienM | and mordred -> thx | 19:32 |
| morgan | EmilienM: there is a env that can be set to point at a real CA bundle. | 19:32 |
| EmilienM | in trustry I have 2.9.1-3~cloud0 and in xenial 2.9.1-3 | 19:33 |
| morgan | EmilienM: i also know they are really looking to honor system-cas properly in... one of the upcoming releases. | 19:33 |
| morgan | of requests | 19:33 |
| morgan | i wonder if the xenial just ended up unpatched :( | 19:33 |
| EmilienM | I need to download the .deb and compare :-) | 19:34 |
| EmilienM | morgan: could it be in python-requestsexceptions ? or just python-requests ? | 19:34 |
| morgan | python-requests | 19:34 |
| EmilienM | kk | 19:34 |
| * EmilienM goes find .deb files | 19:35 | |
| morgan | EmilienM: i would be surprised if it was unpatched. | 19:35 |
| clarkb | ya another possibilitiy is the system cert management has hcnaged | 19:36 |
| *** sballe_ has left #openstack-infra | 19:36 | |
| StevenK | Does http://changelogs.ubuntu.com/changelogs/pool/main/r/requests/requests_2.9.1-3/changelog help? | 19:36 |
| EmilienM | yeah, we use /usr/sbin/update-ca-certificates -f to update ca in trusty | 19:36 |
| EmilienM | StevenK: the thing is trusty & xenial have both the same version, 2.9.1-3 | 19:37 |
| morgan | clarkb: true. | 19:37 |
| EmilienM | StevenK: trusty has 2.9.1-3~cloud0 and xenial 2.9.1-3 | 19:38 |
| *** Remy has quit IRC | 19:38 | |
| pabelanger | timothyb89: the seem to be truncated | 19:39 |
| *** ericksonsantos has quit IRC | 19:39 | |
| StevenK | EmilienM: Do you have both deb | 19:39 |
| StevenK | EmilienM: Do you have both deb's locally? | 19:39 |
| EmilienM | StevenK: not yet | 19:39 |
| StevenK | I suspect ~cloud0 is from UCA | 19:40 |
| EmilienM | right | 19:40 |
| *** RickA-HP has joined #openstack-infra | 19:40 | |
| RickA-HP | Folks. We are looking at adding Tempest tests to the Searchlight service. Is this allowed, having a non-core service adding Tempest tests? | 19:41 |
| EmilienM | morgan, StevenK: so in xenial package, they still have patches | 19:41 |
| RickA-HP | @AJaeger @anteaya ^^^^^ | 19:41 |
| EmilienM | 01_use-system-ca-certificates.patch | 19:41 |
| EmilienM | 03_export-IncompleteRead.patch | 19:41 |
| morgan | EmilienM: yeah. | 19:41 |
| EmilienM | 02_populate-install_requires.patch | 19:41 |
| StevenK | EmilienM: Is there a series file? | 19:42 |
| EmilienM | yeah | 19:42 |
| *** trey has quit IRC | 19:42 | |
| *** matrohon has quit IRC | 19:42 | |
| *** banix has quit IRC | 19:42 | |
| *** EricGonczer_ has quit IRC | 19:42 | |
| *** ddieterly has quit IRC | 19:42 | |
| *** jerryz has quit IRC | 19:42 | |
| *** gordc has quit IRC | 19:42 | |
| *** asselin__ has quit IRC | 19:42 | |
| *** degorenko has quit IRC | 19:42 | |
| *** MarkAtwood has quit IRC | 19:42 | |
| *** jlk has quit IRC | 19:42 | |
| *** pblaho has quit IRC | 19:42 | |
| *** david-lyle has quit IRC | 19:42 | |
| *** bookwar_ has quit IRC | 19:42 | |
| *** zul has quit IRC | 19:42 | |
| *** dangers_away has quit IRC | 19:42 | |
| *** cfarquhar has quit IRC | 19:42 | |
| *** ajmiller has quit IRC | 19:42 | |
| *** otherwiseguy has quit IRC | 19:42 | |
| *** elo has quit IRC | 19:42 | |
| *** clsacramento has quit IRC | 19:42 | |
| *** trown has quit IRC | 19:42 | |
| *** timothyb89 has quit IRC | 19:42 | |
| *** rvba has quit IRC | 19:42 | |
| *** lyz has quit IRC | 19:42 | |
| *** Douhet has quit IRC | 19:42 | |
| *** Kiall has quit IRC | 19:42 | |
| *** skraynev has quit IRC | 19:42 | |
| *** gmann has quit IRC | 19:42 | |
| *** pcm_ has quit IRC | 19:42 | |
| *** gabriel-bezerra has quit IRC | 19:42 | |
| *** thingee has quit IRC | 19:42 | |
| *** akshai has quit IRC | 19:42 | |
| *** flwang1 has quit IRC | 19:42 | |
| *** mriedem has quit IRC | 19:42 | |
| *** sputnik13 has quit IRC | 19:42 | |
| *** keedya has quit IRC | 19:42 | |
| *** mtanino has quit IRC | 19:42 | |
| *** docaedo2 has quit IRC | 19:42 | |
| *** markmcd1 has quit IRC | 19:42 | |
| *** markmcd has quit IRC | 19:42 | |
| *** r-mibu has quit IRC | 19:42 | |
| *** esker has quit IRC | 19:42 | |
| *** burgerk has quit IRC | 19:42 | |
| *** eharney has quit IRC | 19:42 | |
| *** zz_ja has quit IRC | 19:42 | |
| *** ccamacho|away has quit IRC | 19:42 | |
| *** thorst has quit IRC | 19:42 | |
| *** jogo has quit IRC | 19:42 | |
| *** d0ugal has quit IRC | 19:42 | |
| *** binbincong has quit IRC | 19:42 | |
| *** Clint has quit IRC | 19:42 | |
| *** aarefiev has quit IRC | 19:42 | |
| *** netsin has quit IRC | 19:42 | |
| *** fungi has quit IRC | 19:42 | |
| *** kaisers has quit IRC | 19:42 | |
| *** LinuxJedi has quit IRC | 19:42 | |
| *** hughhalf has quit IRC | 19:42 | |
| *** whoops has quit IRC | 19:42 | |
| *** |GonZo2000| has quit IRC | 19:42 | |
| *** lennyb has quit IRC | 19:42 | |
| *** hrubi has quit IRC | 19:42 | |
| *** bkeller` has quit IRC | 19:42 | |
| *** persia has quit IRC | 19:42 | |
| *** rhe00 has quit IRC | 19:42 | |
| *** bexelbie has quit IRC | 19:42 | |
| *** crinkle has quit IRC | 19:42 | |
| *** uberjay_ has quit IRC | 19:42 | |
| *** Vivek has quit IRC | 19:42 | |
| *** kevinbenton has quit IRC | 19:42 | |
| *** kevinshort has quit IRC | 19:42 | |
| *** jgriffith has quit IRC | 19:42 | |
| *** adreznec has quit IRC | 19:42 | |
| *** michaelxin has quit IRC | 19:42 | |
| *** andreaf has quit IRC | 19:42 | |
| *** markmcclain has quit IRC | 19:42 | |
| *** tobiash has quit IRC | 19:42 | |
| StevenK | EmilienM: The existance of a patch is not enough, it also needs to be listed in the series | 19:42 |
| *** jamesmcarthur has quit IRC | 19:42 | |
| EmilienM | StevenK: it's listed | 19:42 |
| StevenK | Great | 19:42 |
| morgan | EmilienM: hmmmmm. | 19:42 |
| *** jamesmcarthur has joined #openstack-infra | 19:43 | |
| StevenK | I've debdiff'd the two python-requests, and the ony real difference is the Depends line | 19:43 |
| StevenK | So maybe the issue isn't requests, but the CA bundle | 19:44 |
| EmilienM | xenial: ca-certificates = 20160104ubuntu1 / trusty is 20160104ubuntu0.14.04.1 | 19:44 |
| openstackgerrit | Dan Smith proposed openstack-infra/devstack-gate: WIP: Start up nova-api on the subnode during multinode upgrades https://review.openstack.org/312221 | 19:44 |
| EmilienM | they look similar | 19:44 |
| StevenK | Huh | 19:45 |
| StevenK | I daresay they are pretty much identical except for changelog entries and maybe their depends | 19:46 |
| *** ericksonsantos has joined #openstack-infra | 19:47 | |
| EmilienM | jamespage: hey, before the netsplit we were talking about SSL issues on xenial | 19:47 |
| *** yolanda has joined #openstack-infra | 19:47 | |
| EmilienM | jamespage: http://logs.openstack.org/30/308530/6/experimental/gate-puppet-openstack-integration-3-scenario002-tempest-ubuntu-xenial/d91c189/console.html#_2016-05-03_12_09_55_464 | 19:47 |
| EmilienM | jamespage: we were wondering if something changed in python-request or maybe on the way to deploy ca bundles, right now we use /usr/sbin/update-ca-certificates | 19:48 |
| *** Swami has joined #openstack-infra | 19:48 | |
| *** baoli has quit IRC | 19:49 | |
| *** phschwartz_ is now known as phschwartz | 19:49 | |
| *** baoli has joined #openstack-infra | 19:50 | |
| morgan | EmilienM: hm. i'll look at that a little more in depth after food if you haven't found it out | 19:50 |
| jamespage | EmilienM, StevenK: the requests in UCA and Xenial should be the same source package apart from the changlog entry | 19:50 |
| clarkb | EmilienM: the other thing to check is if openstack client is using system requests or pypi requests | 19:50 |
| *** dmk0202 has joined #openstack-infra | 19:51 | |
| morgan | clarkb: i expect it's using pypi | 19:51 |
| *** david-lyle has joined #openstack-infra | 19:51 | |
| *** akshai has joined #openstack-infra | 19:51 | |
| *** mriedem has joined #openstack-infra | 19:51 | |
| *** docaedo2 has joined #openstack-infra | 19:51 | |
| *** sputnik13 has joined #openstack-infra | 19:51 | |
| *** keedya has joined #openstack-infra | 19:51 | |
| *** mtanino has joined #openstack-infra | 19:51 | |
| *** markmcd1 has joined #openstack-infra | 19:51 | |
| *** markmcd has joined #openstack-infra | 19:51 | |
| *** r-mibu has joined #openstack-infra | 19:51 | |
| *** esker has joined #openstack-infra | 19:51 | |
| *** burgerk has joined #openstack-infra | 19:51 | |
| *** eharney has joined #openstack-infra | 19:51 | |
| *** zz_ja has joined #openstack-infra | 19:51 | |
| *** ccamacho|away has joined #openstack-infra | 19:51 | |
| *** thorst has joined #openstack-infra | 19:51 | |
| *** jogo has joined #openstack-infra | 19:51 | |
| *** d0ugal has joined #openstack-infra | 19:51 | |
| *** binbincong has joined #openstack-infra | 19:51 | |
| *** Clint has joined #openstack-infra | 19:51 | |
| *** aarefiev has joined #openstack-infra | 19:51 | |
| *** netsin has joined #openstack-infra | 19:51 | |
| *** fungi has joined #openstack-infra | 19:51 | |
| *** kaisers has joined #openstack-infra | 19:51 | |
| *** LinuxJedi has joined #openstack-infra | 19:51 | |
| *** hughhalf has joined #openstack-infra | 19:51 | |
| *** whoops has joined #openstack-infra | 19:51 | |
| *** |GonZo2000| has joined #openstack-infra | 19:51 | |
| *** lennyb has joined #openstack-infra | 19:51 | |
| *** hrubi has joined #openstack-infra | 19:51 | |
| *** rhe00 has joined #openstack-infra | 19:51 | |
| *** bkeller` has joined #openstack-infra | 19:51 | |
| *** bexelbie has joined #openstack-infra | 19:51 | |
| *** persia has joined #openstack-infra | 19:51 | |
| *** crinkle has joined #openstack-infra | 19:51 | |
| *** uberjay_ has joined #openstack-infra | 19:51 | |
| *** Vivek has joined #openstack-infra | 19:51 | |
| *** kevinbenton has joined #openstack-infra | 19:51 | |
| *** jgriffith has joined #openstack-infra | 19:51 | |
| *** kevinshort has joined #openstack-infra | 19:51 | |
| *** adreznec has joined #openstack-infra | 19:51 | |
| *** michaelxin has joined #openstack-infra | 19:51 | |
| *** andreaf has joined #openstack-infra | 19:51 | |
| *** markmcclain has joined #openstack-infra | 19:51 | |
| *** tobiash has joined #openstack-infra | 19:51 | |
| *** thingee has joined #openstack-infra | 19:51 | |
| *** banix has joined #openstack-infra | 19:51 | |
| *** ddieterly has joined #openstack-infra | 19:51 | |
| *** jerryz has joined #openstack-infra | 19:51 | |
| *** gordc has joined #openstack-infra | 19:51 | |
| *** asselin__ has joined #openstack-infra | 19:51 | |
| *** degorenko has joined #openstack-infra | 19:51 | |
| *** MarkAtwood has joined #openstack-infra | 19:51 | |
| *** jlk has joined #openstack-infra | 19:51 | |
| *** pblaho has joined #openstack-infra | 19:51 | |
| *** bookwar_ has joined #openstack-infra | 19:51 | |
| *** zul has joined #openstack-infra | 19:51 | |
| *** dangers_away has joined #openstack-infra | 19:51 | |
| *** cfarquhar has joined #openstack-infra | 19:51 | |
| *** ajmiller has joined #openstack-infra | 19:51 | |
| *** otherwiseguy has joined #openstack-infra | 19:51 | |
| *** elo has joined #openstack-infra | 19:51 | |
| *** clsacramento has joined #openstack-infra | 19:51 | |
| *** trown has joined #openstack-infra | 19:51 | |
| *** timothyb89 has joined #openstack-infra | 19:51 | |
| *** rvba has joined #openstack-infra | 19:51 | |
| *** lyz has joined #openstack-infra | 19:51 | |
| *** Douhet has joined #openstack-infra | 19:51 | |
| *** Kiall has joined #openstack-infra | 19:51 | |
| *** skraynev has joined #openstack-infra | 19:51 | |
| *** gmann has joined #openstack-infra | 19:51 | |
| *** pcm_ has joined #openstack-infra | 19:51 | |
| *** gabriel-bezerra has joined #openstack-infra | 19:51 | |
| StevenK | jamespage: debdiff reports no real changes of substance, at least | 19:51 |
| jamespage | StevenK, the resulting binaries might diff a bit on dependencies... | 19:52 |
| *** Goneri has quit IRC | 19:52 | |
| jamespage | as those are generated to some extent during the package build | 19:52 |
| *** matrohon has joined #openstack-infra | 19:53 | |
| EmilienM | clarkb, morgan: this is not devstack runs, I'm using packaging provided by Ubuntu Xenial | 19:53 |
| morgan | EmilienM: oh. so no pip install ? | 19:53 |
| EmilienM | maybe something does pip install, but not in Puppet CI | 19:54 |
| EmilienM | maybe during the image build | 19:54 |
| morgan | EmilienM: hmm.. then something is wonky with the system CA and how it's being referenced. | 19:54 |
| *** fbo has quit IRC | 19:54 | |
| morgan | i just looked through the logs, no pip afaict | 19:54 |
| EmilienM | not in the puppet logs, indeed, maybe in the xenial image build | 19:54 |
| EmilienM | let me look dib | 19:54 |
| morgan | maybe? | 19:54 |
| jamespage | EmilienM, is this a diff between trusty/mitaka and xenial/mitaka? | 19:55 |
| *** ddieterly is now known as ddieterly[away] | 19:55 | |
| mordred | jamespage: yah | 19:55 |
| clarkb | EmilienM: we should confine that to virtualenvs in the image builds | 19:55 |
| EmilienM | jamespage: we don't setup UCA on Xenial, that's all about it | 19:56 |
| *** trey has joined #openstack-infra | 19:56 | |
| jamespage | EmilienM, yes - that correct - no UCA for Xenial yet... | 19:56 |
| jamespage | mitaka is all just in distro | 19:56 |
| EmilienM | everything else is the same, except the nodepool image obviously | 19:56 |
| *** yolanda has quit IRC | 19:56 | |
| *** fbo has joined #openstack-infra | 19:57 | |
| mgagne | mordred: any plan on supporting bonding in glean? | 19:58 |
| mordred | mgagne: I believe someone has written some initial patches? | 19:58 |
| mgagne | mordred: will do my homework and check review queue | 19:58 |
| jlvillal | greghaynes: I remember a year or so ago you were talking about a decent priced colo facility in Portland. Do you remember the name of it? | 19:58 |
| mordred | mgagne: but yeah, anything that's in the neutron network-info structure should ultimately be supported in glean | 19:58 |
| greghaynes | jlvillal: opus interactive | 19:58 |
| jlvillal | greghaynes: Thanks :) | 19:59 |
| mgagne | mordred: I'm about to defenestrate cloud-init | 19:59 |
| EmilienM | I thought defenestrate was french | 19:59 |
| EmilienM | neat, I can also use it in english | 19:59 |
| jamespage | EmilienM, guessing your module a bit here - you're autogenerating self-signed certs and injecting the CA to the host by writing it to /etc/ssl/certs and running update-ca-certificates -f or suchlike? | 19:59 |
| mordred | mgagne: \o/ | 19:59 |
| mtreinish | EmilienM: it's a great word :) | 19:59 |
| mgagne | rare: throw (someone) out of a window. | 20:00 |
| anteaya | EmilienM: it is a great word | 20:00 |
| anteaya | mtreinish: jinx | 20:00 |
| *** kgiusti1 has joined #openstack-infra | 20:00 | |
| EmilienM | jamespage: exactly! | 20:00 |
| pleia2 | fungi: you'll enjoy our parallel universe meeting log, good luck with the copy/pasta interleaving :) | 20:00 |
| nibalizer | thats so funny to me that we had double meetings | 20:00 |
| anteaya | fungi: I want to read your ramblings | 20:00 |
| *** nadya has joined #openstack-infra | 20:00 | |
| EmilienM | jamespage: we inject the file like this: https://github.com/openstack/puppet-openstack-integration/blob/master/manifests/cacert.pp | 20:00 |
| nibalizer | scalable infra team right | 20:00 |
| nibalizer | fault tollerabt | 20:00 |
| nibalizer | all the jokes | 20:01 |
| anteaya | ha ha ha | 20:01 |
| *** kgiusti1 has quit IRC | 20:01 | |
| *** kgiusti1 has joined #openstack-infra | 20:01 | |
| pleia2 | HA meeting chair | 20:01 |
| EmilienM | jamespage: with the paths: https://github.com/openstack/puppet-openstack-integration/blob/master/manifests/params.pp | 20:01 |
| fungi | pleia2: i may just keep your meeting and try to integrate my updates into an e-mail for the list | 20:01 |
| fungi | thanks for taking over when i ended up in the quiet universe | 20:01 |
| pleia2 | sure thing | 20:01 |
| anteaya | fungi: was anyone with you? | 20:01 |
| * crinkle was | 20:01 | |
| anteaya | fungi: did you have any company? | 20:01 |
| anteaya | crinkle: nice | 20:01 |
| *** nadya has quit IRC | 20:01 | |
| *** EricGonc_ has quit IRC | 20:02 | |
| *** nadya has joined #openstack-infra | 20:02 | |
| *** kgiusti has quit IRC | 20:02 | |
| EmilienM | jamespage: so I put the crt in /usr/local/share/ca-certificates/puppet_openstack.crt and run /usr/sbin/update-ca-certificates -f | 20:02 |
| jamespage | EmilienM, that's what I would do (and indeed what the openstack charms do as well0... | 20:03 |
| jamespage | ) | 20:03 |
| jamespage | still poking... | 20:03 |
| *** sridhar_ram1 has joined #openstack-infra | 20:03 | |
| fungi | anteaya: i was preaching to a room of 40 there for a while. it was probably me, crinkle, persia and 37 other people who weren't watching | 20:03 |
| anteaya | ha ha ha | 20:03 |
| EmilienM | I'm going to defenestrate SSL | 20:03 |
| jesusaur | oof | 20:03 |
| anteaya | so that's how you get to have a quiet meeting | 20:03 |
| anteaya | I've learned that defenstranation is good for starting wars | 20:03 |
| *** sridhar_ram has quit IRC | 20:04 | |
| * fungi notes to schedule more netsplits in the future | 20:04 | |
| anteaya | he he he | 20:04 |
| pabelanger | EmilienM: looking at http://nodepool.openstack.org/dib.ubuntu-xenial.log I don't see that we install python-requests | 20:04 |
| *** shardy has quit IRC | 20:04 | |
| pabelanger | EmilienM: but trusty we do: http://nodepool.openstack.org/dib.ubuntu-trusty.log | 20:04 |
| EmilienM | ouch | 20:04 |
| *** baoli has quit IRC | 20:04 | |
| pabelanger | EmilienM: so a simple test would be to apt-get install python-requests in your run_tests.sh script | 20:04 |
| pabelanger | EmilienM: and see what happens | 20:04 |
| *** baoli has joined #openstack-infra | 20:04 | |
| *** esker has quit IRC | 20:05 | |
| mtreinish | mordred: so on the db stuff and moving off of trove, is there anything I can do to help get things started? | 20:05 |
| *** rockyg has joined #openstack-infra | 20:05 | |
| pabelanger | I should note python-requests-whl is an extra package for trusty, perhaps the dependency has been broken for xenial | 20:05 |
| EmilienM | pabelanger: I can try it, the thing is the result is we have the same version on both trusty & xenial | 20:05 |
| pabelanger | EmilienM: we likely need to ensure it is added to bindep-fallback.txt if we expect it to be installed | 20:06 |
| *** amitgandhinz has quit IRC | 20:06 | |
| *** Sukhdev has quit IRC | 20:07 | |
| *** doug-fish has joined #openstack-infra | 20:08 | |
| *** doug-fish has quit IRC | 20:08 | |
| pabelanger | EmilienM: actually, looks like I am wrong. We are only downloading it, not installing it | 20:08 |
| pabelanger | with trusty | 20:08 |
| StevenK | pabelanger: python-requests-whl was dropped on purpose during Xenial's cycle | 20:09 |
| pabelanger | StevenK: okay, so that explains it missing from xenial | 20:10 |
| mordred | mtreinish: I actually started poking at it a little yesterday | 20:10 |
| *** jamesmcarthur has quit IRC | 20:10 | |
| mtreinish | mordred: oh, cool | 20:10 |
| *** amrith is now known as _amrith_ | 20:12 | |
| *** esker has joined #openstack-infra | 20:13 | |
| *** hashar has quit IRC | 20:15 | |
| EmilienM | does anyone tested xenial nodes already? | 20:16 |
| *** hdd has joined #openstack-infra | 20:17 | |
| mgagne | EmilienM: I'm trying to make it respond to ping on our cloud :D | 20:18 |
| fungi | EmilienM: some experimental jobs and, as of a few hours ago, now infra | 20:18 |
| *** ddieterly[away] is now known as ddieterly | 20:18 | |
| EmilienM | fungi: does something test openstack/ssl? | 20:19 |
| fungi | EmilienM: i don't think devstack/tempest is working on xenial yet | 20:19 |
| clarkb | fungi: EmilienM devstack/tempest is working on xenial but they don't ssl anything | 20:20 |
| EmilienM | ok so i'm an early tester maybe | 20:20 |
| EmilienM | ah, we ssl & ipv6 | 20:20 |
| *** ddieterly is now known as ddieterly[away] | 20:20 | |
| fungi | oh, closer than i thought already | 20:20 |
| *** ccamacho|away has quit IRC | 20:21 | |
| fungi | pabelanger: we're preinstalling the python-requests distro package on ubuntu-trusty again?!? | 20:22 |
| *** amitgandhinz has joined #openstack-infra | 20:22 | |
| pabelanger | fungi: no, I was confused | 20:22 |
| * fungi will pretend not to have seen that. can only focus on troubleshooting one broken thing at a time now | 20:22 | |
| pabelanger | fungi: we are only caching it | 20:22 |
| fungi | oh, caching. good *whew* | 20:23 |
| *** ccamacho has joined #openstack-infra | 20:24 | |
| *** banix has quit IRC | 20:24 | |
| fungi | we've hit a brief lull on the crazy openssl emergency upgrades. i'm assuming nobody's started to look into the write errors uploading to tarballs.o.o yet? | 20:24 |
| *** matrohon has quit IRC | 20:24 | |
| *** kgiusti has joined #openstack-infra | 20:24 | |
| anteaya | fungi: yay lull | 20:24 |
| fungi | i guess not as i'm still the only one logged into it | 20:25 |
| anteaya | fungi: I haven't seen anyone say they are looking at tarballs | 20:25 |
| clarkb | #status notice restarting apache on review.openstack.org to pick up security patches. Gerrit web ui may disappear for a short time. | 20:25 |
| clarkb | did that noop because I am not auth'd with nickserv? | 20:25 |
| anteaya | maybe? | 20:25 |
| *** fitoduarte has joined #openstack-infra | 20:26 | |
| anteaya | the bot is in channel | 20:26 |
| openstackgerrit | Tim Laszlo proposed openstack-infra/shade: Add support for server groups https://review.openstack.org/312237 | 20:26 |
| clarkb | #status notice restarting apache on review.openstack.org to pick up security patches. Gerrit web ui may disappear for a short time. | 20:26 |
| openstackstatus | clarkb: sending notice | 20:26 |
| StevenK | clarkb: Blah, you should switch to using SSL certs to auth to services | 20:26 |
| fungi | aha! | 20:26 |
| fungi | lrwxrwxrwx 1 root root 7 Jun 30 2015 /dev/mapper/main-tarballs -> ../dm-2 | 20:26 |
| fungi | [Tue May 3 04:37:01 2016] EXT4-fs (dm-2): Remounting filesystem read-only | 20:27 |
| *** kgiusti1 has quit IRC | 20:27 | |
| fungi | le sigh | 20:27 |
| StevenK | Heh | 20:27 |
| -openstackstatus- NOTICE: restarting apache on review.openstack.org to pick up security patches. Gerrit web ui may disappear for a short time. | 20:27 | |
| *** matrohon has joined #openstack-infra | 20:27 | |
| clarkb | jpmaxman: hey, we will also need to do the same for apache on openstackid, is it fine to go ahead and just do that? | 20:27 |
| anteaya | fungi: so that was static and logging and tarballs then? | 20:28 |
| openstackstatus | clarkb: finished sending notice | 20:29 |
| openstackgerrit | Paul Belanger proposed openstack-infra/project-config: Add wget to puppet element https://review.openstack.org/312239 | 20:29 |
| pabelanger | fungi: clarkb: Looks like we need to add wget to the puppet element for dib ^ | 20:29 |
| *** kgiusti has quit IRC | 20:31 | |
| openstackgerrit | Emilien Macchi proposed openstack-infra/project-config: Implement periodic job to update Puppet OpenStack constraints https://review.openstack.org/301375 | 20:31 |
| *** annegentle has quit IRC | 20:31 | |
| EmilienM | AJaeger: I addressed all your comments, even if you +2-ed, so we're clean | 20:31 |
| *** e0ne has joined #openstack-infra | 20:34 | |
| jpmaxman | fungi: I think it should be fine let me just double check | 20:35 |
| clarkb | jpmaxman: ya I got confirmnation out of band | 20:35 |
| *** nadya has quit IRC | 20:35 | |
| clarkb | jpmaxman: from smarcet and jimmy | 20:35 |
| jpmaxman | ok cool | 20:36 |
| clarkb | jpmaxman: it is all done now, was a quick one | 20:36 |
| jpmaxman | great | 20:36 |
| jpmaxman | I feel secure again | 20:36 |
| jpmaxman | :D | 20:36 |
| fungi | #status log through some careful scripting (which involved apache reconfiguration to stop holding an open file lock) i offlined the tarballs volume on static.openstack.org to repair its filesystem so it could be remounted read-write | 20:38 |
| openstackstatus | fungi: finished logging | 20:38 |
| *** nadya has joined #openstack-infra | 20:40 | |
| *** ddieterly[away] is now known as ddieterly | 20:41 | |
| *** doug-fish has joined #openstack-infra | 20:42 | |
| *** Sukhdev has joined #openstack-infra | 20:42 | |
| *** bigjools has quit IRC | 20:43 | |
| *** salv-orlando has joined #openstack-infra | 20:44 | |
| *** bigjools has joined #openstack-infra | 20:45 | |
| *** doug-fish has quit IRC | 20:46 | |
| *** tpsilva has quit IRC | 20:47 | |
| *** gyee has joined #openstack-infra | 20:47 | |
| fungi | waynr: looks like electrofelix has dropped off, but now that i've got the tarballs site writeable again i've retriggered the jjb 1.5.0 release jobs and it's updated on pypi now https://pypi.python.org/pypi/jenkins-job-builder | 20:47 |
| asselin_ | hey, i'm seeing an issue in our ci where zuul says build:check-tempest-dsvm-neutron-full 0 0 2, but the zuul status page shows a few jobs with that name queued up. Any idea how to reset the state? | 20:48 |
| clarkb | asselin_: offline and online a node that can run that job or enable disable that job | 20:49 |
| *** salv-orlando has quit IRC | 20:50 | |
| fungi | asselin_: odds are jenkins has gotten itself in a state where it's not picking up jobs | 20:50 |
| *** vgridnev has joined #openstack-infra | 20:50 | |
| fungi | asselin_: oh, thing to check though, it it stuck on the merger work request? | 20:50 |
| fungi | i think the pending jobs could would be nonzero unless somehow zuul got disconnected from its gearman subprocess | 20:51 |
| *** Sukhdev has quit IRC | 20:51 | |
| asselin_ | taking one offline does update the 3rd number: build:check-tempest-dsvm-neutron-full 0 0 1 | 20:52 |
| openstackgerrit | Paul Belanger proposed openstack-infra/project-config: Add ubuntu-precise dib to nodepool https://review.openstack.org/312248 | 20:52 |
| asselin_ | but bringing it back online doesn't help: build:check-tempest-dsvm-neutron-full:devstack-trusty 0 0 2 | 20:52 |
| fungi | asselin_: i'm betting something has caused your zuul-merger worker not to pick up merger work requests | 20:53 |
| fungi | is the zuul-merger daemon running? | 20:53 |
| *** Swami has quit IRC | 20:53 | |
| asselin_ | checking | 20:53 |
| fungi | do you see a nonzero value in the third column for merger jobs? | 20:53 |
| fungi | that's where your merger workers would be registered in gearman | 20:54 |
| asselin_ | merger:update 16 0 1 | 20:54 |
| asselin_ | merger:merge 1959 1 1 | 20:54 |
| *** salv-orlando has joined #openstack-infra | 20:54 | |
| *** baoli has quit IRC | 20:54 | |
| fungi | yeah, looks like you're backed up on merger work requests for sure | 20:54 |
| *** lucas-dinner has quit IRC | 20:54 | |
| fungi | i'd check the debug log for zuul-merger | 20:55 |
| fungi | something has likely made it not happy | 20:55 |
| asselin_ | I see..... | 20:55 |
| pabelanger | I think the vos release for mirror.pypi might be finished | 20:55 |
| fungi | ooh! | 20:55 |
| asselin_ | someone submitted a huge patch chain to a repo, and abandoned it. Zuul merger is still working on it though. | 20:56 |
| fungi | dims: ^ you may want to double-check the things | 20:56 |
| pabelanger | I think it was run on afs01.dfw.openstack.org | 20:56 |
| asselin_ | I guess restart the zuul merger is the best way to skip that? | 20:56 |
| pabelanger | but no longer see the process | 20:56 |
| *** aysyd has quit IRC | 20:56 | |
| fungi | wow. there's a fun new way to gum up a zuul | 20:56 |
| pabelanger | vos examine mirror.pypi --verbose does show the mirror out of sync still | 20:57 |
| fungi | asselin_: i think restarting the merger won't help, because gearman still holds the queue for it | 20:57 |
| dims | fungi : hmmm what did i break? | 20:57 |
| fungi | asselin_: you may need to export your changes from the pipelines you care about, restart zuul, and then reenqueue the exported list | 20:57 |
| asselin_ | yeah....avoiding that, but may not have a choice..... | 20:58 |
| *** lucasagomes has joined #openstack-infra | 20:58 | |
| pabelanger | fungi: jeblair: I think we need another vos release manually? | 20:58 |
| fungi | dims: pabelanger was saying the long-running pypi mirror sync may be done. just giving you a heads up in case you wanted to double check the things you knew were missing | 20:58 |
| dims | fungi : ah. thanks. will check on it in a bit | 20:58 |
| dims | thanks for the heads up. pabelanger and fungi | 20:59 |
| fungi | dims: well, it sounds like maybe it's still not done after all | 20:59 |
| dims | :) | 20:59 |
| dims | no worries | 20:59 |
| pabelanger | Ya, we should see what jeblair says | 20:59 |
| fungi | pabelanger: there's a root screen session on that server i just joined | 21:00 |
| craige | o/ | 21:00 |
| fungi | Release failed: VOLSER: Problems encountered in doing the dump ! | 21:00 |
| pabelanger | fungi: ya, I haven't checked it yet | 21:00 |
| *** rockyg has quit IRC | 21:01 | |
| fungi | i can start it back up again | 21:01 |
| fungi | it ran for 952m39.949s before erroring | 21:01 |
| *** Sukhdev has joined #openstack-infra | 21:02 | |
| pabelanger | Tue May 3 13:39:28 2016 1 Volser: ReadVnodes: IH_CREATE: File exists - restore aborted | 21:02 |
| pabelanger | I see that in VolserLog on ord | 21:02 |
| *** matrohon has quit IRC | 21:03 | |
| fungi | the last vos release was started at 21:46:48 utc yesterday, so that's probably 952m40s later | 21:05 |
| *** trown is now known as trown|outtypewww | 21:06 | |
| *** doug-fish has joined #openstack-infra | 21:07 | |
| *** Sukhdev has quit IRC | 21:07 | |
| *** doug-fis_ has joined #openstack-infra | 21:08 | |
| *** mylu has joined #openstack-infra | 21:09 | |
| fungi | i see discussions of using salvage in cases like this, but am hesitant and would welcome a jeblair or mordred opinion if one of them is around | 21:09 |
| *** doug-fi__ has joined #openstack-infra | 21:09 | |
| * mordred is reading scrollback | 21:09 | |
| *** Swami has joined #openstack-infra | 21:09 | |
| mordred | fungi: before I try to figure out from context ... | 21:10 |
| *** mylu has quit IRC | 21:10 | |
| mordred | the zuul problem and the afs problem are distinct, yes? | 21:10 |
| fungi | mordred: yep, merely interleaved | 21:10 |
| *** Sukhdev has joined #openstack-infra | 21:10 | |
| *** psilvad has quit IRC | 21:11 | |
| fungi | asselin_ was (is?) having an issue with his zuul server choked on a bunch of abandoned changes. completely unrelated to the afs discussion | 21:11 |
| *** doug-fish has quit IRC | 21:11 | |
| mordred | phew | 21:11 |
| mordred | my brain was not processing scrollback well | 21:12 |
| fungi | the afs question is how to get past vos release aborting with a "file exists" error on the destination server | 21:12 |
| mordred | yah. I think the best plan at this point is to wait on jeblair | 21:12 |
| *** doug-fis_ has quit IRC | 21:13 | |
| *** e0ne has quit IRC | 21:13 | |
| fungi | i'm browsing the salvager manpage but really leery of making the situation worse without knowing what i'm doing | 21:13 |
| openstackgerrit | Jim Rollenhagen proposed openstack-infra/project-config: Add api-ref jobs for ironic https://review.openstack.org/312184 | 21:13 |
| waynr | fungi: sweet! | 21:14 |
| *** maishsk_ has joined #openstack-infra | 21:14 | |
| *** maishsk has quit IRC | 21:15 | |
| *** maishsk_ is now known as maishsk | 21:15 | |
| *** mylu has joined #openstack-infra | 21:15 | |
| *** ldnunes has quit IRC | 21:15 | |
| *** thorst has quit IRC | 21:16 | |
| openstackgerrit | Henrique Truta proposed openstack-infra/project-config: Run identity v3 only job in ironic https://review.openstack.org/304307 | 21:17 |
| *** vgridnev has quit IRC | 21:17 | |
| *** thorst has joined #openstack-infra | 21:18 | |
| fungi | this is most strange. it's been several days since the last error from a job trying to hit git.o.o | 21:19 |
| fungi | i wonder if the network issues in rackspace magically vanished? | 21:20 |
| *** lucasagomes has quit IRC | 21:20 | |
| *** tonytan4ever has quit IRC | 21:21 | |
| *** lucasagomes has joined #openstack-infra | 21:22 | |
| *** thorst has quit IRC | 21:22 | |
| pabelanger | Good news everybody. I was able to build ubuntu-precise with our puppet element. Now for a full build with all the elements nodepool needs. | 21:23 |
| openstackgerrit | Paul Belanger proposed openstack-infra/project-config: Add ubuntu-precise dib to nodepool https://review.openstack.org/312248 | 21:23 |
| pabelanger | current stack | 21:23 |
| openstackgerrit | Paul Belanger proposed openstack-infra/project-config: Add ubuntu-precise dib to nodepool https://review.openstack.org/312248 | 21:24 |
| *** flwang1 has joined #openstack-infra | 21:25 | |
| *** |-paul-| has joined #openstack-infra | 21:25 | |
| *** nadya has quit IRC | 21:25 | |
| *** nadya has joined #openstack-infra | 21:26 | |
| *** lakshmiS has quit IRC | 21:26 | |
| *** asettle has joined #openstack-infra | 21:27 | |
| *** burgerk has quit IRC | 21:30 | |
| *** _ari_ has quit IRC | 21:30 | |
| *** jsavak has joined #openstack-infra | 21:30 | |
| *** julim has quit IRC | 21:30 | |
| *** nadya has quit IRC | 21:30 | |
| mriedem | clarkb: looks like we might have some issues with ES shards stuck initializing? http://logstash.openstack.org/elasticsearch/_cluster/health?pretty=true | 21:31 |
| *** maishsk has quit IRC | 21:31 | |
| *** ccamacho has quit IRC | 21:31 | |
| clarkb | mriedem: ya te cluster deadlocks and is unable to go green, plan is to pgrade which i am told makes it better | 21:31 |
| *** sdake_ is now known as sdake | 21:33 | |
| *** e0ne has joined #openstack-infra | 21:34 | |
| *** pfallenop has joined #openstack-infra | 21:35 | |
| fungi | i'm going to go find some dinner and transition into a (hopefully) quieter evening mode | 21:36 |
| fungi | bbiaw | 21:36 |
| *** salv-orlando has quit IRC | 21:37 | |
| *** e0ne has quit IRC | 21:38 | |
| *** baoli has joined #openstack-infra | 21:39 | |
| *** baoli has quit IRC | 21:39 | |
| *** baoli has joined #openstack-infra | 21:40 | |
| *** derekh has quit IRC | 21:40 | |
| *** jheroux has quit IRC | 21:41 | |
| *** lucasagomes has quit IRC | 21:41 | |
| *** baoli_ has joined #openstack-infra | 21:42 | |
| *** inc0 has quit IRC | 21:42 | |
| openstackgerrit | Spencer Krum proposed openstack-infra/system-config: Add ssl upgrade playbook https://review.openstack.org/312261 | 21:42 |
| *** sridhar_ram1 has quit IRC | 21:42 | |
| *** lucasagomes has joined #openstack-infra | 21:44 | |
| *** baoli has quit IRC | 21:45 | |
| asselin_ | fungi, thanks for your help. Restarting zuul merger didn't work, and at the rate of merges & patch chain it woud've taken 8 hours to finish. Restarting zuul worked. | 21:45 |
| *** Sukhdev has quit IRC | 21:47 | |
| *** ccamacho has joined #openstack-infra | 21:47 | |
| *** ddieterly is now known as ddieterly[away] | 21:50 | |
| tonyb | anteaya: I haven't said that to them explictly but it seems like a pretty reasonable expectation. | 21:50 |
| openstackgerrit | Tim Laszlo proposed openstack-infra/shade: Add support for server groups https://review.openstack.org/312237 | 21:50 |
| tonyb | anteaya: they *are* using utc it's just that they re-evaluate which UTC time they use every 6 months | 21:51 |
| *** salv-orlando has joined #openstack-infra | 21:51 | |
| *** amitgandhinz has quit IRC | 21:52 | |
| *** ddieterly[away] is now known as ddieterly | 21:54 | |
| dhellmann | hey, folks, dims mentioned earlier today that there's an issue with the pypi mirror so we should hold off on releasing. Can someone give me a brief status update? I'd like to go ahead and announce that we won't do releases this week if it looks like we'll need that time to deal with the issue, just so everyone knows what to expect. | 21:54 |
| *** ddieterly is now known as ddieterly[away] | 21:54 | |
| openstackgerrit | Spencer Krum proposed openstack-infra/system-config: Add ssl upgrade playbook https://review.openstack.org/312261 | 21:55 |
| *** asettle has quit IRC | 21:58 | |
| *** asettle has joined #openstack-infra | 21:58 | |
| *** mriedem has quit IRC | 21:59 | |
| *** kengo_sakai has joined #openstack-infra | 22:00 | |
| *** DevBox has joined #openstack-infra | 22:03 | |
| *** asettle has quit IRC | 22:03 | |
| asselin_ | i'm running a bandersnatch mirror and for some reason it says it's up to date, but missing oslo.i18n 3.6.0 package. | 22:04 |
| asselin_ | Is there a known issue with that? | 22:04 |
| *** sambetts|afk has quit IRC | 22:04 | |
| *** mylu has quit IRC | 22:04 | |
| *** doug-fi__ has quit IRC | 22:04 | |
| *** kengo_sakai has quit IRC | 22:05 | |
| *** mylu has joined #openstack-infra | 22:05 | |
| asselin_ | i'm seeing the same behavior on 2 bandersnatch mirrors | 22:05 |
| *** salv-orlando has quit IRC | 22:06 | |
| *** sambetts has joined #openstack-infra | 22:07 | |
| *** mylu has quit IRC | 22:09 | |
| *** nemish has quit IRC | 22:10 | |
| *** sigmavirus24 is now known as sigmavirus24_awa | 22:10 | |
| *** nemish has joined #openstack-infra | 22:10 | |
| *** tlbr has joined #openstack-infra | 22:12 | |
| *** mylu has joined #openstack-infra | 22:12 | |
| *** baoli_ has quit IRC | 22:14 | |
| pabelanger | clarkb: ianw: ubuntu-precise built! https://review.openstack.org/#/c/312248 | 22:14 |
| *** ccamacho has quit IRC | 22:15 | |
| *** salv-orlando has joined #openstack-infra | 22:15 | |
| pabelanger | clarkb: ianw: haven't tested image uploads, but figure we can let nodepool try | 22:15 |
| pabelanger | stepping away for a bit | 22:15 |
| *** ccamacho has joined #openstack-infra | 22:15 | |
| *** ddieterly[away] is now known as ddieterly | 22:17 | |
| *** wajdi has quit IRC | 22:17 | |
| clarkb | dhellmann: last I saw afs failed to replicate again and people were wanting to get jeblairs input | 22:17 |
| clarkb | as an alternative we can switch to the rw volume | 22:18 |
| *** jsavak has quit IRC | 22:19 | |
| *** Guest70523 has quit IRC | 22:19 | |
| *** jsavak has joined #openstack-infra | 22:20 | |
| *** cody-somerville has joined #openstack-infra | 22:20 | |
| *** xyang1 has quit IRC | 22:23 | |
| *** nadya has joined #openstack-infra | 22:27 | |
| *** matt-borland has quit IRC | 22:27 | |
| *** salv-orlando has quit IRC | 22:28 | |
| *** salv-orlando has joined #openstack-infra | 22:28 | |
| *** dimtruck is now known as zz_dimtruck | 22:29 | |
| dhellmann | clarkb : ok, I'm comfortable declaring a release hiatus for the week to give you all time to see what's what | 22:30 |
| *** nadya has quit IRC | 22:31 | |
| clarkb | dhellmann: works for me | 22:33 |
| *** weshay has quit IRC | 22:34 | |
| openstackgerrit | Kien Ha proposed openstack-infra/jenkins-job-builder: Add deadline option for build-timeout plugin https://review.openstack.org/312271 | 22:35 |
| dhellmann | clarkb : done. I'll check back on monday if I don't hear from someone before then. | 22:37 |
| *** mylu has quit IRC | 22:38 | |
| *** baoli has joined #openstack-infra | 22:39 | |
| openstackgerrit | Kien Ha proposed openstack-infra/jenkins-job-builder: Add deadline option for build-timeout plugin https://review.openstack.org/312271 | 22:40 |
| openstackgerrit | David Lyle proposed openstack-infra/project-config: Adding tempest-horizon repo and job https://review.openstack.org/312272 | 22:41 |
| *** salv-orlando has quit IRC | 22:42 | |
| *** ccamacho has quit IRC | 22:43 | |
| *** krotscheck is now known as krotscheck_dcm | 22:44 | |
| *** mylu has joined #openstack-infra | 22:46 | |
| *** mylu has quit IRC | 22:47 | |
| *** baoli has quit IRC | 22:48 | |
| *** baoli has joined #openstack-infra | 22:49 | |
| *** _amrith_ is now known as amrith | 22:49 | |
| *** sdague has quit IRC | 22:50 | |
| *** ddieterly is now known as ddieterly[away] | 22:51 | |
| *** ddieterly[away] is now known as ddieterly | 22:51 | |
| *** |-paul-| has quit IRC | 22:53 | |
| anteaya | tonyb: okay well it might be time to make it explicit | 22:53 |
| anteaya | tonyb: as far as I know they are the only group switching meetings back and forth | 22:53 |
| *** baoli has quit IRC | 22:54 | |
| openstackgerrit | Stephen Lowrie proposed openstack/os-testr: Add subunit-describe-calls https://review.openstack.org/312275 | 22:54 |
| *** dmk0202 has quit IRC | 22:54 | |
| anteaya | tonyb: might be nice to give them some heads up that they are stuck with one slot (which ever one they are in) if someone claims the other | 22:54 |
| *** sdake has quit IRC | 22:55 | |
| *** sdake has joined #openstack-infra | 22:55 | |
| *** akshai has quit IRC | 22:57 | |
| *** baoli has joined #openstack-infra | 22:58 | |
| *** akshai has joined #openstack-infra | 22:58 | |
| *** ddieterly has quit IRC | 22:59 | |
| *** akshai has quit IRC | 23:00 | |
| *** bpokorny_ has quit IRC | 23:02 | |
| *** dynarro has quit IRC | 23:02 | |
| *** bpokorny has joined #openstack-infra | 23:02 | |
| *** rbrndt has quit IRC | 23:03 | |
| *** vhosakot has joined #openstack-infra | 23:04 | |
| sc` | in addition to 29418 for the gerrit event stream, does zuul also need to talk to gerrit over 443? | 23:05 |
| *** baoli has quit IRC | 23:06 | |
| *** baoli has joined #openstack-infra | 23:06 | |
| mgagne | sc`: yes to query git repository and see if change has merged IIRC | 23:07 |
| sc` | i thought as much. trying to debug a fortified local install | 23:08 |
| mgagne | URL is configured with [gerrit]/baseurl | 23:08 |
| mgagne | I once had a bad config and was wondering why Zuul wouldn't mark changes as merged. It was waiting for like 5 minutes before giving up | 23:09 |
| sc` | that's where i am, i think | 23:10 |
| *** gordc has quit IRC | 23:11 | |
| *** jsavak has quit IRC | 23:12 | |
| *** baoli has quit IRC | 23:13 | |
| openstackgerrit | Derek Higgins proposed openstack-infra/tripleo-ci: [NO MERGY] Test a fake periodic job https://review.openstack.org/229789 | 23:16 |
| openstackgerrit | Derek Higgins proposed openstack-infra/tripleo-ci: Don't remove the instack.qcow2 image https://review.openstack.org/312281 | 23:16 |
| *** markvoelker_ has quit IRC | 23:16 | |
| *** vhosakot has quit IRC | 23:18 | |
| *** vhosakot has joined #openstack-infra | 23:18 | |
| *** rhallisey has quit IRC | 23:21 | |
| *** MarkAtwood has quit IRC | 23:22 | |
| *** flepied has joined #openstack-infra | 23:24 | |
| *** mriedem has joined #openstack-infra | 23:25 | |
| *** vhosakot has quit IRC | 23:25 | |
| *** HeOS has quit IRC | 23:26 | |
| *** nadya has joined #openstack-infra | 23:27 | |
| *** vhosakot has joined #openstack-infra | 23:28 | |
| *** nelsnels_ has joined #openstack-infra | 23:30 | |
| *** nelsnelson has quit IRC | 23:31 | |
| *** nadya has quit IRC | 23:32 | |
| *** keedya has quit IRC | 23:36 | |
| *** keedya has joined #openstack-infra | 23:37 | |
| *** rfolco has quit IRC | 23:38 | |
| tonyb | anteaya: There is more than one group doing the switch every 6 months thing. | 23:39 |
| *** Swami has quit IRC | 23:43 | |
| *** Guest21848 has quit IRC | 23:44 | |
| *** cody-somerville has quit IRC | 23:45 | |
| *** dingyichen has joined #openstack-infra | 23:45 | |
| anteaya | tonyb: oh really | 23:45 |
| tonyb | anteaya: I agree it goes counter to the norm but I don't think it's a problem that needs to be controlled. It's really no different (IMO) to groups that need to meet on a monthly schedule rather than weekly | 23:46 |
| anteaya | okay I defer to you on this | 23:47 |
| *** yamamoto has joined #openstack-infra | 23:47 | |
| anteaya | but as a data point I don't have any sympathy for a group that does this if they get upset that a slot gets taken by another group whilst they are switching back and forth | 23:48 |
| anteaya | for me it is more about setting expectations | 23:48 |
| anteaya | you can switch but you accept that someone may take your now empty slot | 23:48 |
| anteaya | if they are aware, then fine | 23:48 |
| tonyb | anteaya: I agree. Any empty slot is fair game | 23:49 |
| *** asettle has joined #openstack-infra | 23:49 | |
| anteaya | great, thanks | 23:51 |
| anteaya | I appreciate you helping me understand the situation | 23:51 |
| *** RickA-HP has quit IRC | 23:53 | |
| tonyb | anteaya: Thanks for keeping an eye out for potential problems. | 23:57 |
| anteaya | :) | 23:57 |
| tonyb | anteaya: that's not something I've made time to do for a while | 23:57 |
| anteaya | it is hard to make time for it, I agree | 23:57 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!