| *** jamesmcarthur has joined #openstack-infra | 00:00 | |
| jeblair | pabelanger: yes, though that's for the 'jenkins' user. i guess they are not the same. :) | 00:00 |
|---|---|---|
| pabelanger | jeblair: we should be able to land our zuul-worker element after diskimage-builder has been related | 00:01 |
| pabelanger | released* | 00:01 |
| *** mixos has joined #openstack-infra | 00:03 | |
| jeblair | nibalizer: hiera group overlap is starting to be more complex; i'm about to add the jenkins ssh private key to a third hiera group (which means we have 3 copies of it) | 00:03 |
| openstackgerrit | Khai Do proposed openstack-infra/system-config: Change commit message length validation to 72 chars https://review.openstack.org/316197 | 00:03 |
| jeblair | nibalizer: well, correction, it will be in 2 groups and 1 fqdn (so still 3 places) | 00:03 |
| *** tosky has quit IRC | 00:05 | |
| openstackgerrit | Merged openstack-infra/system-config: Revert "Set region_name for tripleo-test-cloud-rh1" https://review.openstack.org/317129 | 00:05 |
| *** r-mibu has joined #openstack-infra | 00:05 | |
| openstackgerrit | James E. Blair proposed openstack-infra/system-config: Use the jenkins ssh private key for the zuul launcher https://review.openstack.org/317146 | 00:05 |
| jeblair | that is in hiera now ^ | 00:05 |
| pabelanger | jeblair: I believe you could have also used: $openstack_project::jenkins_ssh_key | 00:07 |
| *** Qiming has joined #openstack-infra | 00:07 | |
| pabelanger | jeblair: err, nevermind | 00:07 |
| jeblair | pabelanger: that's the public key i believe | 00:07 |
| pabelanger | jeblair: yes, I fat fingered that | 00:07 |
| *** vkramskikh_ has quit IRC | 00:07 | |
| *** jamesmcarthur has quit IRC | 00:08 | |
| *** jamesmcarthur has joined #openstack-infra | 00:08 | |
| jeblair | once more | 00:08 |
| pabelanger | jeblair: just confiming, did you bring jenkins07.o.o offline? | 00:09 |
| jeblair | pabelanger: not i | 00:09 |
| pabelanger | okay, must be down then | 00:09 |
| *** ddieterly has joined #openstack-infra | 00:11 | |
| *** ddieterly is now known as ddieterly[away] | 00:11 | |
| openstackgerrit | Khai Do proposed openstack-infra/puppet-gerrit: Allow puppet to configure commitmessage.maxLineLength https://review.openstack.org/316175 | 00:11 |
| *** johnny__ has quit IRC | 00:14 | |
| *** jamesmcarthur has quit IRC | 00:14 | |
| *** jamesmcarthur has joined #openstack-infra | 00:15 | |
| *** IlyaG has joined #openstack-infra | 00:15 | |
| jeblair | TASK [zuul_runner] ************************************************************* | 00:16 |
| jeblair | fatal: [node]: FAILED! => {"ansible_job_id": "18234392.1443", "changed": false, "failed": true, "finished": 1, "msg": "Exit code 1", "rc": 1} | 00:16 |
| jeblair | that's not the most helpful thing. | 00:16 |
| Shrews | jeblair: we should add -vvv to ansible-playbook | 00:17 |
| pabelanger | ++ | 00:17 |
| jeblair | good idea | 00:17 |
| jeblair | i think we're going to need to add something to nodepool to tell it to only allocate one node at a time to a target | 00:17 |
| jeblair | otherwise, iterating on this will be very disruptive | 00:18 |
| pabelanger | should telnet be working? | 00:19 |
| *** ddieterly[away] is now known as ddieterly | 00:19 | |
| jeblair | pabelanger: it fails quickly | 00:19 |
| pabelanger | wonder if it is a path issue on the far side | 00:20 |
| pabelanger | or something like that | 00:20 |
| pabelanger | there were some successful jobs: http://paste.openstack.org/raw/497283/ | 00:22 |
| pabelanger | so \o/ to that | 00:22 |
| *** xarses has quit IRC | 00:22 | |
| *** doug-fish has quit IRC | 00:23 | |
| *** IlyaG has quit IRC | 00:23 | |
| *** jamesmcarthur has quit IRC | 00:23 | |
| *** kzaitsev_mb has quit IRC | 00:25 | |
| *** sdake_ has joined #openstack-infra | 00:27 | |
| *** yuanying has joined #openstack-infra | 00:27 | |
| *** mtanino_ has joined #openstack-infra | 00:27 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul: Set default_flow_style=False for readability https://review.openstack.org/317149 | 00:28 |
| pabelanger | jeblair: Shrews: ^ cosmetic change for ansible playbooks | 00:29 |
| *** mtanino has quit IRC | 00:29 | |
| *** xarses has joined #openstack-infra | 00:29 | |
| *** jamesmcarthur has joined #openstack-infra | 00:29 | |
| *** yuanying has quit IRC | 00:30 | |
| *** sdake has quit IRC | 00:30 | |
| *** Qiming has quit IRC | 00:31 | |
| *** rhochmuth has joined #openstack-infra | 00:33 | |
| *** amitgandhinz has joined #openstack-infra | 00:34 | |
| *** ewilson has joined #openstack-infra | 00:35 | |
| *** jamielennox|away is now known as jamielennox | 00:37 | |
| *** rhochmuth has quit IRC | 00:38 | |
| *** baoli has quit IRC | 00:39 | |
| *** sarob has joined #openstack-infra | 00:39 | |
| *** signed8bit_Zzz is now known as signed8bit | 00:40 | |
| *** yuanying has joined #openstack-infra | 00:40 | |
| *** rhallisey has joined #openstack-infra | 00:42 | |
| *** sflanigan has quit IRC | 00:43 | |
| *** _sarob has joined #openstack-infra | 00:43 | |
| *** rhochmuth has joined #openstack-infra | 00:43 | |
| *** jamesmcarthur has quit IRC | 00:44 | |
| *** sflanigan has joined #openstack-infra | 00:44 | |
| *** sflanigan has joined #openstack-infra | 00:44 | |
| *** baoli has joined #openstack-infra | 00:45 | |
| openstackgerrit | Merged openstack-infra/project-config: Revert "Setup region-name for tripleo-test-cloud-rh1" https://review.openstack.org/317128 | 00:47 |
| *** mriedem has joined #openstack-infra | 00:47 | |
| *** sarob has quit IRC | 00:47 | |
| *** ddieterly is now known as ddieterly[away] | 00:50 | |
| *** kzaitsev_mb has joined #openstack-infra | 00:50 | |
| *** _sarob has quit IRC | 00:51 | |
| *** dimtruck is now known as zz_dimtruck | 00:52 | |
| *** gyee has quit IRC | 00:52 | |
| *** jamesmcarthur has joined #openstack-infra | 00:53 | |
| *** ddieterly[away] is now known as ddieterly | 00:53 | |
| *** IlyaG has joined #openstack-infra | 00:54 | |
| *** Liuqing has joined #openstack-infra | 00:56 | |
| *** ewilson has quit IRC | 00:56 | |
| *** ewilson has joined #openstack-infra | 00:57 | |
| *** rhochmuth has quit IRC | 00:58 | |
| *** jamesmcarthur has quit IRC | 00:59 | |
| *** shashank_hegde has quit IRC | 00:59 | |
| *** ewilson has quit IRC | 01:02 | |
| *** Jeffrey4l has joined #openstack-infra | 01:02 | |
| *** bpokorny_ has joined #openstack-infra | 01:03 | |
| openstackgerrit | Merged openstack-infra/irc-meetings: Adding additional chairs to IRC meeting https://review.openstack.org/317120 | 01:04 |
| openstackgerrit | Paul Belanger proposed openstack-infra/system-config: Add nodepool_ssh_public_key to nodepool.o.o https://review.openstack.org/316191 | 01:05 |
| openstackgerrit | Paul Belanger proposed openstack-infra/puppet-openstackci: Add nodepool_ssh_public_key https://review.openstack.org/316188 | 01:05 |
| *** Liuqing has quit IRC | 01:06 | |
| *** bpokorny has quit IRC | 01:07 | |
| *** Sukhdev has quit IRC | 01:07 | |
| pabelanger | okay, zuul-worker DIB element works, tested locally. | 01:07 |
| pabelanger | calling it for the day | 01:07 |
| *** ewilson has joined #openstack-infra | 01:08 | |
| *** jamesmcarthur has joined #openstack-infra | 01:08 | |
| *** bpokorny_ has quit IRC | 01:08 | |
| *** jamesmcarthur has quit IRC | 01:09 | |
| openstackgerrit | Merged openstack/diskimage-builder: Revert "Revert "Properly fail/trap in eval_run_d"" and fix PIPESTATUS https://review.openstack.org/317137 | 01:09 |
| *** jamesmcarthur has joined #openstack-infra | 01:12 | |
| *** Liuqing has joined #openstack-infra | 01:14 | |
| *** rhochmuth has joined #openstack-infra | 01:14 | |
| *** rhochmuth has quit IRC | 01:14 | |
| *** jamesmcarthur has quit IRC | 01:15 | |
| ianw | greghaynes / bkero : ok, 1.16.1 pushed ^ | 01:15 |
| *** kzaitsev_mb has quit IRC | 01:16 | |
| *** baoli has quit IRC | 01:17 | |
| *** ewilson has quit IRC | 01:17 | |
| *** zhurong has joined #openstack-infra | 01:17 | |
| *** cody-somerville has joined #openstack-infra | 01:18 | |
| *** ewilson has joined #openstack-infra | 01:18 | |
| *** kien-ha has joined #openstack-infra | 01:18 | |
| openstackgerrit | Merged openstack-infra/system-config: Use the jenkins ssh private key for the zuul launcher https://review.openstack.org/317146 | 01:21 |
| *** Qiming has joined #openstack-infra | 01:21 | |
| jhesketh | pabelanger: I'm a bit confused by https://review.openstack.org/#/c/316187/1 if you have a moment to help explain it | 01:24 |
| *** jerryz has quit IRC | 01:25 | |
| *** Apoorva_ has joined #openstack-infra | 01:27 | |
| *** rhochmuth has joined #openstack-infra | 01:27 | |
| *** krtaylor has joined #openstack-infra | 01:28 | |
| *** baoli has joined #openstack-infra | 01:28 | |
| *** ddieterly has quit IRC | 01:28 | |
| *** itisha has quit IRC | 01:29 | |
| *** krtaylor has quit IRC | 01:30 | |
| *** yuanying has quit IRC | 01:30 | |
| *** Apoorva has quit IRC | 01:31 | |
| *** Apoorva_ has quit IRC | 01:32 | |
| *** baoli has quit IRC | 01:36 | |
| *** thorst has quit IRC | 01:37 | |
| *** thorst has joined #openstack-infra | 01:38 | |
| *** ccamacho has quit IRC | 01:39 | |
| *** rhochmuth has quit IRC | 01:39 | |
| *** ewilson has quit IRC | 01:40 | |
| *** rhochmuth has joined #openstack-infra | 01:41 | |
| *** rhallisey has quit IRC | 01:41 | |
| *** ccamacho has joined #openstack-infra | 01:42 | |
| *** Sukhdev has joined #openstack-infra | 01:42 | |
| *** rhochmuth has quit IRC | 01:44 | |
| *** Sukhdev has quit IRC | 01:44 | |
| *** jpr has joined #openstack-infra | 01:48 | |
| *** rfolco has quit IRC | 01:52 | |
| *** zz_dimtruck is now known as dimtruck | 01:53 | |
| *** rhochmuth has joined #openstack-infra | 01:58 | |
| *** tphummel has quit IRC | 01:59 | |
| *** jamielennox is now known as jamielennox|away | 01:59 | |
| *** mtanino has joined #openstack-infra | 02:00 | |
| *** Julien-zte has joined #openstack-infra | 02:01 | |
| *** mtanino_ has quit IRC | 02:02 | |
| *** baoli has joined #openstack-infra | 02:02 | |
| *** mtanino has quit IRC | 02:06 | |
| *** thorst has quit IRC | 02:06 | |
| *** rhochmuth has quit IRC | 02:07 | |
| *** thorst has joined #openstack-infra | 02:07 | |
| *** sridhar_ram has quit IRC | 02:07 | |
| *** yamahata has quit IRC | 02:07 | |
| *** baoli has quit IRC | 02:08 | |
| *** csaba has quit IRC | 02:10 | |
| *** gildub has quit IRC | 02:13 | |
| *** kzaitsev_mb has joined #openstack-infra | 02:13 | |
| *** jpr has quit IRC | 02:13 | |
| *** gothicmindfood has quit IRC | 02:14 | |
| *** thorst has quit IRC | 02:15 | |
| *** kzaitsev_mb has quit IRC | 02:18 | |
| *** gothicmindfood has joined #openstack-infra | 02:21 | |
| *** yuanying has joined #openstack-infra | 02:24 | |
| *** csaba has joined #openstack-infra | 02:24 | |
| *** mriedem has quit IRC | 02:28 | |
| *** Julien-zte has quit IRC | 02:29 | |
| *** bhunter71 has quit IRC | 02:29 | |
| *** lakshmiS has quit IRC | 02:31 | |
| *** Wei_Liu has joined #openstack-infra | 02:36 | |
| *** yamahata has joined #openstack-infra | 02:37 | |
| *** yamahata has quit IRC | 02:38 | |
| *** yamahata has joined #openstack-infra | 02:39 | |
| Wei_Liu | hi, I am working on a local CI system, I could not find the "Label Verified -1/+1" on my local gerrit server, the version of gerrit is 2.10-rc0, How can I config this verified -1/+1? | 02:40 |
| *** yamamoto has quit IRC | 02:45 | |
| *** fawadkhaliq has joined #openstack-infra | 02:46 | |
| *** amitgandhinz has quit IRC | 02:51 | |
| *** rhochmuth has joined #openstack-infra | 02:52 | |
| *** yamamoto has joined #openstack-infra | 02:52 | |
| *** kien-ha has quit IRC | 02:53 | |
| *** yuanying has quit IRC | 02:54 | |
| *** rhochmuth has quit IRC | 02:57 | |
| *** woodster_ has quit IRC | 02:58 | |
| *** duobei has joined #openstack-infra | 02:59 | |
| *** yamahata has quit IRC | 03:00 | |
| *** shashank_hegde has joined #openstack-infra | 03:05 | |
| *** fawadkhaliq has quit IRC | 03:09 | |
| *** thorst has joined #openstack-infra | 03:13 | |
| *** kzaitsev_mb has joined #openstack-infra | 03:14 | |
| *** signed8bit has quit IRC | 03:17 | |
| *** psachin has joined #openstack-infra | 03:17 | |
| *** kzaitsev_mb has quit IRC | 03:19 | |
| *** thorst has quit IRC | 03:20 | |
| *** armax has quit IRC | 03:20 | |
| *** links has joined #openstack-infra | 03:31 | |
| *** rhochmuth has joined #openstack-infra | 03:33 | |
| *** shashank_hegde has quit IRC | 03:34 | |
| *** sdake has joined #openstack-infra | 03:36 | |
| openstackgerrit | fumihiko kakuma proposed openstack-infra/devstack-gate: DO NOT REVIEW: This is for verifying CI with local.conf https://review.openstack.org/243545 | 03:37 |
| *** yamahata has joined #openstack-infra | 03:38 | |
| *** dimtruck is now known as zz_dimtruck | 03:38 | |
| *** sdake_ has quit IRC | 03:38 | |
| *** rhochmuth has quit IRC | 03:40 | |
| zaro | Wei_Liu: look here, https://gerrit-review.googlesource.com/Documentation/config-labels.html#label_Verified | 03:42 |
| zaro | Wei_Liu: or you can have gerrit create for you when you create the gerrit site with 'java -jar gerrit.war init -d my_site' | 03:43 |
| *** rhochmuth has joined #openstack-infra | 03:47 | |
| *** yuanying has joined #openstack-infra | 03:48 | |
| *** esikachev has joined #openstack-infra | 03:50 | |
| Wei_Liu | zaro: get it, thanks a lot | 03:50 |
| *** duobei has quit IRC | 03:52 | |
| *** esikachev has quit IRC | 03:54 | |
| *** jamielennox|away is now known as jamielennox | 03:55 | |
| *** yamahata has quit IRC | 03:55 | |
| *** fawadkhaliq has joined #openstack-infra | 03:56 | |
| *** yamahata has joined #openstack-infra | 03:56 | |
| *** yamamoto has quit IRC | 03:58 | |
| *** psachin has quit IRC | 04:02 | |
| *** camunoz has quit IRC | 04:02 | |
| *** winggundamth has quit IRC | 04:04 | |
| *** duobei has joined #openstack-infra | 04:08 | |
| *** abregman has quit IRC | 04:09 | |
| openstackgerrit | Khai Do proposed openstack-infra/project-config: add a build job for Gerrit importer plugin https://review.openstack.org/317223 | 04:10 |
| *** bpokorny has joined #openstack-infra | 04:11 | |
| *** lakshmiS has joined #openstack-infra | 04:12 | |
| *** winggundamth has joined #openstack-infra | 04:13 | |
| openstackgerrit | Khai Do proposed openstack-infra/project-config: add build job for Gerrit delete-project plugin https://review.openstack.org/317226 | 04:14 |
| *** kzaitsev_mb has joined #openstack-infra | 04:15 | |
| *** salv-orlando has joined #openstack-infra | 04:15 | |
| *** psachin has joined #openstack-infra | 04:17 | |
| *** thorst has joined #openstack-infra | 04:18 | |
| openstackgerrit | Khai Do proposed openstack-infra/project-config: remove build job for javamelody plugin for Gerrit 2.8 https://review.openstack.org/317230 | 04:18 |
| *** salv-orl_ has quit IRC | 04:18 | |
| *** rhochmuth has quit IRC | 04:18 | |
| *** sdake_ has joined #openstack-infra | 04:19 | |
| *** bpokorny has quit IRC | 04:20 | |
| *** sdake has quit IRC | 04:20 | |
| *** kzaitsev_mb has quit IRC | 04:20 | |
| *** duobei has quit IRC | 04:22 | |
| *** yuanying has quit IRC | 04:22 | |
| *** yuanying has joined #openstack-infra | 04:23 | |
| *** thorst has quit IRC | 04:25 | |
| *** gildub has joined #openstack-infra | 04:26 | |
| *** yuanying has quit IRC | 04:27 | |
| *** harlowja_at_home has joined #openstack-infra | 04:29 | |
| openstackgerrit | Dong Ma proposed openstack-infra/subunit2sql: Fix db API get_ids_for_all_tests https://review.openstack.org/310323 | 04:39 |
| *** yamamoto has joined #openstack-infra | 04:39 | |
| *** tojuvone has quit IRC | 04:40 | |
| openstackgerrit | Ryo Tagami proposed openstack-infra/jenkins-job-builder: Add support for Jenkins OpenStack Cloud Plugin https://review.openstack.org/306948 | 04:42 |
| *** lakshmiS has quit IRC | 04:45 | |
| *** yuanying has joined #openstack-infra | 04:46 | |
| *** IlyaG_ has joined #openstack-infra | 04:50 | |
| *** tojuvone has joined #openstack-infra | 04:52 | |
| *** sree has joined #openstack-infra | 04:53 | |
| *** sree has quit IRC | 04:53 | |
| *** sree has joined #openstack-infra | 04:53 | |
| *** IlyaG has quit IRC | 04:54 | |
| *** shashank_hegde has joined #openstack-infra | 04:56 | |
| *** flepied has quit IRC | 04:56 | |
| *** sdake_ has quit IRC | 04:56 | |
| *** javeriak has joined #openstack-infra | 04:59 | |
| *** asselin has joined #openstack-infra | 05:03 | |
| *** jcoufal has joined #openstack-infra | 05:04 | |
| *** asselin__ has quit IRC | 05:06 | |
| *** maishsk_ has quit IRC | 05:07 | |
| *** yuanying has quit IRC | 05:08 | |
| *** e0ne has joined #openstack-infra | 05:09 | |
| *** e0ne has quit IRC | 05:11 | |
| *** Sukhdev has joined #openstack-infra | 05:17 | |
| *** kzaitsev_mb has joined #openstack-infra | 05:17 | |
| *** nelsnels_ has quit IRC | 05:18 | |
| *** savihou has joined #openstack-infra | 05:19 | |
| *** harlowja_at_home has quit IRC | 05:20 | |
| *** kzaitsev_mb has quit IRC | 05:22 | |
| *** nelsnelson has joined #openstack-infra | 05:22 | |
| *** thorst has joined #openstack-infra | 05:23 | |
| *** thorst has quit IRC | 05:30 | |
| *** shashank_hegde has quit IRC | 05:32 | |
| *** javeriak has quit IRC | 05:34 | |
| *** hparekh has quit IRC | 05:39 | |
| *** javeriak has joined #openstack-infra | 05:39 | |
| *** hparekh_ has joined #openstack-infra | 05:39 | |
| *** hparekh_ has quit IRC | 05:39 | |
| *** hparekh has joined #openstack-infra | 05:39 | |
| *** jaosorior has joined #openstack-infra | 05:43 | |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder: [WIP] Add PS4 to show file/function/line https://review.openstack.org/317260 | 05:44 |
| *** duobei has joined #openstack-infra | 05:49 | |
| *** shashank_hegde has joined #openstack-infra | 05:49 | |
| *** ramishra has quit IRC | 05:49 | |
| *** ramishra has joined #openstack-infra | 05:50 | |
| *** esikachev has joined #openstack-infra | 05:50 | |
| *** javeriak has quit IRC | 05:52 | |
| *** rlandy has quit IRC | 05:53 | |
| *** nadya has joined #openstack-infra | 05:53 | |
| *** esikachev has quit IRC | 05:55 | |
| *** savihou has quit IRC | 05:58 | |
| *** javeriak has joined #openstack-infra | 05:58 | |
| *** rcernin has joined #openstack-infra | 06:03 | |
| *** Jeffrey4l has quit IRC | 06:04 | |
| *** abregman has joined #openstack-infra | 06:05 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack-infra/project-config: Normalize projects.yaml https://review.openstack.org/316584 | 06:07 |
| *** nijaba has quit IRC | 06:07 | |
| openstackgerrit | Murad Awawdeh proposed openstack-infra/project-config: Basic Jenkins jobs https://review.openstack.org/316443 | 06:09 |
| *** abregman has quit IRC | 06:10 | |
| *** savihou has joined #openstack-infra | 06:11 | |
| *** abregman has joined #openstack-infra | 06:12 | |
| openstackgerrit | Numan Siddique proposed openstack-infra/project-config: Enable functional test job in openstack ci for networking-ovn https://review.openstack.org/316983 | 06:13 |
| *** rcernin has quit IRC | 06:18 | |
| *** savihou has quit IRC | 06:18 | |
| *** rcernin has joined #openstack-infra | 06:21 | |
| *** savihou has joined #openstack-infra | 06:22 | |
| *** shashank_hegde has quit IRC | 06:23 | |
| *** camunoz has joined #openstack-infra | 06:26 | |
| *** timrc has quit IRC | 06:26 | |
| *** thorst has joined #openstack-infra | 06:28 | |
| *** timrc has joined #openstack-infra | 06:29 | |
| *** Sukhdev has quit IRC | 06:29 | |
| *** nadya has quit IRC | 06:31 | |
| *** Liuqing has quit IRC | 06:33 | |
| *** sree has quit IRC | 06:33 | |
| *** changzhi has joined #openstack-infra | 06:33 | |
| *** thorst has quit IRC | 06:35 | |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder: [WIP] Add PS4 to show file/function/line https://review.openstack.org/317260 | 06:39 |
| *** andreas_s has joined #openstack-infra | 06:40 | |
| openstackgerrit | Dong Ma proposed openstack-infra/subunit2sql: Fix db API get_ids_for_all_tests https://review.openstack.org/310323 | 06:40 |
| *** jamielennox is now known as jamielennox|away | 06:41 | |
| *** javeriak has quit IRC | 06:44 | |
| *** akaszuba has joined #openstack-infra | 06:44 | |
| *** jtomasek_ has quit IRC | 06:50 | |
| *** jyuso1 has joined #openstack-infra | 06:51 | |
| openstackgerrit | Merged openstack-infra/project-config: fuel-devops: Add pylint&coverage jobs https://review.openstack.org/315948 | 06:51 |
| *** flepied has joined #openstack-infra | 06:51 | |
| *** flepied has quit IRC | 06:56 | |
| *** jaosorior has quit IRC | 06:56 | |
| *** jaosorior has joined #openstack-infra | 06:57 | |
| *** duobei has quit IRC | 06:57 | |
| *** rhochmuth has joined #openstack-infra | 06:58 | |
| *** mixos has quit IRC | 06:59 | |
| *** rhochmuth has quit IRC | 07:02 | |
| *** duobei has joined #openstack-infra | 07:05 | |
| *** jtomasek_ has joined #openstack-infra | 07:06 | |
| *** javeriak has joined #openstack-infra | 07:08 | |
| *** zeih has joined #openstack-infra | 07:12 | |
| *** jtomasek_ has quit IRC | 07:12 | |
| *** Liuqing has joined #openstack-infra | 07:12 | |
| *** zeih has quit IRC | 07:17 | |
| *** arxcruz has joined #openstack-infra | 07:18 | |
| *** kzaitsev_mb has joined #openstack-infra | 07:18 | |
| openstackgerrit | YAMAMOTO Takashi proposed openstack-infra/irc-meetings: Make networking-midonet meeting every two weeks https://review.openstack.org/317282 | 07:20 |
| *** shashank_hegde has joined #openstack-infra | 07:22 | |
| *** vincentll has joined #openstack-infra | 07:22 | |
| *** Bhargava has joined #openstack-infra | 07:22 | |
| *** fawadkhaliq has quit IRC | 07:22 | |
| *** fawadkhaliq has joined #openstack-infra | 07:23 | |
| *** Liuqing has quit IRC | 07:23 | |
| *** kzaitsev_mb has quit IRC | 07:24 | |
| *** duobei has quit IRC | 07:26 | |
| *** Hal has joined #openstack-infra | 07:27 | |
| *** Hal is now known as Guest60971 | 07:28 | |
| *** |-paul-| has joined #openstack-infra | 07:30 | |
| *** mikelk has joined #openstack-infra | 07:30 | |
| *** ifarkas has joined #openstack-infra | 07:32 | |
| *** esikachev has joined #openstack-infra | 07:32 | |
| *** matrohon has joined #openstack-infra | 07:33 | |
| *** thorst has joined #openstack-infra | 07:33 | |
| *** jlanoux has joined #openstack-infra | 07:34 | |
| *** zeih has joined #openstack-infra | 07:39 | |
| *** thorst has quit IRC | 07:40 | |
| *** zeih has quit IRC | 07:44 | |
| *** nijaba has joined #openstack-infra | 07:46 | |
| *** savihou has quit IRC | 07:48 | |
| *** savihou has joined #openstack-infra | 07:48 | |
| *** Bhargava has left #openstack-infra | 07:50 | |
| *** nmagnezi has joined #openstack-infra | 07:50 | |
| *** duobei has joined #openstack-infra | 07:58 | |
| *** zzzeek has quit IRC | 08:00 | |
| *** zzzeek has joined #openstack-infra | 08:00 | |
| *** rossella_s has joined #openstack-infra | 08:00 | |
| *** shardy has joined #openstack-infra | 08:03 | |
| *** jtomasek has joined #openstack-infra | 08:04 | |
| *** pilgrimstack has joined #openstack-infra | 08:04 | |
| *** savihou has quit IRC | 08:10 | |
| *** jang has joined #openstack-infra | 08:10 | |
| *** savihou has joined #openstack-infra | 08:10 | |
| *** yaume has joined #openstack-infra | 08:11 | |
| yolanda | good morning | 08:12 |
| *** dmk0202 has joined #openstack-infra | 08:12 | |
| *** Jeffrey4l has joined #openstack-infra | 08:13 | |
| *** _degorenko|afk is now known as degorenko | 08:18 | |
| *** acabot has quit IRC | 08:18 | |
| *** jistr has joined #openstack-infra | 08:19 | |
| *** kzaitsev_mb has joined #openstack-infra | 08:20 | |
| openstackgerrit | Merged openstack-infra/project-config: generate_puppetfile: add missing $DIR https://review.openstack.org/316598 | 08:21 |
| *** acabot has joined #openstack-infra | 08:22 | |
| openstackgerrit | Merged openstack-infra/project-config: Don't run dsvm on ironic api-ref changes https://review.openstack.org/316784 | 08:22 |
| *** shashank_hegde has quit IRC | 08:23 | |
| *** hashar has joined #openstack-infra | 08:23 | |
| openstackgerrit | yolanda.robla proposed openstack-infra/system-config: Add infracloud east to puppetmaster clouds https://review.openstack.org/282920 | 08:23 |
| *** hashar has quit IRC | 08:23 | |
| *** hashar has joined #openstack-infra | 08:23 | |
| *** asettle has joined #openstack-infra | 08:24 | |
| *** kzaitsev_mb has quit IRC | 08:25 | |
| openstackgerrit | yolanda.robla proposed openstack-infra/shade: Add bay pod integration for shade+magnum https://review.openstack.org/316650 | 08:29 |
| *** Guest60971 has quit IRC | 08:29 | |
| *** e0ne has joined #openstack-infra | 08:30 | |
| *** chem has joined #openstack-infra | 08:32 | |
| *** docaedo2 has quit IRC | 08:36 | |
| *** kzaitsev_mb has joined #openstack-infra | 08:37 | |
| *** thorst has joined #openstack-infra | 08:38 | |
| *** derekh has joined #openstack-infra | 08:39 | |
| *** fawadkhaliq has quit IRC | 08:41 | |
| *** fawadkhaliq has joined #openstack-infra | 08:42 | |
| *** kzaitsev_mb has quit IRC | 08:42 | |
| *** jcoufal has quit IRC | 08:44 | |
| *** Hal has joined #openstack-infra | 08:45 | |
| *** thorst has quit IRC | 08:45 | |
| *** Hal is now known as Guest36459 | 08:45 | |
| *** kzaitsev_mb has joined #openstack-infra | 08:46 | |
| *** savihou has quit IRC | 08:47 | |
| *** savihou has joined #openstack-infra | 08:48 | |
| *** eyalb has joined #openstack-infra | 08:49 | |
| *** eyalb has quit IRC | 08:50 | |
| *** Jeffrey4l has quit IRC | 08:51 | |
| *** changzhi has quit IRC | 08:51 | |
| *** changzhi has joined #openstack-infra | 08:51 | |
| *** salv-orlando has quit IRC | 08:54 | |
| *** chem` has joined #openstack-infra | 08:55 | |
| *** chem has quit IRC | 08:57 | |
| *** maishsk has joined #openstack-infra | 09:01 | |
| *** javeriak has quit IRC | 09:04 | |
| *** javeriak has joined #openstack-infra | 09:04 | |
| *** maishsk_ has joined #openstack-infra | 09:05 | |
| *** maishsk has quit IRC | 09:05 | |
| *** maishsk_ is now known as maishsk | 09:05 | |
| *** javeriak has quit IRC | 09:06 | |
| *** javeriak has joined #openstack-infra | 09:07 | |
| *** jordanP has joined #openstack-infra | 09:10 | |
| *** kzaitsev_mb has quit IRC | 09:11 | |
| *** sambetts|afk is now known as sambetts | 09:12 | |
| *** vkramskikh_ has joined #openstack-infra | 09:15 | |
| *** rhochmuth has joined #openstack-infra | 09:16 | |
| *** rhochmuth has quit IRC | 09:16 | |
| Kiall | Hey - Q - is infra planning a move to xenial? and any idea on timeline? Looking for access to a xenial version of a package | 09:16 |
| openstackgerrit | Ethan Lynn proposed openstack-infra/project-config: Add tempest tests for senlin API https://review.openstack.org/316544 | 09:16 |
| *** electrofelix has joined #openstack-infra | 09:17 | |
| openstackgerrit | Sam Betts proposed openstack-infra/elastic-recheck: Add query for nova resource tracker/scheduler race https://review.openstack.org/316364 | 09:17 |
| *** dtantsur|afk is now known as dtantsur | 09:21 | |
| *** maishsk has quit IRC | 09:21 | |
| *** sshnaidm has quit IRC | 09:22 | |
| wznoinsk | hi infra cores | 09:23 |
| wznoinsk | http://www.isitdownrightnow.com/jenkins.openstack.org.html | 09:23 |
| Kiall | wznoinsk: all the jenkins UI's were firewalled off after some sort of jenkins security issue... | 09:23 |
| wznoinsk | Kiall: thanks | 09:25 |
| *** sree has joined #openstack-infra | 09:27 | |
| *** kushal has joined #openstack-infra | 09:28 | |
| *** jcoufal has joined #openstack-infra | 09:30 | |
| *** dmk0202 has quit IRC | 09:31 | |
| *** sree_ has joined #openstack-infra | 09:31 | |
| *** sree_ is now known as Guest17456 | 09:31 | |
| *** zqfan has quit IRC | 09:33 | |
| *** sree has quit IRC | 09:33 | |
| *** ihrachys has joined #openstack-infra | 09:34 | |
| *** amotoki has joined #openstack-infra | 09:35 | |
| *** Regalla has joined #openstack-infra | 09:39 | |
| *** maishsk has joined #openstack-infra | 09:41 | |
| *** matrohon has quit IRC | 09:43 | |
| *** Guest17456 has quit IRC | 09:46 | |
| *** zhurong has quit IRC | 09:51 | |
| *** nadya has joined #openstack-infra | 09:54 | |
| *** niska has quit IRC | 09:56 | |
| *** duobei has quit IRC | 10:02 | |
| *** yamahata has quit IRC | 10:02 | |
| *** duobei has joined #openstack-infra | 10:03 | |
| *** nmagnezi has quit IRC | 10:04 | |
| *** nmagnezi has joined #openstack-infra | 10:05 | |
| penguinolog | Hi! Could anybody help us with patch: https://review.openstack.org/#/c/281824/18 - it has +W, it has not predicates, and it's not merged (and I don't see any pending jobs on zuul for it) | 10:08 |
| *** Na3iL has joined #openstack-infra | 10:09 | |
| *** jed56 has quit IRC | 10:09 | |
| *** nmagnezi has quit IRC | 10:09 | |
| *** salv-orl_ has joined #openstack-infra | 10:13 | |
| *** salv-orl_ has quit IRC | 10:13 | |
| *** salv-orl_ has joined #openstack-infra | 10:13 | |
| *** Jeffrey4l has joined #openstack-infra | 10:15 | |
| *** sshnaidm has joined #openstack-infra | 10:15 | |
| *** tosky has joined #openstack-infra | 10:15 | |
| *** kzaitsev_mb has joined #openstack-infra | 10:15 | |
| openstackgerrit | YAMAMOTO Takashi proposed openstack-infra/irc-meetings: Add Neutron Common Classifier meeting https://review.openstack.org/316830 | 10:16 |
| *** sdague has joined #openstack-infra | 10:18 | |
| sdague | hmmm... did gerrit just fall over? | 10:20 |
| sdague | oh, I guess the 500 error was intermiten | 10:21 |
| *** zeih has joined #openstack-infra | 10:23 | |
| *** rossella_s has quit IRC | 10:23 | |
| *** rossella_s has joined #openstack-infra | 10:24 | |
| penguinolog | for our patch: recheck/republish not helps: pending jobs not arrives | 10:24 |
| *** Qiming has quit IRC | 10:25 | |
| *** e0ne has quit IRC | 10:25 | |
| *** e0ne has joined #openstack-infra | 10:26 | |
| *** zeih has quit IRC | 10:27 | |
| *** jlanoux_ has joined #openstack-infra | 10:28 | |
| *** jlanoux has quit IRC | 10:30 | |
| *** niska has joined #openstack-infra | 10:34 | |
| *** yamamoto has quit IRC | 10:36 | |
| *** changzhi has quit IRC | 10:36 | |
| *** maishsk has quit IRC | 10:38 | |
| *** duobei has quit IRC | 10:39 | |
| *** jang has quit IRC | 10:41 | |
| *** daemontool has quit IRC | 10:41 | |
| *** niska has quit IRC | 10:43 | |
| *** nmagnezi has joined #openstack-infra | 10:43 | |
| *** daemontool has joined #openstack-infra | 10:46 | |
| *** jcoufal has quit IRC | 10:48 | |
| *** jordanP has quit IRC | 10:49 | |
| *** zeih has joined #openstack-infra | 10:50 | |
| *** jamielennox|away is now known as jamielennox | 10:53 | |
| *** jlanoux has joined #openstack-infra | 10:54 | |
| *** zeih has quit IRC | 10:54 | |
| *** dtantsur is now known as dtantsur|bbl | 10:55 | |
| *** jlanoux_ has quit IRC | 10:57 | |
| *** zeih has joined #openstack-infra | 10:57 | |
| *** fawadkhaliq has quit IRC | 10:59 | |
| Wei_Liu | hi , how can I update project.config of All-Projects, I did not find edit config button in project's general page. the gerrit version is 2.10-rc10 | 10:59 |
| *** niska has joined #openstack-infra | 11:01 | |
| *** nadya has quit IRC | 11:01 | |
| *** Regalla has quit IRC | 11:01 | |
| *** Jeffrey4l has quit IRC | 11:02 | |
| *** zeih has quit IRC | 11:02 | |
| *** penguinolog has quit IRC | 11:06 | |
| *** lucasagomes is now known as lucas-hungry | 11:07 | |
| *** jcoufal has joined #openstack-infra | 11:09 | |
| *** maishsk has joined #openstack-infra | 11:09 | |
| *** amrith has quit IRC | 11:09 | |
| *** kushal has quit IRC | 11:10 | |
| *** amrith has joined #openstack-infra | 11:12 | |
| *** YorikSar has quit IRC | 11:13 | |
| *** maishsk has quit IRC | 11:14 | |
| *** Jeffrey4l has joined #openstack-infra | 11:14 | |
| *** YorikSar has joined #openstack-infra | 11:14 | |
| *** maishsk has joined #openstack-infra | 11:15 | |
| *** esikachev has quit IRC | 11:16 | |
| *** rhochmuth has joined #openstack-infra | 11:17 | |
| sshnaidm | clarkb, hi | 11:18 |
| *** Qiming has joined #openstack-infra | 11:20 | |
| *** rhochmuth has quit IRC | 11:22 | |
| *** ldnunes has joined #openstack-infra | 11:23 | |
| *** jistr has quit IRC | 11:24 | |
| *** jcoufal has quit IRC | 11:24 | |
| *** rhallisey has joined #openstack-infra | 11:26 | |
| *** hparekh has quit IRC | 11:27 | |
| Wei_Liu | zaro, I did not find "edit config" button in project's general page of my gerrit web, the gerrit version is 2.10-rc0 , is there any other way to edit project.config? | 11:29 |
| *** esikachev has joined #openstack-infra | 11:29 | |
| *** fawadkhaliq has joined #openstack-infra | 11:30 | |
| *** fawadkhaliq has quit IRC | 11:30 | |
| *** Na3iL has quit IRC | 11:30 | |
| *** penguinolog has joined #openstack-infra | 11:31 | |
| *** nadya has joined #openstack-infra | 11:31 | |
| *** javeriak has quit IRC | 11:32 | |
| *** salv-orl_ has quit IRC | 11:32 | |
| *** salv-orlando has joined #openstack-infra | 11:35 | |
| *** hparekh has joined #openstack-infra | 11:36 | |
| *** hparekh has joined #openstack-infra | 11:36 | |
| *** gordc has joined #openstack-infra | 11:36 | |
| *** Jeffrey4l has quit IRC | 11:37 | |
| *** Qiming has quit IRC | 11:37 | |
| openstackgerrit | Merged openstack-infra/puppet-jenkins: Fix incorrect directory permissions in jenkinsuser.pp https://review.openstack.org/315479 | 11:39 |
| *** Na3iL has joined #openstack-infra | 11:39 | |
| *** Qiming has joined #openstack-infra | 11:40 | |
| *** rhochmuth has joined #openstack-infra | 11:40 | |
| *** jed56 has joined #openstack-infra | 11:42 | |
| *** Qiming_ has joined #openstack-infra | 11:43 | |
| *** rhochmuth has quit IRC | 11:44 | |
| *** rhallisey has quit IRC | 11:45 | |
| *** dguitarbite has joined #openstack-infra | 11:46 | |
| dguitarbite | hello, can someone take a look at this review? https://review.openstack.org/#/c/314998/ | 11:46 |
| *** Qiming has quit IRC | 11:46 | |
| *** rhallisey has joined #openstack-infra | 11:46 | |
| *** rfolco has joined #openstack-infra | 11:46 | |
| Kiall | Any project-config core's about for a hopefully quick review? I'd like to be around as it merges to watch for any issues :) https://review.openstack.org/#/c/317029/ | 11:47 |
| EmilienM | pabelanger: do we have plans to have mirrors of UCA ? | 11:49 |
| *** maishsk has quit IRC | 11:49 | |
| *** Na3iL has quit IRC | 11:49 | |
| *** hparekh has quit IRC | 11:50 | |
| *** Jeffrey4l has joined #openstack-infra | 11:51 | |
| *** javeriak has joined #openstack-infra | 11:51 | |
| *** yamamoto has joined #openstack-infra | 11:51 | |
| *** maishsk has joined #openstack-infra | 11:51 | |
| *** dmk0202 has joined #openstack-infra | 11:52 | |
| penguinolog | https://review.openstack.org/#/c/281824/ - no jobs on zuul after rebase, no recheck working. Could anybody help? | 11:52 |
| openstackgerrit | Joshua Hesketh proposed openstack-infra/zuul: Prepare files for testing zuulv25 https://review.openstack.org/316753 | 11:53 |
| *** yamamoto has quit IRC | 11:54 | |
| *** Qiming_ has quit IRC | 11:54 | |
| *** thorst has joined #openstack-infra | 11:55 | |
| *** Qiming has joined #openstack-infra | 11:57 | |
| *** nadya has quit IRC | 11:58 | |
| *** hparekh has joined #openstack-infra | 11:58 | |
| *** Qiming has quit IRC | 11:58 | |
| yolanda | penguinolog, seems you hit a circular dependency | 12:00 |
| yolanda | Exception: Dependency cycle detected: 281824 in [u'281824', u'296457'] | 12:00 |
| *** jistr has joined #openstack-infra | 12:00 | |
| yolanda | try to check the whole dependency chain and amend it | 12:01 |
| *** rhochmuth has joined #openstack-infra | 12:01 | |
| *** jcoufal has joined #openstack-infra | 12:02 | |
| *** weshay has joined #openstack-infra | 12:03 | |
| vgridnev | hello folks, need review and probably fast-approve for change: https://review.openstack.org/#/c/315767/ | 12:04 |
| *** Qiming has joined #openstack-infra | 12:04 | |
| penguinolog | yolanda, how can our team see this exception, if job could not be started? | 12:05 |
| *** julim has joined #openstack-infra | 12:05 | |
| *** gildub has quit IRC | 12:05 | |
| *** rhochmuth has quit IRC | 12:05 | |
| *** aysyd has joined #openstack-infra | 12:06 | |
| *** Qiming has quit IRC | 12:06 | |
| openstackgerrit | Vitaly Gridnev proposed openstack-infra/project-config: [sahara] make grenade job temporary non-voting https://review.openstack.org/315767 | 12:06 |
| *** duobei has joined #openstack-infra | 12:07 | |
| *** Qiming has joined #openstack-infra | 12:07 | |
| *** javeriak has quit IRC | 12:08 | |
| *** dprince has joined #openstack-infra | 12:08 | |
| *** esikachev has quit IRC | 12:09 | |
| *** trown|outtypewww is now known as trown | 12:10 | |
| *** anteaya has joined #openstack-infra | 12:10 | |
| *** hparekh has quit IRC | 12:10 | |
| *** hparekh has joined #openstack-infra | 12:11 | |
| *** rodrigods has quit IRC | 12:11 | |
| *** rodrigods has joined #openstack-infra | 12:11 | |
| *** lucas-hungry is now known as lucasagomes | 12:13 | |
| *** rhochmuth has joined #openstack-infra | 12:14 | |
| *** duobei has quit IRC | 12:15 | |
| openstackgerrit | Thierry Carrez proposed openstack-infra/irc-meetings: Cleanup old Trainers and Evoque meetings https://review.openstack.org/317420 | 12:15 |
| *** raildo-afk is now known as raildo | 12:15 | |
| *** bdemers has quit IRC | 12:15 | |
| *** Qiming has quit IRC | 12:16 | |
| *** Qiming has joined #openstack-infra | 12:16 | |
| *** sshnaidm has quit IRC | 12:17 | |
| *** hparekh has quit IRC | 12:18 | |
| *** nadya has joined #openstack-infra | 12:18 | |
| *** rhochmuth has quit IRC | 12:18 | |
| *** yamamoto has joined #openstack-infra | 12:19 | |
| *** javeriak has joined #openstack-infra | 12:20 | |
| *** ayoung has quit IRC | 12:23 | |
| pabelanger | morning | 12:24 |
| pabelanger | EmilienM: nothing at the moment | 12:25 |
| *** krtaylor has joined #openstack-infra | 12:25 | |
| EmilienM | pabelanger: ok, we also have timeouts, etc on their repos :( | 12:25 |
| pabelanger | EmilienM: Ya, possible we can add it, just not on my list ATM | 12:25 |
| EmilienM | cool no problem, let's first finish the centos thing, I backported the puppet-openstack_extras patch in stable/mitaka so we can test your puppet fact patch in our stable CI | 12:26 |
| pabelanger | great | 12:26 |
| *** jpr has joined #openstack-infra | 12:26 | |
| *** rlandy has joined #openstack-infra | 12:26 | |
| yolanda | penguinolog, i saw that on zuul logs, it's not visible from outside | 12:27 |
| EmilienM | pabelanger: can I steal https://review.openstack.org/#/c/316376/ in stable/* ? | 12:27 |
| *** amitgandhinz has joined #openstack-infra | 12:27 | |
| pabelanger | EmilienM: not stealing, feel free to use | 12:28 |
| EmilienM | ack | 12:28 |
| *** amitgandhinz has quit IRC | 12:29 | |
| *** amitgandhinz has joined #openstack-infra | 12:29 | |
| *** sshnaidm has joined #openstack-infra | 12:33 | |
| *** Jeffrey4l has quit IRC | 12:34 | |
| *** javeriak has quit IRC | 12:34 | |
| *** baoli has joined #openstack-infra | 12:35 | |
| *** hashar has quit IRC | 12:36 | |
| *** rfolco has quit IRC | 12:36 | |
| *** baoli_ has joined #openstack-infra | 12:36 | |
| *** javeriak has joined #openstack-infra | 12:36 | |
| *** rfolco has joined #openstack-infra | 12:36 | |
| *** hparekh has joined #openstack-infra | 12:37 | |
| *** esikachev has joined #openstack-infra | 12:39 | |
| *** baoli has quit IRC | 12:40 | |
| *** javeriak has quit IRC | 12:40 | |
| *** jpr has quit IRC | 12:41 | |
| openstackgerrit | Merged openstack-infra/project-config: Make gate-manila-tempest-minimal-dsvm-lvm job voting https://review.openstack.org/316716 | 12:41 |
| *** _prad_ has joined #openstack-infra | 12:42 | |
| Kiall | Any project-config core's about for a hopefully quick review? Hate to be that guy, but I'd like to be around as it merges to watch for any issues :) https://review.openstack.org/#/c/317029/ | 12:44 |
| openstackgerrit | Merged openstack-infra/project-config: Normalize projects.yaml https://review.openstack.org/316584 | 12:44 |
| *** dtantsur|bbl is now known as dtantsur | 12:45 | |
| openstackgerrit | Merged openstack-infra/project-config: remove build job for javamelody plugin for Gerrit 2.8 https://review.openstack.org/317230 | 12:45 |
| *** hashar has joined #openstack-infra | 12:47 | |
| openstackgerrit | Merged openstack-infra/project-config: add build job for Gerrit delete-project plugin https://review.openstack.org/317226 | 12:48 |
| *** edmondsw has joined #openstack-infra | 12:48 | |
| openstackgerrit | Merged openstack-infra/project-config: Add neutron-dynamic-routing to #-neutron https://review.openstack.org/316595 | 12:48 |
| *** rhochmuth has joined #openstack-infra | 12:49 | |
| *** vincentll has quit IRC | 12:49 | |
| *** salv-orlando has quit IRC | 12:49 | |
| openstackgerrit | Anita Kuno proposed openstack-infra/irc-meetings: Remove the Tuesday 0800 third party meeting. https://review.openstack.org/317444 | 12:51 |
| *** bhunter71 has joined #openstack-infra | 12:52 | |
| anteaya | lennyb: ^^ | 12:52 |
| *** javeriak has joined #openstack-infra | 12:54 | |
| *** salv-orlando has joined #openstack-infra | 12:55 | |
| *** matrohon has joined #openstack-infra | 12:55 | |
| *** psilvad has joined #openstack-infra | 12:57 | |
| *** maishsk has quit IRC | 12:59 | |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: WIP: DONT MERGE Running tests https://review.openstack.org/316436 | 12:59 |
| openstackgerrit | Paul Belanger proposed openstack-infra/project-config: Use regionOne for tripleo-test-cloud-rh1 https://review.openstack.org/317447 | 13:00 |
| *** amrith is now known as _amrith_ | 13:00 | |
| openstackgerrit | Emilien Macchi proposed openstack-infra/project-config: puppet: implement breaker-jobs-nv on xenial https://review.openstack.org/317449 | 13:01 |
| EmilienM | nibalizer: fyi ^ this is a first iteration of running Puppet beaker jobs on Xenial using exprimental queue. | 13:01 |
| openstackgerrit | Paul Belanger proposed openstack-infra/system-config: Use regionOne for tripleo-test-cloud-rh1 https://review.openstack.org/317450 | 13:01 |
| *** xyang1 has joined #openstack-infra | 13:02 | |
| *** vincentll has joined #openstack-infra | 13:03 | |
| *** psilvad has quit IRC | 13:04 | |
| sshnaidm | does anybody succeed to log in into wiki? https://wiki.openstack.org | 13:04 |
| *** doug-fish has joined #openstack-infra | 13:06 | |
| *** psilvad has joined #openstack-infra | 13:06 | |
| *** ewilson has joined #openstack-infra | 13:07 | |
| *** eharney has joined #openstack-infra | 13:07 | |
| pabelanger | sshnaidm: yes, but you need to have an existing user account. We've disabled new user creation as a result of being spammed | 13:07 |
| *** Goneri has joined #openstack-infra | 13:08 | |
| nibalizer | EmilienM: nice! | 13:08 |
| sshnaidm | pabelanger, I tried to log in with launchpad account ad it failed. What can I do then? | 13:08 |
| pabelanger | sshnaidm: sadly, not much at the moment. We are hoping to upgrade the wiki in the coming week to a newer version of software. If that goes well we should be able to open account creation again. | 13:09 |
| sshnaidm | pabelanger, thanks for clarifying this | 13:10 |
| anteaya | lennyb: thank you | 13:10 |
| *** janonymous has joined #openstack-infra | 13:11 | |
| *** psilvad has quit IRC | 13:11 | |
| pabelanger | sshnaidm: Yes, it is not the best policy. Apologies for the inconvenience | 13:12 |
| *** tpsilva has joined #openstack-infra | 13:12 | |
| phschwartz | I am trying to use infra's ansible-puppet and seem to get an error http://paste.openstack.org/show/497336/ any thoughts? | 13:12 |
| *** psilvad has joined #openstack-infra | 13:13 | |
| *** mriedem has joined #openstack-infra | 13:14 | |
| yolanda | phschwartz, that shows that zuul.test cannot be resolved properly | 13:14 |
| vgridnev | hello folks, could you please take a look on this one: https://review.openstack.org/#/c/315767/ | 13:14 |
| *** dstufft has quit IRC | 13:14 | |
| *** pwgravel has joined #openstack-infra | 13:14 | |
| nibalizer | phschwartz: that looks like puppet agent instead of puppet apply | 13:14 |
| nibalizer | puppet apply would not request a certificiate | 13:15 |
| *** dstufft has joined #openstack-infra | 13:15 | |
| *** rvasilets__ has joined #openstack-infra | 13:16 | |
| anteaya | nibalizer: morning | 13:17 |
| anteaya | nibalizer: how far did we get standing up a storyboard-dev server and what can I do to help? | 13:17 |
| nibalizer | anteaya: hi | 13:17 |
| nibalizer | i think we're ready to run launch_node | 13:18 |
| anteaya | hey there | 13:18 |
| anteaya | nibalizer: yay! | 13:18 |
| anteaya | thank you so much | 13:18 |
| *** jordanP has joined #openstack-infra | 13:18 | |
| nibalizer | i haven't done it yet though, and today/tomorrow/thursday i am very busy internally | 13:18 |
| anteaya | nibalizer: I understand | 13:18 |
| *** psilvad has quit IRC | 13:18 | |
| anteaya | nibalizer: is it okay with you if I can find someone else willing to push the button? | 13:18 |
| anteaya | nibalizer: anything they should know before they do, if I can find someone? | 13:19 |
| nibalizer | so either someone else can pick it up, or I can pick it up once I'm done with this thing I'm doing | 13:19 |
| nibalizer | anteaya: yea someone else is fine | 13:19 |
| anteaya | nibalizer: yup, thank you | 13:19 |
| anteaya | nibalizer: appreciate your help getting this far | 13:19 |
| nibalizer | i think clark wants feedback on his patches to launch_node | 13:19 |
| anteaya | good luck wiht the internal thing | 13:19 |
| nibalizer | so it was requested to try that out | 13:19 |
| anteaya | nibalizer: awesome thanks, I'll look up those patches and start staring at them | 13:19 |
| *** _ari_ has joined #openstack-infra | 13:21 | |
| *** vincentll has quit IRC | 13:22 | |
| anteaya | turns out Zara and SotK were able to find me a place to sit at codethink, relocating | 13:22 |
| *** bhunter71 has quit IRC | 13:24 | |
| *** psachin has quit IRC | 13:24 | |
| *** dtantsur has quit IRC | 13:27 | |
| *** anteaya has quit IRC | 13:27 | |
| phschwartz | yolanda: I think nibalizer is right, there is no puppet master so it shouldn't do a puppt agent. Also in my env the host zuul.test is resolvable. | 13:27 |
| *** javeriak has quit IRC | 13:28 | |
| *** nwkarsten has joined #openstack-infra | 13:28 | |
| *** dtantsur has joined #openstack-infra | 13:30 | |
| openstackgerrit | Merged openstack-infra/project-config: Add Designate+Tempest on Mitaka jobs https://review.openstack.org/317029 | 13:32 |
| *** matt-borland has joined #openstack-infra | 13:32 | |
| Kiall | thanks nibalizer + yolanda re ^ :) | 13:32 |
| Kiall | fingers crossed for no explosions once it's pushes ot | 13:32 |
| Kiall | out* | 13:32 |
| *** openstackgerrit has quit IRC | 13:32 | |
| yolanda | Kiall, you don't look very safe... | 13:33 |
| *** openstackgerrit has joined #openstack-infra | 13:33 | |
| *** doug-fish has quit IRC | 13:33 | |
| Kiall | I'm wearing my cape, I'll be OK ;) | 13:33 |
| nwkarsten | I'm running into an issue in my personal system. I'm trying to set up zuul and I'm getting this error in the logs http://paste.openstack.org/show/497272/ I'm using puppet to configure and the SSH that I've passed in are RSA format. Can anyone help? | 13:34 |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: Report overcloud delete fail https://review.openstack.org/317464 | 13:35 |
| *** yamamoto has quit IRC | 13:36 | |
| *** links has quit IRC | 13:36 | |
| *** thiagop has joined #openstack-infra | 13:36 | |
| *** vincentll has joined #openstack-infra | 13:36 | |
| *** rkukura has quit IRC | 13:37 | |
| phschwartz | yolanda: Any thoughts why without a puppetmaster set and passed to the role that it would be attempting to do a puppet agent? | 13:37 |
| phschwartz | mordred: ^ any thoughts, I know your familar with ansible-puppet | 13:37 |
| *** kgiusti has joined #openstack-infra | 13:38 | |
| *** inc0 has joined #openstack-infra | 13:39 | |
| *** bdemers has joined #openstack-infra | 13:40 | |
| Shrews | phschwartz: mordred is vacationing in a land far, far away | 13:40 |
| yolanda | phschwartz, looks as you are not passing the manifest setting | 13:40 |
| yolanda | is no manifest is passed, ansible-puppet runs in agent mode | 13:41 |
| *** jdob has left #openstack-infra | 13:41 | |
| openstackgerrit | Ihar Hrachyshka proposed openstack-infra/release-tools: Added tool to scan project repo for new bug fixes in master https://review.openstack.org/296420 | 13:42 |
| pabelanger | yolanda: mind reviewing https://review.openstack.org/#/c/317450/ and https://review.openstack.org/#/c/317447/ | 13:43 |
| yolanda | ok | 13:44 |
| pabelanger | even testing if possible, pretty sure I have it right this time | 13:44 |
| *** zz_dimtruck is now known as dimtruck | 13:44 | |
| yolanda | it's regionOne, with lower r ? i'm used to RegionOne instead | 13:44 |
| *** sdake has joined #openstack-infra | 13:44 | |
| fungi | nwkarsten: what version of paramiko do you have installed? i know that 2.x doesn't work for zuul yet, but don't recall how it manifests | 13:46 |
| nibalizer | phschwartz: pass in a manifest | 13:47 |
| pabelanger | yolanda: regionOne | 13:48 |
| openstackgerrit | Ihar Hrachyshka proposed openstack-infra/release-tools: Added tool to filter out bugs of specified importance https://review.openstack.org/296421 | 13:48 |
| pabelanger | yolanda: RegionOne will not work | 13:48 |
| yolanda | ok +2 | 13:48 |
| pabelanger | yolanda: cool | 13:48 |
| *** sdake_ has joined #openstack-infra | 13:48 | |
| *** psachin has joined #openstack-infra | 13:48 | |
| *** sdake has quit IRC | 13:49 | |
| *** winggundamth has quit IRC | 13:49 | |
| pabelanger | fungi: do you mind reviewing 317450 and 317447. I have a copy of keystone endpoint-list I can share if needed too. | 13:50 |
| fungi | pabelanger: the one with "nova" as the region name got reverted i guess? | 13:51 |
| fungi | i'm assuming that's what i saw skimming scrollback | 13:52 |
| *** winggundamth has joined #openstack-infra | 13:52 | |
| *** jaosorior has quit IRC | 13:52 | |
| pabelanger | fungi: yes, I mistakenly testing it locally. It was actually the availability zone | 13:52 |
| openstackgerrit | Ihar Hrachyshka proposed openstack-infra/release-tools: Added tool to filter out bugs with specific tag https://review.openstack.org/296454 | 13:52 |
| openstackgerrit | Ihar Hrachyshka proposed openstack-infra/release-tools: Added tool to filter out bugs of specified importance https://review.openstack.org/296421 | 13:52 |
| *** dimtruck is now known as zz_dimtruck | 13:53 | |
| *** sigmavirus24_awa is now known as sigmavirus24 | 13:54 | |
| *** doug-fish has joined #openstack-infra | 13:54 | |
| nwkarsten | fungi: version 1.17.0 | 13:54 |
| *** binbincong has quit IRC | 13:55 | |
| *** penguinolog has quit IRC | 13:55 | |
| *** tosky has quit IRC | 13:56 | |
| *** njohnsto- is now known as njohnston-- | 13:56 | |
| openstackgerrit | Ihar Hrachyshka proposed openstack-infra/release-tools: Add tool that annotates bug numbers with details from LP https://review.openstack.org/296470 | 13:56 |
| *** doug-fis_ has joined #openstack-infra | 13:56 | |
| fungi | nwkarsten: okay, so that's likely not the cause. i believe "SSHException: not a valid EC private key file" is really just a misleading error for the remote server not authorizing your key for access | 13:56 |
| fungi | nwkarsten: looks like it's filed as a long-standing issue with paramiko https://github.com/paramiko/paramiko/issues/387 | 13:57 |
| *** zz_dimtruck is now known as dimtruck | 13:57 | |
| *** jswarren has joined #openstack-infra | 13:58 | |
| *** tosky has joined #openstack-infra | 13:58 | |
| *** bdemers has quit IRC | 13:59 | |
| fungi | nwkarsten: what gerrit is it connecting to? review.openstack.org or one you operate? | 13:59 |
| *** vincentll has quit IRC | 13:59 | |
| *** doug-fish has quit IRC | 13:59 | |
| hashar | hello folks! | 14:00 |
| hashar | any idea what is the issue tracker for the Jenkins Gearman plugin that Khai maintains? I am lost between Storyboard, launchpad and Jenkins jira :D | 14:00 |
| *** binbincong has joined #openstack-infra | 14:01 | |
| *** doug-fis_ has quit IRC | 14:01 | |
| lucasagomes | hi all, if you have some time, mind taking a look at https://review.openstack.org/#/c/315646/ ? The dependency patch for the change is already merged. Thank you | 14:01 |
| fungi | hashar: http://git.openstack.org/cgit/openstack-infra/gearman-plugin/tree/README.rst#n30 says it's https://storyboard.openstack.org/#!/project/706 | 14:01 |
| jlvillal | ttx Can you look at https://review.openstack.org/#/c/305528/ ? | 14:02 |
| jlvillal | ttx We currently don't have a multiple of 4 meetings on http://eavesdrop.openstack.org/ so we are losing meetings on the index | 14:02 |
| nwkarsten | fungi: review.openstack.org | 14:03 |
| fungi | nwkarsten: and what username is zuul configured to authenticate to gerrit as? | 14:03 |
| jlvillal | ttx So right now XenApi and Zagar don't make the index list | 14:03 |
| *** jordanP has quit IRC | 14:03 | |
| ttx | heh, nice | 14:03 |
| ttx | jlvillal: looking | 14:03 |
| jlvillal | ttx thanks | 14:03 |
| *** abregman has quit IRC | 14:04 | |
| *** med_ has joined #openstack-infra | 14:04 | |
| *** med_ has quit IRC | 14:04 | |
| *** med_ has joined #openstack-infra | 14:04 | |
| *** doug-fis_ has joined #openstack-infra | 14:04 | |
| ttx | jlvillal: we'll need a release to get that used | 14:04 |
| *** rhochmuth has quit IRC | 14:05 | |
| ttx | once it merges | 14:05 |
| *** Julien-zte has joined #openstack-infra | 14:05 | |
| jlvillal | ttx, Ah, okay. /me didn't know that. | 14:05 |
| nwkarsten | fungi: my teammates | 14:05 |
| ttx | the irc-meetings post-jobs instalkl yaml2ical from pypi | 14:05 |
| ttx | jlvillal: I'll try to push a release shortly after that | 14:05 |
| jlvillal | ttx, Thank you :) | 14:05 |
| fungi | nwkarsten: mainly asking so that i can confirm the ssh public key associated with it in gerrit's backend db | 14:06 |
| fungi | nwkarsten: and also so that i can check the logs in gerrit to see what the details of the authentication failure actually are | 14:06 |
| nwkarsten | fungi: philip-schwartz | 14:06 |
| fungi | nwkarsten: got it, checking | 14:07 |
| jhesketh | jeblair: I'm off in a minute, but I've been working on adding functional tests to the ansible-launcher if you're interested: https://review.openstack.org/#/q/topic:zuulv25-tests | 14:07 |
| fungi | nwkarsten: there are currently 5 different ssh public keys associated with that account. do you know which one it's supposed to be? | 14:08 |
| jeblair | jhesketh: neat. people keep adding those to requirements.txt though, and i don't think they belong there | 14:09 |
| *** daemontool has quit IRC | 14:09 | |
| jeblair | jhesketh: (they are not requirements for zuul, and i do not want anyone else to use the v25 launcher) | 14:09 |
| phschwartz | fungi: hold a sec. Why are you looking at my public keys? | 14:09 |
| *** jpr has joined #openstack-infra | 14:09 | |
| fungi | phschwartz: nwkarsten says he has a third-party ci using them to authenticate to gerrit | 14:10 |
| nwkarsten | fungi: nope, but i set it up to use not one of those. i'm going to try setting it up to use my own gerrit user | 14:10 |
| hashar | fungi: found it. apparently that is Jenkins upstream tracker from https://wiki.jenkins-ci.org/display/JENKINS/Gearman+Plugin :D | 14:10 |
| hashar | fungi: and storyboard as well bah | 14:10 |
| jhesketh | jeblair: so if we don't want the launcher to be usable by anybody, then sure, we can probably ignore them... but I think we should possibly reconsider how v3 is approached | 14:10 |
| jeblair | jhesketh: what do you mean? | 14:11 |
| fungi | nwkarsten: yeah, that's probably a better solution. there is at least one zuul successfully authenticating as philip-schwartz in gerrit from what i can see, but i also see one (presumably yours) returning AUTH FAILURE FROM 169.45.12.56 no-matching-key | 14:11 |
| jhesketh | jeblair: given the work here and some of the other outstanding v2 patches, I'm starting to think we should merge what makes sense in v2 and start a new v3 branch. Then cherrypick off the current v3 branch the config/layout changes and refactors etc. | 14:12 |
| phschwartz | fungi: I think the issue might be he isn't using the key we have in our hiera config, let me check with him. | 14:12 |
| jeblair | jhesketh: the work here does not align with v3 at all -- it's a dead-end. | 14:12 |
| fungi | phschwartz: yeah, please coordinate with nwkarsten before i troubleshoot further. it looks like a simple case of username/ssh key mismatch in gerrit | 14:13 |
| jhesketh | jeblair: the alternative of trying to sync v2 with v3 I think will be a lot of work... or if we just ignore the ansible-launcher and no longer merge v2 onto v3 we lose a lot of history | 14:13 |
| jeblair | jhesketh: yes, we ignore the ansible launcher | 14:13 |
| jhesketh | jeblair: hmm, but it could align I guess was my thinking | 14:13 |
| jeblair | jhesketh: it's a merge commit where the v3 branch wins in any conflicts | 14:13 |
| *** maishsk has joined #openstack-infra | 14:13 | |
| jhesketh | we could iterate on the ansible launcher (as I imagine we'll need to while we're running it anyway) rather than needing a big cut over | 14:13 |
| jeblair | jhesketh: i should have called it something else. we can rename the file before we merge it into v3 | 14:13 |
| *** tonytan4ever has joined #openstack-infra | 14:14 | |
| jeblair | jhesketh: it's not the ansible launching that means we need a cutover, it's the comptelely different way of defining jobs, which is the main feature of v3, which is what we ought to be spending our time working on | 14:14 |
| jeblair | jhesketh: i really do not want v25 to be a distraction | 14:14 |
| jeblair | if we spend much more time on it, i'm just going to abort it and move back to working on v3 | 14:15 |
| jeblair | i think we can learn some stuff about using ansible which will be useful in v3 | 14:15 |
| jeblair | but it is really not any kind of a base to build v3 off of | 14:15 |
| jeblair | it is simply a stop-gap | 14:15 |
| jhesketh | sure, I agree the big part is the job definitions etc. However won't we want to use a large part of the ansible-launcher in v3? (I mean parts of it already exist there, but would it make more sense to be the same code base) | 14:16 |
| jeblair | jhesketh: most of the novel code in v2 is built around jenkins-job-builder | 14:16 |
| *** rbrndt has joined #openstack-infra | 14:17 | |
| phschwartz | fungi: That is exactly what I think it is. I will work it through with him | 14:17 |
| Shrews | jeblair: have you spent much time fleshing out how jobs in v3 will actually look? | 14:18 |
| jhesketh | jeblair: I guess thinking about how the node-assigning is proposed to change I agree some more (had forgotten about that) | 14:18 |
| jeblair | Shrews: in the spec | 14:18 |
| jeblair | jhesketh: yes that too | 14:18 |
| jeblair | Shrews: as far as implementation -- that's about where i am now -- when i get back to v3, i'm going to be working further on collecting the job configurations and passing them to the launcher appropriately | 14:19 |
| *** matrohon has quit IRC | 14:20 | |
| *** inc0 has quit IRC | 14:21 | |
| *** inc0 has joined #openstack-infra | 14:21 | |
| jhesketh | jeblair: hmm so I think I'll sleep on it some more but I'm seeing less merit in what I had imagined.. I would like to find a way to keep any similarities in v25 and v3 in sync to minimise reproducing it and making sure we get bugs etc fixed in both | 14:22 |
| jeblair | jhesketh: kk | 14:22 |
| jhesketh | jeblair: How did the launcher node you were trying out yesterday go btw? | 14:23 |
| *** amotoki has quit IRC | 14:23 | |
| jeblair | jhesketh: failed for reasons unknown, next step is adding -vvv to ansible-playbook | 14:23 |
| jhesketh | okay | 14:23 |
| *** rfolco has quit IRC | 14:23 | |
| *** rossella_s has quit IRC | 14:23 | |
| *** jordanP has joined #openstack-infra | 14:24 | |
| *** rfolco has joined #openstack-infra | 14:24 | |
| jhesketh | jeblair: my testing found that if it fails during setup it isn't handled very well.. https://review.openstack.org/#/c/317481/1 may help with taht | 14:24 |
| *** rossella_s has joined #openstack-infra | 14:24 | |
| openstackgerrit | Merged openstack-infra/project-config: [sahara] make grenade job temporary non-voting https://review.openstack.org/315767 | 14:25 |
| jeblair | jhesketh: oh thanks! | 14:25 |
| *** zeih has joined #openstack-infra | 14:26 | |
| openstackgerrit | Joshua Hesketh proposed openstack-infra/zuul: Start fleshing out ansible-launcher tests https://review.openstack.org/317482 | 14:26 |
| openstackgerrit | Joshua Hesketh proposed openstack-infra/zuul: Clean up results returned from ansible-launcher https://review.openstack.org/317481 | 14:26 |
| * jhesketh notices a silly mistake | 14:26 | |
| jhesketh | jeblair: changing topics.. it's probably not worth discussing (particularly at the moment), but have you ever considered taskflow for zuul? | 14:26 |
| jeblair | jhesketh: i'm not sure that solves a problem we have right now | 14:28 |
| jhesketh | jeblair: thinking abstractly for the future | 14:28 |
| jeblair | jhesketh: i like that zuul is not abstract | 14:29 |
| jhesketh | heh | 14:29 |
| mriedem | nova would like to add a job to the experimental queue that uses the lvm image backend for libvirt, we need this before refactoring a bunch of that code. it has a +2, so i'm asking for another project-config core to take a look. https://review.openstack.org/#/c/316298/ | 14:30 |
| openstackgerrit | Derek Higgins proposed openstack-infra/tripleo-ci: Use the overcloud full images from the cache https://review.openstack.org/312397 | 14:30 |
| *** vhosakot has joined #openstack-infra | 14:30 | |
| *** eeiden has joined #openstack-infra | 14:30 | |
| mriedem | btw, i've already tested the job config with a devstack-gate change | 14:30 |
| *** zeih has quit IRC | 14:30 | |
| *** mtanino has joined #openstack-infra | 14:30 | |
| openstackgerrit | Merged openstack-infra/project-config: Change groups for Fuel Plugin Cinder Netapp https://review.openstack.org/316659 | 14:30 |
| openstackgerrit | Paul Belanger proposed openstack-infra/puppet-nodepool: Add nodepool_ssh_public_key https://review.openstack.org/316187 | 14:31 |
| pabelanger | jhesketh: hopefully that clears up the commit^ | 14:31 |
| *** _amrith_ is now known as amrith | 14:32 | |
| jhesketh | pabelanger: would it be neater to pass through the pubkey elsehow? eg configdrive? | 14:32 |
| jhesketh | just doesn't feel right to pick up a key if it exists etc | 14:32 |
| *** bhunter71 has joined #openstack-infra | 14:33 | |
| pabelanger | jhesketh: we want to use DIB elements to configure zuul-workers. Since we are moving away from puppet | 14:33 |
| pabelanger | not sure why it would be an issue | 14:34 |
| jhesketh | pabelanger: not an issue, it just doesn't seem the best place.. but I'm not doing the work so.. *shrug* | 14:35 |
| *** markvoelker has joined #openstack-infra | 14:35 | |
| *** markvoelker has quit IRC | 14:35 | |
| jhesketh | pabelanger: would it make more sense as a custom dib element in system-config that holds the key there? | 14:35 |
| pabelanger | jhesketh: not really. The key is in system-config today, we are simply passing it through to nodepool.o.o to keep a local copy of the public key. | 14:36 |
| *** markvoelker has joined #openstack-infra | 14:36 | |
| jhesketh | okay, thanks for the explaination :-) | 14:37 |
| *** nadya has quit IRC | 14:38 | |
| *** kushal has joined #openstack-infra | 14:38 | |
| *** kushal has quit IRC | 14:38 | |
| *** kushal has joined #openstack-infra | 14:38 | |
| *** markvoelker has quit IRC | 14:39 | |
| *** markvoelker has joined #openstack-infra | 14:39 | |
| *** ajmiller has joined #openstack-infra | 14:40 | |
| jhesketh | okay I'm off... night all | 14:40 |
| *** nwkarsten has quit IRC | 14:40 | |
| *** nwkarsten has joined #openstack-infra | 14:41 | |
| *** anteaya has joined #openstack-infra | 14:42 | |
| openstackgerrit | Ryan Hallisey proposed openstack-infra/project-config: Bump tripleo containers job back to experimental https://review.openstack.org/317545 | 14:42 |
| krotscheck | Anyone hear any issues with the npm mirrors? I think those went into rotation this morning... | 14:45 |
| *** Julien-zte has quit IRC | 14:45 | |
| * krotscheck is technically not at work today, but can be pinged in an emergency | 14:45 | |
| *** nwkarsten has quit IRC | 14:45 | |
| *** Julien-zte has joined #openstack-infra | 14:45 | |
| *** zeih has joined #openstack-infra | 14:45 | |
| *** yamahata has joined #openstack-infra | 14:46 | |
| *** sirushti has quit IRC | 14:46 | |
| openstackgerrit | Merged openstack-infra/tripleo-ci: Revert check for centos to free HDD space https://review.openstack.org/316973 | 14:48 |
| openstackgerrit | Ryan Hallisey proposed openstack-infra/project-config: Bump tripleo containers job back to experimental https://review.openstack.org/317545 | 14:49 |
| *** sirushti has joined #openstack-infra | 14:49 | |
| *** yamamoto has joined #openstack-infra | 14:50 | |
| *** zeih has quit IRC | 14:50 | |
| *** nwkarsten has joined #openstack-infra | 14:50 | |
| *** markvoelker has quit IRC | 14:51 | |
| *** bdemers has joined #openstack-infra | 14:52 | |
| dhellmann | infra core, when you have a few minutes please add https://review.openstack.org/#/c/315761 to your review queue. I'd like to close the testing gap we've been trying to address manually and all of the dependencies for that patch are merged. thanks! | 14:52 |
| *** markvoelker has joined #openstack-infra | 14:53 | |
| mriedem | jeblair: thanks re https://review.openstack.org/#/c/316298/ | 14:54 |
| jeblair | mriedem: np | 14:54 |
| *** dtardivel has joined #openstack-infra | 14:56 | |
| *** laurelm has quit IRC | 14:56 | |
| *** schang has quit IRC | 14:57 | |
| *** abramley has quit IRC | 14:57 | |
| *** markvoelker has quit IRC | 14:57 | |
| *** dougshelley66 has quit IRC | 14:57 | |
| *** gildub has joined #openstack-infra | 14:57 | |
| *** abramley has joined #openstack-infra | 14:57 | |
| *** laurelm has joined #openstack-infra | 14:58 | |
| *** markvoelker has joined #openstack-infra | 14:58 | |
| *** IlyaG_ has quit IRC | 14:58 | |
| *** schang has joined #openstack-infra | 14:59 | |
| *** dougshelley66 has joined #openstack-infra | 14:59 | |
| *** salv-orlando has quit IRC | 14:59 | |
| *** jogo has quit IRC | 14:59 | |
| *** rhallisey has quit IRC | 14:59 | |
| *** rhallisey has joined #openstack-infra | 14:59 | |
| *** salv-orlando has joined #openstack-infra | 15:00 | |
| *** salv-orlando has quit IRC | 15:00 | |
| *** cody-somerville has quit IRC | 15:00 | |
| *** yamahata has quit IRC | 15:00 | |
| *** salv-orlando has joined #openstack-infra | 15:00 | |
| *** jogo has joined #openstack-infra | 15:00 | |
| *** yamahata has joined #openstack-infra | 15:01 | |
| dhellmann | thanks, anteaya | 15:01 |
| anteaya | dhellmann: welcome | 15:01 |
| anteaya | dhellmann: may it do as you intend | 15:01 |
| *** salv-orlando has quit IRC | 15:01 | |
| *** Qiming has quit IRC | 15:02 | |
| * dhellmann crosses his fingers | 15:02 | |
| *** matrohon has joined #openstack-infra | 15:02 | |
| *** salv-orlando has joined #openstack-infra | 15:02 | |
| *** mixos has joined #openstack-infra | 15:03 | |
| *** claudiub has joined #openstack-infra | 15:03 | |
| * anteaya also crosses her fingers | 15:03 | |
| openstackgerrit | Merged openstack-infra/project-config: Use regionOne for tripleo-test-cloud-rh1 https://review.openstack.org/317447 | 15:03 |
| *** Julien-zte has quit IRC | 15:04 | |
| anteaya | mriedem: so I looked in all the obvious places I could think of and couldn't find a way of putting my hand in the air to indicate my intent to attend the nova mid-cycle | 15:04 |
| anteaya | mriedem: have I missed something obvious? | 15:04 |
| *** markvoelker has quit IRC | 15:04 | |
| *** gildub has quit IRC | 15:04 | |
| *** yamamoto has quit IRC | 15:05 | |
| *** tonytan4ever has quit IRC | 15:05 | |
| mriedem | anteaya: there was an rsvp email in the -dev list | 15:05 |
| mriedem | for nova | 15:05 |
| *** sdake_ is now known as sdake | 15:06 | |
| mriedem | anteaya: http://lists.openstack.org/pipermail/openstack-dev/2016-May/093815.html | 15:06 |
| *** kushal has quit IRC | 15:06 | |
| anteaya | I did miss it | 15:06 |
| anteaya | thank you | 15:06 |
| *** Jeffrey4l has joined #openstack-infra | 15:06 | |
| *** kushal has joined #openstack-infra | 15:07 | |
| anteaya | mriedem: I've missed the deadline in the email | 15:07 |
| anteaya | mriedem: may I still sign up? | 15:07 |
| *** nelsnelson has quit IRC | 15:07 | |
| anteaya | mriedem: I've signed up, sorry I am late to do so | 15:08 |
| *** nelsnelson has joined #openstack-infra | 15:08 | |
| mriedem | anteaya: i think we can make an exception | 15:09 |
| mriedem | just this once | 15:09 |
| anteaya | thank you | 15:09 |
| openstackgerrit | Merged openstack-infra/system-config: Use regionOne for tripleo-test-cloud-rh1 https://review.openstack.org/317450 | 15:09 |
| *** amitgandhinz has quit IRC | 15:09 | |
| *** weshay is now known as weshay_mtg | 15:09 | |
| *** amotoki has joined #openstack-infra | 15:09 | |
| *** amitgandhinz has joined #openstack-infra | 15:10 | |
| openstackgerrit | Merged openstack-infra/project-config: ensure all projects syncing global requirements use check-requirements https://review.openstack.org/315761 | 15:11 |
| pabelanger | fungi: jeblair: any issues if I bring online the EPEL AFS mirror today? https://review.openstack.org/#/c/315620/ | 15:14 |
| *** nwkarsten has quit IRC | 15:14 | |
| pabelanger | fungi: jeblair: I still need to create the AFS bits for mirror.epel | 15:14 |
| *** nwkarsten has joined #openstack-infra | 15:15 | |
| *** rhochmuth has joined #openstack-infra | 15:15 | |
| *** esikachev has quit IRC | 15:16 | |
| *** kushal has quit IRC | 15:17 | |
| jeblair | pabelanger: no objection here | 15:17 |
| *** amitgandhinz has quit IRC | 15:17 | |
| openstackgerrit | chenying proposed openstack-infra/project-config: Add smaug fullstack job https://review.openstack.org/317566 | 15:17 |
| *** amitgandhinz has joined #openstack-infra | 15:17 | |
| anteaya | is anyone interested/available to help stand up a storyboard-dev server today? | 15:18 |
| anteaya | nibalizer tells me that parts are ready to go, he just has internal things he has to work on for the next few days | 15:19 |
| anteaya | https://review.openstack.org/#/c/312124/ | 15:19 |
| *** kushal has joined #openstack-infra | 15:20 | |
| *** nwkarsten has quit IRC | 15:20 | |
| *** jlanoux has quit IRC | 15:21 | |
| fungi | pabelanger: go for it | 15:22 |
| fungi | anteaya: i can try to boot one in a sec | 15:22 |
| clarkb | pabelanger: only thing I can think of is available disk but we should have plenty after we added the second volume | 15:23 |
| anteaya | fungi: thank you | 15:23 |
| openstackgerrit | Graham Hayes proposed openstack-infra/project-config: Add api-ref jobs to Designate https://review.openstack.org/317001 | 15:24 |
| *** mikelk has quit IRC | 15:24 | |
| *** ayoung has joined #openstack-infra | 15:28 | |
| *** yamamoto has joined #openstack-infra | 15:30 | |
| notmorgan | N/query greghaynes | 15:30 |
| notmorgan | ugh | 15:30 |
| *** Liuqing has joined #openstack-infra | 15:31 | |
| fungi | anteaya: nibalizer: Zara: SotK: i've got the storyboard-dev instance booting now. fingers crossed | 15:31 |
| anteaya | yay! \o/ | 15:31 |
| notmorgan | fungi: woot | 15:31 |
| * anteaya also crosses her fingers | 15:31 | |
| SotK | \o/ | 15:32 |
| SotK | thanks fungi | 15:32 |
| fungi | 4gb flavor, ubuntu trusty (14.04 lts) image | 15:32 |
| Zara | \o/ yay! :D | 15:32 |
| *** Swami has joined #openstack-infra | 15:32 | |
| anteaya | fungi: what flavour is the production instance on for comparison | 15:33 |
| anteaya | fungi: like when they load test the dev instance | 15:33 |
| *** dmk0202 has quit IRC | 15:33 | |
| fungi | anteaya: i used the same flavor as the memory utilization profile in production looked reasonable | 15:33 |
| anteaya | fungi: awesome, thank you | 15:33 |
| anteaya | so right now only difference between prod and dev is prod is on precise and dev is on trusty, yeah? | 15:34 |
| fungi | so modulo memory performance differences between precise and trusty (which are hopefully negligible) this should be capable of operating similarly to the production server | 15:34 |
| anteaya | great | 15:34 |
| fungi | hopefully deployment will only take a few more minutes before we find out whether it worked/broke | 15:35 |
| *** hamzy has quit IRC | 15:35 | |
| anteaya | cool | 15:35 |
| fungi | as long as it can bootstrap its puppet manifests to completion, the remaining issues can be solved through reviews and loading a sample dataset | 15:35 |
| anteaya | yay! | 15:36 |
| fungi | yay! looks like it worked. adding to dns in a moment | 15:36 |
| *** gyee has joined #openstack-infra | 15:36 | |
| anteaya | yay! | 15:36 |
| anteaya | I'm a yay bot | 15:36 |
| anteaya | yay! | 15:36 |
| pabelanger | fungi: AFS bits for https://review.openstack.org/#/c/315620 complete, do you mind reviewing | 15:37 |
| jeblair | !yay | 15:37 |
| Zara | :D | 15:37 |
| openstack | jeblair: Error: "yay" is not a valid command. | 15:37 |
| pabelanger | fungi: when you have spare cycles | 15:37 |
| anteaya | ha ha ha | 15:37 |
| pabelanger | or clarkb :) | 15:37 |
| *** rkukura has joined #openstack-infra | 15:38 | |
| *** jistr has quit IRC | 15:38 | |
| clarkb | ya I can review in a few | 15:38 |
| jeblair | i'm trying a different approach with zuul-launcher today -- i've pulled an idle node off of jenkins, set it to 'hold' in nodepool, and am manually assigning it to zuul-launcher | 15:38 |
| pabelanger | clarkb: also, the region-name for tripleo is 'regionOne' | 15:38 |
| jeblair | i'll manually run a job on it in a bit too | 15:38 |
| pabelanger | clarkb: keystone did list it | 15:38 |
| *** akshai has joined #openstack-infra | 15:38 | |
| pabelanger | jeblair: acl | 15:39 |
| pabelanger | ack* | 15:39 |
| *** nadya has joined #openstack-infra | 15:39 | |
| *** maishsk has quit IRC | 15:39 | |
| fungi | anteaya: nibalizer: Zara: SotK: forward/reverse dns is created now, so should be resolving for you now or within a few minutes | 15:39 |
| fungi | i'm able to ssh into it by name already | 15:39 |
| anteaya | fungi: ack | 15:39 |
| anteaya | yay | 15:39 |
| fungi | looks like we still need to add storyboard developer accounts for ssh access | 15:40 |
| fungi | was there an open review for them? | 15:40 |
| anteaya | http://storyboard-dev.openstack.org/ | 15:40 |
| anteaya | fungi: yes | 15:40 |
| anteaya | so far no dns for me | 15:40 |
| wznoinsk | any infra/zuul cores around? | 15:40 |
| SotK | fungi: https://review.openstack.org/#/c/316711/ | 15:40 |
| fungi | anteaya: my browser also says unable to connect, but i think it's that apache isn't running or something | 15:41 |
| anteaya | fungi: so after SotK is in users we can add him to https://review.openstack.org/#/c/315706/, which still needs some fixing , I welcome suggestions | 15:41 |
| pabelanger | wznoinsk: likely better just to ask your question then ask if a person is around | 15:41 |
| anteaya | fungi: ah okay | 15:41 |
| fungi | SotK: that makes your account details available for us to realize on a server, but i think we still need a realize stanza for you in the openstack_project::storyboard_dev class or something | 15:41 |
| fungi | hrm, there is no storyboard_dev class just storyboard | 15:42 |
| fungi | actually, there's no storyboard-dev server in here either http://git.openstack.org/cgit/openstack-infra/system-config/tree/manifests/site.pp | 15:43 |
| *** nadya has quit IRC | 15:43 | |
| wznoinsk | pabelanger sure thing, forgive if it's a basic question but it looks like my zuul prefers to run certain younger jobs rather than starting the 2nd job from an older set of jobs (same pipeline, same diskimage used so not a nodepool issue), am I missing something here maybe? | 15:43 |
| anteaya | fungi: yes, I hadn't added Adam yet to 315706 | 15:43 |
| *** cloudtrainme has joined #openstack-infra | 15:44 | |
| anteaya | fungi: I think this patch adds it: https://review.openstack.org/#/c/315706/ | 15:44 |
| fungi | aha, so when nibalizer said things were "ready to go" he just meant there were reviews open to implement this server, not that they were merged and i just needed to launch it? | 15:45 |
| anteaya | fungi: ah sorry | 15:45 |
| anteaya | I was just wanting a server | 15:45 |
| pabelanger | wznoinsk: same project? | 15:45 |
| wznoinsk | an example: http://pasteboard.co/ZCjBRxU.png | 15:45 |
| anteaya | I have fallen down as messenger | 15:45 |
| anteaya | yay server | 15:45 |
| wznoinsk | pabelanger yes | 15:45 |
| *** brucet has joined #openstack-infra | 15:45 | |
| anteaya | boo not proper patches in place | 15:45 |
| fungi | anteaya: yep, this is basically a blank slate server because we don't have any puppet additions for storyboard-dev merged yet | 15:46 |
| * anteaya notes she got to use the word 'proper' in a non facetious way | 15:46 | |
| anteaya | fungi: ah | 15:46 |
| anteaya | well yay for server | 15:46 |
| *** sridhar_ram has joined #openstack-infra | 15:46 | |
| e0ne | hi. could anybody help me with https://review.openstack.org/287938, please? | 15:46 |
| pabelanger | wznoinsk: we'd have to look at debug.log to see what is happening. But I would expect zuul to run a patchset from oldest to newest. But I am not 100% sure of that | 15:46 |
| *** lakshmiS has joined #openstack-infra | 15:46 | |
| openstackgerrit | Merged openstack-infra/openstackid-resources: Improved External Order Error https://review.openstack.org/308629 | 15:47 |
| e0ne | I don't understand why jenkins put -1 on it | 15:47 |
| fungi | anteaya: trying to burn through the open reviews for it now | 15:47 |
| anteaya | fungi: ack, standing by to fix or help as you instruct | 15:47 |
| wznoinsk | pabelanger: Zuul version: 2.1.1.dev149, I thought I may be missing some tunning setting I missed, I can upload the log somewhere if you like | 15:47 |
| *** dimtruck is now known as zz_dimtruck | 15:48 | |
| pabelanger | wznoinsk: Ya, if you look at the debug.log you can see why zuul is doing the things it is | 15:48 |
| clarkb | wznoinsk: pabelanger if those jobs started and failed in a known way that should be retried that may explain it | 15:48 |
| *** rhallisey has quit IRC | 15:48 | |
| clarkb | basically job starts in order, fails, gets rescheduled at end of queue | 15:48 |
| *** andreas_s has quit IRC | 15:48 | |
| wznoinsk | clarkb, pabelanger I will look into log looking for this | 15:49 |
| pabelanger | Right, I forgot about that | 15:49 |
| pabelanger | sure, feel free to PB the debug.log too for an extra set of eyes | 15:49 |
| openstackgerrit | Thierry Carrez proposed openstack-infra/irc-meetings: Bump yaml2ical to 0.6.1 https://review.openstack.org/317590 | 15:49 |
| openstackgerrit | Merged openstack-infra/system-config: Add Adam Coldrick to users https://review.openstack.org/316711 | 15:50 |
| *** |-paul-| has quit IRC | 15:50 | |
| *** kushal has quit IRC | 15:51 | |
| *** hongbin has joined #openstack-infra | 15:52 | |
| *** asselin__ has joined #openstack-infra | 15:52 | |
| *** bpokorny has joined #openstack-infra | 15:52 | |
| *** jlanoux has joined #openstack-infra | 15:52 | |
| jlvillal | Does 'recheck' verify again for merge conflicts? If my patch says it is in merge conflict, but when I checkout master and cherry-pick my patch I get no issues. | 15:53 |
| *** earlephilhower has joined #openstack-infra | 15:53 | |
| jlvillal | So wondering if I can do 'recheck' to force it to verify again if it is really in merge conflict. | 15:53 |
| jeblair | jlvillal: yes -- but also check whether it has any dependencies which might be in conflict. it's usually not wrong. | 15:54 |
| fungi | jlvillal: also be aware that zuul uses git merge --strategy=resolve in an attempt to approximate the limited merge conflict resolution capabilities of the java jgit library gerrit uses | 15:54 |
| jlvillal | jeblair: As in 'Depends-On' dependency? | 15:54 |
| *** brucet has quit IRC | 15:54 | |
| openstackgerrit | sebastian marcet proposed openstack-infra/openstackid: Upgrade to LV 5.2 https://review.openstack.org/305521 | 15:55 |
| fungi | jlvillal: yes, if zuul sees a merge conflict on anything in the depends-on chain it will complain about a merge conflict on the dependency too | 15:55 |
| jeblair | jlvillal: yes, though also git dependencies (which should generally not cause a conflict themselves, more or less by definition, though *they* may have Depends-On deps with conflicts) | 15:55 |
| *** asettle has quit IRC | 15:55 | |
| jlvillal | jeblair, fungi Thanks. I think I see the issue. I had a patch series (2 patches) and the first patch did change. | 15:56 |
| *** asselin has quit IRC | 15:56 | |
| jlvillal | Not sure if that would cause it, my guess is yes | 15:56 |
| *** Liuqing has quit IRC | 15:57 | |
| *** armax has joined #openstack-infra | 15:57 | |
| anteaya | fungi: you okay with me adding SotK to 315706 as well as updating the commit message on that patch as yolanda points out? | 15:58 |
| clarkb | pabelanger: at least with the ceph mirror I think I reused the existing principal for the deb mirrors | 15:58 |
| fungi | anteaya: i have that update staged and am about to push it | 15:58 |
| fungi | commit message clarification and all | 15:58 |
| openstackgerrit | Ihar Hrachyshka proposed openstack-infra/release-tools: Added tool to reset backport-potential tags once backports are merged https://review.openstack.org/295993 | 15:58 |
| *** gokrokve has joined #openstack-infra | 15:59 | |
| anteaya | fungi: thank you, thought you might | 15:59 |
| fungi | anteaya: also needed a rebase on the updated state of the parent change | 15:59 |
| * anteaya stands down | 15:59 | |
| anteaya | ah yes, makes sense | 15:59 |
| fungi | just waiting to make sure that gets a good result on the recheck | 15:59 |
| anteaya | yup, standing by | 15:59 |
| *** yamamoto has quit IRC | 15:59 | |
| nibalizer | fungi: ooops! | 15:59 |
| fungi | i'm pretty sure it's fine, but don't want to rebase twice if not | 15:59 |
| anteaya | fungi: agreed | 15:59 |
| nibalizer | i should have said that i think hiera is figured out | 15:59 |
| clarkb | I am not sure we need a new keytab/principal for every single volume | 16:00 |
| nibalizer | so if the patch landed launch node should work | 16:00 |
| anteaya | nibalizer: well you kind of told me that but I didn't understand enough to relay that bit | 16:00 |
| *** cloudtrainme has quit IRC | 16:00 | |
| anteaya | so I stuck with 'can I get a storyboard-dev server' it has a nice ring to it | 16:00 |
| *** yamamoto has joined #openstack-infra | 16:01 | |
| bdemers | dougwig: you mentioned at the summit that in your a10-ci repo, you had a project config that was using an array as an arg to a job config ? | 16:01 |
| bdemers | (we were chatting about building multiple branches, if that helps you remember) | 16:01 |
| *** zz_dimtruck is now known as dimtruck | 16:02 | |
| *** savihou has quit IRC | 16:02 | |
| bdemers | with the goal of basically running py27,34 against multiple configurations | 16:02 |
| fungi | when did we make gate-infra-puppet-apply-debian-jessie voting? it looks totally busted (didn't even upload a console log) | 16:02 |
| anteaya | pabelanger: I think that was your patch yes? | 16:03 |
| anteaya | was that last week? | 16:03 |
| clarkb | fungi: when we added the image I think since all it tests is we can apply puppet for the slaves on those images iirc | 16:03 |
| jeblair | fungi: it's possible a job that failed yesterday without a console log was due to me | 16:03 |
| *** brucet_ has joined #openstack-infra | 16:04 | |
| fungi | jeblair: this one insta-failed just now (my recheck is still running other jobs in the check pipeline) | 16:04 |
| pabelanger | fungi: Ya, it has been passing regularly | 16:04 |
| jeblair | (also, i am using it to test zuul-launcher now, but that should not be visible) | 16:04 |
| jeblair | fungi: oh, it's possible that was me | 16:04 |
| fungi | hrm | 16:05 |
| *** kushal has joined #openstack-infra | 16:05 | |
| pabelanger | clarkb: Ya, I created new credentials for epel. I think I am going to revert that and maybe condense centos / epel into an rpm-mirror user | 16:05 |
| jeblair | sorry about that -- i chose a job that i figured was unlikely to have too many contenders | 16:05 |
| *** cody-somerville has joined #openstack-infra | 16:05 | |
| *** cody-somerville has quit IRC | 16:05 | |
| *** cody-somerville has joined #openstack-infra | 16:05 | |
| jeblair | fungi: ah, i have an idea of how to avoid that -- i'll change the label i'm using, so hopefully it won't run any real jobs | 16:06 |
| fungi | jeblair: ahh, no worries. just trying to get these storyboard-dev patches in shape so i can have teh server reachable for the mancheser sprinters | 16:06 |
| fungi | jeblair: for reference, it was 24/312124/4/check/gate-infra-puppet-apply-debian-jessie/678fb7c | 16:06 |
| jeblair | fungi: yep, that ran on my node. sorry :( | 16:06 |
| *** nmagnezi has quit IRC | 16:07 | |
| *** sdague has quit IRC | 16:07 | |
| fungi | just glad we don't have some other unknown new failure mode | 16:07 |
| * anteaya hands out manchester sprinter jerseys to those round the table | 16:07 | |
| *** cloudtrainme has joined #openstack-infra | 16:08 | |
| anteaya | though I have to admit the better characterization is manchester sweet consumers while sitting in a loft room with a nice breeze | 16:09 |
| anteaya | but that is hard to fit on a jersey | 16:09 |
| anteaya | need a very small font | 16:09 |
| fungi | i think we're still having serious fip leaks | 16:10 |
| anteaya | :( | 16:11 |
| pabelanger | fungi: yes, I delete some FIPs this morning | 16:11 |
| fungi | seems like as soon as we remove floating ips in osic, it fills right back up again | 16:11 |
| fungi | it was working great for a while... did we change something in shade again? | 16:12 |
| clarkb | fungi: I want to say they upgraded the osic cloud, possibly new interaction between shade and new neutron | 16:13 |
| kashyap | clarkb: When you get a sec, seems like 'gate64' CPU model (remember adding that to devstack-gate? :-)) seems to be not detected in this job -- http://logs.openstack.org/03/315703/1/experimental/gate-tempest-dsvm-multinode-live-migration/1288a98/logs/screen-n-cpu.txt.gz?level=TRACE#_2016-05-13_21_32_30 | 16:13 |
| kashyap | (That's the change where it ('gate64') was defined) -- https://review.openstack.org/#/c/168407/) | 16:13 |
| fungi | clarkb: oh, yep the timing does correspond loosely to their kilo->liberty upgrade | 16:13 |
| * kashyap is about to step out, will get in a few hours and then check scroll. Or in the morning. | 16:14 | |
| clarkb | kashyap: yes we know someone was looking into it | 16:14 |
| clarkb | kashyap: earlier assumptions were that maybe libvirt changed where it looked for the models or the model as defined is invalid | 16:14 |
| clarkb | kashyap: someone will need to take xenail libvirt and sort it out | 16:14 |
| kashyap | Okay. Is there a ticket / bug that is tracking this? | 16:14 |
| clarkb | no, not yet we don't have more information that "it fails" | 16:15 |
| kashyap | Okay, this came up in today's live-migration meeting, and I volunteered for an action item to follow up with you. Good that you already have noticed it. :-) | 16:15 |
| *** nwkarsten has joined #openstack-infra | 16:16 | |
| *** nwkarsten has quit IRC | 16:16 | |
| *** degorenko is now known as _degorenko|afk | 16:16 | |
| openstackgerrit | Ihar Hrachyshka proposed openstack-infra/release-tools: Added tool to filter out bugs with specific tag https://review.openstack.org/296454 | 16:16 |
| openstackgerrit | Ihar Hrachyshka proposed openstack-infra/release-tools: Add tool that annotates bug numbers with details from LP https://review.openstack.org/296470 | 16:16 |
| openstackgerrit | Ihar Hrachyshka proposed openstack-infra/release-tools: Added tool to filter out bugs of specified importance https://review.openstack.org/296421 | 16:16 |
| openstackgerrit | Ihar Hrachyshka proposed openstack-infra/release-tools: Added tool to scan project repo for new bug fixes in master https://review.openstack.org/296420 | 16:16 |
| *** nwkarsten has joined #openstack-infra | 16:16 | |
| *** thiagop is now known as thiagop-afk | 16:17 | |
| *** maishsk has joined #openstack-infra | 16:17 | |
| *** rhallisey has joined #openstack-infra | 16:17 | |
| *** rhochmuth has quit IRC | 16:17 | |
| *** matrohon has quit IRC | 16:18 | |
| openstackgerrit | Merged openstack-infra/system-config: Add EPEL mirror https://review.openstack.org/315620 | 16:19 |
| clarkb | kashyap: the only reason that exists is to make live migration work, it would be most excellent if the individuals caring for live migration could figure it out | 16:21 |
| openstackgerrit | Merged openstack-infra/jenkins-job-builder: Add support for Jenkins OpenStack Cloud Plugin https://review.openstack.org/306948 | 16:21 |
| *** jtomasek has quit IRC | 16:22 | |
| anteaya | fungi: as a time frame, I'm about 30 minutes away from needing to leave for my agreed upon dinner appointment | 16:22 |
| anteaya | fungi: if I disappear from channel, know that spritually and emotionally I'm still here supporting the work | 16:23 |
| anteaya | go you! | 16:23 |
| fungi | anteaya: yep, floating ip leak situation is slowing down check results and i'm waiting on this failure to age out before i can recheck it | 16:23 |
| *** yamamoto has quit IRC | 16:23 | |
| fungi | sorry about that | 16:23 |
| anteaya | fungi: understood | 16:23 |
| anteaya | fungi: don't apologize for normal working conditions | 16:23 |
| anteaya | yay that you are able to shepard the server | 16:23 |
| *** yamamoto has joined #openstack-infra | 16:24 | |
| wznoinsk | pabelanger, clarkb: ok it looks like the jobs are failing hence they're rescheduled at the end of the queue, thanks for the hint.... | 16:24 |
| anteaya | thank you | 16:24 |
| fungi | it's still waiting for node assignment on over half its jobs after 22 minutes | 16:24 |
| anteaya | fungi: yup | 16:24 |
| *** jordanP has quit IRC | 16:24 | |
| anteaya | not rushing, just wanted to explain my impending absence in advance | 16:24 |
| fungi | looks like it finally got assignments for everything besides trusty | 16:24 |
| anteaya | yay! | 16:25 |
| clarkb | fungi: is bluebox also leaking more quickly? bluebox has not been updated to newer openstack yet aiui | 16:26 |
| fungi | i'm not holding my breath though. there are changes in check waiting 2.5 hours for a trusty node assignment so far | 16:26 |
| clarkb | comparing the two might help narrow down where the issue is | 16:26 |
| anteaya | fungi: yup | 16:27 |
| kashyap | clarkb: Okay, will spend sometime tomorrow in the morning. I only learned today the word 'Xenial' means Ubuntu 16.04 LTS :-) Me and a couple of others were thinking it's a project named as play on the 'Xen' hypervisor. | 16:27 |
| fungi | clarkb: when i cleaned up leaked fips in bluebox yesterday they didn't seem to _immediately_ return, but i'll try again | 16:27 |
| *** Apoorva has joined #openstack-infra | 16:27 | |
| *** doug-fis_ has quit IRC | 16:28 | |
| BobBall | kashyap: Have you seen http://www.channelpro.co.uk/advice/9797/amd-zen-a-serious-challenge-to-intel-4? Next year you'll be able to run OpenStack on Xenial on Xen on Zen... | 16:28 |
| *** e0ne has quit IRC | 16:28 | |
| anteaya | BobBall: oooooooh | 16:28 |
| anteaya | nice | 16:28 |
| * kashyap really wraps up for the day, on that note :-0 | 16:28 | |
| kashyap | BobBall: Cool | 16:28 |
| BobBall | It hurts my head. | 16:29 |
| anteaya | ha ha ha | 16:29 |
| kashyap | Guess I tripped off your IRC alert system by mentioning Xen | 16:29 |
| anteaya | it is supposed to bring peace to your heart | 16:29 |
| BobBall | yes. I need to set up regular expression highlighting in irssi :P Too many people talking about xenial these days ;) | 16:29 |
| *** yamamoto has quit IRC | 16:29 | |
| *** ajmiller has quit IRC | 16:29 | |
| anteaya | BobBall: and it will only get worse | 16:30 |
| *** yamamoto has joined #openstack-infra | 16:30 | |
| kashyap | BobBall: Hehe, that worsened it | 16:30 |
| *** ajmiller has joined #openstack-infra | 16:30 | |
| * BobBall forces himself to listen to "Always look on the bright side of life" until he calms down | 16:30 | |
| *** hongbin_ has joined #openstack-infra | 16:30 | |
| anteaya | BobBall: does that help? | 16:31 |
| *** kushal has quit IRC | 16:31 | |
| clarkb | kashyap: it would be neat if nova could just boot instances with an lcd of all its known hypervisors cpu flags | 16:31 |
| clarkb | but that might be too restrictive in some envs | 16:31 |
| BobBall | Sometimes, when I'm lucky. | 16:32 |
| *** trown is now known as trown|lunch | 16:32 | |
| *** yamamoto has quit IRC | 16:32 | |
| *** hongbin has quit IRC | 16:32 | |
| *** cloudtrainme has quit IRC | 16:32 | |
| clarkb | however if cloud knows they want live migration to function it is almost required to do that | 16:32 |
| openstackgerrit | Vasyl Saienko proposed openstack-infra/project-config: Set IPXE disabled for grenade-ironic https://review.openstack.org/317615 | 16:32 |
| openstackgerrit | Vasyl Saienko proposed openstack-infra/project-config: Disable IPXE for grenade-ironic https://review.openstack.org/317615 | 16:32 |
| kashyap | clarkb: Yeah, I hear you -- to use the lowest common denominator topic came up in the meeting too. As oppoesd to the current hard-coding in the gateGate. | 16:32 |
| *** kushal has joined #openstack-infra | 16:33 | |
| *** brucet_ has quit IRC | 16:33 | |
| openstackgerrit | James E. Blair proposed openstack-infra/puppet-zuul: Remove quotes from zuul.conf launcher sites https://review.openstack.org/317617 | 16:33 |
| zaro | morning | 16:34 |
| *** brucet_ has joined #openstack-infra | 16:34 | |
| anteaya | morning zaro | 16:34 |
| openstackgerrit | Ben Nemec proposed openstack-infra/tripleo-ci: TEST: Delete the overcloud when finished https://review.openstack.org/297328 | 16:37 |
| openstackgerrit | Ben Nemec proposed openstack-infra/tripleo-ci: Revert "Test with latest master heat" https://review.openstack.org/309051 | 16:37 |
| openstackgerrit | Ben Nemec proposed openstack-infra/tripleo-ci: Test overcloud deletion in periodic job https://review.openstack.org/296765 | 16:37 |
| *** akaszuba has quit IRC | 16:37 | |
| *** rhochmuth has joined #openstack-infra | 16:37 | |
| openstackgerrit | Khai Do proposed openstack-infra/project-config: add a build job for Gerrit importer plugin https://review.openstack.org/317223 | 16:37 |
| openstackgerrit | Vasyl Saienko proposed openstack-infra/project-config: Enable IPXE for grenade-ironic https://review.openstack.org/317615 | 16:37 |
| *** yaume has quit IRC | 16:40 | |
| *** _ari_ has quit IRC | 16:41 | |
| *** doug-fish has joined #openstack-infra | 16:41 | |
| *** brucet_ has quit IRC | 16:41 | |
| openstackgerrit | Adam Coldrick proposed openstack-infra/storyboard: Fix and extend the object model documentation https://review.openstack.org/317620 | 16:41 |
| *** cloudtrainme has joined #openstack-infra | 16:42 | |
| zaro | fungi: Gerrit 2.11.9 was just released. Would you be able to create an 'openstack/2.11.9' branch in openstack-infra/gerrit repo? should be based off of http://git.openstack.org/cgit/openstack-infra/gerrit/tag/?h=v2.11.9 | 16:43 |
| *** kushal has quit IRC | 16:43 | |
| fungi | zaro: done | 16:44 |
| clarkb | zaro: any chance that includes the event emission fix you wrote? | 16:45 |
| *** derekh has quit IRC | 16:46 | |
| zaro | clarkb: unfortunately not. that was a semi-big change and can't cherry pick either. will need to wait for 2.12 | 16:46 |
| zaro | fungi: thanks! | 16:46 |
| *** yamamoto has joined #openstack-infra | 16:46 | |
| clarkb | darn | 16:47 |
| anteaya | :( | 16:47 |
| openstackgerrit | Kiall Mac Innes proposed openstack-infra/project-config: Set Designate+Tempest on Mitaka jobs as voting https://review.openstack.org/317623 | 16:47 |
| fungi | clarkb: pabelanger: 15 stale disassociated fips in bluebox, 54 in osic | 16:48 |
| fungi | i'm deleting them now | 16:48 |
| anteaya | thank you | 16:48 |
| *** tphummel has joined #openstack-infra | 16:49 | |
| *** heyongli has quit IRC | 16:50 | |
| *** heyongli has joined #openstack-infra | 16:52 | |
| *** armax_ has joined #openstack-infra | 16:52 | |
| mfisch | fungi: yo | 16:54 |
| mfisch | fungi: I think it's this guy causing the bounces | 16:54 |
| mfisch | X-MS-Exchange-Inbox-Rules-Loop: tgreenyc@outlook.com | 16:54 |
| *** armax has quit IRC | 16:54 | |
| *** armax_ is now known as armax | 16:54 | |
| sc68cal | mfisch: stay classy outlook | 16:55 |
| mfisch | every bounce header I have has his email in it | 16:55 |
| mfisch | I pinged him last week, no reply | 16:55 |
| mfisch | lets have an admin find him on every openstack ML and remove him | 16:56 |
| mfisch | https://twitter.com/tgreenyc | 16:56 |
| mfisch | vmware | 16:56 |
| mfisch | works at pivotal | 16:56 |
| zxiiro | electrofelix: So what's the plan for a 1.6.0 release? can we get one this week? | 16:57 |
| raildo | fungi: hey, if you have some time, can you take a look on this patch, just to see if you agree with this method to change this job https://review.openstack.org/#/c/313588/ | 16:57 |
| *** abregman has joined #openstack-infra | 16:57 | |
| raildo | fungi: I want to make similar work for the other jobs | 16:57 |
| *** abe_music has joined #openstack-infra | 16:57 | |
| anteaya | me attending the infra meeting today is 50/50, I don't think I have any agenda items up | 16:58 |
| *** jogo has quit IRC | 16:58 | |
| clarkb | raildo: you will also want to exclude liberty and mitaka. | 16:58 |
| *** jogo has joined #openstack-infra | 16:59 | |
| *** psilvad has joined #openstack-infra | 16:59 | |
| raildo | clarkb: ++ | 16:59 |
| fungi | mfisch: your eyes are keener than mine... so it's a subscriber at outlook.com forwarding to a filtered group at googlegroups.com which is then bouncing back to the original sender | 17:00 |
| fungi | icky | 17:00 |
| mfisch | yeah | 17:00 |
| mfisch | I reached out to him on twitter I dont see him here | 17:00 |
| *** piet has joined #openstack-infra | 17:00 | |
| *** gyee has quit IRC | 17:00 | |
| mfisch | i thought it was just me last week | 17:00 |
| *** hongbin_ has quit IRC | 17:01 | |
| *** hongbin has joined #openstack-infra | 17:01 | |
| *** claudiub has quit IRC | 17:01 | |
| *** javeriak has joined #openstack-infra | 17:01 | |
| *** lucasagomes is now known as lucas-dinner | 17:02 | |
| *** dtantsur is now known as dtantsur|afk | 17:03 | |
| fungi | mfisch: honestly, when i post to a lot of our lists i get random backscatter from semi-broken subscribers (out of office/vacation notices, authorization failures, et cetera). mailman does a pretty good job of auto-unsubscribing any accounts who bounce back to the listserv itself, but if their mailservers try to be "smart" and figure out a pre-list originator to whom to reply it misses that | 17:03 |
| fungi | opportunity | 17:03 |
| anteaya | fungi: I have to leave now | 17:03 |
| *** doug-fish has quit IRC | 17:03 | |
| anteaya | thank you for all the help | 17:03 |
| fungi | have a good dinner, anteaya! | 17:03 |
| anteaya | I'll try to check back in later tonight | 17:03 |
| anteaya | fungi: thanks | 17:03 |
| clarkb | fungi: the subject on http://lists.openstack.org/pipermail/openstack/2016-May/016191.html is one of my favorites all time | 17:04 |
| *** javeriak_ has joined #openstack-infra | 17:04 | |
| *** doug-fish has joined #openstack-infra | 17:04 | |
| *** anteaya has quit IRC | 17:04 | |
| clarkb | [SUSPECTED SPAM] OMG it's true | 17:04 |
| fungi | so accurate | 17:04 |
| jeblair | pabelanger, Shrews: https://github.com/ansible/ansible/issues/13323#issuecomment-214553006 i think i'm seeing this | 17:04 |
| *** javeria__ has joined #openstack-infra | 17:05 | |
| jeblair | pabelanger, Shrews: http://paste.openstack.org/show/497389/ | 17:05 |
| *** javeriak has quit IRC | 17:05 | |
| jeblair | note "...FOR USER: None" | 17:05 |
| jeblair | pabelanger, Shrews: that's setting "delegate_to" and "remote_user" on the task | 17:06 |
| jeblair | pabelanger, Shrews: http://paste.openstack.org/show/497390/ | 17:06 |
| *** nwkarsten has quit IRC | 17:07 | |
| *** doug-fis_ has joined #openstack-infra | 17:07 | |
| jeblair | pabelanger, Shrews: i'm going to try adding static.openstack.org to the inventory to fix it. i think that should be an okay fix because we write the playbook as 'hosts: node'. though still, it scares me slightly to do so. | 17:08 |
| *** nwkarsten has joined #openstack-infra | 17:08 | |
| *** sshnaidm has quit IRC | 17:08 | |
| *** doug-fish has quit IRC | 17:08 | |
| *** gyee has joined #openstack-infra | 17:08 | |
| clarkb | if it is in the inventory and the ssh key is valid what protects it from random job things? | 17:08 |
| *** javeriak_ has quit IRC | 17:09 | |
| jeblair | clarkb: that bit about us writing the inventory as specifying 'hosts: node' | 17:09 |
| clarkb | you mean playbook? | 17:09 |
| *** cody-somerville has quit IRC | 17:09 | |
| jeblair | clarkb: yeah sorry | 17:09 |
| *** cody-somerville has joined #openstack-infra | 17:10 | |
| *** cody-somerville has joined #openstack-infra | 17:10 | |
| jeblair | this is something that i think should be okay in v2.5, but could be more problematic in v3 | 17:10 |
| wznoinsk | what does infra use to monitor their infrastructure hosts (cpu, memory, space, network) ? I'm thinking of dstat but not sure how to graph it on the web for easier eyeballing | 17:10 |
| *** eeiden has quit IRC | 17:10 | |
| clarkb | wznoinsk: currently cacti for those things | 17:11 |
| clarkb | wznoinsk: http://cacti.openstack.org | 17:11 |
| jeblair | pabelanger, Shrews, clarkb: and yes, having it just be in the inventory is enough to get it to pay attention to the parameter in the playbook task (i didn't even need to set the user in the inventory) | 17:11 |
| *** earlephilhower has quit IRC | 17:11 | |
| clarkb | wznoinsk: in the jobs themselves you can setup dstat and devstack does this for us on many jobs | 17:11 |
| *** doug-fis_ has quit IRC | 17:12 | |
| *** nwkarsten has quit IRC | 17:12 | |
| *** rhochmuth1 has joined #openstack-infra | 17:12 | |
| *** rhochmuth has quit IRC | 17:12 | |
| *** jerryz has joined #openstack-infra | 17:12 | |
| wznoinsk | clarkb: I've got nagios deployed so I'll be trying a plugin for dstat for this monitoring framework, does cacti only parse the logfiles of always running dstat on the hosts? | 17:13 |
| *** dmsimard has quit IRC | 17:13 | |
| *** doug-fish has joined #openstack-infra | 17:13 | |
| fungi | wznoinsk: cacti only makes snmp requests and records the data those return | 17:13 |
| *** Goneri has quit IRC | 17:13 | |
| *** rhochmuth1 has quit IRC | 17:14 | |
| clarkb | ours is setup to poll snmp every 5 minutes | 17:14 |
| *** rhochmuth has joined #openstack-infra | 17:14 | |
| fungi | wznoinsk: so if you have a custom snmp mib for dstat, then we might be able to set it up to poll that data | 17:14 |
| *** kushal has joined #openstack-infra | 17:14 | |
| fungi | wznoinsk: but cacti doesn't parse any logs | 17:14 |
| *** jlanoux has quit IRC | 17:16 | |
| *** shashank_hegde has joined #openstack-infra | 17:16 | |
| *** dmsimard has joined #openstack-infra | 17:16 | |
| clarkb | fungi: we appear to be leaking in bluebox fairly quickly but not at the same rate as osic | 17:17 |
| clarkb | possibly due to difference in total quotas (we can spin up about 1/3 the number of machines in bb as osic at any time) | 17:18 |
| fungi | clarkb: yeah, no new stale floating ips in bluebox yet, but 21 new stale floating ips in osic just minutes after i cleaned them up | 17:18 |
| *** jlanoux has joined #openstack-infra | 17:18 | |
| *** Goneri has joined #openstack-infra | 17:18 | |
| clarkb | maybe we should just ask for ipv6 everywhere and stop ipv4ing completely :/ | 17:18 |
| clarkb | unfortunatley then we los eall the clouds | 17:19 |
| *** inc0 has quit IRC | 17:20 | |
| *** zz_ja is now known as zz_zz_ja | 17:20 | |
| fungi | lots of boot errors in obh-bhs1 too... "OpenStackCloudException: Error in creating the server." | 17:21 |
| *** maishsk has quit IRC | 17:22 | |
| clarkb | fungi: no valid hosts found? | 17:22 |
| fungi | the traceback doesn't say | 17:22 |
| fungi | might be masking the exception | 17:22 |
| clarkb | we were hitting those last week, I htink that just means they don't have the capacity for us there | 17:22 |
| *** earlephilhower has joined #openstack-infra | 17:22 | |
| fungi | and we're over quota in rax-ord somehow... "OpenStackCloudException: Error in creating instance (Inner Exception: Quota exceeded for instances, ram: Requested 1, 8192, but already used 200, 1638400 of 200, 1638400 instances, ram (HTTP 403) (Request-ID: req-5b75e88d-407d-41ed-9b07-8474c6d73a23)) | 17:22 |
| clarkb | was hoping it was transient but if it persists we should probably contact them andfigure out what has happend since iirc we have dedicated hosts with our own flavor. Maybe a hypervisor or two are down | 17:23 |
| clarkb | fungi: for that I think it may be related to multinode if we don't account for the usbnodes properly | 17:23 |
| clarkb | but I hvaen't managed to investigate it at all and that is just a hunch | 17:23 |
| *** jlanoux has quit IRC | 17:23 | |
| jeblair | clarkb: we at least try to | 17:24 |
| jeblair | clarkb: perhaps there is a bug, but it is at least not the case that we didn't just forget to account for them in the allocator :) | 17:24 |
| jeblair | it might be related to all the stop/starts i did yesterday | 17:24 |
| clarkb | gotcha | 17:24 |
| clarkb | jeblair: rax-ord has been doing that for a couple weeks | 17:24 |
| clarkb | pabelanger noticed a little while ago | 17:24 |
| *** tosky has quit IRC | 17:25 | |
| fungi | if that's the case, it's a lot of multinode hosts. we have 162 nodes reported by nodepool list there at the moment and 18 with 2-node in the name | 17:25 |
| *** johnny__ has joined #openstack-infra | 17:25 | |
| fungi | and we have enough ram quota for 200 | 17:25 |
| *** rhochmuth has quit IRC | 17:25 | |
| *** Jeffrey4l has quit IRC | 17:26 | |
| *** sambetts is now known as sambetts|afk | 17:26 | |
| Kiall | Hey folks, a tiny review to set some new jobs as voting? https://review.openstack.org/#/c/317623/ - we've got some changes up at the moment which these are catching and failing (failing correctly) with :) | 17:26 |
| *** electrofelix has quit IRC | 17:27 | |
| clarkb | fungi: jeblair another possibility is bug in usage accounting nova side | 17:27 |
| clarkb | I know quotas are traditionally problematic in nova | 17:27 |
| fungi | checking the theory | 17:28 |
| openstackgerrit | Raildo Mascena proposed openstack-infra/project-config: Run novaclient functional tests in Identity v3-only https://review.openstack.org/313588 | 17:29 |
| *** flepied has joined #openstack-infra | 17:29 | |
| *** _ari_ has joined #openstack-infra | 17:30 | |
| *** weshay_mtg is now known as weshay | 17:30 | |
| *** cloudtra_ has joined #openstack-infra | 17:31 | |
| openstackgerrit | Khai Do proposed openstack-infra/system-config: Schedule Gerrit garbage collection https://review.openstack.org/317637 | 17:31 |
| *** nadya has joined #openstack-infra | 17:31 | |
| fungi | weird. if i export OS_CLIENT_CONFIG_FILE=/etc/openstack/all-clouds.yaml OS_CLOUD=openstackjenkins-rax OS_REGION=ORD then openstack server list returns instances from dfw not ord | 17:31 |
| clarkb | fungi: OS_REGION_NAME is the flag iirc | 17:32 |
| clarkb | or --os-region-name as an arg | 17:32 |
| fungi | gah, then our documentation is wrong https://git.openstack.org/cgit/openstack-infra/system-config/tree/launch/README#n18 | 17:32 |
| clarkb | fungi: no the docs there are correct | 17:33 |
| *** cloudtrainme has quit IRC | 17:33 | |
| fungi | what's the difference between OS_REGION and OS_REGION_NAME? | 17:33 |
| clarkb | fungi: in those docs we don't use openstackclient it is substituting that var on the command line for the launch command | 17:33 |
| clarkb | openstackclient has its own set of args and env vars that it respects | 17:33 |
| fungi | gah, you're right | 17:34 |
| *** IlyaG has joined #openstack-infra | 17:34 | |
| clarkb | unfortuantely most of the other clients used OS_REGION and openstackclient made it OS_REGION_NAME | 17:34 |
| clarkb | double unfortunately is that we kept the OS_* prefix for everything when openstackclient in theory implies openstack :) | 17:34 |
| jeblair | i can see the arg for env vars but not command line | 17:34 |
| *** Sukhdev has joined #openstack-infra | 17:35 | |
| *** nadya has quit IRC | 17:35 | |
| jeblair | openstack --openstack=openstack | 17:35 |
| *** tonytan4ever has joined #openstack-infra | 17:35 | |
| *** psachin has quit IRC | 17:36 | |
| clarkb | fungi: if we want one set of vars that we need to set we could normalize those docs though. Just change what vars we substitute in the later commands | 17:36 |
| fungi | accounting from the nova api seems to match nodepool's view of the situation | 17:36 |
| jeblair | clarkb: ++ | 17:36 |
| *** pilgrimstack has quit IRC | 17:37 | |
| *** salv-orl_ has joined #openstack-infra | 17:37 | |
| *** Sukhdev has quit IRC | 17:37 | |
| *** javeriak has joined #openstack-infra | 17:38 | |
| clarkb | ya OS_ as an env var prefix makes esnse if you worry about collisions with other vars, they only make sense on the cli flags when you consider the mapping between those and the env vars | 17:38 |
| clarkb | I am guessing the oslo.config makes that automagic so not easy to do it the way eg pip does it | 17:38 |
| zaro | clarkb: would you be able to help here? http://logs.openstack.org/75/316175/3/check/gate-puppet-gerrit-puppet-beaker-rspec-ubuntu-trusty/58cf329/console.html | 17:38 |
| *** javeria__ has quit IRC | 17:39 | |
| clarkb | zaro: let me see | 17:39 |
| *** amotoki has quit IRC | 17:39 | |
| zaro | clarkb: why is it trying to reference, 2.11.4-13-gcb9800e ? | 17:39 |
| zaro | i don't think that's available. | 17:39 |
| *** salv-orlando has quit IRC | 17:40 | |
| clarkb | zaro: http://logs.openstack.org/75/316175/3/check/gate-puppet-gerrit-puppet-beaker-rspec-ubuntu-trusty/58cf329/console.html#_2016-05-17_06_13_55_227 appears to be where it failed | 17:40 |
| *** kushal has quit IRC | 17:40 | |
| clarkb | zaro: it will use the war as specified in the puppet manifests | 17:40 |
| clarkb | zaro: the tests have their own manifest let me find it for you | 17:41 |
| openstackgerrit | Morgan Fainberg proposed openstack-infra/project-config: Add python3-testing to ldappool https://review.openstack.org/317646 | 17:41 |
| clarkb | zaro: https://git.openstack.org/cgit/openstack-infra/puppet-gerrit/tree/spec/acceptance/fixtures/default.pp that is what is used during testing | 17:41 |
| Shrews | jeblair: sorry, was out to lunch. looking now | 17:41 |
| *** banix has joined #openstack-infra | 17:42 | |
| ihrachys | fungi: you were somewhat involved in constraints right? | 17:42 |
| *** nadya has joined #openstack-infra | 17:42 | |
| clarkb | ihrachys: it was largely lifeless and Nakato, do you have a question? | 17:43 |
| *** hamzy has joined #openstack-infra | 17:43 | |
| ihrachys | clarkb: ah right, lifeless. yeah, I am trying to make python-neutronclient use constraints, and it fails in mystic way for me. | 17:43 |
| ihrachys | clarkb: I merely added -c... to install_command | 17:43 |
| clarkb | ah yes magnum ran into that too, I do not know what the resolution of their discussion with lifeless was | 17:44 |
| ihrachys | clarkb: but when initialize tox env, I get: Could not satisfy constraints for 'python-neutronclient': installation from path or url cannot be constrained to a version | 17:44 |
| clarkb | ihrachys: ya it complains about installing via a file or url specificatio nrather than just a package name iirc | 17:44 |
| ihrachys | clarkb: which does not happen when I e.g. remove usedevelop = True | 17:44 |
| clarkb | I do not know why | 17:44 |
| ihrachys | but... neutron has usedevelop = True, and it works | 17:44 |
| clarkb | yup | 17:44 |
| clarkb | ihrachys: let me see if Ican dig up the magnumclient change to see if there was explanation made there | 17:45 |
| clarkb | ihrachys: https://review.openstack.org/#/c/301541/ lifeless left a comment there | 17:45 |
| clarkb | apparently the issue is that magnumclient and neutronclient are both in the constraints file | 17:46 |
| clarkb | whereas neutron or magnum themselves rae not | 17:46 |
| ihrachys | clarkb: oh I now get how it fails :0 | 17:46 |
| fungi | yeah, you're installing from source and at the same time telling it to constrain to a specific version | 17:47 |
| ihrachys | clarkb: so we should grab the file, remove a line with sed, and then use the modified version? | 17:47 |
| clarkb | ihrachys: ya either remove it or modify it to be a file path uri for that specific dep | 17:47 |
| *** e0ne has joined #openstack-infra | 17:47 | |
| ihrachys | which would require some hack like in neutron-*aas with tox_install.sh :-| | 17:47 |
| * clarkb doesn't want to know what tox_install.sh is | 17:48 | |
| ihrachys | clarkb: :D | 17:48 |
| *** earlephilhower has quit IRC | 17:48 | |
| ihrachys | for the sake of scaring everyone http://git.openstack.org/cgit/openstack/neutron-lbaas/tree/tools/tox_install.sh | 17:48 |
| clarkb | fungi: so nova and nodepool bot hagree that we have less than 200 instances? | 17:49 |
| clarkb | fungi: in that case I do think it is likely a problem with our quota acocunting | 17:49 |
| *** hparekh has quit IRC | 17:50 | |
| *** mtanino has quit IRC | 17:51 | |
| clarkb | ihrachys: I am inclined tosay we should modify the line to be a file path since that is what devstack is doing and it works well | 17:52 |
| clarkb | rather than just remove it | 17:52 |
| *** hparekh has joined #openstack-infra | 17:52 | |
| *** sarob has joined #openstack-infra | 17:52 | |
| *** piet has quit IRC | 17:52 | |
| *** trown|lunch is now known as trown | 17:54 | |
| *** piet has joined #openstack-infra | 17:55 | |
| *** cody-somerville has quit IRC | 17:56 | |
| ihrachys | clarkb: ok, let me look at what I can do | 17:56 |
| fungi | clarkb: yes, so i agree with your earlier comment about nova's quota calculations lagging reality | 17:57 |
| fungi | if sdague were around i'd ask him for details there, but instead i'll pester mriedem | 17:58 |
| mriedem | issues with quotas in nova?! unpossible. | 17:59 |
| openstackgerrit | Andreas Florath proposed openstack/diskimage-builder: partitioning-parted: extraced and adapted element https://review.openstack.org/313938 | 18:01 |
| clarkb | fungi: another possile cause is we have leaked some other resource that isn't immediately clear but being factored in, however that razor from occam would imply buggy quota tracking is at fault | 18:01 |
| *** pvaneck has joined #openstack-infra | 18:01 | |
| *** akshai has quit IRC | 18:01 | |
| fungi | clarkb: it's complaining specifically about ram quota | 18:02 |
| *** claudiub has joined #openstack-infra | 18:02 | |
| *** sshnaidm has joined #openstack-infra | 18:02 | |
| *** nwkarsten has joined #openstack-infra | 18:02 | |
| openstackgerrit | yolanda.robla proposed openstack-infra/shade: Add magnum baymodel calls to shade. https://review.openstack.org/308009 | 18:02 |
| *** akshai has joined #openstack-infra | 18:03 | |
| *** vkramskikh_ has quit IRC | 18:03 | |
| *** sarob has quit IRC | 18:04 | |
| *** sarob has joined #openstack-infra | 18:04 | |
| *** pilgrimstack has joined #openstack-infra | 18:05 | |
| notmorgan | ugh. i know we're fighting spam in the wiki but it's blocking me from posting google urls for things like "RSVP forms" | 18:05 |
| notmorgan | :( | 18:05 |
| *** ihrachys has quit IRC | 18:05 | |
| clarkb | notmorgan: does it prevent it even when it isn't a proper link? | 18:06 |
| notmorgan | clarkb: i keep having to un-shorten it because i only had the twitter-fied link | 18:06 |
| notmorgan | clarkb: it blocks it in all cases with the google-shortened urls. | 18:06 |
| notmorgan | clarkb: it's minor, just realized what the problem was. | 18:06 |
| clarkb | clearly if you use a url shortener to link off site you are a spammer. Stop spamming notmorgan | 18:07 |
| * jeblair isn't sure that's a bug :) | 18:07 | |
| notmorgan | clarkb: lol :) | 18:07 |
| notmorgan | clarkb: clearly i'm a spammer then. | 18:07 |
| *** thiagop-afk is now known as thiagop | 18:08 | |
| *** abe_music has quit IRC | 18:08 | |
| openstackgerrit | Andreas Florath proposed openstack/diskimage-builder: [WIP] Add: lvm element https://review.openstack.org/316529 | 18:08 |
| openstackgerrit | Andreas Florath proposed openstack/diskimage-builder: partitioning-parted: extraced and adapted element https://review.openstack.org/313938 | 18:08 |
| *** asselin__ has quit IRC | 18:08 | |
| fungi | yeah, i'd rather see un-minified urls in published form anyway | 18:08 |
| fungi | seems less bug more feature to me | 18:08 |
| *** sarob has quit IRC | 18:09 | |
| *** _ari__ has joined #openstack-infra | 18:09 | |
| *** _ari_ has quit IRC | 18:10 | |
| *** inc0 has joined #openstack-infra | 18:12 | |
| openstackgerrit | Ildiko Vancsa proposed openstack-infra/irc-meetings: Add Cinder-Nova-API-interaction meeting series https://review.openstack.org/317038 | 18:12 |
| *** kzaitsev_mb has quit IRC | 18:13 | |
| *** doug-fis_ has joined #openstack-infra | 18:15 | |
| *** sarob has joined #openstack-infra | 18:15 | |
| clarkb | fungi: we will probably need to submit a ticket with rax for the quota thing, maybe double check the flavors are all 8GB first, would be odd to use bigger flavors on some instances but not impossible | 18:16 |
| *** inc0 has quit IRC | 18:16 | |
| * clarkb tries to figure out the flavor checking | 18:16 | |
| *** akshai has quit IRC | 18:16 | |
| *** _sarob has joined #openstack-infra | 18:16 | |
| *** mtanino has joined #openstack-infra | 18:18 | |
| notmyname | it doesn't look like today's -infra meeting has any golang-related stuff (https://wiki.openstack.org/wiki/Meetings/InfraTeamMeeting). is that correct? if so, I'll be happy to join. but if not, I'll get lunch before the TC meeting | 18:18 |
| notmyname | fungi: ^ | 18:18 |
| *** doug-fish has quit IRC | 18:18 | |
| clarkb | fungi: I count 184 instances of performance1-8 flavor | 18:18 |
| *** akshai has joined #openstack-infra | 18:18 | |
| clarkb | which lines up with the all instance count | 18:19 |
| *** inc0 has joined #openstack-infra | 18:19 | |
| clarkb | so ya probably ticket time | 18:20 |
| fungi | notmyname: that matches my understanding of the agenda. it wasn't a standing weekly topic so i removed it after last week's discussion | 18:20 |
| notmyname | fungi: ok, great. thanks | 18:20 |
| *** sarob has quit IRC | 18:20 | |
| fungi | notmyname: there was an ad-hoc meeting in #openstack-release about go-related stuff around 13:00 utc if you're interested, but that was mostly just bringing the release management team up to speed on the situation so far | 18:20 |
| e0ne | fungi: hi. could you please help with failed jobs on cinder? we don't have any idea why it fails:( | 18:20 |
| zaro | clarkb: i didn't notice, that change is going thru recheck. that job passed previously so i'm betting it will pass next time. | 18:21 |
| notmyname | fungi: yeah, I got that in buffer scrollback (and a brief summary from dhellmann). thanks | 18:22 |
| *** rossella_s has quit IRC | 18:23 | |
| *** rossella_s has joined #openstack-infra | 18:24 | |
| fungi | e0ne: that's not much to go on. can you elaborate? | 18:24 |
| *** sridhar_ram has quit IRC | 18:25 | |
| e0ne | fungi: https://review.openstack.org/#/c/287938/ - jenkins put -1. | 18:25 |
| clarkb | fungi: openstack server list --flavor performance1-8 fwiw | 18:25 |
| e0ne | gate-brick-cinderclient-ext-dsvm-functionalNOT_REGISTERED | 18:25 |
| fungi | e0ne: also i'm preparing my notes for chairing the infra team meeting in about 30 minutes, and want to be able to pay attention to the tc meeting after that, so i'm headed into a not-much-free-time zone | 18:25 |
| clarkb | fungi: pipe that through wc -l and compare against the output from server list without --flavor | 18:25 |
| fungi | e0ne: oh, that'll be an easy one to track down... just a sec | 18:25 |
| e0ne | fungi: i understand.. maybe somebody else will be able to help? | 18:26 |
| fungi | e0ne: i definitely don't see a job named gate-brick-cinderclient-ext-dsvm-functional registered in zuul's gearman | 18:26 |
| fungi | e0ne: looking now to see if it should be there according to the config | 18:27 |
| e0ne | fungi: here is my patch with that job https://review.openstack.org/#/c/265925/ | 18:27 |
| fungi | oh, the admin status command isn't returning quickly for me. that's why | 18:27 |
| *** cody-somerville has joined #openstack-infra | 18:28 | |
| *** vkramskikh_ has joined #openstack-infra | 18:28 | |
| e0ne | fungi: I'm sorry, I don't understand what do you mean | 18:28 |
| fungi | e0ne: i've fallen back to troubleshooting the troubleshooting | 18:29 |
| e0ne | oh.. | 18:29 |
| *** KaiyanSheng has joined #openstack-infra | 18:30 | |
| *** baoli_ has quit IRC | 18:30 | |
| *** rcernin has quit IRC | 18:31 | |
| KaiyanSheng | Hi All, can I get some reviews for https://review.openstack.org/#/c/316293/ please? This review is about adding monasca tempest tests to all the monasca projects as non-voting for now. | 18:33 |
| fungi | e0ne: so it looks like https://review.openstack.org/265925 added that and merged last friday | 18:33 |
| fungi | e0ne: when did it start failing like that? | 18:33 |
| *** tphummel_ has joined #openstack-infra | 18:34 | |
| e0ne | fungi: we don't have a lot of patches to that project, looks like my is a first and only one is created and apprroved after the job is merged | 18:35 |
| *** tphummel has quit IRC | 18:35 | |
| *** tphummel_ is now known as tphummel | 18:35 | |
| *** rhallisey has quit IRC | 18:35 | |
| *** rhallisey has joined #openstack-infra | 18:36 | |
| e0ne | fungi: I've created one more patch https://review.openstack.org/#/c/317668/ | 18:37 |
| fungi | looking on jenkins01 the job is definitely there and configured in /var/lib/jenkins/jobs/gate-brick-cinderclient-ext-dsvm-functional (updated May 13 09:00 utc) | 18:37 |
| *** salv-orl_ has quit IRC | 18:37 | |
| fungi | not sure yet why it's not registered in gearman | 18:37 |
| e0ne | it's still: gate-brick-cinderclient-ext-dsvm-functional: NOT_REGISTERED | 18:38 |
| fungi | yeah | 18:38 |
| *** rockyg has joined #openstack-infra | 18:38 | |
| *** nadya has quit IRC | 18:39 | |
| e0ne | did I miss anything in https://review.openstack.org/265925? | 18:39 |
| fungi | not that i can tell | 18:39 |
| fungi | i'm still digging | 18:39 |
| *** tphummel has quit IRC | 18:39 | |
| e0ne | thank you for the help. I appreciate it | 18:40 |
| fungi | i'm starting to think we've got something wrong with jenkins or zuul | 18:40 |
| fungi | wonder if any other jobs added since friday are experiencing similar lack of registration | 18:41 |
| *** whoops has quit IRC | 18:42 | |
| *** akshai has quit IRC | 18:43 | |
| *** tphummel has joined #openstack-infra | 18:43 | |
| openstackgerrit | Hongbin Lu proposed openstack-infra/project-config: Disable python3 for old branches of magnumclient https://review.openstack.org/316880 | 18:44 |
| openstackgerrit | Thiago da Silva proposed openstack-infra/project-config: add python jobs to pyeclib project https://review.openstack.org/317672 | 18:44 |
| *** whoops has joined #openstack-infra | 18:45 | |
| *** kevinbenton has quit IRC | 18:49 | |
| *** kevinbenton has joined #openstack-infra | 18:50 | |
| fungi | hrm, i don't seem to be able to easily toggle the gearman plugin via lynx | 18:50 |
| fungi | something about it not passing along an expected crumb | 18:51 |
| clarkb | thhats the csrf protection | 18:51 |
| *** sdague has joined #openstack-infra | 18:51 | |
| fungi | yeah, seems like their csrf protection is applied to configuration changes even when not enabled for the rest of the interface | 18:51 |
| *** tlian has joined #openstack-infra | 18:52 | |
| jeblair | i think we have it enabled? | 18:52 |
| fungi | and i guess lynx doesn't respect it | 18:52 |
| fungi | oh, did we enable csrf protection as well as firewalling everything? | 18:52 |
| clarkb | yes should be enabled | 18:52 |
| fungi | i thought csrf protection was breaking nodepool | 18:52 |
| clarkb | fungi: no we just needed to restart nodepool | 18:53 |
| fungi | ahh | 18:53 |
| clarkb | becayse python jenkins only got the key at startup | 18:53 |
| fungi | i wasn't around at that point i guess | 18:53 |
| clarkb | er first request | 18:53 |
| openstackgerrit | Philip Marc Schwartz proposed openstack-infra/ansible-puppet: Fix incorrect param type and use of host vars directly. https://review.openstack.org/317678 | 18:53 |
| tdasilva | hello, I'd like to add a new gate job for project https://github.com/openstack/liberasurecode. It is a C library, so I'm wondering if I just need to add a new job-template under project-config/jenkins/jobs | 18:53 |
| fungi | clarkb: makes sense | 18:53 |
| fungi | clarkb: jeblair: yep, configure global security confirms csrf protection is turned on | 18:54 |
| fungi | up to 17 leaked fips on bluebox and 71 leaked fips in osic | 18:56 |
| clarkb | ya we turned it on because it would still be exploitable if you logged in via proxy | 18:56 |
| fungi | deleting them again | 18:56 |
| nibalizer | fungi: maybe we should be tracking that in graphite | 18:57 |
| clarkb | so we set up layers of protection | 18:57 |
| fungi | nibalizer: not sure tracking it in graphite right now would help much. it shoots right back up after we clear it out at the moment | 18:57 |
| clarkb | tdasilva: ya you will likely want a template for something like make | 18:57 |
| clarkb | tdasilva: then you can have jobs that make build make test etc | 18:58 |
| fungi | gah, it's meeting time and i got sidetracked by bugs again | 18:58 |
| *** annegentle has joined #openstack-infra | 18:59 | |
| tdasilva | clarkb: got it! thanks. are you aware of any other projects that I could use as a template? | 18:59 |
| clarkb | tdasilva: I dont know of anyone using make curre tly | 18:59 |
| *** akshai has joined #openstack-infra | 18:59 | |
| *** sridhar_ram has joined #openstack-infra | 18:59 | |
| fungi | if someone else gets time later, we need to figure out why e0ne's gate-brick-cinderclient-ext-dsvm-functional job is configured on our jenkins masters since early friday but still not registered in zuul's gearman | 18:59 |
| clarkb | but you could probably take the tox template and replace tox with make as appropriate | 18:59 |
| fungi | it's that (weekly infra team meeting) time again! find us in #openstack-meeting for the next hour | 19:00 |
| *** vkramskikh_ has quit IRC | 19:00 | |
| tdasilva | clarkb: cool, I will take a look, thanks! :-) | 19:01 |
| *** akshai_ has joined #openstack-infra | 19:02 | |
| pleia2 | oh hey, meeting time | 19:02 |
| *** akshai has quit IRC | 19:04 | |
| *** doug-fis_ has quit IRC | 19:08 | |
| *** ihrachys has joined #openstack-infra | 19:12 | |
| *** vkramskikh_ has joined #openstack-infra | 19:13 | |
| *** sdake has quit IRC | 19:15 | |
| *** doug-fish has joined #openstack-infra | 19:16 | |
| ianw | pabelanger: hmmm ... in an f23 job -> "msg": "ERROR! mkdir: cannot create directory '/home/jenkins/.ansible/tmp/ansible-tmp-1463511209.13-154152794496369': No space left on device\n", | 19:19 |
| *** woodster_ has joined #openstack-infra | 19:20 | |
| *** sdake has joined #openstack-infra | 19:20 | |
| *** piet has quit IRC | 19:22 | |
| *** sdake has quit IRC | 19:22 | |
| *** sdake has joined #openstack-infra | 19:22 | |
| *** sdake has quit IRC | 19:23 | |
| *** akshai_ has quit IRC | 19:25 | |
| *** sdake has joined #openstack-infra | 19:26 | |
| *** jyuso1 has quit IRC | 19:26 | |
| *** jyuso1 has joined #openstack-infra | 19:26 | |
| *** arxcruz has quit IRC | 19:27 | |
| jokke_ | ianw: smalls like running out of inodes | 19:27 |
| *** dtardivel has quit IRC | 19:30 | |
| *** nadya has joined #openstack-infra | 19:31 | |
| *** comstud has joined #openstack-infra | 19:31 | |
| *** sdake_ has joined #openstack-infra | 19:32 | |
| *** sdake has quit IRC | 19:32 | |
| *** nadya has quit IRC | 19:33 | |
| *** gyee has quit IRC | 19:33 | |
| *** jcoufal has quit IRC | 19:34 | |
| *** banix has quit IRC | 19:34 | |
| *** mriedem has quit IRC | 19:35 | |
| *** kzaitsev_mb has joined #openstack-infra | 19:35 | |
| *** salv-orlando has joined #openstack-infra | 19:35 | |
| *** gokrokve has quit IRC | 19:36 | |
| openstackgerrit | Anne Gentle proposed openstack-infra/project-config: Adds doc publishing jobs for Sphinx extension, os-api-ref https://review.openstack.org/317690 | 19:36 |
| *** rvasilets__ has quit IRC | 19:36 | |
| *** rhochmuth has joined #openstack-infra | 19:38 | |
| *** ihrachys has quit IRC | 19:39 | |
| *** ihrachys has joined #openstack-infra | 19:41 | |
| *** mriedem has joined #openstack-infra | 19:41 | |
| *** dprince has quit IRC | 19:41 | |
| *** vkramskikh_ has quit IRC | 19:41 | |
| *** pilgrimstack has quit IRC | 19:42 | |
| openstackgerrit | Vasyl Saienko proposed openstack-infra/devstack-gate: DO NOT REVIEW https://review.openstack.org/315499 | 19:42 |
| *** rvasilets__ has joined #openstack-infra | 19:43 | |
| hashar | clarkb: zaro: for the git repack thing. I cant find analysis traces by myself :-( Might want to state the problem again on the openstack-infra list and I will catch up dig more | 19:45 |
| hashar | clarkb: zaro: I have no immediate answer / archive :( | 19:46 |
| hashar | as for the git mirrors, I am pretty sure you will have to repack them individually | 19:48 |
| *** e0ne has quit IRC | 19:48 | |
| *** matrohon has joined #openstack-infra | 19:49 | |
| openstackgerrit | Thiago da Silva proposed openstack-infra/project-config: add python jobs to pyeclib project https://review.openstack.org/317672 | 19:49 |
| *** e0ne has joined #openstack-infra | 19:51 | |
| *** ihrachys has quit IRC | 19:52 | |
| *** ihrachys has joined #openstack-infra | 19:52 | |
| *** sdake_ has quit IRC | 19:53 | |
| *** e0ne has quit IRC | 19:54 | |
| *** inc0 has quit IRC | 19:56 | |
| openstackgerrit | Madhuri Kumari proposed openstack-infra/project-config: Add new project Higginsclient to openstack repo https://review.openstack.org/317699 | 19:56 |
| *** ihrachys has quit IRC | 19:57 | |
| *** sdake has joined #openstack-infra | 19:58 | |
| *** abregman has quit IRC | 19:58 | |
| openstackgerrit | Mateusz Matuszkowiak proposed openstack-infra/puppet-nodepool: Added nodepool::mysql class https://review.openstack.org/299661 | 19:58 |
| *** rcernin has joined #openstack-infra | 19:58 | |
| zaro | hashar: this was the topic, https://www.mail-archive.com/openstack-infra@lists.openstack.org/msg04264.html | 19:59 |
| *** piet has joined #openstack-infra | 20:00 | |
| *** doug-fis_ has joined #openstack-infra | 20:00 | |
| zaro | hashar: in additional to that we wanted to know how our mirrors perfomed before vs after gerrit gc | 20:00 |
| pabelanger | sorry for missing our weekly meeting, back now | 20:01 |
| prometheanfire | :D | 20:01 |
| pabelanger | reading up on eavsedrop now | 20:01 |
| prometheanfire | pabelanger: convienent | 20:01 |
| *** e0ne has joined #openstack-infra | 20:01 | |
| jeblair | prometheanfire: using a commont topic in gerrit can help make tracking reviews easier | 20:02 |
| *** _sarob has quit IRC | 20:02 | |
| zaro | hashar: was wondering if your doing something similar and wanted to get your experience | 20:02 |
| *** matrohon has quit IRC | 20:02 | |
| *** bpokorny has quit IRC | 20:03 | |
| *** doug-fi__ has joined #openstack-infra | 20:03 | |
| openstackgerrit | Merged openstack-infra/tripleo-ci: Use the overcloud full images from the cache https://review.openstack.org/312397 | 20:03 |
| *** doug-fish has quit IRC | 20:03 | |
| hashar | zaro: I have seen that thread though apparently I haven't replied to it. So maybe it was on IRC but the eavedrops logs yields nothing : | 20:04 |
| openstackgerrit | Jay Faulkner proposed openstack-infra/project-config: Use TinyIPA and iPXE for most Ironic jobs https://review.openstack.org/313800 | 20:04 |
| *** doug-fis_ has quit IRC | 20:04 | |
| *** e0ne has quit IRC | 20:04 | |
| *** Goneri has quit IRC | 20:04 | |
| hashar | zaro: at Wikimedia people clone directly from Gerrit and if that turns out to be a problem they use a shallow clone / restrict to a single branch or use the github mirrors | 20:05 |
| hashar | zaro: we mirror everything to github. Have some replication to Phabricator as well | 20:05 |
| *** banix has joined #openstack-infra | 20:06 | |
| hashar | zaro: and for the Zuul mergers I have some cron jobs that repack and pack-refs + a custom script to garbage collect old refs under refs/zuul/* | 20:06 |
| *** baoli has joined #openstack-infra | 20:06 | |
| *** sarob has joined #openstack-infra | 20:07 | |
| *** inc0 has joined #openstack-infra | 20:07 | |
| *** sarob has quit IRC | 20:07 | |
| *** _sarob has joined #openstack-infra | 20:07 | |
| *** ffrank has joined #openstack-infra | 20:07 | |
| zaro | jeblair: regarding project renames, would you be able to enlighten me on the impact of change ids changing? is that something with how zuul works? | 20:08 |
| hashar | + we run gerrit gc on the repos from time to time | 20:08 |
| jeblair | zaro: people link to "https://review.openstack.org/1234". gerrit called those "permalinks" for a while. it would be nice if they kept working. | 20:09 |
| pabelanger | jeblair: I am just looking at your playbook now for delegate_to. Why are we running the rsync command from static.o.o over just using rsyc from the node? | 20:09 |
| fungi | zaro: well, a big thing is that change urls are based on the change number, so we'd end up with all new urls for migrated changes (presumably both merged and open) | 20:09 |
| pabelanger | jeblair: that way, I think we don't need to delegate_to | 20:09 |
| fungi | so any old links to changes for projects from before the rename would cease to be valid | 20:09 |
| pabelanger | ianw: where did you see that? | 20:09 |
| jeblair | pabelanger: we want to copy from the node to static. normally synchronize copies between the node and the controller. | 20:10 |
| ianw | pabelanger: random change -> http://logs.openstack.org/42/306842/5/check/gate-tempest-dsvm-platform-fedora23-nv/bcfe6cc/console.html | 20:10 |
| jeblair | pabelanger: however, even that's not enough, because if we delegate to static, it won't have access to the ssh key there. so it turns out we need to copy to the controller and then copy to static :( | 20:10 |
| zaro | fungi, jeblair : ok. i thought it was more technical issue with how the tools integrated | 20:11 |
| *** yamahata has quit IRC | 20:11 | |
| jeblair | pabelanger: even then, we still need to delegate to static though, because that's how we specify 'copy to static' in a play where the remote host is otherwise the worker node. | 20:11 |
| jeblair | zaro: nope | 20:11 |
| pabelanger | jeblair: Ya, that's what I was thinking. Unless we are pushing over the SSH key to the node, we'll need to work how jenkins did. Back to master then over to static | 20:11 |
| jeblair | zaro: it's a people issue. | 20:11 |
| openstackgerrit | Merged openstack-infra/tripleo-ci: Explode log tars so they can be indexed https://review.openstack.org/314272 | 20:11 |
| jeblair | pabelanger: so yeah, i have a local change that implements that; sorry i haven't pushed it up yet, i'm trying to find all the things we're hitting at once, then will push up fixes. | 20:12 |
| zaro | i guess people are harder to fix.. | 20:12 |
| *** _ari__ has quit IRC | 20:13 | |
| pabelanger | jeblair: Can we do dest=rsync://static.o.o/... and delegate_host: local from zuul-launcher | 20:13 |
| jeblair | pabelanger: i don't know -- you want to try that? :) | 20:13 |
| pabelanger | jeblair: which is a push, I think the other way (current) we need to setup mode=pull | 20:13 |
| jeblair | pabelanger: (i've moved on to a jjb issue) | 20:13 |
| pabelanger | jeblair: sure, I can see if I can reproduce locally | 20:14 |
| jeblair | cool | 20:14 |
| jeblair | thanks :) | 20:14 |
| fungi | zaro: though having the change numbers shift out from under a running zuul might be disruptive in that it will have cached other dependency relationships. i don't know exactly how disruptive in practice | 20:14 |
| zaro | hashar: thanks for the info. i guess your use case doesn't apply to what we want to verify. | 20:14 |
| jeblair | pabelanger: (btw, if we decided to put logs in afs, this would be super easy) | 20:14 |
| fungi | zaro: but for example, when you fix a bug and links get added to the bug with the url to the change that fixed it... or appear in a published security advisory... | 20:15 |
| fungi | having those disappear could be human-painful | 20:15 |
| *** javeriak has quit IRC | 20:15 | |
| pabelanger | jeblair: ++ | 20:15 |
| fungi | and i have to wonder whether the git notes get properly updated when making a copy too | 20:15 |
| *** doug-fish has joined #openstack-infra | 20:16 | |
| hashar | zaro: then if you do the repack on gerrit, the mirror should be unaffected imho. I am pretty sure you would need to repack/gc on the mirrors as well | 20:16 |
| pabelanger | ianw: not sure what happen, looks like space issue on HDD | 20:17 |
| *** fesp has joined #openstack-infra | 20:17 | |
| *** vkramskikh_ has joined #openstack-infra | 20:17 | |
| *** doug-fi__ has quit IRC | 20:18 | |
| zaro | hashar: are you saying that the replication won't change what's on the mirror? | 20:18 |
| ianw | pabelanger: yeah ... but during setup? anyway, will keep an eye out, maybe it was just a fluke | 20:18 |
| *** ccamacho has quit IRC | 20:18 | |
| hashar | zaro: I would not sell my soul on that assumption, but intuitively yeah I would expect the mirror / receiving hand to write new packs and eventually end up with loose objects as refs are deleted | 20:19 |
| openstackgerrit | Mateusz Matuszkowiak proposed openstack-infra/puppet-nodepool: Added nodepool::mysql class https://review.openstack.org/299661 | 20:19 |
| hashar | zaro: you would need to ask a git guru really :-( | 20:19 |
| *** anteaya has joined #openstack-infra | 20:19 | |
| pabelanger | ianw: possible fluke. I'd check logstash.o.o to see if other jobs had it | 20:20 |
| *** kzaitsev_mb has quit IRC | 20:20 | |
| openstackgerrit | Mateusz Matuszkowiak proposed openstack-infra/puppet-openstackci: Include nodepool::mysql from openstackci https://review.openstack.org/303306 | 20:20 |
| *** kgiusti has left #openstack-infra | 20:21 | |
| zaro | hashar: ok. i assumed that replication would update the mirror with GCed repo. | 20:24 |
| hashar | zaro: you can look at .git/objects of the nova replicated repo on one of the mirror | 20:24 |
| hashar | zaro: that might confirms | 20:24 |
| jeblair | if so, this may be a good reason to avoid using gerrit gc and just going with the same git gc command everywhere | 20:25 |
| *** akshai has joined #openstack-infra | 20:25 | |
| *** pwgravel has quit IRC | 20:26 | |
| *** akshai_ has joined #openstack-infra | 20:26 | |
| hashar | then I am not sure how Gerrit behave when you use the git CLI to garabge collect stuff | 20:26 |
| hashar | it might bork | 20:26 |
| hashar | explode or whatever | 20:27 |
| zaro | hashar: you'de probably want to use the same jgit CLI that gets packaged with gerrit | 20:28 |
| zaro | althought that might be difficult to maintain | 20:28 |
| jeblair | let's avoid speculation | 20:28 |
| *** chem`` has joined #openstack-infra | 20:29 | |
| jeblair | so far, gerrit devs have said and practice has confirmed that gerrit is a well-behaved git client that respects the file locking necessary for git to work | 20:29 |
| jeblair | that allows us to run 'git repack' behind gerrit's back | 20:29 |
| *** dmk0202 has joined #openstack-infra | 20:29 | |
| *** jpr has quit IRC | 20:29 | |
| jeblair | perhaps something about 'git gc' would make it impossible to run like that, but we have no evidence of that at the moment. a gerrit dev saying that they are certain it would not work, or some testing showing that would be useful. | 20:30 |
| jeblair | but without that, i see no reason to think it wouldn't work. | 20:30 |
| *** akshai has quit IRC | 20:30 | |
| fungi | btw, the faux-cron git repack completed a little while ago, no appreciable change in the usage graph http://cacti.openstack.org/cacti/graph.php?action=view&local_graph_id=2839&rra_id=all | 20:30 |
| jeblair | (especially since we've been repacking repos behind gerrit's back for *years*) | 20:30 |
| *** chem` has quit IRC | 20:31 | |
| fungi | so my guess is that it is actually running. it indicates in its output that it's repacking things | 20:31 |
| jeblair | fungi: ok. i suppose it's running as expected, thanks for double checking :) | 20:31 |
| fungi | and it doesn't take an inordinate amount of time to complete | 20:31 |
| *** bhunter71 has quit IRC | 20:31 | |
| fungi | it's just not solving this particular growth issue | 20:31 |
| fungi | so likely we're piling up unreferenced objects | 20:31 |
| *** sridhar_ram has quit IRC | 20:32 | |
| *** sridhar_ram1 has joined #openstack-infra | 20:32 | |
| zaro | fungi: yeah, i believe i've confirmed that in my gerrit testing emails. you need to do a gc to clean up those refs. | 20:32 |
| hashar | zaro: gerrit gc would use the jgit so that it is straightforward. Then has jeblair said, git gc might just work | 20:33 |
| anteaya | fungi: back now, sorry I missed the infra meeting | 20:33 |
| zaro | fungi: it's actually the '--prune' that cleans up the loos objects. gc runs with prune | 20:35 |
| hashar | fungi: git count-objects -v | 20:36 |
| *** kzaitsev_mb has joined #openstack-infra | 20:36 | |
| hashar | fungi: would give you the number of loose objects and disk consumption + a bunch of other metrics | 20:37 |
| hashar | zaro: on a different topic. Jenkins latest LTS strips parameters passed to Gearman function unless they are explicitly defined in the job :D | 20:39 |
| fungi | i've got that running for the raw file backend of nova now | 20:39 |
| mfisch | infra team - who is the contact for a stackalytics question? | 20:39 |
| fungi | will paste stats as soon as it finishes | 20:39 |
| mfisch | about updating it | 20:39 |
| fungi | mfisch: the stackalytics core reviewers probably | 20:39 |
| hashar | zaro: there is a workaround, and I have filled a task in Jira for you to get the Gearman plugin to autowhitelist parameters (no idea how to do so though) https://issues.jenkins-ci.org/browse/JENKINS-34885 | 20:39 |
| mfisch | yeah as soon as I asked I smacked my head | 20:39 |
| mfisch | sorry | 20:39 |
| fungi | mfisch: https://review.openstack.org/#/admin/groups/183,members | 20:39 |
| *** gyee has joined #openstack-infra | 20:40 | |
| mfisch | our merger is making things complicated | 20:40 |
| fungi | mfisch: not an infra project (or even an official project), just something written by some devs at mirantis | 20:40 |
| mfisch | k | 20:41 |
| *** rcernin has quit IRC | 20:41 | |
| *** flepied1 has joined #openstack-infra | 20:41 | |
| *** baoli has quit IRC | 20:43 | |
| *** baoli has joined #openstack-infra | 20:43 | |
| *** gildub has joined #openstack-infra | 20:43 | |
| zaro | hashar: i'm not sure why that's a gearman plugin issue? i mean shouldn't that be optioned in jenkins core? | 20:44 |
| *** yamahata has joined #openstack-infra | 20:44 | |
| *** flepied has quit IRC | 20:44 | |
| hashar | zaro: Jenkins has a transitional flag to allow untrusted parameters. From the infra list, the idea would be to have the plugin to autowhitelist the parameters | 20:46 |
| *** tonytan_brb has joined #openstack-infra | 20:46 | |
| *** rfolco has quit IRC | 20:47 | |
| hashar | zaro: so one can still prevent untrusted parameters from other sources; And maybe later Jenkins will enforce it / remove the option | 20:47 |
| fungi | so this is the count-objects data for the nova repo on review.o.o: http://paste.openstack.org/show/497418/ | 20:47 |
| *** rfolco has joined #openstack-infra | 20:47 | |
| fungi | interesting that it flags no garbage there | 20:47 |
| *** raildo is now known as raildo-afk | 20:47 | |
| fungi | i guess the "size" there is in kilobytes | 20:48 |
| hashar | then you have 4 million loose objects :D | 20:48 |
| mugsie | when someone has a chance, could I get some reviews on https://review.openstack.org/#/c/317001/ please? | 20:48 |
| *** gildub has quit IRC | 20:49 | |
| *** tonytan4ever has quit IRC | 20:49 | |
| sdague | mugsie: +2 | 20:49 |
| hashar | zaro: dont obsess about it though. I have mentioned it for discussion and as a warning in case you upgrade to latest Jenkins version | 20:49 |
| openstackgerrit | Ben Nemec proposed openstack-infra/tripleo-ci: TEST: Delete the overcloud when finished https://review.openstack.org/297328 | 20:49 |
| openstackgerrit | Ben Nemec proposed openstack-infra/tripleo-ci: Test overcloud deletion in periodic job https://review.openstack.org/296765 | 20:49 |
| openstackgerrit | Ben Nemec proposed openstack-infra/tripleo-ci: Don't pipe yes to a function https://review.openstack.org/317730 | 20:49 |
| mugsie | sdague: ty | 20:49 |
| hashar | fungi: looked at the man page for git-count-objects that is in KiB and there is a -H option for human friendly display ! | 20:50 |
| *** rhallisey has quit IRC | 20:50 | |
| *** kzaitsev_mb has quit IRC | 20:50 | |
| hashar | fungi: then I am not sure why Gerrit would have so many loose objects. Maybe all the merges attempts it did, bunch of caches etc. Then 1.3 millions in pack vs 4 millions loose objects .. that is concerning | 20:51 |
| rm_work | I assume the people who maintain DIB hang out here? :P | 20:51 |
| greghaynes | They all left | 20:51 |
| greghaynes | (kidding) | 20:52 |
| rm_work | lol | 20:52 |
| rm_work | https://github.com/openstack/diskimage-builder/tree/master/elements/source-repositories | 20:52 |
| rm_work | ^^ per that I can only use git / tar? there's no way to copy from the local filesystem? | 20:52 |
| rm_work | or like | 20:52 |
| rm_work | ... I need the files from the current directory on the machine that's building... | 20:52 |
| clarkb | just cp them | 20:53 |
| greghaynes | rm_work: there is not, but you can copy in files in during the extra-data.d phase | 20:53 |
| rm_work | in that case would I just completely ignore that and copy them? | 20:53 |
| rm_work | ok yeah | 20:53 |
| *** shardy has quit IRC | 20:53 | |
| rm_work | good | 20:53 |
| *** kzaitsev_mb has joined #openstack-infra | 20:53 | |
| rm_work | not sure why that didn't occur to me until just now when I was trying to ask, lol | 20:54 |
| hashar | fungi: for comparison mediawiki/core on Wikmedia Gerrit http://paste.openstack.org/show/497419/ 1 Million in pack but a few hundred loose objects | 20:54 |
| rm_work | greghaynes: is there a doc for extra-data.d ? | 20:54 |
| fungi | hashar: thanks, that makes some sense | 20:55 |
| greghaynes | rm_work: kind of - http://docs.openstack.org/developer/diskimage-builder/developer/developing_elements.html#phase-subdirectories | 20:55 |
| fungi | hashar: we've not been garbage-collecting or pruning at all | 20:55 |
| fungi | hashar: only repacking | 20:55 |
| rm_work | hmm k, thanks | 20:55 |
| greghaynes | rm_work: your best bet is to probably cargo the devuser element | 20:55 |
| fungi | hashar: specifically, git repack -afd | 20:55 |
| Kiall | fungi: how exactly are you participating in the TC meet, and having a technical chat here... That's just not something I can manage ;) | 20:56 |
| greghaynes | rm_work: http://git.openstack.org/cgit/openstack/diskimage-builder/tree/elements/devuser/extra-data.d/50-devuser | 20:56 |
| rm_work | ok, thanks. will give it a shot | 20:56 |
| fungi | Kiall: "participating" is a loose concept around here | 20:56 |
| greghaynes | rm_work: actually, http://git.openstack.org/cgit/openstack/diskimage-builder/tree/elements/apt-sources/extra-data.d/99-override-default-apt-sources is probably easier to cargo (the sources.list part) | 20:56 |
| *** psilvad has quit IRC | 20:56 | |
| fungi | Kiall: since i'm not on the tc, i can get away with mostly lurking that meeting | 20:56 |
| rm_work | kk | 20:57 |
| Kiall | I saw messages from you in TC, switched over here for something else.. and more messages from you popped up ;) | 20:57 |
| pabelanger | clarkb: I haven't heard back from OVH about switching to qcow2. Did you want to try and reach out to them? | 20:57 |
| pabelanger | clarkb: re: https://review.openstack.org/#/c/315680/ | 20:57 |
| clarkb | pabelanger: maybe it is a french holiday? I think we can go ahead and switch if we want and beg forgiveness if issues ensue | 20:57 |
| pabelanger | clarkb: WFM | 20:58 |
| *** rprakash has joined #openstack-infra | 20:58 | |
| fungi | pabelanger: clarkb: oh, also i totally didn't talk to mordred because he's on vacation and nowhere near a computer, but apparently the change to add fip cleanup in nodepool is missing a followup change to configure it to happen. which explains the current osic/bluebox situation i guess? | 20:58 |
| clarkb | I actually am in theory getting keys to a house shortly and left my laptop at current place derp | 20:58 |
| *** sdake_ has joined #openstack-infra | 20:58 | |
| *** thorst has quit IRC | 20:59 | |
| clarkb | funo we shouldnt leak this quickly even with that cleanup | 20:59 |
| clarkb | gah | 20:59 |
| *** aysyd has quit IRC | 20:59 | |
| clarkb | fungi ^ | 20:59 |
| clarkb | cleanup was there to handlr a few leaks per day not hundred an hour | 20:59 |
| * fungi will answer to most misspellings of his nick | 20:59 | |
| rprakash | #info rprakash | 20:59 |
| pabelanger | fungi: Ya, we landed the cleanup FIP stuff in nodepool, but it is not enabled. | 20:59 |
| *** salv-orlando has quit IRC | 20:59 | |
| pabelanger | but agree with clarkb, we seem to leaking a lot now | 21:00 |
| rprakash | #help for creating new project, can I ask some questions? | 21:00 |
| *** salv-orlando has joined #openstack-infra | 21:00 | |
| *** sridhar_ram1 has quit IRC | 21:00 | |
| openstackgerrit | Merged openstack-infra/system-config: Puppetboard renamed the module https://review.openstack.org/313876 | 21:00 |
| *** sdake has quit IRC | 21:00 | |
| jeblair | clarkb, pabelanger, fungi: agree, but i think we should enable the fip cleanup and then continue to pursure the cause of the leak utilizing the logs to tell us how bad it is (rather than how annoyed fungi is) | 21:01 |
| *** rfolco has quit IRC | 21:01 | |
| *** julim has quit IRC | 21:01 | |
| *** trown is now known as trown|outtypewww | 21:02 | |
| *** kzaitsev_mb has quit IRC | 21:02 | |
| clarkb | I think it might even be worth reverting... at least to see if the issue is relatrd to shade or not | 21:02 |
| pabelanger | I believe we have a good way to reproduce the issue too | 21:02 |
| clarkb | we never leaked this badly in osic on the old code, wpuld be good info to know if old code leaks like this now | 21:02 |
| hashar | fungi: you could ask ostriches in #wikimedia-releng on my behalf. He is the maintainer for Gerrit and must have some maintenance trick. Your nova repo seems to have the same size as our mediawiki/core one | 21:02 |
| hashar | fungi: so any tip ostriches have would probably apply to your case | 21:02 |
| *** bdemers has quit IRC | 21:03 | |
| fungi | hashar: well, it sounds like you're actually pruning/garbage-collecting yours? in which case that would totally explain the difference | 21:03 |
| *** thorst_ has joined #openstack-infra | 21:03 | |
| jeblair | clarkb: reverting sounds nasty; i think we're past that now. | 21:03 |
| fungi | as i said, we haven't been yet, and we're still evaluating whether we should (and whether we should use git or jgit via gerrit to do so) | 21:04 |
| clarkb | jeblair: how so? | 21:04 |
| jeblair | clarkb: we've landed some stuff post-shade in nodepool | 21:04 |
| *** asettle has joined #openstack-infra | 21:04 | |
| clarkb | ya there may be conflicts I havent tried | 21:04 |
| fungi | jeblair: clarkb: we're quite a few changes down the road from the shade switch, and have zuul v2.5 support implemented | 21:04 |
| fungi | worried that will be unpleasant to untangle | 21:04 |
| clarkb | its just been impossible to isolate the problems and we dont know if it is shade or the cloud | 21:04 |
| jeblair | clarkb: are you working on that? | 21:05 |
| clarkb | on what? | 21:05 |
| jeblair | clarkb: are you working on isolating the problem? | 21:05 |
| clarkb | no, mordred cloudnull and armax were | 21:05 |
| jeblair | i'm trying to figure out if we've hit some kind of roadblock in your work | 21:05 |
| clarkb | but aiui they didnt get anywhere | 21:05 |
| jeblair | yeah, so mordred is on vacation | 21:05 |
| fungi | it did get significantly worse a few days ago, so if we didn't change nodepool then it seems likely related to a behavior change from their kilo->liberty upgrade | 21:05 |
| jeblair | and is not expected to make progress for a while | 21:05 |
| *** inc0 has quit IRC | 21:05 | |
| jeblair | which is why i think we should enable the fip cleanup so it isn't bothering us as much | 21:06 |
| *** jpr has joined #openstack-infra | 21:06 | |
| jeblair | and then, when a sufficient quorum of mordred/cloudnull/armax/Shrews are around to continue, they can without us being harried | 21:06 |
| fungi | which still doesn't exonerate shade/nodepool, but at least helps us narrow the field a bit | 21:06 |
| hashar | fungi: I am pretty sure we run "gerrit gc" on all repos on a something-ly basis. ostriches would confirm he would be the one running them | 21:06 |
| anteaya | fungi: what if anything can I do to help the storyboard-dev effort move along? | 21:07 |
| clarkb | fwiw the pre shade leak rate was a handful of IPs per week | 21:07 |
| fungi | i'm definitely not keeping up with fip cleanup with enough regularity to prevent it from causing significant impact on our node starvation | 21:07 |
| clarkb | but it may or may not be worse now due to cloud or shade | 21:07 |
| *** thorst_ has quit IRC | 21:08 | |
| hashar | clarkb: if it can help the Wikimedia Nodepool is pre shade | 21:08 |
| jeblair | is there a patch to turn on the cleanup? | 21:08 |
| hashar | clarkb: we are running 0.1.1 tag | 21:09 |
| pabelanger | jeblair: I have not seen one | 21:09 |
| jeblair | pabelanger: do you have a moment to write one? | 21:10 |
| fungi | anteaya: not sure. it looks like the failed 312124 check results finally reported halfway into the infra meeting | 21:10 |
| pabelanger | jeblair: sure | 21:10 |
| anteaya | fungi: ah okay | 21:10 |
| jeblair | pabelanger: thanks! | 21:10 |
| fungi | anteaya: at least the other failure was transient, so i'm confident enough i can push the update to the child patch as well | 21:10 |
| *** dmk0202 has quit IRC | 21:10 | |
| *** ewilson has quit IRC | 21:11 | |
| anteaya | fungi: awesome, thank you | 21:11 |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/system-config: Realize SotK and Zara on the storyboard-dev server https://review.openstack.org/315706 | 21:11 |
| *** amotoki has joined #openstack-infra | 21:11 | |
| fungi | and there it is | 21:11 |
| jeblair | ha! | 21:12 |
| jeblair | i was trying to figure out what was taking so long on this zuul-launcher job... | 21:12 |
| jeblair | and the answer was -- it's working! :) | 21:12 |
| anteaya | yay! | 21:12 |
| openstackgerrit | Paul Belanger proposed openstack-infra/nodepool: Use clean-floating-ips for yaml setting https://review.openstack.org/317734 | 21:13 |
| pabelanger | jeblair: trivial fix, for style ^ | 21:13 |
| jeblair | pabelanger: thanks :) | 21:14 |
| *** sdague has quit IRC | 21:14 | |
| *** ldnunes has quit IRC | 21:15 | |
| openstackgerrit | Kaiyan Sheng proposed openstack-infra/project-config: [Monasca] Add check-requirements check job for monasca projects https://review.openstack.org/317735 | 21:15 |
| fungi | clarkb: so what was that you were saying about filtering openstack server list by flavor in rax ord? | 21:15 |
| fungi | i'm finally able to circle around and look into that some more | 21:16 |
| clarkb | fungi: just to confirm we dont have anything booted witg bigger flavors using more ram | 21:16 |
| fungi | oh, right | 21:16 |
| clarkb | we dont but you can pass --flavor performance1-8 to server list to confirm | 21:16 |
| fungi | yep, identical counts | 21:17 |
| *** bpokorny has joined #openstack-infra | 21:17 | |
| fungi | also well below the 200 we should be able to launch | 21:17 |
| openstackgerrit | Paul Belanger proposed openstack-infra/project-config: Enable clean-floating-ips for OVH and BlueBox https://review.openstack.org/317737 | 21:17 |
| armax | jeblair: you are talking about bug 1581220? | 21:17 |
| openstack | bug 1581220 in neutron "race leads same floating ip to be associated to separate ports" [High,Incomplete] https://launchpad.net/bugs/1581220 | 21:17 |
| pabelanger | fungi: clarkb: jeblair: ^ | 21:18 |
| fungi | clarkb: i'm seeing similar errors in osic too | 21:18 |
| fungi | OpenStackCloudException: Error in creating instance (Inner Exception: Quota exceeded for instances, ram: Requested 1, 8192, but already used 100, 819200 of 100, 819200 instances, ram (HTTP 403) (Request-ID: req-ca6abcbb-96e1-44ff-9679-ae095037a897)) | 21:18 |
| *** baoli has quit IRC | 21:18 | |
| mescanef | hello. please review some puppet code in https://review.openstack.org/#/c/303306/ and https://review.openstack.org/#/c/299661/ | 21:18 |
| *** baoli has joined #openstack-infra | 21:19 | |
| *** rhochmuth has quit IRC | 21:19 | |
| *** daemontool has joined #openstack-infra | 21:20 | |
| *** thorst_ has joined #openstack-infra | 21:21 | |
| jeblair | armax: i'm not certain, sorry. | 21:21 |
| fungi | clarkb: there we're hovering at/near the quota too. i wonder if we're leaking instances and hitting over quota condition intermittently until it cleans up | 21:21 |
| armax | jeblair: ok | 21:21 |
| clarkb | or possibly something got lost in the upgrade | 21:22 |
| *** kzaitsev_mb has joined #openstack-infra | 21:22 | |
| *** doug-fis_ has joined #openstack-infra | 21:22 | |
| openstackgerrit | Mateusz Matuszkowiak proposed openstack-infra/puppet-nodepool: Added nodepool::mysql class https://review.openstack.org/299661 | 21:22 |
| rprakash | #info fungi prakash here you gave me http://docs.openstack.org/project-team-guide/ for project ceration but still not able to create a project, is there atemplate or gi clone I can use to create a new project? | 21:22 |
| jeblair | pabelanger: telnet 166.78.99.141 8088 | 21:23 |
| *** doug-fish has quit IRC | 21:23 | |
| fungi | rprakash: can you provide any details on your inability to create a project? the documented steps are http://docs.openstack.org/infra/manual/creators.html | 21:24 |
| fungi | rprakash: how far did you get with that? | 21:24 |
| rprakash | i was not able to follow as what template in zull do I use and if so how I gi clone and submit specs along with the project creation | 21:25 |
| *** hamzy has quit IRC | 21:26 | |
| *** tonytan_brb has quit IRC | 21:26 | |
| rm_work | greghaynes: do I need to do somethign special to get the extra-data.d stuff to run? it seems like it's just ... not doing it. don't see any mention of it in the logs, directory looks right and the script is executable :/ | 21:26 |
| clarkb | rm_work: is your file executable? | 21:26 |
| clarkb | oh derp | 21:26 |
| rm_work | heh | 21:26 |
| clarkb | finish reading | 21:26 |
| fungi | rprakash: i don't understand what you're asking with regard to "submit specs" | 21:26 |
| rprakash | #info like I have created a project in https://launchpad.net/meghdwar with all project details and how do I bring it under openstack/meghdwar | 21:27 |
| clarkb | rm_work: maybe the dir isnt traversable? | 21:27 |
| clarkb | rm_work: shoukd be 555 | 21:27 |
| rm_work | -rwxrwxr-x 1 stack stack 629 May 17 21:08 elements/amphora-agent-ubuntu/extra-data.d/50-copy-local-source-files | 21:27 |
| rm_work | drwxrwxr-x 2 stack stack 4096 May 17 21:08 elements/amphora-agent-ubuntu/extra-data.d/ | 21:27 |
| *** annegentle has quit IRC | 21:27 | |
| *** gildub has joined #openstack-infra | 21:27 | |
| fungi | rprakash: it's covered in the "adding the project to the ci system" section at http://docs.openstack.org/infra/manual/creators.html#adding-the-project-to-the-ci-system | 21:27 |
| *** matt-borland has quit IRC | 21:28 | |
| pabelanger | jeblair: Niiice | 21:28 |
| KaiyanSheng | Hi I have a question about this review generated by OpenStack Proposal Bot https://review.openstack.org/#/c/315792/. How can I trace back to which version change in global-requirments lead to this review? Thank you! | 21:28 |
| *** weshay has quit IRC | 21:28 | |
| *** kzaitsev_mb has quit IRC | 21:28 | |
| pabelanger | jeblair: very cool | 21:28 |
| fungi | rprakash: is it possible your confusion is that you've never previously pushed proposed changes to any openstack project before, and so you need to start from the new contributor documentation? | 21:28 |
| rm_work | basically, there isn't anywhere i need to add the script to a list of stuff or anything, it SHOULD be autodetected | 21:28 |
| rm_work | just making sure i'm not missing something dumb | 21:28 |
| clarkb | ya it should be | 21:28 |
| clarkb | dib just collects all those things based on your elements then run parts them | 21:29 |
| rm_work | k | 21:29 |
| clarkb | is any other part of that element runnig? | 21:29 |
| fungi | rprakash: our project creators guide assumes a basic level of experience submitting changes to other existing openstack projects in gerrit | 21:29 |
| pabelanger | jeblair: is the change live to display the telnet links on status.o.o/zuul ? | 21:29 |
| rprakash | #info fungi the guide stated name requiements specs and other details to be ready with and I have it on the link https://launchpad .net/meghdwar now how do i get a name psace in https://launchpad.net/openstack/meghdwar and I could not folow what zull was suggesting like yaml file and experimental project etc. | 21:29 |
| clarkb | KaiyanSheng: it isnt necessarily a single change. you can look at the git log in openstack/requirements to see the various changes | 21:30 |
| jeblair | pabelanger: no, that's disabled in the javascript right now; it will be easy to switch them back on once we have this running | 21:30 |
| pabelanger | jeblair: ack | 21:30 |
| rprakash | But this is not an existing project for me to follow gerrit bug submission, if that is the case which template shall I use? | 21:30 |
| *** jamielennox is now known as jamielennox|away | 21:30 | |
| pabelanger | jeblair: so, that IP is the zuul-worker right? | 21:30 |
| fungi | rprakash: the project creators guide walks you through that, but our infrastructure is maintained through the same workflows as any openstack project, so you'll need to first get familiar with using git and git-review to create and push a change for review to the openstack-infra/project-config project | 21:31 |
| jeblair | pabelanger: yep | 21:31 |
| jeblair | pabelanger: 3 things on my punch list right now: a) log copying still broken; b) i have a bug in my tail routine for console logs; c) we need to open port 8088 on the workers | 21:32 |
| fungi | rprakash: the configuration change you propose to the openstack-infra/project-config git repository will be reviewed and, once it's correct, will be consumed by our project creation automation to implement the configuration you've written | 21:32 |
| rm_work | clarkb: yeah the rest is running | 21:32 |
| pabelanger | jeblair: ack | 21:33 |
| jeblair | pabelanger: if you want to take (c) that'd be cool | 21:33 |
| pabelanger | jeblair: great work BTW! | 21:33 |
| pabelanger | jeblair: sure | 21:33 |
| rm_work | and failing because the extra-data.d script isn't running T_T | 21:33 |
| *** ayoung has quit IRC | 21:33 | |
| clarkb | rm_work: ok I would need to see logs to further debug | 21:33 |
| *** kzaitsev_mb has joined #openstack-infra | 21:33 | |
| pabelanger | we also have an EPEL mirror now: http://mirror.dfw.rax.openstack.org/epel/ | 21:33 |
| pabelanger | still need to test it, but looks good so far | 21:34 |
| jeblair | pabelanger: (i think we may have existing iptables config for workers; maybe in puppet somewhere; might be as simple as adding to that list) | 21:34 |
| jeblair | pabelanger: at least, i noticed that ports 8000, 8003, and 8004 are open | 21:34 |
| rprakash | #info fungi you mean I git clone https://git.openstack.org/cgit/openstack-infra/project-config/ and start from their by reviewing, adding specs rst file, readme ect and submit back? | 21:34 |
| pabelanger | jeblair: sure, looking now | 21:34 |
| *** lakshmiS has quit IRC | 21:35 | |
| fungi | rprakash: clone that repo, but it's not a template for your new repo. it's configuration for our continuous integration and code hosting platform | 21:35 |
| *** cody-somerville has quit IRC | 21:36 | |
| *** ccamacho has joined #openstack-infra | 21:36 | |
| fungi | rprakash: the http://docs.openstack.org/infra/manual/creators.html#adding-the-project-to-the-ci-system section tells you what sections of which files to change or add entries in | 21:36 |
| KaiyanSheng | @clarkb Thank you. So does the openstack proposal bot job get triggered every several days or someone manually triggered it? | 21:36 |
| fungi | rprakash: then you push that change to gerrit for review | 21:36 |
| rm_work | clarkb: yeah, i'll try to get some... i'm looking through currently too | 21:37 |
| clarkb | KaiyanSheng: it gets triggered when code merges to openstack/requirements but it includes all outstanding updates when it runa | 21:37 |
| rprakash | #info OK I will clone and see if I need to add proejct name etc. there for infra team to take this eperimental project to try set repo...any other hints I wil follow the guide..Thanks Prakash | 21:37 |
| fungi | rprakash: if you don't have an existing project git repo you want imported during the new project creation process, it will start you with a simple, basically empty one and then you can begin building your project by sending changes for review to that project once it exists (once our project creation automation runs on your project-config change) | 21:37 |
| KaiyanSheng | @clarkb Thank you! For https://review.openstack.org/#/c/315792/ seems like it's keep failing, does monasca need to do anything to try to fix it? | 21:38 |
| *** thorst_ has quit IRC | 21:38 | |
| fungi | rprakash: separately, there is a tool called cookiecutter we have some templates for, documented at http://docs.openstack.org/infra/manual/creators.html#preparing-a-new-git-repository-using-cookiecutter | 21:38 |
| rprakash | #fungi apprecaite all your inputs and will try follow and see it gets in to experimental mode to start with -Thanks Prakash | 21:38 |
| fungi | rprakash: you can worry about that part once your basically empty project exists in gerrit | 21:38 |
| *** Swami_ has joined #openstack-infra | 21:38 | |
| *** thorst_ has joined #openstack-infra | 21:39 | |
| *** jamielennox|away is now known as jamielennox | 21:39 | |
| clarkb | KaiyanSheng: yes it is failing due to a known issue with constraints and projects in the constraints list, let me get you a link with details on how to address it | 21:39 |
| KaiyanSheng | Awesome :-) Thank you! | 21:39 |
| *** doug-fish has joined #openstack-infra | 21:40 | |
| clarkb | https://review.openstack.org/#/c/301541/ see lifeless' comment | 21:40 |
| *** kzaitsev_mb has quit IRC | 21:41 | |
| *** ccamacho has quit IRC | 21:41 | |
| KaiyanSheng | @clarkb got it. Thanks! | 21:41 |
| *** annegentle has joined #openstack-infra | 21:42 | |
| fungi | i'm going to step out and get something to eat, then back to hopefully keep plugging at the storyboard-dev situation | 21:42 |
| Zara | \o/ | 21:42 |
| Zara | appreciate it | 21:42 |
| *** Swami has quit IRC | 21:42 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/system-config: Enable tcp/8088 on jenkins slaves https://review.openstack.org/317743 | 21:42 |
| jeblair | pabelanger: did you manage to get that rsync command working? | 21:42 |
| *** doug-fis_ has quit IRC | 21:42 | |
| *** tphummel has quit IRC | 21:42 | |
| pabelanger | jeblair: ^ I think that is what we need, I'll fire up a test locally in a few hours | 21:43 |
| *** kzaitsev_mb has joined #openstack-infra | 21:43 | |
| pabelanger | jeblair: not yet | 21:43 |
| *** thorst_ has quit IRC | 21:43 | |
| jeblair | pabelanger: i think we may either need to do that approach, install the jenkins/zuul ssh key on static.o.o, or use local_action | 21:43 |
| *** hashar has quit IRC | 21:44 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/system-config: Enable tcp/8088 on jenkins slaves https://review.openstack.org/317743 | 21:44 |
| pabelanger | jeblair: agreed. | 21:45 |
| *** edmondsw has quit IRC | 21:45 | |
| *** ccamacho has joined #openstack-infra | 21:45 | |
| rm_work | clarkb: nm i think i found it :P | 21:45 |
| clarkb | rm_work: what is the issue? | 21:46 |
| wznoinsk | hi infra, I'm thinking of touching /etc/fixed_disk_layout to avoid devstack-gate creating swap, I have 16GB for host VMs and always see more than 30% free even during tempest full, I do understand disk space is cheaper when you buy a cloud VM but would there be any reasons why not to disable the swap? (I'm ignoring the fact some bad code can go highwire as there isn't amount of ram/swap it would be enough in most of these situatio | 21:46 |
| wznoinsk | ns) | 21:46 |
| rm_work | it's running, but there's an error somewhere in my paths | 21:46 |
| *** kzaitsev_mb has quit IRC | 21:48 | |
| *** annegentle has quit IRC | 21:49 | |
| *** ccamacho has quit IRC | 21:50 | |
| *** tqtran has joined #openstack-infra | 21:52 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/project-config: Add epel support for configure_mirror.sh https://review.openstack.org/317747 | 21:52 |
| pabelanger | clarkb: fungi: jeblair: tested / working locally ^ | 21:52 |
| *** annegentle has joined #openstack-infra | 21:52 | |
| *** asettle has quit IRC | 21:53 | |
| jeblair | pabelanger, Shrews, clarkb: do you have a minute for an ansible brainstorming session? | 21:54 |
| clarkb | I derped and left laptop at home but can try to phone it | 21:54 |
| *** sdake_ is now known as sdake | 21:54 | |
| *** maishsk has joined #openstack-infra | 21:54 | |
| *** mriedem has quit IRC | 21:55 | |
| jeblair | pabelanger, Shrews, clarkb: https://etherpad.openstack.org/p/jZjPISYSOu | 21:56 |
| jeblair | i'm trying to figure out how to scp the logs from the worker to static.o.o | 21:56 |
| jeblair | i'm still typing in the etherpad, gimme a sec | 21:56 |
| jeblair | clarkb: does etherpad on phone work for you? | 21:57 |
| clarkb | jeblair: ya | 21:57 |
| clarkb | somewhat | 21:57 |
| SpamapS | So, I have a general purpose Zuul question.... | 22:01 |
| SpamapS | I have a job which may run on changes to let's say, 10 repos | 22:01 |
| SpamapS | one of those repos builds a package if there has been a change | 22:01 |
| *** netsin has quit IRC | 22:02 | |
| SpamapS | (it looks in the repo, compares to package repo, and if it's different, builds and uploads the new version) | 22:02 |
| *** netsin has joined #openstack-infra | 22:02 | |
| SpamapS | that version I just built.. I want to get that from the place where the job is running, back into... something.. as a build artifact | 22:02 |
| *** mixos has quit IRC | 22:03 | |
| jeblair | pabelanger, Shrews, clarkb: okay, i've filled out the etherpad with my ideas of how we could copy the logs off; 1 and 2 don't work (tried); 3 and 4 are ways that might work; can you think of any others? | 22:03 |
| *** daemontool has quit IRC | 22:03 | |
| jeblair | SpamapS: i think we need precise terminology here -- you said a repo builds a change; that doesn't compute | 22:03 |
| SpamapS | I suppose if the gate passes and my job is merged, I can discern the new version number and use the superrepo. | 22:03 |
| jeblair | SpamapS: (sorry, i'm not trying to be pedantic; it may have a substantial effect on how to think about this) | 22:04 |
| SpamapS | jeblair: the repo defines a build. | 22:04 |
| SpamapS | dude you don't have to explain taxonomy explosion to me. ;) | 22:04 |
| *** weshay has joined #openstack-infra | 22:04 | |
| jeblair | SpamapS: you just smurf the smurf | 22:04 |
| SpamapS | I understand that 98% of all discussions in openstack are about which meanings we're using for all the words right now. | 22:04 |
| SpamapS | jeblair: don't smurf the smurf without a smurf though | 22:04 |
| SpamapS | so, I have a repo which defines a package build | 22:05 |
| SpamapS | changes to it are fed into a zuul pipeline | 22:05 |
| SpamapS | a job which is running in that pipeline will compare the package repository to the version defined in the build, and if that version does not exist yet, it will build the package. | 22:05 |
| SpamapS | backing up | 22:06 |
| *** doug-fish has quit IRC | 22:06 | |
| SpamapS | I have a git repository | 22:06 |
| SpamapS | which defines a package build :) | 22:06 |
| *** psilvad has joined #openstack-infra | 22:06 | |
| jeblair | SpamapS: we have a number of jobs which put both intermediate or final artifacts on to tarballs.openstack.org | 22:08 |
| *** sigmavirus24 is now known as sigmavirus24_awa | 22:08 | |
| jeblair | SpamapS: (jobs that build, say, diskimages do this sort of thing) | 22:08 |
| jeblair | SpamapS: does that sound like what you need? | 22:08 |
| SpamapS | jeblair: yes I think that's the pattern I need. I want to build a {bag of bytes} and be able to determine which {bag of bytes} the pipeline produced. | 22:09 |
| SpamapS | so that I can use the same {bag of bytes} with the same {bag of commits} elsewhere. | 22:10 |
| jroll | SpamapS: sounds like you want a publisher stanza similar to https://github.com/openstack-infra/project-config/blob/master/jenkins/jobs/ironic-python-agent-jobs.yaml#L49 | 22:10 |
| jroll | SpamapS: that one in particular is run in the post queue, but I assume you could do it elsewhere if you desired (we use post to only do it once merged) | 22:11 |
| jeblair | SpamapS: is it a temporary or semi-permanent blob? like, does this make sense only in the context of check/gate builds for speculative changes? | 22:11 |
| pabelanger | jeblair: I have to run, but will review etherpad once I get back | 22:11 |
| jeblair | SpamapS: or is it as jroll suggests, something that might run in the post queue to update something public semi/permanent? | 22:11 |
| *** anteaya has quit IRC | 22:11 | |
| jroll | yeah, that's a good question | 22:11 |
| *** bhunter71 has joined #openstack-infra | 22:12 | |
| SpamapS | jeblair: semi-permanent. It is very important that the same build artifact used in passing the gate be combined with the other artifacts. | 22:12 |
| SpamapS | A post job would not make sense no. | 22:13 |
| SpamapS | well a post job might make sense for _combining_ the two things | 22:13 |
| jeblair | SpamapS: okay, so we're talking about the pre-merge context | 22:13 |
| SpamapS | (the two things being the package and the commits) | 22:13 |
| SpamapS | yes pre-merge | 22:13 |
| *** markvoelker has joined #openstack-infra | 22:14 | |
| SpamapS | Ok hm, actually I think I may have my answer now that we've gone through externalizing it from my head. | 22:14 |
| *** maishsk_ has joined #openstack-infra | 22:15 | |
| jeblair | SpamapS: i've been thinking about this a lot for zuulv3, and it's something i'd like to solve better there.... but basically the way i think about it is that each zuul item has a proposed future state of the world | 22:15 |
| *** baoli has quit IRC | 22:15 | |
| SpamapS | jeblair: go on | 22:16 |
| *** baoli has joined #openstack-infra | 22:16 | |
| jeblair | SpamapS: for git, zuul handles that internally -- it creates the proposed future state of all the git repos, and it gives that state a name, and puts that name in the git repo as the zuul ref for the item | 22:16 |
| jeblair | (refs/zuul/Zabcd....) | 22:16 |
| *** maishsk has quit IRC | 22:16 | |
| *** maishsk_ is now known as maishsk | 22:16 | |
| jeblair | SpamapS: but we might want to construct other aspects of a speculative state -- like a container, image, package repo, etc. | 22:17 |
| *** tpsilva has quit IRC | 22:17 | |
| SpamapS | right! | 22:17 |
| KaiyanSheng | @clarkb Thank you for your link. I still don't understand why https://review.openstack.org/#/c/315792/4 failed to install python-monascaclient but not earlier? We changed our tox file almost a month ago to follow upper-ocnstraint and it was fine at the beginning. | 22:18 |
| SpamapS | for my problem space, what I might do is just require that a user change the package version in their patch... | 22:18 |
| SpamapS | in this way, the zuul ref does contain the reference to the package version | 22:18 |
| *** jpr has quit IRC | 22:19 | |
| *** xyang1 has quit IRC | 22:19 | |
| *** rockyg has quit IRC | 22:19 | |
| SpamapS | so when it lands, I can use the https://review.openstack.org/Documentation/user-submodules.html feature to link the package repository change to commits on all of the other repositories that were tested with it. | 22:20 |
| clarkb | KaiyanSheng: because monascaclient wasnt in the constraints list at the time I bet | 22:20 |
| SpamapS | essentially, when I go to consume this, I just say "what's the version in the package's git repository?" and that version is the one I use. | 22:20 |
| clarkb | jeblair: re file copying I have nothing | 22:21 |
| jeblair | SpamapS: we can kinda/sorta approximate that for other jobs within a buildset -- a job could put something on tarballs keyed off of the zuul ref, and other jobs in the same buildset can find it based on the zuul ref. but a second item stacked on the first wouldn't see it. so that's part of what we need to add to zuulv3, is a way to pass down that state from one change to its children | 22:21 |
| *** shashank_hegde has quit IRC | 22:21 | |
| *** markvoelker has quit IRC | 22:21 | |
| KaiyanSheng | @clarkb Yes you are right!!! | 22:21 |
| *** markvoelker has joined #openstack-infra | 22:22 | |
| lifeless | clarkb: Nakato and I are discussing how to tackle it | 22:22 |
| SpamapS | jeblair: Could it be as simple as having a monotonically advancing counter for any pipeline? | 22:22 |
| SpamapS | I guess that only works for post | 22:22 |
| SpamapS | n/m | 22:22 |
| *** annegentle has quit IRC | 22:23 | |
| SpamapS | jeblair: I do very much appreciate you helping me think this through. | 22:23 |
| *** dansmith has quit IRC | 22:23 | |
| *** dansmith has joined #openstack-infra | 22:23 | |
| jeblair | SpamapS: you're welcome. i may not fully understand what you're saying yet though. :) | 22:24 |
| *** rossella_s has quit IRC | 22:24 | |
| SpamapS | jeblair: I'm not really sure I understand the problem with child commits, but I don't want to make you explain it to me. :) | 22:24 |
| *** dougshelley66 has quit IRC | 22:24 | |
| SpamapS | jeblair: we probably need a white board and hands to wave. | 22:24 |
| *** rossella_s has joined #openstack-infra | 22:24 | |
| *** sridhar_ram has joined #openstack-infra | 22:24 | |
| *** Swami has joined #openstack-infra | 22:24 | |
| *** dougshelley66 has joined #openstack-infra | 22:24 | |
| jeblair | SpamapS: it would probably be best if both of us understood each other, but yeah, we may not be able to accomplish that in a reasonable amount of time right here :) | 22:24 |
| *** Swami has quit IRC | 22:25 | |
| *** Swami has joined #openstack-infra | 22:26 | |
| *** rhochmuth has joined #openstack-infra | 22:26 | |
| *** baoli has quit IRC | 22:26 | |
| *** baoli has joined #openstack-infra | 22:26 | |
| *** dimtruck is now known as zz_dimtruck | 22:27 | |
| *** Swami_ has quit IRC | 22:28 | |
| *** kzaitsev_mb has joined #openstack-infra | 22:29 | |
| *** rhochmuth has quit IRC | 22:30 | |
| *** nwkarsten has quit IRC | 22:30 | |
| *** aorourke__ is now known as aorourke | 22:30 | |
| openstackgerrit | David Lyle proposed openstack-infra/project-config: Update horizon dsvm tempest job https://review.openstack.org/314795 | 22:32 |
| *** doug-fish has joined #openstack-infra | 22:32 | |
| *** Jeffrey4l has joined #openstack-infra | 22:35 | |
| *** doug-fish has quit IRC | 22:36 | |
| *** ccamacho has joined #openstack-infra | 22:37 | |
| *** doug-fish has joined #openstack-infra | 22:39 | |
| *** _sarob has quit IRC | 22:40 | |
| craige | o/ | 22:40 |
| *** ayoung has joined #openstack-infra | 22:42 | |
| jhesketh | Morning | 22:43 |
| Shrews | jeblair: i'm not aware of other options, but i'm personally a fan of letting static.o.o do the work. | 22:43 |
| Shrews | compared to the other options you listed, that is | 22:43 |
| *** doug-fish has quit IRC | 22:44 | |
| *** rprakash_ has joined #openstack-infra | 22:45 | |
| rprakash_ | #info fungi there? | 22:45 |
| *** sdake_ has joined #openstack-infra | 22:45 | |
| *** zz_dimtruck is now known as dimtruck | 22:45 | |
| *** _prad_ has quit IRC | 22:47 | |
| zaro | fungi: i was wrong about import rename keeping subscriptions. it does not map subscriptions to the new project nor does persist starred setting on those changes. | 22:48 |
| *** sdake has quit IRC | 22:48 | |
| *** kzaitsev_mb has quit IRC | 22:49 | |
| *** psilvad has quit IRC | 22:49 | |
| *** baoli has quit IRC | 22:51 | |
| *** baoli has joined #openstack-infra | 22:51 | |
| *** cody-somerville has joined #openstack-infra | 22:52 | |
| KaiyanSheng | @clarkb I understand why the check job failed but I still follow lifeless's comment about "convert to a file reference" or "remove from constraint file". What constraints file we are talking about? The tox.ini? I added a "install_command = pip install -U --force-reinstall {opts} {packages}" under testenv:venv in review https://review.openstack.org/#/c/317758/ | 22:52 |
| KaiyanSheng | @clarkb not sure that's the solution or not... | 22:52 |
| openstackgerrit | Khai Do proposed openstack-infra/nodepool: Remove duplicate python-jenkins code from nodepool https://review.openstack.org/259157 | 22:54 |
| *** sdake_ has quit IRC | 22:54 | |
| *** nwkarsten has joined #openstack-infra | 22:55 | |
| *** shashank_hegde has joined #openstack-infra | 22:56 | |
| *** camunoz has quit IRC | 22:56 | |
| *** camunoz has joined #openstack-infra | 22:57 | |
| *** hongbin has quit IRC | 22:58 | |
| *** doug-fish has joined #openstack-infra | 22:59 | |
| *** nwkarsten has quit IRC | 22:59 | |
| *** rbrndt has quit IRC | 23:00 | |
| *** r-daneel has joined #openstack-infra | 23:01 | |
| *** doug-fish has quit IRC | 23:03 | |
| openstackgerrit | Merged openstack-infra/system-config: Add a storyboard-dev server https://review.openstack.org/312124 | 23:05 |
| *** baoli has quit IRC | 23:06 | |
| *** Goneri has joined #openstack-infra | 23:07 | |
| *** baoli has joined #openstack-infra | 23:07 | |
| *** lakshmiS has joined #openstack-infra | 23:08 | |
| *** woodster_ has quit IRC | 23:08 | |
| pabelanger | looks like we're trying to recover from some issue in ovh-bhs1 in nodepool | 23:09 |
| *** kzaitsev_mb has joined #openstack-infra | 23:09 | |
| openstackgerrit | Merged openstack-infra/system-config: Realize SotK and Zara on the storyboard-dev server https://review.openstack.org/315706 | 23:10 |
| *** |-paul-| has joined #openstack-infra | 23:10 | |
| *** vhosakot has quit IRC | 23:10 | |
| *** gordc has quit IRC | 23:11 | |
| *** markvoelker has quit IRC | 23:12 | |
| *** baoli has quit IRC | 23:16 | |
| *** baoli has joined #openstack-infra | 23:17 | |
| openstackgerrit | Merged openstack-infra/project-config: Switch to qcow2 for OVH clouds https://review.openstack.org/315680 | 23:17 |
| *** kzaitsev_mb has quit IRC | 23:17 | |
| Jeffrey4l | hey pabelanger , could check this PS? https://review.openstack.org/315860 the hostname on centos is not changed, which case the rabbitmq crash. | 23:17 |
| Jeffrey4l | here is the log http://logs.openstack.org/60/315860/25/check/gate-kolla-dsvm-deploy-centos-binary/0cec277/console.html#_2016-05-17_17_26_31_505 | 23:17 |
| ianw | SpamapS / greghaynes : mind just sanity checking https://review.openstack.org/#/c/317216/2 ? trying to make the dib logs a bit more usable, since i seem to be pulling them apart a lot | 23:18 |
| Jeffrey4l | could u have any idea about this? | 23:18 |
| *** cschwede has quit IRC | 23:18 | |
| *** kzaitsev_mb has joined #openstack-infra | 23:19 | |
| *** pahuang has quit IRC | 23:19 | |
| ianw | SpamapS / greghaynes : also, do you think dib-utils is probably past it's time of being useful? | 23:19 |
| pabelanger | Jeffrey4l: I am not that familiar with kolla | 23:20 |
| pabelanger | Jeffrey4l: but keep in mind, the hostname is unique for each job we run | 23:21 |
| *** salv-orlando has quit IRC | 23:21 | |
| *** cschwede has joined #openstack-infra | 23:22 | |
| Jeffrey4l | pabelanger, i think this is introduced by the new dib image. | 23:22 |
| jeblair | pabelanger: Shrews is voting for 'install key on static.o.o and pull from there'. you indicated that's not your favorite, but is acceptable. i'm starting to lean that way. | 23:22 |
| Jeffrey4l | ok. i will simplify the script and explain what's the issue is. | 23:23 |
| pabelanger | Jeffrey4l: I confirmed in the experimental pipeline kolla passed your votes before switching to DIB. When I was atleast looking at the jobs, I didn't see any errors. Not to say it isn't an issue now | 23:23 |
| Shrews | jeblair: i'm not understanding the downside of that, tbh. is it a security concern? | 23:23 |
| Jeffrey4l | ok. thanks. | 23:24 |
| *** sdake has joined #openstack-infra | 23:24 | |
| *** baoli has quit IRC | 23:24 | |
| pabelanger | jeblair: Shrews: Ya, my only real concern is, we now need to bring static.o.o into the fold with zuul-launcher. EG: installing zuul bits onto static.o.o, I am fine with doing it now, but wouldn't like to see us do that long term | 23:24 |
| *** whoops has quit IRC | 23:24 | |
| jeblair | pabelanger: well, it's just the ssh key, not zuul itself, but point taken | 23:25 |
| jeblair | it is an extra requirement | 23:25 |
| Shrews | on the plus side, the controller(s) do not need massive disk storage | 23:25 |
| *** pahuang has joined #openstack-infra | 23:26 | |
| jeblair | like, the only requirement to have jenkins copy something to a remote host is that it have the public key. this means that to do the same thing with zuul-launcher/ansible, it *additionally* needs a private key. | 23:26 |
| jeblair | that rubs me the wrong way, even though it's sensible :) | 23:26 |
| jeblair | Shrews: yeah -- if we use the controller as intermediate, we wouldn't need the storage for long, but if a whole bunch of jobs ended at once and each had many GB of logs, it could (briefly) be a problem | 23:27 |
| pabelanger | I should note, doing number 2, is how we do it today with puppet logs on our servers. So, we should have a playbook around with this concept working | 23:28 |
| jeblair | pabelanger: well, #2 doesn't work, because of the reasons i mentioned there -- if you know how to fix it, i'd love to see it | 23:29 |
| *** kzaitsev_mb has quit IRC | 23:29 | |
| openstackgerrit | John L. Villalovos proposed openstack-infra/project-config: Ironic-Grenade: Remove DEVSTACK_GATE_TEMPEST_REGEX='ironic' https://review.openstack.org/317766 | 23:30 |
| pabelanger | jeblair: sure, I don't mind taking a stab at it, but can't do it this evening. I say we proceed with the plan you have laid out currently | 23:30 |
| jeblair | okay, i'll write a patch to put the key on static for now | 23:30 |
| *** rprakash_ has quit IRC | 23:31 | |
| jeblair | (honestly, *either* logs-in-swift or logs-in-afs make this easier, but we have to move off of jenkins first) | 23:31 |
| *** rhochmuth has joined #openstack-infra | 23:31 | |
| *** rprakash has quit IRC | 23:31 | |
| *** dansmith has quit IRC | 23:31 | |
| *** dansmith has joined #openstack-infra | 23:32 | |
| Shrews | jeblair: technically, i'd think that #2 would be possible. your playbook seems a bit wonky to me, though. | 23:34 |
| *** dingyichen has joined #openstack-infra | 23:34 | |
| pabelanger | jeblair: is there a log for the failure on #2 some place? | 23:34 |
| jeblair | Shrews: well, the playbook doesn't work. but yeah, the trick is that i don't know that we can say in the second task "copy from controller to static" when we're running a play in the context of "node". | 23:35 |
| *** Swami_ has joined #openstack-infra | 23:35 | |
| *** KaiyanSheng has quit IRC | 23:36 | |
| *** mixos has joined #openstack-infra | 23:36 | |
| jeblair | pabelanger: pasted output into etherpad | 23:36 |
| *** kzaitsev_mb has joined #openstack-infra | 23:36 | |
| pabelanger | jeblair: thanks | 23:37 |
| Shrews | jeblair: the trick would be use of local_action | 23:37 |
| *** armax_ has joined #openstack-infra | 23:37 | |
| jeblair | Shrews: yeah, i think the way to fix #2 is #4 | 23:37 |
| *** Goneri has quit IRC | 23:39 | |
| *** Qiming has joined #openstack-infra | 23:39 | |
| *** Swami has quit IRC | 23:39 | |
| *** armax has quit IRC | 23:39 | |
| *** armax_ is now known as armax | 23:39 | |
| Shrews | jeblair: well, that or just separate into two tasks | 23:39 |
| jeblair | Shrews: what two? | 23:40 |
| pabelanger | Ya, I think I see the issue with #2. it will basically look like: https://github.com/openstack-infra/ansible-puppet/blob/master/tasks/main.yml#L81 | 23:40 |
| pabelanger | replacing puppet_post_puppetdb with rsync | 23:40 |
| Shrews | jeblair: one to syncronize to controller, another (using local_action) to send to static.o.o | 23:40 |
| openstackgerrit | Merged openstack-infra/nodepool: Use clean-floating-ips for yaml setting https://review.openstack.org/317734 | 23:41 |
| pabelanger | Shrews: agreed | 23:41 |
| jeblair | Shrews: there are two tasks there | 23:41 |
| Shrews | jeblair: i could try to cook up an example if you want, but i still like option #3 better | 23:41 |
| *** Swami_ has quit IRC | 23:41 | |
| *** rhochmuth has quit IRC | 23:42 | |
| *** cody-somerville has quit IRC | 23:43 | |
| jeblair | with synchronize, it boils down to: in push mode, the controller or delegate is the source. that *only* leaves the node as the possible destination. so there's no way to specify static.o.o as the target | 23:43 |
| Shrews | jeblair: yes, there are, but the 2nd one isn't executing locally | 23:44 |
| jeblair | but i'd love to see why that's wrong | 23:44 |
| Shrews | jeblair: the 2nd would have to be something like: local_action: command /bin/scp <src> static.o.o:<dest> | 23:44 |
| jeblair | Shrews: right that's what i wrote in #4 | 23:45 |
| jeblair | so i think we're in agreement | 23:45 |
| Shrews | jeblair: oh, so you did. | 23:45 |
| Shrews | jeblair: consensus! | 23:46 |
| jeblair | the thing i kinda like about that is that it's the fastest way to get this going, and i don't have to explain to anyone why our static webserver needs a private key on it | 23:46 |
| *** kzaitsev_mb has quit IRC | 23:46 | |
| *** IlyaG has quit IRC | 23:50 | |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder: Add PS4 to show file/function/line in debug output https://review.openstack.org/317260 | 23:50 |
| openstackgerrit | James E. Blair proposed openstack-infra/system-config: Add jenkins/zuul private key to static.o.o https://review.openstack.org/317773 | 23:51 |
| jeblair | pabelanger, Shrews: let's see what other infra-root folks think about that^. in the mean time, let's give the local_action a try | 23:51 |
| *** kzaitsev_mb has joined #openstack-infra | 23:54 | |
| jeblair | [WARNING]: Consider using synchronize module rather than running rsync | 23:54 |
| jeblair | hehe :) | 23:54 |
| Shrews | jeblair: left my thoughts on that review for others to pick over | 23:55 |
| *** chem`` has quit IRC | 23:55 | |
| jeblair | http://logs.openstack.org/87/316187/2/check/gate-infra-puppet-apply-debian-jessie/e17a5fd/ | 23:55 |
| jeblair | that's an improvement -- the directory exists | 23:55 |
| Shrews | i think i should probably have supper now | 23:55 |
| jeblair | it is empty | 23:55 |
| jeblair | i will go try to find out where on our 14TB log server those files ended up | 23:56 |
| jeblair | oh, heh, they are there, the directory is just mode 700 | 23:57 |
| *** pradk has quit IRC | 23:59 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!
