| clarkb | asselin_: that is a puppet 3 behavior that changes in puppet 4 | 00:00 |
|---|---|---|
| clarkb | asselin_: it is one of the things that bugs me about puppet param passing | 00:00 |
| asselin_ | changes for the worse? | 00:00 |
| pabelanger | don't want to build up a bunch of if logic to populate the DAEMON_ARGS | 00:00 |
| clarkb | asselin_: no changes for the beter, undef will be passed through the whole way | 00:00 |
| clarkb | so it actually listens to you when you pass in values | 00:00 |
| asselin_ | oh I see...so undoes this neat feature I discovered... | 00:01 |
| asselin_ | ok, back to copying and pasting defaults | 00:01 |
| clarkb | yes because this "feature" is bad | 00:01 |
| asselin_ | yeah...agree, it's definitely conterintuitive. | 00:02 |
| clarkb | it means that you can't unset a default for example | 00:03 |
| *** abregman has quit IRC | 00:03 | |
| pabelanger | clarkb: think we can do the bare-precise removal tonight? | 00:04 |
| *** dstufft has quit IRC | 00:04 | |
| *** dstufft- is now known as dstufft | 00:04 | |
| openstackgerrit | Davanum Srinivas (dims) proposed openstack/requirements: Updated from generate-constraints https://review.openstack.org/309273 | 00:04 |
| *** _ari_ has joined #openstack-infra | 00:05 | |
| openstackgerrit | Joshua Harlow proposed openstack/requirements: Oslo releases for week of may 9th https://review.openstack.org/314338 | 00:07 |
| *** abregman has joined #openstack-infra | 00:08 | |
| *** mriedem_afk has quit IRC | 00:08 | |
| *** mriedem has joined #openstack-infra | 00:08 | |
| *** armax has joined #openstack-infra | 00:08 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/nodepool: Test we group dib uploads by image name https://review.openstack.org/314315 | 00:08 |
| *** Jeffrey4l_ has joined #openstack-infra | 00:10 | |
| *** johnny___ has quit IRC | 00:11 | |
| *** rfolco has quit IRC | 00:15 | |
| *** sridhar_ram has quit IRC | 00:17 | |
| *** gongysh has quit IRC | 00:19 | |
| *** ddieterly[away] is now known as ddieterly | 00:21 | |
| *** jpr has joined #openstack-infra | 00:27 | |
| openstackgerrit | Joshua Harlow proposed openstack-infra/project-config: Remove oslo-incubator and absorb oslo.tools repo/project https://review.openstack.org/314342 | 00:29 |
| *** Sukhdev has quit IRC | 00:30 | |
| *** roxanagh_ has quit IRC | 00:31 | |
| *** Sukhdev has joined #openstack-infra | 00:31 | |
| *** abitha has quit IRC | 00:31 | |
| *** ffrank has quit IRC | 00:31 | |
| *** bpokorny has quit IRC | 00:31 | |
| *** Goneri has joined #openstack-infra | 00:32 | |
| openstackgerrit | Davanum Srinivas (dims) proposed openstack/requirements: Updated from generate-constraints https://review.openstack.org/309273 | 00:32 |
| *** pahuang has quit IRC | 00:36 | |
| openstackgerrit | Christopher Aedo proposed openstack-infra/irc-meetings: Add App Ecosystem WG meeting https://review.openstack.org/314322 | 00:36 |
| *** Sukhdev has quit IRC | 00:37 | |
| openstackgerrit | Merged openstack/requirements: Bump stevedore to 1.10 https://review.openstack.org/313985 | 00:39 |
| *** Goneri has quit IRC | 00:39 | |
| *** salv-orlando has joined #openstack-infra | 00:42 | |
| *** pabelanger has quit IRC | 00:42 | |
| *** pahuang has joined #openstack-infra | 00:43 | |
| *** kgiusti has joined #openstack-infra | 00:44 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/nodepool: Test we group dib uploads by image name https://review.openstack.org/314315 | 00:44 |
| *** ajo has joined #openstack-infra | 00:44 | |
| *** dmanchad has joined #openstack-infra | 00:45 | |
| *** pabelanger has joined #openstack-infra | 00:45 | |
| *** mriedem1 has joined #openstack-infra | 00:47 | |
| *** mriedem has quit IRC | 00:48 | |
| *** salv-orlando has quit IRC | 00:48 | |
| *** dmellado has joined #openstack-infra | 00:49 | |
| openstackgerrit | Kien Ha proposed openstack-infra/jenkins-job-builder: Add test and update documentation for mailer plugin https://review.openstack.org/312810 | 00:53 |
| *** Swami has quit IRC | 00:53 | |
| *** tqtran has quit IRC | 00:54 | |
| *** asselin has joined #openstack-infra | 00:56 | |
| *** mriedem1 is now known as mriedem | 00:56 | |
| *** gongysh has joined #openstack-infra | 00:59 | |
| *** _ari_ has quit IRC | 01:00 | |
| *** sdake has joined #openstack-infra | 01:02 | |
| *** asselin has quit IRC | 01:05 | |
| *** zhurong has joined #openstack-infra | 01:05 | |
| *** mriedem1 has joined #openstack-infra | 01:06 | |
| *** mriedem has quit IRC | 01:08 | |
| dims | lifeless : we have some stuff, we can add details - https://etherpad.openstack.org/p/requirements-tasks | 01:09 |
| openstackgerrit | Merged openstack-infra/irc-meetings: Add App Ecosystem WG meeting https://review.openstack.org/314322 | 01:11 |
| *** amitgandhinz has joined #openstack-infra | 01:14 | |
| *** baoli has quit IRC | 01:16 | |
| *** baoli has joined #openstack-infra | 01:16 | |
| *** apoorvad has quit IRC | 01:16 | |
| lifeless | dims: yeah, line 63 | 01:18 |
| *** shashank_hegde has quit IRC | 01:19 | |
| *** mixos has joined #openstack-infra | 01:21 | |
| *** hdd has joined #openstack-infra | 01:22 | |
| *** baoli has quit IRC | 01:22 | |
| *** kengo_sakai has joined #openstack-infra | 01:23 | |
| *** gildub has quit IRC | 01:24 | |
| *** mriedem1 has quit IRC | 01:24 | |
| *** hdd has quit IRC | 01:28 | |
| *** thorst_ has joined #openstack-infra | 01:28 | |
| *** baoli has joined #openstack-infra | 01:34 | |
| *** vhosakot has joined #openstack-infra | 01:44 | |
| *** salv-orlando has joined #openstack-infra | 01:44 | |
| *** hichihara has quit IRC | 01:45 | |
| *** baoli has quit IRC | 01:48 | |
| *** baoli has joined #openstack-infra | 01:48 | |
| *** roxanagh_ has joined #openstack-infra | 01:48 | |
| *** rhallisey has quit IRC | 01:48 | |
| *** gongysh has quit IRC | 01:50 | |
| *** salv-orlando has quit IRC | 01:51 | |
| *** tqtran has joined #openstack-infra | 01:51 | |
| *** hdd has joined #openstack-infra | 01:53 | |
| *** Daisy has joined #openstack-infra | 01:53 | |
| *** tqtran has quit IRC | 01:57 | |
| *** zhurong has quit IRC | 01:57 | |
| *** zhurong has joined #openstack-infra | 01:58 | |
| *** gildub has joined #openstack-infra | 02:01 | |
| *** anteaya has quit IRC | 02:02 | |
| *** yamahata has joined #openstack-infra | 02:03 | |
| *** baoli has quit IRC | 02:03 | |
| openstackgerrit | Fei Long Wang proposed openstack-infra/project-config: Enable PEP8 job for Distil service https://review.openstack.org/314397 | 02:13 |
| *** IlyaG has joined #openstack-infra | 02:17 | |
| *** ayoung has quit IRC | 02:17 | |
| *** woodster_ has quit IRC | 02:18 | |
| *** roxanagh_ has quit IRC | 02:21 | |
| *** gongysh has joined #openstack-infra | 02:23 | |
| *** amotoki has quit IRC | 02:25 | |
| *** IlyaG has quit IRC | 02:25 | |
| *** vilobhmm11 has joined #openstack-infra | 02:27 | |
| *** tphummel has quit IRC | 02:28 | |
| *** elo has quit IRC | 02:28 | |
| *** elo has joined #openstack-infra | 02:31 | |
| *** MarkAtwood has quit IRC | 02:31 | |
| *** armax_ has joined #openstack-infra | 02:34 | |
| *** ddieterly is now known as ddieterly[away] | 02:34 | |
| *** furlongm has quit IRC | 02:37 | |
| *** armax has quit IRC | 02:37 | |
| *** armax_ is now known as armax | 02:37 | |
| *** hdd has quit IRC | 02:38 | |
| *** rajinir has joined #openstack-infra | 02:44 | |
| *** jokke_ has quit IRC | 02:45 | |
| *** jokke_ has joined #openstack-infra | 02:45 | |
| *** tlian has quit IRC | 02:48 | |
| *** tphummel has joined #openstack-infra | 02:49 | |
| *** yuanying has quit IRC | 02:51 | |
| *** amotoki has joined #openstack-infra | 02:52 | |
| *** cody-somerville has joined #openstack-infra | 02:52 | |
| *** salv-orlando has joined #openstack-infra | 02:53 | |
| *** hdd has joined #openstack-infra | 02:54 | |
| *** salv-orlando has quit IRC | 02:54 | |
| *** amotoki has quit IRC | 03:00 | |
| *** tphummel has quit IRC | 03:01 | |
| *** Sukhdev has joined #openstack-infra | 03:05 | |
| *** sdake has quit IRC | 03:07 | |
| openstackgerrit | sebastian marcet proposed openstack-infra/openstackid: Fix on OpenId 2.0 User Discovery https://review.openstack.org/314403 | 03:09 |
| *** amotoki has joined #openstack-infra | 03:10 | |
| *** rfolco has joined #openstack-infra | 03:17 | |
| *** akshai has joined #openstack-infra | 03:18 | |
| *** Jeffrey4l_ has quit IRC | 03:18 | |
| *** zhurong has quit IRC | 03:18 | |
| *** Jeffrey4l_ has joined #openstack-infra | 03:19 | |
| *** gongysh has quit IRC | 03:20 | |
| *** IlyaG has joined #openstack-infra | 03:26 | |
| *** links has joined #openstack-infra | 03:29 | |
| *** dkliban has left #openstack-infra | 03:30 | |
| *** amotoki has quit IRC | 03:31 | |
| *** IlyaG has quit IRC | 03:31 | |
| *** thorst_ has quit IRC | 03:33 | |
| *** thorst_ has joined #openstack-infra | 03:34 | |
| *** ddieterly[away] has quit IRC | 03:35 | |
| *** sridhar_ram has joined #openstack-infra | 03:35 | |
| *** ccamacho has quit IRC | 03:36 | |
| *** sridhar_ram1 has joined #openstack-infra | 03:37 | |
| *** thorst_ has quit IRC | 03:38 | |
| *** amotoki has joined #openstack-infra | 03:39 | |
| *** roxanagh_ has joined #openstack-infra | 03:39 | |
| *** ccamacho has joined #openstack-infra | 03:39 | |
| *** sridhar_ram has quit IRC | 03:40 | |
| *** dimtruck is now known as zz_dimtruck | 03:40 | |
| *** zz_dimtruck is now known as dimtruck | 03:40 | |
| *** ayoung has joined #openstack-infra | 03:42 | |
| *** jamesmca_ has joined #openstack-infra | 03:42 | |
| *** thorst_ has joined #openstack-infra | 03:42 | |
| *** amitgandhinz has quit IRC | 03:44 | |
| *** shashank_hegde has joined #openstack-infra | 03:45 | |
| *** abregman has quit IRC | 03:46 | |
| *** jamesmca_ has quit IRC | 03:46 | |
| *** sridhar_ram1 is now known as sridhar_ram | 03:47 | |
| *** yuanying has joined #openstack-infra | 03:48 | |
| *** tqtran has joined #openstack-infra | 03:53 | |
| *** dimtruck is now known as zz_dimtruck | 03:55 | |
| *** tqtran has quit IRC | 03:57 | |
| *** sirushti has quit IRC | 03:57 | |
| *** salv-orlando has joined #openstack-infra | 03:58 | |
| *** jamespage has quit IRC | 04:00 | |
| *** gnuoy has quit IRC | 04:00 | |
| *** gnuoy has joined #openstack-infra | 04:00 | |
| *** jamespage has joined #openstack-infra | 04:00 | |
| *** salv-orlando has quit IRC | 04:02 | |
| *** vilobhmm11 has quit IRC | 04:04 | |
| *** Daisy has quit IRC | 04:05 | |
| *** yamamot__ has joined #openstack-infra | 04:05 | |
| *** Daisy has joined #openstack-infra | 04:05 | |
| *** Swanson has quit IRC | 04:05 | |
| *** Swanson has joined #openstack-infra | 04:06 | |
| *** sirushti has joined #openstack-infra | 04:06 | |
| *** shashank_hegde has quit IRC | 04:09 | |
| sshnaidm | clarkb, hi | 04:09 |
| *** shashank_hegde has joined #openstack-infra | 04:09 | |
| *** Daisy_ has joined #openstack-infra | 04:09 | |
| sshnaidm | clarkb, about https://review.openstack.org/#/c/312985/ , if I tag it differently will it solve the issue? | 04:10 |
| *** Daisy has quit IRC | 04:10 | |
| *** vilobhmm11 has joined #openstack-infra | 04:10 | |
| *** zz_dimtruck is now known as dimtruck | 04:10 | |
| *** Daisy_ has quit IRC | 04:12 | |
| *** roxanagh_ has quit IRC | 04:12 | |
| *** Daisy has joined #openstack-infra | 04:12 | |
| *** vilobhmm11 has quit IRC | 04:13 | |
| clarkb | sshnaidm: no you need timestamps | 04:13 |
| *** sdake has joined #openstack-infra | 04:13 | |
| sshnaidm | clarkb, ok, thanks | 04:13 |
| clarkb | and if you tag it differently then you need to provide the grok rules for that tag | 04:13 |
| *** Daisy has quit IRC | 04:17 | |
| *** dimtruck is now known as zz_dimtruck | 04:20 | |
| *** vilobhmm11 has joined #openstack-infra | 04:20 | |
| *** kushal has joined #openstack-infra | 04:21 | |
| *** oanson has joined #openstack-infra | 04:22 | |
| *** rlandy has quit IRC | 04:24 | |
| *** vilobhmm11 has quit IRC | 04:25 | |
| *** shashank_hegde has quit IRC | 04:29 | |
| *** psachin has joined #openstack-infra | 04:32 | |
| *** ramishra has joined #openstack-infra | 04:33 | |
| *** cody-somerville has quit IRC | 04:36 | |
| *** fedexo has joined #openstack-infra | 04:42 | |
| *** Nikolay_St has joined #openstack-infra | 04:46 | |
| *** rajinir has quit IRC | 04:46 | |
| *** shashank_hegde has joined #openstack-infra | 04:52 | |
| *** rfolco has quit IRC | 04:53 | |
| *** salv-orlando has joined #openstack-infra | 04:57 | |
| *** akshai has quit IRC | 05:00 | |
| *** jpr has quit IRC | 05:00 | |
| *** Sukhdev has quit IRC | 05:01 | |
| openstackgerrit | Vladimir Kozhukalov proposed openstack-infra/project-config: Decouple Shotgun project from Fuel https://review.openstack.org/298615 | 05:02 |
| kozhukalov | team, could you please review https://review.openstack.org/#/c/298615/ ? | 05:03 |
| *** cbader has quit IRC | 05:04 | |
| *** zhurong has joined #openstack-infra | 05:05 | |
| *** javeriak has joined #openstack-infra | 05:06 | |
| openstackgerrit | Merged openstack/requirements: Updated from generate-constraints https://review.openstack.org/309273 | 05:06 |
| *** sdake has quit IRC | 05:06 | |
| *** winggundamth has joined #openstack-infra | 05:07 | |
| *** armax has quit IRC | 05:08 | |
| *** roxanagh_ has joined #openstack-infra | 05:08 | |
| *** Daisy has joined #openstack-infra | 05:15 | |
| *** hdd has quit IRC | 05:17 | |
| *** sridhar_ram has quit IRC | 05:19 | |
| *** fedexo has quit IRC | 05:20 | |
| *** fedexo has joined #openstack-infra | 05:21 | |
| *** kushal has quit IRC | 05:22 | |
| *** IlyaG has joined #openstack-infra | 05:23 | |
| *** abregman has joined #openstack-infra | 05:23 | |
| *** shashank_hegde has quit IRC | 05:23 | |
| *** cody-somerville has joined #openstack-infra | 05:25 | |
| *** IlyaG has quit IRC | 05:27 | |
| *** Nikolay_St has quit IRC | 05:36 | |
| *** savihou has joined #openstack-infra | 05:38 | |
| *** kushal has joined #openstack-infra | 05:38 | |
| openstackgerrit | Jamie Lennox proposed openstack/requirements: Bump requests-mock to 1.0 https://review.openstack.org/313984 | 05:39 |
| *** roxanagh_ has quit IRC | 05:42 | |
| *** amitgandhinz has joined #openstack-infra | 05:45 | |
| openstackgerrit | Sergey Kraynev proposed openstack-infra/project-config: Add ci-cd-pipeline-app-murano project to openstack https://review.openstack.org/309383 | 05:45 |
| *** javeriak has quit IRC | 05:46 | |
| *** shashank_hegde has joined #openstack-infra | 05:47 | |
| *** amitgandhinz has quit IRC | 05:50 | |
| *** d0ugal has joined #openstack-infra | 05:52 | |
| *** mrmartin has joined #openstack-infra | 05:53 | |
| *** vhosakot has quit IRC | 05:57 | |
| *** oanson has quit IRC | 06:00 | |
| openstackgerrit | Masayuki Igawa proposed openstack-infra/subunit2sql: Capitalize first characters in param docs https://review.openstack.org/306908 | 06:03 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack-infra/project-config: Normalize projects.yaml https://review.openstack.org/314421 | 06:03 |
| *** nadya has joined #openstack-infra | 06:04 | |
| *** nadya has quit IRC | 06:05 | |
| *** thorst_ has quit IRC | 06:06 | |
| *** thorst_ has joined #openstack-infra | 06:06 | |
| *** amotoki has quit IRC | 06:10 | |
| *** thorst_ has quit IRC | 06:11 | |
| *** gongysh has joined #openstack-infra | 06:16 | |
| *** zeih has joined #openstack-infra | 06:18 | |
| *** mrmartin has quit IRC | 06:21 | |
| *** Daisy has quit IRC | 06:24 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/requirements: Updated from generate-constraints https://review.openstack.org/314423 | 06:24 |
| *** Daisy has joined #openstack-infra | 06:24 | |
| *** andreas_s has joined #openstack-infra | 06:26 | |
| *** rcernin has joined #openstack-infra | 06:27 | |
| *** haaj has joined #openstack-infra | 06:27 | |
| *** mixos has quit IRC | 06:27 | |
| *** Nikolay_St has joined #openstack-infra | 06:27 | |
| *** Daisy has quit IRC | 06:28 | |
| *** kzaitsev_mb has joined #openstack-infra | 06:30 | |
| *** haaj_ has joined #openstack-infra | 06:30 | |
| *** yolanda has joined #openstack-infra | 06:30 | |
| *** gongysh has quit IRC | 06:31 | |
| *** javeriak has joined #openstack-infra | 06:31 | |
| *** acruz has joined #openstack-infra | 06:33 | |
| *** haaj has quit IRC | 06:33 | |
| *** vilobhmm11 has joined #openstack-infra | 06:34 | |
| yolanda | good morning | 06:36 |
| AJaeger | morning yolanda ! | 06:36 |
| openstackgerrit | Merged openstack-infra/project-config: Normalize projects.yaml https://review.openstack.org/314421 | 06:38 |
| yolanda | AJaeger, do you know if uploaded tarballs to static expire somehow? right now i'm building an image daily for magnum and uploading to tarball, and i'd like to keep only the latest 5. Do we have some sample of projects doing that? | 06:39 |
| AJaeger | yolanda: I don't know ;( | 06:41 |
| *** rossella_s has joined #openstack-infra | 06:42 | |
| *** nadya has joined #openstack-infra | 06:42 | |
| yolanda | this is a common pattern that we were using downstream, but i don't see anything similar in upstream, and how to purge the older artifacts | 06:45 |
| *** gongysh has joined #openstack-infra | 06:45 | |
| openstackgerrit | Merged openstack-infra/project-config: zuul: add missing layout for puppet-ceph/tarball jobs https://review.openstack.org/314292 | 06:46 |
| *** amitgandhinz has joined #openstack-infra | 06:46 | |
| openstackgerrit | Mehdi Abaakouk (sileht) proposed openstack-infra/project-config: gnocchi: use Ceph devstack plugin https://review.openstack.org/314430 | 06:47 |
| *** DevBox has joined #openstack-infra | 06:47 | |
| *** kzaitsev_mb has quit IRC | 06:47 | |
| *** mrmartin has joined #openstack-infra | 06:47 | |
| openstackgerrit | Merged openstack-infra/project-config: Add project-config reviewing guidelines https://review.openstack.org/310929 | 06:50 |
| *** kzaitsev_mb has joined #openstack-infra | 06:50 | |
| *** migi has joined #openstack-infra | 06:51 | |
| *** migi has quit IRC | 06:51 | |
| *** migi has joined #openstack-infra | 06:51 | |
| *** amitgandhinz has quit IRC | 06:51 | |
| *** Daisy has joined #openstack-infra | 06:53 | |
| *** fedexo has quit IRC | 06:55 | |
| *** kzaitsev_mb has quit IRC | 06:55 | |
| *** hdaniel has joined #openstack-infra | 06:56 | |
| *** amotoki has joined #openstack-infra | 06:59 | |
| *** roxanagh_ has joined #openstack-infra | 07:00 | |
| *** jed56 has joined #openstack-infra | 07:00 | |
| *** markus_z has joined #openstack-infra | 07:00 | |
| openstackgerrit | Merged openstack-infra/project-config: Enable PEP8 job for Distil service https://review.openstack.org/314397 | 07:01 |
| openstackgerrit | Merged openstack-infra/project-config: Decouple Shotgun project from Fuel https://review.openstack.org/298615 | 07:01 |
| *** asselin has joined #openstack-infra | 07:02 | |
| openstackgerrit | Merged openstack-infra/project-config: Disable image-updates for vexxhost https://review.openstack.org/314266 | 07:02 |
| *** tesseract has joined #openstack-infra | 07:03 | |
| *** sshnaidm has quit IRC | 07:03 | |
| *** salv-orlando has quit IRC | 07:05 | |
| *** ananta has joined #openstack-infra | 07:06 | |
| ananta | could some please eyeball https://review.openstack.org/#/c/313525/ I want to add cross project experimental gate job to heat | 07:07 |
| *** jamielennox is now known as jamielennox|away | 07:08 | |
| ananta | I want to setup experimental gate job to see if changes in heat engine break something in magnum, murano etc | 07:08 |
| *** nmagnezi has joined #openstack-infra | 07:09 | |
| openstackgerrit | Mehdi Abaakouk (sileht) proposed openstack-infra/project-config: gnocchi: use Ceph devstack plugin https://review.openstack.org/314430 | 07:09 |
| *** asselin has quit IRC | 07:10 | |
| *** Hal has joined #openstack-infra | 07:14 | |
| *** Hal is now known as Guest47375 | 07:14 | |
| *** vincentll has joined #openstack-infra | 07:14 | |
| *** cody-somerville has quit IRC | 07:15 | |
| yolanda | AJaeger, can you review https://review.openstack.org/313301 ? | 07:16 |
| *** dtardivel has joined #openstack-infra | 07:17 | |
| *** haaj_ has quit IRC | 07:20 | |
| *** yolanda has quit IRC | 07:22 | |
| *** hdaniel has quit IRC | 07:23 | |
| *** d0ugal has quit IRC | 07:23 | |
| *** lennyb has quit IRC | 07:25 | |
| AJaeger | yolanda, did you see anteaya's comment? | 07:25 |
| *** d0ugal has joined #openstack-infra | 07:26 | |
| *** d0ugal has quit IRC | 07:26 | |
| *** d0ugal has joined #openstack-infra | 07:26 | |
| AJaeger | yolanda: +2 - I commented on the comment | 07:27 |
| *** yolanda has joined #openstack-infra | 07:27 | |
| *** roxanagh_ has quit IRC | 07:33 | |
| *** lennyb has joined #openstack-infra | 07:34 | |
| *** mikelk has joined #openstack-infra | 07:34 | |
| *** abregman_ has joined #openstack-infra | 07:36 | |
| *** abregman has quit IRC | 07:36 | |
| *** yaume has joined #openstack-infra | 07:37 | |
| *** markus_z has quit IRC | 07:38 | |
| *** HeOS has joined #openstack-infra | 07:38 | |
| *** jlanoux has joined #openstack-infra | 07:39 | |
| *** gongysh has quit IRC | 07:39 | |
| *** hdaniel has joined #openstack-infra | 07:41 | |
| *** zeih has quit IRC | 07:41 | |
| *** ifarkas has joined #openstack-infra | 07:43 | |
| *** abregman_ is now known as abregman | 07:43 | |
| yolanda | thx AJaeger | 07:44 |
| *** matrohon has joined #openstack-infra | 07:45 | |
| *** javeriak has quit IRC | 07:47 | |
| *** javeriak has joined #openstack-infra | 07:47 | |
| *** amitgandhinz has joined #openstack-infra | 07:48 | |
| *** jamielennox|away is now known as jamielennox | 07:49 | |
| *** vilobhmm11 has quit IRC | 07:49 | |
| *** yolanda has quit IRC | 07:50 | |
| *** amitgandhinz has quit IRC | 07:53 | |
| *** shardy has joined #openstack-infra | 07:56 | |
| *** yolanda has joined #openstack-infra | 07:58 | |
| *** zzzeek has quit IRC | 08:00 | |
| *** zzzeek has joined #openstack-infra | 08:00 | |
| *** jordanP has joined #openstack-infra | 08:01 | |
| *** jaosorior has joined #openstack-infra | 08:01 | |
| openstackgerrit | Merged openstack-infra/project-config: Move ansible-dev magnum shade to non-voting https://review.openstack.org/313301 | 08:04 |
| *** nadya has quit IRC | 08:05 | |
| *** fzhadaev has left #openstack-infra | 08:06 | |
| *** hashar has joined #openstack-infra | 08:08 | |
| *** SlickNik has quit IRC | 08:10 | |
| *** pkoniszewski has quit IRC | 08:11 | |
| *** SlickNik has joined #openstack-infra | 08:11 | |
| *** shashank_hegde has quit IRC | 08:12 | |
| *** zeih has joined #openstack-infra | 08:12 | |
| *** javeriak has quit IRC | 08:12 | |
| *** grauzikas has joined #openstack-infra | 08:13 | |
| *** pkoniszewski has joined #openstack-infra | 08:15 | |
| *** vincentll has quit IRC | 08:16 | |
| *** dtantsur|afk is now known as dtantsur | 08:16 | |
| *** dingyichen has quit IRC | 08:16 | |
| *** vincentll has joined #openstack-infra | 08:16 | |
| *** e0ne has joined #openstack-infra | 08:18 | |
| *** dizquierdo has joined #openstack-infra | 08:19 | |
| *** yamahata has quit IRC | 08:20 | |
| *** SlickN1k has joined #openstack-infra | 08:22 | |
| *** zhurong_ has joined #openstack-infra | 08:22 | |
| *** vipuls has quit IRC | 08:22 | |
| *** SlickNik has quit IRC | 08:22 | |
| *** SlickN1k is now known as SlickNik | 08:22 | |
| *** lucas-dinner is now known as lucasagomes | 08:22 | |
| *** zhurong has quit IRC | 08:22 | |
| *** zeih has quit IRC | 08:23 | |
| *** vipuls has joined #openstack-infra | 08:25 | |
| *** daemontool__ is now known as daemontool | 08:30 | |
| *** abregman has quit IRC | 08:33 | |
| *** esikachev has joined #openstack-infra | 08:36 | |
| therve | Hi, can we get some reviews on https://review.openstack.org/#/c/313806/ ? it's a simple job change on heat and sahara, but we're getting intermittent failures without it | 08:37 |
| *** nadya has joined #openstack-infra | 08:37 | |
| *** jistr has joined #openstack-infra | 08:37 | |
| *** nadya has quit IRC | 08:38 | |
| *** nadya has joined #openstack-infra | 08:38 | |
| *** sshnaidm has joined #openstack-infra | 08:40 | |
| *** amotoki has quit IRC | 08:42 | |
| *** amotoki has joined #openstack-infra | 08:43 | |
| *** abregman has joined #openstack-infra | 08:46 | |
| *** zeih has joined #openstack-infra | 08:47 | |
| *** derekh has joined #openstack-infra | 08:47 | |
| *** amitgandhinz has joined #openstack-infra | 08:49 | |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: Install virtualenv for tempest https://review.openstack.org/314462 | 08:50 |
| *** roxanagh_ has joined #openstack-infra | 08:51 | |
| openstackgerrit | Alexis Lee proposed openstack/requirements: oslo.service>=1.9.0 https://review.openstack.org/314463 | 08:52 |
| *** amitgandhinz has quit IRC | 08:54 | |
| openstackgerrit | Alexis Lee proposed openstack/requirements: oslo.service>=1.10.0 https://review.openstack.org/314463 | 08:55 |
| AJaeger | therve: reviewed - I don't think it will work | 08:57 |
| therve | AJaeger, thanks, looking | 08:57 |
| therve | Hum yeah sounds about right | 08:58 |
| therve | Sigh | 08:58 |
| therve | I'll update it I guess | 08:58 |
| *** sdake has joined #openstack-infra | 09:01 | |
| openstackgerrit | Thomas Herve proposed openstack-infra/project-config: Use neutron-vpnaas grenade plugin in grenade jobs https://review.openstack.org/313806 | 09:01 |
| therve | AJaeger, Should be better | 09:01 |
| AJaeger | therve: +2 | 09:02 |
| *** haaj has joined #openstack-infra | 09:05 | |
| openstackgerrit | Cyril Roelandt proposed openstack/requirements: Only install unicodecsv on Python <= 2.7 https://review.openstack.org/310650 | 09:05 |
| *** haaj has quit IRC | 09:06 | |
| *** haaj has joined #openstack-infra | 09:07 | |
| *** zeih has quit IRC | 09:08 | |
| *** binbincong has quit IRC | 09:10 | |
| *** AJaeger has quit IRC | 09:10 | |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: Add timestamps to postci log https://review.openstack.org/314468 | 09:11 |
| *** vipul- has joined #openstack-infra | 09:13 | |
| *** vipuls has quit IRC | 09:13 | |
| *** pkoniszewski has quit IRC | 09:14 | |
| *** haaj has quit IRC | 09:17 | |
| *** haaj has joined #openstack-infra | 09:17 | |
| *** haaj has joined #openstack-infra | 09:18 | |
| *** pkoniszewski has joined #openstack-infra | 09:18 | |
| wznoinsk | hi all | 09:20 |
| *** savihou has quit IRC | 09:22 | |
| *** savihou has joined #openstack-infra | 09:23 | |
| *** zeih has joined #openstack-infra | 09:24 | |
| *** roxanagh_ has quit IRC | 09:25 | |
| wznoinsk | would there be a 'quick' way to re-enqueue in zuul the jobs my CI missed? I had a problem of zuul and zuul-changes weren't run | 09:25 |
| yolanda | wznoinsk, type recheck as a comment on the changes you missed | 09:26 |
| *** salv-orlando has joined #openstack-infra | 09:27 | |
| *** haaj has quit IRC | 09:27 | |
| *** Daisy has quit IRC | 09:27 | |
| *** Daisy has joined #openstack-infra | 09:28 | |
| *** haaj has joined #openstack-infra | 09:28 | |
| *** zeih has quit IRC | 09:28 | |
| *** daemontool has quit IRC | 09:28 | |
| *** chem has joined #openstack-infra | 09:29 | |
| *** chlong has quit IRC | 09:30 | |
| wznoinsk | yolanda: I better figure out how to do it from command line then... hate clicking, was thinking of maybe something new I could contribute - an wishlist item towards ciwatch, i.e.: a 'copy to clipboard' link next to each CI's name with such enqueue commands list | 09:30 |
| *** salv-orlando has quit IRC | 09:32 | |
| *** jlanoux has quit IRC | 09:32 | |
| *** zqfan has quit IRC | 09:33 | |
| *** Daisy_ has joined #openstack-infra | 09:33 | |
| *** hashar has quit IRC | 09:35 | |
| *** jlanoux has joined #openstack-infra | 09:36 | |
| *** Daisy has quit IRC | 09:36 | |
| *** salv-orlando has joined #openstack-infra | 09:38 | |
| *** salv-orlando has quit IRC | 09:38 | |
| *** salv-orlando has joined #openstack-infra | 09:38 | |
| *** markus_z has joined #openstack-infra | 09:41 | |
| *** tosky has joined #openstack-infra | 09:45 | |
| *** Daisy_ has quit IRC | 09:49 | |
| *** abregman is now known as abregman|afk | 09:49 | |
| *** amitgandhinz has joined #openstack-infra | 09:50 | |
| *** Daisy has joined #openstack-infra | 09:50 | |
| wznoinsk | may sound manic for only a few changes, could be useful after a major outage I guess | 09:53 |
| *** amitgandhinz has quit IRC | 09:54 | |
| *** zeih has joined #openstack-infra | 10:02 | |
| yolanda | wznoinsk, for an outage look at http://docs.openstack.org/infra/zuul/zuul.html | 10:04 |
| yolanda | what we do is run zuul-changes script , that lists the needed zuul-enqueue commands | 10:05 |
| *** zhurong_ has quit IRC | 10:06 | |
| *** javeriak has joined #openstack-infra | 10:06 | |
| *** zeih has quit IRC | 10:06 | |
| *** _degorenko|afk is now known as degorenko | 10:06 | |
| *** daemontool has joined #openstack-infra | 10:08 | |
| *** cdent has joined #openstack-infra | 10:09 | |
| *** jaosorior has quit IRC | 10:09 | |
| *** jaosorior has joined #openstack-infra | 10:09 | |
| openstackgerrit | Claudiu Belu proposed openstack/requirements: Bumps os-win version to 0.4.2 https://review.openstack.org/308506 | 10:10 |
| daemontool | anyone available to review https://review.openstack.org/#/c/314285/ ? New repo creation for the Freezer project, thanks | 10:12 |
| *** sdague has joined #openstack-infra | 10:12 | |
| openstackgerrit | Davanum Srinivas (dims) proposed openstack/requirements: Updated from generate-constraints https://review.openstack.org/314423 | 10:15 |
| *** binbincong has joined #openstack-infra | 10:16 | |
| openstackgerrit | Dmitry Tantsur proposed openstack-infra/project-config: Stop mentioning removed stable/1.* branches in ironic-inspector https://review.openstack.org/314491 | 10:24 |
| *** yamamot__ has quit IRC | 10:24 | |
| *** claudiub has joined #openstack-infra | 10:25 | |
| *** jlanoux_ has joined #openstack-infra | 10:29 | |
| *** jlanoux has quit IRC | 10:30 | |
| *** javeriak has quit IRC | 10:31 | |
| wznoinsk | yolanda yes, makes sense only when the zuul is responsive tho | 10:32 |
| *** javeriak has joined #openstack-infra | 10:35 | |
| *** javeriak has quit IRC | 10:35 | |
| *** javeriak has joined #openstack-infra | 10:36 | |
| *** haaj has joined #openstack-infra | 10:36 | |
| *** abregman|afk is now known as abregman | 10:36 | |
| *** zeih has joined #openstack-infra | 10:39 | |
| openstackgerrit | Valeriy Ponomaryov proposed openstack-infra/project-config: Move gate-grenade-dsvm-manila job to check pipeline https://review.openstack.org/314497 | 10:40 |
| *** gildub has quit IRC | 10:41 | |
| *** sdake has quit IRC | 10:42 | |
| *** roxanagh_ has joined #openstack-infra | 10:42 | |
| *** Daisy_ has joined #openstack-infra | 10:42 | |
| openstackgerrit | yolanda.robla proposed openstack-infra/shade: Add bay certificates to shade https://review.openstack.org/313308 | 10:42 |
| *** cdent has left #openstack-infra | 10:43 | |
| *** chem has quit IRC | 10:45 | |
| *** Daisy has quit IRC | 10:46 | |
| openstackgerrit | Rob Cresswell proposed openstack/requirements: Update XStatic-MDI https://review.openstack.org/314499 | 10:46 |
| openstackgerrit | yolanda.robla proposed openstack-infra/shade: Add magnum services call to shade https://review.openstack.org/313583 | 10:47 |
| *** rodrigods has quit IRC | 10:49 | |
| *** rodrigods has joined #openstack-infra | 10:49 | |
| *** hdaniel has quit IRC | 10:49 | |
| *** chem has joined #openstack-infra | 10:49 | |
| *** amitgandhinz has joined #openstack-infra | 10:50 | |
| *** Daisy_ has quit IRC | 10:50 | |
| *** Daisy has joined #openstack-infra | 10:51 | |
| openstackgerrit | yolanda.robla proposed openstack-infra/shade: Add initial setup for magnum in shade https://review.openstack.org/243239 | 10:53 |
| *** dtantsur is now known as dtantsur|bbl | 10:55 | |
| *** amitgandhinz has quit IRC | 10:55 | |
| *** Daisy has quit IRC | 10:56 | |
| *** haaj has quit IRC | 10:56 | |
| *** oanson has joined #openstack-infra | 11:02 | |
| *** kushal has quit IRC | 11:04 | |
| *** IlyaG has joined #openstack-infra | 11:04 | |
| *** rhallisey has joined #openstack-infra | 11:06 | |
| *** sdake has joined #openstack-infra | 11:07 | |
| sylwesterB | Folks, please review https://review.openstack.org/#/c/312487/ - new project | 11:08 |
| *** IlyaG has quit IRC | 11:09 | |
| *** zhurong has joined #openstack-infra | 11:13 | |
| *** roxanagh_ has quit IRC | 11:15 | |
| *** dims has quit IRC | 11:20 | |
| *** jaosorior has quit IRC | 11:20 | |
| *** javeriak has quit IRC | 11:20 | |
| *** jaosorior has joined #openstack-infra | 11:20 | |
| *** vaidy has quit IRC | 11:21 | |
| *** smarcet has joined #openstack-infra | 11:23 | |
| *** tellesnobrega is now known as tellesnobrega_af | 11:24 | |
| *** dims has joined #openstack-infra | 11:25 | |
| *** kengo_sakai has quit IRC | 11:25 | |
| *** deadnull_ has joined #openstack-infra | 11:26 | |
| *** smarcet has quit IRC | 11:26 | |
| *** gordc has joined #openstack-infra | 11:26 | |
| *** smarcet has joined #openstack-infra | 11:28 | |
| smarcet | fungi: morning , seems that openstackid-dev is down | 11:28 |
| *** javeriak has joined #openstack-infra | 11:30 | |
| *** oanson has quit IRC | 11:33 | |
| *** javeriak has quit IRC | 11:34 | |
| *** javeriak has joined #openstack-infra | 11:34 | |
| openstackgerrit | sebastian marcet proposed openstack-infra/openstackid: Fix on OpenId 2.0 User Discovery https://review.openstack.org/314403 | 11:35 |
| *** javeriak has quit IRC | 11:40 | |
| *** javeriak_ has joined #openstack-infra | 11:40 | |
| openstackgerrit | Alexey Stepanov proposed openstack-infra/project-config: fuel-devops: Add jobs https://review.openstack.org/314518 | 11:41 |
| *** penguinolog has joined #openstack-infra | 11:42 | |
| *** jaosorior has quit IRC | 11:42 | |
| *** jaosorior has joined #openstack-infra | 11:43 | |
| fungi | smarcet: yes, rackspace "lost" it in a host outage. i've got a replacement partially built but was trying to use it as an opportunity to confirm https://review.openstack.org/300005 fixes our bootstrapping race condition there. if you're needing to use it i can just go ahead and work around that again and finish setting it up now | 11:44 |
| smarcet | fungi: morning , :) , yes i u could would be great trying to test this quick fix https://review.openstack.org/#/c/314403/ | 11:46 |
| *** ccamacho is now known as ccamacho|lunch | 11:46 | |
| openstackgerrit | sebastian marcet proposed openstack-infra/openstackid: Fix on OpenId 2.0 User Discovery https://review.openstack.org/314403 | 11:47 |
| *** weshay has joined #openstack-infra | 11:48 | |
| *** baoli has joined #openstack-infra | 11:50 | |
| *** esikachev has quit IRC | 11:50 | |
| *** amitgandhinz has joined #openstack-infra | 11:51 | |
| *** lucasagomes is now known as lucas-hungry | 11:52 | |
| *** baoli_ has joined #openstack-infra | 11:53 | |
| openstackgerrit | Alexey Stepanov proposed openstack-infra/project-config: fuel-devops: Add jobs https://review.openstack.org/314518 | 11:54 |
| *** baoli has quit IRC | 11:56 | |
| *** sdake has quit IRC | 11:56 | |
| *** amitgandhinz has quit IRC | 11:56 | |
| *** jtomasek_ has joined #openstack-infra | 11:58 | |
| *** haaj has joined #openstack-infra | 11:58 | |
| pabelanger | morning | 12:00 |
| mordred | morning pabelanger | 12:02 |
| *** sdake has joined #openstack-infra | 12:02 | |
| *** zeih has quit IRC | 12:02 | |
| *** psilvad has joined #openstack-infra | 12:03 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/nodepool: Test we group dib uploads by image name https://review.openstack.org/314315 | 12:04 |
| *** jcoufal has joined #openstack-infra | 12:04 | |
| *** ldnunes has joined #openstack-infra | 12:04 | |
| *** hdd has joined #openstack-infra | 12:06 | |
| dims | pabelanger : fungi : clarkb : bandersnatch / pypi mirrors are working well. thanks! | 12:08 |
| *** jtomasek_ has quit IRC | 12:08 | |
| *** sdake_ has joined #openstack-infra | 12:08 | |
| pabelanger | Oh, are we running vos.release again for mirror.pypi? I don't see the force flag | 12:09 |
| *** sdake has quit IRC | 12:11 | |
| *** Liuqing has joined #openstack-infra | 12:11 | |
| smarcet | fungi: also seems that something got broken CI build, https://github.com/openstack-infra/project-config/blob/master/jenkins/scripts/php-laravel-build.sh seems to be failing | 12:11 |
| fungi | pabelanger: yep, it completed overnight with the -force so i wanted to see how long a regular vos release would take now | 12:11 |
| *** psilvad has quit IRC | 12:11 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/nodepool: Test we group dib uploads by image name https://review.openstack.org/314315 | 12:12 |
| pabelanger | fungi: \o/ that is good news | 12:12 |
| *** hdd has quit IRC | 12:12 | |
| smarcet | fungi: Mcrypt PHP extension required , seems that is not installed on the server that is used to run the build | 12:13 |
| smarcet | which is the proper place to set the installation of that php mod ? | 12:14 |
| smarcet | on https://github.com/openstack-infra/project-config/blob/master/jenkins/scripts/php-laravel-build.sh? | 12:14 |
| fungi | smarcet: this is resulting in a failure to test the building process? if so we should make the job performing that test install additional packages it needs | 12:14 |
| smarcet | yes its seems so | 12:15 |
| smarcet | on trusty u need to run | 12:15 |
| *** amrith is now known as _amrith_ | 12:15 | |
| fungi | smarcet: where were you seeing the failure? a job result on a proposed openstackid change? | 12:15 |
| *** rfolco has joined #openstack-infra | 12:15 | |
| smarcet | yes | 12:15 |
| smarcet | http://logs.openstack.org/03/314403/3/check/gate-openstackid-unittests/da43718/console.html | 12:16 |
| *** pradk has joined #openstack-infra | 12:16 | |
| *** dprince has joined #openstack-infra | 12:16 | |
| smarcet | fungi: we need to install this on the job | 12:17 |
| smarcet | http://paste.openstack.org/show/496563/ | 12:17 |
| *** hashar has joined #openstack-infra | 12:17 | |
| *** sree has joined #openstack-infra | 12:17 | |
| openstackgerrit | sebastian marcet proposed openstack-infra/openstackid: Fix on OpenId 2.0 User Discovery https://review.openstack.org/314403 | 12:18 |
| *** yolanda has quit IRC | 12:18 | |
| pabelanger | smarcet: fungi: you should be able to use the other-requirements.txt file to better control your test dependencies. | 12:18 |
| pabelanger | either copy bindep-fallback.txt -> other-requirements.txt and add your missing php dependency | 12:18 |
| *** javeriak_ has quit IRC | 12:18 | |
| smarcet | ok | 12:19 |
| pabelanger | or create a minimal other-requirements.txt file listing all our specific requirements | 12:19 |
| fungi | pabelanger: yep, i was going to suggest we start there (copying the fallback list) | 12:19 |
| smarcet | pabelanger: that should be located on the openstackid root project | 12:19 |
| smarcet | ? | 12:19 |
| pabelanger | Yup | 12:19 |
| smarcet | ok | 12:19 |
| pabelanger | if you look at codesearch.o.o, you can see some examples | 12:19 |
| *** bdemers_ has quit IRC | 12:19 | |
| pabelanger | fungi: sorry for the steal! | 12:20 |
| fungi | copy http://git.openstack.org/cgit/openstack-infra/project-config/tree/jenkins/data/bindep-fallback.txt to a "other-requirements.txt" file in the top level directory of the openstack-infra/openstackid repository, delete any packages from there you know aren't needed, and add the one you know is missing | 12:20 |
| smarcet | fungi: got it, thx :D | 12:20 |
| *** psilvad has joined #openstack-infra | 12:21 | |
| fungi | it's also self-testing, so you should be able to see the job pass when you get the necessary additions in that file | 12:21 |
| *** jcoufal has quit IRC | 12:21 | |
| *** jcoufal has joined #openstack-infra | 12:22 | |
| *** yolanda has joined #openstack-infra | 12:22 | |
| openstackgerrit | Alexey Stepanov proposed openstack-infra/project-config: fuel-devops: Add jobs https://review.openstack.org/314518 | 12:23 |
| openstackgerrit | sebastian marcet proposed openstack-infra/openstackid: Fix on OpenId 2.0 User Discovery https://review.openstack.org/314403 | 12:23 |
| *** dkehn has quit IRC | 12:23 | |
| openstackgerrit | Henrique Truta proposed openstack-infra/project-config: Adds ironic v3 only job https://review.openstack.org/304306 | 12:23 |
| fungi | smarcet: okay, the replacement openstackid-dev is online now | 12:24 |
| *** aysyd has joined #openstack-infra | 12:24 | |
| *** mrmartin has quit IRC | 12:24 | |
| *** dkehn has joined #openstack-infra | 12:24 | |
| smarcet | fungi: tnx :) | 12:24 |
| fungi | i need to disappear for a bit to run an errand, but will be back within the hour | 12:25 |
| openstackgerrit | Vasyl Saienko proposed openstack-infra/devstack-gate: Do not set IRONIC_VM_COUNT from devstack-gate https://review.openstack.org/314532 | 12:25 |
| *** markmcd1 has quit IRC | 12:25 | |
| *** markmcd has quit IRC | 12:25 | |
| *** Liuqing has quit IRC | 12:25 | |
| openstackgerrit | sebastian marcet proposed openstack-infra/openstackid: Fix on OpenId 2.0 User Discovery https://review.openstack.org/314403 | 12:26 |
| *** Liuqing has joined #openstack-infra | 12:27 | |
| *** zhurong has quit IRC | 12:27 | |
| *** markmcd has joined #openstack-infra | 12:27 | |
| *** zhurong has joined #openstack-infra | 12:28 | |
| *** sree has quit IRC | 12:28 | |
| *** oanson has joined #openstack-infra | 12:28 | |
| *** mrmartin has joined #openstack-infra | 12:28 | |
| *** rlandy has joined #openstack-infra | 12:29 | |
| *** dizquierdo has quit IRC | 12:29 | |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: Add timestamps to postci log https://review.openstack.org/314468 | 12:30 |
| *** zeih has joined #openstack-infra | 12:30 | |
| jroll | anyone mind a quick project-config patch? https://review.openstack.org/#/c/314066/ | 12:31 |
| *** roxanagh_ has joined #openstack-infra | 12:33 | |
| openstackgerrit | sebastian marcet proposed openstack-infra/openstackid: Fix on OpenId 2.0 User Discovery https://review.openstack.org/314403 | 12:33 |
| penguinolog | Hello! Could anybody look a small patch: https://review.openstack.org/#/c/314518/ | 12:33 |
| *** ramishra has quit IRC | 12:34 | |
| *** hdd has joined #openstack-infra | 12:36 | |
| *** dtantsur|bbl is now known as dtantsur | 12:37 | |
| *** tpsilva has joined #openstack-infra | 12:37 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/nodepool: Test we group dib uploads by image name https://review.openstack.org/314315 | 12:39 |
| *** sshnaidm has quit IRC | 12:39 | |
| openstackgerrit | sebastian marcet proposed openstack-infra/openstackid: Fix on OpenId 2.0 User Discovery https://review.openstack.org/314403 | 12:39 |
| *** burgerk has joined #openstack-infra | 12:40 | |
| *** hdd has quit IRC | 12:41 | |
| *** ccamacho|lunch is now known as ccamacho | 12:44 | |
| *** cbader has joined #openstack-infra | 12:45 | |
| *** thorst_ has joined #openstack-infra | 12:45 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/nodepool: Test we group dib uploads by image name https://review.openstack.org/314315 | 12:45 |
| rodrigods | ianw, hi... can you revisit https://review.openstack.org/#/c/293497/ ? we are depending on a +2 there to have the tempest test approved | 12:46 |
| *** nwkarsten has joined #openstack-infra | 12:46 | |
| *** hdaniel has joined #openstack-infra | 12:48 | |
| *** thorst_ has quit IRC | 12:49 | |
| *** salv-orlando has quit IRC | 12:49 | |
| *** thorst_ has joined #openstack-infra | 12:49 | |
| *** lucas-hungry is now known as lucasagomes | 12:51 | |
| *** Daisy has joined #openstack-infra | 12:51 | |
| smarcet | fungi:pabelanger: i was able to install needed dependencies, but this module , mcrypt, need to be enabled manually sudo php5enmod mcrypt | 12:52 |
| smarcet | where is should put that ? | 12:52 |
| *** amitgandhinz has joined #openstack-infra | 12:52 | |
| *** zeih has quit IRC | 12:52 | |
| smarcet | fungi:pabelanger: https://github.com/openstack-infra/project-config/blob/master/jenkins/scripts/php-laravel-build.sh? | 12:52 |
| *** sree has joined #openstack-infra | 12:53 | |
| *** matt-borland has joined #openstack-infra | 12:53 | |
| pabelanger | smarcet: fungi: to you have any build scripts in your project? or is it just the php-laravel-build.sh? | 12:53 |
| smarcet | its just that one | 12:53 |
| *** sshnaidm has joined #openstack-infra | 12:53 | |
| pabelanger | okay, that should do then | 12:54 |
| smarcet | pabelanger: ok thx for the info:D | 12:54 |
| *** skraynev has joined #openstack-infra | 12:54 | |
| pabelanger | you'll need to wait for new image builds however, since we only update during the DIB process | 12:54 |
| *** edmondsw has joined #openstack-infra | 12:55 | |
| *** ddieterly has joined #openstack-infra | 12:55 | |
| *** tlian has joined #openstack-infra | 12:56 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/nodepool: Test we group dib uploads by image name https://review.openstack.org/314315 | 12:56 |
| skraynev | andreas_s: hi. thank you for the review. fix in progress :) | 12:56 |
| *** amitgandhinz has quit IRC | 12:57 | |
| *** Daisy has quit IRC | 12:57 | |
| *** ananta has quit IRC | 12:58 | |
| *** jlanoux has joined #openstack-infra | 12:58 | |
| *** julim has joined #openstack-infra | 12:58 | |
| *** Qiming has joined #openstack-infra | 12:58 | |
| *** |-paul-| has joined #openstack-infra | 12:59 | |
| *** jlanoux_ has quit IRC | 13:00 | |
| *** zeih has joined #openstack-infra | 13:01 | |
| *** amotoki has quit IRC | 13:01 | |
| *** Goneri has joined #openstack-infra | 13:02 | |
| *** zeih has quit IRC | 13:02 | |
| *** keedya has joined #openstack-infra | 13:02 | |
| *** ddieterly has quit IRC | 13:03 | |
| *** AJaeger has joined #openstack-infra | 13:03 | |
| *** asettle has joined #openstack-infra | 13:03 | |
| *** salv-orlando has joined #openstack-infra | 13:03 | |
| openstackgerrit | Merged openstack-infra/project-config: Stop mentioning removed stable/1.* branches in ironic-inspector https://review.openstack.org/314491 | 13:04 |
| *** Qiming has quit IRC | 13:05 | |
| *** Qiming has joined #openstack-infra | 13:05 | |
| *** Qiming_ has joined #openstack-infra | 13:05 | |
| *** andymaier_ has joined #openstack-infra | 13:05 | |
| skraynev | oops. wrong user ;) | 13:05 |
| *** roxanagh_ has quit IRC | 13:06 | |
| *** hdaniel has quit IRC | 13:07 | |
| *** jamesmca_ has joined #openstack-infra | 13:07 | |
| *** asselin has joined #openstack-infra | 13:08 | |
| openstackgerrit | Michael Krotscheck proposed openstack-infra/project-config: Add js-generator-openstack to OpenStack-Infra https://review.openstack.org/314240 | 13:08 |
| *** gildub has joined #openstack-infra | 13:08 | |
| *** mrmartin has quit IRC | 13:08 | |
| *** akshai has joined #openstack-infra | 13:08 | |
| *** hdaniel has joined #openstack-infra | 13:08 | |
| *** mrmartin has joined #openstack-infra | 13:09 | |
| *** mrmartin has quit IRC | 13:09 | |
| *** jamesmca_ has quit IRC | 13:11 | |
| *** edmondsw has quit IRC | 13:11 | |
| *** sree has quit IRC | 13:13 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/nodepool: Test we group dib uploads by image name https://review.openstack.org/314315 | 13:14 |
| openstackgerrit | Merged openstack-infra/project-config: Add ability to create branches for RefStack https://review.openstack.org/310787 | 13:14 |
| *** asselin has quit IRC | 13:15 | |
| *** asettle has quit IRC | 13:15 | |
| *** eharney has joined #openstack-infra | 13:15 | |
| skraynev | AJaeger: hi. thank you for the review. fix in progress :) currently I read a link provided by you. this project is not a part of Murano, this project uses Murano. | 13:15 |
| *** _ari_ has joined #openstack-infra | 13:15 | |
| AJaeger | skraynev: just state that the project will not be part of big tent and I'm fine. Just want an answer in gerrit ;) | 13:17 |
| *** kengo_sakai has joined #openstack-infra | 13:17 | |
| openstackgerrit | Merged openstack-infra/project-config: Remove neutron release teams from Kuryr https://review.openstack.org/313976 | 13:17 |
| apuimedo | yay! | 13:17 |
| *** kengo_sakai has quit IRC | 13:17 | |
| openstackgerrit | Michael Krotscheck proposed openstack-infra/project-config: New project: js-openstack https://review.openstack.org/314312 | 13:18 |
| *** |-paul-| has quit IRC | 13:18 | |
| *** kengo_sakai has joined #openstack-infra | 13:18 | |
| *** yamahata has joined #openstack-infra | 13:18 | |
| *** hongbin has joined #openstack-infra | 13:19 | |
| *** thorst_ has quit IRC | 13:20 | |
| *** daemontool_ has joined #openstack-infra | 13:21 | |
| openstackgerrit | Raildo Mascena proposed openstack-infra/project-config: Adds ironic v3 only job https://review.openstack.org/304306 | 13:22 |
| *** mriedem has joined #openstack-infra | 13:23 | |
| *** links has quit IRC | 13:23 | |
| *** amitgandhinz has joined #openstack-infra | 13:24 | |
| *** daemontool has quit IRC | 13:24 | |
| skraynev | AJaeger: Could you clarify, that I understand correctly. If project is not a part of Big tent, it can not use openstack infra and have a repo with prefix openstack/* ? | 13:24 |
| *** haaj has quit IRC | 13:27 | |
| *** haaj has joined #openstack-infra | 13:27 | |
| fungi | pabelanger: smarcet: a quicker solution (since php-laravel-build.sh is baked into our worker images) is we could add a shell builder to run that specific command between install-distro-packages and revoke-sudo in http://git.openstack.org/cgit/openstack-infra/project-config/tree/jenkins/jobs/openstackid.yaml | 13:29 |
| fungi | which might also make more sense, depending on where you consider the line is between setup and build steps | 13:30 |
| *** tongli has joined #openstack-infra | 13:30 | |
| Zara | hi, I gave a couple of patches +A but haven't seen any email about it from gerrit, and status.openstack.org isn't reporting anything, wondering if everything's okay with the gate? (eg: this patch: https://review.openstack.org/#/c/310951/ ) | 13:31 |
| *** ramishra has joined #openstack-infra | 13:31 | |
| *** hdaniel_ has joined #openstack-infra | 13:32 | |
| *** thorst_ has joined #openstack-infra | 13:32 | |
| *** ddieterly has joined #openstack-infra | 13:33 | |
| openstackgerrit | Merged openstack-infra/project-config: Give ironic grenade jobs 7 "nodes" running tinyipa https://review.openstack.org/314066 | 13:33 |
| *** esker has quit IRC | 13:34 | |
| AJaeger | skraynev: You can use openstack CI etc, no worries. | 13:34 |
| pabelanger | Zara: possible that zuul missed your event for some reason. I usually try a recheck or toggle the +A to see if zuul picks it up again. | 13:34 |
| AJaeger | skraynev: Just not publish on docs.o.o - your chagne is fine as is. Just wanted to know it. | 13:34 |
| skraynev | AJaeger: cool. got it. so I will put answer in gerrit | 13:35 |
| Zara | pabelanger: okay, will do, thought I'd check in case anyone else was having trouble. thanks. :) | 13:35 |
| *** ramishra has quit IRC | 13:35 | |
| fungi | Zara: yeah, it looks like you never ended up with a verify +1 from jenkins back on may 6 when patchset 4 was uploaded | 13:35 |
| pabelanger | Zara: try that first, I can look into debug.log if needed | 13:35 |
| *** Na3iL has joined #openstack-infra | 13:35 | |
| *** ddieterly is now known as ddieterly[away] | 13:36 | |
| Zara | okay, yeah, rechecking now, thanks! :) | 13:36 |
| openstackgerrit | Sergey Kraynev proposed openstack-infra/project-config: Add ci-cd-pipeline-app-murano project to openstack https://review.openstack.org/309383 | 13:36 |
| fungi | Zara: i think there was an ongoing issue that day and contents of the check pipeline were dumped. leaving a comment like "recheck" should get check results back and if those are +1 (success) then it will automatically get enqueued into the gate after that | 13:36 |
| AJaeger | fungi, pabelanger : I think lifeless answered all my questions regarding bindep | 13:37 |
| fungi | AJaeger: yeah, i read his reply and that matched what i recalled from the change discussions | 13:38 |
| skraynev | AJaeger: updated, comment was added. thx again :) | 13:38 |
| AJaeger | skraynev: will review later... | 13:38 |
| skraynev | AJaeger: kk ) | 13:38 |
| *** savihou has quit IRC | 13:38 | |
| *** sshnaidm has quit IRC | 13:39 | |
| *** savihou has joined #openstack-infra | 13:39 | |
| AJaeger | fungi: so, how do move forward here? I won't be able to do any significant work in May on this... | 13:39 |
| Zara | fungi: yeah, sounds familiar; I thought it wouldn't matter because +A made it check again, but I was wrong | 13:39 |
| * AJaeger could sent the changes for bindep and swift to add [test] today... | 13:40 | |
| *** jsavak has joined #openstack-infra | 13:40 | |
| *** thorst__ has joined #openstack-infra | 13:40 | |
| *** esikachev has joined #openstack-infra | 13:40 | |
| fungi | Zara: it used to for a while, but that (force another check result on approve) caused people to complain that making another round-trip through the check pipeline prior to enqueuing was also too time-consuming | 13:40 |
| * AJaeger will also update infra-manual | 13:40 | |
| *** thorst__ has quit IRC | 13:40 | |
| *** edmondsw has joined #openstack-infra | 13:41 | |
| smarcet | fungi: i need basically that the enabling of php5-mcrypt module its ran after the other requirements | 13:41 |
| smarcet | and before https://github.com/openstack-infra/project-config/blob/master/jenkins/scripts/php-laravel-build.sh | 13:41 |
| *** sshnaidm has joined #openstack-infra | 13:41 | |
| *** thorst_ has quit IRC | 13:41 | |
| fungi | smarcet: right, we could update the job definition to run that, shouldn't need to be run as a part of the build script itself unless you consider enabling that php module as part of the build process | 13:42 |
| smarcet | no its ok | 13:42 |
| smarcet | i will added there a - shell: line :D | 13:42 |
| smarcet | thx for point it out | 13:42 |
| *** hdd has joined #openstack-infra | 13:42 | |
| *** signed8bit has joined #openstack-infra | 13:43 | |
| fungi | that will also take effect a lot faster than changes to the build script, since that build script is embedded directly into our daily image updates | 13:43 |
| *** _amrith_ is now known as amrith | 13:43 | |
| *** haaj_ has joined #openstack-infra | 13:43 | |
| *** vaidy has joined #openstack-infra | 13:43 | |
| *** ddieterly[away] is now known as ddieterly | 13:44 | |
| *** savihou has quit IRC | 13:44 | |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Use "bindep test" https://review.openstack.org/314571 | 13:44 |
| openstackgerrit | Paul Belanger proposed openstack-infra/nodepool: Test we group dib uploads by image name https://review.openstack.org/314315 | 13:44 |
| *** savihou has joined #openstack-infra | 13:45 | |
| *** maestro1 has joined #openstack-infra | 13:45 | |
| *** hichihara has joined #openstack-infra | 13:45 | |
| *** thorst_ has joined #openstack-infra | 13:46 | |
| *** regXboi has joined #openstack-infra | 13:47 | |
| *** Guest47375 has quit IRC | 13:47 | |
| *** haaj has quit IRC | 13:47 | |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/infra-manual: Document "bindep test" usage https://review.openstack.org/314574 | 13:47 |
| AJaeger | fungi, pabelanger: The two changes above implement using test profile | 13:47 |
| *** kengo_sakai has quit IRC | 13:48 | |
| *** vaidy has quit IRC | 13:49 | |
| *** anteaya has joined #openstack-infra | 13:50 | |
| *** thorst_ has quit IRC | 13:50 | |
| pabelanger | AJaeger: sure, I will look shortly | 13:50 |
| *** thorst_ has joined #openstack-infra | 13:50 | |
| *** Hal has joined #openstack-infra | 13:50 | |
| *** schipiga has joined #openstack-infra | 13:50 | |
| schipiga | Hi, all! I would like to make patch to increase build timeout for horizon integration autotests, because our tests becomes more, and we need more time to tests. Please, talk me how to set $BUILD_TIMEOUT. I found its export https://github.com/openstack-infra/devstack-gate/blob/master/devstack-vm-gate-wrap.sh#L357, but can't understand how to manipulate. | 13:50 |
| * AJaeger updated swift as well: https://review.openstack.org/#/c/298313 | 13:50 | |
| *** Hal is now known as Guest35788 | 13:51 | |
| *** thiagop has joined #openstack-infra | 13:51 | |
| *** thorst_ has quit IRC | 13:51 | |
| AJaeger | fungi, FYI, https://review.openstack.org/314312 needs Infra PTL review | 13:51 |
| *** bdemers has joined #openstack-infra | 13:51 | |
| *** dizquierdo has joined #openstack-infra | 13:52 | |
| *** thorst_ has joined #openstack-infra | 13:52 | |
| *** haaj_ has quit IRC | 13:52 | |
| *** hdd has quit IRC | 13:52 | |
| openstackgerrit | Dean Troyer proposed openstack-infra/project-config: Add osc-lib repo to OpenStackClient https://review.openstack.org/314214 | 13:52 |
| *** nmagnezi has quit IRC | 13:52 | |
| fungi | AJaeger: should i wait until it's no longer wip in case those circumstances change? | 13:52 |
| *** sbelous_ has quit IRC | 13:53 | |
| *** zeih has joined #openstack-infra | 13:54 | |
| daemontool_ | AJaeger, at your convenience, Freezer DR repo creation https://review.openstack.org/#/c/314285/ | 13:54 |
| *** savihou has quit IRC | 13:54 | |
| *** sbelous has joined #openstack-infra | 13:54 | |
| AJaeger | you can also give your verbal approval that we can merge later IMHO - just +1 the governance one as well... | 13:54 |
| AJaeger | daemontool_: will review later | 13:54 |
| daemontool_ | thanks no rush | 13:54 |
| schipiga | I can't find any script, that would be executed before https://github.com/openstack-infra/devstack-gate/blob/master/devstack-vm-gate-wrap.sh#L357, and inside that I would export $BUILD_TIMEOUT | 13:55 |
| *** thorst_ has quit IRC | 13:56 | |
| *** Liuqing has quit IRC | 13:56 | |
| *** hdd has joined #openstack-infra | 13:56 | |
| *** yolanda has quit IRC | 13:56 | |
| *** tosky has quit IRC | 13:57 | |
| *** yamahata has quit IRC | 13:57 | |
| *** yamahata has joined #openstack-infra | 13:57 | |
| *** thorst_ has joined #openstack-infra | 13:58 | |
| AJaeger | schipiga: http://git.openstack.org/cgit/openstack-infra/project-config/tree/jenkins/jobs/horizon.yaml#n21 | 13:58 |
| AJaeger | schipiga: the Jenkins config injects the variable | 13:58 |
| openstackgerrit | Thierry Carrez proposed openstack-infra/infra-specs: [WIP] A common task tracker for OpenStack https://review.openstack.org/314185 | 13:59 |
| *** tonytan4ever has joined #openstack-infra | 13:59 | |
| *** haaj has joined #openstack-infra | 14:00 | |
| *** esikachev has quit IRC | 14:00 | |
| *** Qiming__ has joined #openstack-infra | 14:00 | |
| *** amotoki has joined #openstack-infra | 14:01 | |
| *** afazekas has quit IRC | 14:01 | |
| *** afazekas has joined #openstack-infra | 14:01 | |
| andreas_s | skraynev, welcome :) | 14:01 |
| *** yolanda has joined #openstack-infra | 14:01 | |
| schipiga | AJaeger, ohh, so, does it mean, that every time, when it needs to update build timeout in any openstack project, the developers need to send patches to infra ? | 14:01 |
| *** jsavak has quit IRC | 14:02 | |
| *** hdd has quit IRC | 14:02 | |
| *** bdemers has quit IRC | 14:02 | |
| *** savihou has joined #openstack-infra | 14:02 | |
| *** jsavak has joined #openstack-infra | 14:02 | |
| *** Qiming_ has left #openstack-infra | 14:02 | |
| AJaeger | schipiga: yes. Note that I remember two or three requests so far this year, so this is very seldom. | 14:03 |
| fungi | schipiga: it's the case anyway, since that variable is merely interpreted from the job timeout in jenkins itself (which is not part of the job payload but is directly configuring the jenkins service) | 14:03 |
| skraynev | schipiga: afaik - yes ;) | 14:03 |
| *** tonytan4ever has quit IRC | 14:03 | |
| *** bdemers has joined #openstack-infra | 14:03 | |
| openstackgerrit | Merged openstack-infra/storyboard: Add a table for story permissions https://review.openstack.org/310951 | 14:03 |
| *** sigmavirus24_awa is now known as sigmavirus24 | 14:04 | |
| AJaeger | schipiga: the timeout is 100 minutes - before making it much longer, consider splitting up the tests - or improving the testing ;) | 14:04 |
| openstackgerrit | Merged openstack-infra/storyboard: Allow the creation of private stories https://review.openstack.org/310952 | 14:04 |
| *** obondarev has quit IRC | 14:04 | |
| *** mtanino has joined #openstack-infra | 14:04 | |
| schipiga | ok, thank you for explanation :) | 14:05 |
| fungi | effectively, there is a value "x" which is the point at which jenkins will forcibly terminate the running job, then there is a value "y" (calculated as x-N for some "N" of setup/teardown overhead) which gets passed into the job's calling environment to allow the job to know it's about to run out of time, so it can gracefully end what it's doing and prepare logs for collection | 14:05 |
| *** obondarev_ has joined #openstack-infra | 14:05 | |
| *** esker has joined #openstack-infra | 14:05 | |
| openstackgerrit | Doug Hellmann proposed openstack-infra/release-tools: change email topic tags based on summit feedback https://review.openstack.org/312762 | 14:06 |
| fungi | so the "x" jenkins build-timeout value is what you set, and then the "y" devstack-gate $BUILD_TIMEOUT is derived from that | 14:06 |
| *** savihou has quit IRC | 14:07 | |
| *** savihou has joined #openstack-infra | 14:07 | |
| fungi | or, rather, the "y" devstack-gate timeout is derived from the $BUILD_TIMEOUT passed in by jenkins | 14:07 |
| openstackgerrit | sebastian marcet proposed openstack-infra/project-config: Fix on OpenstackId Jenkins Job https://review.openstack.org/314584 | 14:07 |
| *** zz_dimtruck is now known as dimtruck | 14:08 | |
| smarcet | fungi:pabelanger: here is the patch https://review.openstack.org/#/c/314584/ | 14:08 |
| fungi | yep, already gave it my +2, looks like what i was describing | 14:08 |
| smarcet | tnx | 14:09 |
| *** Qiming__ has quit IRC | 14:09 | |
| schipiga | AJaeger, btw, under "splitting up" do you mean to slice tests using several builds instead one to launch all tests? | 14:10 |
| AJaeger | schipiga: yes | 14:10 |
| fungi | schipiga: alternatively, analyze which tests are taking the longest and see if they are unnecessarily inefficient and can be improved/sped up | 14:11 |
| *** julim has quit IRC | 14:11 | |
| AJaeger | what fungi says is my preference ;) | 14:12 |
| * AJaeger will be back later... | 14:12 | |
| *** julim has joined #openstack-infra | 14:12 | |
| *** zeih has quit IRC | 14:13 | |
| schipiga | fungi, ok, thank you | 14:14 |
| *** haaj has quit IRC | 14:14 | |
| *** zeih has joined #openstack-infra | 14:14 | |
| *** jamesmca_ has joined #openstack-infra | 14:16 | |
| *** jsavak has quit IRC | 14:16 | |
| *** jsavak has joined #openstack-infra | 14:17 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/nodepool: Test we group dib uploads by image name https://review.openstack.org/314315 | 14:17 |
| openstackgerrit | Sean Dague proposed openstack/requirements: Bump paramiko to version 2.0 https://review.openstack.org/314595 | 14:17 |
| openstackgerrit | Matthew Treinish proposed openstack-infra/project-config: Ironic: always install tempest plugin from master https://review.openstack.org/299888 | 14:18 |
| mtreinish | jroll: ^^^ the devstack side has landed for that | 14:18 |
| mtreinish | although, the checkout side still isn't right, because we want it to always use master ironic | 14:18 |
| mtreinish | that'll do the zuul ref stuff correctly except on stable branches | 14:19 |
| *** hemanthm has joined #openstack-infra | 14:20 | |
| *** esker has quit IRC | 14:20 | |
| *** rajinir has joined #openstack-infra | 14:20 | |
| jroll | mtreinish: oh neat, thanks | 14:20 |
| jroll | did you have any thoughts on the stable side? | 14:20 |
| *** bdemers has quit IRC | 14:21 | |
| *** rbrndt has joined #openstack-infra | 14:21 | |
| *** esker has joined #openstack-infra | 14:21 | |
| *** esikache1 has joined #openstack-infra | 14:21 | |
| mtreinish | jroll: it gets weird, because you need ironic at stable for devstack, but also from master for the plugin install | 14:22 |
| morgan | mordred: hmm. So it looks like I need to fake out leaked fips for that patch? Since the calls into shade are... Minimal? Or are we just looking to know the method was called? | 14:22 |
| openstackgerrit | Merged openstack-infra/storyboard-webclient: Add UI for making stories private to a list of people https://review.openstack.org/312663 | 14:22 |
| jroll | mtreinish: right, so we need a second clone | 14:22 |
| morgan | And shade tests cover fip cleanup? | 14:22 |
| mtreinish | jroll: this is part of why I push for seperate plugin repo :) | 14:22 |
| mtreinish | jroll: yeah, but there isn't a good way to do that (although there is the cached version on disk at /opt/git) | 14:23 |
| jroll | mtreinish: right, nobody pushed for that until after we had a plugin afaik :/ | 14:23 |
| *** markus_z has quit IRC | 14:23 | |
| mtreinish | jroll: so what you had in the first patch will work it just involves a clone from the network and it makes the plugin not self testing | 14:24 |
| *** nadya has quit IRC | 14:24 | |
| *** vaidy has joined #openstack-infra | 14:24 | |
| *** jaosorior has quit IRC | 14:24 | |
| jroll | mtreinish: right, I'll need to think a bit more on this | 14:24 |
| anteaya | lennyb: hey there | 14:27 |
| anteaya | lennyb: I owe you another apology | 14:27 |
| anteaya | lennyb: my alarm went off but I slept through it | 14:27 |
| anteaya | lennyb: I have to listen to music constantly at night to get my hear to feel some form of comfort with the constant vibration in the ground | 14:27 |
| openstackgerrit | Cyril Roelandt proposed openstack/requirements: Only install unicodecsv on Python < 3.0 https://review.openstack.org/310650 | 14:28 |
| anteaya | lennyb: since it has been just the two of us for about 6 months now, do you have any objection to me posting to the -dev list asking if anyone is getting any value out of having that meeting slot (Tuesday at 08:00 utc) | 14:28 |
| anteaya | lennyb: you attend the Monday at 15:00 utc meeting anyway | 14:29 |
| anteaya | lennyb: if noone does find any value in having that meeting slot remain, I'll propose it be removed and just continue with the Monday at 15:00 utc meeting slot for third-party of the meetings I chair | 14:29 |
| *** zhurong has quit IRC | 14:29 | |
| *** jsavak has quit IRC | 14:30 | |
| *** jsavak has joined #openstack-infra | 14:30 | |
| *** DevBox has quit IRC | 14:31 | |
| *** sigmavirus24 is now known as sigmavirus24_awa | 14:32 | |
| *** sigmavirus24_awa is now known as sigmavirus24 | 14:33 | |
| *** esker has quit IRC | 14:33 | |
| *** esker has joined #openstack-infra | 14:34 | |
| *** keedya has quit IRC | 14:35 | |
| *** sigmavirus24 is now known as sigmavirus24_awa | 14:35 | |
| *** bdemers has joined #openstack-infra | 14:36 | |
| *** keedya has joined #openstack-infra | 14:36 | |
| *** sigmavirus24_awa is now known as sigmavirus24 | 14:37 | |
| *** burgerk has quit IRC | 14:38 | |
| *** tellesnobrega_af is now known as tellesnobrega | 14:38 | |
| *** thorst_ has quit IRC | 14:39 | |
| *** jamesmca_ has quit IRC | 14:39 | |
| *** schipiga has quit IRC | 14:39 | |
| *** jamesmca_ has joined #openstack-infra | 14:39 | |
| *** thorst_ has joined #openstack-infra | 14:39 | |
| *** oanson has quit IRC | 14:39 | |
| *** Qiming has quit IRC | 14:43 | |
| *** thorst_ has quit IRC | 14:44 | |
| openstackgerrit | Raildo Mascena proposed openstack-infra/project-config: Run Neutron functional tests in Identity v3-only https://review.openstack.org/314604 | 14:44 |
| *** ramishra_ has quit IRC | 14:49 | |
| *** jamesmca_ has quit IRC | 14:50 | |
| *** gildub has quit IRC | 14:50 | |
| *** jamesmca_ has joined #openstack-infra | 14:50 | |
| *** IlyaG has joined #openstack-infra | 14:50 | |
| *** cdent has joined #openstack-infra | 14:52 | |
| *** Nikolay_St has quit IRC | 14:52 | |
| *** pcaruana has joined #openstack-infra | 14:53 | |
| *** thorst_ has joined #openstack-infra | 14:54 | |
| *** mixos has joined #openstack-infra | 14:54 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/nodepool: Test we group dib uploads by image name https://review.openstack.org/314315 | 14:54 |
| *** esker has quit IRC | 14:54 | |
| *** mriedem is now known as mriedem_meeting | 14:55 | |
| *** esker has joined #openstack-infra | 14:55 | |
| *** IlyaG has quit IRC | 14:55 | |
| *** zeih has quit IRC | 14:55 | |
| *** nadya has joined #openstack-infra | 14:56 | |
| openstackgerrit | Antoine Cabot proposed openstack-infra/irc-meetings: Upating Watcher team meeting https://review.openstack.org/314613 | 14:56 |
| *** thorst_ has quit IRC | 14:58 | |
| openstackgerrit | Lucas Dutra Nunes proposed openstack-infra/jenkins-job-builder: Add view management functionality https://review.openstack.org/206178 | 14:58 |
| *** jsavak has quit IRC | 14:58 | |
| *** jamesmca_ has quit IRC | 14:59 | |
| *** jsavak has joined #openstack-infra | 14:59 | |
| openstackgerrit | Beth Elwell proposed openstack-infra/storyboard-webclient: Enabled placeholders to be used for custom directives https://review.openstack.org/314615 | 15:00 |
| mugsie | hey - quick question... I want to move a bandit job to voting. Are we still supposed to add bandit to the "commands" directive in the [testenv:flake] section? | 15:01 |
| *** piet has joined #openstack-infra | 15:01 | |
| mugsie | instead of using an seprate job? | 15:02 |
| *** piet has quit IRC | 15:02 | |
| *** piet has joined #openstack-infra | 15:02 | |
| *** thorst_ has joined #openstack-infra | 15:03 | |
| *** asselin has joined #openstack-infra | 15:03 | |
| pabelanger | clarkb: fungi: mordred: jeblair: any objections to landing our initial centos AFS mirror today? https://review.openstack.org/#/c/289520/ | 15:04 |
| fungi | mugsie: adding it to an existing list of static analysis checks reduces the number of jobs, so that's cool as long as it doesn't create additional confusion | 15:04 |
| pabelanger | I wouldn't mind starting the rsync process | 15:04 |
| clarkb | I had previously suggested adding it to the pep8 target to make it self testing and avoid a new job from the get go | 15:05 |
| *** tosky has joined #openstack-infra | 15:05 | |
| tdurakov | hi folks, I'd like to introduce smth similiar to https://github.com/openstack-infra/project-config/blob/master/nodepool/nodepool.yaml#L73 for xenial, are there any guides for this? or examples? | 15:05 |
| *** Jeffrey4l_ has quit IRC | 15:05 | |
| *** zeih has joined #openstack-infra | 15:05 | |
| mugsie | fungi: cool, just wanted to check we were still doing that. | 15:05 |
| mugsie | thanks | 15:05 |
| clarkb | tdurakov: we don't have xenial yet, but can add it in pretty easily | 15:05 |
| clarkb | tdurakov: not sure what sort of guides or examples you are looking for | 15:06 |
| *** oanson has joined #openstack-infra | 15:06 | |
| tdurakov | clarkb: e.g. https://github.com/openstack-infra/project-config/blob/master/nodepool/scripts/multinode_setup.sh - will this work on xenial? | 15:06 |
| clarkb | it should, none of that is distro specific | 15:07 |
| *** psachin has quit IRC | 15:07 | |
| tdurakov | clarkb: and what about providers section? | 15:07 |
| *** rossella_s has quit IRC | 15:07 | |
| clarkb | tdurakov: you need to add a new one for xenial | 15:07 |
| tdurakov | clarkb: where can I read more about providers? | 15:09 |
| clarkb | tdurakov: in the nodepool documentation http://docs.openstack.org/infra/nodepool/configuration.html | 15:09 |
| tdurakov | clarkb: reading, thank you for details! | 15:10 |
| clarkb | tdurakov: http://docs.openstack.org/infra/nodepool/configuration.html#labels appears to be the specific section | 15:11 |
| *** r-mibu has quit IRC | 15:14 | |
| *** burgerk has joined #openstack-infra | 15:14 | |
| *** r-mibu has joined #openstack-infra | 15:14 | |
| jeblair | pabelanger: nope | 15:15 |
| *** mrmartin has joined #openstack-infra | 15:15 | |
| jeblair | krotscheck: how can i help? | 15:15 |
| *** zeih has quit IRC | 15:15 | |
| *** abregman has quit IRC | 15:15 | |
| openstackgerrit | Graham Hayes proposed openstack-infra/project-config: Move Bandit job to voting https://review.openstack.org/314627 | 15:16 |
| *** hdaniel has quit IRC | 15:16 | |
| clarkb | tdurakov: I think you can just copy the trusty-2-node label and s/trusty/xenial/ and it should work | 15:16 |
| mordred | pabelanger: wfm | 15:16 |
| clarkb | tdurakov: basically make a new label for xenial 2 node based on trusty | 15:16 |
| *** hdaniel_ has quit IRC | 15:16 | |
| tdurakov | clarkb: is it that easy? ok let me try that:) | 15:17 |
| clarkb | yup just copy paste and text reaplcement | 15:17 |
| Shrews | jeblair: have any of the zuul3 doc sources been updated? or are they still v2 based | 15:19 |
| *** esikache1 has quit IRC | 15:20 | |
| *** ddieterly is now known as ddieterly[away] | 15:20 | |
| *** esikachev has joined #openstack-infra | 15:20 | |
| *** jpr has joined #openstack-infra | 15:20 | |
| jeblair | Shrews: nope, was planning on updating docs last, since much of what we're doing is still in flux. | 15:20 |
| Shrews | jeblair: gotcha. thx | 15:20 |
| openstackgerrit | Paul Belanger proposed openstack-infra/nodepool: Group DIB uploads by image name https://review.openstack.org/314231 | 15:21 |
| *** ddieterly[away] is now known as ddieterly | 15:22 | |
| pabelanger | clarkb: okay, that should work for both missingDIBs check (when we start) and periodic updates from crontab ^. Also adds a unit test | 15:23 |
| pabelanger | clarkb: ... for grouping image uploads by image-name | 15:23 |
| clarkb | neat | 15:23 |
| *** vhosakot has joined #openstack-infra | 15:23 | |
| *** keedya has quit IRC | 15:23 | |
| *** mixos has quit IRC | 15:23 | |
| *** chuck__ is now known as zul | 15:24 | |
| *** rhallisey has quit IRC | 15:24 | |
| openstackgerrit | Timofey Durakov proposed openstack-infra/project-config: Added ubuntu-xenial-2-node https://review.openstack.org/314632 | 15:24 |
| *** rhallisey has joined #openstack-infra | 15:25 | |
| *** nwkarsten has quit IRC | 15:25 | |
| mordred | Shrews: guess what? phschwartz has found a cloud where the flavors extra_specs stuff is policied off | 15:25 |
| *** jlanoux has quit IRC | 15:25 | |
| phschwartz | mordred: correct | 15:25 |
| mordred | Shrews: so we need to handle exceptions on that and probably not fail the basic get_flavor call | 15:25 |
| *** jamesmca_ has joined #openstack-infra | 15:25 | |
| mordred | Shrews: and we may want to make a config optoin in occ that allows us to indicate that extra_specs is off in a cloud | 15:26 |
| *** tellesnobrega is now known as tellesnobrega_af | 15:26 | |
| Shrews | mordred: ugh | 15:26 |
| *** wshao has joined #openstack-infra | 15:26 | |
| Shrews | i mean... | 15:26 |
| Shrews | just ugh | 15:26 |
| tdurakov | clarkb, done | 15:26 |
| *** mixos has joined #openstack-infra | 15:26 | |
| phschwartz | Shrews: yeah, it is a pain, but it defn blocked me from spawning instances with os_server last night | 15:27 |
| tdurakov | please review https://review.openstack.org/#/c/314632/1 | 15:27 |
| Shrews | mordred: phschwartz: which cloud? | 15:27 |
| AJaeger | mugsie: add it to pep8 target | 15:27 |
| clarkb | tdurakov: done :) maybe pabelanger will approve it | 15:27 |
| phschwartz | Shrews: IBM's beta cloud | 15:27 |
| *** armax has joined #openstack-infra | 15:27 | |
| jeblair | mordred: does refstack have anything to say on the subject? | 15:28 |
| *** keedya has joined #openstack-infra | 15:28 | |
| mugsie | AJaeger: yup - have that in the designate review queue right now | 15:29 |
| *** hichihara has quit IRC | 15:29 | |
| phschwartz | jeblair: good question. I haven't looked to see if it does | 15:29 |
| mordred | jeblair: I do not think so | 15:29 |
| jeblair | :( | 15:29 |
| mordred | jeblair: we only added suport in shade for fetch flavor extra_specs recently ourselves | 15:29 |
| tdurakov | clarkb: thank you! | 15:29 |
| mordred | I didn't even know they existed | 15:30 |
| tdurakov | pabelanger: hi, are you around? | 15:30 |
| mordred | I mean, I don't care specifically about IBM 's beta cloud, since it's going to change significantly before it becomes not beta | 15:30 |
| mordred | but if ibm policied those off, I could see other people doing that | 15:30 |
| mordred | so we should handle the error | 15:30 |
| mordred | SpamapS: ^^ btw - let's not turn off flavor extra_specs in policy for ibm cloud :) | 15:31 |
| phschwartz | mordred: ++ | 15:31 |
| Shrews | mordred: we have already have an option on list_flavors() to not get extra specs. should be easy enough to turn off with an occ option | 15:32 |
| mordred | phschwartz: any chance you have the traceback around? specifically, I'd love to know which exception it's throwing | 15:32 |
| phschwartz | mordred: If we want, I could propose a review that adds the get_extra as a param to get_flavor/search_flavor with it still defaulting to True like it does in list_flavors. That will allow us to pass a param to turn it off. | 15:32 |
| phschwartz | mordred: sec, I can get one | 15:32 |
| openstackgerrit | Adam Coldrick proposed openstack-infra/storyboard-webclient: Complex priorities UI in stories https://review.openstack.org/312666 | 15:32 |
| mordred | Shrews: ya. we just need to plumb through from get | 15:32 |
| mordred | phschwartz: yup | 15:32 |
| *** ggnel_t has quit IRC | 15:33 | |
| phschwartz | mordred: fatal: [localhost]: FAILED! => {"changed": false, "extra_data": null, "failed": true, "msg": "Error fetching flavor extra specs (Inner Exception: Forbidden (HTTP 403))"} | 15:33 |
| mordred | phschwartz: thanks | 15:34 |
| phschwartz | mordred: that is the base error, will get more verbose and paste | 15:34 |
| mordred | nah - that's fine | 15:34 |
| Shrews | can i just state that it is soooo weird to have a policy option to disable that | 15:34 |
| *** ddieterly is now known as ddieterly[away] | 15:34 | |
| mtreinish | Shrews: you can disable anything with policy... | 15:34 |
| phschwartz | mordred: k, won't get more verbose | 15:35 |
| * Shrews disables mtreinish with a policy | 15:35 | |
| Shrews | :) | 15:35 |
| clarkb | pabelanger: reviewed | 15:35 |
| mtreinish | hehe | 15:35 |
| openstackgerrit | Paul Belanger proposed openstack-infra/nodepool: Group DIB uploads by image name https://review.openstack.org/314231 | 15:35 |
| *** esker has quit IRC | 15:35 | |
| mordred | phschwartz: it should be keystoneauth1.exceptions.http.HttpError | 15:35 |
| mordred | mtreinish: yah. disabling anything with policy is one of the STUPIDEST things openstack ever did | 15:36 |
| *** kzaitsev_mb has joined #openstack-infra | 15:36 | |
| mordred | policy.json is the opposite of defcore and the antithesis of interoperability | 15:36 |
| *** esker has joined #openstack-infra | 15:36 | |
| *** mrmartin has quit IRC | 15:37 | |
| *** andreas_s has quit IRC | 15:37 | |
| openstackgerrit | Timofey Durakov proposed openstack-infra/project-config: Swithed to xenial image for multinode live-migration job https://review.openstack.org/314636 | 15:37 |
| *** mixos has quit IRC | 15:38 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/nodepool: Group DIB uploads by image name https://review.openstack.org/314231 | 15:38 |
| pabelanger | clarkb: thanks, updated now | 15:38 |
| jeblair | clarkb, mordred: http://paste.openstack.org/show/496588/ | 15:38 |
| phschwartz | mordred: https://github.com/openstack-infra/shade/blob/master/shade/openstackcloud.py#L1370 | 15:38 |
| phschwartz | mordred: that is the line of code throwing the exception | 15:38 |
| nibalizer | good morning | 15:38 |
| *** andymaier_ has quit IRC | 15:39 | |
| *** dizquierdo has quit IRC | 15:39 | |
| *** aysyd has quit IRC | 15:39 | |
| *** flwang has quit IRC | 15:39 | |
| *** rhallisey has quit IRC | 15:39 | |
| pabelanger | nibalizer: o/ | 15:39 |
| phschwartz | nibalizer: morning | 15:40 |
| *** rhallisey has joined #openstack-infra | 15:40 | |
| openstackgerrit | Dougal Matthews proposed openstack/requirements: Ass Mistral to global requirements https://review.openstack.org/314638 | 15:40 |
| *** deadnull_ is now known as _deadnull | 15:40 | |
| jeblair | clarkb, mordred: um, do we *only* support boot from volume in launch-node now? | 15:40 |
| *** amotoki has quit IRC | 15:41 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade: Don't fail getting flavors if extra_specs is off https://review.openstack.org/314640 | 15:41 |
| mordred | jeblair: if so it's definitely a bug | 15:41 |
| jeblair | clarkb, mordred: i ask because it looks like that is correctly set to None because i did not specify a volume, yet that is not wrapped by a conditional | 15:41 |
| openstackgerrit | Dougal Matthews proposed openstack/requirements: Add Mistral to global requirements https://review.openstack.org/314638 | 15:42 |
| clarkb | jeblair: mordred I have a patch up to fix it... was part of a bad rebase when everything got rewritten... | 15:42 |
| jeblair | clarkb, mordred: so either we're just missing some amount of "if not None"; or we assumed that we could pass in None to get_volume_attach_device and it would, erm, return None | 15:42 |
| jeblair | clarkb: cool | 15:42 |
| fungi | jeblair: fwiw, i tested clarkb's patch yesterday and it worked for me (without boot from volume) | 15:42 |
| jeblair | now might be a good time to merge it | 15:42 |
| clarkb | and its not boot from volume its attach volume post boot | 15:42 |
| clarkb | https://review.openstack.org/#/c/311872/ | 15:42 |
| * mordred would like to land that | 15:42 | |
| fungi | though i was still running into the package installation race 300005 is hoping to fix | 15:43 |
| mordred | phschwartz, Shrews: ^^ see patch above (314640 - not clarkb's thing) | 15:43 |
| jeblair | that looks like the code i was about to write | 15:43 |
| mordred | the code looks correct to me | 15:43 |
| jeblair | Exec['update-apt'] -> Package <| |> | 15:44 |
| clarkb | pabelanger: did you see the comment in the test too? | 15:44 |
| jeblair | fungi: are you just making ascii art? | 15:44 |
| openstackgerrit | Paul Belanger proposed openstack-infra/nodepool: Group DIB uploads by image name https://review.openstack.org/314231 | 15:44 |
| fungi | jeblair: yes, puppet-insanity-ascii-art | 15:44 |
| *** mixos has joined #openstack-infra | 15:44 | |
| pabelanger | clarkb: Ya, I just did. sorry about that | 15:44 |
| jeblair | what does that mean? | 15:44 |
| *** aysyd has joined #openstack-infra | 15:44 | |
| *** javeriak has joined #openstack-infra | 15:45 | |
| fungi | jeblair: it's an empty "resource collector" https://docs.puppet.com/puppet/latest/reference/lang_collectors.html | 15:45 |
| mordred | jeblair: it means "update-apt magic magic package magic puppet ruby" | 15:45 |
| *** mikelk has quit IRC | 15:45 | |
| fungi | "A collector with an empty search expression will match every resource of the specified resource type." | 15:45 |
| jeblair | i think i get it. | 15:45 |
| *** markus_z has joined #openstack-infra | 15:45 | |
| fungi | it's deep puppet voodoo i wanted to avoid, but this seems to be the only way to say "do this thing before you handle any resources of this other resource type anywhere" | 15:46 |
| jeblair | we make sure that we run apt-get update after adding openstack-infra.list, and also before any package install | 15:46 |
| *** woodster_ has joined #openstack-infra | 15:46 | |
| Shrews | mordred: if FlavorGetExtraSpecs fails, i think the flavor.get() will too | 15:46 |
| *** yamahata has quit IRC | 15:47 | |
| Shrews | mordred: oh, nevermind | 15:47 |
| *** vincentll has quit IRC | 15:47 | |
| phschwartz | mordred: that looks like it would do the job | 15:47 |
| *** tellesnobrega_af is now known as tellesnobrega | 15:47 | |
| fungi | jeblair: we tried alternative implementations but they ran into circular deps and/or duplicate resource declaration issues | 15:47 |
| Shrews | mordred: i confused the calls | 15:47 |
| openstackgerrit | Antoine Cabot proposed openstack-infra/irc-meetings: Updating Watcher team meeting time https://review.openstack.org/314613 | 15:47 |
| *** sdake_ has quit IRC | 15:47 | |
| *** yolanda has quit IRC | 15:48 | |
| *** javeriak_ has joined #openstack-infra | 15:48 | |
| fungi | jeblair: also the -> is like the "before" directive except it's apparently the only mechanism for specifying a resource "before" a collector | 15:48 |
| SpamapS | mordred: context? | 15:49 |
| *** javeriak has quit IRC | 15:49 | |
| *** sdake has joined #openstack-infra | 15:50 | |
| nibalizer | clarkb: do we still want https://review.openstack.org/#/c/311903/ ? | 15:50 |
| mordred | SpamapS: current beta ibm cloud turns of GETf /flavors/{id}/os-extra_specs in the policy.json | 15:50 |
| *** sridhar_ram has joined #openstack-infra | 15:50 | |
| *** maestro1 has quit IRC | 15:50 | |
| mordred | SpamapS: for reasons surpassing understanding | 15:50 |
| clarkb | nibalizer: yes we can't redeploy gerrit until that or an equivalent fix merges | 15:51 |
| *** IlyaG has joined #openstack-infra | 15:51 | |
| mordred | SpamapS: we're adding a workaround in shade - but I thought I'd communicate that it's a choice that causes people to need workarounds :) | 15:51 |
| clarkb | nibalizer: assuming upstream bouncy castle doesn't fix their hosting | 15:51 |
| openstackgerrit | Raildo Mascena proposed openstack-infra/project-config: Run Heat functional tests in Identity v3-only https://review.openstack.org/314643 | 15:51 |
| openstackgerrit | Merged openstack-infra/system-config: Properly handle volumes in launch node https://review.openstack.org/311872 | 15:52 |
| *** tesseract has quit IRC | 15:52 | |
| SpamapS | Mordred: ah. We've been discussing a policy testing tool that was developed as a tempest plugin. Would be interesting to have something like that for shade too | 15:53 |
| *** bpokorny has joined #openstack-infra | 15:53 | |
| *** sdake_ has joined #openstack-infra | 15:54 | |
| openstackgerrit | Dmytro Dovbii proposed openstack-infra/project-config: Make gate-murano-python34-db non-voting https://review.openstack.org/314645 | 15:54 |
| mordred | SpamapS: well, we should delete policy files from openstack across the board- but short of that, yeah, I'd love to look a bit more at the policy testing stuff | 15:54 |
| tdurakov | pabelanger: could you please explain what experimental job should I add? https://review.openstack.org/#/c/314636/ | 15:55 |
| *** Sukhdev has joined #openstack-infra | 15:55 | |
| *** ddieterly[away] is now known as ddieterly | 15:55 | |
| tdurakov | pabelanger: tempest-dsvm-multinode-live-migration is already experimental | 15:55 |
| *** IlyaG has quit IRC | 15:56 | |
| openstackgerrit | Dmytro Dovbii proposed openstack-infra/project-config: Make gate-murano-python34-db non-voting https://review.openstack.org/314645 | 15:56 |
| *** sshnaidm has quit IRC | 15:57 | |
| clarkb | pabelanger: one comment, if you think thats too nitpick let me know (I personally find it hard to keep track of multiple index offsets and prefer to avoid it if possible) | 15:57 |
| openstackgerrit | Merged openstack-infra/project-config: Added ubuntu-xenial-2-node https://review.openstack.org/314632 | 15:57 |
| *** sdake has quit IRC | 15:57 | |
| *** flwang has joined #openstack-infra | 15:58 | |
| *** dprince has quit IRC | 15:58 | |
| *** ddecapit has joined #openstack-infra | 15:59 | |
| *** thorst_ has quit IRC | 15:59 | |
| *** brucet has joined #openstack-infra | 15:59 | |
| tdurakov | clarkb: could you also review this one https://review.openstack.org/#/c/314636/1 not sure I properly understood pabelanger comment | 16:01 |
| *** apoorvad has joined #openstack-infra | 16:01 | |
| *** thorst_ has joined #openstack-infra | 16:01 | |
| clarkb | tdurakov: pabelanger is saying that instead of switching the existing job over you could make a new job and have both trusty and xenial. Is the existing job experimental or is it in check/gate? | 16:02 |
| clarkb | if it is experimental then I think it is ok to use your change as is | 16:02 |
| *** matrohon has quit IRC | 16:02 | |
| openstackgerrit | Merged openstack-infra/system-config: Always apt-get update after replacing sources https://review.openstack.org/300005 | 16:02 |
| tdurakov | clarkb: existing one is experimental/non-voting | 16:02 |
| clarkb | pabelanger: ^ I think we can just switch the job over as it is currently experimental | 16:03 |
| *** oanson has quit IRC | 16:03 | |
| *** wshao has quit IRC | 16:03 | |
| jeblair | okay, launch-node take 2 | 16:03 |
| *** keedya has quit IRC | 16:04 | |
| mordred | clarkb: there'san openstack-dev thread "running Fuel tests using nodepool" that I mentioned you in | 16:04 |
| clarkb | uh oh | 16:04 |
| *** jsavak has quit IRC | 16:04 | |
| mordred | it's not bad | 16:04 |
| mordred | they're investigating what's needed for multi-node fuel testing and were tlaking about overlays and stuff | 16:05 |
| mordred | seemed like a clarkb topic | 16:05 |
| *** jsavak has joined #openstack-infra | 16:05 | |
| clarkb | ah | 16:05 |
| *** ericksonsantos has joined #openstack-infra | 16:06 | |
| fungi | yeah, i also replied on it briefly just mentioning the current overlay network implementation in d-g | 16:06 |
| *** ajmiller has quit IRC | 16:06 | |
| phschwartz | mordred: Shrews pointed out something on your patch that I missed. just so you are aware. I know you get a ton of emails :) | 16:06 |
| *** e0ne has quit IRC | 16:06 | |
| clarkb | so everyone knows tl;dr on overlays is vxlan > gre because gre blocked in some clouds. OVS > linuxbridge because linuxbridge + vxlan is only point to point without running extra services (aiui( | 16:06 |
| *** ajmiller has joined #openstack-infra | 16:07 | |
| openstackgerrit | Dmytro Dovbii proposed openstack-infra/project-config: Make gate-murano-python34-db non-voting https://review.openstack.org/314645 | 16:07 |
| fungi | they seemed concerned that doing vxlan setup before their tests would leave them not exercising the parts of their project which are supposed to install and configure vxlan support | 16:08 |
| clarkb | the way we handle that with neutron is we let neutron set up vxlan support direct | 16:08 |
| clarkb | there is no nesting of overlays | 16:08 |
| clarkb | works fine | 16:08 |
| *** hashar has quit IRC | 16:08 | |
| fungi | since what they're testing is an installer and configuration management | 16:08 |
| clarkb | ya so are we :) (devstack) | 16:08 |
| clarkb | where is this thread? I am not finding it | 16:09 |
| krotscheck | jeblair: Hi! | 16:09 |
| nibalizer | i don't think using tinc like that is wrong at all, but if what we have works then there isn't a need to shift gears | 16:09 |
| fungi | well, we're not exercising the parts of devstack that would install ovs/vxlan on the system as a result, right? | 16:09 |
| *** brucet_ has joined #openstack-infra | 16:09 | |
| krotscheck | jeblair: Stil available, or... | 16:09 |
| *** zqfan has joined #openstack-infra | 16:09 | |
| clarkb | fungi: we sort of are, we use devstack to do it | 16:09 |
| *** savihou has quit IRC | 16:09 | |
| fungi | (because it's already installed by the time devstack gets to that) | 16:09 |
| fungi | ahh, good point | 16:10 |
| clarkb | but yes its not in lib/neutron installing that | 16:10 |
| fungi | we do call out to devstack functions for that part | 16:10 |
| pabelanger | tdurakov: okay, thanks for the update. I didn't check zuul, but I should have before commenting | 16:10 |
| fungi | so i guess we exercise them, just not in context | 16:10 |
| clarkb | nibalizer: we don't need tinc | 16:10 |
| krotscheck | jeblair: We should probably start here: https://review.openstack.org/#/c/308669/ | 16:10 |
| clarkb | nibalizer: but that is potentially another possibility or openvpn or whatever | 16:10 |
| *** thorst_ has quit IRC | 16:10 | |
| clarkb | nibalizer: in theory if we use the same tools neutron is using then we have a giant horde of help behind us though | 16:11 |
| nibalizer | clarkb: where does the code that sets up the overlay networking live? | 16:11 |
| nibalizer | in d-g somewhere? | 16:11 |
| clarkb | yes in d-g | 16:11 |
| *** ramishra has joined #openstack-infra | 16:11 | |
| fungi | nibalizer: yep, i linked to it in that thread | 16:11 |
| clarkb | in the functions file | 16:11 |
| openstackgerrit | Merged openstack-infra/storyboard-webclient: Enabled placeholders to be used for custom directives https://review.openstack.org/314615 | 16:11 |
| openstackgerrit | Paul Belanger proposed openstack-infra/nodepool: Group DIB uploads by image name https://review.openstack.org/314231 | 16:11 |
| *** thorst_ has joined #openstack-infra | 16:11 | |
| *** thorst_ has quit IRC | 16:11 | |
| nibalizer | i'm a big tinc fan, so it's going to be hard to not get nerd sniped just trying it out | 16:11 |
| jeblair | krotscheck: +3 | 16:12 |
| krotscheck | jeblair: Awesome! | 16:12 |
| pabelanger | clarkb: testing latest patch now | 16:12 |
| krotscheck | Now we wait for that to land. | 16:12 |
| *** jlanoux has joined #openstack-infra | 16:12 | |
| *** brucet has quit IRC | 16:13 | |
| *** daemontool_ has quit IRC | 16:13 | |
| * clarkb is confused why everyone thinks you have to nest overlays.... | 16:13 | |
| nibalizer | although it looks like maybe this person has already got it working | 16:13 |
| fungi | afs update: the vos release -force completed in just under 59 hours, so i followed up with a normal vos release (no -force) thereafter to make sure it will complete without error now. it's been running for ~4.5 hours so far | 16:13 |
| openstackgerrit | Merged openstack-infra/project-config: Fix on OpenstackId Jenkins Job https://review.openstack.org/314584 | 16:14 |
| *** dprince has joined #openstack-infra | 16:14 | |
| fungi | #status log afs update: the vos release -force completed in just under 59 hours, so i followed up with a normal vos release (no -force) thereafter to make sure it will complete without error now. it's been running for ~4.5 hours so far | 16:14 |
| openstackstatus | fungi: finished logging | 16:14 |
| *** mriedem_meeting is now known as mriedem | 16:14 | |
| smarcet | fungi:clarkb: i will need to re run https://review.openstack.org/#/c/314403/ | 16:14 |
| * fungi is trying to remember to use that | 16:14 | |
| smarcet | how i could do that ? | 16:14 |
| *** acruz has quit IRC | 16:15 | |
| clarkb | smarcet: leave a comment on the change that says "recheck", you may need to wait a bit longer to have puppet apply that update though | 16:15 |
| clarkb | smarcet: puppet runs every 15 minutes so should be ready in about 15 more minutes | 16:15 |
| *** kzaitsev_mb has quit IRC | 16:16 | |
| *** oanson has joined #openstack-infra | 16:17 | |
| jeblair | fungi, clarkb, mordred, nibalizer: i launched afs02.dfw.openstack.org, but it does not appear that puppet matched the afs fileserver node defn | 16:17 |
| *** thorst_ has joined #openstack-infra | 16:17 | |
| smarcet | clarkb: ok thx for the info | 16:17 |
| jeblair | there is no evidence of anything related to afs on the host, and the puppet syslog just looks like the basic server stuff | 16:18 |
| jeblair | oh | 16:18 |
| jeblair | i typod | 16:18 |
| jeblair | fungi, clarkb, mordred, nibalizer: nm | 16:18 |
| *** asettle has joined #openstack-infra | 16:18 | |
| clarkb | jeblair: regex failed on typo? | 16:19 |
| *** tphummel has joined #openstack-infra | 16:19 | |
| jeblair | clarkb: stupid regex | 16:19 |
| openstackgerrit | Merged openstack-infra/system-config: Added clean exit hooks to npm registry script https://review.openstack.org/308669 | 16:20 |
| openstackgerrit | Matthew Thode proposed openstack/gertty: Add Gentoo install instructions https://review.openstack.org/314664 | 16:20 |
| mordred | jeblair: regexes are stupid | 16:21 |
| mordred | jeblair: so stupid | 16:21 |
| openstackgerrit | Yan Ning proposed openstack/requirements: Add python-monascaclient to the global requirements https://review.openstack.org/251674 | 16:22 |
| jeblair | good news, launch-node and the puppet apt-get change work | 16:22 |
| *** thorst_ has quit IRC | 16:22 | |
| openstackgerrit | Merged openstack-infra/project-config: Swithed to xenial image for multinode live-migration job https://review.openstack.org/314636 | 16:23 |
| morgan | mordred: did you see my question from earlier? re: testing nodepool cleaupfips. is this something we need to synthetically create leaked fips or you're just looking to make sure the shade function is called? | 16:23 |
| *** asettle has quit IRC | 16:23 | |
| *** esker has quit IRC | 16:25 | |
| openstackgerrit | Yaroslav Lobankov proposed openstack-infra/project-config: [Rally] Adding two new non-voiting jobs for `rally verify` https://review.openstack.org/310151 | 16:25 |
| *** esker has joined #openstack-infra | 16:26 | |
| *** tqtran has joined #openstack-infra | 16:26 | |
| openstackgerrit | Yan Ning proposed openstack/requirements: Add python-monascaclient to the global requirements https://review.openstack.org/251674 | 16:27 |
| *** ifarkas has quit IRC | 16:28 | |
| *** thomasem has left #openstack-infra | 16:29 | |
| *** Sukhdev has quit IRC | 16:29 | |
| *** Sukhdev has joined #openstack-infra | 16:30 | |
| pabelanger | we seem to be building a lot of nodes OSIC, but only using a 1/4 of them: http://grafana.openstack.org/dashboard/db/nodepool-osic | 16:30 |
| pabelanger | checking nodepool.log for exceptions | 16:30 |
| clarkb | pabelanger: usually that means things like floating IPs are broken or ssh failed or ready script failed | 16:30 |
| *** chuck__ has joined #openstack-infra | 16:30 | |
| jeblair | apparently lm recently released bitkeeper under asl2: https://www.bitkeeper.org/ | 16:30 |
| *** zul has quit IRC | 16:31 | |
| *** chuck__ is now known as zul | 16:31 | |
| pabelanger | clarkb: yup: OpenStackCloudTimeout: Timeout waiting for the floating IP to be attached. | 16:32 |
| *** _deadnull is now known as deadnull_ | 16:33 | |
| *** brucet_ has quit IRC | 16:33 | |
| pabelanger | looks like we are hitting quota in rax also: http://paste.openstack.org/show/496594/ | 16:33 |
| openstackgerrit | Yaroslav Lobankov proposed openstack-infra/project-config: [Rally] Adding two new non-voiting jobs for `rally verify` https://review.openstack.org/310151 | 16:34 |
| *** jlanoux has quit IRC | 16:34 | |
| jeblair | wow, we actually hit 2 quotas at the same time? that's progress in our accounting! | 16:34 |
| *** brucet has joined #openstack-infra | 16:35 | |
| jeblair | mordred: thank goodness, we documented http://docs.openstack.org/infra/system-config/afs.html#adding-a-fileserver :) | 16:35 |
| fungi | yeah, i saw the bitkeeper news by way of vulnerabilities for it getting published to the oss-security ml | 16:35 |
| *** electrofelix has joined #openstack-infra | 16:36 | |
| *** kashyap has joined #openstack-infra | 16:36 | |
| pabelanger | jeblair: do we need to lower anything in nodepool.yaml so we don't throw exceptions? | 16:36 |
| *** abitha has joined #openstack-infra | 16:36 | |
| clarkb | pabelanger: its possible that yolanda moved the magnum shade test instance and as a result nodepool's count is incomplete? | 16:36 |
| kashyap | Isn't my 'recheck' not taking effect here? https://review.openstack.org/#/c/314012/ (That Jenkins job failure should be fixed now) | 16:36 |
| *** yamahata has joined #openstack-infra | 16:37 | |
| clarkb | pabelanger: otherwise I wouldn't expect to have any issues there unless we have properly leaked nodes, the alien list command may point them out | 16:37 |
| kashyap | Or for stable/liberty is there a different secret incantaation? | 16:37 |
| jeblair | pabelanger: if we have max-servers set to > 195, we should lower it; otherwise, we may have leaked something | 16:37 |
| jeblair | pabelanger: what clarkb said | 16:37 |
| clarkb | kashyap: you are queued at http://status.openstack.org/zuul/ | 16:37 |
| * kashyap clicks | 16:37 | |
| kashyap | clarkb: Ah, thanks. I always forget to check the queue | 16:38 |
| *** sdake_ is now known as sdake | 16:38 | |
| *** thorst_ has joined #openstack-infra | 16:38 | |
| *** Swami has joined #openstack-infra | 16:38 | |
| pabelanger | jeblair: clarkb: okay, I'll follow up with yolanda | 16:39 |
| clarkb | pabelanger: well double check on that first, it was in the non jenkins account previously and causing ansible trouble so I asked it be moved, not sure if it was moved | 16:39 |
| jeblair | clarkb: i saw it in openstackci moments ago | 16:40 |
| clarkb | ok, it hasn't moved then. Alien list will hopeflly shed some light on this | 16:40 |
| clarkb | (ansible doesn't timeout quickly when talking to instances it can't ssh into) | 16:40 |
| *** brucet_ has joined #openstack-infra | 16:40 | |
| pabelanger | clarkb: I am getting a fair bit of hits on alien-list over all providers | 16:42 |
| *** thorst_ has quit IRC | 16:42 | |
| clarkb | pabelanger: I think if you do all providers the see each other's as aliens, so you have to restrict per provider | 16:42 |
| clarkb | but I may be wrong about that | 16:42 |
| clarkb | the way we used to do hpcloud with 5 logical providers made it confusing | 16:43 |
| openstackgerrit | Yaroslav Lobankov proposed openstack-infra/project-config: [Rally] Adding two new non-voiting jobs for `rally verify` https://review.openstack.org/310151 | 16:43 |
| openstackgerrit | Yaroslav Lobankov proposed openstack-infra/project-config: [Rally] Adding two new non-voiting jobs for `rally verify` https://review.openstack.org/310151 | 16:43 |
| pabelanger | clarkb: I am seeing 38 alien images in rax-ord alone | 16:43 |
| clarkb | pabelanger: do they all live in rax-ord? | 16:44 |
| pabelanger | they appear to be ubuntu-trusty-2-node-* | 16:44 |
| *** brucet has quit IRC | 16:44 | |
| pabelanger | clarkb: no, other providers have alien-images too | 16:44 |
| *** thorst_ has joined #openstack-infra | 16:44 | |
| pabelanger | but 38 I listed are just rax-ord | 16:44 |
| clarkb | pabelanger: oh ya subnodes show up in alien list I think | 16:44 |
| clarkb | which is a bug | 16:44 |
| *** kengo_sakai has joined #openstack-infra | 16:45 | |
| pabelanger | okay, so that is likely why we cannot launch more | 16:45 |
| clarkb | maybe we also have a bug in calculating ram use ? | 16:45 |
| morgan | jeblair: for nodepool FIP cleanup (cc fungi clarkb) if we're adding tests, is this something that needs synthetic leaked fips or just testing that we call the cleanupfloaters is called? | 16:45 |
| *** brucet_ has quit IRC | 16:45 | |
| *** flaper87 has quit IRC | 16:46 | |
| *** flaper87 has joined #openstack-infra | 16:46 | |
| pabelanger | clarkb: let me get pastebin minus subnodes | 16:46 |
| clarkb | morgan: ideally it would actually be testing that FIPs get cleaned up | 16:46 |
| jeblair | morgan: i think synthetic leaked fips would be better | 16:46 |
| clarkb | morgan: we know the cron lib is going to call it... | 16:46 |
| morgan | clarkb, jeblair: the reason i'm asking is because it literally just calls "shade cleanup fips", I'm thinking the synthetic test should be in shade itself? | 16:47 |
| jeblair | morgan: link to change? | 16:47 |
| *** brucet has joined #openstack-infra | 16:47 | |
| morgan | sec, getting the number | 16:47 |
| *** abregman has joined #openstack-infra | 16:48 | |
| morgan | jeblair: https://review.openstack.org/#/c/307755/ | 16:48 |
| clarkb | thats very different than when I asked for tests | 16:49 |
| *** e0ne has joined #openstack-infra | 16:49 | |
| *** brucet has quit IRC | 16:49 | |
| *** thorst_ has quit IRC | 16:49 | |
| morgan | clarkb: hehe | 16:49 |
| *** kengo_sakai has quit IRC | 16:49 | |
| clarkb | see https://review.openstack.org/#/c/307755/5..8/nodepool/provider_manager.py | 16:49 |
| morgan | clarkb: yeah, i think it's really "check to make sure we called the thing" | 16:49 |
| morgan | oh yeah | 16:49 |
| morgan | very different | 16:49 |
| jeblair | i don't think i would add any tests to that -- but rather, i think i would set that configuration option in our tests so that it does get called, and if there are any problems (eg typos, etc) it bombs... | 16:50 |
| *** derekh has quit IRC | 16:50 | |
| jeblair | however... why is that a configuration option? | 16:50 |
| pabelanger | clarkb: so, back to 314231, I think we need to sort images / providers before we submit uploads otherwise, i have no good way to validate the upload order: http://logs.openstack.org/31/314231/9/check/gate-nodepool-python27-db/f6324de/console.html | 16:50 |
| openstackgerrit | Yaroslav Lobankov proposed openstack-infra/project-config: [Rally] Adding two new non-voiting jobs for `rally verify` https://review.openstack.org/310151 | 16:50 |
| clarkb | pabelanger: the order is the same as in the yaml | 16:51 |
| pabelanger | jeblair: clarkb: current alien-list: http://paste.openstack.org/show/496595/ | 16:51 |
| jeblair | oh, because it's only safe it it's the only user | 16:51 |
| clarkb | pabelanger: because labels and label providers are both lists | 16:51 |
| morgan | jeblair: i think because there are cases we don't want to cleanup FIPs | 16:51 |
| morgan | jeblair: yes | 16:51 |
| jeblair | (fips clearly need metadata :) | 16:51 |
| clarkb | jeblair: more specifically if htere are non shade fips attached | 16:51 |
| openstackgerrit | Yaroslav Lobankov proposed openstack-infra/project-config: [Rally] Adding two new non-voiting jobs for `rally verify` https://review.openstack.org/310151 | 16:51 |
| clarkb | since shade does it in such a way that the fip must be attached or not in use? | 16:51 |
| *** brucet has joined #openstack-infra | 16:52 | |
| morgan | clarkb: pretty much if you aren't using the shade way "assign and attach in one call" shade can't know if the FIP is in use | 16:52 |
| morgan | clarkb: if you're doing "create fip; attach fip" you might race. | 16:52 |
| morgan | and error someone eles' fip. | 16:52 |
| mordred | jeblair: specifically, we have users who have indicated that auto-cleanup of fiups would be dangerous for them | 16:52 |
| mordred | jeblair: I don't remember who | 16:52 |
| clarkb | pabelanger: I thought I deleted the clarkb-test instances last whenever that was week? in any case that one can definitely be deleted | 16:53 |
| morgan | mordred: yeah a number of folks don't only have nodepool in the tenant (leaving out best/worst/otherwise practices) | 16:53 |
| mordred | clarkb: right. we have users who have _other_ things in their clouds than nodepool | 16:53 |
| mordred | so they have fips that have lifecycles that are not ours | 16:53 |
| clarkb | pabelanger: as for the others I think it should be safe to delete them | 16:53 |
| jeblair | mordred: this makes me wonder if we should revisit the idea of nodepool tracking fips | 16:53 |
| *** sshnaidm has joined #openstack-infra | 16:53 | |
| krotscheck | jeblair: We have a merge, and an update: http://puppetboard.openstack.org/report/mirror-update.openstack.org/01a3eb7372d2d35483e77c214b401508fbc76da5 | 16:53 |
| mordred | jeblair: I'd be fine with that as part of the v3 work | 16:53 |
| openstackgerrit | Paul Belanger proposed openstack-infra/nodepool: Group DIB uploads by image name https://review.openstack.org/314231 | 16:54 |
| jeblair | mordred: ya, i should have said "later" :) | 16:54 |
| morgan | jeblair: might be worthwhile knowing which FIPs nodepool owns.. but likely we will still have leaks and need some side-band cleanup-y thing. | 16:54 |
| mordred | jeblair: but I don't think it's worth doing currently | 16:54 |
| mordred | jeblair: :)_ | 16:54 |
| jeblair | mordred: wipe that drool | 16:54 |
| mordred | morgan: also, we should keep poking openstack to stop leaking | 16:54 |
| morgan | mordred: +++ | 16:54 |
| clarkb | mordred: that would be the most excellent outcome | 16:54 |
| openstackgerrit | Yaroslav Lobankov proposed openstack-infra/project-config: [Rally] Adding two new non-voiting jobs for `rally verify` https://review.openstack.org/310151 | 16:54 |
| clarkb | especially if these things are going to be forced on us | 16:54 |
| jeblair | krotscheck: ack, will cycle back in ~5 mins | 16:54 |
| openstackgerrit | Merged openstack-infra/openstackid: Fix on OpenId 2.0 User Discovery https://review.openstack.org/314403 | 16:55 |
| morgan | clarkb, mordred: sooo... simple "did we call the thing" test or say "meh" not needed? | 16:55 |
| krotscheck | jeblair: Thanks. For testing purposes, the next command to issue is "registry-static -d localhost -o /afs/.openstack.org/mirror/npm --blobstore afs-blob-store --hooks openstack-registry-hooks" --- It should exit cleanly. | 16:55 |
| morgan | jeblair: i looked at keycloak, wont meet our needs. Ipsilon is still the best option for us, which isn't awful. | 16:55 |
| clarkb | morgan: I am not too worried about the did we call it test, that seems silly | 16:55 |
| clarkb | morgan: at least within the context of the rest of the existing tests | 16:56 |
| morgan | clarkb: great, then i'll comment on the review and reference this convo. | 16:56 |
| morgan | clarkb: thnx | 16:56 |
| clarkb | morgan: I think jeblair's comment on enabling it in the test configs is a good on though | 16:56 |
| *** deadnull_ has quit IRC | 16:56 | |
| clarkb | then at least it should exercise the code and if we derp it badly it will explode | 16:56 |
| *** andymaier_ has joined #openstack-infra | 16:57 | |
| openstackgerrit | James E. Blair proposed openstack-infra/system-config: Update AFS docs to reference afs02.dfw https://review.openstack.org/314677 | 16:57 |
| openstackgerrit | James E. Blair proposed openstack-infra/system-config: Correct new afs fileserver docs https://review.openstack.org/314678 | 16:57 |
| mordred | ++ | 16:57 |
| jeblair | krotscheck: on it | 16:58 |
| krotscheck | jeblair: Sweet. Lemme know if it explodes. | 16:58 |
| *** yaume has quit IRC | 16:59 | |
| *** esker has quit IRC | 17:00 | |
| *** vilobhmm11 has joined #openstack-infra | 17:00 | |
| clarkb | mordred: morgan but also don't forget to actually test that in shade please :) | 17:00 |
| *** daemontool_ has joined #openstack-infra | 17:00 | |
| *** abregman has quit IRC | 17:00 | |
| jeblair | krotscheck: it's running in screen with afs creds on mirror-update | 17:00 |
| morgan | clarkb: ++ yes, it should 100% be tested in shade | 17:01 |
| krotscheck | jeblair: Danke. | 17:01 |
| krotscheck | jeblair: Does the log output give you an idea of how many sequence revisions it's got to go through? Trying to estimate when I should pester you again ;) | 17:02 |
| jeblair | krotscheck: 1054787/1097297 ? | 17:02 |
| krotscheck | Definitely the right numbers. | 17:02 |
| jeblair | krotscheck: let me get 2 that are 60s apart | 17:03 |
| *** jordanP has quit IRC | 17:03 | |
| *** jamesmca_ has quit IRC | 17:04 | |
| *** brucet has quit IRC | 17:04 | |
| jeblair | 1055177/1097297 -- 1055519/1097297 | 17:04 |
| * krotscheck runs math | 17:05 | |
| jeblair | krotscheck: about 2 hours-ish? | 17:05 |
| *** e0ne has quit IRC | 17:06 | |
| anteaya | so on the infra meeting agenda under renames someone has added: openstack-infra/ansible-puppet -> openstack-infra/ansible-role-puppet | 17:06 |
| anteaya | does anyone have a patch for that change? | 17:06 |
| *** asselin_ has quit IRC | 17:07 | |
| *** johnny___ has joined #openstack-infra | 17:07 | |
| *** jsavak has quit IRC | 17:08 | |
| *** hdd has joined #openstack-infra | 17:08 | |
| krotscheck | jeblair: Alright, I'll come back afte rlunch | 17:10 |
| clarkb | pabelanger: were you going to go ahead and clean out those alien instances? | 17:10 |
| *** thorst_ has joined #openstack-infra | 17:11 | |
| *** mixos has quit IRC | 17:11 | |
| pabelanger | clarkb: Yup, I have been. But we seem to be leaking / cleaning up alien-images via nodepool already | 17:11 |
| jeblair | #status log created afs02.dfw.openstack.org fileserver | 17:11 |
| openstackstatus | jeblair: finished logging | 17:12 |
| clarkb | pabelanger: just images right? or instances too? | 17:12 |
| jeblair | that is in production now ^ | 17:12 |
| pabelanger | clarkb: sorry, that was nodes. I can check images now | 17:12 |
| clarkb | pabelanger: images we leak and don't effectively clean up due to glance and swift funzies | 17:12 |
| clarkb | I actually meant to check in on how shade's work to address that is going | 17:12 |
| *** esikachev has quit IRC | 17:13 | |
| *** e0ne has joined #openstack-infra | 17:13 | |
| clarkb | mordred: ^ you don't happen to know off the top of your head if the glance delete after failed upload and swift cleanup after successful upload stuff has made it into a shade release do you? | 17:13 |
| pabelanger | clarkb: Hmm, looks like something is not happy: http://paste.openstack.org/show/496598/ | 17:14 |
| mordred | clarkb: I think it should have | 17:14 |
| *** shashank_hegde has joined #openstack-infra | 17:14 | |
| mordred | clarkb: ut I could also be wrong | 17:14 |
| clarkb | pabelanger: I think that is probably due to shade managing images now. Likely the name changed orsomething similar to that | 17:14 |
| pabelanger | clarkb: okay, let me see if I can hunt it down | 17:14 |
| *** ddieterly is now known as ddieterly[away] | 17:15 | |
| *** thorst_ has quit IRC | 17:15 | |
| clarkb | pabelanger: you can probably just openstack image list --limit 50000 and filter by hand pretty quickly against each cloud | 17:15 |
| clarkb | but fixing nodepool too would be good | 17:15 |
| *** amrith is now known as _amrith_ | 17:16 | |
| *** thorst_ has joined #openstack-infra | 17:16 | |
| morgan | clarkb: I'll look at the deal with turning on the thing in the tests and see what explodes. | 17:16 |
| pabelanger | Ya, let me get the image-upload patch working again, then I'll dive into nodepool | 17:16 |
| *** _amrith_ is now known as amrith | 17:16 | |
| *** nwkarsten has joined #openstack-infra | 17:16 | |
| pabelanger | clarkb: mind helping 289520 too? | 17:18 |
| pabelanger | s/too/land too/ | 17:18 |
| *** hdd has quit IRC | 17:19 | |
| *** hdd_ has joined #openstack-infra | 17:19 | |
| clarkb | pabelanger: sure, let me catch up on whether or not shade has addressed the major image leak issues then will review that one | 17:19 |
| jeblair | fungi: pypi vos release status? | 17:20 |
| jeblair | fungi: vldb says it's complete... | 17:20 |
| fungi | jeblair: looks like it just finished at 296m47.870s | 17:20 |
| fungi | should i fire another now to see if it's faster/no-op? | 17:21 |
| *** nwkarsten has quit IRC | 17:21 | |
| jeblair | fungi: nah | 17:21 |
| fungi | k | 17:21 |
| *** jistr has quit IRC | 17:21 | |
| jeblair | fungi: i think we decided yesterday to move mirrors to dfw only; i'm ready to do that now unless anyone has objections | 17:21 |
| fungi | presumably we can switch back to serving the read-only volume now? | 17:21 |
| *** shashank_hegde has quit IRC | 17:21 | |
| fungi | oh! yes, please! ;) | 17:21 |
| clarkb | mordred: pabelanger looks like the shade image leak fixes went in april 10th and shade had a release a week ago | 17:22 |
| clarkb | so we should be good there | 17:22 |
| pabelanger | I haven't seen any new FIPs over the last few days. | 17:22 |
| pabelanger | unless somebody else has been manually deleting them | 17:22 |
| clarkb | pabelanger: I think mordred has been cleaning them out periodically | 17:22 |
| mordred | pabelanger: I have cleaned once yesterday | 17:23 |
| mordred | but it's slow | 17:23 |
| pabelanger | Ya | 17:23 |
| *** jamesmca_ has joined #openstack-infra | 17:23 | |
| clarkb | pabelanger: but also looks like we can't attach fips in osic? which would reduce our consumption which would reduce leaks | 17:23 |
| mordred | so I'm confident that the cleaner will take care of us otver time | 17:23 |
| mordred | clarkb: aroo? | 17:23 |
| anteaya | mordred: the cleaner? | 17:23 |
| pabelanger | clarkb: Ya, I've seen an increase in exceptions because of that in OSIC | 17:23 |
| *** thorst_ has quit IRC | 17:23 | |
| openstackgerrit | Armando Migliaccio proposed openstack-infra/project-config: Make grenade-dsvm-neutron-multinode voting https://review.openstack.org/299843 | 17:23 |
| clarkb | mordred: pabelanger pasted some logs earlier today showing that osic fips are all broken. Timeout during attach | 17:23 |
| openstackgerrit | Armando Migliaccio proposed openstack-infra/project-config: Add failure rate graphs for grenade jobs to Neutron Grafana dashboard https://review.openstack.org/314689 | 17:23 |
| * anteaya picutres Jean Reno | 17:24 | |
| jeblair | fungi, krotscheck, mordred: i have deleted the ord replicas of pypi and npm; and created dfw2 replicas; i will kick off vos releases of those now | 17:24 |
| fungi | thanks, jeblair! | 17:24 |
| mordred | jeblair: woot! | 17:25 |
| fungi | curious to see how fast the vos release runs this time ;) | 17:25 |
| *** daemontool_ has quit IRC | 17:25 | |
| pabelanger | clarkb: grafana looks a little better currently for OSIC: http://grafana.openstack.org/dashboard/db/nodepool-osic?panelId=17&fullscreen | 17:25 |
| mordred | pabelanger: can you re-point me to the paste? | 17:25 |
| fungi | jeblair: this is going to be a full replica push of the volume, right? | 17:25 |
| jeblair | fungi: yeah, we should be able to directly compare it to the 3524 minute release to get a full replication time | 17:25 |
| fungi | so i guess we'll find out what our throughput is for large copies | 17:26 |
| fungi | our new throughput, rather | 17:26 |
| clarkb | pabelanger: mordred looking at https://review.openstack.org/#/c/289520/9/modules/openstack_project/files/mirror/centos-mirror-update.sh do yum repos have an index file requring sync to happen first then deletes after? | 17:26 |
| clarkb | if we just straight up delete could that be racey? | 17:26 |
| mordred | clarkb: pabelanger and I went through the delete cases a bunch yesterday | 17:26 |
| clarkb | and its fine? | 17:27 |
| mordred | clarkb: it turns out the upstream is not purging files aggressively like debian repos do | 17:27 |
| clarkb | neat | 17:27 |
| mordred | yah. it's the better choice | 17:27 |
| clarkb | pabelanger: other question is your k5start command has a 30 minute timeout, will the resync succeed in that period of time or are we just going to let it run and fail and run and fail until its done? | 17:27 |
| pabelanger | mordred: let me fine it | 17:28 |
| clarkb | oh and we only need the amd64 packages | 17:28 |
| clarkb | this appears to grab all of centos7? | 17:28 |
| mgagne | has logs been moved away from static.o.o to a different server or is the RRD counter wrapping? http://cacti.openstack.org/cacti/graph.php?action=view&local_graph_id=717&rra_id=all | 17:28 |
| pabelanger | mordred: clarkb: actually, I don't think I pasted anything related to OSIC today. | 17:29 |
| anteaya | mgagne: thanks for mentioning that | 17:29 |
| clarkb | oh huh i386 seems to have gone away in 7, that was a 6 thing | 17:29 |
| anteaya | mgagne: I think I noticed that the other day but then got distracted before I could get anyone's attention | 17:29 |
| mgagne | cool | 17:30 |
| *** e0ne has quit IRC | 17:30 | |
| *** thorst_ has joined #openstack-infra | 17:30 | |
| mgagne | so I guess it's a known issue, not that logs got moved | 17:30 |
| mgagne | same with tar and doc mount point | 17:30 |
| pabelanger | clarkb: in my testings, I didn't have an issue using the --delete flag. But we can change it in a follow up patch for sure | 17:30 |
| anteaya | mgagne: well I know about it | 17:30 |
| clarkb | pabelanger: 16:32:24 pabelanger | clarkb: yup: OpenStackCloudTimeout: Timeout waiting for the floating IP to be attached. | 17:30 |
| anteaya | mgagne: however me knowing about it doesn't get it fixed | 17:30 |
| pabelanger | clarkb: Ya, there is only x86_64 now | 17:30 |
| pabelanger | clarkb: thanks | 17:30 |
| mgagne | knowledge is power :D | 17:30 |
| anteaya | mgagne: we need to keep mentioning it until someone with root access takes a look | 17:30 |
| anteaya | mgagne: well part of it anyway | 17:31 |
| anteaya | permissions closes the loop of power :) | 17:31 |
| anteaya | I don't know why it isn't reporting to cacti any more | 17:31 |
| anteaya | but as far as I know it should be | 17:31 |
| *** mrmartin has joined #openstack-infra | 17:32 | |
| zxiiro | electrofelix: I know we said that 1.5 would have been the last 1.x release but if there's a patch I really need to get in and released would it be possible to get a 1.5.1 or 1.6.0? | 17:32 |
| *** sambetts is now known as sambetts|afk | 17:33 | |
| *** thorst_ has quit IRC | 17:34 | |
| clarkb | pabelanger: I have +2'd the centos mirror change but not approved it. Left a couple non critical comments too. Will let you approve when you are ready to watch it | 17:34 |
| *** asselin_ has joined #openstack-infra | 17:35 | |
| *** ddecapit has quit IRC | 17:36 | |
| SpamapS | is there a known issue with oslo.cache 1.7.0 ? | 17:37 |
| pabelanger | clarkb: sure, I have a follow up patch going to address the unused variable | 17:38 |
| jeblair | clarkb, fungi, mordred: hrm. iftop says we're not going any faster to afs02.dfw. | 17:38 |
| mordred | jeblair: oh! | 17:39 |
| mordred | jeblair: that is surprising to me | 17:39 |
| jeblair | me too | 17:39 |
| openstackgerrit | Paul Belanger proposed openstack-infra/nodepool: Group DIB uploads by image name https://review.openstack.org/314231 | 17:39 |
| electrofelix | zxiiro: 1.5.1 shouldn't be a problem, was there a bug hit? | 17:39 |
| anteaya | mgagne: looks like we aren't getting anyone's attention today either | 17:39 |
| anteaya | mgagne: let's try to remember to mention it another day if we can | 17:40 |
| zxiiro | electrofelix: no there's a plugin that I might need supported, still evaluating my options but I'll let you know. | 17:40 |
| electrofelix | Any reason you couldn't use HEAD once it lands? Not as if the 2.0 will break any job definitions? | 17:40 |
| smarcet | fungi: its seems that tarballs for openstackid is not getting updated http://tarballs.openstack.org/openstackid/?C=M;O=D | 17:41 |
| smarcet | not sure why | 17:41 |
| *** shardy has quit IRC | 17:41 | |
| zxiiro | electrofelix: We prefer to install from releases when possible because that's the version we recommend our devs pull for our sandbox. | 17:41 |
| clarkb | mgagne: anteaya logs have not moved as far as I know, but we did lose the volumes backing that filesystem not too long ago | 17:42 |
| clarkb | we may just need to bounce the snmpd | 17:42 |
| fungi | smarcet: http://status.openstack.org/zuul/ shows there's an openstackid commit with a tarball job queued for the past 47 minutes waiting for a worker | 17:42 |
| smarcet | oh ok thx | 17:43 |
| *** thorst_ has joined #openstack-infra | 17:43 | |
| anteaya | clarkb: I wondered if that was it, needed it attend to the snmpd | 17:43 |
| anteaya | clarkb: might you have time for that, or not today? | 17:43 |
| fungi | smarcet: this is one of the shortcomings i mentioned with the current "deploy from tarball" mechanism, that could possibly be avoided if we deployed from a git checkout instead | 17:43 |
| *** mriedem1 has joined #openstack-infra | 17:43 | |
| clarkb | anteaya: mgagne I can restart the daemon shortly | 17:43 |
| *** mriedem has quit IRC | 17:43 | |
| anteaya | clarkb: thanks so much | 17:43 |
| anteaya | mgagne: thanks for mentioning it! | 17:44 |
| fungi | smarcet: specifically that it takes a little time for branch tarballs to get generated and published | 17:44 |
| smarcet | fungi: got it , thx for the info :) | 17:44 |
| *** ddecapit has joined #openstack-infra | 17:44 | |
| *** nwkarsten has joined #openstack-infra | 17:44 | |
| fungi | smarcet: release tarballs go a lot quicker because we use a prioritized pipeline for those, but branch tarballs get a much lower priority | 17:44 |
| *** nwkarsten has quit IRC | 17:44 | |
| *** nwkarsten has joined #openstack-infra | 17:45 | |
| clarkb | anteaya mgagne daemon is restarted poll interval is 5 minutes iirc so should see content in about 5 minutes or less if that was the fix | 17:45 |
| *** keedya has joined #openstack-infra | 17:46 | |
| mgagne | cool =) | 17:46 |
| *** thorst_ has quit IRC | 17:47 | |
| anteaya | clarkb: thanks so much | 17:48 |
| *** shashank_hegde has joined #openstack-infra | 17:48 | |
| openstackgerrit | Merged openstack-infra/system-config: Initial commit for CentOS AFS mirror https://review.openstack.org/289520 | 17:48 |
| electrofelix | zxiiro: I wonder if you could add a custom entry point to tell JJB to pick up the plugin? | 17:48 |
| *** lucasagomes is now known as lucas-afk | 17:49 | |
| electrofelix | Seems like we should have an answer to this generally | 17:49 |
| *** asettle has joined #openstack-infra | 17:49 | |
| clarkb | tdurakov: there are xenial 2-node instances available now, you should be able to run your job on xenial by check experimentalling | 17:50 |
| jeblair | clarkb, fungi, mordred: more data: i applied some sysctl changes to increase udp kernel buffers; this did not speed up the replication in progress. i then started a replication of mirror.npm, and the overall throughput jumped to 200-300Mbps | 17:50 |
| *** asettle has quit IRC | 17:50 | |
| fungi | weird | 17:50 |
| zxiiro | electrofelix: maybe, but I think it's easier for us to release more often. Actually I'd like to see quicker release cycles for simple changes like adding support for a new plugin or bug fixes. | 17:50 |
| pabelanger | clarkb: ya, so for some reason, our list for label / providers is what we have setup in nodepool.yaml: http://logs.openstack.org/31/314231/11/check/nodepool-coverage-db/fc84d3d/console.html#_2016-05-10_17_48_49_172 | 17:51 |
| pabelanger | clarkb: I need to dive deeper to find out why | 17:51 |
| fungi | jeblair: oh, it applied to a new replication but not the running one. not necessarily weird | 17:51 |
| clarkb | 200-300Mbps is the rough range of throughput I expected based on my napkin maths and shorter rtts | 17:51 |
| zxiiro | electrofelix: Would it be difficult with openstack-infra to release weekly automatically if there were patches in a stable branch? | 17:51 |
| fungi | jeblair: so presumably we were incurring a lot more round-trip delays due to tiny buffers? | 17:51 |
| jeblair | clarkb, fungi: yeah, do you think that the changes may not have affected the existing one? (i mean, this is udp, so i don't know if that makes as much sense as with tcp) | 17:51 |
| pabelanger | clarkb: I'd expect the debug output to be sorted correctly per: https://review.openstack.org/#/c/314231/11/nodepool/tests/fixtures/node_dib_upload_ordering.yaml | 17:52 |
| *** thiagop has quit IRC | 17:52 | |
| *** markus_z has quit IRC | 17:52 | |
| fungi | jeblair: what were the sysctl changes? | 17:52 |
| zxiiro | electrofelix: I think a cool workflow would be, we merge stuff into master, cherry-pick them to stable/1.x a weekly job checks if anything's changed in stable branch and produces a release. | 17:52 |
| tdurakov | 17:53 | |
| jeblair | fungi: http://paste.openstack.org/show/496601/ | 17:53 |
| clarkb | pabelanger: huh, possible the conversion to the internal config is losing the order (though I was fairly sure it wouldn't) | 17:53 |
| *** fitoduarte has joined #openstack-infra | 17:53 | |
| *** tosky has quit IRC | 17:53 | |
| clarkb | pabelanger: oh! labels is a dict in config gah | 17:53 |
| pabelanger | clarkb: Ya, I think that might be happening. | 17:53 |
| *** mixos has joined #openstack-infra | 17:54 | |
| clarkb | pabelanger: so even though we iterate and add in order we lose all that info in the dict | 17:54 |
| clarkb | pabelanger: so we can either sort like you had or change that to an ordered dict | 17:54 |
| pabelanger | clarkb: what you prefer? | 17:54 |
| *** andymaier_ has quit IRC | 17:55 | |
| clarkb | pabelanger: I like chosing datastructures that provide the necessary info rather than slapping it ad hoc on top. My preferrence would be to use ordered dict | 17:55 |
| tdurakov | clarkb: thank you, triggered experimental on https://review.openstack.org/#/c/287997/18 | 17:55 |
| *** lucas-afk is now known as lucasagomes | 17:55 | |
| clarkb | pabelanger: you'll need to update the l.providers = {} line to use OrderedDict as well | 17:55 |
| *** mrmartin has quit IRC | 17:55 | |
| *** abregman has joined #openstack-infra | 17:55 | |
| pabelanger | clarkb: okay, let me get a patch up to fix that rebase a top of it | 17:55 |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: Add timestamps to postci log https://review.openstack.org/314468 | 17:56 |
| jeblair | pabelanger, clarkb: what problem are we solving? | 17:56 |
| fungi | jeblair: best guess is that those only apply on new sockets and that afs is creating a dedicated datagram socket for the transfer traffic. i'd need to do a lot more research though, and currently trying to finish getting my summit summary pushed to the ml before our weekly meeting | 17:57 |
| clarkb | jeblair: right now we iterate by provider to upload images whihc means we slam each provider's glance with a bunch of uploads all at once | 17:57 |
| *** lucasagomes is now known as lucas-dinner | 17:57 | |
| clarkb | jeblair: the idea is to switch to uplodaing by label so that we distribute the cost across all the providers and more closely update the images for a lable across all providers | 17:57 |
| *** Sukhdev_ has joined #openstack-infra | 17:57 | |
| *** Na3iL has quit IRC | 17:58 | |
| clarkb | jeblair: as part of testing that checking order of uploads is important which implies some sort of sorting | 17:58 |
| clarkb | pabelanger: I also just realized I think there is a bug where if we use the same image in multiple labels we will upload it twice | 17:58 |
| jeblair | clarkb: do we wait for all images to complete building before uploading? | 17:58 |
| *** shashank_hegde has quit IRC | 17:58 | |
| clarkb | jeblair: we do | 17:58 |
| jeblair | do we do that on purpose? | 17:59 |
| clarkb | jeblair: no, I think we can also update that as well | 17:59 |
| jeblair | i'm wondering if we thought to do that based on the idea that we wanted to make the switch globally and quickly | 17:59 |
| *** vilobhmm11 has quit IRC | 17:59 | |
| jeblair | but quickly clearly isn't happening | 17:59 |
| electrofelix | zxiiro: technically we could probably release head as 1.6 since the 2.0 changes haven't started to land yet | 17:59 |
| mgagne | clarkb: restarting snmp fixed it. thanks | 17:59 |
| *** ddecapit has quit IRC | 18:00 | |
| electrofelix | might be useful to have a more regular release cadence | 18:00 |
| clarkb | jeblair: switch? | 18:00 |
| *** Sukhdev has quit IRC | 18:00 | |
| jeblair | so maybe we should just upload as they complete, then we would naturally get image uploads clustered by image, and not at once | 18:00 |
| *** madhu_ak has joined #openstack-infra | 18:00 | |
| jeblair | clarkb: switch == start using newly uploaded images | 18:00 |
| clarkb | jeblair: that would cover half of the issue yes, the other half is check for missing images | 18:00 |
| zxiiro | electrofelix: sounds good. I'll ping you once I figure out if / what I need from my end. | 18:00 |
| clarkb | actually check for missing images may upload as they complete already? I owuld have to double check that | 18:01 |
| electrofelix | zxiiro: though I'm mildly concerned that we're edging closer to porting new functionality to what should be a stable branch taking critical bug fixes only..? | 18:01 |
| electrofelix | assuming new plugin support counts as new functionality | 18:01 |
| *** ddecapit has joined #openstack-infra | 18:02 | |
| *** Sukhdev_ has quit IRC | 18:02 | |
| zxiiro | electrofelix: In my opinion adding support for new plugins isn't as risky as changing JJB internals. But technically it is a new feature. | 18:02 |
| *** thorst_ has joined #openstack-infra | 18:02 | |
| clarkb | jeblair: I do think the current change is much simpler though, and worth considering | 18:03 |
| *** pvaneck has joined #openstack-infra | 18:03 | |
| clarkb | jeblair: just to address this quickly, then we can worry about doing it as builds complete | 18:03 |
| *** e0ne has joined #openstack-infra | 18:03 | |
| zxiiro | electrofelix: I feel like adding more plugins support is not risky (unless it's changing an existing supported plugin and it's behaviour) and is always welcome as it expands the usability of JJB | 18:03 |
| openstackgerrit | James E. Blair proposed openstack-infra/puppet-openafs: Increase memory available to network stack on fileservers https://review.openstack.org/314707 | 18:03 |
| zxiiro | I guess we'd have to be cautious of what we're introducing | 18:03 |
| jeblair | clarkb: oh ok, i thought maybe the other way would be simpler (maybe just move some code around) while this seemed like it was adding a bunch of code that we might just remove if we do the other thing | 18:04 |
| jeblair | clarkb: but maybe i don't have my head wrapped around it yet... | 18:04 |
| electrofelix | zxiiro: yeah, they're not the worse | 18:04 |
| *** kzaitsev_mb has joined #openstack-infra | 18:04 | |
| jeblair | clarkb, fungi: sysctls -> puppet in https://review.openstack.org/314707 | 18:04 |
| clarkb | check for missing disk images will do it as they are built | 18:04 |
| electrofelix | just trying to think about slippery slope :p | 18:05 |
| *** lennyb_ has joined #openstack-infra | 18:05 | |
| clarkb | jeblair: the just move some code around method would be synchronous though | 18:05 |
| clarkb | jeblair: so we wouldn't build the next dib until the previous one had finished uploading everywhere | 18:05 |
| electrofelix | zxiiro: been meaning to discuss automated release notifications with the openstack-release team, could include this and see whether there are any fundamental issues with it? | 18:05 |
| *** lennyb_ has quit IRC | 18:05 | |
| clarkb | jeblair: at least in current system clouds like osic and bluebox and internap would update relatively quickly I think | 18:06 |
| openstackgerrit | Emilien Macchi proposed openstack-infra/project-config: zuul/layout: update tripleo jobs for Puppet CI https://review.openstack.org/314708 | 18:06 |
| jeblair | clarkb, fungi: so unfortunately, as experiments go, this one is flawed. we will *not* be able to compare the release of the pypi mirror; we could compare the release of the npm mirror, but we have no control value for that. :| we could repeat this for the pypi mirror again when it's finished. | 18:06 |
| clarkb | (still limited by total number of upload threads though) | 18:06 |
| *** afaranha has joined #openstack-infra | 18:06 | |
| zxiiro | electrofelix: +1, sounds reasonable to me. | 18:06 |
| *** rajinir has quit IRC | 18:06 | |
| *** chuck__ has joined #openstack-infra | 18:06 | |
| fungi | jeblair: perhaps we could abort that vos release and then do a -force? | 18:06 |
| fungi | mighth be tempting fate though | 18:07 |
| afaranha | Hey, Did you guys had this problem recently when running ./stack.sh? | 18:07 |
| afaranha | 2016-05-10 17:56:40.337 | 2016-05-10T17:56:40Z|00001|reconnect|WARN|unix:/var/run/openvswitch/db.sock: connection attempt failed (Permission denied) 2016-05-10 17:56:40.337 | ovs-vsctl: unix:/var/run/openvswitch/db.sock: database connection failed (Permission denied) | 18:07 |
| pabelanger | jeblair: clarkb: back now, yes here is the patch in question: https://review.openstack.org/#/c/314231 figured this was the easiest patch forward, but happy to switch gears if we think uploads right after each build is good too | 18:07 |
| *** nadya_ has joined #openstack-infra | 18:07 | |
| *** zul has quit IRC | 18:07 | |
| afaranha | http://paste.openstack.org/show/496602/ | 18:07 |
| *** tonytan4ever has joined #openstack-infra | 18:07 | |
| *** chuck__ is now known as zul | 18:07 | |
| jeblair | clarkb, pabelanger: is "slamming" glance really a problem? | 18:07 |
| *** bdemers_ has joined #openstack-infra | 18:08 | |
| *** jiggalator has joined #openstack-infra | 18:08 | |
| clarkb | jeblair: in the case of some of the clouds I think so | 18:08 |
| *** bdemers has quit IRC | 18:08 | |
| * jeblair is continuously amazed that any time we try to do more than one thing at once, we destroy openstack clouds | 18:08 | |
| clarkb | jeblair: uploads to rax swift are ridiculously slow for example and other clouds like ovh have a 50% fail rate | 18:08 |
| *** nadya has quit IRC | 18:09 | |
| *** mriedem1 is now known as mriedem | 18:09 | |
| clarkb | it can take 2 hours for a single upload to rax swift | 18:09 |
| *** lennyb_ has joined #openstack-infra | 18:09 | |
| clarkb | and we run 4 at the same time all fighting for that pipe | 18:10 |
| jeblair | clarkb: if we don't upload more than one thing at a time, is it better? | 18:10 |
| clarkb | jeblair: yes when I have done manual uploads outside the normal update loop rax in particular performs much better | 18:10 |
| clarkb | ovh fail rate is still high and I haven't done enough iterations there to see if fail rate goes down | 18:10 |
| *** netsin has quit IRC | 18:11 | |
| pabelanger | so, maybe we should land 294339 first to see how the providers react. Either to more or less upload workers | 18:11 |
| clarkb | on further reading we are already async on the image upload calls so ya if we rewrite waitForBuiltImages() to dispatch uploads as they build we should be good | 18:11 |
| *** rbrndt has quit IRC | 18:12 | |
| jeblair | clarkb: yeah, i just looked at the code and came to the same conclusion | 18:12 |
| *** mrmartin has joined #openstack-infra | 18:13 | |
| *** rbrndt has joined #openstack-infra | 18:13 | |
| *** rcernin has quit IRC | 18:13 | |
| *** lennyb_ has quit IRC | 18:14 | |
| openstackgerrit | James E. Blair proposed openstack-infra/puppet-openafs: Increase memory available to network stack on fileservers https://review.openstack.org/314707 | 18:14 |
| jeblair | now with the right kind of quotations marks <sigh> | 18:14 |
| jeblair | that's what i get for following the module *documentation* | 18:15 |
| *** ddieterly[away] has quit IRC | 18:15 | |
| *** kzaitsev_mb has quit IRC | 18:16 | |
| *** electrofelix has quit IRC | 18:19 | |
| *** abregman has quit IRC | 18:19 | |
| *** abregman has joined #openstack-infra | 18:20 | |
| timothyb89 | pabelanger: thanks for comments on https://review.openstack.org/#/c/311815/ - what should be done to remove stackviz from only ubuntu-precise? | 18:20 |
| *** lennyb_ has joined #openstack-infra | 18:20 | |
| *** lennyb_ has quit IRC | 18:21 | |
| *** mixos has quit IRC | 18:23 | |
| lennyb | anteaya: I totally agree with you regarding removing the meeting mentioned above. | 18:25 |
| anteaya | lennyb: thanks | 18:25 |
| anteaya | lennyb: and I'm sorry I didn't wake up to my alarm this morning | 18:25 |
| anteaya | lennyb: I apologize | 18:25 |
| *** nwkarsten has quit IRC | 18:26 | |
| pabelanger | timothyb89: one option is to remove stackviz from the devstack element and then add stackviz to nodepool.yaml (minus ubuntu-precise). | 18:26 |
| clarkb | jeblair: re sysctl settings, we don't expect those to help cross region do we? | 18:27 |
| pabelanger | jeblair: do you have a moment to check my pts listentries for the centos-mirror service. I followed the docs, but noticed there is a different in my naming schema | 18:27 |
| lennyb | anteaya: np, i am aware of your timezone :) | 18:27 |
| openstackgerrit | James E. Blair proposed openstack-infra/puppet-openafs: Increase memory available to network stack on fileservers https://review.openstack.org/314707 | 18:27 |
| timothyb89 | pabelanger: okay, makes sense, thanks! | 18:27 |
| anteaya | lennyb: :) | 18:27 |
| *** cdent has quit IRC | 18:28 | |
| jeblair | clarkb: they were already in place on the existing fileservers (i wasn't really sure if they were having an effect, so had not committed them to puppet) | 18:29 |
| *** dtardivel has quit IRC | 18:29 | |
| jeblair | [and i think i did that pre-production] | 18:29 |
| clarkb | jeblair: gotcha | 18:29 |
| *** ddecapit has quit IRC | 18:30 | |
| anteaya | lennyb: http://lists.openstack.org/pipermail/openstack-dev/2016-May/094537.html | 18:32 |
| *** baoli_ has quit IRC | 18:32 | |
| *** Daisy has joined #openstack-infra | 18:32 | |
| *** nwkarsten has joined #openstack-infra | 18:32 | |
| *** nwkarsten has quit IRC | 18:32 | |
| *** HeOS has quit IRC | 18:32 | |
| pabelanger | jeblair: okay, I have fixed my issue. Looks like documentation has some typos, will update | 18:32 |
| *** nwkarsten has joined #openstack-infra | 18:33 | |
| openstackgerrit | Merged openstack/requirements: Updated from generate-constraints https://review.openstack.org/314423 | 18:33 |
| *** ddecapit has joined #openstack-infra | 18:33 | |
| openstackgerrit | Merged openstack/requirements: Add kingbird to the list of projects https://review.openstack.org/280295 | 18:33 |
| *** gyee has joined #openstack-infra | 18:34 | |
| *** hdd_ has quit IRC | 18:34 | |
| *** esikachev has joined #openstack-infra | 18:35 | |
| *** dtantsur is now known as dtantsur|afk | 18:36 | |
| *** Daisy has quit IRC | 18:36 | |
| *** ddieterly has joined #openstack-infra | 18:37 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/system-config: Fix typo with pts commands for service user https://review.openstack.org/314715 | 18:37 |
| pabelanger | jeblair: what I needed to do ^ | 18:37 |
| *** mixos has joined #openstack-infra | 18:37 | |
| clarkb | jeblair: I posted a couple questions about those settings | 18:37 |
| *** esikachev has quit IRC | 18:39 | |
| fungi | i think network in parts of ord is probably just broken... http://logs.openstack.org/69/309569/5/gate/gate-horizon-npm-run-test/a3b9787/console.html#_2016-05-10_17_18_09_853 | 18:40 |
| openstackgerrit | Tim Buckley proposed openstack-infra/project-config: Create stackviz element and script in nodepool https://review.openstack.org/311815 | 18:40 |
| fungi | the error there is misleading of course since we're still using ipv4, so no idea what the exact ipv4 failure was before it decided to try ipv6 | 18:41 |
| *** jamesmca_ has quit IRC | 18:41 | |
| lifeless | dims: so yeah, line 63 of that etherpad (at least it was line 63 yesterday :)) | 18:41 |
| *** mriedem has quit IRC | 18:42 | |
| *** mriedem has joined #openstack-infra | 18:42 | |
| dims | :) lifeless | 18:42 |
| *** nwkarsten has quit IRC | 18:42 | |
| *** nwkarsten has joined #openstack-infra | 18:42 | |
| *** hdd has joined #openstack-infra | 18:42 | |
| *** rcernin has joined #openstack-infra | 18:43 | |
| notmyname | infra meeting is in 15 minutes in -meeting, right? | 18:45 |
| *** mestery has quit IRC | 18:45 | |
| openstackgerrit | Doug Hellmann proposed openstack/requirements: update the review instructions for new lib releases https://review.openstack.org/314105 | 18:45 |
| pleia2 | notmyname: yep | 18:45 |
| notmyname | thanks | 18:45 |
| openstackgerrit | Tim Buckley proposed openstack-infra/project-config: Create stackviz element and script in nodepool https://review.openstack.org/311815 | 18:46 |
| *** mestery has joined #openstack-infra | 18:47 | |
| *** jcoufal has quit IRC | 18:47 | |
| *** thorst_ has quit IRC | 18:48 | |
| anteaya | fungi: can you add this to your stack of things to take a peek at: https://review.openstack.org/#/c/310048/7 | 18:48 |
| anteaya | keystone is discussing changing their project naming requirements for specs | 18:48 |
| *** thiagop has joined #openstack-infra | 18:48 | |
| anteaya | sorry their spec for project naming requirements | 18:49 |
| *** thorst_ has joined #openstack-infra | 18:49 | |
| *** hashar has joined #openstack-infra | 18:49 | |
| fungi | anteaya: ooh, what impact are you concerned about there? | 18:49 |
| fungi | i'm not super familiar with keystone's name filters for tenants/projects | 18:50 |
| *** sdake has quit IRC | 18:52 | |
| *** jamesmca_ has joined #openstack-infra | 18:52 | |
| *** rockyg has joined #openstack-infra | 18:53 | |
| *** rajinir has joined #openstack-infra | 18:53 | |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/infra-manual: Document "bindep test" usage https://review.openstack.org/314574 | 18:53 |
| *** asselin has quit IRC | 18:53 | |
| openstackgerrit | Thiago da Silva proposed openstack-infra/project-config: Migrating liberasurecode and pyeclib projects https://review.openstack.org/314724 | 18:54 |
| mnaser | fungi: i'm going to be at -meeting again for the topic of infrastructure for the control plane again, if you want to add that to the agenda (or i can bring it up at the end) | 18:54 |
| anteaya | fungi: me either | 18:55 |
| anteaya | fungi: I'm uncertain of the impact but wanted to make sure noone else thought it was of concern | 18:55 |
| jeblair | pabelanger: ayep, sorry :) | 18:55 |
| anteaya | mnaser: hello | 18:55 |
| mnaser | hi anteaya ! | 18:55 |
| anteaya | mnaser: we keep talking about talking about it | 18:56 |
| anteaya | but so far haven't had a chance to talk about it | 18:56 |
| *** hdd has quit IRC | 18:56 | |
| mnaser | this channel is too active, my buffer can only handle so much :) i figured popping in at the meeting time would be the best time | 18:56 |
| anteaya | you mean #openstack-meeting is not too active? | 18:57 |
| *** hdd has joined #openstack-infra | 18:57 | |
| jeblair | clarkb: i agree with your comments | 18:57 |
| *** thorst_ has quit IRC | 18:57 | |
| openstackgerrit | Thiago da Silva proposed openstack-infra/project-config: Migrating liberasurecode and pyeclib projects https://review.openstack.org/314724 | 18:57 |
| jhesketh | Morning | 18:57 |
| jeblair | clarkb: it's likely that "make some things bigger" doesn't mean the same thing it did in the past :) | 18:57 |
| anteaya | mnaser: and we have channel logs at eavesdrop.openstack.org if you ever want to read backscroll | 18:57 |
| anteaya | jhesketh: morning | 18:57 |
| *** piet has quit IRC | 18:58 | |
| mnaser | oh no, i meant that -infra moves a lot and i cant keep up with it | 18:58 |
| mnaser | we've been busy making big changes in our infrastructure | 18:58 |
| *** hdd has quit IRC | 18:58 | |
| openstackgerrit | James E. Blair proposed openstack-infra/puppet-openafs: Increase memory available to network stack on fileservers https://review.openstack.org/314707 | 18:58 |
| anteaya | mnaser: oh yes, we do | 18:58 |
| anteaya | mnaser: yay | 18:58 |
| anteaya | mnaser: congratulations | 18:58 |
| *** esker has joined #openstack-infra | 18:59 | |
| mnaser | thanks, as we move on now, we'll probably be an annoying provider that doesn't require but prefers raw images, however, deployment times are cut down to seconds and ability to live migrate for a) maintenance and b) distributing workloads | 18:59 |
| mnaser | which will resolve the whole problem we had about noisy neighbour and bump our num_servers back up! | 18:59 |
| anteaya | yay! | 18:59 |
| anteaya | yay! | 18:59 |
| AJaeger | fungi, pabelanger: lifeless and clarkb just discussed in #openstack-swift the other-requirements.txt file. Please read http://eavesdrop.openstack.org/irclogs/%23openstack-swift/latest.log.html#t2016-05-10T18:40:36 - and let's continue discussing after the infra meeting. | 18:59 |
| anteaya | can't wait to get a test instance up on your cloud | 19:00 |
| anteaya | mnaser: are you ready for us again yet? | 19:00 |
| clarkb | tdurakov: http://logs.openstack.org/97/287997/18/experimental/gate-tempest-dsvm-multinode-live-migration/10b6384/console.html failed but it did run on xenial | 19:00 |
| mnaser | i wouldn't say yet, but it's close | 19:00 |
| anteaya | mnaser: great, let us know | 19:00 |
| kevinbenton | (sorry to barge in. looking for one more infra core to merge a change to stabilize heat's grenade job: https://review.openstack.org/#/c/313806/) | 19:00 |
| anteaya | kevinbenton: hey there | 19:00 |
| kevinbenton | anteaya: hey | 19:01 |
| AJaeger | tdasilva: please read http://docs.openstack.org/infra/manual/creators.html and follow it. Your change has no ACLs defined and zuul/layout.yaml is only for one of the two repos... | 19:01 |
| anteaya | kevinbenton: infra meeting just started, stand by | 19:01 |
| kevinbenton | anteaya: sorry about bugging in the channel for a review. this issue has been causing grenade failures quite frequently for heat so i thought i would help try to get it nudge along | 19:02 |
| kevinbenton | anteaya: thanks | 19:02 |
| anteaya | no worries | 19:02 |
| *** salv-orl_ has joined #openstack-infra | 19:02 | |
| *** xyang1 has joined #openstack-infra | 19:02 | |
| anteaya | morgan: when you have a chance can you expain to me the significance of https://review.openstack.org/#/c/310048/7 | 19:02 |
| morgan | anteaya: in the scope of V3 Keystone API, in a given domain all project names are unique | 19:03 |
| morgan | anteaya: with hierarchies, the goal is to make the names only unique within it's parent | 19:03 |
| *** thorst_ has joined #openstack-infra | 19:03 | |
| morgan | since domains are no longer flat parents to all pojects under them | 19:03 |
| morgan | anteaya: domain.project.pproject2.prokject3 | 19:03 |
| morgan | anteaya: in theory domain.projecta.prjecta.projecta should be fine | 19:04 |
| morgan | anteaya: however, V3 keystone says "project names are unique within their domain" even in the case of hierarchies. | 19:04 |
| *** hdd has joined #openstack-infra | 19:04 | |
| anteaya | ah so who would be deciding on the names? | 19:04 |
| morgan | the same person as today, whoeever creates the project | 19:04 |
| *** salv-orlando has quit IRC | 19:05 | |
| mriedem | clarkb: fungi: any idea if elasticrecheck is dead? i haven't seen it commenting on anything in awhile. | 19:05 |
| morgan | the difference is you can't create a duplicated name project in a given domain today. so that spec proposes relaxing the restriction | 19:05 |
| morgan | it just violates our API contract | 19:05 |
| fungi | mriedem: i just saw it comment on something a few minutes ago | 19:05 |
| anteaya | morgan: ah thank you | 19:05 |
| morgan | anteaya: happy to explain | 19:06 |
| anteaya | I appreciate it | 19:06 |
| mriedem | oo i see es cluster health is back to green | 19:06 |
| anteaya | green \o/ | 19:07 |
| clarkb | mriedem: yup pabelanger anteaya and I upgraded the cluster to a newer version which supposedly fixes the bugs that were preventing us from going green | 19:07 |
| *** hdd has quit IRC | 19:07 | |
| *** thorst_ has quit IRC | 19:08 | |
| openstackgerrit | Merged openstack-infra/system-config: Fix typo with pts commands for service user https://review.openstack.org/314715 | 19:08 |
| clarkb | we seem to be indexing just fine | 19:08 |
| clarkb | no logs about running out of memory for timestamps | 19:08 |
| *** hdd has joined #openstack-infra | 19:08 | |
| clarkb | if there are any problems with e-r I think they are e-r side not in elasticsearch | 19:08 |
| SpamapS | Hi, I need a pbr expert... | 19:09 |
| *** nwkarsten has quit IRC | 19:09 | |
| *** thorst_ has joined #openstack-infra | 19:09 | |
| krotscheck | jeblair: It's been about two hours, could you check the screen in mirror_update? | 19:09 |
| SpamapS | http://paste.openstack.org/show/496608/ | 19:10 |
| SpamapS | /opt/stack/keystone is a git repository | 19:10 |
| *** janonymous_ has joined #openstack-infra | 19:11 | |
| *** hdd has quit IRC | 19:11 | |
| openstackgerrit | Thiago da Silva proposed openstack-infra/project-config: Migrating liberasurecode and pyeclib projects https://review.openstack.org/314724 | 19:12 |
| *** pcaruana has quit IRC | 19:12 | |
| *** piet has joined #openstack-infra | 19:13 | |
| *** nwkarste_ has joined #openstack-infra | 19:14 | |
| tdasilva | AJaeger: thanks, had forgot to run 'git add' to add acls, and the reason for zuul.layout.yaml to only contain one of the projects is because only one of them is a python project. my understanding is that we can only run python jobs in zuul, is that correct? | 19:14 |
| *** hdd has joined #openstack-infra | 19:14 | |
| *** thorst_ has quit IRC | 19:14 | |
| AJaeger | tdasilva: it's not correct. | 19:15 |
| AJaeger | tdasilva: you cannot merge any change without an entry in zuul/layout.yaml | 19:15 |
| AJaeger | you can use noop jobs... | 19:15 |
| *** jamesmca_ has quit IRC | 19:15 | |
| *** thorst_ has joined #openstack-infra | 19:15 | |
| tdasilva | AJaeger: got it, thanks! will update | 19:16 |
| *** jamesmca_ has joined #openstack-infra | 19:16 | |
| *** amrith is now known as _amrith_ | 19:16 | |
| *** jamesmca_ has quit IRC | 19:19 | |
| SpamapS | mordred: did you see my pbr traceback? | 19:19 |
| *** thorst_ has quit IRC | 19:20 | |
| *** jsavak has joined #openstack-infra | 19:20 | |
| *** thorst_ has joined #openstack-infra | 19:22 | |
| *** thorst_ has quit IRC | 19:23 | |
| *** thorst_ has joined #openstack-infra | 19:23 | |
| *** vkramskikh_ has joined #openstack-infra | 19:23 | |
| *** jamesmca_ has joined #openstack-infra | 19:25 | |
| *** julim has quit IRC | 19:26 | |
| *** esikachev has joined #openstack-infra | 19:27 | |
| *** thorst_ has quit IRC | 19:30 | |
| *** thorst_ has joined #openstack-infra | 19:30 | |
| mordred | SpamapS: /opt/stack/keystone is a git repo, yeah? | 19:31 |
| mordred | SpamapS: I think I remember this being an issue or something | 19:31 |
| mordred | or having seen this before | 19:31 |
| mordred | lifeless: ^^ | 19:31 |
| mtreinish | mordred: that does look familiar, but I can't remember from exactly where either | 19:33 |
| mordred | mtreinish: I'm hoping lifeless has the remember brain today | 19:33 |
| SpamapS | Yeah it's a git repo | 19:34 |
| SpamapS | describe works on it | 19:34 |
| *** abregman has quit IRC | 19:34 | |
| *** ddecapit has quit IRC | 19:34 | |
| clarkb | is it a shallow clone? | 19:34 |
| *** denisra has joined #openstack-infra | 19:35 | |
| mordred | SpamapS: also, what version is pip | 19:35 |
| *** abregman has joined #openstack-infra | 19:35 | |
| *** thorst_ has quit IRC | 19:36 | |
| *** abregman has quit IRC | 19:36 | |
| *** IlyaG has joined #openstack-infra | 19:37 | |
| *** ddecapit has joined #openstack-infra | 19:37 | |
| *** thorst_ has joined #openstack-infra | 19:37 | |
| *** jamesmca_ has quit IRC | 19:37 | |
| anteaya | mriedem: I'm thinking maybe you can just expand your email footer a bit | 19:37 |
| anteaya | mriedem: get off my lawn | 19:37 |
| anteaya | mriedem: put a shirt on | 19:37 |
| anteaya | mriedem: nova has decided foo | 19:38 |
| *** oanson has quit IRC | 19:38 | |
| openstackgerrit | Thiago da Silva proposed openstack-infra/project-config: Migrating liberasurecode and pyeclib projects https://review.openstack.org/314724 | 19:39 |
| nwkarste_ | i'm having an issue getting a new jenkins job queued with zuul. i get an "invalid project" failure. i can queue other jobs and this new one is listed in "zuul-server -t". does anyone know what i should check next? | 19:39 |
| anteaya | nwkarste_: is this problem with your system or with our system? | 19:39 |
| mriedem | anteaya: i'm pretty sure get off my lawn is (c) by dansmith | 19:40 |
| *** abregman has joined #openstack-infra | 19:40 | |
| nwkarste_ | anteaya: my system | 19:40 |
| anteaya | mriedem: fair enough, but I'm sure there are other 80 year old man sayings out there | 19:40 |
| mriedem | i'll think about them when i take a nap with my afghan on the davenport | 19:41 |
| SpamapS | mordred: pip is 8.1.1 | 19:41 |
| anteaya | nwkarste_: okay so be sure to tell us that you are asking about your system not ours in future | 19:41 |
| anteaya | mriedem: ha ha ha | 19:41 |
| anteaya | mriedem: thank you | 19:41 |
| SpamapS | mordred: virtualenv is 15.0.1 | 19:41 |
| openstackgerrit | Thiago da Silva proposed openstack-infra/project-config: Migrating liberasurecode and pyeclib projects https://review.openstack.org/314724 | 19:41 |
| anteaya | nwkarste_: so if you can share some of your logs in a paste service I think that would be the next step | 19:41 |
| *** IlyaG has quit IRC | 19:41 | |
| *** thorst_ has quit IRC | 19:42 | |
| nwkarste_ | anteaya: http://paste.openstack.org/show/496615/ this is what i get when i try to kick of the job | 19:43 |
| mordred | dstufft: any chance you remember what's up with Spamap paste here? | 19:44 |
| anteaya | nwkarste_: Invalid project: uat-rally-full-daily/dal | 19:44 |
| dansmith | mriedem: I will sell you a per-use license | 19:44 |
| openstackgerrit | Merged openstack-infra/infra-specs: Mark Translation spec as finished https://review.openstack.org/305426 | 19:44 |
| anteaya | nwkarste_: zuul doesn't recognize that project | 19:44 |
| anteaya | nwkarste_: can you paste the contents of the file where that project is defined for zuul? | 19:44 |
| anteaya | dansmith: you are so generous | 19:45 |
| dstufft | mordred: looks like an error from an earlier version of pip with pbr | 19:45 |
| mordred | dstufft: he's on 8.1.1 | 19:45 |
| dansmith | anteaya: it won't be cheap, so, not really. | 19:46 |
| anteaya | dansmith: ha ha ha | 19:46 |
| nwkarste_ | anteaya: http://paste.openstack.org/show/496617/ this is the layout.yaml file | 19:47 |
| anteaya | nwkarste_: that is a lot of pipelines, have you gotten zuul to run successfully in the past? | 19:49 |
| jeblair | krotscheck: it seems to still be running; it is idle now, but was most recently active 2 minutes ago | 19:49 |
| dstufft | mordred: yea, I mean it looks like one that we fixed I think, which means either it's a pbr problem or there was another way to trigger it that I'm unaware of :] | 19:49 |
| krotscheck | jeblair: THat's... not encouraging. | 19:49 |
| * krotscheck thought that patch worked. | 19:49 | |
| jeblair | krotscheck: it just came back to life... | 19:49 |
| nwkarste_ | anteaya: yes, and zuul can run successfully for other jobs in the rally pipeline as well. it is just the uat-rally-full-daily that isn't working | 19:50 |
| jeblair | krotscheck: 1094795/1097870 | 19:50 |
| jeblair | is that still the same high number? | 19:50 |
| krotscheck | No, it's a larger high number | 19:50 |
| krotscheck | 0.03% of the module | 19:50 |
| krotscheck | *mirror | 19:50 |
| *** hdd has quit IRC | 19:51 | |
| *** rcernin has quit IRC | 19:51 | |
| *** piet has quit IRC | 19:51 | |
| lifeless | mordred: context? | 19:51 |
| *** daemontool_ has joined #openstack-infra | 19:51 | |
| mordred | lifeless: http://paste.openstack.org/show/496608/ | 19:51 |
| mordred | lifeless: SpamapS hit that - has pip 8.1.1 installed | 19:52 |
| SpamapS | ugh | 19:52 |
| anteaya | nwkarste_: I'd look deeper into that pipeline then | 19:52 |
| SpamapS | and now on a fresh run through, it passed | 19:52 |
| anteaya | nwkarste_: that seems to be the difference | 19:52 |
| *** hdd has joined #openstack-infra | 19:53 | |
| *** baumann has joined #openstack-infra | 19:53 | |
| *** e0ne has quit IRC | 19:53 | |
| *** tongli has quit IRC | 19:53 | |
| *** jamesmca_ has joined #openstack-infra | 19:53 | |
| openstackgerrit | Matt Riedemann proposed openstack-infra/devstack-gate: DNM: test gate-tempest-dsvm-neutron-lvm-full config https://review.openstack.org/314744 | 19:53 |
| openstackgerrit | Matt Riedemann proposed openstack-infra/devstack-gate: DNM: test gate-tempest-dsvm-neutron-lvm-full config https://review.openstack.org/314744 | 19:57 |
| lifeless | mordred: well for starters you don't have pbr globally installed so ez-install has kicked in | 19:57 |
| *** nwkarste_ has quit IRC | 19:57 | |
| lifeless | mordred: secondly, see the /tmp/pip-jw91qN-build bit - pip has made an isolated build dir, and did that by copying I suspect. I thought we'd backed that out, but perhaps not? Try with latest pip ? | 19:58 |
| pleia2 | here's to never knowing where your phone is \o/ | 19:58 |
| mordred | SpamapS: it's possible you had old pip, then something upgraded it, so your latest run was with appropriate pip | 19:59 |
| *** rcernin has joined #openstack-infra | 19:59 | |
| *** annegentle has joined #openstack-infra | 19:59 | |
| *** janonymous_ has quit IRC | 19:59 | |
| anteaya | pleia2: yay | 19:59 |
| *** afaranha has quit IRC | 20:00 | |
| openstackgerrit | Matt Riedemann proposed openstack-infra/devstack-gate: DNM: test gate-tempest-dsvm-neutron-lvm-full config https://review.openstack.org/314744 | 20:02 |
| *** ddieterly is now known as ddieterly[away] | 20:02 | |
| SpamapS | mordred: it was not an old pip | 20:03 |
| SpamapS | Collecting setuptools\n Downloading setuptools-21.0.0-py2.py3-none-any.whl (509kB)\nCollecting wheel\n Downloading wheel-0.29.0-py2.py3-none-any.whl (66kB)\nInstalling collected packages: pip, setuptools, wheel\nSuccessfully installed pip-8.1.1 setuptools-21.0.0 wheel-0.29.0", "warnings": []} | 20:03 |
| mordred | SpamapS: and that was in a previous task? | 20:04 |
| mordred | weird | 20:04 |
| SpamapS | that was the one that failed yes | 20:04 |
| *** nwkarsten has joined #openstack-infra | 20:04 | |
| AJaeger | fungi, pabelanger: lifeless and clarkb discussed in #openstack-swift the other-requirements.txt file. Please read http://eavesdrop.openstack.org/irclogs/%23openstack-swift/latest.log.html#t2016-05-10T18:40:36 . I don't really care which profiles to use and which not, just want it documented and consistent. | 20:05 |
| *** javeriak_ has quit IRC | 20:05 | |
| AJaeger | somebody else should make a decision on this whether to use test profile or not... | 20:05 |
| jeblair | krotscheck: the high number seems to be increasing before the low number reaches it | 20:05 |
| *** dprince has quit IRC | 20:05 | |
| *** daemontool_ has quit IRC | 20:06 | |
| SpamapS | mordred: I'm going to blame caching | 20:06 |
| krotscheck | jeblair: That's unsurprising. Packages are being published as we try to mirror them. | 20:06 |
| krotscheck | But it's not optimal that the package ends up in a permanent state of catchup. | 20:06 |
| * AJaeger signs off now | 20:07 | |
| mordred | SpamapS: it's a good thing to blame | 20:07 |
| jeblair | krotscheck: so i wonder if we're still in the initial run and we're just approaching the end like achilles | 20:07 |
| *** esikachev has quit IRC | 20:07 | |
| anteaya | night AJaeger | 20:07 |
| fungi | AJaeger: i suppose if projects that don't want to differentiate their testing dependency packages (assuming they have any to begin with) from their runtime dependencies, then as long as bindep installs default profile packages when we ask it to install test profile packages everyone wins? | 20:07 |
| krotscheck | jeblair: Options A: See if I can snapshot the upstream sequence and keep it in memory, and exit when the current sequence matches that one. | 20:08 |
| fungi | night AJaeger! | 20:08 |
| SpamapS | though it was failing for about 12 hours | 20:08 |
| krotscheck | jeblair: Option B: Limit the total number of sequences we permit before exiting. | 20:08 |
| pabelanger | AJaeger: Right, I always thought it would work as clarkb was describing. | 20:08 |
| krotscheck | jeblair: Maybe both? | 20:08 |
| *** ddecapit has quit IRC | 20:08 | |
| *** akshai has quit IRC | 20:08 | |
| jeblair | krotscheck: A is probably best. i'm also okay with waiting a bit longer to see how bad this is in practice. | 20:09 |
| *** nwkarsten has quit IRC | 20:09 | |
| pabelanger | AJaeger: additionally, I'd rather see multi OS support first, then dealing with different test / runtime environments. But that is just me | 20:09 |
| jeblair | krotscheck: (i believe A is like bandersnatch) | 20:09 |
| mordred | SpamapS: the problem was that lifeless had not yet responded | 20:09 |
| mordred | SpamapS: so it's a lifelessheisenbug | 20:09 |
| krotscheck | jeblair: I... do not trust the javascript community to not suddenly burst-deploy in a way that prevents the script from catching up during US working hours. | 20:09 |
| SpamapS | mordred: naturally | 20:10 |
| jeblair | krotscheck: i think B could put us in a state where we get permanently further behind if things are bad | 20:10 |
| jeblair | 2016-05-10T20:10:06.364Z static [info] [1097139/1097938] done processing 281 versions of actor-sdk in 2 minutes, 6 seconds | 20:11 |
| jeblair | 2016-05-10T20:10:28.905Z static [info] latest sequence undefined | 20:11 |
| *** _amrith_ is now known as amrith | 20:11 | |
| jeblair | krotscheck: ^ it is idle now | 20:11 |
| EmilienM | I don't understand why can't I see propose-puppet-openstack-constraints in http://logs.openstack.org/periodic/ | 20:11 |
| krotscheck | jeblair: Ok, let me dig. | 20:12 |
| *** Goneri has quit IRC | 20:12 | |
| *** nwkarsten has joined #openstack-infra | 20:12 | |
| EmilienM | ok I figured | 20:13 |
| jeblair | krotscheck: it woke up again: http://paste.openstack.org/show/496620/ | 20:14 |
| jeblair | (and it's sticking with NaN as the second number now) | 20:14 |
| krotscheck | jeblair: That's very odd. | 20:14 |
| openstackgerrit | Emilien Macchi proposed openstack-infra/project-config: puppet: add missing proposal job in JJB https://review.openstack.org/314751 | 20:14 |
| EmilienM | I noticed project-config CI could let jobs in zuul that are not in JJB | 20:15 |
| *** abregman is now known as abregman|afk | 20:15 | |
| jeblair | EmilienM: if so, it's a bug in the layout test job | 20:15 |
| EmilienM | yeah, I'm looking at the script now | 20:16 |
| AJaeger | fungi, yes, "bindep test" installs packages without any profile plus the test packages. Still, question is what we document and recommend... | 20:16 |
| AJaeger | now, really good night ;) | 20:16 |
| krotscheck | jeblair: looks like the index sequence check against the registry timed out, therefore reutrned undef. | 20:16 |
| jeblair | krotscheck: i don't know whether to be happy or sad that it didn't let a little thing like that get in its way :) | 20:18 |
| EmilienM | jeblair: I think layout-checks.py and run-layout.sh scripts test the opposite: make sure JJB jobs are in the zuul layout | 20:19 |
| krotscheck | jeblair: It's built on a package called "Follow" that advertises itself as "We follow a couchdb and never fail". | 20:19 |
| mordred | fungi: heya - so - it's project naming time again | 20:19 |
| EmilienM | jeblair: but in my case, I forgot to add the job in JJB but added it in Zuul, and CI did not complain | 20:19 |
| jeblair | 2016-05-10T20:18:29.674Z static [info] Update complete. | 20:19 |
| jeblair | root@mirror-update:~# | 20:19 |
| jeblair | krotscheck: ^ | 20:19 |
| mordred | fungi: it's you I come to for the individual membership electorate, right? | 20:19 |
| krotscheck | WOOT | 20:19 |
| krotscheck | That's my output message | 20:20 |
| jeblair | EmilienM: run-layout.sh is supposed to fail if a job is referenced in zuul but not defined by jjb | 20:20 |
| jeblair | krotscheck: want me to run again? | 20:20 |
| krotscheck | jeblair: Yeah, for safety's sake. | 20:20 |
| jeblair | running | 20:20 |
| jeblair | 1097991/1098001 | 20:20 |
| jeblair | 2016-05-10T20:21:01.958Z static [info] Update complete. | 20:21 |
| jeblair | krotscheck: that's looking happy | 20:21 |
| krotscheck | That's looking very happy. | 20:21 |
| krotscheck | Could be that we're good? | 20:21 |
| jeblair | ya | 20:21 |
| krotscheck | Okay, cool! | 20:21 |
| fungi | mordred: heh, i think you've asked lsell for it in the past? that's stuff housed in the foundation member database so i've not been the one pulling that list | 20:21 |
| krotscheck | jeblair: Ok, next step is to clear the sequence file and start over. | 20:22 |
| mordred | fungi: nod | 20:22 |
| krotscheck | ;) | 20:22 |
| fungi | mordred: though i can ask others to provide it, sure | 20:22 |
| jeblair | krotscheck: okiedokie | 20:22 |
| krotscheck | jeblair: To make sure all packages that have bad versions get their versions updated. | 20:22 |
| jeblair | krotscheck: you mentioned the steps in a change comment iirc | 20:22 |
| jeblair | krotscheck: https://review.openstack.org/308669 ? | 20:23 |
| krotscheck | jeblair: registry-static --clean -d localhost -o /afs/.openstack.org/mirror/npm --blobstore afs-blob-store --hooks openstack-registry-hooks | 20:23 |
| *** kgiusti has quit IRC | 20:23 | |
| EmilienM | jeblair: /me investigating but see https://review.openstack.org/#/c/301375/ (nothing in jenkins/jobs/projects.yaml) | 20:23 |
| *** ddieterly[away] is now known as ddieterly | 20:24 | |
| jeblair | 2016-05-10T20:23:39.212Z static [info] Deleting /tmp/registry-static.seq | 20:24 |
| jeblair | 2016-05-10T20:23:39.220Z static [warn] finished cleaning in 0.007 seconds | 20:24 |
| jeblair | 2016-05-10T20:23:39.475Z static [info] latest sequence 1098012 | 20:24 |
| jeblair | krotscheck: and it's chugging through that | 20:24 |
| krotscheck | Starting from zero? | 20:24 |
| jeblair | krotscheck: yep | 20:24 |
| krotscheck | Cool. This one should go faster. | 20:24 |
| krotscheck | Because no tarballs. | 20:24 |
| jeblair | *nod* | 20:24 |
| krotscheck | Alright, I'll come back tomorrow to see where we're at :) | 20:25 |
| anteaya | kevinbenton: why is sahara code changing in this patch? https://review.openstack.org/#/c/313806/2 | 20:25 |
| jeblair | krotscheck: before you leave... | 20:25 |
| krotscheck | Yes? | 20:25 |
| jeblair | krotscheck: you had a second command in the change comment -- is that necessary, or is this now doing what that command would do? | 20:25 |
| *** nwkarsten has quit IRC | 20:26 | |
| kevinbenton | anteaya: it's the only other one using vpnaas in a grenade job. this bug affects any projects using vpnaas | 20:26 |
| *** abitha has quit IRC | 20:26 | |
| anteaya | kevinbenton: thank you /me looks again | 20:26 |
| *** nwkarsten has joined #openstack-infra | 20:26 | |
| krotscheck | jeblair: Ya know, maybe? I was under the impression that passing the --clean flag would be a single-run clean of the sequence file, with a clean exit. | 20:26 |
| jeblair | EmilienM: which job was missing? | 20:26 |
| EmilienM | jeblair: propose-puppet-openstack-constraints | 20:26 |
| EmilienM | maybe it makes sense, propose-puppet-openstack-constraints job was created in JJB, but not part of job-group | 20:27 |
| EmilienM | so nothing to complain | 20:27 |
| krotscheck | But if it's actually chugging through the new changes, I'd check /tmp/registry-static.seq to see if it's getting updated. | 20:27 |
| *** keedya has quit IRC | 20:27 | |
| jeblair | krotscheck: yeah, that's what i thought, but it looks like it's doing clean then, um, make dirty again. | 20:27 |
| krotscheck | dirty dirty javascript | 20:27 |
| jeblair | krotscheck: yes, that is increasing with the numbers it's outputting | 20:27 |
| krotscheck | Oh good. | 20:27 |
| krotscheck | Yeah, I think we're safe. | 20:27 |
| jeblair | krotscheck: cool; see you tomorrow :) | 20:27 |
| krotscheck | Indeedy | 20:28 |
| krotscheck | EmilienM: I almost have bandwidth for gem mirrors! | 20:28 |
| EmilienM | krotscheck: omg omg omg | 20:28 |
| jeblair | EmilienM: the check doesn't do anything special -- it should only succeed if jjb actually instantiates the job | 20:28 |
| pabelanger | clarkb: lets land the bare-precise removal today! I think we can land https://review.openstack.org/#/c/313630/ now, since builds are already in progress | 20:28 |
| jeblair | EmilienM: (so if you define a template but do not instantiate it, it should still fail) | 20:28 |
| EmilienM | jeblair: cool, so nothing critical | 20:28 |
| EmilienM | I'll look that | 20:29 |
| EmilienM | krotscheck: let me know if you need help on the mirror | 20:29 |
| krotscheck | EmilienM: Roger wilco. | 20:29 |
| clarkb | pabelanger: done | 20:29 |
| krotscheck | EmilienM: The big question I have is, how will we make it save into an AFS-sane folder structure. | 20:29 |
| *** mrmartin has quit IRC | 20:29 | |
| *** nwkarsten has quit IRC | 20:31 | |
| dansmith | anteaya: fungi: I should have been more obvious with my rhetorical question.. clearly they're registering ubuntu accounts to spam us. I'm just surprised it's worth that effort (although it clearly is) | 20:31 |
| anteaya | it is | 20:32 |
| dansmith | anteaya: fungi I decided not to say it, but maybe I should have: would it be possible/better to gate new editors on whether they have done their gerrit contributor thing? a higher and maybe more obscure bar? | 20:32 |
| anteaya | the longer bit which I didn't have the strength to type at the time is the search engine effects | 20:32 |
| *** thorst_ has joined #openstack-infra | 20:32 | |
| anteaya | after they spam us, uploading a pdf several times in several places | 20:32 |
| anteaya | the wiki has it in its storage | 20:32 |
| anteaya | deleting it doens't register as deleted to the search engines | 20:33 |
| anteaya | you need to purge to get rid of it | 20:33 |
| fungi | dansmith: actually, the primary remaining use cases for the wiki are from groups within the community who don't use gerrit/git at all | 20:33 |
| anteaya | we can't purge since that would also remove any real content they messed with earlier | 20:33 |
| anteaya | so the search engines still index the spam | 20:33 |
| anteaya | I deleted pdfs for a week and a half then stopped | 20:33 |
| anteaya | since I realized I couldn't tell if I was making progress or not | 20:34 |
| anteaya | as all the pdfs I was deleting were probably already deleted | 20:34 |
| dansmith | fungi: I'm not sure I really agree with that, being a person from a group that uses git/gerrit a lot, and still has a desire for a wiki | 20:34 |
| *** hashar has quit IRC | 20:34 | |
| anteaya | but kept showing up as they were not purged | 20:34 |
| fungi | dansmith: so yes, the wiki (or something like it) having much tighter controls over who can edit and create and delete and move pages would likely help. the question is whether it makes sense to continue being a wiki if we're much more tightly constraining the people who can publish on it | 20:34 |
| *** jpr has quit IRC | 20:35 | |
| dansmith | fungi: anyone within the openstack contributor base? | 20:35 |
| dansmith | that's a lot of people | 20:35 |
| fungi | dansmith: i should rephrase. much of the frightened pushback so far to the (mistaken) impression we're getting rid of the wiki any time soon is from people who are worried we'll make them learn git/gerrit | 20:35 |
| openstackgerrit | Merged openstack-infra/project-config: Use neutron-vpnaas grenade plugin in grenade jobs https://review.openstack.org/313806 | 20:36 |
| EmilienM | krotscheck: I don't understand the question, I'm sorry | 20:36 |
| dansmith | fungi: heh | 20:36 |
| nibalizer | fungi: i was under the impression the wiki is going away | 20:36 |
| *** baoli has joined #openstack-infra | 20:36 | |
| fungi | nibalizer: that was only if we could find suitable alternative publication options for the stakeholders | 20:36 |
| EmilienM | jeblair: what happenned is that I missed to add the job in the project jobs (in jenkins/jobs/projects.yaml, see https://review.openstack.org/314751 ) and it didn't fail. | 20:37 |
| EmilienM | nibalizer: update about puppet/wiki: we almost finished our migration, everything is on docs.o.o or almost | 20:37 |
| jeblair | EmilienM: yeah, that should have failed | 20:38 |
| jeblair | EmilienM: oh wait | 20:38 |
| fungi | nibalizer: so depending on your definition of "going away," it may be that we get to a place where there are some parts of the community not served by an alternate solution and yet we still can't find sufficient parties interested in helping us maintain the wiki, and so those people go off and run their own wiki or publish somewhere else | 20:38 |
| jeblair | EmilienM: no, you defined the job | 20:38 |
| EmilienM | jeblair: https://review.openstack.org/#/c/301375/ | 20:38 |
| EmilienM | yeah | 20:38 |
| EmilienM | the job was created but not part of any project, I don't think that's critical | 20:38 |
| jeblair | EmilienM: why do you think you need 314751? | 20:38 |
| EmilienM | jeblair: because job never ran | 20:39 |
| EmilienM | 16:11:59 EmilienM | I don't understand why can't I see propose-puppet-openstack-constraints in http://logs.openstack.org/periodic/ | 20:39 |
| jeblair | EmilienM: ah let's back up then :) | 20:39 |
| *** kraynevs has joined #openstack-infra | 20:39 | |
| jeblair | EmilienM: that job has no log publishers | 20:40 |
| openstackgerrit | Steve Martinelli proposed openstack/requirements: DO NOT REVIEW https://review.openstack.org/314764 | 20:40 |
| kraynevs | anteya: hi. could you please re-review patch https://review.openstack.org/#/c/309383/ ? | 20:40 |
| jeblair | EmilienM: see my post-hoc review on https://review.openstack.org/301375 | 20:41 |
| *** sridhar_ram1 has joined #openstack-infra | 20:41 | |
| *** baoli has quit IRC | 20:41 | |
| EmilienM | jeblair: ok I'm adding it. But still, job should have run and submit a patch to our repo | 20:41 |
| openstackgerrit | Paul Belanger proposed openstack-infra/system-config: Fixes needed for centos-mirror-update https://review.openstack.org/314766 | 20:41 |
| *** baoli has joined #openstack-infra | 20:42 | |
| *** ccamacho has quit IRC | 20:42 | |
| *** sridhar_ram has quit IRC | 20:42 | |
| pabelanger | clarkb: fixes need to run rsync on mirror-update, plus your previous comments. | 20:42 |
| EmilienM | jeblair: some constraints had new releases, the script should have proposed a patch | 20:42 |
| pabelanger | Also, http://mirror.dfw.rax.openstack.org/centos/7/ now exists | 20:42 |
| EmilienM | jeblair: but without logs, it's hard to figure. /me add publisher | 20:42 |
| pabelanger | step 1 complete | 20:42 |
| anteaya | kraynevs: that name is very nondescriptive to me I'll look more after the tc meeting | 20:42 |
| kraynevs | anteaya: hi. could you please re-review patch https://review.openstack.org/#/c/309383/ ? | 20:43 |
| openstackgerrit | Merged openstack-infra/project-config: Disable bare-precise in nodepool https://review.openstack.org/313630 | 20:43 |
| jeblair | EmilienM: yeah, I'm assuming it ran and failed | 20:43 |
| *** kraynevs has quit IRC | 20:43 | |
| jeblair | (or at least failed to do what you want) | 20:44 |
| openstackgerrit | Emilien Macchi proposed openstack-infra/project-config: puppet/proposal: add missing publishers https://review.openstack.org/314751 | 20:44 |
| EmilienM | jeblair: ^ | 20:44 |
| smarcet | fungi: sorry to bother u, but tarballs on openstackid didnt updated yet http://tarballs.openstack.org/openstackid/?C=M;O=D | 20:45 |
| *** nadya_ has quit IRC | 20:45 | |
| *** nadya has joined #openstack-infra | 20:45 | |
| jeblair | EmilienM: lgtm | 20:45 |
| EmilienM | jeblair: thx for help | 20:46 |
| clarkb | pabelanger: I am sad that -a doesn't work | 20:46 |
| *** bpokorny_ has joined #openstack-infra | 20:46 | |
| pabelanger | clarkb: Ya, I am not sure if it is root that is the issue, or afs | 20:46 |
| clarkb | pabelanger: we are dropping -g and -o based on my diffing on man page and script is that right? | 20:47 |
| clarkb | pabelanger: those make sense since we don't share users with the other mirrors | 20:47 |
| pabelanger | jeblair: now that i have the initial import of mirror.centos, should I add it to afs02.dfw.o.o? | 20:47 |
| jeblair | smarcet: here is the failure: http://logs.openstack.org/a8/a842c9c0e732a06e6ed2bb23313eaf80f7ad2911/post/openstackid-release-branch/3182b1b/console.html | 20:47 |
| fungi | smarcet: it looks like rackspace's ord region network issues bit us on that job http://logs.openstack.org/a8/a842c9c0e732a06e6ed2bb23313eaf80f7ad2911/post/openstackid-release-branch/3182b1b/console.html | 20:47 |
| *** esker has quit IRC | 20:47 | |
| fungi | smarcet: i can reenque the jobs for that ref | 20:47 |
| pabelanger | clarkb: Correct, we drop -g and -o | 20:47 |
| EmilienM | krotscheck: what is your concern about AFS-dir structure for gems? | 20:47 |
| pabelanger | clarkb: plus -H | 20:47 |
| *** eharney has quit IRC | 20:47 | |
| jeblair | fungi: agree | 20:47 |
| smarcet | fungi: jeblair: oh ok | 20:48 |
| EmilienM | krotscheck: do you want me to rebase https://review.openstack.org/#/c/253616/ ? | 20:48 |
| jeblair | pabelanger: yep | 20:48 |
| *** baoli has quit IRC | 20:48 | |
| jeblair | pabelanger, clarkb: what means "-a" "-g" "-o" ? | 20:48 |
| jeblair | oh, rsync args? | 20:49 |
| clarkb | jeblair: rsync flags in https://review.openstack.org/#/c/314766/1 | 20:49 |
| pabelanger | jeblair: ya | 20:49 |
| jeblair | we can't use -a because we don't want -g and -o ? | 20:49 |
| clarkb | jeblair: correct | 20:49 |
| pabelanger | right | 20:49 |
| fungi | smarcet: it's back in the post pipeline now | 20:49 |
| clarkb | which makes senes since remote rsync server isn't going to have users that match ours | 20:49 |
| *** baoli has joined #openstack-infra | 20:49 | |
| jeblair | ya | 20:49 |
| jesusaur | you could use "-a --no-owner --no-group" | 20:50 |
| smarcet | fungi: thx man! | 20:50 |
| pabelanger | jesusaur: didn't think of that | 20:50 |
| *** bpokorny has quit IRC | 20:50 | |
| *** baoli has quit IRC | 20:50 | |
| *** nadya has quit IRC | 20:50 | |
| clarkb | I think it is fine to be explicit I just had to wrap my head around what we were changing | 20:50 |
| jeblair | pabelanger: what's the plan with REPO being a variable -- will we have centos7 and centos8 at once? | 20:50 |
| jeblair | pabelanger: (and will we update them from the same script?) | 20:51 |
| *** nadya has joined #openstack-infra | 20:51 | |
| *** lucas-dinner has quit IRC | 20:51 | |
| *** ddieterly is now known as ddieterly[away] | 20:52 | |
| pabelanger | jeblair: Ya, was thinking centos8 but not sure how far out that is. The next repo I'll likely mirror is epel, so maybe I an make it more generic in that way | 20:52 |
| *** baoli has joined #openstack-infra | 20:52 | |
| pabelanger | Added replication site afs02.dfw.openstack.org /vicepa for volume mirror.centos | 20:52 |
| pabelanger | jeblair: I'll hold off on vos release mirror.centos until you are ready | 20:53 |
| *** ccamacho has joined #openstack-infra | 20:54 | |
| * tellesnobrega is away: I'm busy | 20:55 | |
| anteaya | tellesnobrega: please disable your echo to the channel | 20:56 |
| clarkb | fungi: smarcet did the openstackid post jobs fail earlier? | 20:57 |
| clarkb | or are they just stuck behind low priority compared to check/gate? | 20:57 |
| fungi | clarkb: rax ord network failures | 20:57 |
| tellesnobrega | sorry guys, wrong server | 20:57 |
| fungi | clarkb: i reenqueued it | 20:57 |
| clarkb | fungi: gotcha, and thanks | 20:57 |
| fungi | clarkb: job failed to reach gerrit, and package mirrors | 20:57 |
| *** baoli has quit IRC | 20:57 | |
| fungi | ticket with rackspace is still open | 20:57 |
| *** lucasagomes has joined #openstack-infra | 20:58 | |
| * clarkb is waiting on that bugfix | 20:58 | |
| *** nwkarsten has joined #openstack-infra | 20:58 | |
| fungi | they updated it yesterday to say "hey, i know we haven't updated this in 10 days, but just wanted you to know we're still looking into it" | 20:58 |
| anteaya | that was kind of them | 20:58 |
| *** nwkarste_ has joined #openstack-infra | 20:59 | |
| *** vgridnev has joined #openstack-infra | 21:00 | |
| *** baoli has joined #openstack-infra | 21:00 | |
| jeblair | pabelanger: regarding release: go for it | 21:00 |
| pabelanger | jeblair: ack | 21:00 |
| *** nwkarst__ has joined #openstack-infra | 21:00 | |
| *** _ari_ has quit IRC | 21:01 | |
| *** baoli_ has joined #openstack-infra | 21:01 | |
| jeblair | pabelanger: i was mostly thinking that we need to keep the unit-of-mirroring in mind -- we should have one volume for each mirror that we separately update. if we update multiple releases together (eg ubuntu), the multiple releases can be on one volume. but if we update them separately, they should have multiple volumes. | 21:01 |
| clarkb | mordred: so homeworking on Go, how in the world do you garuntee any sort of dep availability if half of them are on github, half are on bitbucket and the rest are random internet | 21:02 |
| clarkb | mordred: do we just punt on that and say we accept the fail rate from that? | 21:02 |
| pabelanger | jeblair: sure, that works | 21:02 |
| morgan | clarkb: that is a bit scary :( | 21:02 |
| *** nwkars___ has joined #openstack-infra | 21:02 | |
| jeblair | pabelanger: but at any rate, if we have gotten it wrong for centos, we have a while before we have to deal with that for 8. :) | 21:02 |
| *** nwkarsten has quit IRC | 21:03 | |
| clarkb | one option is transparent proxy and force everyone to http | 21:03 |
| clarkb | then cache aggressively | 21:03 |
| *** aysyd has quit IRC | 21:03 | |
| pabelanger | jeblair: Ya, I was planning on moving epel to a separate volume for sure | 21:03 |
| openstackgerrit | Merged openstack-infra/system-config: Fixes needed for centos-mirror-update https://review.openstack.org/314766 | 21:03 |
| *** sridhar_ram1 has quit IRC | 21:04 | |
| jeblair | clarkb: another would be to create a mirror of random git repos | 21:04 |
| *** mixos has quit IRC | 21:04 | |
| clarkb | morgan: its a choice that the non npm js package manager has made too | 21:04 |
| *** nwkarste_ has quit IRC | 21:04 | |
| clarkb | morgan: basically don't centralize content hosting at all | 21:04 |
| morgan | clarkb: ugh.... | 21:04 |
| *** nwkarsten has joined #openstack-infra | 21:04 | |
| fungi | clarkb: rumors i've heard are that go-using shops download and archive all their build deps so they can reuse them without fear they'll disappear | 21:04 |
| *** baoli has quit IRC | 21:04 | |
| morgan | clarkb: doesn't make me happy though :( | 21:04 |
| jeblair | clarkb: and we could 'pull --ff-only' on them :) | 21:04 |
| clarkb | fungi: which is basically what jeblair describes | 21:04 |
| *** nwkarst__ has quit IRC | 21:05 | |
| *** mixos has joined #openstack-infra | 21:05 | |
| *** ddieterly[away] is now known as ddieterly | 21:05 | |
| jeblair | wow, i accidentally best-practiced. | 21:05 |
| fungi | basically, yes | 21:05 |
| clarkb | that wouldn't be too hard to add into our git mirrors | 21:05 |
| fungi | for some definition of "best" | 21:05 |
| jeblair | "best practice for go is to download all of your external dependency git repos into afs" | 21:05 |
| *** nwkarste_ has joined #openstack-infra | 21:06 | |
| fungi | hah | 21:06 |
| *** smarcet has quit IRC | 21:06 | |
| jeblair | i'm sure i saw that in a sidebar in networkworld | 21:06 |
| morgan | jeblair: lol | 21:06 |
| * fungi wonders if that magazine still exists | 21:06 | |
| *** nwkars___ has quit IRC | 21:06 | |
| clarkb | other things that come to mind we will want to address are how to handle installation of mixed lang projects | 21:06 |
| bkero | (mirrored to ftp.cdrom.com and ftp.tucows.com) | 21:06 |
| *** annegentle has quit IRC | 21:07 | |
| clarkb | pip install /path/to/swift may or may not be something we want to continue supporting | 21:07 |
| anteaya | kraynevs I don't understand the purpose of this repo: https://review.openstack.org/#/c/309383/ you mention jenkins and gerrit in the commit message | 21:07 |
| anteaya | why does murano need a repo that deals with jenkins and gerrit? | 21:07 |
| clarkb | anteaya: because murano is the install things project | 21:07 |
| *** annegentle has joined #openstack-infra | 21:07 | |
| *** sridhar_ram has joined #openstack-infra | 21:08 | |
| *** thorst_ has quit IRC | 21:08 | |
| anteaya | clarkb: do you understand what they are after? | 21:08 |
| *** jsavak has quit IRC | 21:08 | |
| clarkb | anteaya: ya its the murano project to deploy ci-cd | 21:08 |
| anteaya | murano deploys openstack services? I thought we had plenty of those already | 21:08 |
| clarkb | it deploys services on openstack | 21:08 |
| *** thorst_ has joined #openstack-infra | 21:09 | |
| anteaya | murano is now deploying infra tools? | 21:09 |
| openstackgerrit | Emilien Macchi proposed openstack-infra/system-config: Added Gem Mirror to Infra https://review.openstack.org/253616 | 21:09 |
| *** nwkarsten has quit IRC | 21:09 | |
| clarkb | they deploy anything aiui | 21:09 |
| *** psilvad has quit IRC | 21:09 | |
| EmilienM | krotscheck: rebased + adjusted, need review/feedback https://review.openstack.org/253616 | 21:09 |
| jeblair | anteaya: http://apps.openstack.org/#tab=murano-apps | 21:09 |
| clarkb | other Go things where we have gotten feet wet with python/js. Do we care how tests are executed? | 21:09 |
| clarkb | I think my only concern there is that it doesn't become a place where designate and swift do things differently, otherwise make a unittests job template for Go and go! | 21:10 |
| jeblair | clarkb: i assume there'd be a PTI for go | 21:11 |
| clarkb | that makes sense | 21:11 |
| nwkarste_ | anteaya: we were able to get the job to queue by restarting zuul. thanks for the help | 21:11 |
| openstackgerrit | Darragh Bailey proposed openstack-infra/jenkins-job-builder: Adding support for Manual Build Trigger https://review.openstack.org/202543 | 21:11 |
| openstackgerrit | Darragh Bailey proposed openstack-infra/jenkins-job-builder: Consolidate trigger-manual and trigger-parameterized-builds https://review.openstack.org/314108 | 21:11 |
| openstackgerrit | Emilien Macchi proposed openstack-infra/system-config: Added Gem Mirror to Infra https://review.openstack.org/253616 | 21:11 |
| anteaya | nwkarste_: glad you found the fix, thanks for sharing your progress | 21:11 |
| *** xyang1 has quit IRC | 21:12 | |
| clarkb | and `go` has a test subcommand | 21:12 |
| clarkb | so hopeflly that is a non contentious item. PTI is run go test in repo | 21:12 |
| clarkb | looks like it does and implicit compile too so doesn't need to get complicated hopefully | 21:13 |
| *** mixos has quit IRC | 21:14 | |
| *** ldnunes has quit IRC | 21:15 | |
| *** rockyg has quit IRC | 21:15 | |
| mordred | clarkb: my thinking on the dep thing | 21:16 |
| mordred | clarkb: was that we'd make openstack projects manage their deps with godep | 21:16 |
| mordred | and commit the manifest file from that tool to the repo | 21:16 |
| mordred | and make sure we use godep in all of our build/test commands | 21:16 |
| anteaya | kraynevs I still don't understand what murano does or why you need this repo, I'm the slow one of the bunch, I don't have a -1 on your patch you are going to have to find another reviewer that understands what you want | 21:17 |
| mordred | then, make a thing similar to our old partial pypi mirror that grabs the git repos of everything that are in the godep files and puts them somewhere | 21:17 |
| anteaya | sorry | 21:17 |
| clarkb | mordred: so not using go get? | 21:17 |
| *** thorst_ has quit IRC | 21:17 | |
| mordred | clarkb: so that we can $somethingsomething to make the gate jobs godep from our git repo mirrors instead of the internet | 21:17 |
| mordred | clarkb: no. we'd use godep | 21:17 |
| SpamapS | it's the same thing as upper constraints really | 21:17 |
| *** rhallisey has quit IRC | 21:17 | |
| mordred | clarkb: https://godoc.org/github.com/tools/godep | 21:18 |
| SpamapS | since go get is like "oh yay, NEW CRACK!" | 21:18 |
| clarkb | ah | 21:18 |
| mordred | pieces of work would be the mirror that consumes it | 21:18 |
| clarkb | so go get is the dep hell thing I was talking about | 21:18 |
| SpamapS | yep | 21:18 |
| clarkb | godep is the newer shiny that actually works? | 21:18 |
| *** matt-borland has quit IRC | 21:18 | |
| openstackgerrit | Matthew Treinish proposed openstack/os-testr: Add whitelist file to ostestr docs https://review.openstack.org/314775 | 21:18 |
| mordred | and something in the zuul cloner space that knows how to clone from our repos rather than the internet | 21:19 |
| mordred | clarkb: yah | 21:19 |
| mordred | clarkb: it's actuallya tool to help people vendor better | 21:19 |
| clarkb | mordred: we also need some way ot telling godep how to use a mirror | 21:19 |
| mordred | clarkb: but it has the sideeffect of doing what we want | 21:19 |
| mordred | clarkb: yah | 21:19 |
| mordred | clarkb: actually, we don't need to do that | 21:19 |
| mordred | clarkb: what we need is for $something to clone the git repos into known locations | 21:19 |
| mordred | godep puts its clone output into a known location in the source tree | 21:20 |
| mordred | so it would be trivial to make a tool that reads the godep manifest file, and then does the cloning | 21:20 |
| clarkb | mordred: ya but we have 9 regions that we will clone from | 21:20 |
| clarkb | potentially | 21:20 |
| mordred | right | 21:20 |
| clarkb | you don't want 10 godep files | 21:20 |
| mordred | just saying - we can make a region-aware ... | 21:20 |
| mordred | golly no | 21:20 |
| *** cbader has quit IRC | 21:20 | |
| mordred | the godep file in teh tree would point to actual internet sources | 21:20 |
| *** annegentle has quit IRC | 21:20 | |
| clarkb | oh I don't think we should make a different tool that reimplements godep | 21:20 |
| mordred | no. that's not what I'm saying | 21:21 |
| mordred | godep is a tool for describing what should be cloned in amanifest file, helping to maintain that over time, and also for cloning those things into a location and telling go about that location | 21:21 |
| *** cbader has joined #openstack-infra | 21:21 | |
| clarkb | right | 21:21 |
| mordred | what I'm saying is that sometimes we like to pre-clone things onto machines | 21:21 |
| clarkb | ah | 21:21 |
| mordred | and point things at repos that are already cloned | 21:22 |
| mordred | godep would be perfectly fine with the world if we pre-clone for it | 21:22 |
| mordred | we would still use godep in the build scripts | 21:22 |
| clarkb | and if it understands something else has splatted repos down | 21:22 |
| mordred | so that devs on their laptops could work and have stuff work normal | 21:22 |
| mordred | yah | 21:22 |
| mordred | all we need to do is be able to read a json file to figure out what it wants to clone | 21:22 |
| clarkb | which based on this wonderfully complete docs I would say it doesn't currently do | 21:22 |
| mordred | which is pretty easy | 21:22 |
| mordred | it does | 21:22 |
| clarkb | ok then the docs are terribly incomplete :) | 21:23 |
| mordred | it will happily not re-clone if you halready have the things | 21:23 |
| mordred | yeah | 21:23 |
| mordred | I leanred this by playing | 21:23 |
| *** yamahata has quit IRC | 21:23 | |
| clarkb | I like that the docs are here are links to all the source, yolo | 21:23 |
| mordred | anywho - to be fair - this is my first stab at sorting out a design | 21:23 |
| mordred | and I have spent about 15 minutes on it - but it does seem doable | 21:23 |
| *** jsavak has joined #openstack-infra | 21:24 | |
| clarkb | ya, that makes sense to me, bsaically put the repos where godep expects them to be with the proper refs checked out or whatever then have it run to tell go the compiler where its libs are located | 21:24 |
| clarkb | we will have to make sure that it uses the refs we have checked out for it rather than eg constraints like behavior | 21:24 |
| mordred | clarkb: yes | 21:25 |
| mordred | clarkb: because if we do that - then we could conceivably have depends-on support for multiple go projects | 21:25 |
| tdurakov | clarkb: are you around? | 21:25 |
| pabelanger | jeblair: nice: Released volume mirror.centos successfully | 21:26 |
| clarkb | mordred: tdurakov yup | 21:26 |
| mordred | clarkb: this: http://paste.openstack.org/show/496629 | 21:27 |
| mordred | clarkb: is Godeps/Godeps.json from me having done a godep save in the consul git repo | 21:27 |
| fungi | gonna find some food, back later | 21:27 |
| tdurakov | clarkb: how to check what image was used for http://logs.openstack.org/97/287997/18/experimental/gate-tempest-dsvm-multinode-live-migration/10b6384/ | 21:28 |
| anteaya | fungi: enjoy food | 21:29 |
| tdurakov | wrong question, where packages for this run were taken from? | 21:29 |
| *** jamesmca_ has quit IRC | 21:29 | |
| clarkb | tdurakov: there is a package listing let me get you a list | 21:29 |
| *** yamahata has joined #openstack-infra | 21:29 | |
| clarkb | tdurakov: http://logs.openstack.org/97/287997/18/experimental/gate-tempest-dsvm-multinode-live-migration/10b6384/logs/dpkg-l.txt.gz | 21:29 |
| clarkb | tdurakov: is there something specific yo uare trying to find out? | 21:30 |
| openstackgerrit | Paul Belanger proposed openstack-infra/system-config: Enable vos release for mirror.centos https://review.openstack.org/314778 | 21:30 |
| tdurakov | clarkb: i've expected to see newer version for libvirt and qemu, but they are the same as for trusty release, is it correct? | 21:31 |
| clarkb | no, 1.3.1 is the xenial version | 21:31 |
| clarkb | trusty is 1.2.something iirc | 21:31 |
| openstackgerrit | Emilien Macchi proposed openstack-infra/system-config: Added Gem Mirror to Infra https://review.openstack.org/253616 | 21:31 |
| clarkb | you can compare using that same log file against older runs of that test | 21:31 |
| tdurakov | clarkb: and what about qemu? | 21:31 |
| clarkb | should be the xenial version too... | 21:31 |
| openstackgerrit | Raildo Mascena proposed openstack-infra/project-config: Run Swift functional tests in Identity v3-only https://review.openstack.org/313659 | 21:31 |
| pabelanger | clarkb: okay, -1 min-ready for bare-precise has landed on nodepool.o.o. I'll remove the images and nodes once nodepool-builder is done today, then we can merge 313631. But getting food first | 21:32 |
| *** |-paul-| has joined #openstack-infra | 21:32 | |
| clarkb | tdurakov: qemu 2.0 on trusty 2.5 on xenial | 21:32 |
| clarkb | 1.2.2 for libvirt bin on trusty, 1.3.1 on xenial | 21:32 |
| *** baumann has left #openstack-infra | 21:33 | |
| tdurakov | clarkb: oh, than you, now it's clear! | 21:33 |
| tdurakov | s/than/thank | 21:33 |
| *** bpokorny_ has quit IRC | 21:34 | |
| *** bpokorny has joined #openstack-infra | 21:34 | |
| *** daemontool_ has joined #openstack-infra | 21:35 | |
| regXboi | question - has access to the jenkins instances been locked down? when trying to click through zuul to a finished jenkins job, the connection now hangs | 21:36 |
| clarkb | regXboi: yes it has been | 21:36 |
| regXboi | ah ... I thought it might have been - thx | 21:36 |
| clarkb | there were security concerns so we bit the bullet and closed it down | 21:37 |
| regXboi | I remember seeing them | 21:37 |
| *** thorst_ has joined #openstack-infra | 21:38 | |
| *** IlyaG has joined #openstack-infra | 21:39 | |
| tdurakov | faced with the issue on xenial with gate64 cpu model, checking logs for that | 21:39 |
| jeblair | pabelanger: how long did it take? | 21:41 |
| pabelanger | jeblair: not long, maybe 30-45mins | 21:41 |
| clarkb | tdurakov: can you point to logs, gate64 cpu model is something I am partially to blame for and probbaly help debug | 21:41 |
| clarkb | tdurakov: basically since we don't have homogenous CPUs in clouds we create a cpu model in libvirt for the tests that is a minimal set that should work | 21:42 |
| clarkb | tdurakov: its possible new libvirt doesn't like a flag or something maybe? | 21:42 |
| jeblair | pabelanger: so about 0.5GB/min | 21:42 |
| *** thorst_ has quit IRC | 21:42 | |
| pabelanger | jeblair: ya, I should have done a better job tracking it. | 21:42 |
| *** IlyaG has quit IRC | 21:43 | |
| tdurakov | clarkb: http://logs.openstack.org/97/287997/18/experimental/gate-tempest-dsvm-multinode-live-migration/10b6384/logs/subnode-2/screen-n-cpu.txt.gz?level=ERROR#_2016-05-10_18_29_04_642 | 21:43 |
| clarkb | though we actually do have tempest working single node on xenial and that should also use gate64 | 21:44 |
| jeblair | regXboi: if you still have links to jenkins, you haven't reloaded your zuul status page in weeks :) | 21:45 |
| tdurakov | clarkb: it looks like this error persists on both primary and subnode | 21:46 |
| *** nwkarste_ has quit IRC | 21:46 | |
| jeblair | regXboi: if you reload it, you will find that once jobs complete, we now link directly to logs.o.o, which you may find helpful | 21:46 |
| *** nwkarsten has joined #openstack-infra | 21:46 | |
| regXboi | jeblair: that is not precisely true | 21:47 |
| regXboi | it was true, but I'm seeing the running links again | 21:47 |
| clarkb | tdurakov: in the past we have run into issues like that when the libvirt process isn't properly restarted | 21:48 |
| clarkb | tdurakov: looking closely I think we only set that cpu model on mulitnode but it is attempted to be installed everywhere | 21:49 |
| tdurakov | clarkb: is it possible that libvirt on xenial use some different path for cpu_map? | 21:49 |
| anteaya | regXboi: the links are for jobs that have completed | 21:49 |
| clarkb | tdurakov: so I think the thing we need to debug is why it doesn't get installed. Maybe the path changed or maybe it has invalid content for new qemu/libvirt | 21:49 |
| *** edmondsw has quit IRC | 21:49 | |
| clarkb | tdurakov: ya I think that is one possibility | 21:49 |
| *** nwkarste_ has joined #openstack-infra | 21:49 | |
| anteaya | regXboi: the docs job completed link takes me to docs | 21:49 |
| jeblair | regXboi: that is strange; there should be no links for running jobs (we did not put them back and i do not see them) | 21:49 |
| clarkb | jeblair I do not see them either | 21:50 |
| anteaya | regXboi: the pep8 completed link takes me to the logs.openstack.org | 21:50 |
| tdurakov | clarkb: need to go now, will check this on local env tomorrow morning, will ping you with results then | 21:51 |
| regXboi | jeblair, anteaya: I agree that completed links go to l.o.o | 21:51 |
| *** nwkarsten has quit IRC | 21:51 | |
| regXboi | I'll double check zuul tomorrow | 21:51 |
| regXboi | but I remember seeing the links weren't there and then they appeared again | 21:51 |
| *** nwkarsten has joined #openstack-infra | 21:51 | |
| anteaya | regXboi: okay, if you can link to a running job do share the link | 21:51 |
| regXboi | which I thought was very .... odd | 21:51 |
| anteaya | regXboi: indeed | 21:51 |
| anteaya | regXboi: if that happens again if you can screenshot that would be great | 21:51 |
| *** mriedem has quit IRC | 21:52 | |
| openstackgerrit | Darragh Bailey proposed openstack-infra/jenkins-job-builder: Allow using lockfile per jenkins master https://review.openstack.org/293631 | 21:52 |
| openstackgerrit | Darragh Bailey proposed openstack-infra/jenkins-job-builder: Prevent corruption of cache by using atomic update https://review.openstack.org/314789 | 21:52 |
| clarkb | tdurakov: ok | 21:52 |
| clarkb | tdurakov: devstack intsalls that so you can see what it is attempting there | 21:52 |
| clarkb | regXboi: what url are you using? | 21:52 |
| clarkb | for the status page? | 21:53 |
| regXboi | http://status.openstack.org/zuul/ | 21:53 |
| *** amotoki has joined #openstack-infra | 21:53 | |
| clarkb | ok its not some shadow status page | 21:53 |
| openstackgerrit | Emilien Macchi proposed openstack-infra/project-config: zuul/layout: update tripleo jobs for Puppet CI https://review.openstack.org/314708 | 21:53 |
| regXboi | and I just did a force refresh in the browser | 21:53 |
| *** nwkarste_ has quit IRC | 21:54 | |
| regXboi | and I'm looking at things like http://docs-draft.openstack.org/32/314732/2/check/gate-oslo.messaging-docs/5dfc4ac//doc/build/html/ | 21:54 |
| regXboi | cool | 21:54 |
| regXboi | ok... I'll chalk it up to a cache issue | 21:54 |
| *** ffrank has joined #openstack-infra | 21:54 | |
| *** bdemers_ has quit IRC | 21:55 | |
| *** daemontool_ has quit IRC | 21:55 | |
| anteaya | regXboi: do say if it appears again | 21:59 |
| *** nwkarsten has quit IRC | 22:02 | |
| *** ccamacho has quit IRC | 22:06 | |
| regXboi | anteaya: will do | 22:07 |
| anteaya | thanks | 22:07 |
| *** salv-orl_ has quit IRC | 22:07 | |
| *** ccamacho has joined #openstack-infra | 22:09 | |
| *** markvoelker_ has joined #openstack-infra | 22:10 | |
| *** sigmavirus24 is now known as sigmavirus24_awa | 22:10 | |
| *** amitgandhinz has quit IRC | 22:11 | |
| *** hdd has quit IRC | 22:11 | |
| *** thorst_ has joined #openstack-infra | 22:12 | |
| *** piet has joined #openstack-infra | 22:14 | |
| *** regXboi has quit IRC | 22:14 | |
| *** thorst_ has quit IRC | 22:16 | |
| *** thorst_ has joined #openstack-infra | 22:17 | |
| *** Guest35788 has quit IRC | 22:18 | |
| *** IlyaG has joined #openstack-infra | 22:19 | |
| *** thorst_ has quit IRC | 22:19 | |
| *** sdake has joined #openstack-infra | 22:22 | |
| *** hdd has joined #openstack-infra | 22:24 | |
| *** dimtruck is now known as zz_dimtruck | 22:27 | |
| *** hdd has quit IRC | 22:30 | |
| *** thorst_ has joined #openstack-infra | 22:30 | |
| *** thorst_ has quit IRC | 22:31 | |
| *** thorst_ has joined #openstack-infra | 22:31 | |
| openstackgerrit | David Lyle proposed openstack-infra/project-config: Update horizon dsvm tempest job https://review.openstack.org/314795 | 22:31 |
| *** markvoelker_ has quit IRC | 22:32 | |
| craige | o/ | 22:34 |
| *** gordc has quit IRC | 22:34 | |
| *** hdd has joined #openstack-infra | 22:35 | |
| *** lcs has joined #openstack-infra | 22:36 | |
| *** lcs has left #openstack-infra | 22:37 | |
| *** tphummel_ has joined #openstack-infra | 22:37 | |
| *** tphummel has quit IRC | 22:37 | |
| *** tphummel_ is now known as tphummel | 22:37 | |
| *** tpsilva has quit IRC | 22:37 | |
| *** jamesmca_ has joined #openstack-infra | 22:39 | |
| *** claudiub has quit IRC | 22:40 | |
| *** jpr has joined #openstack-infra | 22:42 | |
| *** ddieterly is now known as ddieterly[away] | 22:42 | |
| *** vkramskikh_ has quit IRC | 22:43 | |
| *** ddieterly[away] has quit IRC | 22:45 | |
| *** mixos has joined #openstack-infra | 22:45 | |
| jeblair | oh wow, the pypi mirror release finished | 22:47 |
| jeblair | i guess it got faster? | 22:47 |
| jeblair | Released volume mirror.pypi successfully | 22:47 |
| jeblair | real 307m20.860s | 22:47 |
| *** mixos has quit IRC | 22:48 | |
| jeblair | Released volume mirror.pypi successfully | 22:49 |
| jeblair | real 1m29.007s | 22:49 |
| anteaya | yay! | 22:49 |
| jeblair | i think we're set to move back to the ro volume | 22:49 |
| *** mriedem has joined #openstack-infra | 22:50 | |
| *** Qiming has joined #openstack-infra | 22:50 | |
| * jeblair reverts | 22:50 | |
| thingee | anteaya: heads up, I plan to announce a third-party CI requirement with cinder backup drivers. I will include you on the draft before it's sent. | 22:50 |
| dstufft | oh, did y'all do a full sync | 22:50 |
| anteaya | thingee: thanks for the heads up | 22:51 |
| anteaya | thingee: I appreciate you thinking of me | 22:51 |
| *** |-paul-| has quit IRC | 22:51 | |
| anteaya | will you be composing the draft in the next 8 hours do you think? | 22:51 |
| anteaya | was thinking about having some dinner at some point | 22:51 |
| clarkb | dstufft: thats syncing of the underling AFS volumes, not bandersnatch | 22:51 |
| jeblair | dstufft: no, we had a problem with our read-only replicas, so we did a (well, actually, 2) full replication from the read-write to read-only volumes; but the read-write has been up the whole time, so we did not need to do a full bandersnatch sync | 22:51 |
| *** kzaitsev_mb has joined #openstack-infra | 22:52 | |
| thingee | anteaya: I don't plan to send it until tomorrow. | 22:52 |
| anteaya | okay thank you | 22:52 |
| anteaya | I'll look for it tomorrow | 22:52 |
| anteaya | thanks | 22:52 |
| thingee | anteaya: too late to get enough input | 22:52 |
| anteaya | understood | 22:52 |
| openstackgerrit | James E. Blair proposed openstack-infra/system-config: Revert "Start using read/write AFS volume for PyPI mirror" https://review.openstack.org/314800 | 22:53 |
| jeblair | clarkb, fungi, mordred: ^ | 22:53 |
| *** jamesmca_ has quit IRC | 22:53 | |
| dstufft | clarkb: mordred go get: making pip look decent since 2011 (go single binary story, making Python looking sad since 2011) | 22:54 |
| dstufft | clarkb: jeblair ah | 22:55 |
| jeblair | i'm moving the secondary replicas of the wheel mirrors to dfw | 22:55 |
| jeblair | done | 22:56 |
| *** hdd has quit IRC | 22:57 | |
| jeblair | i've taken the lock for debian-ceph-hammer and will move it now | 22:58 |
| jeblair | done | 23:00 |
| *** madhu_ak_ has joined #openstack-infra | 23:01 | |
| jeblair | ubuntu next | 23:01 |
| *** baoli_ has quit IRC | 23:01 | |
| *** kzaitsev_mb has quit IRC | 23:02 | |
| *** jamesmca_ has joined #openstack-infra | 23:03 | |
| *** Qiming has quit IRC | 23:03 | |
| *** tonytan4ever has quit IRC | 23:03 | |
| *** Goneri has joined #openstack-infra | 23:03 | |
| *** rbrndt has quit IRC | 23:04 | |
| *** madhu_ak has quit IRC | 23:04 | |
| dansmith | fungi: I seem to not have powers to delete things on the wiki | 23:04 |
| dansmith | fungi: I'm thinking it's hard for us to complain about stale information if people can't delete things :) | 23:05 |
| *** kzaitsev_mb has joined #openstack-infra | 23:05 | |
| jeblair | dansmith: what happens? | 23:06 |
| dansmith | jeblair: I just don't have a delete button to push | 23:06 |
| jeblair | dansmith: nothing under "Actions" ? | 23:06 |
| *** hdd has joined #openstack-infra | 23:06 | |
| dansmith | jeblair: just move and watch | 23:06 |
| jeblair | dansmith: which page? | 23:06 |
| dansmith | jeblair: several, but here's an example: https://wiki.openstack.org/wiki/ShortTermAuthZinNova | 23:07 |
| jeblair | dansmith: i do for that page, which suggests a perm problem | 23:07 |
| dansmith | yeah | 23:07 |
| jeblair | pleia2, pabelanger: we didn't by chance restrict deleting pages as an emergency spam mitigation, did we? | 23:08 |
| *** zz_dimtruck is now known as dimtruck | 23:09 | |
| jeblair | dansmith: what's your wiki username? | 23:09 |
| dansmith | jeblair: danms, I assume | 23:09 |
| dansmith | https://wiki.openstack.org/wiki/User:Dan_Smith | 23:10 |
| anteaya | I only got delete permissions when I became admin on the wiki | 23:12 |
| jeblair | did we always have that restricted? | 23:12 |
| anteaya | I don't know | 23:13 |
| anteaya | I asked for and got permissions about 2 months ago | 23:13 |
| *** jamielennox is now known as jamielennox|away | 23:13 | |
| pleia2 | jeblair: anteaya is right | 23:13 |
| jeblair | (perhaps the explanation for both problems is that no one wanted to delete pages before now?) | 23:13 |
| anteaya | I don't know what permissions were prior to that | 23:13 |
| pleia2 | delete was only ever allowed by admins afaik | 23:13 |
| anteaya | jeblair: I know I never thought about it | 23:13 |
| pleia2 | people can rename them though | 23:13 |
| pleia2 | which is what the spammers have been doing | 23:13 |
| jeblair | i wonder if that was a choice or accident | 23:13 |
| anteaya | until I felt obliged to put my money where my mouth was, stop complaining and help | 23:14 |
| anteaya | so I asked | 23:14 |
| dansmith | I looked one time when someone showed up with a link to an upgrades page from pre-essex | 23:14 |
| dansmith | but I saw I had no delete button and said "meh" | 23:14 |
| pleia2 | we have been giving trusted community members more privs to help out with cleanup though (hi dansmith!) | 23:15 |
| dansmith | haven't thought about it since until just now | 23:15 |
| dansmith | pleia2: hmm, probably not me then :D | 23:15 |
| pleia2 | haha | 23:15 |
| * dansmith moonlights as a spammer | 23:15 | |
| *** kzaitsev_mb has quit IRC | 23:15 | |
| dansmith | (not really) | 23:15 |
| anteaya | dansmith: definitely you | 23:15 |
| jeblair | pleia2: where's the site config file? | 23:15 |
| pleia2 | jeblair: puppet-mediawiki module, let's see... | 23:16 |
| pleia2 | http://git.openstack.org/cgit/openstack-infra/puppet-mediawiki/tree/templates/Settings.php.erb | 23:16 |
| jeblair | pleia2: so i guess we should give dansmith admin/bureaucrat access for now? | 23:16 |
| pleia2 | that's not where we give people access though (helpfully) | 23:16 |
| pleia2 | jeblair: yeah, I'd say so | 23:16 |
| *** salv-orlando has joined #openstack-infra | 23:16 | |
| jeblair | pleia2: yeah, i'm looking there to see what the acls are defined as | 23:17 |
| pleia2 | ah ok | 23:17 |
| mnaser | would anyone who has ssh access to infra be able to work a small favour to help make our migrations easier? (now or later) | 23:18 |
| JayF | Is there some doc I'm not finding that lists the prereqs for running project-config tests locally? | 23:19 |
| mnaser | we're migrating volume backends and there are 2 volumes in the openstack tenants.. all that i'd ask is create a new volume, mount it, move data to new volume, delete old volume | 23:19 |
| clarkb | mnaser: I can likely do that tomorrow | 23:19 |
| mnaser | (whenever time allows) | 23:19 |
| clarkb | mnaser: though not right now because EHOUSEBUYING | 23:19 |
| dansmith | clarkb: ooh, congrats | 23:19 |
| mnaser | yeah, no rush.. im sure -infra will be much faster to get on this than $customer :) | 23:19 |
| mnaser | but congrats clarkb ! wish you the best | 23:20 |
| mnaser | we need to all mail you really cheesy openstack related housewarming gifts! | 23:20 |
| jeblair | dansmith: you are an admin now, you should be able to del pages | 23:20 |
| dansmith | jeblair: muahaha (translation: confirmed) | 23:20 |
| dansmith | thanks! | 23:20 |
| anteaya | dansmith: thanks for asking and helping | 23:20 |
| jeblair | i think admin is what is needed to delete pages; bureaucrat is needed to make new admins (and some other things) | 23:20 |
| dansmith | now, to find all the pages anteaya has created... | 23:21 |
| *** d0ugal has quit IRC | 23:21 | |
| anteaya | dansmith: go you | 23:21 |
| *** salv-orlando has quit IRC | 23:21 | |
| *** hongbin has quit IRC | 23:21 | |
| *** sdague has quit IRC | 23:21 | |
| anteaya | JayF: well tox runs quite a few | 23:21 |
| *** jamielennox|away is now known as jamielennox | 23:21 | |
| anteaya | JayF: are there tests that are not running locally when you run tox? | 23:22 |
| JayF | anteaya: more that I'm playing whackamole with deps | 23:22 |
| anteaya | JayF: are you willing to share what you are seeing in a paste? | 23:23 |
| dansmith | dhellmann: can I delete release wiki pages that talk about bzr? :D https://wiki.openstack.org/wiki/OldHowToRelease | 23:23 |
| JayF | anteaya: I'm making it work; just slowly -- was hoping there was documentation, if not I can slog through it | 23:23 |
| *** jamesmca_ has quit IRC | 23:23 | |
| JayF | anteaya: just no fun to tox; find the missing package that failed it; tox again | 23:23 |
| *** jamesmca_ has joined #openstack-infra | 23:25 | |
| anteaya | yeah I hear that | 23:26 |
| jeblair | JayF: if you want to take notes and propose an other-dependencies.txt file for project-config, that could help us get a head start on using bindep there | 23:27 |
| jeblair | JayF: (and this will ultimately be the self-documenting way of declaring that information) | 23:27 |
| JayF | jeblair: yeah; I was thinking that but all I was missing in my dev vm was gcc-c++ (after determining they'd never run on os x) | 23:28 |
| *** jsavak has quit IRC | 23:28 | |
| JayF | jeblair: if I get more than a list of 1 I'll gladly do it :) | 23:28 |
| *** rcernin has quit IRC | 23:28 | |
| *** jamesmca_ has quit IRC | 23:29 | |
| jeblair | heh | 23:29 |
| anteaya | JayF: so this doesn't exist anymore, but I wrote it to answer the question you are asking about: https://review.openstack.org/#/c/33456/8/TESTING.rst | 23:29 |
| anteaya | found it with project:^.*oslo.* owner:self yay gerrit queries | 23:29 |
| *** Goneri has quit IRC | 23:30 | |
| JayF | That's not exactly the problem in my case; I know how to tox and run tests (and have configured tox for new projects), just other-requirements.txt (nod to jeblair) wasn't populated | 23:30 |
| *** jamesmca_ has joined #openstack-infra | 23:30 | |
| *** sdake has quit IRC | 23:30 | |
| anteaya | ah I see | 23:30 |
| anteaya | sorry about that | 23:30 |
| dansmith | my delete finger is already sore | 23:31 |
| anteaya | dansmith: go you | 23:31 |
| dansmith | I have deleted enough things in the first page of 50 oldest to refresh the page several times and keep going | 23:32 |
| dansmith | without having to go do the second | 23:32 |
| anteaya | well done | 23:33 |
| *** d0ugal has joined #openstack-infra | 23:36 | |
| *** madhu_ak_ is now known as madhu_ak | 23:36 | |
| *** vhosakot has quit IRC | 23:37 | |
| *** jamesmca_ has quit IRC | 23:38 | |
| *** sdake has joined #openstack-infra | 23:38 | |
| *** brucet has joined #openstack-infra | 23:38 | |
| sdake | fungi you around to discuss vmt things? | 23:39 |
| *** signed8bit is now known as signed8bit_Zzz | 23:40 | |
| JayF | So w/r/t project-config/jenkins/jobs/projects.yaml, and ironic.yaml -- are they basically the same thing? feeding into the same total tree? | 23:40 |
| *** sridhar_ram has quit IRC | 23:40 | |
| *** jamesmca_ has joined #openstack-infra | 23:40 | |
| clarkb | jayf yes nodepool conbines it all into one yaml doc | 23:41 |
| *** sridhar_ram has joined #openstack-infra | 23:42 | |
| JayF | that makes perfect sense, and means I've been chasing a ghost for a while in configs | 23:42 |
| JayF | is there any good reason there would be an ironic.yaml AND jobs for Ironic in projects.yaml? | 23:42 |
| anteaya | JayF: jobs have to be listed in projects.yaml | 23:46 |
| JayF | Yeah, I get it now, just last time I was here projects.yaml was it, there was no ironic.yaml | 23:47 |
| clarkb | yes typically templates and single jobs go in project specific files then you instantiate templates in projects.yaml | 23:47 |
| JayF | and I didn't connect the very obvious dots | 23:47 |
| anteaya | they can be defined anywhere in jenkins/jobs/anyfile.yaml | 23:47 |
| anteaya | JayF: yup, everything is growing and getting more complex | 23:47 |
| anteaya | the filename hopefully is a name to group job definitions and templates so team members can find them | 23:48 |
| JayF | yeah; I think ironic is not doing well in that regard | 23:49 |
| anteaya | I just learned all tripleo jobs get defined on the ironic repo on jenkins/jobs/projects.yaml that is a new one for me | 23:49 |
| JayF | I'm going to get this patch to mergable and then put cleaning up the ironic configs on my list | 23:49 |
| anteaya | does ironic have job templates in files other than ironic.yaml? | 23:49 |
| JayF | yes, in projects.yaml as well | 23:49 |
| anteaya | JayF: awesome thank you | 23:49 |
| JayF | which is what started my whole confusion | 23:49 |
| anteaya | JayF: can you link to where you are looking in projects.yaml? | 23:49 |
| *** brucet has quit IRC | 23:50 | |
| JayF | https://github.com/openstack-infra/project-config/blob/master/jenkins/jobs/projects.yaml#L2442 | 23:50 |
| *** jamesmca_ has quit IRC | 23:51 | |
| *** piet has quit IRC | 23:51 | |
| anteaya | JayF: right so all that needs to stay in that file | 23:54 |
| *** hdd has quit IRC | 23:54 | |
| anteaya | if you look at http://git.openstack.org/cgit/openstack-infra/project-config/tree/jenkins/jobs/projects.yaml#n2442 | 23:54 |
| *** Qiming has joined #openstack-infra | 23:54 | |
| anteaya | you will see that many tripleo jobs are defined on ironic | 23:54 |
| anteaya | I don't know how that decision was made | 23:54 |
| anteaya | but when I questioned it pabelanger told me that was how it was done | 23:55 |
| JayF | not all of those are tripleo jobs | 23:55 |
| JayF | is my point | 23:55 |
| anteaya | right | 23:55 |
| JayF | is there a reason they shouldn't go in ironic.yaml? | 23:55 |
| anteaya | yes | 23:55 |
| JayF | that's the piece I don't grok | 23:55 |
| anteaya | they all need to be in that file | 23:55 |
| *** crinkle has quit IRC | 23:55 | |
| JayF | Like I'll gladly do what I'm told and not understand | 23:55 |
| JayF | but I'm missing something here for sure if that won't work | 23:55 |
| anteaya | but the tripleo jobs don't _have_ to be on the ironic repo | 23:55 |
| anteaya | JayF: I'd like to help you understand | 23:55 |
| *** chlong has joined #openstack-infra | 23:56 | |
| anteaya | JayF: so if we look at http://git.openstack.org/cgit/openstack-infra/project-config/tree/jenkins/jobs/ironic.yaml | 23:56 |
| anteaya | there are job-templates | 23:57 |
| anteaya | this is one job template: '{pipeline}-ironic-dsvm-functional{job-suffix}' | 23:57 |
| *** thorst_ has quit IRC | 23:57 | |
| *** vhosakot has joined #openstack-infra | 23:58 | |
| anteaya | here is that job template called on the ironic repo: http://git.openstack.org/cgit/openstack-infra/project-config/tree/jenkins/jobs/projects.yaml#n2457 | 23:58 |
| *** thorst_ has joined #openstack-infra | 23:58 | |
| anteaya | with the pipeline and job-suffix variables defined | 23:58 |
| anteaya | now that job template is only called once on the ironic repo in projects.yaml | 23:59 |
| anteaya | so the name could have been hardcoded rather than creating the variables | 23:59 |
| anteaya | but how that job runs | 23:59 |
| anteaya | the wrappers, the builders and the publishers for that job are all stated in ironic.yaml | 23:59 |
| JayF | why does the list of jobs have to be in projects.yaml instead of ironic.yaml if they're all combined by nodepool? | 23:59 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!