openstackgerrit | Ihar Hrachyshka proposed openstack-infra/openstack-zuul-jobs master: Bump timeout for unit test jobs https://review.openstack.org/537016 | 00:00 |
---|---|---|
*** zhurong has joined #openstack-infra | 00:02 | |
*** wolverineav has quit IRC | 00:03 | |
*** owalsh_ has joined #openstack-infra | 00:05 | |
*** aeng has quit IRC | 00:05 | |
*** owalsh has quit IRC | 00:06 | |
*** pahuang has quit IRC | 00:06 | |
openstackgerrit | James E. Blair proposed openstack-infra/puppet-mailman master: Use multisite template dir https://review.openstack.org/535852 | 00:08 |
openstackgerrit | James E. Blair proposed openstack-infra/puppet-mailman master: Remove openstack HTML templates https://review.openstack.org/535855 | 00:08 |
openstackgerrit | Monty Taylor proposed openstack-infra/zuul master: Update docs to use sphinx-build and doc/requirements https://review.openstack.org/536881 | 00:08 |
openstackgerrit | Monty Taylor proposed openstack-infra/zuul master: Use reno for release notes https://review.openstack.org/262597 | 00:08 |
openstackgerrit | Monty Taylor proposed openstack-infra/zuul master: Switch to stestr https://review.openstack.org/536882 | 00:08 |
openstackgerrit | Monty Taylor proposed openstack-infra/zuul master: Remove --no-subunit-trace argument https://review.openstack.org/536883 | 00:08 |
*** owalsh_ has quit IRC | 00:11 | |
openstackgerrit | Spencer Krum proposed openstack-infra/puppet-lodgeit master: Replace header on paste.o.o with updated log https://review.openstack.org/537018 | 00:11 |
*** owalsh has joined #openstack-infra | 00:16 | |
*** wolverineav has joined #openstack-infra | 00:16 | |
openstackgerrit | David Shrewsbury proposed openstack-infra/nodepool master: Convert from legacy to native devstack job https://review.openstack.org/535899 | 00:17 |
*** wolverineav has quit IRC | 00:20 | |
*** zhurong has quit IRC | 00:20 | |
*** wolverineav has joined #openstack-infra | 00:21 | |
*** oanson has quit IRC | 00:22 | |
*** aeng has joined #openstack-infra | 00:23 | |
*** pahuang has joined #openstack-infra | 00:23 | |
*** oanson has joined #openstack-infra | 00:24 | |
ianw | gema: dropped a few comments on the linaro xenial bug | 00:33 |
ianw | one thing is the weird multiple interfaces being attached to the instance | 00:33 |
*** Nil_ has quit IRC | 00:34 | |
ianw | it's a long-shot, but i've traced a bunch of communication issues down previously to multiple neutron-agent's running all at once, they didn't get killed properly on a service restart and were in a zombie mode duplicating network setup | 00:34 |
openstackgerrit | Merged openstack-infra/zuul master: ansible: honor command no_log module attribute https://review.openstack.org/535542 | 00:36 |
*** sshnaidm is now known as sshnaidm|off | 00:38 | |
openstackgerrit | Merged openstack-infra/zuul master: executor: block stat get_mime on localhost https://review.openstack.org/535576 | 00:38 |
*** wolverineav has quit IRC | 00:46 | |
openstackgerrit | OpenStack Proposal Bot proposed openstack-dev/hacking master: Updated from global requirements https://review.openstack.org/520377 | 00:48 |
openstackgerrit | OpenStack Proposal Bot proposed openstack-dev/pbr master: Updated from global requirements https://review.openstack.org/537022 | 00:48 |
*** wolverineav has joined #openstack-infra | 00:50 | |
openstackgerrit | OpenStack Proposal Bot proposed openstack/diskimage-builder master: Updated from global requirements https://review.openstack.org/537039 | 00:51 |
*** agopi has joined #openstack-infra | 00:53 | |
*** zhurong has joined #openstack-infra | 00:58 | |
*** nicolasbock has quit IRC | 00:58 | |
*** olaph has joined #openstack-infra | 01:01 | |
*** kien-ha has quit IRC | 01:01 | |
*** larainema has joined #openstack-infra | 01:01 | |
*** r-daneel has quit IRC | 01:01 | |
*** olaph1 has quit IRC | 01:02 | |
*** gk__ has joined #openstack-infra | 01:04 | |
gk__ | fungi: Hi fungi, are you there? | 01:05 |
*** wolverineav has quit IRC | 01:07 | |
*** wolverineav has joined #openstack-infra | 01:08 | |
*** cuongnv has joined #openstack-infra | 01:08 | |
*** stakeda has joined #openstack-infra | 01:14 | |
*** salv-orlando has joined #openstack-infra | 01:15 | |
*** armax has quit IRC | 01:18 | |
*** salv-orlando has quit IRC | 01:20 | |
*** wolverineav has quit IRC | 01:21 | |
*** david-lyle has quit IRC | 01:22 | |
*** jamesmcarthur has joined #openstack-infra | 01:24 | |
*** niska has quit IRC | 01:27 | |
*** jamesmcarthur has quit IRC | 01:29 | |
*** armax has joined #openstack-infra | 01:29 | |
*** caphrim007_ has joined #openstack-infra | 01:29 | |
*** Goneri has quit IRC | 01:30 | |
*** caphrim007 has quit IRC | 01:32 | |
*** caphrim007_ has quit IRC | 01:33 | |
*** wolverineav has joined #openstack-infra | 01:34 | |
*** niska has joined #openstack-infra | 01:37 | |
*** oanson has quit IRC | 01:38 | |
*** oanson has joined #openstack-infra | 01:41 | |
openstackgerrit | OpenStack Proposal Bot proposed openstack-dev/hacking master: Updated from global requirements https://review.openstack.org/520377 | 01:48 |
*** olaph1 has joined #openstack-infra | 01:48 | |
*** s-shiono has joined #openstack-infra | 01:48 | |
*** olaph has quit IRC | 01:48 | |
*** liujiong has joined #openstack-infra | 01:55 | |
*** wolverineav has quit IRC | 01:58 | |
*** olaph has joined #openstack-infra | 01:59 | |
*** olaph1 has quit IRC | 02:02 | |
*** esberglu has joined #openstack-infra | 02:03 | |
*** pcrews has joined #openstack-infra | 02:03 | |
*** esberglu has quit IRC | 02:06 | |
*** wolverineav has joined #openstack-infra | 02:06 | |
*** gcb has joined #openstack-infra | 02:09 | |
*** wolverineav has quit IRC | 02:11 | |
*** armax_ has joined #openstack-infra | 02:12 | |
*** yamamoto has joined #openstack-infra | 02:13 | |
openstackgerrit | OpenStack Proposal Bot proposed openstack/os-testr master: Updated from global requirements https://review.openstack.org/533993 | 02:14 |
*** armax has quit IRC | 02:15 | |
*** armax_ is now known as armax | 02:15 | |
*** hongbin has joined #openstack-infra | 02:16 | |
*** salv-orlando has joined #openstack-infra | 02:17 | |
*** harlowja has quit IRC | 02:20 | |
*** salv-orlando has quit IRC | 02:21 | |
*** dingyichen has joined #openstack-infra | 02:26 | |
*** gk__ has quit IRC | 02:26 | |
*** pcrews has quit IRC | 02:28 | |
*** aeng has quit IRC | 02:28 | |
*** pahuang has quit IRC | 02:28 | |
*** yolanda has quit IRC | 02:30 | |
*** gyee has quit IRC | 02:31 | |
*** olaph1 has joined #openstack-infra | 02:32 | |
*** wxy has joined #openstack-infra | 02:33 | |
*** jamesmcarthur has joined #openstack-infra | 02:33 | |
*** olaph has quit IRC | 02:34 | |
*** gongysh has joined #openstack-infra | 02:35 | |
*** olaph has joined #openstack-infra | 02:36 | |
*** olaph1 has quit IRC | 02:37 | |
ianw | #status log manually removed infracloud chocolate from clouds.yaml (https://review.openstack.org/#/c/536989/) as it was holding up puppet runs | 02:37 |
openstackstatus | ianw: finished logging | 02:37 |
*** wolverineav has joined #openstack-infra | 02:37 | |
*** jamesmcarthur has quit IRC | 02:37 | |
ianw | oh, that's going to race with puppet itself refreshing it i guess | 02:39 |
*** pahuang has joined #openstack-infra | 02:42 | |
ianw | once 536989 merges i manually do a swizzle | 02:42 |
*** wolverineav has quit IRC | 02:42 | |
openstackgerrit | David Moreau Simard proposed openstack-infra/zuul master: Add support for dumping queues from a status.json file https://review.openstack.org/536622 | 02:42 |
*** caphrim007 has joined #openstack-infra | 02:49 | |
*** caphrim007 has quit IRC | 02:54 | |
*** zhurong has quit IRC | 02:57 | |
*** caphrim007 has joined #openstack-infra | 03:00 | |
*** ihrachys_ has quit IRC | 03:15 | |
openstackgerrit | Ian Wienand proposed openstack-infra/system-config master: Revert "Add Puppetlabs mirror for CentOS7" https://review.openstack.org/537234 | 03:16 |
*** smatzek has joined #openstack-infra | 03:17 | |
*** salv-orlando has joined #openstack-infra | 03:17 | |
ianw | EmilienM / pabelanger: ^ sorry, i should have looked at that more closely, it's not quite right. i've put notes in the change about the issues | 03:22 |
*** salv-orlando has quit IRC | 03:22 | |
*** sree has joined #openstack-infra | 03:22 | |
*** ykarel has joined #openstack-infra | 03:23 | |
*** sree_ has joined #openstack-infra | 03:25 | |
*** sree_ is now known as Guest62420 | 03:25 | |
*** sree has quit IRC | 03:29 | |
*** david-lyle has joined #openstack-infra | 03:31 | |
*** rosmaita has quit IRC | 03:31 | |
*** david-lyle has quit IRC | 03:32 | |
*** david-lyle has joined #openstack-infra | 03:33 | |
ianw | hmm, 198.72.124.244 appears to have died on 536989,1 in an annoying way | 03:35 |
ianw | it either rejects ssh or hangs | 03:35 |
*** david-lyle has quit IRC | 03:39 | |
*** felipemonteiro_ has joined #openstack-infra | 03:41 | |
*** smatzek has quit IRC | 03:41 | |
*** felipemonteiro__ has joined #openstack-infra | 03:42 | |
openstackgerrit | sebastian marcet proposed openstack-infra/openstackid-resources master: added new endpoint get promo code by id https://review.openstack.org/537238 | 03:43 |
*** rkukura has quit IRC | 03:45 | |
*** felipemonteiro_ has quit IRC | 03:45 | |
*** ganso has quit IRC | 03:48 | |
*** annp has joined #openstack-infra | 03:48 | |
openstackgerrit | Merged openstack-infra/openstackid-resources master: added new endpoint get promo code by id https://review.openstack.org/537238 | 03:48 |
*** psachin` has joined #openstack-infra | 03:52 | |
*** psachin has joined #openstack-infra | 03:52 | |
*** Goneri has joined #openstack-infra | 03:58 | |
*** ramishra has joined #openstack-infra | 03:59 | |
*** cuongnv has quit IRC | 04:00 | |
*** cuongnv has joined #openstack-infra | 04:01 | |
fungi | infra-root: sorry i'm not around, but i did check my e-mail and can confirm i've heard nothing directly from hpe indicating the infra-cloud environment would be going away (much less when). aside from the vague e-mail i mentioned last week which lance at osu-osl had received and forwarded to me about them planning to reclaim rather than donate the hardware, i've in fact heard nothing at all from them | 04:01 |
fungi | for months | 04:01 |
fungi | so just as (un?)surprised as the rest of you | 04:02 |
*** cuongnv has quit IRC | 04:02 | |
fungi | seems like you all have it well in hand though, so thanks! | 04:02 |
*** cuongnv has joined #openstack-infra | 04:03 | |
*** gongysh has quit IRC | 04:07 | |
*** Goneri has quit IRC | 04:14 | |
*** HenryG has quit IRC | 04:16 | |
*** HenryG has joined #openstack-infra | 04:18 | |
*** salv-orlando has joined #openstack-infra | 04:18 | |
openstackgerrit | Ian Wienand proposed openstack-infra/system-config master: Fix apt-puppetlabs update line https://review.openstack.org/537248 | 04:21 |
ianw | clarkb / EmilienM : see ^ ; please checkout http://mirror.iad.rax.openstack.org/apt-puppetlabs/ and make sure it's ok | 04:21 |
*** janki has joined #openstack-infra | 04:22 | |
*** salv-orlando has quit IRC | 04:22 | |
*** jamesmcarthur has joined #openstack-infra | 04:24 | |
*** rlandy has quit IRC | 04:25 | |
*** jamesmcarthur has quit IRC | 04:26 | |
*** jamesmcarthur has joined #openstack-infra | 04:26 | |
*** dave-mccowan has quit IRC | 04:27 | |
*** gongysh has joined #openstack-infra | 04:29 | |
openstackgerrit | Tristan Cacqueray proposed openstack-infra/nodepool master: openstack: convert rate to float https://review.openstack.org/537250 | 04:30 |
*** jamesmcarthur has quit IRC | 04:30 | |
*** felipemonteiro__ has quit IRC | 04:31 | |
*** annp has quit IRC | 04:33 | |
*** annp has joined #openstack-infra | 04:34 | |
johnsom | Anybody know why the proposal bot reverted the openstackdocstheme 18.1 update? https://review.openstack.org/#/c/533913/6..7/doc/requirements.txt | 04:36 |
johnsom | There is no revert in the requirements gerrit for this. | 04:36 |
johnsom | I asked in the requirements channel but prometheanfire pointed me to ask here. | 04:38 |
prometheanfire | just wondering if the bot is acting up | 04:39 |
*** pramodrj07 has quit IRC | 04:39 | |
*** masber has joined #openstack-infra | 04:42 | |
ianw | johnsom / prometheanfire : hmm dib got one, but in test-requirements.txt https://review.openstack.org/#/c/537039/1/test-requirements.txt | 04:45 |
ianw | that one's in requirements.txt ... if i had to guess i'd say that has something to do with it at least | 04:45 |
johnsom | Yeah, that patch got the 18.1 update, then the bot posted another patch dropping it back to 17.0 | 04:46 |
johnsom | 1.17.0->1.18.1->1.17.0 | 04:47 |
*** hongbin has quit IRC | 04:54 | |
*** ijw has quit IRC | 05:09 | |
tonyb | johnsom: That's really strange. I can't see whay that'd happen, it should be 1.18.1 unless the bot is using different source data doc/requirements.txt ? | 05:16 |
johnsom | Yeah, thought I should ask about it. | 05:18 |
*** salv-orlando has joined #openstack-infra | 05:19 | |
*** harlowja has joined #openstack-infra | 05:19 | |
*** salv-orlando has quit IRC | 05:23 | |
*** pcrews has joined #openstack-infra | 05:25 | |
*** olaph1 has joined #openstack-infra | 05:26 | |
*** olaph has quit IRC | 05:27 | |
*** kiennt26 has quit IRC | 05:28 | |
openstackgerrit | Merged openstack-infra/system-config master: Revert "Add Puppetlabs mirror for CentOS7" https://review.openstack.org/537234 | 05:28 |
*** links has joined #openstack-infra | 05:32 | |
*** pcrews has quit IRC | 05:33 | |
*** pcrews has joined #openstack-infra | 05:39 | |
EmilienM | ianw: awesome | 05:41 |
EmilienM | ianw: http://mirror.iad.rax.openstack.org/yum-puppetlabs/ doesn't work yet | 05:41 |
*** hrubi has quit IRC | 05:43 | |
*** salv-orlando has joined #openstack-infra | 05:45 | |
*** hrubi has joined #openstack-infra | 05:46 | |
openstackgerrit | Merged openstack-infra/project-config master: Add py35 job to Qinling project https://review.openstack.org/536655 | 05:46 |
*** pcrews has quit IRC | 05:51 | |
*** pgadiya has joined #openstack-infra | 05:51 | |
*** armaan has quit IRC | 05:51 | |
*** Guest62420 has quit IRC | 05:53 | |
*** sree has joined #openstack-infra | 05:54 | |
openstackgerrit | Merged openstack-infra/nodepool master: handler: fix support for handler without launch_manager https://review.openstack.org/535550 | 05:55 |
*** clayton has quit IRC | 05:58 | |
*** sree has quit IRC | 05:59 | |
*** armaan has joined #openstack-infra | 05:59 | |
*** rcernin_ has joined #openstack-infra | 06:03 | |
*** rcernin has quit IRC | 06:03 | |
AJaeger | johnsom: might be an out-of-order execution of post jobs ;( | 06:03 |
*** kiennt26 has joined #openstack-infra | 06:03 | |
AJaeger | johnsom: let's wait for next run | 06:03 |
*** coolsvap has joined #openstack-infra | 06:04 | |
*** clayton has joined #openstack-infra | 06:04 | |
AJaeger | infra-root, should we really change timeout to 1h? https://review.openstack.org/537016 | 06:04 |
AJaeger | config-core, could you review https://review.openstack.org/536672 and https://review.openstack.org/536527 , please? | 06:05 |
*** armax has quit IRC | 06:07 | |
*** sree has joined #openstack-infra | 06:08 | |
johnsom | AJaeger I saw some strangeness in the post pipeline earlier, just two jobs were running and some were waiting 9+ hours. Something changed and then the queue cleared like you would expect. | 06:08 |
openstackgerrit | Merged openstack-infra/system-config master: Remove infracloud-chocolate from clouds.yaml https://review.openstack.org/536989 | 06:09 |
AJaeger | johnsom: the post pipeline has low priority - we first serve gate and check | 06:10 |
AJaeger | And I see lots of changes there | 06:10 |
johnsom | Yes, it has been a busy day | 06:10 |
AJaeger | johnsom: http://grafana.openstack.org/dashboard/db/zuul-status - see the Node requests graph. That's the backlog on node request | 06:11 |
AJaeger | So, we need right now 832 nodes - so, no wonder that post is backlogged | 06:12 |
*** sree has quit IRC | 06:12 | |
johnsom | Ah, interesting. I looked for this graph but was looking in the nodepool page. Thanks | 06:13 |
*** agopi has quit IRC | 06:13 | |
openstackgerrit | Merged openstack/diskimage-builder master: Updated from global requirements https://review.openstack.org/537039 | 06:21 |
*** rwsu has joined #openstack-infra | 06:21 | |
*** gcb has quit IRC | 06:22 | |
*** kjackal has joined #openstack-infra | 06:22 | |
*** ijw has joined #openstack-infra | 06:26 | |
ianw | AJaeger: I was hoping you had thoughts on the timeout :) | 06:26 |
*** pcichy has joined #openstack-infra | 06:26 | |
*** slaweq has joined #openstack-infra | 06:26 | |
ianw | pabelanger: ^^ 536989 merged, and chocolate no longer in the clouds, so i think we're in steady state | 06:27 |
*** slaweq has quit IRC | 06:28 | |
*** pcichy has quit IRC | 06:31 | |
*** dbecker has quit IRC | 06:31 | |
*** ijw has quit IRC | 06:33 | |
*** witek has quit IRC | 06:37 | |
*** threestrands has joined #openstack-infra | 06:39 | |
*** threestrands has quit IRC | 06:39 | |
*** threestrands has joined #openstack-infra | 06:39 | |
*** witek has joined #openstack-infra | 06:42 | |
*** slaweq has joined #openstack-infra | 06:44 | |
*** dbecker has joined #openstack-infra | 06:45 | |
*** slaweq has quit IRC | 06:49 | |
*** threestrands has quit IRC | 06:49 | |
*** rocky-shiyan has quit IRC | 06:50 | |
*** makowals has joined #openstack-infra | 06:53 | |
openstackgerrit | Tristan Cacqueray proposed openstack-infra/nodepool master: openstack: convert rate to float https://review.openstack.org/537250 | 06:54 |
*** olaph has joined #openstack-infra | 06:57 | |
*** olaph1 has quit IRC | 06:58 | |
AJaeger | ianw: 1h is long ;( | 06:59 |
AJaeger | base timeout is 1800s, so 30mins - let me -1 and ask for just an additional 10 mins for now... | 07:01 |
*** slaweq has joined #openstack-infra | 07:03 | |
*** ykarel is now known as ykarel|away | 07:09 | |
*** annp has quit IRC | 07:10 | |
*** pcaruana has joined #openstack-infra | 07:10 | |
*** ykarel|away has quit IRC | 07:11 | |
*** rcernin has joined #openstack-infra | 07:12 | |
*** rcernin_ has quit IRC | 07:12 | |
*** slaweq has quit IRC | 07:14 | |
*** olaph1 has joined #openstack-infra | 07:18 | |
*** janki has quit IRC | 07:18 | |
*** olaph has quit IRC | 07:20 | |
*** pcaruana has quit IRC | 07:21 | |
*** pcaruana has joined #openstack-infra | 07:22 | |
*** markvoelker has quit IRC | 07:25 | |
*** markvoelker has joined #openstack-infra | 07:27 | |
gema | ianw: thanks, will look into that today, I started a few yesterday whilst testing the properties and none of them came up with multiple interfaces, trying again now | 07:27 |
*** e0ne has joined #openstack-infra | 07:30 | |
*** kjackal has quit IRC | 07:31 | |
AJaeger | config-core, please put https://review.openstack.org/536952 and https://review.openstack.org/536631 and https://review.openstack.org/536945 on your review queue - those three solve one problem together. | 07:31 |
*** markvoelker has quit IRC | 07:32 | |
*** gridinv has quit IRC | 07:39 | |
*** slaweq has joined #openstack-infra | 07:40 | |
*** armaan has quit IRC | 07:41 | |
*** rwsu has quit IRC | 07:41 | |
*** armaan has joined #openstack-infra | 07:41 | |
*** jamesmcarthur has joined #openstack-infra | 07:42 | |
*** slaweq has quit IRC | 07:45 | |
*** wojdec has joined #openstack-infra | 07:45 | |
*** jamesmcarthur has quit IRC | 07:46 | |
*** gridinv has joined #openstack-infra | 07:47 | |
*** fultonj has quit IRC | 07:47 | |
*** jtomasek has quit IRC | 07:48 | |
*** jtomasek has joined #openstack-infra | 07:49 | |
*** apetrich has quit IRC | 07:52 | |
*** adriant has quit IRC | 07:53 | |
*** trown|outtypewww has quit IRC | 07:53 | |
*** adriant has joined #openstack-infra | 07:53 | |
*** trown has joined #openstack-infra | 07:53 | |
*** shardy has joined #openstack-infra | 08:01 | |
*** e0ne has quit IRC | 08:01 | |
*** pcaruana has quit IRC | 08:01 | |
*** e0ne has joined #openstack-infra | 08:01 | |
*** AJaeger has quit IRC | 08:03 | |
*** apetrich has joined #openstack-infra | 08:05 | |
*** AJaeger has joined #openstack-infra | 08:10 | |
*** alexchadin has joined #openstack-infra | 08:10 | |
*** mandre is now known as mandre_afk | 08:12 | |
*** pcichy has joined #openstack-infra | 08:16 | |
*** florianf has joined #openstack-infra | 08:18 | |
*** aviau has quit IRC | 08:19 | |
*** aviau has joined #openstack-infra | 08:19 | |
*** amoralej|off is now known as amoralej | 08:22 | |
*** tesseract has joined #openstack-infra | 08:27 | |
*** alexchadin has quit IRC | 08:28 | |
*** alexchadin has joined #openstack-infra | 08:29 | |
*** cshastri has joined #openstack-infra | 08:30 | |
*** dingyichen has quit IRC | 08:31 | |
*** oidgar has joined #openstack-infra | 08:34 | |
*** alexchadin has quit IRC | 08:36 | |
*** alexchadin has joined #openstack-infra | 08:36 | |
*** pcaruana has joined #openstack-infra | 08:39 | |
*** russellb has quit IRC | 08:39 | |
*** alexchad_ has joined #openstack-infra | 08:40 | |
*** russellb has joined #openstack-infra | 08:40 | |
*** jbadiapa has joined #openstack-infra | 08:41 | |
*** alexchadin has quit IRC | 08:42 | |
*** rossella_s has quit IRC | 08:44 | |
*** oidgar has quit IRC | 08:44 | |
*** rcernin has quit IRC | 08:44 | |
*** jpena|off is now known as jpena | 08:45 | |
*** s-shiono has quit IRC | 08:45 | |
*** oidgar has joined #openstack-infra | 08:46 | |
*** yamamoto has quit IRC | 08:53 | |
*** oidgar has quit IRC | 08:53 | |
*** tesseract has quit IRC | 08:54 | |
*** jpich has joined #openstack-infra | 08:57 | |
*** rossella_s has joined #openstack-infra | 08:57 | |
*** tesseract has joined #openstack-infra | 09:03 | |
*** rossella_s has quit IRC | 09:05 | |
*** sshnaidm|off is now known as sshnaidm | 09:05 | |
*** wojdec1 has joined #openstack-infra | 09:07 | |
*** mnencia has quit IRC | 09:07 | |
*** harlowja has quit IRC | 09:07 | |
*** freerunner has quit IRC | 09:08 | |
*** rossella_s has joined #openstack-infra | 09:08 | |
*** wojdec has quit IRC | 09:09 | |
*** yamahata has quit IRC | 09:10 | |
*** yamamoto has joined #openstack-infra | 09:10 | |
*** oidgar has joined #openstack-infra | 09:11 | |
*** StigmaGuy has joined #openstack-infra | 09:12 | |
*** mnencia has joined #openstack-infra | 09:14 | |
*** wojdec1 has left #openstack-infra | 09:14 | |
*** freerunner has joined #openstack-infra | 09:14 | |
*** kjackal has joined #openstack-infra | 09:15 | |
*** alexchad_ is now known as alexchadin | 09:15 | |
*** kopecmartin has joined #openstack-infra | 09:16 | |
*** rossella_s has quit IRC | 09:19 | |
*** rossella_s has joined #openstack-infra | 09:20 | |
*** psachin` has quit IRC | 09:24 | |
*** psachin has quit IRC | 09:25 | |
*** kjackal has quit IRC | 09:26 | |
*** ralonsoh has joined #openstack-infra | 09:27 | |
*** markvoelker has joined #openstack-infra | 09:28 | |
*** chrisyang_0660 has joined #openstack-infra | 09:32 | |
*** psachin has joined #openstack-infra | 09:33 | |
*** derekh has joined #openstack-infra | 09:39 | |
*** stakeda has quit IRC | 09:39 | |
*** liujiong has quit IRC | 09:56 | |
*** wolverineav has joined #openstack-infra | 09:57 | |
*** yamamoto has quit IRC | 09:59 | |
*** ralonsoh_ has joined #openstack-infra | 10:01 | |
*** wolverineav has quit IRC | 10:01 | |
*** markvoelker has quit IRC | 10:02 | |
*** electrofelix has joined #openstack-infra | 10:04 | |
*** ralonsoh has quit IRC | 10:04 | |
*** pblaho has joined #openstack-infra | 10:07 | |
*** numans has quit IRC | 10:09 | |
*** rossella_s has quit IRC | 10:09 | |
openstackgerrit | Tobias Henkel proposed openstack-infra/zuul master: Fix builds queued forever after failure to get node request https://review.openstack.org/537335 | 10:10 |
*** numans has joined #openstack-infra | 10:10 | |
*** slaweq has joined #openstack-infra | 10:11 | |
*** rossella_s has joined #openstack-infra | 10:14 | |
*** StigmaGuy has quit IRC | 10:14 | |
*** oidgar has quit IRC | 10:15 | |
openstackgerrit | Chandan Kumar proposed openstack-infra/openstack-zuul-jobs master: Remove neutron-dynamic-routing legacy jobs https://review.openstack.org/528988 | 10:15 |
*** yamamoto has joined #openstack-infra | 10:16 | |
*** jaosorior has quit IRC | 10:16 | |
*** jaosorior has joined #openstack-infra | 10:17 | |
*** kiennt26 has quit IRC | 10:19 | |
*** dtantsur|afk is now known as dtantsur | 10:19 | |
*** sambetts|afk is now known as sambetts | 10:20 | |
*** pgadiya has quit IRC | 10:22 | |
*** pgadiya has joined #openstack-infra | 10:23 | |
*** tosky has joined #openstack-infra | 10:23 | |
*** kjackal has joined #openstack-infra | 10:26 | |
*** zoli is now known as zoli|lunch | 10:26 | |
*** zoli|lunch is now known as zoli | 10:26 | |
*** ldnunes has joined #openstack-infra | 10:28 | |
dmellado | AJaeger: ping do you know if the opensuse repo for clearlinux is failing? | 10:30 |
*** oidgar has joined #openstack-infra | 10:30 | |
dmellado | I'm having troubles since today while trying to use it | 10:31 |
dmellado | Failed to synchronize cache for repo 'home_clearlinux_preview_clear-containers-2.1', disabling | 10:31 |
*** lucas-afk is now known as lucasagomes | 10:33 | |
*** rcernin has joined #openstack-infra | 10:34 | |
*** pbourke has quit IRC | 10:35 | |
*** kjackal has quit IRC | 10:36 | |
*** pbourke has joined #openstack-infra | 10:37 | |
*** cuongnv has quit IRC | 10:37 | |
*** kjackal has joined #openstack-infra | 10:37 | |
*** rosmaita has joined #openstack-infra | 10:38 | |
*** rossella_s has quit IRC | 10:39 | |
*** yankcrime has quit IRC | 10:41 | |
AJaeger | dmellado: no idea. Looking at https://build.opensuse.org/project/show/home:clearlinux:preview:clear-containers-2.1 there was no update for 6 months ;( | 10:41 |
dmellado | :\ | 10:41 |
rosmaita | could someone take a look at https://review.openstack.org/#/c/536939/ ? it's been sitting in the integrated queue for almost 10 hours | 10:42 |
dmellado | AJaeger: it's being used as a part of devstack-plugin-container | 10:42 |
*** slaweq has quit IRC | 10:42 | |
dmellado | https://github.com/openstack/devstack-plugin-container/blob/master/devstack/lib/docker#L164-L170 | 10:43 |
*** slaweq has joined #openstack-infra | 10:43 | |
AJaeger | dmellado: https://download.opensuse.org/repositories/home:/clearlinux:/preview:/clear-containers-2.1/ exists and I see content | 10:43 |
AJaeger | Is this reproduceable? | 10:43 |
dmellado | AJaeger: let me retry it | 10:44 |
AJaeger | dmellado: it looks to me more like a network problem | 10:44 |
*** rossella_s has joined #openstack-infra | 10:45 | |
openstackgerrit | Matthieu Huin proposed openstack-infra/zuul master: [WIP] zuul autohold: allow filtering per commit https://review.openstack.org/536993 | 10:46 |
*** slaweq has quit IRC | 10:48 | |
*** _nick has joined #openstack-infra | 10:49 | |
*** _nick is now known as yankcrime | 10:49 | |
*** rossella_s has quit IRC | 10:51 | |
dmellado | AJaeger: it's interesting, while I can download it using wget | 10:53 |
dmellado | dnf/yum fails to so | 10:53 |
dmellado | http://paste.openstack.org/show/651830/ | 10:53 |
AJaeger | dmellado: strange ;( | 10:53 |
dmellado | another contributir also faced the same issue | 10:53 |
dmellado | I'll try to work around it and push something to the repo | 10:54 |
*** rossella_s has joined #openstack-infra | 10:54 | |
dmellado | the funny thing is that this was just working fine some days ago | 10:54 |
dmellado | ! | 10:54 |
dmellado | but as usual xD | 10:54 |
AJaeger | dmellado: I added the Fedora 26 repo on my openSUSE and can download the metadata, searching works | 10:56 |
*** alexchadin has quit IRC | 10:56 | |
AJaeger | and download works here as well. Do you access a broken mirror by accident? | 10:57 |
dmellado | not that I'm aware | 10:58 |
dmellado | https://paste.fedoraproject.org/paste/4NgOXhGAWXjBSXSvAtDIAw | 10:58 |
*** markvoelker has joined #openstack-infra | 10:58 | |
*** rossella_s has quit IRC | 10:59 | |
*** alexchadin has joined #openstack-infra | 10:59 | |
*** rossella_s has joined #openstack-infra | 10:59 | |
AJaeger | dmellado: looks fine - and https://download.opensuse.org/repositories/home:/clearlinux:/preview:/clear-containers-2.1/Fedora_26/repodata/1696bee0638de7c240f5d583af1b55978de0b77a1cb8e3120560065012fe2635-primary.xml.gz.mirrorlist looks fine as well. | 11:00 |
AJaeger | no ideas ;( | 11:01 |
dmellado | AJaeger: no worries, will try a few things on my own | 11:01 |
dmellado | thanks in any case for checking! | 11:01 |
frickler | dmellado: do you use ipv6 only? download.opensuse.org seems to support it, but the mirror doesn't | 11:01 |
AJaeger | dmellado: hope you figure it out. | 11:01 |
dmellado | frickler: no, I don't | 11:01 |
*** oidgar has quit IRC | 11:02 | |
dmellado | I'm using IPv4 | 11:02 |
dmellado | and wget-ing from the host seems to work | 11:02 |
dmellado | I'm trying to force that dnf/repoquery | 11:02 |
*** ganso has joined #openstack-infra | 11:03 | |
frickler | rosmaita: yes, the gate is very crowded currently. good news is your patch is already at position 14 of about 50 in the queue | 11:05 |
*** wolverineav has joined #openstack-infra | 11:06 | |
*** panda|off is now known as panda | 11:07 | |
*** florianf has quit IRC | 11:10 | |
*** wolverineav has quit IRC | 11:11 | |
*** kjackal has quit IRC | 11:11 | |
*** kjackal has joined #openstack-infra | 11:15 | |
*** florianf has joined #openstack-infra | 11:16 | |
*** gongysh has quit IRC | 11:16 | |
*** rossella_s has quit IRC | 11:18 | |
*** dtantsur is now known as dtantsur|brb | 11:19 | |
*** psachin has quit IRC | 11:19 | |
*** rossella_s has joined #openstack-infra | 11:20 | |
openstackgerrit | Matthieu Huin proposed openstack-infra/zuul master: zuul autohold: allow filtering per commit https://review.openstack.org/536993 | 11:20 |
*** armaan has quit IRC | 11:23 | |
*** bcafarel has joined #openstack-infra | 11:24 | |
*** armaan has joined #openstack-infra | 11:24 | |
*** kjackal has quit IRC | 11:29 | |
*** ldnunes has quit IRC | 11:30 | |
*** ldnunes has joined #openstack-infra | 11:31 | |
*** markvoelker has quit IRC | 11:32 | |
*** jkilpatr has quit IRC | 11:33 | |
rosmaita | frickler: thanks for checking, just wanted to make sure it wasn't in some weird state where it would never get picked up | 11:45 |
*** shardy is now known as shardy_afk | 11:49 | |
openstackgerrit | Jens Harbott (frickler) proposed openstack-infra/openstack-zuul-jobs master: Bump timeout for unit test jobs https://review.openstack.org/537016 | 11:51 |
openstackgerrit | Monty Taylor proposed openstack-infra/zuul master: Update docs to use sphinx-build and doc/requirements https://review.openstack.org/536881 | 11:52 |
frickler | AJaeger: mordred: please take a look at https://review.openstack.org/537016, currently seeing gate failures in both keystone and neutron due to these timeouts | 11:53 |
*** florianf has quit IRC | 11:55 | |
*** oidgar has joined #openstack-infra | 11:55 | |
*** jkilpatr has joined #openstack-infra | 11:55 | |
*** oidgar has quit IRC | 12:01 | |
*** pgadiya has quit IRC | 12:02 | |
*** gpocentek has quit IRC | 12:03 | |
*** ldnunes has quit IRC | 12:03 | |
*** ldnunes has joined #openstack-infra | 12:04 | |
mordred | frickler: +A | 12:04 |
*** florianf has joined #openstack-infra | 12:06 | |
*** dave-mccowan has joined #openstack-infra | 12:09 | |
*** zhurong has joined #openstack-infra | 12:10 | |
*** armaan has quit IRC | 12:13 | |
*** pgadiya has joined #openstack-infra | 12:14 | |
*** jbadiapa has quit IRC | 12:15 | |
*** smatzek has joined #openstack-infra | 12:17 | |
*** oidgar has joined #openstack-infra | 12:18 | |
*** pgadiya_ has joined #openstack-infra | 12:19 | |
*** shardy_afk is now known as shardy | 12:20 | |
*** pgadiya has quit IRC | 12:23 | |
*** slaweq has joined #openstack-infra | 12:24 | |
*** slaweq has quit IRC | 12:29 | |
*** adarazs is now known as adarazs_lunch | 12:29 | |
*** markvoelker has joined #openstack-infra | 12:29 | |
*** panda is now known as panda|lunch | 12:29 | |
*** hrw has quit IRC | 12:29 | |
*** jpena is now known as jpena|lunch | 12:36 | |
*** tpsilva has joined #openstack-infra | 12:45 | |
*** kiennt26 has joined #openstack-infra | 12:48 | |
*** florianf has quit IRC | 12:54 | |
*** florianf has joined #openstack-infra | 12:54 | |
honza | mordred: thanks for the link; while that patch might be necessary, it doesn't actually address my specific issue | 12:55 |
dmellado | AJaeger: I've been checking from some more network locations | 12:57 |
dmellado | and people, and they were hitting the same issue as I did | 12:57 |
dmellado | I'm not sure if you were using some kind of direct suse connection xD | 12:58 |
*** efried_back_wed is now known as efried | 12:58 | |
openstackgerrit | David Shrewsbury proposed openstack-infra/nodepool master: Convert from legacy to native devstack job https://review.openstack.org/535899 | 12:58 |
bcafarel | hi infra cores, can you take a look at https://review.openstack.org/#/c/535390/ ? we'd love meetbot in #networking-sfc to record meetings | 13:01 |
dmellado | bcafarel: hi, king of sfc | 13:01 |
dmellado | xD | 13:01 |
bcafarel | :) | 13:02 |
bcafarel | dmellado: the same, prince of suse | 13:02 |
dmellado | LOL | 13:02 |
*** rosmaita has quit IRC | 13:02 | |
dmellado | if I were the prince of suse I'd make the repo work for me xD | 13:02 |
*** markvoelker has quit IRC | 13:03 | |
*** rosmaita has joined #openstack-infra | 13:04 | |
dmellado | dirk: wouldn't you be so kind of checking the repo status? | 13:04 |
*** trown is now known as trown|ruck | 13:15 | |
*** panda|lunch is now known as panda | 13:15 | |
*** amoralej is now known as amoralej|lunch | 13:19 | |
*** edmondsw has joined #openstack-infra | 13:21 | |
*** edmondsw_ has joined #openstack-infra | 13:22 | |
*** pgadiya_ has quit IRC | 13:25 | |
*** edmondsw has quit IRC | 13:26 | |
openstackgerrit | Monty Taylor proposed openstack-infra/zuul master: Remove webapp https://review.openstack.org/536780 | 13:26 |
openstackgerrit | Monty Taylor proposed openstack-infra/zuul master: Register .json routes with and without suffix https://review.openstack.org/537010 | 13:26 |
openstackgerrit | Monty Taylor proposed openstack-infra/zuul master: Add /info and /{tenant}/info route to zuul-web https://review.openstack.org/537011 | 13:26 |
openstackgerrit | Monty Taylor proposed openstack-infra/zuul master: Add support for configuring graphite_url https://review.openstack.org/537012 | 13:26 |
openstackgerrit | Monty Taylor proposed openstack-infra/zuul master: Move WebInfo config processing into zuul.model https://review.openstack.org/537013 | 13:26 |
openstackgerrit | Monty Taylor proposed openstack-infra/zuul master: Add facility for plugins to register web routes https://review.openstack.org/537014 | 13:26 |
gibi | It seem gerrit pretty slow. Could you just restart it to make it faster? Or is it something else this time? | 13:31 |
*** alexchadin has quit IRC | 13:31 | |
openstackgerrit | Monty Taylor proposed openstack-infra/zuul master: Update docs to use sphinx-build https://review.openstack.org/536881 | 13:31 |
*** sean-k-mooney has quit IRC | 13:32 | |
*** makowals has quit IRC | 13:34 | |
openstackgerrit | Merged openstack-infra/openstack-zuul-jobs master: Bump timeout for unit test jobs https://review.openstack.org/537016 | 13:34 |
*** jbadiapa has joined #openstack-infra | 13:34 | |
*** makowals has joined #openstack-infra | 13:35 | |
openstackgerrit | Honza Pokorny proposed openstack-infra/openstack-zuul-jobs master: Remove build-javascript-tarball job from nodejs-jobs https://review.openstack.org/537383 | 13:37 |
*** jpena|lunch is now known as jpena | 13:38 | |
openstackgerrit | Honza Pokorny proposed openstack-infra/openstack-zuul-jobs master: Remove build-javascript-tarball job from nodejs-jobs https://review.openstack.org/537383 | 13:38 |
*** dsariel has quit IRC | 13:40 | |
*** alexchadin has joined #openstack-infra | 13:40 | |
andreaf | mordred, tobiash: zuul v3 experts :) I see zuulv3 has a github driver, so my question is: is it possible to mix openstack and github repos in the required-projects in a job definition? if so, how? | 13:41 |
*** alexchadin has quit IRC | 13:41 | |
openstackgerrit | Matthieu Huin proposed openstack-infra/zuul master: zuul autohold: allow filtering per commit https://review.openstack.org/536993 | 13:42 |
*** fultonj has joined #openstack-infra | 13:42 | |
*** makowals has quit IRC | 13:43 | |
tobiash | andreaf: yes, that's possible | 13:43 |
tobiash | you just name the repos in required-projects | 13:43 |
tobiash | you don't have to obey anything except if you have naming collisions | 13:43 |
*** rlandy has joined #openstack-infra | 13:44 | |
andreaf | tobiash: how does zuul know whether my project is a github one or an openstack one? | 13:44 |
andreaf | tobiash: heh I probably do have a name collision | 13:44 |
*** makowals has joined #openstack-infra | 13:45 | |
mordred | andreaf: just list it as github.com/foo/bar ... one sec ... | 13:45 |
tobiash | andreaf: and the project needs to be listed in the tenant config | 13:45 |
mordred | andreaf: http://git.openstack.org/cgit/openstack-infra/shade/tree/.zuul.yaml#n185 | 13:46 |
tobiash | and what mordred said | 13:46 |
mordred | andreaf: but yes, also what tobiash said - the project needs to be listed in the zuul main.yaml file for it to be able to go in required-projects | 13:46 |
*** adarazs_lunch is now known as adarazs | 13:47 | |
*** oidgar has quit IRC | 13:47 | |
andreaf | mordred, tobiash: for testing/demo purposes I want to fork an openstack repo on github, make changes and then setup a job (that will never merge) that uses my fork | 13:47 |
*** rcernin has quit IRC | 13:47 | |
andreaf | mordred, tobiash: configuring zuul is a bit of a high bar for this kind of test | 13:48 |
*** florianf has quit IRC | 13:48 | |
mordred | andreaf: nod | 13:49 |
andreaf | and using github or whatever other git is very convenient for experiments as opposed to creating a new project in openstack | 13:49 |
andreaf | I guess the alternative is to maintain a stack of patches on an existing repo in openstack, but that's also a lot of work | 13:50 |
*** daidv has quit IRC | 13:50 | |
*** mhayden has joined #openstack-infra | 13:51 | |
*** mhayden has quit IRC | 13:51 | |
mordred | andreaf: so - depends-on links can be used on arbitrary things | 13:51 |
*** mhayden has joined #openstack-infra | 13:51 | |
mordred | andreaf: https://review.openstack.org/#/c/535541/ is an example (although in that case it didn't work because the sphinx job doesn't do the tox-install-siblings thing) | 13:51 |
*** dsariel has joined #openstack-infra | 13:52 | |
mordred | andreaf: if you look at http://logs.openstack.org/41/535541/1/check/build-openstack-sphinx-docs/c30ac2a/job-output.txt.gz#_2018-01-19_00_34_13_795545 | 13:52 |
mordred | you can see the clone happening | 13:53 |
mordred | I don't know if that's helpful or not though | 13:53 |
*** yamamoto has quit IRC | 13:53 | |
openstackgerrit | Honza Pokorny proposed openstack-infra/openstack-zuul-jobs master: Add always_use_sha variable to publish-openstack-javascript-tarball https://review.openstack.org/537388 | 13:53 |
*** dtantsur|brb is now known as dtantsur | 13:54 | |
andreaf | mordred: yeah I think that's helpful - as long as I can get the repo on the test node somewhere I should be able to use it to run tests | 13:54 |
mordred | andreaf: I think it might be possible in the future to make required-projects able to work with arbitrary urls like depends-on does, but I don't know what kind of timeframe that would be | 13:54 |
mordred | andreaf: woot | 13:54 |
andreaf | thanks! | 13:55 |
*** agopi has joined #openstack-infra | 13:55 | |
*** esberglu has joined #openstack-infra | 13:56 | |
*** esberglu has quit IRC | 13:56 | |
openstackgerrit | Honza Pokorny proposed openstack-infra/project-config master: Add post job to build tarballs for tripleo-ui https://review.openstack.org/537389 | 13:57 |
*** alexchadin has joined #openstack-infra | 13:57 | |
*** eharney has quit IRC | 13:58 | |
*** markvoelker has joined #openstack-infra | 14:00 | |
efried | Howdy folks. gerrit has been grinding since yesterday, getting steadily slower. Known issue? Restarts on the horizon? | 14:00 |
*** weshay|rover is now known as weshay|mtg | 14:00 | |
clarkb | I cant get melody graph data on this wifi connection. Someone else will have to look I guess | 14:01 |
*** coolsvap has quit IRC | 14:02 | |
*** oidgar has joined #openstack-infra | 14:02 | |
*** florianf has joined #openstack-infra | 14:02 | |
*** Goneri has joined #openstack-infra | 14:03 | |
*** jaosorior has quit IRC | 14:05 | |
*** krtaylor has quit IRC | 14:07 | |
AJaeger | dmellado: yes, I'm inside SUSE network... | 14:07 |
snapiri | Infra core: Any chance someone could review https://review.openstack.org/#/c/526053/ (on openstack-dev/devstack), It has one +2 for very long and I would love to get it integrated... | 14:08 |
*** krtaylor has joined #openstack-infra | 14:08 | |
AJaeger | snapiri: devstack is QA project, better ask on #openstack-qa | 14:09 |
*** yamamoto has joined #openstack-infra | 14:10 | |
snapiri | AJaeger: Thanks, will do | 14:10 |
AJaeger | dmellado: looks fine - and https://download.opensuse.org/repositories/home:/clearlinux:/preview:/clear-containers-2.1/Fedora_26/repodata/1696bee0638de7c240f5d583af1b55978de0b77a1cb8e3120560065012fe2635-primary.xml.gz.mirrorlist looks fine as well. | 14:11 |
AJaeger | dmellado: ignore me the above | 14:11 |
AJaeger | dmellado: let's discuss on #opensuse-buildservice, please | 14:11 |
dmellado | AJaeger: sure | 14:11 |
*** amoralej|lunch is now known as amoralej | 14:14 | |
EmilienM | pabelanger, ianw: thx for the mirrors. The APT looks good but the yum isn't here yet, fyi | 14:14 |
*** links has quit IRC | 14:15 | |
*** yamahata has joined #openstack-infra | 14:15 | |
openstackgerrit | David Shrewsbury proposed openstack-infra/nodepool master: Convert from legacy to native devstack job https://review.openstack.org/535899 | 14:16 |
*** smatzek has quit IRC | 14:17 | |
*** esberglu has joined #openstack-infra | 14:17 | |
*** zhurong has quit IRC | 14:18 | |
*** yamahata has quit IRC | 14:24 | |
*** markvoelker has quit IRC | 14:27 | |
*** markvoelker has joined #openstack-infra | 14:27 | |
*** kgiusti has joined #openstack-infra | 14:30 | |
*** yolanda has joined #openstack-infra | 14:32 | |
*** makowals has quit IRC | 14:33 | |
*** lucasagomes is now known as lucas-hungry | 14:35 | |
*** makowals has joined #openstack-infra | 14:36 | |
*** oidgar has quit IRC | 14:39 | |
openstackgerrit | David Shrewsbury proposed openstack-infra/nodepool master: Convert from legacy to native devstack job https://review.openstack.org/535899 | 14:39 |
*** mandre_afk is now known as mandre | 14:41 | |
*** eharney has joined #openstack-infra | 14:44 | |
frickler | infra-root: can someone tell me the url on review.o.o to look at gc data again? somehow I forget to take a note of it. I'd also agree that gerrit is due for a restart | 14:46 |
*** armaan has joined #openstack-infra | 14:47 | |
*** mhayden has quit IRC | 14:49 | |
*** camunoz has joined #openstack-infra | 14:49 | |
*** mhayden has joined #openstack-infra | 14:50 | |
*** jcoufal has joined #openstack-infra | 14:50 | |
*** jcoufal has quit IRC | 14:51 | |
*** slaweq has joined #openstack-infra | 14:51 | |
corvus | frickler: https://review.openstack.org/monitoring | 14:52 |
corvus | frickler: i get a 500 on the graphs | 14:53 |
frickler | corvus: doesn't seem to work for me, either. http://cacti.openstack.org/cacti/graph.php?action=view&local_graph_id=27&rra_id=all looks pretty flat, so I guess I'll do the restart now | 14:54 |
*** oidgar has joined #openstack-infra | 14:54 | |
Roamer` | BTW, on the topic of Gerrit being slow, is it just me, or might there be a problem with it sending out e-mails about comments posted on reviews? So far I don't seem to have received a -V from Zuul and my own "recheck" | 14:55 |
corvus | frickler: let's see if we can find out what the graph error is | 14:55 |
*** markvoelker has quit IRC | 14:55 | |
corvus | frickler: /dev/xvda1 40G 38G 0 100% / | 14:55 |
*** bobh has joined #openstack-infra | 14:55 | |
frickler | corvus: oops, that may explain some things indeed | 14:56 |
*** slaweq has quit IRC | 14:56 | |
corvus | frickler: 11G in root and 24G in var | 14:56 |
corvus | frickler: i think the space in root is due to /root/.bup i don't understand what that dir is for | 14:58 |
*** jcoufal has joined #openstack-infra | 14:58 | |
frickler | corvus: 19G in /var/lib/puppet/reports/review.openstack.org doesn't look sane either | 14:58 |
corvus | mordred: do we write puppet reports to /var/lib/puppet/reports/<host> on all machines? | 14:59 |
*** xarses has quit IRC | 14:59 | |
*** markvoelker has joined #openstack-infra | 14:59 | |
frickler | corvus: I'd say we can remove those from 2016? | 14:59 |
*** olaph1 is now known as olaph | 15:00 | |
openstackgerrit | David Shrewsbury proposed openstack-infra/nodepool master: Support DIB image selection in functional jobs https://review.openstack.org/537408 | 15:00 |
corvus | apparently we do | 15:00 |
corvus | frickler: that seems safe, and we can talk about using logrotate or something later | 15:00 |
corvus | frickler: a lot of the bup data is a cache for bup_review@ci_backup_rs_ord_openstack_org_. i think that's been replaced by bup_review@backup01_ord_rax_ci_openstack_org_. | 15:02 |
corvus | frickler: so i can probably delete the first one | 15:02 |
frickler | corvus: hmm, that was only good for 1G or so | 15:02 |
frickler | corvus: not sure about bup, maybe wait for ianw to comment on that one | 15:02 |
corvus | frickler: i'm pretty sure about it. i set it up. | 15:03 |
mordred | corvus: yes. we are writing reports to that location everywhere | 15:03 |
corvus | frickler: maybe also delete 2017? | 15:03 |
frickler | corvus: I'll delete 20170[1-6]*, that's 8G | 15:05 |
mordred | corvus: we were writing those so that we could collect them and upload them to puppetdb | 15:05 |
corvus | mordred: ack... maybe instead of logrotating them, we could just stop writing them.. | 15:05 |
mordred | corvus: since we don't really have one of those anymore - maybe we should | 15:06 |
mordred | yah | 15:06 |
corvus | i also did an apt-get clean, which recovered 2.6G | 15:07 |
*** slaweq has joined #openstack-infra | 15:07 | |
*** Nil_ has joined #openstack-infra | 15:08 | |
frickler | Roamer`: there seems to be a rather large mail-queue on review.o.o, if you dm me your email address, I can check whether there is some particular error related to it | 15:08 |
corvus | frickler: and yeah, the gc chart looks like it's time to restart. | 15:08 |
*** felipemonteiro has joined #openstack-infra | 15:08 | |
*** felipemonteiro_ has joined #openstack-infra | 15:10 | |
dansmith | are we still having problems with majorly delayed emails from gerrit? | 15:10 |
dansmith | seems like I'm 6-12 hours delayed | 15:10 |
corvus | dansmith: i'll check | 15:10 |
frickler | dansmith: seems there are about 500 queued | 15:10 |
corvus | frickler: those 500 are generally waiting on individual deliveries | 15:10 |
corvus | there isn't a backlog on the host, per se | 15:11 |
*** armax has joined #openstack-infra | 15:11 | |
*** shardy has quit IRC | 15:13 | |
sc` | would these gerrit problems extend to the irc bot? i proposed a change 14 or so hours ago and it never announced in the channel | 15:13 |
corvus | dansmith: the most recent mail i see for you is: 2018-01-24 07:55:18 1eeFst-000965-Rn C="250 2.0.0 Ok: queued as 2F799108AC" | 15:13 |
*** smatzek has joined #openstack-infra | 15:13 | |
corvus | dansmith, frickler, Roamer`: if the root filesystem was full, we will have lost emails from gerrit during that time period | 15:13 |
*** felipemonteiro has quit IRC | 15:13 | |
corvus | dansmith: 1eeFst-000965-Rn was delivered about 1 minute after receipt | 15:14 |
frickler | sc`: there also seems to be a large gap in gerritbot notification, yes. should be fixed now with recovered disk space | 15:15 |
corvus | looks like the disk filled at 08:08 today | 15:15 |
corvus | so the last 7 hours of no email notifications are explained by that | 15:15 |
dansmith | ah okay | 15:16 |
sc` | quite. that makes sense. | 15:17 |
*** lucas-hungry is now known as lucas-brb | 15:17 | |
*** shardy has joined #openstack-infra | 15:17 | |
*** e0ne has quit IRC | 15:18 | |
*** e0ne has joined #openstack-infra | 15:19 | |
*** sshnaidm is now known as sshnaidm|bbl | 15:19 | |
frickler | corvus: shall I do "service gerrit restart", then? | 15:19 |
*** alexchadin has quit IRC | 15:19 | |
corvus | frickler: ++ maybe after doing a #status notice | 15:19 |
openstackgerrit | Tobias Henkel proposed openstack-infra/zuul master: Fix builds queued forever after failure to get node request https://review.openstack.org/537335 | 15:20 |
*** e0ne has quit IRC | 15:20 | |
frickler | corvus: thus? status notice gerrit has been suffering from a full disk, some mails may have been lost in the last couple of hours. we will now restart gerrit to address ongoing slowness, too | 15:21 |
mordred | corvus: ok. SO - we can stop writing the reports by setting "reports" to "none" in the puppet.conf files | 15:21 |
mriedem | we should just bump all job and test timeouts on anything that runs on rax-dfw | 15:21 |
corvus | frickler: lgtm | 15:21 |
mriedem | because lately, everytime i see a timeout, it's usually a rax-dfw node | 15:21 |
*** dhill_ has joined #openstack-infra | 15:21 | |
*** dave-mccowan has quit IRC | 15:22 | |
frickler | mriedem: I don't think we can to this per provider. we did https://review.openstack.org/537016 earlier as a first measure | 15:22 |
frickler | #status notice gerrit has been suffering from a full disk, some mails may have been lost in the last couple of hours. we will now restart gerrit to address ongoing slowness, too | 15:22 |
openstackstatus | frickler: sending notice | 15:22 |
corvus | mriedem: :( any chance there's a problem with the mirror there or something? or pretty sure it's just the cloud itself? | 15:22 |
mordred | corvus: do you remember what mechanism we use to manage our puppet.conf files? | 15:23 |
pabelanger | mordred: ++ | 15:23 |
mriedem | corvus: it's not a package mirror issue, | 15:23 |
mriedem | it's just jobs and tests timing out | 15:23 |
*** sshnaidm|bbl has quit IRC | 15:23 | |
mriedem | i saw a tempest-full job take a full hour longer on rax-dfw than one on infracloud | 15:23 |
-openstackstatus- NOTICE: gerrit has been suffering from a full disk, some mails may have been lost in the last couple of hours. we will now restart gerrit to address ongoing slowness, too | 15:24 | |
pabelanger | mordred: I am not sure it is managed any more, I want to say changes to puppet removal of DIB might have stopped it | 15:24 |
mriedem | frickler: yeah i've been thinking about that for the nova functional jobs | 15:24 |
corvus | mordred: could it be puppet-puppet? | 15:24 |
mordred | well, puppet-puppet is the puppet module we have that can manage puppet.conf settings ... but we don't seem to be using it anywhere | 15:25 |
openstackstatus | frickler: finished sending notice | 15:25 |
mordred | corvus: I'm inclined to go with what pabelanger said - I think we may have lost that file being under management | 15:25 |
corvus | mordred: ansible-role-puppet | 15:25 |
mordred | yah. ansible-role-puppet also can manage the file, but it defaults to false and we are not setting it to true | 15:26 |
*** slaweq has quit IRC | 15:26 | |
mordred | so I think we could either set manage_config: True and puppet_reports: none in our ansible playbook invocatoins of the puppet role | 15:27 |
corvus | mordred: what's the option to manage or not manage puppet.conf? | 15:28 |
mordred | or we could add puppet::puppet to 'openstack_project::server' | 15:28 |
mordred | corvus: manage_config | 15:28 |
*** dprince has joined #openstack-infra | 15:30 | |
corvus | mordred: oh, remote_puppet_adhoc sets it to true, so we get it written during launch-node. and i guess not updated after that. | 15:30 |
mordred | corvus: oh - wow. we set manage_config to true in remote_puppet_adhoc and remote_puppet_infracloud - but nowhere else | 15:30 |
corvus | mordred: also, apparently we manage_config on infracloud (RIP) | 15:30 |
mordred | yah | 15:31 |
corvus | mordred: it seems like it should be okay to do everywhere; i the only thing i'd worry about is cername, but i don't reckon it actually matters anymore? | 15:32 |
corvus | 'certname' even | 15:33 |
Guest28399 | please note that inap-mtl01 is experimenting degraded service with its API, instances are not affected. | 15:33 |
*** Guest28399 is now known as mgagne | 15:33 | |
*** mgagne has joined #openstack-infra | 15:33 | |
mgagne | that was me ^ | 15:33 |
cmurphy | i don't think certname matters to anything anymore | 15:33 |
pabelanger | mgagne: thanks | 15:33 |
*** edmondsw_ is now known as edmondsw | 15:34 | |
*** armaan has quit IRC | 15:34 | |
corvus | mgagne: yep -- though it looks like it may have just gotten better? http://grafana.openstack.org/dashboard/db/nodepool-inap | 15:34 |
*** hongbin has joined #openstack-infra | 15:34 | |
mgagne | working hard to restore service =) | 15:35 |
openstackgerrit | Matthieu Huin proposed openstack-infra/zuul master: zuul autohold: allow filtering per commit https://review.openstack.org/536993 | 15:35 |
openstackgerrit | Monty Taylor proposed openstack-infra/system-config master: Turn off puppet reports https://review.openstack.org/537422 | 15:35 |
mordred | corvus, cmurphy ^^ | 15:36 |
mordred | pabelanger: | 15:36 |
*** yolanda has quit IRC | 15:37 | |
frickler | regarding slow jobs, it would be great if someone would figure out how to repair the "Job runtimes" graph at the bottom of http://grafana.openstack.org/dashboard/db/nodepool* | 15:38 |
* frickler will be looking into slow rush hour traffic now :-/ | 15:40 | |
corvus | infra-root: would you please review https://review.openstack.org/#/q/topic:mailman-templates ? I'll be happy to +W myself if you want -- we need to make sure each lands and is deployed in turn before landing the next. | 15:40 |
corvus | also, that stack uses the new URL-based depends-on syntax, and it looks like it's working, so maybe i should send an email to the dev list now letting folks know about it? | 15:40 |
*** fultonj has quit IRC | 15:41 | |
*** kiennt26 has quit IRC | 15:41 | |
*** wolverineav has joined #openstack-infra | 15:42 | |
*** chem has joined #openstack-infra | 15:43 | |
chem | pabelanger: hi, I've just submitted a backport https://review.openstack.org/537420 to stable/pike from https://review.openstack.org/#/c/530225/ and it has just disappeared | 15:44 |
openstackgerrit | Tobias Henkel proposed openstack-infra/zuul master: Fix cross source dependencies for github https://review.openstack.org/537428 | 15:44 |
corvus | chem: if it was uploading during the gerrit restart, it may have been lost. you may need to upload it again, and if gerrit complains, remove the change-id header (git commit --amend) and let the git hook replace it with a new one | 15:45 |
openstackgerrit | Matt Riedemann proposed openstack-infra/elastic-recheck master: Add query for cinder backup timeout bug 1745168 https://review.openstack.org/537429 | 15:45 |
openstack | bug 1745168 in Cinder "volume backup tests timing out since 1/23" [Undecided,New] https://launchpad.net/bugs/1745168 | 15:45 |
*** dave-mccowan has joined #openstack-infra | 15:46 | |
*** annp has joined #openstack-infra | 15:46 | |
mordred | corvus: I've used the url syntax in a few other places as well and it seems to have worked | 15:46 |
chem | corvus: oki, thanks | 15:47 |
pabelanger | stepping away to run an errand, I should be back in the next hour or so | 15:47 |
chem | corvus: it works and some drop were expected, so everything is fine. Thanks. | 15:47 |
corvus | mordred: have a link to a github depends-on handy? | 15:48 |
mordred | corvus: yah - one sec | 15:49 |
mordred | corvus: https://review.openstack.org/#/c/535541/ | 15:49 |
*** bobh has quit IRC | 15:50 | |
mordred | corvus: and https://review.openstack.org/#/c/520812/ is one that used gerrit url depends-on syntax | 15:50 |
*** mriedem has quit IRC | 15:50 | |
*** david-lyle has joined #openstack-infra | 15:50 | |
*** bobh has joined #openstack-infra | 15:50 | |
*** ssbarnea has quit IRC | 15:51 | |
*** ssbarnea has joined #openstack-infra | 15:51 | |
openstackgerrit | Tobias Henkel proposed openstack-infra/zuul master: Fix runtime stats reporting for noop job https://review.openstack.org/537432 | 15:51 |
*** mriedem has joined #openstack-infra | 15:51 | |
*** e0ne has joined #openstack-infra | 15:52 | |
*** shardy has quit IRC | 16:00 | |
*** shardy has joined #openstack-infra | 16:01 | |
*** sshnaidm|bbl has joined #openstack-infra | 16:03 | |
*** rosmaita_ has joined #openstack-infra | 16:06 | |
*** rossella_s has quit IRC | 16:09 | |
*** rosmaita has quit IRC | 16:09 | |
corvus | mordred: how does https://etherpad.openstack.org/p/CmIyUsn0vE look? i wanted to explain why we're doing it, so i included some github stuff. but if we want to pare that back a bit and announce it later when we have more to show, i could probably make that explanation a bit more basic. | 16:10 |
*** rossella_s has joined #openstack-infra | 16:11 | |
mordred | corvus: I thnk that looks good | 16:12 |
*** bhavik1 has joined #openstack-infra | 16:12 | |
AJaeger | corvus: pleaset update https://docs.openstack.org/infra/manual/developers.html#cross-repository-dependencies for this change | 16:13 |
corvus | AJaeger: yep, will do | 16:13 |
*** fultonj has joined #openstack-infra | 16:14 | |
*** sshnaidm|bbl is now known as sshnaidm | 16:17 | |
*** bhavik1 has quit IRC | 16:19 | |
*** slaweq has joined #openstack-infra | 16:22 | |
*** dougwig has joined #openstack-infra | 16:23 | |
*** lucas-brb is now known as lucasagomes | 16:23 | |
*** ramishra has quit IRC | 16:26 | |
mnaser | "MERGER_FAILURE" is that cleared up? | 16:27 |
*** slaweq has quit IRC | 16:27 | |
*** caphrim007_ has joined #openstack-infra | 16:28 | |
corvus | mnaser: those could be due to the gerrit restart | 16:30 |
mnaser | corvus: cool, rechecked | 16:31 |
*** caphrim007 has quit IRC | 16:31 | |
*** bobh has quit IRC | 16:33 | |
*** felipemonteiro_ has quit IRC | 16:33 | |
*** felipemonteiro_ has joined #openstack-infra | 16:34 | |
*** pcaruana has quit IRC | 16:35 | |
*** annp has quit IRC | 16:35 | |
*** janki has joined #openstack-infra | 16:38 | |
*** janki has quit IRC | 16:39 | |
*** janki has joined #openstack-infra | 16:39 | |
*** e0ne has quit IRC | 16:40 | |
*** slaweq has joined #openstack-infra | 16:40 | |
*** e0ne has joined #openstack-infra | 16:40 | |
openstackgerrit | James E. Blair proposed openstack-infra/infra-manual master: Update depends-on syntax https://review.openstack.org/537451 | 16:41 |
corvus | AJaeger: ^ | 16:41 |
openstackgerrit | Merged openstack-infra/nodepool master: Add a plugin interface for drivers https://review.openstack.org/535551 | 16:41 |
openstackgerrit | Merged openstack-infra/nodepool master: builder: do not cleanup image for driver not managing image https://review.openstack.org/535552 | 16:42 |
AJaeger | jamielennox, could you review https://review.openstack.org/#/c/536096/ , please? | 16:42 |
AJaeger | corvus: thanks | 16:42 |
*** ssbarnea has quit IRC | 16:44 | |
*** ssbarnea has joined #openstack-infra | 16:44 | |
openstackgerrit | David Shrewsbury proposed openstack-infra/nodepool master: Convert from legacy to native devstack job https://review.openstack.org/535899 | 16:45 |
*** slaweq has quit IRC | 16:48 | |
*** pcrews has joined #openstack-infra | 16:49 | |
*** yamamoto has quit IRC | 16:49 | |
openstackgerrit | James E. Blair proposed openstack-infra/zuul master: Fall back on parent jobs from default branch https://review.openstack.org/536998 | 16:50 |
*** oidgar has quit IRC | 16:51 | |
*** kien-ha has joined #openstack-infra | 16:57 | |
*** ihrachys has joined #openstack-infra | 16:58 | |
*** kopecmartin has quit IRC | 16:59 | |
*** gyee has joined #openstack-infra | 16:59 | |
*** rossella_s has quit IRC | 16:59 | |
*** rossella_s has joined #openstack-infra | 17:01 | |
*** bobh has joined #openstack-infra | 17:01 | |
*** gpocentek has joined #openstack-infra | 17:01 | |
*** jcoufal has quit IRC | 17:02 | |
*** hrybacki is now known as hrybacki_mtg | 17:04 | |
*** jcoufal has joined #openstack-infra | 17:04 | |
openstackgerrit | James E. Blair proposed openstack-infra/zuul master: WIP: Fall back on default branch for jobs https://review.openstack.org/537457 | 17:05 |
*** yamamoto has joined #openstack-infra | 17:05 | |
*** yamamoto has quit IRC | 17:07 | |
*** yamamoto has joined #openstack-infra | 17:07 | |
*** yamamoto has quit IRC | 17:07 | |
*** pcrews has quit IRC | 17:07 | |
*** jbadiapa has quit IRC | 17:08 | |
rosmaita_ | could someone take a look at https://review.openstack.org/#/c/536939/ ? it was in the zuul queue, but seems to have disappeared | 17:09 |
*** panda is now known as panda|bbl | 17:11 | |
openstackgerrit | Monty Taylor proposed openstack-infra/zuul master: Add facility for plugins to register web routes https://review.openstack.org/537014 | 17:13 |
*** gyee has quit IRC | 17:15 | |
*** jpich has quit IRC | 17:23 | |
*** zoli is now known as zoli|gone | 17:23 | |
*** zoli|gone is now known as zoli | 17:23 | |
*** slaweq has joined #openstack-infra | 17:24 | |
*** florianf has quit IRC | 17:26 | |
*** felipemonteiro_ has quit IRC | 17:29 | |
*** slaweq has quit IRC | 17:33 | |
*** myoung is now known as myoung|lunch | 17:34 | |
*** yolanda has joined #openstack-infra | 17:35 | |
*** pramodrj07 has joined #openstack-infra | 17:37 | |
openstackgerrit | Merged openstack-infra/elastic-recheck master: Add query for cinder backup timeout bug 1745168 https://review.openstack.org/537429 | 17:39 |
openstack | bug 1745168 in Cinder "volume backup tests timing out since 1/23" [High,In progress] https://launchpad.net/bugs/1745168 - Assigned to Gorka Eguileor (gorka) | 17:39 |
*** trown|ruck is now known as trown|outtypewww | 17:40 | |
*** trown|outtypewww is now known as trown|lunch | 17:40 | |
openstackgerrit | Matt Riedemann proposed openstack-infra/project-config master: Publish release notes for osc-placement https://review.openstack.org/537465 | 17:41 |
*** cshastri has quit IRC | 17:41 | |
*** slaweq has joined #openstack-infra | 17:43 | |
corvus | rosmaita_: i think zuul reported on it during the gerrit restart. it will need a recheck | 17:43 |
mordred | rosmaita_: you're having all the luck this week | 17:47 |
rosmaita_ | no kidding | 17:47 |
rosmaita_ | corvus does that mean re-running all the tests, etc? | 17:48 |
rosmaita_ | (he asked hopefully, realizing that the answer is "of course it does") | 17:48 |
smcginnis | Yep, unfortunately. | 17:49 |
*** gouthamr has joined #openstack-infra | 17:49 | |
*** slaweq has quit IRC | 17:49 | |
rosmaita_ | :( | 17:49 |
AJaeger | config-core, could you review https://review.openstack.org/#/c/536092/ , please? The dependency has merged, we can remove the job now. | 17:51 |
*** ldnunes has quit IRC | 17:51 | |
*** rosmaita_ is now known as rosmaita | 17:52 | |
*** mdrabe has quit IRC | 17:53 | |
*** mdrabe has joined #openstack-infra | 17:53 | |
rosmaita | corvus: i don | 17:55 |
rosmaita | 't want to waste resources, so if a review is +2A but does not show up on zuul.openstack.org, then a recheck is in order? | 17:55 |
*** gouthamr has joined #openstack-infra | 17:56 | |
EmilienM | pabelanger: I'm missing the gpg keys on http://mirror.iad.rax.openstack.org/apt-puppetlabs/ | 17:57 |
EmilienM | pabelanger: see https://apt.puppetlabs.com/ | 17:57 |
EmilienM | pabelanger: can you please add them? | 17:57 |
corvus | rosmaita: generally, yes -- but since this is due to a system malfunction, we could probably directly re-enqueue it | 17:57 |
EmilienM | pabelanger: I need https://apt.puppetlabs.com/DEB-GPG-KEY-puppet in the mirror to be precise | 17:58 |
rosmaita | corvus ty, but i already hit re-check and it's in the queue again | 17:58 |
rosmaita | i think this one also got hit, though: https://review.openstack.org/#/c/536946/ | 17:59 |
corvus | rosmaita: it's in both now :) | 17:59 |
*** kien-ha has quit IRC | 17:59 | |
corvus | rosmaita: i've enqued that one as well | 18:00 |
*** xinliang has quit IRC | 18:00 | |
rosmaita | corvus ty! if you will be in dublin for the ptg, i will buy you a beverage | 18:00 |
corvus | rosmaita: np, sorry for the inconvenience. i'm hoping soon we can re-add the pause functionality to zuul, and make it safer to restart gerrit without losing reports | 18:01 |
corvus | also, the second change hasn't finished enqueuing yet, but it should soon. | 18:01 |
rosmaita | corvus: thanks, appreciate your help | 18:02 |
*** ldnunes has joined #openstack-infra | 18:03 | |
*** myoung|lunch is now known as myoung | 18:04 | |
*** xinliang has joined #openstack-infra | 18:04 | |
*** xinliang has quit IRC | 18:04 | |
*** xinliang has joined #openstack-infra | 18:04 | |
*** david-lyle has quit IRC | 18:04 | |
*** derekh is now known as derekh_afk | 18:07 | |
*** yamamoto has joined #openstack-infra | 18:07 | |
*** sambetts is now known as sambetts|afk | 18:08 | |
*** janki has quit IRC | 18:08 | |
*** tesseract has quit IRC | 18:08 | |
*** dsariel has quit IRC | 18:12 | |
*** jpena is now known as jpena|off | 18:12 | |
*** hrybacki_mtg is now known as hrybacki | 18:14 | |
*** rkukura has joined #openstack-infra | 18:16 | |
*** yamamoto has quit IRC | 18:18 | |
*** shardy is now known as shardy_afk | 18:20 | |
*** e0ne has quit IRC | 18:28 | |
prometheanfire | we have to issue rechecks? | 18:30 |
*** ralonsoh_ has quit IRC | 18:30 | |
*** pramodrj07 has quit IRC | 18:31 | |
*** Pramod has joined #openstack-infra | 18:31 | |
*** electrofelix has quit IRC | 18:32 | |
*** rkukura has quit IRC | 18:33 | |
openstackgerrit | Merged openstack-infra/infra-manual master: Update depends-on syntax https://review.openstack.org/537451 | 18:35 |
pabelanger | EmilienM: we don't usually store gpg keys on mirrors, find it is usually better just to add them into jobs themself (avoids downloading them each time) | 18:44 |
*** ralonsoh has joined #openstack-infra | 18:45 | |
EmilienM | pabelanger: well the key is on their server | 18:47 |
EmilienM | pabelanger: so you want me to download the key from their servers? | 18:47 |
pabelanger | EmilienM: that or copy it intree, so you don't depend on the network | 18:47 |
pabelanger | for other repos, we don't really manage GPG keys | 18:47 |
EmilienM | pabelanger: mhh it's duplication | 18:47 |
EmilienM | pabelanger: what if they change the key | 18:47 |
EmilienM | which happens quite often | 18:48 |
pabelanger | then packages won't be signed properly | 18:48 |
EmilienM | yeah I figured | 18:48 |
EmilienM | but I would rather mirror their keyring | 18:48 |
pabelanger | and we'd need to re-import with reprepro I think | 18:48 |
EmilienM | you're the boss | 18:49 |
EmilienM | but I don't think that's right | 18:49 |
mriedem | we might want to consider pushing https://review.openstack.org/#/c/537437 to top of gate, | 18:49 |
pabelanger | okay, submit a patch to system-config and lets see what others say. But we cannot manually just add it | 18:49 |
mriedem | because it's causing a lot of resets and failures | 18:49 |
pabelanger | will need to be part of system-config | 18:50 |
mriedem | clarkb: fungi: ^ | 18:54 |
*** trown|lunch is now known as trown | 18:54 | |
mriedem | probably going to have a hell of a time landing stuff until https://review.openstack.org/#/c/537437 is merged | 18:54 |
pabelanger | let me look | 18:54 |
pabelanger | looks like we'd have to enqueue first then promote | 18:55 |
*** Pramod has quit IRC | 18:56 | |
pabelanger | mriedem: looks like it would only affect stable/pike, is thet right? | 18:56 |
pabelanger | that* | 18:56 |
mriedem | pabelanger: no master | 18:57 |
mriedem | it was a regression introduced yesterday | 18:57 |
pabelanger | oh, right. I see that now | 18:57 |
pabelanger | okay, give me a moment | 18:57 |
*** ihrachys has quit IRC | 18:58 | |
*** ihrachys has joined #openstack-infra | 18:58 | |
*** felipemonteiro has joined #openstack-infra | 19:00 | |
pabelanger | okay, enqueued and promoted 537437,2 | 19:01 |
pabelanger | #status log enqueued and promoted 537437,2 at the request of mriedem to avoid regression in gate | 19:01 |
openstackstatus | pabelanger: finished logging | 19:01 |
*** felipemonteiro_ has joined #openstack-infra | 19:02 | |
mriedem | pabelanger: cool thanks | 19:03 |
*** jtomasek has quit IRC | 19:05 | |
*** dsariel has joined #openstack-infra | 19:05 | |
*** felipemonteiro has quit IRC | 19:06 | |
*** rkukura has joined #openstack-infra | 19:08 | |
*** lucasagomes is now known as lucas-afk | 19:10 | |
openstackgerrit | Monty Taylor proposed openstack-infra/openstack-zuul-jobs master: Shift infra doc templates to use build-sphinx-docs https://review.openstack.org/537609 | 19:10 |
openstackgerrit | Paul Belanger proposed openstack-infra/project-config master: WIP: Remove tripleo pipelines from zuul https://review.openstack.org/537611 | 19:12 |
ihrachys | when a job failed with POST_FAILURE but nothing of interest in logdir (all tests passed, files collected), should I just recheck? I think we see those more often lately. I wonder if we should make an effort to understand what happened there. | 19:14 |
pabelanger | ihrachys: do you have an example of failure, usually means we might of had networking issue uploading logs | 19:15 |
ihrachys | pabelanger, http://logs.openstack.org/08/533308/1/check/legacy-tempest-dsvm-neutron-full/697fbff/ | 19:15 |
AJaeger | )config-core, could you review https://review.openstack.org/536097 and https://review.openstack.org/536092 - the jobs are in-repo now and can be removed from project-config. | 19:16 |
pabelanger | ihrachys: yah, looks like networking issue: http://logs.openstack.org/08/533308/1/check/legacy-tempest-dsvm-neutron-full/697fbff/job-output.txt.gz#_2018-01-24_16_44_32_119259 | 19:16 |
ihrachys | oh I haven't looked high enough in the log, sorry, yeah | 19:17 |
pabelanger | ihrachys: in that case, a recheck is fine. But we should also see if there is issues in rackspace | 19:17 |
*** david-lyle has joined #openstack-infra | 19:17 | |
openstackgerrit | Paul Belanger proposed openstack-infra/project-config master: WIP: Remove tripleo pipelines from zuul https://review.openstack.org/537611 | 19:17 |
ihrachys | pabelanger, ack! thanks for checking. | 19:18 |
pabelanger | np. I haven't look at logstash in a while, but could be a something more happening | 19:19 |
dirk | dmellado: sorry, your message scrolled out of my backlog - which repo status? | 19:20 |
ihrachys | what's this garbage in console output? http://logs.openstack.org/98/536598/1/check/puppet-openstack-integration-4-scenario001-tempest-centos-7/92f940b/job-output.txt.gz#_2018-01-23_19_34_32_572747 looks like several processes dumping into console in parallel? | 19:21 |
*** jkilpatr has quit IRC | 19:22 | |
*** wolverineav has quit IRC | 19:26 | |
*** pcaruana has joined #openstack-infra | 19:27 | |
*** pcaruana has quit IRC | 19:27 | |
*** wolverineav has joined #openstack-infra | 19:27 | |
*** ralonsoh has quit IRC | 19:28 | |
*** e0ne has joined #openstack-infra | 19:28 | |
*** felipemonteiro_ has quit IRC | 19:32 | |
*** muttley has joined #openstack-infra | 19:32 | |
openstackgerrit | Michael Johnson proposed openstack-infra/project-config master: Add release notes job to octavia-dashboard https://review.openstack.org/537618 | 19:34 |
*** e0ne_ has joined #openstack-infra | 19:35 | |
*** jkilpatr has joined #openstack-infra | 19:37 | |
*** e0ne has quit IRC | 19:38 | |
*** harlowja has joined #openstack-infra | 19:38 | |
*** yamahata has joined #openstack-infra | 19:39 | |
openstackgerrit | Merged openstack-infra/nodepool master: Add provider info command https://review.openstack.org/535817 | 19:39 |
*** slaweq has joined #openstack-infra | 19:45 | |
*** dtantsur is now known as dtantsur|afk | 19:46 | |
*** amoralej is now known as amoralej|off | 19:46 | |
*** muttley has quit IRC | 19:48 | |
*** slaweq has quit IRC | 19:52 | |
*** camunoz has quit IRC | 19:54 | |
*** dave-mccowan has quit IRC | 19:58 | |
*** wolverineav has quit IRC | 20:02 | |
*** wolverineav has joined #openstack-infra | 20:03 | |
openstackgerrit | Emilien Macchi proposed openstack-infra/system-config master: Revert "Revert "Add Puppetlabs mirror for CentOS7"" https://review.openstack.org/537633 | 20:03 |
openstackgerrit | Emilien Macchi proposed openstack-infra/system-config master: Revert "Revert "Add Puppetlabs mirror for CentOS7"" https://review.openstack.org/537633 | 20:03 |
openstackgerrit | Luz Cazares proposed openstack-infra/project-config master: Added NodeJS v6 jobs to check pipeline https://review.openstack.org/537634 | 20:05 |
AJaeger | config-core, could you review https://review.openstack.org/536097, https://review.openstack.org/536092, https://review.openstack.org/#/c/535812/ , please? the jobs are in-repo now and can be removed from project-config. | 20:06 |
*** camunoz has joined #openstack-infra | 20:09 | |
*** ldnunes has quit IRC | 20:15 | |
openstackgerrit | Emilien Macchi proposed openstack-infra/system-config master: Revert "Revert "Add Puppetlabs mirror for CentOS7"" https://review.openstack.org/537633 | 20:16 |
EmilienM | ianw: ^ ready for review. I need to go now, bbl | 20:16 |
*** slaweq has joined #openstack-infra | 20:17 | |
openstackgerrit | Luz Cazares proposed openstack-infra/project-config master: Make py35 jobs voting for refstack-client https://review.openstack.org/537639 | 20:17 |
*** e0ne_ has quit IRC | 20:19 | |
*** dtruong has joined #openstack-infra | 20:20 | |
*** gouthamr has quit IRC | 20:26 | |
*** slaweq has quit IRC | 20:29 | |
openstackgerrit | Doug Hellmann proposed openstack-infra/project-config master: remove the custom release permissions for storyboardclient https://review.openstack.org/537647 | 20:29 |
openstackgerrit | Merged openstack-infra/nodepool master: Fix race in test_provider_removal https://review.openstack.org/536540 | 20:30 |
ianw | EmilienM: cool, i will try it out directly | 20:32 |
openstackgerrit | Pino de Candia proposed openstack-infra/project-config master: Adding new project Tatu (SSH as a Service). https://review.openstack.org/511335 | 20:34 |
*** camunoz has quit IRC | 20:37 | |
*** slaweq has joined #openstack-infra | 20:39 | |
*** slaweq has quit IRC | 20:39 | |
openstackgerrit | Merged openstack-infra/nodepool master: Remove shade_inner_exceptions https://review.openstack.org/536636 | 20:40 |
openstackgerrit | Merged openstack-infra/nodepool master: Set app_name and app_version https://review.openstack.org/536854 | 20:40 |
*** slaweq has joined #openstack-infra | 20:40 | |
openstackgerrit | Merged openstack-infra/system-config master: Fix zuulv3 links https://review.openstack.org/532605 | 20:41 |
*** dave-mccowan has joined #openstack-infra | 20:41 | |
ianw | infra-root: if i could get a couple of eyes on https://review.openstack.org/#/c/536990/ for adding linaro to cloud-launcher config that would be good | 20:42 |
ianw | i reported yesterday that vm's were coming up with multiple interfaces, turns out there was a couple of failing compute nodes, so the hosts were failing and bounced around and collected interfaces until it found somewhere to boot :) | 20:43 |
*** jtomasek has joined #openstack-infra | 20:45 | |
*** slaweq_ has joined #openstack-infra | 20:45 | |
mordred | ianw: wow fun! | 20:46 |
*** slaweq has quit IRC | 20:47 | |
openstackgerrit | Pino de Candia proposed openstack-infra/project-config master: Adding new project for Tatu (SSH as a Service) Horizon Plugin. https://review.openstack.org/537653 | 20:48 |
*** slaweq_ has quit IRC | 20:50 | |
openstackgerrit | Ian Wienand proposed openstack-infra/system-config master: Revert "Revert "Add Puppetlabs mirror for CentOS7"" https://review.openstack.org/537633 | 20:51 |
openstackgerrit | Darragh Bailey proposed openstack/python-jenkins master: Migration to using requests https://review.openstack.org/205637 | 20:51 |
ianw | EmilienM / pabelanger: ^^ few minor tweaks for syntax and copy path, but LGTM. i am running the initial sync manually now, will let you know when it's done for confirmation it looks right, then we can merge | 20:52 |
corvus | ianw, pabelanger: can you +2 https://review.openstack.org/#/q/topic:mailman-templates ? i'll handle the +W sequencing | 20:57 |
*** e0ne has joined #openstack-infra | 21:00 | |
pabelanger | sure | 21:01 |
*** jtomasek has quit IRC | 21:03 | |
openstackgerrit | James E. Blair proposed openstack-infra/zuul master: Use override-checkout to select jobs https://review.openstack.org/537655 | 21:06 |
ianw | mirror-update --> afs: Lost contact with file server 104.130.138.161 in cell openstack.org (code -512) | 21:06 |
ianw | :/ | 21:06 |
*** esberglu has quit IRC | 21:08 | |
*** esberglu has joined #openstack-infra | 21:09 | |
corvus | ianw: it did regain connectivity 28 seconds later | 21:09 |
*** chason has quit IRC | 21:10 | |
ianw | yeah, it seemed to bork the rsync though as it failed one of the files | 21:14 |
*** chason has joined #openstack-infra | 21:15 | |
*** e0ne has quit IRC | 21:20 | |
*** smatzek has quit IRC | 21:21 | |
*** yamahata has quit IRC | 21:21 | |
*** slaweq has joined #openstack-infra | 21:21 | |
*** slaweq has quit IRC | 21:22 | |
*** ekcs has joined #openstack-infra | 21:23 | |
rosmaita | corvus if you have a minute, could you take a look at https://review.openstack.org/#/c/536939/ again? | 21:24 |
openstackgerrit | Merged openstack-infra/system-config master: Add linaro to cloud launcher https://review.openstack.org/536990 | 21:25 |
*** dave-mccowan has quit IRC | 21:25 | |
ekcs | hi, looking for some help here. congress-dashboard doesn’t seem to be getting requirements updates from proposal bot. I think something’s wrong with our project config. Trying to find out exactly what. | 21:25 |
*** jbadiapa has joined #openstack-infra | 21:27 | |
corvus | rosmaita: it's still in the gate queue. check just reported first. | 21:28 |
corvus | rosmaita: looks lo be at least 1.5hours out, if all goes well. | 21:29 |
*** rosmaita has quit IRC | 21:29 | |
*** dprince has quit IRC | 21:30 | |
*** weshay|mtg is now known as weshay|rover | 21:34 | |
*** trown is now known as trown|ruck | 21:34 | |
openstackgerrit | David Shrewsbury proposed openstack-infra/nodepool master: Split out erasing from 'info' command into 'erase' https://review.openstack.org/537663 | 21:36 |
*** panda|bbl is now known as panda | 21:41 | |
*** threestrands has joined #openstack-infra | 21:41 | |
*** sshnaidm has quit IRC | 21:42 | |
openstackgerrit | David Shrewsbury proposed openstack-infra/nodepool master: Support DIB image selection in functional jobs https://review.openstack.org/537408 | 21:44 |
*** threestrands_ has joined #openstack-infra | 21:44 | |
*** threestrands_ has quit IRC | 21:44 | |
*** threestrands_ has joined #openstack-infra | 21:44 | |
*** threestrands has quit IRC | 21:47 | |
openstackgerrit | James E. Blair proposed openstack-infra/project-config master: Add zuul-website repo https://review.openstack.org/537670 | 21:49 |
*** larainema has quit IRC | 21:49 | |
*** eharney has quit IRC | 21:54 | |
*** kien-ha has joined #openstack-infra | 21:55 | |
*** eharney has joined #openstack-infra | 21:56 | |
*** smatzek has joined #openstack-infra | 21:56 | |
*** eharney has quit IRC | 21:59 | |
*** smatzek has quit IRC | 22:01 | |
openstackgerrit | James E. Blair proposed openstack-infra/project-config master: Add zuul-website repo https://review.openstack.org/537670 | 22:02 |
*** trown|ruck is now known as trown|outtypewww | 22:03 | |
*** dsariel has quit IRC | 22:04 | |
*** tpsilva has quit IRC | 22:07 | |
*** rmcall has quit IRC | 22:09 | |
*** Goneri has quit IRC | 22:11 | |
*** ihrachys_ has joined #openstack-infra | 22:13 | |
*** ihrachys has quit IRC | 22:13 | |
openstackgerrit | Merged openstack-infra/puppet-mailman master: Create per-site template directories https://review.openstack.org/535848 | 22:13 |
*** kgiusti has left #openstack-infra | 22:13 | |
*** rosmaita has joined #openstack-infra | 22:14 | |
*** rcernin has joined #openstack-infra | 22:14 | |
*** kien-ha has quit IRC | 22:15 | |
rosmaita | corvus ty | 22:17 |
openstackgerrit | Doug Hellmann proposed openstack-infra/python-storyboardclient master: change default python 3 env in tox to 3.5 https://review.openstack.org/537687 | 22:20 |
openstackgerrit | Doug Hellmann proposed openstack-infra/python-storyboardclient master: ignore .stestr output directory https://review.openstack.org/537688 | 22:20 |
openstackgerrit | Doug Hellmann proposed openstack-infra/python-storyboardclient master: use six to make iteritems python 2/3 compatible https://review.openstack.org/537689 | 22:21 |
*** bobh has quit IRC | 22:28 | |
*** rcernin has quit IRC | 22:29 | |
*** jrist has quit IRC | 22:29 | |
*** chkumar246 has joined #openstack-infra | 22:30 | |
*** jrist has joined #openstack-infra | 22:30 | |
*** sshnaidm has joined #openstack-infra | 22:31 | |
*** rcernin has joined #openstack-infra | 22:31 | |
*** chandankumar has quit IRC | 22:32 | |
EmilienM | ianw: ok! thanks so much for your help | 22:33 |
*** chkumar246 has quit IRC | 22:35 | |
*** chkumar246 has joined #openstack-infra | 22:36 | |
ianw | mhayden: i'm 99.9999% sure i'm missing context in your email to openstack-dev ... but do/can our infra wheel mirrors help at all? | 22:38 |
mhayden | ianw: the mirrors help a lot -- the problem is that we're building all of the clients in osa (per heat's requirements.txt), but we only need a subset of them | 22:38 |
mhayden | some of them have heavy deps | 22:38 |
ianw | mhayden: when you say clients ... is there a tl;dr on what that means? | 22:40 |
mhayden | oh, i mean like python-swiftclient python-novaclient python-monascaclient | 22:41 |
mhayden | heat has them all in its requirements.txt because it needs them to use those various apis | 22:41 |
ianw | ahh, ok | 22:42 |
ianw | so that build, is happening via osa ... and in that environment pip isn't setup to look at our mirrors for the prebuilt wheels? | 22:42 |
*** wolverineav has quit IRC | 22:44 | |
*** wolverineav has joined #openstack-infra | 22:44 | |
*** edmondsw has quit IRC | 22:47 | |
*** wolverineav has quit IRC | 22:49 | |
*** tosky has quit IRC | 22:49 | |
*** claudiub has quit IRC | 22:50 | |
corvus | pabelanger: the current launcher configuration is stable, so new hosts have the correct hostname config. we just need to update the old executors to match. | 22:55 |
corvus | pabelanger: http://lists.openstack.org/pipermail/openstack-infra/2018-January/005761.html | 22:55 |
pabelanger | okay, I'll work on that in the morning | 22:56 |
pabelanger | and see what we need to change | 22:56 |
*** esberglu has quit IRC | 22:56 | |
corvus | okay, the first of the mailman template changes has landed, been applied and looks good. i'm approving the next now. | 22:57 |
smcginnis | Looks like we had a release job fail with what I suspect is a temporary network failure: | 23:01 |
smcginnis | http://logs.openstack.org/cb/cb4f0e814b6b250309246611b0f5d37aba3bbbdf/pre-release/release-openstack-python/8012d1f/job-output.txt.gz#_2018-01-24_22_44_37_577509 | 23:01 |
smcginnis | Could someone re-enqueue this job for us? | 23:02 |
smcginnis | I have the special FungiScript for that if needed. | 23:02 |
notmyname | hi, infra. I'm waiting on 536633 to land (currently going on 24+ hours in the gate). The trick is that I need it in order to get a SHA for the release, and the client deadline is coming quickly! | 23:04 |
notmyname | is there anything to do other than, "be patient, good luck!"? | 23:04 |
mordred | notmyname: looks like it's still actively in the gate - so I think 'be patient' is all I've got for you | 23:08 |
*** eharney has joined #openstack-infra | 23:08 | |
dhellmann | is paste.openstack.org down? | 23:11 |
smcginnis | I am not able to get to it. | 23:12 |
smcginnis | Oh, there it is. Took a very long time. | 23:12 |
dhellmann | smcginnis : while you're here, it sounds like notmyname is running into gate length issues so we may have a late-ish client release from him. | 23:14 |
smcginnis | dhellmann: Yep, saw that. I'll make a note that things could be delayed notmyname. | 23:14 |
notmyname | thanks | 23:15 |
*** jamesmcarthur has joined #openstack-infra | 23:15 | |
smcginnis | pabelanger, corvus: Would either of you be able to help with the re-enqueue request above? | 23:16 |
*** yamahata has joined #openstack-infra | 23:17 | |
corvus | smcginnis: ah yep | 23:19 |
smcginnis | corvus: Thanks! | 23:19 |
corvus | smcginnis: what's this fungi magic? that sounds helpful | 23:19 |
openstackgerrit | Merged openstack-infra/irc-meetings master: Change Heat meeting schedule https://review.openstack.org/536803 | 23:21 |
*** jamesmcarthur has quit IRC | 23:24 | |
smcginnis | corvus: Sorry, having some issues of my own here. This is what he said he uses to get the re-enqueue command: http://paste.openstack.org/show/652914/ | 23:26 |
openstackgerrit | Merged openstack-infra/system-config master: Add openstack branded mailman templates https://review.openstack.org/535851 | 23:26 |
corvus | sudo zuul enqueue-ref --tenant=openstack --trigger=gerrit --pipeline=pre-release --project=openstack/octavia-dashboard --ref=refs/tags/1.0.0.0b3 --newrev=cb4f0e814b6b250309246611b0f5d37aba3bbbdf | 23:27 |
corvus | smcginnis: that produces that ^; that seem reasonable? | 23:28 |
smcginnis | Looks right, from what I know of it. | 23:28 |
corvus | smcginnis: done | 23:28 |
smcginnis | corvus: Thank you. Hopefully better luck this time. | 23:29 |
*** derekh_afk has quit IRC | 23:33 | |
*** apetrich has quit IRC | 23:35 | |
timburke | hi all! i was hoping someone could help me figure out what's going on with zuulv3 and a feature branch | 23:39 |
timburke | i ran into trouble with a merge from master that removed a job from .zuul.yaml -- https://review.openstack.org/#/c/535990/-1..3/.zuul.yaml | 23:40 |
*** rlandy is now known as rlandy|bbl | 23:41 | |
timburke | in the name of expediency, i added back a no-op tox env so we could get the merge in and keep working on other things | 23:41 |
timburke | and did a follow-up to remove it: https://review.openstack.org/#/c/536517/ | 23:42 |
timburke | i suppose unsurprisingly, this change *also* wants to run the now-removed job, and fails when it can't :-/ | 23:42 |
*** jamesmcarthur has joined #openstack-infra | 23:43 | |
timburke | so... does anyone know *why*? or what i need to remove where to get rid of the thing? | 23:43 |
*** armax has quit IRC | 23:43 | |
mordred | corvus: ^^ this one might be a you question | 23:44 |
*** jamesmcarthur has quit IRC | 23:47 | |
mordred | timburke: I don't see swift-tox-func-post-as-copy in swift's master .zuul.yaml | 23:47 |
timburke | nope. nor on feature/deep | 23:48 |
mordred | ok. so it *was* on feature/deep and only on feature/deep and this merge from master wants to remove it, yeah? | 23:48 |
timburke | yes. and i got the merge landed, by adding a tox env that just runs `true` | 23:49 |
mordred | ah - gotcha. so that's why I'm not seeing it. | 23:49 |
timburke | i'd rather like to get rid of the hack, but the follow-up fails like the merge originally did | 23:49 |
mordred | timburke: k. so - (talking out loud as I look at things) ... | 23:50 |
mordred | timburke: if you look in here: http://logs.openstack.org/17/536517/1/check/swift-tox-func-post-as-copy/a48ce51/zuul-info/inventory.yaml you can see the inheritance path for the job - which will tell you where zuul thinks the job is coming from | 23:52 |
corvus | (i'm here and following along) | 23:52 |
timburke | all right... | 23:53 |
johnsom | pre-release failed again for octavia-dashboard | 23:53 |
johnsom | HTTPError: 400 Client Error: File already exists. for url: https://upload.pypi.org/legacy/ | 23:54 |
mordred | corvus: hrm. so ... I have pulled that change, as well as tip of feature/deep ... | 23:54 |
mordred | corvus: and I do not see swift-tox-func-post-as-copy defined :( | 23:54 |
johnsom | I can remove the pypi version if you would like | 23:55 |
*** hongbin has quit IRC | 23:56 | |
mordred | johnsom: what are you trying to accomplish? 1.0.0.0b43 seems to be there on pypi? | 23:56 |
timburke | makes me wonder what repo it's looking at... or maybe which feature/deep? if whatever checkout it's using grabbed a local copy and hasn't pulled in the latest changes... | 23:56 |
johnsom | mordred The pre-release job failed mid-way the first time. http://zuul.openstack.org/builds.html (pipeline: pre-release, project: openstack/octavia-dashboard) | 23:57 |
johnsom | mordred Someone re-enqueued it, but it failed again. | 23:57 |
corvus | smcginnis: ^ | 23:57 |
pabelanger | looking at http://logs.openstack.org/cb/cb4f0e814b6b250309246611b0f5d37aba3bbbdf/pre-release/release-openstack-python/8012d1f/job-output.txt.gz#_2018-01-24_22_44_37_577572 is wasn't pypi publish that failed but task to remove SSH keys | 23:59 |
pabelanger | we actually uploaded the package properly | 23:59 |
*** dingyichen has joined #openstack-infra | 23:59 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!