| *** dimtruck is now known as zz_dimtruck | 00:00 | |
| *** soliosg has quit IRC | 00:00 | |
| *** esikachev has joined #openstack-infra | 00:04 | |
| openstackgerrit | Clint 'SpamapS' Byrum proposed openstack-infra/zuul: Re-enable test_dependent_behind_dequeue https://review.openstack.org/413768 | 00:04 |
|---|---|---|
| *** wolverineav has joined #openstack-infra | 00:05 | |
| *** esikachev has quit IRC | 00:09 | |
| *** wolverineav has quit IRC | 00:09 | |
| *** hongbin has quit IRC | 00:12 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/nodepool: [WIP] Reduce min-ram for ubuntu images for devstack testing https://review.openstack.org/413807 | 00:14 |
| *** wolverineav has joined #openstack-infra | 00:15 | |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul: Fix race condition in test_success_url https://review.openstack.org/413811 | 00:17 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul: Improve test output https://review.openstack.org/413812 | 00:17 |
| *** wolverineav has quit IRC | 00:19 | |
| *** gildub has joined #openstack-infra | 00:22 | |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul: Improve test output https://review.openstack.org/413812 | 00:22 |
| *** pfalleno1 is now known as pfallenop | 00:23 | |
| *** zz_dimtruck is now known as dimtruck | 00:24 | |
| *** llu has joined #openstack-infra | 00:24 | |
| *** mtanino has quit IRC | 00:25 | |
| *** wolverineav has joined #openstack-infra | 00:25 | |
| *** rbuzatu has joined #openstack-infra | 00:25 | |
| llu | hello gurus, I'm wondering why the patch https://review.openstack.org/#/c/413362/ is waiting in the experimental queue for more than 20 hours? | 00:25 |
| *** xarses has quit IRC | 00:26 | |
| *** amoralej|off has quit IRC | 00:28 | |
| *** ajo has quit IRC | 00:29 | |
| *** wolverineav has quit IRC | 00:29 | |
| *** jschwarz has quit IRC | 00:29 | |
| *** dmellado has quit IRC | 00:29 | |
| *** pfallenop has quit IRC | 00:30 | |
| *** pfallenop has joined #openstack-infra | 00:30 | |
| *** geguileo has quit IRC | 00:30 | |
| *** rbuzatu has quit IRC | 00:30 | |
| *** jpena|off has quit IRC | 00:30 | |
| *** dalvarez has quit IRC | 00:30 | |
| *** dmanchad has quit IRC | 00:30 | |
| openstackgerrit | Merged openstack-infra/tripleo-ci: Add ovb-updates job to cistatus page https://review.openstack.org/406166 | 00:30 |
| pabelanger | llu: see the comment I left on https://review.openstack.org/#/c/412322 | 00:31 |
| pabelanger | we should likely update our JJB test to also validate node | 00:32 |
| pabelanger | so things like that don't slip through | 00:32 |
| llu | oh, I'll propose another patch to fix it | 00:32 |
| llu | my bad :( | 00:32 |
| *** Julien-zte has joined #openstack-infra | 00:35 | |
| jerryz | clarkb: ping | 00:37 |
| *** sekelso has quit IRC | 00:38 | |
| openstackgerrit | Lianhao Lu proposed openstack-infra/project-config: networking-odl: corrected the node in jenkins job https://review.openstack.org/413819 | 00:38 |
| clarkb | jerryz: pong | 00:38 |
| openstackgerrit | Steve Martinelli proposed openstack-infra/project-config: retire keystoneclient-kerberos https://review.openstack.org/413820 | 00:38 |
| jerryz | clarkb: do you have any comment on this bug: https://bugs.launchpad.net/devstack/+bug/1651292 | 00:39 |
| openstack | Launchpad bug 1651292 in OpenStack SDK "openstack commands fail in stable/mitaka caused by openstack.__version__ attribute not found" [Undecided,New] | 00:39 |
| clarkb | jerryz: no I have never used opemstack sdk | 00:39 |
| *** ramishra has quit IRC | 00:40 | |
| jerryz | clarkb: somehow, after installing openstack.nose_plugin via tarball, openstacksdk got in bad shape | 00:40 |
| *** wolverineav has joined #openstack-infra | 00:41 | |
| jerryz | clarkb: openstack infra is using wheel in its mirrors, and that would cause this issue | 00:41 |
| *** dalvarez has joined #openstack-infra | 00:41 | |
| jerryz | would/wouldn't | 00:41 |
| *** jimbaker` has joined #openstack-infra | 00:41 | |
| clarkb | I dont know we dony really support nosr or that plugin anymore | 00:41 |
| *** wolverin_ has joined #openstack-infra | 00:41 | |
| clarkb | and yes we mirror wheels since we mirror what is on pypi | 00:42 |
| clarkb | (and also have a compiled wheels mirror for things with C deps) | 00:42 |
| *** ramishra has joined #openstack-infra | 00:42 | |
| jerryz | clarkb: but installing horizon test requirements will get nose_plugin installed in the same namespace as openstacksdk | 00:42 |
| *** rwsu_ has joined #openstack-infra | 00:42 | |
| clarkb | yes they havent stopped using nose | 00:42 |
| jerryz | clarkb: so openstackclient will fail | 00:42 |
| jerryz | clarkb: can you upload wheel version to pypi.python.org? | 00:43 |
| clarkb | of what? | 00:43 |
| jerryz | clarkb: openstack.nose_plugin | 00:43 |
| clarkb | I dont know its certainly not something I intend on foing | 00:44 |
| *** ativelkov_ has joined #openstack-infra | 00:44 | |
| clarkb | since its like 4 years unsupported | 00:44 |
| jerryz | clarkb: the problem is if install from pypi.python.org by tarball, openstackclient would break | 00:44 |
| clarkb | and not even sure who oens the pypi ptoject | 00:44 |
| clarkb | mordred: ^ | 00:44 |
| *** wolverineav has quit IRC | 00:45 | |
| *** ativelkov has quit IRC | 00:45 | |
| *** jimbaker has quit IRC | 00:45 | |
| *** jesusaur has quit IRC | 00:45 | |
| *** rwsu has quit IRC | 00:45 | |
| *** lbeliveau_ has quit IRC | 00:45 | |
| *** skraynev has quit IRC | 00:45 | |
| *** kragniz has quit IRC | 00:45 | |
| *** mmandel has joined #openstack-infra | 00:46 | |
| *** skraynev has joined #openstack-infra | 00:46 | |
| *** wolverin_ has quit IRC | 00:46 | |
| *** kragniz has joined #openstack-infra | 00:47 | |
| clarkb | looks like we can publish to it | 00:47 |
| clarkb | also last release is more than 4 years old | 00:48 |
| *** lbeliveau has joined #openstack-infra | 00:48 | |
| openstackgerrit | Morgan Fainberg proposed openstack-infra/shade: Add in a dynamic project scope test fixture https://review.openstack.org/410453 | 00:49 |
| openstackgerrit | Morgan Fainberg proposed openstack-infra/shade: Add functional test to show floating ip reuse https://review.openstack.org/409842 | 00:49 |
| *** nadya has joined #openstack-infra | 00:50 | |
| clarkb | jerryz: can you check if it is in our wheel mirror | 00:50 |
| *** mmandel has quit IRC | 00:50 | |
| *** uu has quit IRC | 00:50 | |
| jerryz | clarkb: yes. | 00:50 |
| *** ramishra has quit IRC | 00:51 | |
| jerryz | http://mirror.regionone.osic-cloud1.openstack.org/wheel/ubuntu-14.04-x86_64/openstack-nose-plugin/openstack.nose_plugin-0.11-py2-none-any.whl | 00:51 |
| *** wolverineav has joined #openstack-infra | 00:51 | |
| clarkb | ya so you should already be indtalling via wheel | 00:51 |
| clarkb | so I dont think that is the fix | 00:51 |
| jerryz | clarkb: no, my nodepool don't run config_mirrors.sh | 00:52 |
| clarkb | oh this isnt our testing | 00:52 |
| jerryz | clarkb: and anyone running devstack mitaka would fail | 00:53 |
| clarkb | so I think you will eant to eithet stop with hotizon, usr venvs, or get horizon to stop using abandoned software | 00:53 |
| clarkb | devstack doesnt install test deps by default iirc | 00:53 |
| clarkb | and possibly not even horizon | 00:53 |
| *** jesusaur has joined #openstack-infra | 00:54 | |
| jerryz | clarkb: i run devstack without any local.conf change and it failed also | 00:54 |
| *** nadya has quit IRC | 00:54 | |
| *** Kevin_Zheng has joined #openstack-infra | 00:55 | |
| *** uu has joined #openstack-infra | 00:56 | |
| *** wolverineav has quit IRC | 00:56 | |
| *** ajo has joined #openstack-infra | 00:56 | |
| *** tuanluong has joined #openstack-infra | 00:56 | |
| clarkb | huh mqybe they changed it then | 00:56 |
| clarkb | pretty sure you had to flip an option for test deps before | 00:56 |
| *** dimtruck has quit IRC | 00:57 | |
| *** scottda has quit IRC | 00:57 | |
| *** dguitarbite has quit IRC | 00:57 | |
| *** fkautz has quit IRC | 00:57 | |
| *** xgerman has quit IRC | 00:57 | |
| *** sweston has quit IRC | 00:57 | |
| *** tlian has quit IRC | 00:58 | |
| *** dmanchad has joined #openstack-infra | 00:59 | |
| clarkb | so ya Idont have any good suggestions. I'd rather not fix abandoned more than 4 year old code and move on from it | 00:59 |
| jerryz | clarkb: i can't find such option https://github.com/openstack-dev/devstack/blob/stable/mitaka/inc/python#L166 | 01:01 |
| *** jpena|off has joined #openstack-infra | 01:01 | |
| *** amoralej has joined #openstack-infra | 01:01 | |
| *** dmellado has joined #openstack-infra | 01:03 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/nodepool: [WIP] Reduce min-ram for ubuntu images for devstack testing https://review.openstack.org/413807 | 01:05 |
| *** tinwood_holiday has quit IRC | 01:06 | |
| *** dguitarbite has joined #openstack-infra | 01:07 | |
| *** zz_dimtruck has joined #openstack-infra | 01:07 | |
| *** scottda has joined #openstack-infra | 01:07 | |
| *** fkautz has joined #openstack-infra | 01:07 | |
| *** xgerman has joined #openstack-infra | 01:07 | |
| *** sweston has joined #openstack-infra | 01:07 | |
| *** tinwood has joined #openstack-infra | 01:07 | |
| *** dalvarez has quit IRC | 01:07 | |
| *** geguileo has joined #openstack-infra | 01:08 | |
| clarkb | I would see what mordred thinks | 01:10 |
| clarkb | as he is more familiar wuth namespacing and setuptools | 01:10 |
| *** wolverineav has joined #openstack-infra | 01:11 | |
| *** tlian has joined #openstack-infra | 01:11 | |
| *** uu has quit IRC | 01:12 | |
| *** dalvarez has joined #openstack-infra | 01:13 | |
| *** esikachev has joined #openstack-infra | 01:13 | |
| *** wolverineav has quit IRC | 01:15 | |
| *** uu has joined #openstack-infra | 01:15 | |
| *** jcoufal has joined #openstack-infra | 01:16 | |
| *** mtanino has joined #openstack-infra | 01:16 | |
| *** roeyc has quit IRC | 01:17 | |
| jerryz | clarkb: ok, thanks. wait for his inputs. stable/mitaka used to work for me until 12/05/2016 | 01:17 |
| *** esikachev has quit IRC | 01:18 | |
| *** amoralej has quit IRC | 01:19 | |
| *** jpena|off has quit IRC | 01:19 | |
| *** dmanchad has quit IRC | 01:19 | |
| *** dalvarez has quit IRC | 01:19 | |
| *** yuanying has joined #openstack-infra | 01:20 | |
| *** ajo has quit IRC | 01:20 | |
| *** geguileo has quit IRC | 01:21 | |
| *** dmellado has quit IRC | 01:21 | |
| *** jamesdenton has quit IRC | 01:23 | |
| *** zz_dimtruck is now known as dimtruck | 01:24 | |
| jerryz | clarkb: find setuptools begin to break openstackclient since 31.0.0 2016-12-12 | 01:25 |
| *** lindycoder has quit IRC | 01:25 | |
| *** dalvarez has joined #openstack-infra | 01:29 | |
| *** EricGonczer_ has quit IRC | 01:30 | |
| *** wolverineav has joined #openstack-infra | 01:30 | |
| *** dmellado has joined #openstack-infra | 01:30 | |
| *** jpena|off has joined #openstack-infra | 01:31 | |
| *** ajo has joined #openstack-infra | 01:32 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/nodepool: [WIP] Reduce min-ram for ubuntu images for devstack testing https://review.openstack.org/413807 | 01:32 |
| *** jschwarz has joined #openstack-infra | 01:32 | |
| *** jamesdenton has joined #openstack-infra | 01:32 | |
| *** wolverineav has quit IRC | 01:35 | |
| *** dmanchad has joined #openstack-infra | 01:35 | |
| *** rlandy|bbl is now known as rlandy | 01:36 | |
| *** geguileo has joined #openstack-infra | 01:37 | |
| *** amoralej has joined #openstack-infra | 01:38 | |
| *** Julien-zte has quit IRC | 01:39 | |
| *** wolverineav has joined #openstack-infra | 01:40 | |
| *** yanyanhu has joined #openstack-infra | 01:44 | |
| *** Julien-zte has joined #openstack-infra | 01:44 | |
| *** wolverineav has quit IRC | 01:44 | |
| *** tlian has quit IRC | 01:45 | |
| *** esikachev has joined #openstack-infra | 01:47 | |
| *** wolverineav has joined #openstack-infra | 01:50 | |
| *** john-davidge has joined #openstack-infra | 01:52 | |
| *** esikachev has quit IRC | 01:53 | |
| *** yamahata has quit IRC | 01:53 | |
| *** ramishra has joined #openstack-infra | 01:54 | |
| *** wolverineav has quit IRC | 01:54 | |
| *** dkehn has quit IRC | 01:54 | |
| *** kjorgensen has quit IRC | 01:55 | |
| *** kjorgensen has joined #openstack-infra | 01:55 | |
| *** john-davidge has quit IRC | 01:57 | |
| *** hichihara has joined #openstack-infra | 01:58 | |
| *** kjorgensen has quit IRC | 02:00 | |
| *** wolverineav has joined #openstack-infra | 02:00 | |
| *** Jeffrey4l has joined #openstack-infra | 02:00 | |
| *** Julien-zte has quit IRC | 02:00 | |
| *** dimtruck is now known as zz_dimtruck | 02:00 | |
| *** dkehn has joined #openstack-infra | 02:02 | |
| *** jcoufal has quit IRC | 02:02 | |
| *** jkilpatr has joined #openstack-infra | 02:04 | |
| *** wolverineav has quit IRC | 02:04 | |
| *** tqtran has quit IRC | 02:04 | |
| clarkb | pabelanger: re ^ centos at least seems to think 1gb ram required but I didnt test it that was just their docs | 02:05 |
| *** liusheng has quit IRC | 02:05 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/nodepool: [WIP] Reduce min-ram for ubuntu images for devstack testing https://review.openstack.org/413807 | 02:06 |
| pabelanger | clarkb: agreed, only testing ubuntu things right now | 02:06 |
| pabelanger | looks like we can get away with 512 for them | 02:07 |
| *** wolverineav has joined #openstack-infra | 02:10 | |
| *** ramishra has quit IRC | 02:11 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/project-config: Enabled debian / redhat image builds for diskimage-builder https://review.openstack.org/413858 | 02:14 |
| *** wolverineav has quit IRC | 02:14 | |
| pabelanger | clarkb: greghaynes: ianw: jeblair: ^ how we could enable more images for DIB using nodepool | 02:15 |
| ianw | pabelanger: cool. fedora is sometimes problematic with mirrors | 02:16 |
| ianw | we can get this better, but it might be annoying | 02:16 |
| pabelanger | ianw: I can add a fedora mirror tomorrow, shouldn't be difficult | 02:17 |
| pabelanger | oh | 02:17 |
| pabelanger | and we should also update nodepool.yaml for dsvm job to use our mirrors too | 02:17 |
| ianw | it's more the dib side and getting it all piped through | 02:18 |
| pabelanger | ah | 02:18 |
| *** wolverineav has joined #openstack-infra | 02:19 | |
| *** eharney has quit IRC | 02:22 | |
| *** rlandy has quit IRC | 02:23 | |
| *** wolverineav has quit IRC | 02:24 | |
| *** rbuzatu has joined #openstack-infra | 02:25 | |
| *** wolverineav has joined #openstack-infra | 02:29 | |
| openstackgerrit | Morgan Fainberg proposed openstack-infra/shade: Add in a dynamic project scope test fixture https://review.openstack.org/410453 | 02:30 |
| openstackgerrit | Morgan Fainberg proposed openstack-infra/shade: Add functional test to show floating ip reuse https://review.openstack.org/409842 | 02:30 |
| *** sreeram_v has joined #openstack-infra | 02:31 | |
| *** wolverineav has quit IRC | 02:33 | |
| *** sreeram_v has quit IRC | 02:35 | |
| *** jamesdenton has quit IRC | 02:37 | |
| *** jamesden_ has joined #openstack-infra | 02:37 | |
| *** esikachev has joined #openstack-infra | 02:38 | |
| *** wolverineav has joined #openstack-infra | 02:39 | |
| *** baoli has joined #openstack-infra | 02:40 | |
| *** jkilpatr has quit IRC | 02:41 | |
| *** rbuzatu has quit IRC | 02:41 | |
| openstackgerrit | Paul Belanger proposed openstack/diskimage-builder: [WIP] Start with an empty environment for chroot https://review.openstack.org/413868 | 02:42 |
| *** esikachev has quit IRC | 02:43 | |
| *** wolverineav has quit IRC | 02:43 | |
| *** liusheng has joined #openstack-infra | 02:44 | |
| *** mmandel has joined #openstack-infra | 02:46 | |
| *** wolverineav has joined #openstack-infra | 02:49 | |
| *** yuanying has quit IRC | 02:49 | |
| *** yuanying has joined #openstack-infra | 02:50 | |
| *** nadya has joined #openstack-infra | 02:51 | |
| *** mmandel has quit IRC | 02:51 | |
| *** mriedem has joined #openstack-infra | 02:53 | |
| *** wolverineav has quit IRC | 02:53 | |
| *** yuanying has quit IRC | 02:54 | |
| openstackgerrit | Paul Belanger proposed openstack/diskimage-builder: [WIP] Start with an empty environment for chroot https://review.openstack.org/413868 | 02:55 |
| *** nadya has quit IRC | 02:55 | |
| *** sdake has joined #openstack-infra | 02:56 | |
| *** wolverineav has joined #openstack-infra | 02:59 | |
| *** wolverin_ has joined #openstack-infra | 02:59 | |
| *** esikachev has joined #openstack-infra | 03:00 | |
| openstackgerrit | Paul Belanger proposed openstack/diskimage-builder: [WIP] Start with an empty environment for chroot https://review.openstack.org/413868 | 03:01 |
| *** wolverineav has quit IRC | 03:03 | |
| *** wolverin_ has quit IRC | 03:03 | |
| openstackgerrit | Merged openstack/diskimage-builder: Dont run with VIRTUAL_ENV set https://review.openstack.org/413487 | 03:03 |
| *** Goneri has quit IRC | 03:03 | |
| *** baoli has quit IRC | 03:04 | |
| *** adrian_otto has joined #openstack-infra | 03:04 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/nodepool: [WIP] Reduce min-ram for ubuntu images for devstack testing https://review.openstack.org/413807 | 03:04 |
| *** sdake has quit IRC | 03:04 | |
| *** esikachev has quit IRC | 03:05 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/nodepool: Add dib-image-list.json webapp target https://review.openstack.org/413874 | 03:08 |
| openstackgerrit | Matt Riedemann proposed openstack-infra/elastic-recheck: Add query for cinder vol backup bug 1635643 https://review.openstack.org/413875 | 03:09 |
| openstack | bug 1635643 in Cinder "test_volume_backup_create_get_detailed_list_restore_delete failed with "iscsiadm: Could not execute operation on all records: encountered iSCSI database failure" in c-bak log" [Undecided,New] https://launchpad.net/bugs/1635643 | 03:09 |
| *** asselin_ has joined #openstack-infra | 03:09 | |
| *** asselin has quit IRC | 03:09 | |
| *** asselin__ has joined #openstack-infra | 03:10 | |
| *** mtanino has quit IRC | 03:10 | |
| *** asselin_ has quit IRC | 03:13 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/project-config: Use DIB_GRUB_TIMEOUT to set boot timeout https://review.openstack.org/412671 | 03:15 |
| *** ramishra has joined #openstack-infra | 03:15 | |
| *** Julien-zte has joined #openstack-infra | 03:16 | |
| *** Julien-zte has quit IRC | 03:16 | |
| *** Julien-zte has joined #openstack-infra | 03:17 | |
| openstackgerrit | Paul Belanger proposed openstack/diskimage-builder: [WIP] Start with an empty environment for chroot https://review.openstack.org/413868 | 03:18 |
| *** wolverineav has joined #openstack-infra | 03:18 | |
| *** soliosg has joined #openstack-infra | 03:20 | |
| *** wolverineav has quit IRC | 03:22 | |
| *** pahuang has quit IRC | 03:23 | |
| *** liusheng has quit IRC | 03:25 | |
| *** liusheng has joined #openstack-infra | 03:25 | |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder: Revert "Revert Xenial to Python 2" https://review.openstack.org/413733 | 03:26 |
| openstackgerrit | Paul Belanger proposed openstack/diskimage-builder: [WIP] Start with an empty environment for chroot https://review.openstack.org/413868 | 03:27 |
| *** adrian_otto has quit IRC | 03:27 | |
| *** wolverineav has joined #openstack-infra | 03:28 | |
| *** adrian_otto has joined #openstack-infra | 03:29 | |
| *** snarwade has joined #openstack-infra | 03:30 | |
| *** wolverineav has quit IRC | 03:33 | |
| openstackgerrit | Paul Belanger proposed openstack/diskimage-builder: [WIP] Start with an empty environment for chroot https://review.openstack.org/413868 | 03:34 |
| openstackgerrit | Ian Wienand proposed openstack-infra/nodepool: Add dib-image-list.json webapp target https://review.openstack.org/413874 | 03:36 |
| *** amotoki has joined #openstack-infra | 03:36 | |
| *** wolverineav has joined #openstack-infra | 03:38 | |
| *** rbuzatu has joined #openstack-infra | 03:38 | |
| openstackgerrit | Paul Belanger proposed openstack/diskimage-builder: [WIP] Start with an empty environment for chroot https://review.openstack.org/413868 | 03:41 |
| *** links has joined #openstack-infra | 03:42 | |
| *** wolverineav has quit IRC | 03:43 | |
| *** yanyanhu has quit IRC | 03:44 | |
| *** yanyanhu has joined #openstack-infra | 03:44 | |
| *** zz_dimtruck is now known as dimtruck | 03:45 | |
| *** yamamoto_ has joined #openstack-infra | 03:46 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/nodepool: Reduce min-ram for ubuntu images for devstack https://review.openstack.org/413807 | 03:47 |
| *** gouthamr has quit IRC | 03:47 | |
| *** wolverineav has joined #openstack-infra | 03:48 | |
| openstackgerrit | Paul Belanger proposed openstack/diskimage-builder: [WIP] Start with an empty environment for chroot https://review.openstack.org/413868 | 03:49 |
| *** yuanying has joined #openstack-infra | 03:50 | |
| *** yuanying has quit IRC | 03:50 | |
| *** yuanying_ has joined #openstack-infra | 03:50 | |
| *** adrian_otto has quit IRC | 03:51 | |
| *** tjones has joined #openstack-infra | 03:52 | |
| *** wolverineav has quit IRC | 03:52 | |
| *** rbuzatu has quit IRC | 03:53 | |
| *** tjones has left #openstack-infra | 03:53 | |
| pabelanger | ianw: okay, that is shaping up good^ | 03:56 |
| ianw | pabelanger: cool. i plan to get the revert of xenial python2 in and do a dib point release, and that's probably me done for 2016 | 03:57 |
| *** wolverineav has joined #openstack-infra | 03:58 | |
| *** psachin has joined #openstack-infra | 04:00 | |
| *** wolverineav has quit IRC | 04:02 | |
| *** hongbin has joined #openstack-infra | 04:05 | |
| *** jerryz has quit IRC | 04:05 | |
| *** wolverineav has joined #openstack-infra | 04:08 | |
| *** nicolasbock has quit IRC | 04:09 | |
| *** esikachev has joined #openstack-infra | 04:09 | |
| *** yamahata has joined #openstack-infra | 04:10 | |
| *** wolverineav has quit IRC | 04:12 | |
| *** stakeda has quit IRC | 04:13 | |
| *** Daisy has joined #openstack-infra | 04:16 | |
| *** Daisy has quit IRC | 04:16 | |
| *** Daisy has joined #openstack-infra | 04:17 | |
| *** wolverineav has joined #openstack-infra | 04:17 | |
| *** Daisy has quit IRC | 04:17 | |
| *** wolverin_ has joined #openstack-infra | 04:18 | |
| *** esikachev has quit IRC | 04:18 | |
| *** wolverineav has quit IRC | 04:22 | |
| *** wolverin_ has quit IRC | 04:22 | |
| openstackgerrit | Anusha Ramineni proposed openstack-infra/project-config: Add gerritbot notification for valence https://review.openstack.org/413906 | 04:23 |
| *** tuanluong has quit IRC | 04:23 | |
| *** stakeda has joined #openstack-infra | 04:25 | |
| *** aeng has quit IRC | 04:27 | |
| *** wolverineav has joined #openstack-infra | 04:28 | |
| *** wolverineav has quit IRC | 04:32 | |
| *** rbuzatu has joined #openstack-infra | 04:35 | |
| *** yamamoto_ has quit IRC | 04:36 | |
| *** wolverineav has joined #openstack-infra | 04:38 | |
| *** gomarivera has joined #openstack-infra | 04:40 | |
| *** wolverineav has quit IRC | 04:42 | |
| *** yamamoto_ has joined #openstack-infra | 04:43 | |
| *** mtreinish has quit IRC | 04:44 | |
| *** gomarivera has quit IRC | 04:45 | |
| *** mtreinish has joined #openstack-infra | 04:45 | |
| *** sreeram_v has joined #openstack-infra | 04:47 | |
| *** yamamoto_ has quit IRC | 04:53 | |
| *** pgadiya has joined #openstack-infra | 04:54 | |
| openstackgerrit | Paul Belanger proposed openstack/diskimage-builder: Start with an empty environment for chroot https://review.openstack.org/413868 | 04:56 |
| *** yamamoto_ has joined #openstack-infra | 04:57 | |
| *** yamamoto_ has quit IRC | 04:57 | |
| *** wolverineav has joined #openstack-infra | 04:57 | |
| *** hongbin has quit IRC | 04:58 | |
| openstackgerrit | Merged openstack/diskimage-builder: Revert "Revert Xenial to Python 2" https://review.openstack.org/413733 | 05:00 |
| *** wolverineav has quit IRC | 05:01 | |
| *** senk has joined #openstack-infra | 05:01 | |
| *** tqtran has joined #openstack-infra | 05:04 | |
| *** wolverineav has joined #openstack-infra | 05:07 | |
| *** adriant has quit IRC | 05:07 | |
| *** tqtran has quit IRC | 05:08 | |
| *** adrian_otto has joined #openstack-infra | 05:10 | |
| *** wolverineav has quit IRC | 05:11 | |
| openstackgerrit | Tony Breeds proposed openstack-infra/project-config: Make gate-blazar-nova-python27.* non-voting https://review.openstack.org/413910 | 05:15 |
| *** wolverineav has joined #openstack-infra | 05:17 | |
| *** wolverineav has quit IRC | 05:21 | |
| *** wolverineav has joined #openstack-infra | 05:26 | |
| *** soliosg has quit IRC | 05:30 | |
| openstackgerrit | Matthew Thode proposed openstack/diskimage-builder: Fix Gentoo builds on Ubuntu 16.04 Xenial hosts https://review.openstack.org/413395 | 05:30 |
| *** chkumar|off is now known as chandankumar | 05:31 | |
| *** wolverineav has quit IRC | 05:31 | |
| *** adrian_otto1 has joined #openstack-infra | 05:35 | |
| *** wolverineav has joined #openstack-infra | 05:36 | |
| *** adrian_otto has quit IRC | 05:37 | |
| *** yamamoto_ has joined #openstack-infra | 05:39 | |
| *** wolverineav has quit IRC | 05:40 | |
| *** rbuzatu has quit IRC | 05:45 | |
| openstackgerrit | Dirk Mueller proposed openstack-dev/pbr: Don't raise exception on missing man pages https://review.openstack.org/413795 | 05:46 |
| openstackgerrit | Dirk Mueller proposed openstack-dev/pbr: Remove discover from test-requirements https://review.openstack.org/410966 | 05:46 |
| *** wolverineav has joined #openstack-infra | 05:46 | |
| *** amotoki has quit IRC | 05:47 | |
| *** esikachev has joined #openstack-infra | 05:48 | |
| *** wolverineav has quit IRC | 05:51 | |
| *** rbuzatu has joined #openstack-infra | 05:52 | |
| *** john-davidge has joined #openstack-infra | 05:54 | |
| *** esikachev has quit IRC | 05:55 | |
| *** wolverineav has joined #openstack-infra | 05:56 | |
| *** Julien-zte has quit IRC | 05:57 | |
| *** senk has quit IRC | 05:57 | |
| *** john-davidge has quit IRC | 05:59 | |
| *** wolverineav has quit IRC | 06:00 | |
| *** Julien-zte has joined #openstack-infra | 06:01 | |
| *** Julien-zte has quit IRC | 06:02 | |
| *** Julien-zte has joined #openstack-infra | 06:03 | |
| *** gildub has quit IRC | 06:05 | |
| *** hurgleburgler has quit IRC | 06:06 | |
| *** Sukhdev has joined #openstack-infra | 06:08 | |
| *** adrian_otto1 has quit IRC | 06:11 | |
| *** salv-orlando has joined #openstack-infra | 06:12 | |
| *** esikachev has joined #openstack-infra | 06:15 | |
| *** wolverineav has joined #openstack-infra | 06:16 | |
| *** pcaruana has joined #openstack-infra | 06:17 | |
| openstackgerrit | Merged openstack-infra/project-config: networking-odl: corrected the node in jenkins job https://review.openstack.org/413819 | 06:17 |
| *** kjorgensen has joined #openstack-infra | 06:19 | |
| openstackgerrit | Merged openstack-infra/project-config: Add browbeat documentation to readthedocs https://review.openstack.org/413779 | 06:20 |
| *** wolverineav has quit IRC | 06:20 | |
| *** tuanluong has joined #openstack-infra | 06:21 | |
| *** kjorgensen has quit IRC | 06:23 | |
| *** Julien-zte has quit IRC | 06:24 | |
| openstackgerrit | xhzhf proposed openstack/diskimage-builder: H803 hacking have been deprecated https://review.openstack.org/413923 | 06:24 |
| *** Julien-zte has joined #openstack-infra | 06:25 | |
| openstackgerrit | Merged openstack-infra/project-config: create new meta package for openstackclient https://review.openstack.org/412633 | 06:29 |
| *** wolverineav has joined #openstack-infra | 06:35 | |
| *** senk has joined #openstack-infra | 06:37 | |
| openstackgerrit | Matthew Thode proposed openstack/diskimage-builder: Fix Gentoo builds on Ubuntu 16.04 Xenial hosts https://review.openstack.org/413395 | 06:38 |
| openstackgerrit | YAMAMOTO Takashi proposed openstack-infra/devstack-gate: Add save_* functions for clearer saving of artifacts https://review.openstack.org/334504 | 06:39 |
| openstackgerrit | YAMAMOTO Takashi proposed openstack-infra/devstack-gate: Add save_* functions for clearer saving of artifacts https://review.openstack.org/334504 | 06:40 |
| *** wolverineav has quit IRC | 06:40 | |
| *** armax has joined #openstack-infra | 06:42 | |
| *** dimtruck is now known as zz_dimtruck | 06:44 | |
| *** Sukhdev has quit IRC | 06:45 | |
| *** wolverineav has joined #openstack-infra | 06:45 | |
| *** psachin has quit IRC | 06:47 | |
| *** psachin has joined #openstack-infra | 06:47 | |
| *** openstackgerrit has quit IRC | 06:48 | |
| *** wolverineav has quit IRC | 06:50 | |
| *** e0ne has joined #openstack-infra | 06:52 | |
| *** wolverineav has joined #openstack-infra | 06:55 | |
| *** tesseract has joined #openstack-infra | 06:58 | |
| *** tesseract has quit IRC | 06:58 | |
| *** tesseract has joined #openstack-infra | 06:59 | |
| *** tesseract is now known as Guest47337 | 06:59 | |
| *** wolverineav has quit IRC | 06:59 | |
| *** salv-orlando has quit IRC | 07:04 | |
| *** openstackgerrit has joined #openstack-infra | 07:04 | |
| openstackgerrit | Merged openstack-infra/project-config: Enabled debian / redhat image builds for diskimage-builder https://review.openstack.org/413858 | 07:04 |
| *** wolverineav has joined #openstack-infra | 07:05 | |
| *** yuval has joined #openstack-infra | 07:07 | |
| *** amotoki has joined #openstack-infra | 07:08 | |
| *** wolverineav has quit IRC | 07:09 | |
| *** bhavik1 has joined #openstack-infra | 07:13 | |
| *** wolverineav has joined #openstack-infra | 07:15 | |
| *** wolverin_ has joined #openstack-infra | 07:15 | |
| *** wolverineav has quit IRC | 07:19 | |
| *** nadya has joined #openstack-infra | 07:19 | |
| *** wolverin_ has quit IRC | 07:20 | |
| openstackgerrit | mathieu bultel proposed openstack-infra/tripleo-ci: Implement major upgrade for Newton to Ocata https://review.openstack.org/404831 | 07:20 |
| yolanda | good morning | 07:21 |
| *** armax has quit IRC | 07:24 | |
| *** amotoki_ has joined #openstack-infra | 07:26 | |
| *** snarwade is now known as snarwade|lunch | 07:26 | |
| *** amotoki has quit IRC | 07:28 | |
| *** savihou has joined #openstack-infra | 07:29 | |
| openstackgerrit | Merged openstack-infra/project-config: Use DIB_GRUB_TIMEOUT to set boot timeout https://review.openstack.org/412671 | 07:29 |
| openstackgerrit | Merged openstack-infra/project-config: Inspector grenade: use Ironic builders https://review.openstack.org/413551 | 07:31 |
| AJaeger | morning, yolanda ! | 07:33 |
| openstackgerrit | Merged openstack-infra/project-config: make release script repo cloning function more resilient https://review.openstack.org/413766 | 07:34 |
| openstackgerrit | Merged openstack-infra/project-config: Add gerritbot notification for valence https://review.openstack.org/413906 | 07:34 |
| openstackgerrit | Merged openstack-infra/project-config: Start logging Python 3 team channel https://review.openstack.org/413660 | 07:35 |
| *** isaacb has joined #openstack-infra | 07:35 | |
| *** isaacb has quit IRC | 07:36 | |
| *** john-davidge has joined #openstack-infra | 07:40 | |
| *** john-davidge has quit IRC | 07:44 | |
| *** wolverineav has joined #openstack-infra | 07:44 | |
| openstackgerrit | Merged openstack-infra/project-config: Tweak gofmt job https://review.openstack.org/413679 | 07:45 |
| *** wolverin_ has joined #openstack-infra | 07:45 | |
| *** ihrachys has joined #openstack-infra | 07:47 | |
| *** openstackgerrit has quit IRC | 07:48 | |
| AJaeger | yolanda: could you review my change https://review.openstack.org/413590 as well , please? | 07:48 |
| *** wolverineav has quit IRC | 07:49 | |
| *** wolverin_ has quit IRC | 07:49 | |
| *** jpena|off is now known as jpena | 07:50 | |
| *** openstackgerrit has joined #openstack-infra | 07:50 | |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: remove jobs from keystoneclient-kerberos https://review.openstack.org/413790 | 07:50 |
| *** dizquierdo has joined #openstack-infra | 07:53 | |
| *** wolverineav has joined #openstack-infra | 07:55 | |
| openstackgerrit | Ihar Hrachyshka proposed openstack-infra/project-config: Migrate -platform- devstack jobs to -neutron-full- https://review.openstack.org/411328 | 07:57 |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: retire keystoneclient-kerberos https://review.openstack.org/413820 | 07:58 |
| *** wolverineav has quit IRC | 08:00 | |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Remove jobs from keystoneclient-kerberos https://review.openstack.org/413790 | 08:01 |
| *** jpena is now known as jpena|off | 08:01 | |
| *** wolverineav has joined #openstack-infra | 08:03 | |
| *** ihrachys has quit IRC | 08:07 | |
| *** hichihara has quit IRC | 08:08 | |
| *** esikachev has quit IRC | 08:10 | |
| *** esikachev has joined #openstack-infra | 08:11 | |
| *** snarwade|lunch is now known as snarwade | 08:14 | |
| *** esikachev has quit IRC | 08:16 | |
| *** cschwede has quit IRC | 08:18 | |
| *** bhavik1 has quit IRC | 08:18 | |
| *** wolverin_ has joined #openstack-infra | 08:21 | |
| *** cschwede has joined #openstack-infra | 08:21 | |
| *** ccamacho has joined #openstack-infra | 08:21 | |
| AJaeger | oomichi: Looking at these changes, what's the proper solution for them? https://review.openstack.org/#/q/topic:run-intree-tests you gave a -1 on one of them - and I agree, this is ugly. But what's the proper solution? | 08:22 |
| *** wolverineav has quit IRC | 08:24 | |
| *** Julien-zte has quit IRC | 08:24 | |
| *** gomarivera has joined #openstack-infra | 08:25 | |
| *** shardy has joined #openstack-infra | 08:26 | |
| *** isaacb has joined #openstack-infra | 08:27 | |
| oomichi | AJaeger: thanks for picking it up. I feel Tempest plugin tests should affect to the project gating jobs only basically | 08:29 |
| AJaeger | mriedem: nova has a lot of experimental jobs that are for trusty - so only for liberty. What do you think of removing them? | 08:29 |
| *** amotoki_ has quit IRC | 08:30 | |
| *** salv-orlando has joined #openstack-infra | 08:30 | |
| oomichi | AJaeger: but current https://review.openstack.org/#/c/410248 seems to affect tempest gating jobs, right? | 08:30 |
| AJaeger | oomichi: neutron-full is part of integrated gate. | 08:31 |
| oomichi | AJaeger: it would be fine to affect to their own gating jobs only TBH | 08:31 |
| oomichi | AJaeger: "integrated gate" means tempest gating jobs, right? | 08:32 |
| oomichi | AJaeger: "integrated gate" means tempest gating jobs *also*, right? | 08:32 |
| AJaeger | oomichi: the jobs that are run for all the base repos - nova, neutron, glance- and tempest is part of integrated gate testing | 08:32 |
| AJaeger | oomichi: so, yes | 08:32 |
| AJaeger | oomichi: looking at the whole patch series, it looks wrong to me to set a regex to a current value of one seting - a value that you might change anytime in tempest. | 08:33 |
| AJaeger | So, I wonder whether some kind of abstraction is missing here - shouldn't there be an easier way of doing it - one that is less coupled? | 08:34 |
| *** salv-orlando has quit IRC | 08:35 | |
| *** dingyichen has quit IRC | 08:36 | |
| oomichi | AJaeger: tempest repo has the default regex like https://github.com/openstack/tempest/blob/master/tox.ini#L81 | 08:37 |
| *** lezbar has joined #openstack-infra | 08:37 | |
| AJaeger | oomichi: and that change series copies that regex value into each and every devstack job that has a cinder plugin - and enhances it. | 08:38 |
| AJaeger | That is wrong abstraction IMHO. Why can't cinder set something like TEST_ALSO_REGEX | 08:39 |
| AJaeger | or set a variable like we do with devstack? | 08:39 |
| AJaeger | oomichi: what happens if you update line 81 in tox.ini and add more tests - this change will not propagate to project-config | 08:40 |
| openstackgerrit | Tony Breeds proposed openstack-infra/project-config: Teach run-tox-api-ref.sh to install requirements with constraints https://review.openstack.org/413969 | 08:40 |
| oomichi | AJaeger: all-plugin of line 61 is for tempest plugin jobs now | 08:41 |
| oomichi | AJaeger: like "$ tox -e all-plugin -- manila_tempest_tests.tests.api.admin.test_admin_actions" on manila | 08:41 |
| oomichi | AJaeger: they can set the regex as they like | 08:42 |
| oomichi | is it difficult to add more jobs for cinder specific for their tempest plugin? | 08:42 |
| *** cschwede has quit IRC | 08:42 | |
| *** slagle has quit IRC | 08:43 | |
| AJaeger | no, they should be able to duplicate jobs | 08:43 |
| *** salv-orlando has joined #openstack-infra | 08:44 | |
| *** cschwede has joined #openstack-infra | 08:44 | |
| AJaeger | oomichi: are you suggesting them to run *two* jobs? The normal neutron-full plus a specific one that only runs the tempest plugin tests? | 08:44 |
| AJaeger | right now they try to do this with one job | 08:44 |
| *** slagle has joined #openstack-infra | 08:45 | |
| oomichi | AJaeger: yes, it is nice to have two separated jobs on cinder gate if possible :) | 08:45 |
| *** e0ne has quit IRC | 08:45 | |
| AJaeger | oomichi: could you suggest that in the review, please? | 08:46 |
| *** ricardoas has quit IRC | 08:47 | |
| *** john-davidge has joined #openstack-infra | 08:47 | |
| *** flepied has quit IRC | 08:50 | |
| *** ralonsoh has joined #openstack-infra | 08:52 | |
| oomichi | AJaeger: nice idea, I will do that soon | 08:52 |
| AJaeger | thanks, oomichi | 08:53 |
| *** wolverineav has joined #openstack-infra | 08:56 | |
| *** wolverineav has quit IRC | 08:57 | |
| *** wolverin_ has quit IRC | 08:59 | |
| *** zzzeek has quit IRC | 09:00 | |
| *** ralonsoh_ has joined #openstack-infra | 09:00 | |
| *** zzzeek has joined #openstack-infra | 09:00 | |
| *** pgadiya has quit IRC | 09:01 | |
| *** amotoki has joined #openstack-infra | 09:02 | |
| *** ralonsoh has quit IRC | 09:02 | |
| *** isaacb has quit IRC | 09:03 | |
| *** hashar has joined #openstack-infra | 09:07 | |
| *** shu-mutou-AWAY has quit IRC | 09:13 | |
| *** abregman has joined #openstack-infra | 09:15 | |
| *** amotoki has quit IRC | 09:15 | |
| *** dmellado_ has joined #openstack-infra | 09:16 | |
| *** pgadiya has joined #openstack-infra | 09:17 | |
| *** markvoelker has quit IRC | 09:20 | |
| *** asettle has joined #openstack-infra | 09:22 | |
| *** asettle has quit IRC | 09:22 | |
| *** asettle has joined #openstack-infra | 09:22 | |
| *** lucas-afk is now known as lucasagomes | 09:23 | |
| *** rossella_s has joined #openstack-infra | 09:24 | |
| *** nmagnezi has joined #openstack-infra | 09:28 | |
| *** sreeram_v has quit IRC | 09:30 | |
| *** flepied has joined #openstack-infra | 09:30 | |
| *** ralonsoh_ is now known as ralonsoh | 09:33 | |
| *** knangia has joined #openstack-infra | 09:33 | |
| *** stakeda has quit IRC | 09:34 | |
| *** psachin has quit IRC | 09:41 | |
| *** apetrich has quit IRC | 09:43 | |
| openstackgerrit | mathieu bultel proposed openstack-infra/tripleo-ci: Implement major upgrade for Newton to Ocata https://review.openstack.org/404831 | 09:44 |
| *** apetrich has joined #openstack-infra | 09:44 | |
| *** pgadiya has quit IRC | 09:46 | |
| *** jpena|off is now known as jpena | 09:50 | |
| *** jpena is now known as jpena|brb | 09:51 | |
| *** amotoki has joined #openstack-infra | 09:51 | |
| openstackgerrit | Mike Kolesnik proposed openstack-infra/project-config: Add driver variable to ODL tempest jobs https://review.openstack.org/413102 | 09:52 |
| *** e0ne has joined #openstack-infra | 09:56 | |
| *** pgadiya has joined #openstack-infra | 09:58 | |
| *** chem has joined #openstack-infra | 09:59 | |
| *** jaosorior has joined #openstack-infra | 09:59 | |
| *** electrofelix has joined #openstack-infra | 10:00 | |
| *** OferBarber has joined #openstack-infra | 10:00 | |
| *** gomarivera has quit IRC | 10:01 | |
| *** dguitarbite has quit IRC | 10:01 | |
| *** asettle__ has joined #openstack-infra | 10:01 | |
| *** asettle has quit IRC | 10:03 | |
| *** derekh has joined #openstack-infra | 10:03 | |
| *** asettle__ is now known as asettle | 10:04 | |
| *** rafaels has joined #openstack-infra | 10:07 | |
| *** psachin has joined #openstack-infra | 10:07 | |
| *** flepied has quit IRC | 10:08 | |
| *** gomarivera has joined #openstack-infra | 10:10 | |
| *** rossella_s has quit IRC | 10:11 | |
| *** chem has quit IRC | 10:12 | |
| *** rossella_s has joined #openstack-infra | 10:12 | |
| *** sdake has joined #openstack-infra | 10:12 | |
| *** chem has joined #openstack-infra | 10:12 | |
| *** dguitarbite has joined #openstack-infra | 10:13 | |
| *** yamahata has quit IRC | 10:14 | |
| *** sdake_ has joined #openstack-infra | 10:15 | |
| *** sdake_ has quit IRC | 10:16 | |
| *** drifterza has joined #openstack-infra | 10:17 | |
| *** sdake has quit IRC | 10:19 | |
| *** amotoki has quit IRC | 10:20 | |
| *** wolverineav has joined #openstack-infra | 10:21 | |
| *** markvoelker has joined #openstack-infra | 10:21 | |
| *** yanyanhu has quit IRC | 10:24 | |
| *** flepied has joined #openstack-infra | 10:24 | |
| *** rbuzatu_ has joined #openstack-infra | 10:26 | |
| *** rbuzatu has quit IRC | 10:26 | |
| *** wolverineav has quit IRC | 10:26 | |
| *** markvoelker has quit IRC | 10:26 | |
| *** drifterza has quit IRC | 10:28 | |
| openstackgerrit | Pawel Koniszewski proposed openstack-infra/devstack-gate: Set LIVE_MIGRATE_BACK_AND_FORTH to True in LM+grenade job https://review.openstack.org/382456 | 10:31 |
| *** esikachev has joined #openstack-infra | 10:35 | |
| *** jlibosva has joined #openstack-infra | 10:37 | |
| *** gongysh has joined #openstack-infra | 10:39 | |
| *** wolverineav has joined #openstack-infra | 10:42 | |
| *** wolverineav has quit IRC | 10:46 | |
| *** rafaels has quit IRC | 10:47 | |
| *** nadya has quit IRC | 10:56 | |
| *** ihrachys has joined #openstack-infra | 10:57 | |
| *** flepied has quit IRC | 11:06 | |
| *** rfolco has joined #openstack-infra | 11:06 | |
| *** jpena|brb is now known as jpena | 11:06 | |
| *** nadya has joined #openstack-infra | 11:12 | |
| *** kzaitsev_mb has joined #openstack-infra | 11:13 | |
| openstackgerrit | Davanum Srinivas (dims) proposed openstack-infra/project-config: DevStack updown for python3 https://review.openstack.org/413775 | 11:13 |
| *** nadya has quit IRC | 11:13 | |
| *** wolverineav has joined #openstack-infra | 11:15 | |
| *** wolverin_ has joined #openstack-infra | 11:16 | |
| dims | AJaeger : yolanda : please take a look. will immensely help me with hacking over the holidays ^^ | 11:18 |
| AJaeger | dims: hacking over the holidays? I'm not sure I should support that ;) | 11:19 |
| dims | LOL - for decompression :) | 11:19 |
| *** wolverineav has quit IRC | 11:20 | |
| AJaeger | dims: syntax is fine but we use "suffix: -nv" as parameter. I commented... | 11:22 |
| *** flepied has joined #openstack-infra | 11:22 | |
| *** salv-orlando has quit IRC | 11:29 | |
| *** sreeram_v has joined #openstack-infra | 11:31 | |
| *** ociuhandu has quit IRC | 11:33 | |
| openstackgerrit | Vasyl Saienko proposed openstack-infra/devstack-gate: Add a note for br_ironic_vxlan tunnel https://review.openstack.org/379447 | 11:34 |
| *** sreeram_v has quit IRC | 11:36 | |
| *** sdague has joined #openstack-infra | 11:36 | |
| openstackgerrit | Merged openstack-infra/shade: Extract helper methods and change test default to v3 https://review.openstack.org/412105 | 11:36 |
| openstackgerrit | Davanum Srinivas (dims) proposed openstack-infra/project-config: DevStack updown for python3 https://review.openstack.org/413775 | 11:37 |
| *** ramishra has quit IRC | 11:38 | |
| *** nicolasbock has joined #openstack-infra | 11:38 | |
| *** florianf has joined #openstack-infra | 11:40 | |
| *** knangia has quit IRC | 11:40 | |
| mordred | dims, AJaeger: the holidays are the time to hack on the things you want to hack on but normally can't justify | 11:40 |
| *** asettle has quit IRC | 11:42 | |
| *** asettle has joined #openstack-infra | 11:42 | |
| dims | mordred: and the CI is practically empty so does not feel bad to launch a bunch of experiements | 11:42 |
| *** salv-orlando has joined #openstack-infra | 11:43 | |
| AJaeger | mordred: yeah ;) That's why I'm reviewing dims one with prio :) | 11:43 |
| AJaeger | dims: one more change and a question on your review, please | 11:43 |
| AJaeger | mordred: care to review a py34/35 change for me, please? https://review.openstack.org/#/c/413590/ | 11:44 |
| *** ramishra has joined #openstack-infra | 11:44 | |
| *** yamamoto_ has quit IRC | 11:46 | |
| openstackgerrit | Gabriele Cerami proposed openstack-infra/tripleo-ci: updates: enable ssl https://review.openstack.org/402930 | 11:46 |
| *** ricardoas has joined #openstack-infra | 11:46 | |
| openstackgerrit | Davanum Srinivas (dims) proposed openstack-infra/project-config: DevStack updown for python3 https://review.openstack.org/413775 | 11:49 |
| stevemar | AJaeger: 413817 has been restored, removed the depends-on, and abandoned again | 11:52 |
| AJaeger | dims: I'm still puzzled by your !stable regex - should this job run on stable/ocata ? | 11:52 |
| AJaeger | stevemar: great, then please update the project-config changes so that those get triggered | 11:53 |
| dims | AJaeger : no | 11:53 |
| stevemar | AJaeger: sorry about the confusion! my copy and pasting of change IDs caused more of a problem than I thought :) | 11:53 |
| AJaeger | dims: then "None of the stable branches support this job" - might leave me wondering in 6 months about this. | 11:53 |
| AJaeger | What about saying: "This should run on master only to figure out status of py35" ? Or something else... | 11:54 |
| dims | AJaeger : i have "branch: ^(?!stable)" as regex. what should i do? | 11:54 |
| dims | ah just the comment | 11:54 |
| *** deadnull has joined #openstack-infra | 11:54 | |
| openstackgerrit | Steve Martinelli proposed openstack-infra/project-config: Remove jobs from python-keystoneclient-kerberos https://review.openstack.org/413790 | 11:54 |
| AJaeger | dims: that regex is fine. Just rework the comment so that anybody reading it in 6 months is aware why it shouuld not run on pike or queeens... | 11:55 |
| openstackgerrit | Steve Martinelli proposed openstack-infra/project-config: retire keystoneclient-kerberos https://review.openstack.org/413820 | 11:55 |
| openstackgerrit | Davanum Srinivas (dims) proposed openstack-infra/project-config: DevStack updown for python3 https://review.openstack.org/413775 | 11:55 |
| stevemar | AJaeger: how do you remove .gitreview and still push the change? *scratches chin* | 11:55 |
| AJaeger | If you run git review -s, the information about the repo is recorded. | 11:56 |
| AJaeger | Afterwards, you can just remove .gitreview, it's not needed anymore | 11:56 |
| AJaeger | git review -s updates .git/ and that's enough to push a change | 11:57 |
| AJaeger | stevemar: So, I did: git review -s ; git review -d XXX;git rm .gitreview;git commit --a --amend;git review | 11:57 |
| AJaeger | (with one less -) | 11:58 |
| *** florianf has quit IRC | 11:58 | |
| stevemar | ahhh | 11:59 |
| stevemar | TIL | 11:59 |
| stevemar | AJaeger: i'll add that to the project retirement instructions | 11:59 |
| AJaeger | stevemar: thanks | 12:00 |
| AJaeger | it mentions already removing .gitreview AFAIR but seems we should help a bit more... | 12:00 |
| AJaeger | stevemar: with your new project-team-core powers, could you change your +1 to a +2A on https://review.openstack.org/391622 , please? | 12:01 |
| stevemar | AJaeger: of course | 12:01 |
| stevemar | AJaeger: yep, it does mention to remove it (i'll add a bit more info to it) | 12:02 |
| apuimedo | AJaeger: is there some way to have a gate not run until another one has run? | 12:03 |
| apuimedo | for example have a gate build a tarball and have the rest of the gates consume it | 12:03 |
| openstackgerrit | Steve Martinelli proposed openstack-infra/project-config: retire keystoneclient-kerberos https://review.openstack.org/413820 | 12:04 |
| AJaeger | apuimedo: jobs can depend on each other, so you can serialize them. have a look at the publish-to-pypi template in zuul/layout.yaml: First we upload to pypi, then other action happens. | 12:05 |
| *** tuanluong has quit IRC | 12:05 | |
| apuimedo | thanks AJaeger! | 12:05 |
| apuimedo | you are always very helpful! | 12:05 |
| AJaeger | apuimedo: but we never did this for consuming tarballs. Best to talk with clarkb, jeblair, or fungi on the design. | 12:05 |
| apuimedo | very well | 12:05 |
| AJaeger | maybe push a draft for discussion up? | 12:05 |
| apuimedo | good idea | 12:06 |
| stevemar | apuimedo: i know right? AJaeger is the most helpful :) | 12:06 |
| apuimedo | stevemar: and most responsive | 12:06 |
| apuimedo | I'm starting to suspect it's an IRC bot with a really good AI giving answers to our queries | 12:06 |
| openstackgerrit | Merged openstack-infra/project-config: Remove jobs from python-keystoneclient-kerberos https://review.openstack.org/413790 | 12:07 |
| *** gongysh has quit IRC | 12:08 | |
| AJaeger | ;) | 12:08 |
| stevemar | hehe | 12:08 |
| apuimedo | xD | 12:09 |
| apuimedo | basically, we'd like there to be a container registry, but since there is not, we are going to use tarballs.openstack.org instead | 12:09 |
| apuimedo | so that our CI tests that have to run containers do not need to go to the docker registry at all | 12:09 |
| apuimedo | which could give false negatives (and this happened in the past with kuryr-libnetwork) | 12:10 |
| AJaeger | apuimedo: there were some folks looking at setting up a registry | 12:10 |
| apuimedo | AJaeger: the problem IIRC was that kolla's requirements were big and serious enough that a solution needs time | 12:10 |
| *** gomarivera has quit IRC | 12:11 | |
| *** jpena is now known as jpena|lunch | 12:11 | |
| *** jkilpatr has joined #openstack-infra | 12:11 | |
| *** bhavik1 has joined #openstack-infra | 12:11 | |
| AJaeger | apuimedo: AFAIR inc0 wanted to work on it... | 12:12 |
| apuimedo | yeah | 12:13 |
| AJaeger | apuimedo: but yeah, that might take long. So, discuss with rest of team what to do in the meantime | 12:13 |
| apuimedo | cool. Thanks | 12:13 |
| apuimedo | AJaeger: do you know which tz those are in? | 12:13 |
| *** florianf has joined #openstack-infra | 12:14 | |
| *** rbuzatu_ has quit IRC | 12:15 | |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: DONT MERGE: test oooq https://review.openstack.org/414073 | 12:16 |
| *** rbuzatu has joined #openstack-infra | 12:16 | |
| AJaeger | apuimedo: different ones;) Take US West coast, so be back in 4 or 5 hours;) | 12:16 |
| apuimedo | ok | 12:16 |
| apuimedo | Thanks! | 12:16 |
| *** sreeram_v has joined #openstack-infra | 12:17 | |
| *** hashar has quit IRC | 12:18 | |
| *** rbuzatu_ has joined #openstack-infra | 12:20 | |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: DONT MERGE: test oooq https://review.openstack.org/414073 | 12:20 |
| *** rbuzatu has quit IRC | 12:20 | |
| *** ociuhandu has joined #openstack-infra | 12:20 | |
| dims | AJaeger : thanks! | 12:21 |
| *** markvoelker has joined #openstack-infra | 12:22 | |
| *** furlongm_ has quit IRC | 12:23 | |
| *** furlongm has joined #openstack-infra | 12:23 | |
| openstackgerrit | Julia Varlamova proposed openstack-infra/devstack-gate: Add MULTI_KEYSTONE flag and new role https://review.openstack.org/394895 | 12:24 |
| *** furlongm has quit IRC | 12:25 | |
| *** arxcruz has quit IRC | 12:25 | |
| *** salv-orlando has quit IRC | 12:26 | |
| *** furlongm has joined #openstack-infra | 12:26 | |
| openstackgerrit | mathieu bultel proposed openstack-infra/tripleo-ci: Implement major upgrade for Newton to Ocata https://review.openstack.org/404831 | 12:27 |
| *** markvoelker has quit IRC | 12:28 | |
| openstackgerrit | Merged openstack-infra/project-config: DevStack updown for python3 https://review.openstack.org/413775 | 12:34 |
| *** pgadiya has quit IRC | 12:34 | |
| *** yamamoto has joined #openstack-infra | 12:37 | |
| *** snarwade has quit IRC | 12:38 | |
| *** esikachev has quit IRC | 12:38 | |
| *** florianf has quit IRC | 12:39 | |
| *** sreeram_v has quit IRC | 12:41 | |
| *** rraja has joined #openstack-infra | 12:45 | |
| *** lucasagomes is now known as lucas-hungry | 12:47 | |
| tbarron | AJaeger: csaba and rraja and I have some followup questions to https://review.openstack.org/#/c/411469/ when you have a chance. | 12:47 |
| openstackgerrit | Monty Taylor proposed openstack/os-client-config: Update swift constructor to be Session aware https://review.openstack.org/414086 | 12:47 |
| *** derekh has quit IRC | 12:49 | |
| mordred | apuimedo: there is a skeleton up for starting the work on a docker registry server: https://review.openstack.org/#/c/401003/ | 12:54 |
| *** kjorgensen has joined #openstack-infra | 12:54 | |
| mordred | apuimedo, AJaeger: also, I believe we do consume tarballs built in earlier jobs already in some other projects - I don't rember which ones though | 12:55 |
| *** jpena|lunch is now known as jpena | 12:56 | |
| *** dprince has joined #openstack-infra | 12:58 | |
| *** dmellado_ has quit IRC | 12:58 | |
| *** kjorgensen has quit IRC | 12:59 | |
| AJaeger | tbarron: yes? | 12:59 |
| tbarron | AJaeger: thanks | 13:00 |
| *** gouthamr has joined #openstack-infra | 13:00 | |
| tbarron | AJaeger: we were looking at how to get manila glusterfs xenial jobs running. | 13:00 |
| tbarron | They fail but we don't see enough info in the logs to determine why and are hoping that you might have some suggestions. | 13:00 |
| tbarron | Consider https://review.openstack.org/#/c/394986 - where we can compare trusty and xenial jobs for in the same review. | 13:00 |
| tbarron | The trusty jobs succeed but the xenial jobs get POST_FAILURE and very little logs are left to examine. | 13:00 |
| tbarron | We can see from the console log that the pre_test_hook ran, that the devstack run itself failed, but no devstack logs are available to examine. | 13:00 |
| tbarron | Any tips for how to proceed? | 13:00 |
| tbarron | AJaeger: ^^^ figure you've seen a lot more of these than we have :D | 13:01 |
| *** ccamacho is now known as ccamacho|lunch | 13:02 | |
| AJaeger | tbarron: POST_FAILURE is often a CI problem, next time feel free to ask directly here. | 13:02 |
| AJaeger | Looking at the ansible log http://logs.openstack.org/86/394986/1/check/gate-manila-tempest-dsvm-glusterfs-nfs-ubuntu-xenial-nv/5c0632d/_zuul_ansible/ansible_log.txt.gz I see that output files were not generated at all | 13:02 |
| tbarron | hmm, our friend gouthamr pointed out an rsync failure | 13:03 |
| tbarron | http://logs.openstack.org/86/394986/1/check/gate-manila-tempest-dsvm-glusterfs-nfs-ubuntu-xenial-nv/5c0632d/_zuul_ansible/ansible_log.txt.gz | 13:03 |
| AJaeger | tbarron: but if you look at http://logs.openstack.org/86/394986/1/check/gate-manila-tempest-dsvm-glusterfs-nfs-ubuntu-xenial-nv/5c0632d/console.html.gz#_2016-11-08_14_29_32_347298 you see that the "this takes 10-15 minutes" finished after 18 seconds | 13:04 |
| AJaeger | So, it failed directly setting up the tests | 13:04 |
| openstackgerrit | Monty Taylor proposed openstack/os-client-config: Add OpenTelekomCloud to the vendors https://review.openstack.org/412098 | 13:04 |
| AJaeger | tbarron: let's recheck your change and see what happens today (check experimental should run xenial, doesn't it?) | 13:05 |
| tbarron | AJaeger: yeah, right. Are you saying you think it's just an ephemeral issue? | 13:06 |
| AJaeger | tbarron: let's double check ;) | 13:06 |
| tbarron | AJaeger: kk | 13:06 |
| AJaeger | tbarron: you better have this working on Xenial asap since already Ocata is Xenial tested. | 13:06 |
| tbarron | AJaeger: the question here isn't motivation, it's missing information :D | 13:08 |
| AJaeger | tbarron: then let's figure out what's broken ;) | 13:09 |
| AJaeger | ok, let's wait for the results of that check experimental... | 13:09 |
| *** esikachev has joined #openstack-infra | 13:09 | |
| dirk | tbarron: I bet this is the eventlet/greenlet problem | 13:10 |
| *** tqtran has joined #openstack-infra | 13:10 | |
| dirk | we have that on multiple cases righ tnow. basically the VM is OOM | 13:10 |
| tbarron | dirk: THE eventlet/greenlet problem (snarky laugh) | 13:10 |
| tbarron | dirk: oh, interesting | 13:10 |
| tbarron | dirk: these are 8GB VMs, right? | 13:10 |
| openstackgerrit | Merged openstack-infra/shade: Combine list of calls with list of request assertions https://review.openstack.org/412106 | 13:11 |
| AJaeger | tbarron: yes, see http://docs.openstack.org/infra/manual/testing.html | 13:11 |
| tbarron | AJaeger: thanks (bookmarked) | 13:12 |
| *** kgiusti has joined #openstack-infra | 13:12 | |
| AJaeger | looking at logs, this now takes longer than 30 seconds ;) | 13:12 |
| *** psachin has quit IRC | 13:12 | |
| dirk | tbarron: yes, basically at some point glance piles up bazillions of processes and kills the VM | 13:13 |
| dirk | only happens with the newest eventlet/greenlet release and thats why we reduced the upper-constraints to the previous version | 13:13 |
| AJaeger | tbarron: argh, csaba just updated the change and that killed the experimental jobs ;( | 13:14 |
| AJaeger | csaba: a recheck would have been nicer ;) | 13:14 |
| *** tqtran has quit IRC | 13:15 | |
| csaba | AJaeger: that was my intent. I wanted to push a new commit just failed to reset the Change-Id :/ | 13:15 |
| AJaeger | tbarron: let's see what happens, I'll be out christmas tree shopping in a bit and then let's look at the results. But others here might be able to help as well. | 13:15 |
| AJaeger | csaba: just add "recheck" as comment and tests are rerun | 13:15 |
| tbarron | AJaeger: get that tree, it's getting close! | 13:16 |
| tbarron | AJaeger: dirk I guess the constraints change may mean this run looks different ... | 13:16 |
| *** links has quit IRC | 13:18 | |
| *** kgiusti has quit IRC | 13:18 | |
| *** gouthamr has quit IRC | 13:19 | |
| *** gouthamr has joined #openstack-infra | 13:19 | |
| *** askb has quit IRC | 13:20 | |
| openstackgerrit | Merged openstack-infra/shade: Let use_glance handle adding the entry to self.calls https://review.openstack.org/412107 | 13:20 |
| *** psachin has joined #openstack-infra | 13:20 | |
| *** esikache1 has joined #openstack-infra | 13:22 | |
| *** dstufft|travelin is now known as dstufft | 13:22 | |
| *** chlong has joined #openstack-infra | 13:23 | |
| openstackgerrit | Monty Taylor proposed openstack/os-client-config: Update swift constructor to be Session aware https://review.openstack.org/414086 | 13:24 |
| *** esikachev has quit IRC | 13:25 | |
| *** trown|outtypewww is now known as trown | 13:25 | |
| *** lucas-hungry is now known as lucasagomes | 13:26 | |
| *** esberglu has joined #openstack-infra | 13:27 | |
| *** esberglu has quit IRC | 13:27 | |
| *** esberglu has joined #openstack-infra | 13:27 | |
| *** amoralej is now known as amoralej|lunch | 13:28 | |
| apuimedo | mordred: any hint of what to search for in the tarball consumption? | 13:28 |
| mordred | apuimedo: nope - although the thing AJaeger pointed you at earlier - the publish to pypi stuff, does a build tarball in job one, then fetch tarball from tarballs.o.o in step 2 dance | 13:30 |
| mordred | apuimedo: so if you look at {name}-tarball and {name}-pypi-both-upload | 13:30 |
| *** savihou has quit IRC | 13:30 | |
| mordred | you can see what it's doing | 13:30 |
| apuimedo | cool | 13:30 |
| *** savihou has joined #openstack-infra | 13:30 | |
| openstackgerrit | James Slagle proposed openstack-infra/tripleo-ci: Use os-net-config in multinode jobs https://review.openstack.org/409346 | 13:31 |
| openstackgerrit | James Slagle proposed openstack-infra/tripleo-ci: Use disable_contraints in custom roles data in CI https://review.openstack.org/410392 | 13:31 |
| *** rlandy has joined #openstack-infra | 13:33 | |
| *** kgiusti has joined #openstack-infra | 13:35 | |
| *** lindycoder has joined #openstack-infra | 13:35 | |
| *** matrohon has joined #openstack-infra | 13:38 | |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/project-config: Run oooq ha and nonha jobs for quickstart https://review.openstack.org/401298 | 13:38 |
| openstackgerrit | Anton Arefiev proposed openstack-infra/project-config: Fix Inspector grenade job https://review.openstack.org/414109 | 13:39 |
| *** asettle__ has joined #openstack-infra | 13:42 | |
| *** asettle has quit IRC | 13:42 | |
| *** kjorgensen has joined #openstack-infra | 13:43 | |
| *** asettle__ is now known as asettle | 13:43 | |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/project-config: Move containers tripleo job from experimental https://review.openstack.org/414113 | 13:45 |
| *** kjorgensen has quit IRC | 13:47 | |
| *** markvoelker has joined #openstack-infra | 13:48 | |
| *** Julien-zte has joined #openstack-infra | 13:50 | |
| openstackgerrit | Merged openstack-infra/shade: Replace mocks of swiftclient with request_mock https://review.openstack.org/412108 | 13:56 |
| *** matrohon has quit IRC | 13:56 | |
| openstackgerrit | Merged openstack-infra/shade: Stop calling HEAD before DELETE for objects https://review.openstack.org/412528 | 13:56 |
| openstackgerrit | Merged openstack-infra/shade: Stop using full_listing in prep for REST calls https://review.openstack.org/412529 | 13:56 |
| openstackgerrit | James Slagle proposed openstack-infra/tripleo-ci: Use os-net-config in multinode jobs https://review.openstack.org/409346 | 13:58 |
| openstackgerrit | James Slagle proposed openstack-infra/tripleo-ci: Use disable_contraints in custom roles data in CI https://review.openstack.org/410392 | 13:58 |
| openstackgerrit | Steve Martinelli proposed openstack-infra/project-config: retire keystoneclient-kerberos https://review.openstack.org/413820 | 13:59 |
| *** dizquierdo has quit IRC | 14:00 | |
| *** ccamacho|lunch is now known as ccamacho | 14:02 | |
| *** armax has joined #openstack-infra | 14:03 | |
| *** matrohon has joined #openstack-infra | 14:05 | |
| openstackgerrit | Merged openstack-infra/tripleo-ci: Disable the ceilo swift pipeline for multinode https://review.openstack.org/409483 | 14:06 |
| openstackgerrit | Merged openstack-infra/shade: Switch swift calls to REST https://review.openstack.org/412530 | 14:07 |
| openstackgerrit | Merged openstack-infra/shade: Make delete_object return True and False https://review.openstack.org/412543 | 14:07 |
| openstackgerrit | Merged openstack-infra/shade: Update swift exception tests to use 416 https://review.openstack.org/412544 | 14:07 |
| openstackgerrit | Merged openstack-infra/shade: Make assert_calls a bit more readable https://review.openstack.org/412549 | 14:07 |
| toabctl | AJaeger, hey. and idea why http://logs.openstack.org/24/410724/4/check/gate-rpm-packaging-tox-lint-ubuntu-xenial/6a8675b/console.html is failing? | 14:08 |
| toabctl | it tries to query the local pypi mirror and gets a "xmlrpclib.ProtocolError: <ProtocolError for mirror.regionone.osic-cloud1.openstack.org/pypi/simple: 301 Moved Permanently>" | 14:08 |
| *** esikache1 has quit IRC | 14:08 | |
| mriedem | AJaeger: i'd need to look at which nova experimental jobs are trusty only at this point and could be dropped | 14:11 |
| *** esikache1 has joined #openstack-infra | 14:11 | |
| *** esikache1 has quit IRC | 14:15 | |
| *** baoli has joined #openstack-infra | 14:15 | |
| *** baoli has quit IRC | 14:15 | |
| *** baoli has joined #openstack-infra | 14:16 | |
| *** esikache1 has joined #openstack-infra | 14:16 | |
| dhellmann | AJaeger : do you have a second to look at a reno patch to fix a bug that's blocking a couple of projects? https://review.openstack.org/#/c/414161/ | 14:17 |
| Cibo | hello guys, may be somebody faced the problem like this: in devstack-gate ---- the gate_hook func that is been exported --- normaly you will call $BASE/new/devstack-gate/devstack-vm-gate.sh, but after last Thursday it is not working, can anybody please tell me what had happened? | 14:18 |
| *** hurgleburgler has joined #openstack-infra | 14:20 | |
| *** esikache1 has quit IRC | 14:21 | |
| *** jcoufal has joined #openstack-infra | 14:21 | |
| *** matrohon has quit IRC | 14:22 | |
| *** _Cyclone_ has quit IRC | 14:23 | |
| *** esikache1 has joined #openstack-infra | 14:26 | |
| *** eharney has joined #openstack-infra | 14:30 | |
| *** rbuzatu_ has quit IRC | 14:31 | |
| *** _Cyclone_ has joined #openstack-infra | 14:31 | |
| *** rbuzatu has joined #openstack-infra | 14:31 | |
| *** dave-mccowan has joined #openstack-infra | 14:32 | |
| *** sdake has joined #openstack-infra | 14:33 | |
| *** esikache1 has quit IRC | 14:33 | |
| *** Julien-zte has quit IRC | 14:33 | |
| *** jamesden_ has quit IRC | 14:33 | |
| openstackgerrit | Andrey Shestakov proposed openstack-infra/shade: Add failure check to node_set_provision_state https://review.openstack.org/414174 | 14:34 |
| *** Julien-zte has joined #openstack-infra | 14:34 | |
| *** Julien-zte has quit IRC | 14:35 | |
| *** jamesdenton has joined #openstack-infra | 14:35 | |
| *** Julien-zte has joined #openstack-infra | 14:35 | |
| *** Julien-zte has quit IRC | 14:36 | |
| *** esikache1 has joined #openstack-infra | 14:36 | |
| *** Julien-zte has joined #openstack-infra | 14:36 | |
| *** Julien-zte has quit IRC | 14:36 | |
| *** Julien-zte has joined #openstack-infra | 14:37 | |
| *** eharney has quit IRC | 14:37 | |
| *** Julien-zte has quit IRC | 14:37 | |
| *** Julien-zte has joined #openstack-infra | 14:38 | |
| *** rbuzatu has quit IRC | 14:38 | |
| *** Julien-zte has quit IRC | 14:38 | |
| *** amoralej|lunch is now known as amoralej | 14:38 | |
| *** rafaels has joined #openstack-infra | 14:38 | |
| *** Julien-zte has joined #openstack-infra | 14:38 | |
| *** Julien-zte has quit IRC | 14:39 | |
| *** esikache1 has quit IRC | 14:40 | |
| *** jheroux has joined #openstack-infra | 14:41 | |
| *** sreeram_v has joined #openstack-infra | 14:41 | |
| openstackgerrit | Andreas Florath proposed openstack/diskimage-builder: Move evaluation of init system to chroot phases https://review.openstack.org/414179 | 14:43 |
| *** esikache1 has joined #openstack-infra | 14:44 | |
| *** sreeram_v has quit IRC | 14:46 | |
| *** adrian_otto has joined #openstack-infra | 14:47 | |
| *** kzaitsev_mb has quit IRC | 14:48 | |
| *** adrian_otto has quit IRC | 14:48 | |
| *** esikache1 has quit IRC | 14:48 | |
| *** eharney has joined #openstack-infra | 14:50 | |
| *** rbuzatu has joined #openstack-infra | 14:50 | |
| *** nmagnezi has quit IRC | 14:51 | |
| AJaeger | toabctl: strange a 301 moved permanently? pabelanger, mordred , any idea? | 14:53 |
| *** jordanP has joined #openstack-infra | 14:53 | |
| mordred | AJaeger: uhm, weird? | 14:53 |
| openstackgerrit | chenyingnan proposed openstack/diskimage-builder: Change "Openstack" to "OpenStack" https://review.openstack.org/414186 | 14:53 |
| AJaeger | mriedem: there are some that are both trusty and xenial - I expect the trusty can be dropped. | 14:53 |
| AJaeger | mordred: is the URL correct? | 14:54 |
| *** esikache1 has joined #openstack-infra | 14:54 | |
| mriedem | AJaeger: yeah, i can do that | 14:54 |
| AJaeger | thanks, mriedem. | 14:55 |
| AJaeger | tbarron: results are in - and now you should have log files to look at for xenial... | 14:56 |
| *** baoli has quit IRC | 14:58 | |
| *** baoli has joined #openstack-infra | 14:59 | |
| *** kzaitsev_mb has joined #openstack-infra | 14:59 | |
| tbarron | AJaeger: thanks, we'll look ^^ csaba rraja ^^ | 14:59 |
| *** saibarspeis has quit IRC | 14:59 | |
| *** baoli has quit IRC | 14:59 | |
| *** baoli has joined #openstack-infra | 15:00 | |
| AJaeger | tbarron: I can make my project-config change dependent on a fix if you want and wait until that one is in. | 15:00 |
| tbarron | AJaeger: thanks for the offer, let's see if we can get a fix posted | 15:01 |
| *** fguillot has joined #openstack-infra | 15:02 | |
| *** mtanino has joined #openstack-infra | 15:03 | |
| AJaeger | armax: there're some more open neutron changes, could you review them all, please? Do you want change numbers for open reviews? | 15:03 |
| armax | AJaeger: if you’d be so kind, yes…my pipeline of infra changes seems dry | 15:03 |
| armax | dunno why | 15:04 |
| *** kaisers has left #openstack-infra | 15:04 | |
| AJaeger | armax: https://review.openstack.org/407778 https://review.openstack.org/413480 https://review.openstack.org/412547 https://review.openstack.org/411821 https://review.openstack.org/411433 https://review.openstack.org/409564 | 15:07 |
| AJaeger | those have at least one +2 | 15:07 |
| armax | AJaeger: danke | 15:07 |
| armax | AJaeger: +2 don’t count ;) | 15:07 |
| * armax kids | 15:08 | |
| openstackgerrit | Merged openstack-infra/project-config: neutron: move grenade multinode linuxbridge job into check queue https://review.openstack.org/411263 | 15:08 |
| AJaeger | armax: also, found https://review.openstack.org/#/c/408780/ | 15:10 |
| armax | AJaeger: ack | 15:10 |
| *** senk has quit IRC | 15:11 | |
| *** rbuzatu has quit IRC | 15:12 | |
| AJaeger | armax: ihrachys commented on 413032 ... | 15:12 |
| openstackgerrit | Andrey Shestakov proposed openstack-infra/shade: Add failure check to node_set_provision_state https://review.openstack.org/414174 | 15:13 |
| *** Goneri has joined #openstack-infra | 15:13 | |
| *** e0ne has quit IRC | 15:14 | |
| * armax is flooded | 15:15 | |
| * mordred hands armax a towel and some buckets | 15:17 | |
| armax | mordred: thanks, much appreciated | 15:18 |
| *** jheroux has quit IRC | 15:21 | |
| *** dizquierdo has joined #openstack-infra | 15:25 | |
| *** yamamoto has quit IRC | 15:25 | |
| *** salv-orlando has joined #openstack-infra | 15:26 | |
| *** nadya has joined #openstack-infra | 15:27 | |
| pabelanger | what is the best way to override a devstack gate setting from a projects devstack/setting file? eg: for nodepool | 15:30 |
| *** salv-orlando has quit IRC | 15:31 | |
| openstackgerrit | Davanum Srinivas (dims) proposed openstack-infra/devstack-gate: pass-through USE_PYTHON3 to devstack https://review.openstack.org/414196 | 15:32 |
| *** yuval has quit IRC | 15:32 | |
| openstackgerrit | Merged openstack-infra/tripleo-ci: Revert "Enable undercloud ssl on all OVB jobs" https://review.openstack.org/412583 | 15:32 |
| *** psachin has quit IRC | 15:33 | |
| *** mtan_____ has joined #openstack-infra | 15:34 | |
| openstackgerrit | James Slagle proposed openstack-infra/tripleo-ci: Use disable_contraints in custom roles data in CI https://review.openstack.org/410392 | 15:34 |
| clarkb | toabctl: I am not sure that xmlrpc is going to work against our mirrors. they are package content mkrrors not instances of cheeseshop but also thats an http 301 response so follow it to the new location? | 15:35 |
| openstackgerrit | Merged openstack-infra/shade: Add test to verify devstack keystone config https://review.openstack.org/413139 | 15:35 |
| *** mtanino has quit IRC | 15:35 | |
| *** jheroux has joined #openstack-infra | 15:36 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/project-config: Switch to DEVSTACK_GATE_SETTINGS for nodepool dsvm job https://review.openstack.org/414203 | 15:37 |
| pabelanger | clarkb: mordred: ^ would that be the correct way to override the devstack/settings file from nodepool? | 15:38 |
| pabelanger | clarkb: mordred: or does that need to be a pre_test_hook? | 15:39 |
| clarkb | neither | 15:39 |
| clarkb | you want to use th localrc passthrough var | 15:39 |
| pabelanger | k | 15:40 |
| openstackgerrit | Davanum Srinivas (dims) proposed openstack-infra/project-config: Fix typo for USE_PYTHON3 https://review.openstack.org/414204 | 15:40 |
| clarkb | those variables are read by devstack not d-g | 15:40 |
| clarkb | and d-g will sanitize env before starting devstack so best thing is to write it down in localrc file | 15:40 |
| *** deadnull has quit IRC | 15:41 | |
| dims | AJaeger : sdague : looks like i used "true" instead of "True" for the py35 job. fix is in https://review.openstack.org/414204/. sorry! | 15:41 |
| pabelanger | clarkb: okay, so by using KEEP_LOCALRC=1 setting, our export NODEPOOL_PAUSE_CENTOS_7_DIB=false will be passed along properly? | 15:44 |
| clarkb | no | 15:45 |
| sdague | dims: well it doesn't really matter right, because that's just the signalling to d-g | 15:45 |
| clarkb | the keep localrc var requires you write data to a localrc file you eant to keep. we have a var whose contents are written to the localrc by d-g that I would use. I think we already use it to enable the plugin | 15:46 |
| dims | sdague : the check in devstack will not work (http://git.openstack.org/cgit/openstack-dev/devstack/tree/inc/python#n363) | 15:46 |
| clarkb | pabelanger: the issue here is devstack gate doesnt know anything about those vars then when it sudos to run devstack it clwars them out. So you need to use something that affects the config of devstack | 15:46 |
| sdague | dims: ah, can you instead do the USE_PYTHON3=$(trueorfalse False USE_PYTHON3) | 15:47 |
| sdague | then devstack will normalize it | 15:47 |
| Jeffrey4l | the files in /home/jenkins/.ccache is ownered by root now, which cause some issue. any one can confirm this? http://logs.openstack.org/97/399897/4/check/gate-kolla-dsvm-build-ubuntu-binary-ubuntu-xenial-nv/92f56ff/console.html#_2016-12-22_09_56_01_749668 | 15:47 |
| sdague | and it would work | 15:47 |
| clarkb | pabelanger: we want to do what is on line 95 | 15:47 |
| dims | sdague : will do that too | 15:47 |
| *** salv-orlando has joined #openstack-infra | 15:48 | |
| *** yamamoto has joined #openstack-infra | 15:48 | |
| sdague | that should just be a stackrc change in your devstack patch | 15:48 |
| clarkb | Jeffrey4l: when we use them we copy and chown them | 15:48 |
| *** yamamoto has quit IRC | 15:48 | |
| sdague | and if you depends-on the d-g change, we should see it actually working | 15:48 |
| *** yamamoto has joined #openstack-infra | 15:48 | |
| clarkb | Jeffrey4l: so I dont know that that has changed recently | 15:48 |
| sdague | which will be really interesting to see how far everything gets | 15:48 |
| Jeffrey4l | then should i chown them at the beginning of my job? | 15:49 |
| clarkb | Jeffrey4l: thats what we do | 15:49 |
| Jeffrey4l | roger. thanks. | 15:49 |
| clarkb | Jeffrey4l: they get copied to the devstack files/ dir and chowned to the stack user | 15:49 |
| openstackgerrit | Merged openstack-infra/project-config: networking-midonet: Don't skip tempest jobs for tempest plugin changes https://review.openstack.org/413480 | 15:49 |
| Jeffrey4l | this is Kolla's job, which do not use devstack and stack user. | 15:50 |
| clarkb | I understand | 15:50 |
| openstackgerrit | Merged openstack-infra/project-config: neutron: trigger gate hooks for dvr scenario job https://review.openstack.org/412547 | 15:50 |
| openstackgerrit | Merged openstack-infra/project-config: Update networking-sfc grafana dashboard https://review.openstack.org/411821 | 15:51 |
| clarkb | I am just saying the jobs that that data is cached for have always had to copy and chown | 15:51 |
| AJaeger | pabelanger: could you put https://review.openstack.org/413590 on your review queue for later, please? | 15:51 |
| Jeffrey4l | gotcha | 15:51 |
| openstackgerrit | Ihar Hrachyshka proposed openstack-infra/project-config: neutron: kill non-dvr OVS scenario https://review.openstack.org/414210 | 15:52 |
| ihrachys | armax: ^ | 15:52 |
| *** OferBarber has quit IRC | 15:53 | |
| armax | ihrachys: so the dvr scenario job was multinode all along? | 15:53 |
| ihrachys | armax: yes of course | 15:54 |
| *** rbuzatu has joined #openstack-infra | 15:54 | |
| *** DavidPurcell has joined #openstack-infra | 15:54 | |
| ihrachys | armax: we prolly should migrate lb one to multinode too | 15:54 |
| ihrachys | but that's for another day | 15:54 |
| clarkb | Jeffrey4l: https://git.openstack.org/cgit/openstack-infra/devstack-gate/tree/functions.sh#n560 | 15:54 |
| *** xarses has joined #openstack-infra | 15:55 | |
| openstackgerrit | Merged openstack-infra/nodepool: Mitigate config disagreement issues https://review.openstack.org/413125 | 15:56 |
| Jeffrey4l | got. thanks. | 15:56 |
| smcginnis | Are there known issues right now with logging in to gerrit? | 15:56 |
| *** Sukhdev has joined #openstack-infra | 15:56 | |
| *** xarses_ has joined #openstack-infra | 15:57 | |
| mordred | clarkb, pabelanger, jeblair: I'd like to cut a shade release and restart the nodepool builders today - that ok with y'all? | 15:57 |
| AJaeger | clarkb: will having a periodic job in the experimental queue work just fine - see https://review.openstack.org/#/c/408780/3/zuul/layout.yaml ? | 15:58 |
| clarkb | mordred: I think today is going to start my mostly not being here. So I defer to others | 15:58 |
| *** rbuzatu has quit IRC | 15:58 | |
| clarkb | AJaeger: it will work but branch selection is hard set for periodic jobs | 15:58 |
| clarkb | AJaeger: so the experimental job may not do wjat is expected | 15:59 |
| *** xarses has quit IRC | 15:59 | |
| AJaeger | yeah | 15:59 |
| AJaeger | thanks, clarkb | 16:00 |
| clarkb | smcginnis: I just logged in so no known issues on my end | 16:01 |
| *** hongbin has joined #openstack-infra | 16:01 | |
| *** Guest47337 has quit IRC | 16:03 | |
| pabelanger | clarkb: for give me, need some more help. Are you saying, I need to use DEVSTACK_LOCAL_CONFIG to pass the vars? | 16:03 |
| smcginnis | clarkb: Thanks. Must be something on my system. Time to turn it of and back on again. | 16:04 |
| smcginnis | *off | 16:04 |
| pabelanger | which gets saved into localrc | 16:04 |
| mordred | clarkb: cool. I have tested that it still uploads images to rackspace, so it _should_ mostly be a no-op | 16:04 |
| pabelanger | mordred: I am able to support the effort today | 16:05 |
| mordred | pabelanger: woot! | 16:05 |
| mordred | pabelanger: do we have any grafana dashboards that track image upload API stats? I couldn't find any looking | 16:06 |
| clarkb | pabelanger: yes | 16:06 |
| pabelanger | mordred: I dont' think so. just server API things | 16:06 |
| pabelanger | mordred: we should likely add them | 16:06 |
| mordred | k. cool | 16:06 |
| clarkb | because env vars are sanitized by sudo/devstack-gate you need to do something that results in those vars written to config on disk | 16:06 |
| pabelanger | clarkb: okay, let me see if I cna get it | 16:06 |
| clarkb | and that is one of the easiest ways to do that | 16:07 |
| mordred | pabelanger: the move to REST changes the statsd variables that get collected ... but we don't have to deal with fixing server dashboards until we do the nova/neutron APIs | 16:07 |
| *** baoli has quit IRC | 16:09 | |
| *** baoli has joined #openstack-infra | 16:10 | |
| *** gomarivera has joined #openstack-infra | 16:11 | |
| openstackgerrit | Oksana Voshchana proposed openstack-infra/devstack-gate: TEST for multinode grenade devstack https://review.openstack.org/396679 | 16:11 |
| openstackgerrit | Paul Belanger proposed openstack-infra/project-config: Fix include logic for nodepool dsvm jobs https://review.openstack.org/414213 | 16:12 |
| pabelanger | clarkb: ^ | 16:12 |
| pabelanger | mordred: ack | 16:12 |
| dims | mordred : hopefully quick review if you have a minute. ( https://review.openstack.org/#/c/414196/ ) | 16:12 |
| mordred | dims: lgtm | 16:14 |
| dims | thanks! | 16:15 |
| *** chandankumar is now known as chandankumar|off | 16:15 | |
| pabelanger | mordred: AJaeger: if you don't mind too: https://review.openstack.org/#/c/414213/ | 16:16 |
| *** gomarivera has quit IRC | 16:16 | |
| *** xarses_ is now known as xarses | 16:16 | |
| openstackgerrit | Matthew Thode proposed openstack/diskimage-builder: Fix Gentoo builds on Ubuntu 16.04 Xenial hosts https://review.openstack.org/413395 | 16:18 |
| *** yamamoto has quit IRC | 16:20 | |
| *** zz_dimtruck is now known as dimtruck | 16:20 | |
| AJaeger | pabelanger: +2A | 16:20 |
| *** nadya has quit IRC | 16:20 | |
| openstackgerrit | Merged openstack-infra/project-config: Py34/py35 cleanups https://review.openstack.org/413590 | 16:23 |
| *** senk has joined #openstack-infra | 16:23 | |
| openstackgerrit | Merged openstack-infra/project-config: Fix typo for USE_PYTHON3 https://review.openstack.org/414204 | 16:25 |
| jaypipes | AJaeger, clarkb, fungi: morning fellows. quick question for you. what is the process for "resetting" an openstack/ repo to import from a GitHub repo? I am working with Cumulus Networks. They've reworked networking-cumulus on their Github repo and now want to replace the (empty) openstack/metworking-cumulus repo with their github.com/CumulusNetworks/networking-cumulus repo state (and then mark their GH org/repo as read-only). Should I simply | 16:26 |
| jaypipes | put in a new project-config request? or is there something different I need to do? | 16:26 |
| *** inc0 has joined #openstack-infra | 16:26 | |
| openstackgerrit | Merged openstack-infra/project-config: Fix include logic for nodepool dsvm jobs https://review.openstack.org/414213 | 16:26 |
| mordred | jaypipes: if it exists in gerrit already, it just needs one of us to force-push the new repo contents in | 16:28 |
| mordred | jaypipes: I'm about to hop on a call - if nobody else has done it by the time I'm off, I can get it for you | 16:29 |
| jaypipes | mordred: ah, ok, cool. thank you sir. | 16:29 |
| *** asettle has quit IRC | 16:29 | |
| openstackgerrit | Merged openstack-infra/project-config: networking-midonet: Add periodic tempest job for newton https://review.openstack.org/409564 | 16:30 |
| *** abregman has quit IRC | 16:30 | |
| *** ralonsoh has quit IRC | 16:31 | |
| mordred | jaypipes: do they want the v1.0.0pre tag to stick around? | 16:33 |
| *** dizquierdo has quit IRC | 16:33 | |
| jaypipes | mordred: guh, I told them not to tag the repo... meh, | 16:34 |
| AJaeger | jaypipes: in general import happens at repo creation time, see http://docs.openstack.org/infra/manual/creators.html#add-the-project-to-the-master-projects-list | 16:34 |
| mordred | it's ok - I can just leave it out | 16:34 |
| jaypipes | mordred: no, I would say not. | 16:34 |
| jaypipes | mordred: but then again, maybe? | 16:34 |
| jaypipes | not sure really | 16:34 |
| *** baoli has quit IRC | 16:34 | |
| mordred | jaypipes: done. repo contents in gerrit are now what were in github.com/CumulusNetworks/networking-cumulus | 16:35 |
| clarkb | also please please please dont make gerrit projects if you dont intend on using them | 16:35 |
| clarkb | it just makes more work for us | 16:36 |
| mordred | jaypipes: I also added a gitreview file | 16:36 |
| jaypipes | clarkb: Clark, I didn't make the Gerrit repo. | 16:36 |
| jaypipes | clarkb: Cumulus came to me about a week ago and said they had been working in their own GH account and wanted to "do things the OPenStack way" | 16:36 |
| clarkb | I'm not saying you did just as a general thing we see this issue happen over and over | 16:36 |
| jaypipes | mordred: ty | 16:36 |
| clarkb | project gets made in gerrit, is ignored for 6 months, then manual import is wanted | 16:37 |
| jaypipes | clarkb: I've been encouraging Cumulus to work on IRC and get involved in the community. It's not really their bag, unfortunately. | 16:37 |
| *** senk has quit IRC | 16:37 | |
| jaypipes | in any case, I'm going to work with them today to mark their GH repo readonly | 16:38 |
| jaypipes | and they will be using gerrit from now on. | 16:38 |
| *** gomarivera has joined #openstack-infra | 16:38 | |
| AJaeger | jaypipes, then let me ask differently - why did vasyl set up an empty repo and only now it gets filled with life? https://review.openstack.org/354784 | 16:38 |
| AJaeger | jaypipes: could you follow up with Vasyl so that this does not happen again, please? | 16:38 |
| jaypipes | AJaeger: because Vasyl created a Cumulus ML2 agent-based driver, proposed it to networking-cumulus and then the Cumulus folks came out of the GH woodwork and said they'd been working behind a wall and had an ML2 driver based on their Cumulus REST API (not agent-based) and could we please not submit our code. :( | 16:39 |
| jaypipes | AJaeger: Vasyl was only trying to work with Cumulus stuff because OSIC/Intel was asking for Cumulus integration and Cumulus wasn't communicating with anyone. | 16:40 |
| AJaeger | jaypipes: what fun ;( | 16:40 |
| jaypipes | AJaeger: honestly, it's nothing bad that Vasyl did. he was just trying to get some cumulus stuff working and doing it in the openstack way from the beginning. | 16:41 |
| *** kzaitsev_mb has quit IRC | 16:42 | |
| jaypipes | AJaeger: this was vasyl's original agent-based driver that Cumulus saw and didn't want: https://review.openstack.org/#/c/403946/ | 16:42 |
| AJaeger | jaypipes: we've seen too many situations where we get pushed for repo creation and then no interest after a few weeks - or suddenly asking for pushes. | 16:43 |
| AJaeger | jaypipes: I see, it's more complex than I expected. | 16:43 |
| jaypipes | AJaeger: understood, and I certainly am not trying to make work for you guys. | 16:43 |
| *** gomarivera has quit IRC | 16:43 | |
| AJaeger | jaypipes: hope it's solved for good now ;) | 16:43 |
| jaypipes | AJaeger: me too :) | 16:43 |
| jaypipes | thanks all for your help, much appreciated. | 16:44 |
| openstackgerrit | Merged openstack-infra/shade: Add failure check to node_set_provision_state https://review.openstack.org/414174 | 16:44 |
| clarkb | right I thnk the frustration on our end is new projects get treated like most inportant things for review. Then in a non zero number of them once I have put my time into it they get ignored in favor of github or whatever. Then 6 monyhs later its most important again and now I am asked to do more work to import this diverged repo state from elsewhere | 16:45 |
| jaypipes | clarkb: understood. | 16:45 |
| jaypipes | clarkb: again, we're not trying to make work for anyone. this was a situation that we didn't want to happen in the first place. | 16:46 |
| *** Jeffrey4l has quit IRC | 16:46 | |
| *** gomarivera has joined #openstack-infra | 16:49 | |
| AJaeger | clarkb: I give new repos *now* my lowest prio during reviews. I often do an initial review but let those sit then for a week so that more folks can review and comment. I really like submitters to think about the various options... | 16:50 |
| *** kjorgensen has joined #openstack-infra | 16:50 | |
| AJaeger | Just this week I tried to clean the queue ;) | 16:51 |
| AJaeger | empty the queue I meant... | 16:51 |
| *** shardy has quit IRC | 16:51 | |
| *** nadya has joined #openstack-infra | 16:51 | |
| *** electrofelix has quit IRC | 16:52 | |
| clarkb | AJaeger: I mean from the requestors. Its high priority until they actually havr to use gerrit then its back to github | 16:52 |
| clarkb | jaypipes: yup understood and happy to help. | 16:52 |
| AJaeger | clarkb: yeah, I know - I let myself not get pushed on those ;) | 16:52 |
| *** hurgleburgler has quit IRC | 16:52 | |
| clarkb | (very frequently pre summit) | 16:53 |
| AJaeger | Yeah ;( | 16:55 |
| AJaeger | and if it's not in pre-summit, the request is orphaned and abandoned 6 months later ;( | 16:55 |
| AJaeger | been there too often ;( | 16:55 |
| AJaeger | bbl | 16:56 |
| *** bhavik1 has quit IRC | 16:58 | |
| *** lucasagomes is now known as lucas-afk | 16:59 | |
| *** jaosorior has quit IRC | 17:05 | |
| *** sekelso has joined #openstack-infra | 17:05 | |
| *** jaosorior has joined #openstack-infra | 17:05 | |
| *** rbuzatu has joined #openstack-infra | 17:05 | |
| *** Jeffrey4l has joined #openstack-infra | 17:07 | |
| *** tlian has joined #openstack-infra | 17:07 | |
| smcginnis | Anyone around that can check out my gerrit account or give suggetions what I can check? I've tried multiple browsers and multiple machines, and I just cannot get logged in to gerrit today. | 17:09 |
| smcginnis | Seems like I authenticate OK. | 17:09 |
| *** savihou has quit IRC | 17:09 | |
| smcginnis | But then it sends me to a Not Found page. | 17:09 |
| smcginnis | Suspicious thing in the redirected URL is #SignInFailure,SIGN_IN,Contact+site+administrator | 17:09 |
| smcginnis | I've confirmed I can log in to Ubuntu One and check out my account there, so auth seems OK as far as the account itself goes. | 17:10 |
| *** sekelso has quit IRC | 17:11 | |
| jeblair | smcginnis: what's your launchpad id? | 17:13 |
| smcginnis | jeblair: stmcginnis | 17:13 |
| smcginnis | jeblair: Oh wait, not right. | 17:14 |
| smcginnis | jeblair: sean-mcginnis | 17:14 |
| smcginnis | Different on every service. :) | 17:14 |
| jeblair | thx; gimme a few | 17:14 |
| smcginnis | jeblair: Thanks! | 17:15 |
| *** senk has joined #openstack-infra | 17:15 | |
| *** Jeffrey4l has quit IRC | 17:15 | |
| *** Jeffrey4l has joined #openstack-infra | 17:15 | |
| *** rcrit has quit IRC | 17:17 | |
| clarkb | oh possible falout from openid update yesterday? | 17:17 |
| jeblair | clarkb: both ids are present and look correct | 17:18 |
| *** rbuzatu has quit IRC | 17:19 | |
| dirk | any gerrit admin around who can un-abandon https://review.openstack.org/#/c/41133 ? | 17:19 |
| dirk | looks like we need to fix this for stable thanks to the big make-everything-voting change | 17:19 |
| openstackgerrit | Gabriele Cerami proposed openstack-infra/tripleo-ci: updates: enable ssl https://review.openstack.org/402930 | 17:20 |
| *** yamamoto has joined #openstack-infra | 17:20 | |
| jeblair | dirk: i think you're missing a digit; but if you can't get ahold of the author, you might consider just pushing it up as a new change (alter the change id in the commit message) | 17:20 |
| dirk | sorry, yes, I mean https://review.openstack.org/#/c/411332/ | 17:21 |
| clarkb | smcginnis: can you log into the wiki? | 17:21 |
| smcginnis | clarkb: Checking... | 17:21 |
| clarkb | (that uses the old lp url though different openid implementayion so may not tell us much) | 17:21 |
| smcginnis | clarkb: Yes, verified I can log in and made a small edit to make sure. | 17:22 |
| *** flaper87 has quit IRC | 17:22 | |
| *** nadya has quit IRC | 17:22 | |
| *** mugsie|alt has quit IRC | 17:22 | |
| *** Jeffrey4l has quit IRC | 17:23 | |
| *** Jeffrey4l has joined #openstack-infra | 17:23 | |
| AJaeger | dirk, seeing your comment on the make py35 voting: I rather would make py35 not running on stable/newton than make it non-voting everywhere. | 17:26 |
| jeblair | smcginnis: er, sorry for how this sounds -- but have you, erm, tried restarting your browser and beginning the process fresh from review.openstack.org? (openid is a whole mess of redirects and would be nice to rule out some weird browser cache) | 17:27 |
| smcginnis | jeblair: Hah, yep. :) | 17:27 |
| jeblair | ok. we can probably dispense with turning your computer off and on again then. :) | 17:27 |
| dirk | AJaeger: sure, but the aspect that it changed the whole situation for all stable/* branches was not considered | 17:27 |
| dirk | AJaeger: the nv->voting change needs to be reverted for all stable/* + project combinations where it used to fail | 17:28 |
| smcginnis | jeblair: I was originally using just Chrome. Installed Firefox on this machine, same results. Rebooted machine completely. No difference. Logged in to remote machine that I had never used for OpenStack related activites. Tried logging in there. Same. | 17:28 |
| smcginnis | All seems to point to gerrit. | 17:28 |
| AJaeger | dirk: do you have examples where it fails? | 17:28 |
| mordred | jeblair: fwiw, smcginnis is not one of the 8 accouts that already had a login.ubuntu.com yesterday | 17:29 |
| AJaeger | The majority of repos has voting py34 jobs and thus py35 should be voting as well. So, a blind revert is a far too big hammer. | 17:29 |
| jeblair | mordred: thanks for checking that, i forgot to | 17:29 |
| *** yamamoto has quit IRC | 17:30 | |
| *** sshnaidm has quit IRC | 17:31 | |
| smcginnis | So not sure if this has any relevance. WHen I went to login.ubuntu.com to look at my account, the username field was blank. I set it to stmcginnis. Noticed my wiki account was sean-mcginnis, so tried updating it to that and it said that username was already in use. | 17:31 |
| openstackgerrit | Ben Nemec proposed openstack-infra/project-config: Add check-requirements job to additional tripleo projects https://review.openstack.org/414240 | 17:31 |
| *** sshnaidm has joined #openstack-infra | 17:31 | |
| jeblair | smcginnis: good to know. your gerrit account name is different, but i don't *think* that should matter to the sign-in process. | 17:32 |
| AJaeger | dirk, I'll happily fix those fallouts if you can point me at failures. | 17:32 |
| dirk | AJaeger: https://review.openstack.org/#/c/414061/ | 17:33 |
| clarkb | jeblair: yup iirc the gerrit username is independent in gerrit )has its own row in account external ids table) | 17:33 |
| *** inc0 has quit IRC | 17:34 | |
| AJaeger | dirk: so, just the requirements repo? Let me cook up a change... | 17:34 |
| *** inc0 has joined #openstack-infra | 17:34 | |
| openstackgerrit | Leif Madsen proposed openstack-infra/project-config: Match browbeat doc build trigger to rtg project name https://review.openstack.org/414242 | 17:34 |
| dirk | AJaeger: I would guess its much more than that, I'm currently scrambling my gerrit query foo | 17:34 |
| openstackgerrit | Matthew Thode proposed openstack/diskimage-builder: Fix Gentoo builds on Ubuntu 16.04 Xenial hosts https://review.openstack.org/413395 | 17:35 |
| *** mugsie|alt has joined #openstack-infra | 17:35 | |
| *** rbuzatu has joined #openstack-infra | 17:35 | |
| dirk | AJaeger: if its only requirements then the easier change is to just un-abandon the backport for requirements of course | 17:35 |
| dirk | AJaeger: I would expect its much more than that. | 17:35 |
| *** flaper87 has joined #openstack-infra | 17:35 | |
| *** tqtran has joined #openstack-infra | 17:36 | |
| AJaeger | dirk: I doubt it's much more - since most repos have py34 voting already | 17:36 |
| dirk | AJaeger: ah, so its all projects that did have python35-nv but not python-34-jobs | 17:37 |
| dirk | AJaeger: so designate, tap-as-a-service, refstack.. | 17:37 |
| *** asettle has joined #openstack-infra | 17:38 | |
| AJaeger | dirk: do you have failures or just suspicions? I can double check those... | 17:38 |
| dirk | AJaeger: os-xenapi, nova-dpm, | 17:38 |
| dirk | AJaeger: just looking at the infra patchset (looking for change from 35-nv to 35 and no 34 job) | 17:38 |
| dirk | AJaeger: I'd have to post reviews for that I guess.. unless there's a way to trigger that without posting gerrit reviews | 17:39 |
| openstackgerrit | Merged openstack-infra/project-config: Add more oslo libs to job periodic-{name}-{pyhton}-with-oslo-master https://review.openstack.org/407372 | 17:39 |
| *** rbuzatu has quit IRC | 17:40 | |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Run py35 gate not on stable/newton for requirements repo https://review.openstack.org/414243 | 17:40 |
| AJaeger | dirk: that should fix requirements ^ | 17:40 |
| dirk | AJaeger: thanks.. to be honest I would rather fix requirements for 3.5 :) | 17:40 |
| dirk | anyway, I pinged tonyb on this | 17:41 |
| AJaeger | dirk: I'll review those later - check for each repo the last change that merged on stable/newton (if the repo has a newton branch) | 17:41 |
| dirk | AJaeger: most of the ones I just mentioned don't have an open review against stable/newton at this point in time that could be re-checked | 17:41 |
| jeblair | smcginnis: can you restart your browser, then slowly go through the sign-in process and tell me each step you do while i watch the logs? | 17:41 |
| smcginnis | jeblair: Sure, one moment. | 17:42 |
| dirk | AJaeger: isn't there a voting: false missing ? | 17:42 |
| smcginnis | jeblair: OK, closed and reopened browser. At the status:open page. Top right shows I am not logged in. | 17:43 |
| smcginnis | jeblair: Clicking on Sign In link now. | 17:43 |
| smcginnis | jeblair: Redirected to login.ubuntu.com Personal Data Request page. That already shows me authenticated. | 17:43 |
| AJaeger | dirk: nope. It should stay voting on master, just not run on older branches | 17:43 |
| smcginnis | Clicking on Yes, Log Me In for Full Name and Email. | 17:43 |
| AJaeger | dirk: it passes on master AFAIK, dosn't it? | 17:44 |
| smcginnis | jeblair: Redirected to Not Found page. | 17:44 |
| smcginnis | jeblair: Full URL: https://review.openstack.org/#SignInFailure,SIGN_IN,Contact+site+administrator | 17:44 |
| *** baoli has joined #openstack-infra | 17:44 | |
| AJaeger | bbl | 17:44 |
| mordred | I think smcginnis is winning the award for weirdest gerrit issue | 17:45 |
| jeblair | smcginnis: okay, i have seen that request url in the logs before, but i did not see it this time. the logs look like a successful login (though gerrit doesn't log that sort of thing explicitly, so it's hard to be sure) | 17:46 |
| smcginnis | mordred: Winner! | 17:46 |
| *** jaypipes has quit IRC | 17:46 | |
| jeblair | smcginnis: i note something strange: you said ubuntu one said you were already logged in -- but i think it uses a session cookie, so i would expect restarting your browser to clear that and for you to need to reauthenticate | 17:46 |
| smcginnis | jeblair: The account information for login.ubuntu.com does show my login history as successfully logging in to review.openstack.org today. | 17:47 |
| smcginnis | jeblair: I'll explicitly log out and restart my browser again. | 17:47 |
| mordred | jeblair: login.ubuntu.com persists its login status for me when I restart my browser | 17:47 |
| mordred | the only time I've re-logged in to login.ubuntu.com over the last few years is when I get a new computer typically | 17:48 |
| smcginnis | jeblair: OK, same thing. | 17:48 |
| jeblair | oh, am i mistaken about its cookie? | 17:48 |
| *** ociuhandu has quit IRC | 17:48 | |
| mordred | jeblair: do you think it's worth having smcginnis try explicitly logging out of login.ubuntu.com and doing that over too? | 17:49 |
| smcginnis | Cleared cookies, restarted, same. | 17:49 |
| smcginnis | mordred: I did that. | 17:49 |
| mordred | smcginnis: oy | 17:49 |
| jeblair | i see what looks like two more successful logins in the logs | 17:49 |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: Fix OOOQ OVB jobs https://review.openstack.org/414246 | 17:50 |
| smcginnis | Guess I just have to take my red stapler and move my desk to the basement. :[ | 17:51 |
| jeblair | where does gerrit store its auth cookies? | 17:51 |
| *** trown is now known as trown|lunch | 17:51 | |
| jeblair | i don't see an obvious db table for them | 17:51 |
| *** rlandy has quit IRC | 17:51 | |
| jeblair | maybe just ram? | 17:51 |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: DONT MERGE: test running ovb oooq job https://review.openstack.org/414247 | 17:51 |
| clarkb | I think in the cache which is ram | 17:52 |
| *** esikache1 has quit IRC | 17:54 | |
| jeblair | ah, i think both. a ram cache and backed by web_sessions.h2.db on disk | 17:54 |
| *** soliosg has joined #openstack-infra | 17:54 | |
| *** weshay is now known as weshay_afk | 17:54 | |
| *** rlandy has joined #openstack-infra | 17:55 | |
| *** jlibosva has quit IRC | 17:55 | |
| *** esikache1 has joined #openstack-infra | 17:56 | |
| *** asettle has quit IRC | 17:56 | |
| jeblair | smcginnis: do you have a GerritAccount cookie for review.o.o? | 17:56 |
| *** senk has quit IRC | 17:56 | |
| *** asettle has joined #openstack-infra | 17:56 | |
| *** ihrachys has quit IRC | 17:56 | |
| *** jcoufal has quit IRC | 17:57 | |
| pabelanger | clarkb: thanks for the help this morning, I can see a centos-7 dib getting build with nodepool | 17:57 |
| *** dimtruck is now known as zz_dimtruck | 17:57 | |
| *** hashar has joined #openstack-infra | 17:57 | |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack-infra/tripleo-ci: Add "undecloud" or extra node's details to OVB's nodes' json https://review.openstack.org/413548 | 17:58 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack-infra/tripleo-ci: TLS everywhere job introduction https://review.openstack.org/391738 | 17:58 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack-infra/tripleo-ci: Add temporary key to OVB stack if undercloud is created https://review.openstack.org/413477 | 17:58 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack-infra/tripleo-ci: Optionally deploy undercloud node with OVB https://review.openstack.org/412526 | 17:58 |
| smcginnis | jeblair: Looking | 17:59 |
| smcginnis | jeblair: Doesn't look like it. | 17:59 |
| *** jaypipes has joined #openstack-infra | 18:00 | |
| pabelanger | clarkb: oh, spoke too soon. our env-vars in check_devstack_plugin.sh are not correct however. I guess we should be sourcing the localrc file? | 18:00 |
| clarkb | or export to d-g and write to config | 18:01 |
| *** asettle has quit IRC | 18:01 | |
| *** nicolasbock has quit IRC | 18:01 | |
| jeblair | smcginnis: do you have any cookies for review.o.o? | 18:01 |
| *** esikache1 has quit IRC | 18:01 | |
| clarkb | export var=foo; config_var=var=$var | 18:01 |
| *** pradk has quit IRC | 18:01 | |
| *** gomarivera has quit IRC | 18:03 | |
| smcginnis | jeblair: No, not that I see. | 18:04 |
| jeblair | smcginnis: can you load up a change and hit the toggle-ci button? | 18:04 |
| jeblair | smcginnis: then check again to see if you have a 'show-ci-comments' cookie for review.o.o | 18:04 |
| *** yamahata has joined #openstack-infra | 18:05 | |
| *** gomarivera has joined #openstack-infra | 18:05 | |
| *** dave-mccowan has quit IRC | 18:05 | |
| *** nicolasbock has joined #openstack-infra | 18:06 | |
| smcginnis | jeblair: Yep, I now have on cookie for review.openstack.org of 'show-ci-comments'. | 18:06 |
| openstackgerrit | Dean Troyer proposed openstack-infra/project-config: Add bootstrap hook https://review.openstack.org/414252 | 18:12 |
| *** rossella_s has quit IRC | 18:12 | |
| pabelanger | clarkb: is there an example of that happening today? struggling to follow. As you can likely test, pretty green with devstack / devstack-gate | 18:12 |
| *** rossella_s has joined #openstack-infra | 18:12 | |
| clarkb | pabelanger: basically keep what you have but add an export into the d-g env like you had before | 18:14 |
| jeblair | smcginnis: okay, so you can at least store cookies from review.o.o. can you restart and log in once again so i can see if a new session is created for you in the web sessions database? | 18:14 |
| *** EricGonczer_ has joined #openstack-infra | 18:14 | |
| *** EricGonc_ has joined #openstack-infra | 18:15 | |
| openstackgerrit | sebastian marcet proposed openstack-infra/openstackid-resources: Teams API https://review.openstack.org/414256 | 18:17 |
| smcginnis | jeblair: done | 18:17 |
| *** EricGonczer_ has quit IRC | 18:18 | |
| jeblair | smcginnis: previously, your openid appeared in the web sessions db 127 times. after logging in again, no change, still 127. I logged out/in, and saw my count increase from 40 to 41. now it strikes me 127 is an interesting number. perhaps you have the maximum number of web sessions in the database? | 18:20 |
| *** kzaitsev_mb has joined #openstack-infra | 18:20 | |
| smcginnis | jeblair: Odd. Any way to kill those other sessions? Not sure why I would have any outstanding sessions. | 18:20 |
| *** srobert has joined #openstack-infra | 18:20 | |
| *** bhavik1 has joined #openstack-infra | 18:20 | |
| *** newmember has joined #openstack-infra | 18:20 | |
| *** Sukhdev has quit IRC | 18:22 | |
| jeblair | smcginnis: there is a command to flush the web session cache, which i think will cause everyone to have to log in again. that *sounds* like it would help, but i have to consider the possibility that even if we do that, there still might be something about the db where it would not.... | 18:22 |
| jeblair | clarkb, zaro, mordred: ^ thoughts? | 18:22 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack-infra/tripleo-ci: Add "undecloud" or extra node's details to OVB's nodes' json https://review.openstack.org/413548 | 18:23 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack-infra/tripleo-ci: TLS everywhere job introduction https://review.openstack.org/391738 | 18:23 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack-infra/tripleo-ci: Add temporary key to OVB stack if undercloud is created https://review.openstack.org/413477 | 18:23 |
| *** jerryz has joined #openstack-infra | 18:23 | |
| *** ociuhandu has joined #openstack-infra | 18:23 | |
| smcginnis | jeblair: Is there a session timeout? | 18:23 |
| clarkb | jeblair: can you check easily if there is anyone with more than 127? | 18:23 |
| clarkb | and yes I think everyonr will.have to relogin | 18:23 |
| smcginnis | jeblair: If I have to take the afternoon off, I guess I'll have to. ;) | 18:24 |
| mordred | yah. but that's not _terribly_ onerous | 18:24 |
| clarkb | probably nit a major issue this time of day this time of year | 18:24 |
| jeblair | clarkb: hrm. my query method is "strings web_sessions.h2.db | grep".... let me see if i can hook up sort and uniq to help with that | 18:24 |
| pabelanger | clarkb: thanks | 18:24 |
| jeblair | i think the timeout is currently 7 days? | 18:25 |
| jeblair | except -- i can't remember if the syntax error for that was ever fixed | 18:26 |
| jeblair | so it's either 7 days or 12 hours. | 18:26 |
| smcginnis | I can probably wait 12 hours. Not sure 7 would be feasible, but I suppose with the holiday break that wouldn't be too bad. | 18:27 |
| *** EricGonczer_ has joined #openstack-infra | 18:28 | |
| smcginnis | Good excuse to actually take the time off. ;) | 18:28 |
| *** EricGonc_ has quit IRC | 18:28 | |
| jeblair | there are openids with more than 127 entries | 18:28 |
| smcginnis | OK, just coincidence then. | 18:29 |
| jeblair | looks like it :| | 18:29 |
| *** dizquierdo has joined #openstack-infra | 18:29 | |
| mordred | jeblair: https://review.openstack.org/#/c/311888/ 7 days patch landed - although I will say that I still often have to log back in in the morning, so I'm not sure it _works)_ | 18:29 |
| smcginnis | jeblair: Kind of too bad. That would be a simple explanation. | 18:29 |
| openstackgerrit | Paul Belanger proposed openstack-infra/project-config: Remove dsvm nodepool job part 2 https://review.openstack.org/414262 | 18:30 |
| jeblair | smcginnis: i *do* note that there are no login.ubuntu.com entries for you | 18:30 |
| jeblair | only login.launchpad.net | 18:30 |
| jeblair | clarkb, mordred: so this is making me think about the openid provider switch again | 18:30 |
| smcginnis | jeblair: Hmm. Different account name though? | 18:31 |
| jeblair | maybe we should do some experimenting on review-dev | 18:31 |
| jeblair | smcginnis: should be the same | 18:31 |
| *** jcoufal has joined #openstack-infra | 18:31 | |
| jeblair | smcginnis: (and even so, if something were different, you should actually just end up with a second account) | 18:31 |
| *** sdake has quit IRC | 18:31 | |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Run py35 gate not on stable/newton for requirements and murano-agent https://review.openstack.org/414243 | 18:31 |
| smcginnis | k | 18:32 |
| *** newmember has quit IRC | 18:32 | |
| jeblair | clarkb, mordred: i'm going to put review-dev in the emergency file | 18:32 |
| mordred | jeblair: I do not see any entries for stmcginnis or sean-mcginnis in the gerrit user database | 18:32 |
| mordred | select * from account_external_ids where external_id = 'username:sean-mcginnis'; and select * from account_external_ids where external_id = 'username:stmcginnis'; both turn up empty | 18:32 |
| jeblair | mordred: 'https://login.launchpad.net/+id/3eeKY6m | 18:33 |
| jeblair | mordred: username is gerrit username | 18:33 |
| jeblair | mordred: should be account id 11904 | 18:33 |
| AJaeger | dirk, I checked repos that had py35 voting-jobs and no py34 and newton branches and only found requirements and murano-agent with failing py35. See 414243. | 18:34 |
| mordred | jeblair: ah - ok. so SeanM is the gerrit username | 18:34 |
| jeblair | yep | 18:34 |
| smcginnis | Gah! Too many different accounts for me to keep track. Sorry. | 18:34 |
| smcginnis | Of course between gerrit, github, etc, all had conflicts so none could be the same. | 18:35 |
| *** senk has joined #openstack-infra | 18:35 | |
| jeblair | smcginnis: can you log in to https://review-dev.openstack.org/ please? | 18:35 |
| pabelanger | clarkb: there: https://review.openstack.org/#/c/414262 | 18:35 |
| *** rbuzatu has joined #openstack-infra | 18:36 | |
| AJaeger | clarkb, pabelanger, could you review 414243 later, please? | 18:36 |
| smcginnis | jeblair: Interesting. I get to the same Not Found page, but the URL doesn't say anything about not authorized, and the top right shows I am logged in. | 18:36 |
| *** pradk has joined #openstack-infra | 18:36 | |
| pabelanger | really looking forward to zuulv3 to test things like this per-merge :) | 18:36 |
| pabelanger | pre* | 18:36 |
| *** DavidPurcell has quit IRC | 18:36 | |
| SamYaple | having a bit of gate trouble ive not seen at the moment.. is this know? kolla release notes job -- http://logs.openstack.org/31/412231/25/check/gate-kolla-releasenotes/b64361e/console.html#_2016-12-22_17_27_37_880165 | 18:37 |
| smcginnis | jeblair: Looks like I can go to various pages and things look normal on review-dev. | 18:37 |
| *** gomarivera has quit IRC | 18:37 | |
| SamYaple | also other jobs are failing with wierd issues like permissions on ccache (on patches that are just rechecks) | 18:37 |
| AJaeger | pabelanger: 414262 hsa too many $s | 18:37 |
| dirk | AJaeger: ok, thanks a lot for cleaning that up | 18:38 |
| AJaeger | SamYaple: best ask dhellmann on #openstack-release channel | 18:38 |
| jeblair | smcginnis: can you tell me the account id displayed at https://review-dev.openstack.org/#/settings/ ? | 18:38 |
| dirk | AJaeger: i hope your Christmas tree task is already settled ;-) | 18:38 |
| AJaeger | dirk: if I missed any, please tell me and we can handle them the same. | 18:38 |
| AJaeger | dirk: yeah, it is;) My daughter was quick in selecting the perfect tree ;) | 18:39 |
| smcginnis | jeblair: 5481 | 18:39 |
| SamYaple | AJaeger: happy, though other kolla gates are suddently failing too. unreleated to releasenotes | 18:39 |
| jeblair | smcginnis, mordred: interesting -- that is https://login.ubuntu.com/+id/T844wek | 18:39 |
| openstackgerrit | Paul Belanger proposed openstack-infra/project-config: Remove dsvm nodepool job part 2 https://review.openstack.org/414262 | 18:40 |
| AJaeger | SamYaple: there was a new release of reno - and I don't see a config.yaml file in your tree. So, something is odd. But if others fail, you might hit different problems - or my first guess is wrong ;) | 18:40 |
| pabelanger | AJaeger: Thanks for the review | 18:40 |
| AJaeger | SamYaple: I think the config.yaml not found is not a serious error, error is further below. But let's ask dhellmann | 18:41 |
| SamYaple | AJaeger: unrelated to releasenotes, all ubuntu kolla jobs started breaking here too http://logs.openstack.org/35/404435/20/check/gate-kolla-dsvm-build-ubuntu-source-ubuntu-xenial/3f38ec4/console.html#_2016-12-22_17_18_26_786598 | 18:41 |
| sigmavirus | Is there documentation around how often cached repositories are updated on the node images? | 18:41 |
| jeblair | clarkb, mordred, smcginnis: that also appears in review.o.o as account 23390 | 18:41 |
| AJaeger | sigmavirus: why is that important? | 18:42 |
| SamYaple | AJaeger: yea i pinged him, but above is no realeasenotes job and started the same time | 18:42 |
| sigmavirus | AJaeger: bandit has check/gate jobs that rely on python-keystoneclient to make sure we don't break backwards compat and we're getting a weird error: http://logs.openstack.org/14/413214/1/check/gate-bandit-integration-python-keystoneclient/84ff734/console.html#_2016-12-22_16_56_34_648141 | 18:42 |
| *** salv-orlando has quit IRC | 18:43 | |
| AJaeger | sigmavirus: even if we cache, if there's something newer, we take the newer version ;) | 18:43 |
| dhellmann | AJaeger : if you have a few minutes, could you take a look at this reno fix? I'd like to push another release out today if I can. https://review.openstack.org/414231 | 18:43 |
| AJaeger | sigmavirus: linux kernel has 127 chars limit | 18:43 |
| *** rbuzatu_ has joined #openstack-infra | 18:44 | |
| AJaeger | sigmavirus: for interpreter, looks like your ocmmand line is longer ;( | 18:44 |
| smcginnis | jeblair: Bingo. That was the clue. Logged out of login.ubuntu.com from the account showing my gmail email. Logged back in using my work email. Then logged in to r.o.o. Works! | 18:44 |
| smcginnis | jeblair: So weird. Don't even know how I have two and how it would switch on my like that. | 18:44 |
| AJaeger | dhellmann: will do... | 18:44 |
| dhellmann | AJaeger : thanks | 18:44 |
| sigmavirus | AJaeger: TIL | 18:44 |
| smcginnis | jeblair: Thanks for all your time troubleshooting this. Glad (and embarassed) it ended up something so simple. | 18:44 |
| jeblair | smcginnis: or why the second one didn't work | 18:44 |
| smcginnis | You too clarkb and mordred . | 18:44 |
| AJaeger | dhellmann: did you see SamYaple's failure above? The missing config.yaml looks like confusing debug output - but the other one is serious | 18:45 |
| SamYaple | sigmavirus: https://review.openstack.org/#/c/244262/ <--- ran into that a year ago too | 18:45 |
| smcginnis | jeblair: True | 18:45 |
| dhellmann | sigmavirus : in cases where I had to clone another repo and run tox, I put the repo in /tmp to avoid the issue you're hitting | 18:45 |
| *** sdake has joined #openstack-infra | 18:45 | |
| pabelanger | jeblair: clarkb: mordred: also a change to nodepool to reduce the amount of ram we need to use for ubuntu images: https://review.openstack.org/#/c/413807/ | 18:45 |
| mordred | jeblair: woot! | 18:45 |
| sigmavirus | dhellmann: thanks :) | 18:45 |
| jeblair | smcginnis: no problem. glad you have a working account :) | 18:45 |
| dhellmann | AJaeger : yeah, I answered in #openstack-release -- you're right it's safe to ignore the message about the config file (I'll tone that message down) | 18:45 |
| *** jpena is now known as jpena|off | 18:45 | |
| *** zz_dimtruck is now known as dimtruck | 18:45 | |
| smcginnis | jeblair: Me too! And just in time. Time to go be a dad taxi for a bit. Thanks! | 18:45 |
| AJaeger | dhellmann: thanks. Your change is tricky but looks fine. This is all getting complex ;/ | 18:47 |
| *** rbuzatu has quit IRC | 18:47 | |
| dhellmann | AJaeger : yes, I'm having to re-implement more of the git porcelain than I thought I would | 18:49 |
| dhellmann | :-( | 18:49 |
| *** rbuzatu_ has quit IRC | 18:49 | |
| jeblair | sigmavirus: please use zuul-cloner to perform the clone of the other repo in http://git.openstack.org/cgit/openstack/bandit/tree/scripts/integration-test.sh | 18:50 |
| dhellmann | sigmavirus : following up to jeblair's advice, you may want to look at some of the stuff in project-config/jenkins/scripts/release-tools/functions to see how we clone repos for those jobs | 18:52 |
| jeblair | sigmavirus: that will let the job take advantage of the cache, put less load on git.o.o, be faster and more reliable, and also allow it to work with cross-repo-dependencies ("Depends-On") | 18:55 |
| sigmavirus | jeblair: so the way we wrote that was to look for the cached repository | 18:55 |
| sigmavirus | and use that if it existed | 18:56 |
| sigmavirus | AJaeger: helped us out with that | 18:56 |
| *** soliosg is now known as soliosg|afk | 18:57 | |
| *** esikache1 has joined #openstack-infra | 18:58 | |
| jeblair | sigmavirus, AJaeger... oooh... it happens in the job *before* that script runs | 18:59 |
| jeblair | sigmavirus: http://logs.openstack.org/14/413214/1/check/gate-bandit-integration-python-keystoneclient/84ff734/console.html#_2016-12-22_16_55_52_304243 | 18:59 |
| jeblair | sigmavirus: i get it now. that should be good. :) | 18:59 |
| *** jmorgan1 has quit IRC | 18:59 | |
| *** flepied has quit IRC | 18:59 | |
| jeblair | sigmavirus: sorry for the misdirect | 19:00 |
| sigmavirus | no worries :) | 19:00 |
| *** esberglu has quit IRC | 19:00 | |
| *** rossella_s has quit IRC | 19:00 | |
| *** esberglu has joined #openstack-infra | 19:01 | |
| *** amoralej is now known as amoralej|off | 19:01 | |
| *** yamahata has quit IRC | 19:02 | |
| *** dharinic has joined #openstack-infra | 19:03 | |
| *** tphummel has joined #openstack-infra | 19:03 | |
| *** gomarivera has joined #openstack-infra | 19:04 | |
| dharinic | Can I please get some inputs on this failure: http://logs.openstack.org/66/120866/20/check/gate-tempest-dsvm-neutron-src-glance_store-ubuntu-xenial/6216c32/console.html related to the patch: https://review.openstack.org/#/c/120866/ | 19:05 |
| *** esberglu has quit IRC | 19:05 | |
| *** hongbin has quit IRC | 19:05 | |
| *** sshnaidm has quit IRC | 19:06 | |
| *** DavidPurcell has joined #openstack-infra | 19:06 | |
| AJaeger | sigmavirus: you don't need to run git clone at all in the gate for those jobs. gate-bandit-integration- checks out the repo for you and you can use them as is | 19:07 |
| *** DavidPurcell has quit IRC | 19:08 | |
| sigmavirus | AJaeger: right, you helped us set that up :) | 19:08 |
| *** inc0 has quit IRC | 19:08 | |
| AJaeger | sigmavirus: but I think we're in the clone=0 case and then git clone is not run | 19:08 |
| *** sshnaidm has joined #openstack-infra | 19:08 | |
| AJaeger | sigmavirus: I forgot everything already ;( | 19:08 |
| AJaeger | sigmavirus, jeblair : In other words: There should be no git clone run for those repos in our CI | 19:09 |
| *** gomarivera has quit IRC | 19:09 | |
| sigmavirus | AJaeger: right. There isn't. If you look at jenkins/jobs/bandit.yaml we use zuul-cloner prior to running the script | 19:10 |
| AJaeger | sigmavirus: yes, checked that already. | 19:11 |
| AJaeger | sigmavirus: and checking the log file that jeblair linked: All is fine. | 19:11 |
| AJaeger | dharinic: 120866? That's ancient ;) | 19:11 |
| dharinic | AJaeger: reopened it :D | 19:12 |
| dharinic | Was getting installation errors with the tempest tests which was stopping from actual test executions | 19:12 |
| *** dizquierdo has quit IRC | 19:13 | |
| *** rafaels has quit IRC | 19:14 | |
| clarkb | dharinic: it failed when creating an image | 19:14 |
| clarkb | you can see that at end of devstacklog | 19:15 |
| clarkb | too many vales to unpack | 19:15 |
| clarkb | and glance api log says failed due to httperror | 19:16 |
| clarkb | so you'dneed todebug that | 19:16 |
| openstackgerrit | Merged openstack-infra/storyboard-webclient: Make it possible to link to a search/browse for stories https://review.openstack.org/390671 | 19:17 |
| AJaeger | clarkb: could you review https://review.openstack.org/414243 , please? That's a py35 fallout - the one I discussed with dirk earlier | 19:18 |
| dharinic | clarkb: Will have a look. Was not quite sure why an image creation will fail as it is not quite related to the change | 19:19 |
| *** trown|lunch is now known as trown | 19:19 | |
| dharinic | Thanks anyhow clarkb. Will do some debugging | 19:19 |
| clarkb | is glancestore and swift stuff not related to storing images? | 19:21 |
| AJaeger | ;) | 19:22 |
| *** senk has quit IRC | 19:23 | |
| openstackgerrit | Dean Troyer proposed openstack-infra/project-config: Add bootstrap hook https://review.openstack.org/414252 | 19:26 |
| *** hurgleburgler has joined #openstack-infra | 19:28 | |
| * AJaeger waves good night | 19:31 | |
| *** bhavik1 has quit IRC | 19:34 | |
| sigmavirus | G'night AJaeger | 19:36 |
| *** tqtran has quit IRC | 19:36 | |
| *** rcernin has joined #openstack-infra | 19:38 | |
| *** abompard_ has quit IRC | 19:39 | |
| *** chem has quit IRC | 19:39 | |
| *** yamahata has joined #openstack-infra | 19:41 | |
| *** sreeram_v has joined #openstack-infra | 19:42 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade: Fix exception name typo https://review.openstack.org/414316 | 19:44 |
| *** baoli has quit IRC | 19:46 | |
| *** baoli has joined #openstack-infra | 19:46 | |
| *** sreeram_v has quit IRC | 19:47 | |
| *** baoli has quit IRC | 19:47 | |
| *** tphummel has quit IRC | 19:49 | |
| *** flepied has joined #openstack-infra | 19:50 | |
| mordred | self-approving that ^^ it's a typo issue I just hit while running code | 19:51 |
| tdasilva | AJaeger, fungi, mordred: hello, just wanted check back on that liberasurecode/pyeclib topic and was wondering if any of you had a chance to take a look at https://github.com/thiagodasilva/libec | 19:55 |
| tdasilva | I guess what I'm trying to figure out next is how much help I'd need help from infra-team to merge the two repos or can it be done with just a gerrit patch | 19:55 |
| *** baoli has joined #openstack-infra | 19:56 | |
| openstackgerrit | Sean Dague proposed openstack-infra/project-config: Revert "Skip more jobs for driverfixes branches" https://review.openstack.org/414319 | 19:59 |
| sdague | https://review.openstack.org/#/c/414319/ needs a fast revert, it broke a bunch of the gate by putting grenade jobs in the wrong places | 19:59 |
| *** rfolco has quit IRC | 20:00 | |
| sdague | the gate is busted until that lands | 20:01 |
| sdague | I'm about to drop off for the year, so hopefully someone will run with it | 20:01 |
| *** hashar has quit IRC | 20:03 | |
| openstackgerrit | Isaku Yamahata proposed openstack-infra/project-config: make gate-dsvm-networking-odl-functional-carbon-snapshot voting https://review.openstack.org/411433 | 20:03 |
| *** e0ne has joined #openstack-infra | 20:05 | |
| *** baoli has quit IRC | 20:05 | |
| openstackgerrit | Matthew Thode proposed openstack/diskimage-builder: Fix Gentoo builds on Ubuntu 16.04 Xenial hosts https://review.openstack.org/413395 | 20:06 |
| AJaeger | smcginnis: see sdague's comment above, please | 20:07 |
| *** baoli has joined #openstack-infra | 20:07 | |
| *** ricardoas has left #openstack-infra | 20:07 | |
| *** baoli has quit IRC | 20:10 | |
| *** tphummel has joined #openstack-infra | 20:12 | |
| *** xyang1 has joined #openstack-infra | 20:15 | |
| *** baoli has joined #openstack-infra | 20:17 | |
| *** esberglu has joined #openstack-infra | 20:18 | |
| *** savihou has joined #openstack-infra | 20:18 | |
| *** tphummel has quit IRC | 20:22 | |
| openstackgerrit | Merged openstack-infra/project-config: Revert "Skip more jobs for driverfixes branches" https://review.openstack.org/414319 | 20:23 |
| pabelanger | AJaeger: mordred: clarkb: mind confirming: https://review.openstack.org/#/c/414262/ to get diskimage-builder nodepool jobs working agian | 20:24 |
| *** e0ne has quit IRC | 20:27 | |
| *** gomarivera has joined #openstack-infra | 20:28 | |
| openstackgerrit | Anthony Washington proposed openstack-infra/project-config: Glance experimental multinode grenade jobs https://review.openstack.org/414326 | 20:28 |
| *** salv-orlando has joined #openstack-infra | 20:30 | |
| *** e0ne has joined #openstack-infra | 20:30 | |
| *** esberglu has quit IRC | 20:33 | |
| *** aidin has joined #openstack-infra | 20:34 | |
| *** esberglu has joined #openstack-infra | 20:34 | |
| jeblair | sdague: have a nice holiday and happy new year! | 20:34 |
| sdague | jeblair: thank you. And the same to you! | 20:34 |
| *** aidin has quit IRC | 20:34 | |
| *** kzaitsev_mb has quit IRC | 20:36 | |
| *** Sukhdev has joined #openstack-infra | 20:38 | |
| *** esberglu has quit IRC | 20:38 | |
| *** rwsu_ has quit IRC | 20:40 | |
| *** rraja has quit IRC | 20:40 | |
| *** e0ne has quit IRC | 20:41 | |
| *** savihou has quit IRC | 20:45 | |
| *** baoli has quit IRC | 20:46 | |
| *** baoli has joined #openstack-infra | 20:46 | |
| *** asettle has joined #openstack-infra | 20:50 | |
| *** pradk has quit IRC | 20:51 | |
| *** rwsu_ has joined #openstack-infra | 20:53 | |
| *** DavidPurcell has joined #openstack-infra | 20:53 | |
| *** asettle has quit IRC | 20:54 | |
| *** abompard has joined #openstack-infra | 20:57 | |
| *** kzaitsev_mb has joined #openstack-infra | 21:00 | |
| *** rfolco has joined #openstack-infra | 21:00 | |
| *** rfolco has quit IRC | 21:00 | |
| *** esikache1 has quit IRC | 21:03 | |
| *** kgiusti has left #openstack-infra | 21:05 | |
| *** fguillot has quit IRC | 21:06 | |
| *** sdake has quit IRC | 21:06 | |
| *** mtan_____ has quit IRC | 21:09 | |
| *** jcoufal has quit IRC | 21:09 | |
| *** kzaitsev_mb has quit IRC | 21:11 | |
| *** pradk has joined #openstack-infra | 21:13 | |
| *** esikache1 has joined #openstack-infra | 21:15 | |
| *** jaosorior has quit IRC | 21:16 | |
| *** wolverin_ has quit IRC | 21:16 | |
| *** wolverineav has joined #openstack-infra | 21:17 | |
| *** esikache1 has quit IRC | 21:19 | |
| *** esikache1 has joined #openstack-infra | 21:22 | |
| *** wolverineav has quit IRC | 21:22 | |
| *** wolverineav has joined #openstack-infra | 21:23 | |
| *** kzaitsev_mb has joined #openstack-infra | 21:24 | |
| *** esikache1 has quit IRC | 21:26 | |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: DONT MERGE: test running ovb oooq job https://review.openstack.org/414247 | 21:27 |
| openstackgerrit | Merged openstack-infra/elastic-recheck: Add query for cinder vol backup bug 1635643 https://review.openstack.org/413875 | 21:27 |
| openstack | bug 1635643 in Cinder "test_volume_backup_create_get_detailed_list_restore_delete failed with "iscsiadm: Could not execute operation on all records: encountered iSCSI database failure" in c-bak log" [Undecided,New] https://launchpad.net/bugs/1635643 | 21:27 |
| *** wolverineav has quit IRC | 21:28 | |
| tonyb | AJaeger: +1 on https://review.openstack.org/414243 | 21:28 |
| *** john-davidge has quit IRC | 21:31 | |
| *** john-davidge has joined #openstack-infra | 21:32 | |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/project-config: Run oooq ha and nonha jobs for quickstart https://review.openstack.org/401298 | 21:34 |
| *** tqtran has joined #openstack-infra | 21:35 | |
| *** Jeffrey4l has quit IRC | 21:35 | |
| *** MasterOfBugs has joined #openstack-infra | 21:35 | |
| *** john-davidge has quit IRC | 21:36 | |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci: CI test - never merge https://review.openstack.org/413614 | 21:38 |
| *** tqtran has quit IRC | 21:39 | |
| *** eharney has quit IRC | 21:42 | |
| *** sreeram_v has joined #openstack-infra | 21:43 | |
| *** gouthamr has quit IRC | 21:46 | |
| *** sreeram_v has quit IRC | 21:47 | |
| *** Jeffrey4l has joined #openstack-infra | 21:48 | |
| *** flepied has quit IRC | 21:49 | |
| *** rbuzatu has joined #openstack-infra | 21:55 | |
| *** rbuzatu has quit IRC | 21:55 | |
| *** rbuzatu has joined #openstack-infra | 21:55 | |
| jlvillal | Anyone besides Ironic seeing issues with devstack failing with a keystone failure? For example: http://logs.openstack.org/83/414283/1/check/gate-tempest-dsvm-ironic-ipa-wholedisk-pxe_snmp-tinyipa-ubuntu-xenial-nv/00bcccb/logs/devstacklog.txt.gz#_2016-12-22_19_33_35_372 | 21:58 |
| *** toure is now known as toure|gone | 21:58 | |
| *** dprince has quit IRC | 21:59 | |
| *** wolverineav has joined #openstack-infra | 22:04 | |
| *** sdague has quit IRC | 22:08 | |
| *** wolverineav has quit IRC | 22:09 | |
| *** trown is now known as trown|outtypewww | 22:09 | |
| openstackgerrit | Ben Nemec proposed openstack-infra/tripleo-ci: Allow all tcp ports at the end of postci https://review.openstack.org/414342 | 22:09 |
| *** lindycoder has quit IRC | 22:10 | |
| openstackgerrit | Tony Breeds proposed openstack-dev/pbr: Add Constraints support https://review.openstack.org/410968 | 22:10 |
| *** Kiall has joined #openstack-infra | 22:13 | |
| *** srobert_ has joined #openstack-infra | 22:15 | |
| *** DavidPurcell has quit IRC | 22:17 | |
| *** srobert has quit IRC | 22:18 | |
| openstackgerrit | Merged openstack-infra/tripleo-ci: Optionally deploy undercloud node with OVB https://review.openstack.org/412526 | 22:18 |
| *** Sukhdev has quit IRC | 22:19 | |
| *** srobert_ has quit IRC | 22:20 | |
| *** wolverineav has joined #openstack-infra | 22:20 | |
| *** esikache1 has joined #openstack-infra | 22:23 | |
| *** wolverineav has quit IRC | 22:25 | |
| *** rbuzatu has quit IRC | 22:26 | |
| *** rbuzatu has joined #openstack-infra | 22:26 | |
| *** soliosg|afk is now known as soliosg | 22:27 | |
| *** esikache1 has quit IRC | 22:28 | |
| *** rbuzatu_ has joined #openstack-infra | 22:28 | |
| *** rbuzatu has quit IRC | 22:33 | |
| *** kzaitsev_mb has quit IRC | 22:34 | |
| *** chlong has quit IRC | 22:34 | |
| *** jheroux has quit IRC | 22:40 | |
| *** chlong has joined #openstack-infra | 22:41 | |
| openstackgerrit | Merged openstack-infra/nodepool: Reduce min-ram for ubuntu images for devstack https://review.openstack.org/413807 | 22:44 |
| openstackgerrit | Paul Belanger proposed openstack-infra/nodepool: Revert "Reduce min-ram for ubuntu images for devstack" https://review.openstack.org/414344 | 22:44 |
| *** sshnaidm is now known as sshnaidm|away | 22:45 | |
| *** furlongm has quit IRC | 22:45 | |
| pabelanger | infra-root: I incorrectly approved 413807^, I have a revert in progress | 22:45 |
| *** kzaitsev_mb has joined #openstack-infra | 22:47 | |
| *** sdake has joined #openstack-infra | 22:48 | |
| *** rlandy is now known as rlandy|afk | 22:50 | |
| jlvillal | Any idea why we would be seeing an: "Illegal instruction" error? http://logs.openstack.org/39/414339/2/check/gate-tempest-dsvm-ironic-ipa-partition-pxe_snmp-tinyipa-ubuntu-xenial-nv/1d5e63d/logs/devstacklog.txt.gz#_2016-12-22_22_25_10_787 | 22:55 |
| jlvillal | On: ubuntu-xenial-infracloud-vanilla-6365055 | 22:55 |
| johnsom | jlvillal We are also seeing keystone failures on the octavia project | 22:56 |
| jlvillal | johnsom: Awesome, not just us :D | 22:56 |
| johnsom | http://logs.openstack.org/72/414272/2/check/gate-neutron-lbaasv2-dsvm-api-ubuntu-xenial/af7721c/logs/devstacklog.txt.gz#_2016-12-22_22_39_53_590 | 22:56 |
| jlvillal | johnsom: What node did it occur on? In console.html. | 22:56 |
| johnsom | ubuntu-xenial-rax-ord-6365099 | 22:57 |
| jlvillal | johnsom: Darn, I was hoping it was just on one provider | 22:57 |
| jlvillal | johnsom: I changed lib/keystone to execute the command on its own line. And I saw that "Illegal instruction" error | 22:58 |
| openstackgerrit | Andreas Florath proposed openstack/diskimage-builder: dibdevel: new element https://review.openstack.org/414347 | 22:58 |
| *** sdake_ has joined #openstack-infra | 22:58 | |
| *** rbuzatu_ has quit IRC | 22:59 | |
| jlvillal | johnsom: I wonder if any other projects are suffering from this. If only I was a ninja at using that search tool for build logs :( | 22:59 |
| * jlvillal is sadly not a ninja in that area | 22:59 | |
| johnsom | jvillal Do you have the link? | 23:00 |
| johnsom | Ah, I found it. | 23:01 |
| *** esikache1 has joined #openstack-infra | 23:01 | |
| jlvillal | johnsom: To my test patch? https://review.openstack.org/414341 | 23:01 |
| *** sdake has quit IRC | 23:02 | |
| *** kzaitsev_mb has quit IRC | 23:03 | |
| jlvillal | johnsom: lbragstad: I'm also seeing it affect Nova jobs: http://logs.openstack.org/99/414299/1/check/gate-tempest-dsvm-full-devstack-plugin-ceph-ubuntu-xenial/d9fda2a/logs/devstacklog.txt.gz | 23:03 |
| *** Sukhdev has joined #openstack-infra | 23:04 | |
| *** sdake_ has quit IRC | 23:04 | |
| *** kzaitsev_mb has joined #openstack-infra | 23:04 | |
| *** askb has joined #openstack-infra | 23:04 | |
| lbragstad | jlvillal johnsom there was also - https://review.openstack.org/#/c/414319/ | 23:04 |
| lbragstad | but that was specific to grenade (I think?) | 23:05 |
| johnsom | Yeah, that shouldn't impact us | 23:05 |
| johnsom | http://logstash.openstack.org/#/dashboard/file/logstash.json?query=message:%5C%22Public%20network%20connectivity%20check%20failed%5C%22%20AND%20tags:console%20AND%20voting:1&from=864000s | 23:05 |
| johnsom | Yeah, the keystone issue started today. | 23:06 |
| jlvillal | infra-root: We seem to have failures across multiple projects. | 23:06 |
| jlvillal | lbragstad: You probably want a different title for the issue ;) | 23:06 |
| *** esikache1 has quit IRC | 23:06 | |
| lbragstad | jlvillal :) hoping so | 23:06 |
| mriedem | is keystone barfing in devstack setup for anyone else? | 23:07 |
| mriedem | in CI runs today | 23:07 |
| jlvillal | mriedem: Ding ding ding | 23:07 |
| lbragstad | jlvillal i'm looking through all keystone commit and i'm not seeing anything that would impact this | 23:07 |
| johnsom | Yep, everyone it seems | 23:07 |
| jlvillal | mriedem: http://logs.openstack.org/39/414339/2/check/gate-tempest-dsvm-ironic-ipa-partition-pxe_snmp-tinyipa-ubuntu-xenial-nv/1d5e63d/logs/devstacklog.txt.gz#_2016-12-22_22_25_10_787 | 23:07 |
| mriedem | ah ok | 23:07 |
| jlvillal | mriedem: Getting an "Illegal instruction" error | 23:07 |
| jlvillal | dtroyer: Any chance it could be an openstack client issue? | 23:07 |
| *** adriant has joined #openstack-infra | 23:07 | |
| lbragstad | mriedem i assume your failures look like this - http://logs.openstack.org/39/414339/2/check/gate-tempest-dsvm-ironic-ipa-partition-pxe_snmp-tinyipa-ubuntu-xenial-nv/1d5e63d/logs/devstacklog.txt.gz#_2016-12-22_22_25_10_787 ? | 23:07 |
| mriedem | i didn't have that specific line | 23:08 |
| mriedem | but saw a core:notice in the apache errors log | 23:08 |
| jlvillal | That link has a patch to execute the openstack client on the line by itself. Thus see the "Illegal instruction" | 23:08 |
| mriedem | http://logs.openstack.org/29/414329/1/check/gate-tempest-dsvm-cells-ubuntu-xenial/e827443/logs/apache/error.txt.gz | 23:08 |
| *** xarses_ has joined #openstack-infra | 23:08 | |
| mriedem | [Thu Dec 22 21:25:43.916881 2016] [core:notice] [pid 17509:tid 139814084061056] AH00094: Command line: '/usr/sbin/apache2' | 23:08 |
| *** dimtruck is now known as zz_dimtruck | 23:08 | |
| openstackgerrit | Merged openstack-infra/nodepool: Revert "Reduce min-ram for ubuntu images for devstack" https://review.openstack.org/414344 | 23:10 |
| mriedem | https://review.openstack.org/#/c/413118/ ? | 23:10 |
| *** xarses has quit IRC | 23:11 | |
| mriedem | it's weird | 23:11 |
| mriedem | http://logs.openstack.org/29/414329/1/check/gate-tempest-dsvm-cells-ubuntu-xenial/e827443/logs/syslog.txt.gz#_Dec_22_21_25_39 | 23:11 |
| mriedem | apache is stopping right before the failure | 23:12 |
| jlvillal | mriedem: Hmm. I wonder if we are waiting for that to propogate? | 23:12 |
| jlvillal | pabelanger: Are you around? | 23:12 |
| *** EricGonczer_ has quit IRC | 23:12 | |
| mriedem | logstash isn't giving me any love | 23:14 |
| jlvillal | mriedem: http://logstash.openstack.org/#/dashboard/file/logstash.json?query=message:%5C%22Public%20network%20connectivity%20check%20failed%5C%22%20AND%20tags:console%20AND%20voting:1&from=864000s | 23:15 |
| jlvillal | mriedem: Though it took like a long time for it to display anything in my browser. I thought it wasn't working at first. | 23:15 |
| mriedem | ah yeah i'm getting results now | 23:16 |
| stevemar | mriedem: things be broke? | 23:17 |
| jlvillal | stevemar: Yep | 23:17 |
| jlvillal | stevemar: For example: http://logs.openstack.org/39/414339/2/check/gate-tempest-dsvm-ironic-ipa-partition-pxe_snmp-tinyipa-ubuntu-xenial-nv/1d5e63d/logs/devstacklog.txt.gz#_2016-12-22_22_25_10_787 | 23:17 |
| stevemar | what the heck is 'illegal instruction' | 23:18 |
| *** esikache1 has joined #openstack-infra | 23:18 | |
| stevemar | thats not something OSC or keystone emits AFAIK | 23:18 |
| lbragstad | stevemar nope | 23:18 |
| jlvillal | http://stackoverflow.com/questions/24104394/program-exited-with-code-132 | 23:19 |
| *** jordanP has quit IRC | 23:19 | |
| mriedem | yeah i think apache is crashing | 23:19 |
| *** kzaitsev_mb has quit IRC | 23:20 | |
| stevemar | definitely looks python related | 23:20 |
| stevemar | oh | 23:20 |
| lbragstad | http://logs.openstack.org/29/414329/1/check/gate-tempest-dsvm-cells-ubuntu-xenial/e827443/logs/apache/error.txt.gz | 23:20 |
| johnsom | I see similar behavior from older successful runs | 23:21 |
| johnsom | http://logs.openstack.org/12/403912/3/check/gate-neutron-lbaasv2-dsvm-loadbalancer/b622d1d/logs/apache/error.txt.gz | 23:21 |
| jlvillal | I see Neutron failing too: http://logs.openstack.org/07/406407/12/gate/gate-tempest-dsvm-neutron-dvr-ubuntu-xenial/5484f2f/logs/devstacklog.txt.gz#_2016-12-22_21_21_24_283 | 23:21 |
| jlvillal | So I think it is OpenStack wide | 23:21 |
| johnsom | Yeah, it's across a bunch of projects: http://logstash.openstack.org/#dashboard/file/logstash.json?query=message%3A%5C%22lib%2Fkeystone%3Acreate_keystone_accounts%3A1%20%20%3A%20%20%20exit_trap%5C%22 | 23:22 |
| *** esikache1 has quit IRC | 23:22 | |
| lbragstad | oof - http://logstash.openstack.org/#/dashboard/file/logstash.json?query=message:%5C%22lib%2Fkeystone:create_keystone_accounts:1%20%20:%20%20%20exit_trap%5C%22 | 23:24 |
| lbragstad | looks like a lot of failures started happening about 5 hours ago | 23:25 |
| *** xyang1 has quit IRC | 23:25 | |
| mriedem | jlvillal: is there a bug tracking this anywhere? | 23:26 |
| mriedem | i'd like to get a query into elastic-recheck | 23:26 |
| jlvillal | mriedem: I haven't created one. | 23:26 |
| *** kzaitsev_mb has joined #openstack-infra | 23:27 | |
| *** zz_dimtruck is now known as dimtruck | 23:28 | |
| jlvillal | mriedem: Would you like to create one? I'm willing to do it also. | 23:28 |
| *** gomarivera has quit IRC | 23:35 | |
| jlvillal | mriedem: I will create a bug report | 23:35 |
| mriedem | just open one against openstack-gate for now i suppose | 23:35 |
| jlvillal | mriedem: https://bugs.launchpad.net/openstack-gate/+bug/1652186 | 23:37 |
| openstack | Launchpad bug 1652186 in OpenStack-Gate "CI jobs failing in devstack/lib/keystone" [Undecided,New] | 23:37 |
| *** ijw has joined #openstack-infra | 23:38 | |
| clarkb | I am running errands but that really doesnt look likr an apache issue | 23:41 |
| clarkb | looks like osc not liking the command given | 23:41 |
| openstackgerrit | Merged openstack-infra/tripleo-ci: updates: enable ssl https://review.openstack.org/402930 | 23:41 |
| mriedem | it shouldn't be https://review.openstack.org/#/c/413118/ because we haven't gotten that far when this fails | 23:41 |
| mriedem | tada https://github.com/openstack/requirements/commit/71419ad9b9550fedafe536de5dc54300fdf75724 | 23:42 |
| clarkb | I'm guessing you should be able to run devstack up to that point and run the command manually | 23:42 |
| *** salv-orlando has quit IRC | 23:42 | |
| *** sreeram_v has joined #openstack-infra | 23:43 | |
| mriedem | https://github.com/openstack/python-openstackclient/compare/3.5.0...3.6.0 | 23:44 |
| johnsom | Yeah, creating a venv, pip install python-openstackclient 3.60, run the "openstack project show admin -f value -c id" and it works, so not sure it's the client | 23:44 |
| mriedem | i don't see anything in that diff that looks suspicious either | 23:45 |
| jlvillal | I wonder if: Merged openstack-infra/nodepool: Revert "Reduce min-ram for ubuntu images for devstack" https://review.openstack.org/414344 | 23:46 |
| jlvillal | What it was reverting caused an issue. | 23:46 |
| *** esberglu has joined #openstack-infra | 23:46 | |
| jlvillal | Though the original patch landed an hour ago and we have been seeing the issue for more than an hour. Never mind. | 23:47 |
| jlvillal | Never mind | 23:47 |
| *** sreeram_v has quit IRC | 23:48 | |
| *** dimtruck is now known as zz_dimtruck | 23:49 | |
| *** gouthamr has joined #openstack-infra | 23:52 | |
| johnsom | Comparing a last-known-good job and a failed, I see flaske8 2.1.0->2.5.5, hacking 0.9.6->0.12.0 and pep8 1.5.6->1.5.7 in the pip2-freeze | 23:54 |
| *** Sukhdev has quit IRC | 23:55 | |
| johnsom | Sorry, flaske->flake8 So I don't see any package changes that jump out at me | 23:55 |
| *** baoli has quit IRC | 23:57 | |
| johnsom | No difference in the dpkg list either... Strange | 23:58 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!