Tuesday, 2018-11-13

*** kaisers has quit IRC00:04
*** agopi|brb has joined #openstack-infra00:14
*** kaisers has joined #openstack-infra00:19
openstackgerritrongyaozu proposed openstack-infra/infra-specs master: remove the dumplicate words  https://review.openstack.org/61739900:20
openstackgerritrongyaozu proposed openstack-infra/infra-specs master: remove the dumplicate word  https://review.openstack.org/61740000:22
*** gyee has quit IRC00:39
*** longkb has joined #openstack-infra00:53
*** rlandy is now known as rlandy|bbl01:06
*** longkb has quit IRC01:24
*** imacdonn has joined #openstack-infra01:38
*** imacdonn_ has quit IRC01:38
*** mrsoul has quit IRC02:41
*** armax has quit IRC02:56
*** psachin has joined #openstack-infra03:00
*** ijw has quit IRC03:09
*** ijw has joined #openstack-infra03:15
*** apetrich has quit IRC03:15
*** ijw has quit IRC03:16
*** ijw_ has joined #openstack-infra03:16
*** ijw_ has quit IRC03:20
*** roman_g has quit IRC03:27
*** dave-mccowan has joined #openstack-infra03:29
*** yamamoto has joined #openstack-infra03:30
*** dave-mccowan has quit IRC03:34
*** udesale has joined #openstack-infra03:43
ianw#status log removed bridge.o.o /opt/system-config/playbooks/roles/exim/filter_plugins/__pycache__/filters.cpython-36.pyc file which was stopping exim role from running, see also https://github.com/ansible/ansible/pull/4858703:48
openstackstatusianw: finished logging03:49
ianwfungi: ^ so the exim role hasn't been running since around https://review.openstack.org/#/c/590753/03:50
ianwsince that file was left behind the the tree, it was running a "blank" exim role, which overrode the real one as it was earlier in the path03:50
ianwthat is, the role had no tasks, variables, etc; i.e. did nothing.03:51
ianwwe'll see what ansible reviewers think (if anything) but i've propsed to warn when you're overriding roles in https://github.com/ansible/ansible/pull/48587 ... it would have made this at least more obvious03:52
*** ykarel has joined #openstack-infra03:53
ianwoh, and very neatly did not trip the functional testing, because that's a fresh host of course so the right role is actually run there03:58
*** ramishra has joined #openstack-infra04:02
*** scas has joined #openstack-infra04:02
*** rlandy|bbl is now known as rlandy04:23
*** rlandy has quit IRC04:23
*** yamamoto has quit IRC04:34
*** coolsvap has joined #openstack-infra04:34
*** owalsh_ has joined #openstack-infra04:35
*** owalsh has quit IRC04:39
*** threestrands has joined #openstack-infra05:02
*** chandankumar has joined #openstack-infra05:09
*** chandankumar is now known as chkumar|ruck05:10
*** ykarel has quit IRC05:13
*** dayou has quit IRC05:15
*** ykarel has joined #openstack-infra05:19
*** janki has joined #openstack-infra05:37
*** dayou has joined #openstack-infra05:42
*** ykarel_ has joined #openstack-infra06:00
fungiianw: bizarre, and thanks for finding that!06:03
*** ykarel has quit IRC06:03
*** ykarel_ is now known as ykarel06:08
ianwfungi: it was quite the yak shaving adventure ....06:11
fungii'm not sure i would have figured it out. excellent detective work06:12
*** coolsvap has quit IRC06:14
*** gary_perkins has quit IRC06:15
*** udesale has quit IRC06:16
*** smarcet has joined #openstack-infra06:16
*** udesale has joined #openstack-infra06:16
*** shardy has joined #openstack-infra06:19
*** gary_perkins has joined #openstack-infra06:19
*** smarcet has quit IRC06:23
*** Douhet has quit IRC06:26
*** Douhet has joined #openstack-infra06:28
*** shrasool has joined #openstack-infra06:30
*** kjackal has joined #openstack-infra06:33
*** coolsvap has joined #openstack-infra06:37
*** shardy has quit IRC06:37
*** ykarel_ has joined #openstack-infra06:42
*** ykarel has quit IRC06:45
*** gary_perkins has quit IRC06:47
*** gary_perkins has joined #openstack-infra06:49
*** quiquell|off is now known as quiquell06:50
openstackgerritzhouxinyong proposed openstack/diskimage-builder master: delete the duplicate words in  package-outside-debootstrap-ac93e9ce991819f1.yaml  https://review.openstack.org/61750107:02
openstackgerritzhouxinyong proposed openstack/diskimage-builder master: fix some errors for ill-syntax in  README.rst  https://review.openstack.org/61750207:06
*** Douhet has quit IRC07:09
*** Douhet has joined #openstack-infra07:10
*** kjackal has quit IRC07:13
*** shrasool has quit IRC07:14
*** kjackal has joined #openstack-infra07:16
*** ykarel_ has quit IRC07:25
*** ykarel_ has joined #openstack-infra07:26
*** ykarel__ has joined #openstack-infra07:30
*** ykarel_ has quit IRC07:33
*** ijw has joined #openstack-infra07:39
*** yamamoto has joined #openstack-infra07:42
*** mriedem has joined #openstack-infra07:49
*** ijw has quit IRC07:49
*** ykarel__ is now known as ykarel07:50
*** e0ne has joined #openstack-infra07:58
*** e0ne has quit IRC08:00
*** longkb has joined #openstack-infra08:00
*** slaweq has joined #openstack-infra08:01
*** lbragstad has joined #openstack-infra08:03
*** phausman has joined #openstack-infra08:03
*** threestrands has quit IRC08:04
*** lbragstad has quit IRC08:06
*** smarcet has joined #openstack-infra08:09
*** smarcet has quit IRC08:11
*** carl_cai has joined #openstack-infra08:11
*** smarcet has joined #openstack-infra08:12
*** lbragstad has joined #openstack-infra08:12
*** smarcet has quit IRC08:12
*** yamamoto has quit IRC08:22
*** ginopc has quit IRC08:23
*** yamamoto has joined #openstack-infra08:24
*** smarcet has joined #openstack-infra08:28
*** quiquell has quit IRC08:32
*** quiquell has joined #openstack-infra08:33
*** smarcet has quit IRC08:33
*** priteau has joined #openstack-infra08:35
*** diablo_rojo has joined #openstack-infra08:35
*** tosky has joined #openstack-infra08:37
*** smarcet has joined #openstack-infra08:40
*** smarcet has quit IRC08:46
*** ijw has joined #openstack-infra08:46
*** ijw has quit IRC08:48
*** ijw has joined #openstack-infra08:49
*** e0ne has joined #openstack-infra08:49
*** yamamoto has quit IRC08:49
*** jpena|off is now known as jpena08:50
*** yamamoto has joined #openstack-infra08:50
corvusianw: bravo :)08:52
*** smarcet has joined #openstack-infra08:53
*** roman_g has joined #openstack-infra08:54
*** yamamoto has quit IRC08:55
*** ginopc has joined #openstack-infra08:55
*** yamamoto has joined #openstack-infra08:55
*** smarcet has quit IRC08:55
openstackgerritChris Hoge proposed openstack-infra/project-config master: Add new documentation project for The Four Opens  https://review.openstack.org/61700508:55
*** diablo_rojo has quit IRC08:57
*** ralonsoh has joined #openstack-infra08:58
*** smarcet has joined #openstack-infra08:59
*** shardy has joined #openstack-infra09:02
*** smarcet has quit IRC09:04
*** ccamacho has joined #openstack-infra09:06
*** smarcet has joined #openstack-infra09:06
*** janki has quit IRC09:07
*** smarcet has quit IRC09:07
*** ijw_ has joined #openstack-infra09:09
*** ykarel is now known as ykarel|lunch09:10
*** ijw has quit IRC09:11
*** smarcet has joined #openstack-infra09:11
*** jpich has joined #openstack-infra09:11
*** lbragstad has quit IRC09:12
*** e0ne has quit IRC09:13
*** e0ne has joined #openstack-infra09:18
*** dave-mccowan has joined #openstack-infra09:21
*** smarcet has quit IRC09:21
*** lbragstad has joined #openstack-infra09:24
*** derekh has joined #openstack-infra09:26
*** bobh has joined #openstack-infra09:26
*** jd_ has joined #openstack-infra09:27
*** shardy has quit IRC09:27
*** ramishra has quit IRC09:28
*** ramishra has joined #openstack-infra09:34
*** e0ne has quit IRC09:35
*** smarcet has joined #openstack-infra09:35
*** e0ne has joined #openstack-infra09:36
*** e0ne has quit IRC09:36
*** mriedem has quit IRC09:38
*** mriedem has joined #openstack-infra09:38
*** lbragstad has quit IRC09:39
*** ykarel|lunch is now known as ykarel09:45
*** mriedem has quit IRC09:46
*** mriedem has joined #openstack-infra09:50
*** priteau has quit IRC09:52
*** lbragstad has joined #openstack-infra09:54
*** yamamoto has quit IRC09:54
*** yamamoto has joined #openstack-infra09:55
*** yamamoto has quit IRC09:55
*** pcaruana has joined #openstack-infra09:56
*** smarcet has quit IRC09:57
*** ijw_ has quit IRC09:57
*** bobh has quit IRC09:59
*** jtomasek has joined #openstack-infra10:00
*** bobh has joined #openstack-infra10:00
*** e0ne has joined #openstack-infra10:01
*** jtomasek has quit IRC10:01
*** bobh has quit IRC10:02
*** smarcet has joined #openstack-infra10:03
*** lbragstad has quit IRC10:04
*** longkb has quit IRC10:06
*** yamamoto has joined #openstack-infra10:08
*** electrofelix has joined #openstack-infra10:11
*** yamamoto has quit IRC10:17
*** ramishra_ has joined #openstack-infra10:18
*** yamamoto has joined #openstack-infra10:19
*** ramishra has quit IRC10:20
*** owalsh_ is now known as owalsh10:27
*** yamamoto has quit IRC10:28
*** slaweq_ has joined #openstack-infra10:29
*** psachin has quit IRC10:36
*** smarcet has quit IRC10:37
*** e0ne has quit IRC10:38
*** slaweq_ has quit IRC10:39
*** smarcet has joined #openstack-infra10:39
*** carl_cai has quit IRC10:41
*** shardy has joined #openstack-infra10:43
*** janki has joined #openstack-infra10:43
*** lbragstad has joined #openstack-infra10:44
*** ccamacho has quit IRC10:47
*** psachin has joined #openstack-infra10:47
openstackgerritChris Hoge proposed openstack-infra/project-config master: Add new documentation project for The Four Opens  https://review.openstack.org/61700510:49
*** ifat_afek has joined #openstack-infra10:52
*** ifat_afek has quit IRC10:59
*** smarcet has quit IRC11:00
*** florianf|afk is now known as florianf|summit11:00
*** apetrich has joined #openstack-infra11:02
*** electrofelix has quit IRC11:03
*** shrasool has joined #openstack-infra11:03
*** shrasool has quit IRC11:05
*** smarcet has joined #openstack-infra11:07
openstackgerritChandan Kumar proposed openstack-infra/elastic-recheck master: Add query for ssh timeout in tempest scenario for bug 1802971  https://review.openstack.org/61757911:07
openstackbug 1802971 in tripleo "tempest volume_boot_pattern and basic_ops running concurrently causing timeouts" [Critical,Triaged] https://launchpad.net/bugs/180297111:07
openstackgerritClark Boylan proposed openstack-infra/zuul-website-media master: Add Zuul poster/page pdf  https://review.openstack.org/61758111:07
*** electrofelix has joined #openstack-infra11:13
*** panda|rover|lch is now known as panda|rover11:13
*** chkumar|ruck has quit IRC11:14
*** chandankumar has joined #openstack-infra11:15
*** chandankumar is now known as chkumar|ruck11:15
*** dkehn has quit IRC11:17
*** smarcet has quit IRC11:17
openstackgerritMerged openstack-infra/zuul-website-media master: Add Zuul poster/page pdf  https://review.openstack.org/61758111:18
*** shrasool has joined #openstack-infra11:19
*** shrasool has quit IRC11:20
*** smarcet has joined #openstack-infra11:20
*** smarcet has quit IRC11:21
*** shardy has quit IRC11:24
*** apetrich has quit IRC11:26
*** bnemec has joined #openstack-infra11:26
*** smarcet has joined #openstack-infra11:27
*** smarcet has quit IRC11:28
*** mriedem has quit IRC11:28
*** coolsvap has quit IRC11:30
*** ykarel_ has joined #openstack-infra11:30
*** lbragstad has quit IRC11:32
*** ifat_afek has joined #openstack-infra11:33
*** ykarel has quit IRC11:33
*** bnemec has quit IRC11:35
*** chkumar has joined #openstack-infra11:36
*** chkumar|ruck has quit IRC11:37
*** chkumar is now known as chkumar|ruck11:37
*** dave-mccowan has quit IRC11:39
*** lbragstad has joined #openstack-infra11:40
*** ykarel_ is now known as ykarel11:45
*** smarcet has joined #openstack-infra11:52
*** lbragstad has quit IRC11:52
*** lbragstad has joined #openstack-infra11:53
*** ccamacho has joined #openstack-infra12:04
*** lbragstad has quit IRC12:09
*** lbragstad has joined #openstack-infra12:12
*** lbragstad has quit IRC12:12
*** bobh has joined #openstack-infra12:22
*** rh-jelabarre has joined #openstack-infra12:24
*** mriedem has joined #openstack-infra12:24
*** rh-jelabarre has quit IRC12:25
*** ccamacho has quit IRC12:26
*** rh-jelabarre has joined #openstack-infra12:26
*** ccamacho has joined #openstack-infra12:26
*** ccamacho has quit IRC12:28
*** ccamacho has joined #openstack-infra12:29
*** apetrich has joined #openstack-infra12:29
*** bnemec has joined #openstack-infra12:33
*** ccamacho has quit IRC12:33
*** ccamacho has joined #openstack-infra12:33
*** ifat_afek has quit IRC12:35
*** ifat_afek has joined #openstack-infra12:36
openstackgerritJeremy Stanley proposed openstack-infra/zuul-website master: Link the overview brochure from the splash page  https://review.openstack.org/61762312:38
*** ccamacho has quit IRC12:38
clarkbmordred[m]: were you going to join the openapi session? starts in a minute12:39
*** jpena is now known as jpena|lunch12:40
*** yamamoto has joined #openstack-infra12:42
*** smarcet has joined #openstack-infra12:43
*** bobh has quit IRC12:44
*** yamamoto has quit IRC12:46
*** arxcruz is now known as arxcruz|summit\12:47
*** apetrich has quit IRC12:47
*** arxcruz|summit\ is now known as arxcruz|summit12:48
*** smarcet has quit IRC12:48
*** yamamoto has joined #openstack-infra12:50
fungilots of assertions about being able to use openapi to generate sdks12:55
fungimordred is missing all the fun12:55
clarkbbut its also a presentation so far, so not much discussion12:55
openstackgerritJames E. Blair proposed openstack-infra/zuul-website master: Alter brochure link  https://review.openstack.org/61763112:56
*** e0ne has joined #openstack-infra12:56
*** e0ne has quit IRC12:57
openstackgerritJames E. Blair proposed openstack-infra/zuul-website master: Switch brochure link to h4  https://review.openstack.org/61763212:57
*** smarcet has joined #openstack-infra12:57
*** e0ne has joined #openstack-infra12:58
*** ykarel_ has joined #openstack-infra12:59
*** bobh has joined #openstack-infra12:59
*** derekh has quit IRC13:00
*** ykarel has quit IRC13:02
*** ykarel_ is now known as ykarel13:05
openstackgerritAndreas Jaeger proposed openstack-infra/zuul-website master: Add some "."  https://review.openstack.org/61763413:06
*** boden has joined #openstack-infra13:08
*** dhill_ has joined #openstack-infra13:09
*** e0ne has quit IRC13:10
*** dave-mccowan has joined #openstack-infra13:11
openstackgerritJeremy Stanley proposed openstack-infra/zuul-website master: Reduce vertical spacing between video and brochure  https://review.openstack.org/61763913:21
openstackgerritMerged openstack-infra/zuul-website master: Link the overview brochure from the splash page  https://review.openstack.org/61762313:23
openstackgerritMerged openstack-infra/zuul-website master: Alter brochure link  https://review.openstack.org/61763113:23
openstackgerritMerged openstack-infra/zuul-website master: Add some "."  https://review.openstack.org/61763413:23
*** rlandy has joined #openstack-infra13:27
*** bobh has quit IRC13:29
*** bnemec has quit IRC13:29
*** dave-mccowan has quit IRC13:31
*** bobh has joined #openstack-infra13:34
*** aojea has joined #openstack-infra13:36
*** dkehn has joined #openstack-infra13:36
*** apetrich has joined #openstack-infra13:38
*** yamamoto has quit IRC13:39
*** yamamoto has joined #openstack-infra13:39
*** jpena|lunch is now known as jpena13:40
*** yamamoto has quit IRC13:41
*** yamamoto has joined #openstack-infra13:42
*** janki has quit IRC13:44
openstackgerritMatt Riedemann proposed openstack-infra/elastic-recheck master: Add query for cinder backup timeout bug 1483434  https://review.openstack.org/61765513:45
openstackbug 1483434 in Cinder "VolumesBackupsV2Test:test_volume_backup_create_get_detailed_list_restore_delete times out waiting to restore volume" [Medium,Confirmed] https://launchpad.net/bugs/148343413:45
*** ifat_afek has quit IRC13:51
*** dave-mccowan has joined #openstack-infra13:53
*** yamamoto has quit IRC13:53
*** hamzy has quit IRC13:55
*** yamamoto has joined #openstack-infra13:55
*** yamamoto has quit IRC13:59
openstackgerritMerged openstack-infra/elastic-recheck master: Add query for cinder backup timeout bug 1483434  https://review.openstack.org/61765514:02
openstackbug 1483434 in Cinder "VolumesBackupsV2Test:test_volume_backup_create_get_detailed_list_restore_delete times out waiting to restore volume" [Medium,Confirmed] https://launchpad.net/bugs/148343414:02
*** yamamoto has joined #openstack-infra14:02
*** spsurya has joined #openstack-infra14:03
*** pbourke has quit IRC14:03
*** pbourke has joined #openstack-infra14:03
openstackgerritMatt Riedemann proposed openstack-infra/openstack-zuul-jobs master: Add grenade-py3 job to integrated-gate-py35 template  https://review.openstack.org/61766214:04
*** yamamoto has quit IRC14:04
*** yamamoto has joined #openstack-infra14:06
*** apetrich has quit IRC14:06
*** ifat_afek has joined #openstack-infra14:08
*** ifat_afek has left #openstack-infra14:09
mriedemwhere is the "queue: integrated" defined that i'm seeing in project-config? i'm not seeing it in openstack-zuul-jobs.14:09
mriedemsearching for "name: integrated" isn't helping me on openstack.o.o14:09
*** bobh has quit IRC14:10
*** dave-mccowan has quit IRC14:10
*** yamamoto has quit IRC14:11
*** yamamoto has joined #openstack-infra14:13
corvusmriedem: that's it -- it's nothing more than multiple projects having the same string in that field14:15
*** udesale has quit IRC14:16
corvusmriedem: so every project with 'integrated' set as the queue name is in that shared queue14:17
corvusmriedem: there's a separate, but similar concept in that there is a project-template that all the integrated projects have which defines a set of jobs they should all run14:17
*** chkumar|ruck has quit IRC14:17
*** yamamoto has quit IRC14:18
*** yamamoto_ has joined #openstack-infra14:18
*** yamamoto_ has quit IRC14:18
*** yamamoto has joined #openstack-infra14:18
corvusor at least there used to be, i haven't kept up with that14:19
mriedemright that's what i'm looking for, where the integrated-gate(-py35) template is getting used14:20
openstackgerritJeremy Stanley proposed openstack-infra/zuul-website master: Reduce vertical spacing between video and brochure  https://review.openstack.org/61763914:20
mriedemoh nvm i see,14:21
mriedemit's in nova's .zuul.yaml now14:21
mriedemused to be in project-config but that's all moving to the projects, i knew this, just haven't looked in awhile14:22
*** bobh has joined #openstack-infra14:22
*** yamamoto has quit IRC14:23
*** bobh has quit IRC14:25
mriedemdid the devstack move to bionic already happen?14:29
mriedemnvm14:29
*** agopi|brb is now known as agopi14:29
clarkbmriedem: I don't think so14:30
clarkb(just based on looking at node usage in nodepool)14:30
*** rossella_s has joined #openstack-infra14:31
mriedemyeah nvm looking at https://bugs.launchpad.net/devstack-plugin-ceph/+bug/1803143 but it's on xenial nodes14:32
openstackLaunchpad bug 1803143 in devstack-plugin-ceph "devstack-plugin-ceph-tempest fails with "ImportError: cannot import name deploy"" [Undecided,New]14:32
mriedemusually ceph jobs failing with paste is a distro-specific issue14:32
*** derekh has joined #openstack-infra14:32
*** udesale has joined #openstack-infra14:33
*** e0ne has joined #openstack-infra14:34
*** ykarel has quit IRC14:38
*** ykarel has joined #openstack-infra14:39
*** yamamoto has joined #openstack-infra14:39
*** bobh has joined #openstack-infra14:40
*** markmcd has quit IRC14:40
*** ykarel_ has joined #openstack-infra14:41
*** ykarel has quit IRC14:44
openstackgerritMerged openstack-infra/project-config master: Add new documentation project for The Four Opens  https://review.openstack.org/61700514:48
*** ykarel__ has joined #openstack-infra14:52
*** ykarel_ has quit IRC14:55
*** yamamoto_ has joined #openstack-infra14:56
*** yamamoto_ has quit IRC14:56
*** yamamoto has quit IRC14:56
*** jistr is now known as jistr|mtg14:57
*** mriedem has quit IRC14:57
*** yamamoto has joined #openstack-infra14:58
openstackgerritDavid Moreau Simard proposed openstack-infra/zuul-website master: Reduce padding to remove extraneous whitespace  https://review.openstack.org/61768014:58
*** yamamoto has quit IRC14:59
*** ykarel__ is now known as ykarel15:03
*** bnemec has joined #openstack-infra15:04
*** ykarel is now known as ykarel|away15:05
*** e0ne has quit IRC15:05
*** bnemec has quit IRC15:10
openstackgerritDavid Moreau Simard proposed openstack-infra/zuul-website master: Reduce padding to remove extraneous whitespace  https://review.openstack.org/61768015:10
*** yamamoto has joined #openstack-infra15:12
openstackgerritTobias Henkel proposed openstack-infra/zuul master: Convert zuul_return into action plugin  https://review.openstack.org/59116815:14
*** mriedem has joined #openstack-infra15:16
openstackgerritTobias Henkel proposed openstack-infra/zuul master: Convert zuul_return into action plugin  https://review.openstack.org/59116815:20
*** bobh has quit IRC15:23
*** ccamacho has joined #openstack-infra15:24
*** apetrich has joined #openstack-infra15:27
*** rossella_s has quit IRC15:33
*** apetrich has quit IRC15:35
*** yamamoto has quit IRC15:36
*** psachin has quit IRC15:38
*** quiquell is now known as quiquell|off15:38
*** yamamoto has joined #openstack-infra15:39
openstackgerritJames E. Blair proposed openstack-infra/nodepool master: Move k8s install to pre playbook  https://review.openstack.org/61769915:39
corvusSpamapS: this is probably not your highest priority, but it just wanted to draw your attention to my -1 on //review.openstack.org/612824 which may be masked in the gerrit/gertty ui by a +2 from tobiash15:44
*** efried has joined #openstack-infra15:45
tobiashRemoved the masking +2 now ;)15:46
*** aojeagarcia has joined #openstack-infra15:48
*** armax has joined #openstack-infra15:50
*** efried has quit IRC15:50
corvustobiash: i think we can drop the reno from https://review.openstack.org/61626215:50
corvusotherwise lgtm15:51
tobiashcorvus: Shrews wanted reno, I'm happy either way :)15:52
*** aojea has quit IRC15:53
corvushrm.  well, i'm very much opposed to considering the zk api public.  i could see it if we were doing an upgrade.  i mostly don't want to give the impression that anyone should go and use this data.  i think release notes should only be included if they might possibly cause a user to do something.15:54
*** ccamacho has quit IRC15:54
corvustobiash: i guess since you say it's for zuul, maybe it's okay.  but let's try to get on the same page when Shrews gets back.15:55
*** jistr|mtg is now known as jistr15:59
*** gyee has joined #openstack-infra16:00
*** quiquell|off is now known as quiquell16:00
*** aojeagarcia has quit IRC16:01
*** aojeagarcia has joined #openstack-infra16:01
corvusfungi, dmsimard see comments on 61768016:02
*** yamamoto has quit IRC16:02
dmsimardcorvus: oh, wasn't aware, I'll try and figure that out -- thanks16:02
*** quiquell is now known as quiquell|off16:04
dmsimardcorvus: so do we edit both, then ? or how does that work16:04
corvusdmsimard: i've been editing the scss and compiling.  with... something.16:04
corvusprobably 'scss'16:04
dmsimard"sass", okay16:05
*** bnemec has joined #openstack-infra16:06
*** aojeagarcia has quit IRC16:11
*** spsurya has quit IRC16:12
openstackgerritTristan Cacqueray proposed openstack-infra/zuul master: Add allowed-triggers and allowed-reporters tenant settings  https://review.openstack.org/55408216:16
*** efried has joined #openstack-infra16:17
*** yamamoto has joined #openstack-infra16:18
*** smarcet has quit IRC16:19
*** ifat_afek has joined #openstack-infra16:20
*** bnemec has quit IRC16:23
*** mriedem has quit IRC16:25
*** ykarel_ has joined #openstack-infra16:27
*** ykarel|away has quit IRC16:30
*** ramishra_ has quit IRC16:32
openstackgerritTristan Cacqueray proposed openstack-infra/zuul master: Add allowed-triggers and allowed-reporters tenant settings  https://review.openstack.org/55408216:34
*** armax has quit IRC16:36
*** yamamoto has quit IRC16:38
*** irclogbot_1 has joined #openstack-infra16:40
*** irclogbot_1 has quit IRC16:43
openstackgerritTristan Cacqueray proposed openstack-infra/zuul master: Add allowed-labels tenant setting  https://review.openstack.org/61774016:49
*** d0ugal has quit IRC16:57
*** ginopc has quit IRC17:01
*** efried has quit IRC17:06
*** agopi is now known as agopi|food17:12
*** jpich has quit IRC17:19
*** ijw has joined #openstack-infra17:22
*** jpich has joined #openstack-infra17:25
*** udesale has quit IRC17:25
*** bobh has joined #openstack-infra17:28
*** ykarel_ is now known as ykarel|pto17:36
*** jtomasek has joined #openstack-infra17:41
*** apetrich has joined #openstack-infra17:41
*** jpich has quit IRC17:46
*** jtomasek has quit IRC17:51
*** trown is now known as trown|lunch17:56
*** ykarel|pto has quit IRC17:59
*** derekh has quit IRC18:00
*** ianychoi has quit IRC18:00
*** ianychoi has joined #openstack-infra18:01
*** e0ne has joined #openstack-infra18:05
*** ifat_afek has quit IRC18:06
*** jpena is now known as jpena|off18:07
*** slaweq_ has joined #openstack-infra18:09
*** slaweq has quit IRC18:10
*** apetrich has quit IRC18:11
*** apetrich has joined #openstack-infra18:11
*** panda|rover is now known as panda|off18:11
openstackgerritzhouxinyong proposed openstack/os-testr master: Advancing the protocal of the website to HTTPS in generate_subunit.rst.  https://review.openstack.org/61776718:16
*** mtreinish has quit IRC18:23
*** mtreinish has joined #openstack-infra18:23
*** armax has joined #openstack-infra18:25
*** rkukura has quit IRC18:27
*** bobh has quit IRC18:29
*** e0ne has quit IRC18:30
*** fuentess has joined #openstack-infra18:36
*** smarcet has joined #openstack-infra18:38
*** gyee has quit IRC18:38
*** ralonsoh has quit IRC18:40
*** emerson has quit IRC18:49
*** emerson has joined #openstack-infra18:52
*** electrofelix has quit IRC19:01
*** rkukura has joined #openstack-infra19:04
*** phausman has quit IRC19:05
*** bobh has joined #openstack-infra19:08
*** bobh has quit IRC19:08
*** agopi|food is now known as agopi19:09
*** irclogbot_1 has joined #openstack-infra19:10
*** bobh has joined #openstack-infra19:11
*** trown|lunch is now known as trown19:25
*** kjackal has quit IRC19:26
*** smarcet has quit IRC19:27
*** kjackal has joined #openstack-infra19:27
SpamapScorvus: thanks for the tip, I'll revisit soon.19:31
*** apetrich has quit IRC19:36
*** kjackal has quit IRC19:40
*** kjackal has joined #openstack-infra19:40
*** rkukura has quit IRC19:49
openstackgerritTristan Cacqueray proposed openstack-infra/zuul master: Add allowed-labels tenant setting  https://review.openstack.org/61774019:49
*** apetrich has joined #openstack-infra19:49
*** armax has quit IRC20:03
*** bobh has quit IRC20:08
*** armax has joined #openstack-infra20:08
*** irclogbot_1 has quit IRC20:09
*** irclogbot_1 has joined #openstack-infra20:12
*** bobh has joined #openstack-infra20:12
*** bobh has quit IRC20:12
*** bobh has joined #openstack-infra20:13
*** yamamoto has joined #openstack-infra20:24
*** smarcet has joined #openstack-infra20:27
*** shrasool has joined #openstack-infra20:34
*** rkukura has joined #openstack-infra20:34
*** aojea has joined #openstack-infra20:36
*** smarcet has quit IRC20:37
*** ssbarnea|bkp2 has joined #openstack-infra20:42
*** ssbarnea has quit IRC20:42
*** yamamoto has quit IRC21:00
*** ijw has quit IRC21:07
*** rkukura has quit IRC21:18
*** d0ugal has joined #openstack-infra21:23
*** d0ugal has quit IRC21:24
*** d0ugal has joined #openstack-infra21:24
*** bobh has quit IRC21:24
*** aojea has quit IRC21:44
*** jtomasek has joined #openstack-infra21:49
*** jtomasek has quit IRC21:50
*** rkukura has joined #openstack-infra21:52
*** pcaruana has quit IRC21:56
*** aojea has joined #openstack-infra22:07
*** panda|off has quit IRC22:09
*** kukacz has quit IRC22:09
*** kukacz has joined #openstack-infra22:10
*** panda has joined #openstack-infra22:10
*** trown is now known as trown|outtypewww22:11
*** aojea has quit IRC22:14
*** rlandy is now known as rlandy|brb22:16
*** florianf|summit is now known as florianf|afk22:16
EmilienM2018-11-13 21:08:47.546641 | primary | Download error on http://mirror.iad.rax.openstack.org/pypi/simple/pbr/: timed out -- Some packages may not be found!22:16
EmilienMsome issues with RAX FYI22:16
*** aojea has joined #openstack-infra22:17
*** aojea has quit IRC22:17
*** yamamoto has joined #openstack-infra22:22
clarkbEmilienM: couod be an issue with pyoi22:23
clarkb*pypi22:23
clarkbthat is a proxy now and it cant cache those indexes22:23
*** slaweq_ has quit IRC22:25
*** slaweq has joined #openstack-infra22:25
*** yamamoto has quit IRC22:27
EmilienMnot just pypi22:27
EmilienMhttp://logs.openstack.org/01/611801/13/gate/tripleo-ci-centos-7-scenario000-multinode-oooq-container-updates/0a261bd/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz#_2018-11-13_09_58_1722:27
EmilienMrpm mirrors too22:27
EmilienMalso http://mirror.regionone.limestone.openstack.org:808022:30
EmilienM404 issues22:30
*** ijw has joined #openstack-infra22:31
*** sshnaidm is now known as sshnaidm|pto22:34
*** e0ne has joined #openstack-infra22:34
*** kaisers has quit IRC22:35
ianwEmilienM: hrm, logging in ...22:37
EmilienMwe got a bunch of infra issues at this time, causing our gate to timeout22:39
ianwEmilienM: hrm, well "cat mirror01.iad.rax.openstack.org_8080_access.log | grep 2018:21:08 | grep pbr" on the iad.rax mirror shows that it didn't process any requests for that url at 21:08:4722:43
ianw(we really should fixup the apache timestamps so they don't use that silly non-iso format)22:43
ianwwhich suggests the request didn't get to the mirror ...22:43
fungiinternal connectivity issues in both rackspace's washington dc region and limestone in texas would be... odd22:44
ianw"FAILED! => {"changed": false, "msg": "http://mirror.iad.rax.openstack.org:8080/rdo/centos7-master/deps/latest/noarch/puppet-5.5.6-1.el7.noarch.rpm: [Errno 14] HTTP Error 404 - Not Found"22:45
ianwthat particular one, really must be the remote end returning a 40422:45
*** boden has quit IRC22:46
ianwEmilienM: can you point me to the logs for the 2018-11-13 21:08:47.546641 failure?22:47
*** rlandy|brb is now known as rlandy22:47
EmilienMwe have a patch that we'll need to be promoted into the gate at the top if you can22:47
EmilienMianw: all links are on #triploe22:47
EmilienM#tripleo22:47
ianwok, reading now :)22:50
*** shrasool has quit IRC22:51
*** e0ne has quit IRC22:55
*** auristor has quit IRC22:59
*** gyee has joined #openstack-infra23:01
*** fuentess has quit IRC23:06
*** auristor has joined #openstack-infra23:09
ianwEmilienM: hrm, ok, found i think a smoking gun for the rax issues23:15
ianw[Tue Nov 13 21:08:32.545808 2018] [cache_disk:error] [pid 9573:tid 139755123623680] (2)No such file or directory: [client 162.242.218.207:44058] AH00708: Cannot open data file /var/cache/apache2/proxy/zE/ud/ui/DB/Ln/IaA7GODoY1Zw.header.vary/Uh/SH/fw/5E/x3/s_WTNPazjkqw.data23:15
ianwright at the same time as http://logs.openstack.org/03/616203/9/gate/tripleo-ci-centos-7-containers-multinode/099c730/job-output.txt.gz#_2018-11-13_21_08_31_97086323:15
ianwi don't know why that is in mirror01.iad.rax.openstack.org_error.log and not the 8080 mirror log?23:17
ianwohhh, pypi isn't on 8080.  my mistake23:18
*** yamamoto has joined #openstack-infra23:19
ianwcat mirror01.iad.rax.openstack.org_error.log | grep 'Nov 13' | grep cache_disk | wc -l23:19
ianw252823:19
ianwoh dear ... if that means we're resetting so many jobs ...23:20
*** florianf|afk has quit IRC23:23
fungicorruption on the cinder volume? or did it fill up?23:24
ianwfungi: great minds, just looking at that23:24
* fungi should probably be sleeping by now23:24
*** yamamoto has quit IRC23:24
ianw /dev/mapper/main-proxycache   99G   72G   22G  77% /var/cache/apache2 ... plenty of space23:24
ianwand nothing in dmesg23:24
ianwthis is not a common error in google, suggesting it's something odd23:25
fungii suppose apache could have somehow written a corrupt cachefile23:25
ianw[Tue Nov 13 23:20:34.669043 2018] [proxy_http:error] [pid 9639:tid 139755048089344] (104)Connection reset by peer: [client 104.239.175.102:39610] AH01102: error reading status line from remote server pypi.org:44323:26
ianw[Tue Nov 13 23:20:36.436768 2018] [cache_disk:error] [pid 9573:tid 139754980947712] (2)No such file or directory: [client 104.239.175.102:39614] AH00708: Cannot open data file /var/cache/apache2/proxy/zE/ud/ui/DB/Ln/IaA7GODoY1Zw.header.vary/Uh/SH/fw/5E/x3/s_WTNPazjkqw.data23:26
ianwhrm, that's oddly correlated23:26
ianwtailing the logs, it's happening quite a bit23:27
ianwdfw has similar things23:29
ianwmirror02.limestone.regionone too ... maybe it's a red herring message23:30
ianwok, so we're seeing something like "Cannot open data file /var/cache/apache2/proxy/zE/ud/ui/DB/Ln/IaA7GODoY1Zw.header.vary/Uh/SH/fw/5E/x3/s_WTNPazjkqw.data"23:41
ianwI have been stracing htcacheclean and it has not removed that file, so we can rule out that i think23:42
ianwthis file ... /var/cache/apache2/proxy/zE/ud/ui/DB/Ln/IaA7GODoY1Zw.header.vary/Uh/SH/fw/5E/x3/s_WTNPazjkqw.header23:54
ianwis clearly reltaed to pbr on pypi ... http://paste.openstack.org/show/734797/23:55
*** kjackal has quit IRC23:56
*** emerson has quit IRC23:57
*** yamamoto has joined #openstack-infra23:57

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!